-- Logs begin at Sat 2022-07-30 20:01:15 UTC, end at Sat 2022-07-30 22:32:22 UTC. -- Jul 30 20:43:01.163246 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Jul 30 20:43:01.173174 ncdv-master-1 devstack@keystone.service[91075]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 30 20:43:01.175332 ncdv-master-1 devstack@keystone.service[91075]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jul 30 20:43:01 2022] *** Jul 30 20:43:01.175332 ncdv-master-1 devstack@keystone.service[91075]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 30 20:43:01.175332 ncdv-master-1 devstack@keystone.service[91075]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 30 20:43:01.175332 ncdv-master-1 devstack@keystone.service[91075]: nodename: ncdv-master-1 Jul 30 20:43:01.175332 ncdv-master-1 devstack@keystone.service[91075]: machine: x86_64 Jul 30 20:43:01.175332 ncdv-master-1 devstack@keystone.service[91075]: clock source: unix Jul 30 20:43:01.175332 ncdv-master-1 devstack@keystone.service[91075]: pcre jit disabled Jul 30 20:43:01.175332 ncdv-master-1 devstack@keystone.service[91075]: detected number of CPU cores: 4 Jul 30 20:43:01.175332 ncdv-master-1 devstack@keystone.service[91075]: current working directory: / Jul 30 20:43:01.175332 ncdv-master-1 devstack@keystone.service[91075]: detected binary path: /usr/bin/uwsgi-core Jul 30 20:43:01.175332 ncdv-master-1 devstack@keystone.service[91075]: your processes number limit is 47680 Jul 30 20:43:01.175332 ncdv-master-1 devstack@keystone.service[91075]: your memory page size is 4096 bytes Jul 30 20:43:01.176023 ncdv-master-1 devstack@keystone.service[91075]: detected max file descriptor number: 2048 Jul 30 20:43:01.176023 ncdv-master-1 devstack@keystone.service[91075]: lock engine: pthread robust mutexes Jul 30 20:43:01.176023 ncdv-master-1 devstack@keystone.service[91075]: thunder lock: enabled Jul 30 20:43:01.176023 ncdv-master-1 devstack@keystone.service[91075]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 30 20:43:01.176023 ncdv-master-1 devstack@keystone.service[91075]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 30 20:43:01.220869 ncdv-master-1 devstack@keystone.service[91075]: Python main interpreter initialized at 0x55dd463989c0 Jul 30 20:43:01.220869 ncdv-master-1 devstack@keystone.service[91075]: python threads support enabled Jul 30 20:43:01.220869 ncdv-master-1 devstack@keystone.service[91075]: your server socket listen backlog is limited to 100 connections Jul 30 20:43:01.220869 ncdv-master-1 devstack@keystone.service[91075]: your mercy for graceful operations on workers is 90 seconds Jul 30 20:43:01.221194 ncdv-master-1 devstack@keystone.service[91075]: mapped 403077 bytes (393 KB) for 2 cores Jul 30 20:43:01.221316 ncdv-master-1 devstack@keystone.service[91075]: *** Operational MODE: preforking *** Jul 30 20:43:01.221540 ncdv-master-1 devstack@keystone.service[91075]: *** uWSGI is running in multiple interpreter mode *** Jul 30 20:43:01.221540 ncdv-master-1 devstack@keystone.service[91075]: spawned uWSGI master process (pid: 91075) Jul 30 20:43:01.221731 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. Jul 30 20:43:01.222560 ncdv-master-1 devstack@keystone.service[91075]: spawned uWSGI worker 1 (pid: 91085, cores: 1) Jul 30 20:43:01.223338 ncdv-master-1 devstack@keystone.service[91075]: spawned uWSGI worker 2 (pid: 91086, cores: 1) Jul 30 20:43:01.223338 ncdv-master-1 devstack@keystone.service[91075]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 30 20:43:06.965297 ncdv-master-1 devstack@keystone.service[91086]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 20:43:06.965297 ncdv-master-1 devstack@keystone.service[91086]: from cryptography.utils import int_from_bytes Jul 30 20:43:06.966099 ncdv-master-1 devstack@keystone.service[91086]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 20:43:06.966099 ncdv-master-1 devstack@keystone.service[91086]: from cryptography.utils import int_from_bytes Jul 30 20:43:06.967465 ncdv-master-1 devstack@keystone.service[91085]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 20:43:06.967465 ncdv-master-1 devstack@keystone.service[91085]: from cryptography.utils import int_from_bytes Jul 30 20:43:06.967927 ncdv-master-1 devstack@keystone.service[91085]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 20:43:06.967927 ncdv-master-1 devstack@keystone.service[91085]: from cryptography.utils import int_from_bytes Jul 30 20:43:07.016810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 30 20:43:07.017029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 30 20:43:07.017205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] command line args: [] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 30 20:43:07.017480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 30 20:43:07.017660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ================================================================================ {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 30 20:43:07.017916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] admin_token = **** {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.018163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] config_dir = [] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.018241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 30 20:43:07.018351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.018435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 30 20:43:07.018546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] config_source = [] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.018635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] command line args: [] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 30 20:43:07.018721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] debug = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.018874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 30 20:43:07.018953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.020380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ================================================================================ {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 30 20:43:07.020467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.020533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] admin_token = **** {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.020591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.020647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] config_dir = [] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.020709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.020771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.020771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] config_source = [] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.020890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.020953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] debug = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.021016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] list_limit = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.021078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.021167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] log_config_append = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.021167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.021274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.021331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] log_dir = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.021386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.021448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] log_file = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.021510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.021571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.021628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.021688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.021745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] list_limit = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.021806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.021863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] log_config_append = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.021863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.021960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.022018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] log_dir = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.022078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.022143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] log_file = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.022201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.022256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.022316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.022880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.023055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.023055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.023524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.023687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.023876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.023876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.024266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.024495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.024664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.024859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.025049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.025242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.025471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.025649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.025881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.026053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.026053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.026414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.026636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.026804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] publish_errors = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.026993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.027187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.027423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.027592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.027592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.027900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.028041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.028041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.028327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.028486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] standard_threads = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.028622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] publish_errors = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.028746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.028887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.029022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.029182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.029314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.029438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.029703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] use_journal = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.029859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.030006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] use_json = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.030006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] use_stderr = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.030248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.030373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] use_syslog = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.030537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] standard_threads = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.030697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.030826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.030950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.031075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.031199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.031362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.031362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] use_journal = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.031605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.031729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] use_json = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.031869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.032003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] use_stderr = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.032003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] use_syslog = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.032246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.032376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:43:07.032501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.032624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.032757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.032881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.033042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.033172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.033303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.033429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.033562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.033703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.033828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.033952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.034083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.034208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.034344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.034469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.034593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.034716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.034840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.034962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.035109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.035237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.035432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.035567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.035692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.035816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.036012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.036145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.036270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.036401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.036526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.036649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.036782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.036914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.037045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.037186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.037311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.037435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.037567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.037697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.037822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.037945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.038068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.038068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.038314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.038440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.038563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.038686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.038808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.039169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.039345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.039480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.039619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.039619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.039860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.039984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.040120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.040246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.040370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.040499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.040626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.040758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.041396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.041524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.041650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.041774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.041904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.042037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.042162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.042286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.042410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.042533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.042662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.042861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.042989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.043158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.043331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.043464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.043589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.043725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.043851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.043975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.044098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.044221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.044345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.044477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.044602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.044725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.044850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.044984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.045108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.045239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.045239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.045482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.045482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.045722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.045722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.045971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.045971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.046205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.046336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.046460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.046614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.046762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.046889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.047019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.047152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.047276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.047435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.047574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.047708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.047833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.047959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.048082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.048207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.048344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.048488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.048616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.048749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.048881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.049008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.049133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.049267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.049392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.049529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.049659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.049797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.049923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.050050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.050192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.050192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.050430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.050561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.050687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.050811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.050945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.050945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.051190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.051366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.051498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.051624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.051761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.051888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.052029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.052156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.052280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.052417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.052542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.052674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.052799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.052924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.053048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.053220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.053352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.053477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.053601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.053726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.053861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.053995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.054121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.054246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.054371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.054496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.054685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.054825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.054959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.055091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.055217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.055373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.055501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.055714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.055842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.055967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.056092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.056217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.056341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.056475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.057220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.057328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.057408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.057482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.057562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.057635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.057706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.057790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.057865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.057936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.058007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.058085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.058159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.058239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.058313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.058385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.058455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.058527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.058598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.058681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.058755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.058826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] auth.external = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.058897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.058968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.059040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.059119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.059200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.059273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.059386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.059460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] auth.password = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.059546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.059648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] auth.token = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.059731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] auth.external = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.059814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.059889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.059960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.060031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.060103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.060185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.060259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.060337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] auth.password = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.060418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.060500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] auth.token = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.060580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.060661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.060743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.060817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.060889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] credential.caching = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.060961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.061032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.061111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.061186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.061258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.061338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.061412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.061483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.061563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.061637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.061710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] credential.caching = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.061781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.061864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.061946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.062028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.062109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.062189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.062261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.062333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.062404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.062487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.062561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.062633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.062704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.062775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.062846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.062925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.062999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.063071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.063142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.063213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.063280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] federation.caching = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.063384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.063460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.063532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.063604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.063675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.063745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.063828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.063903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.063981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.064054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.064126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] federation.caching = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.064197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.064277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.064351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.064423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.064500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.064572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.064643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.064723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.064797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.064869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.064941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.065012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.065083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] identity.caching = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.065165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.065246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.065320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.065391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.065463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.065534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.065686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.065763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.065836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.065907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.065978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] identity.caching = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.066049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.066049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.066268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.066352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.066425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.066425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.066567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.066643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.066714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.066714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.066854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.066925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.067005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.067084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.067157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.067235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.067335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.067411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.067495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.067571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.067643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.067643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.067779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.067853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.067933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.068007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.068078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.068150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.068221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.068292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.068372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.068372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.068503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.068575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.068646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.068718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.068798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.068873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.068945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.069017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.069096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.069262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.069354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.069497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.069580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.069748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.069830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.069987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.070076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.070235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.070323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.070476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.070557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.070723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.070811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.070959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.071038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.071197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.071275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.071456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.071549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.071699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.071779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.071941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.072033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.072220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.072311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.072455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.072537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.072693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.072771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.072925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.073017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.073169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.073655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.073729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.073802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.073879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.073962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.074037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.074108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.074262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.074342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.074517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.074605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.074771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.074851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.075016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.075102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.075254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.075369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.075515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.user = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.075595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.075759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.075837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.076000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.076088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.076241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.076319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.076475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.user = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.076553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.076729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.076819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.076981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.077060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.077216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.077300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.077446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.077525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.077684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.077763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.077920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.077999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.078160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.078240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.078394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.078473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.078629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.078706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.078873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.078953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.079116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.079195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.079375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.079459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.079626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.079706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.079859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.079946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.080107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.080186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.080347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.080428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.080585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.080663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.080818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.080896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.081052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.081132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.081297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.081375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.081543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.081630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.081778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.081858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.082020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.082098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.082253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.082337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.082501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.082582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.082741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.082819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.082977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.083056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.083215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.083362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.083488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.083567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.083730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.083808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.083967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.084048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.084203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.084277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.084444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] resource.caching = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.084522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.084697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.084798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.084933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.085021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.085171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.085249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.085414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] resource.caching = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.085493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.085664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.085759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.085904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.085983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.086141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.086220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.086380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.086457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.086622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.086701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.086853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] role.caching = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.086930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.087096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] role.driver = sql {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.087176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.087354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.087438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.087599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.087679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.087866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] role.caching = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.087945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.088120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] role.driver = sql {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.088198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.088356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.088437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.088603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.088681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.088853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.088932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.089101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.089183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.089353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.089431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.089585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.089671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.089836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.089916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.090085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.090163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.090333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.090419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.090566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.090644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.090818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.090967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.091054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.091206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.091325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.091486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.091590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.091740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.091986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.092078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.092229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.092308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.092461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.092539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.092721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.092829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.092972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.093057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.093210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.093288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.093443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.093535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.093676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.093756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.093908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.093987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.094164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.094249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.094394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.094473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.094641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.094719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.094876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.094964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.095126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.095204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.095383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.095468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.095623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] token.caching = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.095705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.095861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.095940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.096104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.096183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.096341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.096423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.096583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] token.caching = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.096662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.096825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.096905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.097062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.097142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.097308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.097388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.097553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.097632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.097806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.097887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.098044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.098122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.098287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.098365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.098537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.098617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.098792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.098871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.099034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.099113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.099278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.099372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.099538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.099617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.099790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.099869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.100044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.100126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] database.connection = **** {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.100278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.100368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.100536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.100620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.100794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.100873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.101039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.101120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] database.connection = **** {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.101278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.101367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.101517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.101597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.101756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.101843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.101995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.102074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.102241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.102320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.102476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.102563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.102716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.102802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.102949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.103027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.103193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.103279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.103987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.104197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.104314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.104453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.104532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.104697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.104780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.104940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.105020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.105112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 30 20:43:07.105192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.105409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.105645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.105889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.106129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:43:07.106302 ncdv-master-1 devstack@keystone.service[91085]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 30 20:43:07.134828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.135061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.135150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.135301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.135437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.135551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.143679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.143970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.173570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.173802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.173885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.174108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.226660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.227006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.277696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.277932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.278091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.278331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.342549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.342808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.342899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.343013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.343115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.343240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.343358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.343493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.343576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.343711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.343795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.343926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.367220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.367476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.367712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.367797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.367935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.368019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.368154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.368246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.368370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.368452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.368585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.368665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.368829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.369585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.380295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.380565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.393668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.393911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.394019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.394136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.394220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.394357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.394440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.394574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.394659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.394789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.394872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.395006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.395089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.395248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 30 20:43:07.412671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.412884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 30 20:43:07.413226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.413335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.413431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 30 20:43:07.413559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 30 20:43:07.413685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.413876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.413962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.414081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 30 20:43:07.414177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.414351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.414431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.414611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.414870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.415127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.424292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.424571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.424843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.424957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.425129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.425225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.425490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.425771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.434436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.435053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.437461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.437745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.438039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.438123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.438320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.438414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.438601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.438682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.438863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.438945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.439146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.439231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.439428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.439510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.439700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.439781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.439979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.440061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.440250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.440330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.440526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.440793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.464416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.464508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.465903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.465986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.466180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.466263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.470807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.471014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.471100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.471333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.471431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.471662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.478041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.478297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.478481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.478769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.482452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.482738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.482896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.483030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.483185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.483335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.483507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.483613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.483801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.484005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.484096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.484290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.484462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.484569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.484742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.485027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.501195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.501469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.501826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.502106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.505477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.506056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.508678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.508972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.509387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.509786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.513472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.514217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.516722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.517423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.519880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.520179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.520464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.520640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.520755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.520943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.521037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.521236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.521421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.521528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.521811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.522205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.537848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.538131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.538400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.538660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.538757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.538945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.539214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.539502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.545713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.546669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.547419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.547703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.548398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.548683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.550409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.550689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.550979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.551274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.551412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.551579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.551697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.551984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.552279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.552576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.563503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.563782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.564064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.564343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.564569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.564654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.564849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.564934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.565133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.565217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.565420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.565706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.565992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.566282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.580895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.582121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.583892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.585193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.587895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.589238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.589369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.590738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.590851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.591126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.591443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.592291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.592572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.592875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.701117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.701304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.702605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.702689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.705598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.705685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.705894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.705976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.706189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.706272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.706470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.706554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.714495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.714642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.714785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.714933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.715069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.715220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.721912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.722090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 30 20:43:07.722305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.722483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.722592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.722773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.722879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.723058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.723149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.723368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.723454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.723660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.723755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.723952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.724036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.724236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.724328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.724513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.724598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.724785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.724866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.725055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.725145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.725322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.725403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.725591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.725672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.725865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 30 20:43:07.760241 ncdv-master-1 devstack@keystone.service[91086]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dd463989c0 pid: 91086 (default app) Jul 30 20:43:07.760636 ncdv-master-1 devstack@keystone.service[91085]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dd463989c0 pid: 91085 (default app) Jul 30 20:43:07.763710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb187d-9317-4079-921d-a6a70401bfcb None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:07.764008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb187d-9317-4079-921d-a6a70401bfcb None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:07.764288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb187d-9317-4079-921d-a6a70401bfcb None None] PATH_INFO: `/v3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:07.768498 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Sat Jul 30 20:43:07 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:15.866914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7dbc4-5081-4df2-9caf-a2ad4e055791 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:15.867511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7dbc4-5081-4df2-9caf-a2ad4e055791 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:15.867511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7dbc4-5081-4df2-9caf-a2ad4e055791 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:15.872137 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:15.877338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7020f36-0244-47f9-8476-db8f784a1ea2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:15.877798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7020f36-0244-47f9-8476-db8f784a1ea2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:15.877896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7020f36-0244-47f9-8476-db8f784a1ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:15.956135 ncdv-master-1 devstack@keystone.service[91086]: INFO dbcounter [None req-b7020f36-0244-47f9-8476-db8f784a1ea2 None None] Registered counter for database keystone Jul 30 20:43:15.976682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG oslo_db.sqlalchemy.engines [None req-b7020f36-0244-47f9-8476-db8f784a1ea2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91086) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:43:15.982970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writer thread running {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 20:43:16.168092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG passlib.handlers.bcrypt [None req-b7020f36-0244-47f9-8476-db8f784a1ea2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91086) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 30 20:43:16.168433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG passlib.handlers.bcrypt [None req-b7020f36-0244-47f9-8476-db8f784a1ea2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91086) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 30 20:43:16.222614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b7020f36-0244-47f9-8476-db8f784a1ea2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:16.224298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b7020f36-0244-47f9-8476-db8f784a1ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:16.355912 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 30 20:43:16.389794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7dbc4-5081-4df2-9caf-a2ad4e055791 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:16.467225 ncdv-master-1 devstack@keystone.service[91085]: INFO dbcounter [None req-0de7dbc4-5081-4df2-9caf-a2ad4e055791 None None] Registered counter for database keystone Jul 30 20:43:16.488872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG oslo_db.sqlalchemy.engines [None req-0de7dbc4-5081-4df2-9caf-a2ad4e055791 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:43:16.495184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writer thread running {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 20:43:16.613995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7dbc4-5081-4df2-9caf-a2ad4e055791 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:16.618332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611eff3-c6db-4c1d-87a4-4a8c4d0227c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:16.619052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611eff3-c6db-4c1d-87a4-4a8c4d0227c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:16.619364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611eff3-c6db-4c1d-87a4-4a8c4d0227c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:16.619645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611eff3-c6db-4c1d-87a4-4a8c4d0227c4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:16.628238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611eff3-c6db-4c1d-87a4-4a8c4d0227c4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:16.679844 ncdv-master-1 devstack@keystone.service[91085]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c611eff3-c6db-4c1d-87a4-4a8c4d0227c4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 30 20:43:16.680196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611eff3-c6db-4c1d-87a4-4a8c4d0227c4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:16.689960 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1324 bytes} [Sat Jul 30 20:43:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 20:43:16.696112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7020f36-0244-47f9-8476-db8f784a1ea2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:16.710990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7020f36-0244-47f9-8476-db8f784a1ea2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:16.716122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153f440-c9b5-4ae7-b008-9d7c1bdba103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:16.717289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153f440-c9b5-4ae7-b008-9d7c1bdba103 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:16.717525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153f440-c9b5-4ae7-b008-9d7c1bdba103 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:16.717798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153f440-c9b5-4ae7-b008-9d7c1bdba103 admin admin] PATH_INFO: `/v3/projects/375d034049af46779b4f307bede15a89` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:16.719311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153f440-c9b5-4ae7-b008-9d7c1bdba103 admin admin] RBAC: Authorizing `identity:get_project(project_id=375d034049af46779b4f307bede15a89)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:16.769347 ncdv-master-1 devstack@keystone.service[91086]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6153f440-c9b5-4ae7-b008-9d7c1bdba103 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 30 20:43:16.769697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153f440-c9b5-4ae7-b008-9d7c1bdba103 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:16.774371 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3/5] 10.222.0.17 () {56 vars in 1207 bytes} [Sat Jul 30 20:43:16 2022] GET /identity/v3/projects/375d034049af46779b4f307bede15a89 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:18.991152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8300650-c0e5-4f63-821d-2e6309e86439 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:18.991739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8300650-c0e5-4f63-821d-2e6309e86439 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:18.991739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8300650-c0e5-4f63-821d-2e6309e86439 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:18.996761 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3/6] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:19.002333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb1a9e-b5e6-4a3f-84b2-f80b1e0f3689 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:19.002732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb1a9e-b5e6-4a3f-84b2-f80b1e0f3689 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:19.002895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb1a9e-b5e6-4a3f-84b2-f80b1e0f3689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:19.022919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8dfb1a9e-b5e6-4a3f-84b2-f80b1e0f3689 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:19.024453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8dfb1a9e-b5e6-4a3f-84b2-f80b1e0f3689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:19.032297 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 30 20:43:19.055331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8300650-c0e5-4f63-821d-2e6309e86439 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:19.068041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8300650-c0e5-4f63-821d-2e6309e86439 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:19.072838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102de6c7-d509-43ae-b18f-8f68bec9ee66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:19.073447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102de6c7-d509-43ae-b18f-8f68bec9ee66 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:19.073737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102de6c7-d509-43ae-b18f-8f68bec9ee66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:19.074019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102de6c7-d509-43ae-b18f-8f68bec9ee66 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:19.081717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102de6c7-d509-43ae-b18f-8f68bec9ee66 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:19.083537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102de6c7-d509-43ae-b18f-8f68bec9ee66 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:19.092347 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1324 bytes} [Sat Jul 30 20:43:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 20:43:19.097457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb1a9e-b5e6-4a3f-84b2-f80b1e0f3689 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:19.106900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb1a9e-b5e6-4a3f-84b2-f80b1e0f3689 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:19.111219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fd3d4-796b-4129-9a81-ce75a692ffa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:19.111872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fd3d4-796b-4129-9a81-ce75a692ffa8 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:19.112157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fd3d4-796b-4129-9a81-ce75a692ffa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:19.112432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fd3d4-796b-4129-9a81-ce75a692ffa8 admin admin] PATH_INFO: `/v3/users/57e206ec85774a5086d011cb1726114a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:19.113770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fd3d4-796b-4129-9a81-ce75a692ffa8 admin admin] RBAC: Authorizing `identity:get_user(user_id=57e206ec85774a5086d011cb1726114a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:19.115601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fd3d4-796b-4129-9a81-ce75a692ffa8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:19.117203 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 5/9] 10.222.0.17 () {56 vars in 1198 bytes} [Sat Jul 30 20:43:19 2022] GET /identity/v3/users/57e206ec85774a5086d011cb1726114a => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:21.376473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303aa372-c9e2-41d7-8e8d-60f71102573f None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:21.377025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303aa372-c9e2-41d7-8e8d-60f71102573f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:21.377025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303aa372-c9e2-41d7-8e8d-60f71102573f None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:21.378353 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:43:21.383418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916d430-1760-4d2b-82e5-8b5632a33bff None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:21.383805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916d430-1760-4d2b-82e5-8b5632a33bff None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:21.384013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916d430-1760-4d2b-82e5-8b5632a33bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:21.404354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7916d430-1760-4d2b-82e5-8b5632a33bff None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:21.405540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7916d430-1760-4d2b-82e5-8b5632a33bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:21.432875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560b5c7-21a3-4c6e-ab81-3a862ee4df02 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:21.433170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560b5c7-21a3-4c6e-ab81-3a862ee4df02 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:21.433460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560b5c7-21a3-4c6e-ab81-3a862ee4df02 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:21.434809 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 6/11] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:43:21.439864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffda48-b44f-4c47-a195-0803d48a7ac5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:21.440159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffda48-b44f-4c47-a195-0803d48a7ac5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:21.440442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffda48-b44f-4c47-a195-0803d48a7ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:21.482005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG passlib.handlers.bcrypt [None req-cbffda48-b44f-4c47-a195-0803d48a7ac5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91085) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 30 20:43:21.482429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG passlib.handlers.bcrypt [None req-cbffda48-b44f-4c47-a195-0803d48a7ac5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91085) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 30 20:43:21.484054 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:21.507975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916d430-1760-4d2b-82e5-8b5632a33bff None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:21.528594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-cbffda48-b44f-4c47-a195-0803d48a7ac5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:21.530209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cbffda48-b44f-4c47-a195-0803d48a7ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:21.531201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:21.611438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916d430-1760-4d2b-82e5-8b5632a33bff None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:21.631774 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:43:21.646015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e2637-bde8-4614-9598-f5c9c137e8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:21.646663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e2637-bde8-4614-9598-f5c9c137e8ca None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:21.646949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e2637-bde8-4614-9598-f5c9c137e8ca None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:21.647232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e2637-bde8-4614-9598-f5c9c137e8ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:21.655438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffda48-b44f-4c47-a195-0803d48a7ac5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:21.658603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e2637-bde8-4614-9598-f5c9c137e8ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:21.667483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-611e2637-bde8-4614-9598-f5c9c137e8ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:43:21.667483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:21.667483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:21.667483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:21.667483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:21.667483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:21.667483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:21.667483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:21.667483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:21.667483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:21.667483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:21.667483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:21.667483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:21.667483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:21.667483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:21.667483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:21.668404 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:21.668404 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:21.668404 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:21.668404 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:21.668404 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:21.668404 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:21.668404 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:21.668404 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:21.668404 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:21.668404 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:21.668404 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:21.668404 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:21.668404 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:21.668404 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:21.668404 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:21.668404 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:21.669206 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:21.669206 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:21.669206 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:21.669206 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:21.669206 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:21.669206 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:21.669206 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:21.669206 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:21.669206 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:21.669206 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:21.669206 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:43:21.669206 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:43:21.669206 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 7/14] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:43:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:43:21.674280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e2637-bde8-4614-9598-f5c9c137e8ca None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:21.755678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:21.756076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffda48-b44f-4c47-a195-0803d48a7ac5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:21.758444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:21.775540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e2637-bde8-4614-9598-f5c9c137e8ca None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:21.794405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25842e2-5da8-4535-9575-7aa5adf1446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:21.795297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25842e2-5da8-4535-9575-7aa5adf1446b None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:21.795616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25842e2-5da8-4535-9575-7aa5adf1446b None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:21.795897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25842e2-5da8-4535-9575-7aa5adf1446b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:21.808958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abee11-fbab-47f4-a000-6c8b1e08d0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:21.809582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abee11-fbab-47f4-a000-6c8b1e08d0ae None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:21.809867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abee11-fbab-47f4-a000-6c8b1e08d0ae None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:21.810145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abee11-fbab-47f4-a000-6c8b1e08d0ae None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:21.810867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abee11-fbab-47f4-a000-6c8b1e08d0ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:21.811195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abee11-fbab-47f4-a000-6c8b1e08d0ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:21.812624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abee11-fbab-47f4-a000-6c8b1e08d0ae None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:21.824419 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 8/15] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:43:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:43:21.830600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abee11-fbab-47f4-a000-6c8b1e08d0ae None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:21.863197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25842e2-5da8-4535-9575-7aa5adf1446b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:21.864773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25842e2-5da8-4535-9575-7aa5adf1446b None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:21.931518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abee11-fbab-47f4-a000-6c8b1e08d0ae None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:21.963654 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 8/16] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:43:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 30 20:43:21.965859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc6bf0-7750-4b91-9384-95b600935e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:21.966507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc6bf0-7750-4b91-9384-95b600935e2f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:21.966793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc6bf0-7750-4b91-9384-95b600935e2f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:21.967071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc6bf0-7750-4b91-9384-95b600935e2f None admin] PATH_INFO: `/v3/users/57e206ec85774a5086d011cb1726114a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:21.968358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc6bf0-7750-4b91-9384-95b600935e2f None admin] RBAC: Authorizing `identity:get_user(user_id=57e206ec85774a5086d011cb1726114a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:21.969186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25842e2-5da8-4535-9575-7aa5adf1446b None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:21.969820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc6bf0-7750-4b91-9384-95b600935e2f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:21.971417 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 9/17] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:21 2022] GET /identity/v3/users/57e206ec85774a5086d011cb1726114a => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:43:21.972515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:21.976583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc6bf0-7750-4b91-9384-95b600935e2f None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:21.992116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:22.080453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25842e2-5da8-4535-9575-7aa5adf1446b None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:22.087510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc6bf0-7750-4b91-9384-95b600935e2f None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:22.118054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8c8f3-5d39-4ee0-866f-f7815c284c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:22.119528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8c8f3-5d39-4ee0-866f-f7815c284c76 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:22.119817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8c8f3-5d39-4ee0-866f-f7815c284c76 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:22.120150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8c8f3-5d39-4ee0-866f-f7815c284c76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:22.124278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101f8ba-4d80-45e5-80ef-e5e84b6ceb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:22.124922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101f8ba-4d80-45e5-80ef-e5e84b6ceb92 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:22.125212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101f8ba-4d80-45e5-80ef-e5e84b6ceb92 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:22.125493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101f8ba-4d80-45e5-80ef-e5e84b6ceb92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:22.126662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101f8ba-4d80-45e5-80ef-e5e84b6ceb92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:22.128154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101f8ba-4d80-45e5-80ef-e5e84b6ceb92 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:22.129728 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 10/18] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:43:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:43:22.136003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101f8ba-4d80-45e5-80ef-e5e84b6ceb92 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:22.139457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8c8f3-5d39-4ee0-866f-f7815c284c76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:22.140925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8c8f3-5d39-4ee0-866f-f7815c284c76 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:22.159346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-edd8c8f3-5d39-4ee0-866f-f7815c284c76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:43:22.159346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:22.159346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:22.159346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:22.159346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:22.159346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:22.159346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:22.159346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:22.159346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:22.159346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:22.159346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:22.159346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:22.159346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:43:22.159346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:43:22.159346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:43:22.160211 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:43:22.160211 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:22.160211 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:22.160211 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:22.160211 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:22.160211 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:22.160211 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:22.160211 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:22.160211 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:22.160211 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:22.160211 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:22.160211 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:22.160211 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:22.160211 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:22.160211 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:22.160211 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:22.160211 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:22.161035 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:43:22.161035 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:43:22.161035 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:43:22.161035 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:43:22.161035 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 9/19] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:43:22.166297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8c8f3-5d39-4ee0-866f-f7815c284c76 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:22.216657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:22.221165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:22.237853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101f8ba-4d80-45e5-80ef-e5e84b6ceb92 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:22.267854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8c8f3-5d39-4ee0-866f-f7815c284c76 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:22.272467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cdc03-ae1e-4770-ba99-5ff6274282c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:22.273092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cdc03-ae1e-4770-ba99-5ff6274282c9 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:22.273381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cdc03-ae1e-4770-ba99-5ff6274282c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:22.273662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cdc03-ae1e-4770-ba99-5ff6274282c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:22.274456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cdc03-ae1e-4770-ba99-5ff6274282c9 None admin] RBAC: Adding query filter params (role.id=3b89b89da98d4ec08a0587aa13832636, scope.domain.id=default, user.id=57e206ec85774a5086d011cb1726114a) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:22.274798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cdc03-ae1e-4770-ba99-5ff6274282c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:22.276291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cdc03-ae1e-4770-ba99-5ff6274282c9 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:22.283171 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 11/20] 10.222.0.17 () {56 vars in 1322 bytes} [Sat Jul 30 20:43:22 2022] GET /identity/v3/role_assignments?user.id=57e206ec85774a5086d011cb1726114a&scope.domain.id=default&role.id=3b89b89da98d4ec08a0587aa13832636 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:43:22.300967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9925d-5b4b-4094-acd1-670a2f851059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:22.301650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9925d-5b4b-4094-acd1-670a2f851059 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:22.301935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9925d-5b4b-4094-acd1-670a2f851059 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:22.302210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9925d-5b4b-4094-acd1-670a2f851059 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:22.302931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9925d-5b4b-4094-acd1-670a2f851059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:22.303239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9925d-5b4b-4094-acd1-670a2f851059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:22.304705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9925d-5b4b-4094-acd1-670a2f851059 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:22.325418 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 10/21] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:43:25.061164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b68b5c-aff3-4c58-9539-2535203515ac None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:25.061775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b68b5c-aff3-4c58-9539-2535203515ac None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:25.062199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b68b5c-aff3-4c58-9539-2535203515ac None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:25.064406 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 12/22] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:25.069792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02abdc-3bad-423b-8868-a60a8a0acc1f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:25.070276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02abdc-3bad-423b-8868-a60a8a0acc1f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:25.070363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02abdc-3bad-423b-8868-a60a8a0acc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:25.102555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8a02abdc-3bad-423b-8868-a60a8a0acc1f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:25.104341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8a02abdc-3bad-423b-8868-a60a8a0acc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:25.202538 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 11/23] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:25.239243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b68b5c-aff3-4c58-9539-2535203515ac None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:25.249867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f4924-7a69-480c-9ed6-032dbcf7cb80 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:25.250102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f4924-7a69-480c-9ed6-032dbcf7cb80 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:25.250390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f4924-7a69-480c-9ed6-032dbcf7cb80 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:25.251972 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 12/24] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:25.261777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae691bc-ff56-42da-8b80-842bd92047a2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:25.262070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae691bc-ff56-42da-8b80-842bd92047a2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:25.262351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae691bc-ff56-42da-8b80-842bd92047a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:25.300333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-eae691bc-ff56-42da-8b80-842bd92047a2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:25.301637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-eae691bc-ff56-42da-8b80-842bd92047a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:25.418599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:25.463158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b68b5c-aff3-4c58-9539-2535203515ac None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:25.497153 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 13/25] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:25.500472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8a300-d0c1-4500-83a8-dbddff7193e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:25.501077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8a300-d0c1-4500-83a8-dbddff7193e9 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:25.501366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8a300-d0c1-4500-83a8-dbddff7193e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:25.501643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8a300-d0c1-4500-83a8-dbddff7193e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:25.513206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8a300-d0c1-4500-83a8-dbddff7193e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:25.514723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8a300-d0c1-4500-83a8-dbddff7193e9 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:25.517882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:25.533194 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-99f8a300-d0c1-4500-83a8-dbddff7193e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:43:25.533194 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:25.533194 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:25.533194 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:25.533194 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:25.533194 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:25.533194 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:25.533194 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:25.533194 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:25.533194 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:25.533194 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:25.533194 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:25.533194 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:43:25.533194 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:43:25.533194 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:43:25.534092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:43:25.534092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:25.534092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:25.534092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:25.534092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:25.534092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:25.534092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:25.534092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:25.534092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:25.534092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:25.534092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:25.534092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:25.534092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:25.534092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:25.534092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:25.534092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:25.534092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:25.534890 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:43:25.534890 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:43:25.534890 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:43:25.534890 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:43:25.534890 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 13/26] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:25.541956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae691bc-ff56-42da-8b80-842bd92047a2 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:25.553340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8a300-d0c1-4500-83a8-dbddff7193e9 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:25.701221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8a300-d0c1-4500-83a8-dbddff7193e9 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:25.707123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae691bc-ff56-42da-8b80-842bd92047a2 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:25.749327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa9bb6-b613-4edf-a0c6-f1adccc2b2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:25.750694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa9bb6-b613-4edf-a0c6-f1adccc2b2d9 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:25.751454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa9bb6-b613-4edf-a0c6-f1adccc2b2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:25.751911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa9bb6-b613-4edf-a0c6-f1adccc2b2d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:25.755731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c0715-6a39-4762-b6db-43c2b06d3d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:25.756641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c0715-6a39-4762-b6db-43c2b06d3d1a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:25.757004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c0715-6a39-4762-b6db-43c2b06d3d1a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:25.757359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c0715-6a39-4762-b6db-43c2b06d3d1a None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:25.758427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c0715-6a39-4762-b6db-43c2b06d3d1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:25.758865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c0715-6a39-4762-b6db-43c2b06d3d1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:25.760654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c0715-6a39-4762-b6db-43c2b06d3d1a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:25.764888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa9bb6-b613-4edf-a0c6-f1adccc2b2d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:25.771519 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-beaa9bb6-b613-4edf-a0c6-f1adccc2b2d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:43:25.771519 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:25.771519 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:25.771519 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:25.771519 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:25.771519 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:25.771519 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:25.771519 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:25.771519 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:25.771519 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:25.771519 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:25.771519 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:25.771519 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:25.771519 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:25.771519 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:25.771519 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:25.772366 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:25.772366 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:25.772366 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:25.772366 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:25.772366 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:25.772366 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:25.772366 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:25.772366 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:25.772366 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:25.772366 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:25.772366 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:25.772366 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:25.772366 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:25.772366 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:25.772366 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:25.772366 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:25.773127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:25.773127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:25.773127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:25.773127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:25.773127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:25.773127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:25.773127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:25.773127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:25.773127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:25.773127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:25.773127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:43:25.773127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:43:25.775345 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 14/27] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:43:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:25.776480 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 14/28] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:25.776851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d2c66-ec70-4781-954e-ed1a7240f599 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:25.777314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d2c66-ec70-4781-954e-ed1a7240f599 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:25.777758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d2c66-ec70-4781-954e-ed1a7240f599 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:25.779493 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 15/29] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:25.781191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d2c66-ec70-4781-954e-ed1a7240f599 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:25.783532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815676-b690-4776-86df-e87b6f6d8384 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:25.783904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815676-b690-4776-86df-e87b6f6d8384 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:25.784263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815676-b690-4776-86df-e87b6f6d8384 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:25.787062 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 15/30] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:25.791546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c815676-b690-4776-86df-e87b6f6d8384 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:25.844442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:25.862233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:25.925011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d2c66-ec70-4781-954e-ed1a7240f599 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:25.939381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c815676-b690-4776-86df-e87b6f6d8384 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:25.967924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86530fcf-9f14-42b1-b04d-5ecbd777d989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:25.968743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86530fcf-9f14-42b1-b04d-5ecbd777d989 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:25.969103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86530fcf-9f14-42b1-b04d-5ecbd777d989 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:25.969461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86530fcf-9f14-42b1-b04d-5ecbd777d989 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:25.970357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86530fcf-9f14-42b1-b04d-5ecbd777d989 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:25.970739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86530fcf-9f14-42b1-b04d-5ecbd777d989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:25.972354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86530fcf-9f14-42b1-b04d-5ecbd777d989 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:25.976638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ada221-af10-483b-8eb7-20d483765610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:25.977299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ada221-af10-483b-8eb7-20d483765610 None admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:25.977604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ada221-af10-483b-8eb7-20d483765610 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:25.978578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ada221-af10-483b-8eb7-20d483765610 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:25.979587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ada221-af10-483b-8eb7-20d483765610 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:25.981082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ada221-af10-483b-8eb7-20d483765610 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:25.982606 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 16/31] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:43:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:25.983782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a682e52-404b-46da-92cb-a08a049a16f2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:25.984083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a682e52-404b-46da-92cb-a08a049a16f2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:25.984431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a682e52-404b-46da-92cb-a08a049a16f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:26.006032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6a682e52-404b-46da-92cb-a08a049a16f2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:26.009534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6a682e52-404b-46da-92cb-a08a049a16f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:26.084398 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 17/32] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:26.085722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51bb2a-87a3-4ce1-be8a-742414dce6ee None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:26.086014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51bb2a-87a3-4ce1-be8a-742414dce6ee None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:26.086440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51bb2a-87a3-4ce1-be8a-742414dce6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:26.105667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0c51bb2a-87a3-4ce1-be8a-742414dce6ee None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:26.106918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0c51bb2a-87a3-4ce1-be8a-742414dce6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:26.157057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:26.177473 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 16/33] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 30 20:43:25 2022] POST /identity/v3/projects => generated 301 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:43:26.179170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ada221-af10-483b-8eb7-20d483765610 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:26.183908 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 18/34] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:26.184768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51bb2a-87a3-4ce1-be8a-742414dce6ee None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:26.310127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:26.327759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ada221-af10-483b-8eb7-20d483765610 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:26.330057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51bb2a-87a3-4ce1-be8a-742414dce6ee None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:26.366164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c67a3-1a66-4d14-9792-787ece37c379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:26.366836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c67a3-1a66-4d14-9792-787ece37c379 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:26.367123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c67a3-1a66-4d14-9792-787ece37c379 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:26.367508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c67a3-1a66-4d14-9792-787ece37c379 None admin] PATH_INFO: `/v3/users/57e206ec85774a5086d011cb1726114a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:26.368750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ef89a-05c3-4ed5-89d5-8970d12ad431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:26.369058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c67a3-1a66-4d14-9792-787ece37c379 None admin] RBAC: Authorizing `identity:get_user(user_id=57e206ec85774a5086d011cb1726114a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:26.369413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef89a-05c3-4ed5-89d5-8970d12ad431 None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:26.369702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef89a-05c3-4ed5-89d5-8970d12ad431 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:26.370033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef89a-05c3-4ed5-89d5-8970d12ad431 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:26.370619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c67a3-1a66-4d14-9792-787ece37c379 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:26.370772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ef89a-05c3-4ed5-89d5-8970d12ad431 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:26.372680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ef89a-05c3-4ed5-89d5-8970d12ad431 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:26.372779 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 17/35] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:26 2022] GET /identity/v3/users/57e206ec85774a5086d011cb1726114a => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:26.378297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff4bcd-8f7f-4172-ad5e-a0ad6d303bac None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:26.378601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff4bcd-8f7f-4172-ad5e-a0ad6d303bac None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:26.381128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff4bcd-8f7f-4172-ad5e-a0ad6d303bac None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:26.382537 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 18/36] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:26.383458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff4bcd-8f7f-4172-ad5e-a0ad6d303bac None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:26.504438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff4bcd-8f7f-4172-ad5e-a0ad6d303bac None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:26.505855 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 19/37] 10.222.0.17 () {60 vars in 1131 bytes} [Sat Jul 30 20:43:26 2022] POST /identity/v3/roles => generated 225 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:43:26.506872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ef89a-05c3-4ed5-89d5-8970d12ad431 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:26.550316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76a710-4c17-4ccd-857e-074450ee4176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:26.550976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76a710-4c17-4ccd-857e-074450ee4176 None admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:26.551267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76a710-4c17-4ccd-857e-074450ee4176 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:26.551651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76a710-4c17-4ccd-857e-074450ee4176 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:26.552426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76a710-4c17-4ccd-857e-074450ee4176 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:26.553953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76a710-4c17-4ccd-857e-074450ee4176 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:26.579800 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 19/38] 10.222.0.17 () {60 vars in 1131 bytes} [Sat Jul 30 20:43:26 2022] POST /identity/v3/roles => generated 219 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:43:26.580135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:26.582661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1262f54-6405-4a78-919f-7e642e09610b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:26.583050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1262f54-6405-4a78-919f-7e642e09610b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:26.588410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1262f54-6405-4a78-919f-7e642e09610b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:26.628026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e1262f54-6405-4a78-919f-7e642e09610b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:26.629818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e1262f54-6405-4a78-919f-7e642e09610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:26.655628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:26.667714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ef89a-05c3-4ed5-89d5-8970d12ad431 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:26.714361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70c507-d71f-4cda-b7e4-124950fd9b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:26.715054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70c507-d71f-4cda-b7e4-124950fd9b0e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:26.716500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70c507-d71f-4cda-b7e4-124950fd9b0e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:26.716500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70c507-d71f-4cda-b7e4-124950fd9b0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:26.717197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70c507-d71f-4cda-b7e4-124950fd9b0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:26.719506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70c507-d71f-4cda-b7e4-124950fd9b0e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:26.721280 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 20/39] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:43:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:26.722599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f30d7f-93b9-493f-8f4e-e6c1a817ec98 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:26.722894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f30d7f-93b9-493f-8f4e-e6c1a817ec98 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:26.723178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f30d7f-93b9-493f-8f4e-e6c1a817ec98 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:26.724602 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 21/40] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:26.728952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f30d7f-93b9-493f-8f4e-e6c1a817ec98 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:26.762933 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 20/41] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:26.764031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2af46-d09d-44dc-b282-03e78188d701 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:26.764717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2af46-d09d-44dc-b282-03e78188d701 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:26.764717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2af46-d09d-44dc-b282-03e78188d701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:26.792901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-05c2af46-d09d-44dc-b282-03e78188d701 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:26.794912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-05c2af46-d09d-44dc-b282-03e78188d701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:26.867747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f30d7f-93b9-493f-8f4e-e6c1a817ec98 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:26.875473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:26.893040 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 21/42] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:26.893876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2af46-d09d-44dc-b282-03e78188d701 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:26.906416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28c840-1a3d-49a1-8933-6c88b1c3ea1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:26.907219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28c840-1a3d-49a1-8933-6c88b1c3ea1d None admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:26.907543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28c840-1a3d-49a1-8933-6c88b1c3ea1d None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:26.907838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28c840-1a3d-49a1-8933-6c88b1c3ea1d None admin] PATH_INFO: `/v3/domains/default/users/57e206ec85774a5086d011cb1726114a/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:26.909908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28c840-1a3d-49a1-8933-6c88b1c3ea1d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=57e206ec85774a5086d011cb1726114a, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:26.911389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28c840-1a3d-49a1-8933-6c88b1c3ea1d None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:26.935319 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 22/43] 10.222.0.17 () {58 vars in 1361 bytes} [Sat Jul 30 20:43:26 2022] PUT /identity/v3/domains/default/users/57e206ec85774a5086d011cb1726114a/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:43:26.935319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28c840-1a3d-49a1-8933-6c88b1c3ea1d None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:27.000675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:27.033501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2af46-d09d-44dc-b282-03e78188d701 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:27.049997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28c840-1a3d-49a1-8933-6c88b1c3ea1d None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:27.074940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9286f-dc35-448b-8a59-b305c3481f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:27.075781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9286f-dc35-448b-8a59-b305c3481f11 None admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:27.076230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9286f-dc35-448b-8a59-b305c3481f11 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:27.076524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9286f-dc35-448b-8a59-b305c3481f11 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:27.077322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9286f-dc35-448b-8a59-b305c3481f11 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:27.078819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9286f-dc35-448b-8a59-b305c3481f11 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:27.087920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e903b64-4bcf-4692-9d86-e97993e5cb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:27.088610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e903b64-4bcf-4692-9d86-e97993e5cb31 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:27.088995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e903b64-4bcf-4692-9d86-e97993e5cb31 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:27.089178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e903b64-4bcf-4692-9d86-e97993e5cb31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:27.090390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e903b64-4bcf-4692-9d86-e97993e5cb31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:27.091934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e903b64-4bcf-4692-9d86-e97993e5cb31 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:27.093770 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 23/44] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:43:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:27.096339 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1131 bytes} [Sat Jul 30 20:43:26 2022] POST /identity/v3/roles => generated 223 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:43:27.099779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e903b64-4bcf-4692-9d86-e97993e5cb31 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:27.149134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:27.229417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e903b64-4bcf-4692-9d86-e97993e5cb31 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:27.266822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8db46-b156-4d51-950c-a8d120cac480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:27.267503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8db46-b156-4d51-950c-a8d120cac480 None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:27.267798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8db46-b156-4d51-950c-a8d120cac480 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:27.268086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8db46-b156-4d51-950c-a8d120cac480 None admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:27.268858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8db46-b156-4d51-950c-a8d120cac480 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:27.270338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8db46-b156-4d51-950c-a8d120cac480 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:27.302645 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 30 20:43:27 2022] POST /identity/v3/projects => generated 312 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:43:29.208206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0233c2-629e-4bf4-8711-e6fa46129d85 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:29.208719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0233c2-629e-4bf4-8711-e6fa46129d85 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:29.208800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0233c2-629e-4bf4-8711-e6fa46129d85 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:29.210114 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 23/47] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:29.215412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b78311-214d-4694-a5bc-d115d9ed5687 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:29.215794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b78311-214d-4694-a5bc-d115d9ed5687 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:29.216021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b78311-214d-4694-a5bc-d115d9ed5687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:29.234124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-89b78311-214d-4694-a5bc-d115d9ed5687 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:29.235687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-89b78311-214d-4694-a5bc-d115d9ed5687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:29.301982 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 25/48] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:29.326801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0233c2-629e-4bf4-8711-e6fa46129d85 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:29.430294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0233c2-629e-4bf4-8711-e6fa46129d85 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:29.463917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17129ae-1754-4f6c-a7cd-6359261267f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:29.464563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17129ae-1754-4f6c-a7cd-6359261267f4 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:29.464846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17129ae-1754-4f6c-a7cd-6359261267f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:29.465122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17129ae-1754-4f6c-a7cd-6359261267f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:29.468639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:29.478683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17129ae-1754-4f6c-a7cd-6359261267f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:29.484629 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-b17129ae-1754-4f6c-a7cd-6359261267f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:43:29.484629 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:29.484629 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:29.484629 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:29.484629 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:29.484629 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:29.484629 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:29.484629 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:29.484629 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:29.484629 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:29.484629 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:29.484629 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:29.484629 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:29.484629 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:29.484629 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:29.484629 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:29.485633 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:29.485633 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:29.485633 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:29.485633 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:29.485633 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:29.485633 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:29.485633 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:29.485633 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:29.485633 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:29.485633 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:29.485633 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:29.485633 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:29.485633 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:29.485633 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:29.485633 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:29.485633 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:29.486590 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:29.486590 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:29.486590 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:29.486590 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:29.486590 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:29.486590 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:29.486590 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:29.486590 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:29.486590 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:29.486590 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:29.486590 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:43:29.486590 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:43:29.486590 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 24/49] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:43:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:29.493946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b78311-214d-4694-a5bc-d115d9ed5687 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:29.512069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:29.556797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f06bd1-36fd-4c94-9dfe-1b8e781a156d None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:29.557013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f06bd1-36fd-4c94-9dfe-1b8e781a156d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:29.557301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f06bd1-36fd-4c94-9dfe-1b8e781a156d None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:29.558689 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 25/50] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:43:29.563666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835a9e5-0aac-470a-8358-2f5b9e6335f5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:29.563967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835a9e5-0aac-470a-8358-2f5b9e6335f5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:29.564285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835a9e5-0aac-470a-8358-2f5b9e6335f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:29.582530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1835a9e5-0aac-470a-8358-2f5b9e6335f5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:29.583787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1835a9e5-0aac-470a-8358-2f5b9e6335f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:29.595529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b78311-214d-4694-a5bc-d115d9ed5687 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:29.632402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8c4bf-a5a7-400d-a2d0-2262f28968b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:29.633033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8c4bf-a5a7-400d-a2d0-2262f28968b3 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:29.633321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8c4bf-a5a7-400d-a2d0-2262f28968b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:29.633603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8c4bf-a5a7-400d-a2d0-2262f28968b3 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:29.635070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8c4bf-a5a7-400d-a2d0-2262f28968b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:29.635417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8c4bf-a5a7-400d-a2d0-2262f28968b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:29.636813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8c4bf-a5a7-400d-a2d0-2262f28968b3 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:29.644943 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 26/51] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:43:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:29.651584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8c4bf-a5a7-400d-a2d0-2262f28968b3 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:29.654925 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 26/52] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:43:29.678760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835a9e5-0aac-470a-8358-2f5b9e6335f5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:29.728883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:29.750810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8c4bf-a5a7-400d-a2d0-2262f28968b3 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:29.778303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835a9e5-0aac-470a-8358-2f5b9e6335f5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:29.784040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9106e5c-c07a-4299-be3d-4b299de79024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:29.784682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9106e5c-c07a-4299-be3d-4b299de79024 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:29.784969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9106e5c-c07a-4299-be3d-4b299de79024 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:29.785251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9106e5c-c07a-4299-be3d-4b299de79024 None admin] PATH_INFO: `/v3/users/57e206ec85774a5086d011cb1726114a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:29.786431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9106e5c-c07a-4299-be3d-4b299de79024 None admin] RBAC: Authorizing `identity:get_user(user_id=57e206ec85774a5086d011cb1726114a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:29.787914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9106e5c-c07a-4299-be3d-4b299de79024 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:29.789505 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 27/53] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:29 2022] GET /identity/v3/users/57e206ec85774a5086d011cb1726114a => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:43:29.795407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9106e5c-c07a-4299-be3d-4b299de79024 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:29.803770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:29.813368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383d5af-d4c7-43c5-9b21-ae2765dad476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:29.813955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383d5af-d4c7-43c5-9b21-ae2765dad476 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:29.814248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383d5af-d4c7-43c5-9b21-ae2765dad476 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:29.814532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383d5af-d4c7-43c5-9b21-ae2765dad476 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:29.815743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383d5af-d4c7-43c5-9b21-ae2765dad476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:29.817211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383d5af-d4c7-43c5-9b21-ae2765dad476 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:29.818867 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 27/54] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:43:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:43:29.824516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383d5af-d4c7-43c5-9b21-ae2765dad476 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:29.895812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9106e5c-c07a-4299-be3d-4b299de79024 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:29.923737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383d5af-d4c7-43c5-9b21-ae2765dad476 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:29.929134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49957ff1-f0aa-4c08-9fd9-0df584858de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:29.929781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49957ff1-f0aa-4c08-9fd9-0df584858de7 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:29.930071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49957ff1-f0aa-4c08-9fd9-0df584858de7 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:29.930355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49957ff1-f0aa-4c08-9fd9-0df584858de7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:29.932109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49957ff1-f0aa-4c08-9fd9-0df584858de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:29.933557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49957ff1-f0aa-4c08-9fd9-0df584858de7 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:29.935348 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 28/55] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:43:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:43:29.941022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49957ff1-f0aa-4c08-9fd9-0df584858de7 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:29.957295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:29.959853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418d8a4-c255-4cd0-90a4-0fb8945089f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:29.960493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418d8a4-c255-4cd0-90a4-0fb8945089f1 None admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:29.960782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418d8a4-c255-4cd0-90a4-0fb8945089f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:29.961069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418d8a4-c255-4cd0-90a4-0fb8945089f1 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:29.961750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418d8a4-c255-4cd0-90a4-0fb8945089f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:29.963228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418d8a4-c255-4cd0-90a4-0fb8945089f1 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:29.988809 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 28/56] 10.222.0.17 () {60 vars in 1140 bytes} [Sat Jul 30 20:43:29 2022] POST /identity/v3/projects => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 20:43:30.050330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49957ff1-f0aa-4c08-9fd9-0df584858de7 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:30.088550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef675f-aac0-43b5-a072-8ae0cd2bb01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:30.089221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef675f-aac0-43b5-a072-8ae0cd2bb01e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:30.089535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef675f-aac0-43b5-a072-8ae0cd2bb01e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:30.089835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef675f-aac0-43b5-a072-8ae0cd2bb01e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:30.090676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef675f-aac0-43b5-a072-8ae0cd2bb01e None admin] RBAC: Adding query filter params (role.id=3b89b89da98d4ec08a0587aa13832636, scope.domain.id=default, user.id=57e206ec85774a5086d011cb1726114a) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:30.091017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef675f-aac0-43b5-a072-8ae0cd2bb01e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:30.092618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef675f-aac0-43b5-a072-8ae0cd2bb01e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:30.099407 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 29/57] 10.222.0.17 () {56 vars in 1322 bytes} [Sat Jul 30 20:43:29 2022] GET /identity/v3/role_assignments?user.id=57e206ec85774a5086d011cb1726114a&scope.domain.id=default&role.id=3b89b89da98d4ec08a0587aa13832636 => generated 530 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:43:32.244986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94dbb3-6073-4244-b9a2-8505d1b51e31 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:32.245494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94dbb3-6073-4244-b9a2-8505d1b51e31 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:32.245607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94dbb3-6073-4244-b9a2-8505d1b51e31 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:32.247191 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 29/58] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:32.252432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc00b0-fec3-47ea-8365-cfe544541759 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:32.252849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc00b0-fec3-47ea-8365-cfe544541759 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:32.253010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc00b0-fec3-47ea-8365-cfe544541759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:32.271520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-47fc00b0-fec3-47ea-8365-cfe544541759 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:32.272731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-47fc00b0-fec3-47ea-8365-cfe544541759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:32.337077 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 30/59] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:32.362146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94dbb3-6073-4244-b9a2-8505d1b51e31 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:32.409087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:32.463777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94dbb3-6073-4244-b9a2-8505d1b51e31 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:32.497831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e035e-27a3-4e2b-a0da-e0526885d05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:32.498413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e035e-27a3-4e2b-a0da-e0526885d05c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:32.498702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e035e-27a3-4e2b-a0da-e0526885d05c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:32.498983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e035e-27a3-4e2b-a0da-e0526885d05c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:32.500178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e035e-27a3-4e2b-a0da-e0526885d05c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:32.501631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e035e-27a3-4e2b-a0da-e0526885d05c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:32.503204 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 30/60] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:43:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:32.508621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc00b0-fec3-47ea-8365-cfe544541759 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:32.518448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:32.605947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc00b0-fec3-47ea-8365-cfe544541759 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:32.641278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cf112-5457-4bb0-9246-68115bc2bd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:32.641896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cf112-5457-4bb0-9246-68115bc2bd9c None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:32.642185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cf112-5457-4bb0-9246-68115bc2bd9c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:32.642466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cf112-5457-4bb0-9246-68115bc2bd9c None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:32.643155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cf112-5457-4bb0-9246-68115bc2bd9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:32.644648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cf112-5457-4bb0-9246-68115bc2bd9c None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:32.670396 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 31/61] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 30 20:43:32 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 20:43:36.074047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11274a65-ea16-4121-b500-d669680cf5ce None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:36.075030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11274a65-ea16-4121-b500-d669680cf5ce None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:36.075562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11274a65-ea16-4121-b500-d669680cf5ce None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:36.077118 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 31/62] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:36.082629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8eb31-ae3f-4fe4-a72e-39c8b0012521 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:36.083527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8eb31-ae3f-4fe4-a72e-39c8b0012521 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:36.084020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8eb31-ae3f-4fe4-a72e-39c8b0012521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:36.090269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc9a1c-40ad-40aa-8321-42622c14dcfe None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:36.090841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc9a1c-40ad-40aa-8321-42622c14dcfe None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:36.091379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc9a1c-40ad-40aa-8321-42622c14dcfe None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:36.093042 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 32/63] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:43:36.098622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06d07a-382a-44d4-ba59-ece1921e2b62 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:36.099161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06d07a-382a-44d4-ba59-ece1921e2b62 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:36.099729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06d07a-382a-44d4-ba59-ece1921e2b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:36.123849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f6f8eb31-ae3f-4fe4-a72e-39c8b0012521 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:36.126652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f6f8eb31-ae3f-4fe4-a72e-39c8b0012521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:36.136331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-6a06d07a-382a-44d4-ba59-ece1921e2b62 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:36.137560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6a06d07a-382a-44d4-ba59-ece1921e2b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:36.223672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:36.237617 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 32/64] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:36.257367 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 33/65] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:43:36.274712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8eb31-ae3f-4fe4-a72e-39c8b0012521 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:36.297871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06d07a-382a-44d4-ba59-ece1921e2b62 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:36.372713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:36.426931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8eb31-ae3f-4fe4-a72e-39c8b0012521 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:36.444711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06d07a-382a-44d4-ba59-ece1921e2b62 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:36.464021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d88ca-c989-4104-879e-8e0ddbe1c193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:36.464783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d88ca-c989-4104-879e-8e0ddbe1c193 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:36.465146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d88ca-c989-4104-879e-8e0ddbe1c193 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:36.465500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d88ca-c989-4104-879e-8e0ddbe1c193 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:36.481292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d88ca-c989-4104-879e-8e0ddbe1c193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:36.482629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80ab6a-f8d6-4729-a083-0f7c20f8188a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:36.483522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80ab6a-f8d6-4729-a083-0f7c20f8188a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:36.483962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80ab6a-f8d6-4729-a083-0f7c20f8188a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:36.484387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80ab6a-f8d6-4729-a083-0f7c20f8188a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:36.488182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-331d88ca-c989-4104-879e-8e0ddbe1c193 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:43:36.488182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:36.488182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:36.488182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:36.488182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:36.488182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:36.488182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:36.488182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:36.488182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:36.488182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:36.488182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:36.488182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:36.488182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:36.488182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:36.488182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:36.488182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:36.489302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:36.489302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:36.489302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:36.489302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:36.489302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:36.489302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:36.489302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:36.489302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:36.489302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:36.489302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:36.489302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:36.489302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:36.489302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:36.489302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:36.489302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:36.489302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:36.490074 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:36.490074 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:36.490074 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:36.490074 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:36.490074 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:36.490074 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:36.490074 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:36.490074 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:36.490074 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:36.490074 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:36.490074 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:43:36.490074 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:43:36.492138 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 33/66] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:43:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:36.495328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e235b39-308a-48cb-a23d-3f35e01e44a3 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:36.496074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e235b39-308a-48cb-a23d-3f35e01e44a3 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:36.496813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e235b39-308a-48cb-a23d-3f35e01e44a3 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:36.499375 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 34/67] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:36.500484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e235b39-308a-48cb-a23d-3f35e01e44a3 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:36.506895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80ab6a-f8d6-4729-a083-0f7c20f8188a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:36.512489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-8a80ab6a-f8d6-4729-a083-0f7c20f8188a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:43:36.512489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:36.512489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:36.512489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:36.512489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:36.512489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:36.512489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:36.512489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:36.512489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:36.512489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:36.512489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:36.512489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:36.512489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:36.512489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:36.512489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:36.512489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:36.513571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:36.513571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:36.513571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:36.513571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:36.513571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:36.513571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:36.513571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:36.513571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:36.513571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:36.513571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:36.513571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:36.513571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:36.513571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:36.513571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:36.513571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:36.513571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:36.514557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:36.514557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:36.514557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:36.514557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:36.514557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:36.514557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:36.514557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:36.514557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:36.514557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:36.514557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:36.514557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:43:36.514557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:43:36.515810 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 34/68] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:43:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:36.517508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929844d-736f-4d8d-8608-55cade928db3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:36.518028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929844d-736f-4d8d-8608-55cade928db3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:36.518671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929844d-736f-4d8d-8608-55cade928db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:36.538013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-6929844d-736f-4d8d-8608-55cade928db3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:36.539533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6929844d-736f-4d8d-8608-55cade928db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:36.575783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:36.629541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e235b39-308a-48cb-a23d-3f35e01e44a3 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:36.633578 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 35/69] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:36.639363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929844d-736f-4d8d-8608-55cade928db3 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:36.675773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e36dbe-df35-4361-abee-8084ef530973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:36.676406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e36dbe-df35-4361-abee-8084ef530973 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:36.676558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:36.676704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e36dbe-df35-4361-abee-8084ef530973 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:36.676963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e36dbe-df35-4361-abee-8084ef530973 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:36.677689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e36dbe-df35-4361-abee-8084ef530973 None admin] RBAC: Adding query filter params (name=member) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:36.677989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e36dbe-df35-4361-abee-8084ef530973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:36.679421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e36dbe-df35-4361-abee-8084ef530973 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:36.688681 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 35/70] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:43:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:36.693519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c596784-ab0b-483e-8c1b-742e721b2b28 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:36.694162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c596784-ab0b-483e-8c1b-742e721b2b28 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:36.694452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c596784-ab0b-483e-8c1b-742e721b2b28 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:36.695900 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 36/71] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:36.699321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c596784-ab0b-483e-8c1b-742e721b2b28 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:36.752054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929844d-736f-4d8d-8608-55cade928db3 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:36.786169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00ccdf-a19d-44e9-9322-1a1c41174590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:36.786722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00ccdf-a19d-44e9-9322-1a1c41174590 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:36.787007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00ccdf-a19d-44e9-9322-1a1c41174590 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:36.787303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00ccdf-a19d-44e9-9322-1a1c41174590 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:36.788024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00ccdf-a19d-44e9-9322-1a1c41174590 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:36.788328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00ccdf-a19d-44e9-9322-1a1c41174590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:36.789724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00ccdf-a19d-44e9-9322-1a1c41174590 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:36.801291 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 36/72] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:43:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:36.802118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c596784-ab0b-483e-8c1b-742e721b2b28 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:36.804185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00ccdf-a19d-44e9-9322-1a1c41174590 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:36.818704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:36.836778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e55801-ed1c-477a-9766-7c2fd9fce8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:36.837433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e55801-ed1c-477a-9766-7c2fd9fce8f4 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:36.837723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e55801-ed1c-477a-9766-7c2fd9fce8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:36.838038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e55801-ed1c-477a-9766-7c2fd9fce8f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:36.853246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e55801-ed1c-477a-9766-7c2fd9fce8f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:36.858635 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-58e55801-ed1c-477a-9766-7c2fd9fce8f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:43:36.858635 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:36.858635 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:36.858635 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:36.858635 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:36.858635 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:36.858635 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:36.858635 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:36.858635 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:36.858635 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:36.858635 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:36.858635 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:36.858635 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:36.858635 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:36.858635 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:36.858635 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:36.859626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:36.859626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:36.859626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:36.859626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:36.859626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:36.859626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:36.859626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:36.859626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:36.859626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:36.859626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:36.859626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:36.859626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:36.859626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:36.859626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:36.859626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:36.859626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:36.860569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:36.860569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:36.860569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:36.860569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:36.860569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:36.860569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:36.860569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:36.860569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:36.860569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:36.860569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:36.860569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:43:36.860569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:43:36.860569 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 37/73] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:43:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:36.861441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d2396-dc32-43eb-a406-79f23655b130 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:36.861441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d2396-dc32-43eb-a406-79f23655b130 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:36.861574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d2396-dc32-43eb-a406-79f23655b130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:36.880725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4a2d2396-dc32-43eb-a406-79f23655b130 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:36.881951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4a2d2396-dc32-43eb-a406-79f23655b130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:36.912444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:36.919033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00ccdf-a19d-44e9-9322-1a1c41174590 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:36.951701 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 38/74] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:36.953036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ba333-3e28-4889-aa59-27adf89b93fd None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:36.953354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ba333-3e28-4889-aa59-27adf89b93fd None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:36.953664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ba333-3e28-4889-aa59-27adf89b93fd None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:36.955330 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 39/75] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:36.955845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ba333-3e28-4889-aa59-27adf89b93fd None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:36.959642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d60d3-6e84-4b56-b122-042a66542417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:36.960306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d60d3-6e84-4b56-b122-042a66542417 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:36.960599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d60d3-6e84-4b56-b122-042a66542417 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:36.960882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d60d3-6e84-4b56-b122-042a66542417 None admin] PATH_INFO: `/v3/users/9e9636a0c442469e88a4bc0a1fd199b3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:36.976313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d60d3-6e84-4b56-b122-042a66542417 None admin] RBAC: Authorizing `identity:get_user(user_id=9e9636a0c442469e88a4bc0a1fd199b3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:36.978325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d60d3-6e84-4b56-b122-042a66542417 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:36.984365 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 37/76] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:36 2022] GET /identity/v3/users/9e9636a0c442469e88a4bc0a1fd199b3 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:36.984365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d60d3-6e84-4b56-b122-042a66542417 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:37.067144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ba333-3e28-4889-aa59-27adf89b93fd None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:37.075150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:37.084476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d60d3-6e84-4b56-b122-042a66542417 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:37.102068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a65d9-eae9-42d9-b927-4dba9df1ceff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:37.103224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a65d9-eae9-42d9-b927-4dba9df1ceff None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:37.103535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a65d9-eae9-42d9-b927-4dba9df1ceff None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:37.103811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a65d9-eae9-42d9-b927-4dba9df1ceff None admin] PATH_INFO: `/v3/users/57e206ec85774a5086d011cb1726114a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:37.104965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a65d9-eae9-42d9-b927-4dba9df1ceff None admin] RBAC: Authorizing `identity:get_user(user_id=57e206ec85774a5086d011cb1726114a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:37.106423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a65d9-eae9-42d9-b927-4dba9df1ceff None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:37.108053 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 40/77] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:36 2022] GET /identity/v3/users/57e206ec85774a5086d011cb1726114a => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:37.109237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e97707-f7ea-409c-a9d1-b968fafb4ce4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:37.109531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e97707-f7ea-409c-a9d1-b968fafb4ce4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:37.109808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e97707-f7ea-409c-a9d1-b968fafb4ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:37.119615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402ae54-35ae-42c0-abf6-4f04ced8bd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:37.120282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402ae54-35ae-42c0-abf6-4f04ced8bd74 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:37.120571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402ae54-35ae-42c0-abf6-4f04ced8bd74 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:37.121105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402ae54-35ae-42c0-abf6-4f04ced8bd74 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:37.121824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402ae54-35ae-42c0-abf6-4f04ced8bd74 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:37.122558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402ae54-35ae-42c0-abf6-4f04ced8bd74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:37.124016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402ae54-35ae-42c0-abf6-4f04ced8bd74 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:37.127155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-24e97707-f7ea-409c-a9d1-b968fafb4ce4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:37.128362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-24e97707-f7ea-409c-a9d1-b968fafb4ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:37.132052 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 38/78] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:43:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:37.132833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402ae54-35ae-42c0-abf6-4f04ced8bd74 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:37.151163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:37.197044 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 41/79] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:37.198062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e97707-f7ea-409c-a9d1-b968fafb4ce4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:37.239801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402ae54-35ae-42c0-abf6-4f04ced8bd74 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:37.273179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5a351-7d35-4603-9612-d6c12693021e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:37.273903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5a351-7d35-4603-9612-d6c12693021e None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:37.274695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5a351-7d35-4603-9612-d6c12693021e None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:37.274998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5a351-7d35-4603-9612-d6c12693021e None admin] PATH_INFO: `/v3/roles/member` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:37.285621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5a351-7d35-4603-9612-d6c12693021e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:37.290974 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-55b5a351-7d35-4603-9612-d6c12693021e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:43:37.290974 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:37.290974 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:37.290974 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:37.290974 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:37.290974 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:37.290974 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:37.290974 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:37.290974 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:37.290974 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:37.290974 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:37.290974 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:37.290974 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:37.290974 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:37.290974 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:37.290974 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:37.291827 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:37.291827 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:37.291827 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:37.291827 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:37.291827 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:37.291827 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:37.291827 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:37.291827 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:37.291827 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:37.291827 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:37.291827 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:37.291827 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:37.291827 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:37.291827 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:37.291827 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:37.291827 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:37.292873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:37.292873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:37.292873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:37.292873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:37.292873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:37.292873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:37.292873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:37.292873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:37.292873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:37.292873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:37.292873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:43:37.292873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:43:37.292873 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 39/80] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:43:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:37.292873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5a351-7d35-4603-9612-d6c12693021e None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:37.300912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e97707-f7ea-409c-a9d1-b968fafb4ce4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:37.304011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:37.337335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f568f3-70e7-4f44-b62b-82df8bb889c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:37.337891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f568f3-70e7-4f44-b62b-82df8bb889c2 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:37.338177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f568f3-70e7-4f44-b62b-82df8bb889c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:37.338461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f568f3-70e7-4f44-b62b-82df8bb889c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:37.369190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:37.392064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5a351-7d35-4603-9612-d6c12693021e None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:37.406014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f568f3-70e7-4f44-b62b-82df8bb889c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:37.407567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f568f3-70e7-4f44-b62b-82df8bb889c2 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:37.424687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973ff17-6dd8-4b65-a4c2-cd943e44bcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:37.425310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973ff17-6dd8-4b65-a4c2-cd943e44bcd5 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:37.425605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973ff17-6dd8-4b65-a4c2-cd943e44bcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:37.425892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973ff17-6dd8-4b65-a4c2-cd943e44bcd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:37.494593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973ff17-6dd8-4b65-a4c2-cd943e44bcd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:37.496361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973ff17-6dd8-4b65-a4c2-cd943e44bcd5 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:37.504213 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 42/81] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:43:37.505049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f568f3-70e7-4f44-b62b-82df8bb889c2 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:37.510251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:37.578744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:37.603121 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 40/82] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:43:37.607978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973ff17-6dd8-4b65-a4c2-cd943e44bcd5 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:37.617479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f568f3-70e7-4f44-b62b-82df8bb889c2 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:37.652927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be91e8d-03e5-4e23-a823-468a3df12675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:37.653575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be91e8d-03e5-4e23-a823-468a3df12675 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:37.653870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be91e8d-03e5-4e23-a823-468a3df12675 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:37.654151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be91e8d-03e5-4e23-a823-468a3df12675 None admin] PATH_INFO: `/v3/users/9e9636a0c442469e88a4bc0a1fd199b3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:37.655342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be91e8d-03e5-4e23-a823-468a3df12675 None admin] RBAC: Authorizing `identity:get_user(user_id=9e9636a0c442469e88a4bc0a1fd199b3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:37.656803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be91e8d-03e5-4e23-a823-468a3df12675 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:37.658556 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 43/83] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:37 2022] GET /identity/v3/users/9e9636a0c442469e88a4bc0a1fd199b3 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:37.659143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be91e8d-03e5-4e23-a823-468a3df12675 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:37.704168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973ff17-6dd8-4b65-a4c2-cd943e44bcd5 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:37.727168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:37.738318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6dc95-e7c8-4d3b-b6c4-14a761e965fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:37.738965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6dc95-e7c8-4d3b-b6c4-14a761e965fa None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:37.739255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6dc95-e7c8-4d3b-b6c4-14a761e965fa None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:37.739570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6dc95-e7c8-4d3b-b6c4-14a761e965fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:37.740724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6dc95-e7c8-4d3b-b6c4-14a761e965fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:37.742179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6dc95-e7c8-4d3b-b6c4-14a761e965fa None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:37.743912 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 41/84] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:43:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:37.744659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6dc95-e7c8-4d3b-b6c4-14a761e965fa None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:37.757909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be91e8d-03e5-4e23-a823-468a3df12675 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:37.791888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a10f9e-2c53-48f7-be7b-df5d718f7cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:37.792465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:37.792557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a10f9e-2c53-48f7-be7b-df5d718f7cc7 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:37.792784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a10f9e-2c53-48f7-be7b-df5d718f7cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:37.793071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a10f9e-2c53-48f7-be7b-df5d718f7cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:37.793794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a10f9e-2c53-48f7-be7b-df5d718f7cc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:37.794125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a10f9e-2c53-48f7-be7b-df5d718f7cc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:37.795503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a10f9e-2c53-48f7-be7b-df5d718f7cc7 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:37.803469 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 44/85] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:43:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:37.804263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a10f9e-2c53-48f7-be7b-df5d718f7cc7 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:37.851985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6dc95-e7c8-4d3b-b6c4-14a761e965fa None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:37.888533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a323d1d-1357-4135-bfd3-216ac5d78ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:37.889099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a323d1d-1357-4135-bfd3-216ac5d78ab7 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:37.889383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a323d1d-1357-4135-bfd3-216ac5d78ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:37.889662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a323d1d-1357-4135-bfd3-216ac5d78ab7 None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:37.890851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a323d1d-1357-4135-bfd3-216ac5d78ab7 None admin] RBAC: Authorizing `identity:get_project(project_id=02833278e27846f49032cf41d32ccefb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:37.892341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a323d1d-1357-4135-bfd3-216ac5d78ab7 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:37.893992 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 42/86] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:43:37 2022] GET /identity/v3/projects/02833278e27846f49032cf41d32ccefb => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:37.897489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a323d1d-1357-4135-bfd3-216ac5d78ab7 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:37.905065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a10f9e-2c53-48f7-be7b-df5d718f7cc7 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:37.940502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67945db-cb09-4086-97d1-a8f6d21357a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:37.941153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67945db-cb09-4086-97d1-a8f6d21357a4 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:37.941443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67945db-cb09-4086-97d1-a8f6d21357a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:37.941759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67945db-cb09-4086-97d1-a8f6d21357a4 None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:37.942930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67945db-cb09-4086-97d1-a8f6d21357a4 None admin] RBAC: Authorizing `identity:get_project(project_id=02833278e27846f49032cf41d32ccefb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:37.944419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67945db-cb09-4086-97d1-a8f6d21357a4 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:37.951592 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 45/87] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:43:37 2022] GET /identity/v3/projects/02833278e27846f49032cf41d32ccefb => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:37.951592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67945db-cb09-4086-97d1-a8f6d21357a4 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:37.953968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:38.001174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a323d1d-1357-4135-bfd3-216ac5d78ab7 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:38.014667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:38.043762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d2121-cfe7-4cfe-9d73-5944d4ad2e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:38.044392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d2121-cfe7-4cfe-9d73-5944d4ad2e86 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:38.044676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d2121-cfe7-4cfe-9d73-5944d4ad2e86 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:38.044954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d2121-cfe7-4cfe-9d73-5944d4ad2e86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:38.070134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67945db-cb09-4086-97d1-a8f6d21357a4 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:38.103164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac276d9-2d6a-41f7-b017-6184c63cbad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:38.103846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac276d9-2d6a-41f7-b017-6184c63cbad8 None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:38.104127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac276d9-2d6a-41f7-b017-6184c63cbad8 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:38.104407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac276d9-2d6a-41f7-b017-6184c63cbad8 None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:38.105094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac276d9-2d6a-41f7-b017-6184c63cbad8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:38.106543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac276d9-2d6a-41f7-b017-6184c63cbad8 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:38.112918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d2121-cfe7-4cfe-9d73-5944d4ad2e86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:38.114398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d2121-cfe7-4cfe-9d73-5944d4ad2e86 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:38.127599 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 46/88] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 30 20:43:37 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:43:38.135757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac276d9-2d6a-41f7-b017-6184c63cbad8 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:38.195827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:38.247541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac276d9-2d6a-41f7-b017-6184c63cbad8 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:38.247814 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 43/89] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:43:38.252889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d2121-cfe7-4cfe-9d73-5944d4ad2e86 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:38.267665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:38.291106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0f8d2-df2b-4704-941b-546b1821d8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:38.291604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f8d2-df2b-4704-941b-546b1821d8c9 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:38.291889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f8d2-df2b-4704-941b-546b1821d8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:38.292168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f8d2-df2b-4704-941b-546b1821d8c9 None admin] PATH_INFO: `/v3/users/9e9636a0c442469e88a4bc0a1fd199b3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:38.293357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0f8d2-df2b-4704-941b-546b1821d8c9 None admin] RBAC: Authorizing `identity:get_user(user_id=9e9636a0c442469e88a4bc0a1fd199b3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:38.294851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0f8d2-df2b-4704-941b-546b1821d8c9 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:38.296880 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 47/90] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:38 2022] GET /identity/v3/users/9e9636a0c442469e88a4bc0a1fd199b3 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:38.297596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0f8d2-df2b-4704-941b-546b1821d8c9 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:38.374594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d2121-cfe7-4cfe-9d73-5944d4ad2e86 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:38.416283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0f8d2-df2b-4704-941b-546b1821d8c9 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:38.420762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797e337-5590-4934-b0f0-a36d4ff5a323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:38.421642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797e337-5590-4934-b0f0-a36d4ff5a323 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:38.422111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797e337-5590-4934-b0f0-a36d4ff5a323 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:38.422595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797e337-5590-4934-b0f0-a36d4ff5a323 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:38.423711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797e337-5590-4934-b0f0-a36d4ff5a323 None admin] RBAC: Adding query filter params (role.id=c3edb43d117b427a91e426e4e42f0c63, scope.project.id=02833278e27846f49032cf41d32ccefb, user.id=9e9636a0c442469e88a4bc0a1fd199b3) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:38.424206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797e337-5590-4934-b0f0-a36d4ff5a323 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:38.426420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797e337-5590-4934-b0f0-a36d4ff5a323 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:38.438548 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 44/91] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:43:38 2022] GET /identity/v3/role_assignments?user.id=9e9636a0c442469e88a4bc0a1fd199b3&scope.project.id=02833278e27846f49032cf41d32ccefb&role.id=c3edb43d117b427a91e426e4e42f0c63 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:38.439948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797e337-5590-4934-b0f0-a36d4ff5a323 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:38.453407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:38.465759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a092d8b-52e3-41ff-a29d-90a14cab9e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:38.466404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a092d8b-52e3-41ff-a29d-90a14cab9e91 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:38.466691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a092d8b-52e3-41ff-a29d-90a14cab9e91 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:38.466974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a092d8b-52e3-41ff-a29d-90a14cab9e91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:38.467825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a092d8b-52e3-41ff-a29d-90a14cab9e91 None admin] RBAC: Adding query filter params (role.id=3b89b89da98d4ec08a0587aa13832636, scope.project.id=02833278e27846f49032cf41d32ccefb, user.id=57e206ec85774a5086d011cb1726114a) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:38.468148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a092d8b-52e3-41ff-a29d-90a14cab9e91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:38.469642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a092d8b-52e3-41ff-a29d-90a14cab9e91 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:38.476186 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 48/92] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:43:38 2022] GET /identity/v3/role_assignments?user.id=57e206ec85774a5086d011cb1726114a&scope.project.id=02833278e27846f49032cf41d32ccefb&role.id=3b89b89da98d4ec08a0587aa13832636 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:38.477075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a092d8b-52e3-41ff-a29d-90a14cab9e91 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:38.582972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:38.597411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a092d8b-52e3-41ff-a29d-90a14cab9e91 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:38.637797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797e337-5590-4934-b0f0-a36d4ff5a323 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:38.638388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d654e-a1e5-4bf1-bedf-c70331cd4865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:38.639033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d654e-a1e5-4bf1-bedf-c70331cd4865 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:38.639352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d654e-a1e5-4bf1-bedf-c70331cd4865 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:38.639639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d654e-a1e5-4bf1-bedf-c70331cd4865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:38.706700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:38.709862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09f61c-2621-4e03-b788-0c3c8610de75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:38.710621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09f61c-2621-4e03-b788-0c3c8610de75 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:38.710924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09f61c-2621-4e03-b788-0c3c8610de75 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:38.711218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09f61c-2621-4e03-b788-0c3c8610de75 None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:38.713120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09f61c-2621-4e03-b788-0c3c8610de75 None admin] RBAC: Authorizing `identity:get_project(project_id=02833278e27846f49032cf41d32ccefb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:38.714627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09f61c-2621-4e03-b788-0c3c8610de75 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:38.720160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d654e-a1e5-4bf1-bedf-c70331cd4865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:38.721921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d654e-a1e5-4bf1-bedf-c70331cd4865 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:38.728067 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 45/93] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:43:38 2022] GET /identity/v3/projects/02833278e27846f49032cf41d32ccefb => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:38.734083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09f61c-2621-4e03-b788-0c3c8610de75 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:38.833119 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 49/94] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:43:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:43:38.839892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d654e-a1e5-4bf1-bedf-c70331cd4865 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:38.938664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:38.949532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d654e-a1e5-4bf1-bedf-c70331cd4865 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:38.958899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09f61c-2621-4e03-b788-0c3c8610de75 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:38.987115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc63e97-0d8f-4490-a94f-2d0867064119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:38.988114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc63e97-0d8f-4490-a94f-2d0867064119 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:38.988603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc63e97-0d8f-4490-a94f-2d0867064119 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:38.989059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc63e97-0d8f-4490-a94f-2d0867064119 None admin] PATH_INFO: `/v3/projects/eedf6974be53495cb5e0de03dd838db0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:38.990547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc63e97-0d8f-4490-a94f-2d0867064119 None admin] RBAC: Authorizing `identity:get_project(project_id=eedf6974be53495cb5e0de03dd838db0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:38.992340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc63e97-0d8f-4490-a94f-2d0867064119 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:38.995086 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 50/95] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:43:38 2022] GET /identity/v3/projects/eedf6974be53495cb5e0de03dd838db0 => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:39.002140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc63e97-0d8f-4490-a94f-2d0867064119 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:39.048584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e803ea-4d76-4cb6-9dd4-d78e50d50972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:39.049336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e803ea-4d76-4cb6-9dd4-d78e50d50972 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:39.049770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e803ea-4d76-4cb6-9dd4-d78e50d50972 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:39.050022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e803ea-4d76-4cb6-9dd4-d78e50d50972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:39.050892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e803ea-4d76-4cb6-9dd4-d78e50d50972 None admin] RBAC: Adding query filter params (role.id=bb6a9a85fcb54a31a5a42bea4a88a5b9, scope.project.id=02833278e27846f49032cf41d32ccefb, user.id=9e9636a0c442469e88a4bc0a1fd199b3) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:39.051271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e803ea-4d76-4cb6-9dd4-d78e50d50972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:39.052810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e803ea-4d76-4cb6-9dd4-d78e50d50972 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:39.066098 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 46/96] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:43:38 2022] GET /identity/v3/role_assignments?user.id=9e9636a0c442469e88a4bc0a1fd199b3&scope.project.id=02833278e27846f49032cf41d32ccefb&role.id=bb6a9a85fcb54a31a5a42bea4a88a5b9 => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:39.114119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc63e97-0d8f-4490-a94f-2d0867064119 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:39.152728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe9106-46e6-431a-a7a0-eb4a5026bb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:39.153669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe9106-46e6-431a-a7a0-eb4a5026bb2f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:39.154133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe9106-46e6-431a-a7a0-eb4a5026bb2f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:39.154584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe9106-46e6-431a-a7a0-eb4a5026bb2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:39.155622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe9106-46e6-431a-a7a0-eb4a5026bb2f None admin] RBAC: Adding query filter params (role.id=c3edb43d117b427a91e426e4e42f0c63, scope.project.id=eedf6974be53495cb5e0de03dd838db0, user.id=9e9636a0c442469e88a4bc0a1fd199b3) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:39.156115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe9106-46e6-431a-a7a0-eb4a5026bb2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:39.157755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe9106-46e6-431a-a7a0-eb4a5026bb2f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:39.164220 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 51/97] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:43:39 2022] GET /identity/v3/role_assignments?user.id=9e9636a0c442469e88a4bc0a1fd199b3&scope.project.id=eedf6974be53495cb5e0de03dd838db0&role.id=c3edb43d117b427a91e426e4e42f0c63 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:41.402695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b730fd-65a3-4a60-aff7-887f73a0476e None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:41.403210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b730fd-65a3-4a60-aff7-887f73a0476e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:41.403303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b730fd-65a3-4a60-aff7-887f73a0476e None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:41.404757 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 47/98] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:41.420605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22706538-eeb5-4a8f-9475-8fbfb6b84902 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:41.421061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22706538-eeb5-4a8f-9475-8fbfb6b84902 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:41.421135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22706538-eeb5-4a8f-9475-8fbfb6b84902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:41.448288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-22706538-eeb5-4a8f-9475-8fbfb6b84902 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:41.449495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-22706538-eeb5-4a8f-9475-8fbfb6b84902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:41.467684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:41.527083 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 52/99] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:41.550966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b730fd-65a3-4a60-aff7-887f73a0476e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:41.565131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:41.685763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b730fd-65a3-4a60-aff7-887f73a0476e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:41.733073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3e638-7461-4eb0-82dc-5172194b1598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:41.733729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3e638-7461-4eb0-82dc-5172194b1598 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:41.734014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3e638-7461-4eb0-82dc-5172194b1598 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:41.734292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3e638-7461-4eb0-82dc-5172194b1598 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:41.738764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3e638-7461-4eb0-82dc-5172194b1598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:41.740300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3e638-7461-4eb0-82dc-5172194b1598 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:41.742183 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 48/100] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:43:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:41.748487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22706538-eeb5-4a8f-9475-8fbfb6b84902 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:41.871221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22706538-eeb5-4a8f-9475-8fbfb6b84902 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:41.910887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68d6ce-b34d-4123-8045-9785369783f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:41.911915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68d6ce-b34d-4123-8045-9785369783f6 None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:41.912432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68d6ce-b34d-4123-8045-9785369783f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:41.912925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68d6ce-b34d-4123-8045-9785369783f6 None admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:41.913858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68d6ce-b34d-4123-8045-9785369783f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:41.915713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68d6ce-b34d-4123-8045-9785369783f6 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:41.947210 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 53/101] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 30 20:43:41 2022] POST /identity/v3/projects => generated 302 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:43:42.002223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782afd7-415f-4ec9-8c70-29131e386592 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:42.002512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782afd7-415f-4ec9-8c70-29131e386592 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:42.002789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782afd7-415f-4ec9-8c70-29131e386592 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:42.006887 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 49/102] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:42.018103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c6906-3e4d-47aa-beee-9b8b1207b885 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:42.018431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c6906-3e4d-47aa-beee-9b8b1207b885 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:42.018678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c6906-3e4d-47aa-beee-9b8b1207b885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:42.031004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:42.044838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-de3c6906-3e4d-47aa-beee-9b8b1207b885 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:42.046163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-de3c6906-3e4d-47aa-beee-9b8b1207b885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:42.088421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf00cc-3b73-4c1a-9ca7-f1674c4eca42 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:42.088717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf00cc-3b73-4c1a-9ca7-f1674c4eca42 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:42.088987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf00cc-3b73-4c1a-9ca7-f1674c4eca42 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:42.090331 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 50/103] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:42.096665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83b795-f924-4905-823b-fc170ff44034 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:42.096977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83b795-f924-4905-823b-fc170ff44034 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:42.097373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83b795-f924-4905-823b-fc170ff44034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:42.124923 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 54/104] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:42.140444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bf83b795-f924-4905-823b-fc170ff44034 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:42.141689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bf83b795-f924-4905-823b-fc170ff44034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:42.151748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c6906-3e4d-47aa-beee-9b8b1207b885 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:42.270702 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 51/105] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:43:42.272103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf34487-9305-4afc-8a0d-d505b394a151 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:42.272496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf34487-9305-4afc-8a0d-d505b394a151 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:42.272779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf34487-9305-4afc-8a0d-d505b394a151 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:42.274413 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 52/106] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:42.279391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c6906-3e4d-47aa-beee-9b8b1207b885 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:42.280977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4f9d6-e984-4d47-b31e-59d5db5c3d2d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:42.281272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4f9d6-e984-4d47-b31e-59d5db5c3d2d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:42.281552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4f9d6-e984-4d47-b31e-59d5db5c3d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:42.298929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:42.310308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-98c4f9d6-e984-4d47-b31e-59d5db5c3d2d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:42.311849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-98c4f9d6-e984-4d47-b31e-59d5db5c3d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:42.322798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37357d3-1ee0-4c9b-b05d-d67b811075ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:42.323500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37357d3-1ee0-4c9b-b05d-d67b811075ef None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:42.323792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37357d3-1ee0-4c9b-b05d-d67b811075ef None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:42.324081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37357d3-1ee0-4c9b-b05d-d67b811075ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:42.326845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:42.337956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37357d3-1ee0-4c9b-b05d-d67b811075ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:42.344739 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-e37357d3-1ee0-4c9b-b05d-d67b811075ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 30 20:43:42.344739 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:42.344739 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:42.344739 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:42.344739 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:42.344739 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:42.344739 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:42.344739 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:42.344739 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:42.344739 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:42.344739 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:42.344739 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:42.344739 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:42.344739 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:42.344739 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:42.344739 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:42.345790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:42.345790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:42.345790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:42.345790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:42.345790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:42.345790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:42.345790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:42.345790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:42.345790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:42.345790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:42.345790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:42.345790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:42.345790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:42.345790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:42.345790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:42.345790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:42.346673 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:42.346673 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:42.346673 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:42.346673 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:42.346673 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:42.346673 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:42.346673 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:42.346673 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:42.346673 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:42.346673 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:42.346673 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 30 20:43:42.346673 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:43:42.346673 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 55/107] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:43:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:42.347329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37357d3-1ee0-4c9b-b05d-d67b811075ef None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:42.400405 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 53/108] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:42.402436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4f9d6-e984-4d47-b31e-59d5db5c3d2d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:42.481053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37357d3-1ee0-4c9b-b05d-d67b811075ef None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:42.523800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e56299-9569-4d51-8f73-37762c63733e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:42.525222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e56299-9569-4d51-8f73-37762c63733e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:42.525646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e56299-9569-4d51-8f73-37762c63733e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:42.526057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e56299-9569-4d51-8f73-37762c63733e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:42.537822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e56299-9569-4d51-8f73-37762c63733e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:42.540711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4f9d6-e984-4d47-b31e-59d5db5c3d2d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:42.543849 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-67e56299-9569-4d51-8f73-37762c63733e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:43:42.543849 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:42.543849 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:42.543849 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:42.543849 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:42.543849 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:42.543849 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:42.543849 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:42.543849 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:42.543849 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:42.543849 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:42.543849 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:42.543849 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:42.543849 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:42.543849 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:42.543849 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:42.544730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:42.544730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:42.544730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:42.544730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:42.544730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:42.544730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:42.544730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:42.544730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:42.544730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:42.544730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:42.544730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:42.544730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:42.544730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:42.544730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:42.544730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:42.544730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:42.545483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:42.545483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:42.545483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:42.545483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:42.545483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:42.545483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:42.545483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:42.545483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:42.545483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:42.545483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:42.545483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:43:42.545483 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:43:42.548098 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 56/109] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:43:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:42.549114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e56299-9569-4d51-8f73-37762c63733e None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:42.581362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e873159-bfef-4ff5-8a77-18188d76455b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:42.582102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e873159-bfef-4ff5-8a77-18188d76455b None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:42.582399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e873159-bfef-4ff5-8a77-18188d76455b None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:42.583870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e873159-bfef-4ff5-8a77-18188d76455b None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:42.584929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e873159-bfef-4ff5-8a77-18188d76455b None admin] RBAC: Adding query filter params (name=reader) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:42.585415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e873159-bfef-4ff5-8a77-18188d76455b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:42.588176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e873159-bfef-4ff5-8a77-18188d76455b None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:42.591247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:42.603686 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 54/110] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:43:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:42.609574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db71731-ed7a-4a00-8671-3b48ba240aa1 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:42.610853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db71731-ed7a-4a00-8671-3b48ba240aa1 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:42.611339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db71731-ed7a-4a00-8671-3b48ba240aa1 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:42.613499 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 55/111] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:42.614597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db71731-ed7a-4a00-8671-3b48ba240aa1 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:42.633998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:42.690846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e56299-9569-4d51-8f73-37762c63733e None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:42.726046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c682f-de22-4176-bb7c-6819e9eee5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:42.726697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c682f-de22-4176-bb7c-6819e9eee5a9 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:42.726982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c682f-de22-4176-bb7c-6819e9eee5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:42.727970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c682f-de22-4176-bb7c-6819e9eee5a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:42.737771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db71731-ed7a-4a00-8671-3b48ba240aa1 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:42.738655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c682f-de22-4176-bb7c-6819e9eee5a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:42.743534 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-645c682f-de22-4176-bb7c-6819e9eee5a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:43:42.743534 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:42.743534 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:42.743534 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:42.743534 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:42.743534 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:42.743534 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:42.743534 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:42.743534 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:42.743534 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:42.743534 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:42.743534 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:42.743534 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:42.743534 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:42.743534 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:42.743534 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:42.744585 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:42.744585 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:42.744585 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:42.744585 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:42.744585 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:42.744585 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:42.744585 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:42.744585 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:42.744585 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:42.744585 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:42.744585 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:42.744585 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:42.744585 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:42.744585 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:42.744585 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:42.744585 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:42.750535 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:42.750535 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:42.750535 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:42.750535 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:42.750535 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:42.750535 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:42.750535 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:42.750535 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:42.750535 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:42.750535 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:42.750535 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:43:42.750535 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:43:42.750535 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 57/112] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:43:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:42.750535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c682f-de22-4176-bb7c-6819e9eee5a9 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:42.784223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84789f04-7e93-498f-9ddc-39f9e653bb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:42.784786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84789f04-7e93-498f-9ddc-39f9e653bb4c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:42.785075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84789f04-7e93-498f-9ddc-39f9e653bb4c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:42.785359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84789f04-7e93-498f-9ddc-39f9e653bb4c None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:42.786112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84789f04-7e93-498f-9ddc-39f9e653bb4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:42.786425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84789f04-7e93-498f-9ddc-39f9e653bb4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:42.787937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84789f04-7e93-498f-9ddc-39f9e653bb4c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:42.797147 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 56/113] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:43:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:42.802800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f74cc2-9a0c-4b86-bef2-d3b1525ce4c4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:42.803099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f74cc2-9a0c-4b86-bef2-d3b1525ce4c4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:42.803411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f74cc2-9a0c-4b86-bef2-d3b1525ce4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:42.821662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-45f74cc2-9a0c-4b86-bef2-d3b1525ce4c4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:42.822858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-45f74cc2-9a0c-4b86-bef2-d3b1525ce4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:42.854713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c682f-de22-4176-bb7c-6819e9eee5a9 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:42.870339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:42.881599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:42.899567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2d500-af53-476b-80b8-5b5817e8bb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:42.899567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2d500-af53-476b-80b8-5b5817e8bb7c None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:42.899567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2d500-af53-476b-80b8-5b5817e8bb7c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:42.899567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2d500-af53-476b-80b8-5b5817e8bb7c None admin] PATH_INFO: `/v3/users/e7db8ab50eb849038f34fc401374e743` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:42.903317 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 57/114] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:42.903317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c6fab-cff1-4162-b512-ba7b696a6237 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:42.903317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c6fab-cff1-4162-b512-ba7b696a6237 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:42.903317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c6fab-cff1-4162-b512-ba7b696a6237 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:42.904535 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 58/115] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:42.909087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c6fab-cff1-4162-b512-ba7b696a6237 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:42.917077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2d500-af53-476b-80b8-5b5817e8bb7c None admin] RBAC: Authorizing `identity:get_user(user_id=e7db8ab50eb849038f34fc401374e743)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:42.918828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2d500-af53-476b-80b8-5b5817e8bb7c None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:42.921009 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 58/116] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:42 2022] GET /identity/v3/users/e7db8ab50eb849038f34fc401374e743 => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:42.921770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2d500-af53-476b-80b8-5b5817e8bb7c None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:43.027825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c6fab-cff1-4162-b512-ba7b696a6237 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:43.028271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2d500-af53-476b-80b8-5b5817e8bb7c None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:43.064149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4635d8-2de2-43f4-be25-a1bbe597a704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:43.064716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4635d8-2de2-43f4-be25-a1bbe597a704 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:43.065010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4635d8-2de2-43f4-be25-a1bbe597a704 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:43.065296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4635d8-2de2-43f4-be25-a1bbe597a704 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:43.066021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4635d8-2de2-43f4-be25-a1bbe597a704 None admin] RBAC: Adding query filter params (name=member) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:43.066338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4635d8-2de2-43f4-be25-a1bbe597a704 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:43.067779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4635d8-2de2-43f4-be25-a1bbe597a704 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:43.068560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f28f7e-2531-4320-9d93-ba5965772b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:43.069447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f28f7e-2531-4320-9d93-ba5965772b6e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:43.069926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f28f7e-2531-4320-9d93-ba5965772b6e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:43.070349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f28f7e-2531-4320-9d93-ba5965772b6e None admin] PATH_INFO: `/v3/users/57e206ec85774a5086d011cb1726114a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:43.071732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f28f7e-2531-4320-9d93-ba5965772b6e None admin] RBAC: Authorizing `identity:get_user(user_id=57e206ec85774a5086d011cb1726114a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:43.073406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f28f7e-2531-4320-9d93-ba5965772b6e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:43.075056 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 59/117] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:42 2022] GET /identity/v3/users/57e206ec85774a5086d011cb1726114a => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:43.076229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41200b5-c51d-4267-b556-7430a22ffe29 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:43.076522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41200b5-c51d-4267-b556-7430a22ffe29 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:43.076852 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 59/118] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:43:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:43.076953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41200b5-c51d-4267-b556-7430a22ffe29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:43.081898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4635d8-2de2-43f4-be25-a1bbe597a704 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:43.094723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a41200b5-c51d-4267-b556-7430a22ffe29 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:43.096038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a41200b5-c51d-4267-b556-7430a22ffe29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:43.137578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:43.147224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:43.172890 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 60/119] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:43.173979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41200b5-c51d-4267-b556-7430a22ffe29 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:43.209408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4635d8-2de2-43f4-be25-a1bbe597a704 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:43.247148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020c7be-9511-4f6d-8298-870ee09cecec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:43.247953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020c7be-9511-4f6d-8298-870ee09cecec None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:43.248325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020c7be-9511-4f6d-8298-870ee09cecec None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:43.248613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020c7be-9511-4f6d-8298-870ee09cecec None admin] PATH_INFO: `/v3/roles/member` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:43.259690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020c7be-9511-4f6d-8298-870ee09cecec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:43.265589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-e020c7be-9511-4f6d-8298-870ee09cecec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:43:43.265589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:43.265589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:43.265589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:43.265589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:43.265589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:43.265589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:43.265589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:43.265589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:43.265589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:43.265589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:43.265589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:43.265589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:43.265589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:43.265589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:43.265589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:43.266429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:43.266429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:43.266429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:43.266429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:43.266429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:43.266429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:43.266429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:43.266429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:43.266429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:43.266429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:43.266429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:43.266429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:43.266429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:43.266429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:43.266429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:43.266429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:43.267164 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:43.267164 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:43.267164 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:43.267164 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:43.267164 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:43.267164 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:43.267164 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:43.267164 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:43.267164 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:43.267164 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:43.267164 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:43:43.267164 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:43:43.267164 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 60/120] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:43:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:43.267853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020c7be-9511-4f6d-8298-870ee09cecec None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:43.297417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41200b5-c51d-4267-b556-7430a22ffe29 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:43.332235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5896e-4920-44e8-aef1-1527987cc8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:43.332866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5896e-4920-44e8-aef1-1527987cc8eb None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:43.333156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5896e-4920-44e8-aef1-1527987cc8eb None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:43.333459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5896e-4920-44e8-aef1-1527987cc8eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:43.367528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020c7be-9511-4f6d-8298-870ee09cecec None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:43.375780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:43.380892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:43.404266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3a079-1a1a-4169-830b-5549a5ae7b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:43.404933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3a079-1a1a-4169-830b-5549a5ae7b55 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:43.405228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3a079-1a1a-4169-830b-5549a5ae7b55 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:43.405514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3a079-1a1a-4169-830b-5549a5ae7b55 None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:43.406699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3a079-1a1a-4169-830b-5549a5ae7b55 None admin] RBAC: Authorizing `identity:get_project(project_id=02833278e27846f49032cf41d32ccefb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:43.408345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3a079-1a1a-4169-830b-5549a5ae7b55 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:43.410063 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 61/121] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:43:43 2022] GET /identity/v3/projects/02833278e27846f49032cf41d32ccefb => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:43.410777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5896e-4920-44e8-aef1-1527987cc8eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:43.410886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3a079-1a1a-4169-830b-5549a5ae7b55 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:43.412285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5896e-4920-44e8-aef1-1527987cc8eb None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:43.526926 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 61/122] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:43:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:43:43.527865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5896e-4920-44e8-aef1-1527987cc8eb None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:43.529602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3a079-1a1a-4169-830b-5549a5ae7b55 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:43.566521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfefba4-3036-4c5f-af0c-37f047893951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:43.567987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfefba4-3036-4c5f-af0c-37f047893951 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:43.568470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfefba4-3036-4c5f-af0c-37f047893951 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:43.568939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfefba4-3036-4c5f-af0c-37f047893951 None admin] PATH_INFO: `/v3/users/9e9636a0c442469e88a4bc0a1fd199b3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:43.570435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfefba4-3036-4c5f-af0c-37f047893951 None admin] RBAC: Authorizing `identity:get_user(user_id=9e9636a0c442469e88a4bc0a1fd199b3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:43.572896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfefba4-3036-4c5f-af0c-37f047893951 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:43.574790 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 62/123] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:43 2022] GET /identity/v3/users/9e9636a0c442469e88a4bc0a1fd199b3 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:43.575758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfefba4-3036-4c5f-af0c-37f047893951 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:43.612916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:43.626088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:43.645832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5896e-4920-44e8-aef1-1527987cc8eb None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:43.683270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b5cd3-881f-4386-9a53-9deb6780877f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:43.683931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b5cd3-881f-4386-9a53-9deb6780877f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:43.684214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b5cd3-881f-4386-9a53-9deb6780877f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:43.684487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b5cd3-881f-4386-9a53-9deb6780877f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:43.685602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfefba4-3036-4c5f-af0c-37f047893951 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:43.696376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b5cd3-881f-4386-9a53-9deb6780877f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:43.701446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-8c4b5cd3-881f-4386-9a53-9deb6780877f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:43:43.701446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:43.701446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:43.701446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:43.701446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:43.701446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:43.701446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:43.701446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:43.701446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:43.701446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:43.701446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:43.701446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:43.701446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:43.701446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:43.701446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:43.701446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:43.702429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:43.702429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:43.702429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:43.702429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:43.702429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:43.702429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:43.702429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:43.702429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:43.702429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:43.702429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:43.702429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:43.702429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:43.702429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:43.702429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:43.702429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:43.702429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:43.703423 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:43.703423 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:43.703423 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:43.703423 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:43.703423 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:43.703423 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:43.703423 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:43.703423 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:43.703423 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:43.703423 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:43.703423 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:43:43.703423 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:43:43.705334 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 62/124] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:43:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:43.708593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b5cd3-881f-4386-9a53-9deb6780877f None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:43.726551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9213f-a7f4-4d75-9f11-a66a6911d3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:43.727937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9213f-a7f4-4d75-9f11-a66a6911d3f1 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:43.728227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9213f-a7f4-4d75-9f11-a66a6911d3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:43.728618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9213f-a7f4-4d75-9f11-a66a6911d3f1 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:43.729335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9213f-a7f4-4d75-9f11-a66a6911d3f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:43.729643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9213f-a7f4-4d75-9f11-a66a6911d3f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:43.731025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9213f-a7f4-4d75-9f11-a66a6911d3f1 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:43.739149 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 63/125] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:43:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:43.745117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9213f-a7f4-4d75-9f11-a66a6911d3f1 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:43.814989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b5cd3-881f-4386-9a53-9deb6780877f None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:43.844115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:43.850678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9213f-a7f4-4d75-9f11-a66a6911d3f1 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:43.851239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3444f-499b-4c9a-a4fb-58233e9ed838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:43.852773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3444f-499b-4c9a-a4fb-58233e9ed838 None admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:43.853327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3444f-499b-4c9a-a4fb-58233e9ed838 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:43.853755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3444f-499b-4c9a-a4fb-58233e9ed838 None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb/users/57e206ec85774a5086d011cb1726114a/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:43.855765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3444f-499b-4c9a-a4fb-58233e9ed838 None admin] RBAC: Authorizing `identity:create_grant(project_id=02833278e27846f49032cf41d32ccefb, user_id=57e206ec85774a5086d011cb1726114a, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:43.857238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3444f-499b-4c9a-a4fb-58233e9ed838 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:43.861721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:43.871406 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 63/126] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:43:43 2022] PUT /identity/v3/projects/02833278e27846f49032cf41d32ccefb/users/57e206ec85774a5086d011cb1726114a/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:43:43.872145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3444f-499b-4c9a-a4fb-58233e9ed838 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:43.891803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81d337-33e1-4f78-8d3b-ed2f7f0feb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:43.892672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81d337-33e1-4f78-8d3b-ed2f7f0feb13 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:43.893208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81d337-33e1-4f78-8d3b-ed2f7f0feb13 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:43.893740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81d337-33e1-4f78-8d3b-ed2f7f0feb13 None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:43.895126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81d337-33e1-4f78-8d3b-ed2f7f0feb13 None admin] RBAC: Authorizing `identity:get_project(project_id=02833278e27846f49032cf41d32ccefb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:43.897307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81d337-33e1-4f78-8d3b-ed2f7f0feb13 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:43.899416 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 64/127] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:43:43 2022] GET /identity/v3/projects/02833278e27846f49032cf41d32ccefb => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:43.900082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81d337-33e1-4f78-8d3b-ed2f7f0feb13 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:44.020399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3444f-499b-4c9a-a4fb-58233e9ed838 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:44.050551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81d337-33e1-4f78-8d3b-ed2f7f0feb13 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:44.063468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4d20e-9065-41a1-a9eb-49381d2cd701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:44.064438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4d20e-9065-41a1-a9eb-49381d2cd701 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:44.064937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4d20e-9065-41a1-a9eb-49381d2cd701 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:44.065409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4d20e-9065-41a1-a9eb-49381d2cd701 None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:44.066868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4d20e-9065-41a1-a9eb-49381d2cd701 None admin] RBAC: Authorizing `identity:get_project(project_id=02833278e27846f49032cf41d32ccefb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:44.068827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4d20e-9065-41a1-a9eb-49381d2cd701 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:44.071115 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 64/128] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:43:43 2022] GET /identity/v3/projects/02833278e27846f49032cf41d32ccefb => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:44.072130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4d20e-9065-41a1-a9eb-49381d2cd701 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:44.093018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b50548-865f-4390-a41d-9fb697130cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:44.093652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b50548-865f-4390-a41d-9fb697130cdf None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:44.093948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b50548-865f-4390-a41d-9fb697130cdf None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:44.094233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b50548-865f-4390-a41d-9fb697130cdf None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:44.094958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b50548-865f-4390-a41d-9fb697130cdf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:44.095269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b50548-865f-4390-a41d-9fb697130cdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:44.096705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b50548-865f-4390-a41d-9fb697130cdf None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:44.106337 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 65/129] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:43:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:44.107021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b50548-865f-4390-a41d-9fb697130cdf None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:44.158632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:44.176881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:44.205180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4d20e-9065-41a1-a9eb-49381d2cd701 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:44.249678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44792b3-43c4-4964-bf7c-35cce4718a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:44.250745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44792b3-43c4-4964-bf7c-35cce4718a64 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:44.251339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44792b3-43c4-4964-bf7c-35cce4718a64 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:44.251700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44792b3-43c4-4964-bf7c-35cce4718a64 None admin] PATH_INFO: `/v3/users/9e9636a0c442469e88a4bc0a1fd199b3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:44.252911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44792b3-43c4-4964-bf7c-35cce4718a64 None admin] RBAC: Authorizing `identity:get_user(user_id=9e9636a0c442469e88a4bc0a1fd199b3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:44.253015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b50548-865f-4390-a41d-9fb697130cdf None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:44.254626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44792b3-43c4-4964-bf7c-35cce4718a64 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:44.257185 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 65/130] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:44 2022] GET /identity/v3/users/9e9636a0c442469e88a4bc0a1fd199b3 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:44.257939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44792b3-43c4-4964-bf7c-35cce4718a64 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:44.295875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996c73b-6137-4d08-98b6-087a6a66223a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:44.296556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996c73b-6137-4d08-98b6-087a6a66223a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:44.296846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996c73b-6137-4d08-98b6-087a6a66223a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:44.297130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996c73b-6137-4d08-98b6-087a6a66223a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:44.297983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996c73b-6137-4d08-98b6-087a6a66223a None admin] RBAC: Adding query filter params (role.id=db8677d195074e639671c1d9bf559e95, scope.project.id=02833278e27846f49032cf41d32ccefb, user.id=e7db8ab50eb849038f34fc401374e743) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:44.298300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996c73b-6137-4d08-98b6-087a6a66223a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:44.299901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996c73b-6137-4d08-98b6-087a6a66223a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:44.311514 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 66/131] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:43:44 2022] GET /identity/v3/role_assignments?user.id=e7db8ab50eb849038f34fc401374e743&scope.project.id=02833278e27846f49032cf41d32ccefb&role.id=db8677d195074e639671c1d9bf559e95 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:44.312640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996c73b-6137-4d08-98b6-087a6a66223a None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:44.391893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44792b3-43c4-4964-bf7c-35cce4718a64 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:44.426886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:44.438364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2658df5-296c-485a-b936-8feb806a24bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:44.439905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2658df5-296c-485a-b936-8feb806a24bc None admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:44.440198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2658df5-296c-485a-b936-8feb806a24bc None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:44.440487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2658df5-296c-485a-b936-8feb806a24bc None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb/users/9e9636a0c442469e88a4bc0a1fd199b3/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:44.442794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2658df5-296c-485a-b936-8feb806a24bc None admin] RBAC: Authorizing `identity:create_grant(project_id=02833278e27846f49032cf41d32ccefb, user_id=9e9636a0c442469e88a4bc0a1fd199b3, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:44.444372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2658df5-296c-485a-b936-8feb806a24bc None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:44.464930 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 66/132] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:43:44 2022] PUT /identity/v3/projects/02833278e27846f49032cf41d32ccefb/users/9e9636a0c442469e88a4bc0a1fd199b3/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:43:44.465969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2658df5-296c-485a-b936-8feb806a24bc None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:44.561762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996c73b-6137-4d08-98b6-087a6a66223a None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:44.569638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:44.609457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2658df5-296c-485a-b936-8feb806a24bc None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:44.629104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bad394-ac8f-41a5-adde-2d6dd9929582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:44.630684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bad394-ac8f-41a5-adde-2d6dd9929582 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:44.631516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bad394-ac8f-41a5-adde-2d6dd9929582 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:44.635706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bad394-ac8f-41a5-adde-2d6dd9929582 None admin] PATH_INFO: `/v3/users/9e9636a0c442469e88a4bc0a1fd199b3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:44.641289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bad394-ac8f-41a5-adde-2d6dd9929582 None admin] RBAC: Authorizing `identity:get_user(user_id=9e9636a0c442469e88a4bc0a1fd199b3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:44.643326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bad394-ac8f-41a5-adde-2d6dd9929582 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:44.650797 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 67/133] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:44 2022] GET /identity/v3/users/9e9636a0c442469e88a4bc0a1fd199b3 => generated 275 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:44.652590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbc571-b11a-408d-b8f3-217e40790a3f None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:44.654206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbc571-b11a-408d-b8f3-217e40790a3f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:44.654687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbc571-b11a-408d-b8f3-217e40790a3f None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:44.657554 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 68/134] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:44.660509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbc571-b11a-408d-b8f3-217e40790a3f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:44.689297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf9834-f895-4b90-9046-b59e1bc352bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:44.690677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf9834-f895-4b90-9046-b59e1bc352bc None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:44.691423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf9834-f895-4b90-9046-b59e1bc352bc None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:44.691932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf9834-f895-4b90-9046-b59e1bc352bc None admin] PATH_INFO: `/v3/projects/eedf6974be53495cb5e0de03dd838db0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:44.694110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf9834-f895-4b90-9046-b59e1bc352bc None admin] RBAC: Authorizing `identity:get_project(project_id=eedf6974be53495cb5e0de03dd838db0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:44.695956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf9834-f895-4b90-9046-b59e1bc352bc None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:44.698854 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 67/135] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:43:44 2022] GET /identity/v3/projects/eedf6974be53495cb5e0de03dd838db0 => generated 312 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:44.700623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3c38b-a0d3-4c7f-bbdf-4c6a7eb2416e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:44.701071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3c38b-a0d3-4c7f-bbdf-4c6a7eb2416e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:44.701502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3c38b-a0d3-4c7f-bbdf-4c6a7eb2416e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:44.725320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-15c3c38b-a0d3-4c7f-bbdf-4c6a7eb2416e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:44.726659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-15c3c38b-a0d3-4c7f-bbdf-4c6a7eb2416e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:44.786281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:44.794250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbc571-b11a-408d-b8f3-217e40790a3f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:44.807851 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 68/136] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:44.808868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3c38b-a0d3-4c7f-bbdf-4c6a7eb2416e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:44.833726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c7487-7c74-4c2e-9df1-886a26093140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:44.834642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c7487-7c74-4c2e-9df1-886a26093140 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:44.835086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c7487-7c74-4c2e-9df1-886a26093140 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:44.835949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c7487-7c74-4c2e-9df1-886a26093140 None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:44.837901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c7487-7c74-4c2e-9df1-886a26093140 None admin] RBAC: Authorizing `identity:get_project(project_id=02833278e27846f49032cf41d32ccefb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:44.839548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c7487-7c74-4c2e-9df1-886a26093140 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:44.842213 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 69/137] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:43:44 2022] GET /identity/v3/projects/02833278e27846f49032cf41d32ccefb => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:44.847941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c7487-7c74-4c2e-9df1-886a26093140 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:44.903663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:44.967650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c7487-7c74-4c2e-9df1-886a26093140 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:45.018171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3c38b-a0d3-4c7f-bbdf-4c6a7eb2416e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:45.026018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a927e-9ce8-42c0-bd94-5f29e6c6c87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:45.026986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a927e-9ce8-42c0-bd94-5f29e6c6c87a None admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:45.027453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a927e-9ce8-42c0-bd94-5f29e6c6c87a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:45.027886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a927e-9ce8-42c0-bd94-5f29e6c6c87a None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb/users/9e9636a0c442469e88a4bc0a1fd199b3/roles/bb6a9a85fcb54a31a5a42bea4a88a5b9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:45.040275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a927e-9ce8-42c0-bd94-5f29e6c6c87a None admin] RBAC: Authorizing `identity:create_grant(project_id=02833278e27846f49032cf41d32ccefb, user_id=9e9636a0c442469e88a4bc0a1fd199b3, role_id=bb6a9a85fcb54a31a5a42bea4a88a5b9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:45.041896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a927e-9ce8-42c0-bd94-5f29e6c6c87a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:45.056499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f0071-ccd2-4ed0-8d65-3fabf781739d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:45.057215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f0071-ccd2-4ed0-8d65-3fabf781739d None admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:45.057497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f0071-ccd2-4ed0-8d65-3fabf781739d None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:45.057768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f0071-ccd2-4ed0-8d65-3fabf781739d None admin] PATH_INFO: `/v3/projects/eedf6974be53495cb5e0de03dd838db0/users/9e9636a0c442469e88a4bc0a1fd199b3/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:45.059780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f0071-ccd2-4ed0-8d65-3fabf781739d None admin] RBAC: Authorizing `identity:create_grant(project_id=eedf6974be53495cb5e0de03dd838db0, user_id=9e9636a0c442469e88a4bc0a1fd199b3, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:45.061224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f0071-ccd2-4ed0-8d65-3fabf781739d None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:45.074086 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 70/138] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:43:44 2022] PUT /identity/v3/projects/02833278e27846f49032cf41d32ccefb/users/9e9636a0c442469e88a4bc0a1fd199b3/roles/bb6a9a85fcb54a31a5a42bea4a88a5b9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:43:45.074946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a927e-9ce8-42c0-bd94-5f29e6c6c87a None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:45.076471 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 69/139] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:43:44 2022] PUT /identity/v3/projects/eedf6974be53495cb5e0de03dd838db0/users/9e9636a0c442469e88a4bc0a1fd199b3/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:43:45.250033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:45.253545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a927e-9ce8-42c0-bd94-5f29e6c6c87a None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:45.296933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e64d95-9432-474f-8655-4df3692f2612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:45.297617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e64d95-9432-474f-8655-4df3692f2612 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:45.297910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e64d95-9432-474f-8655-4df3692f2612 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:45.298194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e64d95-9432-474f-8655-4df3692f2612 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:45.299478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e64d95-9432-474f-8655-4df3692f2612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:45.300983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e64d95-9432-474f-8655-4df3692f2612 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:45.302637 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 71/140] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:43:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:45.308795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f0071-ccd2-4ed0-8d65-3fabf781739d None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:45.378232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:45.460393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f0071-ccd2-4ed0-8d65-3fabf781739d None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:45.498998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a539b72-4108-4a92-ab32-b382c1dcf55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:45.499662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a539b72-4108-4a92-ab32-b382c1dcf55f None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:45.499942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a539b72-4108-4a92-ab32-b382c1dcf55f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:45.500271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a539b72-4108-4a92-ab32-b382c1dcf55f None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:45.500930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a539b72-4108-4a92-ab32-b382c1dcf55f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:45.502377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a539b72-4108-4a92-ab32-b382c1dcf55f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:45.531082 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 70/141] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 30 20:43:45 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:43:46.714745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa57af1-185e-437c-964c-e7e45f38fd12 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:46.715473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa57af1-185e-437c-964c-e7e45f38fd12 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:46.715473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa57af1-185e-437c-964c-e7e45f38fd12 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:46.716686 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 72/142] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:46.722028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b3c68-b008-47d5-8fb6-bc05bf911e6d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:46.722869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b3c68-b008-47d5-8fb6-bc05bf911e6d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:46.723453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b3c68-b008-47d5-8fb6-bc05bf911e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:46.748338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ce5b3c68-b008-47d5-8fb6-bc05bf911e6d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:46.749541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ce5b3c68-b008-47d5-8fb6-bc05bf911e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:46.831915 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 71/143] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:46.874781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa57af1-185e-437c-964c-e7e45f38fd12 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:47.039046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa57af1-185e-437c-964c-e7e45f38fd12 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:47.080969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75538e-4703-4fad-8905-2cad166663c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:47.081840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75538e-4703-4fad-8905-2cad166663c5 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:47.082142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75538e-4703-4fad-8905-2cad166663c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:47.082423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75538e-4703-4fad-8905-2cad166663c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:47.099419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75538e-4703-4fad-8905-2cad166663c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:47.105069 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-8a75538e-4703-4fad-8905-2cad166663c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:43:47.105069 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:47.105069 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:47.105069 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:47.105069 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:47.105069 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:47.105069 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:47.105069 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:47.105069 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:47.105069 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:47.105069 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:47.105069 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:47.105069 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:47.105069 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:47.105069 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:47.105069 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:47.105959 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:47.105959 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:47.105959 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:47.105959 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:47.105959 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:47.105959 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:47.105959 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:47.105959 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:47.105959 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:47.105959 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:47.105959 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:47.105959 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:47.105959 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:47.105959 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:47.105959 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:47.105959 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:47.106733 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:47.106733 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:47.106733 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:47.106733 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:47.106733 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:47.106733 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:47.106733 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:47.106733 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:47.106733 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:47.106733 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:47.106733 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:43:47.106733 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:43:47.106733 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 73/144] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:43:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:47.116294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b3c68-b008-47d5-8fb6-bc05bf911e6d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:47.167374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:47.251422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b3c68-b008-47d5-8fb6-bc05bf911e6d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:47.295249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90394ff9-34d6-43a8-a3a0-9d70ba419401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:47.295929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90394ff9-34d6-43a8-a3a0-9d70ba419401 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:47.296209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90394ff9-34d6-43a8-a3a0-9d70ba419401 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:47.296485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90394ff9-34d6-43a8-a3a0-9d70ba419401 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:47.297233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90394ff9-34d6-43a8-a3a0-9d70ba419401 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:47.297537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90394ff9-34d6-43a8-a3a0-9d70ba419401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:47.299017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90394ff9-34d6-43a8-a3a0-9d70ba419401 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:47.311612 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 72/145] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:43:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:47.318056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75538e-4703-4fad-8905-2cad166663c5 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:47.369172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:47.455481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75538e-4703-4fad-8905-2cad166663c5 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:47.497823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38617998-77a3-4701-873d-fa4139ebb998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:47.498488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38617998-77a3-4701-873d-fa4139ebb998 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:47.498778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38617998-77a3-4701-873d-fa4139ebb998 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:47.499060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38617998-77a3-4701-873d-fa4139ebb998 None admin] PATH_INFO: `/v3/users/57e206ec85774a5086d011cb1726114a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:47.500317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38617998-77a3-4701-873d-fa4139ebb998 None admin] RBAC: Authorizing `identity:get_user(user_id=57e206ec85774a5086d011cb1726114a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:47.501860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38617998-77a3-4701-873d-fa4139ebb998 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:47.503469 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 74/146] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:47 2022] GET /identity/v3/users/57e206ec85774a5086d011cb1726114a => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:47.509636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90394ff9-34d6-43a8-a3a0-9d70ba419401 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:47.517821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec48783-575a-4f43-9b8d-f24aa65b83da None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:47.518118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec48783-575a-4f43-9b8d-f24aa65b83da None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:47.518396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec48783-575a-4f43-9b8d-f24aa65b83da None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:47.519925 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 75/147] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:43:47.529123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279c617-a793-497e-8fe3-83b6d99bc8db None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:47.529425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279c617-a793-497e-8fe3-83b6d99bc8db None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:47.529716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279c617-a793-497e-8fe3-83b6d99bc8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:47.556559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c279c617-a793-497e-8fe3-83b6d99bc8db None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:47.558084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c279c617-a793-497e-8fe3-83b6d99bc8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:47.672325 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 76/148] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:43:47.676994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:47.695158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90394ff9-34d6-43a8-a3a0-9d70ba419401 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:47.753483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279c617-a793-497e-8fe3-83b6d99bc8db None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:47.754556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf647af0-3b11-4a2c-ab97-07d487c149f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:47.755190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf647af0-3b11-4a2c-ab97-07d487c149f0 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:47.755625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf647af0-3b11-4a2c-ab97-07d487c149f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:47.755908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf647af0-3b11-4a2c-ab97-07d487c149f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:47.801294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:47.897478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf647af0-3b11-4a2c-ab97-07d487c149f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:47.900049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf647af0-3b11-4a2c-ab97-07d487c149f0 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:47.920174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279c617-a793-497e-8fe3-83b6d99bc8db None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:47.982835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb0e33-b840-4d0d-835a-b6f78554f89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:47.983624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb0e33-b840-4d0d-835a-b6f78554f89c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:47.984004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb0e33-b840-4d0d-835a-b6f78554f89c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:47.984357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb0e33-b840-4d0d-835a-b6f78554f89c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:48.023351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb0e33-b840-4d0d-835a-b6f78554f89c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:48.029045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-87cb0e33-b840-4d0d-835a-b6f78554f89c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 30 20:43:48.029045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:48.029045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:48.029045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:48.029045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:48.029045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:48.029045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:48.029045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:48.029045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:48.029045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:48.029045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:48.029045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:48.029045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:48.029045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:48.029045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:48.029045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:48.029896 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:48.029896 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:48.029896 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:48.029896 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:48.029896 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:48.029896 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:48.029896 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:48.029896 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:48.029896 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:48.029896 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:48.029896 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:48.029896 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:48.029896 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:48.029896 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:48.029896 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:48.029896 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:48.030664 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:48.030664 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:48.030664 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:48.030664 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:48.030664 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:48.030664 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:48.030664 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:48.030664 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:48.030664 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:48.030664 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:48.030664 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 30 20:43:48.030664 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:43:48.030664 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 77/149] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:43:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:43:48.038079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb0e33-b840-4d0d-835a-b6f78554f89c None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:48.041414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:48.057801 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 73/150] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:43:48.063213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf647af0-3b11-4a2c-ab97-07d487c149f0 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:48.247676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:48.258718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf647af0-3b11-4a2c-ab97-07d487c149f0 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:48.288821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb0e33-b840-4d0d-835a-b6f78554f89c None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:48.314840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ba5dc-c80f-4e29-8ff7-67318a219cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:48.315990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ba5dc-c80f-4e29-8ff7-67318a219cf9 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:48.316740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ba5dc-c80f-4e29-8ff7-67318a219cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:48.317227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ba5dc-c80f-4e29-8ff7-67318a219cf9 None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:48.318789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ba5dc-c80f-4e29-8ff7-67318a219cf9 None admin] RBAC: Authorizing `identity:get_project(project_id=02833278e27846f49032cf41d32ccefb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:48.320476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ba5dc-c80f-4e29-8ff7-67318a219cf9 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:48.322882 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 74/151] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:43:48 2022] GET /identity/v3/projects/02833278e27846f49032cf41d32ccefb => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:43:48.324757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c531d4-0bc3-4465-b863-4cd7cfa20402 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:48.325413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c531d4-0bc3-4465-b863-4cd7cfa20402 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:48.325932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c531d4-0bc3-4465-b863-4cd7cfa20402 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:48.327673 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 75/152] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:48.332248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c531d4-0bc3-4465-b863-4cd7cfa20402 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:48.374048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31934a57-b1bd-4651-a63e-717f65c82927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:48.374689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31934a57-b1bd-4651-a63e-717f65c82927 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:48.374980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31934a57-b1bd-4651-a63e-717f65c82927 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:48.375259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31934a57-b1bd-4651-a63e-717f65c82927 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:48.376029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31934a57-b1bd-4651-a63e-717f65c82927 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:48.376339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31934a57-b1bd-4651-a63e-717f65c82927 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:48.377744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31934a57-b1bd-4651-a63e-717f65c82927 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:48.398757 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 78/153] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:43:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:48.400006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec54db1-43a6-41a4-8545-3bfb7180f2a5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:48.400296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec54db1-43a6-41a4-8545-3bfb7180f2a5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:48.400578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec54db1-43a6-41a4-8545-3bfb7180f2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:48.419698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:48.437312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9ec54db1-43a6-41a4-8545-3bfb7180f2a5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:48.438528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9ec54db1-43a6-41a4-8545-3bfb7180f2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:48.487322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c531d4-0bc3-4465-b863-4cd7cfa20402 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:48.537931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1a438-6164-449e-a840-978a655154f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:48.538561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1a438-6164-449e-a840-978a655154f3 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:48.538900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1a438-6164-449e-a840-978a655154f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:48.539122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1a438-6164-449e-a840-978a655154f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:48.540030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1a438-6164-449e-a840-978a655154f3 None admin] RBAC: Adding query filter params (role.id=3b89b89da98d4ec08a0587aa13832636, scope.project.id=02833278e27846f49032cf41d32ccefb, user.id=57e206ec85774a5086d011cb1726114a) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:48.540341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1a438-6164-449e-a840-978a655154f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:48.541788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1a438-6164-449e-a840-978a655154f3 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:48.556028 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 76/154] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:43:48 2022] GET /identity/v3/role_assignments?user.id=57e206ec85774a5086d011cb1726114a&scope.project.id=02833278e27846f49032cf41d32ccefb&role.id=3b89b89da98d4ec08a0587aa13832636 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:48.557038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1a438-6164-449e-a840-978a655154f3 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:48.612682 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 79/155] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:48.672281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec54db1-43a6-41a4-8545-3bfb7180f2a5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:48.703345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1a438-6164-449e-a840-978a655154f3 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:48.751684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:48.757043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069a182-f40d-4c5a-8379-afe494f034c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:48.757684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069a182-f40d-4c5a-8379-afe494f034c4 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:48.757975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069a182-f40d-4c5a-8379-afe494f034c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:48.758826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069a182-f40d-4c5a-8379-afe494f034c4 None admin] PATH_INFO: `/v3/users/e7db8ab50eb849038f34fc401374e743` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:48.764300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069a182-f40d-4c5a-8379-afe494f034c4 None admin] RBAC: Authorizing `identity:get_user(user_id=e7db8ab50eb849038f34fc401374e743)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:48.765804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069a182-f40d-4c5a-8379-afe494f034c4 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:48.767569 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 77/156] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:48 2022] GET /identity/v3/users/e7db8ab50eb849038f34fc401374e743 => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:48.773395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069a182-f40d-4c5a-8379-afe494f034c4 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:48.794288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:48.829945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec54db1-43a6-41a4-8545-3bfb7180f2a5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:48.889605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260769b3-7dad-43da-a4d3-529432455165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:48.890290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260769b3-7dad-43da-a4d3-529432455165 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:48.890574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260769b3-7dad-43da-a4d3-529432455165 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:48.890849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260769b3-7dad-43da-a4d3-529432455165 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:48.913456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260769b3-7dad-43da-a4d3-529432455165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:48.919040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-260769b3-7dad-43da-a4d3-529432455165 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:43:48.919040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:48.919040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:48.919040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:48.919040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:48.919040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:48.919040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:48.919040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:48.919040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:48.919040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:48.919040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:48.919040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:48.919040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:48.919040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:48.919040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:48.919040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:48.920205 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:48.920205 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:48.920205 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:48.920205 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:48.920205 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:48.920205 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:48.920205 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:48.920205 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:48.920205 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:48.920205 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:48.920205 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:48.920205 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:48.920205 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:48.920205 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:48.920205 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:48.920205 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:48.921020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:48.921020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:48.921020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:48.921020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:48.921020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:48.921020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:48.921020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:48.921020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:48.921020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:48.921020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:48.921020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:43:48.921020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:43:48.924767 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 80/157] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:43:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:43:48.931759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069a182-f40d-4c5a-8379-afe494f034c4 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:48.932329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260769b3-7dad-43da-a4d3-529432455165 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:49.008963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db6f54-1aea-4b75-9244-aa5a01ad6dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:49.009649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db6f54-1aea-4b75-9244-aa5a01ad6dea None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:49.010074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db6f54-1aea-4b75-9244-aa5a01ad6dea None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:49.010360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db6f54-1aea-4b75-9244-aa5a01ad6dea None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:49.018974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db6f54-1aea-4b75-9244-aa5a01ad6dea None admin] RBAC: Authorizing `identity:get_project(project_id=02833278e27846f49032cf41d32ccefb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:49.020660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db6f54-1aea-4b75-9244-aa5a01ad6dea None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:49.022655 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 78/158] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:43:48 2022] GET /identity/v3/projects/02833278e27846f49032cf41d32ccefb => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:43:49.030797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db6f54-1aea-4b75-9244-aa5a01ad6dea None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:49.093007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260769b3-7dad-43da-a4d3-529432455165 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:49.150104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd4fe0-0865-4ea3-900e-f8e5cdc71675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:49.150677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd4fe0-0865-4ea3-900e-f8e5cdc71675 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:49.150957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd4fe0-0865-4ea3-900e-f8e5cdc71675 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:49.151240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd4fe0-0865-4ea3-900e-f8e5cdc71675 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:49.152065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd4fe0-0865-4ea3-900e-f8e5cdc71675 None admin] RBAC: Adding query filter params (name=member) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:49.152426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd4fe0-0865-4ea3-900e-f8e5cdc71675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:49.153847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd4fe0-0865-4ea3-900e-f8e5cdc71675 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:49.167732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:49.168934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:49.171634 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 81/159] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:43:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:49.176261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd4fe0-0865-4ea3-900e-f8e5cdc71675 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:49.187393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db6f54-1aea-4b75-9244-aa5a01ad6dea None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:49.230337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c90281-d126-4e2d-bc87-135cacce3064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:49.231307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c90281-d126-4e2d-bc87-135cacce3064 None admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:49.231856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c90281-d126-4e2d-bc87-135cacce3064 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:49.232289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c90281-d126-4e2d-bc87-135cacce3064 None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb/users/e7db8ab50eb849038f34fc401374e743/roles/db8677d195074e639671c1d9bf559e95` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:49.234650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c90281-d126-4e2d-bc87-135cacce3064 None admin] RBAC: Authorizing `identity:create_grant(project_id=02833278e27846f49032cf41d32ccefb, user_id=e7db8ab50eb849038f34fc401374e743, role_id=db8677d195074e639671c1d9bf559e95)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:49.237491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c90281-d126-4e2d-bc87-135cacce3064 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:49.259385 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 79/160] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:43:49 2022] PUT /identity/v3/projects/02833278e27846f49032cf41d32ccefb/users/e7db8ab50eb849038f34fc401374e743/roles/db8677d195074e639671c1d9bf559e95 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:43:49.261806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4dee0-e834-4641-84c3-b2ce8d26223c None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:49.262947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4dee0-e834-4641-84c3-b2ce8d26223c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:49.263481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4dee0-e834-4641-84c3-b2ce8d26223c None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:49.266945 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 80/161] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:49.276292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42a81d-8e76-495c-a747-3ca7f61f7d40 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:49.277226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42a81d-8e76-495c-a747-3ca7f61f7d40 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:49.277688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42a81d-8e76-495c-a747-3ca7f61f7d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:49.306209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ef42a81d-8e76-495c-a747-3ca7f61f7d40 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:49.307775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ef42a81d-8e76-495c-a747-3ca7f61f7d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:49.394511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd4fe0-0865-4ea3-900e-f8e5cdc71675 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:49.398223 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 81/162] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:49.426598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42a81d-8e76-495c-a747-3ca7f61f7d40 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:49.449502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91da6b-bae5-4f65-a8a5-53f24f065835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:49.450320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91da6b-bae5-4f65-a8a5-53f24f065835 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:49.450945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91da6b-bae5-4f65-a8a5-53f24f065835 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:49.451370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91da6b-bae5-4f65-a8a5-53f24f065835 None admin] PATH_INFO: `/v3/users/9e9636a0c442469e88a4bc0a1fd199b3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:49.452679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91da6b-bae5-4f65-a8a5-53f24f065835 None admin] RBAC: Authorizing `identity:get_user(user_id=9e9636a0c442469e88a4bc0a1fd199b3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:49.454237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91da6b-bae5-4f65-a8a5-53f24f065835 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:49.467332 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 82/163] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:49 2022] GET /identity/v3/users/9e9636a0c442469e88a4bc0a1fd199b3 => generated 275 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:49.467332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91da6b-bae5-4f65-a8a5-53f24f065835 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:49.521064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:49.623317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:49.629491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42a81d-8e76-495c-a747-3ca7f61f7d40 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:49.691848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91da6b-bae5-4f65-a8a5-53f24f065835 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:49.704193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414e8bc-12b9-4ff7-812f-77e46b58ae71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:49.704845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414e8bc-12b9-4ff7-812f-77e46b58ae71 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:49.705128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414e8bc-12b9-4ff7-812f-77e46b58ae71 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:49.705402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414e8bc-12b9-4ff7-812f-77e46b58ae71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:49.732048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414e8bc-12b9-4ff7-812f-77e46b58ae71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:49.740729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-1414e8bc-12b9-4ff7-812f-77e46b58ae71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:43:49.740729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:49.740729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:49.740729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:49.740729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:49.740729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:49.740729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:49.740729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:49.740729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:49.740729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:49.740729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:49.740729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:49.740729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:49.740729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:49.740729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:49.740729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:49.741799 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:49.741799 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:49.741799 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:49.741799 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:49.741799 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:49.741799 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:49.741799 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:49.741799 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:49.741799 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:49.741799 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:49.741799 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:49.741799 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:49.741799 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:49.741799 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:49.741799 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:49.741799 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:49.743341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:49.743341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:49.743341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:49.743341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:49.743341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:49.743341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:49.743341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:49.743341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:49.743341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:49.743341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:49.743341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:43:49.743341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:43:49.752230 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 82/164] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:43:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:49.756075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af62e9-cf37-4cd5-80bb-fb27967a3ba5 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:49.756764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af62e9-cf37-4cd5-80bb-fb27967a3ba5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:49.758484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af62e9-cf37-4cd5-80bb-fb27967a3ba5 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:49.762117 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 83/165] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:49.766461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af62e9-cf37-4cd5-80bb-fb27967a3ba5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:49.775731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d581d-e995-427c-b49b-035e73ae22c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:49.780967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d581d-e995-427c-b49b-035e73ae22c9 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:49.781442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d581d-e995-427c-b49b-035e73ae22c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:49.781892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d581d-e995-427c-b49b-035e73ae22c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:49.865720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d581d-e995-427c-b49b-035e73ae22c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:49.868623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d581d-e995-427c-b49b-035e73ae22c9 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:50.016902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:50.028953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af62e9-cf37-4cd5-80bb-fb27967a3ba5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:50.059075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:50.108885 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 83/166] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:43:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:43:50.110177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb624a9-d752-4154-8c3e-1b4347ea7ad9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:50.110460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb624a9-d752-4154-8c3e-1b4347ea7ad9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:50.110742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb624a9-d752-4154-8c3e-1b4347ea7ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:50.118000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157ad25-4db8-47d7-ad6f-3989eca630b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:50.118639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157ad25-4db8-47d7-ad6f-3989eca630b5 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:50.118923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157ad25-4db8-47d7-ad6f-3989eca630b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:50.119202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157ad25-4db8-47d7-ad6f-3989eca630b5 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:50.119957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157ad25-4db8-47d7-ad6f-3989eca630b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:50.120267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157ad25-4db8-47d7-ad6f-3989eca630b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:50.121918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157ad25-4db8-47d7-ad6f-3989eca630b5 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:50.145193 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 84/167] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:43:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:50.145906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157ad25-4db8-47d7-ad6f-3989eca630b5 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:50.150930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ceb624a9-d752-4154-8c3e-1b4347ea7ad9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:50.154095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ceb624a9-d752-4154-8c3e-1b4347ea7ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:50.262589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157ad25-4db8-47d7-ad6f-3989eca630b5 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:50.297743 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 84/168] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:50.298514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb624a9-d752-4154-8c3e-1b4347ea7ad9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:50.301315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c08cfa-f752-49fe-b3d4-a55fe270466e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:50.302263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c08cfa-f752-49fe-b3d4-a55fe270466e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:50.302785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c08cfa-f752-49fe-b3d4-a55fe270466e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:50.303281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c08cfa-f752-49fe-b3d4-a55fe270466e None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:50.304859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c08cfa-f752-49fe-b3d4-a55fe270466e None admin] RBAC: Authorizing `identity:get_project(project_id=02833278e27846f49032cf41d32ccefb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:50.306510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c08cfa-f752-49fe-b3d4-a55fe270466e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:50.308582 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 85/169] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:43:50 2022] GET /identity/v3/projects/02833278e27846f49032cf41d32ccefb => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:50.314184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c08cfa-f752-49fe-b3d4-a55fe270466e None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:50.395640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:50.515676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb624a9-d752-4154-8c3e-1b4347ea7ad9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:50.519610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:50.521567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c08cfa-f752-49fe-b3d4-a55fe270466e None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:50.570162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da2b8f-6c1b-457e-a7ce-9973c2630be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:50.571532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da2b8f-6c1b-457e-a7ce-9973c2630be6 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:50.575319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da2b8f-6c1b-457e-a7ce-9973c2630be6 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:50.575319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da2b8f-6c1b-457e-a7ce-9973c2630be6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:50.575319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da2b8f-6c1b-457e-a7ce-9973c2630be6 None admin] RBAC: Adding query filter params (role.id=c3edb43d117b427a91e426e4e42f0c63, scope.project.id=02833278e27846f49032cf41d32ccefb, user.id=9e9636a0c442469e88a4bc0a1fd199b3) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:50.575319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da2b8f-6c1b-457e-a7ce-9973c2630be6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:50.575319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da2b8f-6c1b-457e-a7ce-9973c2630be6 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:50.581697 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 86/170] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:43:50 2022] GET /identity/v3/role_assignments?user.id=9e9636a0c442469e88a4bc0a1fd199b3&scope.project.id=02833278e27846f49032cf41d32ccefb&role.id=c3edb43d117b427a91e426e4e42f0c63 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:50.582720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da2b8f-6c1b-457e-a7ce-9973c2630be6 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:50.589491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fbcd7-abff-4464-a695-417e6e4a5116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:50.590450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fbcd7-abff-4464-a695-417e6e4a5116 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:50.590881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fbcd7-abff-4464-a695-417e6e4a5116 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:50.591340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fbcd7-abff-4464-a695-417e6e4a5116 None admin] PATH_INFO: `/v3/users/9e9636a0c442469e88a4bc0a1fd199b3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:50.596060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fbcd7-abff-4464-a695-417e6e4a5116 None admin] RBAC: Authorizing `identity:get_user(user_id=9e9636a0c442469e88a4bc0a1fd199b3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:50.597713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fbcd7-abff-4464-a695-417e6e4a5116 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:50.603380 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 85/171] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:50 2022] GET /identity/v3/users/9e9636a0c442469e88a4bc0a1fd199b3 => generated 275 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:50.604885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ce34a-904e-4416-b95d-c224d837d87b None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:50.605315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ce34a-904e-4416-b95d-c224d837d87b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:50.605750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ce34a-904e-4416-b95d-c224d837d87b None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:50.607987 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 86/172] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:50.609006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ce34a-904e-4416-b95d-c224d837d87b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:50.704644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da2b8f-6c1b-457e-a7ce-9973c2630be6 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:50.707446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:50.745534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca06b6-1b1c-47cf-9184-79e840f9f870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:50.746829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca06b6-1b1c-47cf-9184-79e840f9f870 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:50.747377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca06b6-1b1c-47cf-9184-79e840f9f870 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:50.747862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca06b6-1b1c-47cf-9184-79e840f9f870 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:50.760529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca06b6-1b1c-47cf-9184-79e840f9f870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:50.767119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-11ca06b6-1b1c-47cf-9184-79e840f9f870 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:43:50.767119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:50.767119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:50.767119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:50.767119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:50.767119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:50.767119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:50.767119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:50.767119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:50.767119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:50.767119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:50.767119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:50.767119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:50.767119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:50.767119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:50.767119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:50.768098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:50.768098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:50.768098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:50.768098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:50.768098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:50.768098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:50.768098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:50.768098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:50.768098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:50.768098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:50.768098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:50.768098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:50.768098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:50.768098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:50.768098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:50.768098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:50.768925 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:50.768925 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:50.768925 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:50.768925 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:50.768925 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:50.768925 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:50.768925 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:50.768925 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:50.768925 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:50.768925 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:50.768925 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:43:50.768925 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:43:50.771401 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 87/173] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:43:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:50.772935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a69815-b796-4218-8460-bb41023b7699 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:50.773504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a69815-b796-4218-8460-bb41023b7699 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:50.774573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a69815-b796-4218-8460-bb41023b7699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:50.794430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d0a69815-b796-4218-8460-bb41023b7699 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:50.796024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d0a69815-b796-4218-8460-bb41023b7699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:50.841160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ce34a-904e-4416-b95d-c224d837d87b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:50.874987 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 88/174] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:50.876231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a69815-b796-4218-8460-bb41023b7699 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:50.909220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12543aa-f41b-4561-af31-31de860c4245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:50.909796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12543aa-f41b-4561-af31-31de860c4245 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:50.910080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12543aa-f41b-4561-af31-31de860c4245 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:50.910367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12543aa-f41b-4561-af31-31de860c4245 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:50.975701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:50.984733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:50.994439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a69815-b796-4218-8460-bb41023b7699 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:51.030591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12543aa-f41b-4561-af31-31de860c4245 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:51.032027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12543aa-f41b-4561-af31-31de860c4245 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:51.036966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdc271-0b2f-4b50-b68a-37f652bc70ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:51.037894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdc271-0b2f-4b50-b68a-37f652bc70ca None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:51.038400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdc271-0b2f-4b50-b68a-37f652bc70ca None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:51.038907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdc271-0b2f-4b50-b68a-37f652bc70ca None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:51.040871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdc271-0b2f-4b50-b68a-37f652bc70ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:51.041413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdc271-0b2f-4b50-b68a-37f652bc70ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:51.043007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdc271-0b2f-4b50-b68a-37f652bc70ca None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:51.054223 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 89/175] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:43:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:51.056004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdc271-0b2f-4b50-b68a-37f652bc70ca None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:51.172950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdc271-0b2f-4b50-b68a-37f652bc70ca None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:51.208924 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 87/176] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:43:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:43:51.209811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12543aa-f41b-4561-af31-31de860c4245 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:51.222066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f679646-ee89-4447-b4d7-46d08694dd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:51.223186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f679646-ee89-4447-b4d7-46d08694dd40 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:51.223726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f679646-ee89-4447-b4d7-46d08694dd40 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:51.224207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f679646-ee89-4447-b4d7-46d08694dd40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:51.251312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f679646-ee89-4447-b4d7-46d08694dd40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:51.262723 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-3f679646-ee89-4447-b4d7-46d08694dd40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:43:51.262723 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:51.262723 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:51.262723 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:51.262723 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:51.262723 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:51.262723 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:51.262723 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:51.262723 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:51.262723 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:51.262723 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:51.262723 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:51.262723 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:51.262723 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:51.262723 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:51.262723 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:51.263725 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:51.263725 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:51.263725 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:51.263725 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:51.263725 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:51.263725 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:51.263725 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:51.263725 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:51.263725 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:51.263725 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:51.263725 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:51.263725 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:51.263725 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:51.263725 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:51.263725 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:51.263725 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:51.264537 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:51.264537 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:51.264537 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:51.264537 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:51.264537 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:51.264537 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:51.264537 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:51.264537 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:51.264537 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:51.264537 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:51.264537 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:43:51.264537 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:43:51.268473 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 90/177] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:43:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:51.270374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f679646-ee89-4447-b4d7-46d08694dd40 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:51.310526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:51.359686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:51.387524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12543aa-f41b-4561-af31-31de860c4245 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:51.436587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0c78e-2d8f-45dd-b501-3e778b62f502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:51.437916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0c78e-2d8f-45dd-b501-3e778b62f502 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:51.438462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0c78e-2d8f-45dd-b501-3e778b62f502 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:51.439203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0c78e-2d8f-45dd-b501-3e778b62f502 None admin] PATH_INFO: `/v3/users/9e9636a0c442469e88a4bc0a1fd199b3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:51.441266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0c78e-2d8f-45dd-b501-3e778b62f502 None admin] RBAC: Authorizing `identity:get_user(user_id=9e9636a0c442469e88a4bc0a1fd199b3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:51.443728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0c78e-2d8f-45dd-b501-3e778b62f502 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:51.445548 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 88/178] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:51 2022] GET /identity/v3/users/9e9636a0c442469e88a4bc0a1fd199b3 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:51.448105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0c78e-2d8f-45dd-b501-3e778b62f502 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:51.464363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f679646-ee89-4447-b4d7-46d08694dd40 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:51.504399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e194ab7-75da-4941-82fb-b44abebd0a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:51.505044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e194ab7-75da-4941-82fb-b44abebd0a0e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:51.505326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e194ab7-75da-4941-82fb-b44abebd0a0e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:51.505608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e194ab7-75da-4941-82fb-b44abebd0a0e None admin] PATH_INFO: `/v3/projects/eedf6974be53495cb5e0de03dd838db0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:51.506780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e194ab7-75da-4941-82fb-b44abebd0a0e None admin] RBAC: Authorizing `identity:get_project(project_id=eedf6974be53495cb5e0de03dd838db0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:51.509024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e194ab7-75da-4941-82fb-b44abebd0a0e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:51.510603 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 91/179] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:43:51 2022] GET /identity/v3/projects/eedf6974be53495cb5e0de03dd838db0 => generated 312 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:51.515699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabc154-d241-4838-85bd-fab28bb288bf None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:51.515699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabc154-d241-4838-85bd-fab28bb288bf None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:51.515699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabc154-d241-4838-85bd-fab28bb288bf None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:51.518004 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 92/180] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:51.519075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabc154-d241-4838-85bd-fab28bb288bf None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:51.594443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0c78e-2d8f-45dd-b501-3e778b62f502 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:51.616170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:51.634519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabc154-d241-4838-85bd-fab28bb288bf None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:51.635472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0022110-1583-4112-836c-c1d40b0938b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:51.636108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0022110-1583-4112-836c-c1d40b0938b5 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:51.636397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0022110-1583-4112-836c-c1d40b0938b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:51.636675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0022110-1583-4112-836c-c1d40b0938b5 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:51.637399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0022110-1583-4112-836c-c1d40b0938b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:51.637709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0022110-1583-4112-836c-c1d40b0938b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:51.639099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0022110-1583-4112-836c-c1d40b0938b5 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:51.640631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:51.654130 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 89/181] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:43:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:51.654130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0022110-1583-4112-836c-c1d40b0938b5 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:51.678024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529653a-072a-4711-b6b2-ce415370a065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:51.678646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529653a-072a-4711-b6b2-ce415370a065 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:51.678929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529653a-072a-4711-b6b2-ce415370a065 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:51.679202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529653a-072a-4711-b6b2-ce415370a065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:51.750834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529653a-072a-4711-b6b2-ce415370a065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:51.752344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529653a-072a-4711-b6b2-ce415370a065 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:51.758391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0022110-1583-4112-836c-c1d40b0938b5 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:51.795344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba80f5b-3348-4f29-9949-92959f1fd9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:51.795982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba80f5b-3348-4f29-9949-92959f1fd9d4 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:51.796271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba80f5b-3348-4f29-9949-92959f1fd9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:51.796553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba80f5b-3348-4f29-9949-92959f1fd9d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:51.797349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba80f5b-3348-4f29-9949-92959f1fd9d4 None admin] RBAC: Adding query filter params (role.id=c3edb43d117b427a91e426e4e42f0c63, scope.project.id=eedf6974be53495cb5e0de03dd838db0, user.id=9e9636a0c442469e88a4bc0a1fd199b3) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:51.797668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba80f5b-3348-4f29-9949-92959f1fd9d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:51.799116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba80f5b-3348-4f29-9949-92959f1fd9d4 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:51.805980 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 90/182] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:43:51 2022] GET /identity/v3/role_assignments?user.id=9e9636a0c442469e88a4bc0a1fd199b3&scope.project.id=eedf6974be53495cb5e0de03dd838db0&role.id=c3edb43d117b427a91e426e4e42f0c63 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:51.808865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb80a7-279b-4e93-bb10-5cd14efe16a5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:51.809685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb80a7-279b-4e93-bb10-5cd14efe16a5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:51.810052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb80a7-279b-4e93-bb10-5cd14efe16a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:51.835959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f1bb80a7-279b-4e93-bb10-5cd14efe16a5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:51.837866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f1bb80a7-279b-4e93-bb10-5cd14efe16a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:51.845187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:51.864716 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 93/183] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:43:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:43:51.866555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1718a-3c1f-44aa-bb46-b421fc3159d1 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:51.867251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1718a-3c1f-44aa-bb46-b421fc3159d1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:51.868618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1718a-3c1f-44aa-bb46-b421fc3159d1 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:51.870302 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 94/184] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:51.876328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1718a-3c1f-44aa-bb46-b421fc3159d1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:51.927740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:51.943445 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 91/185] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:51.945176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c0bee-e5c4-47df-8b5f-3676b3bd2403 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:51.946204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c0bee-e5c4-47df-8b5f-3676b3bd2403 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:51.946825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c0bee-e5c4-47df-8b5f-3676b3bd2403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:51.987896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-491c0bee-e5c4-47df-8b5f-3676b3bd2403 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:51.989159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-491c0bee-e5c4-47df-8b5f-3676b3bd2403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:52.033569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1718a-3c1f-44aa-bb46-b421fc3159d1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:52.071993 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 92/186] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:52.077393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c0bee-e5c4-47df-8b5f-3676b3bd2403 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:52.102241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb96af-38bd-43f7-b2dd-734b739056ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:52.103095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb96af-38bd-43f7-b2dd-734b739056ac None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:52.103421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb96af-38bd-43f7-b2dd-734b739056ac None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:52.103702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb96af-38bd-43f7-b2dd-734b739056ac None admin] PATH_INFO: `/v3/users/e278464475b2423fa85987f1391426cf` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:52.124118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb96af-38bd-43f7-b2dd-734b739056ac None admin] RBAC: Authorizing `identity:get_user(user_id=e278464475b2423fa85987f1391426cf)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:52.125607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb96af-38bd-43f7-b2dd-734b739056ac None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:52.131739 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 95/187] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:51 2022] GET /identity/v3/users/e278464475b2423fa85987f1391426cf => generated 283 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:52.131739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb96af-38bd-43f7-b2dd-734b739056ac None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:52.175425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:52.198433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c0bee-e5c4-47df-8b5f-3676b3bd2403 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:52.222192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:52.237480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb96af-38bd-43f7-b2dd-734b739056ac None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:52.238069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295c0e5-3587-400e-9186-339634b7d2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:52.238723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295c0e5-3587-400e-9186-339634b7d2dc None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:52.239022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295c0e5-3587-400e-9186-339634b7d2dc None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:52.239278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295c0e5-3587-400e-9186-339634b7d2dc None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:52.241224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295c0e5-3587-400e-9186-339634b7d2dc None admin] RBAC: Authorizing `identity:get_project(project_id=02833278e27846f49032cf41d32ccefb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:52.243212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295c0e5-3587-400e-9186-339634b7d2dc None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:52.249923 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 93/188] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:43:52 2022] GET /identity/v3/projects/02833278e27846f49032cf41d32ccefb => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:52.249923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295c0e5-3587-400e-9186-339634b7d2dc None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:52.280490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f287640-9d37-46a2-a1ae-9ede44c48253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:52.281135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f287640-9d37-46a2-a1ae-9ede44c48253 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:52.281512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f287640-9d37-46a2-a1ae-9ede44c48253 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:52.281693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f287640-9d37-46a2-a1ae-9ede44c48253 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:52.282829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f287640-9d37-46a2-a1ae-9ede44c48253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:52.284428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f287640-9d37-46a2-a1ae-9ede44c48253 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:52.286233 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 96/189] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:43:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:52.286911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f287640-9d37-46a2-a1ae-9ede44c48253 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:52.364288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295c0e5-3587-400e-9186-339634b7d2dc None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:52.391026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f287640-9d37-46a2-a1ae-9ede44c48253 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:52.398535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dd83a-edf1-4af0-b654-e6251924f4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:52.399180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dd83a-edf1-4af0-b654-e6251924f4e0 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:52.399503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dd83a-edf1-4af0-b654-e6251924f4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:52.399779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dd83a-edf1-4af0-b654-e6251924f4e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:52.401888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:52.410051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5dd83a-edf1-4af0-b654-e6251924f4e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:52.415032 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-af5dd83a-edf1-4af0-b654-e6251924f4e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:43:52.415032 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:52.415032 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:52.415032 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:52.415032 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:52.415032 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:52.415032 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:52.415032 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:52.415032 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:52.415032 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:52.415032 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:52.415032 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:52.415032 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:52.415032 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:52.415032 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:52.415032 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:52.416129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:52.416129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:52.416129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:52.416129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:52.416129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:52.416129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:52.416129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:52.416129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:52.416129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:52.416129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:52.416129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:52.416129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:52.416129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:52.416129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:52.416129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:52.416129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:52.417122 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:52.417122 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:52.417122 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:52.417122 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:52.417122 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:52.417122 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:52.417122 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:52.417122 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:52.417122 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:52.417122 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:52.417122 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:43:52.417122 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:43:52.417122 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 94/190] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:43:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:52.417122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dd83a-edf1-4af0-b654-e6251924f4e0 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:52.429308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb24aa-0b24-4258-896f-4bbff3003f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:52.430455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb24aa-0b24-4258-896f-4bbff3003f2e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:52.430740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb24aa-0b24-4258-896f-4bbff3003f2e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:52.431020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb24aa-0b24-4258-896f-4bbff3003f2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:52.466662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:52.498393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb24aa-0b24-4258-896f-4bbff3003f2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:52.499899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb24aa-0b24-4258-896f-4bbff3003f2e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:52.517612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dd83a-edf1-4af0-b654-e6251924f4e0 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:52.550226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f3d5e-53f1-442a-9ac4-77bd05ecc9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:52.550840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f3d5e-53f1-442a-9ac4-77bd05ecc9d9 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:52.551117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f3d5e-53f1-442a-9ac4-77bd05ecc9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:52.551431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f3d5e-53f1-442a-9ac4-77bd05ecc9d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:52.552214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f3d5e-53f1-442a-9ac4-77bd05ecc9d9 None admin] RBAC: Adding query filter params (role.id=bb6a9a85fcb54a31a5a42bea4a88a5b9, scope.project.id=02833278e27846f49032cf41d32ccefb, user.id=9e9636a0c442469e88a4bc0a1fd199b3) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:52.552517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f3d5e-53f1-442a-9ac4-77bd05ecc9d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:52.553938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f3d5e-53f1-442a-9ac4-77bd05ecc9d9 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:52.560192 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 95/191] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:43:52 2022] GET /identity/v3/role_assignments?user.id=9e9636a0c442469e88a4bc0a1fd199b3&scope.project.id=02833278e27846f49032cf41d32ccefb&role.id=bb6a9a85fcb54a31a5a42bea4a88a5b9 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:52.571687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f3d5e-53f1-442a-9ac4-77bd05ecc9d9 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:52.605486 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 97/192] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:43:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:43:52.609502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe473aa-45d8-45ff-99f2-cd70cb03ae89 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:52.609801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe473aa-45d8-45ff-99f2-cd70cb03ae89 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:52.610399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe473aa-45d8-45ff-99f2-cd70cb03ae89 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:52.612176 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 98/193] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:52.616460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe473aa-45d8-45ff-99f2-cd70cb03ae89 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:52.630806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:52.692275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f3d5e-53f1-442a-9ac4-77bd05ecc9d9 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:52.707704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:52.733722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b717d5-842a-4ad2-a542-b35b2d60397b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:52.734350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b717d5-842a-4ad2-a542-b35b2d60397b None admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:52.734634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b717d5-842a-4ad2-a542-b35b2d60397b None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:52.734915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b717d5-842a-4ad2-a542-b35b2d60397b None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:52.735636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b717d5-842a-4ad2-a542-b35b2d60397b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:52.737072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b717d5-842a-4ad2-a542-b35b2d60397b None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:52.738094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe473aa-45d8-45ff-99f2-cd70cb03ae89 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:52.768235 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 96/194] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 30 20:43:52 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:43:52.769156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b717d5-842a-4ad2-a542-b35b2d60397b None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:52.780611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779253fe-ab70-40e1-8625-bcfde4d0a771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:52.780611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779253fe-ab70-40e1-8625-bcfde4d0a771 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:52.780611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779253fe-ab70-40e1-8625-bcfde4d0a771 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:52.780611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779253fe-ab70-40e1-8625-bcfde4d0a771 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:52.781715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779253fe-ab70-40e1-8625-bcfde4d0a771 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:52.782038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779253fe-ab70-40e1-8625-bcfde4d0a771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:52.783836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779253fe-ab70-40e1-8625-bcfde4d0a771 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:52.795232 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 99/195] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:43:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:52.796871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff97bf4-0deb-4a85-a12b-f3b011385b87 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:52.796871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff97bf4-0deb-4a85-a12b-f3b011385b87 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:52.797062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff97bf4-0deb-4a85-a12b-f3b011385b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:52.821194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9ff97bf4-0deb-4a85-a12b-f3b011385b87 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:52.822456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9ff97bf4-0deb-4a85-a12b-f3b011385b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:52.915402 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 100/196] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:52.916008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b717d5-842a-4ad2-a542-b35b2d60397b None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:52.916125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff97bf4-0deb-4a85-a12b-f3b011385b87 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:52.918220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:52.978460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca1755-bebd-407a-9171-9eb5ed08e074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:52.979533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca1755-bebd-407a-9171-9eb5ed08e074 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:52.980037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca1755-bebd-407a-9171-9eb5ed08e074 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:52.980498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca1755-bebd-407a-9171-9eb5ed08e074 None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:52.982252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca1755-bebd-407a-9171-9eb5ed08e074 None admin] RBAC: Authorizing `identity:get_project(project_id=ae7c0ef917404ec9a98252b586e52c5c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:52.984763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca1755-bebd-407a-9171-9eb5ed08e074 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:52.987492 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 97/197] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:43:52 2022] GET /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:52.988878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca1755-bebd-407a-9171-9eb5ed08e074 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:53.052641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:53.081537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff97bf4-0deb-4a85-a12b-f3b011385b87 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:53.128430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22691c7d-1801-458f-bb1a-a4232a00257f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:53.129571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22691c7d-1801-458f-bb1a-a4232a00257f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:53.130139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22691c7d-1801-458f-bb1a-a4232a00257f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:53.130428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22691c7d-1801-458f-bb1a-a4232a00257f None admin] PATH_INFO: `/v3/users/e278464475b2423fa85987f1391426cf` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:53.133391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22691c7d-1801-458f-bb1a-a4232a00257f None admin] RBAC: Authorizing `identity:get_user(user_id=e278464475b2423fa85987f1391426cf)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:53.135209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22691c7d-1801-458f-bb1a-a4232a00257f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:53.137683 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 101/198] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:52 2022] GET /identity/v3/users/e278464475b2423fa85987f1391426cf => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:53.138842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22691c7d-1801-458f-bb1a-a4232a00257f None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:53.157549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca1755-bebd-407a-9171-9eb5ed08e074 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:53.198450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb7f3a-5d17-495c-a8c9-76a8adea22f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:53.199557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb7f3a-5d17-495c-a8c9-76a8adea22f3 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:53.200052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb7f3a-5d17-495c-a8c9-76a8adea22f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:53.201142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb7f3a-5d17-495c-a8c9-76a8adea22f3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:53.217768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb7f3a-5d17-495c-a8c9-76a8adea22f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:53.222653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:53.226373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-7bfb7f3a-5d17-495c-a8c9-76a8adea22f3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 30 20:43:53.226373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:53.226373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:53.226373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:53.226373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:53.226373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:53.226373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:53.226373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:53.226373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:53.226373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:53.226373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:53.226373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:53.226373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:53.226373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:53.226373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:53.226373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:53.228005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:53.228005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:53.228005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:53.228005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:53.228005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:53.228005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:53.228005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:53.228005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:53.228005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:53.228005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:53.228005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:53.228005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:53.228005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:53.228005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:53.228005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:53.228005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:53.228792 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:53.228792 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:53.228792 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:53.228792 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:53.228792 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:53.228792 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:53.228792 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:53.228792 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:53.228792 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:53.228792 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:53.228792 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 30 20:43:53.228792 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:43:53.228792 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 98/199] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:43:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:53.229466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb7f3a-5d17-495c-a8c9-76a8adea22f3 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:53.264730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22691c7d-1801-458f-bb1a-a4232a00257f None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:53.302208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9dfb1-29ab-48f0-b143-1d929b259933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:53.303568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9dfb1-29ab-48f0-b143-1d929b259933 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:53.303568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9dfb1-29ab-48f0-b143-1d929b259933 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:53.303568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9dfb1-29ab-48f0-b143-1d929b259933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:53.304467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9dfb1-29ab-48f0-b143-1d929b259933 None admin] RBAC: Adding query filter params (role.id=3b89b89da98d4ec08a0587aa13832636, scope.project.id=ae7c0ef917404ec9a98252b586e52c5c, user.id=e278464475b2423fa85987f1391426cf) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:53.305423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9dfb1-29ab-48f0-b143-1d929b259933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:53.307053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9dfb1-29ab-48f0-b143-1d929b259933 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:53.313127 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 102/200] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:43:53 2022] GET /identity/v3/role_assignments?user.id=e278464475b2423fa85987f1391426cf&scope.project.id=ae7c0ef917404ec9a98252b586e52c5c&role.id=3b89b89da98d4ec08a0587aa13832636 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:53.320282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9dfb1-29ab-48f0-b143-1d929b259933 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:53.336197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb7f3a-5d17-495c-a8c9-76a8adea22f3 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:53.339771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:53.378545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0f4a6-e5a7-49d7-88c0-9ac7233918c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:53.379502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0f4a6-e5a7-49d7-88c0-9ac7233918c0 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:53.380064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0f4a6-e5a7-49d7-88c0-9ac7233918c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:53.380521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0f4a6-e5a7-49d7-88c0-9ac7233918c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:53.515345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0f4a6-e5a7-49d7-88c0-9ac7233918c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:53.517193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0f4a6-e5a7-49d7-88c0-9ac7233918c0 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:53.531150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9dfb1-29ab-48f0-b143-1d929b259933 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:53.592841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1f96e-ec8c-4083-8aaf-6e8f8e61e780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:53.593847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1f96e-ec8c-4083-8aaf-6e8f8e61e780 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:53.595017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1f96e-ec8c-4083-8aaf-6e8f8e61e780 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:53.595590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1f96e-ec8c-4083-8aaf-6e8f8e61e780 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:53.596507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1f96e-ec8c-4083-8aaf-6e8f8e61e780 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:53.597203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1f96e-ec8c-4083-8aaf-6e8f8e61e780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:53.600273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1f96e-ec8c-4083-8aaf-6e8f8e61e780 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:53.604378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:53.620525 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 103/201] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:43:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:53.626454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1f96e-ec8c-4083-8aaf-6e8f8e61e780 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:53.699643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:53.708961 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 99/202] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:43:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:43:53.732503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0f4a6-e5a7-49d7-88c0-9ac7233918c0 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:53.800100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1f96e-ec8c-4083-8aaf-6e8f8e61e780 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:53.835444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3b7c1-95a3-4e29-aa1e-4b6ffbfcc923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:53.836352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3b7c1-95a3-4e29-aa1e-4b6ffbfcc923 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:53.836641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3b7c1-95a3-4e29-aa1e-4b6ffbfcc923 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:53.836919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3b7c1-95a3-4e29-aa1e-4b6ffbfcc923 None admin] PATH_INFO: `/v3/users/e7db8ab50eb849038f34fc401374e743` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:53.838154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3b7c1-95a3-4e29-aa1e-4b6ffbfcc923 None admin] RBAC: Authorizing `identity:get_user(user_id=e7db8ab50eb849038f34fc401374e743)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:53.839801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3b7c1-95a3-4e29-aa1e-4b6ffbfcc923 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:53.841873 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 104/203] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:53 2022] GET /identity/v3/users/e7db8ab50eb849038f34fc401374e743 => generated 289 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:43:53.848434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3b7c1-95a3-4e29-aa1e-4b6ffbfcc923 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:53.943674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:53.948802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0f4a6-e5a7-49d7-88c0-9ac7233918c0 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:54.003232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b57ad-9a7b-48b4-bee7-3b3ed695f262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:54.004029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b57ad-9a7b-48b4-bee7-3b3ed695f262 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:54.004363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b57ad-9a7b-48b4-bee7-3b3ed695f262 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:54.004730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b57ad-9a7b-48b4-bee7-3b3ed695f262 None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:54.008592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b57ad-9a7b-48b4-bee7-3b3ed695f262 None admin] RBAC: Authorizing `identity:get_project(project_id=ae7c0ef917404ec9a98252b586e52c5c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:54.008942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b57ad-9a7b-48b4-bee7-3b3ed695f262 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:54.010648 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 100/204] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:43:53 2022] GET /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:43:54.016869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b57ad-9a7b-48b4-bee7-3b3ed695f262 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:54.055695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3b7c1-95a3-4e29-aa1e-4b6ffbfcc923 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:54.088089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:54.136908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b57ad-9a7b-48b4-bee7-3b3ed695f262 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:54.169452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38488d10-0336-481b-a534-f3ac5af1ed6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:54.173665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38488d10-0336-481b-a534-f3ac5af1ed6c None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:54.173665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38488d10-0336-481b-a534-f3ac5af1ed6c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:54.173665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38488d10-0336-481b-a534-f3ac5af1ed6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:54.201750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c85432-aec6-4b3c-a13c-355adb692f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:54.203539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c85432-aec6-4b3c-a13c-355adb692f5a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:54.204405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c85432-aec6-4b3c-a13c-355adb692f5a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:54.206201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c85432-aec6-4b3c-a13c-355adb692f5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:54.207768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c85432-aec6-4b3c-a13c-355adb692f5a None admin] RBAC: Adding query filter params (role.id=bb6a9a85fcb54a31a5a42bea4a88a5b9, scope.project.id=ae7c0ef917404ec9a98252b586e52c5c, user.id=e278464475b2423fa85987f1391426cf) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:54.209526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c85432-aec6-4b3c-a13c-355adb692f5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:54.212495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c85432-aec6-4b3c-a13c-355adb692f5a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:54.225542 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 101/205] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:43:54 2022] GET /identity/v3/role_assignments?user.id=e278464475b2423fa85987f1391426cf&scope.project.id=ae7c0ef917404ec9a98252b586e52c5c&role.id=bb6a9a85fcb54a31a5a42bea4a88a5b9 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:43:54.284338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38488d10-0336-481b-a534-f3ac5af1ed6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:54.286328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38488d10-0336-481b-a534-f3ac5af1ed6c None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:54.368027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:54.423310 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 105/206] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:43:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:43:54.434744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c85432-aec6-4b3c-a13c-355adb692f5a None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:54.570874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c85432-aec6-4b3c-a13c-355adb692f5a None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:54.611449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:54.621950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab1186-7aa1-4b36-a47f-3e79702c29b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:54.622599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab1186-7aa1-4b36-a47f-3e79702c29b9 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:54.622835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab1186-7aa1-4b36-a47f-3e79702c29b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:54.623118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab1186-7aa1-4b36-a47f-3e79702c29b9 None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:54.627311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab1186-7aa1-4b36-a47f-3e79702c29b9 None admin] RBAC: Authorizing `identity:get_project(project_id=02833278e27846f49032cf41d32ccefb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:54.627311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab1186-7aa1-4b36-a47f-3e79702c29b9 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:54.627992 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 102/207] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:43:54 2022] GET /identity/v3/projects/02833278e27846f49032cf41d32ccefb => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:54.633535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38488d10-0336-481b-a534-f3ac5af1ed6c None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:54.765967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38488d10-0336-481b-a534-f3ac5af1ed6c None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:54.806172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a008c2-3289-40ca-8193-30e34dd3407a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:54.807212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a008c2-3289-40ca-8193-30e34dd3407a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:54.807712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a008c2-3289-40ca-8193-30e34dd3407a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:54.808197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a008c2-3289-40ca-8193-30e34dd3407a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:54.809190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a008c2-3289-40ca-8193-30e34dd3407a None admin] RBAC: Adding query filter params (role.id=db8677d195074e639671c1d9bf559e95, scope.project.id=02833278e27846f49032cf41d32ccefb, user.id=e7db8ab50eb849038f34fc401374e743) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:54.809781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a008c2-3289-40ca-8193-30e34dd3407a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:54.811491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a008c2-3289-40ca-8193-30e34dd3407a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:54.817956 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 106/208] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:43:54 2022] GET /identity/v3/role_assignments?user.id=e7db8ab50eb849038f34fc401374e743&scope.project.id=02833278e27846f49032cf41d32ccefb&role.id=db8677d195074e639671c1d9bf559e95 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:55.349689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790b17f-d41b-4927-80ff-554907db9e58 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:55.350203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790b17f-d41b-4927-80ff-554907db9e58 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:55.350278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790b17f-d41b-4927-80ff-554907db9e58 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:55.351673 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 103/209] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:55.356978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f1da6-3ea3-4a41-87bf-09b041be6d2f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:55.357403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f1da6-3ea3-4a41-87bf-09b041be6d2f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:55.357579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f1da6-3ea3-4a41-87bf-09b041be6d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:55.378190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ce8f1da6-3ea3-4a41-87bf-09b041be6d2f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:55.379592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ce8f1da6-3ea3-4a41-87bf-09b041be6d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:55.407913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:55.460548 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 107/210] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:55.487697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790b17f-d41b-4927-80ff-554907db9e58 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:55.602845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790b17f-d41b-4927-80ff-554907db9e58 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:55.640906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e82bb-2371-4afa-b574-6da20b73e3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:55.641607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e82bb-2371-4afa-b574-6da20b73e3d5 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:55.641894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e82bb-2371-4afa-b574-6da20b73e3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:55.642167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e82bb-2371-4afa-b574-6da20b73e3d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:55.653100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e82bb-2371-4afa-b574-6da20b73e3d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:55.658539 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-fa0e82bb-2371-4afa-b574-6da20b73e3d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:43:55.658539 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:55.658539 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:55.658539 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:55.658539 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:55.658539 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:55.658539 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:55.658539 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:55.658539 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:55.658539 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:55.658539 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:55.658539 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:55.658539 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:55.658539 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:55.658539 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:55.658539 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:55.659424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:55.659424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:55.659424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:55.659424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:55.659424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:55.659424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:55.659424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:55.659424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:55.659424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:55.659424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:55.659424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:55.659424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:55.659424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:55.659424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:55.659424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:55.659424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:55.660216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:55.660216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:55.660216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:55.660216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:55.660216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:55.660216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:55.660216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:55.660216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:55.660216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:55.660216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:55.660216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:43:55.660216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:43:55.660216 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 104/211] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:43:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:55.666343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f1da6-3ea3-4a41-87bf-09b041be6d2f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:55.707800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9ab48-4b00-41cc-9235-621d286a6382 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:55.708105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9ab48-4b00-41cc-9235-621d286a6382 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:55.708361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9ab48-4b00-41cc-9235-621d286a6382 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:55.709732 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 105/212] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:43:55.715542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3171b-ef3c-4fca-ad38-4d03691f5ee9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:55.715940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3171b-ef3c-4fca-ad38-4d03691f5ee9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:55.716320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3171b-ef3c-4fca-ad38-4d03691f5ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:55.735438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-27e3171b-ef3c-4fca-ad38-4d03691f5ee9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:55.736799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-27e3171b-ef3c-4fca-ad38-4d03691f5ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:55.781605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f1da6-3ea3-4a41-87bf-09b041be6d2f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:55.797601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:55.820126 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 106/213] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:43:55.828101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057064ef-564e-428c-bbbb-1bf64f0a8171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:55.828737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057064ef-564e-428c-bbbb-1bf64f0a8171 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:55.829025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057064ef-564e-428c-bbbb-1bf64f0a8171 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:55.829302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057064ef-564e-428c-bbbb-1bf64f0a8171 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:55.830033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057064ef-564e-428c-bbbb-1bf64f0a8171 None admin] RBAC: Adding query filter params (name=member) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:55.830341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057064ef-564e-428c-bbbb-1bf64f0a8171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:55.831795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057064ef-564e-428c-bbbb-1bf64f0a8171 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:55.840869 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 108/214] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:43:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:55.846801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3171b-ef3c-4fca-ad38-4d03691f5ee9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:55.851089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057064ef-564e-428c-bbbb-1bf64f0a8171 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:55.886217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:55.978914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3171b-ef3c-4fca-ad38-4d03691f5ee9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:55.982010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057064ef-564e-428c-bbbb-1bf64f0a8171 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:56.030640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37bde7-a059-431b-aedf-4a410b0697ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:56.034492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37bde7-a059-431b-aedf-4a410b0697ef None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:56.034492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37bde7-a059-431b-aedf-4a410b0697ef None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:56.034492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37bde7-a059-431b-aedf-4a410b0697ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:56.034492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37bde7-a059-431b-aedf-4a410b0697ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:56.034829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37bde7-a059-431b-aedf-4a410b0697ef None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:56.036353 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 109/215] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:43:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:56.037425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067bd1c-5ef8-46bd-8f98-10fa8443446e None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:56.037823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067bd1c-5ef8-46bd-8f98-10fa8443446e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:56.038105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067bd1c-5ef8-46bd-8f98-10fa8443446e None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:56.043202 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 110/216] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:56.043202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067bd1c-5ef8-46bd-8f98-10fa8443446e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:56.047682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc093f64-c346-47ff-b150-43c114c41ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:56.048555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc093f64-c346-47ff-b150-43c114c41ae9 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:56.048984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc093f64-c346-47ff-b150-43c114c41ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:56.049403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc093f64-c346-47ff-b150-43c114c41ae9 None admin] PATH_INFO: `/v3/users/9ae88a7921ab430f823b5288d9f4694d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:56.066106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc093f64-c346-47ff-b150-43c114c41ae9 None admin] RBAC: Authorizing `identity:get_user(user_id=9ae88a7921ab430f823b5288d9f4694d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:56.068697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc093f64-c346-47ff-b150-43c114c41ae9 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:56.072008 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 107/217] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:55 2022] GET /identity/v3/users/9ae88a7921ab430f823b5288d9f4694d => generated 297 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:56.073315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d568b-1698-4a84-9c31-a6c7134b24b7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:56.073744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d568b-1698-4a84-9c31-a6c7134b24b7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:56.074206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d568b-1698-4a84-9c31-a6c7134b24b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:56.093908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0b3d568b-1698-4a84-9c31-a6c7134b24b7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:56.095342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0b3d568b-1698-4a84-9c31-a6c7134b24b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:56.138085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:56.147685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:56.161887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067bd1c-5ef8-46bd-8f98-10fa8443446e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:56.167946 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 108/218] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:56.168617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d568b-1698-4a84-9c31-a6c7134b24b7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:56.208352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f1d16-516d-432f-a875-46279d675870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:56.208981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f1d16-516d-432f-a875-46279d675870 None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:56.209267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f1d16-516d-432f-a875-46279d675870 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:56.209543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f1d16-516d-432f-a875-46279d675870 None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:56.210229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f1d16-516d-432f-a875-46279d675870 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:56.212280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f1d16-516d-432f-a875-46279d675870 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:56.235349 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 111/219] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 30 20:43:56 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:43:56.236138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f1d16-516d-432f-a875-46279d675870 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:56.290875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d568b-1698-4a84-9c31-a6c7134b24b7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:56.333343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc72846-228e-4b4e-943d-8ac361e4c6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:56.334038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc72846-228e-4b4e-943d-8ac361e4c6b1 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:56.334329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc72846-228e-4b4e-943d-8ac361e4c6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:56.334661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc72846-228e-4b4e-943d-8ac361e4c6b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:56.364686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f1d16-516d-432f-a875-46279d675870 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:56.391948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:56.412801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd093-5ca9-4359-aad9-b25baa71f05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:56.413472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd093-5ca9-4359-aad9-b25baa71f05e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:56.413863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd093-5ca9-4359-aad9-b25baa71f05e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:56.414695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd093-5ca9-4359-aad9-b25baa71f05e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:56.425067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc72846-228e-4b4e-943d-8ac361e4c6b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:56.427237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc72846-228e-4b4e-943d-8ac361e4c6b1 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:56.430606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dd093-5ca9-4359-aad9-b25baa71f05e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:56.438024 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-5a4dd093-5ca9-4359-aad9-b25baa71f05e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:43:56.438024 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:56.438024 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:56.438024 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:56.438024 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:56.438024 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:56.438024 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:56.438024 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:56.438024 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:56.438024 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:56.438024 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:56.438024 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:56.438024 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:56.438024 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:56.438024 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:56.438024 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:56.439041 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:56.439041 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:56.439041 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:56.439041 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:56.439041 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:56.439041 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:56.439041 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:56.439041 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:56.439041 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:56.439041 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:56.439041 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:56.439041 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:56.439041 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:56.439041 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:56.439041 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:56.439041 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:56.440717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:56.440717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:56.440717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:56.440717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:56.440717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:56.440717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:56.440717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:56.440717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:56.440717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:56.440717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:56.440717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:43:56.440717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:43:56.440717 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 112/220] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:43:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:56.445131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd093-5ca9-4359-aad9-b25baa71f05e None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:56.458601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:56.560803 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 109/221] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:43:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:43:56.566184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc72846-228e-4b4e-943d-8ac361e4c6b1 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:56.586252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd093-5ca9-4359-aad9-b25baa71f05e None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:56.632313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb12445-142b-401d-844a-d4ddc136e062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:56.633731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb12445-142b-401d-844a-d4ddc136e062 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:56.634273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb12445-142b-401d-844a-d4ddc136e062 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:56.634273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb12445-142b-401d-844a-d4ddc136e062 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:56.635261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb12445-142b-401d-844a-d4ddc136e062 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:56.635602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb12445-142b-401d-844a-d4ddc136e062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:56.637000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb12445-142b-401d-844a-d4ddc136e062 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:56.648980 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 113/222] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:43:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:56.654849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb12445-142b-401d-844a-d4ddc136e062 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:56.681246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:56.708801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc72846-228e-4b4e-943d-8ac361e4c6b1 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:56.748865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf00819-c425-476d-8e5c-a70a8399d225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:56.749523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf00819-c425-476d-8e5c-a70a8399d225 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:56.749807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf00819-c425-476d-8e5c-a70a8399d225 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:56.750080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf00819-c425-476d-8e5c-a70a8399d225 None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:56.751267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf00819-c425-476d-8e5c-a70a8399d225 None admin] RBAC: Authorizing `identity:get_project(project_id=ae7c0ef917404ec9a98252b586e52c5c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:56.752766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf00819-c425-476d-8e5c-a70a8399d225 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:56.753010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:56.754618 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 110/223] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:43:56 2022] GET /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:43:56.761641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf00819-c425-476d-8e5c-a70a8399d225 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:56.802664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb12445-142b-401d-844a-d4ddc136e062 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:56.849336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fa3db-eeed-49e6-bb59-29b66c6b612a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:56.850512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fa3db-eeed-49e6-bb59-29b66c6b612a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:56.850803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fa3db-eeed-49e6-bb59-29b66c6b612a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:56.851087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fa3db-eeed-49e6-bb59-29b66c6b612a None admin] PATH_INFO: `/v3/users/e278464475b2423fa85987f1391426cf` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:56.852850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fa3db-eeed-49e6-bb59-29b66c6b612a None admin] RBAC: Authorizing `identity:get_user(user_id=e278464475b2423fa85987f1391426cf)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:56.855085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fa3db-eeed-49e6-bb59-29b66c6b612a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:56.857794 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 114/224] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:56 2022] GET /identity/v3/users/e278464475b2423fa85987f1391426cf => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:43:56.864346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fa3db-eeed-49e6-bb59-29b66c6b612a None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:56.895937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf00819-c425-476d-8e5c-a70a8399d225 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:56.959280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0c108-e952-44f8-bfaf-3cf6f98523b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:56.960478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0c108-e952-44f8-bfaf-3cf6f98523b6 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:56.960782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0c108-e952-44f8-bfaf-3cf6f98523b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:56.961865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0c108-e952-44f8-bfaf-3cf6f98523b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:56.962687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0c108-e952-44f8-bfaf-3cf6f98523b6 None admin] RBAC: Adding query filter params (role.id=c3edb43d117b427a91e426e4e42f0c63, scope.project.id=ae7c0ef917404ec9a98252b586e52c5c, user.id=9ae88a7921ab430f823b5288d9f4694d) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:56.963168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0c108-e952-44f8-bfaf-3cf6f98523b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:56.965287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0c108-e952-44f8-bfaf-3cf6f98523b6 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:56.973113 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 111/225] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:43:56 2022] GET /identity/v3/role_assignments?user.id=9ae88a7921ab430f823b5288d9f4694d&scope.project.id=ae7c0ef917404ec9a98252b586e52c5c&role.id=c3edb43d117b427a91e426e4e42f0c63 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:56.974479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfee11e-f222-4832-a7c2-bae8edde4ab7 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:56.974771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfee11e-f222-4832-a7c2-bae8edde4ab7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:56.975051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfee11e-f222-4832-a7c2-bae8edde4ab7 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:56.976401 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 112/226] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:56.982766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37045dc-8d7e-440b-83ec-574d20077bd3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:56.983326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37045dc-8d7e-440b-83ec-574d20077bd3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:56.983788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37045dc-8d7e-440b-83ec-574d20077bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:56.999809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:57.007387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a37045dc-8d7e-440b-83ec-574d20077bd3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:57.009827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a37045dc-8d7e-440b-83ec-574d20077bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:57.072180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fa3db-eeed-49e6-bb59-29b66c6b612a None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:57.095836 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 113/227] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:57.122611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37045dc-8d7e-440b-83ec-574d20077bd3 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:57.155106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a7d36-1807-4000-bbcf-96acc210af5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:57.155805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a7d36-1807-4000-bbcf-96acc210af5a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:57.156091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a7d36-1807-4000-bbcf-96acc210af5a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:57.156369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a7d36-1807-4000-bbcf-96acc210af5a None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:57.158422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a7d36-1807-4000-bbcf-96acc210af5a None admin] RBAC: Authorizing `identity:get_project(project_id=ae7c0ef917404ec9a98252b586e52c5c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:57.160274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a7d36-1807-4000-bbcf-96acc210af5a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:57.161994 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 115/228] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:43:56 2022] GET /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:57.168241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a7d36-1807-4000-bbcf-96acc210af5a None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:57.175316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:57.314189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a7d36-1807-4000-bbcf-96acc210af5a None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:57.343303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37045dc-8d7e-440b-83ec-574d20077bd3 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:57.367076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13ce52-0bfe-4f41-859b-a8d347cec675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:57.369296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13ce52-0bfe-4f41-859b-a8d347cec675 None admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:57.369591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13ce52-0bfe-4f41-859b-a8d347cec675 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:57.369890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13ce52-0bfe-4f41-859b-a8d347cec675 None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c/users/e278464475b2423fa85987f1391426cf/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:57.373135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13ce52-0bfe-4f41-859b-a8d347cec675 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae7c0ef917404ec9a98252b586e52c5c, user_id=e278464475b2423fa85987f1391426cf, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:57.375466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13ce52-0bfe-4f41-859b-a8d347cec675 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:57.402092 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 116/229] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:43:57 2022] PUT /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c/users/e278464475b2423fa85987f1391426cf/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 20:43:57.411276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc13f0-5d77-4189-bb15-3707c8ffb963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:57.411960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc13f0-5d77-4189-bb15-3707c8ffb963 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:57.412244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc13f0-5d77-4189-bb15-3707c8ffb963 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:57.412519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc13f0-5d77-4189-bb15-3707c8ffb963 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:57.417400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:57.428836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc13f0-5d77-4189-bb15-3707c8ffb963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:57.434226 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-dddc13f0-5d77-4189-bb15-3707c8ffb963 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:43:57.434226 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:57.434226 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:57.434226 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:57.434226 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:57.434226 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:57.434226 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:57.434226 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:57.434226 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:57.434226 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:57.434226 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:57.434226 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:57.434226 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:57.434226 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:57.434226 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:57.434226 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:57.435098 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:57.435098 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:57.435098 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:57.435098 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:57.435098 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:57.435098 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:57.435098 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:57.435098 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:57.435098 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:57.435098 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:57.435098 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:57.435098 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:57.435098 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:57.435098 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:57.435098 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:57.435098 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:57.435915 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:57.435915 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:57.435915 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:57.435915 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:57.435915 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:57.435915 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:57.435915 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:57.435915 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:57.435915 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:57.435915 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:57.435915 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:43:57.435915 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:43:57.435915 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 114/230] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:43:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:57.445313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13ce52-0bfe-4f41-859b-a8d347cec675 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:57.530343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:57.563823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13ce52-0bfe-4f41-859b-a8d347cec675 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:57.600267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb0763-797a-4b47-8d0c-4ec183dae85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:57.600962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb0763-797a-4b47-8d0c-4ec183dae85d None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:57.601251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb0763-797a-4b47-8d0c-4ec183dae85d None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:57.601607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb0763-797a-4b47-8d0c-4ec183dae85d None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:57.602344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb0763-797a-4b47-8d0c-4ec183dae85d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:57.602651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb0763-797a-4b47-8d0c-4ec183dae85d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:57.604124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb0763-797a-4b47-8d0c-4ec183dae85d None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:57.613563 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 117/231] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:43:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:57.620364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc13f0-5d77-4189-bb15-3707c8ffb963 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:57.747583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc13f0-5d77-4189-bb15-3707c8ffb963 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:57.792719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761edaf-740f-42e8-9a33-da734c07ad06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:57.793754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761edaf-740f-42e8-9a33-da734c07ad06 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:57.794237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761edaf-740f-42e8-9a33-da734c07ad06 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:57.794701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761edaf-740f-42e8-9a33-da734c07ad06 None admin] PATH_INFO: `/v3/users/e278464475b2423fa85987f1391426cf` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:57.796128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761edaf-740f-42e8-9a33-da734c07ad06 None admin] RBAC: Authorizing `identity:get_user(user_id=e278464475b2423fa85987f1391426cf)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:57.797775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761edaf-740f-42e8-9a33-da734c07ad06 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:57.799671 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 115/232] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:57 2022] GET /identity/v3/users/e278464475b2423fa85987f1391426cf => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:57.805833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb0763-797a-4b47-8d0c-4ec183dae85d None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:57.934402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb0763-797a-4b47-8d0c-4ec183dae85d None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:57.971054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:57.977046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00011ec-d41a-434d-a500-3f53fc31962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:57.977876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00011ec-d41a-434d-a500-3f53fc31962a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:57.978409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00011ec-d41a-434d-a500-3f53fc31962a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:57.978690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00011ec-d41a-434d-a500-3f53fc31962a None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:57.980021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00011ec-d41a-434d-a500-3f53fc31962a None admin] RBAC: Authorizing `identity:get_project(project_id=ae7c0ef917404ec9a98252b586e52c5c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:57.981542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00011ec-d41a-434d-a500-3f53fc31962a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:57.983408 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 118/233] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:43:57 2022] GET /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:43:57.989093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761edaf-740f-42e8-9a33-da734c07ad06 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:58.081049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:58.132023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761edaf-740f-42e8-9a33-da734c07ad06 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:58.185934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d3b5e-d9af-424e-ad9a-715c2d04da11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:58.186533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d3b5e-d9af-424e-ad9a-715c2d04da11 None admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:58.186820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d3b5e-d9af-424e-ad9a-715c2d04da11 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:58.187097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d3b5e-d9af-424e-ad9a-715c2d04da11 None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c/users/e278464475b2423fa85987f1391426cf/roles/bb6a9a85fcb54a31a5a42bea4a88a5b9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:58.189513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d3b5e-d9af-424e-ad9a-715c2d04da11 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae7c0ef917404ec9a98252b586e52c5c, user_id=e278464475b2423fa85987f1391426cf, role_id=bb6a9a85fcb54a31a5a42bea4a88a5b9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:58.190968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d3b5e-d9af-424e-ad9a-715c2d04da11 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:58.212650 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 116/234] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:43:57 2022] PUT /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c/users/e278464475b2423fa85987f1391426cf/roles/bb6a9a85fcb54a31a5a42bea4a88a5b9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:43:59.092475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd56c5a-3c10-43d4-b70a-7fab1533b013 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:59.093445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd56c5a-3c10-43d4-b70a-7fab1533b013 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:59.093975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd56c5a-3c10-43d4-b70a-7fab1533b013 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:59.095607 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 119/235] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:59.113208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d2f7f-9fec-4091-8a60-e3507bed371d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:59.114121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d2f7f-9fec-4091-8a60-e3507bed371d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:59.114599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d2f7f-9fec-4091-8a60-e3507bed371d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:59.140273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-026d2f7f-9fec-4091-8a60-e3507bed371d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:59.141845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-026d2f7f-9fec-4091-8a60-e3507bed371d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:59.182214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca74f03-eae6-4371-81b0-450e9901d95e None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:59.182826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca74f03-eae6-4371-81b0-450e9901d95e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:59.183324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca74f03-eae6-4371-81b0-450e9901d95e None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:59.184872 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 120/236] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:43:59.200593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d3ba6-c26c-4545-9fc0-99315c123649 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:59.201233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d3ba6-c26c-4545-9fc0-99315c123649 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:59.201708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d3ba6-c26c-4545-9fc0-99315c123649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:59.230635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c19d3ba6-c26c-4545-9fc0-99315c123649 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:59.232242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c19d3ba6-c26c-4545-9fc0-99315c123649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:59.284823 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 117/237] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:43:59.312904 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 121/238] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:43:59.320778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d2f7f-9fec-4091-8a60-e3507bed371d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:59.354549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d3ba6-c26c-4545-9fc0-99315c123649 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:59.405921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:59.481330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d2f7f-9fec-4091-8a60-e3507bed371d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:59.509513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d3ba6-c26c-4545-9fc0-99315c123649 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:59.530626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20721659-3787-40bf-adb3-16a4c1044b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:59.531540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20721659-3787-40bf-adb3-16a4c1044b2e None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:59.531971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20721659-3787-40bf-adb3-16a4c1044b2e None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:59.533146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20721659-3787-40bf-adb3-16a4c1044b2e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:59.547699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:59.552665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20721659-3787-40bf-adb3-16a4c1044b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:43:59.559361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-20721659-3787-40bf-adb3-16a4c1044b2e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 30 20:43:59.559361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:43:59.559361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:43:59.559361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:43:59.559361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:43:59.559361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:43:59.559361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:43:59.559361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:43:59.559361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:43:59.559361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:43:59.559361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:43:59.559361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:43:59.559361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:43:59.559361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:43:59.559361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:43:59.559361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:43:59.560424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:43:59.560424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:43:59.560424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:43:59.560424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:43:59.560424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:43:59.560424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:43:59.560424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:43:59.560424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:43:59.560424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:43:59.560424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:43:59.560424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:43:59.560424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:43:59.560424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:43:59.560424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:43:59.560424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:43:59.560424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:43:59.561258 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:43:59.561258 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:43:59.561258 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:43:59.561258 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:43:59.561258 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:43:59.561258 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:43:59.561258 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:43:59.561258 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:43:59.561258 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:43:59.561258 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:43:59.561258 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 30 20:43:59.561258 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:43:59.561258 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 118/239] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:43:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:43:59.572115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20721659-3787-40bf-adb3-16a4c1044b2e None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:59.588807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed5c83-f876-4a94-aafe-3cb8e5ffc21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:59.589582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed5c83-f876-4a94-aafe-3cb8e5ffc21c None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:59.589875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed5c83-f876-4a94-aafe-3cb8e5ffc21c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:59.590159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed5c83-f876-4a94-aafe-3cb8e5ffc21c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:59.592358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed5c83-f876-4a94-aafe-3cb8e5ffc21c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:59.593951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed5c83-f876-4a94-aafe-3cb8e5ffc21c None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:59.595988 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 122/240] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:43:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:43:59.602124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed5c83-f876-4a94-aafe-3cb8e5ffc21c None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:59.692503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20721659-3787-40bf-adb3-16a4c1044b2e None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:59.709284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:43:59.733218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0ff61-58c4-4ca4-ad99-d4932d4e985a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:59.734079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0ff61-58c4-4ca4-ad99-d4932d4e985a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:59.734506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0ff61-58c4-4ca4-ad99-d4932d4e985a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:59.734925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0ff61-58c4-4ca4-ad99-d4932d4e985a None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:59.735826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0ff61-58c4-4ca4-ad99-d4932d4e985a None admin] RBAC: Adding query filter params (name=reader) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:43:59.736304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0ff61-58c4-4ca4-ad99-d4932d4e985a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:59.738198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0ff61-58c4-4ca4-ad99-d4932d4e985a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:59.748162 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 119/241] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:43:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:43:59.754972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0ff61-58c4-4ca4-ad99-d4932d4e985a None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:43:59.786729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed5c83-f876-4a94-aafe-3cb8e5ffc21c None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:59.843168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d436c-8604-4058-8c91-41df274fdd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:59.844252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d436c-8604-4058-8c91-41df274fdd7a None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:59.844745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d436c-8604-4058-8c91-41df274fdd7a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:59.845232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d436c-8604-4058-8c91-41df274fdd7a None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:59.846212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d436c-8604-4058-8c91-41df274fdd7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:59.847978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d436c-8604-4058-8c91-41df274fdd7a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:59.872598 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 123/242] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 30 20:43:59 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 20:43:59.876619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0ff61-58c4-4ca4-ad99-d4932d4e985a None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:43:59.881635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd52ca0-0f8c-4b91-b9c6-eb7df2709507 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:59.882270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd52ca0-0f8c-4b91-b9c6-eb7df2709507 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:59.882864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd52ca0-0f8c-4b91-b9c6-eb7df2709507 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:59.884648 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 124/243] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:43:59 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:43:59.890796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203dd6c-0e2b-46db-95e1-56b66eaf9c9a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:59.891475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203dd6c-0e2b-46db-95e1-56b66eaf9c9a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:59.892053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203dd6c-0e2b-46db-95e1-56b66eaf9c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:59.917169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd36f79-3c53-4c80-bd64-e1ee350c3e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:43:59.917833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd36f79-3c53-4c80-bd64-e1ee350c3e16 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:43:59.918119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd36f79-3c53-4c80-bd64-e1ee350c3e16 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:43:59.918398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd36f79-3c53-4c80-bd64-e1ee350c3e16 None admin] PATH_INFO: `/v3/users/7f2b87b048aa4d9d974d12366affb46b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:43:59.928672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e203dd6c-0e2b-46db-95e1-56b66eaf9c9a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:43:59.930851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e203dd6c-0e2b-46db-95e1-56b66eaf9c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:43:59.935081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd36f79-3c53-4c80-bd64-e1ee350c3e16 None admin] RBAC: Authorizing `identity:get_user(user_id=7f2b87b048aa4d9d974d12366affb46b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:43:59.939319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd36f79-3c53-4c80-bd64-e1ee350c3e16 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:43:59.939319 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 120/244] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:43:59 2022] GET /identity/v3/users/7f2b87b048aa4d9d974d12366affb46b => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:43:59.943319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd36f79-3c53-4c80-bd64-e1ee350c3e16 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:00.004135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:00.027714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:00.083161 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 125/245] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:00.098177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd36f79-3c53-4c80-bd64-e1ee350c3e16 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:00.107817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203dd6c-0e2b-46db-95e1-56b66eaf9c9a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:00.170755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3bcd2-3128-4cb2-bbf1-17fae93ba6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:00.171441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3bcd2-3128-4cb2-bbf1-17fae93ba6b8 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:00.171731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3bcd2-3128-4cb2-bbf1-17fae93ba6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:00.172013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3bcd2-3128-4cb2-bbf1-17fae93ba6b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:00.220476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203dd6c-0e2b-46db-95e1-56b66eaf9c9a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:00.248474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3bcd2-3128-4cb2-bbf1-17fae93ba6b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:00.249990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3bcd2-3128-4cb2-bbf1-17fae93ba6b8 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:00.263992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c52389-e9cf-40b5-98d9-ba21c1ba1403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:00.265016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c52389-e9cf-40b5-98d9-ba21c1ba1403 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:00.265521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c52389-e9cf-40b5-98d9-ba21c1ba1403 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:00.265989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c52389-e9cf-40b5-98d9-ba21c1ba1403 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:00.277789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c52389-e9cf-40b5-98d9-ba21c1ba1403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:00.283070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-c3c52389-e9cf-40b5-98d9-ba21c1ba1403 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:00.283070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:00.283070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:00.283070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:00.283070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:00.283070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:00.283070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:00.283070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:00.283070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:00.283070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:00.283070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:00.283070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:00.283070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:00.283070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:00.283070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:00.283070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:00.285136 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:00.285136 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:00.285136 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:00.285136 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:00.285136 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:00.285136 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:00.285136 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:00.285136 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:00.285136 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:00.285136 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:00.285136 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:00.285136 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:00.285136 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:00.285136 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:00.285136 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:00.285136 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:00.285946 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:00.285946 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:00.285946 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:00.285946 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:00.285946 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:00.285946 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:00.285946 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:00.285946 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:00.285946 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:00.285946 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:00.285946 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:00.285946 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:00.293786 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 126/246] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:44:00.295326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c52389-e9cf-40b5-98d9-ba21c1ba1403 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:00.332741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:00.333974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:00.361774 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 121/247] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:43:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 30 20:44:00.367319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3bcd2-3128-4cb2-bbf1-17fae93ba6b8 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:00.410326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c52389-e9cf-40b5-98d9-ba21c1ba1403 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:00.452216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae9783-7302-4af4-bd1b-f021acea9348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:00.452959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae9783-7302-4af4-bd1b-f021acea9348 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:00.453132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae9783-7302-4af4-bd1b-f021acea9348 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:00.453406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae9783-7302-4af4-bd1b-f021acea9348 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:00.454404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae9783-7302-4af4-bd1b-f021acea9348 None admin] RBAC: Adding query filter params (name=member) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:00.454404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae9783-7302-4af4-bd1b-f021acea9348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:00.458744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae9783-7302-4af4-bd1b-f021acea9348 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:00.465856 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 127/248] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:44:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:00.467110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c50415-50cf-4030-9e81-963110bb9ec3 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:00.467447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c50415-50cf-4030-9e81-963110bb9ec3 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:00.467729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c50415-50cf-4030-9e81-963110bb9ec3 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:00.469652 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 128/249] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:00.474130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c50415-50cf-4030-9e81-963110bb9ec3 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:00.486503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3bcd2-3128-4cb2-bbf1-17fae93ba6b8 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:00.531375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea5129-881d-432b-81be-4337e3f18df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:00.532032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea5129-881d-432b-81be-4337e3f18df3 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:00.532321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea5129-881d-432b-81be-4337e3f18df3 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:00.532595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea5129-881d-432b-81be-4337e3f18df3 None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:00.533865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea5129-881d-432b-81be-4337e3f18df3 None admin] RBAC: Authorizing `identity:get_project(project_id=ae7c0ef917404ec9a98252b586e52c5c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:00.535371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea5129-881d-432b-81be-4337e3f18df3 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:00.537039 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 122/250] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:00 2022] GET /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:00.543927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb80fb-b206-4434-9478-d9a2e248415b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:00.544218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb80fb-b206-4434-9478-d9a2e248415b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:00.544503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb80fb-b206-4434-9478-d9a2e248415b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:00.551578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:00.565618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f7eb80fb-b206-4434-9478-d9a2e248415b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:00.567226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f7eb80fb-b206-4434-9478-d9a2e248415b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:00.592150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:00.598771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c50415-50cf-4030-9e81-963110bb9ec3 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:00.645307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa9a38-aa9d-4e40-a892-8818a9bdc21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:00.645885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa9a38-aa9d-4e40-a892-8818a9bdc21d None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:00.646171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa9a38-aa9d-4e40-a892-8818a9bdc21d None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:00.646449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa9a38-aa9d-4e40-a892-8818a9bdc21d None admin] PATH_INFO: `/v3/users/9ae88a7921ab430f823b5288d9f4694d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:00.648692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa9a38-aa9d-4e40-a892-8818a9bdc21d None admin] RBAC: Authorizing `identity:get_user(user_id=9ae88a7921ab430f823b5288d9f4694d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:00.650174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa9a38-aa9d-4e40-a892-8818a9bdc21d None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:00.653347 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 123/252] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:00.654431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb80fb-b206-4434-9478-d9a2e248415b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:00.657030 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 129/252] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:44:00 2022] GET /identity/v3/users/9ae88a7921ab430f823b5288d9f4694d => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:00.658858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa9a38-aa9d-4e40-a892-8818a9bdc21d None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:00.770701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa9a38-aa9d-4e40-a892-8818a9bdc21d None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:00.790590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb80fb-b206-4434-9478-d9a2e248415b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:00.807108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00076988-a242-4963-9932-f07a30243843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:00.807837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00076988-a242-4963-9932-f07a30243843 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:00.808121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00076988-a242-4963-9932-f07a30243843 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:00.808450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00076988-a242-4963-9932-f07a30243843 None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:00.809627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00076988-a242-4963-9932-f07a30243843 None admin] RBAC: Authorizing `identity:get_project(project_id=ae7c0ef917404ec9a98252b586e52c5c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:00.811093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00076988-a242-4963-9932-f07a30243843 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:00.817668 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 130/253] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:00 2022] GET /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:00.818608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00076988-a242-4963-9932-f07a30243843 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:00.833058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:00.845296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176f685-59eb-41d8-aba8-a4d43fa1d32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:00.846361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176f685-59eb-41d8-aba8-a4d43fa1d32e None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:00.846859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176f685-59eb-41d8-aba8-a4d43fa1d32e None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:00.847360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176f685-59eb-41d8-aba8-a4d43fa1d32e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:00.848390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176f685-59eb-41d8-aba8-a4d43fa1d32e None admin] RBAC: Adding query filter params (role.id=db8677d195074e639671c1d9bf559e95, scope.project.id=ae7c0ef917404ec9a98252b586e52c5c, user.id=7f2b87b048aa4d9d974d12366affb46b) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:00.848911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176f685-59eb-41d8-aba8-a4d43fa1d32e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:00.850645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176f685-59eb-41d8-aba8-a4d43fa1d32e None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:00.863370 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 124/254] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:44:00 2022] GET /identity/v3/role_assignments?user.id=7f2b87b048aa4d9d974d12366affb46b&scope.project.id=ae7c0ef917404ec9a98252b586e52c5c&role.id=db8677d195074e639671c1d9bf559e95 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:00.864553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176f685-59eb-41d8-aba8-a4d43fa1d32e None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:00.990568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:01.033217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176f685-59eb-41d8-aba8-a4d43fa1d32e None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:01.081172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5319f-646b-4d9c-ae39-66ece22a6f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:01.082837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5319f-646b-4d9c-ae39-66ece22a6f4c None admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:01.083362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5319f-646b-4d9c-ae39-66ece22a6f4c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:01.084095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5319f-646b-4d9c-ae39-66ece22a6f4c None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c/users/9ae88a7921ab430f823b5288d9f4694d/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:01.086970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5319f-646b-4d9c-ae39-66ece22a6f4c None admin] RBAC: Authorizing `identity:create_grant(project_id=ae7c0ef917404ec9a98252b586e52c5c, user_id=9ae88a7921ab430f823b5288d9f4694d, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:01.087678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00076988-a242-4963-9932-f07a30243843 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:01.088905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5319f-646b-4d9c-ae39-66ece22a6f4c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:01.108618 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 125/255] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:44:00 2022] PUT /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c/users/9ae88a7921ab430f823b5288d9f4694d/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:44:01.142044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5925b-eac0-4dbc-984b-c953d7d62336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:01.143238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5925b-eac0-4dbc-984b-c953d7d62336 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:01.143649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5925b-eac0-4dbc-984b-c953d7d62336 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:01.143984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5925b-eac0-4dbc-984b-c953d7d62336 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:01.160664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5925b-eac0-4dbc-984b-c953d7d62336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:01.166741 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-86b5925b-eac0-4dbc-984b-c953d7d62336 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:44:01.166741 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:01.166741 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:01.166741 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:01.166741 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:01.166741 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:01.166741 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:01.166741 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:01.166741 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:01.166741 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:01.166741 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:01.166741 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:01.166741 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:01.166741 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:01.166741 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:01.166741 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:01.167680 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:01.167680 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:01.167680 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:01.167680 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:01.167680 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:01.167680 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:01.167680 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:01.167680 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:01.167680 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:01.167680 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:01.167680 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:01.167680 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:01.167680 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:01.167680 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:01.167680 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:01.167680 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:01.168472 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:01.168472 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:01.168472 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:01.168472 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:01.168472 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:01.168472 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:01.168472 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:01.168472 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:01.168472 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:01.168472 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:01.168472 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:44:01.168472 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:01.169072 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 131/256] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:44:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:01.174230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5319f-646b-4d9c-ae39-66ece22a6f4c None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:01.250826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:01.308778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5319f-646b-4d9c-ae39-66ece22a6f4c None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:01.347432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ee982-4159-498c-9a5d-324becfd4098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:01.348075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ee982-4159-498c-9a5d-324becfd4098 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:01.348360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ee982-4159-498c-9a5d-324becfd4098 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:01.348636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ee982-4159-498c-9a5d-324becfd4098 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:01.349372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ee982-4159-498c-9a5d-324becfd4098 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:01.349676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ee982-4159-498c-9a5d-324becfd4098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:01.351075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ee982-4159-498c-9a5d-324becfd4098 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:01.362126 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 126/257] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:01.368175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5925b-eac0-4dbc-984b-c953d7d62336 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:01.474058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:01.481533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5925b-eac0-4dbc-984b-c953d7d62336 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:01.518941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3397e34-98bf-42c5-a514-63df8bd2c20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:01.519582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3397e34-98bf-42c5-a514-63df8bd2c20d None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:01.519866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3397e34-98bf-42c5-a514-63df8bd2c20d None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:01.520141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3397e34-98bf-42c5-a514-63df8bd2c20d None admin] PATH_INFO: `/v3/users/e278464475b2423fa85987f1391426cf` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:01.521323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3397e34-98bf-42c5-a514-63df8bd2c20d None admin] RBAC: Authorizing `identity:get_user(user_id=e278464475b2423fa85987f1391426cf)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:01.522782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3397e34-98bf-42c5-a514-63df8bd2c20d None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:01.524815 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 132/258] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:44:01 2022] GET /identity/v3/users/e278464475b2423fa85987f1391426cf => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:01.532459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ee982-4159-498c-9a5d-324becfd4098 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:01.660778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ee982-4159-498c-9a5d-324becfd4098 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:01.688149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:01.710639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bce59-46d4-4ecf-a5e0-9e5972c53198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:01.711323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bce59-46d4-4ecf-a5e0-9e5972c53198 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:01.711616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bce59-46d4-4ecf-a5e0-9e5972c53198 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:01.711894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bce59-46d4-4ecf-a5e0-9e5972c53198 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:01.817360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bce59-46d4-4ecf-a5e0-9e5972c53198 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:01.818863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bce59-46d4-4ecf-a5e0-9e5972c53198 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:01.939954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c711d4-7d0d-4c50-8194-ed1141bca51c None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:01.940266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c711d4-7d0d-4c50-8194-ed1141bca51c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:01.940513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c711d4-7d0d-4c50-8194-ed1141bca51c None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:01.942145 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 133/259] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:01.958309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb94be-7396-499b-92fb-c35636b093b1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:01.958656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb94be-7396-499b-92fb-c35636b093b1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:01.959043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb94be-7396-499b-92fb-c35636b093b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:01.970476 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 127/260] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:01.975596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bce59-46d4-4ecf-a5e0-9e5972c53198 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:02.000517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2cfb94be-7396-499b-92fb-c35636b093b1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:02.002066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2cfb94be-7396-499b-92fb-c35636b093b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:02.025408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:02.102194 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 134/261] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:02.139152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb94be-7396-499b-92fb-c35636b093b1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:02.233416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bce59-46d4-4ecf-a5e0-9e5972c53198 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:02.303684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:02.320712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb94be-7396-499b-92fb-c35636b093b1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:02.336065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5312a4-68ea-45dc-9ea3-fe05a03ea7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:02.336743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5312a4-68ea-45dc-9ea3-fe05a03ea7df None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:02.337026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5312a4-68ea-45dc-9ea3-fe05a03ea7df None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:02.337298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5312a4-68ea-45dc-9ea3-fe05a03ea7df None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:02.344040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5312a4-68ea-45dc-9ea3-fe05a03ea7df None admin] RBAC: Authorizing `identity:get_project(project_id=ae7c0ef917404ec9a98252b586e52c5c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:02.345506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5312a4-68ea-45dc-9ea3-fe05a03ea7df None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:02.347536 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 128/262] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:01 2022] GET /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c => generated 302 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:02.356305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5312a4-68ea-45dc-9ea3-fe05a03ea7df None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:02.377964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a891c34-3774-4c32-8ac8-ea7b467b0cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:02.378625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a891c34-3774-4c32-8ac8-ea7b467b0cff None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:02.378918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a891c34-3774-4c32-8ac8-ea7b467b0cff None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:02.379177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a891c34-3774-4c32-8ac8-ea7b467b0cff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:02.396932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a891c34-3774-4c32-8ac8-ea7b467b0cff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:02.402873 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-9a891c34-3774-4c32-8ac8-ea7b467b0cff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:44:02.402873 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:02.402873 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:02.402873 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:02.402873 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:02.402873 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:02.402873 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:02.402873 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:02.402873 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:02.402873 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:02.402873 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:02.402873 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:02.402873 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:02.402873 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:02.402873 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:02.402873 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:02.403780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:02.403780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:02.403780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:02.403780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:02.403780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:02.403780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:02.403780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:02.403780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:02.403780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:02.403780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:02.403780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:02.403780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:02.403780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:02.403780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:02.403780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:02.403780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:02.404578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:02.404578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:02.404578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:02.404578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:02.404578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:02.404578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:02.404578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:02.404578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:02.404578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:02.404578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:02.404578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:44:02.404578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:02.417004 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 135/263] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:44:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:44:02.422690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a891c34-3774-4c32-8ac8-ea7b467b0cff None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:02.575196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a891c34-3774-4c32-8ac8-ea7b467b0cff None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:02.627094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894ca2f-0dc0-4d3d-b95a-258a0cd07885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:02.627689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894ca2f-0dc0-4d3d-b95a-258a0cd07885 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:02.627977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894ca2f-0dc0-4d3d-b95a-258a0cd07885 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:02.628261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894ca2f-0dc0-4d3d-b95a-258a0cd07885 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:02.628997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894ca2f-0dc0-4d3d-b95a-258a0cd07885 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:02.629425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894ca2f-0dc0-4d3d-b95a-258a0cd07885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:02.630927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894ca2f-0dc0-4d3d-b95a-258a0cd07885 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:02.640632 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 136/264] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:02.646457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894ca2f-0dc0-4d3d-b95a-258a0cd07885 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:02.656414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:02.677553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:02.697448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5312a4-68ea-45dc-9ea3-fe05a03ea7df None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:02.805365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894ca2f-0dc0-4d3d-b95a-258a0cd07885 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:02.824012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652f7a4-b135-420b-a2e4-2f51c77cdfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:02.824890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f7a4-b135-420b-a2e4-2f51c77cdfab None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:02.825349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f7a4-b135-420b-a2e4-2f51c77cdfab None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:02.825764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f7a4-b135-420b-a2e4-2f51c77cdfab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:02.826680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652f7a4-b135-420b-a2e4-2f51c77cdfab None admin] RBAC: Adding query filter params (role.id=3b89b89da98d4ec08a0587aa13832636, scope.project.id=ae7c0ef917404ec9a98252b586e52c5c, user.id=e278464475b2423fa85987f1391426cf) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:02.827115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652f7a4-b135-420b-a2e4-2f51c77cdfab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:02.828702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652f7a4-b135-420b-a2e4-2f51c77cdfab None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:02.849522 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 129/265] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:44:02 2022] GET /identity/v3/role_assignments?user.id=e278464475b2423fa85987f1391426cf&scope.project.id=ae7c0ef917404ec9a98252b586e52c5c&role.id=3b89b89da98d4ec08a0587aa13832636 => generated 608 bytes in 493 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:02.876453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb56d3-9e5a-47fc-a1be-03a3938e721b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:02.877403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb56d3-9e5a-47fc-a1be-03a3938e721b None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:02.877726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb56d3-9e5a-47fc-a1be-03a3938e721b None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:02.878099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb56d3-9e5a-47fc-a1be-03a3938e721b None admin] PATH_INFO: `/v3/users/e278464475b2423fa85987f1391426cf` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:02.879451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb56d3-9e5a-47fc-a1be-03a3938e721b None admin] RBAC: Authorizing `identity:get_user(user_id=e278464475b2423fa85987f1391426cf)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:02.884386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb56d3-9e5a-47fc-a1be-03a3938e721b None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:02.886922 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 137/266] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:44:02 2022] GET /identity/v3/users/e278464475b2423fa85987f1391426cf => generated 283 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:02.892402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652f7a4-b135-420b-a2e4-2f51c77cdfab None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:03.056944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652f7a4-b135-420b-a2e4-2f51c77cdfab None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:03.105913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46dfe2-cd8d-4240-8c7f-4be5f97ce061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:03.106566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46dfe2-cd8d-4240-8c7f-4be5f97ce061 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:03.106850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46dfe2-cd8d-4240-8c7f-4be5f97ce061 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:03.107120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46dfe2-cd8d-4240-8c7f-4be5f97ce061 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:03.133684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:03.199490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46dfe2-cd8d-4240-8c7f-4be5f97ce061 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:03.201063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46dfe2-cd8d-4240-8c7f-4be5f97ce061 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:03.393474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1884aa-490c-4f63-9265-000c156791da None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:03.394475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1884aa-490c-4f63-9265-000c156791da None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:03.394979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1884aa-490c-4f63-9265-000c156791da None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:03.401084 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 138/267] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:03.413103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c6b30-48fa-426e-b3aa-9455751e588d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:03.414296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c6b30-48fa-426e-b3aa-9455751e588d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:03.414774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c6b30-48fa-426e-b3aa-9455751e588d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:03.454722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-236c6b30-48fa-426e-b3aa-9455751e588d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:03.455952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-236c6b30-48fa-426e-b3aa-9455751e588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:03.470596 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 130/268] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:03.480305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46dfe2-cd8d-4240-8c7f-4be5f97ce061 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:03.539272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:03.560952 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 139/269] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:44:03.593973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46dfe2-cd8d-4240-8c7f-4be5f97ce061 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:03.603777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c6b30-48fa-426e-b3aa-9455751e588d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:03.635661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:03.635950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd664d7-43a6-4520-a2bb-6981d1b14c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:03.636700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd664d7-43a6-4520-a2bb-6981d1b14c66 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:03.636880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd664d7-43a6-4520-a2bb-6981d1b14c66 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:03.637154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd664d7-43a6-4520-a2bb-6981d1b14c66 None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:03.639369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd664d7-43a6-4520-a2bb-6981d1b14c66 None admin] RBAC: Authorizing `identity:get_project(project_id=ae7c0ef917404ec9a98252b586e52c5c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:03.640836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd664d7-43a6-4520-a2bb-6981d1b14c66 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:03.642669 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 131/270] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:03 2022] GET /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:03.654811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd664d7-43a6-4520-a2bb-6981d1b14c66 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:03.812035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c6b30-48fa-426e-b3aa-9455751e588d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:03.841109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd664d7-43a6-4520-a2bb-6981d1b14c66 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:03.888804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:03.899985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d48cd-5570-4def-aa1f-f36e99c035f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:03.900642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d48cd-5570-4def-aa1f-f36e99c035f1 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:03.900926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d48cd-5570-4def-aa1f-f36e99c035f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:03.901198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d48cd-5570-4def-aa1f-f36e99c035f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:03.920122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95764b53-986c-4830-9c8c-b4d09a10d290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:03.920695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95764b53-986c-4830-9c8c-b4d09a10d290 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:03.920978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95764b53-986c-4830-9c8c-b4d09a10d290 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:03.921253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95764b53-986c-4830-9c8c-b4d09a10d290 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:03.922073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95764b53-986c-4830-9c8c-b4d09a10d290 None admin] RBAC: Adding query filter params (role.id=bb6a9a85fcb54a31a5a42bea4a88a5b9, scope.project.id=ae7c0ef917404ec9a98252b586e52c5c, user.id=e278464475b2423fa85987f1391426cf) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:03.922385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95764b53-986c-4830-9c8c-b4d09a10d290 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:03.923923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95764b53-986c-4830-9c8c-b4d09a10d290 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:03.931280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d48cd-5570-4def-aa1f-f36e99c035f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:03.936580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-9d5d48cd-5570-4def-aa1f-f36e99c035f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:03.936580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:03.936580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:03.936580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:03.936580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:03.936580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:03.936580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:03.936580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:03.936580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:03.936580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:03.936580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:03.936580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:03.936580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:03.936580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:03.936580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:03.936580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:03.937540 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:03.937540 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:03.937540 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:03.937540 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:03.937540 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:03.937540 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:03.937540 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:03.937540 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:03.937540 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:03.937540 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:03.937540 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:03.937540 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:03.937540 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:03.937540 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:03.937540 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:03.937540 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:03.938343 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:03.938343 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:03.938343 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:03.938343 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:03.938343 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:03.938343 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:03.938343 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:03.938343 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:03.938343 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:03.938343 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:03.938343 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:03.938343 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:03.943619 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 140/271] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:44:03.946263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d48cd-5570-4def-aa1f-f36e99c035f1 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:03.947896 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 132/272] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:44:03 2022] GET /identity/v3/role_assignments?user.id=e278464475b2423fa85987f1391426cf&scope.project.id=ae7c0ef917404ec9a98252b586e52c5c&role.id=bb6a9a85fcb54a31a5a42bea4a88a5b9 => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:03.996276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68bfdb-5356-48d9-baaa-dd524f245cf1 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:03.997080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68bfdb-5356-48d9-baaa-dd524f245cf1 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:03.997582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68bfdb-5356-48d9-baaa-dd524f245cf1 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:03.999413 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 133/273] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:44:04.005266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df9035-b463-49a8-a4c9-17341e9f1565 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:04.005882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df9035-b463-49a8-a4c9-17341e9f1565 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:04.006365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df9035-b463-49a8-a4c9-17341e9f1565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:04.026281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-62df9035-b463-49a8-a4c9-17341e9f1565 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:04.027938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-62df9035-b463-49a8-a4c9-17341e9f1565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:04.047666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:04.089674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d48cd-5570-4def-aa1f-f36e99c035f1 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:04.133431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c170a28-39bd-4b63-8609-c4894ef68c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:04.134329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c170a28-39bd-4b63-8609-c4894ef68c33 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:04.134758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c170a28-39bd-4b63-8609-c4894ef68c33 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:04.135204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c170a28-39bd-4b63-8609-c4894ef68c33 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:04.136112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c170a28-39bd-4b63-8609-c4894ef68c33 None admin] RBAC: Adding query filter params (name=member) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:04.136559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c170a28-39bd-4b63-8609-c4894ef68c33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:04.138720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c170a28-39bd-4b63-8609-c4894ef68c33 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:04.154016 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 141/274] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:44:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:04.154016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18123ecd-ff1c-4a83-b326-f6b84b3904be None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:04.154016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18123ecd-ff1c-4a83-b326-f6b84b3904be None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:04.154016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18123ecd-ff1c-4a83-b326-f6b84b3904be None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:04.154755 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 142/275] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:04.156761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18123ecd-ff1c-4a83-b326-f6b84b3904be None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:04.169945 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 134/276] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:44:04.176727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1a90e-e41e-4c56-a001-5f92750f0a8c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:04.177035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1a90e-e41e-4c56-a001-5f92750f0a8c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:04.177338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1a90e-e41e-4c56-a001-5f92750f0a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:04.218549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f8a1a90e-e41e-4c56-a001-5f92750f0a8c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:04.219794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f8a1a90e-e41e-4c56-a001-5f92750f0a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:04.302891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18123ecd-ff1c-4a83-b326-f6b84b3904be None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:04.316540 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 135/277] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:04.317315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1a90e-e41e-4c56-a001-5f92750f0a8c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:04.350739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ec579-8ed5-4f3a-bb32-b08e838112b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:04.351542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ec579-8ed5-4f3a-bb32-b08e838112b4 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:04.351830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ec579-8ed5-4f3a-bb32-b08e838112b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:04.352158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ec579-8ed5-4f3a-bb32-b08e838112b4 None admin] PATH_INFO: `/v3/users/b513b824e25a4182a64c60960b35cc1f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:04.354706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:04.367400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:04.371762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ec579-8ed5-4f3a-bb32-b08e838112b4 None admin] RBAC: Authorizing `identity:get_user(user_id=b513b824e25a4182a64c60960b35cc1f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:04.373392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ec579-8ed5-4f3a-bb32-b08e838112b4 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:04.375085 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 143/278] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:44:04 2022] GET /identity/v3/users/b513b824e25a4182a64c60960b35cc1f => generated 293 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:04.380317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ec579-8ed5-4f3a-bb32-b08e838112b4 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:04.424822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1a90e-e41e-4c56-a001-5f92750f0a8c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:04.462390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a63da-d1be-454c-9457-293f7aa0bc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:04.462994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a63da-d1be-454c-9457-293f7aa0bc08 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:04.463280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a63da-d1be-454c-9457-293f7aa0bc08 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:04.463588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a63da-d1be-454c-9457-293f7aa0bc08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:04.464743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a63da-d1be-454c-9457-293f7aa0bc08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:04.466194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a63da-d1be-454c-9457-293f7aa0bc08 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:04.467813 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 136/279] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:04.468612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a63da-d1be-454c-9457-293f7aa0bc08 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:04.485629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ec579-8ed5-4f3a-bb32-b08e838112b4 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:04.520102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb48ec-fc7c-4e53-855d-30117e8dc6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:04.520740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb48ec-fc7c-4e53-855d-30117e8dc6bd None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:04.521021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb48ec-fc7c-4e53-855d-30117e8dc6bd None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:04.521293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb48ec-fc7c-4e53-855d-30117e8dc6bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:04.531653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb48ec-fc7c-4e53-855d-30117e8dc6bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:04.536471 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-a2cb48ec-fc7c-4e53-855d-30117e8dc6bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:04.536471 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:04.536471 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:04.536471 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:04.536471 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:04.536471 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:04.536471 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:04.536471 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:04.536471 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:04.536471 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:04.536471 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:04.536471 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:04.536471 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:04.536471 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:04.536471 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:04.536471 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:04.537374 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:04.537374 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:04.537374 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:04.537374 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:04.537374 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:04.537374 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:04.537374 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:04.537374 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:04.537374 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:04.537374 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:04.537374 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:04.537374 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:04.537374 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:04.537374 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:04.537374 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:04.537374 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:04.538160 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:04.538160 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:04.538160 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:04.538160 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:04.538160 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:04.538160 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:04.538160 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:04.538160 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:04.538160 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:04.538160 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:04.538160 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:04.538160 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:04.538160 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 144/280] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:04.538918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0fba6-2e07-475d-a065-3311ad188399 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:04.540285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0fba6-2e07-475d-a065-3311ad188399 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:04.540285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0fba6-2e07-475d-a065-3311ad188399 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:04.540572 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 145/281] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:04.541247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0fba6-2e07-475d-a065-3311ad188399 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:04.569209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a63da-d1be-454c-9457-293f7aa0bc08 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:04.581090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:04.595148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:04.605284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a0c57-1502-48b5-aed7-50844b92573f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:04.605908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a0c57-1502-48b5-aed7-50844b92573f None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:04.606190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a0c57-1502-48b5-aed7-50844b92573f None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:04.606465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a0c57-1502-48b5-aed7-50844b92573f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:04.607242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a0c57-1502-48b5-aed7-50844b92573f None admin] RBAC: Adding query filter params (role.id=c3edb43d117b427a91e426e4e42f0c63, user.id=b513b824e25a4182a64c60960b35cc1f, scope.system=all) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:04.607582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a0c57-1502-48b5-aed7-50844b92573f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:04.609049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a0c57-1502-48b5-aed7-50844b92573f None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:04.614202 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 137/282] 10.222.0.17 () {56 vars in 1308 bytes} [Sat Jul 30 20:44:04 2022] GET /identity/v3/role_assignments?user.id=b513b824e25a4182a64c60960b35cc1f&scope.system=all&role.id=c3edb43d117b427a91e426e4e42f0c63 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:04.614781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a0c57-1502-48b5-aed7-50844b92573f None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:04.646831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0fba6-2e07-475d-a065-3311ad188399 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:04.685042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4655f-2586-4d5e-be97-69285fa2268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:04.685673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4655f-2586-4d5e-be97-69285fa2268d None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:04.685977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4655f-2586-4d5e-be97-69285fa2268d None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:04.686255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4655f-2586-4d5e-be97-69285fa2268d None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:04.686940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4655f-2586-4d5e-be97-69285fa2268d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:04.688480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4655f-2586-4d5e-be97-69285fa2268d None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:04.714004 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 146/283] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 30 20:44:04 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:44:04.715651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24513a-4c67-4da5-9468-bef978b61b2b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:04.715993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24513a-4c67-4da5-9468-bef978b61b2b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:04.716282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24513a-4c67-4da5-9468-bef978b61b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:04.743136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a0c57-1502-48b5-aed7-50844b92573f None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:04.761649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fb24513a-4c67-4da5-9468-bef978b61b2b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:04.764424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fb24513a-4c67-4da5-9468-bef978b61b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:04.792934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466da288-c76d-43fd-84c3-a38d4b7862bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:04.793591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466da288-c76d-43fd-84c3-a38d4b7862bd None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:04.793868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466da288-c76d-43fd-84c3-a38d4b7862bd None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:04.794144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466da288-c76d-43fd-84c3-a38d4b7862bd None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:04.795013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466da288-c76d-43fd-84c3-a38d4b7862bd None admin] RBAC: Adding query filter params (name=member) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:04.795380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466da288-c76d-43fd-84c3-a38d4b7862bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:04.796845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466da288-c76d-43fd-84c3-a38d4b7862bd None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:04.810557 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 138/284] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:44:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:04.817421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466da288-c76d-43fd-84c3-a38d4b7862bd None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:04.875032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:04.885383 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 147/285] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:04.906214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24513a-4c67-4da5-9468-bef978b61b2b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:04.951480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:04.956749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466da288-c76d-43fd-84c3-a38d4b7862bd None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:05.010711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67449093-65d5-49b8-8cc1-66002fea1c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:05.013973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67449093-65d5-49b8-8cc1-66002fea1c90 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:05.013973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67449093-65d5-49b8-8cc1-66002fea1c90 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:05.013973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67449093-65d5-49b8-8cc1-66002fea1c90 None admin] PATH_INFO: `/v3/users/9ae88a7921ab430f823b5288d9f4694d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:05.015724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67449093-65d5-49b8-8cc1-66002fea1c90 None admin] RBAC: Authorizing `identity:get_user(user_id=9ae88a7921ab430f823b5288d9f4694d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:05.017018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67449093-65d5-49b8-8cc1-66002fea1c90 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:05.023608 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 139/286] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:44:04 2022] GET /identity/v3/users/9ae88a7921ab430f823b5288d9f4694d => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:05.027662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67449093-65d5-49b8-8cc1-66002fea1c90 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:05.038492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24513a-4c67-4da5-9468-bef978b61b2b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:05.082299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33794c6d-c3f8-4d76-a56c-0c16b8f1ac1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:05.082802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33794c6d-c3f8-4d76-a56c-0c16b8f1ac1e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:05.084153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33794c6d-c3f8-4d76-a56c-0c16b8f1ac1e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:05.084432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33794c6d-c3f8-4d76-a56c-0c16b8f1ac1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:05.095905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33794c6d-c3f8-4d76-a56c-0c16b8f1ac1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:05.100984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-33794c6d-c3f8-4d76-a56c-0c16b8f1ac1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 30 20:44:05.100984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:05.100984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:05.100984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:05.100984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:05.100984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:05.100984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:05.100984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:05.100984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:05.100984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:05.100984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:05.100984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:05.100984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:05.100984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:05.100984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:05.100984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:05.102638 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:05.102638 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:05.102638 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:05.102638 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:05.102638 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:05.102638 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:05.102638 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:05.102638 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:05.102638 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:05.102638 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:05.102638 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:05.102638 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:05.102638 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:05.102638 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:05.102638 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:05.102638 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:05.103608 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:05.103608 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:05.103608 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:05.103608 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:05.103608 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:05.103608 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:05.103608 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:05.103608 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:05.103608 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:05.103608 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:05.103608 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 30 20:44:05.103608 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:05.103608 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 148/287] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:05.110521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33794c6d-c3f8-4d76-a56c-0c16b8f1ac1e None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:05.187352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67449093-65d5-49b8-8cc1-66002fea1c90 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:05.189702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:05.225950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa08fc-0a70-445b-badc-63a79eb4a2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:05.226662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa08fc-0a70-445b-badc-63a79eb4a2c2 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:05.226942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa08fc-0a70-445b-badc-63a79eb4a2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:05.227221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa08fc-0a70-445b-badc-63a79eb4a2c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:05.227735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:05.236445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33794c6d-c3f8-4d76-a56c-0c16b8f1ac1e None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:05.277634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba08c8-73b6-4417-9df1-7a065e46ee5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:05.278179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba08c8-73b6-4417-9df1-7a065e46ee5d None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:05.278559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba08c8-73b6-4417-9df1-7a065e46ee5d None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:05.278837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba08c8-73b6-4417-9df1-7a065e46ee5d None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:05.279683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba08c8-73b6-4417-9df1-7a065e46ee5d None admin] RBAC: Adding query filter params (name=reader) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:05.280035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba08c8-73b6-4417-9df1-7a065e46ee5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:05.281461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba08c8-73b6-4417-9df1-7a065e46ee5d None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:05.290903 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 149/288] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:44:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:05.301763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba08c8-73b6-4417-9df1-7a065e46ee5d None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:05.318092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa08fc-0a70-445b-badc-63a79eb4a2c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:05.319587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa08fc-0a70-445b-badc-63a79eb4a2c2 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:05.442279 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 140/289] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:05.448762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa08fc-0a70-445b-badc-63a79eb4a2c2 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:05.451807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:05.561447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa08fc-0a70-445b-badc-63a79eb4a2c2 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:05.601786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077d93d-33c3-4152-a649-beca40c38dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:05.602565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077d93d-33c3-4152-a649-beca40c38dd6 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:05.602831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077d93d-33c3-4152-a649-beca40c38dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:05.603109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077d93d-33c3-4152-a649-beca40c38dd6 None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:05.606953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077d93d-33c3-4152-a649-beca40c38dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=ae7c0ef917404ec9a98252b586e52c5c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:05.610395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077d93d-33c3-4152-a649-beca40c38dd6 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:05.612334 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 141/290] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:05 2022] GET /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:05.620277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077d93d-33c3-4152-a649-beca40c38dd6 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:05.620434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba08c8-73b6-4417-9df1-7a065e46ee5d None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:05.664383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523c596-5e5c-4d56-825c-35d81a6bbe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:05.665055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523c596-5e5c-4d56-825c-35d81a6bbe51 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:05.665378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523c596-5e5c-4d56-825c-35d81a6bbe51 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:05.665674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523c596-5e5c-4d56-825c-35d81a6bbe51 None admin] PATH_INFO: `/v3/users/7f2b87b048aa4d9d974d12366affb46b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:05.668032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523c596-5e5c-4d56-825c-35d81a6bbe51 None admin] RBAC: Authorizing `identity:get_user(user_id=7f2b87b048aa4d9d974d12366affb46b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:05.669476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523c596-5e5c-4d56-825c-35d81a6bbe51 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:05.673934 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 150/291] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:44:05 2022] GET /identity/v3/users/7f2b87b048aa4d9d974d12366affb46b => generated 297 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:05.677833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523c596-5e5c-4d56-825c-35d81a6bbe51 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:05.744524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:05.767256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:05.778060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077d93d-33c3-4152-a649-beca40c38dd6 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:05.839324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf9f53-a319-47fa-8124-02b6b306b27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:05.839968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf9f53-a319-47fa-8124-02b6b306b27a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:05.840251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf9f53-a319-47fa-8124-02b6b306b27a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:05.841653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf9f53-a319-47fa-8124-02b6b306b27a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:05.842454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf9f53-a319-47fa-8124-02b6b306b27a None admin] RBAC: Adding query filter params (role.id=c3edb43d117b427a91e426e4e42f0c63, scope.project.id=ae7c0ef917404ec9a98252b586e52c5c, user.id=9ae88a7921ab430f823b5288d9f4694d) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:05.842762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf9f53-a319-47fa-8124-02b6b306b27a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:05.844849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf9f53-a319-47fa-8124-02b6b306b27a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:05.852106 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 142/292] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:44:05 2022] GET /identity/v3/role_assignments?user.id=9ae88a7921ab430f823b5288d9f4694d&scope.project.id=ae7c0ef917404ec9a98252b586e52c5c&role.id=c3edb43d117b427a91e426e4e42f0c63 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:05.920456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523c596-5e5c-4d56-825c-35d81a6bbe51 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:05.975603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabfb9f-d096-43ca-bd55-22a1aa113d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:05.977235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabfb9f-d096-43ca-bd55-22a1aa113d85 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:05.977740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabfb9f-d096-43ca-bd55-22a1aa113d85 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:05.978212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabfb9f-d096-43ca-bd55-22a1aa113d85 None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:05.982158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabfb9f-d096-43ca-bd55-22a1aa113d85 None admin] RBAC: Authorizing `identity:get_project(project_id=ae7c0ef917404ec9a98252b586e52c5c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:05.984012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabfb9f-d096-43ca-bd55-22a1aa113d85 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:05.990968 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 151/293] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:05 2022] GET /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:05.994875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf9f53-a319-47fa-8124-02b6b306b27a None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:06.143405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf9f53-a319-47fa-8124-02b6b306b27a None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:06.179155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e93caf-5cd7-4f49-ba99-f1b2139d8564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:06.180738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e93caf-5cd7-4f49-ba99-f1b2139d8564 None admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:06.181245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e93caf-5cd7-4f49-ba99-f1b2139d8564 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:06.181724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e93caf-5cd7-4f49-ba99-f1b2139d8564 None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c/users/7f2b87b048aa4d9d974d12366affb46b/roles/db8677d195074e639671c1d9bf559e95` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:06.183918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e93caf-5cd7-4f49-ba99-f1b2139d8564 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae7c0ef917404ec9a98252b586e52c5c, user_id=7f2b87b048aa4d9d974d12366affb46b, role_id=db8677d195074e639671c1d9bf559e95)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:06.185621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e93caf-5cd7-4f49-ba99-f1b2139d8564 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:06.188884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:06.200936 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 143/294] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:44:05 2022] PUT /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c/users/7f2b87b048aa4d9d974d12366affb46b/roles/db8677d195074e639671c1d9bf559e95 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:44:06.993554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5573d8-9a44-4fda-a8aa-5c4cc61a75be None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:06.993554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5573d8-9a44-4fda-a8aa-5c4cc61a75be None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:06.993554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5573d8-9a44-4fda-a8aa-5c4cc61a75be None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:06.993554 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 152/295] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:06.998831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c1f0f-6365-451a-ae48-c3616fb845b1 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:06.999224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c1f0f-6365-451a-ae48-c3616fb845b1 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:06.999431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c1f0f-6365-451a-ae48-c3616fb845b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:07.021984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-6a2c1f0f-6365-451a-ae48-c3616fb845b1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:07.023581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6a2c1f0f-6365-451a-ae48-c3616fb845b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:07.093098 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 144/296] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:44:07.116130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5573d8-9a44-4fda-a8aa-5c4cc61a75be None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:07.223446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:07.231622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5573d8-9a44-4fda-a8aa-5c4cc61a75be None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:07.267004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fc06f-0e61-4272-9602-ef837b398b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:07.267989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fc06f-0e61-4272-9602-ef837b398b9c None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:07.268414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fc06f-0e61-4272-9602-ef837b398b9c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:07.268828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fc06f-0e61-4272-9602-ef837b398b9c None admin] PATH_INFO: `/v3/roles/member` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:07.282608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fc06f-0e61-4272-9602-ef837b398b9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:07.288606 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-d35fc06f-0e61-4272-9602-ef837b398b9c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:07.288606 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:07.288606 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:07.288606 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:07.288606 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:07.288606 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:07.288606 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:07.288606 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:07.288606 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:07.288606 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:07.288606 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:07.288606 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:07.288606 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:07.288606 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:07.288606 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:07.288606 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:07.289848 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:07.289848 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:07.289848 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:07.289848 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:07.289848 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:07.289848 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:07.289848 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:07.289848 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:07.289848 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:07.289848 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:07.289848 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:07.289848 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:07.289848 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:07.289848 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:07.289848 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:07.289848 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:07.290845 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:07.290845 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:07.290845 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:07.290845 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:07.290845 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:07.290845 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:07.290845 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:07.290845 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:07.290845 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:07.290845 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:07.290845 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:07.290845 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:07.293484 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 153/297] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:07.300959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c1f0f-6365-451a-ae48-c3616fb845b1 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:07.403529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c1f0f-6365-451a-ae48-c3616fb845b1 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:07.432277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:07.445904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5abbdb-437a-438f-a964-c1a77a5d0b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:07.446549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5abbdb-437a-438f-a964-c1a77a5d0b3e None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:07.446833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5abbdb-437a-438f-a964-c1a77a5d0b3e None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:07.447107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5abbdb-437a-438f-a964-c1a77a5d0b3e None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:07.447864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5abbdb-437a-438f-a964-c1a77a5d0b3e None admin] RBAC: Adding query filter params (name=member) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:07.448168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5abbdb-437a-438f-a964-c1a77a5d0b3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:07.449556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5abbdb-437a-438f-a964-c1a77a5d0b3e None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:07.452825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c23bac-1ed9-4a18-8705-8989f87ed93a None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:07.453285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c23bac-1ed9-4a18-8705-8989f87ed93a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:07.453716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c23bac-1ed9-4a18-8705-8989f87ed93a None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:07.455335 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 154/298] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:07.459034 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 145/299] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:44:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:07.461448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce02b3-0e95-43b1-9542-c99bca9a5ad6 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:07.461984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce02b3-0e95-43b1-9542-c99bca9a5ad6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:07.462456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce02b3-0e95-43b1-9542-c99bca9a5ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:07.465395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5abbdb-437a-438f-a964-c1a77a5d0b3e None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:07.483782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-94ce02b3-0e95-43b1-9542-c99bca9a5ad6 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:07.485414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-94ce02b3-0e95-43b1-9542-c99bca9a5ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:07.571392 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 155/300] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:07.588059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce02b3-0e95-43b1-9542-c99bca9a5ad6 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:07.588494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5abbdb-437a-438f-a964-c1a77a5d0b3e None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:07.625062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0ee63-e1a5-432f-a027-14cb5c921cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:07.625753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0ee63-e1a5-432f-a027-14cb5c921cca None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:07.626109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0ee63-e1a5-432f-a027-14cb5c921cca None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:07.626303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0ee63-e1a5-432f-a027-14cb5c921cca None admin] PATH_INFO: `/v3/users/b513b824e25a4182a64c60960b35cc1f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:07.627943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0ee63-e1a5-432f-a027-14cb5c921cca None admin] RBAC: Authorizing `identity:get_user(user_id=b513b824e25a4182a64c60960b35cc1f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:07.629017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0ee63-e1a5-432f-a027-14cb5c921cca None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:07.630796 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 146/301] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:44:07 2022] GET /identity/v3/users/b513b824e25a4182a64c60960b35cc1f => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:07.636441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0ee63-e1a5-432f-a027-14cb5c921cca None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:07.680643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:07.696401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce02b3-0e95-43b1-9542-c99bca9a5ad6 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:07.697216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:07.733827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48893b-f7b1-415f-8960-1d445efcf474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:07.734477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48893b-f7b1-415f-8960-1d445efcf474 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:07.734792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48893b-f7b1-415f-8960-1d445efcf474 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:07.735024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48893b-f7b1-415f-8960-1d445efcf474 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:07.744486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0ee63-e1a5-432f-a027-14cb5c921cca None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:07.746293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48893b-f7b1-415f-8960-1d445efcf474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:07.751137 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-2f48893b-f7b1-415f-8960-1d445efcf474 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 30 20:44:07.751137 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:07.751137 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:07.751137 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:07.751137 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:07.751137 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:07.751137 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:07.751137 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:07.751137 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:07.751137 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:07.751137 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:07.751137 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:07.751137 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:07.751137 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:07.751137 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:07.751137 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:07.752059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:07.752059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:07.752059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:07.752059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:07.752059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:07.752059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:07.752059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:07.752059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:07.752059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:07.752059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:07.752059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:07.752059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:07.752059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:07.752059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:07.752059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:07.752059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:07.752858 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:07.752858 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:07.752858 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:07.752858 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:07.752858 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:07.752858 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:07.752858 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:07.752858 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:07.752858 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:07.752858 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:07.752858 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 30 20:44:07.752858 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:07.752858 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 156/302] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:44:07.754856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9cc52-267e-4549-9c30-beebc096fad6 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:07.755153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9cc52-267e-4549-9c30-beebc096fad6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:07.755456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9cc52-267e-4549-9c30-beebc096fad6 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:07.757828 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 157/303] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:07.762059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9cc52-267e-4549-9c30-beebc096fad6 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:07.786552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615f43b-fad0-4d3a-8d0b-707dc341905e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:07.787219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615f43b-fad0-4d3a-8d0b-707dc341905e None admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:07.787536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615f43b-fad0-4d3a-8d0b-707dc341905e None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:07.787816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615f43b-fad0-4d3a-8d0b-707dc341905e None admin] PATH_INFO: `/v3/system/users/b513b824e25a4182a64c60960b35cc1f/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:07.789816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615f43b-fad0-4d3a-8d0b-707dc341905e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b513b824e25a4182a64c60960b35cc1f, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:07.791181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615f43b-fad0-4d3a-8d0b-707dc341905e None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:07.800931 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 147/304] 10.222.0.17 () {58 vars in 1334 bytes} [Sat Jul 30 20:44:07 2022] PUT /identity/v3/system/users/b513b824e25a4182a64c60960b35cc1f/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 20:44:07.802400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e5939-2838-4da8-b7df-26dd4d9c28ed None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:07.802888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e5939-2838-4da8-b7df-26dd4d9c28ed None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:07.803401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e5939-2838-4da8-b7df-26dd4d9c28ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:07.826043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7e6e5939-2838-4da8-b7df-26dd4d9c28ed None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:07.827855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7e6e5939-2838-4da8-b7df-26dd4d9c28ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:07.903779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9cc52-267e-4549-9c30-beebc096fad6 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:07.908964 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 148/305] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:07.933429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e5939-2838-4da8-b7df-26dd4d9c28ed None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:07.944039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d17094-c05d-42ef-bddf-0cc9800baecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:07.945208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d17094-c05d-42ef-bddf-0cc9800baecb None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:07.945491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d17094-c05d-42ef-bddf-0cc9800baecb None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:07.945760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d17094-c05d-42ef-bddf-0cc9800baecb None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:07.946499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d17094-c05d-42ef-bddf-0cc9800baecb None admin] RBAC: Adding query filter params (name=reader) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:07.946799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d17094-c05d-42ef-bddf-0cc9800baecb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:07.948255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d17094-c05d-42ef-bddf-0cc9800baecb None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:07.959824 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 158/306] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:44:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:07.966230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d17094-c05d-42ef-bddf-0cc9800baecb None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:07.979477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:07.998675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:08.062855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e5939-2838-4da8-b7df-26dd4d9c28ed None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:08.095767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d17094-c05d-42ef-bddf-0cc9800baecb None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:08.106457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c927e7e-e6db-4752-a26c-2a0fc0b0fe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:08.107745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c927e7e-e6db-4752-a26c-2a0fc0b0fe36 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:08.108477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c927e7e-e6db-4752-a26c-2a0fc0b0fe36 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:08.108903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c927e7e-e6db-4752-a26c-2a0fc0b0fe36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:08.110385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c927e7e-e6db-4752-a26c-2a0fc0b0fe36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:08.112703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c927e7e-e6db-4752-a26c-2a0fc0b0fe36 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:08.115109 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 149/307] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:08.121088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c927e7e-e6db-4752-a26c-2a0fc0b0fe36 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:08.135650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b93a7-87e0-4575-927e-e4b699b91983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:08.136529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b93a7-87e0-4575-927e-e4b699b91983 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:08.137111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b93a7-87e0-4575-927e-e4b699b91983 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:08.137659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b93a7-87e0-4575-927e-e4b699b91983 None admin] PATH_INFO: `/v3/users/a3c709422e13473784caeade75b3fa34` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:08.152964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b93a7-87e0-4575-927e-e4b699b91983 None admin] RBAC: Authorizing `identity:get_user(user_id=a3c709422e13473784caeade75b3fa34)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:08.154496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b93a7-87e0-4575-927e-e4b699b91983 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:08.161119 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 159/308] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:44:07 2022] GET /identity/v3/users/a3c709422e13473784caeade75b3fa34 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:08.162132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b93a7-87e0-4575-927e-e4b699b91983 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:08.232294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c927e7e-e6db-4752-a26c-2a0fc0b0fe36 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:08.237349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:08.250901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:08.269310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd8f3f-dfe7-43c1-99b4-d77f7020146c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:08.269957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd8f3f-dfe7-43c1-99b4-d77f7020146c None admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:08.270244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd8f3f-dfe7-43c1-99b4-d77f7020146c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:08.270523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd8f3f-dfe7-43c1-99b4-d77f7020146c None admin] PATH_INFO: `/v3/groups` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:08.271556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd8f3f-dfe7-43c1-99b4-d77f7020146c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:08.273315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd8f3f-dfe7-43c1-99b4-d77f7020146c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:08.280823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b93a7-87e0-4575-927e-e4b699b91983 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:08.292334 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 150/309] 10.222.0.17 () {60 vars in 1134 bytes} [Sat Jul 30 20:44:08 2022] POST /identity/v3/groups => generated 229 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 20:44:08.328103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb8eba-0f84-483f-be8e-23fb448ae4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:08.329242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb8eba-0f84-483f-be8e-23fb448ae4b1 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:08.329766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb8eba-0f84-483f-be8e-23fb448ae4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:08.330238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb8eba-0f84-483f-be8e-23fb448ae4b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:08.331244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb8eba-0f84-483f-be8e-23fb448ae4b1 None admin] RBAC: Adding query filter params (role.id=db8677d195074e639671c1d9bf559e95, user.id=a3c709422e13473784caeade75b3fa34, scope.system=all) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:08.331813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb8eba-0f84-483f-be8e-23fb448ae4b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:08.333628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb8eba-0f84-483f-be8e-23fb448ae4b1 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:08.340111 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 160/310] 10.222.0.17 () {56 vars in 1308 bytes} [Sat Jul 30 20:44:08 2022] GET /identity/v3/role_assignments?user.id=a3c709422e13473784caeade75b3fa34&scope.system=all&role.id=db8677d195074e639671c1d9bf559e95 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:08.557276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a61691-ddc6-4a77-86ac-30b613e01679 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:08.557569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a61691-ddc6-4a77-86ac-30b613e01679 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:08.557740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a61691-ddc6-4a77-86ac-30b613e01679 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:08.559360 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 151/311] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:08.564595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c0efc-bf77-4abd-ba5c-24811b64ece0 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:08.564891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c0efc-bf77-4abd-ba5c-24811b64ece0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:08.565176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c0efc-bf77-4abd-ba5c-24811b64ece0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:08.587436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-cd7c0efc-bf77-4abd-ba5c-24811b64ece0 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:08.589030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cd7c0efc-bf77-4abd-ba5c-24811b64ece0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:08.661683 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 161/312] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:08.686360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a61691-ddc6-4a77-86ac-30b613e01679 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:08.795561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a61691-ddc6-4a77-86ac-30b613e01679 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:08.830437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9d964-b5ad-461c-bb27-cf51eb5a26cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:08.831148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9d964-b5ad-461c-bb27-cf51eb5a26cb None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:08.831468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9d964-b5ad-461c-bb27-cf51eb5a26cb None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:08.831782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9d964-b5ad-461c-bb27-cf51eb5a26cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:08.843429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9d964-b5ad-461c-bb27-cf51eb5a26cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:08.848946 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-78c9d964-b5ad-461c-bb27-cf51eb5a26cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 30 20:44:08.848946 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:08.848946 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:08.848946 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:08.848946 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:08.848946 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:08.848946 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:08.848946 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:08.848946 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:08.848946 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:08.848946 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:08.848946 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:08.848946 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:08.848946 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:08.848946 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:08.848946 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:08.849825 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:08.849825 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:08.849825 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:08.849825 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:08.849825 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:08.849825 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:08.849825 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:08.849825 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:08.849825 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:08.849825 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:08.849825 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:08.849825 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:08.849825 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:08.849825 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:08.849825 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:08.849825 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:08.850622 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:08.850622 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:08.850622 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:08.850622 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:08.850622 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:08.850622 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:08.850622 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:08.850622 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:08.850622 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:08.850622 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:08.850622 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 30 20:44:08.850622 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:08.850622 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 152/313] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:08.855933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c0efc-bf77-4abd-ba5c-24811b64ece0 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:08.919771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:08.965229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c0efc-bf77-4abd-ba5c-24811b64ece0 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:09.000972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c65ac3-8495-4f53-af8e-59a3e0f372ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:09.001605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c65ac3-8495-4f53-af8e-59a3e0f372ee None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:09.001892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c65ac3-8495-4f53-af8e-59a3e0f372ee None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:09.002170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c65ac3-8495-4f53-af8e-59a3e0f372ee None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:09.002895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c65ac3-8495-4f53-af8e-59a3e0f372ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:09.003201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c65ac3-8495-4f53-af8e-59a3e0f372ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:09.004610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c65ac3-8495-4f53-af8e-59a3e0f372ee None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:09.014034 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 162/314] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:44:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:09.019532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9d964-b5ad-461c-bb27-cf51eb5a26cb None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:09.062456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:09.134477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9d964-b5ad-461c-bb27-cf51eb5a26cb None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:09.171679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531376f-0c44-4f27-ab69-965ed5d2f7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:09.172332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531376f-0c44-4f27-ab69-965ed5d2f7a4 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:09.172671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531376f-0c44-4f27-ab69-965ed5d2f7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:09.172949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531376f-0c44-4f27-ab69-965ed5d2f7a4 None admin] PATH_INFO: `/v3/users/7f2b87b048aa4d9d974d12366affb46b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:09.174153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531376f-0c44-4f27-ab69-965ed5d2f7a4 None admin] RBAC: Authorizing `identity:get_user(user_id=7f2b87b048aa4d9d974d12366affb46b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:09.175698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531376f-0c44-4f27-ab69-965ed5d2f7a4 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:09.177476 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 153/315] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:44:09 2022] GET /identity/v3/users/7f2b87b048aa4d9d974d12366affb46b => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:09.183073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c65ac3-8495-4f53-af8e-59a3e0f372ee None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:09.290373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c65ac3-8495-4f53-af8e-59a3e0f372ee None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:09.313180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:09.325788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bada6-4d84-4603-8e21-7bf548fc9202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:09.326404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bada6-4d84-4603-8e21-7bf548fc9202 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:09.326688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bada6-4d84-4603-8e21-7bf548fc9202 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:09.326967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bada6-4d84-4603-8e21-7bf548fc9202 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:09.400629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bada6-4d84-4603-8e21-7bf548fc9202 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:09.402010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bada6-4d84-4603-8e21-7bf548fc9202 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:09.505822 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 163/316] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:09.510643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531376f-0c44-4f27-ab69-965ed5d2f7a4 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:09.621932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531376f-0c44-4f27-ab69-965ed5d2f7a4 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:09.629830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:09.659501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35230c2-9a08-4902-b79a-e33b3abbea55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:09.660057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35230c2-9a08-4902-b79a-e33b3abbea55 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:09.660340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35230c2-9a08-4902-b79a-e33b3abbea55 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:09.660616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35230c2-9a08-4902-b79a-e33b3abbea55 None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:09.661799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35230c2-9a08-4902-b79a-e33b3abbea55 None admin] RBAC: Authorizing `identity:get_project(project_id=ae7c0ef917404ec9a98252b586e52c5c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:09.663237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35230c2-9a08-4902-b79a-e33b3abbea55 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:09.669982 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 154/317] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:09 2022] GET /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:09.671371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bada6-4d84-4603-8e21-7bf548fc9202 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:09.696487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:09.774215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bada6-4d84-4603-8e21-7bf548fc9202 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:09.808821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d70ee6-dd04-48dc-9193-886716f95dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:09.809438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d70ee6-dd04-48dc-9193-886716f95dd9 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:09.809725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d70ee6-dd04-48dc-9193-886716f95dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:09.810000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d70ee6-dd04-48dc-9193-886716f95dd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:09.810789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d70ee6-dd04-48dc-9193-886716f95dd9 None admin] RBAC: Adding query filter params (role.id=db8677d195074e639671c1d9bf559e95, scope.project.id=ae7c0ef917404ec9a98252b586e52c5c, user.id=7f2b87b048aa4d9d974d12366affb46b) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:09.811095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d70ee6-dd04-48dc-9193-886716f95dd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:09.812556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d70ee6-dd04-48dc-9193-886716f95dd9 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:09.823169 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 164/318] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:44:09 2022] GET /identity/v3/role_assignments?user.id=7f2b87b048aa4d9d974d12366affb46b&scope.project.id=ae7c0ef917404ec9a98252b586e52c5c&role.id=db8677d195074e639671c1d9bf559e95 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:10.197053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa9616-eba1-488b-8c0d-05f11c6b8ef5 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:10.197597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa9616-eba1-488b-8c0d-05f11c6b8ef5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:10.197597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa9616-eba1-488b-8c0d-05f11c6b8ef5 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:10.199108 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 155/319] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:10.204036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd3ffd-a8bf-4c1a-9692-b460fc4422b2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:10.204433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd3ffd-a8bf-4c1a-9692-b460fc4422b2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:10.204608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd3ffd-a8bf-4c1a-9692-b460fc4422b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:10.223159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8afd3ffd-a8bf-4c1a-9692-b460fc4422b2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:10.224379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8afd3ffd-a8bf-4c1a-9692-b460fc4422b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:10.294817 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 165/320] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:10.319211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa9616-eba1-488b-8c0d-05f11c6b8ef5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:10.421567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa9616-eba1-488b-8c0d-05f11c6b8ef5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:10.454818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26dec3d-994b-4b6a-96d0-ee1e9c6fdae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:10.455496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dec3d-994b-4b6a-96d0-ee1e9c6fdae7 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:10.455782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dec3d-994b-4b6a-96d0-ee1e9c6fdae7 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:10.456057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dec3d-994b-4b6a-96d0-ee1e9c6fdae7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:10.466637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26dec3d-994b-4b6a-96d0-ee1e9c6fdae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:10.471523 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-f26dec3d-994b-4b6a-96d0-ee1e9c6fdae7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:10.471523 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:10.471523 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:10.471523 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:10.471523 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:10.471523 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:10.471523 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:10.471523 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:10.471523 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:10.471523 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:10.471523 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:10.471523 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:10.471523 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:10.471523 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:10.471523 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:10.471523 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:10.472534 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:10.472534 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:10.472534 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:10.472534 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:10.472534 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:10.472534 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:10.472534 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:10.472534 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:10.472534 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:10.472534 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:10.472534 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:10.472534 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:10.472534 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:10.472534 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:10.472534 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:10.472534 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:10.473331 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:10.473331 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:10.473331 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:10.473331 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:10.473331 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:10.473331 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:10.473331 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:10.473331 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:10.473331 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:10.473331 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:10.473331 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:10.473331 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:10.475439 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 156/321] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:10.479169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd3ffd-a8bf-4c1a-9692-b460fc4422b2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:10.498793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:10.592157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd3ffd-a8bf-4c1a-9692-b460fc4422b2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:10.627831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9226b6-1f76-444c-9393-fb54c5c4b8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:10.628456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9226b6-1f76-444c-9393-fb54c5c4b8a5 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:10.628736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9226b6-1f76-444c-9393-fb54c5c4b8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:10.629007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9226b6-1f76-444c-9393-fb54c5c4b8a5 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:10.629720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9226b6-1f76-444c-9393-fb54c5c4b8a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:10.630024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9226b6-1f76-444c-9393-fb54c5c4b8a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:10.631424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9226b6-1f76-444c-9393-fb54c5c4b8a5 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:10.640065 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 166/322] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:44:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:10.645829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26dec3d-994b-4b6a-96d0-ee1e9c6fdae7 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:10.668408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55d1ad-2435-4456-b3ab-d0c0258729f1 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:10.668765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55d1ad-2435-4456-b3ab-d0c0258729f1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:10.669054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55d1ad-2435-4456-b3ab-d0c0258729f1 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:10.671159 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 167/323] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:44:10.676055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9a104-31a4-46d6-b0ad-36cbd536761a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:10.676367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9a104-31a4-46d6-b0ad-36cbd536761a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:10.676647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9a104-31a4-46d6-b0ad-36cbd536761a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:10.684400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:10.696169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-38b9a104-31a4-46d6-b0ad-36cbd536761a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:10.697370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-38b9a104-31a4-46d6-b0ad-36cbd536761a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:10.752917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26dec3d-994b-4b6a-96d0-ee1e9c6fdae7 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:10.764435 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 168/324] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:44:10.765763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499cb79-6f5b-442f-b36d-0ccbad4a583b None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:10.766059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499cb79-6f5b-442f-b36d-0ccbad4a583b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:10.766338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499cb79-6f5b-442f-b36d-0ccbad4a583b None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:10.767822 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 169/325] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:10.773568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cde417-8f19-46a7-9ff2-286a04efedc8 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:10.773877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cde417-8f19-46a7-9ff2-286a04efedc8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:10.774155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cde417-8f19-46a7-9ff2-286a04efedc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:10.788126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea60e9-de45-424d-bebb-bf0f22551e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:10.789060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea60e9-de45-424d-bebb-bf0f22551e6d None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:10.789344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea60e9-de45-424d-bebb-bf0f22551e6d None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:10.789619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea60e9-de45-424d-bebb-bf0f22551e6d None admin] PATH_INFO: `/v3/users/b513b824e25a4182a64c60960b35cc1f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:10.790801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea60e9-de45-424d-bebb-bf0f22551e6d None admin] RBAC: Authorizing `identity:get_user(user_id=b513b824e25a4182a64c60960b35cc1f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:10.791640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-31cde417-8f19-46a7-9ff2-286a04efedc8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:10.792273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea60e9-de45-424d-bebb-bf0f22551e6d None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:10.792836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-31cde417-8f19-46a7-9ff2-286a04efedc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:10.793874 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 157/326] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:44:10 2022] GET /identity/v3/users/b513b824e25a4182a64c60960b35cc1f => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:10.794850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea60e9-de45-424d-bebb-bf0f22551e6d None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:10.794955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:10.862428 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 170/327] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:44:10.863192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cde417-8f19-46a7-9ff2-286a04efedc8 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:10.897722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea60e9-de45-424d-bebb-bf0f22551e6d None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:10.899854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:10.933117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9dc69-9a1e-4626-8e19-fea43ce4b616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:10.933754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9dc69-9a1e-4626-8e19-fea43ce4b616 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:10.934034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9dc69-9a1e-4626-8e19-fea43ce4b616 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:10.934313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9dc69-9a1e-4626-8e19-fea43ce4b616 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:10.935474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9dc69-9a1e-4626-8e19-fea43ce4b616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:10.936932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9dc69-9a1e-4626-8e19-fea43ce4b616 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:10.938501 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 158/328] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:10.939263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9dc69-9a1e-4626-8e19-fea43ce4b616 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:10.969603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cde417-8f19-46a7-9ff2-286a04efedc8 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:11.005584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97d034-d8cd-4c9f-80ba-0811b92277d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:11.006492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97d034-d8cd-4c9f-80ba-0811b92277d7 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:11.006910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97d034-d8cd-4c9f-80ba-0811b92277d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:11.007912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97d034-d8cd-4c9f-80ba-0811b92277d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:11.008849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97d034-d8cd-4c9f-80ba-0811b92277d7 None admin] RBAC: Adding query filter params (role.id=c3edb43d117b427a91e426e4e42f0c63, user.id=b513b824e25a4182a64c60960b35cc1f, scope.system=all) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:11.009153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97d034-d8cd-4c9f-80ba-0811b92277d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:11.010578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97d034-d8cd-4c9f-80ba-0811b92277d7 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:11.015531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:11.023577 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 171/329] 10.222.0.17 () {56 vars in 1308 bytes} [Sat Jul 30 20:44:10 2022] GET /identity/v3/role_assignments?user.id=b513b824e25a4182a64c60960b35cc1f&scope.system=all&role.id=c3edb43d117b427a91e426e4e42f0c63 => generated 510 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:11.024349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97d034-d8cd-4c9f-80ba-0811b92277d7 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:11.049281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9dc69-9a1e-4626-8e19-fea43ce4b616 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:11.087491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb62a7-f55a-4f23-8e5f-a0ef64c6d4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:11.088192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb62a7-f55a-4f23-8e5f-a0ef64c6d4a8 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:11.088451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb62a7-f55a-4f23-8e5f-a0ef64c6d4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:11.088724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb62a7-f55a-4f23-8e5f-a0ef64c6d4a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:11.100708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb62a7-f55a-4f23-8e5f-a0ef64c6d4a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:11.106051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-44bb62a7-f55a-4f23-8e5f-a0ef64c6d4a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 30 20:44:11.106051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:11.106051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:11.106051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:11.106051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:11.106051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:11.106051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:11.106051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:11.106051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:11.106051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:11.106051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:11.106051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:11.106051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:11.106051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:11.106051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:11.106051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:11.107013 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:11.107013 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:11.107013 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:11.107013 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:11.107013 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:11.107013 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:11.107013 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:11.107013 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:11.107013 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:11.107013 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:11.107013 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:11.107013 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:11.107013 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:11.107013 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:11.107013 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:11.107013 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:11.107861 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:11.107861 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:11.107861 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:11.107861 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:11.107861 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:11.107861 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:11.107861 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:11.107861 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:11.107861 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:11.107861 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:11.107861 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 30 20:44:11.107861 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:11.107861 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 159/330] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:11.113320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb62a7-f55a-4f23-8e5f-a0ef64c6d4a8 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:11.138624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97d034-d8cd-4c9f-80ba-0811b92277d7 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:11.147543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:11.180699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97dcea-8ecf-406c-97d7-a7419412b014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:11.181339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97dcea-8ecf-406c-97d7-a7419412b014 None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:11.181653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97dcea-8ecf-406c-97d7-a7419412b014 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:11.181906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97dcea-8ecf-406c-97d7-a7419412b014 None admin] PATH_INFO: `/v3/groups` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:11.182576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97dcea-8ecf-406c-97d7-a7419412b014 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:11.184462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97dcea-8ecf-406c-97d7-a7419412b014 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:11.202214 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 172/331] 10.222.0.17 () {60 vars in 1134 bytes} [Sat Jul 30 20:44:11 2022] POST /identity/v3/groups => generated 226 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:44:11.246891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb62a7-f55a-4f23-8e5f-a0ef64c6d4a8 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:11.289438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621ddc5-2053-4cf6-86aa-e4f07a0b2619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:11.290082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ddc5-2053-4cf6-86aa-e4f07a0b2619 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:11.290363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ddc5-2053-4cf6-86aa-e4f07a0b2619 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:11.290633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ddc5-2053-4cf6-86aa-e4f07a0b2619 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:11.291400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621ddc5-2053-4cf6-86aa-e4f07a0b2619 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:11.291704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621ddc5-2053-4cf6-86aa-e4f07a0b2619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:11.293331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621ddc5-2053-4cf6-86aa-e4f07a0b2619 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:11.302835 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 160/332] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:44:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:11.308560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97dcea-8ecf-406c-97d7-a7419412b014 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:11.376196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:11.425150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97dcea-8ecf-406c-97d7-a7419412b014 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:11.458734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56588798-8ebc-454c-8d47-d447d5013d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:11.459420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56588798-8ebc-454c-8d47-d447d5013d78 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:11.459711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56588798-8ebc-454c-8d47-d447d5013d78 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:11.459992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56588798-8ebc-454c-8d47-d447d5013d78 None admin] PATH_INFO: `/v3/users/a3c709422e13473784caeade75b3fa34` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:11.461773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56588798-8ebc-454c-8d47-d447d5013d78 None admin] RBAC: Authorizing `identity:get_user(user_id=a3c709422e13473784caeade75b3fa34)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:11.463227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56588798-8ebc-454c-8d47-d447d5013d78 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:11.464871 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 173/333] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:44:11 2022] GET /identity/v3/users/a3c709422e13473784caeade75b3fa34 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:11.470809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621ddc5-2053-4cf6-86aa-e4f07a0b2619 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:11.570988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:11.581226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621ddc5-2053-4cf6-86aa-e4f07a0b2619 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:11.628029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd5fb3-8afb-49cb-b1ca-4681ecf129a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:11.628645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd5fb3-8afb-49cb-b1ca-4681ecf129a1 None admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:11.629063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd5fb3-8afb-49cb-b1ca-4681ecf129a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:11.633184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd5fb3-8afb-49cb-b1ca-4681ecf129a1 None admin] PATH_INFO: `/v3/system/users/a3c709422e13473784caeade75b3fa34/roles/db8677d195074e639671c1d9bf559e95` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:11.633184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd5fb3-8afb-49cb-b1ca-4681ecf129a1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a3c709422e13473784caeade75b3fa34, role_id=db8677d195074e639671c1d9bf559e95)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:11.633184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd5fb3-8afb-49cb-b1ca-4681ecf129a1 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:11.645028 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 161/334] 10.222.0.17 () {58 vars in 1334 bytes} [Sat Jul 30 20:44:11 2022] PUT /identity/v3/system/users/a3c709422e13473784caeade75b3fa34/roles/db8677d195074e639671c1d9bf559e95 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:44:14.239386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8674b91-0162-40dd-b8da-b1dc00de939f None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:14.239902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8674b91-0162-40dd-b8da-b1dc00de939f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:14.239977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8674b91-0162-40dd-b8da-b1dc00de939f None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:14.242079 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 174/335] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:14.247660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0d39a-d98c-47ed-8224-6bd8852124e9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:14.248486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0d39a-d98c-47ed-8224-6bd8852124e9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:14.248486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0d39a-d98c-47ed-8224-6bd8852124e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:14.277258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8ee0d39a-d98c-47ed-8224-6bd8852124e9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:14.278488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8ee0d39a-d98c-47ed-8224-6bd8852124e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:14.378198 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 162/336] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:14.408693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8674b91-0162-40dd-b8da-b1dc00de939f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:14.514953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02ed7d-c8e2-43cc-a6dd-1421144f1d64 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:14.515240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02ed7d-c8e2-43cc-a6dd-1421144f1d64 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:14.515468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02ed7d-c8e2-43cc-a6dd-1421144f1d64 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:14.516901 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 163/337] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:44:14.522155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907dac4-9517-43c5-bcbc-3e026454ac3c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:14.522443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907dac4-9517-43c5-bcbc-3e026454ac3c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:14.523325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907dac4-9517-43c5-bcbc-3e026454ac3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:14.553665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4907dac4-9517-43c5-bcbc-3e026454ac3c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:14.555857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4907dac4-9517-43c5-bcbc-3e026454ac3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:14.559119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8674b91-0162-40dd-b8da-b1dc00de939f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:14.611711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:14.631422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b581c-28d3-4a30-acba-d4c1c6f556f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:14.632755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b581c-28d3-4a30-acba-d4c1c6f556f7 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:14.633073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b581c-28d3-4a30-acba-d4c1c6f556f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:14.633342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b581c-28d3-4a30-acba-d4c1c6f556f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:14.651962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b581c-28d3-4a30-acba-d4c1c6f556f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:14.664664 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-d10b581c-28d3-4a30-acba-d4c1c6f556f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:44:14.664664 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:14.664664 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:14.664664 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:14.664664 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:14.664664 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:14.664664 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:14.664664 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:14.664664 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:14.664664 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:14.664664 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:14.664664 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:14.664664 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:14.664664 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:14.664664 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:14.664664 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:14.665597 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:14.665597 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:14.665597 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:14.665597 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:14.665597 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:14.665597 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:14.665597 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:14.665597 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:14.665597 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:14.665597 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:14.665597 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:14.665597 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:14.665597 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:14.665597 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:14.665597 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:14.665597 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:14.666375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:14.666375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:14.666375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:14.666375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:14.666375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:14.666375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:14.666375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:14.666375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:14.666375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:14.666375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:14.666375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:44:14.666375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:14.666375 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 175/338] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:44:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:14.667553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc7e7c-606a-4aaa-b36d-10f079dc3610 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:14.668288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc7e7c-606a-4aaa-b36d-10f079dc3610 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:14.668288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc7e7c-606a-4aaa-b36d-10f079dc3610 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:14.669528 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 176/339] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:14.674944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31df152-1b25-47ff-9b86-d320acb840ba None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:14.675447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31df152-1b25-47ff-9b86-d320acb840ba None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:14.675719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31df152-1b25-47ff-9b86-d320acb840ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:14.681291 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 164/340] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:44:14.684591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907dac4-9517-43c5-bcbc-3e026454ac3c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:14.706916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e31df152-1b25-47ff-9b86-d320acb840ba None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:14.708473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e31df152-1b25-47ff-9b86-d320acb840ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:14.723794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:14.806086 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 177/341] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:44:14.807796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31df152-1b25-47ff-9b86-d320acb840ba None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:14.860111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907dac4-9517-43c5-bcbc-3e026454ac3c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:14.915712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60023a-6923-41a5-bcd8-3552886258e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:14.916849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60023a-6923-41a5-bcd8-3552886258e9 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:14.917350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60023a-6923-41a5-bcd8-3552886258e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:14.917815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60023a-6923-41a5-bcd8-3552886258e9 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:14.918851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60023a-6923-41a5-bcd8-3552886258e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:14.919367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60023a-6923-41a5-bcd8-3552886258e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:14.920992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60023a-6923-41a5-bcd8-3552886258e9 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:14.930796 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 165/342] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:14.932097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60023a-6923-41a5-bcd8-3552886258e9 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:14.983196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31df152-1b25-47ff-9b86-d320acb840ba None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:15.020335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:15.021632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:15.052079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b3a34-8d62-4f51-aec3-da05b441c8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:15.053291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b3a34-8d62-4f51-aec3-da05b441c8ea None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:15.053727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b3a34-8d62-4f51-aec3-da05b441c8ea None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:15.054956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b3a34-8d62-4f51-aec3-da05b441c8ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:15.057268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60023a-6923-41a5-bcd8-3552886258e9 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:15.067484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b3a34-8d62-4f51-aec3-da05b441c8ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:15.074120 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-ec8b3a34-8d62-4f51-aec3-da05b441c8ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:15.074120 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:15.074120 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:15.074120 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:15.074120 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:15.074120 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:15.074120 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:15.074120 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:15.074120 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:15.074120 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:15.074120 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:15.074120 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:15.074120 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:15.074120 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:15.074120 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:15.074120 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:15.075008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:15.075008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:15.075008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:15.075008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:15.075008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:15.075008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:15.075008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:15.075008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:15.075008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:15.075008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:15.075008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:15.075008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:15.075008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:15.075008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:15.075008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:15.075008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:15.075843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:15.075843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:15.075843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:15.075843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:15.075843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:15.075843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:15.075843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:15.075843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:15.075843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:15.075843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:15.075843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:15.075843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:15.078148 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 178/343] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:15.079100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b3a34-8d62-4f51-aec3-da05b441c8ea None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:15.128806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f18d8-3124-400f-b785-77434c27b40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:15.129781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f18d8-3124-400f-b785-77434c27b40b None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:15.132840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f18d8-3124-400f-b785-77434c27b40b None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:15.133316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f18d8-3124-400f-b785-77434c27b40b None admin] PATH_INFO: `/v3/roles/member` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:15.156641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f18d8-3124-400f-b785-77434c27b40b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:15.165376 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-f04f18d8-3124-400f-b785-77434c27b40b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:15.165376 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:15.165376 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:15.165376 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:15.165376 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:15.165376 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:15.165376 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:15.165376 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:15.165376 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:15.165376 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:15.165376 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:15.165376 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:15.165376 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:15.165376 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:15.165376 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:15.165376 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:15.166465 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:15.166465 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:15.166465 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:15.166465 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:15.166465 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:15.166465 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:15.166465 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:15.166465 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:15.166465 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:15.166465 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:15.166465 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:15.166465 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:15.166465 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:15.166465 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:15.166465 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:15.166465 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:15.167333 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:15.167333 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:15.167333 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:15.167333 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:15.167333 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:15.167333 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:15.167333 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:15.167333 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:15.167333 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:15.167333 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:15.167333 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:15.167333 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:15.169368 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 166/344] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:15.170376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f18d8-3124-400f-b785-77434c27b40b None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:15.287088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b3a34-8d62-4f51-aec3-da05b441c8ea None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:15.291942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f18d8-3124-400f-b785-77434c27b40b None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:15.332358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9a6cc-fcaf-4630-b918-0c142b20222b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:15.333338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9a6cc-fcaf-4630-b918-0c142b20222b None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:15.333784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9a6cc-fcaf-4630-b918-0c142b20222b None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:15.334257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9a6cc-fcaf-4630-b918-0c142b20222b None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:15.335720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9a6cc-fcaf-4630-b918-0c142b20222b None admin] RBAC: Adding query filter params (name=member) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:15.336883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9a6cc-fcaf-4630-b918-0c142b20222b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:15.338613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9a6cc-fcaf-4630-b918-0c142b20222b None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:15.351690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:15.360352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dac08-a237-4520-8e85-2153bbfd2788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:15.361269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dac08-a237-4520-8e85-2153bbfd2788 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:15.361712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dac08-a237-4520-8e85-2153bbfd2788 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:15.362175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dac08-a237-4520-8e85-2153bbfd2788 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:15.363022 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 167/345] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:44:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:15.363830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9a6cc-fcaf-4630-b918-0c142b20222b None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:15.427131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:15.462148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63dac08-a237-4520-8e85-2153bbfd2788 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:15.464635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63dac08-a237-4520-8e85-2153bbfd2788 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:15.489674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9a6cc-fcaf-4630-b918-0c142b20222b None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:15.545771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d561112-3c91-42aa-8770-bcf5892b1deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:15.546511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d561112-3c91-42aa-8770-bcf5892b1deb None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:15.546807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d561112-3c91-42aa-8770-bcf5892b1deb None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:15.547090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d561112-3c91-42aa-8770-bcf5892b1deb None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:15.547870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d561112-3c91-42aa-8770-bcf5892b1deb None admin] RBAC: Adding query filter params (name=member) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:15.548180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d561112-3c91-42aa-8770-bcf5892b1deb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:15.549571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d561112-3c91-42aa-8770-bcf5892b1deb None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:15.560399 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 168/346] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:44:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:15.561270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7133fb-05e3-4946-ada9-d351766f6c6d None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:15.561566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7133fb-05e3-4946-ada9-d351766f6c6d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:15.561845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7133fb-05e3-4946-ada9-d351766f6c6d None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:15.563281 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 169/347] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:15.566070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7133fb-05e3-4946-ada9-d351766f6c6d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:15.611316 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 179/348] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:15.613044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85abff-0746-4f7e-8b76-360b12e8a3be None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:15.613345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85abff-0746-4f7e-8b76-360b12e8a3be None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:15.613621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85abff-0746-4f7e-8b76-360b12e8a3be None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:15.615132 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 180/349] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:15.616104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f162c-acff-4d4d-8583-eed276d24238 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:15.616464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f162c-acff-4d4d-8583-eed276d24238 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:15.616747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f162c-acff-4d4d-8583-eed276d24238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:15.641355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-826f162c-acff-4d4d-8583-eed276d24238 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:15.642559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-826f162c-acff-4d4d-8583-eed276d24238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:15.658034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:15.713448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7133fb-05e3-4946-ada9-d351766f6c6d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:15.723677 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 181/350] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:15.724747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f162c-acff-4d4d-8583-eed276d24238 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:15.730075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:15.769359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea503e-d110-44fb-b77d-cc574601658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:15.770159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea503e-d110-44fb-b77d-cc574601658c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:15.770500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea503e-d110-44fb-b77d-cc574601658c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:15.770848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea503e-d110-44fb-b77d-cc574601658c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:15.852229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f162c-acff-4d4d-8583-eed276d24238 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:15.856717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea503e-d110-44fb-b77d-cc574601658c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:15.858178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea503e-d110-44fb-b77d-cc574601658c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:15.895624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7857a03-67b8-4d0e-b120-d49d1bbe075b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:15.896277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7857a03-67b8-4d0e-b120-d49d1bbe075b None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:15.896571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7857a03-67b8-4d0e-b120-d49d1bbe075b None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:15.896848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7857a03-67b8-4d0e-b120-d49d1bbe075b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:15.936735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:15.983875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7857a03-67b8-4d0e-b120-d49d1bbe075b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:15.986066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7857a03-67b8-4d0e-b120-d49d1bbe075b None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:15.988766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:15.990017 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 170/351] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:15.990518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea503e-d110-44fb-b77d-cc574601658c None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:16.115241 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 182/352] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:16.119319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3fcb7-0634-4207-813d-1c9937bedbe0 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:16.119319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3fcb7-0634-4207-813d-1c9937bedbe0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:16.119319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3fcb7-0634-4207-813d-1c9937bedbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:16.122478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea503e-d110-44fb-b77d-cc574601658c None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:16.138588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b0c3fcb7-0634-4207-813d-1c9937bedbe0 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:16.139991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b0c3fcb7-0634-4207-813d-1c9937bedbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:16.162894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68627f4-9165-41d9-bee1-6e9cc310aa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:16.165946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68627f4-9165-41d9-bee1-6e9cc310aa7c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:16.165946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68627f4-9165-41d9-bee1-6e9cc310aa7c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:16.165946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68627f4-9165-41d9-bee1-6e9cc310aa7c None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:16.169397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68627f4-9165-41d9-bee1-6e9cc310aa7c None admin] RBAC: Authorizing `identity:get_project(project_id=02833278e27846f49032cf41d32ccefb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:16.169397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68627f4-9165-41d9-bee1-6e9cc310aa7c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:16.171215 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 171/353] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:15 2022] GET /identity/v3/projects/02833278e27846f49032cf41d32ccefb => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:16.171215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68627f4-9165-41d9-bee1-6e9cc310aa7c None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:16.211523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:16.230801 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 183/354] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:16.232613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c0680-b014-4d5d-b8ea-642bdb715aa9 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:16.233024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c0680-b014-4d5d-b8ea-642bdb715aa9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:16.233309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c0680-b014-4d5d-b8ea-642bdb715aa9 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:16.234586 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 184/355] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:16.235278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c0680-b014-4d5d-b8ea-642bdb715aa9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:16.283991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:16.296094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68627f4-9165-41d9-bee1-6e9cc310aa7c None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:16.336168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3723c9-d141-4259-8e40-3dfaa4a0e7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:16.336822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3723c9-d141-4259-8e40-3dfaa4a0e7b2 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:16.337108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3723c9-d141-4259-8e40-3dfaa4a0e7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:16.337387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3723c9-d141-4259-8e40-3dfaa4a0e7b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:16.351697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3723c9-d141-4259-8e40-3dfaa4a0e7b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:16.356528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-3e3723c9-d141-4259-8e40-3dfaa4a0e7b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 30 20:44:16.356528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:16.356528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:16.356528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:16.356528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:16.356528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:16.356528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:16.356528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:16.356528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:16.356528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:16.356528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:16.356528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:16.356528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:16.356528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:16.356528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:16.356528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:16.357474 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:16.357474 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:16.357474 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:16.357474 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:16.357474 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:16.357474 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:16.357474 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:16.357474 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:16.357474 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:16.357474 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:16.357474 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:16.357474 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:16.357474 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:16.357474 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:16.357474 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:16.357474 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:16.358319 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:16.358319 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:16.358319 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:16.358319 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:16.358319 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:16.358319 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:16.358319 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:16.358319 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:16.358319 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:16.358319 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:16.358319 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 30 20:44:16.358319 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:16.358319 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 172/356] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:16.359015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3723c9-d141-4259-8e40-3dfaa4a0e7b2 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:16.368555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c0680-b014-4d5d-b8ea-642bdb715aa9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:16.411338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddb705-c536-4320-b1f8-359539d3d230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:16.412291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddb705-c536-4320-b1f8-359539d3d230 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:16.412759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddb705-c536-4320-b1f8-359539d3d230 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:16.413098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddb705-c536-4320-b1f8-359539d3d230 None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:16.414312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddb705-c536-4320-b1f8-359539d3d230 None admin] RBAC: Authorizing `identity:get_project(project_id=02833278e27846f49032cf41d32ccefb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:16.415827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddb705-c536-4320-b1f8-359539d3d230 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:16.417689 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 185/357] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:16 2022] GET /identity/v3/projects/02833278e27846f49032cf41d32ccefb => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:16.418357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddb705-c536-4320-b1f8-359539d3d230 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:16.473961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:16.486718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3723c9-d141-4259-8e40-3dfaa4a0e7b2 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:16.530024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339b07e-9353-4672-99e6-632c485f276b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:16.530685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339b07e-9353-4672-99e6-632c485f276b None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:16.530971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339b07e-9353-4672-99e6-632c485f276b None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:16.531248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339b07e-9353-4672-99e6-632c485f276b None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:16.532464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339b07e-9353-4672-99e6-632c485f276b None admin] RBAC: Authorizing `identity:get_project(project_id=ae7c0ef917404ec9a98252b586e52c5c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:16.533915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339b07e-9353-4672-99e6-632c485f276b None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:16.535694 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 173/358] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:16 2022] GET /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:16.536810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b7362-7f70-45fd-a804-4c7599ae59bd None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:16.537095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b7362-7f70-45fd-a804-4c7599ae59bd None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:16.537371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b7362-7f70-45fd-a804-4c7599ae59bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:16.538368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddb705-c536-4320-b1f8-359539d3d230 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:16.541089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:16.558504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4d0b7362-7f70-45fd-a804-4c7599ae59bd None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:16.559734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4d0b7362-7f70-45fd-a804-4c7599ae59bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:16.582924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b58ab-8ad9-46a7-b4f7-25bb28781681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:16.583643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b58ab-8ad9-46a7-b4f7-25bb28781681 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:16.584199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b58ab-8ad9-46a7-b4f7-25bb28781681 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:16.584478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b58ab-8ad9-46a7-b4f7-25bb28781681 None admin] PATH_INFO: `/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:16.591970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b58ab-8ad9-46a7-b4f7-25bb28781681 None admin] RBAC: Authorizing `identity:get_group(group_id=5eb0646886ae4d3fb7fd78fc77d0d450)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:16.593436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b58ab-8ad9-46a7-b4f7-25bb28781681 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:16.595098 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 186/359] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 30 20:44:16 2022] GET /identity/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:16.600539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b58ab-8ad9-46a7-b4f7-25bb28781681 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:16.644641 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 174/360] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:16.645649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b7362-7f70-45fd-a804-4c7599ae59bd None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:16.720740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b58ab-8ad9-46a7-b4f7-25bb28781681 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:16.746501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:16.762116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6a8fc-127b-4b73-a2cd-9643981f0f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:16.762325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b7362-7f70-45fd-a804-4c7599ae59bd None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:16.762771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6a8fc-127b-4b73-a2cd-9643981f0f8b None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:16.763056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6a8fc-127b-4b73-a2cd-9643981f0f8b None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:16.763876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6a8fc-127b-4b73-a2cd-9643981f0f8b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:16.776414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6a8fc-127b-4b73-a2cd-9643981f0f8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:16.781788 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-80f6a8fc-127b-4b73-a2cd-9643981f0f8b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:44:16.781788 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:16.781788 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:16.781788 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:16.781788 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:16.781788 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:16.781788 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:16.781788 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:16.781788 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:16.781788 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:16.781788 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:16.781788 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:16.781788 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:16.781788 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:16.781788 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:16.781788 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:16.782756 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:16.782756 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:16.782756 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:16.782756 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:16.782756 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:16.782756 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:16.782756 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:16.782756 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:16.782756 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:16.782756 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:16.782756 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:16.782756 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:16.782756 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:16.782756 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:16.782756 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:16.782756 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:16.784255 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:16.784255 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:16.784255 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:16.784255 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:16.784255 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:16.784255 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:16.784255 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:16.784255 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:16.784255 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:16.784255 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:16.784255 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:44:16.784255 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:16.784255 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 187/361] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:44:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:16.784255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6a8fc-127b-4b73-a2cd-9643981f0f8b None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:16.802772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825ea38-46f2-42d5-9660-b8657eea412f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:16.803446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825ea38-46f2-42d5-9660-b8657eea412f None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:16.804466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825ea38-46f2-42d5-9660-b8657eea412f None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:16.804579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825ea38-46f2-42d5-9660-b8657eea412f None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:16.805284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825ea38-46f2-42d5-9660-b8657eea412f None admin] RBAC: Adding query filter params (name=reader) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:16.805592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825ea38-46f2-42d5-9660-b8657eea412f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:16.807963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825ea38-46f2-42d5-9660-b8657eea412f None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:16.817574 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 175/362] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:44:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:16.818617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825ea38-46f2-42d5-9660-b8657eea412f None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:16.819759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:16.908200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6a8fc-127b-4b73-a2cd-9643981f0f8b None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:16.946582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825ea38-46f2-42d5-9660-b8657eea412f None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:16.951278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd2ec2-b6e0-4d77-b582-e0ff81756412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:16.951971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd2ec2-b6e0-4d77-b582-e0ff81756412 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:16.952273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd2ec2-b6e0-4d77-b582-e0ff81756412 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:16.952539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd2ec2-b6e0-4d77-b582-e0ff81756412 None admin] PATH_INFO: `/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:16.954286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd2ec2-b6e0-4d77-b582-e0ff81756412 None admin] RBAC: Authorizing `identity:get_group(group_id=5eb0646886ae4d3fb7fd78fc77d0d450)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:16.958029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd2ec2-b6e0-4d77-b582-e0ff81756412 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:16.958029 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 188/363] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 30 20:44:16 2022] GET /identity/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:16.958338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd2ec2-b6e0-4d77-b582-e0ff81756412 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:16.986037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850c5a5-bea0-4dd1-8e82-5ebee0ec3658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:16.986619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c5a5-bea0-4dd1-8e82-5ebee0ec3658 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:16.986909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c5a5-bea0-4dd1-8e82-5ebee0ec3658 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:16.987220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c5a5-bea0-4dd1-8e82-5ebee0ec3658 None admin] PATH_INFO: `/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:16.988400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850c5a5-bea0-4dd1-8e82-5ebee0ec3658 None admin] RBAC: Authorizing `identity:get_group(group_id=5eb0646886ae4d3fb7fd78fc77d0d450)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:16.989846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850c5a5-bea0-4dd1-8e82-5ebee0ec3658 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:16.992160 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 176/364] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 30 20:44:16 2022] GET /identity/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:16.993013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850c5a5-bea0-4dd1-8e82-5ebee0ec3658 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:17.018417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:17.057810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:17.064543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd2ec2-b6e0-4d77-b582-e0ff81756412 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:17.097641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44924c10-8381-4837-b1a8-812ed6f4a0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:17.098259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44924c10-8381-4837-b1a8-812ed6f4a0f2 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:17.098542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44924c10-8381-4837-b1a8-812ed6f4a0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:17.098820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44924c10-8381-4837-b1a8-812ed6f4a0f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:17.099545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850c5a5-bea0-4dd1-8e82-5ebee0ec3658 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:17.099662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44924c10-8381-4837-b1a8-812ed6f4a0f2 None admin] RBAC: Adding query filter params (group.id=5eb0646886ae4d3fb7fd78fc77d0d450, role.id=bb6a9a85fcb54a31a5a42bea4a88a5b9, scope.project.id=02833278e27846f49032cf41d32ccefb) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:17.099974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44924c10-8381-4837-b1a8-812ed6f4a0f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:17.102009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44924c10-8381-4837-b1a8-812ed6f4a0f2 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:17.107453 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 189/365] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Jul 30 20:44:16 2022] GET /identity/v3/role_assignments?group.id=5eb0646886ae4d3fb7fd78fc77d0d450&scope.project.id=02833278e27846f49032cf41d32ccefb&role.id=bb6a9a85fcb54a31a5a42bea4a88a5b9 => generated 260 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:17.108234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44924c10-8381-4837-b1a8-812ed6f4a0f2 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:17.148725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d715e-bb4d-4478-a1df-fbbd6d458384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:17.149400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d715e-bb4d-4478-a1df-fbbd6d458384 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:17.149686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d715e-bb4d-4478-a1df-fbbd6d458384 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:17.149962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d715e-bb4d-4478-a1df-fbbd6d458384 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:17.162987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d715e-bb4d-4478-a1df-fbbd6d458384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:17.169362 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-ef7d715e-bb4d-4478-a1df-fbbd6d458384 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:44:17.169362 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:17.169362 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:17.169362 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:17.169362 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:17.169362 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:17.169362 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:17.169362 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:17.169362 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:17.169362 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:17.169362 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:17.169362 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:17.169362 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:17.169362 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:17.169362 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:17.169362 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:17.170398 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:17.170398 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:17.170398 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:17.170398 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:17.170398 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:17.170398 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:17.170398 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:17.170398 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:17.170398 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:17.170398 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:17.170398 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:17.170398 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:17.170398 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:17.170398 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:17.170398 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:17.170398 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:17.171190 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:17.171190 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:17.171190 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:17.171190 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:17.171190 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:17.171190 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:17.171190 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:17.171190 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:17.171190 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:17.171190 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:17.171190 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:44:17.171190 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:17.171190 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 177/366] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:44:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:17.172547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d715e-bb4d-4478-a1df-fbbd6d458384 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:17.232119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44924c10-8381-4837-b1a8-812ed6f4a0f2 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:17.261279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:17.270100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccae9b8-6004-49ac-82a6-32e6a03412ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:17.270988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccae9b8-6004-49ac-82a6-32e6a03412ad None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:17.271279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccae9b8-6004-49ac-82a6-32e6a03412ad None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:17.271588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccae9b8-6004-49ac-82a6-32e6a03412ad None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:17.272315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccae9b8-6004-49ac-82a6-32e6a03412ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:17.273165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccae9b8-6004-49ac-82a6-32e6a03412ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:17.275317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccae9b8-6004-49ac-82a6-32e6a03412ad None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:17.284161 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 190/367] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:17.285007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccae9b8-6004-49ac-82a6-32e6a03412ad None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:17.291972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d715e-bb4d-4478-a1df-fbbd6d458384 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:17.308246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:17.327131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dd727-4c8b-46a9-a0e9-b845bcd44bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:17.328116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dd727-4c8b-46a9-a0e9-b845bcd44bb7 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:17.328116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dd727-4c8b-46a9-a0e9-b845bcd44bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:17.328373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dd727-4c8b-46a9-a0e9-b845bcd44bb7 None admin] PATH_INFO: `/v3/users/a3c709422e13473784caeade75b3fa34` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:17.329518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dd727-4c8b-46a9-a0e9-b845bcd44bb7 None admin] RBAC: Authorizing `identity:get_user(user_id=a3c709422e13473784caeade75b3fa34)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:17.330958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dd727-4c8b-46a9-a0e9-b845bcd44bb7 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:17.337272 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 178/368] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:44:17 2022] GET /identity/v3/users/a3c709422e13473784caeade75b3fa34 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:17.337272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dd727-4c8b-46a9-a0e9-b845bcd44bb7 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:17.397584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccae9b8-6004-49ac-82a6-32e6a03412ad None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:17.441592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dd727-4c8b-46a9-a0e9-b845bcd44bb7 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:17.443354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1af016-693b-468a-83ac-9371cde4c882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:17.445186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1af016-693b-468a-83ac-9371cde4c882 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:17.445186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1af016-693b-468a-83ac-9371cde4c882 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:17.445186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1af016-693b-468a-83ac-9371cde4c882 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:17.445829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1af016-693b-468a-83ac-9371cde4c882 None admin] RBAC: Adding query filter params (group.id=5eb0646886ae4d3fb7fd78fc77d0d450, role.id=c3edb43d117b427a91e426e4e42f0c63, scope.project.id=02833278e27846f49032cf41d32ccefb) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:17.446136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1af016-693b-468a-83ac-9371cde4c882 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:17.447791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1af016-693b-468a-83ac-9371cde4c882 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:17.453732 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 191/369] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Jul 30 20:44:17 2022] GET /identity/v3/role_assignments?group.id=5eb0646886ae4d3fb7fd78fc77d0d450&scope.project.id=02833278e27846f49032cf41d32ccefb&role.id=c3edb43d117b427a91e426e4e42f0c63 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:17.454519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1af016-693b-468a-83ac-9371cde4c882 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:17.499969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79262f2-d01b-4b1a-aa34-2e33f252a09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:17.501012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79262f2-d01b-4b1a-aa34-2e33f252a09f None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:17.502129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79262f2-d01b-4b1a-aa34-2e33f252a09f None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:17.502620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79262f2-d01b-4b1a-aa34-2e33f252a09f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:17.503698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79262f2-d01b-4b1a-aa34-2e33f252a09f None admin] RBAC: Adding query filter params (group.id=5eb0646886ae4d3fb7fd78fc77d0d450, role.id=c3edb43d117b427a91e426e4e42f0c63, scope.project.id=ae7c0ef917404ec9a98252b586e52c5c) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:17.504648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79262f2-d01b-4b1a-aa34-2e33f252a09f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:17.507725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79262f2-d01b-4b1a-aa34-2e33f252a09f None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:17.515878 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 179/370] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Jul 30 20:44:17 2022] GET /identity/v3/role_assignments?group.id=5eb0646886ae4d3fb7fd78fc77d0d450&scope.project.id=ae7c0ef917404ec9a98252b586e52c5c&role.id=c3edb43d117b427a91e426e4e42f0c63 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:17.517187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79262f2-d01b-4b1a-aa34-2e33f252a09f None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:17.558371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:17.583257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:17.607772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1af016-693b-468a-83ac-9371cde4c882 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:17.688247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd7762-ad91-44f7-890d-0088fbab022f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:17.689302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd7762-ad91-44f7-890d-0088fbab022f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:17.689797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd7762-ad91-44f7-890d-0088fbab022f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:17.690348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd7762-ad91-44f7-890d-0088fbab022f None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:17.691436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd7762-ad91-44f7-890d-0088fbab022f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:17.692053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd7762-ad91-44f7-890d-0088fbab022f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:17.693679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd7762-ad91-44f7-890d-0088fbab022f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:17.715961 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 192/371] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:17.717460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd7762-ad91-44f7-890d-0088fbab022f None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:17.742788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79262f2-d01b-4b1a-aa34-2e33f252a09f None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:17.784070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f9449-41cc-4e9e-b453-0685a0136677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:17.785067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f9449-41cc-4e9e-b453-0685a0136677 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:17.785673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f9449-41cc-4e9e-b453-0685a0136677 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:17.786141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f9449-41cc-4e9e-b453-0685a0136677 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:17.916071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f9449-41cc-4e9e-b453-0685a0136677 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:17.917956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f9449-41cc-4e9e-b453-0685a0136677 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:17.920379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd7762-ad91-44f7-890d-0088fbab022f None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:17.930808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:18.029865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f2c65-e8de-4c4f-9d96-7c174d47d17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:18.030509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f2c65-e8de-4c4f-9d96-7c174d47d17a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:18.030801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f2c65-e8de-4c4f-9d96-7c174d47d17a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:18.031082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f2c65-e8de-4c4f-9d96-7c174d47d17a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:18.031914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f2c65-e8de-4c4f-9d96-7c174d47d17a None admin] RBAC: Adding query filter params (role.id=db8677d195074e639671c1d9bf559e95, user.id=a3c709422e13473784caeade75b3fa34, scope.system=all) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:18.032224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f2c65-e8de-4c4f-9d96-7c174d47d17a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:18.033687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f2c65-e8de-4c4f-9d96-7c174d47d17a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:18.034188 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 180/372] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:18.035392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f9449-41cc-4e9e-b453-0685a0136677 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:18.061804 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 193/373] 10.222.0.17 () {56 vars in 1308 bytes} [Sat Jul 30 20:44:17 2022] GET /identity/v3/role_assignments?user.id=a3c709422e13473784caeade75b3fa34&scope.system=all&role.id=db8677d195074e639671c1d9bf559e95 => generated 510 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:18.062958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f2c65-e8de-4c4f-9d96-7c174d47d17a None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:18.087691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:18.149344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f9449-41cc-4e9e-b453-0685a0136677 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:18.161494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:18.190125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c115b6-1eed-45e0-97a5-ee1cda3ad06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:18.191165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c115b6-1eed-45e0-97a5-ee1cda3ad06b None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:18.191734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c115b6-1eed-45e0-97a5-ee1cda3ad06b None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:18.192198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c115b6-1eed-45e0-97a5-ee1cda3ad06b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:18.268406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c115b6-1eed-45e0-97a5-ee1cda3ad06b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:18.270234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c115b6-1eed-45e0-97a5-ee1cda3ad06b None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:18.353554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f2c65-e8de-4c4f-9d96-7c174d47d17a None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:18.385047 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 181/374] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:18.390356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c115b6-1eed-45e0-97a5-ee1cda3ad06b None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:18.403043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:18.444027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6535dbd-bdb8-4d74-8597-4989fe4d4e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:18.444747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6535dbd-bdb8-4d74-8597-4989fe4d4e75 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:18.445063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6535dbd-bdb8-4d74-8597-4989fe4d4e75 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:18.445290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6535dbd-bdb8-4d74-8597-4989fe4d4e75 None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:18.446504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6535dbd-bdb8-4d74-8597-4989fe4d4e75 None admin] RBAC: Authorizing `identity:get_project(project_id=ae7c0ef917404ec9a98252b586e52c5c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:18.447977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6535dbd-bdb8-4d74-8597-4989fe4d4e75 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:18.449647 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 194/375] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:18 2022] GET /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c => generated 302 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:18.455319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6535dbd-bdb8-4d74-8597-4989fe4d4e75 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:18.504093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c115b6-1eed-45e0-97a5-ee1cda3ad06b None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:18.541543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c599a6-9644-44a0-ba86-dc3e1969a6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:18.542773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c599a6-9644-44a0-ba86-dc3e1969a6d4 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:18.543253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c599a6-9644-44a0-ba86-dc3e1969a6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:18.543794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c599a6-9644-44a0-ba86-dc3e1969a6d4 None admin] PATH_INFO: `/v3/projects/375d034049af46779b4f307bede15a89` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:18.545180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c599a6-9644-44a0-ba86-dc3e1969a6d4 None admin] RBAC: Authorizing `identity:get_project(project_id=375d034049af46779b4f307bede15a89)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:18.546809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c599a6-9644-44a0-ba86-dc3e1969a6d4 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:18.549092 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 182/376] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:18 2022] GET /identity/v3/projects/375d034049af46779b4f307bede15a89 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:18.556121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c599a6-9644-44a0-ba86-dc3e1969a6d4 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:18.627856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:18.686068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6535dbd-bdb8-4d74-8597-4989fe4d4e75 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:18.703940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:18.739280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c599a6-9644-44a0-ba86-dc3e1969a6d4 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:18.756846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd51b5c-2491-4e36-ad0d-7b09a6aa4850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:18.758056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd51b5c-2491-4e36-ad0d-7b09a6aa4850 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:18.758330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd51b5c-2491-4e36-ad0d-7b09a6aa4850 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:18.758610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd51b5c-2491-4e36-ad0d-7b09a6aa4850 None admin] PATH_INFO: `/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:18.762511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd51b5c-2491-4e36-ad0d-7b09a6aa4850 None admin] RBAC: Authorizing `identity:get_group(group_id=5eb0646886ae4d3fb7fd78fc77d0d450)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:18.762511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd51b5c-2491-4e36-ad0d-7b09a6aa4850 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:18.764475 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 195/377] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 30 20:44:18 2022] GET /identity/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450 => generated 226 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:18.769936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd51b5c-2491-4e36-ad0d-7b09a6aa4850 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:18.787667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270506c7-97fb-4469-a438-1514d97aa052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:18.788670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270506c7-97fb-4469-a438-1514d97aa052 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:18.789146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270506c7-97fb-4469-a438-1514d97aa052 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:18.789960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270506c7-97fb-4469-a438-1514d97aa052 None admin] PATH_INFO: `/v3/groups/88e954a0de604f52b17972fdbb7faaa9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:18.797575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270506c7-97fb-4469-a438-1514d97aa052 None admin] RBAC: Authorizing `identity:get_group(group_id=88e954a0de604f52b17972fdbb7faaa9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:18.799346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270506c7-97fb-4469-a438-1514d97aa052 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:18.801641 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 183/378] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 30 20:44:18 2022] GET /identity/v3/groups/88e954a0de604f52b17972fdbb7faaa9 => generated 229 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:18.808115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270506c7-97fb-4469-a438-1514d97aa052 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:18.958351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270506c7-97fb-4469-a438-1514d97aa052 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:18.987704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd51b5c-2491-4e36-ad0d-7b09a6aa4850 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:18.997550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4666a0-54fa-4fc4-8e63-0db649ed3ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:18.998432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4666a0-54fa-4fc4-8e63-0db649ed3ce5 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:18.998917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4666a0-54fa-4fc4-8e63-0db649ed3ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:18.999484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4666a0-54fa-4fc4-8e63-0db649ed3ce5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:19.000566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4666a0-54fa-4fc4-8e63-0db649ed3ce5 None admin] RBAC: Adding query filter params (group.id=88e954a0de604f52b17972fdbb7faaa9, role.id=3b89b89da98d4ec08a0587aa13832636, scope.project.id=375d034049af46779b4f307bede15a89) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:19.001082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4666a0-54fa-4fc4-8e63-0db649ed3ce5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:19.002827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4666a0-54fa-4fc4-8e63-0db649ed3ce5 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:19.010478 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 184/379] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Jul 30 20:44:18 2022] GET /identity/v3/role_assignments?group.id=88e954a0de604f52b17972fdbb7faaa9&scope.project.id=375d034049af46779b4f307bede15a89&role.id=3b89b89da98d4ec08a0587aa13832636 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:19.056484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbf78d-f797-49a3-a8fb-bbe92d417ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:19.057617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbf78d-f797-49a3-a8fb-bbe92d417ca7 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:19.058146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbf78d-f797-49a3-a8fb-bbe92d417ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:19.058611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbf78d-f797-49a3-a8fb-bbe92d417ca7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:19.059801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbf78d-f797-49a3-a8fb-bbe92d417ca7 None admin] RBAC: Adding query filter params (group.id=5eb0646886ae4d3fb7fd78fc77d0d450, role.id=bb6a9a85fcb54a31a5a42bea4a88a5b9, scope.project.id=ae7c0ef917404ec9a98252b586e52c5c) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:19.060361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbf78d-f797-49a3-a8fb-bbe92d417ca7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:19.061989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbf78d-f797-49a3-a8fb-bbe92d417ca7 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:19.072871 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 196/380] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Jul 30 20:44:18 2022] GET /identity/v3/role_assignments?group.id=5eb0646886ae4d3fb7fd78fc77d0d450&scope.project.id=ae7c0ef917404ec9a98252b586e52c5c&role.id=bb6a9a85fcb54a31a5a42bea4a88a5b9 => generated 260 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:19.907818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68e048-81e3-4a91-9077-33823a128f6a None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:19.908920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68e048-81e3-4a91-9077-33823a128f6a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:19.909449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68e048-81e3-4a91-9077-33823a128f6a None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:19.911088 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 185/381] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:19.917557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273b65-6e52-42e0-b3a0-f8ed4da9ca60 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:19.918525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273b65-6e52-42e0-b3a0-f8ed4da9ca60 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:19.918999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273b65-6e52-42e0-b3a0-f8ed4da9ca60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:19.928609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:19.945012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c5273b65-6e52-42e0-b3a0-f8ed4da9ca60 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:19.946231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c5273b65-6e52-42e0-b3a0-f8ed4da9ca60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:20.045000 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 197/382] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:20.068294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68e048-81e3-4a91-9077-33823a128f6a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:20.078509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:20.185649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff607fe9-70b8-42b3-8011-5e1998c08e3b None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:20.186253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff607fe9-70b8-42b3-8011-5e1998c08e3b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:20.186816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff607fe9-70b8-42b3-8011-5e1998c08e3b None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:20.188668 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 198/383] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:20.193833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b807d-09ac-42af-beae-28fc8c97999b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:20.195455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b807d-09ac-42af-beae-28fc8c97999b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:20.195949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b807d-09ac-42af-beae-28fc8c97999b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:20.214063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68e048-81e3-4a91-9077-33823a128f6a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:20.239064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5f9b807d-09ac-42af-beae-28fc8c97999b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:20.240985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5f9b807d-09ac-42af-beae-28fc8c97999b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:20.283989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f7d3e-38cc-4996-baa2-13ea86bb635e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:20.284638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f7d3e-38cc-4996-baa2-13ea86bb635e None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:20.284920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f7d3e-38cc-4996-baa2-13ea86bb635e None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:20.285192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f7d3e-38cc-4996-baa2-13ea86bb635e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:20.306459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f7d3e-38cc-4996-baa2-13ea86bb635e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:20.317408 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-266f7d3e-38cc-4996-baa2-13ea86bb635e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:44:20.317408 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:20.317408 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:20.317408 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:20.317408 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:20.317408 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:20.317408 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:20.317408 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:20.317408 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:20.317408 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:20.317408 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:20.317408 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:20.317408 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:20.317408 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:20.317408 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:20.317408 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:20.318281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:20.318281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:20.318281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:20.318281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:20.318281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:20.318281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:20.318281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:20.318281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:20.318281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:20.318281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:20.318281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:20.318281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:20.318281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:20.318281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:20.318281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:20.318281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:20.319083 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:20.319083 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:20.319083 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:20.319083 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:20.319083 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:20.319083 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:20.319083 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:20.319083 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:20.319083 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:20.319083 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:20.319083 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:44:20.319083 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:20.319083 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 186/384] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:44:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:20.328193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f7d3e-38cc-4996-baa2-13ea86bb635e None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:20.374531 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 199/385] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:20.414025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b807d-09ac-42af-beae-28fc8c97999b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:20.431025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:20.475882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f7d3e-38cc-4996-baa2-13ea86bb635e None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:20.502905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:20.527391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775caaf-0222-4a89-8d34-c122ad9fcc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:20.528457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775caaf-0222-4a89-8d34-c122ad9fcc63 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:20.528952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775caaf-0222-4a89-8d34-c122ad9fcc63 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:20.529506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775caaf-0222-4a89-8d34-c122ad9fcc63 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:20.530519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775caaf-0222-4a89-8d34-c122ad9fcc63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:20.531024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775caaf-0222-4a89-8d34-c122ad9fcc63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:20.532639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775caaf-0222-4a89-8d34-c122ad9fcc63 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:20.542720 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 187/386] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:20.542927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b807d-09ac-42af-beae-28fc8c97999b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:20.549394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dccd94-c567-4364-9e52-5cb2705dc9b3 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:20.550111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dccd94-c567-4364-9e52-5cb2705dc9b3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:20.550604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dccd94-c567-4364-9e52-5cb2705dc9b3 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:20.552680 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 188/387] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:20.553859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dccd94-c567-4364-9e52-5cb2705dc9b3 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:20.588111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51652674-e3f5-4e4b-82fc-87bfac75d393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:20.588968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51652674-e3f5-4e4b-82fc-87bfac75d393 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:20.589106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51652674-e3f5-4e4b-82fc-87bfac75d393 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:20.589287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51652674-e3f5-4e4b-82fc-87bfac75d393 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:20.602884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51652674-e3f5-4e4b-82fc-87bfac75d393 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:20.608014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-51652674-e3f5-4e4b-82fc-87bfac75d393 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:20.608014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:20.608014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:20.608014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:20.608014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:20.608014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:20.608014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:20.608014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:20.608014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:20.608014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:20.608014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:20.608014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:20.608014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:20.608014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:20.608014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:20.608014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:20.608944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:20.608944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:20.608944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:20.608944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:20.608944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:20.608944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:20.608944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:20.608944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:20.608944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:20.608944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:20.608944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:20.608944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:20.608944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:20.608944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:20.608944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:20.608944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:20.609780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:20.609780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:20.609780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:20.609780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:20.609780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:20.609780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:20.609780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:20.609780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:20.609780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:20.609780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:20.609780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:20.609780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:20.614148 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 200/388] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:44:20.615431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5294f4d-df76-47b3-a90e-f7fa9e47bb0c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:20.615718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5294f4d-df76-47b3-a90e-f7fa9e47bb0c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:20.615992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5294f4d-df76-47b3-a90e-f7fa9e47bb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:20.634945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b5294f4d-df76-47b3-a90e-f7fa9e47bb0c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:20.636174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b5294f4d-df76-47b3-a90e-f7fa9e47bb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:20.679077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dccd94-c567-4364-9e52-5cb2705dc9b3 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:20.708746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:20.711557 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 201/389] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:20.712561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5294f4d-df76-47b3-a90e-f7fa9e47bb0c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:20.730096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d049dbb-e5fb-46d8-b1f8-b9f7b182c8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:20.731143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d049dbb-e5fb-46d8-b1f8-b9f7b182c8ce None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:20.731691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d049dbb-e5fb-46d8-b1f8-b9f7b182c8ce None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:20.732323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d049dbb-e5fb-46d8-b1f8-b9f7b182c8ce None admin] PATH_INFO: `/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:20.733760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d049dbb-e5fb-46d8-b1f8-b9f7b182c8ce None admin] RBAC: Authorizing `identity:get_group(group_id=5eb0646886ae4d3fb7fd78fc77d0d450)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:20.735653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d049dbb-e5fb-46d8-b1f8-b9f7b182c8ce None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:20.738041 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 189/390] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 30 20:44:20 2022] GET /identity/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:20.743816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d049dbb-e5fb-46d8-b1f8-b9f7b182c8ce None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:20.788113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:20.833674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5294f4d-df76-47b3-a90e-f7fa9e47bb0c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:20.859708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d049dbb-e5fb-46d8-b1f8-b9f7b182c8ce None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:20.868055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95f580-dbcf-4e0e-b352-2c0da31466e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:20.868667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95f580-dbcf-4e0e-b352-2c0da31466e6 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:20.868951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95f580-dbcf-4e0e-b352-2c0da31466e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:20.869224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95f580-dbcf-4e0e-b352-2c0da31466e6 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:20.869933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95f580-dbcf-4e0e-b352-2c0da31466e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:20.870232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95f580-dbcf-4e0e-b352-2c0da31466e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:20.871897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95f580-dbcf-4e0e-b352-2c0da31466e6 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:20.886518 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 202/391] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:44:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:20.887466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95f580-dbcf-4e0e-b352-2c0da31466e6 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:20.902751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dc0ad-fd72-4583-993b-12308f44cb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:20.903893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dc0ad-fd72-4583-993b-12308f44cb69 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:20.904414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dc0ad-fd72-4583-993b-12308f44cb69 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:20.904890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dc0ad-fd72-4583-993b-12308f44cb69 None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:20.906427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659dc0ad-fd72-4583-993b-12308f44cb69 None admin] RBAC: Authorizing `identity:get_project(project_id=02833278e27846f49032cf41d32ccefb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:20.908288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659dc0ad-fd72-4583-993b-12308f44cb69 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:20.911172 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 190/392] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:20 2022] GET /identity/v3/projects/02833278e27846f49032cf41d32ccefb => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:20.917243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dc0ad-fd72-4583-993b-12308f44cb69 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:20.986909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:20.993900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95f580-dbcf-4e0e-b352-2c0da31466e6 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:21.014697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:21.045945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721395d-da89-4026-9c5e-d023d8137723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:21.047585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721395d-da89-4026-9c5e-d023d8137723 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:21.048360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721395d-da89-4026-9c5e-d023d8137723 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:21.048873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721395d-da89-4026-9c5e-d023d8137723 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:21.053139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dc0ad-fd72-4583-993b-12308f44cb69 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:21.064249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721395d-da89-4026-9c5e-d023d8137723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:21.072598 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-9721395d-da89-4026-9c5e-d023d8137723 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:21.072598 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:21.072598 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:21.072598 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:21.072598 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:21.072598 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:21.072598 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:21.072598 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:21.072598 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:21.072598 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:21.072598 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:21.072598 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:21.072598 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:21.072598 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:21.072598 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:21.072598 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:21.073459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:21.073459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:21.073459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:21.073459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:21.073459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:21.073459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:21.073459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:21.073459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:21.073459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:21.073459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:21.073459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:21.073459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:21.073459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:21.073459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:21.073459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:21.073459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:21.074258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:21.074258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:21.074258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:21.074258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:21.074258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:21.074258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:21.074258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:21.074258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:21.074258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:21.074258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:21.074258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:21.074258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:21.077538 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 203/393] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:21.078510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721395d-da89-4026-9c5e-d023d8137723 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:21.095948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506baef-eb19-4985-b88c-e9a09c21ee4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:21.097058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506baef-eb19-4985-b88c-e9a09c21ee4f None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:21.097788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506baef-eb19-4985-b88c-e9a09c21ee4f None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:21.098300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506baef-eb19-4985-b88c-e9a09c21ee4f None admin] PATH_INFO: `/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:21.101017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506baef-eb19-4985-b88c-e9a09c21ee4f None admin] RBAC: Authorizing `identity:get_group(group_id=5eb0646886ae4d3fb7fd78fc77d0d450)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:21.103441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506baef-eb19-4985-b88c-e9a09c21ee4f None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:21.106132 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 191/394] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 30 20:44:20 2022] GET /identity/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:21.107109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506baef-eb19-4985-b88c-e9a09c21ee4f None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:21.208975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721395d-da89-4026-9c5e-d023d8137723 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:21.234143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506baef-eb19-4985-b88c-e9a09c21ee4f None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:21.248790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d55b4-5a2b-41f9-b933-76ce5cd3ba79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:21.249831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d55b4-5a2b-41f9-b933-76ce5cd3ba79 None admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:21.250373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d55b4-5a2b-41f9-b933-76ce5cd3ba79 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:21.250849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d55b4-5a2b-41f9-b933-76ce5cd3ba79 None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb/groups/5eb0646886ae4d3fb7fd78fc77d0d450/roles/bb6a9a85fcb54a31a5a42bea4a88a5b9` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:21.253349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d55b4-5a2b-41f9-b933-76ce5cd3ba79 None admin] RBAC: Authorizing `identity:create_grant(project_id=02833278e27846f49032cf41d32ccefb, group_id=5eb0646886ae4d3fb7fd78fc77d0d450, role_id=bb6a9a85fcb54a31a5a42bea4a88a5b9)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:21.255068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d55b4-5a2b-41f9-b933-76ce5cd3ba79 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:21.267703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:21.279317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87db648-f442-4fc1-9fb1-7396c2accb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:21.279317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87db648-f442-4fc1-9fb1-7396c2accb3c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:21.279317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87db648-f442-4fc1-9fb1-7396c2accb3c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:21.279317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87db648-f442-4fc1-9fb1-7396c2accb3c None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:21.279733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87db648-f442-4fc1-9fb1-7396c2accb3c None admin] RBAC: Adding query filter params (name=member) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:21.279733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87db648-f442-4fc1-9fb1-7396c2accb3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:21.279733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87db648-f442-4fc1-9fb1-7396c2accb3c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:21.280472 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 204/395] 10.222.0.17 () {58 vars in 1442 bytes} [Sat Jul 30 20:44:21 2022] PUT /identity/v3/projects/02833278e27846f49032cf41d32ccefb/groups/5eb0646886ae4d3fb7fd78fc77d0d450/roles/bb6a9a85fcb54a31a5a42bea4a88a5b9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:44:21.282255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d55b4-5a2b-41f9-b933-76ce5cd3ba79 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:21.293699 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 192/396] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:44:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:21.299314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87db648-f442-4fc1-9fb1-7396c2accb3c None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:21.372446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:21.476990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87db648-f442-4fc1-9fb1-7396c2accb3c None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:21.503105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d55b4-5a2b-41f9-b933-76ce5cd3ba79 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:21.547421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c940b-4dad-4296-9e26-c9a97331e9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:21.548670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c940b-4dad-4296-9e26-c9a97331e9fd None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:21.548961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c940b-4dad-4296-9e26-c9a97331e9fd None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:21.549244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c940b-4dad-4296-9e26-c9a97331e9fd None admin] PATH_INFO: `/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:21.550754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c940b-4dad-4296-9e26-c9a97331e9fd None admin] RBAC: Authorizing `identity:get_group(group_id=5eb0646886ae4d3fb7fd78fc77d0d450)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:21.552679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c940b-4dad-4296-9e26-c9a97331e9fd None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:21.556453 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 193/397] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 30 20:44:21 2022] GET /identity/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450 => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:21.563541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c940b-4dad-4296-9e26-c9a97331e9fd None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:21.568621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1603a0f-7698-4a3c-9151-d5e2114296c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:21.569787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1603a0f-7698-4a3c-9151-d5e2114296c9 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:21.570296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1603a0f-7698-4a3c-9151-d5e2114296c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:21.570781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1603a0f-7698-4a3c-9151-d5e2114296c9 None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:21.572401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1603a0f-7698-4a3c-9151-d5e2114296c9 None admin] RBAC: Authorizing `identity:get_project(project_id=02833278e27846f49032cf41d32ccefb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:21.574274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1603a0f-7698-4a3c-9151-d5e2114296c9 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:21.576304 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 205/398] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:21 2022] GET /identity/v3/projects/02833278e27846f49032cf41d32ccefb => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:21.582371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1603a0f-7698-4a3c-9151-d5e2114296c9 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:21.647143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:21.703255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c940b-4dad-4296-9e26-c9a97331e9fd None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:21.736884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1603a0f-7698-4a3c-9151-d5e2114296c9 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:21.740372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:21.742224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369f2b4-e87e-4110-ac9b-8427d21cbd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:21.743021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369f2b4-e87e-4110-ac9b-8427d21cbd90 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:21.743421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369f2b4-e87e-4110-ac9b-8427d21cbd90 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:21.743705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369f2b4-e87e-4110-ac9b-8427d21cbd90 None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:21.744893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369f2b4-e87e-4110-ac9b-8427d21cbd90 None admin] RBAC: Authorizing `identity:get_project(project_id=ae7c0ef917404ec9a98252b586e52c5c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:21.746650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369f2b4-e87e-4110-ac9b-8427d21cbd90 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:21.748599 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 194/399] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:21 2022] GET /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:21.749742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba2580-414d-4e57-a141-906ad5bae2d3 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:21.750031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba2580-414d-4e57-a141-906ad5bae2d3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:21.750309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba2580-414d-4e57-a141-906ad5bae2d3 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:21.751685 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 195/400] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:21.752539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a4caa-538f-43b8-8ccd-c097ba4fa193 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:21.752993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a4caa-538f-43b8-8ccd-c097ba4fa193 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:21.753092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a4caa-538f-43b8-8ccd-c097ba4fa193 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:21.759810 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 196/401] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:21.759810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a4caa-538f-43b8-8ccd-c097ba4fa193 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:21.784515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39151bc-17cb-4720-97ea-527b8dcb07a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:21.785191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39151bc-17cb-4720-97ea-527b8dcb07a8 None admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:21.785462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39151bc-17cb-4720-97ea-527b8dcb07a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:21.785728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39151bc-17cb-4720-97ea-527b8dcb07a8 None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb/groups/5eb0646886ae4d3fb7fd78fc77d0d450/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:21.787765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39151bc-17cb-4720-97ea-527b8dcb07a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=02833278e27846f49032cf41d32ccefb, group_id=5eb0646886ae4d3fb7fd78fc77d0d450, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:21.789225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39151bc-17cb-4720-97ea-527b8dcb07a8 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:21.802799 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 206/402] 10.222.0.17 () {58 vars in 1442 bytes} [Sat Jul 30 20:44:21 2022] PUT /identity/v3/projects/02833278e27846f49032cf41d32ccefb/groups/5eb0646886ae4d3fb7fd78fc77d0d450/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:44:21.804570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69122c21-ed81-47ab-afb4-2546fa1eb788 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:21.804857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69122c21-ed81-47ab-afb4-2546fa1eb788 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:21.805134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69122c21-ed81-47ab-afb4-2546fa1eb788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:21.828646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-69122c21-ed81-47ab-afb4-2546fa1eb788 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:21.829890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-69122c21-ed81-47ab-afb4-2546fa1eb788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:21.887969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a4caa-538f-43b8-8ccd-c097ba4fa193 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:21.925464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:21.927743 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 207/403] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:21.932811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18babf1a-a6b9-4e16-9d9b-46b114d5a457 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:21.933470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18babf1a-a6b9-4e16-9d9b-46b114d5a457 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:21.936606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18babf1a-a6b9-4e16-9d9b-46b114d5a457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:21.940897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296f730-402d-4abc-9d77-7aeb2a4d99db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:21.941868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296f730-402d-4abc-9d77-7aeb2a4d99db None admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:21.942373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296f730-402d-4abc-9d77-7aeb2a4d99db None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:21.942846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296f730-402d-4abc-9d77-7aeb2a4d99db None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c/groups/5eb0646886ae4d3fb7fd78fc77d0d450/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:21.948549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296f730-402d-4abc-9d77-7aeb2a4d99db None admin] RBAC: Authorizing `identity:create_grant(project_id=ae7c0ef917404ec9a98252b586e52c5c, group_id=5eb0646886ae4d3fb7fd78fc77d0d450, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:21.952116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296f730-402d-4abc-9d77-7aeb2a4d99db None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:21.968304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-18babf1a-a6b9-4e16-9d9b-46b114d5a457 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:21.969522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-18babf1a-a6b9-4e16-9d9b-46b114d5a457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:21.970338 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 197/404] 10.222.0.17 () {58 vars in 1442 bytes} [Sat Jul 30 20:44:21 2022] PUT /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c/groups/5eb0646886ae4d3fb7fd78fc77d0d450/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:44:21.971455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296f730-402d-4abc-9d77-7aeb2a4d99db None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:22.080881 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 208/405] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:22.107375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18babf1a-a6b9-4e16-9d9b-46b114d5a457 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:22.149621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:22.201097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296f730-402d-4abc-9d77-7aeb2a4d99db None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:22.238225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8c684-2daf-4bc4-b58b-840a040912c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:22.238887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8c684-2daf-4bc4-b58b-840a040912c0 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:22.239172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8c684-2daf-4bc4-b58b-840a040912c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:22.239483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8c684-2daf-4bc4-b58b-840a040912c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:22.252169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8c684-2daf-4bc4-b58b-840a040912c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:22.257659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-dfc8c684-2daf-4bc4-b58b-840a040912c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:44:22.257659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:22.257659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:22.257659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:22.257659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:22.257659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:22.257659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:22.257659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:22.257659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:22.257659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:22.257659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:22.257659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:22.257659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:22.257659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:22.257659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:22.257659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:22.258580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:22.258580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:22.258580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:22.258580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:22.258580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:22.258580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:22.258580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:22.258580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:22.258580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:22.258580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:22.258580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:22.258580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:22.258580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:22.258580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:22.258580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:22.258580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:22.259616 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:22.259616 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:22.259616 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:22.259616 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:22.259616 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:22.259616 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:22.259616 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:22.259616 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:22.259616 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:22.259616 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:22.259616 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:44:22.259616 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:22.259616 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 198/406] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:44:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:22.260555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18babf1a-a6b9-4e16-9d9b-46b114d5a457 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:22.268616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8c684-2daf-4bc4-b58b-840a040912c0 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:22.298089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20349ef6-f339-4717-a4bf-8802f7200dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:22.298748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20349ef6-f339-4717-a4bf-8802f7200dda None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:22.299034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20349ef6-f339-4717-a4bf-8802f7200dda None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:22.299371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20349ef6-f339-4717-a4bf-8802f7200dda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:22.311363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20349ef6-f339-4717-a4bf-8802f7200dda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:22.316587 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-20349ef6-f339-4717-a4bf-8802f7200dda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:44:22.316587 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:22.316587 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:22.316587 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:22.316587 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:22.316587 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:22.316587 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:22.316587 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:22.316587 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:22.316587 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:22.316587 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:22.316587 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:22.316587 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:22.316587 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:22.316587 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:22.316587 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:22.318475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:22.318475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:22.318475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:22.318475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:22.318475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:22.318475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:22.318475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:22.318475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:22.318475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:22.318475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:22.318475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:22.318475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:22.318475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:22.318475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:22.318475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:22.318475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:22.319737 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:22.319737 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:22.319737 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:22.319737 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:22.319737 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:22.319737 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:22.319737 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:22.319737 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:22.319737 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:22.319737 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:22.319737 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:44:22.319737 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:22.319737 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 209/407] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:44:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:44:22.328113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:22.329132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20349ef6-f339-4717-a4bf-8802f7200dda None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:22.387679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8c684-2daf-4bc4-b58b-840a040912c0 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:22.434980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff1eff-ed89-4bc4-a01d-0131e3d7bcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:22.436245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff1eff-ed89-4bc4-a01d-0131e3d7bcb6 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:22.436535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff1eff-ed89-4bc4-a01d-0131e3d7bcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:22.436810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff1eff-ed89-4bc4-a01d-0131e3d7bcb6 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:22.437532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff1eff-ed89-4bc4-a01d-0131e3d7bcb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:22.437837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff1eff-ed89-4bc4-a01d-0131e3d7bcb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:22.439215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff1eff-ed89-4bc4-a01d-0131e3d7bcb6 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:22.458648 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 199/408] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:22.464311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff1eff-ed89-4bc4-a01d-0131e3d7bcb6 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:22.497876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:22.529770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20349ef6-f339-4717-a4bf-8802f7200dda None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:22.594860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab58409-aba3-4faf-9472-01d7584cd290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:22.595844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab58409-aba3-4faf-9472-01d7584cd290 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:22.596186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab58409-aba3-4faf-9472-01d7584cd290 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:22.602332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab58409-aba3-4faf-9472-01d7584cd290 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:22.603148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab58409-aba3-4faf-9472-01d7584cd290 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:22.603549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab58409-aba3-4faf-9472-01d7584cd290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:22.605075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab58409-aba3-4faf-9472-01d7584cd290 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:22.617764 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 210/409] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:22.625350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab58409-aba3-4faf-9472-01d7584cd290 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:22.655843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff1eff-ed89-4bc4-a01d-0131e3d7bcb6 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:22.679460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:22.727149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5038efe-7c8b-44f0-b44c-295c4e7aa53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:22.727864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5038efe-7c8b-44f0-b44c-295c4e7aa53c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:22.728148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5038efe-7c8b-44f0-b44c-295c4e7aa53c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:22.728426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5038efe-7c8b-44f0-b44c-295c4e7aa53c None admin] PATH_INFO: `/v3/groups/88e954a0de604f52b17972fdbb7faaa9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:22.731308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5038efe-7c8b-44f0-b44c-295c4e7aa53c None admin] RBAC: Authorizing `identity:get_group(group_id=88e954a0de604f52b17972fdbb7faaa9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:22.732777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5038efe-7c8b-44f0-b44c-295c4e7aa53c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:22.734420 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 200/410] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 30 20:44:22 2022] GET /identity/v3/groups/88e954a0de604f52b17972fdbb7faaa9 => generated 229 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:22.742109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5038efe-7c8b-44f0-b44c-295c4e7aa53c None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:22.821798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab58409-aba3-4faf-9472-01d7584cd290 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:22.884468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5038efe-7c8b-44f0-b44c-295c4e7aa53c None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:22.886988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa4bf4-924d-407c-9528-9d8b21f9b580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:22.887612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa4bf4-924d-407c-9528-9d8b21f9b580 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:22.887891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa4bf4-924d-407c-9528-9d8b21f9b580 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:22.888156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa4bf4-924d-407c-9528-9d8b21f9b580 None admin] PATH_INFO: `/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:22.889944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa4bf4-924d-407c-9528-9d8b21f9b580 None admin] RBAC: Authorizing `identity:get_group(group_id=5eb0646886ae4d3fb7fd78fc77d0d450)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:22.891401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa4bf4-924d-407c-9528-9d8b21f9b580 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:22.897480 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 211/411] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 30 20:44:22 2022] GET /identity/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450 => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:22.898928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa4bf4-924d-407c-9528-9d8b21f9b580 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:22.921859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:22.938756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07e79c-822c-4050-a562-ea329bdfd3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:22.939621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07e79c-822c-4050-a562-ea329bdfd3b2 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:22.939906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07e79c-822c-4050-a562-ea329bdfd3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:22.940182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07e79c-822c-4050-a562-ea329bdfd3b2 None admin] PATH_INFO: `/v3/projects/375d034049af46779b4f307bede15a89` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:22.941350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b07e79c-822c-4050-a562-ea329bdfd3b2 None admin] RBAC: Authorizing `identity:get_project(project_id=375d034049af46779b4f307bede15a89)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:22.942893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b07e79c-822c-4050-a562-ea329bdfd3b2 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:22.944993 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 201/412] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:22 2022] GET /identity/v3/projects/375d034049af46779b4f307bede15a89 => generated 344 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:22.950977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07e79c-822c-4050-a562-ea329bdfd3b2 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:23.051908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:23.098455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa4bf4-924d-407c-9528-9d8b21f9b580 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:23.132841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07e79c-822c-4050-a562-ea329bdfd3b2 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:23.159509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83505cb2-50d0-491a-a720-d3e3661097f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:23.160153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83505cb2-50d0-491a-a720-d3e3661097f8 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:23.160432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83505cb2-50d0-491a-a720-d3e3661097f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:23.160701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83505cb2-50d0-491a-a720-d3e3661097f8 None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:23.162554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83505cb2-50d0-491a-a720-d3e3661097f8 None admin] RBAC: Authorizing `identity:get_project(project_id=ae7c0ef917404ec9a98252b586e52c5c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:23.164611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83505cb2-50d0-491a-a720-d3e3661097f8 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:23.166252 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 212/413] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:22 2022] GET /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:23.173102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83505cb2-50d0-491a-a720-d3e3661097f8 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:23.195466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd6300-3c76-4ba8-a165-6f193b7bba54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:23.196154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd6300-3c76-4ba8-a165-6f193b7bba54 None admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:23.196435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd6300-3c76-4ba8-a165-6f193b7bba54 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:23.196710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd6300-3c76-4ba8-a165-6f193b7bba54 None admin] PATH_INFO: `/v3/projects/375d034049af46779b4f307bede15a89/groups/88e954a0de604f52b17972fdbb7faaa9/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:23.200268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd6300-3c76-4ba8-a165-6f193b7bba54 None admin] RBAC: Authorizing `identity:create_grant(project_id=375d034049af46779b4f307bede15a89, group_id=88e954a0de604f52b17972fdbb7faaa9, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:23.201700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd6300-3c76-4ba8-a165-6f193b7bba54 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:23.222259 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 202/414] 10.222.0.17 () {58 vars in 1442 bytes} [Sat Jul 30 20:44:22 2022] PUT /identity/v3/projects/375d034049af46779b4f307bede15a89/groups/88e954a0de604f52b17972fdbb7faaa9/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:44:23.314544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:23.340636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83505cb2-50d0-491a-a720-d3e3661097f8 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:23.380362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b841326-33b4-49a3-b4bb-51f96c0c2722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:23.381425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b841326-33b4-49a3-b4bb-51f96c0c2722 None admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:23.381957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b841326-33b4-49a3-b4bb-51f96c0c2722 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:23.382466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b841326-33b4-49a3-b4bb-51f96c0c2722 None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c/groups/5eb0646886ae4d3fb7fd78fc77d0d450/roles/bb6a9a85fcb54a31a5a42bea4a88a5b9` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:23.384952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b841326-33b4-49a3-b4bb-51f96c0c2722 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae7c0ef917404ec9a98252b586e52c5c, group_id=5eb0646886ae4d3fb7fd78fc77d0d450, role_id=bb6a9a85fcb54a31a5a42bea4a88a5b9)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:23.386789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b841326-33b4-49a3-b4bb-51f96c0c2722 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:23.407554 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 213/415] 10.222.0.17 () {58 vars in 1442 bytes} [Sat Jul 30 20:44:23 2022] PUT /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c/groups/5eb0646886ae4d3fb7fd78fc77d0d450/roles/bb6a9a85fcb54a31a5a42bea4a88a5b9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:44:23.937771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56342f-98d8-483c-9433-80586be7176a None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:23.938163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56342f-98d8-483c-9433-80586be7176a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:23.938341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56342f-98d8-483c-9433-80586be7176a None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:23.939698 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 203/416] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:23.946158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021910e-3924-4668-b084-0993a262d10e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:23.946443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021910e-3924-4668-b084-0993a262d10e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:23.946720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021910e-3924-4668-b084-0993a262d10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:23.976421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5021910e-3924-4668-b084-0993a262d10e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:23.977668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5021910e-3924-4668-b084-0993a262d10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:24.069782 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 214/417] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:24.105359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56342f-98d8-483c-9433-80586be7176a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:24.215012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56342f-98d8-483c-9433-80586be7176a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:24.224665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:24.253105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43478cc2-53b9-4648-b44d-11261fcb77c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:24.254118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43478cc2-53b9-4648-b44d-11261fcb77c1 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:24.254623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43478cc2-53b9-4648-b44d-11261fcb77c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:24.255094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43478cc2-53b9-4648-b44d-11261fcb77c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:24.266798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43478cc2-53b9-4648-b44d-11261fcb77c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:24.272941 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-43478cc2-53b9-4648-b44d-11261fcb77c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:44:24.272941 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:24.272941 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:24.272941 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:24.272941 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:24.272941 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:24.272941 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:24.272941 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:24.272941 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:24.272941 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:24.272941 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:24.272941 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:24.272941 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:24.272941 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:24.272941 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:24.272941 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:24.273920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:24.273920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:24.273920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:24.273920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:24.273920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:24.273920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:24.273920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:24.273920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:24.273920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:24.273920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:24.273920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:24.273920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:24.273920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:24.273920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:24.273920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:24.273920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:24.274781 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:24.274781 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:24.274781 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:24.274781 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:24.274781 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:24.274781 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:24.274781 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:24.274781 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:24.274781 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:24.274781 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:24.274781 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:44:24.274781 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:24.277607 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 204/418] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:44:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:24.284014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021910e-3924-4668-b084-0993a262d10e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:24.363397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:24.406252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021910e-3924-4668-b084-0993a262d10e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:24.451001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556283d3-1cdf-481c-8c04-f4331da0aef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:24.451663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556283d3-1cdf-481c-8c04-f4331da0aef7 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:24.451948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556283d3-1cdf-481c-8c04-f4331da0aef7 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:24.452223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556283d3-1cdf-481c-8c04-f4331da0aef7 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:24.452947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556283d3-1cdf-481c-8c04-f4331da0aef7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:24.453251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556283d3-1cdf-481c-8c04-f4331da0aef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:24.454679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556283d3-1cdf-481c-8c04-f4331da0aef7 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:24.467745 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 215/419] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:24.474433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43478cc2-53b9-4648-b44d-11261fcb77c1 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:24.608156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43478cc2-53b9-4648-b44d-11261fcb77c1 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:24.633406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b3068-7873-41a5-9d36-4d663988d3f0 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:24.633742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b3068-7873-41a5-9d36-4d663988d3f0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:24.634023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b3068-7873-41a5-9d36-4d663988d3f0 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:24.635366 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 216/420] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:24.640419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e070b-da48-4cff-80a7-12e9a3406d68 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:24.640704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e070b-da48-4cff-80a7-12e9a3406d68 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:24.640985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e070b-da48-4cff-80a7-12e9a3406d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:24.666646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e654a20-388d-4570-83c1-3b68b6364eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:24.667280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e654a20-388d-4570-83c1-3b68b6364eb7 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:24.667586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e654a20-388d-4570-83c1-3b68b6364eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:24.667866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e654a20-388d-4570-83c1-3b68b6364eb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:24.668965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bf9e070b-da48-4cff-80a7-12e9a3406d68 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:24.671813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bf9e070b-da48-4cff-80a7-12e9a3406d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:24.731774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:24.781268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e654a20-388d-4570-83c1-3b68b6364eb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:24.782782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e654a20-388d-4570-83c1-3b68b6364eb7 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:24.802962 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 217/421] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:24.825015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e070b-da48-4cff-80a7-12e9a3406d68 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:24.930493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:24.975993 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 205/422] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:24.978173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a303f8-0840-4bc1-81eb-8fd817116808 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:24.978691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a303f8-0840-4bc1-81eb-8fd817116808 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:24.979174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a303f8-0840-4bc1-81eb-8fd817116808 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:24.985267 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 206/423] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:24.986545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a303f8-0840-4bc1-81eb-8fd817116808 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:24.988281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e070b-da48-4cff-80a7-12e9a3406d68 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:25.025393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b01e2-fabc-4f69-800e-ebd1c0d60185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:25.026559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b01e2-fabc-4f69-800e-ebd1c0d60185 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:25.026559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b01e2-fabc-4f69-800e-ebd1c0d60185 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:25.026744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b01e2-fabc-4f69-800e-ebd1c0d60185 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:25.037315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b01e2-fabc-4f69-800e-ebd1c0d60185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:25.042792 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-805b01e2-fabc-4f69-800e-ebd1c0d60185 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:25.042792 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:25.042792 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:25.042792 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:25.042792 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:25.042792 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:25.042792 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:25.042792 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:25.042792 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:25.042792 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:25.042792 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:25.042792 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:25.042792 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:25.042792 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:25.042792 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:25.042792 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:25.043713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:25.043713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:25.043713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:25.043713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:25.043713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:25.043713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:25.043713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:25.043713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:25.043713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:25.043713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:25.043713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:25.043713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:25.043713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:25.043713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:25.043713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:25.043713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:25.045110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:25.045110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:25.045110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:25.045110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:25.045110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:25.045110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:25.045110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:25.045110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:25.045110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:25.045110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:25.045110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:25.045110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:25.045110 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 218/424] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:44:25.045809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e02f63-e58f-41ba-891c-ed505bcad915 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:25.045809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e02f63-e58f-41ba-891c-ed505bcad915 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:25.046124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e02f63-e58f-41ba-891c-ed505bcad915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:25.064059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-99e02f63-e58f-41ba-891c-ed505bcad915 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:25.065270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-99e02f63-e58f-41ba-891c-ed505bcad915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:25.075640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:25.105270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a303f8-0840-4bc1-81eb-8fd817116808 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:25.143764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6105e8-766b-4cc5-ab06-7854e47f8cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:25.144433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6105e8-766b-4cc5-ab06-7854e47f8cad None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:25.144721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6105e8-766b-4cc5-ab06-7854e47f8cad None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:25.144997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6105e8-766b-4cc5-ab06-7854e47f8cad None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:25.146297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6105e8-766b-4cc5-ab06-7854e47f8cad None admin] RBAC: Authorizing `identity:get_project(project_id=02833278e27846f49032cf41d32ccefb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:25.147980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6105e8-766b-4cc5-ab06-7854e47f8cad None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:25.149646 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 207/425] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:24 2022] GET /identity/v3/projects/02833278e27846f49032cf41d32ccefb => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:25.150478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6105e8-766b-4cc5-ab06-7854e47f8cad None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:25.152224 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 219/426] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:25.155141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e02f63-e58f-41ba-891c-ed505bcad915 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:25.216102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:25.265789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e02f63-e58f-41ba-891c-ed505bcad915 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:25.280169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6105e8-766b-4cc5-ab06-7854e47f8cad None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:25.304032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b6607-9c57-45b1-b0b1-1d5b367b9bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:25.305424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b6607-9c57-45b1-b0b1-1d5b367b9bce None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:25.305920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b6607-9c57-45b1-b0b1-1d5b367b9bce None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:25.306491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b6607-9c57-45b1-b0b1-1d5b367b9bce None admin] PATH_INFO: `/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:25.307971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b6607-9c57-45b1-b0b1-1d5b367b9bce None admin] RBAC: Authorizing `identity:get_group(group_id=5eb0646886ae4d3fb7fd78fc77d0d450)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:25.309893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b6607-9c57-45b1-b0b1-1d5b367b9bce None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:25.312307 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 220/427] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 30 20:44:25 2022] GET /identity/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:25.313528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b6607-9c57-45b1-b0b1-1d5b367b9bce None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:25.315281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2dc52-6d4c-45fb-acf0-2735c0e96ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:25.316024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2dc52-6d4c-45fb-acf0-2735c0e96ed9 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:25.316656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2dc52-6d4c-45fb-acf0-2735c0e96ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:25.316778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2dc52-6d4c-45fb-acf0-2735c0e96ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:25.317567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2dc52-6d4c-45fb-acf0-2735c0e96ed9 None admin] RBAC: Adding query filter params (name=member) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:25.317941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2dc52-6d4c-45fb-acf0-2735c0e96ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:25.319485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2dc52-6d4c-45fb-acf0-2735c0e96ed9 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:25.321897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:25.329097 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 208/428] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:44:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:25.330085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2dc52-6d4c-45fb-acf0-2735c0e96ed9 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:25.442250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b6607-9c57-45b1-b0b1-1d5b367b9bce None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:25.451859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2dc52-6d4c-45fb-acf0-2735c0e96ed9 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:25.476657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:25.494852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192fcc9-03f6-4bf6-a72f-f5e4341d85ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:25.495883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192fcc9-03f6-4bf6-a72f-f5e4341d85ed None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:25.496251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192fcc9-03f6-4bf6-a72f-f5e4341d85ed None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:25.496604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192fcc9-03f6-4bf6-a72f-f5e4341d85ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:25.499652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a758380-bab5-426c-8b78-2ac028bc9cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:25.500286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a758380-bab5-426c-8b78-2ac028bc9cfa None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:25.500572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a758380-bab5-426c-8b78-2ac028bc9cfa None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:25.500853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a758380-bab5-426c-8b78-2ac028bc9cfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:25.501650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a758380-bab5-426c-8b78-2ac028bc9cfa None admin] RBAC: Adding query filter params (group.id=5eb0646886ae4d3fb7fd78fc77d0d450, role.id=bb6a9a85fcb54a31a5a42bea4a88a5b9, scope.project.id=02833278e27846f49032cf41d32ccefb) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:25.501961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a758380-bab5-426c-8b78-2ac028bc9cfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:25.503439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a758380-bab5-426c-8b78-2ac028bc9cfa None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:25.509982 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 209/429] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Jul 30 20:44:25 2022] GET /identity/v3/role_assignments?group.id=5eb0646886ae4d3fb7fd78fc77d0d450&scope.project.id=02833278e27846f49032cf41d32ccefb&role.id=bb6a9a85fcb54a31a5a42bea4a88a5b9 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:25.510798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a758380-bab5-426c-8b78-2ac028bc9cfa None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:25.513100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192fcc9-03f6-4bf6-a72f-f5e4341d85ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:25.519172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-1192fcc9-03f6-4bf6-a72f-f5e4341d85ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:25.519172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:25.519172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:25.519172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:25.519172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:25.519172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:25.519172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:25.519172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:25.519172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:25.519172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:25.519172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:25.519172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:25.519172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:25.519172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:25.519172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:25.519172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:25.520289 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:25.520289 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:25.520289 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:25.520289 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:25.520289 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:25.520289 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:25.520289 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:25.520289 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:25.520289 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:25.520289 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:25.520289 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:25.520289 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:25.520289 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:25.520289 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:25.520289 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:25.520289 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:25.521158 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:25.521158 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:25.521158 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:25.521158 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:25.521158 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:25.521158 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:25.521158 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:25.521158 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:25.521158 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:25.521158 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:25.521158 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 30 20:44:25.521158 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:25.524667 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 221/430] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:25.541373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192fcc9-03f6-4bf6-a72f-f5e4341d85ed None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:25.587532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:25.630092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a758380-bab5-426c-8b78-2ac028bc9cfa None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:25.667797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f67697-1d5f-4fa1-8ba2-e64c054fda0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:25.668534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f67697-1d5f-4fa1-8ba2-e64c054fda0b None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:25.668751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f67697-1d5f-4fa1-8ba2-e64c054fda0b None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:25.669034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f67697-1d5f-4fa1-8ba2-e64c054fda0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:25.740227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192fcc9-03f6-4bf6-a72f-f5e4341d85ed None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:25.743793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f67697-1d5f-4fa1-8ba2-e64c054fda0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:25.744882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f67697-1d5f-4fa1-8ba2-e64c054fda0b None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:25.806121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7325bd2-fcc6-4273-a4ca-f5a7ef0792a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:25.807126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7325bd2-fcc6-4273-a4ca-f5a7ef0792a3 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:25.807635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7325bd2-fcc6-4273-a4ca-f5a7ef0792a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:25.808114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7325bd2-fcc6-4273-a4ca-f5a7ef0792a3 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:25.809092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7325bd2-fcc6-4273-a4ca-f5a7ef0792a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:25.815318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7325bd2-fcc6-4273-a4ca-f5a7ef0792a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:25.817352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7325bd2-fcc6-4273-a4ca-f5a7ef0792a3 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:25.821380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:25.833976 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 222/431] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:44:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:25.841574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7325bd2-fcc6-4273-a4ca-f5a7ef0792a3 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:25.888080 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 210/432] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:25.893654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f67697-1d5f-4fa1-8ba2-e64c054fda0b None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:25.941403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:26.028282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7325bd2-fcc6-4273-a4ca-f5a7ef0792a3 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:26.046378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f67697-1d5f-4fa1-8ba2-e64c054fda0b None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:26.063579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ef7c7-73ce-4bd4-967e-57a08554048f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:26.064128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ef7c7-73ce-4bd4-967e-57a08554048f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:26.064409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ef7c7-73ce-4bd4-967e-57a08554048f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:26.064791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ef7c7-73ce-4bd4-967e-57a08554048f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:26.092604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8444f-01b1-42b6-b4a2-b0ec493c3e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:26.093252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8444f-01b1-42b6-b4a2-b0ec493c3e78 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:26.093534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8444f-01b1-42b6-b4a2-b0ec493c3e78 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:26.093997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8444f-01b1-42b6-b4a2-b0ec493c3e78 None admin] PATH_INFO: `/v3/projects/02833278e27846f49032cf41d32ccefb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:26.094955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8444f-01b1-42b6-b4a2-b0ec493c3e78 None admin] RBAC: Authorizing `identity:get_project(project_id=02833278e27846f49032cf41d32ccefb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:26.096428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8444f-01b1-42b6-b4a2-b0ec493c3e78 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:26.098373 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 211/433] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:25 2022] GET /identity/v3/projects/02833278e27846f49032cf41d32ccefb => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:26.099536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c18d50-21f8-4feb-b068-61cdc5495a53 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:26.099823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c18d50-21f8-4feb-b068-61cdc5495a53 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:26.100098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c18d50-21f8-4feb-b068-61cdc5495a53 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:26.101474 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 212/434] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:26.106437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c18d50-21f8-4feb-b068-61cdc5495a53 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:26.138213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:26.143221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ef7c7-73ce-4bd4-967e-57a08554048f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:26.144717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ef7c7-73ce-4bd4-967e-57a08554048f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:26.188360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:26.211899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c18d50-21f8-4feb-b068-61cdc5495a53 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:26.242539 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 223/435] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 30 20:44:26.243873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225baa4e-d60d-4c15-a4fb-9be9d7c164d3 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:26.244218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225baa4e-d60d-4c15-a4fb-9be9d7c164d3 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:26.244449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225baa4e-d60d-4c15-a4fb-9be9d7c164d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:26.245292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ede6c-74af-47a7-954d-848c9d3f0718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:26.246188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ede6c-74af-47a7-954d-848c9d3f0718 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:26.246469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ede6c-74af-47a7-954d-848c9d3f0718 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:26.246743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ede6c-74af-47a7-954d-848c9d3f0718 None admin] PATH_INFO: `/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:26.247950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ede6c-74af-47a7-954d-848c9d3f0718 None admin] RBAC: Authorizing `identity:get_group(group_id=5eb0646886ae4d3fb7fd78fc77d0d450)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:26.249384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ede6c-74af-47a7-954d-848c9d3f0718 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:26.250949 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 213/436] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 30 20:44:26 2022] GET /identity/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:26.252063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30f288-bce4-4ebf-b124-6f561b408a7d None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:26.252349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30f288-bce4-4ebf-b124-6f561b408a7d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:26.252623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30f288-bce4-4ebf-b124-6f561b408a7d None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:26.253799 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 214/437] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:26.254478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30f288-bce4-4ebf-b124-6f561b408a7d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:26.263715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-225baa4e-d60d-4c15-a4fb-9be9d7c164d3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:26.264918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-225baa4e-d60d-4c15-a4fb-9be9d7c164d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:26.331890 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 224/438] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:26.332795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225baa4e-d60d-4c15-a4fb-9be9d7c164d3 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:26.356224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:26.358104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30f288-bce4-4ebf-b124-6f561b408a7d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:26.392828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91dc5fe-35bf-4a15-adb6-efa84b9193db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:26.393556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dc5fe-35bf-4a15-adb6-efa84b9193db None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:26.393840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dc5fe-35bf-4a15-adb6-efa84b9193db None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:26.394114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dc5fe-35bf-4a15-adb6-efa84b9193db None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:26.395251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91dc5fe-35bf-4a15-adb6-efa84b9193db None admin] RBAC: Authorizing `identity:get_project(project_id=ae7c0ef917404ec9a98252b586e52c5c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:26.396782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91dc5fe-35bf-4a15-adb6-efa84b9193db None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:26.398511 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 215/439] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:26 2022] GET /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:26.399618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31344bf1-f465-4295-ae24-93bce573f928 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:26.399898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31344bf1-f465-4295-ae24-93bce573f928 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:26.400170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31344bf1-f465-4295-ae24-93bce573f928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:26.407745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:26.417642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-31344bf1-f465-4295-ae24-93bce573f928 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:26.418836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-31344bf1-f465-4295-ae24-93bce573f928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:26.432944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225baa4e-d60d-4c15-a4fb-9be9d7c164d3 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:26.466341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58658dd-d63c-4080-a127-2f5b9f673695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:26.466960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58658dd-d63c-4080-a127-2f5b9f673695 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:26.467247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58658dd-d63c-4080-a127-2f5b9f673695 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:26.467554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58658dd-d63c-4080-a127-2f5b9f673695 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:26.468332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58658dd-d63c-4080-a127-2f5b9f673695 None admin] RBAC: Adding query filter params (group.id=5eb0646886ae4d3fb7fd78fc77d0d450, role.id=c3edb43d117b427a91e426e4e42f0c63, scope.project.id=02833278e27846f49032cf41d32ccefb) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:26.468638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58658dd-d63c-4080-a127-2f5b9f673695 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:26.470072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58658dd-d63c-4080-a127-2f5b9f673695 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:26.475730 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 225/440] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Jul 30 20:44:26 2022] GET /identity/v3/role_assignments?group.id=5eb0646886ae4d3fb7fd78fc77d0d450&scope.project.id=02833278e27846f49032cf41d32ccefb&role.id=c3edb43d117b427a91e426e4e42f0c63 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:26.476499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58658dd-d63c-4080-a127-2f5b9f673695 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:26.496792 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 216/441] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:26.497985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31344bf1-f465-4295-ae24-93bce573f928 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:26.595104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58658dd-d63c-4080-a127-2f5b9f673695 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:26.612125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:26.619920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31344bf1-f465-4295-ae24-93bce573f928 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:26.636918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4c937-ab00-448f-afad-cbec06d07f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:26.637838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4c937-ab00-448f-afad-cbec06d07f6c None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:26.638264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4c937-ab00-448f-afad-cbec06d07f6c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:26.638716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4c937-ab00-448f-afad-cbec06d07f6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:26.646994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:26.652672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4c937-ab00-448f-afad-cbec06d07f6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:26.658093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-47e4c937-ab00-448f-afad-cbec06d07f6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:44:26.658093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:26.658093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:26.658093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:26.658093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:26.658093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:26.658093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:26.658093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:26.658093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:26.658093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:26.658093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:26.658093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:26.658093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:26.658093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:26.658093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:26.658093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:26.659163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:26.659163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:26.659163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:26.659163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:26.659163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:26.659163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:26.659163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:26.659163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:26.659163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:26.659163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:26.659163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:26.659163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:26.659163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:26.659163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:26.659163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:26.659163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:26.660004 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:26.660004 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:26.660004 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:26.660004 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:26.660004 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:26.660004 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:26.660004 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:26.660004 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:26.660004 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:26.660004 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:26.660004 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:44:26.660004 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:26.660783 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 226/442] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:44:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:26.661083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4c937-ab00-448f-afad-cbec06d07f6c None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:26.667914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fa3ec-cb00-4a42-bf78-f052c06d888c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:26.668608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fa3ec-cb00-4a42-bf78-f052c06d888c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:26.669872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fa3ec-cb00-4a42-bf78-f052c06d888c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:26.669872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fa3ec-cb00-4a42-bf78-f052c06d888c None admin] PATH_INFO: `/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:26.671492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fa3ec-cb00-4a42-bf78-f052c06d888c None admin] RBAC: Authorizing `identity:get_group(group_id=5eb0646886ae4d3fb7fd78fc77d0d450)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:26.673018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fa3ec-cb00-4a42-bf78-f052c06d888c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:26.674878 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 217/443] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 30 20:44:26 2022] GET /identity/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:26.675837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fa3ec-cb00-4a42-bf78-f052c06d888c None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:26.793500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4c937-ab00-448f-afad-cbec06d07f6c None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:26.806713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fa3ec-cb00-4a42-bf78-f052c06d888c None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:26.841629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3d8eb-2b54-4c8c-ab23-36c25dfeec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:26.842584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3d8eb-2b54-4c8c-ab23-36c25dfeec49 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:26.842874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3d8eb-2b54-4c8c-ab23-36c25dfeec49 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:26.843155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3d8eb-2b54-4c8c-ab23-36c25dfeec49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:26.847612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e93ab-2ad6-4c4c-8d47-0c46ba2022b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:26.848435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e93ab-2ad6-4c4c-8d47-0c46ba2022b1 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:26.849125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e93ab-2ad6-4c4c-8d47-0c46ba2022b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:26.849557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e93ab-2ad6-4c4c-8d47-0c46ba2022b1 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:26.850349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e93ab-2ad6-4c4c-8d47-0c46ba2022b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:26.851150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e93ab-2ad6-4c4c-8d47-0c46ba2022b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:26.853061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e93ab-2ad6-4c4c-8d47-0c46ba2022b1 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:26.855143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3d8eb-2b54-4c8c-ab23-36c25dfeec49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:26.860568 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-00d3d8eb-2b54-4c8c-ab23-36c25dfeec49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:44:26.860568 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:26.860568 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:26.860568 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:26.860568 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:26.860568 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:26.860568 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:26.860568 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:26.860568 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:26.860568 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:26.860568 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:26.860568 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:26.860568 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:26.860568 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:26.860568 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:26.860568 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:26.861652 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:26.861652 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:26.861652 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:26.861652 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:26.861652 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:26.861652 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:26.861652 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:26.861652 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:26.861652 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:26.861652 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:26.861652 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:26.861652 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:26.861652 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:26.861652 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:26.861652 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:26.861652 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:26.862625 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:26.862625 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:26.862625 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:26.862625 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:26.862625 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:26.862625 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:26.862625 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:26.862625 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:26.862625 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:26.862625 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:26.862625 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:44:26.862625 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:26.863352 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 218/444] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:26.863352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e93ab-2ad6-4c4c-8d47-0c46ba2022b1 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:26.868422 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 227/445] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:44:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:26.868422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3d8eb-2b54-4c8c-ab23-36c25dfeec49 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:26.901120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:26.948447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:27.002207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e93ab-2ad6-4c4c-8d47-0c46ba2022b1 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:27.011974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3d8eb-2b54-4c8c-ab23-36c25dfeec49 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:27.042536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176883c-307c-4a9b-a309-1fb37112c4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:27.043673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176883c-307c-4a9b-a309-1fb37112c4af None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:27.044131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176883c-307c-4a9b-a309-1fb37112c4af None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:27.044613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176883c-307c-4a9b-a309-1fb37112c4af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:27.045725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176883c-307c-4a9b-a309-1fb37112c4af None admin] RBAC: Adding query filter params (group.id=5eb0646886ae4d3fb7fd78fc77d0d450, role.id=c3edb43d117b427a91e426e4e42f0c63, scope.project.id=ae7c0ef917404ec9a98252b586e52c5c) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:27.046110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176883c-307c-4a9b-a309-1fb37112c4af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:27.047858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176883c-307c-4a9b-a309-1fb37112c4af None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:27.054460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7026c48-a29a-4be0-9922-ef966829d584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:27.054625 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 219/446] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Jul 30 20:44:26 2022] GET /identity/v3/role_assignments?group.id=5eb0646886ae4d3fb7fd78fc77d0d450&scope.project.id=ae7c0ef917404ec9a98252b586e52c5c&role.id=c3edb43d117b427a91e426e4e42f0c63 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:27.055088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7026c48-a29a-4be0-9922-ef966829d584 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:27.055413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7026c48-a29a-4be0-9922-ef966829d584 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:27.055496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176883c-307c-4a9b-a309-1fb37112c4af None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:27.055694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7026c48-a29a-4be0-9922-ef966829d584 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:27.056416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7026c48-a29a-4be0-9922-ef966829d584 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:27.056724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7026c48-a29a-4be0-9922-ef966829d584 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:27.058121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7026c48-a29a-4be0-9922-ef966829d584 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:27.068555 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 228/447] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:27.076210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7026c48-a29a-4be0-9922-ef966829d584 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:27.184361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:27.196896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176883c-307c-4a9b-a309-1fb37112c4af None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:27.198220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7026c48-a29a-4be0-9922-ef966829d584 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:27.222930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:27.234848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af8aae-c28e-47df-b3ff-7aeb00d27d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:27.235555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af8aae-c28e-47df-b3ff-7aeb00d27d7d None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:27.235855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af8aae-c28e-47df-b3ff-7aeb00d27d7d None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:27.236131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af8aae-c28e-47df-b3ff-7aeb00d27d7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:27.239376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf537d-e5c5-4f76-b359-15ef693b30f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:27.240933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf537d-e5c5-4f76-b359-15ef693b30f3 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:27.240933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf537d-e5c5-4f76-b359-15ef693b30f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:27.240933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf537d-e5c5-4f76-b359-15ef693b30f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:27.309497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af8aae-c28e-47df-b3ff-7aeb00d27d7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:27.311020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af8aae-c28e-47df-b3ff-7aeb00d27d7d None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:27.326884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf537d-e5c5-4f76-b359-15ef693b30f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:27.328459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf537d-e5c5-4f76-b359-15ef693b30f3 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:27.419635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:27.434518 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 220/448] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:27.440216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af8aae-c28e-47df-b3ff-7aeb00d27d7d None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:27.458647 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 229/449] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 30 20:44:27.464530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf537d-e5c5-4f76-b359-15ef693b30f3 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:27.486020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:27.543028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af8aae-c28e-47df-b3ff-7aeb00d27d7d None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:27.569627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf537d-e5c5-4f76-b359-15ef693b30f3 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:27.579388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c36a0-673b-464f-bf1f-bde707d1bbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:27.580042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c36a0-673b-464f-bf1f-bde707d1bbf0 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:27.580333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c36a0-673b-464f-bf1f-bde707d1bbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:27.580611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c36a0-673b-464f-bf1f-bde707d1bbf0 None admin] PATH_INFO: `/v3/projects/ae7c0ef917404ec9a98252b586e52c5c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:27.581775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c36a0-673b-464f-bf1f-bde707d1bbf0 None admin] RBAC: Authorizing `identity:get_project(project_id=ae7c0ef917404ec9a98252b586e52c5c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:27.583227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c36a0-673b-464f-bf1f-bde707d1bbf0 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:27.584951 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 221/450] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:27 2022] GET /identity/v3/projects/ae7c0ef917404ec9a98252b586e52c5c => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:27.590462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c36a0-673b-464f-bf1f-bde707d1bbf0 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:27.602685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a244e56-bb55-418d-9bba-37f7ed7d3643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:27.603390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a244e56-bb55-418d-9bba-37f7ed7d3643 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:27.603675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a244e56-bb55-418d-9bba-37f7ed7d3643 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:27.603954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a244e56-bb55-418d-9bba-37f7ed7d3643 None admin] PATH_INFO: `/v3/projects/375d034049af46779b4f307bede15a89` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:27.605119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a244e56-bb55-418d-9bba-37f7ed7d3643 None admin] RBAC: Authorizing `identity:get_project(project_id=375d034049af46779b4f307bede15a89)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:27.606552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a244e56-bb55-418d-9bba-37f7ed7d3643 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:27.608226 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 230/451] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:44:27 2022] GET /identity/v3/projects/375d034049af46779b4f307bede15a89 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:27.613516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a244e56-bb55-418d-9bba-37f7ed7d3643 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:27.651785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:27.693260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c36a0-673b-464f-bf1f-bde707d1bbf0 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:27.701189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:27.714770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a244e56-bb55-418d-9bba-37f7ed7d3643 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:27.741604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c054c-a7c6-457e-bbe3-c61e348d755b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:27.742254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c054c-a7c6-457e-bbe3-c61e348d755b None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:27.742538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c054c-a7c6-457e-bbe3-c61e348d755b None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:27.742818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c054c-a7c6-457e-bbe3-c61e348d755b None admin] PATH_INFO: `/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:27.744088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c054c-a7c6-457e-bbe3-c61e348d755b None admin] RBAC: Authorizing `identity:get_group(group_id=5eb0646886ae4d3fb7fd78fc77d0d450)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:27.745566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c054c-a7c6-457e-bbe3-c61e348d755b None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:27.747897 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 222/452] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 30 20:44:27 2022] GET /identity/v3/groups/5eb0646886ae4d3fb7fd78fc77d0d450 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:27.753470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c054c-a7c6-457e-bbe3-c61e348d755b None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:27.754939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5b581-78df-46e4-ab66-e1ad758337f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:27.755614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5b581-78df-46e4-ab66-e1ad758337f9 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:27.755895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5b581-78df-46e4-ab66-e1ad758337f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:27.756167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5b581-78df-46e4-ab66-e1ad758337f9 None admin] PATH_INFO: `/v3/groups/88e954a0de604f52b17972fdbb7faaa9` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:27.757900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5b581-78df-46e4-ab66-e1ad758337f9 None admin] RBAC: Authorizing `identity:get_group(group_id=88e954a0de604f52b17972fdbb7faaa9)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:27.759359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5b581-78df-46e4-ab66-e1ad758337f9 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:27.761069 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 231/453] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 30 20:44:27 2022] GET /identity/v3/groups/88e954a0de604f52b17972fdbb7faaa9 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:27.766540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5b581-78df-46e4-ab66-e1ad758337f9 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:27.870503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c054c-a7c6-457e-bbe3-c61e348d755b None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:27.886543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5b581-78df-46e4-ab66-e1ad758337f9 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:27.897708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:27.908015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b92a9-56a3-4d55-933d-2dced027763d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:27.908981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b92a9-56a3-4d55-933d-2dced027763d None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:27.909270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b92a9-56a3-4d55-933d-2dced027763d None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:27.909551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b92a9-56a3-4d55-933d-2dced027763d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:27.910873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b92a9-56a3-4d55-933d-2dced027763d None admin] RBAC: Adding query filter params (group.id=5eb0646886ae4d3fb7fd78fc77d0d450, role.id=bb6a9a85fcb54a31a5a42bea4a88a5b9, scope.project.id=ae7c0ef917404ec9a98252b586e52c5c) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:27.911199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b92a9-56a3-4d55-933d-2dced027763d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:27.913653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b92a9-56a3-4d55-933d-2dced027763d None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:27.921164 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 223/454] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Jul 30 20:44:27 2022] GET /identity/v3/role_assignments?group.id=5eb0646886ae4d3fb7fd78fc77d0d450&scope.project.id=ae7c0ef917404ec9a98252b586e52c5c&role.id=bb6a9a85fcb54a31a5a42bea4a88a5b9 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:27.921747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698c196-0435-40d1-a657-448ada4db369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:27.922442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c196-0435-40d1-a657-448ada4db369 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:27.922727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c196-0435-40d1-a657-448ada4db369 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:27.923005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c196-0435-40d1-a657-448ada4db369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:27.923848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698c196-0435-40d1-a657-448ada4db369 None admin] RBAC: Adding query filter params (group.id=88e954a0de604f52b17972fdbb7faaa9, role.id=3b89b89da98d4ec08a0587aa13832636, scope.project.id=375d034049af46779b4f307bede15a89) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:27.924162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698c196-0435-40d1-a657-448ada4db369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:27.925650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698c196-0435-40d1-a657-448ada4db369 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:27.933594 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 232/455] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Jul 30 20:44:27 2022] GET /identity/v3/role_assignments?group.id=88e954a0de604f52b17972fdbb7faaa9&scope.project.id=375d034049af46779b4f307bede15a89&role.id=3b89b89da98d4ec08a0587aa13832636 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:30.767454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b3ec2-ae22-40c2-885e-7323a9edc07b None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:30.768012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b3ec2-ae22-40c2-885e-7323a9edc07b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:30.768012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b3ec2-ae22-40c2-885e-7323a9edc07b None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:30.769654 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 224/456] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:30.776049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f1948-6d82-4457-896e-879e16eae726 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:30.776542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f1948-6d82-4457-896e-879e16eae726 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:30.776653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f1948-6d82-4457-896e-879e16eae726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:30.804887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1d8f1948-6d82-4457-896e-879e16eae726 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:30.806130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1d8f1948-6d82-4457-896e-879e16eae726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:30.826920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:30.899900 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 233/457] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:30.951643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b3ec2-ae22-40c2-885e-7323a9edc07b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:30.965036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6e4c7-e736-4524-a147-d5e467989c63 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:30.967676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6e4c7-e736-4524-a147-d5e467989c63 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:30.968210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6e4c7-e736-4524-a147-d5e467989c63 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:30.976856 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 234/458] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:30 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:30.985102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d5182-0d15-44bf-8ad1-fdadccbb1f5d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:30.986005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d5182-0d15-44bf-8ad1-fdadccbb1f5d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:30.988321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d5182-0d15-44bf-8ad1-fdadccbb1f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:31.038097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b86d5182-0d15-44bf-8ad1-fdadccbb1f5d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:31.039241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b86d5182-0d15-44bf-8ad1-fdadccbb1f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:31.188183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b3ec2-ae22-40c2-885e-7323a9edc07b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:31.202118 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 235/459] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:44:31.240378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d5182-0d15-44bf-8ad1-fdadccbb1f5d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:31.251238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fea5a-7cf5-4357-aa58-cedbd888fafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:31.251927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fea5a-7cf5-4357-aa58-cedbd888fafe None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:31.252211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fea5a-7cf5-4357-aa58-cedbd888fafe None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:31.252485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fea5a-7cf5-4357-aa58-cedbd888fafe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:31.273155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fea5a-7cf5-4357-aa58-cedbd888fafe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:31.274743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fea5a-7cf5-4357-aa58-cedbd888fafe None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:31.301800 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-426fea5a-7cf5-4357-aa58-cedbd888fafe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:31.301800 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:31.301800 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:31.301800 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:31.301800 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:31.301800 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:31.301800 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:31.301800 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:31.301800 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:31.301800 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:31.301800 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:31.301800 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:31.301800 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:31.301800 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:31.301800 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:31.302683 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:31.302683 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:31.302683 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:31.302683 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:31.302683 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:31.302683 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:31.302683 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:31.302683 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:31.302683 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:31.302683 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:31.302683 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:31.302683 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:31.302683 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:31.302683 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:31.302683 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:31.302683 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:31.302683 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:31.304104 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:31.304104 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:31.304104 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:31.304104 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:31.304104 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 225/460] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:31.312236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fea5a-7cf5-4357-aa58-cedbd888fafe None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:31.327727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:31.344162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d5182-0d15-44bf-8ad1-fdadccbb1f5d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:31.383773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:31.406827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8258931-470f-488f-b81c-3862431a152e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:31.407508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8258931-470f-488f-b81c-3862431a152e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:31.407795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8258931-470f-488f-b81c-3862431a152e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:31.408071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8258931-470f-488f-b81c-3862431a152e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:31.426485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8258931-470f-488f-b81c-3862431a152e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:31.428007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8258931-470f-488f-b81c-3862431a152e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:31.461709 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-f8258931-470f-488f-b81c-3862431a152e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:31.461709 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:31.461709 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:31.461709 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:31.461709 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:31.461709 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:31.461709 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:31.461709 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:31.461709 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:31.461709 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:31.461709 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:31.461709 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:31.461709 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:31.461709 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:31.461709 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:31.462641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:31.462641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:31.462641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:31.462641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:31.462641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:31.462641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:31.462641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:31.462641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:31.462641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:31.462641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:31.462641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:31.462641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:31.462641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:31.462641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:31.462641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:31.462641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:31.462641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:31.463513 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:31.463513 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:31.463513 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:31.463513 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:31.463513 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 236/461] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:31.472383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8258931-470f-488f-b81c-3862431a152e None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:31.486748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fea5a-7cf5-4357-aa58-cedbd888fafe None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:31.523465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdd1a0-4665-41ab-86da-272b4c6c712c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:31.524094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd1a0-4665-41ab-86da-272b4c6c712c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:31.524381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd1a0-4665-41ab-86da-272b4c6c712c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:31.524655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd1a0-4665-41ab-86da-272b4c6c712c None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:31.525352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdd1a0-4665-41ab-86da-272b4c6c712c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:31.525657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdd1a0-4665-41ab-86da-272b4c6c712c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:31.527024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdd1a0-4665-41ab-86da-272b4c6c712c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:31.540286 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 226/462] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:31.545593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdd1a0-4665-41ab-86da-272b4c6c712c None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:31.655675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8258931-470f-488f-b81c-3862431a152e None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:31.687779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:31.693317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50f6b9-1a47-4e44-909f-7203b4b7de2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:31.693965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50f6b9-1a47-4e44-909f-7203b4b7de2f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:31.694249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50f6b9-1a47-4e44-909f-7203b4b7de2f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:31.694525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50f6b9-1a47-4e44-909f-7203b4b7de2f None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:31.694923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdd1a0-4665-41ab-86da-272b4c6c712c None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:31.695220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50f6b9-1a47-4e44-909f-7203b4b7de2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:31.695565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50f6b9-1a47-4e44-909f-7203b4b7de2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:31.696942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50f6b9-1a47-4e44-909f-7203b4b7de2f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:31.697076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:31.718319 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 237/463] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:31.718319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c47550-205c-4297-8bb3-8e2f06447800 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:31.718319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c47550-205c-4297-8bb3-8e2f06447800 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:31.718319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c47550-205c-4297-8bb3-8e2f06447800 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:31.718319 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 238/464] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:31.718319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e1571-8196-4e09-a51d-59ea346cd676 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:31.718832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e1571-8196-4e09-a51d-59ea346cd676 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:31.718832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e1571-8196-4e09-a51d-59ea346cd676 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:31.720132 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 239/465] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:31.720629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e1571-8196-4e09-a51d-59ea346cd676 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:31.745173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8caf5-5609-4aea-9cba-bb63452a5922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:31.746059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8caf5-5609-4aea-9cba-bb63452a5922 None admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:31.746342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8caf5-5609-4aea-9cba-bb63452a5922 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:31.746619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8caf5-5609-4aea-9cba-bb63452a5922 None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:31.747386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8caf5-5609-4aea-9cba-bb63452a5922 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:31.748834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8caf5-5609-4aea-9cba-bb63452a5922 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:31.770425 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 227/466] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 30 20:44:31 2022] POST /identity/v3/users => generated 246 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:44:31.772557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fc9d0-105e-4f58-bf05-bed2c88100f3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:31.773062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fc9d0-105e-4f58-bf05-bed2c88100f3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:31.773557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fc9d0-105e-4f58-bf05-bed2c88100f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:31.793617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d15fc9d0-105e-4f58-bf05-bed2c88100f3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:31.795202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d15fc9d0-105e-4f58-bf05-bed2c88100f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:31.852499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e1571-8196-4e09-a51d-59ea346cd676 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:31.891376 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 228/467] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:31.891376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340da2b4-4fc5-43f8-b691-1d30602592ba None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:31.891376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340da2b4-4fc5-43f8-b691-1d30602592ba None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:31.891376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340da2b4-4fc5-43f8-b691-1d30602592ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:31.909027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-340da2b4-4fc5-43f8-b691-1d30602592ba None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:31.910297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-340da2b4-4fc5-43f8-b691-1d30602592ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:31.913476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d410128-355f-4578-9fe0-0653f9adef9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:31.914199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d410128-355f-4578-9fe0-0653f9adef9a None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:31.914553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d410128-355f-4578-9fe0-0653f9adef9a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:31.914896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d410128-355f-4578-9fe0-0653f9adef9a None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:31.915752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d410128-355f-4578-9fe0-0653f9adef9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:31.917387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d410128-355f-4578-9fe0-0653f9adef9a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:31.970329 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 240/468] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 30 20:44:31 2022] POST /identity/v3/users => generated 248 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 20:44:31.971620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d410128-355f-4578-9fe0-0653f9adef9a None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:32.039996 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 229/469] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:32.064382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:32.071209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340da2b4-4fc5-43f8-b691-1d30602592ba None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:32.102707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:32.139268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d410128-355f-4578-9fe0-0653f9adef9a None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:32.182086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d970e-1a81-4e07-9f3e-fa4ba77f4e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:32.183163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d970e-1a81-4e07-9f3e-fa4ba77f4e8a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:32.183730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d970e-1a81-4e07-9f3e-fa4ba77f4e8a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:32.184393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d970e-1a81-4e07-9f3e-fa4ba77f4e8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:32.197113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d970e-1a81-4e07-9f3e-fa4ba77f4e8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:32.199840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d970e-1a81-4e07-9f3e-fa4ba77f4e8a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:32.216338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340da2b4-4fc5-43f8-b691-1d30602592ba None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:32.219950 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-968d970e-1a81-4e07-9f3e-fa4ba77f4e8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:32.219950 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:32.219950 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:32.219950 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:32.219950 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:32.219950 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:32.219950 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:32.219950 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:32.219950 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:32.219950 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:32.219950 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:32.219950 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:32.219950 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:32.219950 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:32.219950 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:32.220805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:32.220805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:32.220805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:32.220805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:32.220805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:32.220805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:32.220805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:32.220805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:32.220805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:32.220805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:32.220805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:32.220805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:32.220805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:32.220805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:32.220805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:32.220805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:32.220805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:32.221651 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:32.221651 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:32.221651 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:32.221651 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:32.221651 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 241/470] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:32.222534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e695f6-a06a-4623-b393-dfd4551d9955 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:32.222534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e695f6-a06a-4623-b393-dfd4551d9955 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:32.222815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e695f6-a06a-4623-b393-dfd4551d9955 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:32.225704 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 242/471] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:32.228811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e695f6-a06a-4623-b393-dfd4551d9955 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:32.263580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a9c74-e145-4057-94ee-8b10b3440929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:32.264224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a9c74-e145-4057-94ee-8b10b3440929 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:32.264505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a9c74-e145-4057-94ee-8b10b3440929 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:32.264780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a9c74-e145-4057-94ee-8b10b3440929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:32.278443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a9c74-e145-4057-94ee-8b10b3440929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:32.279947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a9c74-e145-4057-94ee-8b10b3440929 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:32.303044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-ab4a9c74-e145-4057-94ee-8b10b3440929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:32.303044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:32.303044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:32.303044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:32.303044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:32.303044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:32.303044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:32.303044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:32.303044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:32.303044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:32.303044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:32.303044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:32.303044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:32.303044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:32.303044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:32.304056 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:32.304056 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:32.304056 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:32.304056 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:32.304056 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:32.304056 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:32.304056 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:32.304056 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:32.304056 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:32.304056 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:32.304056 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:32.304056 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:32.304056 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:32.304056 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:32.304056 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:32.304056 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:32.304056 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:32.304924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:32.304924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:32.304924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:32.304924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:32.304924 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 230/472] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:32.305999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8bba1-ce33-4d95-880a-b5c3285084e7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:32.305999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8bba1-ce33-4d95-880a-b5c3285084e7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:32.306154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8bba1-ce33-4d95-880a-b5c3285084e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:32.328168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7de8bba1-ce33-4d95-880a-b5c3285084e7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:32.329366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7de8bba1-ce33-4d95-880a-b5c3285084e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:32.367493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:32.374448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e695f6-a06a-4623-b393-dfd4551d9955 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:32.406380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:32.414821 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 231/473] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:32.416063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8bba1-ce33-4d95-880a-b5c3285084e7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:32.425616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16e0f1-b041-4a76-8da9-a2c8d8f59fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:32.428692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16e0f1-b041-4a76-8da9-a2c8d8f59fbb None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:32.429166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16e0f1-b041-4a76-8da9-a2c8d8f59fbb None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:32.429645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16e0f1-b041-4a76-8da9-a2c8d8f59fbb None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:32.430521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16e0f1-b041-4a76-8da9-a2c8d8f59fbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:32.431051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16e0f1-b041-4a76-8da9-a2c8d8f59fbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:32.433304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16e0f1-b041-4a76-8da9-a2c8d8f59fbb None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:32.451882 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 243/474] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:32.453015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16e0f1-b041-4a76-8da9-a2c8d8f59fbb None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:32.551087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8bba1-ce33-4d95-880a-b5c3285084e7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:32.573229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16e0f1-b041-4a76-8da9-a2c8d8f59fbb None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:32.594621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc49702-10c3-4b58-8d56-0803169b4486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:32.595587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc49702-10c3-4b58-8d56-0803169b4486 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:32.596503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc49702-10c3-4b58-8d56-0803169b4486 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:32.596972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc49702-10c3-4b58-8d56-0803169b4486 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:32.598144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc49702-10c3-4b58-8d56-0803169b4486 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:32.598634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc49702-10c3-4b58-8d56-0803169b4486 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:32.601452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc49702-10c3-4b58-8d56-0803169b4486 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:32.611826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fc8d6-cc63-4af3-bb9d-7f56c98b2b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:32.612579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fc8d6-cc63-4af3-bb9d-7f56c98b2b22 None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:32.612969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fc8d6-cc63-4af3-bb9d-7f56c98b2b22 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:32.613659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fc8d6-cc63-4af3-bb9d-7f56c98b2b22 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:32.614189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fc8d6-cc63-4af3-bb9d-7f56c98b2b22 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:32.615997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fc8d6-cc63-4af3-bb9d-7f56c98b2b22 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:32.617502 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 232/475] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:32.618829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc49702-10c3-4b58-8d56-0803169b4486 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:32.625541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.sql.core [None req-ef7fc8d6-cc63-4af3-bb9d-7f56c98b2b22 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 30 20:44:32.625541 ncdv-master-1 devstack@keystone.service[91086]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 30 20:44:32.625541 ncdv-master-1 devstack@keystone.service[91086]: [parameters: {'id': '813dd271eaa64b2a8a3f44fa9ed0b34f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 30 20:44:32.625541 ncdv-master-1 devstack@keystone.service[91086]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91086) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 30 20:44:32.645391 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-ef7fc8d6-cc63-4af3-bb9d-7f56c98b2b22 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 30 20:44:32.645391 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:32.645391 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 30 20:44:32.645391 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 30 20:44:32.645391 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 30 20:44:32.645391 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 30 20:44:32.645391 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 30 20:44:32.645391 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application result = self._query(query) Jul 30 20:44:32.645391 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 30 20:44:32.645391 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application conn.query(q) Jul 30 20:44:32.645391 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 30 20:44:32.645391 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 30 20:44:32.645391 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 30 20:44:32.645391 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application result.read() Jul 30 20:44:32.645391 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 30 20:44:32.646393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 30 20:44:32.646393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 30 20:44:32.646393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 30 20:44:32.646393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 30 20:44:32.646393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 30 20:44:32.646393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 30 20:44:32.646393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 30 20:44:32.646393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 30 20:44:32.646393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:32.646393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 30 20:44:32.646393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:32.646393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:32.646393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 30 20:44:32.646393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 30 20:44:32.646393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 30 20:44:32.646393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return ref.to_dict() Jul 30 20:44:32.646393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 30 20:44:32.646393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application next(self.gen) Jul 30 20:44:32.647408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 30 20:44:32.647408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application yield resource Jul 30 20:44:32.647408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 30 20:44:32.647408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application next(self.gen) Jul 30 20:44:32.647408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 30 20:44:32.647408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.session.rollback() Jul 30 20:44:32.647408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 20:44:32.647408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.force_reraise() Jul 30 20:44:32.647408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 20:44:32.647408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise self.value Jul 30 20:44:32.647408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 30 20:44:32.647408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 30 20:44:32.647408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 30 20:44:32.647408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application session.commit() Jul 30 20:44:32.647408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 30 20:44:32.647408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 30 20:44:32.647408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 30 20:44:32.648308 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._prepare_impl() Jul 30 20:44:32.648308 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 30 20:44:32.648308 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.session.flush() Jul 30 20:44:32.648308 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 30 20:44:32.648308 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._flush(objects) Jul 30 20:44:32.648308 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 30 20:44:32.648308 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 30 20:44:32.648308 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 30 20:44:32.648308 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application compat.raise_( Jul 30 20:44:32.648308 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 30 20:44:32.648308 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception Jul 30 20:44:32.648308 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 30 20:44:32.648308 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application flush_context.execute() Jul 30 20:44:32.648308 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 30 20:44:32.648308 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rec.execute(self) Jul 30 20:44:32.648308 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 30 20:44:32.648308 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 30 20:44:32.649188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 30 20:44:32.649188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 30 20:44:32.649188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 30 20:44:32.649188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 30 20:44:32.649188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 30 20:44:32.649188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 30 20:44:32.649188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 30 20:44:32.649188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 30 20:44:32.649188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 30 20:44:32.649188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 30 20:44:32.649188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 30 20:44:32.649188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 30 20:44:32.649188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 30 20:44:32.649188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 30 20:44:32.649188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 30 20:44:32.649188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception Jul 30 20:44:32.650014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 30 20:44:32.650014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 30 20:44:32.650014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 30 20:44:32.650014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 30 20:44:32.650014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 30 20:44:32.650014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application result = self._query(query) Jul 30 20:44:32.650014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 30 20:44:32.650014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application conn.query(q) Jul 30 20:44:32.650014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 30 20:44:32.650014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 30 20:44:32.650014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 30 20:44:32.650014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application result.read() Jul 30 20:44:32.650014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 30 20:44:32.650014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 30 20:44:32.650014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 30 20:44:32.650014 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 30 20:44:32.650803 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 30 20:44:32.650803 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 30 20:44:32.650803 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 30 20:44:32.650803 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 30 20:44:32.650803 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 30 20:44:32.650803 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 30 20:44:32.650803 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [parameters: {'id': '813dd271eaa64b2a8a3f44fa9ed0b34f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 30 20:44:32.650803 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 30 20:44:32.650803 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:32.650803 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:44:32.650803 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:32.650803 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:32.650803 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:32.650803 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:32.650803 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:32.650803 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:32.651631 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:32.651631 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:32.651631 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:32.651631 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:32.651631 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:32.651631 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:32.651631 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 30 20:44:32.651631 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 30 20:44:32.651631 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:32.651631 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:32.651631 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 30 20:44:32.651631 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 30 20:44:32.651631 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 30 20:44:32.651631 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 30 20:44:32.651631 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 30 20:44:32.651631 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:32.654309 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 244/476] 10.222.0.17 () {60 vars in 1131 bytes} [Sat Jul 30 20:44:32 2022] POST /identity/v3/roles => generated 144 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:32.654309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fc8d6-cc63-4af3-bb9d-7f56c98b2b22 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:32.683933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:32.702035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:32.755421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc49702-10c3-4b58-8d56-0803169b4486 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:32.773883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fc8d6-cc63-4af3-bb9d-7f56c98b2b22 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:32.798861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a299d-591d-432b-acbf-3ce010ae70d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:32.799842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a299d-591d-432b-acbf-3ce010ae70d9 None admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:32.800231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a299d-591d-432b-acbf-3ce010ae70d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:32.800941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a299d-591d-432b-acbf-3ce010ae70d9 None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:32.802008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a299d-591d-432b-acbf-3ce010ae70d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:32.804274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a299d-591d-432b-acbf-3ce010ae70d9 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:32.812506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309f188-19c5-4832-9fe3-20a9c34a4aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:32.813335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309f188-19c5-4832-9fe3-20a9c34a4aff None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:32.813802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309f188-19c5-4832-9fe3-20a9c34a4aff None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:32.814231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309f188-19c5-4832-9fe3-20a9c34a4aff None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:32.815194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309f188-19c5-4832-9fe3-20a9c34a4aff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:32.817603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309f188-19c5-4832-9fe3-20a9c34a4aff None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:32.839439 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 233/477] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 30 20:44:32 2022] POST /identity/v3/users => generated 249 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:44:32.839439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a299d-591d-432b-acbf-3ce010ae70d9 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:32.853861 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 245/478] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 30 20:44:32 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:44:32.962818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a299d-591d-432b-acbf-3ce010ae70d9 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:32.983168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:33.015225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d4835-2000-4c3c-975f-4838eff116a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:33.015939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d4835-2000-4c3c-975f-4838eff116a3 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:33.016227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d4835-2000-4c3c-975f-4838eff116a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:33.016509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d4835-2000-4c3c-975f-4838eff116a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:33.029236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d4835-2000-4c3c-975f-4838eff116a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:33.046162 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-4a4d4835-2000-4c3c-975f-4838eff116a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:44:33.046162 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:33.046162 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:33.046162 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:33.046162 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:33.046162 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:33.046162 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:33.046162 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:33.046162 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:33.046162 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:33.046162 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:33.046162 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:33.046162 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:33.046162 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:33.046162 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:33.046162 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:33.047103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:33.047103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:33.047103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:33.047103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:33.047103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:33.047103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:33.047103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:33.047103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:33.047103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:33.047103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:33.047103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:33.047103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:33.047103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:33.047103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:33.047103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:33.047103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:33.047962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:33.047962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:33.047962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:33.047962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:33.047962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:33.047962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:33.047962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:33.047962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:33.047962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:33.047962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:33.047962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 30 20:44:33.047962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:33.047962 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 234/479] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:44:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:33.053860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309f188-19c5-4832-9fe3-20a9c34a4aff None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:33.159770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:33.183676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309f188-19c5-4832-9fe3-20a9c34a4aff None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:33.222119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202881f2-7e41-4808-ab3c-4b0748c47313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:33.222673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202881f2-7e41-4808-ab3c-4b0748c47313 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:33.222956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202881f2-7e41-4808-ab3c-4b0748c47313 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:33.223234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202881f2-7e41-4808-ab3c-4b0748c47313 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:33.223994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202881f2-7e41-4808-ab3c-4b0748c47313 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:33.224303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202881f2-7e41-4808-ab3c-4b0748c47313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:33.226246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202881f2-7e41-4808-ab3c-4b0748c47313 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:33.235081 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 246/480] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:34.569436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c1f7f-99fd-4369-83a9-407c61e20f08 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:34.570035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c1f7f-99fd-4369-83a9-407c61e20f08 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:34.570035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c1f7f-99fd-4369-83a9-407c61e20f08 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:34.571902 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 235/481] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:34.577973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e597d11-97e3-4c8e-a434-e92077e7e19d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:34.578482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e597d11-97e3-4c8e-a434-e92077e7e19d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:34.578556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e597d11-97e3-4c8e-a434-e92077e7e19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:34.605072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7e597d11-97e3-4c8e-a434-e92077e7e19d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:34.606280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7e597d11-97e3-4c8e-a434-e92077e7e19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:34.690634 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 247/482] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:34.734427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e597d11-97e3-4c8e-a434-e92077e7e19d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:34.734844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f3c4a-657c-40ff-949d-c069ba425fd8 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:34.735136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f3c4a-657c-40ff-949d-c069ba425fd8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:34.735443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f3c4a-657c-40ff-949d-c069ba425fd8 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:34.737065 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 236/483] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:34.742513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363ae05-6169-4629-b4f7-49d310ebfb76 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:34.742801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363ae05-6169-4629-b4f7-49d310ebfb76 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:34.743083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363ae05-6169-4629-b4f7-49d310ebfb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:34.761813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-6363ae05-6169-4629-b4f7-49d310ebfb76 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:34.763026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6363ae05-6169-4629-b4f7-49d310ebfb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:34.831761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:34.879952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e597d11-97e3-4c8e-a434-e92077e7e19d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:34.924841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83476c6-69ca-47ad-a4b6-7b2d15e55084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:34.925495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83476c6-69ca-47ad-a4b6-7b2d15e55084 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:34.925780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83476c6-69ca-47ad-a4b6-7b2d15e55084 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:34.926059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83476c6-69ca-47ad-a4b6-7b2d15e55084 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:34.931512 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 237/484] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:44:34.944243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83476c6-69ca-47ad-a4b6-7b2d15e55084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:34.952287 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-d83476c6-69ca-47ad-a4b6-7b2d15e55084 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:34.952287 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:34.952287 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:34.952287 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:34.952287 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:34.952287 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:34.952287 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:34.952287 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:34.952287 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:34.952287 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:34.952287 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:34.952287 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:34.952287 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:34.952287 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:34.952287 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:34.952287 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:34.953190 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:34.953190 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:34.953190 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:34.953190 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:34.953190 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:34.953190 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:34.953190 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:34.953190 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:34.953190 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:34.953190 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:34.953190 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:34.953190 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:34.953190 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:34.953190 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:34.953190 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:34.953190 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:34.954006 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:34.954006 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:34.954006 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:34.954006 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:34.954006 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:34.954006 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:34.954006 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:34.954006 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:34.954006 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:34.954006 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:34.954006 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:34.954006 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:34.954006 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 248/485] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:44:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:34.960025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363ae05-6169-4629-b4f7-49d310ebfb76 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:34.969881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83476c6-69ca-47ad-a4b6-7b2d15e55084 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:35.094231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83476c6-69ca-47ad-a4b6-7b2d15e55084 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:35.128503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:35.148115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e206ad-670e-4b9f-a725-52cc2992f413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:35.148793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e206ad-670e-4b9f-a725-52cc2992f413 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:35.149106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e206ad-670e-4b9f-a725-52cc2992f413 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:35.149482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e206ad-670e-4b9f-a725-52cc2992f413 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:35.165929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363ae05-6169-4629-b4f7-49d310ebfb76 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:35.168463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e206ad-670e-4b9f-a725-52cc2992f413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:35.174549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:35.178037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-c2e206ad-670e-4b9f-a725-52cc2992f413 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:35.178037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:35.178037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:35.178037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:35.178037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:35.178037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:35.178037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:35.178037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:35.178037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:35.178037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:35.178037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:35.178037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:35.178037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:35.178037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:35.178037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:35.178037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:35.178930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:35.178930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:35.178930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:35.178930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:35.178930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:35.178930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:35.178930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:35.178930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:35.178930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:35.178930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:35.178930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:35.178930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:35.178930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:35.178930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:35.178930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:35.178930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:35.179782 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:35.179782 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:35.179782 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:35.179782 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:35.179782 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:35.179782 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:35.179782 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:35.179782 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:35.179782 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:35.179782 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:35.179782 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:35.179782 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:35.179782 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 249/486] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:44:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:35.189108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e206ad-670e-4b9f-a725-52cc2992f413 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:35.217150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389edbd-8d3e-4e12-8a1d-306a93a4171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:35.217790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389edbd-8d3e-4e12-8a1d-306a93a4171c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:35.218118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389edbd-8d3e-4e12-8a1d-306a93a4171c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:35.218405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389edbd-8d3e-4e12-8a1d-306a93a4171c None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:35.219133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389edbd-8d3e-4e12-8a1d-306a93a4171c None admin] RBAC: Adding query filter params (name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:35.219467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389edbd-8d3e-4e12-8a1d-306a93a4171c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:35.223191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389edbd-8d3e-4e12-8a1d-306a93a4171c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:35.247429 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 238/487] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:44:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:35.249549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389edbd-8d3e-4e12-8a1d-306a93a4171c None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:35.389643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389edbd-8d3e-4e12-8a1d-306a93a4171c None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:35.423558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e206ad-670e-4b9f-a725-52cc2992f413 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:35.453710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab7356-2a8b-4d96-9131-5c7421122167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:35.454376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab7356-2a8b-4d96-9131-5c7421122167 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:35.454660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab7356-2a8b-4d96-9131-5c7421122167 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:35.454938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab7356-2a8b-4d96-9131-5c7421122167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:35.471579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0bb14-665e-4077-b9f6-fa1cd530ba39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:35.472505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0bb14-665e-4077-b9f6-fa1cd530ba39 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:35.472983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0bb14-665e-4077-b9f6-fa1cd530ba39 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:35.473537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0bb14-665e-4077-b9f6-fa1cd530ba39 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:35.474453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0bb14-665e-4077-b9f6-fa1cd530ba39 None admin] RBAC: Adding query filter params (name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:35.475865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0bb14-665e-4077-b9f6-fa1cd530ba39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:35.477075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab7356-2a8b-4d96-9131-5c7421122167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:35.478696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0bb14-665e-4077-b9f6-fa1cd530ba39 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:35.480525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab7356-2a8b-4d96-9131-5c7421122167 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:35.498266 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 250/488] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:44:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:35.504992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0bb14-665e-4077-b9f6-fa1cd530ba39 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:35.509492 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-8cab7356-2a8b-4d96-9131-5c7421122167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:35.509492 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:35.509492 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:35.509492 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:35.509492 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:35.509492 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:35.509492 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:35.509492 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:35.509492 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:35.509492 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:35.509492 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:35.509492 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:35.509492 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:35.509492 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:35.509492 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:35.510361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:35.510361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:35.510361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:35.510361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:35.510361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:35.510361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:35.510361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:35.510361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:35.510361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:35.510361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:35.510361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:35.510361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:35.510361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:35.510361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:35.510361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:35.510361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:35.510361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:35.511209 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:35.511209 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:35.511209 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:35.511209 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:35.519927 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 239/489] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:35.533015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab7356-2a8b-4d96-9131-5c7421122167 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:35.589531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:35.593495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:35.697613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0bb14-665e-4077-b9f6-fa1cd530ba39 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:35.712015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab7356-2a8b-4d96-9131-5c7421122167 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:35.754614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42ed5d-473b-469b-a157-a09a0c46ffe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:35.755521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42ed5d-473b-469b-a157-a09a0c46ffe0 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:35.755812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42ed5d-473b-469b-a157-a09a0c46ffe0 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:35.756130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42ed5d-473b-469b-a157-a09a0c46ffe0 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:35.757282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42ed5d-473b-469b-a157-a09a0c46ffe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:35.757596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42ed5d-473b-469b-a157-a09a0c46ffe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:35.759406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42ed5d-473b-469b-a157-a09a0c46ffe0 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:35.762368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce9745-7bdb-41d4-9d56-91095b9b4148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:35.763142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce9745-7bdb-41d4-9d56-91095b9b4148 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:35.763556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce9745-7bdb-41d4-9d56-91095b9b4148 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:35.763936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce9745-7bdb-41d4-9d56-91095b9b4148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:35.776846 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 240/490] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:35.777075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce9745-7bdb-41d4-9d56-91095b9b4148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:35.778512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dd6c0-d07c-4a74-9972-21b033cc9c50 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:35.778739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce9745-7bdb-41d4-9d56-91095b9b4148 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:35.779111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dd6c0-d07c-4a74-9972-21b033cc9c50 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:35.779774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dd6c0-d07c-4a74-9972-21b033cc9c50 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:35.786181 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 241/491] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:35.786181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dd6c0-d07c-4a74-9972-21b033cc9c50 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:35.800072 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-52ce9745-7bdb-41d4-9d56-91095b9b4148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:35.800072 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:35.800072 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:35.800072 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:35.800072 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:35.800072 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:35.800072 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:35.800072 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:35.800072 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:35.800072 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:35.800072 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:35.800072 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:35.800072 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:35.800072 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:35.800072 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:35.800995 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:35.800995 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:35.800995 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:35.800995 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:35.800995 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:35.800995 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:35.800995 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:35.800995 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:35.800995 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:35.800995 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:35.800995 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:35.800995 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:35.800995 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:35.800995 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:35.800995 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:35.800995 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:35.800995 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:35.801952 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:35.801952 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:35.801952 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:35.801952 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:35.801952 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 251/492] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:44:35.803121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7d5db-2228-4802-b59c-6352b0008e2f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:35.803441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7d5db-2228-4802-b59c-6352b0008e2f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:35.803722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7d5db-2228-4802-b59c-6352b0008e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:35.824081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b2b7d5db-2228-4802-b59c-6352b0008e2f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:35.825324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b2b7d5db-2228-4802-b59c-6352b0008e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:35.907127 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 252/493] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:35.907127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7d5db-2228-4802-b59c-6352b0008e2f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:35.913261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:35.944338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:35.963789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dd6c0-d07c-4a74-9972-21b033cc9c50 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:36.014105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444f2cd-72f2-4ead-82d7-5047471eb13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:36.014692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444f2cd-72f2-4ead-82d7-5047471eb13a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:36.014979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444f2cd-72f2-4ead-82d7-5047471eb13a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:36.015253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444f2cd-72f2-4ead-82d7-5047471eb13a None admin] PATH_INFO: `/v3/users/nova` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:36.019226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7d5db-2228-4802-b59c-6352b0008e2f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:36.024111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444f2cd-72f2-4ead-82d7-5047471eb13a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:36.027055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444f2cd-72f2-4ead-82d7-5047471eb13a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:36.042344 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-e444f2cd-72f2-4ead-82d7-5047471eb13a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 30 20:44:36.042344 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:36.042344 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:36.042344 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:36.042344 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:36.042344 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:36.042344 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:36.042344 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:36.042344 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:36.042344 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:36.042344 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:36.042344 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:36.042344 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:44:36.042344 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:44:36.042344 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:44:36.042344 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:44:36.043589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:36.043589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:36.043589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:44:36.043589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:36.043589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:44:36.043589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:36.043589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:36.043589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:36.043589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:36.043589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:36.043589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:36.043589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:36.043589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:36.043589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:36.043589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:36.043589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:36.043589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:36.043589 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:36.044508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:36.044508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:36.044508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:44:36.044508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:44:36.044508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:44:36.044508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:44:36.044508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:44:36.044508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:44:36.044508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 30 20:44:36.044508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:36.044508 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 242/494] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Jul 30 20:44:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:36.044508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444f2cd-72f2-4ead-82d7-5047471eb13a None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:36.063028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237a5e7-396c-457f-b273-72092deb15d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:36.063790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237a5e7-396c-457f-b273-72092deb15d7 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:36.064071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237a5e7-396c-457f-b273-72092deb15d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:36.064348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237a5e7-396c-457f-b273-72092deb15d7 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:36.065043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237a5e7-396c-457f-b273-72092deb15d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:36.065349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237a5e7-396c-457f-b273-72092deb15d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:36.066745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237a5e7-396c-457f-b273-72092deb15d7 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:36.078546 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 253/495] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:36.079610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce867d0c-4e8c-4b7f-9f74-c0ed65f9725d None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:36.079911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce867d0c-4e8c-4b7f-9f74-c0ed65f9725d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:36.080188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce867d0c-4e8c-4b7f-9f74-c0ed65f9725d None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:36.081389 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 254/496] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:36.082081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce867d0c-4e8c-4b7f-9f74-c0ed65f9725d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:36.151162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444f2cd-72f2-4ead-82d7-5047471eb13a None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:36.181891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:36.188514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1621b80-02f8-471c-bd84-8cd122806adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:36.189166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1621b80-02f8-471c-bd84-8cd122806adc None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:36.189449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1621b80-02f8-471c-bd84-8cd122806adc None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:36.189748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1621b80-02f8-471c-bd84-8cd122806adc None admin] PATH_INFO: `/v3/roles/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:36.194578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce867d0c-4e8c-4b7f-9f74-c0ed65f9725d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:36.198261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:36.201749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1621b80-02f8-471c-bd84-8cd122806adc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:36.206894 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-b1621b80-02f8-471c-bd84-8cd122806adc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:36.206894 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:36.206894 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:36.206894 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:36.206894 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:36.206894 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:36.206894 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:36.206894 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:36.206894 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:36.206894 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:36.206894 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:36.206894 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:36.206894 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:36.206894 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:36.206894 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:36.206894 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:36.208014 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:36.208014 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:36.208014 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:36.208014 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:36.208014 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:36.208014 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:36.208014 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:36.208014 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:36.208014 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:36.208014 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:36.208014 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:36.208014 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:36.208014 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:36.208014 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:36.208014 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:36.208014 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:36.214484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:36.214484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:36.214484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:36.214484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:36.214484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:36.214484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:36.214484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:36.214484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:36.214484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:36.214484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:36.214484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:36.214484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:36.214484 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 243/497] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:44:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:36.214484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132a2f0-ab7c-4184-8b26-a9903a7aed32 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:36.215203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132a2f0-ab7c-4184-8b26-a9903a7aed32 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:36.215203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132a2f0-ab7c-4184-8b26-a9903a7aed32 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:36.215203 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 244/498] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:36.215203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132a2f0-ab7c-4184-8b26-a9903a7aed32 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:36.240949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6a92a-6cc1-4835-bcac-b92fafaeaeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:36.241564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6a92a-6cc1-4835-bcac-b92fafaeaeaa None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:36.241842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6a92a-6cc1-4835-bcac-b92fafaeaeaa None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:36.242112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6a92a-6cc1-4835-bcac-b92fafaeaeaa None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:36.242888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6a92a-6cc1-4835-bcac-b92fafaeaeaa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:36.243193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6a92a-6cc1-4835-bcac-b92fafaeaeaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:36.244660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6a92a-6cc1-4835-bcac-b92fafaeaeaa None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:36.282196 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 255/499] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Jul 30 20:44:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:36.283528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c376146-bb06-4b1f-915b-fd7abae1c82e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:36.283823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c376146-bb06-4b1f-915b-fd7abae1c82e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:36.284107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c376146-bb06-4b1f-915b-fd7abae1c82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:36.301125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1c376146-bb06-4b1f-915b-fd7abae1c82e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:36.302328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1c376146-bb06-4b1f-915b-fd7abae1c82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:36.312737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132a2f0-ab7c-4184-8b26-a9903a7aed32 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:36.346134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544650be-1477-4768-a777-bc3736853046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:36.346771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544650be-1477-4768-a777-bc3736853046 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:36.347068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544650be-1477-4768-a777-bc3736853046 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:36.347370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544650be-1477-4768-a777-bc3736853046 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:36.355241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544650be-1477-4768-a777-bc3736853046 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:36.356728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544650be-1477-4768-a777-bc3736853046 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:36.368180 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 256/500] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:36.368426 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-544650be-1477-4768-a777-bc3736853046 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 30 20:44:36.368426 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:36.368426 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:36.368426 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:36.368426 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:36.368426 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:36.368426 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:36.368426 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:36.368426 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:36.368426 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:36.368426 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:36.368426 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:36.368426 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:44:36.368426 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:44:36.368426 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:44:36.368426 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:44:36.369298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:36.369298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:36.369298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:44:36.369298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:36.369298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:44:36.369298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:36.369298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:36.369298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:36.369298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:36.369298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:36.369298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:36.369298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:36.369298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:36.369298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:36.369298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:36.369298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:36.369298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:36.369298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:36.370181 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:36.370181 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:36.370181 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:44:36.370181 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:44:36.370181 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:44:36.370181 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:44:36.370181 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:44:36.370181 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:44:36.370181 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 30 20:44:36.370181 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:36.370940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16467739-0329-4431-8c43-ce51a65ae452 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:36.370940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16467739-0329-4431-8c43-ce51a65ae452 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:36.370940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16467739-0329-4431-8c43-ce51a65ae452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:36.371115 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 245/501] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:36.371115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544650be-1477-4768-a777-bc3736853046 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:36.393965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-16467739-0329-4431-8c43-ce51a65ae452 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:36.395155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-16467739-0329-4431-8c43-ce51a65ae452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:36.437313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:36.460410 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 257/502] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:36.461239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16467739-0329-4431-8c43-ce51a65ae452 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:36.476189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:36.482749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544650be-1477-4768-a777-bc3736853046 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:36.517929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b16dde-46b5-475a-a61e-ab46771ee38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:36.518544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b16dde-46b5-475a-a61e-ab46771ee38a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:36.518833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b16dde-46b5-475a-a61e-ab46771ee38a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:36.519109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b16dde-46b5-475a-a61e-ab46771ee38a None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:36.519851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b16dde-46b5-475a-a61e-ab46771ee38a None admin] RBAC: Adding query filter params (name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:36.520154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b16dde-46b5-475a-a61e-ab46771ee38a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:36.521568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b16dde-46b5-475a-a61e-ab46771ee38a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:36.529885 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 246/503] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:44:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:36.530671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b16dde-46b5-475a-a61e-ab46771ee38a None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:36.563069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16467739-0329-4431-8c43-ce51a65ae452 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:36.596738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f3d73-f1e4-4c1e-9962-4b5ca127e64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:36.597369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f3d73-f1e4-4c1e-9962-4b5ca127e64a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:36.597645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f3d73-f1e4-4c1e-9962-4b5ca127e64a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:36.597924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f3d73-f1e4-4c1e-9962-4b5ca127e64a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:36.630017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b16dde-46b5-475a-a61e-ab46771ee38a None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:36.652478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:36.664313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64617d17-78b8-4069-9460-583f008bd739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:36.664928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64617d17-78b8-4069-9460-583f008bd739 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:36.665220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64617d17-78b8-4069-9460-583f008bd739 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:36.665501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64617d17-78b8-4069-9460-583f008bd739 None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:36.666288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64617d17-78b8-4069-9460-583f008bd739 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:36.666598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64617d17-78b8-4069-9460-583f008bd739 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:36.667422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f3d73-f1e4-4c1e-9962-4b5ca127e64a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:36.668079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64617d17-78b8-4069-9460-583f008bd739 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:36.668891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f3d73-f1e4-4c1e-9962-4b5ca127e64a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:36.683332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:36.706094 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 247/504] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Jul 30 20:44:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:36.707120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64617d17-78b8-4069-9460-583f008bd739 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:36.771005 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 258/505] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:36.771823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f3d73-f1e4-4c1e-9962-4b5ca127e64a None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:36.808042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64617d17-78b8-4069-9460-583f008bd739 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:36.842059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb96f00-8db1-4db4-9eb7-3ee0673d40e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:36.842699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb96f00-8db1-4db4-9eb7-3ee0673d40e0 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:36.842986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb96f00-8db1-4db4-9eb7-3ee0673d40e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:36.843268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb96f00-8db1-4db4-9eb7-3ee0673d40e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:36.853754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb96f00-8db1-4db4-9eb7-3ee0673d40e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:36.858560 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-9cb96f00-8db1-4db4-9eb7-3ee0673d40e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:36.858560 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:36.858560 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:36.858560 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:36.858560 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:36.858560 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:36.858560 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:36.858560 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:36.858560 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:36.858560 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:36.858560 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:36.858560 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:36.858560 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:36.858560 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:36.858560 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:36.858560 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:36.859650 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:36.859650 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:36.859650 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:36.859650 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:36.859650 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:36.859650 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:36.859650 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:36.859650 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:36.859650 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:36.859650 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:36.859650 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:36.859650 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:36.859650 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:36.859650 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:36.859650 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:36.859650 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:36.866074 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:36.866074 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:36.866074 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:36.866074 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:36.866074 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:36.866074 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:36.866074 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:36.866074 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:36.866074 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:36.866074 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:36.866074 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:36.866074 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:36.866074 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 248/506] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:44:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:36.866074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb96f00-8db1-4db4-9eb7-3ee0673d40e0 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:36.869585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f3d73-f1e4-4c1e-9962-4b5ca127e64a None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:36.883766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:36.903793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d325fa-9b8e-4932-b2fd-465c4949992f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:36.904441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d325fa-9b8e-4932-b2fd-465c4949992f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:36.904725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d325fa-9b8e-4932-b2fd-465c4949992f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:36.904828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:36.905002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d325fa-9b8e-4932-b2fd-465c4949992f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:36.915750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d325fa-9b8e-4932-b2fd-465c4949992f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:36.917241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d325fa-9b8e-4932-b2fd-465c4949992f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:36.933020 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-d1d325fa-9b8e-4932-b2fd-465c4949992f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:36.933020 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:36.933020 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:36.933020 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:36.933020 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:36.933020 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:36.933020 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:36.933020 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:36.933020 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:36.933020 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:36.933020 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:36.933020 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:36.933020 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:36.933020 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:36.933020 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:36.934021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:36.934021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:36.934021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:36.934021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:36.934021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:36.934021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:36.934021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:36.934021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:36.934021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:36.934021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:36.934021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:36.934021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:36.934021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:36.934021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:36.934021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:36.934021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:36.934021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:36.939894 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:36.939894 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:36.939894 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:36.939894 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:36.939894 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 259/507] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:36.939894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d325fa-9b8e-4932-b2fd-465c4949992f None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:36.966127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb96f00-8db1-4db4-9eb7-3ee0673d40e0 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:37.000344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f46210-3ca8-4e39-bf17-6d4bcaab4c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:37.000986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f46210-3ca8-4e39-bf17-6d4bcaab4c31 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:37.001269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f46210-3ca8-4e39-bf17-6d4bcaab4c31 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:37.001544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f46210-3ca8-4e39-bf17-6d4bcaab4c31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:37.012275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f46210-3ca8-4e39-bf17-6d4bcaab4c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:37.013750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f46210-3ca8-4e39-bf17-6d4bcaab4c31 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:37.028235 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-d9f46210-3ca8-4e39-bf17-6d4bcaab4c31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:37.028235 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:37.028235 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:37.028235 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:37.028235 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:37.028235 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:37.028235 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:37.028235 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:37.028235 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:37.028235 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:37.028235 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:37.028235 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:37.028235 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:37.028235 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:37.028235 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:37.029059 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:37.029059 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:37.029059 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:37.029059 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:37.029059 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:37.029059 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:37.029059 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:37.029059 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:37.029059 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:37.029059 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:37.029059 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:37.029059 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:37.029059 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:37.029059 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:37.029059 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:37.029059 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:37.029059 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:37.029901 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:37.029901 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:37.029901 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:37.029901 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:37.029901 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 249/508] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:37.030499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f46210-3ca8-4e39-bf17-6d4bcaab4c31 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:37.042202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d325fa-9b8e-4932-b2fd-465c4949992f None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:37.076148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcadf6-4bfa-45bc-828a-ab57bc3e5184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:37.076762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcadf6-4bfa-45bc-828a-ab57bc3e5184 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:37.077046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcadf6-4bfa-45bc-828a-ab57bc3e5184 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:37.077321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcadf6-4bfa-45bc-828a-ab57bc3e5184 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:37.110671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:37.120405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:37.129763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f46210-3ca8-4e39-bf17-6d4bcaab4c31 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:37.152464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcadf6-4bfa-45bc-828a-ab57bc3e5184 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:37.153922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcadf6-4bfa-45bc-828a-ab57bc3e5184 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:37.164875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9e61a-adb9-4759-bd20-c76939aa302f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:37.165581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9e61a-adb9-4759-bd20-c76939aa302f None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:37.165995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9e61a-adb9-4759-bd20-c76939aa302f None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:37.166284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9e61a-adb9-4759-bd20-c76939aa302f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:37.177528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9e61a-adb9-4759-bd20-c76939aa302f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:37.179506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9e61a-adb9-4759-bd20-c76939aa302f None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:37.193372 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-37c9e61a-adb9-4759-bd20-c76939aa302f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:37.193372 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:37.193372 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:37.193372 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:37.193372 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:37.193372 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:37.193372 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:37.193372 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:37.193372 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:37.193372 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:37.193372 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:37.193372 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:37.193372 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:37.193372 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:37.193372 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:37.194849 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:37.194849 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:37.194849 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:37.194849 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:37.194849 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:37.194849 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:37.194849 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:37.194849 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:37.194849 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:37.194849 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:37.194849 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:37.194849 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:37.194849 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:37.194849 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:37.194849 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:37.194849 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:37.194849 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:37.195820 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:37.195820 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:37.195820 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:37.195820 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:37.195820 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 250/509] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:37.196137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9e61a-adb9-4759-bd20-c76939aa302f None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:37.262497 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 260/510] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:37.263372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcadf6-4bfa-45bc-828a-ab57bc3e5184 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:37.298107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9e61a-adb9-4759-bd20-c76939aa302f None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:37.328390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:37.331629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2fe9a-cab1-41ff-af61-8054cc426be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:37.332251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2fe9a-cab1-41ff-af61-8054cc426be2 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:37.332537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2fe9a-cab1-41ff-af61-8054cc426be2 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:37.332814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2fe9a-cab1-41ff-af61-8054cc426be2 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:37.333529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2fe9a-cab1-41ff-af61-8054cc426be2 None admin] RBAC: Adding query filter params (name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:37.333836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2fe9a-cab1-41ff-af61-8054cc426be2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:37.335805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2fe9a-cab1-41ff-af61-8054cc426be2 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:37.343905 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 251/511] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:44:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:37.344720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2fe9a-cab1-41ff-af61-8054cc426be2 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:37.353115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:37.368718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcadf6-4bfa-45bc-828a-ab57bc3e5184 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:37.403224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41119889-0f9c-4b8f-a53a-366231adeb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:37.403885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41119889-0f9c-4b8f-a53a-366231adeb8e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:37.404173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41119889-0f9c-4b8f-a53a-366231adeb8e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:37.404447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41119889-0f9c-4b8f-a53a-366231adeb8e None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:37.405138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41119889-0f9c-4b8f-a53a-366231adeb8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:37.405448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41119889-0f9c-4b8f-a53a-366231adeb8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:37.406817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41119889-0f9c-4b8f-a53a-366231adeb8e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:37.418442 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 261/512] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:37.419495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41119889-0f9c-4b8f-a53a-366231adeb8e None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:37.442745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2fe9a-cab1-41ff-af61-8054cc426be2 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:37.476354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546e884-547a-4fde-bdc2-9b433ee732b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:37.476970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546e884-547a-4fde-bdc2-9b433ee732b0 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:37.477258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546e884-547a-4fde-bdc2-9b433ee732b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:37.477537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546e884-547a-4fde-bdc2-9b433ee732b0 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:37.478231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546e884-547a-4fde-bdc2-9b433ee732b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:37.478538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546e884-547a-4fde-bdc2-9b433ee732b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:37.479945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546e884-547a-4fde-bdc2-9b433ee732b0 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:37.491403 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 252/513] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:37.492189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546e884-547a-4fde-bdc2-9b433ee732b0 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:37.517704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41119889-0f9c-4b8f-a53a-366231adeb8e None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:37.542533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:37.551462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8778f3-cf99-4c60-943e-a00098bc5202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:37.552016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8778f3-cf99-4c60-943e-a00098bc5202 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:37.552301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8778f3-cf99-4c60-943e-a00098bc5202 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:37.552576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8778f3-cf99-4c60-943e-a00098bc5202 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:37.553798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8778f3-cf99-4c60-943e-a00098bc5202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:37.554112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8778f3-cf99-4c60-943e-a00098bc5202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:37.555505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8778f3-cf99-4c60-943e-a00098bc5202 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:37.558502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:37.567499 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 262/514] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:37.568290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8778f3-cf99-4c60-943e-a00098bc5202 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:37.593087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546e884-547a-4fde-bdc2-9b433ee732b0 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:37.631573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c49237-f136-4670-987d-e33c76459718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:37.632401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c49237-f136-4670-987d-e33c76459718 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:37.632691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c49237-f136-4670-987d-e33c76459718 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:37.632970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c49237-f136-4670-987d-e33c76459718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:37.643360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c49237-f136-4670-987d-e33c76459718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:37.644809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c49237-f136-4670-987d-e33c76459718 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:37.659119 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-c7c49237-f136-4670-987d-e33c76459718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:37.659119 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:37.659119 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:37.659119 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:37.659119 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:37.659119 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:37.659119 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:37.659119 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:37.659119 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:37.659119 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:37.659119 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:37.659119 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:37.659119 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:37.659119 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:37.659119 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:37.660044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:37.660044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:37.660044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:37.660044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:37.660044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:37.660044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:37.660044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:37.660044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:37.660044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:37.660044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:37.660044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:37.660044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:37.660044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:37.660044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:37.660044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:37.660044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:37.660044 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:37.660892 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:37.660892 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:37.660892 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:37.660892 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:37.660892 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 253/515] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:37.661198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c49237-f136-4670-987d-e33c76459718 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:37.672234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8778f3-cf99-4c60-943e-a00098bc5202 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:37.706673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a74e5-2501-4397-85a3-65d1d31f8771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:37.707337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a74e5-2501-4397-85a3-65d1d31f8771 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:37.707626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a74e5-2501-4397-85a3-65d1d31f8771 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:37.708183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a74e5-2501-4397-85a3-65d1d31f8771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:37.717677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a74e5-2501-4397-85a3-65d1d31f8771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:37.719132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a74e5-2501-4397-85a3-65d1d31f8771 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:37.733955 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-e31a74e5-2501-4397-85a3-65d1d31f8771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:37.733955 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:37.733955 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:37.733955 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:37.733955 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:37.733955 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:37.733955 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:37.733955 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:37.733955 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:37.733955 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:37.733955 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:37.733955 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:37.733955 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:37.733955 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:37.733955 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:37.734957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:37.734957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:37.734957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:37.734957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:37.734957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:37.734957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:37.734957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:37.734957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:37.734957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:37.734957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:37.734957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:37.734957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:37.734957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:37.734957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:37.734957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:37.734957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:37.734957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:37.735875 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:37.735875 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:37.735875 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:37.735875 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:37.735875 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 263/516] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:37.735875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a74e5-2501-4397-85a3-65d1d31f8771 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:37.770810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c49237-f136-4670-987d-e33c76459718 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:37.778327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:37.788444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:37.805952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a8337-2bed-4db7-8509-edf4d3386ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:37.806504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a8337-2bed-4db7-8509-edf4d3386ab5 None admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:37.806785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a8337-2bed-4db7-8509-edf4d3386ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:37.807061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a8337-2bed-4db7-8509-edf4d3386ab5 None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:37.807774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a8337-2bed-4db7-8509-edf4d3386ab5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:37.809220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a8337-2bed-4db7-8509-edf4d3386ab5 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:37.830963 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 254/517] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 30 20:44:37 2022] POST /identity/v3/users => generated 247 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:44:37.831848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a8337-2bed-4db7-8509-edf4d3386ab5 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:37.838867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a74e5-2501-4397-85a3-65d1d31f8771 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:37.877310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b2aad-a31d-4618-8d59-63d9f35fe3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:37.878334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b2aad-a31d-4618-8d59-63d9f35fe3e4 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:37.878838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b2aad-a31d-4618-8d59-63d9f35fe3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:37.879117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b2aad-a31d-4618-8d59-63d9f35fe3e4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:37.889000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b2aad-a31d-4618-8d59-63d9f35fe3e4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:37.890484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b2aad-a31d-4618-8d59-63d9f35fe3e4 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:37.904243 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-7a9b2aad-a31d-4618-8d59-63d9f35fe3e4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 30 20:44:37.904243 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:37.904243 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:37.904243 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:37.904243 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:37.904243 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:37.904243 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:37.904243 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:37.904243 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:37.904243 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:37.904243 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:37.904243 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:37.904243 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:44:37.904243 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:44:37.904243 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:44:37.904243 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:44:37.905294 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:37.905294 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:37.905294 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:44:37.905294 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:37.905294 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:44:37.905294 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:37.905294 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:37.905294 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:37.905294 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:37.905294 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:37.905294 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:37.905294 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:37.905294 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:37.905294 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:37.905294 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:37.905294 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:37.905294 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:37.905294 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:37.906207 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:37.906207 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:37.906207 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:44:37.906207 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:44:37.906207 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:44:37.906207 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:44:37.906207 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:44:37.906207 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:44:37.906207 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 30 20:44:37.906207 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:37.906207 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 264/518] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:44:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:37.906809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b2aad-a31d-4618-8d59-63d9f35fe3e4 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:37.949399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a8337-2bed-4db7-8509-edf4d3386ab5 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:37.986621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f62d2c-0b09-4fc9-9768-834c688603ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:37.987324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f62d2c-0b09-4fc9-9768-834c688603ee None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:37.987602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f62d2c-0b09-4fc9-9768-834c688603ee None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:37.987892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f62d2c-0b09-4fc9-9768-834c688603ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:38.000432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f62d2c-0b09-4fc9-9768-834c688603ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:38.002085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f62d2c-0b09-4fc9-9768-834c688603ee None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:38.019707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:38.020924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-d7f62d2c-0b09-4fc9-9768-834c688603ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:38.020924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:38.020924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:38.020924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:38.020924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:38.020924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:38.020924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:38.020924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:38.020924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:38.020924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:38.020924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:38.020924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:38.020924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:44:38.020924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:44:38.020924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:44:38.022298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:44:38.022298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:38.022298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:38.022298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:38.022298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:38.022298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:38.022298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:38.022298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:38.022298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:38.022298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:38.022298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:38.022298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:38.022298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:38.022298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:38.022298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:38.022298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:38.022298 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:38.023190 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:44:38.023190 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:44:38.023190 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:44:38.023190 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:44:38.023190 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:44:38.023190 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:44:38.023190 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:38.023190 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:38.023649 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 255/519] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:38.024242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f62d2c-0b09-4fc9-9768-834c688603ee None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:38.029782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b2aad-a31d-4618-8d59-63d9f35fe3e4 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:38.067144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:38.071856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4155d-cda5-4fbb-b26d-3de220bde7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:38.072493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4155d-cda5-4fbb-b26d-3de220bde7fb None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:38.072780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4155d-cda5-4fbb-b26d-3de220bde7fb None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:38.073059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4155d-cda5-4fbb-b26d-3de220bde7fb None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:38.073765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4155d-cda5-4fbb-b26d-3de220bde7fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:38.074528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4155d-cda5-4fbb-b26d-3de220bde7fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:38.076145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4155d-cda5-4fbb-b26d-3de220bde7fb None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:38.088739 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 265/520] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:38.089563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4155d-cda5-4fbb-b26d-3de220bde7fb None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:38.145319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f62d2c-0b09-4fc9-9768-834c688603ee None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:38.185038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7737e-19db-415c-bf90-fe201c7ef34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:38.185662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7737e-19db-415c-bf90-fe201c7ef34d None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:38.185951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7737e-19db-415c-bf90-fe201c7ef34d None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:38.186232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7737e-19db-415c-bf90-fe201c7ef34d None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:38.186929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7737e-19db-415c-bf90-fe201c7ef34d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:38.187236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7737e-19db-415c-bf90-fe201c7ef34d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:38.188664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7737e-19db-415c-bf90-fe201c7ef34d None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:38.201301 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 256/521] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:38.202361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7737e-19db-415c-bf90-fe201c7ef34d None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:38.209672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4155d-cda5-4fbb-b26d-3de220bde7fb None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:38.248324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d51ae-aba6-4e97-82cf-7390c58e6038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:38.249120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d51ae-aba6-4e97-82cf-7390c58e6038 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:38.249408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d51ae-aba6-4e97-82cf-7390c58e6038 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:38.249732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d51ae-aba6-4e97-82cf-7390c58e6038 None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:38.250651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d51ae-aba6-4e97-82cf-7390c58e6038 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:38.250967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d51ae-aba6-4e97-82cf-7390c58e6038 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:38.252485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d51ae-aba6-4e97-82cf-7390c58e6038 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:38.275900 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 266/522] 10.222.0.17 () {56 vars in 1139 bytes} [Sat Jul 30 20:44:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:38.275900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d51ae-aba6-4e97-82cf-7390c58e6038 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:38.292266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:38.309938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:38.317411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7737e-19db-415c-bf90-fe201c7ef34d None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:38.352974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1478b8-b85d-4c88-8c55-a4e76b14a735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:38.352974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1478b8-b85d-4c88-8c55-a4e76b14a735 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:38.352974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1478b8-b85d-4c88-8c55-a4e76b14a735 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:38.352974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1478b8-b85d-4c88-8c55-a4e76b14a735 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:38.353530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1478b8-b85d-4c88-8c55-a4e76b14a735 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:38.353802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1478b8-b85d-4c88-8c55-a4e76b14a735 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:38.355232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1478b8-b85d-4c88-8c55-a4e76b14a735 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:38.379335 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 257/523] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:44:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:38.379335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1478b8-b85d-4c88-8c55-a4e76b14a735 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:38.389577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d51ae-aba6-4e97-82cf-7390c58e6038 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:38.425940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54c79c-d6e2-4c58-98f3-e6b68a7e100d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:38.426620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54c79c-d6e2-4c58-98f3-e6b68a7e100d None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:38.426908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54c79c-d6e2-4c58-98f3-e6b68a7e100d None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:38.427184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54c79c-d6e2-4c58-98f3-e6b68a7e100d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:38.434919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54c79c-d6e2-4c58-98f3-e6b68a7e100d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:38.436443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54c79c-d6e2-4c58-98f3-e6b68a7e100d None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:38.448964 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-ba54c79c-d6e2-4c58-98f3-e6b68a7e100d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:38.448964 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:38.448964 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:38.448964 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:38.448964 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:38.448964 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:38.448964 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:38.448964 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:38.448964 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:38.448964 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:38.448964 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:38.448964 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:38.448964 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:44:38.448964 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:44:38.448964 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:44:38.449840 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:44:38.449840 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:38.449840 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:38.449840 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:38.449840 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:38.449840 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:38.449840 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:38.449840 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:38.449840 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:38.449840 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:38.449840 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:38.449840 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:38.449840 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:38.449840 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:38.449840 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:38.449840 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:38.449840 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:38.450721 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:44:38.450721 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:44:38.450721 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:44:38.450721 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:44:38.450721 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:44:38.450721 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:44:38.450721 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:38.450721 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:38.450721 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 267/524] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:38.451214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54c79c-d6e2-4c58-98f3-e6b68a7e100d None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:38.488164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1478b8-b85d-4c88-8c55-a4e76b14a735 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:38.526441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac89ae-b93e-40e5-8b70-5bf4f66ab193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:38.527097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac89ae-b93e-40e5-8b70-5bf4f66ab193 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:38.527422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac89ae-b93e-40e5-8b70-5bf4f66ab193 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:38.527706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac89ae-b93e-40e5-8b70-5bf4f66ab193 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:38.539256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac89ae-b93e-40e5-8b70-5bf4f66ab193 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:38.539606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:38.541826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac89ae-b93e-40e5-8b70-5bf4f66ab193 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:38.555160 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-43ac89ae-b93e-40e5-8b70-5bf4f66ab193 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 30 20:44:38.555160 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:38.555160 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:38.555160 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:38.555160 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:38.555160 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:38.555160 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:38.555160 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:38.555160 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:38.555160 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:38.555160 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:38.555160 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:38.555160 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:44:38.555160 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:44:38.555160 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:44:38.555160 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:44:38.556240 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:38.556240 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:38.556240 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:44:38.556240 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:38.556240 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:44:38.556240 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:38.556240 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:38.556240 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:38.556240 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:38.556240 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:38.556240 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:38.556240 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:38.556240 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:38.556240 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:38.556240 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:38.556240 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:38.556240 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:38.556240 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:38.562310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:38.562310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:38.562310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:44:38.562310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:44:38.562310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:44:38.562310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:44:38.562310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:44:38.562310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:44:38.562310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 30 20:44:38.562310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:38.562310 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 258/525] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:38.562310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac89ae-b93e-40e5-8b70-5bf4f66ab193 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:38.569263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54c79c-d6e2-4c58-98f3-e6b68a7e100d None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:38.575150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:38.608578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e570166-2719-495c-8f7a-8ac57f094000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:38.609233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e570166-2719-495c-8f7a-8ac57f094000 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:38.609518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e570166-2719-495c-8f7a-8ac57f094000 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:38.609796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e570166-2719-495c-8f7a-8ac57f094000 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:38.672620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac89ae-b93e-40e5-8b70-5bf4f66ab193 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:38.687672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e570166-2719-495c-8f7a-8ac57f094000 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:38.689245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e570166-2719-495c-8f7a-8ac57f094000 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:38.708697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf43f2-c443-452e-b024-a502f788d02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:38.709863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf43f2-c443-452e-b024-a502f788d02c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:38.710149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf43f2-c443-452e-b024-a502f788d02c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:38.710423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf43f2-c443-452e-b024-a502f788d02c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:38.711667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf43f2-c443-452e-b024-a502f788d02c None admin] RBAC: Adding query filter params (role.id=50fb737d5edf48298d0a6061ba652acb, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=08a2a5793b7a4797a470719a682e541a) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:38.712132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf43f2-c443-452e-b024-a502f788d02c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:38.713580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf43f2-c443-452e-b024-a502f788d02c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:38.731352 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 259/526] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:44:38 2022] GET /identity/v3/role_assignments?user.id=08a2a5793b7a4797a470719a682e541a&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=50fb737d5edf48298d0a6061ba652acb => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:38.731352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf43f2-c443-452e-b024-a502f788d02c None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:38.793384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:38.830208 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 268/527] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:38.831125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e570166-2719-495c-8f7a-8ac57f094000 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:38.841436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:38.868219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf43f2-c443-452e-b024-a502f788d02c None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:38.908103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245b2d5-01d1-404f-b5e0-2a6964a27b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:38.908947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245b2d5-01d1-404f-b5e0-2a6964a27b93 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:38.909243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245b2d5-01d1-404f-b5e0-2a6964a27b93 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:38.909631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245b2d5-01d1-404f-b5e0-2a6964a27b93 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:38.910399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245b2d5-01d1-404f-b5e0-2a6964a27b93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:38.910709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245b2d5-01d1-404f-b5e0-2a6964a27b93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:38.912210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245b2d5-01d1-404f-b5e0-2a6964a27b93 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:38.927107 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 260/528] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:44:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:38.928028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245b2d5-01d1-404f-b5e0-2a6964a27b93 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:38.970011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e570166-2719-495c-8f7a-8ac57f094000 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:39.019334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abf1a8-914c-4b2d-ade0-0e7fca45bd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:39.019334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abf1a8-914c-4b2d-ade0-0e7fca45bd55 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:39.019334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abf1a8-914c-4b2d-ade0-0e7fca45bd55 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:39.019334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abf1a8-914c-4b2d-ade0-0e7fca45bd55 None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:39.019748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abf1a8-914c-4b2d-ade0-0e7fca45bd55 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:39.019748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abf1a8-914c-4b2d-ade0-0e7fca45bd55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:39.019748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abf1a8-914c-4b2d-ade0-0e7fca45bd55 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:39.034770 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 269/529] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Jul 30 20:44:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:39.035848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abf1a8-914c-4b2d-ade0-0e7fca45bd55 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:39.056455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245b2d5-01d1-404f-b5e0-2a6964a27b93 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:39.076358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:39.095999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e71920-fc1d-4be4-95f7-6fc74936ca55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:39.096688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e71920-fc1d-4be4-95f7-6fc74936ca55 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:39.097029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e71920-fc1d-4be4-95f7-6fc74936ca55 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:39.097367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e71920-fc1d-4be4-95f7-6fc74936ca55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:39.105510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:39.110962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e71920-fc1d-4be4-95f7-6fc74936ca55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:39.112566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e71920-fc1d-4be4-95f7-6fc74936ca55 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:39.129853 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-39e71920-fc1d-4be4-95f7-6fc74936ca55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:39.129853 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:39.129853 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:39.129853 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:39.129853 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:39.129853 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:39.129853 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:39.129853 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:39.129853 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:39.129853 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:39.129853 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:39.129853 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:39.129853 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:39.129853 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:39.129853 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:39.130832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:39.130832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:39.130832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:39.130832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:39.130832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:39.130832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:39.130832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:39.130832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:39.130832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:39.130832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:39.130832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:39.130832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:39.130832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:39.130832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:39.130832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:39.130832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:39.130832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:39.131770 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:39.131770 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:39.131770 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:39.131770 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:39.131770 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 261/530] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:39.132294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e71920-fc1d-4be4-95f7-6fc74936ca55 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:39.165817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abf1a8-914c-4b2d-ade0-0e7fca45bd55 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:39.211205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf70c9-c698-4b6f-b00a-dc72064a5f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:39.211889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf70c9-c698-4b6f-b00a-dc72064a5f63 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:39.212176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf70c9-c698-4b6f-b00a-dc72064a5f63 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:39.212455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf70c9-c698-4b6f-b00a-dc72064a5f63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:39.213247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf70c9-c698-4b6f-b00a-dc72064a5f63 None admin] RBAC: Adding query filter params (role.id=50fb737d5edf48298d0a6061ba652acb, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=60d1fa32e98f45128f990a107db45eae) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:39.213563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf70c9-c698-4b6f-b00a-dc72064a5f63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:39.215132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf70c9-c698-4b6f-b00a-dc72064a5f63 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:39.221873 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 270/531] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:44:39 2022] GET /identity/v3/role_assignments?user.id=60d1fa32e98f45128f990a107db45eae&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=50fb737d5edf48298d0a6061ba652acb => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:39.222788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf70c9-c698-4b6f-b00a-dc72064a5f63 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:39.261279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e71920-fc1d-4be4-95f7-6fc74936ca55 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:39.307318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960768b1-c21a-4f42-bd5a-a10366a05f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:39.308355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960768b1-c21a-4f42-bd5a-a10366a05f31 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:39.308870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960768b1-c21a-4f42-bd5a-a10366a05f31 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:39.309365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960768b1-c21a-4f42-bd5a-a10366a05f31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:39.403561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960768b1-c21a-4f42-bd5a-a10366a05f31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:39.405959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960768b1-c21a-4f42-bd5a-a10366a05f31 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:39.420374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:39.471106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:39.485258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf70c9-c698-4b6f-b00a-dc72064a5f63 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:39.540984 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 262/532] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:39.542861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960768b1-c21a-4f42-bd5a-a10366a05f31 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:39.550654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef033ae0-b873-4430-9c5f-157e3a2bcf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:39.551581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef033ae0-b873-4430-9c5f-157e3a2bcf7c None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:39.552091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef033ae0-b873-4430-9c5f-157e3a2bcf7c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:39.552570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef033ae0-b873-4430-9c5f-157e3a2bcf7c None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:39.553994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef033ae0-b873-4430-9c5f-157e3a2bcf7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:39.554499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef033ae0-b873-4430-9c5f-157e3a2bcf7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:39.556110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef033ae0-b873-4430-9c5f-157e3a2bcf7c None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:39.578047 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 271/533] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:39.585835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef033ae0-b873-4430-9c5f-157e3a2bcf7c None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:39.645540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:39.658777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960768b1-c21a-4f42-bd5a-a10366a05f31 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:39.697526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f581d11-0d86-4edf-8ce9-99321a0c7d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:39.698289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f581d11-0d86-4edf-8ce9-99321a0c7d0d None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:39.698581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f581d11-0d86-4edf-8ce9-99321a0c7d0d None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:39.698855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f581d11-0d86-4edf-8ce9-99321a0c7d0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:39.710363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f581d11-0d86-4edf-8ce9-99321a0c7d0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:39.711958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f581d11-0d86-4edf-8ce9-99321a0c7d0d None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:39.728966 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-0f581d11-0d86-4edf-8ce9-99321a0c7d0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:39.728966 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:39.728966 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:39.728966 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:39.728966 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:39.728966 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:39.728966 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:39.728966 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:39.728966 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:39.728966 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:39.728966 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:39.728966 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:39.728966 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:39.728966 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:39.728966 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:39.729855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:39.729855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:39.729855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:39.729855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:39.729855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:39.729855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:39.729855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:39.729855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:39.729855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:39.729855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:39.729855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:39.729855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:39.729855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:39.729855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:39.729855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:39.729855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:39.729855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:39.730696 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:39.730696 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:39.730696 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:39.730696 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:39.734766 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 263/534] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:39.736077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f581d11-0d86-4edf-8ce9-99321a0c7d0d None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:39.749439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef033ae0-b873-4430-9c5f-157e3a2bcf7c None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:39.843806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f581d11-0d86-4edf-8ce9-99321a0c7d0d None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:39.844002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349a3c2-ee0d-4ba9-9335-91d529033c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:39.844629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349a3c2-ee0d-4ba9-9335-91d529033c78 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:39.844917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349a3c2-ee0d-4ba9-9335-91d529033c78 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:39.845195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349a3c2-ee0d-4ba9-9335-91d529033c78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:39.864004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349a3c2-ee0d-4ba9-9335-91d529033c78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:39.865551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349a3c2-ee0d-4ba9-9335-91d529033c78 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:39.880763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2cf8c-e1ca-4426-9e50-07cee0012203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:39.882072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2cf8c-e1ca-4426-9e50-07cee0012203 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:39.882360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2cf8c-e1ca-4426-9e50-07cee0012203 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:39.882636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2cf8c-e1ca-4426-9e50-07cee0012203 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:39.883355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2cf8c-e1ca-4426-9e50-07cee0012203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:39.883662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2cf8c-e1ca-4426-9e50-07cee0012203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:39.885030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2cf8c-e1ca-4426-9e50-07cee0012203 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:39.887424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-4349a3c2-ee0d-4ba9-9335-91d529033c78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:39.887424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:39.887424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:39.887424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:39.887424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:39.887424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:39.887424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:39.887424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:39.887424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:39.887424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:39.887424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:39.887424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:39.887424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:44:39.887424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:44:39.887424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:44:39.888214 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:44:39.888214 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:39.888214 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:39.888214 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:39.888214 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:39.888214 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:39.888214 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:39.888214 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:39.888214 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:39.888214 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:39.888214 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:39.888214 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:39.888214 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:39.888214 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:39.888214 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:39.888214 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:39.888214 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:39.889057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:44:39.889057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:44:39.889057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:44:39.889057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:44:39.889057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:44:39.889057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:44:39.889057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:39.889057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:39.889057 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 272/535] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:44:39.900516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349a3c2-ee0d-4ba9-9335-91d529033c78 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:39.902781 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 264/536] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:39.904023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2cf8c-e1ca-4426-9e50-07cee0012203 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:39.906808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:39.948469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:40.017174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2cf8c-e1ca-4426-9e50-07cee0012203 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:40.055944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb77ba5-39e6-4bd7-903c-943bcd742648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:40.056699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb77ba5-39e6-4bd7-903c-943bcd742648 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:40.056981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb77ba5-39e6-4bd7-903c-943bcd742648 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:40.057244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb77ba5-39e6-4bd7-903c-943bcd742648 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:40.064690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb77ba5-39e6-4bd7-903c-943bcd742648 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:40.066140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb77ba5-39e6-4bd7-903c-943bcd742648 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:40.079007 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-edb77ba5-39e6-4bd7-903c-943bcd742648 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:40.079007 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:40.079007 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:40.079007 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:40.079007 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:40.079007 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:40.079007 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:40.079007 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:40.079007 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:40.079007 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:40.079007 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:40.079007 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:40.079007 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:44:40.079007 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:44:40.079007 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:44:40.079970 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:44:40.079970 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:40.079970 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:40.079970 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:40.079970 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:40.079970 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:40.079970 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:40.079970 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:40.079970 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:40.079970 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:40.079970 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:40.079970 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:40.079970 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:40.079970 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:40.079970 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:40.079970 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:40.079970 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:40.080823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:44:40.080823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:44:40.080823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:44:40.080823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:44:40.080823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:44:40.080823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:44:40.080823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:40.080823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:40.085389 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 265/537] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:44:40.086806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb77ba5-39e6-4bd7-903c-943bcd742648 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:40.158609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:40.162726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349a3c2-ee0d-4ba9-9335-91d529033c78 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:40.203105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb77ba5-39e6-4bd7-903c-943bcd742648 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:40.239355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c970c1-80cf-4763-8b8f-834d1468c627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:40.240216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c970c1-80cf-4763-8b8f-834d1468c627 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:40.241059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c970c1-80cf-4763-8b8f-834d1468c627 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:40.241304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c970c1-80cf-4763-8b8f-834d1468c627 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:40.242059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c970c1-80cf-4763-8b8f-834d1468c627 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:40.242364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c970c1-80cf-4763-8b8f-834d1468c627 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:40.242464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd02af7-ec17-4558-9fa9-5694a47e5473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:40.243059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd02af7-ec17-4558-9fa9-5694a47e5473 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:40.243373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd02af7-ec17-4558-9fa9-5694a47e5473 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:40.243660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd02af7-ec17-4558-9fa9-5694a47e5473 None admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:40.243821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c970c1-80cf-4763-8b8f-834d1468c627 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:40.244424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd02af7-ec17-4558-9fa9-5694a47e5473 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:40.244736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd02af7-ec17-4558-9fa9-5694a47e5473 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:40.246423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd02af7-ec17-4558-9fa9-5694a47e5473 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:40.257618 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 266/538] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:44:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:40.263596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436992a-533c-4a23-a22f-bb40db43f6ad None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:40.263886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436992a-533c-4a23-a22f-bb40db43f6ad None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:40.264166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436992a-533c-4a23-a22f-bb40db43f6ad None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:40.265907 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 267/539] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:40.267079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436992a-533c-4a23-a22f-bb40db43f6ad None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:40.276333 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 273/540] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:44:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:40.277603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39fb11-a1f7-4744-95e8-945c55d0202e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:40.277899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39fb11-a1f7-4744-95e8-945c55d0202e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:40.278183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39fb11-a1f7-4744-95e8-945c55d0202e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:40.302073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4f39fb11-a1f7-4744-95e8-945c55d0202e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:40.303937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4f39fb11-a1f7-4744-95e8-945c55d0202e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:40.379087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436992a-533c-4a23-a22f-bb40db43f6ad None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:40.383563 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 274/541] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:40.384552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39fb11-a1f7-4744-95e8-945c55d0202e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:40.399834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:40.408424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:40.418750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416d254-2587-4fdb-a4ac-12e0b8f314cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:40.419485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416d254-2587-4fdb-a4ac-12e0b8f314cd None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:40.419835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416d254-2587-4fdb-a4ac-12e0b8f314cd None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:40.420259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416d254-2587-4fdb-a4ac-12e0b8f314cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:40.421180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416d254-2587-4fdb-a4ac-12e0b8f314cd None admin] RBAC: Adding query filter params (role.id=50fb737d5edf48298d0a6061ba652acb, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=1656aa416bc146f486e71517e476773a) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:40.421548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416d254-2587-4fdb-a4ac-12e0b8f314cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:40.423096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416d254-2587-4fdb-a4ac-12e0b8f314cd None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:40.434187 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 268/542] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:44:40 2022] GET /identity/v3/role_assignments?user.id=1656aa416bc146f486e71517e476773a&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=50fb737d5edf48298d0a6061ba652acb => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:40.438190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416d254-2587-4fdb-a4ac-12e0b8f314cd None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:40.520627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39fb11-a1f7-4744-95e8-945c55d0202e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:40.568772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67602786-cba0-4f48-83a8-083e81f43dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:40.569338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67602786-cba0-4f48-83a8-083e81f43dc6 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:40.569625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67602786-cba0-4f48-83a8-083e81f43dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:40.569905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67602786-cba0-4f48-83a8-083e81f43dc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:40.570725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67602786-cba0-4f48-83a8-083e81f43dc6 None admin] RBAC: Adding query filter params (role.id=50fb737d5edf48298d0a6061ba652acb, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=4a886ccf9590432caf209526410a7b53) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:40.571041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67602786-cba0-4f48-83a8-083e81f43dc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:40.576109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67602786-cba0-4f48-83a8-083e81f43dc6 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:40.589270 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 275/543] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:44:40 2022] GET /identity/v3/role_assignments?user.id=4a886ccf9590432caf209526410a7b53&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=50fb737d5edf48298d0a6061ba652acb => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:40.621545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416d254-2587-4fdb-a4ac-12e0b8f314cd None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:40.681292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af88769-d577-4b59-acb9-1908db0261c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:40.681972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af88769-d577-4b59-acb9-1908db0261c0 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:40.682258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af88769-d577-4b59-acb9-1908db0261c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:40.682540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af88769-d577-4b59-acb9-1908db0261c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:40.698988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af88769-d577-4b59-acb9-1908db0261c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:40.704760 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-1af88769-d577-4b59-acb9-1908db0261c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:40.704760 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:40.704760 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:40.704760 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:40.704760 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:40.704760 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:40.704760 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:40.704760 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:40.704760 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:40.704760 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:40.704760 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:40.704760 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:40.704760 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:40.704760 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:40.704760 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:40.704760 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:40.706950 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:40.706950 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:40.706950 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:40.706950 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:40.706950 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:40.706950 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:40.706950 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:40.706950 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:40.706950 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:40.706950 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:40.706950 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:40.706950 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:40.706950 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:40.706950 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:40.706950 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:40.706950 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:40.708909 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:40.708909 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:40.708909 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:40.708909 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:40.708909 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:40.708909 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:40.708909 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:40.708909 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:40.708909 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:40.708909 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:40.708909 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:40.708909 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:40.708909 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 269/544] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:44:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:40.712417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67602786-cba0-4f48-83a8-083e81f43dc6 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:40.796561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:40.831105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67602786-cba0-4f48-83a8-083e81f43dc6 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:40.868601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e047e-8f87-4361-981f-a876a651cd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:40.869226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e047e-8f87-4361-981f-a876a651cd9a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:40.869510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e047e-8f87-4361-981f-a876a651cd9a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:40.869786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e047e-8f87-4361-981f-a876a651cd9a None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:40.870507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e047e-8f87-4361-981f-a876a651cd9a None admin] RBAC: Adding query filter params (name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:40.871068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e047e-8f87-4361-981f-a876a651cd9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:40.872672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e047e-8f87-4361-981f-a876a651cd9a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:40.882290 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 276/545] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:44:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:40.888681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af88769-d577-4b59-acb9-1908db0261c0 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:40.942130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:41.002260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af88769-d577-4b59-acb9-1908db0261c0 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:41.046038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab82e1d-720c-45b7-976d-f7e4f3371546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:41.046747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab82e1d-720c-45b7-976d-f7e4f3371546 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:41.046980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab82e1d-720c-45b7-976d-f7e4f3371546 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:41.047261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab82e1d-720c-45b7-976d-f7e4f3371546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:41.058685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab82e1d-720c-45b7-976d-f7e4f3371546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:41.060182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab82e1d-720c-45b7-976d-f7e4f3371546 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:41.075213 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-6ab82e1d-720c-45b7-976d-f7e4f3371546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:41.075213 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:41.075213 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:41.075213 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:41.075213 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:41.075213 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:41.075213 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:41.075213 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:41.075213 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:41.075213 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:41.075213 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:41.075213 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:41.075213 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:41.075213 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:41.075213 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:41.076097 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:41.076097 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:41.076097 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:41.076097 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:41.076097 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:41.076097 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:41.076097 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:41.076097 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:41.076097 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:41.076097 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:41.076097 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:41.076097 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:41.076097 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:41.076097 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:41.076097 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:41.076097 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:41.076097 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:41.076982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:41.076982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:41.076982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:41.076982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:41.076982 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 270/546] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:41.082391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e047e-8f87-4361-981f-a876a651cd9a None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:41.189970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e047e-8f87-4361-981f-a876a651cd9a None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:41.230106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2030f4a-ce92-455c-a1d7-db510672bac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:41.230827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2030f4a-ce92-455c-a1d7-db510672bac6 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:41.231123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2030f4a-ce92-455c-a1d7-db510672bac6 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:41.231436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2030f4a-ce92-455c-a1d7-db510672bac6 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:41.232153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2030f4a-ce92-455c-a1d7-db510672bac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:41.232462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2030f4a-ce92-455c-a1d7-db510672bac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:41.233922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2030f4a-ce92-455c-a1d7-db510672bac6 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:41.235728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:41.249023 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 277/547] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:41.254475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab82e1d-720c-45b7-976d-f7e4f3371546 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:41.378227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:41.385433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab82e1d-720c-45b7-976d-f7e4f3371546 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:41.426965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c485b-19db-40d7-8991-803abeb0cdee None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:41.427348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c485b-19db-40d7-8991-803abeb0cdee None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:41.427574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c485b-19db-40d7-8991-803abeb0cdee None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:41.429184 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 278/548] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:41.434348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ee841-007c-4c27-a646-5372adcb1195 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:41.434641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ee841-007c-4c27-a646-5372adcb1195 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:41.434925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ee841-007c-4c27-a646-5372adcb1195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:41.448801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736d745-7ada-4aa2-a797-88eb180f2aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:41.449453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736d745-7ada-4aa2-a797-88eb180f2aae None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:41.449736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736d745-7ada-4aa2-a797-88eb180f2aae None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:41.450012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736d745-7ada-4aa2-a797-88eb180f2aae None admin] PATH_INFO: `/v3/users/swift` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:41.457797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736d745-7ada-4aa2-a797-88eb180f2aae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:41.459931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736d745-7ada-4aa2-a797-88eb180f2aae None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:41.471185 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-0736d745-7ada-4aa2-a797-88eb180f2aae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 30 20:44:41.471185 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:41.471185 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:41.471185 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:41.471185 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:41.471185 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:41.471185 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:41.471185 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:41.471185 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:41.471185 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:41.471185 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:41.471185 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:41.471185 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:44:41.471185 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:44:41.471185 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:44:41.471185 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:44:41.472579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:41.472579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:41.472579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:44:41.472579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:41.472579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:44:41.472579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:41.472579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:41.472579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:41.472579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:41.472579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:41.472579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:41.472579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:41.472579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:41.472579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:41.472579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:41.472579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:41.472579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:41.472579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:41.473642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:41.473642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:41.473642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:44:41.473642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:44:41.473642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:44:41.473642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:44:41.473642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:44:41.473642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:44:41.473642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 30 20:44:41.473642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:41.473642 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 271/549] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:44:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:41.478118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736d745-7ada-4aa2-a797-88eb180f2aae None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:41.478255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-219ee841-007c-4c27-a646-5372adcb1195 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:41.479494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-219ee841-007c-4c27-a646-5372adcb1195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:41.617737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736d745-7ada-4aa2-a797-88eb180f2aae None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:41.638464 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 279/550] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:44:41.681062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f468fa8-a493-4b86-b96a-224a99500b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:41.681793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f468fa8-a493-4b86-b96a-224a99500b86 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:41.682084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f468fa8-a493-4b86-b96a-224a99500b86 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:41.682535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f468fa8-a493-4b86-b96a-224a99500b86 None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:41.683510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f468fa8-a493-4b86-b96a-224a99500b86 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:41.683909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f468fa8-a493-4b86-b96a-224a99500b86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:41.686164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f468fa8-a493-4b86-b96a-224a99500b86 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:41.691882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ee841-007c-4c27-a646-5372adcb1195 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:41.725715 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 272/551] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Jul 30 20:44:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:41.732061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f468fa8-a493-4b86-b96a-224a99500b86 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:41.766456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:41.881972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ee841-007c-4c27-a646-5372adcb1195 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:41.908413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:41.921460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1781df3-3db5-45d6-ba9f-6be54f49f29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:41.922142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1781df3-3db5-45d6-ba9f-6be54f49f29a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:41.922427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1781df3-3db5-45d6-ba9f-6be54f49f29a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:41.922703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1781df3-3db5-45d6-ba9f-6be54f49f29a None admin] PATH_INFO: `/v3/roles/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:41.938685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1781df3-3db5-45d6-ba9f-6be54f49f29a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:41.944322 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-c1781df3-3db5-45d6-ba9f-6be54f49f29a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:41.944322 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:41.944322 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:41.944322 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:41.944322 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:41.944322 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:41.944322 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:41.944322 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:41.944322 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:41.944322 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:41.944322 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:41.944322 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:41.944322 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:41.944322 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:41.944322 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:41.944322 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:41.945298 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:41.945298 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:41.945298 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:41.945298 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:41.945298 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:41.945298 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:41.945298 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:41.945298 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:41.945298 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:41.945298 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:41.945298 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:41.945298 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:41.945298 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:41.945298 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:41.945298 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:41.945298 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:41.946244 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:41.946244 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:41.946244 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:41.946244 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:41.946244 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:41.946244 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:41.946244 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:41.946244 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:41.946244 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:41.946244 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:41.946244 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:41.946244 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:41.946244 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 280/552] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:44:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:44:41.947965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f468fa8-a493-4b86-b96a-224a99500b86 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:41.955956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1781df3-3db5-45d6-ba9f-6be54f49f29a None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:42.001784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1bb513-3f0e-43ac-9888-39a8798ce3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:42.002477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bb513-3f0e-43ac-9888-39a8798ce3dc None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:42.002877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bb513-3f0e-43ac-9888-39a8798ce3dc None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:42.003232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bb513-3f0e-43ac-9888-39a8798ce3dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:42.089674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1bb513-3f0e-43ac-9888-39a8798ce3dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:42.092056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1bb513-3f0e-43ac-9888-39a8798ce3dc None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:42.102166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1781df3-3db5-45d6-ba9f-6be54f49f29a None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:42.114628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:42.154824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96236669-246f-45c5-a091-f0c257644806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:42.155623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96236669-246f-45c5-a091-f0c257644806 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:42.155965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96236669-246f-45c5-a091-f0c257644806 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:42.156667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96236669-246f-45c5-a091-f0c257644806 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:42.157717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96236669-246f-45c5-a091-f0c257644806 None admin] RBAC: Adding query filter params (name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:42.158028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96236669-246f-45c5-a091-f0c257644806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:42.159929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96236669-246f-45c5-a091-f0c257644806 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:42.171436 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 281/553] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:44:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:42.172992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70d6e2-368e-4519-914b-4b7946adfbf7 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:42.173286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70d6e2-368e-4519-914b-4b7946adfbf7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:42.173829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70d6e2-368e-4519-914b-4b7946adfbf7 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:42.175357 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 282/554] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:42.176503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70d6e2-368e-4519-914b-4b7946adfbf7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:42.225805 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 273/555] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:42.227440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51bb92-1dd6-4cbd-8bd9-aee3e226aa4d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:42.227834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51bb92-1dd6-4cbd-8bd9-aee3e226aa4d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:42.228235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51bb92-1dd6-4cbd-8bd9-aee3e226aa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:42.242771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:42.247759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8d51bb92-1dd6-4cbd-8bd9-aee3e226aa4d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:42.249482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8d51bb92-1dd6-4cbd-8bd9-aee3e226aa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:42.314552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70d6e2-368e-4519-914b-4b7946adfbf7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:42.345398 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 274/556] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:42.347080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51bb92-1dd6-4cbd-8bd9-aee3e226aa4d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:42.352025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4eb051-23ed-4150-a43c-e2bcb9eb422b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:42.352359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4eb051-23ed-4150-a43c-e2bcb9eb422b None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:42.352815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4eb051-23ed-4150-a43c-e2bcb9eb422b None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:42.353192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4eb051-23ed-4150-a43c-e2bcb9eb422b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:42.364765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4eb051-23ed-4150-a43c-e2bcb9eb422b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:42.367085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4eb051-23ed-4150-a43c-e2bcb9eb422b None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:42.382993 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-bf4eb051-23ed-4150-a43c-e2bcb9eb422b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:42.382993 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:42.382993 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:42.382993 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:42.382993 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:42.382993 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:42.382993 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:42.382993 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:42.382993 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:42.382993 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:42.382993 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:42.382993 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:42.382993 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:42.382993 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:42.382993 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:42.384102 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:42.384102 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:42.384102 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:42.384102 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:42.384102 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:42.384102 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:42.384102 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:42.384102 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:42.384102 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:42.384102 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:42.384102 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:42.384102 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:42.384102 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:42.384102 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:42.384102 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:42.384102 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:42.384102 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:42.385025 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:42.385025 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:42.385025 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:42.385025 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:42.386063 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 283/557] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:42.387272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4eb051-23ed-4150-a43c-e2bcb9eb422b None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:42.408817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:42.487502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51bb92-1dd6-4cbd-8bd9-aee3e226aa4d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:42.495917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:42.500529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4eb051-23ed-4150-a43c-e2bcb9eb422b None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:42.533730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d30371-3c14-44b7-9226-c149a78d8630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:42.534500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d30371-3c14-44b7-9226-c149a78d8630 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:42.534953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d30371-3c14-44b7-9226-c149a78d8630 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:42.535360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d30371-3c14-44b7-9226-c149a78d8630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:42.542769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ce41f-566a-4a15-a8aa-7c5d9f9de2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:42.543619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce41f-566a-4a15-a8aa-7c5d9f9de2c6 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:42.544063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce41f-566a-4a15-a8aa-7c5d9f9de2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:42.544978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce41f-566a-4a15-a8aa-7c5d9f9de2c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:42.546487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d30371-3c14-44b7-9226-c149a78d8630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:42.548148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d30371-3c14-44b7-9226-c149a78d8630 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:42.561770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ce41f-566a-4a15-a8aa-7c5d9f9de2c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:42.565202 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-56d30371-3c14-44b7-9226-c149a78d8630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:42.565202 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:42.565202 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:42.565202 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:42.565202 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:42.565202 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:42.565202 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:42.565202 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:42.565202 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:42.565202 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:42.565202 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:42.565202 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:42.565202 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:42.565202 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:42.565202 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:42.567602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:42.567602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:42.567602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:42.567602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:42.567602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:42.567602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:42.567602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:42.567602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:42.567602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:42.567602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:42.567602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:42.567602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:42.567602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:42.567602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:42.567602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:42.567602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:42.567602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:42.570181 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:42.570181 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:42.570181 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:42.570181 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:42.570181 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 275/558] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:42.570816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d30371-3c14-44b7-9226-c149a78d8630 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:42.577826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-490ce41f-566a-4a15-a8aa-7c5d9f9de2c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:42.577826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:42.577826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:42.577826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:42.577826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:42.577826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:42.577826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:42.577826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:42.577826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:42.577826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:42.577826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:42.577826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:42.577826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:42.577826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:42.577826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:42.577826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:42.578930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:42.578930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:42.578930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:42.578930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:42.578930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:42.578930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:42.578930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:42.578930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:42.578930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:42.578930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:42.578930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:42.578930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:42.578930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:42.578930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:42.578930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:42.578930 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:42.580199 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:42.580199 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:42.580199 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:42.580199 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:42.580199 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:42.580199 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:42.580199 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:42.580199 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:42.580199 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:42.580199 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:42.580199 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:42.580199 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:42.584470 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 284/559] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:44:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:42.585486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ce41f-566a-4a15-a8aa-7c5d9f9de2c6 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:42.707558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:42.713335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d30371-3c14-44b7-9226-c149a78d8630 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:42.718093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ce41f-566a-4a15-a8aa-7c5d9f9de2c6 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:42.757050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d90000-1ba3-476d-85c9-a88cebb496b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:42.758424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d90000-1ba3-476d-85c9-a88cebb496b8 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:42.758861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d90000-1ba3-476d-85c9-a88cebb496b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:42.759010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629d15f-b82f-490c-a74b-63a6a9ed97ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:42.759458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d90000-1ba3-476d-85c9-a88cebb496b8 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:42.759897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629d15f-b82f-490c-a74b-63a6a9ed97ab None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:42.760281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629d15f-b82f-490c-a74b-63a6a9ed97ab None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:42.760628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d90000-1ba3-476d-85c9-a88cebb496b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:42.760755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629d15f-b82f-490c-a74b-63a6a9ed97ab None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:42.761186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d90000-1ba3-476d-85c9-a88cebb496b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:42.761667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629d15f-b82f-490c-a74b-63a6a9ed97ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:42.762070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629d15f-b82f-490c-a74b-63a6a9ed97ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:42.763051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d90000-1ba3-476d-85c9-a88cebb496b8 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:42.763739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629d15f-b82f-490c-a74b-63a6a9ed97ab None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:42.778272 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 285/561] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:42.778510 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 276/561] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:42.779395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629d15f-b82f-490c-a74b-63a6a9ed97ab None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:42.786233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d90000-1ba3-476d-85c9-a88cebb496b8 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:42.801819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:42.906135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629d15f-b82f-490c-a74b-63a6a9ed97ab None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:42.919802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d90000-1ba3-476d-85c9-a88cebb496b8 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:42.957145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27e707-8d37-4032-a8b9-faeea9f4ffc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:42.958330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27e707-8d37-4032-a8b9-faeea9f4ffc4 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:42.958822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27e707-8d37-4032-a8b9-faeea9f4ffc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:42.959587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27e707-8d37-4032-a8b9-faeea9f4ffc4 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:42.961197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27e707-8d37-4032-a8b9-faeea9f4ffc4 None admin] RBAC: Adding query filter params (name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:42.961831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27e707-8d37-4032-a8b9-faeea9f4ffc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:42.963767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27e707-8d37-4032-a8b9-faeea9f4ffc4 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:42.965212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9da5b-b98c-4449-b386-6d8182426df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:42.965947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9da5b-b98c-4449-b386-6d8182426df4 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:42.966310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9da5b-b98c-4449-b386-6d8182426df4 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:42.966679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9da5b-b98c-4449-b386-6d8182426df4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:42.975112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9da5b-b98c-4449-b386-6d8182426df4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:42.976372 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 286/562] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:44:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:42.976944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9da5b-b98c-4449-b386-6d8182426df4 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:42.977997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27e707-8d37-4032-a8b9-faeea9f4ffc4 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:42.991806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-3ca9da5b-b98c-4449-b386-6d8182426df4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:42.991806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:42.991806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:42.991806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:42.991806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:42.991806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:42.991806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:42.991806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:42.991806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:42.991806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:42.991806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:42.991806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:42.991806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:44:42.991806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:44:42.991806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:44:42.992762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:44:42.992762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:42.992762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:42.992762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:42.992762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:42.992762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:42.992762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:42.992762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:42.992762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:42.992762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:42.992762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:42.992762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:42.992762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:42.992762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:42.992762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:42.992762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:42.992762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:42.993646 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:44:42.993646 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:44:42.993646 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:44:42.993646 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:44:42.993646 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:44:42.993646 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:44:42.993646 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:42.993646 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:42.993646 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 277/563] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:42.994126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9da5b-b98c-4449-b386-6d8182426df4 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:43.021654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:43.088590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:43.111375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27e707-8d37-4032-a8b9-faeea9f4ffc4 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:43.134224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9da5b-b98c-4449-b386-6d8182426df4 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:43.148820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c796e-929b-4e0d-ac72-ed8897283a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:43.149816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c796e-929b-4e0d-ac72-ed8897283a9e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:43.150308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c796e-929b-4e0d-ac72-ed8897283a9e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:43.150786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c796e-929b-4e0d-ac72-ed8897283a9e None admin] PATH_INFO: `/v3/users/nova` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:43.159135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c796e-929b-4e0d-ac72-ed8897283a9e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:43.160930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c796e-929b-4e0d-ac72-ed8897283a9e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:43.171587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f48553-257b-4c06-9ed7-4e6a70782997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:43.172245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f48553-257b-4c06-9ed7-4e6a70782997 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:43.172528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f48553-257b-4c06-9ed7-4e6a70782997 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:43.172805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f48553-257b-4c06-9ed7-4e6a70782997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:43.175121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-bf1c796e-929b-4e0d-ac72-ed8897283a9e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 30 20:44:43.175121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:43.175121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:43.175121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:43.175121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:43.175121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:43.175121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:43.175121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:43.175121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:43.175121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:43.175121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:43.175121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:43.175121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:44:43.175121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:44:43.175121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:44:43.175121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:44:43.176118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:43.176118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:43.176118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:44:43.176118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:43.176118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:44:43.176118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:43.176118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:43.176118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:43.176118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:43.176118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:43.176118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:43.176118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:43.176118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:43.176118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:43.176118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:43.176118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:43.176118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:43.176118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:43.177055 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:43.177055 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:43.177055 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:44:43.177055 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:44:43.177055 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:44:43.177055 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:44:43.177055 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:44:43.177055 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:44:43.177055 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 30 20:44:43.177055 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:43.177055 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 287/564] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Jul 30 20:44:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:43.177744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c796e-929b-4e0d-ac72-ed8897283a9e None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:43.183847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f48553-257b-4c06-9ed7-4e6a70782997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:43.185301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f48553-257b-4c06-9ed7-4e6a70782997 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:43.200602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-59f48553-257b-4c06-9ed7-4e6a70782997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:43.200602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:43.200602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:43.200602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:43.200602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:43.200602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:43.200602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:43.200602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:43.200602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:43.200602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:43.200602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:43.200602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:43.200602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:43.200602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:43.200602 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:43.201606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:43.201606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:43.201606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:43.201606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:43.201606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:43.201606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:43.201606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:43.201606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:43.201606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:43.201606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:43.201606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:43.201606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:43.201606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:43.201606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:43.201606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:43.201606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:43.201606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:43.202536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:43.202536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:43.202536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:43.202536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:43.202536 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 278/565] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:43.203977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b96b05-7df0-4a6a-a703-4ca4f017bda9 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:43.203977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b96b05-7df0-4a6a-a703-4ca4f017bda9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:43.203977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b96b05-7df0-4a6a-a703-4ca4f017bda9 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:43.205347 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 279/566] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:43.210529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b96b05-7df0-4a6a-a703-4ca4f017bda9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:43.290317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:43.303753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c796e-929b-4e0d-ac72-ed8897283a9e None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:43.327031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b96b05-7df0-4a6a-a703-4ca4f017bda9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:43.337644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645f0a6-87de-4fe9-9a8b-d97738c9bd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:43.338338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645f0a6-87de-4fe9-9a8b-d97738c9bd60 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:43.338625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645f0a6-87de-4fe9-9a8b-d97738c9bd60 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:43.338898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645f0a6-87de-4fe9-9a8b-d97738c9bd60 None admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:43.339672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645f0a6-87de-4fe9-9a8b-d97738c9bd60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:43.339979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645f0a6-87de-4fe9-9a8b-d97738c9bd60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:43.341407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645f0a6-87de-4fe9-9a8b-d97738c9bd60 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:43.350383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:43.355270 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 288/567] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:44:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:43.356167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645f0a6-87de-4fe9-9a8b-d97738c9bd60 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:43.369482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e23e6-5c64-4e60-aaa3-e3975e4e4989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:43.370113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e23e6-5c64-4e60-aaa3-e3975e4e4989 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:43.370404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e23e6-5c64-4e60-aaa3-e3975e4e4989 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:43.370939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e23e6-5c64-4e60-aaa3-e3975e4e4989 None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:43.371781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e23e6-5c64-4e60-aaa3-e3975e4e4989 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:43.372090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e23e6-5c64-4e60-aaa3-e3975e4e4989 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:43.373520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e23e6-5c64-4e60-aaa3-e3975e4e4989 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:43.391623 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 280/568] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Jul 30 20:44:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:43.392819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76faa4-be8b-4e6a-9e8d-7dd6fa9ce9a2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:43.393107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76faa4-be8b-4e6a-9e8d-7dd6fa9ce9a2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:43.393380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76faa4-be8b-4e6a-9e8d-7dd6fa9ce9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:43.410975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-db76faa4-be8b-4e6a-9e8d-7dd6fa9ce9a2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:43.412276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-db76faa4-be8b-4e6a-9e8d-7dd6fa9ce9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:43.456578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645f0a6-87de-4fe9-9a8b-d97738c9bd60 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:43.478060 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 281/569] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:43.478874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76faa4-be8b-4e6a-9e8d-7dd6fa9ce9a2 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:43.490994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98b062-4435-4201-a616-a341f7c014ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:43.491658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98b062-4435-4201-a616-a341f7c014ba None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:43.491945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98b062-4435-4201-a616-a341f7c014ba None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:43.492225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98b062-4435-4201-a616-a341f7c014ba None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:43.493040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98b062-4435-4201-a616-a341f7c014ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:43.493458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98b062-4435-4201-a616-a341f7c014ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:43.494843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98b062-4435-4201-a616-a341f7c014ba None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:43.507800 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 289/570] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:43.509009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2842b-73af-42fb-ae67-69fae7a773a8 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:43.509306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2842b-73af-42fb-ae67-69fae7a773a8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:43.509585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2842b-73af-42fb-ae67-69fae7a773a8 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:43.514902 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 290/571] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:43.514902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2842b-73af-42fb-ae67-69fae7a773a8 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:43.538183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:43.572789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:43.579045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76faa4-be8b-4e6a-9e8d-7dd6fa9ce9a2 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:43.612246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984e246-2358-49a8-bbbe-e371f85dbcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:43.612858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984e246-2358-49a8-bbbe-e371f85dbcd9 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:43.613137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984e246-2358-49a8-bbbe-e371f85dbcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:43.613415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984e246-2358-49a8-bbbe-e371f85dbcd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:43.613794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2842b-73af-42fb-ae67-69fae7a773a8 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:43.614190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984e246-2358-49a8-bbbe-e371f85dbcd9 None admin] RBAC: Adding query filter params (role.id=50fb737d5edf48298d0a6061ba652acb, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=2181960e3bed4031889d6e72a721e151) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:43.614497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984e246-2358-49a8-bbbe-e371f85dbcd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:43.616550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984e246-2358-49a8-bbbe-e371f85dbcd9 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:43.623048 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 282/572] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:44:43 2022] GET /identity/v3/role_assignments?user.id=2181960e3bed4031889d6e72a721e151&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=50fb737d5edf48298d0a6061ba652acb => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:43.623873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984e246-2358-49a8-bbbe-e371f85dbcd9 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:43.658232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd240602-dd72-4a61-920b-2559353ee87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:43.659167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd240602-dd72-4a61-920b-2559353ee87f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:43.659804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd240602-dd72-4a61-920b-2559353ee87f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:43.660251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd240602-dd72-4a61-920b-2559353ee87f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:43.676966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd240602-dd72-4a61-920b-2559353ee87f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:43.680236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd240602-dd72-4a61-920b-2559353ee87f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:43.697705 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-fd240602-dd72-4a61-920b-2559353ee87f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:43.697705 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:43.697705 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:43.697705 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:43.697705 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:43.697705 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:43.697705 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:43.697705 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:43.697705 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:43.697705 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:43.697705 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:43.697705 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:43.697705 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:43.697705 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:43.697705 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:43.698704 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:43.698704 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:43.698704 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:43.698704 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:43.698704 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:43.698704 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:43.698704 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:43.698704 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:43.698704 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:43.698704 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:43.698704 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:43.698704 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:43.698704 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:43.698704 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:43.698704 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:43.698704 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:43.698704 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:43.699766 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:43.699766 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:43.699766 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:43.699766 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:43.699766 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 291/573] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:43.699766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd240602-dd72-4a61-920b-2559353ee87f None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:43.746947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984e246-2358-49a8-bbbe-e371f85dbcd9 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:43.773909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:43.785550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a7c9f-684d-4d97-9209-4eaac1e2162c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:43.786214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a7c9f-684d-4d97-9209-4eaac1e2162c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:43.786498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a7c9f-684d-4d97-9209-4eaac1e2162c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:43.786771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a7c9f-684d-4d97-9209-4eaac1e2162c None admin] PATH_INFO: `/v3/roles/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:43.799097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a7c9f-684d-4d97-9209-4eaac1e2162c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:43.805078 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-421a7c9f-684d-4d97-9209-4eaac1e2162c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:43.805078 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:43.805078 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:43.805078 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:43.805078 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:43.805078 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:43.805078 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:43.805078 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:43.805078 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:43.805078 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:43.805078 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:43.805078 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:43.805078 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:43.805078 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:43.805078 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:43.805078 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:43.806036 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:43.806036 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:43.806036 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:43.806036 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:43.806036 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:43.806036 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:43.806036 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:43.806036 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:43.806036 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:43.806036 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:43.806036 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:43.806036 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:43.806036 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:43.806036 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:43.806036 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:43.806036 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:43.806892 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:43.806892 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:43.806892 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:43.806892 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:43.806892 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:43.806892 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:43.806892 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:43.806892 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:43.806892 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:43.806892 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:43.806892 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:43.806892 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:43.806892 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 283/574] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:44:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:43.807660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9d007-78ba-4488-aa0a-987d135c3430 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:43.808846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9d007-78ba-4488-aa0a-987d135c3430 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:43.808846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9d007-78ba-4488-aa0a-987d135c3430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:43.821274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd240602-dd72-4a61-920b-2559353ee87f None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:43.827264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1be9d007-78ba-4488-aa0a-987d135c3430 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:43.828434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1be9d007-78ba-4488-aa0a-987d135c3430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:43.835519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:43.861544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7157405-d42a-4cae-8996-e28e5857a855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:43.862367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7157405-d42a-4cae-8996-e28e5857a855 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:43.862503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7157405-d42a-4cae-8996-e28e5857a855 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:43.862728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7157405-d42a-4cae-8996-e28e5857a855 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:43.871904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7157405-d42a-4cae-8996-e28e5857a855 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:43.873814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7157405-d42a-4cae-8996-e28e5857a855 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:43.886510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-c7157405-d42a-4cae-8996-e28e5857a855 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 30 20:44:43.886510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:43.886510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:43.886510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:43.886510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:43.886510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:43.886510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:43.886510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:43.886510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:43.886510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:43.886510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:43.886510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:43.886510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:44:43.886510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:44:43.886510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:44:43.886510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:44:43.887543 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:43.887543 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:43.887543 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:44:43.887543 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:43.887543 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:44:43.887543 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:43.887543 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:43.887543 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:43.887543 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:43.887543 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:43.887543 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:43.887543 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:43.887543 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:43.887543 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:43.887543 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:43.887543 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:43.887543 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:43.887543 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:43.888521 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:43.888521 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:43.888521 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:44:43.888521 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:44:43.888521 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:44:43.888521 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:44:43.888521 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:44:43.888521 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:44:43.888521 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 30 20:44:43.888521 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:43.888521 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 292/575] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:43.888521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7157405-d42a-4cae-8996-e28e5857a855 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:43.903835 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 284/576] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:43.904678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9d007-78ba-4488-aa0a-987d135c3430 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:44.000548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7157405-d42a-4cae-8996-e28e5857a855 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:44.027806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9d007-78ba-4488-aa0a-987d135c3430 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:44.041639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:44.047965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf36360-27e3-4fa9-95b2-86dc740c0547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:44.048592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf36360-27e3-4fa9-95b2-86dc740c0547 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:44.048874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf36360-27e3-4fa9-95b2-86dc740c0547 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:44.049147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf36360-27e3-4fa9-95b2-86dc740c0547 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:44.049837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf36360-27e3-4fa9-95b2-86dc740c0547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:44.050141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf36360-27e3-4fa9-95b2-86dc740c0547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:44.051595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf36360-27e3-4fa9-95b2-86dc740c0547 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:44.064506 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 293/577] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:44.065324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf36360-27e3-4fa9-95b2-86dc740c0547 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:44.071449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335732fa-8739-4add-83e4-364989b7f259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:44.072141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335732fa-8739-4add-83e4-364989b7f259 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:44.072426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335732fa-8739-4add-83e4-364989b7f259 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:44.072749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335732fa-8739-4add-83e4-364989b7f259 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:44.073529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335732fa-8739-4add-83e4-364989b7f259 None admin] RBAC: Adding query filter params (name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:44.073836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335732fa-8739-4add-83e4-364989b7f259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:44.075238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335732fa-8739-4add-83e4-364989b7f259 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:44.089473 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 285/578] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:44:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:44.089473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335732fa-8739-4add-83e4-364989b7f259 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:44.103579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:44.180646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf36360-27e3-4fa9-95b2-86dc740c0547 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:44.198167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335732fa-8739-4add-83e4-364989b7f259 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:44.217509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25f0d3-741c-4f66-a3fb-3a41e0d19390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:44.218235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25f0d3-741c-4f66-a3fb-3a41e0d19390 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:44.218520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25f0d3-741c-4f66-a3fb-3a41e0d19390 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:44.218794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25f0d3-741c-4f66-a3fb-3a41e0d19390 None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:44.219615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25f0d3-741c-4f66-a3fb-3a41e0d19390 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:44.219922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25f0d3-741c-4f66-a3fb-3a41e0d19390 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:44.221565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25f0d3-741c-4f66-a3fb-3a41e0d19390 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:44.237894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaac659-47f4-40fc-b611-912ddc361226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:44.238549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaac659-47f4-40fc-b611-912ddc361226 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:44.239339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaac659-47f4-40fc-b611-912ddc361226 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:44.239635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaac659-47f4-40fc-b611-912ddc361226 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:44.243079 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 294/579] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Jul 30 20:44:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:44.247846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25f0d3-741c-4f66-a3fb-3a41e0d19390 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:44.253984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaac659-47f4-40fc-b611-912ddc361226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:44.260094 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-0eaac659-47f4-40fc-b611-912ddc361226 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:44.260094 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:44.260094 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:44.260094 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:44.260094 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:44.260094 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:44.260094 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:44.260094 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:44.260094 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:44.260094 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:44.260094 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:44.260094 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:44.260094 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:44.260094 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:44.260094 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:44.260094 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:44.261020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:44.261020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:44.261020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:44.261020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:44.261020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:44.261020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:44.261020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:44.261020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:44.261020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:44.261020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:44.261020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:44.261020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:44.261020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:44.261020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:44.261020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:44.261020 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:44.261841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:44.261841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:44.261841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:44.261841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:44.261841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:44.261841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:44.261841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:44.261841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:44.261841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:44.261841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:44.261841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:44.261841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:44.261841 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 286/580] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:44:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:44.262978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaac659-47f4-40fc-b611-912ddc361226 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:44.306450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:44.351559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:44.362459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25f0d3-741c-4f66-a3fb-3a41e0d19390 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:44.380572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaac659-47f4-40fc-b611-912ddc361226 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:44.399660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2631b-f2c8-4b95-8796-cb661ed8de1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:44.400304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2631b-f2c8-4b95-8796-cb661ed8de1f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:44.400583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2631b-f2c8-4b95-8796-cb661ed8de1f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:44.400861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2631b-f2c8-4b95-8796-cb661ed8de1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:44.407501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2631b-f2c8-4b95-8796-cb661ed8de1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:44.408936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2631b-f2c8-4b95-8796-cb661ed8de1f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:44.416186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb75329-7943-4295-b2cf-50a8cd085e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:44.416831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb75329-7943-4295-b2cf-50a8cd085e90 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:44.417115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb75329-7943-4295-b2cf-50a8cd085e90 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:44.417393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb75329-7943-4295-b2cf-50a8cd085e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:44.420710 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-7ea2631b-f2c8-4b95-8796-cb661ed8de1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:44.420710 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:44.420710 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:44.420710 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:44.420710 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:44.420710 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:44.420710 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:44.420710 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:44.420710 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:44.420710 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:44.420710 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:44.420710 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:44.420710 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:44:44.420710 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:44:44.420710 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:44:44.421569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:44:44.421569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:44.421569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:44.421569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:44.421569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:44.421569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:44.421569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:44.421569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:44.421569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:44.421569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:44.421569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:44.421569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:44.421569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:44.421569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:44.421569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:44.421569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:44.421569 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:44.427681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:44:44.427681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:44:44.427681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:44:44.427681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:44:44.427681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:44:44.427681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:44:44.427681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:44.427681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:44.427681 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 295/581] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:44.427681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2631b-f2c8-4b95-8796-cb661ed8de1f None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:44.433074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb75329-7943-4295-b2cf-50a8cd085e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:44.434644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb75329-7943-4295-b2cf-50a8cd085e90 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:44.449489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-cdb75329-7943-4295-b2cf-50a8cd085e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:44.449489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:44.449489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:44.449489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:44.449489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:44.449489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:44.449489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:44.449489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:44.449489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:44.449489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:44.449489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:44.449489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:44.449489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:44.449489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:44.449489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:44.450547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:44.450547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:44.450547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:44.450547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:44.450547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:44.450547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:44.450547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:44.450547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:44.450547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:44.450547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:44.450547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:44.450547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:44.450547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:44.450547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:44.450547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:44.450547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:44.450547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:44.451573 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:44.451573 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:44.451573 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:44.451573 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:44.451573 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 287/582] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:44.451967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb75329-7943-4295-b2cf-50a8cd085e90 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:44.535656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2631b-f2c8-4b95-8796-cb661ed8de1f None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:44.546804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:44.563891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb75329-7943-4295-b2cf-50a8cd085e90 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:44.572222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2ec6a-2d19-429e-8324-37854a897122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:44.572936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2ec6a-2d19-429e-8324-37854a897122 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:44.573404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2ec6a-2d19-429e-8324-37854a897122 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:44.573745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2ec6a-2d19-429e-8324-37854a897122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:44.584506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2ec6a-2d19-429e-8324-37854a897122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:44.586023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2ec6a-2d19-429e-8324-37854a897122 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:44.601234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc502c53-b189-4de8-bab2-e249a37c5922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:44.601407 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-9df2ec6a-2d19-429e-8324-37854a897122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:44.601407 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:44.601407 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:44.601407 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:44.601407 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:44.601407 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:44.601407 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:44.601407 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:44.601407 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:44.601407 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:44.601407 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:44.601407 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:44.601407 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:44.601407 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:44.601407 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:44.602450 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:44.602450 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:44.602450 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:44.602450 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:44.602450 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:44.602450 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:44.602450 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:44.602450 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:44.602450 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:44.602450 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:44.602450 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:44.602450 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:44.602450 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:44.602450 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:44.602450 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:44.602450 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:44.602450 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:44.603594 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:44.603594 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:44.603594 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:44.603594 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:44.603862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc502c53-b189-4de8-bab2-e249a37c5922 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:44.604057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc502c53-b189-4de8-bab2-e249a37c5922 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:44.608725 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 296/583] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:44.608871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc502c53-b189-4de8-bab2-e249a37c5922 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:44.608971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2ec6a-2d19-429e-8324-37854a897122 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:44.609057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc502c53-b189-4de8-bab2-e249a37c5922 None admin] RBAC: Adding query filter params (name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:44.609057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc502c53-b189-4de8-bab2-e249a37c5922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:44.609057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc502c53-b189-4de8-bab2-e249a37c5922 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:44.611521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:44.618311 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 288/584] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:44:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:44.619130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc502c53-b189-4de8-bab2-e249a37c5922 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:44.728316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2ec6a-2d19-429e-8324-37854a897122 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:44.739987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc502c53-b189-4de8-bab2-e249a37c5922 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:44.764438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5e87d-0cd6-4f4e-bdc5-b50a7fed8ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:44.765076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5e87d-0cd6-4f4e-bdc5-b50a7fed8ba6 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:44.765363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5e87d-0cd6-4f4e-bdc5-b50a7fed8ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:44.765642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5e87d-0cd6-4f4e-bdc5-b50a7fed8ba6 None admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:44.766410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5e87d-0cd6-4f4e-bdc5-b50a7fed8ba6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:44.766725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5e87d-0cd6-4f4e-bdc5-b50a7fed8ba6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:44.770038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5e87d-0cd6-4f4e-bdc5-b50a7fed8ba6 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:44.780753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fcbc6-e310-4727-b913-13fe7ab4d486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:44.781464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fcbc6-e310-4727-b913-13fe7ab4d486 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:44.781817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fcbc6-e310-4727-b913-13fe7ab4d486 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:44.782466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fcbc6-e310-4727-b913-13fe7ab4d486 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:44.782969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fcbc6-e310-4727-b913-13fe7ab4d486 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:44.783380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fcbc6-e310-4727-b913-13fe7ab4d486 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:44.789626 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 297/585] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:44:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:44.789626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5e87d-0cd6-4f4e-bdc5-b50a7fed8ba6 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:44.789854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fcbc6-e310-4727-b913-13fe7ab4d486 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:44.802880 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 289/586] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:44.803843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fcbc6-e310-4727-b913-13fe7ab4d486 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:44.816273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:44.856720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:44.896910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5e87d-0cd6-4f4e-bdc5-b50a7fed8ba6 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:44.914070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fcbc6-e310-4727-b913-13fe7ab4d486 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:44.931419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792554d8-0d40-4858-80d7-62cb8861781e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:44.932035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792554d8-0d40-4858-80d7-62cb8861781e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:44.932325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792554d8-0d40-4858-80d7-62cb8861781e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:44.932599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792554d8-0d40-4858-80d7-62cb8861781e None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:44.933280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792554d8-0d40-4858-80d7-62cb8861781e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:44.933584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792554d8-0d40-4858-80d7-62cb8861781e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:44.934943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792554d8-0d40-4858-80d7-62cb8861781e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:44.950745 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 298/587] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:44.950745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792554d8-0d40-4858-80d7-62cb8861781e None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:44.953733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bf856-8cc9-4238-be05-03e6562e641a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:44.954382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bf856-8cc9-4238-be05-03e6562e641a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:44.954667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bf856-8cc9-4238-be05-03e6562e641a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:44.954942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bf856-8cc9-4238-be05-03e6562e641a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:44.966810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788bf856-8cc9-4238-be05-03e6562e641a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:44.968359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788bf856-8cc9-4238-be05-03e6562e641a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:44.987630 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-788bf856-8cc9-4238-be05-03e6562e641a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:44.987630 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:44.987630 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:44.987630 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:44.987630 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:44.987630 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:44.987630 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:44.987630 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:44.987630 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:44.987630 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:44.987630 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:44.987630 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:44.987630 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:44.987630 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:44.987630 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:44.988747 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:44.988747 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:44.988747 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:44.988747 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:44.988747 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:44.988747 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:44.988747 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:44.988747 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:44.988747 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:44.988747 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:44.988747 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:44.988747 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:44.988747 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:44.988747 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:44.988747 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:44.988747 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:44.988747 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:44.989909 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:44.989909 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:44.989909 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:44.989909 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:44.994135 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 290/588] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:44.994135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bf856-8cc9-4238-be05-03e6562e641a None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:45.062183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:45.071497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792554d8-0d40-4858-80d7-62cb8861781e None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:45.094718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:45.107650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cba139-8365-47b3-8556-326be7951ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:45.108267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cba139-8365-47b3-8556-326be7951ac1 None admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:45.108552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cba139-8365-47b3-8556-326be7951ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:45.108831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cba139-8365-47b3-8556-326be7951ac1 None admin] PATH_INFO: `/v3/projects/ec96772eef284ab3913f9628b136be7a/users/08a2a5793b7a4797a470719a682e541a/roles/50fb737d5edf48298d0a6061ba652acb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:45.109198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bf856-8cc9-4238-be05-03e6562e641a None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:45.124029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cba139-8365-47b3-8556-326be7951ac1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec96772eef284ab3913f9628b136be7a, user_id=08a2a5793b7a4797a470719a682e541a, role_id=50fb737d5edf48298d0a6061ba652acb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:45.125467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cba139-8365-47b3-8556-326be7951ac1 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:45.147315 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 299/589] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:44:44 2022] PUT /identity/v3/projects/ec96772eef284ab3913f9628b136be7a/users/08a2a5793b7a4797a470719a682e541a/roles/50fb737d5edf48298d0a6061ba652acb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:44:45.147315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cba139-8365-47b3-8556-326be7951ac1 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:45.159316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703f7f9-4b5d-4778-961e-95df31cb205a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:45.160497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703f7f9-4b5d-4778-961e-95df31cb205a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:45.160897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703f7f9-4b5d-4778-961e-95df31cb205a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:45.161576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703f7f9-4b5d-4778-961e-95df31cb205a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:45.172732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703f7f9-4b5d-4778-961e-95df31cb205a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:45.175008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703f7f9-4b5d-4778-961e-95df31cb205a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:45.189821 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-f703f7f9-4b5d-4778-961e-95df31cb205a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 30 20:44:45.189821 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:45.189821 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:45.189821 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:45.189821 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:45.189821 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:45.189821 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:45.189821 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:45.189821 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:45.189821 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:45.189821 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:45.189821 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:45.189821 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:44:45.189821 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:44:45.189821 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:44:45.189821 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:44:45.190990 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:45.190990 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:45.190990 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:44:45.190990 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:45.190990 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:44:45.190990 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:45.190990 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:45.190990 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:45.190990 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:45.190990 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:45.190990 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:45.190990 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:45.190990 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:45.190990 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:45.190990 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:45.190990 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:45.190990 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:45.190990 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:45.192254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:45.192254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:45.192254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:44:45.192254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:44:45.192254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:44:45.192254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:44:45.192254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:44:45.192254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:44:45.192254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 30 20:44:45.192254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:45.192254 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 291/590] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:45.192254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703f7f9-4b5d-4778-961e-95df31cb205a None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:45.274139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cba139-8365-47b3-8556-326be7951ac1 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:45.314529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad7e78-fd38-4c08-a738-ff7c4d0b39dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:45.315684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad7e78-fd38-4c08-a738-ff7c4d0b39dc None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:45.316252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad7e78-fd38-4c08-a738-ff7c4d0b39dc None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:45.316812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad7e78-fd38-4c08-a738-ff7c4d0b39dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:45.325639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad7e78-fd38-4c08-a738-ff7c4d0b39dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:45.326511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703f7f9-4b5d-4778-961e-95df31cb205a None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:45.327520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad7e78-fd38-4c08-a738-ff7c4d0b39dc None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:45.341224 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-22ad7e78-fd38-4c08-a738-ff7c4d0b39dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:45.341224 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:45.341224 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:45.341224 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:45.341224 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:45.341224 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:45.341224 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:45.341224 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:45.341224 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:45.341224 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:45.341224 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:45.341224 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:45.341224 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:44:45.341224 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:44:45.341224 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:44:45.342400 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:44:45.342400 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:45.342400 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:45.342400 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:45.342400 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:45.342400 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:45.342400 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:45.342400 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:45.342400 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:45.342400 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:45.342400 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:45.342400 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:45.342400 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:45.342400 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:45.342400 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:45.342400 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:45.342400 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:45.343555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:44:45.343555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:44:45.343555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:44:45.343555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:44:45.343555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:44:45.343555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:44:45.343555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:45.343555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:45.350899 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 300/591] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:45.350899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad7e78-fd38-4c08-a738-ff7c4d0b39dc None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:45.362575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:45.384325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014391a0-ce9f-40ff-9dd8-a29455e3fd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:45.385098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014391a0-ce9f-40ff-9dd8-a29455e3fd13 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:45.385646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014391a0-ce9f-40ff-9dd8-a29455e3fd13 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:45.385986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014391a0-ce9f-40ff-9dd8-a29455e3fd13 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:45.387296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014391a0-ce9f-40ff-9dd8-a29455e3fd13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:45.387635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014391a0-ce9f-40ff-9dd8-a29455e3fd13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:45.389632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014391a0-ce9f-40ff-9dd8-a29455e3fd13 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:45.390067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:45.406245 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 292/592] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:45.407364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014391a0-ce9f-40ff-9dd8-a29455e3fd13 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:45.471682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad7e78-fd38-4c08-a738-ff7c4d0b39dc None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:45.511239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5168d46-2fd6-4c22-a952-6f18ebadfa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:45.512688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5168d46-2fd6-4c22-a952-6f18ebadfa7c None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:45.513450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5168d46-2fd6-4c22-a952-6f18ebadfa7c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:45.513914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5168d46-2fd6-4c22-a952-6f18ebadfa7c None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:45.515180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5168d46-2fd6-4c22-a952-6f18ebadfa7c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:45.516091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5168d46-2fd6-4c22-a952-6f18ebadfa7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:45.517738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5168d46-2fd6-4c22-a952-6f18ebadfa7c None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:45.538294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014391a0-ce9f-40ff-9dd8-a29455e3fd13 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:45.545198 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 301/593] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Jul 30 20:44:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:45.546402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5168d46-2fd6-4c22-a952-6f18ebadfa7c None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:45.580578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c417ba2-b7f0-44ee-9f67-2228cb9268f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:45.581569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c417ba2-b7f0-44ee-9f67-2228cb9268f0 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:45.581930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c417ba2-b7f0-44ee-9f67-2228cb9268f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:45.582283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c417ba2-b7f0-44ee-9f67-2228cb9268f0 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:45.583242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c417ba2-b7f0-44ee-9f67-2228cb9268f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:45.583675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c417ba2-b7f0-44ee-9f67-2228cb9268f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:45.587952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c417ba2-b7f0-44ee-9f67-2228cb9268f0 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:45.609134 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 293/594] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:44:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:45.610398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c417ba2-b7f0-44ee-9f67-2228cb9268f0 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:45.660163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:45.675583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5168d46-2fd6-4c22-a952-6f18ebadfa7c None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:45.691635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:45.731502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d20f39-eec2-43a8-a3c8-09373bfcd850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:45.732512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d20f39-eec2-43a8-a3c8-09373bfcd850 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:45.732944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d20f39-eec2-43a8-a3c8-09373bfcd850 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:45.733294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d20f39-eec2-43a8-a3c8-09373bfcd850 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:45.736376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c417ba2-b7f0-44ee-9f67-2228cb9268f0 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:45.749545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d20f39-eec2-43a8-a3c8-09373bfcd850 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:45.751380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d20f39-eec2-43a8-a3c8-09373bfcd850 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:45.765264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-46d20f39-eec2-43a8-a3c8-09373bfcd850 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 30 20:44:45.765264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:45.765264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:45.765264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:45.765264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:45.765264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:45.765264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:45.765264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:45.765264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:45.765264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:45.765264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:45.765264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:45.765264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:44:45.765264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:44:45.765264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:44:45.765264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:44:45.766283 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:45.766283 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:45.766283 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:44:45.766283 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:45.766283 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:44:45.766283 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:45.766283 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:45.766283 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:45.766283 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:45.766283 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:45.766283 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:45.766283 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:45.766283 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:45.766283 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:45.766283 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:45.766283 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:45.766283 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:45.766283 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:45.767231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:45.767231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:45.767231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:44:45.767231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:44:45.767231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:44:45.767231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:44:45.767231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:44:45.767231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:44:45.767231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 30 20:44:45.767231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:45.769571 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 302/595] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:44:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:45.770503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d20f39-eec2-43a8-a3c8-09373bfcd850 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:45.785529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef05c71-40ca-4aae-bbd0-579a4f2c3375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:45.786814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef05c71-40ca-4aae-bbd0-579a4f2c3375 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:45.787389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef05c71-40ca-4aae-bbd0-579a4f2c3375 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:45.787869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef05c71-40ca-4aae-bbd0-579a4f2c3375 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:45.799859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef05c71-40ca-4aae-bbd0-579a4f2c3375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:45.801539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef05c71-40ca-4aae-bbd0-579a4f2c3375 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:45.817535 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-1ef05c71-40ca-4aae-bbd0-579a4f2c3375 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:45.817535 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:45.817535 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:45.817535 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:45.817535 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:45.817535 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:45.817535 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:45.817535 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:45.817535 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:45.817535 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:45.817535 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:45.817535 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:45.817535 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:45.817535 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:45.817535 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:45.819166 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:45.819166 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:45.819166 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:45.819166 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:45.819166 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:45.819166 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:45.819166 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:45.819166 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:45.819166 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:45.819166 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:45.819166 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:45.819166 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:45.819166 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:45.819166 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:45.819166 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:45.819166 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:45.819166 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:45.820098 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:45.820098 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:45.820098 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:45.820098 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:45.826900 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 294/596] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:45.827991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef05c71-40ca-4aae-bbd0-579a4f2c3375 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:45.895731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d20f39-eec2-43a8-a3c8-09373bfcd850 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:45.932001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:45.936484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4aa51d-44f3-44bc-a01d-b1ea3d8e2825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:45.937162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4aa51d-44f3-44bc-a01d-b1ea3d8e2825 None admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:45.937443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4aa51d-44f3-44bc-a01d-b1ea3d8e2825 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:45.937717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4aa51d-44f3-44bc-a01d-b1ea3d8e2825 None admin] PATH_INFO: `/v3/projects/ec96772eef284ab3913f9628b136be7a/users/60d1fa32e98f45128f990a107db45eae/roles/50fb737d5edf48298d0a6061ba652acb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:45.941595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef05c71-40ca-4aae-bbd0-579a4f2c3375 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:45.958551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4aa51d-44f3-44bc-a01d-b1ea3d8e2825 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec96772eef284ab3913f9628b136be7a, user_id=60d1fa32e98f45128f990a107db45eae, role_id=50fb737d5edf48298d0a6061ba652acb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:45.960994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4aa51d-44f3-44bc-a01d-b1ea3d8e2825 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:45.972323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:45.978515 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 303/597] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:44:45 2022] PUT /identity/v3/projects/ec96772eef284ab3913f9628b136be7a/users/60d1fa32e98f45128f990a107db45eae/roles/50fb737d5edf48298d0a6061ba652acb => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:44:45.979282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4aa51d-44f3-44bc-a01d-b1ea3d8e2825 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:45.999630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e4d71-6312-4709-8308-41a64c141dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:46.000635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e4d71-6312-4709-8308-41a64c141dbd None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:46.001089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e4d71-6312-4709-8308-41a64c141dbd None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:46.001848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e4d71-6312-4709-8308-41a64c141dbd None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:46.003429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e4d71-6312-4709-8308-41a64c141dbd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:46.003935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e4d71-6312-4709-8308-41a64c141dbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:46.006492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e4d71-6312-4709-8308-41a64c141dbd None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:46.036713 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 295/598] 10.222.0.17 () {56 vars in 1139 bytes} [Sat Jul 30 20:44:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:46.039045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785c2b-62d9-44d6-844b-70b14e065a8d None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:46.039555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785c2b-62d9-44d6-844b-70b14e065a8d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:46.040008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785c2b-62d9-44d6-844b-70b14e065a8d None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:46.042517 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 296/599] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:46.043630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51785c2b-62d9-44d6-844b-70b14e065a8d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:46.125640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4aa51d-44f3-44bc-a01d-b1ea3d8e2825 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:46.170872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51785c2b-62d9-44d6-844b-70b14e065a8d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:46.172776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0de220-3ba0-4842-b901-d301795df9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:46.174258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0de220-3ba0-4842-b901-d301795df9d9 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:46.174570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0de220-3ba0-4842-b901-d301795df9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:46.174833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0de220-3ba0-4842-b901-d301795df9d9 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:46.175572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0de220-3ba0-4842-b901-d301795df9d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:46.175887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0de220-3ba0-4842-b901-d301795df9d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:46.177299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0de220-3ba0-4842-b901-d301795df9d9 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:46.192351 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 304/600] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:46.194067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87856987-30b1-43a9-ba36-99876ad0ad39 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:46.194568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87856987-30b1-43a9-ba36-99876ad0ad39 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:46.195183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87856987-30b1-43a9-ba36-99876ad0ad39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:46.215280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-87856987-30b1-43a9-ba36-99876ad0ad39 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:46.216854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-87856987-30b1-43a9-ba36-99876ad0ad39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:46.223737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f9502-0824-4549-91c4-767fb2b27a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:46.224490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f9502-0824-4549-91c4-767fb2b27a54 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:46.224831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f9502-0824-4549-91c4-767fb2b27a54 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:46.225116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f9502-0824-4549-91c4-767fb2b27a54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:46.239391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f9502-0824-4549-91c4-767fb2b27a54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:46.241406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f9502-0824-4549-91c4-767fb2b27a54 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:46.262272 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-6c2f9502-0824-4549-91c4-767fb2b27a54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:46.262272 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:46.262272 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:46.262272 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:46.262272 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:46.262272 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:46.262272 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:46.262272 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:46.262272 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:46.262272 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:46.262272 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:46.262272 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:46.262272 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:46.262272 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:46.262272 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:46.263315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:46.263315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:46.263315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:46.263315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:46.263315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:46.263315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:46.263315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:46.263315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:46.263315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:46.263315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:46.263315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:46.263315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:46.263315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:46.263315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:46.263315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:46.263315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:46.263315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:46.264258 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:46.264258 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:46.264258 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:46.264258 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:46.264258 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 297/601] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:46.265143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f9502-0824-4549-91c4-767fb2b27a54 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:46.267362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:46.287980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:46.301340 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 305/602] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:46.303050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87856987-30b1-43a9-ba36-99876ad0ad39 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:46.399854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f9502-0824-4549-91c4-767fb2b27a54 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:46.419191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87856987-30b1-43a9-ba36-99876ad0ad39 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:46.438509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0aa51-0950-4f07-84c3-9a4c9f36c20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:46.439308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0aa51-0950-4f07-84c3-9a4c9f36c20c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:46.439601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0aa51-0950-4f07-84c3-9a4c9f36c20c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:46.439879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0aa51-0950-4f07-84c3-9a4c9f36c20c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:46.448045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0aa51-0950-4f07-84c3-9a4c9f36c20c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:46.449406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0aa51-0950-4f07-84c3-9a4c9f36c20c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:46.462657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69722836-ab67-4308-b8b8-f3842cac2c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:46.462854 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-1ce0aa51-0950-4f07-84c3-9a4c9f36c20c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:46.462854 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:46.462854 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:46.462854 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:46.462854 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:46.462854 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:46.462854 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:46.462854 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:46.462854 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:46.462854 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:46.462854 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:46.462854 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:46.462854 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:44:46.462854 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:44:46.462854 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:44:46.463723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:44:46.463723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:46.463723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:46.463723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:46.463723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:46.463723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:46.463723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:46.463723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:46.463723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:46.463723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:46.463723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:46.463723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:46.463723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:46.463723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:46.463723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:46.463723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:46.463723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:46.464605 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:44:46.464605 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:44:46.464605 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:44:46.464605 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:44:46.464605 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:44:46.464605 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:44:46.464605 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:46.464605 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:46.465052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69722836-ab67-4308-b8b8-f3842cac2c11 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:46.465052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69722836-ab67-4308-b8b8-f3842cac2c11 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:46.465052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69722836-ab67-4308-b8b8-f3842cac2c11 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:46.465052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69722836-ab67-4308-b8b8-f3842cac2c11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:46.465052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69722836-ab67-4308-b8b8-f3842cac2c11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:46.467737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69722836-ab67-4308-b8b8-f3842cac2c11 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:46.468721 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 298/603] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:46.473186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0aa51-0950-4f07-84c3-9a4c9f36c20c None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:46.486735 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 306/604] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:46.488110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69722836-ab67-4308-b8b8-f3842cac2c11 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:46.544928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:46.557734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:46.589056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0aa51-0950-4f07-84c3-9a4c9f36c20c None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:46.613774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69722836-ab67-4308-b8b8-f3842cac2c11 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:46.629444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c0d56-12ad-4f0c-bbbf-9258e52cc665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:46.630795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c0d56-12ad-4f0c-bbbf-9258e52cc665 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:46.631138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c0d56-12ad-4f0c-bbbf-9258e52cc665 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:46.631803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c0d56-12ad-4f0c-bbbf-9258e52cc665 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:46.644090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c0d56-12ad-4f0c-bbbf-9258e52cc665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:46.650002 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-448c0d56-12ad-4f0c-bbbf-9258e52cc665 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:46.650002 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:46.650002 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:46.650002 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:46.650002 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:46.650002 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:46.650002 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:46.650002 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:46.650002 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:46.650002 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:46.650002 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:46.650002 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:46.650002 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:46.650002 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:46.650002 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:46.650002 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:46.650935 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:46.650935 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:46.650935 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:46.650935 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:46.650935 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:46.650935 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:46.650935 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:46.650935 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:46.650935 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:46.650935 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:46.650935 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:46.650935 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:46.650935 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:46.650935 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:46.650935 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:46.650935 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:46.651842 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:46.651842 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:46.651842 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:46.651842 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:46.651842 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:46.651842 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:46.651842 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:46.651842 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:46.651842 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:46.651842 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:46.651842 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:46.651842 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:46.651842 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 299/605] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:44:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:46.652569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c0d56-12ad-4f0c-bbbf-9258e52cc665 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:46.660317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5481120-f724-437d-8be8-9526087d1da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:46.661200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5481120-f724-437d-8be8-9526087d1da7 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:46.661716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5481120-f724-437d-8be8-9526087d1da7 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:46.662708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5481120-f724-437d-8be8-9526087d1da7 None admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:46.663685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5481120-f724-437d-8be8-9526087d1da7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:46.664189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5481120-f724-437d-8be8-9526087d1da7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:46.665917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5481120-f724-437d-8be8-9526087d1da7 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:46.680968 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 307/606] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:44:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:46.682064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5481120-f724-437d-8be8-9526087d1da7 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:46.766976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c0d56-12ad-4f0c-bbbf-9258e52cc665 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:46.791982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5481120-f724-437d-8be8-9526087d1da7 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:46.797037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:46.806471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:46.811126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7cfdd-131a-4fb5-8013-db1fd7ce522a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:46.812104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7cfdd-131a-4fb5-8013-db1fd7ce522a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:46.812555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7cfdd-131a-4fb5-8013-db1fd7ce522a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:46.812993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7cfdd-131a-4fb5-8013-db1fd7ce522a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:46.821165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7cfdd-131a-4fb5-8013-db1fd7ce522a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:46.823027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7cfdd-131a-4fb5-8013-db1fd7ce522a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:46.834626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfc979-605e-4aa8-b669-e57be7613751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:46.835398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfc979-605e-4aa8-b669-e57be7613751 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:46.835800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfc979-605e-4aa8-b669-e57be7613751 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:46.836153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfc979-605e-4aa8-b669-e57be7613751 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:46.836965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfc979-605e-4aa8-b669-e57be7613751 None admin] RBAC: Adding query filter params (name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:46.837366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfc979-605e-4aa8-b669-e57be7613751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:46.838127 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-9ec7cfdd-131a-4fb5-8013-db1fd7ce522a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:46.838127 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:46.838127 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:46.838127 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:46.838127 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:46.838127 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:46.838127 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:46.838127 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:46.838127 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:46.838127 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:46.838127 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:46.838127 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:46.838127 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:44:46.838127 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:44:46.838127 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:44:46.839191 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:44:46.839191 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:46.839191 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:46.839191 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:46.839191 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:46.839191 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:46.839191 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:46.839191 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:46.839191 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:46.839191 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:46.839191 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:46.839191 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:46.839191 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:46.839191 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:46.839191 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:46.839191 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:46.839191 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:46.840306 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:44:46.840306 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:44:46.840306 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:44:46.840306 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:44:46.840306 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:44:46.840306 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:44:46.840306 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:46.840306 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:46.841462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfc979-605e-4aa8-b669-e57be7613751 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:46.842648 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 300/607] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:46.843832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7cfdd-131a-4fb5-8013-db1fd7ce522a None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:46.851473 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 308/608] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:44:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:46.852433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfc979-605e-4aa8-b669-e57be7613751 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:46.954334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7cfdd-131a-4fb5-8013-db1fd7ce522a None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:46.967179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfc979-605e-4aa8-b669-e57be7613751 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:46.996931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718747a-cde9-4841-ad79-fad876150106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:46.997946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718747a-cde9-4841-ad79-fad876150106 None admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:46.998447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718747a-cde9-4841-ad79-fad876150106 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:46.999029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718747a-cde9-4841-ad79-fad876150106 None admin] PATH_INFO: `/v3/projects/ec96772eef284ab3913f9628b136be7a/users/1656aa416bc146f486e71517e476773a/roles/50fb737d5edf48298d0a6061ba652acb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:47.011463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdd617-9df6-4908-8875-9de1851558ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:47.012990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdd617-9df6-4908-8875-9de1851558ac None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:47.013630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdd617-9df6-4908-8875-9de1851558ac None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:47.014210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdd617-9df6-4908-8875-9de1851558ac None admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:47.015356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdd617-9df6-4908-8875-9de1851558ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:47.015877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdd617-9df6-4908-8875-9de1851558ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:47.018248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdd617-9df6-4908-8875-9de1851558ac None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:47.019371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718747a-cde9-4841-ad79-fad876150106 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec96772eef284ab3913f9628b136be7a, user_id=1656aa416bc146f486e71517e476773a, role_id=50fb737d5edf48298d0a6061ba652acb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:47.021118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718747a-cde9-4841-ad79-fad876150106 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:47.035745 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 309/609] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:44:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:47.037507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdd617-9df6-4908-8875-9de1851558ac None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:47.039064 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 301/610] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:44:46 2022] PUT /identity/v3/projects/ec96772eef284ab3913f9628b136be7a/users/1656aa416bc146f486e71517e476773a/roles/50fb737d5edf48298d0a6061ba652acb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:44:47.045073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718747a-cde9-4841-ad79-fad876150106 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:47.105442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:47.110005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:47.213502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdd617-9df6-4908-8875-9de1851558ac None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:47.269485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718747a-cde9-4841-ad79-fad876150106 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:47.271726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479a9bb-80ac-450b-9ea2-a94715d10d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:47.272727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479a9bb-80ac-450b-9ea2-a94715d10d6d None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:47.273233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479a9bb-80ac-450b-9ea2-a94715d10d6d None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:47.274606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479a9bb-80ac-450b-9ea2-a94715d10d6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:47.287378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479a9bb-80ac-450b-9ea2-a94715d10d6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:47.289855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479a9bb-80ac-450b-9ea2-a94715d10d6d None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:47.310226 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-0479a9bb-80ac-450b-9ea2-a94715d10d6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:47.310226 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:47.310226 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:47.310226 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:47.310226 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:47.310226 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:47.310226 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:47.310226 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:47.310226 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:47.310226 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:47.310226 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:47.310226 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:47.310226 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:47.310226 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:47.310226 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:47.311205 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:47.311205 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:47.311205 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:47.311205 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:47.311205 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:47.311205 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:47.311205 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:47.311205 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:47.311205 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:47.311205 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:47.311205 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:47.311205 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:47.311205 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:47.311205 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:47.311205 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:47.311205 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:47.311205 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:47.312130 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:47.312130 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:47.312130 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:47.312130 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:47.314574 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 310/611] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:47.322143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479a9bb-80ac-450b-9ea2-a94715d10d6d None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:47.324398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ef39a-2b4f-4d82-9716-18d4bd7ddd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:47.325093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ef39a-2b4f-4d82-9716-18d4bd7ddd26 None admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:47.325382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ef39a-2b4f-4d82-9716-18d4bd7ddd26 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:47.325664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ef39a-2b4f-4d82-9716-18d4bd7ddd26 None admin] PATH_INFO: `/v3/projects/ec96772eef284ab3913f9628b136be7a/users/4a886ccf9590432caf209526410a7b53/roles/50fb737d5edf48298d0a6061ba652acb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:47.355569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ef39a-2b4f-4d82-9716-18d4bd7ddd26 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec96772eef284ab3913f9628b136be7a, user_id=4a886ccf9590432caf209526410a7b53, role_id=50fb737d5edf48298d0a6061ba652acb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:47.357025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ef39a-2b4f-4d82-9716-18d4bd7ddd26 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:47.379541 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 302/612] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:44:47 2022] PUT /identity/v3/projects/ec96772eef284ab3913f9628b136be7a/users/4a886ccf9590432caf209526410a7b53/roles/50fb737d5edf48298d0a6061ba652acb => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:44:47.449928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:47.477168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479a9bb-80ac-450b-9ea2-a94715d10d6d None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:47.524302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce03d27-c67d-4e0f-b026-4a229abb1995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:47.525332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce03d27-c67d-4e0f-b026-4a229abb1995 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:47.525829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce03d27-c67d-4e0f-b026-4a229abb1995 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:47.526335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce03d27-c67d-4e0f-b026-4a229abb1995 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:47.527340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce03d27-c67d-4e0f-b026-4a229abb1995 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:47.527890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce03d27-c67d-4e0f-b026-4a229abb1995 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:47.529654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce03d27-c67d-4e0f-b026-4a229abb1995 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:47.550894 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 311/613] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:47.557387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ef39a-2b4f-4d82-9716-18d4bd7ddd26 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:47.674540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:47.691657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd39cf-45d8-414a-b33d-454169279665 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:47.691942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd39cf-45d8-414a-b33d-454169279665 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:47.692223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd39cf-45d8-414a-b33d-454169279665 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:47.693920 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 312/614] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:47.698983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b489a19-3214-410e-a3c0-689497e3b82a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:47.699253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ef39a-2b4f-4d82-9716-18d4bd7ddd26 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:47.699384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b489a19-3214-410e-a3c0-689497e3b82a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:47.699565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b489a19-3214-410e-a3c0-689497e3b82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:47.719050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4b489a19-3214-410e-a3c0-689497e3b82a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:47.720239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4b489a19-3214-410e-a3c0-689497e3b82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:47.757283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed7145-9c0f-4bde-adf3-7d378f083fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:47.758036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed7145-9c0f-4bde-adf3-7d378f083fb7 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:47.758321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed7145-9c0f-4bde-adf3-7d378f083fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:47.758735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed7145-9c0f-4bde-adf3-7d378f083fb7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:47.768915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed7145-9c0f-4bde-adf3-7d378f083fb7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:47.770376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed7145-9c0f-4bde-adf3-7d378f083fb7 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:47.783417 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-d5ed7145-9c0f-4bde-adf3-7d378f083fb7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 30 20:44:47.783417 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:47.783417 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:47.783417 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:47.783417 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:47.783417 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:47.783417 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:47.783417 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:47.783417 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:47.783417 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:47.783417 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:47.783417 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:47.783417 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:44:47.783417 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:44:47.783417 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:44:47.783417 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:44:47.784550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:47.784550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:47.784550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:44:47.784550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:47.784550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:44:47.784550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:47.784550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:47.784550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:47.784550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:47.784550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:47.784550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:47.784550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:47.784550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:47.784550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:47.784550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:47.784550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:47.784550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:47.784550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:47.785806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:47.785806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:47.785806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:44:47.785806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:44:47.785806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:44:47.785806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:44:47.785806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:44:47.785806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:44:47.785806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 30 20:44:47.785806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:47.785806 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 303/615] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:44:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:47.800270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed7145-9c0f-4bde-adf3-7d378f083fb7 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:47.823225 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 313/616] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:47.855504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b489a19-3214-410e-a3c0-689497e3b82a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:47.959713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:47.968944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed7145-9c0f-4bde-adf3-7d378f083fb7 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:48.018496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b489a19-3214-410e-a3c0-689497e3b82a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:48.044327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4906a-24ac-4402-94fb-51ea8336fb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:48.047200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4906a-24ac-4402-94fb-51ea8336fb81 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:48.047200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4906a-24ac-4402-94fb-51ea8336fb81 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:48.047200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4906a-24ac-4402-94fb-51ea8336fb81 None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:48.047200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4906a-24ac-4402-94fb-51ea8336fb81 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:48.047200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4906a-24ac-4402-94fb-51ea8336fb81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:48.048297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4906a-24ac-4402-94fb-51ea8336fb81 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:48.064708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:48.070047 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 304/617] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Jul 30 20:44:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:48.075966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4906a-24ac-4402-94fb-51ea8336fb81 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:48.105362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813ad4c-126f-4a60-b689-5319710f77b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:48.106012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813ad4c-126f-4a60-b689-5319710f77b6 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:48.106295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813ad4c-126f-4a60-b689-5319710f77b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:48.106564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813ad4c-126f-4a60-b689-5319710f77b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:48.148238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813ad4c-126f-4a60-b689-5319710f77b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:48.153276 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-b813ad4c-126f-4a60-b689-5319710f77b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:48.153276 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:48.153276 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:48.153276 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:48.153276 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:48.153276 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:48.153276 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:48.153276 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:48.153276 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:48.153276 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:48.153276 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:48.153276 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:48.153276 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:48.153276 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:48.153276 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:48.153276 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:48.154195 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:48.154195 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:48.154195 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:48.154195 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:48.154195 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:48.154195 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:48.154195 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:48.154195 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:48.154195 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:48.154195 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:48.154195 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:48.154195 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:48.154195 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:48.154195 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:48.154195 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:48.154195 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:48.155042 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:48.155042 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:48.155042 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:48.155042 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:48.155042 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:48.155042 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:48.155042 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:48.155042 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:48.155042 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:48.155042 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:48.155042 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:48.155042 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:48.159641 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 314/618] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:44:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:44:48.165811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813ad4c-126f-4a60-b689-5319710f77b6 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:48.187516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4906a-24ac-4402-94fb-51ea8336fb81 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:48.228021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d67c7e-052d-4af1-8fbc-c1a14efa1fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:48.229045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d67c7e-052d-4af1-8fbc-c1a14efa1fa0 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:48.230560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d67c7e-052d-4af1-8fbc-c1a14efa1fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:48.231040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d67c7e-052d-4af1-8fbc-c1a14efa1fa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:48.242894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d67c7e-052d-4af1-8fbc-c1a14efa1fa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:48.244678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d67c7e-052d-4af1-8fbc-c1a14efa1fa0 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:48.260877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-f5d67c7e-052d-4af1-8fbc-c1a14efa1fa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:48.260877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:48.260877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:48.260877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:48.260877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:48.260877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:48.260877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:48.260877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:48.260877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:48.260877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:48.260877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:48.260877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:48.260877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:48.260877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:48.260877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:48.261958 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:48.261958 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:48.261958 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:48.261958 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:48.261958 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:48.261958 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:48.261958 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:48.261958 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:48.261958 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:48.261958 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:48.261958 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:48.261958 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:48.261958 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:48.261958 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:48.261958 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:48.261958 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:48.261958 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:48.262847 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:48.262847 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:48.262847 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:48.262847 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:48.265063 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 305/619] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:44:48.271533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d67c7e-052d-4af1-8fbc-c1a14efa1fa0 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:48.334157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:48.383856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813ad4c-126f-4a60-b689-5319710f77b6 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:48.394732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d67c7e-052d-4af1-8fbc-c1a14efa1fa0 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:48.433148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc7e77-c36f-4eaa-a13f-3466f64060d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:48.434223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc7e77-c36f-4eaa-a13f-3466f64060d8 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:48.434725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc7e77-c36f-4eaa-a13f-3466f64060d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:48.435203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc7e77-c36f-4eaa-a13f-3466f64060d8 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:48.436192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc7e77-c36f-4eaa-a13f-3466f64060d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:48.436723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc7e77-c36f-4eaa-a13f-3466f64060d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:48.438291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc7e77-c36f-4eaa-a13f-3466f64060d8 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:48.451118 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 306/620] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:48.456870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc7e77-c36f-4eaa-a13f-3466f64060d8 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:48.459995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda9f69-d6e5-449d-851d-0a289c34aa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:48.460776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda9f69-d6e5-449d-851d-0a289c34aa2b None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:48.461020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda9f69-d6e5-449d-851d-0a289c34aa2b None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:48.461299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda9f69-d6e5-449d-851d-0a289c34aa2b None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:48.462024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda9f69-d6e5-449d-851d-0a289c34aa2b None admin] RBAC: Adding query filter params (name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:48.462382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda9f69-d6e5-449d-851d-0a289c34aa2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:48.463854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda9f69-d6e5-449d-851d-0a289c34aa2b None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:48.467605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:48.485110 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 315/621] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:44:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:48.492337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda9f69-d6e5-449d-851d-0a289c34aa2b None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:48.568745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc7e77-c36f-4eaa-a13f-3466f64060d8 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:48.584148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:48.605110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d516254-e5de-4264-bbd8-00daaaf91524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:48.605819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d516254-e5de-4264-bbd8-00daaaf91524 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:48.606177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d516254-e5de-4264-bbd8-00daaaf91524 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:48.606528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d516254-e5de-4264-bbd8-00daaaf91524 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:48.613733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d516254-e5de-4264-bbd8-00daaaf91524 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:48.615878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d516254-e5de-4264-bbd8-00daaaf91524 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:48.627843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-3d516254-e5de-4264-bbd8-00daaaf91524 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:48.627843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:48.627843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:48.627843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:48.627843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:48.627843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:48.627843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:48.627843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:48.627843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:48.627843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:48.627843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:48.627843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:48.627843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:44:48.627843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:44:48.627843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:44:48.628767 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:44:48.628767 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:48.628767 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:48.628767 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:48.628767 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:48.628767 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:48.628767 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:48.628767 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:48.628767 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:48.628767 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:48.628767 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:48.628767 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:48.628767 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:48.628767 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:48.628767 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:48.628767 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:48.628767 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:48.629973 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:44:48.629973 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:44:48.629973 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:44:48.629973 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:44:48.629973 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:44:48.629973 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:44:48.629973 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:48.629973 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:48.629973 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 307/622] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:48.635222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d516254-e5de-4264-bbd8-00daaaf91524 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:48.689332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda9f69-d6e5-449d-851d-0a289c34aa2b None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:48.724153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce659c-5f07-4a55-8923-61451ce21a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:48.725128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce659c-5f07-4a55-8923-61451ce21a8a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:48.725418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce659c-5f07-4a55-8923-61451ce21a8a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:48.725697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce659c-5f07-4a55-8923-61451ce21a8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:48.736700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce659c-5f07-4a55-8923-61451ce21a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:48.738230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce659c-5f07-4a55-8923-61451ce21a8a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:48.738429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d516254-e5de-4264-bbd8-00daaaf91524 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:48.753370 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-1cce659c-5f07-4a55-8923-61451ce21a8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:48.753370 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:48.753370 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:48.753370 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:48.753370 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:48.753370 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:48.753370 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:48.753370 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:48.753370 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:48.753370 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:48.753370 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:48.753370 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:48.753370 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:48.753370 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:48.753370 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:48.754267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:48.754267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:48.754267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:48.754267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:48.754267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:48.754267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:48.754267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:48.754267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:48.754267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:48.754267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:48.754267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:48.754267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:48.754267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:48.754267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:48.754267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:48.754267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:48.754267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:48.755632 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:48.755632 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:48.755632 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:48.755632 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:48.755632 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 316/623] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:48.760524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470b3bd-77aa-4925-9e7a-1cf01e04741b None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:48.760823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470b3bd-77aa-4925-9e7a-1cf01e04741b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:48.761110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470b3bd-77aa-4925-9e7a-1cf01e04741b None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:48.762627 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 317/624] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:48.763381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470b3bd-77aa-4925-9e7a-1cf01e04741b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:48.774747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d57d2-3890-416a-bbde-2fe7772a01c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:48.775478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d57d2-3890-416a-bbde-2fe7772a01c9 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:48.775769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d57d2-3890-416a-bbde-2fe7772a01c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:48.776044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d57d2-3890-416a-bbde-2fe7772a01c9 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:48.776898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d57d2-3890-416a-bbde-2fe7772a01c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:48.777211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d57d2-3890-416a-bbde-2fe7772a01c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:48.778778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d57d2-3890-416a-bbde-2fe7772a01c9 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:48.792836 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 308/625] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:44:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:48.799171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c0746-f0fb-481a-af13-1118eea8f5c9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:48.799714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c0746-f0fb-481a-af13-1118eea8f5c9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:48.799903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c0746-f0fb-481a-af13-1118eea8f5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:48.819801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:48.821690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bf7c0746-f0fb-481a-af13-1118eea8f5c9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:48.822932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bf7c0746-f0fb-481a-af13-1118eea8f5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:48.861648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:48.879861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470b3bd-77aa-4925-9e7a-1cf01e04741b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:48.913312 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 309/626] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:48.914176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c0746-f0fb-481a-af13-1118eea8f5c9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:48.937703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ac296-88ea-485e-b995-e643c8696109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:48.938336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ac296-88ea-485e-b995-e643c8696109 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:48.938621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ac296-88ea-485e-b995-e643c8696109 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:48.938900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ac296-88ea-485e-b995-e643c8696109 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:48.939635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ac296-88ea-485e-b995-e643c8696109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:48.939940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ac296-88ea-485e-b995-e643c8696109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:48.941335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ac296-88ea-485e-b995-e643c8696109 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:48.957453 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 318/627] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:48.958773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ac296-88ea-485e-b995-e643c8696109 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:49.055507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c0746-f0fb-481a-af13-1118eea8f5c9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:49.091266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09896a-ef85-405e-8a89-92a43b9101c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:49.092223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09896a-ef85-405e-8a89-92a43b9101c6 None admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:49.092686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09896a-ef85-405e-8a89-92a43b9101c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:49.093114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09896a-ef85-405e-8a89-92a43b9101c6 None admin] PATH_INFO: `/v3/projects/ec96772eef284ab3913f9628b136be7a/users/2181960e3bed4031889d6e72a721e151/roles/50fb737d5edf48298d0a6061ba652acb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:49.104854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ac296-88ea-485e-b995-e643c8696109 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:49.112475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09896a-ef85-405e-8a89-92a43b9101c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec96772eef284ab3913f9628b136be7a, user_id=2181960e3bed4031889d6e72a721e151, role_id=50fb737d5edf48298d0a6061ba652acb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:49.114636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09896a-ef85-405e-8a89-92a43b9101c6 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:49.116380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:49.132821 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 310/628] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:44:48 2022] PUT /identity/v3/projects/ec96772eef284ab3913f9628b136be7a/users/2181960e3bed4031889d6e72a721e151/roles/50fb737d5edf48298d0a6061ba652acb => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:44:49.134027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09896a-ef85-405e-8a89-92a43b9101c6 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:49.168084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3420fe-ba9b-48ed-97a5-398b1bec54d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:49.169099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3420fe-ba9b-48ed-97a5-398b1bec54d0 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:49.169555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3420fe-ba9b-48ed-97a5-398b1bec54d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:49.171184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3420fe-ba9b-48ed-97a5-398b1bec54d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:49.174040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:49.198455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3420fe-ba9b-48ed-97a5-398b1bec54d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:49.207095 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-ee3420fe-ba9b-48ed-97a5-398b1bec54d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:49.207095 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:49.207095 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:49.207095 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:49.207095 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:49.207095 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:49.207095 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:49.207095 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:49.207095 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:49.207095 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:49.207095 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:49.207095 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:49.207095 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:49.207095 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:49.207095 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:49.207095 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:49.208163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:49.208163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:49.208163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:49.208163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:49.208163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:49.208163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:49.208163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:49.208163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:49.208163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:49.208163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:49.208163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:49.208163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:49.208163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:49.208163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:49.208163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:49.208163 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:49.209641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:49.209641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:49.209641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:49.209641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:49.209641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:49.209641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:49.209641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:49.209641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:49.209641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:49.209641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:49.209641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:49.209641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:49.209641 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 319/629] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:44:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:49.216852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3420fe-ba9b-48ed-97a5-398b1bec54d0 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:49.329182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09896a-ef85-405e-8a89-92a43b9101c6 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:49.380680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12e9e3-5e56-41cc-b999-bfddd6aa81ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:49.381263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12e9e3-5e56-41cc-b999-bfddd6aa81ab None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:49.381553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12e9e3-5e56-41cc-b999-bfddd6aa81ab None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:49.382228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12e9e3-5e56-41cc-b999-bfddd6aa81ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:49.392025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12e9e3-5e56-41cc-b999-bfddd6aa81ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:49.393485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12e9e3-5e56-41cc-b999-bfddd6aa81ab None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:49.408085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3420fe-ba9b-48ed-97a5-398b1bec54d0 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:49.409338 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-1c12e9e3-5e56-41cc-b999-bfddd6aa81ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 30 20:44:49.409338 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:49.409338 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:49.409338 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:49.409338 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:49.409338 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:49.409338 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:49.409338 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:49.409338 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:49.409338 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:49.409338 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:49.409338 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:49.409338 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:44:49.409338 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:44:49.409338 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:44:49.409338 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:44:49.410264 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:49.410264 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:49.410264 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:44:49.410264 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:49.410264 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:44:49.410264 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:49.410264 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:49.410264 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:49.410264 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:49.410264 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:49.410264 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:49.410264 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:49.410264 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:49.410264 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:49.410264 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:49.410264 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:49.410264 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:49.410264 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:49.411242 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:49.411242 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:49.411242 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:44:49.411242 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:44:49.411242 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:44:49.411242 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:44:49.411242 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:44:49.411242 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:44:49.411242 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 30 20:44:49.411242 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:49.411242 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 311/630] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Jul 30 20:44:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:49.417387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12e9e3-5e56-41cc-b999-bfddd6aa81ab None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:49.452869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e0b7e-215f-498a-a1d6-65700d81752e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:49.453972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e0b7e-215f-498a-a1d6-65700d81752e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:49.454462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e0b7e-215f-498a-a1d6-65700d81752e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:49.454942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e0b7e-215f-498a-a1d6-65700d81752e None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:49.456161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e0b7e-215f-498a-a1d6-65700d81752e None admin] RBAC: Adding query filter params (name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:49.456826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e0b7e-215f-498a-a1d6-65700d81752e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:49.458631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e0b7e-215f-498a-a1d6-65700d81752e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:49.469546 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 320/631] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:44:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:49.476990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e0b7e-215f-498a-a1d6-65700d81752e None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:49.506033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:49.527695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:49.544139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12e9e3-5e56-41cc-b999-bfddd6aa81ab None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:49.584595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb840602-ceb3-4630-8551-2c490e2d21eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:49.585229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb840602-ceb3-4630-8551-2c490e2d21eb None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:49.585518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb840602-ceb3-4630-8551-2c490e2d21eb None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:49.585800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb840602-ceb3-4630-8551-2c490e2d21eb None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:49.586608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb840602-ceb3-4630-8551-2c490e2d21eb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:49.586920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb840602-ceb3-4630-8551-2c490e2d21eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:49.589207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb840602-ceb3-4630-8551-2c490e2d21eb None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:49.612701 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 312/632] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Jul 30 20:44:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:49.616308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb840602-ceb3-4630-8551-2c490e2d21eb None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:49.653398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e0b7e-215f-498a-a1d6-65700d81752e None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:49.688939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccf1a7-d2ba-4db9-847e-85fd92bda87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:49.689754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccf1a7-d2ba-4db9-847e-85fd92bda87a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:49.690170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccf1a7-d2ba-4db9-847e-85fd92bda87a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:49.690547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccf1a7-d2ba-4db9-847e-85fd92bda87a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:49.702657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccf1a7-d2ba-4db9-847e-85fd92bda87a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:49.704348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccf1a7-d2ba-4db9-847e-85fd92bda87a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:49.719978 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-38ccf1a7-d2ba-4db9-847e-85fd92bda87a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:49.719978 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:49.719978 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:49.719978 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:49.719978 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:49.719978 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:49.719978 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:49.719978 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:49.719978 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:49.719978 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:49.719978 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:49.719978 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:49.719978 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:49.719978 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:49.719978 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:49.721084 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:49.721084 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:49.721084 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:49.721084 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:49.721084 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:49.721084 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:49.721084 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:49.721084 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:49.721084 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:49.721084 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:49.721084 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:49.721084 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:49.721084 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:49.721084 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:49.721084 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:49.721084 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:49.721084 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:49.722211 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:49.722211 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:49.722211 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:49.722211 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:49.723736 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 321/633] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:44:49.725035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93994dfe-d235-4d64-bd45-814b4f20b95d None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:49.729907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93994dfe-d235-4d64-bd45-814b4f20b95d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:49.730303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93994dfe-d235-4d64-bd45-814b4f20b95d None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:49.731996 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 322/634] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:49.732822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93994dfe-d235-4d64-bd45-814b4f20b95d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:49.762581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb840602-ceb3-4630-8551-2c490e2d21eb None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:49.809730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:49.818915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48593eda-5de5-4a06-bbe4-25d91e07ffc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:49.819826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48593eda-5de5-4a06-bbe4-25d91e07ffc9 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:49.820280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48593eda-5de5-4a06-bbe4-25d91e07ffc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:49.821246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48593eda-5de5-4a06-bbe4-25d91e07ffc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:49.828813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:49.851777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93994dfe-d235-4d64-bd45-814b4f20b95d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:49.892856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93a08c-c247-4473-8f57-6b9e60f5b0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:49.893734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93a08c-c247-4473-8f57-6b9e60f5b0e5 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:49.894171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93a08c-c247-4473-8f57-6b9e60f5b0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:49.895177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93a08c-c247-4473-8f57-6b9e60f5b0e5 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:49.896195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93a08c-c247-4473-8f57-6b9e60f5b0e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:49.897385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93a08c-c247-4473-8f57-6b9e60f5b0e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:49.899185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93a08c-c247-4473-8f57-6b9e60f5b0e5 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:49.913425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48593eda-5de5-4a06-bbe4-25d91e07ffc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:49.915247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48593eda-5de5-4a06-bbe4-25d91e07ffc9 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:49.919803 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 323/635] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:49.921288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecd8ea-105a-4756-ae5b-a57a6cf0ace9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:49.921738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecd8ea-105a-4756-ae5b-a57a6cf0ace9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:49.922149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecd8ea-105a-4756-ae5b-a57a6cf0ace9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:49.941503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-85ecd8ea-105a-4756-ae5b-a57a6cf0ace9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:49.942857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-85ecd8ea-105a-4756-ae5b-a57a6cf0ace9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:50.031788 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 324/636] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:50.033467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecd8ea-105a-4756-ae5b-a57a6cf0ace9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:50.062271 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 313/637] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:50.067746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48593eda-5de5-4a06-bbe4-25d91e07ffc9 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:50.100165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:50.134981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:50.170262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecd8ea-105a-4756-ae5b-a57a6cf0ace9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:50.177998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48593eda-5de5-4a06-bbe4-25d91e07ffc9 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:50.211826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e30c9f-f12c-4cc9-b232-f2aacebbb1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:50.212473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e30c9f-f12c-4cc9-b232-f2aacebbb1b2 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:50.212758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e30c9f-f12c-4cc9-b232-f2aacebbb1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:50.213031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e30c9f-f12c-4cc9-b232-f2aacebbb1b2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:50.213889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fe99c-7fb3-4d26-8ced-84bc190fb4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:50.214655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fe99c-7fb3-4d26-8ced-84bc190fb4fd None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:50.215041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fe99c-7fb3-4d26-8ced-84bc190fb4fd None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:50.215474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fe99c-7fb3-4d26-8ced-84bc190fb4fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:50.221104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e30c9f-f12c-4cc9-b232-f2aacebbb1b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:50.222913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e30c9f-f12c-4cc9-b232-f2aacebbb1b2 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:50.226229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fe99c-7fb3-4d26-8ced-84bc190fb4fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:50.231189 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-c97fe99c-7fb3-4d26-8ced-84bc190fb4fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:50.231189 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:50.231189 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:50.231189 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:50.231189 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:50.231189 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:50.231189 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:50.231189 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:50.231189 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:50.231189 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:50.231189 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:50.231189 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:50.231189 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:50.231189 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:50.231189 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:50.231189 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:50.232297 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:50.232297 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:50.232297 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:50.232297 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:50.232297 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:50.232297 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:50.232297 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:50.232297 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:50.232297 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:50.232297 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:50.232297 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:50.232297 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:50.232297 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:50.232297 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:50.232297 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:50.232297 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:50.233152 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:50.233152 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:50.233152 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:50.233152 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:50.233152 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:50.233152 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:50.233152 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:50.233152 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:50.233152 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:50.233152 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:50.233152 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:50.233152 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:50.233909 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 314/638] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:44:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:50.234348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fe99c-7fb3-4d26-8ced-84bc190fb4fd None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:50.236825 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-50e30c9f-f12c-4cc9-b232-f2aacebbb1b2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 30 20:44:50.236825 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:50.236825 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:50.236825 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:50.236825 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:50.236825 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:50.236825 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:50.236825 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:50.236825 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:50.236825 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:50.236825 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:50.236825 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:50.236825 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:44:50.236825 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:44:50.236825 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:44:50.236825 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:44:50.237780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:50.237780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:50.237780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:44:50.237780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:50.237780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:44:50.237780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:50.237780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:50.237780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:50.237780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:50.237780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:50.237780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:50.237780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:50.237780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:50.237780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:50.237780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:50.237780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:50.237780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:50.237780 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:50.238733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:50.238733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:50.238733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:44:50.238733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:44:50.238733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:44:50.238733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:44:50.238733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:44:50.238733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:44:50.238733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 30 20:44:50.238733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:50.238733 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 325/639] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:50.239381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4af6d-0b4c-4f0d-8422-c87263688819 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:50.239453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4af6d-0b4c-4f0d-8422-c87263688819 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:50.240527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4af6d-0b4c-4f0d-8422-c87263688819 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:50.246252 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 326/640] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:50.246252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4af6d-0b4c-4f0d-8422-c87263688819 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:50.345561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:50.356842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fe99c-7fb3-4d26-8ced-84bc190fb4fd None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:50.362825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4af6d-0b4c-4f0d-8422-c87263688819 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:50.393460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ee3c9-ae37-4d9b-a061-1932cf726b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:50.394322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ee3c9-ae37-4d9b-a061-1932cf726b8f None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:50.394755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ee3c9-ae37-4d9b-a061-1932cf726b8f None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:50.395214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ee3c9-ae37-4d9b-a061-1932cf726b8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:50.395705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:50.401747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590a720-d4fd-4e81-b395-583685bd938e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:50.402452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590a720-d4fd-4e81-b395-583685bd938e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:50.402808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590a720-d4fd-4e81-b395-583685bd938e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:50.403153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590a720-d4fd-4e81-b395-583685bd938e None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:50.403966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590a720-d4fd-4e81-b395-583685bd938e None admin] RBAC: Adding query filter params (name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:50.404339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590a720-d4fd-4e81-b395-583685bd938e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:50.405822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590a720-d4fd-4e81-b395-583685bd938e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:50.407506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ee3c9-ae37-4d9b-a061-1932cf726b8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:50.409019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ee3c9-ae37-4d9b-a061-1932cf726b8f None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:50.420916 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 327/641] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:44:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:50.420916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590a720-d4fd-4e81-b395-583685bd938e None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:50.424627 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-7f2ee3c9-ae37-4d9b-a061-1932cf726b8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:50.424627 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:50.424627 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:50.424627 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:50.424627 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:50.424627 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:50.424627 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:50.424627 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:50.424627 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:50.424627 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:50.424627 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:50.424627 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:50.424627 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:50.424627 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:50.424627 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:50.425756 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:50.425756 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:50.425756 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:50.425756 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:50.425756 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:50.425756 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:50.425756 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:50.425756 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:50.425756 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:50.425756 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:50.425756 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:50.425756 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:50.425756 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:50.425756 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:50.425756 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:50.425756 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:50.425756 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:50.426740 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:50.426740 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:50.426740 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:50.426740 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:50.426740 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 315/642] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:50.432011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42c70d-4e09-44c6-9acf-93b52697e3f5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:50.432289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42c70d-4e09-44c6-9acf-93b52697e3f5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:50.432570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42c70d-4e09-44c6-9acf-93b52697e3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:50.450275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3e42c70d-4e09-44c6-9acf-93b52697e3f5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:50.451551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3e42c70d-4e09-44c6-9acf-93b52697e3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:50.527334 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 316/643] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:50.527533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42c70d-4e09-44c6-9acf-93b52697e3f5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:50.538815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590a720-d4fd-4e81-b395-583685bd938e None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:50.576402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6a75a-b2dd-49f0-8395-c8f6da98923b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:50.577036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6a75a-b2dd-49f0-8395-c8f6da98923b None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:50.577322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6a75a-b2dd-49f0-8395-c8f6da98923b None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:50.577600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6a75a-b2dd-49f0-8395-c8f6da98923b None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:50.578395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6a75a-b2dd-49f0-8395-c8f6da98923b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:50.578705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6a75a-b2dd-49f0-8395-c8f6da98923b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:50.580161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6a75a-b2dd-49f0-8395-c8f6da98923b None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:50.598762 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 328/644] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Jul 30 20:44:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:50.600955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6a75a-b2dd-49f0-8395-c8f6da98923b None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:50.612621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:50.644505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42c70d-4e09-44c6-9acf-93b52697e3f5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:50.659522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:50.680256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb4481-3ad3-4acb-a208-fc66dc5554c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:50.680836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb4481-3ad3-4acb-a208-fc66dc5554c5 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:50.681122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb4481-3ad3-4acb-a208-fc66dc5554c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:50.681401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb4481-3ad3-4acb-a208-fc66dc5554c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:50.691799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb4481-3ad3-4acb-a208-fc66dc5554c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:50.693287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb4481-3ad3-4acb-a208-fc66dc5554c5 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:50.708275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-7ddb4481-3ad3-4acb-a208-fc66dc5554c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:50.708275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:50.708275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:50.708275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:50.708275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:50.708275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:50.708275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:50.708275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:50.708275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:50.708275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:50.708275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:50.708275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:50.708275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:50.708275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:50.708275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:50.709744 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:50.709744 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:50.709744 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:50.709744 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:50.709744 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:50.709744 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:50.709744 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:50.709744 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:50.709744 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:50.709744 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:50.709744 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:50.709744 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:50.709744 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:50.709744 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:50.709744 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:50.709744 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:50.709744 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:50.710799 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:50.710799 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:50.710799 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:50.710799 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:50.710799 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 317/645] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:50.714934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6a75a-b2dd-49f0-8395-c8f6da98923b None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:50.715119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb4481-3ad3-4acb-a208-fc66dc5554c5 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:50.753815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471173b-029f-460d-8e46-22dbcab46c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:50.754465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471173b-029f-460d-8e46-22dbcab46c93 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:50.754752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471173b-029f-460d-8e46-22dbcab46c93 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:50.755034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471173b-029f-460d-8e46-22dbcab46c93 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:50.756318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471173b-029f-460d-8e46-22dbcab46c93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:50.756628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471173b-029f-460d-8e46-22dbcab46c93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:50.758003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471173b-029f-460d-8e46-22dbcab46c93 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:50.769655 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 329/646] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:50.770278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471173b-029f-460d-8e46-22dbcab46c93 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:50.826352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb4481-3ad3-4acb-a208-fc66dc5554c5 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:50.851377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:50.863848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4221c8-cd67-4a96-8ddf-65b92d59aa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:50.864587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4221c8-cd67-4a96-8ddf-65b92d59aa15 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:50.864909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4221c8-cd67-4a96-8ddf-65b92d59aa15 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:50.865189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4221c8-cd67-4a96-8ddf-65b92d59aa15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:50.875406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471173b-029f-460d-8e46-22dbcab46c93 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:50.875987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4221c8-cd67-4a96-8ddf-65b92d59aa15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:50.881464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-9e4221c8-cd67-4a96-8ddf-65b92d59aa15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:50.881464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:50.881464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:50.881464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:50.881464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:50.881464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:50.881464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:50.881464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:50.881464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:50.881464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:50.881464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:50.881464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:50.881464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:50.881464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:50.881464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:50.881464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:50.882573 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:50.882573 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:50.882573 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:50.882573 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:50.882573 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:50.882573 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:50.882573 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:50.882573 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:50.882573 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:50.882573 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:50.882573 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:50.882573 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:50.882573 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:50.882573 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:50.882573 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:50.882573 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:50.883439 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:50.883439 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:50.883439 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:50.883439 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:50.883439 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:50.883439 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:50.883439 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:50.883439 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:50.883439 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:50.883439 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:50.883439 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:50.883439 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:50.883439 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 318/647] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:44:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:50.883439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4221c8-cd67-4a96-8ddf-65b92d59aa15 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:50.894330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:50.919228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784bf85-5156-4bf4-b7be-be35389e2d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:50.919889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784bf85-5156-4bf4-b7be-be35389e2d75 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:50.920175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784bf85-5156-4bf4-b7be-be35389e2d75 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:50.920459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784bf85-5156-4bf4-b7be-be35389e2d75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:50.998052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784bf85-5156-4bf4-b7be-be35389e2d75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:50.999472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784bf85-5156-4bf4-b7be-be35389e2d75 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:51.007967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4221c8-cd67-4a96-8ddf-65b92d59aa15 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:51.043455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12716c08-59b1-4ef0-9c29-a5dc548dfb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:51.044108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12716c08-59b1-4ef0-9c29-a5dc548dfb9e None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:51.044399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12716c08-59b1-4ef0-9c29-a5dc548dfb9e None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:51.044681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12716c08-59b1-4ef0-9c29-a5dc548dfb9e None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:51.045746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12716c08-59b1-4ef0-9c29-a5dc548dfb9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:51.046067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12716c08-59b1-4ef0-9c29-a5dc548dfb9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:51.047829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12716c08-59b1-4ef0-9c29-a5dc548dfb9e None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:51.061222 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 319/648] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:51.062105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12716c08-59b1-4ef0-9c29-a5dc548dfb9e None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:51.109864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:51.113154 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 330/649] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:51.113868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784bf85-5156-4bf4-b7be-be35389e2d75 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:51.128959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:51.174518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12716c08-59b1-4ef0-9c29-a5dc548dfb9e None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:51.213345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b886c-5ac1-4024-8e3f-3e36ced55bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:51.214093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b886c-5ac1-4024-8e3f-3e36ced55bfc None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:51.214443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b886c-5ac1-4024-8e3f-3e36ced55bfc None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:51.214806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b886c-5ac1-4024-8e3f-3e36ced55bfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:51.222273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b886c-5ac1-4024-8e3f-3e36ced55bfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:51.223851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b886c-5ac1-4024-8e3f-3e36ced55bfc None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:51.225364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784bf85-5156-4bf4-b7be-be35389e2d75 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:51.237495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-1e3b886c-5ac1-4024-8e3f-3e36ced55bfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:51.237495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:51.237495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:51.237495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:51.237495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:51.237495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:51.237495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:51.237495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:51.237495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:51.237495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:51.237495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:51.237495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:51.237495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:44:51.237495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:44:51.237495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:44:51.238409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:44:51.238409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:51.238409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:51.238409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:51.238409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:51.238409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:51.238409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:51.238409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:51.238409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:51.238409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:51.238409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:51.238409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:51.238409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:51.238409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:51.238409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:51.238409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:51.238409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:51.239476 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:44:51.239476 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:44:51.239476 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:44:51.239476 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:44:51.239476 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:44:51.239476 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:44:51.239476 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:51.239476 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:51.239476 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 320/650] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:51.239476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b886c-5ac1-4024-8e3f-3e36ced55bfc None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:51.266449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3b5ed-e1e8-4690-9911-89ae00970a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:51.266998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3b5ed-e1e8-4690-9911-89ae00970a14 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:51.267310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3b5ed-e1e8-4690-9911-89ae00970a14 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:51.267593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3b5ed-e1e8-4690-9911-89ae00970a14 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:51.268308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3b5ed-e1e8-4690-9911-89ae00970a14 None admin] RBAC: Adding query filter params (name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:51.268614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3b5ed-e1e8-4690-9911-89ae00970a14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:51.270031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3b5ed-e1e8-4690-9911-89ae00970a14 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:51.278330 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 331/651] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:44:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:51.278969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3b5ed-e1e8-4690-9911-89ae00970a14 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:51.357833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b886c-5ac1-4024-8e3f-3e36ced55bfc None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:51.362667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:51.363423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:51.396325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3b5ed-e1e8-4690-9911-89ae00970a14 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:51.406411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c1ffa-ac1f-4063-ac12-786429291612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:51.407092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c1ffa-ac1f-4063-ac12-786429291612 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:51.407417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c1ffa-ac1f-4063-ac12-786429291612 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:51.407705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c1ffa-ac1f-4063-ac12-786429291612 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:51.417451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c1ffa-ac1f-4063-ac12-786429291612 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:51.418980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c1ffa-ac1f-4063-ac12-786429291612 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:51.432663 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-fa3c1ffa-ac1f-4063-ac12-786429291612 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 30 20:44:51.432663 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:51.432663 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:51.432663 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:51.432663 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:51.432663 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:51.432663 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:51.432663 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:51.432663 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:51.432663 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:51.432663 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:51.432663 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:51.432663 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:44:51.432663 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:44:51.432663 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:44:51.432663 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:44:51.433688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:51.433688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:51.433688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:44:51.433688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:51.433688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:44:51.433688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:51.433688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:51.433688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:51.433688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:51.433688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:51.433688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:51.433688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:51.433688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:51.433688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:51.433688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:51.433688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:51.433688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:51.433688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:51.434651 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:51.434651 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:51.434651 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:44:51.434651 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:44:51.434651 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:44:51.434651 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:44:51.434651 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:44:51.434651 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:44:51.434651 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 30 20:44:51.434651 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:51.434651 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 321/652] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:51.434651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c1ffa-ac1f-4063-ac12-786429291612 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:51.441368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d93760-1466-4fd0-8bd5-27d0b86e255f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:51.442025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d93760-1466-4fd0-8bd5-27d0b86e255f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:51.442329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d93760-1466-4fd0-8bd5-27d0b86e255f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:51.442701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d93760-1466-4fd0-8bd5-27d0b86e255f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:51.453834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d93760-1466-4fd0-8bd5-27d0b86e255f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:51.455281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d93760-1466-4fd0-8bd5-27d0b86e255f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:51.471358 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-26d93760-1466-4fd0-8bd5-27d0b86e255f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:51.471358 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:51.471358 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:51.471358 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:51.471358 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:51.471358 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:51.471358 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:51.471358 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:51.471358 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:51.471358 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:51.471358 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:51.471358 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:51.471358 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:51.471358 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:51.471358 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:51.472514 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:51.472514 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:51.472514 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:51.472514 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:51.472514 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:51.472514 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:51.472514 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:51.472514 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:51.472514 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:51.472514 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:51.472514 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:51.472514 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:51.472514 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:51.472514 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:51.472514 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:51.472514 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:51.472514 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:51.473474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:51.473474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:51.473474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:51.473474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:51.473474 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 332/653] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:51.474019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d93760-1466-4fd0-8bd5-27d0b86e255f None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:51.551842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c1ffa-ac1f-4063-ac12-786429291612 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:51.578167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d93760-1466-4fd0-8bd5-27d0b86e255f None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:51.586970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fe29c-d77e-4dc9-8241-af54e35faed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:51.587641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fe29c-d77e-4dc9-8241-af54e35faed1 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:51.587924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fe29c-d77e-4dc9-8241-af54e35faed1 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:51.588200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fe29c-d77e-4dc9-8241-af54e35faed1 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:51.588954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fe29c-d77e-4dc9-8241-af54e35faed1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:51.589265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fe29c-d77e-4dc9-8241-af54e35faed1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:51.590692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fe29c-d77e-4dc9-8241-af54e35faed1 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:51.603338 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 322/654] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:44:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:51.603971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fe29c-d77e-4dc9-8241-af54e35faed1 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:51.604097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:51.617148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cded35-4d5d-4065-b6f4-92a5ea18d9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:51.617798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cded35-4d5d-4065-b6f4-92a5ea18d9ff None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:51.618086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cded35-4d5d-4065-b6f4-92a5ea18d9ff None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:51.618366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cded35-4d5d-4065-b6f4-92a5ea18d9ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:51.629812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cded35-4d5d-4065-b6f4-92a5ea18d9ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:51.631177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:51.631314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cded35-4d5d-4065-b6f4-92a5ea18d9ff None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:51.645578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-c4cded35-4d5d-4065-b6f4-92a5ea18d9ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:51.645578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:51.645578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:51.645578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:51.645578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:51.645578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:51.645578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:51.645578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:51.645578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:51.645578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:51.645578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:51.645578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:51.645578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:51.645578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:51.645578 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:51.647047 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:51.647047 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:51.647047 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:51.647047 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:51.647047 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:51.647047 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:51.647047 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:51.647047 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:51.647047 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:51.647047 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:51.647047 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:51.647047 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:51.647047 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:51.647047 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:51.647047 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:51.647047 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:51.647047 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:51.648178 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:51.648178 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:51.648178 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:51.648178 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:51.648178 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 333/655] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:51.648178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cded35-4d5d-4065-b6f4-92a5ea18d9ff None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:51.705128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fe29c-d77e-4dc9-8241-af54e35faed1 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:51.738815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d073b57-b616-4052-8c2c-e11b9e27b955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:51.739564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d073b57-b616-4052-8c2c-e11b9e27b955 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:51.740394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d073b57-b616-4052-8c2c-e11b9e27b955 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:51.740673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d073b57-b616-4052-8c2c-e11b9e27b955 None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:51.741479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d073b57-b616-4052-8c2c-e11b9e27b955 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:51.741785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d073b57-b616-4052-8c2c-e11b9e27b955 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:51.743634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d073b57-b616-4052-8c2c-e11b9e27b955 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:51.749140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cded35-4d5d-4065-b6f4-92a5ea18d9ff None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:51.763802 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 323/656] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Jul 30 20:44:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:51.765043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c178ec-e4db-4ddd-acb5-9245297c53ae None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:51.765341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c178ec-e4db-4ddd-acb5-9245297c53ae None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:51.765622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c178ec-e4db-4ddd-acb5-9245297c53ae None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:51.766980 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 324/657] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:51.767527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c178ec-e4db-4ddd-acb5-9245297c53ae None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:51.791186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259426f9-2429-4962-a349-fcbac35e08af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:51.791864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259426f9-2429-4962-a349-fcbac35e08af None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:51.792152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259426f9-2429-4962-a349-fcbac35e08af None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:51.792429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259426f9-2429-4962-a349-fcbac35e08af None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:51.793122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259426f9-2429-4962-a349-fcbac35e08af None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:51.793430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259426f9-2429-4962-a349-fcbac35e08af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:51.794797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259426f9-2429-4962-a349-fcbac35e08af None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:51.808753 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 334/658] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:51.809971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259426f9-2429-4962-a349-fcbac35e08af None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:51.852625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:51.857714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:51.877318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c178ec-e4db-4ddd-acb5-9245297c53ae None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:51.910247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab688063-a21e-4fcc-a5b3-47131f9dbbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:51.910935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab688063-a21e-4fcc-a5b3-47131f9dbbae None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:51.911222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab688063-a21e-4fcc-a5b3-47131f9dbbae None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:51.911522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab688063-a21e-4fcc-a5b3-47131f9dbbae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:51.912797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab688063-a21e-4fcc-a5b3-47131f9dbbae None admin] RBAC: Adding query filter params (role.id=50fb737d5edf48298d0a6061ba652acb, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=08a2a5793b7a4797a470719a682e541a) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:51.913102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab688063-a21e-4fcc-a5b3-47131f9dbbae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:51.913712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259426f9-2429-4962-a349-fcbac35e08af None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:51.914518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab688063-a21e-4fcc-a5b3-47131f9dbbae None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:51.920294 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 325/659] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:44:51 2022] GET /identity/v3/role_assignments?user.id=08a2a5793b7a4797a470719a682e541a&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=50fb737d5edf48298d0a6061ba652acb => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:51.921386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab688063-a21e-4fcc-a5b3-47131f9dbbae None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:51.954409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12aa6e-b4ba-4ba2-ad81-7fc1387572a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:51.955158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12aa6e-b4ba-4ba2-ad81-7fc1387572a5 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:51.955482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12aa6e-b4ba-4ba2-ad81-7fc1387572a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:51.955874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12aa6e-b4ba-4ba2-ad81-7fc1387572a5 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:51.956584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12aa6e-b4ba-4ba2-ad81-7fc1387572a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:51.956896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12aa6e-b4ba-4ba2-ad81-7fc1387572a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:51.958372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12aa6e-b4ba-4ba2-ad81-7fc1387572a5 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:51.977957 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 335/660] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:51.977957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8d5c5-556e-4645-bc5f-eb250ada4d1f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:51.977957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8d5c5-556e-4645-bc5f-eb250ada4d1f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:51.977957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8d5c5-556e-4645-bc5f-eb250ada4d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:51.997054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fde8d5c5-556e-4645-bc5f-eb250ada4d1f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:51.998133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fde8d5c5-556e-4645-bc5f-eb250ada4d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:52.058406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab688063-a21e-4fcc-a5b3-47131f9dbbae None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:52.083350 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 336/661] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:52.087558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8d5c5-556e-4645-bc5f-eb250ada4d1f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:52.097966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d855976-550c-4a51-8041-c41517710711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:52.098518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d855976-550c-4a51-8041-c41517710711 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:52.098792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d855976-550c-4a51-8041-c41517710711 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:52.099595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d855976-550c-4a51-8041-c41517710711 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:52.118290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:52.125115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:52.184002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d855976-550c-4a51-8041-c41517710711 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:52.185457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d855976-550c-4a51-8041-c41517710711 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:52.212148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8d5c5-556e-4645-bc5f-eb250ada4d1f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:52.248873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a7994-b989-487c-bbe8-ce8bfe66c7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:52.249517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a7994-b989-487c-bbe8-ce8bfe66c7eb None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:52.249803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a7994-b989-487c-bbe8-ce8bfe66c7eb None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:52.250075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a7994-b989-487c-bbe8-ce8bfe66c7eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:52.256880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a7994-b989-487c-bbe8-ce8bfe66c7eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:52.258324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a7994-b989-487c-bbe8-ce8bfe66c7eb None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:52.269512 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-865a7994-b989-487c-bbe8-ce8bfe66c7eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:52.269512 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:52.269512 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:52.269512 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:52.269512 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:52.269512 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:52.269512 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:52.269512 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:52.269512 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:52.269512 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:52.269512 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:52.269512 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:52.269512 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:44:52.269512 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:44:52.269512 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:44:52.270602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:44:52.270602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:52.270602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:52.270602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:52.270602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:52.270602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:52.270602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:52.270602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:52.270602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:52.270602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:52.270602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:52.270602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:52.270602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:52.270602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:52.270602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:52.270602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:52.270602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:52.272284 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:44:52.272284 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:44:52.272284 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:44:52.272284 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:44:52.272284 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:44:52.272284 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:44:52.272284 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:52.272284 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:52.272284 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 337/662] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:52.272284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a7994-b989-487c-bbe8-ce8bfe66c7eb None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:52.294854 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 326/663] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:52.295869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d855976-550c-4a51-8041-c41517710711 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:52.345472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:52.376605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:52.390575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a7994-b989-487c-bbe8-ce8bfe66c7eb None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:52.403073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d855976-550c-4a51-8041-c41517710711 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:52.426503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59032b-6201-401b-877a-3cc68521203c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:52.427134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59032b-6201-401b-877a-3cc68521203c None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:52.427979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59032b-6201-401b-877a-3cc68521203c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:52.428360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59032b-6201-401b-877a-3cc68521203c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:52.435857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff59032b-6201-401b-877a-3cc68521203c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:52.437291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff59032b-6201-401b-877a-3cc68521203c None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:52.438982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e7f05-69eb-4c7d-8651-f26c649ed728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:52.439648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e7f05-69eb-4c7d-8651-f26c649ed728 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:52.439933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e7f05-69eb-4c7d-8651-f26c649ed728 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:52.440199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e7f05-69eb-4c7d-8651-f26c649ed728 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:52.450562 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-ff59032b-6201-401b-877a-3cc68521203c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 30 20:44:52.450562 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:52.450562 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:52.450562 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:52.450562 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:52.450562 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:52.450562 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:52.450562 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:52.450562 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:52.450562 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:52.450562 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:52.450562 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:52.450562 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:44:52.450562 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:44:52.450562 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:44:52.450562 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:44:52.452170 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:52.452170 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:52.452170 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:44:52.452170 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:52.452170 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:44:52.452170 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:52.452170 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:52.452170 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:52.452170 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:52.452170 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:52.452170 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:52.452170 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:52.452170 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:52.452170 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:52.452170 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:52.452170 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:52.452170 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:52.452170 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:52.453475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:52.453475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:52.453475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:44:52.453475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:44:52.453475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:44:52.453475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:44:52.453475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:44:52.453475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:44:52.453475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 30 20:44:52.453475 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:52.454029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e7f05-69eb-4c7d-8651-f26c649ed728 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:52.455688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-d99e7f05-69eb-4c7d-8651-f26c649ed728 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:52.455688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:52.455688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:52.455688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:52.455688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:52.455688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:52.455688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:52.455688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:52.455688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:52.455688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:52.455688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:52.455688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:52.455688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:52.455688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:52.455688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:52.455688 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:52.462561 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:52.462561 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:52.462561 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:52.462561 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:52.462561 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:52.462561 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:52.462561 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:52.462561 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:52.462561 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:52.462561 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:52.462561 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:52.462561 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:52.462561 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:52.462561 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:52.462561 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:52.462561 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:52.466409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:52.466409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:52.466409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:52.466409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:52.466409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:52.466409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:52.466409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:52.466409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:52.466409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:52.466409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:52.466409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:44:52.466409 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:52.467959 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 338/664] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:44:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:52.468114 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 327/665] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:44:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:52.468255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59032b-6201-401b-877a-3cc68521203c None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:52.468395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e7f05-69eb-4c7d-8651-f26c649ed728 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:52.563037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e7f05-69eb-4c7d-8651-f26c649ed728 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:52.571075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:52.573695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59032b-6201-401b-877a-3cc68521203c None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:52.601184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee0650-8105-4609-a0ad-7395cf589ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:52.601858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee0650-8105-4609-a0ad-7395cf589ee7 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:52.602140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee0650-8105-4609-a0ad-7395cf589ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:52.602414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee0650-8105-4609-a0ad-7395cf589ee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:52.609253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78c31f-d316-4d4e-bf12-3bc6e6af1bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:52.610040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78c31f-d316-4d4e-bf12-3bc6e6af1bee None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:52.610322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78c31f-d316-4d4e-bf12-3bc6e6af1bee None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:52.610653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78c31f-d316-4d4e-bf12-3bc6e6af1bee None admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:52.611364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78c31f-d316-4d4e-bf12-3bc6e6af1bee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:52.611676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78c31f-d316-4d4e-bf12-3bc6e6af1bee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:52.612952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee0650-8105-4609-a0ad-7395cf589ee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:52.613138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78c31f-d316-4d4e-bf12-3bc6e6af1bee None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:52.614369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee0650-8105-4609-a0ad-7395cf589ee7 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:52.626378 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 339/666] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:52.627262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78c31f-d316-4d4e-bf12-3bc6e6af1bee None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:52.635982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-b2ee0650-8105-4609-a0ad-7395cf589ee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:52.635982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:52.635982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:52.635982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:52.635982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:52.635982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:52.635982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:52.635982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:52.635982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:52.635982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:52.635982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:52.635982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:52.635982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:52.635982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:52.635982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:52.637040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:52.637040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:52.637040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:52.637040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:52.637040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:52.637040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:52.637040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:52.637040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:52.637040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:52.637040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:52.637040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:52.637040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:52.637040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:52.637040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:52.637040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:52.637040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:52.637040 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:52.637946 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:52.637946 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:52.637946 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:52.637946 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:52.637946 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 328/667] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:52.638230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee0650-8105-4609-a0ad-7395cf589ee7 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:52.644407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:52.741140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78c31f-d316-4d4e-bf12-3bc6e6af1bee None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:52.750109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee0650-8105-4609-a0ad-7395cf589ee7 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:52.777553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d580ce-15cc-4217-aef6-7b3aea3a319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:52.778170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d580ce-15cc-4217-aef6-7b3aea3a319b None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:52.778450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d580ce-15cc-4217-aef6-7b3aea3a319b None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:52.778721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d580ce-15cc-4217-aef6-7b3aea3a319b None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:52.779536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d580ce-15cc-4217-aef6-7b3aea3a319b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:52.779839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d580ce-15cc-4217-aef6-7b3aea3a319b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:52.781275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d580ce-15cc-4217-aef6-7b3aea3a319b None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:52.785179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958d755-f04a-4e84-8f2f-1dd266fcab92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:52.785792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958d755-f04a-4e84-8f2f-1dd266fcab92 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:52.786072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958d755-f04a-4e84-8f2f-1dd266fcab92 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:52.786347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958d755-f04a-4e84-8f2f-1dd266fcab92 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:52.787610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958d755-f04a-4e84-8f2f-1dd266fcab92 None admin] RBAC: Adding query filter params (name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:52.787964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958d755-f04a-4e84-8f2f-1dd266fcab92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:52.789322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958d755-f04a-4e84-8f2f-1dd266fcab92 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:52.799371 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 340/668] 10.222.0.17 () {56 vars in 1139 bytes} [Sat Jul 30 20:44:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:52.800169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d580ce-15cc-4217-aef6-7b3aea3a319b None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:52.806476 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 329/669] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:44:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:52.807544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958d755-f04a-4e84-8f2f-1dd266fcab92 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:52.835890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:52.871093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:52.907278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d580ce-15cc-4217-aef6-7b3aea3a319b None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:52.920953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958d755-f04a-4e84-8f2f-1dd266fcab92 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:52.941065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f12f75-2e52-4c68-a3c6-b3ed40685c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:52.941876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f12f75-2e52-4c68-a3c6-b3ed40685c10 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:52.942161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f12f75-2e52-4c68-a3c6-b3ed40685c10 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:52.942436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f12f75-2e52-4c68-a3c6-b3ed40685c10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:52.943803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f12f75-2e52-4c68-a3c6-b3ed40685c10 None admin] RBAC: Adding query filter params (role.id=50fb737d5edf48298d0a6061ba652acb, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=60d1fa32e98f45128f990a107db45eae) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:52.944111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f12f75-2e52-4c68-a3c6-b3ed40685c10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:52.945543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f12f75-2e52-4c68-a3c6-b3ed40685c10 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:52.951120 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 341/670] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:44:52 2022] GET /identity/v3/role_assignments?user.id=60d1fa32e98f45128f990a107db45eae&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=50fb737d5edf48298d0a6061ba652acb => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:52.951933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f12f75-2e52-4c68-a3c6-b3ed40685c10 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:52.965215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2eb91-0dd0-46f6-a5c2-ffb1c16b5edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:52.966114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2eb91-0dd0-46f6-a5c2-ffb1c16b5edf None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:52.966541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2eb91-0dd0-46f6-a5c2-ffb1c16b5edf None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:52.967093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2eb91-0dd0-46f6-a5c2-ffb1c16b5edf None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:52.967843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2eb91-0dd0-46f6-a5c2-ffb1c16b5edf None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:52.968150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2eb91-0dd0-46f6-a5c2-ffb1c16b5edf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:52.969663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2eb91-0dd0-46f6-a5c2-ffb1c16b5edf None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:52.983874 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 330/671] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:52.984848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2eb91-0dd0-46f6-a5c2-ffb1c16b5edf None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:53.084969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f12f75-2e52-4c68-a3c6-b3ed40685c10 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:53.117596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:53.131576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb29215-0752-4c20-9831-100d6ad9450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:53.132241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb29215-0752-4c20-9831-100d6ad9450f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:53.132600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb29215-0752-4c20-9831-100d6ad9450f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:53.132952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb29215-0752-4c20-9831-100d6ad9450f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:53.145212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2eb91-0dd0-46f6-a5c2-ffb1c16b5edf None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:53.176154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:53.195681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125eb62-3ada-423d-8ba2-a40b5046ea99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:53.197589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125eb62-3ada-423d-8ba2-a40b5046ea99 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:53.197589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125eb62-3ada-423d-8ba2-a40b5046ea99 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:53.197589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125eb62-3ada-423d-8ba2-a40b5046ea99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:53.210004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125eb62-3ada-423d-8ba2-a40b5046ea99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:53.212166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125eb62-3ada-423d-8ba2-a40b5046ea99 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:53.229424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-2125eb62-3ada-423d-8ba2-a40b5046ea99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:53.229424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:53.229424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:53.229424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:53.229424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:53.229424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:53.229424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:53.229424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:53.229424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:53.229424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:53.229424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:53.229424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:53.229424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:53.229424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:53.229424 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:53.230379 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:53.230379 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:53.230379 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:53.230379 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:53.230379 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:53.230379 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:53.230379 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:53.230379 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:53.230379 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:53.230379 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:53.230379 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:53.230379 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:53.230379 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:53.230379 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:53.230379 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:53.230379 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:53.230379 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:53.231892 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:53.231892 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:53.231892 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:53.231892 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:53.231892 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 331/672] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:53.231892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125eb62-3ada-423d-8ba2-a40b5046ea99 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:53.233831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb29215-0752-4c20-9831-100d6ad9450f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:53.236612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb29215-0752-4c20-9831-100d6ad9450f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:53.359821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125eb62-3ada-423d-8ba2-a40b5046ea99 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:53.365734 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 342/673] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:53.365734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb29215-0752-4c20-9831-100d6ad9450f None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:53.395272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:53.409751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:53.418855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6c632-393a-4262-a8fd-0a714c5dc69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:53.420059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6c632-393a-4262-a8fd-0a714c5dc69b None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:53.420504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6c632-393a-4262-a8fd-0a714c5dc69b None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:53.420952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6c632-393a-4262-a8fd-0a714c5dc69b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:53.431613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6c632-393a-4262-a8fd-0a714c5dc69b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:53.433567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6c632-393a-4262-a8fd-0a714c5dc69b None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:53.445930 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-e6b6c632-393a-4262-a8fd-0a714c5dc69b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:53.445930 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:53.445930 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:53.445930 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:53.445930 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:53.445930 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:53.445930 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:53.445930 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:53.445930 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:53.445930 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:53.445930 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:53.445930 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:53.445930 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:44:53.445930 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:44:53.445930 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:44:53.446845 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:44:53.446845 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:53.446845 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:53.446845 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:53.446845 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:53.446845 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:53.446845 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:53.446845 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:53.446845 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:53.446845 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:53.446845 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:53.446845 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:53.446845 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:53.446845 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:53.446845 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:53.446845 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:53.446845 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:53.448359 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:44:53.448359 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:44:53.448359 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:44:53.448359 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:44:53.448359 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:44:53.448359 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:44:53.448359 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:53.448359 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:53.451946 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 332/674] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:53.452826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6c632-393a-4262-a8fd-0a714c5dc69b None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:53.494003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb29215-0752-4c20-9831-100d6ad9450f None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:53.543071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ada8f0-1811-414f-aa9e-c53789a07e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:53.544446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ada8f0-1811-414f-aa9e-c53789a07e0b None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:53.544917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ada8f0-1811-414f-aa9e-c53789a07e0b None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:53.545395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ada8f0-1811-414f-aa9e-c53789a07e0b None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:53.546274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ada8f0-1811-414f-aa9e-c53789a07e0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:53.547313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ada8f0-1811-414f-aa9e-c53789a07e0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:53.549180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ada8f0-1811-414f-aa9e-c53789a07e0b None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:53.559984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6c632-393a-4262-a8fd-0a714c5dc69b None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:53.571039 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 343/675] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:53.572246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ada8f0-1811-414f-aa9e-c53789a07e0b None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:53.607190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47054396-bec4-4068-a1ef-5db16a9af2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:53.607891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47054396-bec4-4068-a1ef-5db16a9af2a4 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:53.608180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47054396-bec4-4068-a1ef-5db16a9af2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:53.608463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47054396-bec4-4068-a1ef-5db16a9af2a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:53.622630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47054396-bec4-4068-a1ef-5db16a9af2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:53.624292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47054396-bec4-4068-a1ef-5db16a9af2a4 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:53.640584 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-47054396-bec4-4068-a1ef-5db16a9af2a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:53.640584 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:53.640584 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:53.640584 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:53.640584 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:53.640584 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:53.640584 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:53.640584 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:53.640584 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:53.640584 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:53.640584 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:53.640584 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:53.640584 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:53.640584 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:53.640584 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:53.641530 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:53.641530 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:53.641530 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:53.641530 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:53.641530 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:53.641530 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:53.641530 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:53.641530 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:53.641530 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:53.641530 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:53.641530 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:53.641530 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:53.641530 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:53.641530 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:53.641530 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:53.641530 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:53.641530 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:53.642445 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:53.642445 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:53.642445 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:53.642445 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:53.646742 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 333/676] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:53.647713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47054396-bec4-4068-a1ef-5db16a9af2a4 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:53.697423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:53.700048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:53.713953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ada8f0-1811-414f-aa9e-c53789a07e0b None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:53.759744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e582fea-6011-46b4-a8ff-5c6b534fd8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:53.761402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e582fea-6011-46b4-a8ff-5c6b534fd8bd None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:53.761898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e582fea-6011-46b4-a8ff-5c6b534fd8bd None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:53.762372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e582fea-6011-46b4-a8ff-5c6b534fd8bd None admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:53.763051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47054396-bec4-4068-a1ef-5db16a9af2a4 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:53.763549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e582fea-6011-46b4-a8ff-5c6b534fd8bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:53.764059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e582fea-6011-46b4-a8ff-5c6b534fd8bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:53.766848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e582fea-6011-46b4-a8ff-5c6b534fd8bd None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:53.783954 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 344/677] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:53.785714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e582fea-6011-46b4-a8ff-5c6b534fd8bd None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:53.805479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c7988-d50e-42d0-a7d9-62e0c19c540c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:53.806105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c7988-d50e-42d0-a7d9-62e0c19c540c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:53.806423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c7988-d50e-42d0-a7d9-62e0c19c540c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:53.806723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c7988-d50e-42d0-a7d9-62e0c19c540c None admin] PATH_INFO: `/v3/users/swift` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:53.815638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c7988-d50e-42d0-a7d9-62e0c19c540c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:53.817136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c7988-d50e-42d0-a7d9-62e0c19c540c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:53.833704 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-408c7988-d50e-42d0-a7d9-62e0c19c540c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 30 20:44:53.833704 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:53.833704 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:53.833704 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:53.833704 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:53.833704 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:53.833704 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:53.833704 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:53.833704 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:53.833704 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:53.833704 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:53.833704 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:53.833704 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:44:53.833704 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:44:53.833704 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:44:53.833704 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:44:53.834920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:53.834920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:53.834920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:44:53.834920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:53.834920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:44:53.834920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:53.834920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:53.834920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:53.834920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:53.834920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:53.834920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:53.834920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:53.834920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:53.834920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:53.834920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:53.834920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:53.834920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:53.834920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:53.836265 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:53.836265 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:53.836265 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:44:53.836265 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:44:53.836265 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:44:53.836265 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:44:53.836265 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:44:53.836265 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:44:53.836265 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 30 20:44:53.836265 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:53.836265 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 334/678] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:44:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:53.836265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c7988-d50e-42d0-a7d9-62e0c19c540c None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:53.905636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e582fea-6011-46b4-a8ff-5c6b534fd8bd None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:53.942070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd39bd-d8ac-44a6-a516-7550f28c3e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:53.943141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd39bd-d8ac-44a6-a516-7550f28c3e3a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:53.943688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd39bd-d8ac-44a6-a516-7550f28c3e3a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:53.944171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd39bd-d8ac-44a6-a516-7550f28c3e3a None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:53.945383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd39bd-d8ac-44a6-a516-7550f28c3e3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:53.945893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd39bd-d8ac-44a6-a516-7550f28c3e3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:53.947515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd39bd-d8ac-44a6-a516-7550f28c3e3a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:53.954475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c7988-d50e-42d0-a7d9-62e0c19c540c None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:53.956769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:53.961151 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 345/679] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:53.962322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd39bd-d8ac-44a6-a516-7550f28c3e3a None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:53.977321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:54.003352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb94766-8185-4097-a912-ed9b75ee45c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:54.003352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb94766-8185-4097-a912-ed9b75ee45c1 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:54.003352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb94766-8185-4097-a912-ed9b75ee45c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:54.003352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb94766-8185-4097-a912-ed9b75ee45c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:54.003703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb94766-8185-4097-a912-ed9b75ee45c1 None admin] RBAC: Adding query filter params (role.id=50fb737d5edf48298d0a6061ba652acb, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=1656aa416bc146f486e71517e476773a) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:54.003703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb94766-8185-4097-a912-ed9b75ee45c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:54.004519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb94766-8185-4097-a912-ed9b75ee45c1 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:54.011736 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 335/680] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:44:53 2022] GET /identity/v3/role_assignments?user.id=1656aa416bc146f486e71517e476773a&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=50fb737d5edf48298d0a6061ba652acb => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:54.012628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb94766-8185-4097-a912-ed9b75ee45c1 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:54.082510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd39bd-d8ac-44a6-a516-7550f28c3e3a None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:54.122779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caee046-c8ab-4d22-ba79-ad9b21e0035c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:54.123486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caee046-c8ab-4d22-ba79-ad9b21e0035c None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:54.123779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caee046-c8ab-4d22-ba79-ad9b21e0035c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:54.124061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caee046-c8ab-4d22-ba79-ad9b21e0035c None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:54.125027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caee046-c8ab-4d22-ba79-ad9b21e0035c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:54.125447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caee046-c8ab-4d22-ba79-ad9b21e0035c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:54.126994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caee046-c8ab-4d22-ba79-ad9b21e0035c None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:54.133363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb94766-8185-4097-a912-ed9b75ee45c1 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:54.148691 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 346/681] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Jul 30 20:44:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:54.153882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caee046-c8ab-4d22-ba79-ad9b21e0035c None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:54.175361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03a3d6-7fce-4e56-8211-46dc62009849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:54.175968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03a3d6-7fce-4e56-8211-46dc62009849 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:54.176257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03a3d6-7fce-4e56-8211-46dc62009849 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:54.176538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03a3d6-7fce-4e56-8211-46dc62009849 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:54.184429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03a3d6-7fce-4e56-8211-46dc62009849 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:54.186133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03a3d6-7fce-4e56-8211-46dc62009849 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:54.199159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-df03a3d6-7fce-4e56-8211-46dc62009849 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:54.199159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:54.199159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:54.199159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:54.199159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:54.199159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:54.199159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:54.199159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:54.199159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:54.199159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:54.199159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:54.199159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:54.199159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:44:54.199159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:44:54.199159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:44:54.200237 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:44:54.200237 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:54.200237 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:54.200237 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:54.200237 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:54.200237 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:54.200237 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:54.200237 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:54.200237 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:54.200237 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:54.200237 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:54.200237 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:54.200237 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:54.200237 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:54.200237 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:54.200237 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:54.200237 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:54.201130 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:44:54.201130 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:44:54.201130 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:44:54.201130 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:44:54.201130 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:44:54.201130 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:44:54.201130 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:54.201130 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:54.201130 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 336/682] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:54.206463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03a3d6-7fce-4e56-8211-46dc62009849 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:54.231776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:54.239745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:54.280039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caee046-c8ab-4d22-ba79-ad9b21e0035c None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:54.326078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03a3d6-7fce-4e56-8211-46dc62009849 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:54.328052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780df0e-e8e5-493a-b2e9-5b1b7841710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:54.329941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780df0e-e8e5-493a-b2e9-5b1b7841710a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:54.330449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780df0e-e8e5-493a-b2e9-5b1b7841710a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:54.330926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780df0e-e8e5-493a-b2e9-5b1b7841710a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:54.371596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0c32a-3d6e-4d4d-9c91-6a0013a66237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:54.372619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0c32a-3d6e-4d4d-9c91-6a0013a66237 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:54.373123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0c32a-3d6e-4d4d-9c91-6a0013a66237 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:54.373617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0c32a-3d6e-4d4d-9c91-6a0013a66237 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:54.374448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0c32a-3d6e-4d4d-9c91-6a0013a66237 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:54.374827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0c32a-3d6e-4d4d-9c91-6a0013a66237 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:54.376378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0c32a-3d6e-4d4d-9c91-6a0013a66237 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:54.389555 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 337/683] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:44:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:54.390834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9edd8-5c43-487a-9834-d653927062d7 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:54.391183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9edd8-5c43-487a-9834-d653927062d7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:54.391496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9edd8-5c43-487a-9834-d653927062d7 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:54.392928 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 338/684] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:54.397894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9edd8-5c43-487a-9834-d653927062d7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:54.437861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780df0e-e8e5-493a-b2e9-5b1b7841710a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:54.439429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780df0e-e8e5-493a-b2e9-5b1b7841710a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:54.505477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:54.519372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9edd8-5c43-487a-9834-d653927062d7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:54.532281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:54.567089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c7fac-bef1-48a9-a9ff-da0eb6b78e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:54.568071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c7fac-bef1-48a9-a9ff-da0eb6b78e84 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:54.568417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c7fac-bef1-48a9-a9ff-da0eb6b78e84 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:54.568700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c7fac-bef1-48a9-a9ff-da0eb6b78e84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:54.569974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c7fac-bef1-48a9-a9ff-da0eb6b78e84 None admin] RBAC: Adding query filter params (role.id=50fb737d5edf48298d0a6061ba652acb, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=4a886ccf9590432caf209526410a7b53) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:54.570545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c7fac-bef1-48a9-a9ff-da0eb6b78e84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:54.572667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c7fac-bef1-48a9-a9ff-da0eb6b78e84 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:54.576608 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 347/685] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:54.578086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f8971-dc82-4c8c-ad20-ac0bb71eaff5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:54.578523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f8971-dc82-4c8c-ad20-ac0bb71eaff5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:54.578974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f8971-dc82-4c8c-ad20-ac0bb71eaff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:54.579584 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 339/686] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:44:54 2022] GET /identity/v3/role_assignments?user.id=4a886ccf9590432caf209526410a7b53&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=50fb737d5edf48298d0a6061ba652acb => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:54.584895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c7fac-bef1-48a9-a9ff-da0eb6b78e84 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:54.615231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-303f8971-dc82-4c8c-ad20-ac0bb71eaff5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:54.618635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-303f8971-dc82-4c8c-ad20-ac0bb71eaff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:54.752388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c7fac-bef1-48a9-a9ff-da0eb6b78e84 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:54.784697 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 348/687] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:54.795392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5802c-3b7b-4950-ad28-b86fb04d2ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:54.796401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5802c-3b7b-4950-ad28-b86fb04d2ae3 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:54.796907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5802c-3b7b-4950-ad28-b86fb04d2ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:54.797380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5802c-3b7b-4950-ad28-b86fb04d2ae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:54.810748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5802c-3b7b-4950-ad28-b86fb04d2ae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:54.812321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5802c-3b7b-4950-ad28-b86fb04d2ae3 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:54.822612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f8971-dc82-4c8c-ad20-ac0bb71eaff5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:54.828255 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-f9c5802c-3b7b-4950-ad28-b86fb04d2ae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:54.828255 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:54.828255 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:54.828255 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:54.828255 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:54.828255 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:54.828255 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:54.828255 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:54.828255 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:54.828255 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:54.828255 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:54.828255 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:54.828255 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:54.828255 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:54.828255 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:54.829310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:54.829310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:54.829310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:54.829310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:54.829310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:54.829310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:54.829310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:54.829310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:54.829310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:54.829310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:54.829310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:54.829310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:54.829310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:54.829310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:54.829310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:54.829310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:54.829310 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:54.830397 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:54.830397 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:54.830397 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:54.830397 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:54.833134 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 340/688] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:54.837491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5802c-3b7b-4950-ad28-b86fb04d2ae3 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:54.841666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:54.969578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5802c-3b7b-4950-ad28-b86fb04d2ae3 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:55.010671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c427d8-e598-42fc-b4f6-8deaead06253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:55.010862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c427d8-e598-42fc-b4f6-8deaead06253 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:55.011065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c427d8-e598-42fc-b4f6-8deaead06253 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:55.011278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c427d8-e598-42fc-b4f6-8deaead06253 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:55.012027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c427d8-e598-42fc-b4f6-8deaead06253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:55.012337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c427d8-e598-42fc-b4f6-8deaead06253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:55.013773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c427d8-e598-42fc-b4f6-8deaead06253 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:55.027704 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 341/689] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:55.040434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c427d8-e598-42fc-b4f6-8deaead06253 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:55.060010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f8971-dc82-4c8c-ad20-ac0bb71eaff5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:55.075679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:55.112934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab035ac-fc69-43c7-8f36-12c6e8705164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:55.113602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab035ac-fc69-43c7-8f36-12c6e8705164 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:55.113943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab035ac-fc69-43c7-8f36-12c6e8705164 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:55.114224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab035ac-fc69-43c7-8f36-12c6e8705164 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:55.129375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:55.132488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab035ac-fc69-43c7-8f36-12c6e8705164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:55.140347 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-8ab035ac-fc69-43c7-8f36-12c6e8705164 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:44:55.140347 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:55.140347 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:55.140347 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:55.140347 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:55.140347 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:55.140347 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:55.140347 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:55.140347 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:55.140347 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:55.140347 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:55.140347 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:55.140347 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:55.140347 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:55.140347 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:55.140347 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:55.141299 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:55.141299 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:55.141299 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:55.141299 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:55.141299 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:55.141299 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:55.141299 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:55.141299 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:55.141299 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:55.141299 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:55.141299 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:55.141299 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:55.141299 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:55.141299 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:55.141299 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:55.141299 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:55.142127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:55.142127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:55.142127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:55.142127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:55.142127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:55.142127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:55.142127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:55.142127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:55.142127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:55.142127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:55.142127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:44:55.142127 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:55.147981 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 349/690] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:44:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:44:55.148893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab035ac-fc69-43c7-8f36-12c6e8705164 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:55.172115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c427d8-e598-42fc-b4f6-8deaead06253 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:55.222554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23d41d-5e1b-4db6-9d1f-a664831e6e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:55.223204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23d41d-5e1b-4db6-9d1f-a664831e6e7d None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:55.223511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23d41d-5e1b-4db6-9d1f-a664831e6e7d None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:55.223791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23d41d-5e1b-4db6-9d1f-a664831e6e7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:55.237557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23d41d-5e1b-4db6-9d1f-a664831e6e7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:55.241651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23d41d-5e1b-4db6-9d1f-a664831e6e7d None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:55.265107 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-3d23d41d-5e1b-4db6-9d1f-a664831e6e7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:55.265107 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:55.265107 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:55.265107 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:55.265107 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:55.265107 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:55.265107 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:55.265107 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:55.265107 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:55.265107 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:55.265107 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:55.265107 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:55.265107 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:44:55.265107 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:44:55.265107 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:44:55.267150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:44:55.267150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:55.267150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:55.267150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:55.267150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:55.267150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:55.267150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:55.267150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:55.267150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:55.267150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:55.267150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:55.267150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:55.267150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:55.267150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:55.267150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:55.267150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:55.267150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:55.269337 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:44:55.269337 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:44:55.269337 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:44:55.269337 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:44:55.269337 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:44:55.269337 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:44:55.269337 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:55.269337 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:55.272200 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 342/691] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:55.275308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23d41d-5e1b-4db6-9d1f-a664831e6e7d None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:55.328661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab035ac-fc69-43c7-8f36-12c6e8705164 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:55.388934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3a19c-8ebf-44c5-8103-e17ed83b33fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:55.389579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3a19c-8ebf-44c5-8103-e17ed83b33fa None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:55.389866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3a19c-8ebf-44c5-8103-e17ed83b33fa None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:55.390143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3a19c-8ebf-44c5-8103-e17ed83b33fa None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:55.390867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3a19c-8ebf-44c5-8103-e17ed83b33fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:55.391171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3a19c-8ebf-44c5-8103-e17ed83b33fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:55.392583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3a19c-8ebf-44c5-8103-e17ed83b33fa None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:55.403624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23d41d-5e1b-4db6-9d1f-a664831e6e7d None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:55.407180 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 350/692] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:55.413861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3a19c-8ebf-44c5-8103-e17ed83b33fa None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:55.430414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:55.445100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:55.450136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281df5c1-bbac-419e-b573-c5795ead0398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:55.450788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281df5c1-bbac-419e-b573-c5795ead0398 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:55.451078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281df5c1-bbac-419e-b573-c5795ead0398 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:55.451391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281df5c1-bbac-419e-b573-c5795ead0398 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:55.452167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281df5c1-bbac-419e-b573-c5795ead0398 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:55.452477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281df5c1-bbac-419e-b573-c5795ead0398 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:55.453942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281df5c1-bbac-419e-b573-c5795ead0398 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:55.467639 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 343/693] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:44:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:55.473422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281df5c1-bbac-419e-b573-c5795ead0398 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:55.624791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3a19c-8ebf-44c5-8103-e17ed83b33fa None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:55.630007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281df5c1-bbac-419e-b573-c5795ead0398 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:55.670802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b920a12-fb74-4879-b8c1-6708f27bba86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:55.671470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b920a12-fb74-4879-b8c1-6708f27bba86 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:55.671759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b920a12-fb74-4879-b8c1-6708f27bba86 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:55.672038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b920a12-fb74-4879-b8c1-6708f27bba86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:55.672832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b920a12-fb74-4879-b8c1-6708f27bba86 None admin] RBAC: Adding query filter params (role.id=50fb737d5edf48298d0a6061ba652acb, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=2181960e3bed4031889d6e72a721e151) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:55.673141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b920a12-fb74-4879-b8c1-6708f27bba86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:55.674578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b920a12-fb74-4879-b8c1-6708f27bba86 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:55.682513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c51b7-90a7-4c95-a448-8385b0921015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:55.683174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c51b7-90a7-4c95-a448-8385b0921015 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:55.683486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c51b7-90a7-4c95-a448-8385b0921015 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:55.683769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c51b7-90a7-4c95-a448-8385b0921015 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:55.694633 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 344/694] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:44:55 2022] GET /identity/v3/role_assignments?user.id=2181960e3bed4031889d6e72a721e151&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=50fb737d5edf48298d0a6061ba652acb => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:55.700097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d1b9b-d5f2-4571-b6ab-f8052d290a48 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:55.700403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d1b9b-d5f2-4571-b6ab-f8052d290a48 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:55.700659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d1b9b-d5f2-4571-b6ab-f8052d290a48 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:55.701332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c51b7-90a7-4c95-a448-8385b0921015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:55.702401 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 345/695] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:44:55.702833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c51b7-90a7-4c95-a448-8385b0921015 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:55.712909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59a8c7-73bc-4930-9229-ad18122ab5f2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:55.713237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59a8c7-73bc-4930-9229-ad18122ab5f2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:55.713476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59a8c7-73bc-4930-9229-ad18122ab5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:55.724806 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-f53c51b7-90a7-4c95-a448-8385b0921015 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:55.724806 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:55.724806 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:55.724806 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:55.724806 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:55.724806 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:55.724806 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:55.724806 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:55.724806 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:55.724806 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:55.724806 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:55.724806 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:55.724806 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:55.724806 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:55.724806 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:55.726960 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:55.726960 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:55.726960 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:55.726960 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:55.726960 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:55.726960 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:55.726960 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:55.726960 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:55.726960 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:55.726960 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:55.726960 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:55.726960 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:55.726960 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:55.726960 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:55.726960 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:55.726960 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:55.726960 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:55.729125 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:55.729125 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:55.729125 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:55.729125 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:55.729125 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 351/696] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:44:55.735326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c51b7-90a7-4c95-a448-8385b0921015 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:55.753653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2c59a8c7-73bc-4930-9229-ad18122ab5f2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:55.754918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2c59a8c7-73bc-4930-9229-ad18122ab5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:55.839688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:55.871208 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 346/697] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:44:55.891103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:55.915858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59a8c7-73bc-4930-9229-ad18122ab5f2 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:55.946616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c51b7-90a7-4c95-a448-8385b0921015 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:55.997288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c3624-a275-40b3-8dfb-2f885ecd9946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:55.998135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c3624-a275-40b3-8dfb-2f885ecd9946 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:55.998417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c3624-a275-40b3-8dfb-2f885ecd9946 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:55.998693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c3624-a275-40b3-8dfb-2f885ecd9946 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:55.999447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c3624-a275-40b3-8dfb-2f885ecd9946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:55.999759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c3624-a275-40b3-8dfb-2f885ecd9946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:56.001643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c3624-a275-40b3-8dfb-2f885ecd9946 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:56.015971 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 352/698] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:56.022601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c3624-a275-40b3-8dfb-2f885ecd9946 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:56.065796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59a8c7-73bc-4930-9229-ad18122ab5f2 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:56.115393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeab14-17b8-4ba4-918e-6bfd1f589e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:56.116151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeab14-17b8-4ba4-918e-6bfd1f589e7f None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:56.116440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeab14-17b8-4ba4-918e-6bfd1f589e7f None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:56.116717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeab14-17b8-4ba4-918e-6bfd1f589e7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:56.130721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baeab14-17b8-4ba4-918e-6bfd1f589e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:56.132341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baeab14-17b8-4ba4-918e-6bfd1f589e7f None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:56.153107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c3624-a275-40b3-8dfb-2f885ecd9946 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:56.153279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-8baeab14-17b8-4ba4-918e-6bfd1f589e7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:56.153279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:56.153279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:56.153279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:56.153279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:56.153279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:56.153279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:56.153279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:56.153279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:56.153279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:56.153279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:56.153279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:56.153279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:56.153279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:56.153279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:56.154150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:56.154150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:56.154150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:56.154150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:56.154150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:56.154150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:56.154150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:56.154150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:56.154150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:56.154150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:56.154150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:56.154150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:56.154150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:56.154150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:56.154150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:56.154150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:56.154150 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:56.156536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:56.156536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:56.156536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:56.156536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:56.156536 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 347/699] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:44:56.162290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeab14-17b8-4ba4-918e-6bfd1f589e7f None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:56.194547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:56.202528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9ef74-9656-4d5c-bb2b-c88a3c9f0f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:56.203579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9ef74-9656-4d5c-bb2b-c88a3c9f0f03 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:56.204072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9ef74-9656-4d5c-bb2b-c88a3c9f0f03 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:56.204549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9ef74-9656-4d5c-bb2b-c88a3c9f0f03 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:56.206459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:56.216446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9ef74-9656-4d5c-bb2b-c88a3c9f0f03 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:56.218253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9ef74-9656-4d5c-bb2b-c88a3c9f0f03 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:56.230857 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-24e9ef74-9656-4d5c-bb2b-c88a3c9f0f03 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 30 20:44:56.230857 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:56.230857 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:56.230857 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:56.230857 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:56.230857 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:56.230857 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:56.230857 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:56.230857 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:56.230857 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:56.230857 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:56.230857 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:56.230857 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:44:56.230857 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:44:56.230857 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:44:56.230857 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:44:56.231917 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:56.231917 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:56.231917 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:44:56.231917 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:56.231917 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:44:56.231917 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:56.231917 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:56.231917 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:56.231917 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:56.231917 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:56.231917 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:56.231917 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:56.231917 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:56.231917 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:56.231917 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:56.231917 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:56.231917 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:56.231917 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:56.232891 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:56.232891 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:56.232891 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:44:56.232891 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:44:56.232891 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:44:56.232891 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:44:56.232891 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:44:56.232891 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:44:56.232891 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 30 20:44:56.232891 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:56.235446 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 353/700] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Jul 30 20:44:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:56.241777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9ef74-9656-4d5c-bb2b-c88a3c9f0f03 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:56.297592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeab14-17b8-4ba4-918e-6bfd1f589e7f None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:56.341639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8a92c-96a6-429c-9803-24990e4783eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:56.344760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8a92c-96a6-429c-9803-24990e4783eb None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:56.344760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8a92c-96a6-429c-9803-24990e4783eb None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:56.344760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8a92c-96a6-429c-9803-24990e4783eb None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:56.344760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8a92c-96a6-429c-9803-24990e4783eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:56.344760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8a92c-96a6-429c-9803-24990e4783eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:56.345643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8a92c-96a6-429c-9803-24990e4783eb None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:56.360168 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 348/701] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:56.367129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8a92c-96a6-429c-9803-24990e4783eb None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:56.405398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9ef74-9656-4d5c-bb2b-c88a3c9f0f03 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:56.473176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:56.488761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8a92c-96a6-429c-9803-24990e4783eb None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:56.501393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a62ca-ce44-4bf0-b247-0d15b2a8400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:56.502368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a62ca-ce44-4bf0-b247-0d15b2a8400a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:56.502887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a62ca-ce44-4bf0-b247-0d15b2a8400a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:56.503434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a62ca-ce44-4bf0-b247-0d15b2a8400a None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:56.504444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a62ca-ce44-4bf0-b247-0d15b2a8400a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:56.504975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a62ca-ce44-4bf0-b247-0d15b2a8400a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:56.506651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a62ca-ce44-4bf0-b247-0d15b2a8400a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:56.528833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6fcfc-1a55-4a0d-a078-e4a26c90908d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:56.529478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6fcfc-1a55-4a0d-a078-e4a26c90908d None admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:56.529761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6fcfc-1a55-4a0d-a078-e4a26c90908d None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:56.530036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6fcfc-1a55-4a0d-a078-e4a26c90908d None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:56.530719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6fcfc-1a55-4a0d-a078-e4a26c90908d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:56.532201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6fcfc-1a55-4a0d-a078-e4a26c90908d None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:56.542703 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 354/702] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Jul 30 20:44:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:44:56.548470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a62ca-ce44-4bf0-b247-0d15b2a8400a None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:56.557181 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 349/703] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 30 20:44:56 2022] POST /identity/v3/users => generated 254 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:44:56.629233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:56.694169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a62ca-ce44-4bf0-b247-0d15b2a8400a None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:56.735076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63906698-9372-4242-8e03-d3e247889e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:56.735740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63906698-9372-4242-8e03-d3e247889e08 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:56.736028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63906698-9372-4242-8e03-d3e247889e08 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:56.736308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63906698-9372-4242-8e03-d3e247889e08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:56.827186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63906698-9372-4242-8e03-d3e247889e08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:56.828750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63906698-9372-4242-8e03-d3e247889e08 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:56.886500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:56.942092 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 355/704] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:44:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:44:56.948020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6fcfc-1a55-4a0d-a078-e4a26c90908d None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:57.013496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1b01f-e735-4a96-8233-f1dadb58d9d7 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:57.013496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1b01f-e735-4a96-8233-f1dadb58d9d7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:57.013768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1b01f-e735-4a96-8233-f1dadb58d9d7 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:57.018825 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 356/705] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:44:57.020095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fb8db-1cd0-43dd-8ecd-685fcd3256c8 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:57.020381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fb8db-1cd0-43dd-8ecd-685fcd3256c8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:57.020650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fb8db-1cd0-43dd-8ecd-685fcd3256c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:57.047236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fd0fb8db-1cd0-43dd-8ecd-685fcd3256c8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:57.049499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fd0fb8db-1cd0-43dd-8ecd-685fcd3256c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:57.082865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6fcfc-1a55-4a0d-a078-e4a26c90908d None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:57.123933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7498857-97a7-4bfd-9c11-a8643383aba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:57.123933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7498857-97a7-4bfd-9c11-a8643383aba0 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:57.124244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7498857-97a7-4bfd-9c11-a8643383aba0 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:57.124520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7498857-97a7-4bfd-9c11-a8643383aba0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:57.136732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7498857-97a7-4bfd-9c11-a8643383aba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:57.138460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7498857-97a7-4bfd-9c11-a8643383aba0 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:57.140828 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 357/706] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:44:57.146328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:57.160103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-c7498857-97a7-4bfd-9c11-a8643383aba0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:57.160103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:57.160103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:57.160103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:57.160103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:57.160103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:57.160103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:57.160103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:57.160103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:57.160103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:57.160103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:57.160103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:57.160103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:57.160103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:57.160103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:57.161095 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:57.161095 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:57.161095 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:57.161095 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:57.161095 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:57.161095 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:57.161095 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:57.161095 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:57.161095 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:57.161095 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:57.161095 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:57.161095 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:57.161095 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:57.161095 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:57.161095 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:57.161095 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:57.161095 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:57.162541 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:57.162541 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:57.162541 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:57.162541 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:57.162541 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 350/707] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:57.167980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fb8db-1cd0-43dd-8ecd-685fcd3256c8 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:57.183329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7498857-97a7-4bfd-9c11-a8643383aba0 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:57.277526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:57.302185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fb8db-1cd0-43dd-8ecd-685fcd3256c8 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:57.308575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7498857-97a7-4bfd-9c11-a8643383aba0 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:57.347906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3078d-c999-42e3-bd63-4fc216095e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:57.348730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3078d-c999-42e3-bd63-4fc216095e52 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:57.349152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3078d-c999-42e3-bd63-4fc216095e52 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:57.349585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3078d-c999-42e3-bd63-4fc216095e52 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:57.350420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3078d-c999-42e3-bd63-4fc216095e52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:57.350848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3078d-c999-42e3-bd63-4fc216095e52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:57.352362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3078d-c999-42e3-bd63-4fc216095e52 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:57.353537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ad093-3aca-4056-bfdf-d8675118b877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:57.354669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ad093-3aca-4056-bfdf-d8675118b877 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:57.355121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ad093-3aca-4056-bfdf-d8675118b877 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:57.356177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ad093-3aca-4056-bfdf-d8675118b877 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:57.356981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ad093-3aca-4056-bfdf-d8675118b877 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:57.358527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ad093-3aca-4056-bfdf-d8675118b877 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:57.367393 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 358/708] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:57.369732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74795e-4793-4232-bf9d-ffd8d855042f None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:57.374361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74795e-4793-4232-bf9d-ffd8d855042f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:57.374361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74795e-4793-4232-bf9d-ffd8d855042f None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:57.374361 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 359/709] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:57.375484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74795e-4793-4232-bf9d-ffd8d855042f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:57.377708 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-bc5ad093-3aca-4056-bfdf-d8675118b877 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 30 20:44:57.377708 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:57.377708 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:44:57.377708 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:44:57.377708 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:44:57.377708 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:44:57.377708 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:44:57.377708 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:44:57.377708 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 30 20:44:57.377708 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:57.377708 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:44:57.377708 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:57.377708 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:57.377708 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:57.377708 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:57.377708 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:57.378643 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:57.378643 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:57.378643 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:57.378643 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:57.378643 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:57.378643 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:57.378643 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:57.378643 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:44:57.378643 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:44:57.378643 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:44:57.378643 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:44:57.378643 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:57.378643 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:57.378643 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:57.378643 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:57.378643 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:57.379531 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:57.379531 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:57.379531 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:57.379531 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:57.379531 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:57.379531 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:57.379531 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:57.379531 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:57.379531 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:57.379531 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:57.379531 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:57.379531 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:44:57.379531 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:44:57.379531 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 30 20:44:57.379531 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:44:57.381592 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 351/710] 10.222.0.17 () {56 vars in 1129 bytes} [Sat Jul 30 20:44:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:44:57.387498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931dbfe-dcdb-477b-92f1-4acbbc070afa None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:57.387498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931dbfe-dcdb-477b-92f1-4acbbc070afa None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:57.387498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931dbfe-dcdb-477b-92f1-4acbbc070afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:57.417014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0931dbfe-dcdb-477b-92f1-4acbbc070afa None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:57.419492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0931dbfe-dcdb-477b-92f1-4acbbc070afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:57.494757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:57.509666 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 352/711] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:44:57.510558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931dbfe-dcdb-477b-92f1-4acbbc070afa None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:57.517735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74795e-4793-4232-bf9d-ffd8d855042f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:57.559027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbe6ff-6666-42fd-a257-a99da0f7d8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:57.559633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbe6ff-6666-42fd-a257-a99da0f7d8a1 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:57.559919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbe6ff-6666-42fd-a257-a99da0f7d8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:57.560198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbe6ff-6666-42fd-a257-a99da0f7d8a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:57.567818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbe6ff-6666-42fd-a257-a99da0f7d8a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:57.569404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbe6ff-6666-42fd-a257-a99da0f7d8a1 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:57.581670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-43dbe6ff-6666-42fd-a257-a99da0f7d8a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:57.581670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:57.581670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:57.581670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:57.581670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:57.581670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:57.581670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:57.581670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:57.581670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:57.581670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:57.581670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:57.581670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:57.581670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:44:57.581670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:44:57.581670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:44:57.582612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:44:57.582612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:57.582612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:57.582612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:57.582612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:57.582612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:57.582612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:57.582612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:57.582612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:57.582612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:57.582612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:57.582612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:57.582612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:57.582612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:57.582612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:57.582612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:57.582612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:57.584075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:44:57.584075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:44:57.584075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:44:57.584075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:44:57.584075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:44:57.584075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:44:57.584075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:44:57.584075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:57.584075 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 360/712] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:57.589080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbe6ff-6666-42fd-a257-a99da0f7d8a1 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:57.589786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:57.642903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931dbfe-dcdb-477b-92f1-4acbbc070afa None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:57.684658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8fca8-8b92-453d-ab9e-9c525266b075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:57.685316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8fca8-8b92-453d-ab9e-9c525266b075 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:57.685605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8fca8-8b92-453d-ab9e-9c525266b075 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:57.685941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8fca8-8b92-453d-ab9e-9c525266b075 None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:57.686633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8fca8-8b92-453d-ab9e-9c525266b075 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:57.686992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8fca8-8b92-453d-ab9e-9c525266b075 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:57.688408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8fca8-8b92-453d-ab9e-9c525266b075 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:57.694091 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 353/713] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Jul 30 20:44:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:57.694914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8fca8-8b92-453d-ab9e-9c525266b075 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:57.717804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbe6ff-6666-42fd-a257-a99da0f7d8a1 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:57.758215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:57.765145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3c73d-4f43-4228-b899-53b112020f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:57.766227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3c73d-4f43-4228-b899-53b112020f6c None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:57.767050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3c73d-4f43-4228-b899-53b112020f6c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:57.767511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3c73d-4f43-4228-b899-53b112020f6c None admin] PATH_INFO: `/v3/services/network` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:57.768589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3c73d-4f43-4228-b899-53b112020f6c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:57.770106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3c73d-4f43-4228-b899-53b112020f6c None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:57.791333 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-7bd3c73d-4f43-4228-b899-53b112020f6c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 30 20:44:57.791333 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:57.791333 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:44:57.791333 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:44:57.791333 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:44:57.791333 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:44:57.791333 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:44:57.791333 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:44:57.791333 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 30 20:44:57.791333 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:57.791333 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:44:57.791333 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:57.791333 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:57.791333 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:57.791333 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:57.791333 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:57.791333 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:57.792947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:57.792947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:57.792947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:57.792947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:57.792947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:57.792947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:57.792947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:44:57.792947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:44:57.792947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:44:57.792947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:44:57.792947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:57.792947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:57.792947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:57.792947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:57.792947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:57.792947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:57.793948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:57.793948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:57.793948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:57.793948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:57.793948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:57.793948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:57.793948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:57.793948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:57.793948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:57.793948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:57.793948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:44:57.793948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:44:57.793948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 30 20:44:57.793948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:57.797790 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 361/714] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:44:57 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:57.798969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3c73d-4f43-4228-b899-53b112020f6c None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:57.821625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8fca8-8b92-453d-ab9e-9c525266b075 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:57.872019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fac1d-57e4-41af-bfc2-fa9ac43f68cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:57.873214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fac1d-57e4-41af-bfc2-fa9ac43f68cb None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:57.873665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fac1d-57e4-41af-bfc2-fa9ac43f68cb None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:57.874505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fac1d-57e4-41af-bfc2-fa9ac43f68cb None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:57.875714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fac1d-57e4-41af-bfc2-fa9ac43f68cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:57.876196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fac1d-57e4-41af-bfc2-fa9ac43f68cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:57.878039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:57.879785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fac1d-57e4-41af-bfc2-fa9ac43f68cb None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:57.898166 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 354/715] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:57.899771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fac1d-57e4-41af-bfc2-fa9ac43f68cb None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:57.927237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3c73d-4f43-4228-b899-53b112020f6c None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:57.977884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fb3cf-8dc9-4adc-9ed8-47cf0544f43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:57.978875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fb3cf-8dc9-4adc-9ed8-47cf0544f43f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:57.979588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fb3cf-8dc9-4adc-9ed8-47cf0544f43f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:57.980092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fb3cf-8dc9-4adc-9ed8-47cf0544f43f None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:57.981524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fb3cf-8dc9-4adc-9ed8-47cf0544f43f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:57.982166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fb3cf-8dc9-4adc-9ed8-47cf0544f43f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:57.984096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fb3cf-8dc9-4adc-9ed8-47cf0544f43f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:57.997554 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 362/716] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Jul 30 20:44:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:57.998683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fb3cf-8dc9-4adc-9ed8-47cf0544f43f None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:58.057344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fac1d-57e4-41af-bfc2-fa9ac43f68cb None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:58.078417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:58.106964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126e64f-acce-4e7f-b0d7-af553ef6a4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:58.107755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126e64f-acce-4e7f-b0d7-af553ef6a4df None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:58.108042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126e64f-acce-4e7f-b0d7-af553ef6a4df None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:58.108315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126e64f-acce-4e7f-b0d7-af553ef6a4df None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:58.111204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126e64f-acce-4e7f-b0d7-af553ef6a4df None admin] RBAC: Adding query filter params (name=network) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:58.111204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126e64f-acce-4e7f-b0d7-af553ef6a4df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:58.111570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126e64f-acce-4e7f-b0d7-af553ef6a4df None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:58.117462 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 355/717] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 30 20:44:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:58.124014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126e64f-acce-4e7f-b0d7-af553ef6a4df None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:58.230465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fb3cf-8dc9-4adc-9ed8-47cf0544f43f None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:58.272274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:58.285423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8db130-88a3-4bf6-89b2-e733359761cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:58.286050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8db130-88a3-4bf6-89b2-e733359761cf None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:58.286401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8db130-88a3-4bf6-89b2-e733359761cf None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:58.287173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8db130-88a3-4bf6-89b2-e733359761cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:58.288787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8db130-88a3-4bf6-89b2-e733359761cf None admin] RBAC: Adding query filter params (role.id=3b89b89da98d4ec08a0587aa13832636, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=08a2a5793b7a4797a470719a682e541a) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:58.289108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8db130-88a3-4bf6-89b2-e733359761cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:58.290567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8db130-88a3-4bf6-89b2-e733359761cf None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:58.297375 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 363/718] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:44:57 2022] GET /identity/v3/role_assignments?user.id=08a2a5793b7a4797a470719a682e541a&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=3b89b89da98d4ec08a0587aa13832636 => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:58.306219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126e64f-acce-4e7f-b0d7-af553ef6a4df None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:58.346024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f6945-e18c-426a-9546-62a6fd8b060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:58.346648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f6945-e18c-426a-9546-62a6fd8b060b None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:58.346901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f6945-e18c-426a-9546-62a6fd8b060b None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:58.347124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f6945-e18c-426a-9546-62a6fd8b060b None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:58.347843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f6945-e18c-426a-9546-62a6fd8b060b None admin] RBAC: Adding query filter params (type=network) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:58.348151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f6945-e18c-426a-9546-62a6fd8b060b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:58.350111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f6945-e18c-426a-9546-62a6fd8b060b None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:58.363452 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 356/719] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 30 20:44:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:58.681760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75496ec7-e01f-4da0-ae54-e990600f2d97 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:58.681952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75496ec7-e01f-4da0-ae54-e990600f2d97 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:58.682251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75496ec7-e01f-4da0-ae54-e990600f2d97 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:58.683925 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 364/720] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:58.692484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde20d-8722-44d5-a5b3-7a8e38639f10 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:58.692813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde20d-8722-44d5-a5b3-7a8e38639f10 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:58.693089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde20d-8722-44d5-a5b3-7a8e38639f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:58.711767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-81bde20d-8722-44d5-a5b3-7a8e38639f10 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:58.712959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-81bde20d-8722-44d5-a5b3-7a8e38639f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:44:58.765395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:58.805105 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 357/721] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:44:58.831582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75496ec7-e01f-4da0-ae54-e990600f2d97 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:58.958066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75496ec7-e01f-4da0-ae54-e990600f2d97 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:59.008232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff8142-265d-48b7-af95-a9704d678ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:59.008232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff8142-265d-48b7-af95-a9704d678ef4 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:59.008232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff8142-265d-48b7-af95-a9704d678ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:59.008232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff8142-265d-48b7-af95-a9704d678ef4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:59.024672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff8142-265d-48b7-af95-a9704d678ef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:44:59.030075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-07ff8142-265d-48b7-af95-a9704d678ef4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:44:59.030075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:59.030075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:59.030075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:59.030075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:59.030075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:59.030075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:59.030075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:59.030075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:59.030075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:59.030075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:59.030075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:59.030075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:44:59.030075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:44:59.030075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:44:59.030075 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:44:59.031030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:44:59.031030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:44:59.031030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:44:59.031030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:44:59.031030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:59.031030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:59.031030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:59.031030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:59.031030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:59.031030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:59.031030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:59.031030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:59.031030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:59.031030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:59.031030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:59.031030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:59.031908 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:59.031908 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:59.031908 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:59.031908 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:59.031908 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:44:59.031908 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:44:59.031908 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:44:59.031908 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:44:59.031908 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:44:59.031908 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:44:59.031908 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:44:59.031908 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:59.031908 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 365/722] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:44:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:59.037549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bde20d-8722-44d5-a5b3-7a8e38639f10 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:59.165116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bde20d-8722-44d5-a5b3-7a8e38639f10 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:59.200516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505fe70-c82f-41af-896b-4968fd203c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:59.201143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505fe70-c82f-41af-896b-4968fd203c3a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:59.201425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505fe70-c82f-41af-896b-4968fd203c3a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:59.201699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505fe70-c82f-41af-896b-4968fd203c3a None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:59.202409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505fe70-c82f-41af-896b-4968fd203c3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:59.202711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505fe70-c82f-41af-896b-4968fd203c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:59.204111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505fe70-c82f-41af-896b-4968fd203c3a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:59.212944 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 358/723] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:44:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:59.218389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff8142-265d-48b7-af95-a9704d678ef4 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:59.283939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:59.334832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff8142-265d-48b7-af95-a9704d678ef4 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:59.370104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b218757-de04-490d-b3a0-2cfcb2970b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:59.371060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b218757-de04-490d-b3a0-2cfcb2970b43 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:59.371360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b218757-de04-490d-b3a0-2cfcb2970b43 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:59.371635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b218757-de04-490d-b3a0-2cfcb2970b43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:59.387003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b218757-de04-490d-b3a0-2cfcb2970b43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:59.388534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b218757-de04-490d-b3a0-2cfcb2970b43 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:59.408852 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-9b218757-de04-490d-b3a0-2cfcb2970b43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:59.408852 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:59.408852 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:59.408852 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:59.408852 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:59.408852 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:59.408852 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:59.408852 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:59.408852 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:59.408852 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:59.408852 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:59.408852 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:59.408852 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:44:59.408852 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:44:59.408852 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:44:59.410924 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:44:59.410924 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:59.410924 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:59.410924 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:59.410924 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:59.410924 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:59.410924 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:59.410924 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:59.410924 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:59.410924 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:59.410924 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:59.410924 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:59.410924 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:59.410924 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:59.410924 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:59.410924 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:59.410924 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:59.413808 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:44:59.413808 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:44:59.413808 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:44:59.413808 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:59.413808 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 366/724] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:59.417421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505fe70-c82f-41af-896b-4968fd203c3a None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:59.456192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:59.548553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505fe70-c82f-41af-896b-4968fd203c3a None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:59.591839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374cd69-9d66-4b0c-a773-f23837129239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:59.592465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374cd69-9d66-4b0c-a773-f23837129239 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:59.592749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374cd69-9d66-4b0c-a773-f23837129239 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:59.593027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374cd69-9d66-4b0c-a773-f23837129239 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:59.593711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374cd69-9d66-4b0c-a773-f23837129239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:44:59.594011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374cd69-9d66-4b0c-a773-f23837129239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:59.595399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374cd69-9d66-4b0c-a773-f23837129239 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:59.612577 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 359/725] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:44:59.618779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b218757-de04-490d-b3a0-2cfcb2970b43 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:59.773953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b218757-de04-490d-b3a0-2cfcb2970b43 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:44:59.776393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:44:59.816805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d8b27-cc52-4e9c-8812-d5722eaafac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:44:59.817460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d8b27-cc52-4e9c-8812-d5722eaafac8 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:59.817876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d8b27-cc52-4e9c-8812-d5722eaafac8 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:59.818154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d8b27-cc52-4e9c-8812-d5722eaafac8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:59.832444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d8b27-cc52-4e9c-8812-d5722eaafac8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:44:59.834515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d8b27-cc52-4e9c-8812-d5722eaafac8 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:44:59.848153 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-175d8b27-cc52-4e9c-8812-d5722eaafac8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 30 20:44:59.848153 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:44:59.848153 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:44:59.848153 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:44:59.848153 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:44:59.848153 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:44:59.848153 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:44:59.848153 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:44:59.848153 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:44:59.848153 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:44:59.848153 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:44:59.848153 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:44:59.848153 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:44:59.848153 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:44:59.848153 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:44:59.848153 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:44:59.849590 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:44:59.849590 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:44:59.849590 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:44:59.849590 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:59.849590 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:44:59.849590 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:44:59.849590 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:44:59.849590 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:44:59.849590 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:44:59.849590 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:44:59.849590 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:44:59.849590 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:44:59.849590 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:44:59.849590 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:44:59.849590 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:44:59.849590 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:44:59.849590 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:44:59.849590 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:44:59.851627 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:44:59.851627 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:44:59.851627 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:44:59.851627 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:44:59.851627 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:44:59.851627 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:44:59.851627 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:44:59.851627 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:44:59.851627 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 30 20:44:59.851627 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:44:59.851627 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 367/726] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:44:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:44:59.856275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374cd69-9d66-4b0c-a773-f23837129239 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:44:59.903873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc67ba4-d35f-4a8e-8f74-0e58d0c8296d None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:59.904222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc67ba4-d35f-4a8e-8f74-0e58d0c8296d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:59.904421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc67ba4-d35f-4a8e-8f74-0e58d0c8296d None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:59.906131 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 368/727] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:44:59.912900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ef661-3214-415a-9ebd-191fa12d620c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:44:59.913199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ef661-3214-415a-9ebd-191fa12d620c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:44:59.913448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ef661-3214-415a-9ebd-191fa12d620c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:44:59.934271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c41ef661-3214-415a-9ebd-191fa12d620c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:44:59.935667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c41ef661-3214-415a-9ebd-191fa12d620c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:00.019388 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 369/728] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 20:45:00.028263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:00.034687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374cd69-9d66-4b0c-a773-f23837129239 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:00.043698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ef661-3214-415a-9ebd-191fa12d620c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:00.116636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9601b-e680-4ada-b2f5-4fd8ba971f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:00.117270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9601b-e680-4ada-b2f5-4fd8ba971f87 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:00.117552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9601b-e680-4ada-b2f5-4fd8ba971f87 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:00.117825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9601b-e680-4ada-b2f5-4fd8ba971f87 None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:00.118920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9601b-e680-4ada-b2f5-4fd8ba971f87 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:00.119224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9601b-e680-4ada-b2f5-4fd8ba971f87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:00.124322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9601b-e680-4ada-b2f5-4fd8ba971f87 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:00.157813 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 360/729] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Jul 30 20:44:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:00.164153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9601b-e680-4ada-b2f5-4fd8ba971f87 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:00.233740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:00.250336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ef661-3214-415a-9ebd-191fa12d620c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:00.317305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c9755-ad8f-48e4-9ac7-a4dfff9a8f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:00.318481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c9755-ad8f-48e4-9ac7-a4dfff9a8f8f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:00.318762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c9755-ad8f-48e4-9ac7-a4dfff9a8f8f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:00.319030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c9755-ad8f-48e4-9ac7-a4dfff9a8f8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:00.343277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c9755-ad8f-48e4-9ac7-a4dfff9a8f8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:45:00.348100 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-e80c9755-ad8f-48e4-9ac7-a4dfff9a8f8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:45:00.348100 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:00.348100 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:00.348100 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:00.348100 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:00.348100 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:00.348100 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:00.348100 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:00.348100 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:00.348100 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:00.348100 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:00.348100 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:00.348100 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:45:00.348100 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:45:00.348100 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:45:00.348100 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:45:00.349579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:45:00.349579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:45:00.349579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:45:00.349579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:45:00.349579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:00.349579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:00.349579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:00.349579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:00.349579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:00.349579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:00.349579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:00.349579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:00.349579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:00.349579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:00.349579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:00.349579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:00.350441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:00.350441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:00.350441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:00.350441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:00.350441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:45:00.350441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:45:00.350441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:45:00.350441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:45:00.350441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:45:00.350441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:45:00.350441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:45:00.350441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:00.350441 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 370/730] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:45:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:00.359641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c9755-ad8f-48e4-9ac7-a4dfff9a8f8f None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:00.366606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9601b-e680-4ada-b2f5-4fd8ba971f87 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:00.433016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71581b-043f-4d5a-86ec-96c305c8233c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:00.433016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71581b-043f-4d5a-86ec-96c305c8233c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:00.433016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71581b-043f-4d5a-86ec-96c305c8233c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:00.433016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71581b-043f-4d5a-86ec-96c305c8233c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:00.457946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:00.546823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71581b-043f-4d5a-86ec-96c305c8233c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:00.548299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71581b-043f-4d5a-86ec-96c305c8233c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:00.565724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c9755-ad8f-48e4-9ac7-a4dfff9a8f8f None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:00.638287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51293a99-18d8-4a5c-a702-805f6c3d1a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:00.640359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51293a99-18d8-4a5c-a702-805f6c3d1a6d None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:00.640648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51293a99-18d8-4a5c-a702-805f6c3d1a6d None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:00.640927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51293a99-18d8-4a5c-a702-805f6c3d1a6d None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:00.642452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51293a99-18d8-4a5c-a702-805f6c3d1a6d None admin] RBAC: Adding query filter params (name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:00.642762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51293a99-18d8-4a5c-a702-805f6c3d1a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:00.644248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51293a99-18d8-4a5c-a702-805f6c3d1a6d None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:00.671900 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 371/731] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:45:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:00.675417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51293a99-18d8-4a5c-a702-805f6c3d1a6d None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:00.734488 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 361/732] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:45:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 20:45:00.736182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:00.740813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71581b-043f-4d5a-86ec-96c305c8233c None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:00.830880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51293a99-18d8-4a5c-a702-805f6c3d1a6d None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:00.836338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:00.878941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd86460-cd5f-4393-9a11-e0a086232e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:00.879776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd86460-cd5f-4393-9a11-e0a086232e88 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:00.880099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd86460-cd5f-4393-9a11-e0a086232e88 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:00.880711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd86460-cd5f-4393-9a11-e0a086232e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:00.886401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71581b-043f-4d5a-86ec-96c305c8233c None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:00.897076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd86460-cd5f-4393-9a11-e0a086232e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:00.899157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd86460-cd5f-4393-9a11-e0a086232e88 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:00.918612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-5bd86460-cd5f-4393-9a11-e0a086232e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:00.918612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:00.918612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:00.918612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:00.918612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:00.918612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:00.918612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:00.918612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:00.918612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:00.918612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:00.918612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:00.918612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:00.918612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:00.918612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:00.918612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:00.919616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:00.919616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:00.919616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:00.919616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:00.919616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:00.919616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:00.919616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:00.919616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:00.919616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:00.919616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:00.919616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:00.919616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:00.919616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:00.919616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:00.919616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:00.919616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:00.919616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:00.920510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:00.920510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:00.920510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:00.920510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:00.920510 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 372/733] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:00.921314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570360bf-2948-487e-8530-0020f200c7e2 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:00.922005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570360bf-2948-487e-8530-0020f200c7e2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:00.922005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570360bf-2948-487e-8530-0020f200c7e2 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:00.923313 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 373/734] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:00.928611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570360bf-2948-487e-8530-0020f200c7e2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:00.928829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ceac37-8b31-4f88-ab72-e1ee54b65330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:00.929521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ceac37-8b31-4f88-ab72-e1ee54b65330 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:00.929809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ceac37-8b31-4f88-ab72-e1ee54b65330 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:00.930088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ceac37-8b31-4f88-ab72-e1ee54b65330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:00.942372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ceac37-8b31-4f88-ab72-e1ee54b65330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:00.944158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ceac37-8b31-4f88-ab72-e1ee54b65330 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:00.960400 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-34ceac37-8b31-4f88-ab72-e1ee54b65330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:00.960400 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:00.960400 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:00.960400 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:00.960400 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:00.960400 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:00.960400 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:00.960400 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:00.960400 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:00.960400 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:00.960400 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:00.960400 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:00.960400 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:00.960400 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:00.960400 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:00.962524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:00.962524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:00.962524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:00.962524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:00.962524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:00.962524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:00.962524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:00.962524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:00.962524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:00.962524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:00.962524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:00.962524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:00.962524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:00.962524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:00.962524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:00.962524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:00.962524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:00.967550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:00.967550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:00.967550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:00.967550 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:00.967550 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 362/735] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:00.967550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b90d1-3762-4b2a-8e13-74cc0b8eb0f0 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:00.968425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b90d1-3762-4b2a-8e13-74cc0b8eb0f0 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:00.968425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b90d1-3762-4b2a-8e13-74cc0b8eb0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:00.992389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-601b90d1-3762-4b2a-8e13-74cc0b8eb0f0 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:00.993564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-601b90d1-3762-4b2a-8e13-74cc0b8eb0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:01.030426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:01.076340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570360bf-2948-487e-8530-0020f200c7e2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:01.083310 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 363/736] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:45:01.083310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b90d1-3762-4b2a-8e13-74cc0b8eb0f0 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:01.130157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6a0e2-b0a8-4fb6-91ce-bc430755154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:01.132098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6a0e2-b0a8-4fb6-91ce-bc430755154a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:01.132647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6a0e2-b0a8-4fb6-91ce-bc430755154a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:01.133130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6a0e2-b0a8-4fb6-91ce-bc430755154a None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:01.134378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6a0e2-b0a8-4fb6-91ce-bc430755154a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:01.135686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6a0e2-b0a8-4fb6-91ce-bc430755154a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:01.136204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:01.137088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6a0e2-b0a8-4fb6-91ce-bc430755154a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:01.157043 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 374/737] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:01.157844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6a0e2-b0a8-4fb6-91ce-bc430755154a None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:01.221102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b90d1-3762-4b2a-8e13-74cc0b8eb0f0 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:01.257985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3a9ed-d39a-467f-bc02-28bc0f2badc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:01.259265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3a9ed-d39a-467f-bc02-28bc0f2badc2 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:01.260039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3a9ed-d39a-467f-bc02-28bc0f2badc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:01.260527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3a9ed-d39a-467f-bc02-28bc0f2badc2 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:01.261899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3a9ed-d39a-467f-bc02-28bc0f2badc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:01.262523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3a9ed-d39a-467f-bc02-28bc0f2badc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:01.264429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3a9ed-d39a-467f-bc02-28bc0f2badc2 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:01.273519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6a0e2-b0a8-4fb6-91ce-bc430755154a None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:01.279019 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 364/738] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:01.284850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea779e0-c2d5-4f47-979f-08ccec8bbbf4 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:01.285182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea779e0-c2d5-4f47-979f-08ccec8bbbf4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:01.285830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea779e0-c2d5-4f47-979f-08ccec8bbbf4 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:01.288166 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 365/739] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:01.292294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea779e0-c2d5-4f47-979f-08ccec8bbbf4 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:01.308657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:01.317466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc8e04-98a3-4f4c-a24a-44f9925165b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:01.318101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc8e04-98a3-4f4c-a24a-44f9925165b1 None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:01.318419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc8e04-98a3-4f4c-a24a-44f9925165b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:01.318695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc8e04-98a3-4f4c-a24a-44f9925165b1 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:01.319422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc8e04-98a3-4f4c-a24a-44f9925165b1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:01.320815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc8e04-98a3-4f4c-a24a-44f9925165b1 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:01.338590 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 375/740] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 30 20:45:01 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:45:01.339443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc8e04-98a3-4f4c-a24a-44f9925165b1 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:01.407281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:01.433949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea779e0-c2d5-4f47-979f-08ccec8bbbf4 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:01.480482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0ddbb-8546-480b-a1ae-e87689b40041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:01.481153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0ddbb-8546-480b-a1ae-e87689b40041 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:01.481447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0ddbb-8546-480b-a1ae-e87689b40041 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:01.481734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0ddbb-8546-480b-a1ae-e87689b40041 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:01.485388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc8e04-98a3-4f4c-a24a-44f9925165b1 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:01.490463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0ddbb-8546-480b-a1ae-e87689b40041 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:01.492022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0ddbb-8546-480b-a1ae-e87689b40041 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:01.505304 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-26c0ddbb-8546-480b-a1ae-e87689b40041 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 30 20:45:01.505304 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:01.505304 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:01.505304 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:01.505304 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:01.505304 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:01.505304 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:01.505304 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:01.505304 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:01.505304 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:01.505304 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:01.505304 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:01.505304 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:45:01.505304 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:45:01.505304 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:45:01.505304 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:45:01.506385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:01.506385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:01.506385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:45:01.506385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:01.506385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:45:01.506385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:01.506385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:01.506385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:01.506385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:01.506385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:01.506385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:01.506385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:01.506385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:01.506385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:01.506385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:01.506385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:01.506385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:01.506385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:01.512508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:01.512508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:01.512508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:45:01.512508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:45:01.512508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:45:01.512508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:45:01.512508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:45:01.512508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:45:01.512508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 30 20:45:01.512508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:01.512508 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 366/741] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Jul 30 20:45:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:01.512508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c13db7-165a-4785-8581-3199507fc580 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:01.512508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c13db7-165a-4785-8581-3199507fc580 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:01.513402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c13db7-165a-4785-8581-3199507fc580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:01.529299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b2c13db7-165a-4785-8581-3199507fc580 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:01.530519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b2c13db7-165a-4785-8581-3199507fc580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:01.530770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e820193-da17-4912-a5e9-fced0a4dbdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:01.531503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e820193-da17-4912-a5e9-fced0a4dbdb1 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:01.531789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e820193-da17-4912-a5e9-fced0a4dbdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:01.532065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e820193-da17-4912-a5e9-fced0a4dbdb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:01.540965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e820193-da17-4912-a5e9-fced0a4dbdb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:01.542445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e820193-da17-4912-a5e9-fced0a4dbdb1 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:01.557270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-8e820193-da17-4912-a5e9-fced0a4dbdb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:01.557270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:01.557270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:01.557270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:01.557270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:01.557270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:01.557270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:01.557270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:01.557270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:01.557270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:01.557270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:01.557270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:01.557270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:45:01.557270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:45:01.557270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:45:01.558240 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:45:01.558240 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:01.558240 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:01.558240 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:01.558240 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:01.558240 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:01.558240 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:01.558240 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:01.558240 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:01.558240 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:01.558240 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:01.558240 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:01.558240 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:01.558240 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:01.558240 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:01.558240 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:01.558240 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:01.559148 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:45:01.559148 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:45:01.559148 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:45:01.559148 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:45:01.559148 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:45:01.559148 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:45:01.559148 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:01.559148 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:01.559148 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 376/742] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:45:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:01.560427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd5237-37bf-4c9f-a96d-ceaa22b89475 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:01.560427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd5237-37bf-4c9f-a96d-ceaa22b89475 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:01.560427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd5237-37bf-4c9f-a96d-ceaa22b89475 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:01.561788 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 377/743] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:01.566111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd5237-37bf-4c9f-a96d-ceaa22b89475 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:01.612785 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 367/744] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:45:01.613641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c13db7-165a-4785-8581-3199507fc580 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:01.614636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:01.678833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd5237-37bf-4c9f-a96d-ceaa22b89475 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:01.707253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:01.717464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399df63-8b85-4981-b45c-c9e10e73216a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:01.718298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399df63-8b85-4981-b45c-c9e10e73216a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:01.718587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399df63-8b85-4981-b45c-c9e10e73216a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:01.718881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399df63-8b85-4981-b45c-c9e10e73216a None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:01.719707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399df63-8b85-4981-b45c-c9e10e73216a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:01.720020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399df63-8b85-4981-b45c-c9e10e73216a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:01.721461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399df63-8b85-4981-b45c-c9e10e73216a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:01.731188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c13db7-165a-4785-8581-3199507fc580 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:01.740346 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 378/745] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Jul 30 20:45:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:01.741588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7443342-d73a-4c50-b958-29f474026ef4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:01.741877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7443342-d73a-4c50-b958-29f474026ef4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:01.742154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7443342-d73a-4c50-b958-29f474026ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:01.760610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c7443342-d73a-4c50-b958-29f474026ef4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:01.761804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c7443342-d73a-4c50-b958-29f474026ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:01.777359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97168719-d90a-4593-a619-fb249dbd8af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:01.777931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97168719-d90a-4593-a619-fb249dbd8af4 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:01.778216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97168719-d90a-4593-a619-fb249dbd8af4 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:01.778494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97168719-d90a-4593-a619-fb249dbd8af4 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:01.779247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97168719-d90a-4593-a619-fb249dbd8af4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:01.779587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97168719-d90a-4593-a619-fb249dbd8af4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:01.781018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97168719-d90a-4593-a619-fb249dbd8af4 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:01.793506 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 368/746] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:45:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:01.794131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97168719-d90a-4593-a619-fb249dbd8af4 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:01.846022 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 379/747] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 20:45:01.847561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7443342-d73a-4c50-b958-29f474026ef4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:01.889470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:01.907229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97168719-d90a-4593-a619-fb249dbd8af4 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:01.944670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93f050-2cdb-428d-a53e-6e6b4a91e6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:01.945329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93f050-2cdb-428d-a53e-6e6b4a91e6b2 None admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:01.945613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93f050-2cdb-428d-a53e-6e6b4a91e6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:01.945889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93f050-2cdb-428d-a53e-6e6b4a91e6b2 None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:01.946921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93f050-2cdb-428d-a53e-6e6b4a91e6b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:01.948413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93f050-2cdb-428d-a53e-6e6b4a91e6b2 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:01.959587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7443342-d73a-4c50-b958-29f474026ef4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:01.964847 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 369/748] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 30 20:45:01 2022] POST /identity/v3/services => generated 240 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:45:01.965483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93f050-2cdb-428d-a53e-6e6b4a91e6b2 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:01.968259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:02.036588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b71ebd-2901-4959-a1c6-654c19090b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:02.037307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b71ebd-2901-4959-a1c6-654c19090b3b None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:02.037773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b71ebd-2901-4959-a1c6-654c19090b3b None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:02.038146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b71ebd-2901-4959-a1c6-654c19090b3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:02.121165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b71ebd-2901-4959-a1c6-654c19090b3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:02.122837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b71ebd-2901-4959-a1c6-654c19090b3b None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:02.136551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93f050-2cdb-428d-a53e-6e6b4a91e6b2 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:02.160437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:02.184952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184593e-8e58-43b0-bd27-eac4878ca867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:02.185726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184593e-8e58-43b0-bd27-eac4878ca867 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:02.186113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184593e-8e58-43b0-bd27-eac4878ca867 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:02.186507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184593e-8e58-43b0-bd27-eac4878ca867 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:02.187493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184593e-8e58-43b0-bd27-eac4878ca867 None admin] RBAC: Adding query filter params (role.id=3b89b89da98d4ec08a0587aa13832636, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=2181960e3bed4031889d6e72a721e151) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:02.187911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184593e-8e58-43b0-bd27-eac4878ca867 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:02.189479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184593e-8e58-43b0-bd27-eac4878ca867 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:02.198442 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 370/749] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:45:01 2022] GET /identity/v3/role_assignments?user.id=2181960e3bed4031889d6e72a721e151&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=3b89b89da98d4ec08a0587aa13832636 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:02.199259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184593e-8e58-43b0-bd27-eac4878ca867 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:02.251459 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 380/750] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:45:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 30 20:45:02.260523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b71ebd-2901-4959-a1c6-654c19090b3b None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:02.299483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:02.367948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184593e-8e58-43b0-bd27-eac4878ca867 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:02.420159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cfa9c-e6ba-4c62-adc1-f4a452cf0dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:02.421156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cfa9c-e6ba-4c62-adc1-f4a452cf0dfc None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:02.421543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cfa9c-e6ba-4c62-adc1-f4a452cf0dfc None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:02.422242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cfa9c-e6ba-4c62-adc1-f4a452cf0dfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:02.428537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b71ebd-2901-4959-a1c6-654c19090b3b None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:02.436749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cfa9c-e6ba-4c62-adc1-f4a452cf0dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:45:02.444495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-2b8cfa9c-e6ba-4c62-adc1-f4a452cf0dfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:45:02.444495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:02.444495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:02.444495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:02.444495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:02.444495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:02.444495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:02.444495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:02.444495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:02.444495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:02.444495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:02.444495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:02.444495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:45:02.444495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:45:02.444495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:45:02.444495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:45:02.445555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:45:02.445555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:45:02.445555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:45:02.445555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:45:02.445555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:02.445555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:02.445555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:02.445555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:02.445555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:02.445555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:02.445555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:02.445555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:02.445555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:02.445555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:02.445555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:02.445555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:02.446571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:02.446571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:02.446571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:02.446571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:02.446571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:45:02.446571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:45:02.446571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:45:02.446571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:45:02.446571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:45:02.446571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:45:02.446571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:45:02.446571 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:02.449728 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 371/751] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:45:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:02.454893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cfa9c-e6ba-4c62-adc1-f4a452cf0dfc None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:02.478439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:02.490575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edd961-37e7-4714-aaa8-f3f6fc2c71bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:02.491473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edd961-37e7-4714-aaa8-f3f6fc2c71bd None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:02.491855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edd961-37e7-4714-aaa8-f3f6fc2c71bd None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:02.492225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edd961-37e7-4714-aaa8-f3f6fc2c71bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:02.509096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35edd961-37e7-4714-aaa8-f3f6fc2c71bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:02.511520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35edd961-37e7-4714-aaa8-f3f6fc2c71bd None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:02.528368 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-35edd961-37e7-4714-aaa8-f3f6fc2c71bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:02.528368 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:02.528368 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:02.528368 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:02.528368 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:02.528368 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:02.528368 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:02.528368 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:02.528368 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:02.528368 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:02.528368 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:02.528368 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:02.528368 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:02.528368 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:02.528368 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:02.529457 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:02.529457 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:02.529457 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:02.529457 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:02.529457 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:02.529457 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:02.529457 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:02.529457 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:02.529457 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:02.529457 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:02.529457 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:02.529457 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:02.529457 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:02.529457 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:02.529457 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:02.529457 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:02.529457 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:02.530546 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:02.530546 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:02.530546 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:02.530546 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:02.533097 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 381/752] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:02.543366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edd961-37e7-4714-aaa8-f3f6fc2c71bd None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:02.657355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cfa9c-e6ba-4c62-adc1-f4a452cf0dfc None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:02.678779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edd961-37e7-4714-aaa8-f3f6fc2c71bd None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:02.696442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f5160-02a0-44a9-8049-7cc1f078dc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:02.697244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f5160-02a0-44a9-8049-7cc1f078dc2f None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:02.697780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f5160-02a0-44a9-8049-7cc1f078dc2f None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:02.698570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f5160-02a0-44a9-8049-7cc1f078dc2f None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:02.699449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f5160-02a0-44a9-8049-7cc1f078dc2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:02.699878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:02.700373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f5160-02a0-44a9-8049-7cc1f078dc2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:02.702668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f5160-02a0-44a9-8049-7cc1f078dc2f None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:02.713187 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 372/753] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:45:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:02.718695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f5160-02a0-44a9-8049-7cc1f078dc2f None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:02.761770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0083bb-66b9-469b-9a47-919c56d7d00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:02.762582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0083bb-66b9-469b-9a47-919c56d7d00e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:02.763012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0083bb-66b9-469b-9a47-919c56d7d00e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:02.763440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0083bb-66b9-469b-9a47-919c56d7d00e None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:02.764349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0083bb-66b9-469b-9a47-919c56d7d00e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:02.764761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0083bb-66b9-469b-9a47-919c56d7d00e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:02.766419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0083bb-66b9-469b-9a47-919c56d7d00e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:02.790369 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 382/754] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:02.794961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0083bb-66b9-469b-9a47-919c56d7d00e None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:02.857859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f5160-02a0-44a9-8049-7cc1f078dc2f None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:02.892994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c835e-31f0-4ad1-8783-fbdaac8e1518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:02.893910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c835e-31f0-4ad1-8783-fbdaac8e1518 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:02.894340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c835e-31f0-4ad1-8783-fbdaac8e1518 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:02.894780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c835e-31f0-4ad1-8783-fbdaac8e1518 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:02.906114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c835e-31f0-4ad1-8783-fbdaac8e1518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:02.907837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c835e-31f0-4ad1-8783-fbdaac8e1518 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:02.924954 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-c96c835e-31f0-4ad1-8783-fbdaac8e1518 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:02.924954 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:02.924954 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:02.924954 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:02.924954 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:02.924954 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:02.924954 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:02.924954 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:02.924954 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:02.924954 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:02.924954 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:02.924954 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:02.924954 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:02.924954 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:02.924954 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:02.926066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:02.926066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:02.926066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:02.926066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:02.926066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:02.926066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:02.926066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:02.926066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:02.926066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:02.926066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:02.926066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:02.926066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:02.926066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:02.926066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:02.926066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:02.926066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:02.926066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:02.927153 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:02.927153 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:02.927153 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:02.927153 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:02.933316 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 373/755] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:02.934694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c835e-31f0-4ad1-8783-fbdaac8e1518 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:02.943658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:02.987073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:03.029073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0083bb-66b9-469b-9a47-919c56d7d00e None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:03.056129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c835e-31f0-4ad1-8783-fbdaac8e1518 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:03.094829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942d9b2-4a5c-4876-ba61-5426fcb52fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:03.095513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942d9b2-4a5c-4876-ba61-5426fcb52fc7 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:03.095800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942d9b2-4a5c-4876-ba61-5426fcb52fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:03.096079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942d9b2-4a5c-4876-ba61-5426fcb52fc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:03.110024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942d9b2-4a5c-4876-ba61-5426fcb52fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:03.111501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942d9b2-4a5c-4876-ba61-5426fcb52fc7 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:03.128369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc97f52-18dc-4ffe-9ed8-c472461eb04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:03.128996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc97f52-18dc-4ffe-9ed8-c472461eb04d None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:03.129280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc97f52-18dc-4ffe-9ed8-c472461eb04d None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:03.129550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc97f52-18dc-4ffe-9ed8-c472461eb04d None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:03.130804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc97f52-18dc-4ffe-9ed8-c472461eb04d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:03.131110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc97f52-18dc-4ffe-9ed8-c472461eb04d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:03.132554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc97f52-18dc-4ffe-9ed8-c472461eb04d None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:03.137692 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-1942d9b2-4a5c-4876-ba61-5426fcb52fc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:03.137692 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:03.137692 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:03.137692 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:03.137692 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:03.137692 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:03.137692 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:03.137692 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:03.137692 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:03.137692 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:03.137692 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:03.137692 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:03.137692 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:45:03.137692 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:45:03.137692 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:45:03.138717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:45:03.138717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:03.138717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:03.138717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:03.138717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:03.138717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:03.138717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:03.138717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:03.138717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:03.138717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:03.138717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:03.138717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:03.138717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:03.138717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:03.138717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:03.138717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:03.138717 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:03.140990 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:45:03.140990 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:45:03.140990 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:45:03.140990 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:45:03.140990 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:45:03.140990 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:45:03.140990 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:03.140990 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:03.144588 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 383/756] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:45:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:03.145472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942d9b2-4a5c-4876-ba61-5426fcb52fc7 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:03.161095 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 374/757] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:03.166683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc97f52-18dc-4ffe-9ed8-c472461eb04d None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:03.327699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:03.331404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc97f52-18dc-4ffe-9ed8-c472461eb04d None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:03.351021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942d9b2-4a5c-4876-ba61-5426fcb52fc7 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:03.367666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:03.374503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975543e-5667-4e98-a1c0-07121d2baa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:03.375582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975543e-5667-4e98-a1c0-07121d2baa07 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:03.376021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975543e-5667-4e98-a1c0-07121d2baa07 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:03.376311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975543e-5667-4e98-a1c0-07121d2baa07 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:03.385031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975543e-5667-4e98-a1c0-07121d2baa07 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:03.386502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975543e-5667-4e98-a1c0-07121d2baa07 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:03.400343 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-f975543e-5667-4e98-a1c0-07121d2baa07 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 30 20:45:03.400343 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:03.400343 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:03.400343 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:03.400343 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:03.400343 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:03.400343 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:03.400343 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:03.400343 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:03.400343 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:03.400343 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:03.400343 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:03.400343 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:45:03.400343 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:45:03.400343 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:45:03.400343 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:45:03.402270 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:03.402270 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:03.402270 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:45:03.402270 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:03.402270 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:45:03.402270 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:03.402270 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:03.402270 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:03.402270 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:03.402270 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:03.402270 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:03.402270 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:03.402270 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:03.402270 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:03.402270 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:03.402270 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:03.402270 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:03.402270 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:03.403475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:03.403475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:03.403475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:45:03.403475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:45:03.403475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:45:03.403475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:45:03.403475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:45:03.403475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:45:03.403475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 30 20:45:03.403475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:03.403475 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 375/758] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Jul 30 20:45:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:03.412498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975543e-5667-4e98-a1c0-07121d2baa07 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:03.426439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d05fa-b2b3-40e1-bdd8-8191eda43289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:03.427644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d05fa-b2b3-40e1-bdd8-8191eda43289 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:03.427931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d05fa-b2b3-40e1-bdd8-8191eda43289 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:03.428205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d05fa-b2b3-40e1-bdd8-8191eda43289 None admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:03.428958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d05fa-b2b3-40e1-bdd8-8191eda43289 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:03.429266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d05fa-b2b3-40e1-bdd8-8191eda43289 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:03.430868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d05fa-b2b3-40e1-bdd8-8191eda43289 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:03.444952 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 384/759] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:45:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:03.451343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d05fa-b2b3-40e1-bdd8-8191eda43289 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:03.578009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975543e-5667-4e98-a1c0-07121d2baa07 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:03.609627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d05fa-b2b3-40e1-bdd8-8191eda43289 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:03.613575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eaa60c-afa4-4f2f-92a3-892c3eef506f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:03.614315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaa60c-afa4-4f2f-92a3-892c3eef506f None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:03.614709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaa60c-afa4-4f2f-92a3-892c3eef506f None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:03.615056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaa60c-afa4-4f2f-92a3-892c3eef506f None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:03.616855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eaa60c-afa4-4f2f-92a3-892c3eef506f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:03.617243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eaa60c-afa4-4f2f-92a3-892c3eef506f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:03.618789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eaa60c-afa4-4f2f-92a3-892c3eef506f None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:03.640045 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 376/760] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Jul 30 20:45:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:03.646125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eaa60c-afa4-4f2f-92a3-892c3eef506f None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:03.684342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f587a0-eb62-4c0f-bdb9-6defebce60ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:03.686287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f587a0-eb62-4c0f-bdb9-6defebce60ee None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:03.686287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f587a0-eb62-4c0f-bdb9-6defebce60ee None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:03.686287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f587a0-eb62-4c0f-bdb9-6defebce60ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:03.688088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f587a0-eb62-4c0f-bdb9-6defebce60ee None admin] RBAC: Adding query filter params (role.id=50fb737d5edf48298d0a6061ba652acb, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=877b427e6ff84af29a59dc9e1a3128ef) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:03.688088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f587a0-eb62-4c0f-bdb9-6defebce60ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:03.689692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f587a0-eb62-4c0f-bdb9-6defebce60ee None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:03.695722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:03.697712 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 385/761] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:45:03 2022] GET /identity/v3/role_assignments?user.id=877b427e6ff84af29a59dc9e1a3128ef&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=50fb737d5edf48298d0a6061ba652acb => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:03.865961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eaa60c-afa4-4f2f-92a3-892c3eef506f None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:03.899922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d584a1-ffc6-4f4a-af9c-0fb2f128bbc0 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:03.900253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d584a1-ffc6-4f4a-af9c-0fb2f128bbc0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:03.900478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d584a1-ffc6-4f4a-af9c-0fb2f128bbc0 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:03.906566 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 386/762] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:03.911609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618560f0-3b1f-4bd6-ad37-4fcd7c08396e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:03.911609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618560f0-3b1f-4bd6-ad37-4fcd7c08396e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:03.911609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618560f0-3b1f-4bd6-ad37-4fcd7c08396e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:03.928392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-618560f0-3b1f-4bd6-ad37-4fcd7c08396e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:03.929318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525b733-1cb7-421d-9e85-4d3536168191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:03.929565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-618560f0-3b1f-4bd6-ad37-4fcd7c08396e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:03.929980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525b733-1cb7-421d-9e85-4d3536168191 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:03.930267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525b733-1cb7-421d-9e85-4d3536168191 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:03.930547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525b733-1cb7-421d-9e85-4d3536168191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:03.952154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525b733-1cb7-421d-9e85-4d3536168191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:03.953682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525b733-1cb7-421d-9e85-4d3536168191 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:03.975975 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-7525b733-1cb7-421d-9e85-4d3536168191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:03.975975 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:03.975975 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:03.975975 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:03.975975 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:03.975975 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:03.975975 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:03.975975 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:03.975975 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:03.975975 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:03.975975 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:03.975975 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:03.975975 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:03.975975 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:03.975975 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:03.976938 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:03.976938 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:03.976938 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:03.976938 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:03.976938 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:03.976938 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:03.976938 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:03.976938 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:03.976938 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:03.976938 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:03.976938 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:03.976938 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:03.976938 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:03.976938 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:03.976938 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:03.976938 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:03.976938 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:03.977857 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:03.977857 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:03.977857 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:03.977857 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:03.979351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:03.979782 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 377/763] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:03.986672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525b733-1cb7-421d-9e85-4d3536168191 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:04.060817 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 387/764] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:04.095714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:04.099315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618560f0-3b1f-4bd6-ad37-4fcd7c08396e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:04.150672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525b733-1cb7-421d-9e85-4d3536168191 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:04.213593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b50fa-d6be-4eb0-a082-395a77155519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:04.214143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b50fa-d6be-4eb0-a082-395a77155519 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:04.214426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b50fa-d6be-4eb0-a082-395a77155519 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:04.214699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b50fa-d6be-4eb0-a082-395a77155519 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:04.215421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b50fa-d6be-4eb0-a082-395a77155519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:04.215728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b50fa-d6be-4eb0-a082-395a77155519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:04.217180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b50fa-d6be-4eb0-a082-395a77155519 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:04.238546 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 378/765] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:04.242992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b50fa-d6be-4eb0-a082-395a77155519 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:04.284476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618560f0-3b1f-4bd6-ad37-4fcd7c08396e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:04.345051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8033d1-dde4-4e9d-afe0-8dc17a815cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:04.345705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8033d1-dde4-4e9d-afe0-8dc17a815cd0 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:04.345988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8033d1-dde4-4e9d-afe0-8dc17a815cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:04.346260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8033d1-dde4-4e9d-afe0-8dc17a815cd0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:04.346883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8033d1-dde4-4e9d-afe0-8dc17a815cd0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:04.348288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8033d1-dde4-4e9d-afe0-8dc17a815cd0 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:04.360791 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-ef8033d1-dde4-4e9d-afe0-8dc17a815cd0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 30 20:45:04.360791 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:04.360791 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:04.360791 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:04.360791 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:04.360791 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:04.360791 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:04.360791 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:04.360791 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 30 20:45:04.360791 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:04.360791 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:04.360791 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:04.360791 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:04.360791 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:04.360791 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:04.360791 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:04.361768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:04.361768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:04.361768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:04.361768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:04.361768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:04.361768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:04.361768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:04.361768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:04.361768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:04.361768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:04.361768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:04.361768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:04.361768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:04.361768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:04.361768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:04.361768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:04.362658 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:04.362658 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:04.362658 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:04.362658 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:04.362658 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:04.362658 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:04.362658 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:04.362658 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:04.362658 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:04.362658 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:04.362658 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:04.362658 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:04.362658 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:04.362658 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 30 20:45:04.362658 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:04.363520 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 388/766] 10.222.0.17 () {56 vars in 1129 bytes} [Sat Jul 30 20:45:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:04.373388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8033d1-dde4-4e9d-afe0-8dc17a815cd0 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:04.420633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:04.431365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b50fa-d6be-4eb0-a082-395a77155519 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:04.491769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:04.504422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dc3c9-877e-494c-917d-47d14f3af060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:04.505156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dc3c9-877e-494c-917d-47d14f3af060 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:04.505470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dc3c9-877e-494c-917d-47d14f3af060 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:04.505712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dc3c9-877e-494c-917d-47d14f3af060 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:04.523783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9dc3c9-877e-494c-917d-47d14f3af060 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:04.526132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9dc3c9-877e-494c-917d-47d14f3af060 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:04.544823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-8b9dc3c9-877e-494c-917d-47d14f3af060 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:04.544823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:04.544823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:04.544823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:04.544823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:04.544823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:04.544823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:04.544823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:04.544823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:04.544823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:04.544823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:04.544823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:04.544823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:45:04.544823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:45:04.544823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:45:04.545807 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:45:04.545807 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:04.545807 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:04.545807 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:04.545807 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:04.545807 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:04.545807 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:04.545807 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:04.545807 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:04.545807 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:04.545807 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:04.545807 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:04.545807 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:04.545807 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:04.545807 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:04.545807 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:04.545807 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:04.546714 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:45:04.546714 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:45:04.546714 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:45:04.546714 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:45:04.546714 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:45:04.546714 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:45:04.546714 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:04.546714 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:04.548077 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 379/767] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:45:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:04.553145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dc3c9-877e-494c-917d-47d14f3af060 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:04.575614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8033d1-dde4-4e9d-afe0-8dc17a815cd0 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:04.614146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7224c3a-5214-43f1-afa4-3f04836b6054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:04.614782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7224c3a-5214-43f1-afa4-3f04836b6054 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:04.615107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7224c3a-5214-43f1-afa4-3f04836b6054 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:04.615428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7224c3a-5214-43f1-afa4-3f04836b6054 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:04.616106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7224c3a-5214-43f1-afa4-3f04836b6054 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:04.616406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7224c3a-5214-43f1-afa4-3f04836b6054 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:04.617973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7224c3a-5214-43f1-afa4-3f04836b6054 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:04.623388 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 389/768] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Jul 30 20:45:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:04.634934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7224c3a-5214-43f1-afa4-3f04836b6054 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:04.717354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dc3c9-877e-494c-917d-47d14f3af060 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:04.753204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c8109-6b2e-4b3a-a71c-ae8c68d7e0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:04.753754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c8109-6b2e-4b3a-a71c-ae8c68d7e0ab None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:04.754157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c8109-6b2e-4b3a-a71c-ae8c68d7e0ab None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:04.754434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c8109-6b2e-4b3a-a71c-ae8c68d7e0ab None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:04.755869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c8109-6b2e-4b3a-a71c-ae8c68d7e0ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:04.756176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c8109-6b2e-4b3a-a71c-ae8c68d7e0ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:04.757611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c8109-6b2e-4b3a-a71c-ae8c68d7e0ab None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:04.770126 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 380/769] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:45:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:04.771945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54649983-35b6-4360-a6df-8afd6ff299b5 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:04.772233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54649983-35b6-4360-a6df-8afd6ff299b5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:04.772513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54649983-35b6-4360-a6df-8afd6ff299b5 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:04.773976 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 381/770] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:04.780784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:04.781908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d291a57-f829-481c-8f68-2079bda37ba5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:04.782196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d291a57-f829-481c-8f68-2079bda37ba5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:04.782512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d291a57-f829-481c-8f68-2079bda37ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:04.799195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7224c3a-5214-43f1-afa4-3f04836b6054 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:04.804984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8d291a57-f829-481c-8f68-2079bda37ba5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:04.806199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8d291a57-f829-481c-8f68-2079bda37ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:04.844821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46d543-eaa6-4cd8-89cd-3939a4857ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:04.845980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46d543-eaa6-4cd8-89cd-3939a4857ab5 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:04.846457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46d543-eaa6-4cd8-89cd-3939a4857ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:04.846872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46d543-eaa6-4cd8-89cd-3939a4857ab5 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:04.847617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46d543-eaa6-4cd8-89cd-3939a4857ab5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:04.847923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46d543-eaa6-4cd8-89cd-3939a4857ab5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:04.849425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46d543-eaa6-4cd8-89cd-3939a4857ab5 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:04.857899 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 390/771] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Jul 30 20:45:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:04.859385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46d543-eaa6-4cd8-89cd-3939a4857ab5 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:04.872112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:04.911687 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 382/772] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:04.911687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d291a57-f829-481c-8f68-2079bda37ba5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:05.019035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46d543-eaa6-4cd8-89cd-3939a4857ab5 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:05.035116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d291a57-f829-481c-8f68-2079bda37ba5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:05.059114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920eb41-df79-4887-b6a3-b106d8e0dca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:05.060249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920eb41-df79-4887-b6a3-b106d8e0dca5 None admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:05.060538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920eb41-df79-4887-b6a3-b106d8e0dca5 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:05.060966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920eb41-df79-4887-b6a3-b106d8e0dca5 None admin] PATH_INFO: `/v3/projects/ec96772eef284ab3913f9628b136be7a/users/08a2a5793b7a4797a470719a682e541a/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:05.062921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920eb41-df79-4887-b6a3-b106d8e0dca5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec96772eef284ab3913f9628b136be7a, user_id=08a2a5793b7a4797a470719a682e541a, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:05.064414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920eb41-df79-4887-b6a3-b106d8e0dca5 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:05.075656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464b4dd-19ce-4632-9360-77b915e212d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:05.076240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464b4dd-19ce-4632-9360-77b915e212d3 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:05.076579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464b4dd-19ce-4632-9360-77b915e212d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:05.076792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464b4dd-19ce-4632-9360-77b915e212d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:05.077541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464b4dd-19ce-4632-9360-77b915e212d3 None admin] RBAC: Adding query filter params (interface=public, service_id=94f6eabd29cc4d71bec9297516770443, region_id=RegionOne) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:05.077852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464b4dd-19ce-4632-9360-77b915e212d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:05.087660 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 391/773] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:45:04 2022] PUT /identity/v3/projects/ec96772eef284ab3913f9628b136be7a/users/08a2a5793b7a4797a470719a682e541a/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:45:05.087878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464b4dd-19ce-4632-9360-77b915e212d3 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:05.087964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920eb41-df79-4887-b6a3-b106d8e0dca5 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:05.088039 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 383/774] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Jul 30 20:45:04 2022] GET /identity/v3/endpoints?service_id=94f6eabd29cc4d71bec9297516770443&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:05.088554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56b256-e69e-4705-9172-968d6a610bee None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:05.089134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56b256-e69e-4705-9172-968d6a610bee None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:05.089412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56b256-e69e-4705-9172-968d6a610bee None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:05.094987 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 384/775] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:05.096583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56b256-e69e-4705-9172-968d6a610bee None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:05.108236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:05.150406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:05.231210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56b256-e69e-4705-9172-968d6a610bee None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:05.243080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920eb41-df79-4887-b6a3-b106d8e0dca5 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:05.284438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b24d08-6667-441f-99b4-084696ce4b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:05.285380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b24d08-6667-441f-99b4-084696ce4b6c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:05.285612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b24d08-6667-441f-99b4-084696ce4b6c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:05.285888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b24d08-6667-441f-99b4-084696ce4b6c None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:05.286634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b24d08-6667-441f-99b4-084696ce4b6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:05.288026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b24d08-6667-441f-99b4-084696ce4b6c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:05.288357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109788b-6d93-463e-a084-24557f0eeab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:05.289126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109788b-6d93-463e-a084-24557f0eeab1 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:05.289416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109788b-6d93-463e-a084-24557f0eeab1 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:05.289859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109788b-6d93-463e-a084-24557f0eeab1 None admin] PATH_INFO: `/v3/services/network` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:05.290428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109788b-6d93-463e-a084-24557f0eeab1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:05.291856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109788b-6d93-463e-a084-24557f0eeab1 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:05.293892 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 385/776] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Jul 30 20:45:05 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:05.294885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d113-f86c-4fe6-9180-e7c5705bf70c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:05.295173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d113-f86c-4fe6-9180-e7c5705bf70c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:05.297277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d113-f86c-4fe6-9180-e7c5705bf70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:05.302222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-6109788b-6d93-463e-a084-24557f0eeab1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 30 20:45:05.302222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:05.302222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:05.302222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:05.302222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:05.302222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:05.302222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:05.302222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:05.302222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 30 20:45:05.302222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:05.302222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:05.302222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:05.302222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:05.302222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:05.302222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:05.302222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:05.302222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:05.303269 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:05.303269 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:05.303269 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:05.303269 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:05.303269 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:05.303269 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:05.303269 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:05.303269 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:05.303269 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:05.303269 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:05.303269 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:05.303269 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:05.303269 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:05.303269 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:05.303269 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:05.303269 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:05.304173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:05.304173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:05.304173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:05.304173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:05.304173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:05.304173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:05.304173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:05.304173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:05.304173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:05.304173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:05.304173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:05.304173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:05.304173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 30 20:45:05.304173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:05.308475 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 392/777] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:45:05 2022] GET /identity/v3/services/network => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:05.310701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109788b-6d93-463e-a084-24557f0eeab1 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:05.319386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b783d113-f86c-4fe6-9180-e7c5705bf70c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:05.320656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b783d113-f86c-4fe6-9180-e7c5705bf70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:05.406224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:05.419683 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 386/778] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:05.440792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109788b-6d93-463e-a084-24557f0eeab1 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:05.452052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783d113-f86c-4fe6-9180-e7c5705bf70c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:05.521590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:05.522921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbed5ff-be5a-4373-bc02-4fac714127ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:05.523655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbed5ff-be5a-4373-bc02-4fac714127ad None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:05.523981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbed5ff-be5a-4373-bc02-4fac714127ad None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:05.524240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbed5ff-be5a-4373-bc02-4fac714127ad None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:05.524987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbed5ff-be5a-4373-bc02-4fac714127ad None admin] RBAC: Adding query filter params (name=network) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:05.525291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbed5ff-be5a-4373-bc02-4fac714127ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:05.526832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbed5ff-be5a-4373-bc02-4fac714127ad None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:05.539244 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 393/779] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 30 20:45:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:05.545175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbed5ff-be5a-4373-bc02-4fac714127ad None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:05.609864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783d113-f86c-4fe6-9180-e7c5705bf70c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:05.648722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf52ca2-1e0f-49c4-b834-404985dde949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:05.649854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf52ca2-1e0f-49c4-b834-404985dde949 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:05.650434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf52ca2-1e0f-49c4-b834-404985dde949 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:05.650911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf52ca2-1e0f-49c4-b834-404985dde949 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:05.653102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbed5ff-be5a-4373-bc02-4fac714127ad None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:05.663246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf52ca2-1e0f-49c4-b834-404985dde949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:45:05.668960 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-eaf52ca2-1e0f-49c4-b834-404985dde949 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:45:05.668960 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:05.668960 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:05.668960 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:05.668960 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:05.668960 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:05.668960 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:05.668960 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:05.668960 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:05.668960 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:05.668960 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:05.668960 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:05.668960 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:45:05.668960 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:45:05.668960 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:45:05.668960 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:45:05.669893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:45:05.669893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:45:05.669893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:45:05.669893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:45:05.669893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:05.669893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:05.669893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:05.669893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:05.669893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:05.669893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:05.669893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:05.669893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:05.669893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:05.669893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:05.669893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:05.669893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:05.670745 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:05.670745 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:05.670745 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:05.670745 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:05.670745 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:45:05.670745 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:45:05.670745 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:45:05.670745 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:45:05.670745 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:45:05.670745 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:45:05.670745 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:45:05.670745 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:05.673515 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 387/780] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:45:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:05.680530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf52ca2-1e0f-49c4-b834-404985dde949 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:05.689712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b23a4-4b58-4504-9496-4660c02acf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:05.690406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b23a4-4b58-4504-9496-4660c02acf96 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:05.690692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b23a4-4b58-4504-9496-4660c02acf96 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:05.690968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b23a4-4b58-4504-9496-4660c02acf96 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:05.691682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b23a4-4b58-4504-9496-4660c02acf96 None admin] RBAC: Adding query filter params (type=network) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:05.691988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b23a4-4b58-4504-9496-4660c02acf96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:05.693629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b23a4-4b58-4504-9496-4660c02acf96 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:05.698901 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 394/781] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 30 20:45:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:05.704390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b23a4-4b58-4504-9496-4660c02acf96 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:05.707497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:05.814078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b23a4-4b58-4504-9496-4660c02acf96 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:05.849986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96beeb6-313a-4015-93a1-1a90a682416a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:05.850620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96beeb6-313a-4015-93a1-1a90a682416a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:05.850900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96beeb6-313a-4015-93a1-1a90a682416a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:05.851176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96beeb6-313a-4015-93a1-1a90a682416a None admin] PATH_INFO: `/v3/endpoints` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:05.852006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96beeb6-313a-4015-93a1-1a90a682416a None admin] RBAC: Adding query filter params (interface=public, service_id=1ae8ca1f50a04b29a352fea8e3c22443, region_id=RegionOne) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:05.852318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96beeb6-313a-4015-93a1-1a90a682416a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:05.853970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96beeb6-313a-4015-93a1-1a90a682416a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:05.861753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:05.862858 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 395/782] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Jul 30 20:45:05 2022] GET /identity/v3/endpoints?service_id=1ae8ca1f50a04b29a352fea8e3c22443&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:05.869029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96beeb6-313a-4015-93a1-1a90a682416a None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:05.873824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf52ca2-1e0f-49c4-b834-404985dde949 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:05.937128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e744b72-282e-431f-9bd0-fd255785219b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:05.937914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e744b72-282e-431f-9bd0-fd255785219b None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:05.938197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e744b72-282e-431f-9bd0-fd255785219b None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:05.938518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e744b72-282e-431f-9bd0-fd255785219b None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:05.939241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e744b72-282e-431f-9bd0-fd255785219b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:05.939569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e744b72-282e-431f-9bd0-fd255785219b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:05.940930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e744b72-282e-431f-9bd0-fd255785219b None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:05.951329 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 388/783] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:45:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:05.956549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e744b72-282e-431f-9bd0-fd255785219b None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:06.049050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:06.075687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e744b72-282e-431f-9bd0-fd255785219b None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:06.126803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96beeb6-313a-4015-93a1-1a90a682416a None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:06.128836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86912d6-8f78-4530-aa65-f22b4fc0d4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:06.129486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86912d6-8f78-4530-aa65-f22b4fc0d4b6 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:06.130298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86912d6-8f78-4530-aa65-f22b4fc0d4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:06.130573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86912d6-8f78-4530-aa65-f22b4fc0d4b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:06.153243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86912d6-8f78-4530-aa65-f22b4fc0d4b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:06.154718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86912d6-8f78-4530-aa65-f22b4fc0d4b6 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:06.184361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-f86912d6-8f78-4530-aa65-f22b4fc0d4b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:06.184361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:06.184361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:06.184361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:06.184361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:06.184361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:06.184361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:06.184361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:06.184361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:06.184361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:06.184361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:06.184361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:06.184361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:06.184361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:06.184361 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:06.185330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:06.185330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:06.185330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:06.185330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:06.185330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:06.185330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:06.185330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:06.185330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:06.185330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:06.185330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:06.185330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:06.185330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:06.185330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:06.185330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:06.185330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:06.185330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:06.185330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:06.186239 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:06.186239 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:06.186239 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:06.186239 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:06.192135 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 389/784] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:06.197766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56158709-f546-43fb-b35c-3ee1c7422d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:06.199110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86912d6-8f78-4530-aa65-f22b4fc0d4b6 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:06.199759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56158709-f546-43fb-b35c-3ee1c7422d11 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:06.200042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56158709-f546-43fb-b35c-3ee1c7422d11 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:06.200308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56158709-f546-43fb-b35c-3ee1c7422d11 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:06.200958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56158709-f546-43fb-b35c-3ee1c7422d11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:06.210420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56158709-f546-43fb-b35c-3ee1c7422d11 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:06.219622 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 396/785] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Jul 30 20:45:05 2022] GET /identity/v3/services => generated 772 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:06.225361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:06.300962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93429b72-dc80-4e2b-9972-50eec9a2a251 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:06.301299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93429b72-dc80-4e2b-9972-50eec9a2a251 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:06.301507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93429b72-dc80-4e2b-9972-50eec9a2a251 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:06.303169 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 397/786] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:45:06.308574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0edd1-2345-4e62-87bd-c9aa1934cf1a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:06.308919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0edd1-2345-4e62-87bd-c9aa1934cf1a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:06.309200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0edd1-2345-4e62-87bd-c9aa1934cf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:06.343906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0ec0edd1-2345-4e62-87bd-c9aa1934cf1a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:06.345059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0ec0edd1-2345-4e62-87bd-c9aa1934cf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:06.363397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86912d6-8f78-4530-aa65-f22b4fc0d4b6 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:06.432146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb818e2-59d9-41ed-9637-0974f51cef1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:06.432792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb818e2-59d9-41ed-9637-0974f51cef1a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:06.433074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb818e2-59d9-41ed-9637-0974f51cef1a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:06.433347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb818e2-59d9-41ed-9637-0974f51cef1a None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:06.434065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb818e2-59d9-41ed-9637-0974f51cef1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:06.434370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb818e2-59d9-41ed-9637-0974f51cef1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:06.435832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb818e2-59d9-41ed-9637-0974f51cef1a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:06.448949 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 390/787] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:06.458560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb818e2-59d9-41ed-9637-0974f51cef1a None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:06.478364 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 398/788] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:45:06.505849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0edd1-2345-4e62-87bd-c9aa1934cf1a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:06.594547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:06.625364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:06.640678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0edd1-2345-4e62-87bd-c9aa1934cf1a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:06.677777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43019a-2b96-44ed-95ac-5f4c0e25ff60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:06.678799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43019a-2b96-44ed-95ac-5f4c0e25ff60 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:06.679449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43019a-2b96-44ed-95ac-5f4c0e25ff60 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:06.679939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43019a-2b96-44ed-95ac-5f4c0e25ff60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:06.683818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb818e2-59d9-41ed-9637-0974f51cef1a None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:06.691086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43019a-2b96-44ed-95ac-5f4c0e25ff60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:45:06.697164 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-9d43019a-2b96-44ed-95ac-5f4c0e25ff60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:45:06.697164 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:06.697164 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:06.697164 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:06.697164 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:06.697164 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:06.697164 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:06.697164 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:06.697164 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:06.697164 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:06.697164 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:06.697164 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:06.697164 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:45:06.697164 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:45:06.697164 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:45:06.697164 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:45:06.698088 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:45:06.698088 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:45:06.698088 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:45:06.698088 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:45:06.698088 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:06.698088 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:06.698088 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:06.698088 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:06.698088 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:06.698088 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:06.698088 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:06.698088 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:06.698088 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:06.698088 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:06.698088 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:06.698088 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:06.698934 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:06.698934 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:06.698934 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:06.698934 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:06.698934 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:45:06.698934 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:45:06.698934 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:45:06.698934 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:45:06.698934 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:45:06.698934 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:45:06.698934 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:45:06.698934 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:06.701830 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 399/789] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:45:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:06.707709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43019a-2b96-44ed-95ac-5f4c0e25ff60 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:06.728513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbebd04-2c7c-4fa1-bdef-3b6eb8d738f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:06.729296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbebd04-2c7c-4fa1-bdef-3b6eb8d738f0 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:06.729586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbebd04-2c7c-4fa1-bdef-3b6eb8d738f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:06.729864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbebd04-2c7c-4fa1-bdef-3b6eb8d738f0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:06.740168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbebd04-2c7c-4fa1-bdef-3b6eb8d738f0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:06.748443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbebd04-2c7c-4fa1-bdef-3b6eb8d738f0 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:06.771318 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-4fbebd04-2c7c-4fa1-bdef-3b6eb8d738f0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 30 20:45:06.771318 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:06.771318 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:06.771318 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:06.771318 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:06.771318 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:06.771318 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:06.771318 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:06.771318 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:06.771318 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:06.771318 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:06.771318 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:06.771318 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:45:06.771318 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:45:06.771318 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:45:06.771318 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:45:06.772294 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:06.772294 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:06.772294 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:45:06.772294 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:06.772294 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:45:06.772294 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:06.772294 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:06.772294 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:06.772294 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:06.772294 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:06.772294 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:06.772294 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:06.772294 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:06.772294 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:06.772294 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:06.772294 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:06.772294 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:06.772294 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:06.773345 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:06.773345 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:06.773345 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:45:06.773345 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:45:06.773345 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:45:06.773345 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:45:06.773345 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:45:06.773345 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:45:06.773345 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 30 20:45:06.773345 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:06.773345 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 391/790] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:45:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:06.776318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbebd04-2c7c-4fa1-bdef-3b6eb8d738f0 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:06.831330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43019a-2b96-44ed-95ac-5f4c0e25ff60 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:06.856542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:06.870029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cf8b1-7114-47ab-8c28-42f72c34cb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:06.871054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cf8b1-7114-47ab-8c28-42f72c34cb31 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:06.871469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cf8b1-7114-47ab-8c28-42f72c34cb31 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:06.871852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cf8b1-7114-47ab-8c28-42f72c34cb31 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:06.872674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cf8b1-7114-47ab-8c28-42f72c34cb31 None admin] RBAC: Adding query filter params (name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:06.873085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cf8b1-7114-47ab-8c28-42f72c34cb31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:06.874564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cf8b1-7114-47ab-8c28-42f72c34cb31 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:06.887936 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 400/791] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:45:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:06.896694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cf8b1-7114-47ab-8c28-42f72c34cb31 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:06.949646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbebd04-2c7c-4fa1-bdef-3b6eb8d738f0 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:07.005639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cf8b1-7114-47ab-8c28-42f72c34cb31 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:07.044907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba9d85-181a-4282-9530-58badee9393d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:07.045810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:07.047029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba9d85-181a-4282-9530-58badee9393d None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:07.047535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba9d85-181a-4282-9530-58badee9393d None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:07.047884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba9d85-181a-4282-9530-58badee9393d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:07.061275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba9d85-181a-4282-9530-58badee9393d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:07.062889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba9d85-181a-4282-9530-58badee9393d None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:07.072595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f499683-43de-47a6-8864-7dc1d7c6e8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:07.073237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f499683-43de-47a6-8864-7dc1d7c6e8e6 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:07.073543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f499683-43de-47a6-8864-7dc1d7c6e8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:07.073809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f499683-43de-47a6-8864-7dc1d7c6e8e6 None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:07.074623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f499683-43de-47a6-8864-7dc1d7c6e8e6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:07.074933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f499683-43de-47a6-8864-7dc1d7c6e8e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:07.076404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f499683-43de-47a6-8864-7dc1d7c6e8e6 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:07.079057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-caba9d85-181a-4282-9530-58badee9393d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:07.079057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:07.079057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:07.079057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:07.079057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:07.079057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:07.079057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:07.079057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:07.079057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:07.079057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:07.079057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:07.079057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:07.079057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:07.079057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:07.079057 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:07.080182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:07.080182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:07.080182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:07.080182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:07.080182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:07.080182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:07.080182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:07.080182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:07.080182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:07.080182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:07.080182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:07.080182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:07.080182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:07.080182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:07.080182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:07.080182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:07.080182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:07.081121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:07.081121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:07.081121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:07.081121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:07.081503 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 401/792] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:07.087078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba9d85-181a-4282-9530-58badee9393d None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:07.129715 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 392/793] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Jul 30 20:45:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:07.130760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:07.136252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f499683-43de-47a6-8864-7dc1d7c6e8e6 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:07.194226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba9d85-181a-4282-9530-58badee9393d None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:07.231014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e9a3c-bf00-40bc-9cdc-6cdd87ef8051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:07.231959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e9a3c-bf00-40bc-9cdc-6cdd87ef8051 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:07.232270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e9a3c-bf00-40bc-9cdc-6cdd87ef8051 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:07.232536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e9a3c-bf00-40bc-9cdc-6cdd87ef8051 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:07.233233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e9a3c-bf00-40bc-9cdc-6cdd87ef8051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:07.233542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e9a3c-bf00-40bc-9cdc-6cdd87ef8051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:07.234927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e9a3c-bf00-40bc-9cdc-6cdd87ef8051 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:07.249940 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 402/794] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:07.256292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e9a3c-bf00-40bc-9cdc-6cdd87ef8051 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:07.359655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:07.365685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e9a3c-bf00-40bc-9cdc-6cdd87ef8051 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:07.411402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4f14b-1210-4f22-b4f5-9c4952472201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:07.412043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4f14b-1210-4f22-b4f5-9c4952472201 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:07.412336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4f14b-1210-4f22-b4f5-9c4952472201 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:07.412619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4f14b-1210-4f22-b4f5-9c4952472201 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:07.429306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4f14b-1210-4f22-b4f5-9c4952472201 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:07.431720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4f14b-1210-4f22-b4f5-9c4952472201 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:07.450060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f499683-43de-47a6-8864-7dc1d7c6e8e6 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:07.455647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-03c4f14b-1210-4f22-b4f5-9c4952472201 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 30 20:45:07.455647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:07.455647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:07.455647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:07.455647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:07.455647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:07.455647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:07.455647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:07.455647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:07.455647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:07.455647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:07.455647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:07.455647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:45:07.455647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:45:07.455647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:45:07.455647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:45:07.456879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:07.456879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:07.456879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:45:07.456879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:07.456879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:45:07.456879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:07.456879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:07.456879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:07.456879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:07.456879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:07.456879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:07.456879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:07.456879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:07.456879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:07.456879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:07.456879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:07.456879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:07.456879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:07.458036 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:07.458036 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:07.458036 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:45:07.458036 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:45:07.458036 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:45:07.458036 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:45:07.458036 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:45:07.458036 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:45:07.458036 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 30 20:45:07.458036 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:07.458036 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 403/795] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Jul 30 20:45:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:07.465203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4f14b-1210-4f22-b4f5-9c4952472201 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:07.520183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a0de5-be6e-443c-a7e2-39b8f627aa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:07.520906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a0de5-be6e-443c-a7e2-39b8f627aa61 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:07.521246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a0de5-be6e-443c-a7e2-39b8f627aa61 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:07.521535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a0de5-be6e-443c-a7e2-39b8f627aa61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:07.533669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a0de5-be6e-443c-a7e2-39b8f627aa61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:07.535190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a0de5-be6e-443c-a7e2-39b8f627aa61 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:07.553549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-ef5a0de5-be6e-443c-a7e2-39b8f627aa61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:07.553549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:07.553549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:07.553549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:07.553549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:07.553549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:07.553549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:07.553549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:07.553549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:07.553549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:07.553549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:07.553549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:07.553549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:07.553549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:07.553549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:07.554581 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:07.554581 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:07.554581 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:07.554581 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:07.554581 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:07.554581 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:07.554581 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:07.554581 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:07.554581 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:07.554581 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:07.554581 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:07.554581 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:07.554581 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:07.554581 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:07.554581 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:07.554581 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:07.554581 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:07.556140 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:07.556140 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:07.556140 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:07.556140 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:07.556140 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 393/796] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:07.564400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a0de5-be6e-443c-a7e2-39b8f627aa61 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:07.640149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4f14b-1210-4f22-b4f5-9c4952472201 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:07.686558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:07.690276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bf9f4-7c2a-4a23-a01c-c895d62068fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:07.690912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bf9f4-7c2a-4a23-a01c-c895d62068fe None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:07.693301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bf9f4-7c2a-4a23-a01c-c895d62068fe None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:07.693590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bf9f4-7c2a-4a23-a01c-c895d62068fe None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:07.694400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0bf9f4-7c2a-4a23-a01c-c895d62068fe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:07.694711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0bf9f4-7c2a-4a23-a01c-c895d62068fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:07.696189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0bf9f4-7c2a-4a23-a01c-c895d62068fe None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:07.737852 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 404/797] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Jul 30 20:45:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:07.743682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bf9f4-7c2a-4a23-a01c-c895d62068fe None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:07.770722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:07.790989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a0de5-be6e-443c-a7e2-39b8f627aa61 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:07.825627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b3781-61f5-4414-bbe3-8201a859fbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:07.826254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b3781-61f5-4414-bbe3-8201a859fbe6 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:07.826538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b3781-61f5-4414-bbe3-8201a859fbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:07.826814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b3781-61f5-4414-bbe3-8201a859fbe6 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:07.827536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b3781-61f5-4414-bbe3-8201a859fbe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:07.827847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b3781-61f5-4414-bbe3-8201a859fbe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:07.829235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b3781-61f5-4414-bbe3-8201a859fbe6 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:07.841654 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 394/798] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:07.842967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bae60-7aa5-47ca-b51c-68d9f7fee718 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:07.843263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bae60-7aa5-47ca-b51c-68d9f7fee718 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:07.843566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bae60-7aa5-47ca-b51c-68d9f7fee718 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:07.844940 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 395/799] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:07.850054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bae60-7aa5-47ca-b51c-68d9f7fee718 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:07.872006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bf9f4-7c2a-4a23-a01c-c895d62068fe None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:07.909650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d4775-ee1a-4f0a-a6a7-845e92534db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:07.910429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d4775-ee1a-4f0a-a6a7-845e92534db1 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:07.910721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d4775-ee1a-4f0a-a6a7-845e92534db1 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:07.911711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d4775-ee1a-4f0a-a6a7-845e92534db1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:07.923036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d4775-ee1a-4f0a-a6a7-845e92534db1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:07.924544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d4775-ee1a-4f0a-a6a7-845e92534db1 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:07.944408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-b81d4775-ee1a-4f0a-a6a7-845e92534db1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:07.944408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:07.944408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:07.944408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:07.944408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:07.944408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:07.944408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:07.944408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:07.944408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:07.944408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:07.944408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:07.944408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:07.944408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:07.944408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:07.944408 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:07.945653 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:07.945653 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:07.945653 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:07.945653 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:07.945653 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:07.945653 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:07.945653 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:07.945653 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:07.945653 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:07.945653 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:07.945653 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:07.945653 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:07.945653 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:07.945653 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:07.945653 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:07.945653 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:07.945653 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:07.947612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:07.947612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:07.947612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:07.947612 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:07.947612 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 405/800] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:07.947612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054e714-5625-4ec7-a8da-55f4f3df4fb3 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:07.948949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054e714-5625-4ec7-a8da-55f4f3df4fb3 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:07.948949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054e714-5625-4ec7-a8da-55f4f3df4fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:07.959625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bae60-7aa5-47ca-b51c-68d9f7fee718 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:07.961208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:07.972657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a054e714-5625-4ec7-a8da-55f4f3df4fb3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:07.974172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a054e714-5625-4ec7-a8da-55f4f3df4fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:07.997803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32bae8-c35c-4a99-a2a4-c54782b402f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:07.998389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32bae8-c35c-4a99-a2a4-c54782b402f0 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:07.998680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32bae8-c35c-4a99-a2a4-c54782b402f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:07.998958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32bae8-c35c-4a99-a2a4-c54782b402f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:08.008253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32bae8-c35c-4a99-a2a4-c54782b402f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:08.011045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32bae8-c35c-4a99-a2a4-c54782b402f0 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:08.024201 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-6a32bae8-c35c-4a99-a2a4-c54782b402f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:08.024201 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:08.024201 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:08.024201 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:08.024201 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:08.024201 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:08.024201 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:08.024201 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:08.024201 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:08.024201 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:08.024201 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:08.024201 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:08.024201 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:45:08.024201 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:45:08.024201 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:45:08.025138 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:45:08.025138 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:08.025138 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:08.025138 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:08.025138 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:08.025138 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:08.025138 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:08.025138 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:08.025138 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:08.025138 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:08.025138 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:08.025138 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:08.025138 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:08.025138 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:08.025138 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:08.025138 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:08.025138 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:08.026051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:45:08.026051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:45:08.026051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:45:08.026051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:45:08.026051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:45:08.026051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:45:08.026051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:08.026051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:08.026051 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 396/801] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:45:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:08.026547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32bae8-c35c-4a99-a2a4-c54782b402f0 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:08.052061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:08.063422 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 406/802] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:08.065031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054e714-5625-4ec7-a8da-55f4f3df4fb3 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:08.159466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32bae8-c35c-4a99-a2a4-c54782b402f0 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:08.177689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054e714-5625-4ec7-a8da-55f4f3df4fb3 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:08.195715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212548f-10e7-43a9-a0cc-370fb9fefec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:08.196287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212548f-10e7-43a9-a0cc-370fb9fefec0 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:08.196582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212548f-10e7-43a9-a0cc-370fb9fefec0 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:08.196853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212548f-10e7-43a9-a0cc-370fb9fefec0 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:08.197547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212548f-10e7-43a9-a0cc-370fb9fefec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:08.197849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212548f-10e7-43a9-a0cc-370fb9fefec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:08.199216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212548f-10e7-43a9-a0cc-370fb9fefec0 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:08.212823 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 397/803] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:08.213900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212548f-10e7-43a9-a0cc-370fb9fefec0 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:08.222847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c2588-a230-464b-abc1-ab51e18428f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:08.223545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c2588-a230-464b-abc1-ab51e18428f8 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:08.223829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c2588-a230-464b-abc1-ab51e18428f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:08.224100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c2588-a230-464b-abc1-ab51e18428f8 None admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:08.224864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c2588-a230-464b-abc1-ab51e18428f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:08.225225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c2588-a230-464b-abc1-ab51e18428f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:08.226673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c2588-a230-464b-abc1-ab51e18428f8 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:08.238529 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 407/804] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:45:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:08.243193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:08.244770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c2588-a230-464b-abc1-ab51e18428f8 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:08.302977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:08.328784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212548f-10e7-43a9-a0cc-370fb9fefec0 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:08.354922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c2588-a230-464b-abc1-ab51e18428f8 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:08.368738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226b3a0-3e80-445b-be41-8c9479011b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:08.369492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226b3a0-3e80-445b-be41-8c9479011b2c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:08.369787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226b3a0-3e80-445b-be41-8c9479011b2c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:08.370128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226b3a0-3e80-445b-be41-8c9479011b2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:08.381912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226b3a0-3e80-445b-be41-8c9479011b2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:45:08.387252 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-0226b3a0-3e80-445b-be41-8c9479011b2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:45:08.387252 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:08.387252 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:08.387252 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:08.387252 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:08.387252 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:08.387252 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:08.387252 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:08.387252 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:08.387252 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:08.387252 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:08.387252 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:08.387252 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:45:08.387252 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:45:08.387252 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:45:08.387252 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:45:08.388196 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:45:08.388196 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:45:08.388196 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:45:08.388196 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:45:08.388196 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:08.388196 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:08.388196 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:08.388196 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:08.388196 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:08.388196 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:08.388196 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:08.388196 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:08.388196 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:08.388196 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:08.388196 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:08.388196 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:08.389046 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:08.389046 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:08.389046 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:08.389046 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:08.389046 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:45:08.389046 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:45:08.389046 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:45:08.389046 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:45:08.389046 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:45:08.389046 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:45:08.389046 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:45:08.389046 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:08.389046 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 398/805] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:45:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:08.390122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379daeb-fa5b-4da0-9967-053931d81001 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:08.390219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379daeb-fa5b-4da0-9967-053931d81001 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:08.390470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379daeb-fa5b-4da0-9967-053931d81001 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:08.391892 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 399/806] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:08.392431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379daeb-fa5b-4da0-9967-053931d81001 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:08.401386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72c26f-bf38-4dd3-a582-a45ed45f62ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:08.402320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72c26f-bf38-4dd3-a582-a45ed45f62ff None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:08.402843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72c26f-bf38-4dd3-a582-a45ed45f62ff None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:08.403313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72c26f-bf38-4dd3-a582-a45ed45f62ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:08.411603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72c26f-bf38-4dd3-a582-a45ed45f62ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:08.413291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72c26f-bf38-4dd3-a582-a45ed45f62ff None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:08.425796 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-1a72c26f-bf38-4dd3-a582-a45ed45f62ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:08.425796 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:08.425796 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:08.425796 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:08.425796 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:08.425796 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:08.425796 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:08.425796 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:08.425796 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:08.425796 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:08.425796 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:08.425796 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:08.425796 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:45:08.425796 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:45:08.425796 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:45:08.427264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:45:08.427264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:08.427264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:08.427264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:08.427264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:08.427264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:08.427264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:08.427264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:08.427264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:08.427264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:08.427264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:08.427264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:08.427264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:08.427264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:08.427264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:08.427264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:08.427264 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:08.428288 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:45:08.428288 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:45:08.428288 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:45:08.428288 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:45:08.428288 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:45:08.428288 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:45:08.428288 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:08.428288 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:08.430221 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 408/807] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:45:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:08.435362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a160e-d377-4134-91ea-4bb921d37ced None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:08.435362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a160e-d377-4134-91ea-4bb921d37ced None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:08.435362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a160e-d377-4134-91ea-4bb921d37ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:08.451428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0c7a160e-d377-4134-91ea-4bb921d37ced None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:08.452568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0c7a160e-d377-4134-91ea-4bb921d37ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:08.482598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:08.503335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379daeb-fa5b-4da0-9967-053931d81001 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:08.547319 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 409/808] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:08.547536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc093e7-f6b4-45c0-87c2-e2b057c94337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:08.547650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a160e-d377-4134-91ea-4bb921d37ced None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:08.547737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc093e7-f6b4-45c0-87c2-e2b057c94337 None admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:08.547737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc093e7-f6b4-45c0-87c2-e2b057c94337 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:08.547737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc093e7-f6b4-45c0-87c2-e2b057c94337 None admin] PATH_INFO: `/v3/projects/ec96772eef284ab3913f9628b136be7a/users/2181960e3bed4031889d6e72a721e151/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:08.549538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc093e7-f6b4-45c0-87c2-e2b057c94337 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec96772eef284ab3913f9628b136be7a, user_id=2181960e3bed4031889d6e72a721e151, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:08.551054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc093e7-f6b4-45c0-87c2-e2b057c94337 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:08.567103 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 400/809] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:45:08 2022] PUT /identity/v3/projects/ec96772eef284ab3913f9628b136be7a/users/2181960e3bed4031889d6e72a721e151/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:45:08.568647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc093e7-f6b4-45c0-87c2-e2b057c94337 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:08.609809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:08.692988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a160e-d377-4134-91ea-4bb921d37ced None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:08.721933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc093e7-f6b4-45c0-87c2-e2b057c94337 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:08.743615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7586b08-a283-4503-b4eb-2205c31b3f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:08.744824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7586b08-a283-4503-b4eb-2205c31b3f38 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:08.745115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7586b08-a283-4503-b4eb-2205c31b3f38 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:08.745696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7586b08-a283-4503-b4eb-2205c31b3f38 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:08.746831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7586b08-a283-4503-b4eb-2205c31b3f38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:08.747157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7586b08-a283-4503-b4eb-2205c31b3f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:08.748812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7586b08-a283-4503-b4eb-2205c31b3f38 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:08.760483 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 410/810] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:45:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:08.761529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7586b08-a283-4503-b4eb-2205c31b3f38 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:08.773645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8b803-4113-40a2-9bc3-d19dcdb7bda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:08.775067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8b803-4113-40a2-9bc3-d19dcdb7bda2 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:08.775618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8b803-4113-40a2-9bc3-d19dcdb7bda2 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:08.776117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8b803-4113-40a2-9bc3-d19dcdb7bda2 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:08.777097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8b803-4113-40a2-9bc3-d19dcdb7bda2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:08.777613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8b803-4113-40a2-9bc3-d19dcdb7bda2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:08.779249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8b803-4113-40a2-9bc3-d19dcdb7bda2 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:08.796612 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 401/811] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:45:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:08.797895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8b803-4113-40a2-9bc3-d19dcdb7bda2 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:08.800829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:08.888748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7586b08-a283-4503-b4eb-2205c31b3f38 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:08.898482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:08.919637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8b803-4113-40a2-9bc3-d19dcdb7bda2 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:08.930327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f07c4-6aea-468f-a0f6-0ceb88361901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:08.931018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f07c4-6aea-468f-a0f6-0ceb88361901 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:08.931388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f07c4-6aea-468f-a0f6-0ceb88361901 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:08.931837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f07c4-6aea-468f-a0f6-0ceb88361901 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:08.932472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f07c4-6aea-468f-a0f6-0ceb88361901 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:08.933946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f07c4-6aea-468f-a0f6-0ceb88361901 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:08.944736 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-e46f07c4-6aea-468f-a0f6-0ceb88361901 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 30 20:45:08.944736 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:08.944736 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:08.944736 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:08.944736 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:08.944736 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:08.944736 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:08.944736 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:08.944736 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 30 20:45:08.944736 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:08.944736 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:08.944736 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:08.944736 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:08.944736 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:08.944736 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:08.944736 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:08.945716 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:08.945716 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:08.945716 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:08.945716 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:08.945716 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:08.945716 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:08.945716 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:08.945716 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:08.945716 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:08.945716 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:08.945716 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:08.945716 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:08.945716 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:08.945716 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:08.945716 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:08.945716 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:08.946592 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:08.946592 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:08.946592 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:08.946592 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:08.946592 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:08.946592 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:08.946592 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:08.946592 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:08.946592 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:08.946592 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:08.946592 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:08.946592 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:08.946592 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:08.946592 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 30 20:45:08.946592 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:08.946592 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 411/812] 10.222.0.17 () {56 vars in 1129 bytes} [Sat Jul 30 20:45:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:08.947515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f07c4-6aea-468f-a0f6-0ceb88361901 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:08.968403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9156f98-f53b-421d-ba5c-7e987629090a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:08.969073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9156f98-f53b-421d-ba5c-7e987629090a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:08.969364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9156f98-f53b-421d-ba5c-7e987629090a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:08.969646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9156f98-f53b-421d-ba5c-7e987629090a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:08.980489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9156f98-f53b-421d-ba5c-7e987629090a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:08.981884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9156f98-f53b-421d-ba5c-7e987629090a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:09.001993 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-b9156f98-f53b-421d-ba5c-7e987629090a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:09.001993 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:09.001993 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:09.001993 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:09.001993 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:09.001993 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:09.001993 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:09.001993 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:09.001993 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:09.001993 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:09.001993 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:09.001993 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:09.001993 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:09.001993 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:09.001993 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:09.002981 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:09.002981 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:09.002981 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:09.002981 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:09.002981 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:09.002981 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:09.002981 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:09.002981 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:09.002981 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:09.002981 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:09.002981 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:09.002981 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:09.002981 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:09.002981 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:09.002981 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:09.002981 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:09.002981 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:09.003920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:09.003920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:09.003920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:09.003920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:09.003920 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 402/813] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:09.004576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f01bd9-c834-49bb-9a66-262bcf8f507e None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:09.005181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f01bd9-c834-49bb-9a66-262bcf8f507e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:09.005484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f01bd9-c834-49bb-9a66-262bcf8f507e None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:09.011358 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 403/814] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:09.011358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f01bd9-c834-49bb-9a66-262bcf8f507e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:09.071103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:09.073644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f07c4-6aea-468f-a0f6-0ceb88361901 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:09.110703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35009a-ab0a-43f6-a731-ed19a4bf3fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:09.111412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35009a-ab0a-43f6-a731-ed19a4bf3fb9 None admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:09.111712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35009a-ab0a-43f6-a731-ed19a4bf3fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:09.112455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35009a-ab0a-43f6-a731-ed19a4bf3fb9 None admin] PATH_INFO: `/v3/projects/ec96772eef284ab3913f9628b136be7a/users/877b427e6ff84af29a59dc9e1a3128ef/roles/50fb737d5edf48298d0a6061ba652acb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:09.127685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f01bd9-c834-49bb-9a66-262bcf8f507e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:09.127870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35009a-ab0a-43f6-a731-ed19a4bf3fb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec96772eef284ab3913f9628b136be7a, user_id=877b427e6ff84af29a59dc9e1a3128ef, role_id=50fb737d5edf48298d0a6061ba652acb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:09.129308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35009a-ab0a-43f6-a731-ed19a4bf3fb9 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:09.143358 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 412/815] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:45:08 2022] PUT /identity/v3/projects/ec96772eef284ab3913f9628b136be7a/users/877b427e6ff84af29a59dc9e1a3128ef/roles/50fb737d5edf48298d0a6061ba652acb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:45:09.144709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b505ca-0cca-4a6e-b971-d8d98f751204 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:09.145071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b505ca-0cca-4a6e-b971-d8d98f751204 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:09.145492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b505ca-0cca-4a6e-b971-d8d98f751204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:09.172923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d0b505ca-0cca-4a6e-b971-d8d98f751204 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:09.174594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d0b505ca-0cca-4a6e-b971-d8d98f751204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:09.182947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171274fe-7388-491b-881a-e872f95a2df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:09.184138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171274fe-7388-491b-881a-e872f95a2df9 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:09.184672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171274fe-7388-491b-881a-e872f95a2df9 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:09.185129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171274fe-7388-491b-881a-e872f95a2df9 None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:09.186046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171274fe-7388-491b-881a-e872f95a2df9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:09.186704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171274fe-7388-491b-881a-e872f95a2df9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:09.188508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171274fe-7388-491b-881a-e872f95a2df9 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:09.195866 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 404/816] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Jul 30 20:45:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:09.198120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171274fe-7388-491b-881a-e872f95a2df9 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:09.198684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:09.307397 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 413/817] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:09.307397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b505ca-0cca-4a6e-b971-d8d98f751204 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:09.341771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171274fe-7388-491b-881a-e872f95a2df9 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:09.369337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:09.393199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffa444-8591-450a-971c-ef4f50fd0d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:09.393837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffa444-8591-450a-971c-ef4f50fd0d9a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:09.394127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffa444-8591-450a-971c-ef4f50fd0d9a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:09.394410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffa444-8591-450a-971c-ef4f50fd0d9a None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:09.395119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffa444-8591-450a-971c-ef4f50fd0d9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:09.396019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffa444-8591-450a-971c-ef4f50fd0d9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:09.397398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffa444-8591-450a-971c-ef4f50fd0d9a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:09.413857 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 405/818] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:09.415149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffa444-8591-450a-971c-ef4f50fd0d9a None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:09.442826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b505ca-0cca-4a6e-b971-d8d98f751204 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:09.479267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bb585-3bf0-4f46-b286-f41ae26e6eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:09.479999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bb585-3bf0-4f46-b286-f41ae26e6eef None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:09.480291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bb585-3bf0-4f46-b286-f41ae26e6eef None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:09.480570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bb585-3bf0-4f46-b286-f41ae26e6eef None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:09.481249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bb585-3bf0-4f46-b286-f41ae26e6eef None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:09.481557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bb585-3bf0-4f46-b286-f41ae26e6eef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:09.482929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bb585-3bf0-4f46-b286-f41ae26e6eef None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:09.488307 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 414/819] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Jul 30 20:45:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:09.489729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bb585-3bf0-4f46-b286-f41ae26e6eef None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:09.506119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:09.529924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffa444-8591-450a-971c-ef4f50fd0d9a None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:09.566590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a0e81-b15c-4b92-8bfa-2cf8bf35fe95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:09.567584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a0e81-b15c-4b92-8bfa-2cf8bf35fe95 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:09.568052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a0e81-b15c-4b92-8bfa-2cf8bf35fe95 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:09.568570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a0e81-b15c-4b92-8bfa-2cf8bf35fe95 None admin] PATH_INFO: `/v3/services/network` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:09.569371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a0e81-b15c-4b92-8bfa-2cf8bf35fe95 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:09.570934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a0e81-b15c-4b92-8bfa-2cf8bf35fe95 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:09.580551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-537a0e81-b15c-4b92-8bfa-2cf8bf35fe95 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 30 20:45:09.580551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:09.580551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:09.580551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:09.580551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:09.580551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:09.580551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:09.580551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:09.580551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 30 20:45:09.580551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:09.580551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:09.580551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:09.580551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:09.580551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:09.580551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:09.580551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:09.580551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:09.581579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:09.581579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:09.581579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:09.581579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:09.581579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:09.581579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:09.581579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:09.581579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:09.581579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:09.581579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:09.581579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:09.581579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:09.581579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:09.581579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:09.581579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:09.581579 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:09.582514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:09.582514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:09.582514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:09.582514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:09.582514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:09.582514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:09.582514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:09.582514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:09.582514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:09.582514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:09.582514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:09.582514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:09.582514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 30 20:45:09.582514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:09.590681 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 406/820] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:45:09 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:09.591842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a0e81-b15c-4b92-8bfa-2cf8bf35fe95 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:09.593823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bb585-3bf0-4f46-b286-f41ae26e6eef None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:09.630058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d65dd-134c-4397-a034-eba26a931bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:09.630757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d65dd-134c-4397-a034-eba26a931bf8 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:09.631047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d65dd-134c-4397-a034-eba26a931bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:09.631375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d65dd-134c-4397-a034-eba26a931bf8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:09.640061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d65dd-134c-4397-a034-eba26a931bf8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:09.640717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:09.642142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d65dd-134c-4397-a034-eba26a931bf8 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:09.655707 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-fa5d65dd-134c-4397-a034-eba26a931bf8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 30 20:45:09.655707 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:09.655707 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:09.655707 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:09.655707 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:09.655707 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:09.655707 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:09.655707 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:09.655707 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:09.655707 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:09.655707 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:09.655707 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:09.655707 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:45:09.655707 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:45:09.655707 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:45:09.655707 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:45:09.656713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:09.656713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:09.656713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:45:09.656713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:09.656713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:45:09.656713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:09.656713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:09.656713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:09.656713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:09.656713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:09.656713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:09.656713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:09.656713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:09.656713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:09.656713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:09.656713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:09.656713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:09.656713 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:09.657986 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:09.657986 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:09.657986 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:45:09.657986 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:45:09.657986 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:45:09.657986 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:45:09.657986 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:45:09.657986 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:45:09.657986 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 30 20:45:09.657986 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:09.657986 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 415/821] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Jul 30 20:45:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:09.658620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d65dd-134c-4397-a034-eba26a931bf8 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:09.708711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a0e81-b15c-4b92-8bfa-2cf8bf35fe95 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:09.750487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4d33d-f7ef-4233-ad64-b72da1ba0eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:09.751145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4d33d-f7ef-4233-ad64-b72da1ba0eee None admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:09.751469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4d33d-f7ef-4233-ad64-b72da1ba0eee None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:09.751750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4d33d-f7ef-4233-ad64-b72da1ba0eee None admin] PATH_INFO: `/v3/endpoints` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:09.752491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4d33d-f7ef-4233-ad64-b72da1ba0eee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:09.754017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:09.755908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4d33d-f7ef-4233-ad64-b72da1ba0eee None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:09.786899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d65dd-134c-4397-a034-eba26a931bf8 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:09.791468 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 407/822] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 20:45:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:45:09.792658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4d33d-f7ef-4233-ad64-b72da1ba0eee None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:09.875628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20d7d7-3ae6-4b20-ab53-ab8d665d9c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:09.876720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20d7d7-3ae6-4b20-ab53-ab8d665d9c66 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:09.877208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20d7d7-3ae6-4b20-ab53-ab8d665d9c66 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:09.877737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20d7d7-3ae6-4b20-ab53-ab8d665d9c66 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:09.878665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20d7d7-3ae6-4b20-ab53-ab8d665d9c66 None admin] RBAC: Adding query filter params (name=network) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:09.879184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20d7d7-3ae6-4b20-ab53-ab8d665d9c66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:09.880888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20d7d7-3ae6-4b20-ab53-ab8d665d9c66 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:09.892560 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 416/823] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 30 20:45:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:09.894393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20d7d7-3ae6-4b20-ab53-ab8d665d9c66 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:10.016663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:10.020744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4d33d-f7ef-4233-ad64-b72da1ba0eee None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:10.058241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb7163-7231-4b45-8610-e645dbb540e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:10.059023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb7163-7231-4b45-8610-e645dbb540e4 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:10.059440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb7163-7231-4b45-8610-e645dbb540e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:10.059838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb7163-7231-4b45-8610-e645dbb540e4 None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:10.060911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb7163-7231-4b45-8610-e645dbb540e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:10.061476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb7163-7231-4b45-8610-e645dbb540e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:10.062892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb7163-7231-4b45-8610-e645dbb540e4 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:10.078893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20d7d7-3ae6-4b20-ab53-ab8d665d9c66 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:10.082422 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 408/824] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Jul 30 20:45:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:10.093350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb7163-7231-4b45-8610-e645dbb540e4 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:10.126410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f764c34-eeb0-468e-a501-daeea4112236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:10.127236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f764c34-eeb0-468e-a501-daeea4112236 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:10.127832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f764c34-eeb0-468e-a501-daeea4112236 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:10.128207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f764c34-eeb0-468e-a501-daeea4112236 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:10.129139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f764c34-eeb0-468e-a501-daeea4112236 None admin] RBAC: Adding query filter params (type=network) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:10.130077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f764c34-eeb0-468e-a501-daeea4112236 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:10.132199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f764c34-eeb0-468e-a501-daeea4112236 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:10.133718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:10.144987 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 417/825] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 30 20:45:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:10.146454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f764c34-eeb0-468e-a501-daeea4112236 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:10.219812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb7163-7231-4b45-8610-e645dbb540e4 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:10.255460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f764c34-eeb0-468e-a501-daeea4112236 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:10.256741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c5bba-38ab-48d1-8d07-cee7b8785a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:10.257471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c5bba-38ab-48d1-8d07-cee7b8785a7a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:10.257856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c5bba-38ab-48d1-8d07-cee7b8785a7a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:10.258230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c5bba-38ab-48d1-8d07-cee7b8785a7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:10.307250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:10.318269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6c5d9-51c9-4649-8b79-4da83c6ecbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:10.318893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6c5d9-51c9-4649-8b79-4da83c6ecbfb None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:10.319173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6c5d9-51c9-4649-8b79-4da83c6ecbfb None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:10.319469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6c5d9-51c9-4649-8b79-4da83c6ecbfb None admin] PATH_INFO: `/v3/endpoints` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:10.320187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6c5d9-51c9-4649-8b79-4da83c6ecbfb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:10.321552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6c5d9-51c9-4649-8b79-4da83c6ecbfb None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:10.356098 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 418/826] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 20:45:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:45:10.380330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c5bba-38ab-48d1-8d07-cee7b8785a7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:10.381848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c5bba-38ab-48d1-8d07-cee7b8785a7a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:10.510877 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 409/827] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:45:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 30 20:45:10.516891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6c5d9-51c9-4649-8b79-4da83c6ecbfb None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:10.589178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:10.646311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6c5d9-51c9-4649-8b79-4da83c6ecbfb None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:10.681331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db636d-2bb4-495a-b008-64719d4bd59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:10.682277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db636d-2bb4-495a-b008-64719d4bd59b None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:10.682710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db636d-2bb4-495a-b008-64719d4bd59b None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:10.683162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db636d-2bb4-495a-b008-64719d4bd59b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:10.694673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db636d-2bb4-495a-b008-64719d4bd59b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:10.696354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db636d-2bb4-495a-b008-64719d4bd59b None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:10.710832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-84db636d-2bb4-495a-b008-64719d4bd59b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:10.710832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:10.710832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:10.710832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:10.710832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:10.710832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:10.710832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:10.710832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:10.710832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:10.710832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:10.710832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:10.710832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:10.710832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:10.710832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:10.710832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:10.711938 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:10.711938 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:10.711938 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:10.711938 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:10.711938 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:10.711938 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:10.711938 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:10.711938 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:10.711938 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:10.711938 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:10.711938 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:10.711938 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:10.711938 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:10.711938 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:10.711938 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:10.711938 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:10.711938 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:10.713031 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:10.713031 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:10.713031 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:10.713031 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:10.714911 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 419/828] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:10.720194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c5bba-38ab-48d1-8d07-cee7b8785a7a None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:10.784416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:10.842980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c5bba-38ab-48d1-8d07-cee7b8785a7a None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:10.886220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2af58-6ba6-4434-8adf-46203d264834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:10.886854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2af58-6ba6-4434-8adf-46203d264834 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:10.887141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2af58-6ba6-4434-8adf-46203d264834 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:10.887455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2af58-6ba6-4434-8adf-46203d264834 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:10.888162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2af58-6ba6-4434-8adf-46203d264834 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:10.888473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2af58-6ba6-4434-8adf-46203d264834 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:10.889860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2af58-6ba6-4434-8adf-46203d264834 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:10.902280 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 410/829] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:10.907579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db636d-2bb4-495a-b008-64719d4bd59b None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:10.975413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda475f-f0e4-4a33-8425-31d238a20ee7 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:10.975832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda475f-f0e4-4a33-8425-31d238a20ee7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:10.976134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda475f-f0e4-4a33-8425-31d238a20ee7 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:10.978577 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 411/830] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:10.985303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811c78f-c6ee-4c01-ac19-bc7badf51ab3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:10.985645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811c78f-c6ee-4c01-ac19-bc7badf51ab3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:10.985937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811c78f-c6ee-4c01-ac19-bc7badf51ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:11.020605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e811c78f-c6ee-4c01-ac19-bc7badf51ab3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:11.021973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e811c78f-c6ee-4c01-ac19-bc7badf51ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:11.041168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db636d-2bb4-495a-b008-64719d4bd59b None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:11.042887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:11.085726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadfd9c-0d42-407c-8139-51c649f1a47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:11.086615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadfd9c-0d42-407c-8139-51c649f1a47a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:11.087044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadfd9c-0d42-407c-8139-51c649f1a47a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:11.087368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadfd9c-0d42-407c-8139-51c649f1a47a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:11.096476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadfd9c-0d42-407c-8139-51c649f1a47a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:11.097938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadfd9c-0d42-407c-8139-51c649f1a47a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:11.100290 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 412/831] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:11.112927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-fdadfd9c-0d42-407c-8139-51c649f1a47a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:11.112927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:11.112927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:11.112927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:11.112927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:11.112927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:11.112927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:11.112927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:11.112927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:11.112927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:11.112927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:11.112927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:11.112927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:45:11.112927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:45:11.112927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:45:11.114424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:45:11.114424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:11.114424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:11.114424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:11.114424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:11.114424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:11.114424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:11.114424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:11.114424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:11.114424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:11.114424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:11.114424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:11.114424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:11.114424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:11.114424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:11.114424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:11.114424 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:11.116460 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:45:11.116460 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:45:11.116460 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:45:11.116460 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:45:11.116460 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:45:11.116460 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:45:11.116460 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:11.116460 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:11.116460 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 420/832] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:45:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:11.120218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811c78f-c6ee-4c01-ac19-bc7badf51ab3 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:11.130262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadfd9c-0d42-407c-8139-51c649f1a47a None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:11.199792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:11.249763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadfd9c-0d42-407c-8139-51c649f1a47a None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:11.262265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811c78f-c6ee-4c01-ac19-bc7badf51ab3 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:11.286411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf609cb4-8e3f-4ee3-97a2-452b502323a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:11.287113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf609cb4-8e3f-4ee3-97a2-452b502323a6 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:11.287449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf609cb4-8e3f-4ee3-97a2-452b502323a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:11.287765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf609cb4-8e3f-4ee3-97a2-452b502323a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:11.299266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf609cb4-8e3f-4ee3-97a2-452b502323a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:45:11.302133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7df0c5-a19c-4af6-8016-8b33527345a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:11.303017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7df0c5-a19c-4af6-8016-8b33527345a7 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:11.303543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7df0c5-a19c-4af6-8016-8b33527345a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:11.304107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7df0c5-a19c-4af6-8016-8b33527345a7 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:11.305075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7df0c5-a19c-4af6-8016-8b33527345a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:11.305393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-cf609cb4-8e3f-4ee3-97a2-452b502323a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:45:11.305393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:11.305393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:11.305393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:11.305393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:11.305393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:11.305393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:11.305393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:11.305393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:11.305393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:11.305393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:11.305393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:11.305393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:45:11.305393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:45:11.305393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:45:11.305393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:45:11.306323 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:45:11.306323 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:45:11.306323 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:45:11.306323 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:45:11.306323 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:11.306323 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:11.306323 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:11.306323 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:11.306323 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:11.306323 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:11.306323 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:11.306323 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:11.306323 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:11.306323 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:11.306323 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:11.306323 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:11.307173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:11.307173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:11.307173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:11.307173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:11.307173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:45:11.307173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:45:11.307173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:45:11.307173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:45:11.307173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:45:11.307173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:45:11.307173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:45:11.307173 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:11.308677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7df0c5-a19c-4af6-8016-8b33527345a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:11.310526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7df0c5-a19c-4af6-8016-8b33527345a7 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:11.312368 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 421/833] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:45:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:11.313492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf609cb4-8e3f-4ee3-97a2-452b502323a6 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:11.327408 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 413/834] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:45:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:11.334539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7df0c5-a19c-4af6-8016-8b33527345a7 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:11.349239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:11.440735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf609cb4-8e3f-4ee3-97a2-452b502323a6 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:11.447037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7df0c5-a19c-4af6-8016-8b33527345a7 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:11.454348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:11.479844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690522a5-9069-49d1-9344-b8ad4a1943cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:11.480918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690522a5-9069-49d1-9344-b8ad4a1943cf None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:11.481639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690522a5-9069-49d1-9344-b8ad4a1943cf None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:11.482096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690522a5-9069-49d1-9344-b8ad4a1943cf None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:11.482529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c963e11-8ec7-4c00-b304-d77ad62d118f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:11.483205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690522a5-9069-49d1-9344-b8ad4a1943cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:11.483338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c963e11-8ec7-4c00-b304-d77ad62d118f None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:11.483617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c963e11-8ec7-4c00-b304-d77ad62d118f None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:11.483982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c963e11-8ec7-4c00-b304-d77ad62d118f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:11.484226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690522a5-9069-49d1-9344-b8ad4a1943cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:11.484892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c963e11-8ec7-4c00-b304-d77ad62d118f None admin] RBAC: Adding query filter params (role.id=3b89b89da98d4ec08a0587aa13832636, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=08a2a5793b7a4797a470719a682e541a) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:11.485274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c963e11-8ec7-4c00-b304-d77ad62d118f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:11.486220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690522a5-9069-49d1-9344-b8ad4a1943cf None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:11.486845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c963e11-8ec7-4c00-b304-d77ad62d118f None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:11.495596 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 414/835] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:45:11 2022] GET /identity/v3/role_assignments?user.id=08a2a5793b7a4797a470719a682e541a&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=3b89b89da98d4ec08a0587aa13832636 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:11.502067 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 422/836] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:45:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:11.508587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c963e11-8ec7-4c00-b304-d77ad62d118f None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:11.630962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c963e11-8ec7-4c00-b304-d77ad62d118f None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:11.668996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2282c-c345-44a8-bb0c-a3bb398dab8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:11.669729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2282c-c345-44a8-bb0c-a3bb398dab8b None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:11.670023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2282c-c345-44a8-bb0c-a3bb398dab8b None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:11.670308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2282c-c345-44a8-bb0c-a3bb398dab8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:11.684925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2282c-c345-44a8-bb0c-a3bb398dab8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:11.686421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2282c-c345-44a8-bb0c-a3bb398dab8b None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:11.701987 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-9ab2282c-c345-44a8-bb0c-a3bb398dab8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:11.701987 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:11.701987 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:11.701987 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:11.701987 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:11.701987 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:11.701987 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:11.701987 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:11.701987 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:11.701987 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:11.701987 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:11.701987 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:11.701987 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:11.701987 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:11.701987 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:11.702920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:11.702920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:11.702920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:11.702920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:11.702920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:11.702920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:11.702920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:11.702920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:11.702920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:11.702920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:11.702920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:11.702920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:11.702920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:11.702920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:11.702920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:11.702920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:11.702920 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:11.703877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:11.703877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:11.703877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:11.703877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:11.703877 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 415/837] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:11.710978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690522a5-9069-49d1-9344-b8ad4a1943cf None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:11.750419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0ed73-4dda-4e00-a055-83f9e8d2c410 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:11.750758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0ed73-4dda-4e00-a055-83f9e8d2c410 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:11.750979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0ed73-4dda-4e00-a055-83f9e8d2c410 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:11.752505 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 416/838] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:45:11.757598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16ca85-5913-4d14-b936-7de6e6348132 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:11.757894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16ca85-5913-4d14-b936-7de6e6348132 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:11.758174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16ca85-5913-4d14-b936-7de6e6348132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:11.777441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5b16ca85-5913-4d14-b936-7de6e6348132 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:11.778748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5b16ca85-5913-4d14-b936-7de6e6348132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:11.801426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:11.821064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:11.840136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690522a5-9069-49d1-9344-b8ad4a1943cf None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:11.868383 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 417/839] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:45:11.878318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137409b0-eb76-4362-a876-8ae5972be5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:11.879243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137409b0-eb76-4362-a876-8ae5972be5d2 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:11.879830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137409b0-eb76-4362-a876-8ae5972be5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:11.880312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137409b0-eb76-4362-a876-8ae5972be5d2 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:11.881206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137409b0-eb76-4362-a876-8ae5972be5d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:11.881732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137409b0-eb76-4362-a876-8ae5972be5d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:11.883408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137409b0-eb76-4362-a876-8ae5972be5d2 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:11.894569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16ca85-5913-4d14-b936-7de6e6348132 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:11.898364 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 423/840] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:11.904043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137409b0-eb76-4362-a876-8ae5972be5d2 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:12.028086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16ca85-5913-4d14-b936-7de6e6348132 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:12.034659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137409b0-eb76-4362-a876-8ae5972be5d2 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:12.073549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719c9af-dbdf-4a68-b3ff-7c701f19aa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:12.074417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719c9af-dbdf-4a68-b3ff-7c701f19aa00 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:12.074529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719c9af-dbdf-4a68-b3ff-7c701f19aa00 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:12.074810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719c9af-dbdf-4a68-b3ff-7c701f19aa00 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:12.080720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab7db0-1e22-4df0-86ce-03065789ad04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:12.081926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab7db0-1e22-4df0-86ce-03065789ad04 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:12.082420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab7db0-1e22-4df0-86ce-03065789ad04 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:12.082528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719c9af-dbdf-4a68-b3ff-7c701f19aa00 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:12.083716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab7db0-1e22-4df0-86ce-03065789ad04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:12.084512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719c9af-dbdf-4a68-b3ff-7c701f19aa00 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:12.096563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab7db0-1e22-4df0-86ce-03065789ad04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:45:12.096847 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-4719c9af-dbdf-4a68-b3ff-7c701f19aa00 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 30 20:45:12.096847 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:12.096847 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:12.096847 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:12.096847 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:12.096847 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:12.096847 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:12.096847 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:12.096847 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:12.096847 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:12.096847 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:12.096847 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:12.096847 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:45:12.096847 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:45:12.096847 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:45:12.096847 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:45:12.098119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:12.098119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:12.098119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:45:12.098119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:12.098119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:45:12.098119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:12.098119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:12.098119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:12.098119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:12.098119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:12.098119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:12.098119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:12.098119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:12.098119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:12.098119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:12.098119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:12.098119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:12.098119 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:12.099743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:12.099743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:12.099743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:45:12.099743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:45:12.099743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:45:12.099743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:45:12.099743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:45:12.099743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:45:12.099743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 30 20:45:12.099743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:12.103401 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 424/841] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:45:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:12.104253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719c9af-dbdf-4a68-b3ff-7c701f19aa00 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:12.106315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-f0ab7db0-1e22-4df0-86ce-03065789ad04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:45:12.106315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:12.106315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:12.106315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:12.106315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:12.106315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:12.106315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:12.106315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:12.106315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:12.106315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:12.106315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:12.106315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:12.106315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:45:12.106315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:45:12.106315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:45:12.106315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:45:12.107275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:45:12.107275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:45:12.107275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:45:12.107275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:45:12.107275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:12.107275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:12.107275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:12.107275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:12.107275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:12.107275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:12.107275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:12.107275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:12.107275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:12.107275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:12.107275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:12.107275 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:12.108171 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:12.108171 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:12.108171 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:12.108171 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:12.108171 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:45:12.108171 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:45:12.108171 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:45:12.108171 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:45:12.108171 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:45:12.108171 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:45:12.108171 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:45:12.108171 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:12.108810 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 418/842] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:45:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:12.112445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:12.115773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab7db0-1e22-4df0-86ce-03065789ad04 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:12.132375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:12.224154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab7db0-1e22-4df0-86ce-03065789ad04 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:12.243716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719c9af-dbdf-4a68-b3ff-7c701f19aa00 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:12.261073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e94c09-8fe6-4607-808c-6191b46e6071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:12.261681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e94c09-8fe6-4607-808c-6191b46e6071 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:12.261967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e94c09-8fe6-4607-808c-6191b46e6071 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:12.262247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e94c09-8fe6-4607-808c-6191b46e6071 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:12.262971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e94c09-8fe6-4607-808c-6191b46e6071 None admin] RBAC: Adding query filter params (name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:12.263275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e94c09-8fe6-4607-808c-6191b46e6071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:12.264807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e94c09-8fe6-4607-808c-6191b46e6071 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:12.274333 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 419/843] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:45:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:12.281127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e94c09-8fe6-4607-808c-6191b46e6071 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:12.285402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ea4ce-373d-4a96-a7af-28a2e822b027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:12.286486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ea4ce-373d-4a96-a7af-28a2e822b027 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:12.287004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ea4ce-373d-4a96-a7af-28a2e822b027 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:12.287525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ea4ce-373d-4a96-a7af-28a2e822b027 None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:12.288562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ea4ce-373d-4a96-a7af-28a2e822b027 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:12.289093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ea4ce-373d-4a96-a7af-28a2e822b027 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:12.290838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ea4ce-373d-4a96-a7af-28a2e822b027 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:12.315884 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 425/844] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Jul 30 20:45:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:12.317637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ea4ce-373d-4a96-a7af-28a2e822b027 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:12.365432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:12.383743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:12.394320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e94c09-8fe6-4607-808c-6191b46e6071 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:12.426190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ea4ce-373d-4a96-a7af-28a2e822b027 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:12.431432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ada0fd-9474-484d-bbd1-0e83778edf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:12.432089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ada0fd-9474-484d-bbd1-0e83778edf51 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:12.432374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ada0fd-9474-484d-bbd1-0e83778edf51 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:12.432650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ada0fd-9474-484d-bbd1-0e83778edf51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:12.444289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ada0fd-9474-484d-bbd1-0e83778edf51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:12.445746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ada0fd-9474-484d-bbd1-0e83778edf51 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:12.461101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-59ada0fd-9474-484d-bbd1-0e83778edf51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:12.461101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:12.461101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:12.461101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:12.461101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:12.461101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:12.461101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:12.461101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:12.461101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:12.461101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:12.461101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:12.461101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:12.461101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:12.461101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:12.461101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:12.461992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:12.461992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:12.461992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:12.461992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:12.461992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:12.461992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:12.461992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:12.461992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:12.461992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:12.461992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:12.461992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:12.461992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:12.461992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:12.461992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:12.461992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:12.461992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:12.461992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:12.462909 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:12.462909 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:12.462909 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:12.462909 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:12.462909 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 420/845] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:12.463627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa2d83-fbea-40d2-9469-1c9910ef170e None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:12.463741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa2d83-fbea-40d2-9469-1c9910ef170e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:12.463916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa2d83-fbea-40d2-9469-1c9910ef170e None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:12.465278 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 421/846] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:12.470181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa2d83-fbea-40d2-9469-1c9910ef170e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:12.474470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279f780-6f64-43a7-9a70-43968ffcd37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:12.475106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279f780-6f64-43a7-9a70-43968ffcd37b None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:12.475495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279f780-6f64-43a7-9a70-43968ffcd37b None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:12.475775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279f780-6f64-43a7-9a70-43968ffcd37b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:12.550825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279f780-6f64-43a7-9a70-43968ffcd37b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:12.552261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279f780-6f64-43a7-9a70-43968ffcd37b None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:12.580248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa2d83-fbea-40d2-9469-1c9910ef170e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:12.607523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:12.616231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:12.618480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512bad3-e061-47bc-9949-ab104130a47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:12.619223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512bad3-e061-47bc-9949-ab104130a47b None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:12.619613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512bad3-e061-47bc-9949-ab104130a47b None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:12.619955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512bad3-e061-47bc-9949-ab104130a47b None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:12.620979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512bad3-e061-47bc-9949-ab104130a47b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:12.621346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512bad3-e061-47bc-9949-ab104130a47b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:12.622800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512bad3-e061-47bc-9949-ab104130a47b None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:12.641158 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 422/847] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:12.641158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee954bd3-3d31-47d8-8727-8fca4b1cbe2e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:12.641158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee954bd3-3d31-47d8-8727-8fca4b1cbe2e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:12.641158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee954bd3-3d31-47d8-8727-8fca4b1cbe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:12.658218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ee954bd3-3d31-47d8-8727-8fca4b1cbe2e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:12.659523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ee954bd3-3d31-47d8-8727-8fca4b1cbe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:12.669857 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 426/848] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:45:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 30 20:45:12.669857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279f780-6f64-43a7-9a70-43968ffcd37b None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:12.740075 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 423/849] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:12.740944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee954bd3-3d31-47d8-8727-8fca4b1cbe2e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:12.789968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279f780-6f64-43a7-9a70-43968ffcd37b None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:12.827327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b610cd-5c06-42cf-a6d8-0d3e057478db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:12.828093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b610cd-5c06-42cf-a6d8-0d3e057478db None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:12.828441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b610cd-5c06-42cf-a6d8-0d3e057478db None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:12.828784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b610cd-5c06-42cf-a6d8-0d3e057478db None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:12.836586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b610cd-5c06-42cf-a6d8-0d3e057478db None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:12.838243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b610cd-5c06-42cf-a6d8-0d3e057478db None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:12.850947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-21b610cd-5c06-42cf-a6d8-0d3e057478db None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 30 20:45:12.850947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:12.850947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:12.850947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:12.850947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:12.850947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:12.850947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:12.850947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:12.850947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:12.850947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:12.850947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:12.850947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:12.850947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:45:12.850947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:45:12.850947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:45:12.850947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:45:12.852262 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:12.852262 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:12.852262 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:45:12.852262 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:12.852262 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:45:12.852262 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:12.852262 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:12.852262 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:12.852262 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:12.852262 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:12.852262 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:12.852262 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:12.852262 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:12.852262 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:12.852262 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:12.852262 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:12.852262 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:12.852262 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:12.853209 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:12.853209 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:12.853209 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:45:12.853209 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:45:12.853209 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:45:12.853209 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:45:12.853209 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:45:12.853209 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:45:12.853209 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 30 20:45:12.853209 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:12.853209 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 427/850] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Jul 30 20:45:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:12.853817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b610cd-5c06-42cf-a6d8-0d3e057478db None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:12.861787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee954bd3-3d31-47d8-8727-8fca4b1cbe2e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:12.880358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:12.881396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:12.901983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbbac5-c81f-4f45-975e-b0d30c30f22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:12.902632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbbac5-c81f-4f45-975e-b0d30c30f22d None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:12.902960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbbac5-c81f-4f45-975e-b0d30c30f22d None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:12.903268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbbac5-c81f-4f45-975e-b0d30c30f22d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:12.914654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbbac5-c81f-4f45-975e-b0d30c30f22d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:12.916190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbbac5-c81f-4f45-975e-b0d30c30f22d None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:12.930743 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-b8bbbac5-c81f-4f45-975e-b0d30c30f22d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:12.930743 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:12.930743 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:12.930743 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:12.930743 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:12.930743 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:12.930743 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:12.930743 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:12.930743 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:12.930743 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:12.930743 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:12.930743 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:12.930743 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:12.930743 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:12.930743 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:12.931860 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:12.931860 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:12.931860 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:12.931860 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:12.931860 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:12.931860 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:12.931860 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:12.931860 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:12.931860 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:12.931860 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:12.931860 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:12.931860 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:12.931860 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:12.931860 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:12.931860 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:12.931860 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:12.931860 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:12.937777 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:12.937777 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:12.937777 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:12.937777 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:12.937777 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 424/851] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:12.937777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbbac5-c81f-4f45-975e-b0d30c30f22d None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:12.970369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b610cd-5c06-42cf-a6d8-0d3e057478db None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:13.017554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c857edf-c6a0-4707-b717-4539766bff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:13.018294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c857edf-c6a0-4707-b717-4539766bff20 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:13.018651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c857edf-c6a0-4707-b717-4539766bff20 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:13.018998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c857edf-c6a0-4707-b717-4539766bff20 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:13.019952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c857edf-c6a0-4707-b717-4539766bff20 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:13.022726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c857edf-c6a0-4707-b717-4539766bff20 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:13.034258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-3c857edf-c6a0-4707-b717-4539766bff20 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 30 20:45:13.034258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:13.034258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:13.034258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:13.034258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:13.034258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:13.034258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:13.034258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:13.034258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 30 20:45:13.034258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:13.034258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:13.034258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:13.034258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:13.034258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:13.034258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:13.034258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:13.034258 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:13.035267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:13.035267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:13.035267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:13.035267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:13.035267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:13.035267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:13.035267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:13.035267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:13.035267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:13.035267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:13.035267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:13.035267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:13.035267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:13.035267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:13.035267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:13.035267 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:13.036497 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:13.036497 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:13.036497 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:13.036497 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:13.036497 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:13.036497 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:13.036497 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:13.036497 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:13.036497 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:13.036497 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:13.036497 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:13.036497 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:13.036497 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 30 20:45:13.036497 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:13.038506 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 428/852] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:45:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:13.039548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c857edf-c6a0-4707-b717-4539766bff20 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:13.057253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbbac5-c81f-4f45-975e-b0d30c30f22d None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:13.097791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81e215-cb25-4a00-988b-51327c883c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:13.098874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81e215-cb25-4a00-988b-51327c883c8a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:13.099161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81e215-cb25-4a00-988b-51327c883c8a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:13.099474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81e215-cb25-4a00-988b-51327c883c8a None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:13.100253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81e215-cb25-4a00-988b-51327c883c8a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:13.100563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81e215-cb25-4a00-988b-51327c883c8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:13.101982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81e215-cb25-4a00-988b-51327c883c8a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:13.120776 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 425/853] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Jul 30 20:45:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:13.121687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81e215-cb25-4a00-988b-51327c883c8a None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:13.134032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:13.149292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c857edf-c6a0-4707-b717-4539766bff20 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:13.152905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:13.187131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82618ab5-b36b-4724-b6b4-99c852d74e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:13.187774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82618ab5-b36b-4724-b6b4-99c852d74e71 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:13.188055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82618ab5-b36b-4724-b6b4-99c852d74e71 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:13.188339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82618ab5-b36b-4724-b6b4-99c852d74e71 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:13.189030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82618ab5-b36b-4724-b6b4-99c852d74e71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:13.189347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82618ab5-b36b-4724-b6b4-99c852d74e71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:13.190749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82618ab5-b36b-4724-b6b4-99c852d74e71 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:13.203544 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 429/854] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:13.204352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82618ab5-b36b-4724-b6b4-99c852d74e71 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:13.235721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81e215-cb25-4a00-988b-51327c883c8a None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:13.276065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cfd87-0ce5-40b8-9edb-a094eebe71a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:13.276689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cfd87-0ce5-40b8-9edb-a094eebe71a5 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:13.276979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cfd87-0ce5-40b8-9edb-a094eebe71a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:13.277263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cfd87-0ce5-40b8-9edb-a094eebe71a5 None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:13.277940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cfd87-0ce5-40b8-9edb-a094eebe71a5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:13.278251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cfd87-0ce5-40b8-9edb-a094eebe71a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:13.279678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cfd87-0ce5-40b8-9edb-a094eebe71a5 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:13.284159 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 426/855] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:45:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:13.284937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cfd87-0ce5-40b8-9edb-a094eebe71a5 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:13.325076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82618ab5-b36b-4724-b6b4-99c852d74e71 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:13.362000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d43a5-4f2c-4c5f-9e01-24c8e721574c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:13.363036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d43a5-4f2c-4c5f-9e01-24c8e721574c None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:13.363348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d43a5-4f2c-4c5f-9e01-24c8e721574c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:13.363631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d43a5-4f2c-4c5f-9e01-24c8e721574c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:13.381330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:13.386144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:13.397883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cfd87-0ce5-40b8-9edb-a094eebe71a5 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:13.437860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d43a5-4f2c-4c5f-9e01-24c8e721574c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:13.438807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133eb52-5424-4296-be62-25f3f1244fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:13.439474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d43a5-4f2c-4c5f-9e01-24c8e721574c None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:13.439579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133eb52-5424-4296-be62-25f3f1244fe2 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:13.439761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133eb52-5424-4296-be62-25f3f1244fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:13.440033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133eb52-5424-4296-be62-25f3f1244fe2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:13.447229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133eb52-5424-4296-be62-25f3f1244fe2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:13.448715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133eb52-5424-4296-be62-25f3f1244fe2 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:13.461858 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-b133eb52-5424-4296-be62-25f3f1244fe2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:13.461858 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:13.461858 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:13.461858 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:13.461858 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:13.461858 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:13.461858 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:13.461858 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:13.461858 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:13.461858 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:13.461858 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:13.461858 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:13.461858 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:45:13.461858 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:45:13.461858 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:45:13.462823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:45:13.462823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:13.462823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:13.462823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:13.462823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:13.462823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:13.462823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:13.462823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:13.462823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:13.462823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:13.462823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:13.462823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:13.462823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:13.462823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:13.462823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:13.462823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:13.462823 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:13.463775 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:45:13.463775 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:45:13.463775 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:45:13.463775 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:45:13.463775 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:45:13.463775 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:45:13.463775 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:13.463775 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:13.463775 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 427/856] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:45:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:13.464270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133eb52-5424-4296-be62-25f3f1244fe2 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:13.555585 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 430/857] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:45:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 30 20:45:13.556431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d43a5-4f2c-4c5f-9e01-24c8e721574c None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:13.585480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133eb52-5424-4296-be62-25f3f1244fe2 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:13.604508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:13.623178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4b8ca-0783-4801-a9f3-9e83c51ba6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:13.624109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4b8ca-0783-4801-a9f3-9e83c51ba6bf None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:13.624668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4b8ca-0783-4801-a9f3-9e83c51ba6bf None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:13.624944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4b8ca-0783-4801-a9f3-9e83c51ba6bf None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:13.625622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4b8ca-0783-4801-a9f3-9e83c51ba6bf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:13.625925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4b8ca-0783-4801-a9f3-9e83c51ba6bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:13.627276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4b8ca-0783-4801-a9f3-9e83c51ba6bf None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:13.639328 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 428/858] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:45:13 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:13.639328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4b8ca-0783-4801-a9f3-9e83c51ba6bf None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:13.664526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:13.684831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d43a5-4f2c-4c5f-9e01-24c8e721574c None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:13.742408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739ffb6-c7d0-4ff2-a211-cc8c80847da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:13.743386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739ffb6-c7d0-4ff2-a211-cc8c80847da2 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:13.743724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739ffb6-c7d0-4ff2-a211-cc8c80847da2 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:13.744008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739ffb6-c7d0-4ff2-a211-cc8c80847da2 None admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:13.744788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739ffb6-c7d0-4ff2-a211-cc8c80847da2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:13.745102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739ffb6-c7d0-4ff2-a211-cc8c80847da2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:13.746860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739ffb6-c7d0-4ff2-a211-cc8c80847da2 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:13.760906 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 431/859] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:45:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:13.766734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739ffb6-c7d0-4ff2-a211-cc8c80847da2 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:13.804393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4b8ca-0783-4801-a9f3-9e83c51ba6bf None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:13.853830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53134782-eb67-4bb2-86f2-5bf4751aa040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:13.853830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53134782-eb67-4bb2-86f2-5bf4751aa040 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:13.854124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53134782-eb67-4bb2-86f2-5bf4751aa040 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:13.854200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53134782-eb67-4bb2-86f2-5bf4751aa040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:13.868371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53134782-eb67-4bb2-86f2-5bf4751aa040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:13.869842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53134782-eb67-4bb2-86f2-5bf4751aa040 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:13.890577 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-53134782-eb67-4bb2-86f2-5bf4751aa040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:13.890577 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:13.890577 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:13.890577 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:13.890577 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:13.890577 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:13.890577 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:13.890577 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:13.890577 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:13.890577 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:13.890577 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:13.890577 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:13.890577 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:13.890577 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:13.890577 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:13.891528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:13.891528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:13.891528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:13.891528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:13.891528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:13.891528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:13.891528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:13.891528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:13.891528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:13.891528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:13.891528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:13.891528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:13.891528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:13.891528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:13.891528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:13.891528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:13.891528 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:13.892461 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:13.892461 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:13.892461 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:13.892461 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:13.892461 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 429/860] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:13.893337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87d8b7-b1c7-4046-9953-23291a3aadce None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:13.893635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87d8b7-b1c7-4046-9953-23291a3aadce None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:13.893916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87d8b7-b1c7-4046-9953-23291a3aadce None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:13.895879 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 430/861] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:13.900974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87d8b7-b1c7-4046-9953-23291a3aadce None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:13.908179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739ffb6-c7d0-4ff2-a211-cc8c80847da2 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:13.915824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:13.946610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee67193-6e37-4471-9ea5-d2863c47335b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:13.947241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee67193-6e37-4471-9ea5-d2863c47335b None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:13.947555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee67193-6e37-4471-9ea5-d2863c47335b None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:13.947838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee67193-6e37-4471-9ea5-d2863c47335b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:13.948628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee67193-6e37-4471-9ea5-d2863c47335b None admin] RBAC: Adding query filter params (role.id=3b89b89da98d4ec08a0587aa13832636, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=2181960e3bed4031889d6e72a721e151) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:13.948941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee67193-6e37-4471-9ea5-d2863c47335b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:13.950871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee67193-6e37-4471-9ea5-d2863c47335b None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:13.957285 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 432/862] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:45:13 2022] GET /identity/v3/role_assignments?user.id=2181960e3bed4031889d6e72a721e151&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=3b89b89da98d4ec08a0587aa13832636 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:13.959002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a8ed7-51be-461a-a21a-99c36dbbe0eb None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:13.959312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a8ed7-51be-461a-a21a-99c36dbbe0eb None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:13.959606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a8ed7-51be-461a-a21a-99c36dbbe0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:13.980155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-505a8ed7-51be-461a-a21a-99c36dbbe0eb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:13.981431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-505a8ed7-51be-461a-a21a-99c36dbbe0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:13.994909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:14.031381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87d8b7-b1c7-4046-9953-23291a3aadce None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:14.078698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe54cd-3482-427c-a19b-d6c831ee2611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:14.080126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe54cd-3482-427c-a19b-d6c831ee2611 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:14.080591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe54cd-3482-427c-a19b-d6c831ee2611 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:14.081023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe54cd-3482-427c-a19b-d6c831ee2611 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:14.081884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe54cd-3482-427c-a19b-d6c831ee2611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:14.082345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe54cd-3482-427c-a19b-d6c831ee2611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:14.084068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe54cd-3482-427c-a19b-d6c831ee2611 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:14.098038 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 431/863] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:14.103400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe54cd-3482-427c-a19b-d6c831ee2611 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:14.111319 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 433/864] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:14.135556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a8ed7-51be-461a-a21a-99c36dbbe0eb None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:14.233311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe54cd-3482-427c-a19b-d6c831ee2611 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:14.251165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:14.253331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a8ed7-51be-461a-a21a-99c36dbbe0eb None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:14.271997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:14.285700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7e9b6-77aa-47b1-a3a5-8e527bafa07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:14.286659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7e9b6-77aa-47b1-a3a5-8e527bafa07e None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:14.287146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7e9b6-77aa-47b1-a3a5-8e527bafa07e None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:14.287676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7e9b6-77aa-47b1-a3a5-8e527bafa07e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:14.295029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7e9b6-77aa-47b1-a3a5-8e527bafa07e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:14.296416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9e059-3677-4ea8-8aab-ee19ca8b480c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:14.297038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7e9b6-77aa-47b1-a3a5-8e527bafa07e None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:14.297148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9e059-3677-4ea8-8aab-ee19ca8b480c None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:14.297405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9e059-3677-4ea8-8aab-ee19ca8b480c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:14.297685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9e059-3677-4ea8-8aab-ee19ca8b480c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:14.298489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9e059-3677-4ea8-8aab-ee19ca8b480c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:14.300019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9e059-3677-4ea8-8aab-ee19ca8b480c None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:14.309734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-13f9e059-3677-4ea8-8aab-ee19ca8b480c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 30 20:45:14.309734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:14.309734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:14.309734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:14.309734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:14.309734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:14.309734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:14.309734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:14.309734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 30 20:45:14.309734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:14.309734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:14.309734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:14.309734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:14.309734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:14.309734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:14.309734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:14.310715 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:14.310715 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:14.310715 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:14.310715 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:14.310715 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:14.310715 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:14.310715 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:14.310715 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:14.310715 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:14.310715 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:14.310715 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:14.310715 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:14.310715 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:14.310715 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:14.310715 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:14.310715 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:14.311602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:14.311602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:14.311602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:14.311602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:14.311602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:14.311602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:14.311602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:14.311602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:14.311602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:14.311602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:14.311602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:14.311602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:14.311602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:14.311602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 30 20:45:14.311602 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:14.311602 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 434/865] 10.222.0.17 () {56 vars in 1132 bytes} [Sat Jul 30 20:45:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:14.312461 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-f8a7e9b6-77aa-47b1-a3a5-8e527bafa07e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:14.312461 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:14.312461 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:14.312461 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:14.312461 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:14.312461 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:14.312461 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:14.312461 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:14.312461 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:14.312461 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:14.312461 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:14.312461 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:14.312461 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:45:14.312461 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:45:14.312461 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:45:14.313276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:45:14.313276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:14.313276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:14.313276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:14.313276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:14.313276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:14.313276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:14.313276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:14.313276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:14.313276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:14.313276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:14.313276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:14.313276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:14.313276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:14.313276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:14.313276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:14.313276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:14.314176 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:45:14.314176 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:45:14.314176 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:45:14.314176 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:45:14.314176 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:45:14.314176 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:45:14.314176 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:14.314176 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:14.314176 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 432/866] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:45:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:14.326850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9e059-3677-4ea8-8aab-ee19ca8b480c None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:14.327025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7e9b6-77aa-47b1-a3a5-8e527bafa07e None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:14.434457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9e059-3677-4ea8-8aab-ee19ca8b480c None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:14.434690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7e9b6-77aa-47b1-a3a5-8e527bafa07e None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:14.471263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274863c-0231-445d-9900-9e6f3a91383c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:14.472050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39edcd3-babb-4838-ae49-993fec381ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:14.472187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274863c-0231-445d-9900-9e6f3a91383c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:14.472561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274863c-0231-445d-9900-9e6f3a91383c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:14.472663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39edcd3-babb-4838-ae49-993fec381ae2 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:14.472947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39edcd3-babb-4838-ae49-993fec381ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:14.473586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274863c-0231-445d-9900-9e6f3a91383c None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:14.473755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39edcd3-babb-4838-ae49-993fec381ae2 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:14.474434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39edcd3-babb-4838-ae49-993fec381ae2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:14.474741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39edcd3-babb-4838-ae49-993fec381ae2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:14.474846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274863c-0231-445d-9900-9e6f3a91383c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:14.475232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274863c-0231-445d-9900-9e6f3a91383c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:14.476153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39edcd3-babb-4838-ae49-993fec381ae2 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:14.476870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274863c-0231-445d-9900-9e6f3a91383c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:14.481526 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 435/867] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 30 20:45:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:14.487333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39edcd3-babb-4838-ae49-993fec381ae2 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:14.490032 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 433/868] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:45:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:14.496026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274863c-0231-445d-9900-9e6f3a91383c None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:14.520166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:14.552691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:14.606490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39edcd3-babb-4838-ae49-993fec381ae2 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:14.612197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274863c-0231-445d-9900-9e6f3a91383c None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:14.641584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab66dd-5f2d-4ccd-8bea-3e622d1a4508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:14.642212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab66dd-5f2d-4ccd-8bea-3e622d1a4508 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:14.642496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab66dd-5f2d-4ccd-8bea-3e622d1a4508 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:14.642805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab66dd-5f2d-4ccd-8bea-3e622d1a4508 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:14.643520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab66dd-5f2d-4ccd-8bea-3e622d1a4508 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:14.643884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab66dd-5f2d-4ccd-8bea-3e622d1a4508 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:14.645294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab66dd-5f2d-4ccd-8bea-3e622d1a4508 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:14.650906 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 436/869] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 30 20:45:14 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:14.654647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4949a81-2426-4b79-96d4-d79c584cea09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:14.655304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4949a81-2426-4b79-96d4-d79c584cea09 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:14.655599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4949a81-2426-4b79-96d4-d79c584cea09 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:14.655873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4949a81-2426-4b79-96d4-d79c584cea09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:14.656681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4949a81-2426-4b79-96d4-d79c584cea09 None admin] RBAC: Adding query filter params (role.id=50fb737d5edf48298d0a6061ba652acb, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=877b427e6ff84af29a59dc9e1a3128ef) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:14.656993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4949a81-2426-4b79-96d4-d79c584cea09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:14.658482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4949a81-2426-4b79-96d4-d79c584cea09 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:14.666244 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 434/870] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:45:14 2022] GET /identity/v3/role_assignments?user.id=877b427e6ff84af29a59dc9e1a3128ef&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=50fb737d5edf48298d0a6061ba652acb => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:16.030140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a365227-0b3e-4f66-a518-20631231950f None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:16.030644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a365227-0b3e-4f66-a518-20631231950f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:16.030754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a365227-0b3e-4f66-a518-20631231950f None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:16.032440 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 437/871] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:16.037786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d573f-f064-47e9-a481-c782dc49f3ac None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:16.038295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d573f-f064-47e9-a481-c782dc49f3ac None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:16.038295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d573f-f064-47e9-a481-c782dc49f3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:16.060991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-597d573f-f064-47e9-a481-c782dc49f3ac None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:16.062328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-597d573f-f064-47e9-a481-c782dc49f3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:16.133882 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 435/872] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:45:16.157832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a365227-0b3e-4f66-a518-20631231950f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:16.250421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:16.260429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a365227-0b3e-4f66-a518-20631231950f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:16.298788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e307b7-5af4-4176-a7c8-6b0b7ff52fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:16.299443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e307b7-5af4-4176-a7c8-6b0b7ff52fcf None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:16.299722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e307b7-5af4-4176-a7c8-6b0b7ff52fcf None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:16.299995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e307b7-5af4-4176-a7c8-6b0b7ff52fcf None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:16.300686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e307b7-5af4-4176-a7c8-6b0b7ff52fcf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:16.302086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e307b7-5af4-4176-a7c8-6b0b7ff52fcf None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:16.320196 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 438/873] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 30 20:45:16 2022] POST /identity/v3/services => generated 251 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:45:16.431814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52729121-3f85-4037-9d18-14bde300ede2 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:16.432471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52729121-3f85-4037-9d18-14bde300ede2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:16.432960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52729121-3f85-4037-9d18-14bde300ede2 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:16.434535 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 436/874] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:16.440439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1405a6-c134-42db-80fa-cae1f5b32800 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:16.440748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1405a6-c134-42db-80fa-cae1f5b32800 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:16.441005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1405a6-c134-42db-80fa-cae1f5b32800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:16.461155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9b1405a6-c134-42db-80fa-cae1f5b32800 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:16.462377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9b1405a6-c134-42db-80fa-cae1f5b32800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:16.542150 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 439/875] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:16.568906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52729121-3f85-4037-9d18-14bde300ede2 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:16.619141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:16.694729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52729121-3f85-4037-9d18-14bde300ede2 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:16.730932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633515b8-0139-4c91-9e0a-a6b0c4fd210f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:16.731925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633515b8-0139-4c91-9e0a-a6b0c4fd210f None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:16.732316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633515b8-0139-4c91-9e0a-a6b0c4fd210f None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:16.732696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633515b8-0139-4c91-9e0a-a6b0c4fd210f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:16.733434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633515b8-0139-4c91-9e0a-a6b0c4fd210f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:16.734912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633515b8-0139-4c91-9e0a-a6b0c4fd210f None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:16.744478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-633515b8-0139-4c91-9e0a-a6b0c4fd210f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 30 20:45:16.744478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:16.744478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:16.744478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:16.744478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:16.744478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:16.744478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:16.744478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:16.744478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 30 20:45:16.744478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:16.744478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:16.744478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:16.744478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:16.744478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:16.744478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:16.744478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:16.744478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:16.746071 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:16.746071 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:16.746071 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:16.746071 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:16.746071 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:16.746071 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:16.746071 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:16.746071 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:16.746071 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:16.746071 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:16.746071 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:16.746071 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:16.746071 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:16.746071 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:16.746071 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:16.746071 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:16.747223 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:16.747223 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:16.747223 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:16.747223 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:16.747223 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:16.747223 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:16.747223 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:16.747223 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:16.747223 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:16.747223 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:16.747223 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:16.747223 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:16.747223 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 30 20:45:16.747223 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:16.749284 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 437/876] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 30 20:45:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:16.755533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1405a6-c134-42db-80fa-cae1f5b32800 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:16.838882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:16.862506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1405a6-c134-42db-80fa-cae1f5b32800 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:16.902272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdbdb9-2efb-4e5d-bf31-bb1f09b01114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:16.902898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdbdb9-2efb-4e5d-bf31-bb1f09b01114 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:16.903179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdbdb9-2efb-4e5d-bf31-bb1f09b01114 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:16.903487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdbdb9-2efb-4e5d-bf31-bb1f09b01114 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:16.904168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdbdb9-2efb-4e5d-bf31-bb1f09b01114 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:16.904467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdbdb9-2efb-4e5d-bf31-bb1f09b01114 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:16.905824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdbdb9-2efb-4e5d-bf31-bb1f09b01114 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:16.911726 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 440/877] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Jul 30 20:45:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:16.917305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633515b8-0139-4c91-9e0a-a6b0c4fd210f None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:17.032740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ff162-468c-4947-b464-d3a3bfbf0080 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:17.033314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ff162-468c-4947-b464-d3a3bfbf0080 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:17.033314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ff162-468c-4947-b464-d3a3bfbf0080 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:17.034851 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 441/878] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:17.041355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec76d5-06a2-4a49-b0cb-bb0cbbeefb16 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:17.041835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec76d5-06a2-4a49-b0cb-bb0cbbeefb16 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:17.042332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec76d5-06a2-4a49-b0cb-bb0cbbeefb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:17.057183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633515b8-0139-4c91-9e0a-a6b0c4fd210f None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:17.059648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:17.063803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-acec76d5-06a2-4a49-b0cb-bb0cbbeefb16 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:17.065218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-acec76d5-06a2-4a49-b0cb-bb0cbbeefb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:17.094739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48524e05-ee40-4f5a-9564-8c912e2d9ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:17.095301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48524e05-ee40-4f5a-9564-8c912e2d9ccb None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:17.095568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48524e05-ee40-4f5a-9564-8c912e2d9ccb None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:17.095849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48524e05-ee40-4f5a-9564-8c912e2d9ccb None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:17.096528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48524e05-ee40-4f5a-9564-8c912e2d9ccb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:17.096841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48524e05-ee40-4f5a-9564-8c912e2d9ccb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:17.099071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48524e05-ee40-4f5a-9564-8c912e2d9ccb None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:17.103989 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 438/879] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Jul 30 20:45:16 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:17.150370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e08f28-afa2-4b31-abe0-f345ac0b4c5c None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:17.150596 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 442/880] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:17 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:45:17.150698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e08f28-afa2-4b31-abe0-f345ac0b4c5c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:17.150932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e08f28-afa2-4b31-abe0-f345ac0b4c5c None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:17.156068 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 439/881] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:45:17.158350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e11f3-a4f4-4425-9047-73e41db02a48 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:17.158645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e11f3-a4f4-4425-9047-73e41db02a48 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:17.158925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e11f3-a4f4-4425-9047-73e41db02a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:17.175020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e08f28-afa2-4b31-abe0-f345ac0b4c5c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:17.180521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3b0e11f3-a4f4-4425-9047-73e41db02a48 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:17.181330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3b0e11f3-a4f4-4425-9047-73e41db02a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:17.262492 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 443/882] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:17 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:17.288806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e11f3-a4f4-4425-9047-73e41db02a48 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:17.291180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:17.325240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e08f28-afa2-4b31-abe0-f345ac0b4c5c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:17.365002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932dd2d-4a99-4ebc-aee2-01bab344e807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:17.365977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932dd2d-4a99-4ebc-aee2-01bab344e807 None admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:17.366497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932dd2d-4a99-4ebc-aee2-01bab344e807 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:17.367041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932dd2d-4a99-4ebc-aee2-01bab344e807 None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:17.368131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932dd2d-4a99-4ebc-aee2-01bab344e807 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:17.370016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932dd2d-4a99-4ebc-aee2-01bab344e807 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:17.389666 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 440/883] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 30 20:45:17 2022] POST /identity/v3/services => generated 269 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:45:17.406427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e11f3-a4f4-4425-9047-73e41db02a48 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:17.453967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5e203-8d6d-4565-810c-76eb41448e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:17.454649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5e203-8d6d-4565-810c-76eb41448e4d None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:17.454963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5e203-8d6d-4565-810c-76eb41448e4d None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:17.455238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5e203-8d6d-4565-810c-76eb41448e4d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:17.468357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5e203-8d6d-4565-810c-76eb41448e4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:45:17.474184 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-b8d5e203-8d6d-4565-810c-76eb41448e4d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 30 20:45:17.474184 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:17.474184 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:17.474184 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:17.474184 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:17.474184 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:17.474184 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:17.474184 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:17.474184 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:17.474184 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:17.474184 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:17.474184 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:17.474184 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:45:17.474184 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:45:17.474184 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:45:17.474184 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:45:17.475182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:45:17.475182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:45:17.475182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:45:17.475182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:45:17.475182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:17.475182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:17.475182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:17.475182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:17.475182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:17.475182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:17.475182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:17.475182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:17.475182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:17.475182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:17.475182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:17.475182 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:17.476080 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:17.476080 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:17.476080 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:17.476080 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:17.476080 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:45:17.476080 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:45:17.476080 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:45:17.476080 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:45:17.476080 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:45:17.476080 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:45:17.476080 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 30 20:45:17.476080 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:17.476080 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 444/884] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Jul 30 20:45:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:17.484967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932dd2d-4a99-4ebc-aee2-01bab344e807 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:17.518843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:17.615728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932dd2d-4a99-4ebc-aee2-01bab344e807 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:17.659150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab852b-1300-4f67-b8a9-481a1da0c013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:17.659839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab852b-1300-4f67-b8a9-481a1da0c013 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:17.660122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab852b-1300-4f67-b8a9-481a1da0c013 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:17.660917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab852b-1300-4f67-b8a9-481a1da0c013 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:17.661643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab852b-1300-4f67-b8a9-481a1da0c013 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:17.661943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab852b-1300-4f67-b8a9-481a1da0c013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:17.663341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab852b-1300-4f67-b8a9-481a1da0c013 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:17.672331 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 441/885] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Jul 30 20:45:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:17.678694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5e203-8d6d-4565-810c-76eb41448e4d None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:17.742706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:17.786614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5e203-8d6d-4565-810c-76eb41448e4d None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:17.822542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116caf3d-c703-4f86-aa44-6cd2a2705f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:17.823197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116caf3d-c703-4f86-aa44-6cd2a2705f7c None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:17.823504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116caf3d-c703-4f86-aa44-6cd2a2705f7c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:17.823783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116caf3d-c703-4f86-aa44-6cd2a2705f7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:17.834999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116caf3d-c703-4f86-aa44-6cd2a2705f7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:17.836484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116caf3d-c703-4f86-aa44-6cd2a2705f7c None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:17.851916 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-116caf3d-c703-4f86-aa44-6cd2a2705f7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:17.851916 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:17.851916 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:17.851916 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:17.851916 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:17.851916 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:17.851916 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:17.851916 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:17.851916 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:17.851916 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:17.851916 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:17.851916 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:17.851916 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:17.851916 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:17.851916 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:17.852879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:17.852879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:17.852879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:17.852879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:17.852879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:17.852879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:17.852879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:17.852879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:17.852879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:17.852879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:17.852879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:17.852879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:17.852879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:17.852879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:17.852879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:17.852879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:17.852879 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:17.853788 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:17.853788 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:17.853788 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:17.853788 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:17.853788 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 445/886] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:17.860184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab852b-1300-4f67-b8a9-481a1da0c013 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:17.962253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:17.972323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab852b-1300-4f67-b8a9-481a1da0c013 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:18.010191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e525fe-8adb-478c-ae8c-c349318fe6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:18.010724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e525fe-8adb-478c-ae8c-c349318fe6d0 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:18.011414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e525fe-8adb-478c-ae8c-c349318fe6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:18.011620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e525fe-8adb-478c-ae8c-c349318fe6d0 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:18.012323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e525fe-8adb-478c-ae8c-c349318fe6d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:18.012630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e525fe-8adb-478c-ae8c-c349318fe6d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:18.015208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e525fe-8adb-478c-ae8c-c349318fe6d0 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:18.027245 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 442/887] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:18.037082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116caf3d-c703-4f86-aa44-6cd2a2705f7c None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:18.152893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116caf3d-c703-4f86-aa44-6cd2a2705f7c None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:18.164283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:18.191788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82367b-b3c3-4e3b-8cef-9f3718433957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:18.192851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82367b-b3c3-4e3b-8cef-9f3718433957 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:18.193361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82367b-b3c3-4e3b-8cef-9f3718433957 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:18.193909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82367b-b3c3-4e3b-8cef-9f3718433957 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:18.202258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82367b-b3c3-4e3b-8cef-9f3718433957 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:18.204125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82367b-b3c3-4e3b-8cef-9f3718433957 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:18.216431 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-6c82367b-b3c3-4e3b-8cef-9f3718433957 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 30 20:45:18.216431 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:18.216431 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:18.216431 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:18.216431 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:18.216431 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:18.216431 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:18.216431 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:18.216431 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:18.216431 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:18.216431 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:18.216431 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:18.216431 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:45:18.216431 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:45:18.216431 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:45:18.216431 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:45:18.217429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:18.217429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:18.217429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:45:18.217429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:18.217429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:45:18.217429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:18.217429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:18.217429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:18.217429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:18.217429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:18.217429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:18.217429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:18.217429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:18.217429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:18.217429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:18.217429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:18.217429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:18.217429 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:18.218441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:18.218441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:18.218441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:45:18.218441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:45:18.218441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:45:18.218441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:45:18.218441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:45:18.218441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:45:18.218441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 30 20:45:18.218441 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:18.218441 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 446/888] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Jul 30 20:45:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:18.225907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e525fe-8adb-478c-ae8c-c349318fe6d0 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:18.334415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e525fe-8adb-478c-ae8c-c349318fe6d0 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:18.371476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf47a68-9267-416c-b74c-6ea7e224a640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:18.372501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf47a68-9267-416c-b74c-6ea7e224a640 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:18.372994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf47a68-9267-416c-b74c-6ea7e224a640 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:18.373485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf47a68-9267-416c-b74c-6ea7e224a640 None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:18.374487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf47a68-9267-416c-b74c-6ea7e224a640 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:18.375070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf47a68-9267-416c-b74c-6ea7e224a640 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:18.376877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf47a68-9267-416c-b74c-6ea7e224a640 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:18.396319 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 443/889] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Jul 30 20:45:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:18.404381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82367b-b3c3-4e3b-8cef-9f3718433957 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:18.510077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82367b-b3c3-4e3b-8cef-9f3718433957 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:18.544461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504306e-cfa5-4d4a-a341-87d64f32ee85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:18.545088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504306e-cfa5-4d4a-a341-87d64f32ee85 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:18.545372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504306e-cfa5-4d4a-a341-87d64f32ee85 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:18.545650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504306e-cfa5-4d4a-a341-87d64f32ee85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:18.589973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:18.624759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504306e-cfa5-4d4a-a341-87d64f32ee85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:18.626252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504306e-cfa5-4d4a-a341-87d64f32ee85 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:18.729945 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 447/890] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:45:18 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 30 20:45:18.735583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf47a68-9267-416c-b74c-6ea7e224a640 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:18.747412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:18.766749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f21291-ae79-4fad-9a0d-6afde6e53a0d None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:18.767033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f21291-ae79-4fad-9a0d-6afde6e53a0d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:18.767232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f21291-ae79-4fad-9a0d-6afde6e53a0d None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:18.769325 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 448/891] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:45:18.774904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579abb8-5e86-40ad-91a5-4db856dc7d7b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:18.775198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579abb8-5e86-40ad-91a5-4db856dc7d7b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:18.775504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579abb8-5e86-40ad-91a5-4db856dc7d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:18.794703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6579abb8-5e86-40ad-91a5-4db856dc7d7b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:18.795968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6579abb8-5e86-40ad-91a5-4db856dc7d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:18.855590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf47a68-9267-416c-b74c-6ea7e224a640 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:18.861513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:18.871374 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 449/892] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:18.891194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579abb8-5e86-40ad-91a5-4db856dc7d7b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:18.897288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c586891-ae8a-4407-a45a-0c27a6883243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:18.898200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c586891-ae8a-4407-a45a-0c27a6883243 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:18.898693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c586891-ae8a-4407-a45a-0c27a6883243 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:18.899191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c586891-ae8a-4407-a45a-0c27a6883243 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:18.911515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c586891-ae8a-4407-a45a-0c27a6883243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:18.913308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c586891-ae8a-4407-a45a-0c27a6883243 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:18.930458 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-6c586891-ae8a-4407-a45a-0c27a6883243 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:18.930458 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:18.930458 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:18.930458 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:18.930458 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:18.930458 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:18.930458 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:18.930458 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:18.930458 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:18.930458 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:18.930458 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:18.930458 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:18.930458 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:18.930458 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:18.930458 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:18.931429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:18.931429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:18.931429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:18.931429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:18.931429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:18.931429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:18.931429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:18.931429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:18.931429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:18.931429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:18.931429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:18.931429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:18.931429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:18.931429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:18.931429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:18.931429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:18.931429 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:18.932649 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:18.932649 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:18.932649 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:18.932649 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:18.932649 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 444/893] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:18.937461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c586891-ae8a-4407-a45a-0c27a6883243 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:19.001714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579abb8-5e86-40ad-91a5-4db856dc7d7b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:19.023353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:19.043205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed92e02-9c36-41b1-a1e7-39dff54c97b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:19.044072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed92e02-9c36-41b1-a1e7-39dff54c97b4 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:19.044458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed92e02-9c36-41b1-a1e7-39dff54c97b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:19.044835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed92e02-9c36-41b1-a1e7-39dff54c97b4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:19.045568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed92e02-9c36-41b1-a1e7-39dff54c97b4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:19.047039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed92e02-9c36-41b1-a1e7-39dff54c97b4 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:19.056579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-aed92e02-9c36-41b1-a1e7-39dff54c97b4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 30 20:45:19.056579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:19.056579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:19.056579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:19.056579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:19.056579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:19.056579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:19.056579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:19.056579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 30 20:45:19.056579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:19.056579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:19.056579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:19.056579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:19.056579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:19.056579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:19.056579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:19.056579 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:19.057836 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:19.057836 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:19.057836 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:19.057836 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:19.057836 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:19.057836 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:19.057836 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:19.057836 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:19.057836 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:19.057836 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:19.057836 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:19.057836 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:19.057836 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:19.057836 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:19.057836 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:19.057836 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:19.058793 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:19.058793 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:19.058793 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:19.058793 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:19.058793 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:19.058793 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:19.058793 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:19.058793 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:19.058793 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:19.058793 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:19.058793 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:19.058793 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:19.058793 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 30 20:45:19.058793 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:19.059884 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 450/894] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:45:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:19.065464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed92e02-9c36-41b1-a1e7-39dff54c97b4 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:19.087278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c586891-ae8a-4407-a45a-0c27a6883243 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:19.131780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:19.134579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d2d96-8b0a-44b7-a78a-399305f71663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:19.135417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d2d96-8b0a-44b7-a78a-399305f71663 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:19.135812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d2d96-8b0a-44b7-a78a-399305f71663 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:19.136243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d2d96-8b0a-44b7-a78a-399305f71663 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:19.137086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d2d96-8b0a-44b7-a78a-399305f71663 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:19.137659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d2d96-8b0a-44b7-a78a-399305f71663 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:19.139043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d2d96-8b0a-44b7-a78a-399305f71663 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:19.160872 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 445/895] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:19.163569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d2d96-8b0a-44b7-a78a-399305f71663 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:19.182823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed92e02-9c36-41b1-a1e7-39dff54c97b4 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:19.219862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5ac51-9fb0-46c2-813b-ad231bd27935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:19.220906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5ac51-9fb0-46c2-813b-ad231bd27935 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:19.221408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5ac51-9fb0-46c2-813b-ad231bd27935 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:19.221926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5ac51-9fb0-46c2-813b-ad231bd27935 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:19.222819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5ac51-9fb0-46c2-813b-ad231bd27935 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:19.223461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5ac51-9fb0-46c2-813b-ad231bd27935 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:19.225045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5ac51-9fb0-46c2-813b-ad231bd27935 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:19.230588 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 451/896] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:45:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:19.238272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5ac51-9fb0-46c2-813b-ad231bd27935 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:19.293243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d2d96-8b0a-44b7-a78a-399305f71663 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:19.317846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:19.333703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b941c-060d-41b4-a160-953d6cb95863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:19.334408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b941c-060d-41b4-a160-953d6cb95863 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:19.334694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b941c-060d-41b4-a160-953d6cb95863 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:19.335025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b941c-060d-41b4-a160-953d6cb95863 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:19.342458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b941c-060d-41b4-a160-953d6cb95863 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:19.343983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b941c-060d-41b4-a160-953d6cb95863 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:19.356580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-0a6b941c-060d-41b4-a160-953d6cb95863 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:19.356580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:19.356580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:19.356580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:19.356580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:19.356580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:19.356580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:19.356580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:19.356580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:19.356580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:19.356580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:19.356580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:19.356580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:45:19.356580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:45:19.356580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:45:19.357578 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:45:19.357578 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:19.357578 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:19.357578 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:19.357578 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:19.357578 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:19.357578 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:19.357578 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:19.357578 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:19.357578 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:19.357578 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:19.357578 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:19.357578 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:19.357578 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:19.357578 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:19.357578 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:19.357578 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:19.358482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:45:19.358482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:45:19.358482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:45:19.358482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:45:19.358482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:45:19.358482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:45:19.358482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:19.358482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:19.359500 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 446/897] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:45:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:19.371340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b941c-060d-41b4-a160-953d6cb95863 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:19.374526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5ac51-9fb0-46c2-813b-ad231bd27935 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:19.410979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:19.420254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6786b-1d0f-44b7-ba93-9b33fd913a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:19.420880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6786b-1d0f-44b7-ba93-9b33fd913a8d None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:19.421165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6786b-1d0f-44b7-ba93-9b33fd913a8d None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:19.421468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6786b-1d0f-44b7-ba93-9b33fd913a8d None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:19.422154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6786b-1d0f-44b7-ba93-9b33fd913a8d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:19.422462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6786b-1d0f-44b7-ba93-9b33fd913a8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:19.423932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6786b-1d0f-44b7-ba93-9b33fd913a8d None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:19.431462 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 452/898] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:45:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:19.432745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af57b4-c4d9-4e95-aff0-ccd4fb3e84f3 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:19.433039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af57b4-c4d9-4e95-aff0-ccd4fb3e84f3 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:19.433324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af57b4-c4d9-4e95-aff0-ccd4fb3e84f3 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:19.438361 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 453/899] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:19.439575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af57b4-c4d9-4e95-aff0-ccd4fb3e84f3 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:19.493458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b941c-060d-41b4-a160-953d6cb95863 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:19.530150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17c3a8-7289-4fcc-a77c-e23c1fc1688e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:19.530932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17c3a8-7289-4fcc-a77c-e23c1fc1688e None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:19.531222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17c3a8-7289-4fcc-a77c-e23c1fc1688e None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:19.531537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17c3a8-7289-4fcc-a77c-e23c1fc1688e None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:19.532293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17c3a8-7289-4fcc-a77c-e23c1fc1688e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:19.532607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17c3a8-7289-4fcc-a77c-e23c1fc1688e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:19.534063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17c3a8-7289-4fcc-a77c-e23c1fc1688e None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:19.553062 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 447/900] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:45:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:19.553062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b794b4c-85e0-4940-b620-d3e50c6206a4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:19.553062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b794b4c-85e0-4940-b620-d3e50c6206a4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:19.553062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b794b4c-85e0-4940-b620-d3e50c6206a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:19.554348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af57b4-c4d9-4e95-aff0-ccd4fb3e84f3 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:19.569845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5b794b4c-85e0-4940-b620-d3e50c6206a4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:19.571039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5b794b4c-85e0-4940-b620-d3e50c6206a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:19.589844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72774802-bea7-4f66-8060-7da9c7a5bdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:19.590467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72774802-bea7-4f66-8060-7da9c7a5bdce None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:19.590745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72774802-bea7-4f66-8060-7da9c7a5bdce None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:19.591018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72774802-bea7-4f66-8060-7da9c7a5bdce None admin] PATH_INFO: `/v3/endpoints` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:19.591787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72774802-bea7-4f66-8060-7da9c7a5bdce None admin] RBAC: Adding query filter params (interface=public, service_id=3cc5f63c5e3841a09bad7a3d8dd32457, region_id=RegionOne) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:19.592098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72774802-bea7-4f66-8060-7da9c7a5bdce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:19.593458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72774802-bea7-4f66-8060-7da9c7a5bdce None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:19.599756 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 454/901] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Jul 30 20:45:19 2022] GET /identity/v3/endpoints?service_id=3cc5f63c5e3841a09bad7a3d8dd32457&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:19.600428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72774802-bea7-4f66-8060-7da9c7a5bdce None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:19.612234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:19.652377 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 448/902] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:19.656158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b794b4c-85e0-4940-b620-d3e50c6206a4 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:19.673392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:19.720199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72774802-bea7-4f66-8060-7da9c7a5bdce None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:19.752962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512be2f6-f72e-4994-a6e5-854a1da1f15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:19.753580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512be2f6-f72e-4994-a6e5-854a1da1f15d None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:19.753859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512be2f6-f72e-4994-a6e5-854a1da1f15d None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:19.754652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512be2f6-f72e-4994-a6e5-854a1da1f15d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:19.755453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512be2f6-f72e-4994-a6e5-854a1da1f15d None admin] RBAC: Adding query filter params (role.id=eac828dd4fbe49b8807c54ed514b5095, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=877b427e6ff84af29a59dc9e1a3128ef) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:19.755761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512be2f6-f72e-4994-a6e5-854a1da1f15d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:19.757190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512be2f6-f72e-4994-a6e5-854a1da1f15d None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:19.771317 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 455/903] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:45:19 2022] GET /identity/v3/role_assignments?user.id=877b427e6ff84af29a59dc9e1a3128ef&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=eac828dd4fbe49b8807c54ed514b5095 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:19.771317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512be2f6-f72e-4994-a6e5-854a1da1f15d None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:19.772134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b794b4c-85e0-4940-b620-d3e50c6206a4 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:19.824139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc6fb9-5374-4f9b-9847-182e4ccf6360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:19.824864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc6fb9-5374-4f9b-9847-182e4ccf6360 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:19.825203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc6fb9-5374-4f9b-9847-182e4ccf6360 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:19.825482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc6fb9-5374-4f9b-9847-182e4ccf6360 None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:19.826165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc6fb9-5374-4f9b-9847-182e4ccf6360 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:19.828449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc6fb9-5374-4f9b-9847-182e4ccf6360 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:19.843518 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 449/904] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Jul 30 20:45:19 2022] GET /identity/v3/services => generated 1268 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 20:45:19.904016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512be2f6-f72e-4994-a6e5-854a1da1f15d None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:19.928892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:19.947455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582952fc-8342-41b9-ba12-f8d961156de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:19.948112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582952fc-8342-41b9-ba12-f8d961156de1 None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:19.948395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582952fc-8342-41b9-ba12-f8d961156de1 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:19.948668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582952fc-8342-41b9-ba12-f8d961156de1 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:19.949380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582952fc-8342-41b9-ba12-f8d961156de1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:19.950859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582952fc-8342-41b9-ba12-f8d961156de1 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:19.970625 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 456/905] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 30 20:45:19 2022] POST /identity/v3/services => generated 241 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:45:19.979475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f48fe-443c-4f6e-a79b-62bb77d9b82a None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:19.979828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f48fe-443c-4f6e-a79b-62bb77d9b82a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:19.980045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f48fe-443c-4f6e-a79b-62bb77d9b82a None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:19.981800 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 450/906] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:19.988120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b32dce-4a72-4c3f-8f6b-6c1620b5cb0e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:19.989333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b32dce-4a72-4c3f-8f6b-6c1620b5cb0e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:19.989626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b32dce-4a72-4c3f-8f6b-6c1620b5cb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:20.010934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-12b32dce-4a72-4c3f-8f6b-6c1620b5cb0e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:20.013655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-12b32dce-4a72-4c3f-8f6b-6c1620b5cb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:20.103101 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 457/907] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:45:20.128497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f48fe-443c-4f6e-a79b-62bb77d9b82a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:20.178404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:20.251210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f48fe-443c-4f6e-a79b-62bb77d9b82a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:20.287084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618843b-2b79-4430-b7cb-e9f00244c282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:20.287776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618843b-2b79-4430-b7cb-e9f00244c282 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:20.288061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618843b-2b79-4430-b7cb-e9f00244c282 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:20.288338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618843b-2b79-4430-b7cb-e9f00244c282 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:20.288965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618843b-2b79-4430-b7cb-e9f00244c282 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:20.290460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618843b-2b79-4430-b7cb-e9f00244c282 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:20.300117 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-4618843b-2b79-4430-b7cb-e9f00244c282 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 30 20:45:20.300117 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:20.300117 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:20.300117 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:20.300117 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:20.300117 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:20.300117 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:20.300117 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:20.300117 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 30 20:45:20.300117 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:20.300117 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:20.300117 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:20.300117 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:20.300117 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:20.300117 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:20.300117 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:20.302034 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:20.302034 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:20.302034 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:20.302034 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:20.302034 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:20.302034 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:20.302034 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:20.302034 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:20.302034 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:20.302034 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:20.302034 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:20.302034 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:20.302034 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:20.302034 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:20.302034 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:20.302034 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:20.302855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:20.302855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:20.302855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:20.302855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:20.302855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:20.302855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:20.302855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:20.302855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:20.302855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:20.302855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:20.302855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:20.302855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:20.302855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:20.302855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 30 20:45:20.302855 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:20.302855 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 451/908] 10.222.0.17 () {56 vars in 1132 bytes} [Sat Jul 30 20:45:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:20.309211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b32dce-4a72-4c3f-8f6b-6c1620b5cb0e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:20.418933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b32dce-4a72-4c3f-8f6b-6c1620b5cb0e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:20.426656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:20.455482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf45144-9c1c-4e1b-b092-4e09b6e5f262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:20.456117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf45144-9c1c-4e1b-b092-4e09b6e5f262 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:20.456403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf45144-9c1c-4e1b-b092-4e09b6e5f262 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:20.456681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf45144-9c1c-4e1b-b092-4e09b6e5f262 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:20.457429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf45144-9c1c-4e1b-b092-4e09b6e5f262 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:20.457737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf45144-9c1c-4e1b-b092-4e09b6e5f262 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:20.459107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf45144-9c1c-4e1b-b092-4e09b6e5f262 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:20.464293 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 458/909] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 30 20:45:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:20.472648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618843b-2b79-4430-b7cb-e9f00244c282 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:20.577053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:20.580671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618843b-2b79-4430-b7cb-e9f00244c282 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:20.616108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff76937-e215-4448-b652-a93005c5b761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:20.616744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff76937-e215-4448-b652-a93005c5b761 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:20.617024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff76937-e215-4448-b652-a93005c5b761 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:20.617297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff76937-e215-4448-b652-a93005c5b761 None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:20.617979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff76937-e215-4448-b652-a93005c5b761 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:20.618278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff76937-e215-4448-b652-a93005c5b761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:20.619675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff76937-e215-4448-b652-a93005c5b761 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:20.625469 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 452/910] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 30 20:45:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:20.633116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf45144-9c1c-4e1b-b092-4e09b6e5f262 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:20.734939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf45144-9c1c-4e1b-b092-4e09b6e5f262 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:20.775261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ade6e-9557-48f3-b052-40d2259e0259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:20.775928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ade6e-9557-48f3-b052-40d2259e0259 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:20.776215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ade6e-9557-48f3-b052-40d2259e0259 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:20.776496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ade6e-9557-48f3-b052-40d2259e0259 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:20.777256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ade6e-9557-48f3-b052-40d2259e0259 None admin] RBAC: Adding query filter params (interface=public, service_id=262f0e9aac5a4eacbc278017d603b859, region_id=RegionOne) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:20.777569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ade6e-9557-48f3-b052-40d2259e0259 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:20.778958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ade6e-9557-48f3-b052-40d2259e0259 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:20.784389 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 459/911] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Jul 30 20:45:20 2022] GET /identity/v3/endpoints?service_id=262f0e9aac5a4eacbc278017d603b859&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:20.789851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff76937-e215-4448-b652-a93005c5b761 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:20.898209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff76937-e215-4448-b652-a93005c5b761 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:20.932400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35b57e-8150-4b97-a8d3-8174566da4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:20.933065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35b57e-8150-4b97-a8d3-8174566da4a2 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:20.933348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35b57e-8150-4b97-a8d3-8174566da4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:20.933672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35b57e-8150-4b97-a8d3-8174566da4a2 None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:20.934327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35b57e-8150-4b97-a8d3-8174566da4a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:20.935719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35b57e-8150-4b97-a8d3-8174566da4a2 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:20.942583 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 453/912] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Jul 30 20:45:20 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 20:45:22.149681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6822de3-41ff-47b2-8c59-1162f284848a None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:22.150258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6822de3-41ff-47b2-8c59-1162f284848a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:22.150258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6822de3-41ff-47b2-8c59-1162f284848a None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:22.151989 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 460/913] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:22.157383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e179d7-467c-4516-aa95-72c4f096df42 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:22.157796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e179d7-467c-4516-aa95-72c4f096df42 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:22.157952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e179d7-467c-4516-aa95-72c4f096df42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:22.177598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-46e179d7-467c-4516-aa95-72c4f096df42 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:22.178897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-46e179d7-467c-4516-aa95-72c4f096df42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:22.179910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb7c39-9ef8-44e6-afc4-0ccdb73d562a None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:22.180281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb7c39-9ef8-44e6-afc4-0ccdb73d562a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:22.180615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb7c39-9ef8-44e6-afc4-0ccdb73d562a None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:22.183467 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 461/914] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:45:22.188487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0df1f-0d85-46de-aeff-430051ab25ad None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:22.188777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0df1f-0d85-46de-aeff-430051ab25ad None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:22.189059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0df1f-0d85-46de-aeff-430051ab25ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:22.202627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:22.215965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-eec0df1f-0d85-46de-aeff-430051ab25ad None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:22.217443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-eec0df1f-0d85-46de-aeff-430051ab25ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:22.249251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:22.264559 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 454/915] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:22.294039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e179d7-467c-4516-aa95-72c4f096df42 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:22.302239 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 462/916] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:22.324917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0df1f-0d85-46de-aeff-430051ab25ad None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:22.411010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e179d7-467c-4516-aa95-72c4f096df42 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:22.427762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0df1f-0d85-46de-aeff-430051ab25ad None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:22.447168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f76cfa-8232-4197-aac8-b522bc4f34db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:22.447847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f76cfa-8232-4197-aac8-b522bc4f34db None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:22.448133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f76cfa-8232-4197-aac8-b522bc4f34db None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:22.448409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f76cfa-8232-4197-aac8-b522bc4f34db None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:22.449470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f76cfa-8232-4197-aac8-b522bc4f34db None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:22.451088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f76cfa-8232-4197-aac8-b522bc4f34db None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:22.460723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-b8f76cfa-8232-4197-aac8-b522bc4f34db None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 30 20:45:22.460723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:22.460723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:22.460723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:22.460723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:22.460723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:22.460723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:22.460723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:22.460723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 30 20:45:22.460723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:22.460723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:22.460723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:22.460723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:22.460723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:22.460723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:22.460723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:22.460723 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:22.461726 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:22.461726 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:22.461726 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:22.461726 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:22.461726 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:22.461726 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:22.461726 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:22.461726 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:22.461726 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:22.461726 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:22.461726 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:22.461726 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:22.461726 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:22.461726 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:22.461726 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:22.461726 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:22.462596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:22.462596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:22.462596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:22.462596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:22.462596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:22.462596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:22.462596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:22.462596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:22.462596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:22.462596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:22.462596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:22.462596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:22.462596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 30 20:45:22.462596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:22.462596 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 455/917] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:45:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:22.463457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a69ca-5803-41ec-8d0d-0a22a2d4e637 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:22.463457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a69ca-5803-41ec-8d0d-0a22a2d4e637 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:22.464192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a69ca-5803-41ec-8d0d-0a22a2d4e637 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:22.464824 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 456/918] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:22.468923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a69ca-5803-41ec-8d0d-0a22a2d4e637 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:22.470409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458153b-e976-4415-ad55-b1676ae159cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:22.471202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458153b-e976-4415-ad55-b1676ae159cb None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:22.471524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458153b-e976-4415-ad55-b1676ae159cb None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:22.471809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458153b-e976-4415-ad55-b1676ae159cb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:22.482787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458153b-e976-4415-ad55-b1676ae159cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:45:22.487681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-c458153b-e976-4415-ad55-b1676ae159cb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 30 20:45:22.487681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:22.487681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:22.487681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:22.487681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:22.487681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:22.487681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:22.487681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:22.487681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:22.487681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:22.487681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:22.487681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:22.487681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:45:22.487681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:45:22.487681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:45:22.487681 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:45:22.489169 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:45:22.489169 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:45:22.489169 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:45:22.489169 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:45:22.489169 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:22.489169 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:22.489169 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:22.489169 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:22.489169 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:22.489169 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:22.489169 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:22.489169 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:22.489169 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:22.489169 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:22.489169 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:22.489169 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:22.490021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:22.490021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:22.490021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:22.490021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:22.490021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:45:22.490021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:45:22.490021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:45:22.490021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:45:22.490021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:45:22.490021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:45:22.490021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 30 20:45:22.490021 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:22.490021 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 463/919] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Jul 30 20:45:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:22.490711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90d826-d363-4021-8bc7-ecd79dcae498 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:22.491265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90d826-d363-4021-8bc7-ecd79dcae498 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:22.491265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90d826-d363-4021-8bc7-ecd79dcae498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:22.498420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:22.510068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8e90d826-d363-4021-8bc7-ecd79dcae498 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:22.511210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8e90d826-d363-4021-8bc7-ecd79dcae498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:22.531105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:22.587100 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 464/920] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:22.588334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90d826-d363-4021-8bc7-ecd79dcae498 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:22.596187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a69ca-5803-41ec-8d0d-0a22a2d4e637 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:22.633699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc591e6-a5e1-4f26-8c7f-de06dc070fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:22.634421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc591e6-a5e1-4f26-8c7f-de06dc070fe8 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:22.634704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc591e6-a5e1-4f26-8c7f-de06dc070fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:22.634974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc591e6-a5e1-4f26-8c7f-de06dc070fe8 None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:22.635676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc591e6-a5e1-4f26-8c7f-de06dc070fe8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:22.635978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc591e6-a5e1-4f26-8c7f-de06dc070fe8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:22.637380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc591e6-a5e1-4f26-8c7f-de06dc070fe8 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:22.642074 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 457/921] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:45:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:22.642074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc591e6-a5e1-4f26-8c7f-de06dc070fe8 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:22.710530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90d826-d363-4021-8bc7-ecd79dcae498 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:22.739889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:22.747596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a77c8-89d6-43f1-a2e8-224c31fba420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:22.748117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a77c8-89d6-43f1-a2e8-224c31fba420 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:22.748458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a77c8-89d6-43f1-a2e8-224c31fba420 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:22.748741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a77c8-89d6-43f1-a2e8-224c31fba420 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:22.749454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a77c8-89d6-43f1-a2e8-224c31fba420 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:22.749760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a77c8-89d6-43f1-a2e8-224c31fba420 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:22.751179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a77c8-89d6-43f1-a2e8-224c31fba420 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:22.757843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc591e6-a5e1-4f26-8c7f-de06dc070fe8 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:22.769508 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 465/922] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Jul 30 20:45:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:22.772207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a77c8-89d6-43f1-a2e8-224c31fba420 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:22.793089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:22.805627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549974f9-8a7a-44c7-8d74-9f80eb42e8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:22.806614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549974f9-8a7a-44c7-8d74-9f80eb42e8f5 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:22.806910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549974f9-8a7a-44c7-8d74-9f80eb42e8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:22.807473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549974f9-8a7a-44c7-8d74-9f80eb42e8f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:22.808680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549974f9-8a7a-44c7-8d74-9f80eb42e8f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:22.810600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549974f9-8a7a-44c7-8d74-9f80eb42e8f5 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:22.820924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-549974f9-8a7a-44c7-8d74-9f80eb42e8f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 30 20:45:22.820924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:22.820924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:22.820924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:22.820924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:22.820924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:22.820924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:22.820924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:22.820924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 30 20:45:22.820924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:22.820924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:22.820924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:22.820924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:22.820924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:22.820924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:22.820924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:22.820924 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:22.821956 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:22.821956 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:22.821956 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:22.821956 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:22.821956 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:22.821956 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:22.821956 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:22.821956 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:22.821956 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:22.821956 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:22.821956 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:22.821956 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:22.821956 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:22.821956 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:22.821956 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:22.821956 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:22.822913 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:22.822913 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:22.822913 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:22.822913 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:22.822913 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:22.822913 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:22.822913 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:22.822913 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:22.822913 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:22.822913 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:22.822913 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:22.822913 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:22.822913 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 30 20:45:22.822913 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:22.822913 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 458/923] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 30 20:45:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:22.823757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549974f9-8a7a-44c7-8d74-9f80eb42e8f5 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:22.889195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a77c8-89d6-43f1-a2e8-224c31fba420 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:22.923761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549974f9-8a7a-44c7-8d74-9f80eb42e8f5 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:22.925557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329578f6-0b9e-4886-9b15-08f5195a93e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:22.926812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329578f6-0b9e-4886-9b15-08f5195a93e2 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:22.927092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329578f6-0b9e-4886-9b15-08f5195a93e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:22.927401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329578f6-0b9e-4886-9b15-08f5195a93e2 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:22.928079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329578f6-0b9e-4886-9b15-08f5195a93e2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:22.928382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329578f6-0b9e-4886-9b15-08f5195a93e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:22.929747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329578f6-0b9e-4886-9b15-08f5195a93e2 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:22.939402 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 466/924] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 30 20:45:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:22.939402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329578f6-0b9e-4886-9b15-08f5195a93e2 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:22.964869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3393d-c183-4380-8224-493448b5eead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:22.965519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3393d-c183-4380-8224-493448b5eead None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:22.965802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3393d-c183-4380-8224-493448b5eead None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:22.966081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3393d-c183-4380-8224-493448b5eead None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:22.976711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3393d-c183-4380-8224-493448b5eead None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:22.978196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3393d-c183-4380-8224-493448b5eead None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:22.986613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:22.994430 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-b7a3393d-c183-4380-8224-493448b5eead None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:22.994430 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:22.994430 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:22.994430 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:22.994430 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:22.994430 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:22.994430 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:22.994430 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:22.994430 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:22.994430 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:22.994430 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:22.994430 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:22.994430 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:22.994430 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:22.994430 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:22.995659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:22.995659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:22.995659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:22.995659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:22.995659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:22.995659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:22.995659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:22.995659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:22.995659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:22.995659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:22.995659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:22.995659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:22.995659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:22.995659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:22.995659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:22.995659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:22.995659 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:22.996574 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:22.996574 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:22.996574 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:22.996574 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:22.999324 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 459/925] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:22.999893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3393d-c183-4380-8224-493448b5eead None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:23.039660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:23.061038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329578f6-0b9e-4886-9b15-08f5195a93e2 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:23.096724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2435a0-8eba-4d39-90e5-93f04054623c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:23.097353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2435a0-8eba-4d39-90e5-93f04054623c None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:23.097633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2435a0-8eba-4d39-90e5-93f04054623c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:23.098520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2435a0-8eba-4d39-90e5-93f04054623c None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:23.099201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2435a0-8eba-4d39-90e5-93f04054623c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:23.099727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2435a0-8eba-4d39-90e5-93f04054623c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:23.101105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2435a0-8eba-4d39-90e5-93f04054623c None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:23.111019 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 467/926] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Jul 30 20:45:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:23.111019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2435a0-8eba-4d39-90e5-93f04054623c None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:23.126822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3393d-c183-4380-8224-493448b5eead None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:23.167799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2636a8-4837-4d14-b4dd-2e7da8f31c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:23.168483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2636a8-4837-4d14-b4dd-2e7da8f31c0d None admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:23.168733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2636a8-4837-4d14-b4dd-2e7da8f31c0d None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:23.168977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2636a8-4837-4d14-b4dd-2e7da8f31c0d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:23.169689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2636a8-4837-4d14-b4dd-2e7da8f31c0d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:23.171065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2636a8-4837-4d14-b4dd-2e7da8f31c0d None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:23.193567 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 460/927] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 20:45:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:45:23.194686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2636a8-4837-4d14-b4dd-2e7da8f31c0d None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:23.236027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2435a0-8eba-4d39-90e5-93f04054623c None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:23.282729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2761215-1279-46a3-b9ba-284d06d72f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:23.283400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2761215-1279-46a3-b9ba-284d06d72f51 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:23.283680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2761215-1279-46a3-b9ba-284d06d72f51 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:23.283954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2761215-1279-46a3-b9ba-284d06d72f51 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:23.284661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2761215-1279-46a3-b9ba-284d06d72f51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:23.284962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2761215-1279-46a3-b9ba-284d06d72f51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:23.287118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2761215-1279-46a3-b9ba-284d06d72f51 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:23.292480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:23.297102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:23.301076 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 468/928] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:23.302463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730caec-14e4-4c69-9551-90e770dc3ed9 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:23.302764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730caec-14e4-4c69-9551-90e770dc3ed9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:23.303046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730caec-14e4-4c69-9551-90e770dc3ed9 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:23.308827 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 469/929] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:23.308827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730caec-14e4-4c69-9551-90e770dc3ed9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:23.355586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2636a8-4837-4d14-b4dd-2e7da8f31c0d None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:23.391724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ccf41-3014-4dcf-a9bc-091721233c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:23.392864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ccf41-3014-4dcf-a9bc-091721233c0f None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:23.392864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ccf41-3014-4dcf-a9bc-091721233c0f None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:23.392864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ccf41-3014-4dcf-a9bc-091721233c0f None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:23.393549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ccf41-3014-4dcf-a9bc-091721233c0f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:23.393866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ccf41-3014-4dcf-a9bc-091721233c0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:23.395269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ccf41-3014-4dcf-a9bc-091721233c0f None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:23.405375 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 461/930] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Jul 30 20:45:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:23.405375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36c9d4-0b9e-47ef-8a4e-e986328a0793 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:23.405375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36c9d4-0b9e-47ef-8a4e-e986328a0793 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:23.405375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36c9d4-0b9e-47ef-8a4e-e986328a0793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:23.424929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ac36c9d4-0b9e-47ef-8a4e-e986328a0793 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:23.426401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ac36c9d4-0b9e-47ef-8a4e-e986328a0793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:23.433479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730caec-14e4-4c69-9551-90e770dc3ed9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:23.471586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84773bf-8113-4763-8295-8a7733046373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:23.472228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84773bf-8113-4763-8295-8a7733046373 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:23.472510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84773bf-8113-4763-8295-8a7733046373 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:23.473305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84773bf-8113-4763-8295-8a7733046373 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:23.482878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84773bf-8113-4763-8295-8a7733046373 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:23.484867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84773bf-8113-4763-8295-8a7733046373 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:23.498200 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-b84773bf-8113-4763-8295-8a7733046373 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 30 20:45:23.498200 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:23.498200 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:23.498200 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:23.498200 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:23.498200 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:23.498200 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:23.498200 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:23.498200 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:23.498200 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:23.498200 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:23.498200 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:23.498200 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:45:23.498200 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:45:23.498200 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:45:23.498200 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:45:23.499155 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:23.499155 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:23.499155 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:45:23.499155 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:23.499155 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:45:23.499155 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:23.499155 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:23.499155 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:23.499155 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:23.499155 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:23.499155 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:23.499155 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:23.499155 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:23.499155 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:23.499155 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:23.499155 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:23.499155 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:23.499155 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:23.500149 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:23.500149 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:23.500149 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:45:23.500149 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:45:23.500149 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:45:23.500149 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:45:23.500149 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:45:23.500149 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:45:23.500149 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 30 20:45:23.500149 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:23.500678 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 470/931] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Jul 30 20:45:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:23.501307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84773bf-8113-4763-8295-8a7733046373 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:23.505042 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 462/932] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:23.505042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36c9d4-0b9e-47ef-8a4e-e986328a0793 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:23.561079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:23.573938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:23.615864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36c9d4-0b9e-47ef-8a4e-e986328a0793 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:23.618462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84773bf-8113-4763-8295-8a7733046373 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:23.654204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f675a85-29a2-4b6f-b1fa-1ee8a7b21dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:23.654726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecd67a-a4cb-4855-9e5d-4074b0ce6c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:23.654846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f675a85-29a2-4b6f-b1fa-1ee8a7b21dd9 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:23.655093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f675a85-29a2-4b6f-b1fa-1ee8a7b21dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:23.655395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f675a85-29a2-4b6f-b1fa-1ee8a7b21dd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:23.655519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecd67a-a4cb-4855-9e5d-4074b0ce6c3a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:23.655678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecd67a-a4cb-4855-9e5d-4074b0ce6c3a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:23.655959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecd67a-a4cb-4855-9e5d-4074b0ce6c3a None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:23.656150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f675a85-29a2-4b6f-b1fa-1ee8a7b21dd9 None admin] RBAC: Adding query filter params (interface=public, service_id=2945d3e266bb4c6da94ec123f2c39ff5, region_id=RegionOne) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:23.656566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f675a85-29a2-4b6f-b1fa-1ee8a7b21dd9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:23.656755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecd67a-a4cb-4855-9e5d-4074b0ce6c3a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:23.657063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecd67a-a4cb-4855-9e5d-4074b0ce6c3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:23.657898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f675a85-29a2-4b6f-b1fa-1ee8a7b21dd9 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:23.658493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecd67a-a4cb-4855-9e5d-4074b0ce6c3a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:23.668272 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 471/933] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Jul 30 20:45:23 2022] GET /identity/v3/endpoints?service_id=2945d3e266bb4c6da94ec123f2c39ff5&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:23.668272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f675a85-29a2-4b6f-b1fa-1ee8a7b21dd9 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:23.680298 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 463/934] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Jul 30 20:45:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:23.681134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecd67a-a4cb-4855-9e5d-4074b0ce6c3a None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:23.789036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecd67a-a4cb-4855-9e5d-4074b0ce6c3a None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:23.793825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f675a85-29a2-4b6f-b1fa-1ee8a7b21dd9 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:23.798237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:23.819955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:23.827896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa039957-afc3-4586-b233-8d632144d480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:23.828556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa039957-afc3-4586-b233-8d632144d480 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:23.828822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa039957-afc3-4586-b233-8d632144d480 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:23.829154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa039957-afc3-4586-b233-8d632144d480 None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:23.829819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa039957-afc3-4586-b233-8d632144d480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:23.831240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa039957-afc3-4586-b233-8d632144d480 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:23.831618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96856ca-a79e-44a4-8af0-ec242ba0d353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:23.832842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96856ca-a79e-44a4-8af0-ec242ba0d353 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:23.833198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96856ca-a79e-44a4-8af0-ec242ba0d353 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:23.833387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96856ca-a79e-44a4-8af0-ec242ba0d353 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:23.834005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96856ca-a79e-44a4-8af0-ec242ba0d353 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:23.835391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96856ca-a79e-44a4-8af0-ec242ba0d353 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:23.838064 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 464/935] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Jul 30 20:45:23 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 20:45:23.838805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa039957-afc3-4586-b233-8d632144d480 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:23.856177 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-f96856ca-a79e-44a4-8af0-ec242ba0d353 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 30 20:45:23.856177 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:23.856177 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:23.856177 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:23.856177 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:23.856177 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:23.856177 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:23.856177 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:23.856177 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 30 20:45:23.856177 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:23.856177 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:23.856177 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:23.856177 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:23.856177 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:23.856177 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:23.856177 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:23.857231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:23.857231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:23.857231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:23.857231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:23.857231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:23.857231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:23.857231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:23.857231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:23.857231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:23.857231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:23.857231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:23.857231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:23.857231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:23.857231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:23.857231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:23.857231 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:23.858071 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:23.858071 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:23.858071 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:23.858071 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:23.858071 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:23.858071 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:23.858071 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:23.858071 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:23.858071 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:23.858071 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:23.858071 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:23.858071 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:23.858071 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:23.858071 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 30 20:45:23.858071 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:23.860757 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 472/936] 10.222.0.17 () {56 vars in 1132 bytes} [Sat Jul 30 20:45:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:23.867534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96856ca-a79e-44a4-8af0-ec242ba0d353 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:23.963619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa039957-afc3-4586-b233-8d632144d480 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:24.014442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9b833-fc33-4fa1-9a15-0577cf5a880d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:24.014882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96856ca-a79e-44a4-8af0-ec242ba0d353 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:24.015442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9b833-fc33-4fa1-9a15-0577cf5a880d None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:24.015830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9b833-fc33-4fa1-9a15-0577cf5a880d None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:24.017254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9b833-fc33-4fa1-9a15-0577cf5a880d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:24.030627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9b833-fc33-4fa1-9a15-0577cf5a880d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:24.032128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9b833-fc33-4fa1-9a15-0577cf5a880d None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:24.049819 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-c5c9b833-fc33-4fa1-9a15-0577cf5a880d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:24.049819 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:24.049819 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:24.049819 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:24.049819 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:24.049819 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:24.049819 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:24.049819 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:24.049819 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:24.049819 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:24.049819 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:24.049819 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:24.049819 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:24.049819 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:24.049819 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:24.051269 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:24.051269 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:24.051269 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:24.051269 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:24.051269 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:24.051269 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:24.051269 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:24.051269 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:24.051269 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:24.051269 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:24.051269 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:24.051269 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:24.051269 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:24.051269 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:24.051269 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:24.051269 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:24.051269 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:24.052486 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:24.052486 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:24.052486 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:24.052486 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:24.052486 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 465/937] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:24.059780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9b833-fc33-4fa1-9a15-0577cf5a880d None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:24.059931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee052a-838a-41b4-85fd-0612bfb0f57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:24.060559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee052a-838a-41b4-85fd-0612bfb0f57e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:24.060836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee052a-838a-41b4-85fd-0612bfb0f57e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:24.061110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee052a-838a-41b4-85fd-0612bfb0f57e None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:24.061785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee052a-838a-41b4-85fd-0612bfb0f57e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:24.062086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee052a-838a-41b4-85fd-0612bfb0f57e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:24.063491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee052a-838a-41b4-85fd-0612bfb0f57e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:24.069090 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 473/938] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 30 20:45:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:24.075270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee052a-838a-41b4-85fd-0612bfb0f57e None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:24.091650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:24.139125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:24.187196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9b833-fc33-4fa1-9a15-0577cf5a880d None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:24.193198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee052a-838a-41b4-85fd-0612bfb0f57e None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:24.227935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cdbec-d13b-4743-9d8b-ce7a3709c47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:24.228564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cdbec-d13b-4743-9d8b-ce7a3709c47d None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:24.228855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cdbec-d13b-4743-9d8b-ce7a3709c47d None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:24.229137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cdbec-d13b-4743-9d8b-ce7a3709c47d None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:24.229837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cdbec-d13b-4743-9d8b-ce7a3709c47d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:24.230146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cdbec-d13b-4743-9d8b-ce7a3709c47d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:24.231542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cdbec-d13b-4743-9d8b-ce7a3709c47d None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:24.232305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d17005-871e-416e-8134-c31268f6d527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:24.233286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d17005-871e-416e-8134-c31268f6d527 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:24.233861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d17005-871e-416e-8134-c31268f6d527 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:24.234335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d17005-871e-416e-8134-c31268f6d527 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:24.235203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d17005-871e-416e-8134-c31268f6d527 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:24.235727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d17005-871e-416e-8134-c31268f6d527 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:24.237290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d17005-871e-416e-8134-c31268f6d527 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:24.243780 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 474/939] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 30 20:45:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:24.244306 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 466/940] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:24.249683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d17005-871e-416e-8134-c31268f6d527 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:24.249942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cdbec-d13b-4743-9d8b-ce7a3709c47d None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:24.348146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:24.361921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d17005-871e-416e-8134-c31268f6d527 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:24.365838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cdbec-d13b-4743-9d8b-ce7a3709c47d None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:24.381045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:24.402132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fc7d4-9911-4208-ba06-b928b1994114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:24.403146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fc7d4-9911-4208-ba06-b928b1994114 None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:24.403983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fc7d4-9911-4208-ba06-b928b1994114 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:24.404596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fc7d4-9911-4208-ba06-b928b1994114 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:24.405841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fc7d4-9911-4208-ba06-b928b1994114 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:24.406972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f47e0f-15c9-4232-80b2-3de6bcd98e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:24.407683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f47e0f-15c9-4232-80b2-3de6bcd98e23 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:24.407984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f47e0f-15c9-4232-80b2-3de6bcd98e23 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:24.408247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f47e0f-15c9-4232-80b2-3de6bcd98e23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:24.408596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fc7d4-9911-4208-ba06-b928b1994114 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:24.416301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f47e0f-15c9-4232-80b2-3de6bcd98e23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:24.417786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f47e0f-15c9-4232-80b2-3de6bcd98e23 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:24.431177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-86f47e0f-15c9-4232-80b2-3de6bcd98e23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:24.431177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:24.431177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:24.431177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:24.431177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:24.431177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:24.431177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:24.431177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:24.431177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:24.431177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:24.431177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:24.431177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:24.431177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:45:24.431177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:45:24.431177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:45:24.432204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:45:24.432204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:24.432204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:24.432204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:24.432204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:24.432204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:24.432204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:24.432204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:24.432204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:24.432204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:24.432204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:24.432204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:24.432204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:24.432204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:24.432204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:24.432204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:24.432204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:24.433177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:45:24.433177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:45:24.433177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:45:24.433177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:45:24.433177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:45:24.433177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:45:24.433177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:24.433177 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:24.437309 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 467/941] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:45:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:24.438179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f47e0f-15c9-4232-80b2-3de6bcd98e23 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:24.439415 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 475/942] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 20:45:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 20:45:24.561285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f47e0f-15c9-4232-80b2-3de6bcd98e23 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:24.607716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1c745-5e7d-4338-9672-e45a00eca2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:24.608314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1c745-5e7d-4338-9672-e45a00eca2ef None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:24.608624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1c745-5e7d-4338-9672-e45a00eca2ef None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:24.608893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1c745-5e7d-4338-9672-e45a00eca2ef None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:24.609647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1c745-5e7d-4338-9672-e45a00eca2ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:24.609955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1c745-5e7d-4338-9672-e45a00eca2ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:24.612184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1c745-5e7d-4338-9672-e45a00eca2ef None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:24.622001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:24.625998 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 468/943] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:45:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:24.633467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fc7d4-9911-4208-ba06-b928b1994114 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:24.757376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fc7d4-9911-4208-ba06-b928b1994114 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:24.791123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e6f29-5693-4e1d-9239-89d0ac592e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:24.791856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e6f29-5693-4e1d-9239-89d0ac592e7c None admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:24.792138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e6f29-5693-4e1d-9239-89d0ac592e7c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:24.792420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e6f29-5693-4e1d-9239-89d0ac592e7c None admin] PATH_INFO: `/v3/projects/ec96772eef284ab3913f9628b136be7a/users/877b427e6ff84af29a59dc9e1a3128ef/roles/eac828dd4fbe49b8807c54ed514b5095` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:24.794619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e6f29-5693-4e1d-9239-89d0ac592e7c None admin] RBAC: Authorizing `identity:create_grant(project_id=ec96772eef284ab3913f9628b136be7a, user_id=877b427e6ff84af29a59dc9e1a3128ef, role_id=eac828dd4fbe49b8807c54ed514b5095)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:24.796073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e6f29-5693-4e1d-9239-89d0ac592e7c None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:24.811355 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 476/944] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:45:24 2022] PUT /identity/v3/projects/ec96772eef284ab3913f9628b136be7a/users/877b427e6ff84af29a59dc9e1a3128ef/roles/eac828dd4fbe49b8807c54ed514b5095 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:45:25.555079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0a0d0-df56-45b6-8567-1f5e46f6ef05 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:25.555624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0a0d0-df56-45b6-8567-1f5e46f6ef05 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:25.555624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0a0d0-df56-45b6-8567-1f5e46f6ef05 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:25.557201 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 469/945] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:25.562442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16b860-4701-4990-af81-8100764b7052 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:25.562865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16b860-4701-4990-af81-8100764b7052 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:25.563054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16b860-4701-4990-af81-8100764b7052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:25.581644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7c16b860-4701-4990-af81-8100764b7052 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:25.582889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7c16b860-4701-4990-af81-8100764b7052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:25.609553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:25.656395 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 477/946] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:25.681130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0a0d0-df56-45b6-8567-1f5e46f6ef05 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:25.791890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0a0d0-df56-45b6-8567-1f5e46f6ef05 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:25.827778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b66bd-482a-455f-a03a-a88944c8ca63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:25.828787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b66bd-482a-455f-a03a-a88944c8ca63 None admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:25.829292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b66bd-482a-455f-a03a-a88944c8ca63 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:25.829785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b66bd-482a-455f-a03a-a88944c8ca63 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:25.830676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b66bd-482a-455f-a03a-a88944c8ca63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:25.832402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b66bd-482a-455f-a03a-a88944c8ca63 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:25.835247 ncdv-master-1 devstack@keystone.service[91085]: WARNING keystone.server.flask.common [None req-c51b66bd-482a-455f-a03a-a88944c8ca63 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 30 20:45:25.856426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.sql.core [None req-c51b66bd-482a-455f-a03a-a88944c8ca63 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 30 20:45:25.856426 ncdv-master-1 devstack@keystone.service[91085]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 30 20:45:25.856426 ncdv-master-1 devstack@keystone.service[91085]: [parameters: {'id': '42aaa84650c34b189320d217cc0b0e70', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 30 20:45:25.856426 ncdv-master-1 devstack@keystone.service[91085]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91085) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 30 20:45:25.874678 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-c51b66bd-482a-455f-a03a-a88944c8ca63 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 42aaa84650c34b189320d217cc0b0e70.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 42aaa84650c34b189320d217cc0b0e70. Jul 30 20:45:25.874678 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:25.874678 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 30 20:45:25.874678 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 30 20:45:25.874678 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 30 20:45:25.874678 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 30 20:45:25.874678 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 30 20:45:25.874678 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application result = self._query(query) Jul 30 20:45:25.874678 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 30 20:45:25.874678 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application conn.query(q) Jul 30 20:45:25.874678 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 30 20:45:25.874678 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 30 20:45:25.874678 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 30 20:45:25.875596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application result.read() Jul 30 20:45:25.875596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 30 20:45:25.875596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 30 20:45:25.875596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 30 20:45:25.875596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 30 20:45:25.875596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 30 20:45:25.875596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 30 20:45:25.875596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 30 20:45:25.875596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 30 20:45:25.875596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 30 20:45:25.875596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:25.875596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 30 20:45:25.875596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:25.875596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:25.875596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 30 20:45:25.875596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 30 20:45:25.875596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 30 20:45:25.875596 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 30 20:45:25.876606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 30 20:45:25.876606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application next(self.gen) Jul 30 20:45:25.876606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 30 20:45:25.876606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application yield resource Jul 30 20:45:25.876606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 30 20:45:25.876606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application next(self.gen) Jul 30 20:45:25.876606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 30 20:45:25.876606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.session.rollback() Jul 30 20:45:25.876606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 20:45:25.876606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.force_reraise() Jul 30 20:45:25.876606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 20:45:25.876606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise self.value Jul 30 20:45:25.876606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 30 20:45:25.876606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 30 20:45:25.876606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 30 20:45:25.876606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application session.commit() Jul 30 20:45:25.876606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 30 20:45:25.877536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 30 20:45:25.877536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 30 20:45:25.877536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._prepare_impl() Jul 30 20:45:25.877536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 30 20:45:25.877536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.session.flush() Jul 30 20:45:25.877536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 30 20:45:25.877536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._flush(objects) Jul 30 20:45:25.877536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 30 20:45:25.877536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 30 20:45:25.877536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 30 20:45:25.877536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application compat.raise_( Jul 30 20:45:25.877536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 30 20:45:25.877536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception Jul 30 20:45:25.877536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 30 20:45:25.877536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application flush_context.execute() Jul 30 20:45:25.877536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 30 20:45:25.877536 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rec.execute(self) Jul 30 20:45:25.878489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 30 20:45:25.878489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 30 20:45:25.878489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 30 20:45:25.878489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 30 20:45:25.878489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 30 20:45:25.878489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 30 20:45:25.878489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 30 20:45:25.878489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 30 20:45:25.878489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 30 20:45:25.878489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 30 20:45:25.878489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 30 20:45:25.878489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 30 20:45:25.878489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 30 20:45:25.878489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 30 20:45:25.878489 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 30 20:45:25.881342 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 30 20:45:25.881342 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 30 20:45:25.881342 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception Jul 30 20:45:25.881342 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 30 20:45:25.881342 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 30 20:45:25.881342 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 30 20:45:25.881342 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 30 20:45:25.881342 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 30 20:45:25.881342 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application result = self._query(query) Jul 30 20:45:25.881342 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 30 20:45:25.881342 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application conn.query(q) Jul 30 20:45:25.881342 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 30 20:45:25.881342 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 30 20:45:25.881342 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 30 20:45:25.881342 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application result.read() Jul 30 20:45:25.881342 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 30 20:45:25.881342 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 30 20:45:25.883549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 30 20:45:25.883549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 30 20:45:25.883549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 30 20:45:25.883549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 30 20:45:25.883549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 30 20:45:25.883549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 30 20:45:25.883549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 30 20:45:25.883549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 30 20:45:25.883549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [parameters: {'id': '42aaa84650c34b189320d217cc0b0e70', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 30 20:45:25.883549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 30 20:45:25.883549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:25.883549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:25.883549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:25.883549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:25.883549 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 30 20:45:25.885510 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 30 20:45:25.885510 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 30 20:45:25.885510 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 30 20:45:25.885510 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 30 20:45:25.885510 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:25.885510 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:25.885510 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:25.885510 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:25.885510 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:25.885510 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:25.885510 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:25.885510 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:25.885510 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:25.885510 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:25.885510 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:25.885510 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:25.885510 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:25.888244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:25.888244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 30 20:45:25.888244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 30 20:45:25.888244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:25.888244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:25.888244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 30 20:45:25.888244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 30 20:45:25.888244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 42aaa84650c34b189320d217cc0b0e70. Jul 30 20:45:25.888244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:25.890957 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 470/947] 10.222.0.17 () {60 vars in 1140 bytes} [Sat Jul 30 20:45:25 2022] POST /identity/v3/projects => generated 262 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:25.896036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16b860-4701-4990-af81-8100764b7052 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:26.001587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16b860-4701-4990-af81-8100764b7052 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:26.040159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c5a16-e7cb-428c-a5f6-2e998d0d29fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:26.040816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c5a16-e7cb-428c-a5f6-2e998d0d29fb None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:26.041104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c5a16-e7cb-428c-a5f6-2e998d0d29fb None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:26.041384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c5a16-e7cb-428c-a5f6-2e998d0d29fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:26.054568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c5a16-e7cb-428c-a5f6-2e998d0d29fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:26.056059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c5a16-e7cb-428c-a5f6-2e998d0d29fb None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:26.067957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-8c5c5a16-e7cb-428c-a5f6-2e998d0d29fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:26.067957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:26.067957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:26.067957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:26.067957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:26.067957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:26.067957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:26.067957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:26.067957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:26.067957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:26.067957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:26.067957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:26.067957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:45:26.067957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:45:26.067957 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:45:26.070059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:45:26.070059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:26.070059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:26.070059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:26.070059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:26.070059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:26.070059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:26.070059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:26.070059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:26.070059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:26.070059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:26.070059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:26.070059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:26.070059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:26.070059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:26.070059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:26.070059 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:26.072310 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:45:26.072310 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:45:26.072310 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:45:26.072310 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:45:26.072310 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:45:26.072310 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:45:26.072310 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:26.072310 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:26.072310 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 478/948] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:45:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:26.076951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b66bd-482a-455f-a03a-a88944c8ca63 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:26.144811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:26.195388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b66bd-482a-455f-a03a-a88944c8ca63 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:26.233168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4388ccc-c1c6-474f-b0db-a590ffcf5c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:26.233854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4388ccc-c1c6-474f-b0db-a590ffcf5c85 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:26.234148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4388ccc-c1c6-474f-b0db-a590ffcf5c85 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:26.234430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4388ccc-c1c6-474f-b0db-a590ffcf5c85 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:26.235161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4388ccc-c1c6-474f-b0db-a590ffcf5c85 None admin] RBAC: Adding query filter params (name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:26.235502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4388ccc-c1c6-474f-b0db-a590ffcf5c85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:26.237207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4388ccc-c1c6-474f-b0db-a590ffcf5c85 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:26.258127 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 471/949] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 30 20:45:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:26.296575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188404d-c622-45a7-99b4-dcae2d775084 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:26.296894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188404d-c622-45a7-99b4-dcae2d775084 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:26.297132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188404d-c622-45a7-99b4-dcae2d775084 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:26.298849 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 479/950] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:26.304791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e56aa-20ec-4ef5-a321-b86f4be46fd9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:26.305086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e56aa-20ec-4ef5-a321-b86f4be46fd9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:26.305360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e56aa-20ec-4ef5-a321-b86f4be46fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:26.326002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-469e56aa-20ec-4ef5-a321-b86f4be46fd9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:26.327642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-469e56aa-20ec-4ef5-a321-b86f4be46fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:26.406547 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 472/951] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:26.431181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188404d-c622-45a7-99b4-dcae2d775084 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:26.459049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:26.547889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188404d-c622-45a7-99b4-dcae2d775084 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:26.584083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f9e66-a071-45c5-a315-37276cf4eba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:26.584717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f9e66-a071-45c5-a315-37276cf4eba6 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:26.585007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f9e66-a071-45c5-a315-37276cf4eba6 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:26.585289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f9e66-a071-45c5-a315-37276cf4eba6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:26.585924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f9e66-a071-45c5-a315-37276cf4eba6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:26.587319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f9e66-a071-45c5-a315-37276cf4eba6 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:26.596375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-a24f9e66-a071-45c5-a315-37276cf4eba6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 30 20:45:26.596375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:26.596375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:26.596375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:26.596375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:26.596375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:26.596375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:26.596375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:26.596375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 30 20:45:26.596375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:26.596375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:26.596375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:26.596375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:26.596375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:26.596375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:26.596375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:26.596375 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:26.597395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:26.597395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:26.597395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:26.597395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:26.597395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:26.597395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:26.597395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:26.597395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:26.597395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:26.597395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:26.597395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:26.597395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:26.597395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:26.597395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:26.597395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:26.597395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:26.598909 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:26.598909 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:26.598909 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:26.598909 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:26.598909 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:26.598909 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:26.598909 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:26.598909 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:26.598909 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:26.598909 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:26.598909 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:26.598909 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:26.598909 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 30 20:45:26.598909 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:26.598909 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 480/952] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 30 20:45:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:26.604310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e56aa-20ec-4ef5-a321-b86f4be46fd9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:26.654297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:26.711657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e56aa-20ec-4ef5-a321-b86f4be46fd9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:26.748439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4566b-9680-4da5-9384-30694f188899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:26.749459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4566b-9680-4da5-9384-30694f188899 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:26.749955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4566b-9680-4da5-9384-30694f188899 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:26.750451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4566b-9680-4da5-9384-30694f188899 None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:26.751365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4566b-9680-4da5-9384-30694f188899 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:26.751896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4566b-9680-4da5-9384-30694f188899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:26.753505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4566b-9680-4da5-9384-30694f188899 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:26.759579 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 473/953] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Jul 30 20:45:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:26.771347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f9e66-a071-45c5-a315-37276cf4eba6 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:26.867985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:26.884897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f9e66-a071-45c5-a315-37276cf4eba6 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:26.918610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91024df-8c27-4df0-9630-52b3b03b29c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:26.919234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91024df-8c27-4df0-9630-52b3b03b29c5 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:26.919550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91024df-8c27-4df0-9630-52b3b03b29c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:26.919828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91024df-8c27-4df0-9630-52b3b03b29c5 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:26.920512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91024df-8c27-4df0-9630-52b3b03b29c5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:26.920818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91024df-8c27-4df0-9630-52b3b03b29c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:26.922187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91024df-8c27-4df0-9630-52b3b03b29c5 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:26.930634 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 481/954] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Jul 30 20:45:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:26.935002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852d2da-7dec-42b8-9f39-a64f4085c28d None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:26.935325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852d2da-7dec-42b8-9f39-a64f4085c28d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:26.935606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852d2da-7dec-42b8-9f39-a64f4085c28d None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:26.937135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91024df-8c27-4df0-9630-52b3b03b29c5 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:26.937268 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 474/955] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:26.942571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6374e2-628b-4718-a616-1eac4b49ab31 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:26.942865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6374e2-628b-4718-a616-1eac4b49ab31 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:26.943133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6374e2-628b-4718-a616-1eac4b49ab31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:26.962128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1e6374e2-628b-4718-a616-1eac4b49ab31 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:26.963026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1e6374e2-628b-4718-a616-1eac4b49ab31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:27.053417 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 475/956] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:45:27.058260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91024df-8c27-4df0-9630-52b3b03b29c5 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:27.076445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6374e2-628b-4718-a616-1eac4b49ab31 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:27.106570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514add6-83b5-4cff-ab78-55fd1f35f047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:27.107735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514add6-83b5-4cff-ab78-55fd1f35f047 None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:27.108279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514add6-83b5-4cff-ab78-55fd1f35f047 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:27.108844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514add6-83b5-4cff-ab78-55fd1f35f047 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:27.109825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514add6-83b5-4cff-ab78-55fd1f35f047 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:27.111827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514add6-83b5-4cff-ab78-55fd1f35f047 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:27.129869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:27.140117 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 482/957] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 20:45:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 20:45:27.197012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6374e2-628b-4718-a616-1eac4b49ab31 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:27.243035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4c589-62b3-4b7b-95a8-650a4dd64f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:27.243642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4c589-62b3-4b7b-95a8-650a4dd64f35 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:27.243929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4c589-62b3-4b7b-95a8-650a4dd64f35 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:27.244207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4c589-62b3-4b7b-95a8-650a4dd64f35 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:27.244851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4c589-62b3-4b7b-95a8-650a4dd64f35 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:27.246503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4c589-62b3-4b7b-95a8-650a4dd64f35 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:27.256978 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-87c4c589-62b3-4b7b-95a8-650a4dd64f35 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 30 20:45:27.256978 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:27.256978 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:27.256978 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:27.256978 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:27.256978 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:27.256978 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:27.256978 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:27.256978 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 30 20:45:27.256978 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:27.256978 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:27.256978 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:27.256978 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:27.256978 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:27.256978 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:27.256978 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:27.256978 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:27.258103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:27.258103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:27.258103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:27.258103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:27.258103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:27.258103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:27.258103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:27.258103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:27.258103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:27.258103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:27.258103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:27.258103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:27.258103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:27.258103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:27.258103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:27.258103 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:27.259005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:27.259005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:27.259005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:27.259005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:27.259005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:27.259005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:27.259005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:27.259005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:27.259005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:27.259005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:27.259005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:27.259005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:27.259005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 30 20:45:27.259005 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:27.259005 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 476/958] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:45:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:27.266712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514add6-83b5-4cff-ab78-55fd1f35f047 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:27.278580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:27.280236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4ed93-8416-4956-955f-0358f599df1e None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:27.280236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4ed93-8416-4956-955f-0358f599df1e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:27.280528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4ed93-8416-4956-955f-0358f599df1e None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:27.282050 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 477/959] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:27.288542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd33987-b984-448a-80ec-a99bec3dceac None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:27.288976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd33987-b984-448a-80ec-a99bec3dceac None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:27.289084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd33987-b984-448a-80ec-a99bec3dceac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:27.308558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8bd33987-b984-448a-80ec-a99bec3dceac None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:27.309793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8bd33987-b984-448a-80ec-a99bec3dceac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:27.386367 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 478/960] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:45:27.393911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514add6-83b5-4cff-ab78-55fd1f35f047 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:27.411839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd33987-b984-448a-80ec-a99bec3dceac None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:27.439550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c70464-ebfb-4be4-8c38-d96decfafc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:27.440501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70464-ebfb-4be4-8c38-d96decfafc59 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:27.440790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70464-ebfb-4be4-8c38-d96decfafc59 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:27.441390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70464-ebfb-4be4-8c38-d96decfafc59 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:27.442502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c70464-ebfb-4be4-8c38-d96decfafc59 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:27.443175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c70464-ebfb-4be4-8c38-d96decfafc59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:27.444538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:27.446189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c70464-ebfb-4be4-8c38-d96decfafc59 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:27.454247 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 483/961] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 30 20:45:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:27.460957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c70464-ebfb-4be4-8c38-d96decfafc59 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:27.527389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd33987-b984-448a-80ec-a99bec3dceac None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:27.560668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:27.570559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37c84f-2a3d-4e27-9350-afb0e7f5a8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:27.572038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37c84f-2a3d-4e27-9350-afb0e7f5a8b4 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:27.572672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37c84f-2a3d-4e27-9350-afb0e7f5a8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:27.573642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37c84f-2a3d-4e27-9350-afb0e7f5a8b4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:27.589313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37c84f-2a3d-4e27-9350-afb0e7f5a8b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:45:27.597374 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-5b37c84f-2a3d-4e27-9350-afb0e7f5a8b4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 30 20:45:27.597374 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:27.597374 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:27.597374 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:27.597374 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:27.597374 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:27.597374 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:27.597374 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:27.597374 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:27.597374 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:27.597374 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:27.597374 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:27.597374 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:45:27.597374 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:45:27.597374 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:45:27.597374 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:45:27.598386 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:45:27.598386 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:45:27.598386 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:45:27.598386 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:45:27.598386 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:27.598386 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:27.598386 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:27.598386 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:27.598386 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:27.598386 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:27.598386 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:27.598386 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:27.598386 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:27.598386 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:27.598386 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:27.598386 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:27.599249 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:27.599249 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:27.599249 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:27.599249 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:27.599249 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:45:27.599249 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:45:27.599249 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:45:27.599249 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:45:27.599249 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:45:27.599249 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:45:27.599249 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 30 20:45:27.599249 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:27.599951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c70464-ebfb-4be4-8c38-d96decfafc59 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:27.603783 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 479/962] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Jul 30 20:45:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:27.609666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37c84f-2a3d-4e27-9350-afb0e7f5a8b4 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:27.641058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2502ee2-8c82-4997-a55e-9abae0fcfff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:27.641777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2502ee2-8c82-4997-a55e-9abae0fcfff4 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:27.642137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2502ee2-8c82-4997-a55e-9abae0fcfff4 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:27.642490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2502ee2-8c82-4997-a55e-9abae0fcfff4 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:27.643261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2502ee2-8c82-4997-a55e-9abae0fcfff4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:27.643721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2502ee2-8c82-4997-a55e-9abae0fcfff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:27.645740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2502ee2-8c82-4997-a55e-9abae0fcfff4 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:27.652221 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 484/963] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 30 20:45:27 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:27.725907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:27.741209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37c84f-2a3d-4e27-9350-afb0e7f5a8b4 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:27.782592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b1317-1e12-4733-aed3-89371248a499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:27.783154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b1317-1e12-4733-aed3-89371248a499 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:27.783473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b1317-1e12-4733-aed3-89371248a499 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:27.783753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b1317-1e12-4733-aed3-89371248a499 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:27.784553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b1317-1e12-4733-aed3-89371248a499 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:27.784872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b1317-1e12-4733-aed3-89371248a499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:27.786940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b1317-1e12-4733-aed3-89371248a499 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:27.796907 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 480/964] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Jul 30 20:45:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:27.802842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2502ee2-8c82-4997-a55e-9abae0fcfff4 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:27.913148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2502ee2-8c82-4997-a55e-9abae0fcfff4 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:27.948607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320f718-7cab-420c-9a99-614812ad1c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:27.949316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320f718-7cab-420c-9a99-614812ad1c87 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:27.949600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320f718-7cab-420c-9a99-614812ad1c87 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:27.949876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320f718-7cab-420c-9a99-614812ad1c87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:27.951925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:27.964224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320f718-7cab-420c-9a99-614812ad1c87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:27.965709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320f718-7cab-420c-9a99-614812ad1c87 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:27.981734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-7320f718-7cab-420c-9a99-614812ad1c87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:27.981734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:27.981734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:27.981734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:27.981734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:27.981734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:27.981734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:27.981734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:27.981734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:27.981734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:27.981734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:27.981734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:27.981734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:27.981734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:27.981734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:27.982694 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:27.982694 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:27.982694 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:27.982694 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:27.982694 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:27.982694 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:27.982694 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:27.982694 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:27.982694 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:27.982694 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:27.982694 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:27.982694 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:27.982694 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:27.982694 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:27.982694 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:27.982694 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:27.982694 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:27.983666 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:27.983666 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:27.983666 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:27.983666 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:27.983666 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 485/965] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:27.990600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b1317-1e12-4733-aed3-89371248a499 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:28.114681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b1317-1e12-4733-aed3-89371248a499 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:28.157643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5c692-d040-4da4-a0bb-61b3d77bee24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:28.158632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5c692-d040-4da4-a0bb-61b3d77bee24 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:28.159158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5c692-d040-4da4-a0bb-61b3d77bee24 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:28.159711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5c692-d040-4da4-a0bb-61b3d77bee24 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:28.161382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5c692-d040-4da4-a0bb-61b3d77bee24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:28.167646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5c692-d040-4da4-a0bb-61b3d77bee24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:28.169239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5c692-d040-4da4-a0bb-61b3d77bee24 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:28.188601 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 481/966] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:28.200400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320f718-7cab-420c-9a99-614812ad1c87 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:28.404751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320f718-7cab-420c-9a99-614812ad1c87 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:28.466567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31e45a-2da3-4d40-8ea9-c381a06e1d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:28.468387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31e45a-2da3-4d40-8ea9-c381a06e1d35 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:28.469738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31e45a-2da3-4d40-8ea9-c381a06e1d35 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:28.470611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31e45a-2da3-4d40-8ea9-c381a06e1d35 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:28.487571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31e45a-2da3-4d40-8ea9-c381a06e1d35 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:28.490473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31e45a-2da3-4d40-8ea9-c381a06e1d35 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:28.521494 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-ff31e45a-2da3-4d40-8ea9-c381a06e1d35 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 30 20:45:28.521494 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:28.521494 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:28.521494 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:28.521494 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:28.521494 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:28.521494 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:28.521494 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:28.521494 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:28.521494 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:28.521494 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:28.521494 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:28.521494 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:45:28.521494 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:45:28.521494 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:45:28.521494 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:45:28.522524 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:28.522524 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:28.522524 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:45:28.522524 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:28.522524 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:45:28.522524 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:28.522524 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:28.522524 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:28.522524 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:28.522524 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:28.522524 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:28.522524 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:28.522524 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:28.522524 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:28.522524 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:28.522524 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:28.522524 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:28.522524 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:28.523541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:28.523541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:28.523541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:45:28.523541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:45:28.523541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:45:28.523541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:45:28.523541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:45:28.523541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:45:28.523541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 30 20:45:28.523541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:28.529141 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 486/967] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Jul 30 20:45:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:28.536603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5c692-d040-4da4-a0bb-61b3d77bee24 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:28.573924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:28.692834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5c692-d040-4da4-a0bb-61b3d77bee24 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:28.729211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a670054-9c9f-4d4a-bc38-708b3fa7008b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:28.730183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a670054-9c9f-4d4a-bc38-708b3fa7008b None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:28.730678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a670054-9c9f-4d4a-bc38-708b3fa7008b None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:28.731177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a670054-9c9f-4d4a-bc38-708b3fa7008b None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:28.732236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a670054-9c9f-4d4a-bc38-708b3fa7008b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:28.732776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a670054-9c9f-4d4a-bc38-708b3fa7008b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:28.734064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23995e8-be01-40c7-bf35-f9a53c95dacd None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:28.734513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23995e8-be01-40c7-bf35-f9a53c95dacd None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:28.734679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23995e8-be01-40c7-bf35-f9a53c95dacd None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:28.735240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a670054-9c9f-4d4a-bc38-708b3fa7008b None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:28.736200 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 487/968] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:28.741559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d29694-6821-4647-ac0d-79d4f985cbad None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:28.741848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d29694-6821-4647-ac0d-79d4f985cbad None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:28.742128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d29694-6821-4647-ac0d-79d4f985cbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:28.757893 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 482/969] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Jul 30 20:45:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:28.765970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a670054-9c9f-4d4a-bc38-708b3fa7008b None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:28.771119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c1d29694-6821-4647-ac0d-79d4f985cbad None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:28.772577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c1d29694-6821-4647-ac0d-79d4f985cbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:28.830037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:28.846470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:28.870853 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 488/970] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:45:28.896002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a670054-9c9f-4d4a-bc38-708b3fa7008b None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:28.902941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d29694-6821-4647-ac0d-79d4f985cbad None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:28.937277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4794f-79e5-4619-8dcc-ab0d8c58e501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:28.938458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4794f-79e5-4619-8dcc-ab0d8c58e501 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:28.938946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4794f-79e5-4619-8dcc-ab0d8c58e501 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:28.939500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4794f-79e5-4619-8dcc-ab0d8c58e501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:29.033145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4794f-79e5-4619-8dcc-ab0d8c58e501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:29.033347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d29694-6821-4647-ac0d-79d4f985cbad None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:29.035468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4794f-79e5-4619-8dcc-ab0d8c58e501 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:29.071178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08acb2-0714-4fd0-9dc8-092361953633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:29.071855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08acb2-0714-4fd0-9dc8-092361953633 None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:29.072141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08acb2-0714-4fd0-9dc8-092361953633 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:29.072419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08acb2-0714-4fd0-9dc8-092361953633 None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:29.073108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08acb2-0714-4fd0-9dc8-092361953633 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:29.074808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08acb2-0714-4fd0-9dc8-092361953633 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:29.077444 ncdv-master-1 devstack@keystone.service[91086]: WARNING keystone.server.flask.common [None req-4c08acb2-0714-4fd0-9dc8-092361953633 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 30 20:45:29.092475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.sql.core [None req-4c08acb2-0714-4fd0-9dc8-092361953633 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 30 20:45:29.092475 ncdv-master-1 devstack@keystone.service[91086]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 30 20:45:29.092475 ncdv-master-1 devstack@keystone.service[91086]: [parameters: {'user_id': '28c8261b0705470caca506104b7d8b17', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 30 20:45:29.092475 ncdv-master-1 devstack@keystone.service[91086]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91086) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 30 20:45:29.100132 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-4c08acb2-0714-4fd0-9dc8-092361953633 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 30 20:45:29.100132 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:29.100132 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 30 20:45:29.100132 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 30 20:45:29.100132 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 30 20:45:29.100132 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 30 20:45:29.100132 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 30 20:45:29.100132 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application result = self._query(query) Jul 30 20:45:29.100132 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 30 20:45:29.100132 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application conn.query(q) Jul 30 20:45:29.100132 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 30 20:45:29.100132 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 30 20:45:29.100132 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 30 20:45:29.100132 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application result.read() Jul 30 20:45:29.100132 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 30 20:45:29.101067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 30 20:45:29.101067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 30 20:45:29.101067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 30 20:45:29.101067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 30 20:45:29.101067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 30 20:45:29.101067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 30 20:45:29.101067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 30 20:45:29.101067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 30 20:45:29.101067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:29.101067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 30 20:45:29.101067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:29.101067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:29.101067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 30 20:45:29.101067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 30 20:45:29.101067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 30 20:45:29.101067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 30 20:45:29.101067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 30 20:45:29.101067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application next(self.gen) Jul 30 20:45:29.102023 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 30 20:45:29.102023 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application yield resource Jul 30 20:45:29.102023 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 30 20:45:29.102023 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application next(self.gen) Jul 30 20:45:29.102023 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 30 20:45:29.102023 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.session.rollback() Jul 30 20:45:29.102023 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 20:45:29.102023 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.force_reraise() Jul 30 20:45:29.102023 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 20:45:29.102023 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise self.value Jul 30 20:45:29.102023 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 30 20:45:29.102023 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 30 20:45:29.102023 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 30 20:45:29.102023 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application session.commit() Jul 30 20:45:29.102023 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 30 20:45:29.102023 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 30 20:45:29.102023 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 30 20:45:29.102944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._prepare_impl() Jul 30 20:45:29.102944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 30 20:45:29.102944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.session.flush() Jul 30 20:45:29.102944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 30 20:45:29.102944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._flush(objects) Jul 30 20:45:29.102944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 30 20:45:29.102944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 30 20:45:29.102944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 30 20:45:29.102944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application compat.raise_( Jul 30 20:45:29.102944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 30 20:45:29.102944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception Jul 30 20:45:29.102944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 30 20:45:29.102944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application flush_context.execute() Jul 30 20:45:29.102944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 30 20:45:29.102944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rec.execute(self) Jul 30 20:45:29.102944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 30 20:45:29.102944 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 30 20:45:29.103904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 30 20:45:29.103904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 30 20:45:29.103904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 30 20:45:29.103904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 30 20:45:29.103904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 30 20:45:29.103904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 30 20:45:29.103904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 30 20:45:29.103904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 30 20:45:29.103904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 30 20:45:29.103904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 30 20:45:29.103904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 30 20:45:29.103904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 30 20:45:29.103904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 30 20:45:29.103904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 30 20:45:29.103904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 30 20:45:29.103904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception Jul 30 20:45:29.104790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 30 20:45:29.104790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 30 20:45:29.104790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 30 20:45:29.104790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 30 20:45:29.104790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 30 20:45:29.104790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application result = self._query(query) Jul 30 20:45:29.104790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 30 20:45:29.104790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application conn.query(q) Jul 30 20:45:29.104790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 30 20:45:29.104790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 30 20:45:29.104790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 30 20:45:29.104790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application result.read() Jul 30 20:45:29.104790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 30 20:45:29.104790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 30 20:45:29.104790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 30 20:45:29.104790 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 30 20:45:29.105647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 30 20:45:29.105647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 30 20:45:29.105647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 30 20:45:29.105647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 30 20:45:29.105647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 30 20:45:29.105647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 30 20:45:29.105647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [parameters: {'user_id': '28c8261b0705470caca506104b7d8b17', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 30 20:45:29.105647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 30 20:45:29.105647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:29.105647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:29.105647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:29.105647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:29.105647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:29.105647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:29.105647 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:29.106466 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:29.106466 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:29.106466 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:29.106466 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:29.106466 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:29.106466 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:29.106466 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:29.106466 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 30 20:45:29.106466 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 30 20:45:29.106466 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:29.106466 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:29.106466 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:45:29.106466 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:29.106466 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:45:29.106466 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:29.106466 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 30 20:45:29.106466 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 30 20:45:29.108820 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 30 20:45:29.108820 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 30 20:45:29.108820 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 30 20:45:29.108820 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 30 20:45:29.108820 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 30 20:45:29.108820 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:29.108820 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 489/971] 10.222.0.17 () {60 vars in 1131 bytes} [Sat Jul 30 20:45:28 2022] POST /identity/v3/users => generated 160 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:29.108820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08acb2-0714-4fd0-9dc8-092361953633 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:29.132180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:29.157904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:29.178479 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 483/972] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:45:28 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 30 20:45:29.186076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4794f-79e5-4619-8dcc-ab0d8c58e501 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:29.244886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08acb2-0714-4fd0-9dc8-092361953633 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:29.283613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5705f0d-b71f-43c0-96dd-24e3b9e826bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:29.284777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5705f0d-b71f-43c0-96dd-24e3b9e826bd None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:29.285792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5705f0d-b71f-43c0-96dd-24e3b9e826bd None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:29.286300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5705f0d-b71f-43c0-96dd-24e3b9e826bd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:29.294511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5705f0d-b71f-43c0-96dd-24e3b9e826bd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:29.296622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5705f0d-b71f-43c0-96dd-24e3b9e826bd None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:29.299143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4794f-79e5-4619-8dcc-ab0d8c58e501 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:29.309619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-f5705f0d-b71f-43c0-96dd-24e3b9e826bd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 30 20:45:29.309619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:29.309619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:29.309619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:29.309619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:29.309619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:29.309619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:29.309619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:29.309619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:29.309619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:29.309619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:29.309619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:29.309619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:45:29.309619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:45:29.309619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:45:29.309619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:45:29.310555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:29.310555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:29.310555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:45:29.310555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:29.310555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:45:29.310555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:29.310555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:29.310555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:29.310555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:29.310555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:29.310555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:29.310555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:29.310555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:29.310555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:29.310555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:29.310555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:29.310555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:29.310555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:29.311546 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:29.311546 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:29.311546 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:45:29.311546 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:45:29.311546 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:45:29.311546 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:45:29.311546 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:45:29.311546 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:45:29.311546 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 30 20:45:29.311546 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:29.318374 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 490/973] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:45:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:29.320383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5705f0d-b71f-43c0-96dd-24e3b9e826bd None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:29.337579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3251216-37b2-49bd-8abc-f92c59b29a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:29.338750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3251216-37b2-49bd-8abc-f92c59b29a73 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:29.338750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3251216-37b2-49bd-8abc-f92c59b29a73 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:29.339190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3251216-37b2-49bd-8abc-f92c59b29a73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:29.350366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3251216-37b2-49bd-8abc-f92c59b29a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:29.352188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3251216-37b2-49bd-8abc-f92c59b29a73 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:29.367877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-e3251216-37b2-49bd-8abc-f92c59b29a73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:29.367877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:29.367877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:29.367877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:29.367877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:29.367877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:29.367877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:29.367877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:29.367877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:29.367877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:29.367877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:29.367877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:29.367877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:29.367877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:29.367877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:29.369015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:29.369015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:29.369015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:29.369015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:29.369015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:29.369015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:29.369015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:29.369015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:29.369015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:29.369015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:29.369015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:29.369015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:29.369015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:29.369015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:29.369015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:29.369015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:29.369015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:29.370374 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:29.370374 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:29.370374 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:29.370374 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:29.376563 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 484/974] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:29.377168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3251216-37b2-49bd-8abc-f92c59b29a73 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:29.405664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:29.437525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:29.442707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5705f0d-b71f-43c0-96dd-24e3b9e826bd None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:29.478990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847ed8e-852e-4ae2-bfd7-de3e3b1826a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:29.479997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847ed8e-852e-4ae2-bfd7-de3e3b1826a1 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:29.480514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847ed8e-852e-4ae2-bfd7-de3e3b1826a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:29.481009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847ed8e-852e-4ae2-bfd7-de3e3b1826a1 None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:29.481982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847ed8e-852e-4ae2-bfd7-de3e3b1826a1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:29.482508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847ed8e-852e-4ae2-bfd7-de3e3b1826a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:29.484163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847ed8e-852e-4ae2-bfd7-de3e3b1826a1 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:29.492782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3251216-37b2-49bd-8abc-f92c59b29a73 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:29.531554 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 491/975] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 30 20:45:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:29.534898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6d440-fe9a-41a7-a049-3d28662605d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:29.535511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6d440-fe9a-41a7-a049-3d28662605d0 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:29.535798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6d440-fe9a-41a7-a049-3d28662605d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:29.536074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6d440-fe9a-41a7-a049-3d28662605d0 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:29.536799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6d440-fe9a-41a7-a049-3d28662605d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:29.537107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6d440-fe9a-41a7-a049-3d28662605d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:29.538523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6d440-fe9a-41a7-a049-3d28662605d0 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:29.553797 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 485/976] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:29.559793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847ed8e-852e-4ae2-bfd7-de3e3b1826a1 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:29.560912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d213ef-ab03-4cc3-9584-48f26c3fd5ba None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:29.561209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d213ef-ab03-4cc3-9584-48f26c3fd5ba None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:29.561573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d213ef-ab03-4cc3-9584-48f26c3fd5ba None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:29.563222 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 486/977] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:29.569568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ccb8d-410f-4c45-8f54-071a9294801b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:29.569877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ccb8d-410f-4c45-8f54-071a9294801b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:29.570128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ccb8d-410f-4c45-8f54-071a9294801b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:29.593128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4d2ccb8d-410f-4c45-8f54-071a9294801b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:29.594471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4d2ccb8d-410f-4c45-8f54-071a9294801b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:29.685054 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 487/978] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:45:29.699047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847ed8e-852e-4ae2-bfd7-de3e3b1826a1 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:29.713837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ccb8d-410f-4c45-8f54-071a9294801b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:29.730638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:29.752118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f0b70-c0a4-4319-862d-6a01c3571250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:29.753753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f0b70-c0a4-4319-862d-6a01c3571250 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:29.754294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f0b70-c0a4-4319-862d-6a01c3571250 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:29.754876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f0b70-c0a4-4319-862d-6a01c3571250 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:29.765114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f0b70-c0a4-4319-862d-6a01c3571250 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:29.767186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f0b70-c0a4-4319-862d-6a01c3571250 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:29.786541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-179f0b70-c0a4-4319-862d-6a01c3571250 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:29.786541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:29.786541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:29.786541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:29.786541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:29.786541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:29.786541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:29.786541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:29.786541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:29.786541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:29.786541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:29.786541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:29.786541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:45:29.786541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:45:29.786541 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:45:29.787661 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:45:29.787661 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:29.787661 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:29.787661 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:29.787661 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:29.787661 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:29.787661 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:29.787661 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:29.787661 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:29.787661 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:29.787661 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:29.787661 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:29.787661 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:29.787661 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:29.787661 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:29.787661 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:29.787661 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:29.788761 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:45:29.788761 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:45:29.788761 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:45:29.788761 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:45:29.788761 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:45:29.788761 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:45:29.788761 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:29.788761 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:29.790494 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 492/979] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:45:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:29.797472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f0b70-c0a4-4319-862d-6a01c3571250 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:29.824182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:29.849899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ccb8d-410f-4c45-8f54-071a9294801b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:29.890054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae46f6-3090-415b-9917-de6b82185a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:29.890871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae46f6-3090-415b-9917-de6b82185a5d None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:29.891268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae46f6-3090-415b-9917-de6b82185a5d None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:29.891667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae46f6-3090-415b-9917-de6b82185a5d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:29.892396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae46f6-3090-415b-9917-de6b82185a5d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:29.893874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae46f6-3090-415b-9917-de6b82185a5d None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:29.904908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-9aae46f6-3090-415b-9917-de6b82185a5d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 30 20:45:29.904908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:29.904908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:29.904908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:29.904908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:29.904908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:29.904908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:29.904908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:29.904908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 30 20:45:29.904908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:29.904908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:29.904908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:29.904908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:29.904908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:29.904908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:29.904908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:29.904908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:29.906137 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:29.906137 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:29.906137 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:29.906137 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:29.906137 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:29.906137 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:29.906137 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:29.906137 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:29.906137 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:29.906137 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:29.906137 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:29.906137 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:29.906137 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:29.906137 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:29.906137 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:29.906137 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:29.907199 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:29.907199 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:29.907199 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:29.907199 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:29.907199 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:29.907199 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:29.907199 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:29.907199 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:29.907199 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:29.907199 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:29.907199 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:29.907199 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:29.907199 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 30 20:45:29.907199 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:29.908316 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 488/980] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 30 20:45:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:29.913090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae46f6-3090-415b-9917-de6b82185a5d None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:29.936056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f0b70-c0a4-4319-862d-6a01c3571250 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:29.972249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53149885-aba8-48ab-ad5a-57967d2a8b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:29.973144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53149885-aba8-48ab-ad5a-57967d2a8b1e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:29.973608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53149885-aba8-48ab-ad5a-57967d2a8b1e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:29.973991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53149885-aba8-48ab-ad5a-57967d2a8b1e None admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:29.974904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53149885-aba8-48ab-ad5a-57967d2a8b1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:29.975320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53149885-aba8-48ab-ad5a-57967d2a8b1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:29.976883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53149885-aba8-48ab-ad5a-57967d2a8b1e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:29.995597 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 493/981] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:45:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:29.997523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53149885-aba8-48ab-ad5a-57967d2a8b1e None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:30.008393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:30.035552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae46f6-3090-415b-9917-de6b82185a5d None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:30.075453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a4179-2903-4758-892b-2730555084a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:30.076358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a4179-2903-4758-892b-2730555084a5 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:30.076646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a4179-2903-4758-892b-2730555084a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:30.076928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a4179-2903-4758-892b-2730555084a5 None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:30.077615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a4179-2903-4758-892b-2730555084a5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:30.077926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a4179-2903-4758-892b-2730555084a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:30.079330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a4179-2903-4758-892b-2730555084a5 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:30.081522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:30.084877 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 489/982] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Jul 30 20:45:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:30.091317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a4179-2903-4758-892b-2730555084a5 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:30.108312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53149885-aba8-48ab-ad5a-57967d2a8b1e None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:30.145927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45b265-3fc1-4bf5-8807-29027a0eb48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:30.146543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45b265-3fc1-4bf5-8807-29027a0eb48f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:30.146830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45b265-3fc1-4bf5-8807-29027a0eb48f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:30.147112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45b265-3fc1-4bf5-8807-29027a0eb48f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:30.147931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45b265-3fc1-4bf5-8807-29027a0eb48f None admin] RBAC: Adding query filter params (role.id=eac828dd4fbe49b8807c54ed514b5095, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=877b427e6ff84af29a59dc9e1a3128ef) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:30.148244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45b265-3fc1-4bf5-8807-29027a0eb48f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:30.149685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45b265-3fc1-4bf5-8807-29027a0eb48f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:30.155612 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 494/983] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:45:29 2022] GET /identity/v3/role_assignments?user.id=877b427e6ff84af29a59dc9e1a3128ef&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=eac828dd4fbe49b8807c54ed514b5095 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:30.156914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e7124-65e8-4721-b025-17e156c05a0f None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:30.157213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e7124-65e8-4721-b025-17e156c05a0f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:30.157497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e7124-65e8-4721-b025-17e156c05a0f None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:30.158697 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 495/984] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:30.164322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914e0a2-40af-4605-a41e-75dff814e41a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:30.164615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914e0a2-40af-4605-a41e-75dff814e41a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:30.164900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914e0a2-40af-4605-a41e-75dff814e41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:30.190646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4914e0a2-40af-4605-a41e-75dff814e41a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:30.193172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4914e0a2-40af-4605-a41e-75dff814e41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:30.215052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a4179-2903-4758-892b-2730555084a5 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:30.254175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082fb25-d68a-4694-b240-7f084da0c3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:30.254819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082fb25-d68a-4694-b240-7f084da0c3bc None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:30.255107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082fb25-d68a-4694-b240-7f084da0c3bc None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:30.255416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082fb25-d68a-4694-b240-7f084da0c3bc None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:30.256104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082fb25-d68a-4694-b240-7f084da0c3bc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:30.256408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082fb25-d68a-4694-b240-7f084da0c3bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:30.257804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082fb25-d68a-4694-b240-7f084da0c3bc None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:30.268172 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 490/985] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Jul 30 20:45:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:30.271333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082fb25-d68a-4694-b240-7f084da0c3bc None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:30.278028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:30.279819 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 496/986] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:45:30.303517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914e0a2-40af-4605-a41e-75dff814e41a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:30.383967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:30.391411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082fb25-d68a-4694-b240-7f084da0c3bc None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:30.416344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914e0a2-40af-4605-a41e-75dff814e41a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:30.428334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae652ecd-aad5-42e6-98c4-4ca692190c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:30.429047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae652ecd-aad5-42e6-98c4-4ca692190c43 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:30.429342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae652ecd-aad5-42e6-98c4-4ca692190c43 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:30.429643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae652ecd-aad5-42e6-98c4-4ca692190c43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:30.430385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae652ecd-aad5-42e6-98c4-4ca692190c43 None admin] RBAC: Adding query filter params (interface=admin, service_id=2945d3e266bb4c6da94ec123f2c39ff5, region_id=RegionOne) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:30.430698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae652ecd-aad5-42e6-98c4-4ca692190c43 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:30.432093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae652ecd-aad5-42e6-98c4-4ca692190c43 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:30.437205 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 491/987] 10.222.0.17 () {56 vars in 1249 bytes} [Sat Jul 30 20:45:30 2022] GET /identity/v3/endpoints?service_id=2945d3e266bb4c6da94ec123f2c39ff5&interface=admin®ion_id=RegionOne => generated 193 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:30.443450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae652ecd-aad5-42e6-98c4-4ca692190c43 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:30.456055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3f700-9364-453c-96e3-c85ef9c0692b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:30.457193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3f700-9364-453c-96e3-c85ef9c0692b None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:30.457487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3f700-9364-453c-96e3-c85ef9c0692b None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:30.457763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3f700-9364-453c-96e3-c85ef9c0692b None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:30.458452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3f700-9364-453c-96e3-c85ef9c0692b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:30.459955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3f700-9364-453c-96e3-c85ef9c0692b None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:30.479321 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 497/988] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 30 20:45:30 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 20:45:30.530231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:30.571265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae652ecd-aad5-42e6-98c4-4ca692190c43 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:30.617115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9875879-de55-4506-8c7c-863e1490cb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:30.617756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9875879-de55-4506-8c7c-863e1490cb25 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:30.618101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9875879-de55-4506-8c7c-863e1490cb25 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:30.618389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9875879-de55-4506-8c7c-863e1490cb25 None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:30.619067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9875879-de55-4506-8c7c-863e1490cb25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:30.620754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9875879-de55-4506-8c7c-863e1490cb25 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:30.635432 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 492/989] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Jul 30 20:45:30 2022] GET /identity/v3/services => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 20:45:32.466415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da5e2-179f-43f9-a801-a3e36c24ac7a None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:32.466941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da5e2-179f-43f9-a801-a3e36c24ac7a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:32.467020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da5e2-179f-43f9-a801-a3e36c24ac7a None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:32.468526 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 498/990] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:32.473606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4c343-4d31-416a-88d8-acdd73551c81 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:32.474007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4c343-4d31-416a-88d8-acdd73551c81 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:32.474171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4c343-4d31-416a-88d8-acdd73551c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:32.492658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-60f4c343-4d31-416a-88d8-acdd73551c81 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:32.493856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-60f4c343-4d31-416a-88d8-acdd73551c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:32.564428 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 493/991] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:32.587525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4da5e2-179f-43f9-a801-a3e36c24ac7a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:32.701153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4da5e2-179f-43f9-a801-a3e36c24ac7a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:32.732109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:32.740697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd354f-35e8-4bc7-af0f-41a0964b932c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:32.742075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd354f-35e8-4bc7-af0f-41a0964b932c None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:32.742756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd354f-35e8-4bc7-af0f-41a0964b932c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:32.743037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd354f-35e8-4bc7-af0f-41a0964b932c None admin] PATH_INFO: `/v3/services/image` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:32.743727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd354f-35e8-4bc7-af0f-41a0964b932c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:32.745377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd354f-35e8-4bc7-af0f-41a0964b932c None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:32.755339 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-e0fd354f-35e8-4bc7-af0f-41a0964b932c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 30 20:45:32.755339 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:32.755339 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:32.755339 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:32.755339 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:32.755339 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:32.755339 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:32.755339 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:32.755339 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 30 20:45:32.755339 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:32.755339 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:32.755339 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:32.755339 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:32.755339 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:32.755339 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:32.755339 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:32.755339 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:32.756451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:32.756451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:32.756451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:32.756451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:32.756451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:32.756451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:32.756451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:32.756451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:32.756451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:32.756451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:32.756451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:32.756451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:32.756451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:32.756451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:32.756451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:32.756451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:32.757918 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:32.757918 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:32.757918 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:32.757918 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:32.757918 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:32.757918 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:32.757918 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:32.757918 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:32.757918 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:32.757918 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:32.757918 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:32.757918 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:32.757918 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 30 20:45:32.757918 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:32.758891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb3f8-51dc-49ee-b111-eb623ed79ac0 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:32.759176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb3f8-51dc-49ee-b111-eb623ed79ac0 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:32.759645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb3f8-51dc-49ee-b111-eb623ed79ac0 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:32.759842 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 499/992] 10.222.0.17 () {56 vars in 1105 bytes} [Sat Jul 30 20:45:32 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:32.761030 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 494/993] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:32.762233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd354f-35e8-4bc7-af0f-41a0964b932c None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:32.765532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05426391-22fd-40eb-9fe4-d813075c6ca0 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:32.765825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05426391-22fd-40eb-9fe4-d813075c6ca0 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:32.766108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05426391-22fd-40eb-9fe4-d813075c6ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:32.784280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-05426391-22fd-40eb-9fe4-d813075c6ca0 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:32.785516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-05426391-22fd-40eb-9fe4-d813075c6ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:32.842636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:32.861642 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 495/994] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:45:32.876107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd354f-35e8-4bc7-af0f-41a0964b932c None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:32.877198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3527daf-1617-4d1e-8bdf-8ed7df6180f5 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:32.877490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3527daf-1617-4d1e-8bdf-8ed7df6180f5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:32.877776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3527daf-1617-4d1e-8bdf-8ed7df6180f5 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:32.879844 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 496/995] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:45:32.884628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa04fe-6a15-4da4-9e89-cedd6d70269c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:32.884922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa04fe-6a15-4da4-9e89-cedd6d70269c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:32.885238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa04fe-6a15-4da4-9e89-cedd6d70269c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:32.902909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-20aa04fe-6a15-4da4-9e89-cedd6d70269c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:32.904143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-20aa04fe-6a15-4da4-9e89-cedd6d70269c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:32.911839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb8151-a7d8-43b0-84a3-d8bcbe68aa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:32.912455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb8151-a7d8-43b0-84a3-d8bcbe68aa81 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:32.912736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb8151-a7d8-43b0-84a3-d8bcbe68aa81 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:32.913007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb8151-a7d8-43b0-84a3-d8bcbe68aa81 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:32.913671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb8151-a7d8-43b0-84a3-d8bcbe68aa81 None admin] RBAC: Adding query filter params (name=image) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:32.913969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb8151-a7d8-43b0-84a3-d8bcbe68aa81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:32.915336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb8151-a7d8-43b0-84a3-d8bcbe68aa81 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:32.920341 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 500/996] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:32.921347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb8151-a7d8-43b0-84a3-d8bcbe68aa81 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:32.974635 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 497/997] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:45:32.975569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa04fe-6a15-4da4-9e89-cedd6d70269c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:32.977968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:33.026475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb8151-a7d8-43b0-84a3-d8bcbe68aa81 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:33.060172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59d1e3-78f3-4b0a-a3b8-07aaf073de1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:33.060817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59d1e3-78f3-4b0a-a3b8-07aaf073de1e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:33.061102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59d1e3-78f3-4b0a-a3b8-07aaf073de1e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:33.061378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59d1e3-78f3-4b0a-a3b8-07aaf073de1e None admin] PATH_INFO: `/v3/services/compute` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:33.062327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59d1e3-78f3-4b0a-a3b8-07aaf073de1e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:33.063411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59d1e3-78f3-4b0a-a3b8-07aaf073de1e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:33.072750 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-5b59d1e3-78f3-4b0a-a3b8-07aaf073de1e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 30 20:45:33.072750 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:33.072750 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:33.072750 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:33.072750 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:33.072750 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:33.072750 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:33.072750 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:33.072750 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 30 20:45:33.072750 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:33.072750 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:33.072750 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:33.072750 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:33.072750 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:33.072750 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:33.072750 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:33.072750 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:33.073743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:33.073743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:33.073743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:33.073743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:33.073743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:33.073743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:33.073743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:33.073743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:33.073743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:33.073743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:33.073743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:33.073743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:33.073743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:33.073743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:33.073743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:33.073743 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:33.074624 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:33.074624 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:33.074624 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:33.074624 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:33.074624 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:33.074624 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:33.074624 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:33.074624 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:33.074624 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:33.074624 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:33.074624 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:33.074624 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:33.074624 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 30 20:45:33.074624 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:33.074624 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 501/998] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:45:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:33.075570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59d1e3-78f3-4b0a-a3b8-07aaf073de1e None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:33.093582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa04fe-6a15-4da4-9e89-cedd6d70269c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:33.111734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:33.130335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94aae0-c30a-453a-9f7c-ac1f4b92fded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:33.130962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94aae0-c30a-453a-9f7c-ac1f4b92fded None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:33.131249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94aae0-c30a-453a-9f7c-ac1f4b92fded None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:33.131557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94aae0-c30a-453a-9f7c-ac1f4b92fded None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:33.132235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94aae0-c30a-453a-9f7c-ac1f4b92fded None admin] RBAC: Adding query filter params (type=image) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:33.132537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94aae0-c30a-453a-9f7c-ac1f4b92fded None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:33.133918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94aae0-c30a-453a-9f7c-ac1f4b92fded None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:33.138240 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 498/999] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:32 2022] GET /identity/v3/services?type=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:33.139005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94aae0-c30a-453a-9f7c-ac1f4b92fded None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:33.179941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59d1e3-78f3-4b0a-a3b8-07aaf073de1e None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:33.206146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:33.219872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae9d4c-7363-4515-8fa7-569c1ad876b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:33.220539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae9d4c-7363-4515-8fa7-569c1ad876b2 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:33.220823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae9d4c-7363-4515-8fa7-569c1ad876b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:33.221099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae9d4c-7363-4515-8fa7-569c1ad876b2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:33.221741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae9d4c-7363-4515-8fa7-569c1ad876b2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:33.223708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae9d4c-7363-4515-8fa7-569c1ad876b2 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:33.233506 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-d0ae9d4c-7363-4515-8fa7-569c1ad876b2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 30 20:45:33.233506 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:33.233506 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:33.233506 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:33.233506 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:33.233506 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:33.233506 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:33.233506 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:33.233506 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 30 20:45:33.233506 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:33.233506 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:33.233506 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:33.233506 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:33.233506 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:33.233506 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:33.233506 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:33.233506 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:33.234607 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:33.234607 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:33.234607 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:33.234607 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:33.234607 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:33.234607 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:33.234607 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:33.234607 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:33.234607 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:33.234607 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:33.234607 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:33.234607 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:33.234607 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:33.234607 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:33.234607 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:33.234607 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:33.235922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:33.235922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:33.235922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:33.235922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:33.235922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:33.235922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:33.235922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:33.235922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:33.235922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:33.235922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:33.235922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:33.235922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:33.235922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 30 20:45:33.235922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:33.241694 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 502/1000] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 30 20:45:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:33.242660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae9d4c-7363-4515-8fa7-569c1ad876b2 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:33.260112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94aae0-c30a-453a-9f7c-ac1f4b92fded None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:33.296806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f94eb-2f61-490a-acde-0bc4441ca8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:33.297445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f94eb-2f61-490a-acde-0bc4441ca8aa None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:33.297720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f94eb-2f61-490a-acde-0bc4441ca8aa None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:33.297990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f94eb-2f61-490a-acde-0bc4441ca8aa None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:33.298682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f94eb-2f61-490a-acde-0bc4441ca8aa None admin] RBAC: Adding query filter params (name=compute) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:33.298985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f94eb-2f61-490a-acde-0bc4441ca8aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:33.300533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f94eb-2f61-490a-acde-0bc4441ca8aa None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:33.306119 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 499/1001] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 30 20:45:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:33.311714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f94eb-2f61-490a-acde-0bc4441ca8aa None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:33.362395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:33.367531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae9d4c-7363-4515-8fa7-569c1ad876b2 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:33.406740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf1b55-7e99-4c80-8f91-aa96c8471f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:33.407397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf1b55-7e99-4c80-8f91-aa96c8471f56 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:33.407681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf1b55-7e99-4c80-8f91-aa96c8471f56 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:33.407946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf1b55-7e99-4c80-8f91-aa96c8471f56 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:33.408617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf1b55-7e99-4c80-8f91-aa96c8471f56 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:33.408921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf1b55-7e99-4c80-8f91-aa96c8471f56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:33.410817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf1b55-7e99-4c80-8f91-aa96c8471f56 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:33.415833 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 503/1002] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Jul 30 20:45:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:33.418710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f94eb-2f61-490a-acde-0bc4441ca8aa None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:33.422731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf1b55-7e99-4c80-8f91-aa96c8471f56 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:33.455621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b056dd-8590-487f-ab4e-7e7ed9b1d72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:33.457138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b056dd-8590-487f-ab4e-7e7ed9b1d72c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:33.457588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b056dd-8590-487f-ab4e-7e7ed9b1d72c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:33.457873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b056dd-8590-487f-ab4e-7e7ed9b1d72c None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:33.458553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b056dd-8590-487f-ab4e-7e7ed9b1d72c None admin] RBAC: Adding query filter params (type=compute) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:33.458866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b056dd-8590-487f-ab4e-7e7ed9b1d72c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:33.460272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b056dd-8590-487f-ab4e-7e7ed9b1d72c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:33.467317 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 500/1003] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 30 20:45:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:33.470958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b056dd-8590-487f-ab4e-7e7ed9b1d72c None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:33.481468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:33.535657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf1b55-7e99-4c80-8f91-aa96c8471f56 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:33.572606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5858a9-8d5a-4708-90dd-ee81c3d192cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:33.573232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5858a9-8d5a-4708-90dd-ee81c3d192cc None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:33.573514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5858a9-8d5a-4708-90dd-ee81c3d192cc None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:33.573791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5858a9-8d5a-4708-90dd-ee81c3d192cc None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:33.574465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5858a9-8d5a-4708-90dd-ee81c3d192cc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:33.574767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5858a9-8d5a-4708-90dd-ee81c3d192cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:33.576236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5858a9-8d5a-4708-90dd-ee81c3d192cc None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:33.581790 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 504/1004] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Jul 30 20:45:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:33.587126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5858a9-8d5a-4708-90dd-ee81c3d192cc None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:33.588964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b056dd-8590-487f-ab4e-7e7ed9b1d72c None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:33.601733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:33.626918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e4daa-c612-4499-8efa-305e9dbbaca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:33.627572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e4daa-c612-4499-8efa-305e9dbbaca3 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:33.627864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e4daa-c612-4499-8efa-305e9dbbaca3 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:33.628142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e4daa-c612-4499-8efa-305e9dbbaca3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:33.628965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e4daa-c612-4499-8efa-305e9dbbaca3 None admin] RBAC: Adding query filter params (interface=public, service_id=7db7fe6c5e104105bb67e30a834a890a, region_id=RegionOne) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:33.629278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e4daa-c612-4499-8efa-305e9dbbaca3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:33.630639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e4daa-c612-4499-8efa-305e9dbbaca3 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:33.636836 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 501/1005] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Jul 30 20:45:33 2022] GET /identity/v3/endpoints?service_id=7db7fe6c5e104105bb67e30a834a890a&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:33.642232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e4daa-c612-4499-8efa-305e9dbbaca3 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:33.701913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5858a9-8d5a-4708-90dd-ee81c3d192cc None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:33.716679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:33.739565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26143c4-a42d-45c9-88d8-fe1ac33db6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:33.740184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26143c4-a42d-45c9-88d8-fe1ac33db6aa None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:33.740522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26143c4-a42d-45c9-88d8-fe1ac33db6aa None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:33.740941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26143c4-a42d-45c9-88d8-fe1ac33db6aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:33.741606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26143c4-a42d-45c9-88d8-fe1ac33db6aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:33.742952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26143c4-a42d-45c9-88d8-fe1ac33db6aa None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:33.750206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e4daa-c612-4499-8efa-305e9dbbaca3 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:33.760696 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 505/1006] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 20:45:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 20:45:33.796358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e69665-cdd1-463f-bf1a-ee9a4f335989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:33.796913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e69665-cdd1-463f-bf1a-ee9a4f335989 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:33.797197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e69665-cdd1-463f-bf1a-ee9a4f335989 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:33.797472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e69665-cdd1-463f-bf1a-ee9a4f335989 None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:33.798167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e69665-cdd1-463f-bf1a-ee9a4f335989 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:33.799627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e69665-cdd1-463f-bf1a-ee9a4f335989 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:33.807496 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 502/1007] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Jul 30 20:45:33 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 20:45:35.400382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2266e9-d5c3-41bd-8996-79c58cb100c8 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:35.400997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2266e9-d5c3-41bd-8996-79c58cb100c8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:35.400997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2266e9-d5c3-41bd-8996-79c58cb100c8 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:35.402421 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 506/1008] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:35.407391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de1f9d-2fed-4c62-95d8-b6daf10e4d30 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:35.407775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de1f9d-2fed-4c62-95d8-b6daf10e4d30 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:35.407959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de1f9d-2fed-4c62-95d8-b6daf10e4d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:35.426719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-61de1f9d-2fed-4c62-95d8-b6daf10e4d30 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:35.427947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-61de1f9d-2fed-4c62-95d8-b6daf10e4d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:35.455974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:35.499889 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 503/1009] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:35 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:35.523194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2266e9-d5c3-41bd-8996-79c58cb100c8 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:35.626066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2266e9-d5c3-41bd-8996-79c58cb100c8 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:35.660861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c907d2-b263-44c6-9175-599e2e8f3308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:35.661409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c907d2-b263-44c6-9175-599e2e8f3308 None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:35.661698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c907d2-b263-44c6-9175-599e2e8f3308 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:35.661977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c907d2-b263-44c6-9175-599e2e8f3308 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:35.662686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c907d2-b263-44c6-9175-599e2e8f3308 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:35.664082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c907d2-b263-44c6-9175-599e2e8f3308 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:35.685388 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 507/1010] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 30 20:45:35 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:45:36.078396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f0867-4fd5-4a47-b22d-c8213431ec32 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:36.078732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f0867-4fd5-4a47-b22d-c8213431ec32 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:36.078966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f0867-4fd5-4a47-b22d-c8213431ec32 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:36.080525 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 504/1011] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:36.082915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1b013-cec3-4b5e-881a-755b9b17d535 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:36.083213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1b013-cec3-4b5e-881a-755b9b17d535 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:36.083544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1b013-cec3-4b5e-881a-755b9b17d535 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:36.085093 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 508/1012] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:36.086346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf68c44-bc0c-4ad2-babb-5c030e9e09f7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:36.086640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf68c44-bc0c-4ad2-babb-5c030e9e09f7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:36.086917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf68c44-bc0c-4ad2-babb-5c030e9e09f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:36.091402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cb5ee-6cd0-4ed1-af82-946d94315b56 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:36.091630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cb5ee-6cd0-4ed1-af82-946d94315b56 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:36.091916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cb5ee-6cd0-4ed1-af82-946d94315b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:36.107308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ddf68c44-bc0c-4ad2-babb-5c030e9e09f7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:36.108495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ddf68c44-bc0c-4ad2-babb-5c030e9e09f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:36.109544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e23cb5ee-6cd0-4ed1-af82-946d94315b56 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:36.110725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e23cb5ee-6cd0-4ed1-af82-946d94315b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:36.142525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:36.193369 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 509/1013] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:36 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:45:36.194393 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 505/1014] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:36 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:45:36.218321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cb5ee-6cd0-4ed1-af82-946d94315b56 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:36.218589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf68c44-bc0c-4ad2-babb-5c030e9e09f7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:36.314497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:36.326661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf68c44-bc0c-4ad2-babb-5c030e9e09f7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:36.330742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cb5ee-6cd0-4ed1-af82-946d94315b56 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:36.364044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e51f75-7d76-40f6-a2ed-21da8034bd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:36.364696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e51f75-7d76-40f6-a2ed-21da8034bd1e None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:36.365033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e51f75-7d76-40f6-a2ed-21da8034bd1e None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:36.365251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e51f75-7d76-40f6-a2ed-21da8034bd1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:36.366408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e51f75-7d76-40f6-a2ed-21da8034bd1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:36.367876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e51f75-7d76-40f6-a2ed-21da8034bd1e None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:36.374650 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 506/1015] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:36.374788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c87537-fc49-4b22-ae76-c681ee597042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:36.374788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c87537-fc49-4b22-ae76-c681ee597042 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:36.374788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c87537-fc49-4b22-ae76-c681ee597042 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:36.374788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c87537-fc49-4b22-ae76-c681ee597042 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:36.375090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c87537-fc49-4b22-ae76-c681ee597042 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:36.375681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c87537-fc49-4b22-ae76-c681ee597042 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:36.375853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e51f75-7d76-40f6-a2ed-21da8034bd1e None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:36.385380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-c1c87537-fc49-4b22-ae76-c681ee597042 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 30 20:45:36.385380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:36.385380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:36.385380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:36.385380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:36.385380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:36.385380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:36.385380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:36.385380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 30 20:45:36.385380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:36.385380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:36.385380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:36.385380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:36.385380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:36.385380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:36.385380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:36.385380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:36.386395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:36.386395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:36.386395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:36.386395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:36.386395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:36.386395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:36.386395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:36.386395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:36.386395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:36.386395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:36.386395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:36.386395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:36.386395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:36.386395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:36.386395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:36.386395 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:36.387318 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:36.387318 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:36.387318 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:36.387318 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:36.387318 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:36.387318 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:36.387318 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:36.387318 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:36.387318 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:36.387318 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:36.387318 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:36.387318 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:36.387318 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 30 20:45:36.387318 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:36.391716 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 510/1016] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:45:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:36.392722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c87537-fc49-4b22-ae76-c681ee597042 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:36.426676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:36.490084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e51f75-7d76-40f6-a2ed-21da8034bd1e None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:36.523234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c87537-fc49-4b22-ae76-c681ee597042 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:36.526154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21360187-abdc-4776-a6ba-677efd65fe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:36.526774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21360187-abdc-4776-a6ba-677efd65fe52 None admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:36.527059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21360187-abdc-4776-a6ba-677efd65fe52 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:36.527360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21360187-abdc-4776-a6ba-677efd65fe52 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:36.528048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21360187-abdc-4776-a6ba-677efd65fe52 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:36.529473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21360187-abdc-4776-a6ba-677efd65fe52 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:36.560679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8145a7-cebf-420f-8281-2990644058d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:36.561301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8145a7-cebf-420f-8281-2990644058d7 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:36.561587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8145a7-cebf-420f-8281-2990644058d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:36.561868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8145a7-cebf-420f-8281-2990644058d7 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:36.562538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8145a7-cebf-420f-8281-2990644058d7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:36.562847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8145a7-cebf-420f-8281-2990644058d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:36.564259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8145a7-cebf-420f-8281-2990644058d7 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:36.567495 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 507/1017] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 30 20:45:36 2022] POST /identity/v3/projects => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:45:36.575350 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 511/1018] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 30 20:45:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:36.578634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21360187-abdc-4776-a6ba-677efd65fe52 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:36.594006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:36.693283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21360187-abdc-4776-a6ba-677efd65fe52 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:36.729894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975a367-ec07-44d4-a954-6ccd9cc0753e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:36.730528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975a367-ec07-44d4-a954-6ccd9cc0753e None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:36.730869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975a367-ec07-44d4-a954-6ccd9cc0753e None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:36.731151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975a367-ec07-44d4-a954-6ccd9cc0753e None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:36.731900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975a367-ec07-44d4-a954-6ccd9cc0753e None admin] RBAC: Adding query filter params (type=compute) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:36.732219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975a367-ec07-44d4-a954-6ccd9cc0753e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:36.733592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975a367-ec07-44d4-a954-6ccd9cc0753e None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:36.739451 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 508/1019] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 30 20:45:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:36.745753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8145a7-cebf-420f-8281-2990644058d7 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:36.838311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:36.853592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8145a7-cebf-420f-8281-2990644058d7 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:36.888353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444ef7f-2f78-46f7-9e5b-d7aef45fd4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:36.888975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444ef7f-2f78-46f7-9e5b-d7aef45fd4e6 None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:36.889255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444ef7f-2f78-46f7-9e5b-d7aef45fd4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:36.889528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444ef7f-2f78-46f7-9e5b-d7aef45fd4e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:36.890237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444ef7f-2f78-46f7-9e5b-d7aef45fd4e6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:36.891622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444ef7f-2f78-46f7-9e5b-d7aef45fd4e6 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:36.923346 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 512/1020] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 20:45:36 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:45:37.950852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85734a27-c780-41ad-bf8e-4262702f932c None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:37.951616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85734a27-c780-41ad-bf8e-4262702f932c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:37.951616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85734a27-c780-41ad-bf8e-4262702f932c None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:37.952927 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 509/1021] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:37.958453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5525f59-d2ec-4165-b1db-11e41c6657a5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:37.958850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5525f59-d2ec-4165-b1db-11e41c6657a5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:37.959033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5525f59-d2ec-4165-b1db-11e41c6657a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:37.977486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e5525f59-d2ec-4165-b1db-11e41c6657a5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:37.978685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e5525f59-d2ec-4165-b1db-11e41c6657a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:38.063334 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 513/1022] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:38.086720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85734a27-c780-41ad-bf8e-4262702f932c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:38.166160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:38.195241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85734a27-c780-41ad-bf8e-4262702f932c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:38.230758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d03f7f-431a-4dbe-86b2-415f0c8df806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:38.231351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d03f7f-431a-4dbe-86b2-415f0c8df806 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:38.231641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d03f7f-431a-4dbe-86b2-415f0c8df806 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:38.231919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d03f7f-431a-4dbe-86b2-415f0c8df806 None admin] PATH_INFO: `/v3/services/image` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:38.232543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d03f7f-431a-4dbe-86b2-415f0c8df806 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:38.233912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d03f7f-431a-4dbe-86b2-415f0c8df806 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:38.243494 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-48d03f7f-431a-4dbe-86b2-415f0c8df806 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 30 20:45:38.243494 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:38.243494 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:38.243494 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:38.243494 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:38.243494 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:38.243494 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:38.243494 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:38.243494 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 30 20:45:38.243494 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:38.243494 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:38.243494 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:38.243494 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:38.243494 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:38.243494 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:38.243494 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:38.243494 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:38.244482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:38.244482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:38.244482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:38.244482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:38.244482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:38.244482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:38.244482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:38.244482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:38.244482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:38.244482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:38.244482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:38.244482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:38.244482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:38.244482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:38.244482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:38.244482 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:38.250537 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:38.250537 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:38.250537 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:38.250537 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:38.250537 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:38.250537 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:38.250537 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:38.250537 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:38.250537 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:38.250537 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:38.250537 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:38.250537 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:38.250537 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 30 20:45:38.250537 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:38.250537 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 510/1023] 10.222.0.17 () {56 vars in 1105 bytes} [Sat Jul 30 20:45:38 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:38.251378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5525f59-d2ec-4165-b1db-11e41c6657a5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:38.340990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:38.375156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5525f59-d2ec-4165-b1db-11e41c6657a5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:38.413487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7734fa9-e7a4-488c-8fde-b42609fe7204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:38.414119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7734fa9-e7a4-488c-8fde-b42609fe7204 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:38.414404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7734fa9-e7a4-488c-8fde-b42609fe7204 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:38.414680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7734fa9-e7a4-488c-8fde-b42609fe7204 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:38.415385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7734fa9-e7a4-488c-8fde-b42609fe7204 None admin] RBAC: Adding query filter params (name=image) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:38.415695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7734fa9-e7a4-488c-8fde-b42609fe7204 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:38.417059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7734fa9-e7a4-488c-8fde-b42609fe7204 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:38.427603 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 514/1024] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:38.428522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d03f7f-431a-4dbe-86b2-415f0c8df806 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:38.531301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d03f7f-431a-4dbe-86b2-415f0c8df806 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:38.565304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ad7a8-e011-47a8-8821-ee34b7c713a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:38.566449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ad7a8-e011-47a8-8821-ee34b7c713a3 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:38.566730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ad7a8-e011-47a8-8821-ee34b7c713a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:38.567004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ad7a8-e011-47a8-8821-ee34b7c713a3 None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:38.567710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ad7a8-e011-47a8-8821-ee34b7c713a3 None admin] RBAC: Adding query filter params (type=image) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:38.568071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ad7a8-e011-47a8-8821-ee34b7c713a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:38.569382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ad7a8-e011-47a8-8821-ee34b7c713a3 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:38.582198 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 511/1025] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:38.583975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7734fa9-e7a4-488c-8fde-b42609fe7204 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:38.693014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7734fa9-e7a4-488c-8fde-b42609fe7204 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:38.729535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ccea9-e7ab-467c-8b55-234a3ad944be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:38.730187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ccea9-e7ab-467c-8b55-234a3ad944be None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:38.730475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ccea9-e7ab-467c-8b55-234a3ad944be None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:38.730754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ccea9-e7ab-467c-8b55-234a3ad944be None admin] PATH_INFO: `/v3/endpoints` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:38.731561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ccea9-e7ab-467c-8b55-234a3ad944be None admin] RBAC: Adding query filter params (interface=public, service_id=d20806745846411b8bf099465ce72626, region_id=RegionOne) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:38.731879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ccea9-e7ab-467c-8b55-234a3ad944be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:38.733289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ccea9-e7ab-467c-8b55-234a3ad944be None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:38.735086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:38.746314 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 515/1026] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Jul 30 20:45:38 2022] GET /identity/v3/endpoints?service_id=d20806745846411b8bf099465ce72626&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:38.747660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ad7a8-e011-47a8-8821-ee34b7c713a3 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:38.750657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:38.854567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ad7a8-e011-47a8-8821-ee34b7c713a3 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:38.872485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcc251-79e7-4b73-a2b8-9bae5319074a None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:38.872779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcc251-79e7-4b73-a2b8-9bae5319074a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:38.873033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcc251-79e7-4b73-a2b8-9bae5319074a None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:38.874376 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 516/1027] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:38.880100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdede8a-1c59-40f1-91c9-29c36e4366b2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:38.880385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdede8a-1c59-40f1-91c9-29c36e4366b2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:38.880659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdede8a-1c59-40f1-91c9-29c36e4366b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:38.896097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15614c-1b7d-4287-bd88-259bf733cf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:38.897158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15614c-1b7d-4287-bd88-259bf733cf1c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:38.897711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15614c-1b7d-4287-bd88-259bf733cf1c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:38.898272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15614c-1b7d-4287-bd88-259bf733cf1c None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:38.899463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15614c-1b7d-4287-bd88-259bf733cf1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:38.899570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5fdede8a-1c59-40f1-91c9-29c36e4366b2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:38.900854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5fdede8a-1c59-40f1-91c9-29c36e4366b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:38.902085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15614c-1b7d-4287-bd88-259bf733cf1c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:38.915770 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 512/1028] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Jul 30 20:45:38 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 20:45:38.984071 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 517/1029] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:45:39.011704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15614c-1b7d-4287-bd88-259bf733cf1c None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:39.086293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:39.129976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15614c-1b7d-4287-bd88-259bf733cf1c None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:39.169182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa2d1e-24e8-4879-820d-a88ef4bb8f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:39.170125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa2d1e-24e8-4879-820d-a88ef4bb8f5a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:39.170553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa2d1e-24e8-4879-820d-a88ef4bb8f5a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:39.170984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa2d1e-24e8-4879-820d-a88ef4bb8f5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:39.172342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa2d1e-24e8-4879-820d-a88ef4bb8f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:39.174141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa2d1e-24e8-4879-820d-a88ef4bb8f5a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:39.176364 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 513/1030] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:39.182074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdede8a-1c59-40f1-91c9-29c36e4366b2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:39.283793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdede8a-1c59-40f1-91c9-29c36e4366b2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:39.300339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e46d51-10c4-4640-91c9-656b32e021a0 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:39.300624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e46d51-10c4-4640-91c9-656b32e021a0 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:39.300910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e46d51-10c4-4640-91c9-656b32e021a0 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:39.302410 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 514/1031] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:39.307185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ab4e5-6da5-43c3-9869-6424c8e5761f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:39.307514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ab4e5-6da5-43c3-9869-6424c8e5761f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:39.307796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ab4e5-6da5-43c3-9869-6424c8e5761f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:39.310676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:39.321016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1279bf-fb06-4670-993e-a0d0a489833e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:39.321704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1279bf-fb06-4670-993e-a0d0a489833e None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:39.321987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1279bf-fb06-4670-993e-a0d0a489833e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:39.322259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1279bf-fb06-4670-993e-a0d0a489833e None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:39.322945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1279bf-fb06-4670-993e-a0d0a489833e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:39.324395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1279bf-fb06-4670-993e-a0d0a489833e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:39.326451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0d7ab4e5-6da5-43c3-9869-6424c8e5761f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:39.327753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0d7ab4e5-6da5-43c3-9869-6424c8e5761f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:39.355671 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 518/1032] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 30 20:45:39 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 20:45:39.404123 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 515/1033] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:45:39.429564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1279bf-fb06-4670-993e-a0d0a489833e None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:39.540250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1279bf-fb06-4670-993e-a0d0a489833e None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:39.575784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d19bd-1593-4cb6-b36b-c809de73a5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:39.576437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d19bd-1593-4cb6-b36b-c809de73a5f0 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:39.576727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d19bd-1593-4cb6-b36b-c809de73a5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:39.577008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d19bd-1593-4cb6-b36b-c809de73a5f0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:39.587761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d19bd-1593-4cb6-b36b-c809de73a5f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:45:39.593037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-e10d19bd-1593-4cb6-b36b-c809de73a5f0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 30 20:45:39.593037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:39.593037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:39.593037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:39.593037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:39.593037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:39.593037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:39.593037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:39.593037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:39.593037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:39.593037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:39.593037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:39.593037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:45:39.593037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:45:39.593037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:45:39.593037 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:45:39.594005 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:45:39.594005 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:45:39.594005 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:45:39.594005 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:45:39.594005 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:39.594005 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:39.594005 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:39.594005 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:39.594005 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:39.594005 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:39.594005 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:39.594005 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:39.594005 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:39.594005 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:39.594005 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:39.594005 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:39.594866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:39.594866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:39.594866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:39.594866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:39.594866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:45:39.594866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:45:39.594866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:45:39.594866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:45:39.594866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:45:39.594866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:45:39.594866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 30 20:45:39.594866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:39.594866 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 519/1034] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Jul 30 20:45:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:39.600514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ab4e5-6da5-43c3-9869-6424c8e5761f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:39.666851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:39.706598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ab4e5-6da5-43c3-9869-6424c8e5761f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:39.741218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d961c-fb2f-4378-85bc-e5c376ecd60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:39.741846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d961c-fb2f-4378-85bc-e5c376ecd60c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:39.742130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d961c-fb2f-4378-85bc-e5c376ecd60c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:39.742406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d961c-fb2f-4378-85bc-e5c376ecd60c None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:39.743117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d961c-fb2f-4378-85bc-e5c376ecd60c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:39.743453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d961c-fb2f-4378-85bc-e5c376ecd60c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:39.744821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d961c-fb2f-4378-85bc-e5c376ecd60c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:39.758374 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 516/1035] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Jul 30 20:45:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:39.759756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d19bd-1593-4cb6-b36b-c809de73a5f0 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:39.807129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:39.864431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d19bd-1593-4cb6-b36b-c809de73a5f0 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:39.897481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6562b6b-551a-4015-84b8-29c3000ad9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:39.899652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6562b6b-551a-4015-84b8-29c3000ad9c6 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:39.899652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6562b6b-551a-4015-84b8-29c3000ad9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:39.899652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6562b6b-551a-4015-84b8-29c3000ad9c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:39.910134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6562b6b-551a-4015-84b8-29c3000ad9c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:39.911693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6562b6b-551a-4015-84b8-29c3000ad9c6 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:39.926722 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-e6562b6b-551a-4015-84b8-29c3000ad9c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:39.926722 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:39.926722 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:39.926722 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:39.926722 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:39.926722 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:39.926722 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:39.926722 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:39.926722 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:39.926722 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:39.926722 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:39.926722 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:39.926722 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:39.926722 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:39.926722 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:39.927642 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:39.927642 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:39.927642 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:39.927642 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:39.927642 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:39.927642 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:39.927642 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:39.927642 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:39.927642 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:39.927642 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:39.927642 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:39.927642 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:39.927642 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:39.927642 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:39.927642 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:39.927642 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:39.927642 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:39.928568 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:39.928568 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:39.928568 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:39.928568 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:39.931639 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 520/1036] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:39.933520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d961c-fb2f-4378-85bc-e5c376ecd60c None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:40.051573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d961c-fb2f-4378-85bc-e5c376ecd60c None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:40.075027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:40.086984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed556e8-6034-4c9c-b2f7-5f5e0e1d4e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:40.087832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed556e8-6034-4c9c-b2f7-5f5e0e1d4e1c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:40.088257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed556e8-6034-4c9c-b2f7-5f5e0e1d4e1c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:40.088690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed556e8-6034-4c9c-b2f7-5f5e0e1d4e1c None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:40.089652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed556e8-6034-4c9c-b2f7-5f5e0e1d4e1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:40.090013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed556e8-6034-4c9c-b2f7-5f5e0e1d4e1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:40.093452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed556e8-6034-4c9c-b2f7-5f5e0e1d4e1c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:40.110008 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 517/1037] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:40.111731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6562b6b-551a-4015-84b8-29c3000ad9c6 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:40.211266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:40.218010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6562b6b-551a-4015-84b8-29c3000ad9c6 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:40.251839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254497f-5781-4a01-997e-6c049826005a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:40.252477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254497f-5781-4a01-997e-6c049826005a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:40.252765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254497f-5781-4a01-997e-6c049826005a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:40.253044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254497f-5781-4a01-997e-6c049826005a None admin] PATH_INFO: `/v3/users/nova` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:40.260373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254497f-5781-4a01-997e-6c049826005a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:40.261827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254497f-5781-4a01-997e-6c049826005a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:40.273414 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-4254497f-5781-4a01-997e-6c049826005a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 30 20:45:40.273414 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:40.273414 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:40.273414 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:40.273414 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:40.273414 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:40.273414 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:40.273414 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:40.273414 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:40.273414 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:40.273414 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:40.273414 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:40.273414 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:45:40.273414 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:45:40.273414 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:45:40.273414 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:45:40.274382 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:40.274382 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:40.274382 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:45:40.274382 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:40.274382 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:45:40.274382 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:40.274382 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:40.274382 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:40.274382 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:40.274382 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:40.274382 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:40.274382 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:40.274382 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:40.274382 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:40.274382 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:40.274382 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:40.274382 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:40.274382 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:40.275427 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:40.275427 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:40.275427 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:45:40.275427 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:45:40.275427 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:45:40.275427 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:45:40.275427 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:45:40.275427 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:45:40.275427 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 30 20:45:40.275427 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:40.275427 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 521/1038] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Jul 30 20:45:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:40.282274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed556e8-6034-4c9c-b2f7-5f5e0e1d4e1c None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:40.387569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed556e8-6034-4c9c-b2f7-5f5e0e1d4e1c None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:40.422174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27de0d1-82c7-4007-86a5-02cfa68dfecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:40.422795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27de0d1-82c7-4007-86a5-02cfa68dfecb None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:40.423081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27de0d1-82c7-4007-86a5-02cfa68dfecb None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:40.423389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27de0d1-82c7-4007-86a5-02cfa68dfecb None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:40.424189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27de0d1-82c7-4007-86a5-02cfa68dfecb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:40.424501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27de0d1-82c7-4007-86a5-02cfa68dfecb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:40.425966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27de0d1-82c7-4007-86a5-02cfa68dfecb None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:40.447320 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 518/1039] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Jul 30 20:45:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:40.449077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254497f-5781-4a01-997e-6c049826005a None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:40.553671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254497f-5781-4a01-997e-6c049826005a None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:40.588416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9b417-82c4-44a4-b685-7c2e64c334fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:40.589043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9b417-82c4-44a4-b685-7c2e64c334fd None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:40.589325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9b417-82c4-44a4-b685-7c2e64c334fd None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:40.589596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9b417-82c4-44a4-b685-7c2e64c334fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:40.615409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:40.660666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9b417-82c4-44a4-b685-7c2e64c334fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:40.662124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9b417-82c4-44a4-b685-7c2e64c334fd None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:40.770510 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 522/1040] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:45:40 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 30 20:45:40.771795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27de0d1-82c7-4007-86a5-02cfa68dfecb None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:40.819282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:40.874670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27de0d1-82c7-4007-86a5-02cfa68dfecb None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:40.909035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87037131-1662-4add-96a2-d05cec2f0d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:40.909698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87037131-1662-4add-96a2-d05cec2f0d49 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:40.909978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87037131-1662-4add-96a2-d05cec2f0d49 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:40.910249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87037131-1662-4add-96a2-d05cec2f0d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:40.920471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87037131-1662-4add-96a2-d05cec2f0d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:40.921907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87037131-1662-4add-96a2-d05cec2f0d49 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:40.937028 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-87037131-1662-4add-96a2-d05cec2f0d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:40.937028 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:40.937028 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:40.937028 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:40.937028 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:40.937028 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:40.937028 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:40.937028 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:40.937028 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:40.937028 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:40.937028 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:40.937028 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:40.937028 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:40.937028 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:40.937028 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:40.937934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:40.937934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:40.937934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:40.937934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:40.937934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:40.937934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:40.937934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:40.937934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:40.937934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:40.937934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:40.937934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:40.937934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:40.937934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:40.937934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:40.937934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:40.937934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:40.937934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:40.938862 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:40.938862 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:40.938862 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:40.938862 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:40.938862 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 519/1041] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:40.945498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9b417-82c4-44a4-b685-7c2e64c334fd None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:41.003530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:41.062414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9b417-82c4-44a4-b685-7c2e64c334fd None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:41.102532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dc28a-88a3-4a19-b6d5-cc7b6840b1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:41.103084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dc28a-88a3-4a19-b6d5-cc7b6840b1c2 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:41.103400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dc28a-88a3-4a19-b6d5-cc7b6840b1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:41.103705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dc28a-88a3-4a19-b6d5-cc7b6840b1c2 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:41.104392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1dc28a-88a3-4a19-b6d5-cc7b6840b1c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:41.104786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1dc28a-88a3-4a19-b6d5-cc7b6840b1c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:41.106166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1dc28a-88a3-4a19-b6d5-cc7b6840b1c2 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:41.118081 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 523/1042] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:41.123790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87037131-1662-4add-96a2-d05cec2f0d49 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:41.198973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8ebcb-b649-4f13-be4f-681c391f706e None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:41.199266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8ebcb-b649-4f13-be4f-681c391f706e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:41.199611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8ebcb-b649-4f13-be4f-681c391f706e None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:41.200987 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 524/1043] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:45:41.206038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4bf1d-ca05-40c8-81f3-64200ffe7145 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:41.206377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4bf1d-ca05-40c8-81f3-64200ffe7145 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:41.206658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4bf1d-ca05-40c8-81f3-64200ffe7145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:41.223640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:41.224449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e9b4bf1d-ca05-40c8-81f3-64200ffe7145 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:41.225653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e9b4bf1d-ca05-40c8-81f3-64200ffe7145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:41.231867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87037131-1662-4add-96a2-d05cec2f0d49 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:41.267875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a985c-bc65-42c6-9a98-3ce1ee7bdf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:41.268512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a985c-bc65-42c6-9a98-3ce1ee7bdf21 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:41.268825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a985c-bc65-42c6-9a98-3ce1ee7bdf21 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:41.269100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a985c-bc65-42c6-9a98-3ce1ee7bdf21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:41.275845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a985c-bc65-42c6-9a98-3ce1ee7bdf21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:41.277280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a985c-bc65-42c6-9a98-3ce1ee7bdf21 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:41.288495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-b55a985c-bc65-42c6-9a98-3ce1ee7bdf21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:41.288495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:41.288495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:41.288495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:41.288495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:41.288495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:41.288495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:41.288495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:41.288495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:41.288495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:41.288495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:41.288495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:41.288495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:45:41.288495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:45:41.288495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:45:41.289422 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:45:41.289422 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:41.289422 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:41.289422 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:41.289422 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:41.289422 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:41.289422 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:41.289422 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:41.289422 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:41.289422 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:41.289422 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:41.289422 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:41.289422 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:41.289422 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:41.289422 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:41.289422 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:41.289422 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:41.290330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:45:41.290330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:45:41.290330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:45:41.290330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:45:41.290330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:45:41.290330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:45:41.290330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:41.290330 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:41.290330 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 520/1044] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:45:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:41.295360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a985c-bc65-42c6-9a98-3ce1ee7bdf21 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:41.299421 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 525/1045] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:45:41.321483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4bf1d-ca05-40c8-81f3-64200ffe7145 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:41.369655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:41.404700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a985c-bc65-42c6-9a98-3ce1ee7bdf21 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:41.424652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4bf1d-ca05-40c8-81f3-64200ffe7145 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:41.439527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2732e6-9f96-44ce-a14b-95ddc9bcfa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:41.440157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2732e6-9f96-44ce-a14b-95ddc9bcfa32 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:41.440442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2732e6-9f96-44ce-a14b-95ddc9bcfa32 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:41.441241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2732e6-9f96-44ce-a14b-95ddc9bcfa32 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:41.441991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2732e6-9f96-44ce-a14b-95ddc9bcfa32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:41.442299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2732e6-9f96-44ce-a14b-95ddc9bcfa32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:41.443763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2732e6-9f96-44ce-a14b-95ddc9bcfa32 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:41.456586 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 521/1046] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:45:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:41.462172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2732e6-9f96-44ce-a14b-95ddc9bcfa32 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:41.464035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbe683-19f2-44ad-9fa6-4e2a50c481b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:41.464695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbe683-19f2-44ad-9fa6-4e2a50c481b7 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:41.464978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbe683-19f2-44ad-9fa6-4e2a50c481b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:41.465251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbe683-19f2-44ad-9fa6-4e2a50c481b7 None admin] PATH_INFO: `/v3/services/image` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:41.465881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cbe683-19f2-44ad-9fa6-4e2a50c481b7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:41.467356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cbe683-19f2-44ad-9fa6-4e2a50c481b7 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:41.477086 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-d9cbe683-19f2-44ad-9fa6-4e2a50c481b7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 30 20:45:41.477086 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:41.477086 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:45:41.477086 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:45:41.477086 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:45:41.477086 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:45:41.477086 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:45:41.477086 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:41.477086 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 30 20:45:41.477086 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:41.477086 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:45:41.477086 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:41.477086 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:41.477086 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:41.477086 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:41.477086 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:41.477086 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:41.478105 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:41.478105 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:41.478105 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:41.478105 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:41.478105 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:41.478105 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:41.478105 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:45:41.478105 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:45:41.478105 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:45:41.478105 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:45:41.478105 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:41.478105 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:41.478105 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:41.478105 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:41.478105 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:41.478105 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:41.480447 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:41.480447 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:41.480447 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:41.480447 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:41.480447 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:41.480447 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:41.480447 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:41.480447 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:41.480447 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:41.480447 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:41.480447 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:45:41.480447 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:45:41.480447 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 30 20:45:41.480447 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:41.480447 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 526/1047] 10.222.0.17 () {56 vars in 1105 bytes} [Sat Jul 30 20:45:41 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:41.485424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:41.485599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbe683-19f2-44ad-9fa6-4e2a50c481b7 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:41.577461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2732e6-9f96-44ce-a14b-95ddc9bcfa32 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:41.597477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbe683-19f2-44ad-9fa6-4e2a50c481b7 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:41.607907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:41.616421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5281c-c5d5-46c6-9840-f4fbfcb995f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:41.617052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5281c-c5d5-46c6-9840-f4fbfcb995f9 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:41.617342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5281c-c5d5-46c6-9840-f4fbfcb995f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:41.617616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5281c-c5d5-46c6-9840-f4fbfcb995f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:41.618525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5281c-c5d5-46c6-9840-f4fbfcb995f9 None admin] RBAC: Adding query filter params (role.id=eac828dd4fbe49b8807c54ed514b5095, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=08a2a5793b7a4797a470719a682e541a) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:41.618831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5281c-c5d5-46c6-9840-f4fbfcb995f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:41.620731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5281c-c5d5-46c6-9840-f4fbfcb995f9 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:41.635321 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 522/1048] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:45:41 2022] GET /identity/v3/role_assignments?user.id=08a2a5793b7a4797a470719a682e541a&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=eac828dd4fbe49b8807c54ed514b5095 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:41.642091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d56c15-71b7-4f58-9590-694a49c0c687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:41.642843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d56c15-71b7-4f58-9590-694a49c0c687 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:41.643197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d56c15-71b7-4f58-9590-694a49c0c687 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:41.643596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d56c15-71b7-4f58-9590-694a49c0c687 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:41.644460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d56c15-71b7-4f58-9590-694a49c0c687 None admin] RBAC: Adding query filter params (name=image) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:41.644837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d56c15-71b7-4f58-9590-694a49c0c687 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:41.646455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d56c15-71b7-4f58-9590-694a49c0c687 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:41.650220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811a2ef-4182-42a9-9cc2-25db2f32de83 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:41.650811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811a2ef-4182-42a9-9cc2-25db2f32de83 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:41.651338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811a2ef-4182-42a9-9cc2-25db2f32de83 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:41.652933 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 527/1049] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:41.653099 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 523/1050] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:45:41.658619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d56c15-71b7-4f58-9590-694a49c0c687 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:41.659104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14c9a0-49c7-4b91-b42a-c6e763cb597a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:41.660044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14c9a0-49c7-4b91-b42a-c6e763cb597a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:41.660327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14c9a0-49c7-4b91-b42a-c6e763cb597a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:41.680850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8b14c9a0-49c7-4b91-b42a-c6e763cb597a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:41.682401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8b14c9a0-49c7-4b91-b42a-c6e763cb597a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:41.764603 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 524/1051] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:41.769736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d56c15-71b7-4f58-9590-694a49c0c687 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:41.790842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14c9a0-49c7-4b91-b42a-c6e763cb597a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:41.803350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:41.807869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5ba04-89f0-4ce5-81c1-7f0c1f01edee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:41.808482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5ba04-89f0-4ce5-81c1-7f0c1f01edee None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:41.808764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5ba04-89f0-4ce5-81c1-7f0c1f01edee None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:41.809038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5ba04-89f0-4ce5-81c1-7f0c1f01edee None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:41.809717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5ba04-89f0-4ce5-81c1-7f0c1f01edee None admin] RBAC: Adding query filter params (type=image) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:41.810018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5ba04-89f0-4ce5-81c1-7f0c1f01edee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:41.811426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5ba04-89f0-4ce5-81c1-7f0c1f01edee None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:41.822471 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 528/1052] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:41.827655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5ba04-89f0-4ce5-81c1-7f0c1f01edee None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:41.872745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:41.898327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14c9a0-49c7-4b91-b42a-c6e763cb597a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:41.935756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1416a-7c0e-4324-96fb-319c0ba3d0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:41.936398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1416a-7c0e-4324-96fb-319c0ba3d0e3 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:41.936676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1416a-7c0e-4324-96fb-319c0ba3d0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:41.936950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1416a-7c0e-4324-96fb-319c0ba3d0e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:41.939814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5ba04-89f0-4ce5-81c1-7f0c1f01edee None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:41.949287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1416a-7c0e-4324-96fb-319c0ba3d0e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:45:41.956902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-d3c1416a-7c0e-4324-96fb-319c0ba3d0e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:45:41.956902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:41.956902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:41.956902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:41.956902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:41.956902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:41.956902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:41.956902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:41.956902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:41.956902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:41.956902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:41.956902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:41.956902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:45:41.956902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:45:41.956902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:45:41.956902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:45:41.957843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:45:41.957843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:45:41.957843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:45:41.957843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:45:41.957843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:41.957843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:41.957843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:41.957843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:41.957843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:41.957843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:41.957843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:41.957843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:41.957843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:41.957843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:41.957843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:41.957843 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:41.958695 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:41.958695 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:41.958695 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:41.958695 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:41.958695 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:45:41.958695 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:45:41.958695 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:45:41.958695 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:45:41.958695 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:45:41.958695 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:45:41.958695 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:45:41.958695 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:41.960586 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 525/1053] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:45:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:41.967714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1416a-7c0e-4324-96fb-319c0ba3d0e3 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:41.982425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366785ff-58ce-4241-8550-b30ce57f4da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:41.983408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366785ff-58ce-4241-8550-b30ce57f4da7 None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:41.983699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366785ff-58ce-4241-8550-b30ce57f4da7 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:41.983979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366785ff-58ce-4241-8550-b30ce57f4da7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:41.984770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366785ff-58ce-4241-8550-b30ce57f4da7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:41.986258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366785ff-58ce-4241-8550-b30ce57f4da7 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:42.027330 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 529/1054] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 20:45:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 20:45:42.060246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:42.099842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1416a-7c0e-4324-96fb-319c0ba3d0e3 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:42.150196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0611d-34a5-4256-b309-ecaebf0e4171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:42.150852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0611d-34a5-4256-b309-ecaebf0e4171 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:42.151087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0611d-34a5-4256-b309-ecaebf0e4171 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:42.151328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0611d-34a5-4256-b309-ecaebf0e4171 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:42.152083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0611d-34a5-4256-b309-ecaebf0e4171 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:42.152395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0611d-34a5-4256-b309-ecaebf0e4171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:42.153800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0611d-34a5-4256-b309-ecaebf0e4171 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:42.164041 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 526/1055] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:45:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:42.170068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366785ff-58ce-4241-8550-b30ce57f4da7 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:42.276118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:42.285465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366785ff-58ce-4241-8550-b30ce57f4da7 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:42.320848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3dc880-35be-4fc3-b045-8b50bf2c805c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:42.321501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3dc880-35be-4fc3-b045-8b50bf2c805c None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:42.321788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3dc880-35be-4fc3-b045-8b50bf2c805c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:42.322066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3dc880-35be-4fc3-b045-8b50bf2c805c None admin] PATH_INFO: `/v3/users/72816754b8774ac8ab2a899d13b8f4c1` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:42.340229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3dc880-35be-4fc3-b045-8b50bf2c805c None admin] RBAC: Authorizing `identity:get_user(user_id=72816754b8774ac8ab2a899d13b8f4c1)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:42.341706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3dc880-35be-4fc3-b045-8b50bf2c805c None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:42.343632 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 530/1056] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:45:42 2022] GET /identity/v3/users/72816754b8774ac8ab2a899d13b8f4c1 => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:42.349563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0611d-34a5-4256-b309-ecaebf0e4171 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:42.458290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0611d-34a5-4256-b309-ecaebf0e4171 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:42.484484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:42.493652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b6bc9-69ce-471e-9234-f34e834e7b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:42.494280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b6bc9-69ce-471e-9234-f34e834e7b1e None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:42.494567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b6bc9-69ce-471e-9234-f34e834e7b1e None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:42.494848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b6bc9-69ce-471e-9234-f34e834e7b1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:42.563842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b6bc9-69ce-471e-9234-f34e834e7b1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:42.565308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b6bc9-69ce-471e-9234-f34e834e7b1e None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:42.671094 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 527/1057] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:45:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 30 20:45:42.672440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3dc880-35be-4fc3-b045-8b50bf2c805c None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:42.775069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3dc880-35be-4fc3-b045-8b50bf2c805c None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:42.809834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4696a-d02f-4ccf-be56-768f5e909085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:42.810494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4696a-d02f-4ccf-be56-768f5e909085 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:42.810755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4696a-d02f-4ccf-be56-768f5e909085 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:42.811030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4696a-d02f-4ccf-be56-768f5e909085 None admin] PATH_INFO: `/v3/projects/8acf66fd199c40e6a827c80865794934` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:42.812228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4696a-d02f-4ccf-be56-768f5e909085 None admin] RBAC: Authorizing `identity:get_project(project_id=8acf66fd199c40e6a827c80865794934)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:42.813661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4696a-d02f-4ccf-be56-768f5e909085 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:42.815363 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 531/1058] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:45:42 2022] GET /identity/v3/projects/8acf66fd199c40e6a827c80865794934 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:42.822142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b6bc9-69ce-471e-9234-f34e834e7b1e None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:42.850501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:42.924348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b6bc9-69ce-471e-9234-f34e834e7b1e None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:42.957944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816adef0-8d26-4d7b-8720-58b9f6bab06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:42.958694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816adef0-8d26-4d7b-8720-58b9f6bab06d None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:42.959085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816adef0-8d26-4d7b-8720-58b9f6bab06d None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:42.959500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816adef0-8d26-4d7b-8720-58b9f6bab06d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:42.960388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816adef0-8d26-4d7b-8720-58b9f6bab06d None admin] RBAC: Adding query filter params (role.id=3b89b89da98d4ec08a0587aa13832636, scope.project.id=8acf66fd199c40e6a827c80865794934, user.id=72816754b8774ac8ab2a899d13b8f4c1) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:42.960800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816adef0-8d26-4d7b-8720-58b9f6bab06d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:42.962327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816adef0-8d26-4d7b-8720-58b9f6bab06d None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:42.973306 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 528/1059] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:45:42 2022] GET /identity/v3/role_assignments?user.id=72816754b8774ac8ab2a899d13b8f4c1&scope.project.id=8acf66fd199c40e6a827c80865794934&role.id=3b89b89da98d4ec08a0587aa13832636 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:43.855539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09601dd-5d33-4d79-86d7-ba8b02335ba6 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:43.856083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09601dd-5d33-4d79-86d7-ba8b02335ba6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:43.856083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09601dd-5d33-4d79-86d7-ba8b02335ba6 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:43.857596 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 532/1060] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:43.862719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2570255-98f5-44f1-b2f2-2b63f063fde3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:43.863173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2570255-98f5-44f1-b2f2-2b63f063fde3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:43.863331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2570255-98f5-44f1-b2f2-2b63f063fde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:43.882373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f2570255-98f5-44f1-b2f2-2b63f063fde3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:43.883678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f2570255-98f5-44f1-b2f2-2b63f063fde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:43.951324 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 529/1061] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:43.975960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09601dd-5d33-4d79-86d7-ba8b02335ba6 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:44.003931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:44.093292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09601dd-5d33-4d79-86d7-ba8b02335ba6 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:44.136363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba13696-be01-4d73-9f10-320aefba4405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:44.136935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba13696-be01-4d73-9f10-320aefba4405 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:44.137221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba13696-be01-4d73-9f10-320aefba4405 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:44.137497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba13696-be01-4d73-9f10-320aefba4405 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:44.148545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba13696-be01-4d73-9f10-320aefba4405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:45:44.153616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-2ba13696-be01-4d73-9f10-320aefba4405 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 30 20:45:44.153616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:44.153616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:44.153616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:44.153616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:44.153616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:44.153616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:44.153616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:44.153616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:44.153616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:44.153616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:44.153616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:44.153616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:45:44.153616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:45:44.153616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:45:44.153616 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:45:44.154712 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:45:44.154712 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:45:44.154712 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:45:44.154712 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:45:44.154712 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:44.154712 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:44.154712 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:44.154712 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:44.154712 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:44.154712 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:44.154712 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:44.154712 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:44.154712 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:44.154712 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:44.154712 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:44.154712 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:44.161219 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:44.161219 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:44.161219 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:44.161219 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:44.161219 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:45:44.161219 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:45:44.161219 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:45:44.161219 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:45:44.161219 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:45:44.161219 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:45:44.161219 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 30 20:45:44.161219 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:44.161219 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 533/1062] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Jul 30 20:45:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:44.163625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2570255-98f5-44f1-b2f2-2b63f063fde3 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:44.191256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:44.268463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2570255-98f5-44f1-b2f2-2b63f063fde3 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:44.303257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77352165-4bfd-44b9-a93c-f5c1349a9522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:44.303930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77352165-4bfd-44b9-a93c-f5c1349a9522 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:44.304219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77352165-4bfd-44b9-a93c-f5c1349a9522 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:44.304496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77352165-4bfd-44b9-a93c-f5c1349a9522 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:44.305214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77352165-4bfd-44b9-a93c-f5c1349a9522 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:44.305523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77352165-4bfd-44b9-a93c-f5c1349a9522 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:44.307877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77352165-4bfd-44b9-a93c-f5c1349a9522 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:44.322748 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 530/1063] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Jul 30 20:45:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:44.322925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d8bae-c6c0-4ed7-9021-da614be3042b None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:44.322925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d8bae-c6c0-4ed7-9021-da614be3042b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:44.322925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d8bae-c6c0-4ed7-9021-da614be3042b None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:44.322925 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 534/1064] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:44.324032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77352165-4bfd-44b9-a93c-f5c1349a9522 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:44.328503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530fde-3ea9-4f54-b9c4-6d074593f16e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:44.328920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530fde-3ea9-4f54-b9c4-6d074593f16e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:44.329304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530fde-3ea9-4f54-b9c4-6d074593f16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:44.350400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-cc530fde-3ea9-4f54-b9c4-6d074593f16e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:44.352073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cc530fde-3ea9-4f54-b9c4-6d074593f16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:44.418007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:44.428106 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 535/1065] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:44.439475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77352165-4bfd-44b9-a93c-f5c1349a9522 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:44.452023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc530fde-3ea9-4f54-b9c4-6d074593f16e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:44.464478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:44.476939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b7501-c413-4dfe-abe6-fc3a5fc434d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:44.477736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b7501-c413-4dfe-abe6-fc3a5fc434d0 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:44.478117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b7501-c413-4dfe-abe6-fc3a5fc434d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:44.478491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b7501-c413-4dfe-abe6-fc3a5fc434d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:44.489369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b7501-c413-4dfe-abe6-fc3a5fc434d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:44.490819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b7501-c413-4dfe-abe6-fc3a5fc434d0 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:44.506204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-e03b7501-c413-4dfe-abe6-fc3a5fc434d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:44.506204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:44.506204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:44.506204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:44.506204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:44.506204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:44.506204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:44.506204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:44.506204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:44.506204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:44.506204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:44.506204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:44.506204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:44.506204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:44.506204 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:44.507366 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:44.507366 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:44.507366 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:44.507366 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:44.507366 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:44.507366 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:44.507366 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:44.507366 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:44.507366 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:44.507366 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:44.507366 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:44.507366 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:44.507366 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:44.507366 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:44.507366 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:44.507366 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:44.507366 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:44.508577 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:44.508577 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:44.508577 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:44.508577 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:44.512182 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 531/1066] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:44.513068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b7501-c413-4dfe-abe6-fc3a5fc434d0 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:44.564951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc530fde-3ea9-4f54-b9c4-6d074593f16e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:44.600967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cf334-6a98-41c4-b9a4-e1b15aa679dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:44.601600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cf334-6a98-41c4-b9a4-e1b15aa679dd None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:44.601882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cf334-6a98-41c4-b9a4-e1b15aa679dd None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:44.602160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cf334-6a98-41c4-b9a4-e1b15aa679dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:44.620706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b7501-c413-4dfe-abe6-fc3a5fc434d0 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:44.664192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe688a5-553f-4e3d-8086-242569cff790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:44.664880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe688a5-553f-4e3d-8086-242569cff790 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:44.665170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe688a5-553f-4e3d-8086-242569cff790 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:44.665449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe688a5-553f-4e3d-8086-242569cff790 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:44.666459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe688a5-553f-4e3d-8086-242569cff790 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:44.667026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe688a5-553f-4e3d-8086-242569cff790 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:44.669589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe688a5-553f-4e3d-8086-242569cff790 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:44.672798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:44.684752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cf334-6a98-41c4-b9a4-e1b15aa679dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:44.686216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cf334-6a98-41c4-b9a4-e1b15aa679dd None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:44.686756 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 532/1067] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:44.692805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe688a5-553f-4e3d-8086-242569cff790 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:44.699755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:44.796373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe688a5-553f-4e3d-8086-242569cff790 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:44.798846 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 536/1068] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:45:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 30 20:45:44.805475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cf334-6a98-41c4-b9a4-e1b15aa679dd None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:44.835030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb900bd6-1c9e-4e7b-9c19-bf0c18db8633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:44.835977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb900bd6-1c9e-4e7b-9c19-bf0c18db8633 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:44.836266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb900bd6-1c9e-4e7b-9c19-bf0c18db8633 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:44.836547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb900bd6-1c9e-4e7b-9c19-bf0c18db8633 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:44.845656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb900bd6-1c9e-4e7b-9c19-bf0c18db8633 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:44.847625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb900bd6-1c9e-4e7b-9c19-bf0c18db8633 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:44.863108 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-eb900bd6-1c9e-4e7b-9c19-bf0c18db8633 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 30 20:45:44.863108 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:44.863108 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:44.863108 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:44.863108 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:44.863108 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:44.863108 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:44.863108 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:44.863108 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:44.863108 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:44.863108 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:44.863108 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:44.863108 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:45:44.863108 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:45:44.863108 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:45:44.863108 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:45:44.864557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:44.864557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:44.864557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:45:44.864557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:44.864557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:45:44.864557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:44.864557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:44.864557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:44.864557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:44.864557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:44.864557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:44.864557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:44.864557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:44.864557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:44.864557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:44.864557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:44.864557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:44.864557 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:44.865508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:44.865508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:44.865508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:45:44.865508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:45:44.865508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:45:44.865508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:45:44.865508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:45:44.865508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:45:44.865508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 30 20:45:44.865508 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:44.866839 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 533/1069] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Jul 30 20:45:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:44.871503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb900bd6-1c9e-4e7b-9c19-bf0c18db8633 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:44.913723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cf334-6a98-41c4-b9a4-e1b15aa679dd None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:44.924536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:44.932965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:44.950988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0422c-9d1d-449d-8bed-fdff8b5000c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:44.951664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0422c-9d1d-449d-8bed-fdff8b5000c1 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:44.951951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0422c-9d1d-449d-8bed-fdff8b5000c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:44.952225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0422c-9d1d-449d-8bed-fdff8b5000c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:44.962605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0422c-9d1d-449d-8bed-fdff8b5000c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:44.964173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0422c-9d1d-449d-8bed-fdff8b5000c1 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:44.980654 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-53b0422c-9d1d-449d-8bed-fdff8b5000c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:44.980654 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:44.980654 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:44.980654 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:44.980654 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:44.980654 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:44.980654 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:44.980654 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:44.980654 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:44.980654 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:44.980654 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:44.980654 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:44.980654 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:44.980654 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:44.980654 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:44.981623 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:44.981623 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:44.981623 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:44.981623 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:44.981623 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:44.981623 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:44.981623 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:44.981623 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:44.981623 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:44.981623 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:44.981623 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:44.981623 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:44.981623 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:44.981623 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:44.981623 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:44.981623 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:44.981623 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:44.982552 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:44.982552 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:44.982552 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:44.982552 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:44.982779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb900bd6-1c9e-4e7b-9c19-bf0c18db8633 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:44.982868 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 537/1070] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:44.990742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0422c-9d1d-449d-8bed-fdff8b5000c1 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:45.034013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda6090-39a0-43b2-ad3c-f4f183a6e317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:45.034869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda6090-39a0-43b2-ad3c-f4f183a6e317 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:45.035311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda6090-39a0-43b2-ad3c-f4f183a6e317 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:45.035732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda6090-39a0-43b2-ad3c-f4f183a6e317 None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:45.036537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda6090-39a0-43b2-ad3c-f4f183a6e317 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:45.036848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda6090-39a0-43b2-ad3c-f4f183a6e317 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:45.039096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda6090-39a0-43b2-ad3c-f4f183a6e317 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:45.064214 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 534/1071] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Jul 30 20:45:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:45.066018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda6090-39a0-43b2-ad3c-f4f183a6e317 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:45.116265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0422c-9d1d-449d-8bed-fdff8b5000c1 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:45.155159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c061aa9-fd8d-4f41-96d6-3f9233bbfcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:45.155822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c061aa9-fd8d-4f41-96d6-3f9233bbfcc9 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:45.156110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c061aa9-fd8d-4f41-96d6-3f9233bbfcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:45.156394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c061aa9-fd8d-4f41-96d6-3f9233bbfcc9 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:45.157075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c061aa9-fd8d-4f41-96d6-3f9233bbfcc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:45.157581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c061aa9-fd8d-4f41-96d6-3f9233bbfcc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:45.158898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c061aa9-fd8d-4f41-96d6-3f9233bbfcc9 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:45.172569 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 538/1072] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:45.177433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda6090-39a0-43b2-ad3c-f4f183a6e317 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:45.195574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:45.217848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1ede3-0364-4f8c-89d3-df5aedc30560 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:45.218142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1ede3-0364-4f8c-89d3-df5aedc30560 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:45.218421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1ede3-0364-4f8c-89d3-df5aedc30560 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:45.219824 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 539/1073] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:45:45.220481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e6c82-78e6-4bf5-9eb3-7ef4ec2109f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:45.221372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e6c82-78e6-4bf5-9eb3-7ef4ec2109f4 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:45.222387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e6c82-78e6-4bf5-9eb3-7ef4ec2109f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:45.222882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e6c82-78e6-4bf5-9eb3-7ef4ec2109f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:45.225889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33edf5-6d1d-40cf-85e4-960a494b54a1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:45.226180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33edf5-6d1d-40cf-85e4-960a494b54a1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:45.226461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33edf5-6d1d-40cf-85e4-960a494b54a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:45.236783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e6c82-78e6-4bf5-9eb3-7ef4ec2109f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:45.239576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e6c82-78e6-4bf5-9eb3-7ef4ec2109f4 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:45.246327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2b33edf5-6d1d-40cf-85e4-960a494b54a1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:45.247606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2b33edf5-6d1d-40cf-85e4-960a494b54a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:45.258992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-120e6c82-78e6-4bf5-9eb3-7ef4ec2109f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:45.258992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:45.258992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:45.258992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:45.258992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:45.258992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:45.258992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:45.258992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:45.258992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:45.258992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:45.258992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:45.258992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:45.258992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:45.258992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:45.258992 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:45.260279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:45.260279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:45.260279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:45.260279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:45.260279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:45.260279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:45.260279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:45.260279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:45.260279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:45.260279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:45.260279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:45.260279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:45.260279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:45.260279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:45.260279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:45.260279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:45.260279 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:45.261315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:45.261315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:45.261315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:45.261315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:45.267536 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 535/1074] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:45.269339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e6c82-78e6-4bf5-9eb3-7ef4ec2109f4 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:45.270325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:45.322534 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 540/1075] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:45:45.346478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33edf5-6d1d-40cf-85e4-960a494b54a1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:45.393443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e6c82-78e6-4bf5-9eb3-7ef4ec2109f4 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:45.431235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82dd6c-086e-40c7-af29-7532a6db7696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:45.431976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82dd6c-086e-40c7-af29-7532a6db7696 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:45.432361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82dd6c-086e-40c7-af29-7532a6db7696 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:45.432746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82dd6c-086e-40c7-af29-7532a6db7696 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:45.433545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82dd6c-086e-40c7-af29-7532a6db7696 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:45.433952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82dd6c-086e-40c7-af29-7532a6db7696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:45.435462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82dd6c-086e-40c7-af29-7532a6db7696 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:45.470965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33edf5-6d1d-40cf-85e4-960a494b54a1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:45.510621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30f8ca-20d7-4d98-92cb-fd945e6ab3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:45.511302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30f8ca-20d7-4d98-92cb-fd945e6ab3f2 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:45.511606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30f8ca-20d7-4d98-92cb-fd945e6ab3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:45.511890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30f8ca-20d7-4d98-92cb-fd945e6ab3f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:45.523851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30f8ca-20d7-4d98-92cb-fd945e6ab3f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:45:45.528962 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-3f30f8ca-20d7-4d98-92cb-fd945e6ab3f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:45:45.528962 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:45.528962 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:45.528962 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:45.528962 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:45.528962 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:45.528962 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:45.528962 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:45.528962 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:45.528962 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:45.528962 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:45.528962 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:45.528962 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:45:45.528962 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:45:45.528962 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:45:45.528962 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:45:45.530098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:45:45.530098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:45:45.530098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:45:45.530098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:45:45.530098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:45.530098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:45.530098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:45.530098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:45.530098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:45.530098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:45.530098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:45.530098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:45.530098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:45.530098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:45.530098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:45.530098 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:45.531121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:45.531121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:45.531121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:45.531121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:45.531121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:45:45.531121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:45:45.531121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:45:45.531121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:45:45.531121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:45:45.531121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:45:45.531121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:45:45.531121 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:45.535330 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 541/1076] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:45:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:45.536477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30f8ca-20d7-4d98-92cb-fd945e6ab3f2 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:45.552994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:45.575427 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 536/1077] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:45.581046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82dd6c-086e-40c7-af29-7532a6db7696 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:45.608244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:45.643552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30f8ca-20d7-4d98-92cb-fd945e6ab3f2 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:45.677562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc5ec5-4518-4360-9a63-339c671c48aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:45.678170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc5ec5-4518-4360-9a63-339c671c48aa None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:45.678452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc5ec5-4518-4360-9a63-339c671c48aa None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:45.678719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc5ec5-4518-4360-9a63-339c671c48aa None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:45.679450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc5ec5-4518-4360-9a63-339c671c48aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:45.679751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc5ec5-4518-4360-9a63-339c671c48aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:45.681104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc5ec5-4518-4360-9a63-339c671c48aa None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:45.682063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82dd6c-086e-40c7-af29-7532a6db7696 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:45.689174 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 542/1078] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:45:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:45.694955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc5ec5-4518-4360-9a63-339c671c48aa None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:45.719113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a045e5f-73f1-40df-ad51-03b4f786dd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:45.719776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a045e5f-73f1-40df-ad51-03b4f786dd8b None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:45.720056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a045e5f-73f1-40df-ad51-03b4f786dd8b None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:45.720333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a045e5f-73f1-40df-ad51-03b4f786dd8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:45.726842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a045e5f-73f1-40df-ad51-03b4f786dd8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:45.728313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a045e5f-73f1-40df-ad51-03b4f786dd8b None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:45.740324 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-0a045e5f-73f1-40df-ad51-03b4f786dd8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:45.740324 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:45.740324 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:45.740324 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:45.740324 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:45.740324 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:45.740324 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:45.740324 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:45.740324 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:45.740324 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:45.740324 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:45.740324 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:45.740324 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:45:45.740324 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:45:45.740324 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:45:45.741406 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:45:45.741406 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:45.741406 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:45.741406 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:45.741406 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:45.741406 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:45.741406 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:45.741406 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:45.741406 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:45.741406 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:45.741406 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:45.741406 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:45.741406 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:45.741406 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:45.741406 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:45.741406 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:45.741406 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:45.742514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:45:45.742514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:45:45.742514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:45:45.742514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:45:45.742514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:45:45.742514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:45:45.742514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:45.742514 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:45.742514 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 537/1079] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:45:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:45.747422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a045e5f-73f1-40df-ad51-03b4f786dd8b None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:45.770587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:45.795483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc5ec5-4518-4360-9a63-339c671c48aa None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:45.829612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26e93f-3bb9-40e6-a136-6a58fbe86b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:45.830249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26e93f-3bb9-40e6-a136-6a58fbe86b26 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:45.830534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26e93f-3bb9-40e6-a136-6a58fbe86b26 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:45.830808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26e93f-3bb9-40e6-a136-6a58fbe86b26 None admin] PATH_INFO: `/v3/users/72816754b8774ac8ab2a899d13b8f4c1` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:45.831905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:45.832024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26e93f-3bb9-40e6-a136-6a58fbe86b26 None admin] RBAC: Authorizing `identity:get_user(user_id=72816754b8774ac8ab2a899d13b8f4c1)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:45.833399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26e93f-3bb9-40e6-a136-6a58fbe86b26 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:45.835548 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 543/1080] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:45:45 2022] GET /identity/v3/users/72816754b8774ac8ab2a899d13b8f4c1 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:45.840894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26e93f-3bb9-40e6-a136-6a58fbe86b26 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:45.848475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a045e5f-73f1-40df-ad51-03b4f786dd8b None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:45.881916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1842737-2ea9-438d-bb79-694c63e286d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:45.882555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1842737-2ea9-438d-bb79-694c63e286d9 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:45.882785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1842737-2ea9-438d-bb79-694c63e286d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:45.883052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1842737-2ea9-438d-bb79-694c63e286d9 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:45.883819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1842737-2ea9-438d-bb79-694c63e286d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:45.884142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1842737-2ea9-438d-bb79-694c63e286d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:45.885542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1842737-2ea9-438d-bb79-694c63e286d9 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:45.897241 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 538/1081] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:45:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:45.903025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1842737-2ea9-438d-bb79-694c63e286d9 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:45.938783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26e93f-3bb9-40e6-a136-6a58fbe86b26 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:45.972847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d89be-01c8-46f5-8445-c5718dcd2009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:45.973540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d89be-01c8-46f5-8445-c5718dcd2009 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:45.973822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d89be-01c8-46f5-8445-c5718dcd2009 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:45.974097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d89be-01c8-46f5-8445-c5718dcd2009 None admin] PATH_INFO: `/v3/projects/8acf66fd199c40e6a827c80865794934` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:45.975244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d89be-01c8-46f5-8445-c5718dcd2009 None admin] RBAC: Authorizing `identity:get_project(project_id=8acf66fd199c40e6a827c80865794934)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:45.976735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d89be-01c8-46f5-8445-c5718dcd2009 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:45.978536 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 544/1082] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:45:45 2022] GET /identity/v3/projects/8acf66fd199c40e6a827c80865794934 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:45.984363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d89be-01c8-46f5-8445-c5718dcd2009 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:45.997841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:46.001895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1842737-2ea9-438d-bb79-694c63e286d9 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:46.036788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d924864-e85f-4a56-9203-3745874c3ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:46.037454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d924864-e85f-4a56-9203-3745874c3ed4 None admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:46.037743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d924864-e85f-4a56-9203-3745874c3ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:46.038021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d924864-e85f-4a56-9203-3745874c3ed4 None admin] PATH_INFO: `/v3/projects/ec96772eef284ab3913f9628b136be7a/users/08a2a5793b7a4797a470719a682e541a/roles/eac828dd4fbe49b8807c54ed514b5095` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:46.040452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d924864-e85f-4a56-9203-3745874c3ed4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec96772eef284ab3913f9628b136be7a, user_id=08a2a5793b7a4797a470719a682e541a, role_id=eac828dd4fbe49b8807c54ed514b5095)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:46.041925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d924864-e85f-4a56-9203-3745874c3ed4 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:46.059337 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 539/1083] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:45:45 2022] PUT /identity/v3/projects/ec96772eef284ab3913f9628b136be7a/users/08a2a5793b7a4797a470719a682e541a/roles/eac828dd4fbe49b8807c54ed514b5095 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 20:45:46.090714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d89be-01c8-46f5-8445-c5718dcd2009 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:46.128056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f3816-06e8-45a4-a5e2-62c77fb2cb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:46.128755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f3816-06e8-45a4-a5e2-62c77fb2cb4f None admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:46.129043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f3816-06e8-45a4-a5e2-62c77fb2cb4f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:46.129328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f3816-06e8-45a4-a5e2-62c77fb2cb4f None admin] PATH_INFO: `/v3/projects/8acf66fd199c40e6a827c80865794934/users/72816754b8774ac8ab2a899d13b8f4c1/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:46.131419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f3816-06e8-45a4-a5e2-62c77fb2cb4f None admin] RBAC: Authorizing `identity:create_grant(project_id=8acf66fd199c40e6a827c80865794934, user_id=72816754b8774ac8ab2a899d13b8f4c1, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:46.132891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f3816-06e8-45a4-a5e2-62c77fb2cb4f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:46.148381 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 545/1084] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:45:45 2022] PUT /identity/v3/projects/8acf66fd199c40e6a827c80865794934/users/72816754b8774ac8ab2a899d13b8f4c1/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 20:45:48.267961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6dd47-adbc-41f1-a793-21a7d8016791 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:48.268621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6dd47-adbc-41f1-a793-21a7d8016791 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:48.268621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6dd47-adbc-41f1-a793-21a7d8016791 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:48.269909 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 540/1085] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:48.275806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ad53a-542b-48a2-8763-0e72fc977c89 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:48.276365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ad53a-542b-48a2-8763-0e72fc977c89 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:48.276365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ad53a-542b-48a2-8763-0e72fc977c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:48.295092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a75ad53a-542b-48a2-8763-0e72fc977c89 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:48.296329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a75ad53a-542b-48a2-8763-0e72fc977c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:48.357557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:48.362334 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 546/1086] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:48.387924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6dd47-adbc-41f1-a793-21a7d8016791 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:48.398466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:48.416874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb874e7-3bca-4a13-96e7-0d8be6503c09 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:48.417160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb874e7-3bca-4a13-96e7-0d8be6503c09 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:48.417440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb874e7-3bca-4a13-96e7-0d8be6503c09 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:48.418810 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 547/1087] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:45:48.423816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37284fcf-04f9-4778-a4aa-3641f5799c1e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:48.424283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37284fcf-04f9-4778-a4aa-3641f5799c1e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:48.424568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37284fcf-04f9-4778-a4aa-3641f5799c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:48.443624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-37284fcf-04f9-4778-a4aa-3641f5799c1e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:48.444970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-37284fcf-04f9-4778-a4aa-3641f5799c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:48.495266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6dd47-adbc-41f1-a793-21a7d8016791 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:48.513208 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 548/1088] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:45:48.529357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe53cd3-f92a-49d0-8ee2-012416cd5853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:48.529997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe53cd3-f92a-49d0-8ee2-012416cd5853 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:48.530282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe53cd3-f92a-49d0-8ee2-012416cd5853 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:48.530555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe53cd3-f92a-49d0-8ee2-012416cd5853 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:48.538247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37284fcf-04f9-4778-a4aa-3641f5799c1e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:48.541151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe53cd3-f92a-49d0-8ee2-012416cd5853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:45:48.545940 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-bfe53cd3-f92a-49d0-8ee2-012416cd5853 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 30 20:45:48.545940 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:48.545940 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:48.545940 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:48.545940 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:48.545940 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:48.545940 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:48.545940 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:48.545940 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:48.545940 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:48.545940 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:48.545940 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:48.545940 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:45:48.545940 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:45:48.545940 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:45:48.545940 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:45:48.546984 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:45:48.546984 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:45:48.546984 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:45:48.546984 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:45:48.546984 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:48.546984 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:48.546984 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:48.546984 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:48.546984 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:48.546984 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:48.546984 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:48.546984 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:48.546984 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:48.546984 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:48.546984 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:48.546984 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:48.547962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:48.547962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:48.547962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:48.547962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:48.547962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:45:48.547962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:45:48.547962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:45:48.547962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:45:48.547962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:45:48.547962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:45:48.547962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 30 20:45:48.547962 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:48.547962 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 541/1089] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Jul 30 20:45:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:48.554749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe53cd3-f92a-49d0-8ee2-012416cd5853 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:48.617530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:48.635480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37284fcf-04f9-4778-a4aa-3641f5799c1e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:48.653637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe53cd3-f92a-49d0-8ee2-012416cd5853 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:48.666455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:48.672782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bfc86-552b-4f72-b91e-eb9a2faac8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:48.673435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bfc86-552b-4f72-b91e-eb9a2faac8a1 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:48.673726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bfc86-552b-4f72-b91e-eb9a2faac8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:48.674005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bfc86-552b-4f72-b91e-eb9a2faac8a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:48.684080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bfc86-552b-4f72-b91e-eb9a2faac8a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:45:48.688904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-445bfc86-552b-4f72-b91e-eb9a2faac8a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:45:48.688904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:48.688904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:48.688904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:48.688904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:48.688904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:48.688904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:48.688904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:48.688904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:48.688904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:48.688904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:48.688904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:48.688904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:45:48.688904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:45:48.688904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:45:48.688904 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:45:48.689826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:45:48.689826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:45:48.689826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:45:48.689826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:45:48.689826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:48.689826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:48.689826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:48.689826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:48.689826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:48.689826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:48.689826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:48.689826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:48.689826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:48.689826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:48.689826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:48.689826 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:48.690734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:48.690734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:48.690734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:48.690734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:48.690734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:45:48.690734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:45:48.690734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:45:48.690734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:45:48.690734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:45:48.690734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:45:48.690734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:45:48.690734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:45:48.691903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3a4f8-1da5-4f5e-b242-963300d0501c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:48.691903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3a4f8-1da5-4f5e-b242-963300d0501c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:48.691903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3a4f8-1da5-4f5e-b242-963300d0501c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:48.692132 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 549/1090] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:45:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:48.692210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3a4f8-1da5-4f5e-b242-963300d0501c None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:48.692210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3a4f8-1da5-4f5e-b242-963300d0501c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:48.692210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3a4f8-1da5-4f5e-b242-963300d0501c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:48.692566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3a4f8-1da5-4f5e-b242-963300d0501c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:48.696237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bfc86-552b-4f72-b91e-eb9a2faac8a1 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:48.700502 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 542/1091] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Jul 30 20:45:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:48.706576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3a4f8-1da5-4f5e-b242-963300d0501c None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:48.793405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bfc86-552b-4f72-b91e-eb9a2faac8a1 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:48.802994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3a4f8-1da5-4f5e-b242-963300d0501c None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:48.827415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0f3d3-5a93-4c59-89ee-f82ed825635f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:48.827838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:48.828040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0f3d3-5a93-4c59-89ee-f82ed825635f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:48.828308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0f3d3-5a93-4c59-89ee-f82ed825635f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:48.828582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0f3d3-5a93-4c59-89ee-f82ed825635f None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:48.829290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0f3d3-5a93-4c59-89ee-f82ed825635f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:48.829636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0f3d3-5a93-4c59-89ee-f82ed825635f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:48.831028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0f3d3-5a93-4c59-89ee-f82ed825635f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:48.836190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b679a5-5eb7-4711-baf3-30d1bf703502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:48.837024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b679a5-5eb7-4711-baf3-30d1bf703502 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:48.837310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b679a5-5eb7-4711-baf3-30d1bf703502 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:48.837657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b679a5-5eb7-4711-baf3-30d1bf703502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:48.839888 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 550/1092] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:45:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:48.845607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0f3d3-5a93-4c59-89ee-f82ed825635f None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:48.851931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b679a5-5eb7-4711-baf3-30d1bf703502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:48.853361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b679a5-5eb7-4711-baf3-30d1bf703502 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:48.867146 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-36b679a5-5eb7-4711-baf3-30d1bf703502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:48.867146 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:48.867146 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:48.867146 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:48.867146 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:48.867146 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:48.867146 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:48.867146 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:48.867146 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:48.867146 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:48.867146 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:48.867146 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:48.867146 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:48.867146 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:48.867146 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:48.868129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:48.868129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:48.868129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:48.868129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:48.868129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:48.868129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:48.868129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:48.868129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:48.868129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:48.868129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:48.868129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:48.868129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:48.868129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:48.868129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:48.868129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:48.868129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:48.868129 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:48.869032 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:48.869032 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:48.869032 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:48.869032 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:48.869032 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 543/1093] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:48.874213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b679a5-5eb7-4711-baf3-30d1bf703502 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:48.899653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:48.947030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0f3d3-5a93-4c59-89ee-f82ed825635f None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:48.973857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b679a5-5eb7-4711-baf3-30d1bf703502 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:48.980604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921df62-923a-4af0-a291-f842a9802d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:48.981245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921df62-923a-4af0-a291-f842a9802d61 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:48.981528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921df62-923a-4af0-a291-f842a9802d61 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:48.981805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921df62-923a-4af0-a291-f842a9802d61 None admin] PATH_INFO: `/v3/users/72816754b8774ac8ab2a899d13b8f4c1` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:48.982972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921df62-923a-4af0-a291-f842a9802d61 None admin] RBAC: Authorizing `identity:get_user(user_id=72816754b8774ac8ab2a899d13b8f4c1)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:48.984452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921df62-923a-4af0-a291-f842a9802d61 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:48.986101 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 551/1094] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:45:48 2022] GET /identity/v3/users/72816754b8774ac8ab2a899d13b8f4c1 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:48.991925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921df62-923a-4af0-a291-f842a9802d61 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:49.007496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe334e6-6f1a-4bce-b3e3-f870f35cc079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:49.008140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe334e6-6f1a-4bce-b3e3-f870f35cc079 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:49.008421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe334e6-6f1a-4bce-b3e3-f870f35cc079 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:49.008690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe334e6-6f1a-4bce-b3e3-f870f35cc079 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:49.009394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe334e6-6f1a-4bce-b3e3-f870f35cc079 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:49.009697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe334e6-6f1a-4bce-b3e3-f870f35cc079 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:49.011081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe334e6-6f1a-4bce-b3e3-f870f35cc079 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:49.024457 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 544/1095] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:49.030176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe334e6-6f1a-4bce-b3e3-f870f35cc079 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:49.074845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:49.133971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe334e6-6f1a-4bce-b3e3-f870f35cc079 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:49.168813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9718a59-d3e1-4939-9d6b-0e0bcdbc00ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:49.169455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9718a59-d3e1-4939-9d6b-0e0bcdbc00ac None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:49.169733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9718a59-d3e1-4939-9d6b-0e0bcdbc00ac None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:49.170012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9718a59-d3e1-4939-9d6b-0e0bcdbc00ac None admin] PATH_INFO: `/v3/users/nova` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:49.177641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9718a59-d3e1-4939-9d6b-0e0bcdbc00ac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:49.179064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9718a59-d3e1-4939-9d6b-0e0bcdbc00ac None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:49.190841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-a9718a59-d3e1-4939-9d6b-0e0bcdbc00ac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 30 20:45:49.190841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:49.190841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:49.190841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:49.190841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:49.190841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:49.190841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:49.190841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:49.190841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:49.190841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:49.190841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:49.190841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:49.190841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:45:49.190841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:45:49.190841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:45:49.190841 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:45:49.191937 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:49.191937 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:49.191937 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:45:49.191937 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:49.191937 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:45:49.191937 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:45:49.191937 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:49.191937 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:49.191937 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:49.191937 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:49.191937 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:49.191937 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:49.191937 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:49.191937 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:49.191937 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:49.191937 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:49.191937 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:49.191937 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:49.193009 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:49.193009 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:49.193009 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:45:49.193009 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:45:49.193009 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:45:49.193009 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:45:49.193009 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:45:49.193009 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:45:49.193009 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 30 20:45:49.193009 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:49.193009 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 545/1096] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Jul 30 20:45:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:49.197712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9718a59-d3e1-4939-9d6b-0e0bcdbc00ac None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:49.223183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921df62-923a-4af0-a291-f842a9802d61 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:49.244108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:49.259228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adf790-3a68-4d8b-ae6d-4fc7fa51bc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:49.259875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adf790-3a68-4d8b-ae6d-4fc7fa51bc81 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:49.260158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adf790-3a68-4d8b-ae6d-4fc7fa51bc81 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:49.260435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adf790-3a68-4d8b-ae6d-4fc7fa51bc81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:49.296508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:49.300037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9718a59-d3e1-4939-9d6b-0e0bcdbc00ac None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:49.326139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23adf790-3a68-4d8b-ae6d-4fc7fa51bc81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:49.327578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23adf790-3a68-4d8b-ae6d-4fc7fa51bc81 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:49.335713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c2d62-23ad-42fc-b2d8-710c51d391a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:49.336339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c2d62-23ad-42fc-b2d8-710c51d391a2 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:49.336622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c2d62-23ad-42fc-b2d8-710c51d391a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:49.336898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c2d62-23ad-42fc-b2d8-710c51d391a2 None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:49.337697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c2d62-23ad-42fc-b2d8-710c51d391a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:49.338010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c2d62-23ad-42fc-b2d8-710c51d391a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:49.339449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c2d62-23ad-42fc-b2d8-710c51d391a2 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:49.357199 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 546/1097] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Jul 30 20:45:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:49.363007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c2d62-23ad-42fc-b2d8-710c51d391a2 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:49.424065 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 552/1098] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:45:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 30 20:45:49.430143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adf790-3a68-4d8b-ae6d-4fc7fa51bc81 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:49.451115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:49.460631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c2d62-23ad-42fc-b2d8-710c51d391a2 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:49.494092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73535050-5f65-4b69-bf71-db5e432065d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:49.494707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73535050-5f65-4b69-bf71-db5e432065d6 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:49.495256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73535050-5f65-4b69-bf71-db5e432065d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:49.495563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73535050-5f65-4b69-bf71-db5e432065d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:49.523007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:49.529529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adf790-3a68-4d8b-ae6d-4fc7fa51bc81 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:49.562464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2869d-18da-4197-b414-d933a373fad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:49.563105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2869d-18da-4197-b414-d933a373fad0 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:49.563421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2869d-18da-4197-b414-d933a373fad0 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:49.563699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2869d-18da-4197-b414-d933a373fad0 None admin] PATH_INFO: `/v3/projects/8acf66fd199c40e6a827c80865794934` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:49.564559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73535050-5f65-4b69-bf71-db5e432065d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:49.564840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2869d-18da-4197-b414-d933a373fad0 None admin] RBAC: Authorizing `identity:get_project(project_id=8acf66fd199c40e6a827c80865794934)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:49.566536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73535050-5f65-4b69-bf71-db5e432065d6 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:49.566838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2869d-18da-4197-b414-d933a373fad0 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:49.568535 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 553/1099] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:45:49 2022] GET /identity/v3/projects/8acf66fd199c40e6a827c80865794934 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:49.574542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2869d-18da-4197-b414-d933a373fad0 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:49.661688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:49.666522 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 547/1100] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:45:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 30 20:45:49.672286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73535050-5f65-4b69-bf71-db5e432065d6 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:49.674104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2869d-18da-4197-b414-d933a373fad0 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:49.707609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6f886-dda0-461d-8878-8971d4f6c6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:49.708214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6f886-dda0-461d-8878-8971d4f6c6c2 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:49.708493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6f886-dda0-461d-8878-8971d4f6c6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:49.708763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6f886-dda0-461d-8878-8971d4f6c6c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:49.709539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6f886-dda0-461d-8878-8971d4f6c6c2 None admin] RBAC: Adding query filter params (role.id=3b89b89da98d4ec08a0587aa13832636, scope.project.id=8acf66fd199c40e6a827c80865794934, user.id=72816754b8774ac8ab2a899d13b8f4c1) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:49.709844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6f886-dda0-461d-8878-8971d4f6c6c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:49.711266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6f886-dda0-461d-8878-8971d4f6c6c2 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:49.717061 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 554/1101] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:45:49 2022] GET /identity/v3/role_assignments?user.id=72816754b8774ac8ab2a899d13b8f4c1&scope.project.id=8acf66fd199c40e6a827c80865794934&role.id=3b89b89da98d4ec08a0587aa13832636 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:49.728984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:49.773718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73535050-5f65-4b69-bf71-db5e432065d6 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:49.811183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aeb9e4-b217-4c28-a252-8af4e7139dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:49.811879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeb9e4-b217-4c28-a252-8af4e7139dca None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:49.812166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeb9e4-b217-4c28-a252-8af4e7139dca None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:49.812445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeb9e4-b217-4c28-a252-8af4e7139dca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:49.823700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aeb9e4-b217-4c28-a252-8af4e7139dca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:49.825184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aeb9e4-b217-4c28-a252-8af4e7139dca None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:49.840900 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-84aeb9e4-b217-4c28-a252-8af4e7139dca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:49.840900 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:49.840900 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:49.840900 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:49.840900 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:49.840900 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:49.840900 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:49.840900 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:49.840900 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:49.840900 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:49.840900 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:49.840900 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:49.840900 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:45:49.840900 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:45:49.840900 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:45:49.842050 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:45:49.842050 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:49.842050 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:49.842050 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:49.842050 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:49.842050 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:49.842050 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:49.842050 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:49.842050 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:49.842050 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:49.842050 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:49.842050 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:49.842050 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:49.842050 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:49.842050 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:49.842050 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:49.842050 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:49.843071 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:45:49.843071 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:45:49.843071 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:45:49.843071 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:49.843071 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 548/1102] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:45:49.848724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6f886-dda0-461d-8878-8971d4f6c6c2 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:49.951903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6f886-dda0-461d-8878-8971d4f6c6c2 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:49.991967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c665ff-d40e-4024-9b6e-428682354d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:49.992599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c665ff-d40e-4024-9b6e-428682354d5f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:49.992883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c665ff-d40e-4024-9b6e-428682354d5f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:49.993160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c665ff-d40e-4024-9b6e-428682354d5f None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:49.993864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c665ff-d40e-4024-9b6e-428682354d5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:49.994174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c665ff-d40e-4024-9b6e-428682354d5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:49.995890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c665ff-d40e-4024-9b6e-428682354d5f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:50.008555 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 555/1103] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:50.014225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aeb9e4-b217-4c28-a252-8af4e7139dca None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:50.112909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aeb9e4-b217-4c28-a252-8af4e7139dca None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:50.123219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:50.147888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f3775-86cf-430f-bef0-c8fa37fadb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:50.148522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f3775-86cf-430f-bef0-c8fa37fadb53 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:50.148800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f3775-86cf-430f-bef0-c8fa37fadb53 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:50.149068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f3775-86cf-430f-bef0-c8fa37fadb53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:50.155922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f3775-86cf-430f-bef0-c8fa37fadb53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:50.157357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f3775-86cf-430f-bef0-c8fa37fadb53 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:50.169761 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-229f3775-86cf-430f-bef0-c8fa37fadb53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:50.169761 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:45:50.169761 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:45:50.169761 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:45:50.169761 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:45:50.169761 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:45:50.169761 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:45:50.169761 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:45:50.169761 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:45:50.169761 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:45:50.169761 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:45:50.169761 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:45:50.169761 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:45:50.169761 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:45:50.169761 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:45:50.170883 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:45:50.170883 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:45:50.170883 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:45:50.170883 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:45:50.170883 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:45:50.170883 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:45:50.170883 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:45:50.170883 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:45:50.170883 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:45:50.170883 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:45:50.170883 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:45:50.170883 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:45:50.170883 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:45:50.170883 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:45:50.170883 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:45:50.170883 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:45:50.170883 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:45:50.172373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:45:50.172373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:45:50.172373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:45:50.172373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:45:50.172373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:45:50.172373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:45:50.172373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:45:50.172373 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:45:50.172373 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 549/1104] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:45:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:45:50.176750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c665ff-d40e-4024-9b6e-428682354d5f None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:50.191227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:50.275611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c665ff-d40e-4024-9b6e-428682354d5f None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:50.311363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3247817-ccd6-40c9-a240-f6f55b0ff68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:50.312009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3247817-ccd6-40c9-a240-f6f55b0ff68e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:50.312297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3247817-ccd6-40c9-a240-f6f55b0ff68e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:50.312572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3247817-ccd6-40c9-a240-f6f55b0ff68e None admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:50.313337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3247817-ccd6-40c9-a240-f6f55b0ff68e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:50.313643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3247817-ccd6-40c9-a240-f6f55b0ff68e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:50.315088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3247817-ccd6-40c9-a240-f6f55b0ff68e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:50.327754 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 556/1105] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:45:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:50.333845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f3775-86cf-430f-bef0-c8fa37fadb53 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:50.432045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f3775-86cf-430f-bef0-c8fa37fadb53 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:50.464273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609f4f9-673b-4656-967b-7c54596f2e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:50.464887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609f4f9-673b-4656-967b-7c54596f2e6e None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:50.465169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609f4f9-673b-4656-967b-7c54596f2e6e None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:50.465445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609f4f9-673b-4656-967b-7c54596f2e6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:50.466224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609f4f9-673b-4656-967b-7c54596f2e6e None admin] RBAC: Adding query filter params (role.id=eac828dd4fbe49b8807c54ed514b5095, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=08a2a5793b7a4797a470719a682e541a) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:50.466532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609f4f9-673b-4656-967b-7c54596f2e6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:50.468032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609f4f9-673b-4656-967b-7c54596f2e6e None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:50.474390 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 550/1106] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:45:50 2022] GET /identity/v3/role_assignments?user.id=08a2a5793b7a4797a470719a682e541a&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=eac828dd4fbe49b8807c54ed514b5095 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:51.983898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79f0e0-28a6-4eaa-a50e-d6c1c126332a None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:51.984451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79f0e0-28a6-4eaa-a50e-d6c1c126332a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:51.984451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79f0e0-28a6-4eaa-a50e-d6c1c126332a None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:51.985768 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 557/1107] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:51.991674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b310ed-9145-4689-b907-d67567c23445 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:51.992085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b310ed-9145-4689-b907-d67567c23445 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:51.992380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b310ed-9145-4689-b907-d67567c23445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:52.010798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e7b310ed-9145-4689-b907-d67567c23445 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:52.012239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e7b310ed-9145-4689-b907-d67567c23445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:52.038594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:52.078488 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 551/1108] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:52.105563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79f0e0-28a6-4eaa-a50e-d6c1c126332a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:52.175751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:52.206549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79f0e0-28a6-4eaa-a50e-d6c1c126332a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:52.238970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8641be-7ae9-418f-83c5-9782f35e6ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:52.239587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8641be-7ae9-418f-83c5-9782f35e6ee0 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:52.239874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8641be-7ae9-418f-83c5-9782f35e6ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:52.240150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8641be-7ae9-418f-83c5-9782f35e6ee0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:52.241292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8641be-7ae9-418f-83c5-9782f35e6ee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:52.242721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8641be-7ae9-418f-83c5-9782f35e6ee0 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:52.244323 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 558/1109] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:45:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:52.250471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b310ed-9145-4689-b907-d67567c23445 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:52.345249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b310ed-9145-4689-b907-d67567c23445 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:52.378324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d512bf-9cf2-45e8-9bf7-566bf9aefc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:52.378936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d512bf-9cf2-45e8-9bf7-566bf9aefc54 None admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:52.379219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d512bf-9cf2-45e8-9bf7-566bf9aefc54 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:52.379524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d512bf-9cf2-45e8-9bf7-566bf9aefc54 None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:52.380214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d512bf-9cf2-45e8-9bf7-566bf9aefc54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:52.381663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d512bf-9cf2-45e8-9bf7-566bf9aefc54 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:52.402894 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 552/1110] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 30 20:45:52 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 20:45:54.670280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3ee8e-0e38-4a5f-961a-2c0a8373335c None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:54.670839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3ee8e-0e38-4a5f-961a-2c0a8373335c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:54.670839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3ee8e-0e38-4a5f-961a-2c0a8373335c None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:54.672199 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 559/1111] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:54.677952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042192a-1268-4636-bf9e-da997dae904d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:54.678379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042192a-1268-4636-bf9e-da997dae904d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:54.678506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042192a-1268-4636-bf9e-da997dae904d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:54.696696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0042192a-1268-4636-bf9e-da997dae904d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:54.697867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0042192a-1268-4636-bf9e-da997dae904d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:54.711675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:54.764496 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 553/1112] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:54.788644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3ee8e-0e38-4a5f-961a-2c0a8373335c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:54.887874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3ee8e-0e38-4a5f-961a-2c0a8373335c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:54.919832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fa9f1-a1fd-4f70-a1a7-880a84124ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:54.920499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fa9f1-a1fd-4f70-a1a7-880a84124ab4 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:54.920734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fa9f1-a1fd-4f70-a1a7-880a84124ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:54.921008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fa9f1-a1fd-4f70-a1a7-880a84124ab4 None admin] PATH_INFO: `/v3/roles/bb6a9a85fcb54a31a5a42bea4a88a5b9` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:54.922412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fa9f1-a1fd-4f70-a1a7-880a84124ab4 None admin] RBAC: Authorizing `identity:get_role(role_id=bb6a9a85fcb54a31a5a42bea4a88a5b9)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:54.923798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fa9f1-a1fd-4f70-a1a7-880a84124ab4 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:54.925167 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 560/1113] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:45:54 2022] GET /identity/v3/roles/bb6a9a85fcb54a31a5a42bea4a88a5b9 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:54.930831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042192a-1268-4636-bf9e-da997dae904d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:55.025709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042192a-1268-4636-bf9e-da997dae904d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:55.057662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e9e61-0ad6-46e4-a8ee-5c46793b7fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:55.058289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e9e61-0ad6-46e4-a8ee-5c46793b7fbe None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:55.058570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e9e61-0ad6-46e4-a8ee-5c46793b7fbe None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:55.058844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e9e61-0ad6-46e4-a8ee-5c46793b7fbe None admin] PATH_INFO: `/v3/users/ea0e35911b244218b57401fe66c578a8` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:55.072534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e9e61-0ad6-46e4-a8ee-5c46793b7fbe None admin] RBAC: Authorizing `identity:get_user(user_id=ea0e35911b244218b57401fe66c578a8)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:55.073949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e9e61-0ad6-46e4-a8ee-5c46793b7fbe None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:55.075562 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 554/1114] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:45:54 2022] GET /identity/v3/users/ea0e35911b244218b57401fe66c578a8 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:55.082095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fa9f1-a1fd-4f70-a1a7-880a84124ab4 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:55.093052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:55.180211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fa9f1-a1fd-4f70-a1a7-880a84124ab4 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:55.213759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3d69e-43d5-4058-9b86-5f6f56e387fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:55.214371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3d69e-43d5-4058-9b86-5f6f56e387fc None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:55.214651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3d69e-43d5-4058-9b86-5f6f56e387fc None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:55.214922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3d69e-43d5-4058-9b86-5f6f56e387fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:55.279457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3d69e-43d5-4058-9b86-5f6f56e387fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:55.280885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3d69e-43d5-4058-9b86-5f6f56e387fc None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:55.290413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:55.376269 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 561/1115] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:45:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 30 20:45:55.382152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e9e61-0ad6-46e4-a8ee-5c46793b7fbe None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:55.392588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:55.478035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e9e61-0ad6-46e4-a8ee-5c46793b7fbe None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:55.510336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819738e1-2651-445a-aeb7-1256978a8e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:55.510961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819738e1-2651-445a-aeb7-1256978a8e31 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:55.511242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819738e1-2651-445a-aeb7-1256978a8e31 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:55.511541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819738e1-2651-445a-aeb7-1256978a8e31 None admin] PATH_INFO: `/v3/projects/8acf66fd199c40e6a827c80865794934` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:55.512660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819738e1-2651-445a-aeb7-1256978a8e31 None admin] RBAC: Authorizing `identity:get_project(project_id=8acf66fd199c40e6a827c80865794934)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:55.514066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819738e1-2651-445a-aeb7-1256978a8e31 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:55.515771 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 555/1116] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:45:55 2022] GET /identity/v3/projects/8acf66fd199c40e6a827c80865794934 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:55.522252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3d69e-43d5-4058-9b86-5f6f56e387fc None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:55.618185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3d69e-43d5-4058-9b86-5f6f56e387fc None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:55.627185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:55.652060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d95ed2-09f6-41f2-af30-b2aa23d5935a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:55.652692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d95ed2-09f6-41f2-af30-b2aa23d5935a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:55.652974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d95ed2-09f6-41f2-af30-b2aa23d5935a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:55.653248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d95ed2-09f6-41f2-af30-b2aa23d5935a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:55.654019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d95ed2-09f6-41f2-af30-b2aa23d5935a None admin] RBAC: Adding query filter params (role.id=bb6a9a85fcb54a31a5a42bea4a88a5b9, scope.project.id=8acf66fd199c40e6a827c80865794934, user.id=ea0e35911b244218b57401fe66c578a8) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:45:55.654323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d95ed2-09f6-41f2-af30-b2aa23d5935a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:55.655771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d95ed2-09f6-41f2-af30-b2aa23d5935a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:55.660961 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 562/1117] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:45:55 2022] GET /identity/v3/role_assignments?user.id=ea0e35911b244218b57401fe66c578a8&scope.project.id=8acf66fd199c40e6a827c80865794934&role.id=bb6a9a85fcb54a31a5a42bea4a88a5b9 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:57.841873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1edde-0db7-4b39-bed7-1cd5b5c0d982 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:57.842435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1edde-0db7-4b39-bed7-1cd5b5c0d982 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:57.842435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1edde-0db7-4b39-bed7-1cd5b5c0d982 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:57.843807 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 556/1118] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:45:57.849659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd371b5-ca5a-401d-b315-509ea112334b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:57.850085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd371b5-ca5a-401d-b315-509ea112334b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:57.850192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd371b5-ca5a-401d-b315-509ea112334b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:57.868432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5fd371b5-ca5a-401d-b315-509ea112334b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:45:57.869617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5fd371b5-ca5a-401d-b315-509ea112334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:45:57.933743 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 563/1119] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:45:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:45:57.958956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1edde-0db7-4b39-bed7-1cd5b5c0d982 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:58.036906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:58.060305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1edde-0db7-4b39-bed7-1cd5b5c0d982 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:58.094109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c4a5e-be64-4cba-8f64-593f9bc0201a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:58.094674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c4a5e-be64-4cba-8f64-593f9bc0201a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:58.094957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c4a5e-be64-4cba-8f64-593f9bc0201a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:58.095231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c4a5e-be64-4cba-8f64-593f9bc0201a None admin] PATH_INFO: `/v3/roles/bb6a9a85fcb54a31a5a42bea4a88a5b9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:58.097230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c4a5e-be64-4cba-8f64-593f9bc0201a None admin] RBAC: Authorizing `identity:get_role(role_id=bb6a9a85fcb54a31a5a42bea4a88a5b9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:58.098597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c4a5e-be64-4cba-8f64-593f9bc0201a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:58.099972 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 557/1120] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:45:57 2022] GET /identity/v3/roles/bb6a9a85fcb54a31a5a42bea4a88a5b9 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:58.106139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd371b5-ca5a-401d-b315-509ea112334b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:58.202410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd371b5-ca5a-401d-b315-509ea112334b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:58.204106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:45:58.239548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf737d-a059-4525-9db1-6df2fd2e10c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:58.240186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf737d-a059-4525-9db1-6df2fd2e10c2 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:58.240463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf737d-a059-4525-9db1-6df2fd2e10c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:58.240735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf737d-a059-4525-9db1-6df2fd2e10c2 None admin] PATH_INFO: `/v3/users/ea0e35911b244218b57401fe66c578a8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:58.241874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf737d-a059-4525-9db1-6df2fd2e10c2 None admin] RBAC: Authorizing `identity:get_user(user_id=ea0e35911b244218b57401fe66c578a8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:58.243322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf737d-a059-4525-9db1-6df2fd2e10c2 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:58.245291 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 564/1121] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:45:58 2022] GET /identity/v3/users/ea0e35911b244218b57401fe66c578a8 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:45:58.251537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c4a5e-be64-4cba-8f64-593f9bc0201a None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:58.350094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c4a5e-be64-4cba-8f64-593f9bc0201a None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:58.383024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9b166-7652-4545-a78b-b97e4cd22d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:58.383695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9b166-7652-4545-a78b-b97e4cd22d0d None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:58.383976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9b166-7652-4545-a78b-b97e4cd22d0d None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:58.384250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9b166-7652-4545-a78b-b97e4cd22d0d None admin] PATH_INFO: `/v3/projects/8acf66fd199c40e6a827c80865794934` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:58.385395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9b166-7652-4545-a78b-b97e4cd22d0d None admin] RBAC: Authorizing `identity:get_project(project_id=8acf66fd199c40e6a827c80865794934)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:58.386824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9b166-7652-4545-a78b-b97e4cd22d0d None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:58.388517 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 558/1122] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:45:58 2022] GET /identity/v3/projects/8acf66fd199c40e6a827c80865794934 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:45:58.395085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf737d-a059-4525-9db1-6df2fd2e10c2 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:45:58.491282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf737d-a059-4525-9db1-6df2fd2e10c2 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:45:58.524658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78893254-70df-4d13-9458-812472709c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:45:58.525310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78893254-70df-4d13-9458-812472709c3a None admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:45:58.525590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78893254-70df-4d13-9458-812472709c3a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:45:58.525864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78893254-70df-4d13-9458-812472709c3a None admin] PATH_INFO: `/v3/projects/8acf66fd199c40e6a827c80865794934/users/ea0e35911b244218b57401fe66c578a8/roles/bb6a9a85fcb54a31a5a42bea4a88a5b9` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:45:58.528002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78893254-70df-4d13-9458-812472709c3a None admin] RBAC: Authorizing `identity:create_grant(project_id=8acf66fd199c40e6a827c80865794934, user_id=ea0e35911b244218b57401fe66c578a8, role_id=bb6a9a85fcb54a31a5a42bea4a88a5b9)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:45:58.529414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78893254-70df-4d13-9458-812472709c3a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:45:58.541538 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 565/1123] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:45:58 2022] PUT /identity/v3/projects/8acf66fd199c40e6a827c80865794934/users/ea0e35911b244218b57401fe66c578a8/roles/bb6a9a85fcb54a31a5a42bea4a88a5b9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:46:00.744065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de95803-f01a-4df5-94fa-02a847fca4e1 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:00.744639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de95803-f01a-4df5-94fa-02a847fca4e1 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:00.744639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de95803-f01a-4df5-94fa-02a847fca4e1 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:00.746180 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 559/1124] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:46:00.751881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4170b-294f-4892-bed9-a4244ada0f3e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:00.753054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4170b-294f-4892-bed9-a4244ada0f3e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:00.753536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4170b-294f-4892-bed9-a4244ada0f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:00.772811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-29d4170b-294f-4892-bed9-a4244ada0f3e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:46:00.774008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-29d4170b-294f-4892-bed9-a4244ada0f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:46:00.798391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:00.841572 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 566/1125] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:46:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:46:00.866901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de95803-f01a-4df5-94fa-02a847fca4e1 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:00.881721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:00.965573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de95803-f01a-4df5-94fa-02a847fca4e1 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:00.999673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4852381-e1c4-4302-8e4b-f5dc6ebba274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:01.000307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4852381-e1c4-4302-8e4b-f5dc6ebba274 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:01.000587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4852381-e1c4-4302-8e4b-f5dc6ebba274 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:01.000860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4852381-e1c4-4302-8e4b-f5dc6ebba274 None admin] PATH_INFO: `/v3/roles/bb6a9a85fcb54a31a5a42bea4a88a5b9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:01.002783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4852381-e1c4-4302-8e4b-f5dc6ebba274 None admin] RBAC: Authorizing `identity:get_role(role_id=bb6a9a85fcb54a31a5a42bea4a88a5b9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:01.004177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4852381-e1c4-4302-8e4b-f5dc6ebba274 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:01.005500 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 560/1126] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:46:00 2022] GET /identity/v3/roles/bb6a9a85fcb54a31a5a42bea4a88a5b9 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:01.011667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4170b-294f-4892-bed9-a4244ada0f3e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:01.107514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4170b-294f-4892-bed9-a4244ada0f3e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:01.140284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a936c-6365-47c3-9dcf-32155c8221b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:01.140916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a936c-6365-47c3-9dcf-32155c8221b8 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:01.141205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a936c-6365-47c3-9dcf-32155c8221b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:01.141484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a936c-6365-47c3-9dcf-32155c8221b8 None admin] PATH_INFO: `/v3/users/ea0e35911b244218b57401fe66c578a8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:01.142625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a936c-6365-47c3-9dcf-32155c8221b8 None admin] RBAC: Authorizing `identity:get_user(user_id=ea0e35911b244218b57401fe66c578a8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:01.144709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a936c-6365-47c3-9dcf-32155c8221b8 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:01.146277 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 567/1127] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:46:01 2022] GET /identity/v3/users/ea0e35911b244218b57401fe66c578a8 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:01.152443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4852381-e1c4-4302-8e4b-f5dc6ebba274 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:01.231618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:01.253876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4852381-e1c4-4302-8e4b-f5dc6ebba274 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:01.286330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd598575-a420-400e-95f8-ae02b9d34ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:01.286944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd598575-a420-400e-95f8-ae02b9d34ef0 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:01.287229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd598575-a420-400e-95f8-ae02b9d34ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:01.287536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd598575-a420-400e-95f8-ae02b9d34ef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:01.352347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd598575-a420-400e-95f8-ae02b9d34ef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:01.353773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd598575-a420-400e-95f8-ae02b9d34ef0 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:01.430779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:01.450580 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 561/1128] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:46:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 30 20:46:01.456606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a936c-6365-47c3-9dcf-32155c8221b8 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:01.484016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:01.553800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a936c-6365-47c3-9dcf-32155c8221b8 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:01.586179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8747a-e641-4352-95dc-c00db420e056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:01.586806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8747a-e641-4352-95dc-c00db420e056 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:01.587086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8747a-e641-4352-95dc-c00db420e056 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:01.587388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8747a-e641-4352-95dc-c00db420e056 None admin] PATH_INFO: `/v3/projects/8acf66fd199c40e6a827c80865794934` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:01.588526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8747a-e641-4352-95dc-c00db420e056 None admin] RBAC: Authorizing `identity:get_project(project_id=8acf66fd199c40e6a827c80865794934)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:01.589946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8747a-e641-4352-95dc-c00db420e056 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:01.591612 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 568/1129] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:46:01 2022] GET /identity/v3/projects/8acf66fd199c40e6a827c80865794934 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:01.598328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd598575-a420-400e-95f8-ae02b9d34ef0 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:01.693181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd598575-a420-400e-95f8-ae02b9d34ef0 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:01.725459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db290a-1799-4545-a9a4-02869f3b1189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:01.726054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db290a-1799-4545-a9a4-02869f3b1189 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:01.726335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db290a-1799-4545-a9a4-02869f3b1189 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:01.726609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db290a-1799-4545-a9a4-02869f3b1189 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:01.727401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db290a-1799-4545-a9a4-02869f3b1189 None admin] RBAC: Adding query filter params (role.id=bb6a9a85fcb54a31a5a42bea4a88a5b9, scope.project.id=8acf66fd199c40e6a827c80865794934, user.id=ea0e35911b244218b57401fe66c578a8) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:46:01.727708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db290a-1799-4545-a9a4-02869f3b1189 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:01.729114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db290a-1799-4545-a9a4-02869f3b1189 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:01.734636 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 562/1130] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:46:01 2022] GET /identity/v3/role_assignments?user.id=ea0e35911b244218b57401fe66c578a8&scope.project.id=8acf66fd199c40e6a827c80865794934&role.id=bb6a9a85fcb54a31a5a42bea4a88a5b9 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:03.956896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee4391-356d-4df2-b652-56be08947d0a None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:03.957429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee4391-356d-4df2-b652-56be08947d0a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:03.957429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee4391-356d-4df2-b652-56be08947d0a None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:03.958816 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 569/1131] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:46:03.963922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e45f2d-61cc-4bc9-82f3-87a639154c2e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:03.964323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e45f2d-61cc-4bc9-82f3-87a639154c2e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:03.964472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e45f2d-61cc-4bc9-82f3-87a639154c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:03.982635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f4e45f2d-61cc-4bc9-82f3-87a639154c2e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:46:03.983854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f4e45f2d-61cc-4bc9-82f3-87a639154c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:46:04.023693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:04.049963 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 563/1132] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:46:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:46:04.074232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee4391-356d-4df2-b652-56be08947d0a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:04.166427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:04.173345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee4391-356d-4df2-b652-56be08947d0a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:04.206523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02839b-08a2-4c7b-8f73-b298f39720cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:04.207198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02839b-08a2-4c7b-8f73-b298f39720cb None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:04.207465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02839b-08a2-4c7b-8f73-b298f39720cb None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:04.207743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02839b-08a2-4c7b-8f73-b298f39720cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:04.208885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02839b-08a2-4c7b-8f73-b298f39720cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:04.210307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02839b-08a2-4c7b-8f73-b298f39720cb None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:04.211896 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 570/1133] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:46:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:04.217673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e45f2d-61cc-4bc9-82f3-87a639154c2e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:04.314146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e45f2d-61cc-4bc9-82f3-87a639154c2e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:04.347431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb11ec5-6172-48c4-be14-08f347d17934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:04.348044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb11ec5-6172-48c4-be14-08f347d17934 None admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:04.348327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb11ec5-6172-48c4-be14-08f347d17934 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:04.348598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb11ec5-6172-48c4-be14-08f347d17934 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:04.349276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb11ec5-6172-48c4-be14-08f347d17934 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:04.350702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb11ec5-6172-48c4-be14-08f347d17934 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:04.377848 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 564/1134] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 30 20:46:04 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 20:46:06.621061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19f4d0-2eb9-4160-ba81-7f936ac0d464 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:06.621597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19f4d0-2eb9-4160-ba81-7f936ac0d464 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:06.621597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19f4d0-2eb9-4160-ba81-7f936ac0d464 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:06.622969 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 571/1135] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:46:06.628766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a894cb2-c1cb-40e8-9ecd-8d8c293c8ce8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:06.629164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a894cb2-c1cb-40e8-9ecd-8d8c293c8ce8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:06.629324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a894cb2-c1cb-40e8-9ecd-8d8c293c8ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:06.647256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2a894cb2-c1cb-40e8-9ecd-8d8c293c8ce8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:46:06.648471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2a894cb2-c1cb-40e8-9ecd-8d8c293c8ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:46:06.667803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:06.713123 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 565/1136] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:46:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:46:06.739083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19f4d0-2eb9-4160-ba81-7f936ac0d464 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:06.836641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19f4d0-2eb9-4160-ba81-7f936ac0d464 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:06.870823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab23d1-9c4e-47e5-887c-3b6144fbbe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:06.871538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab23d1-9c4e-47e5-887c-3b6144fbbe0f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:06.871771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab23d1-9c4e-47e5-887c-3b6144fbbe0f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:06.872043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab23d1-9c4e-47e5-887c-3b6144fbbe0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:06.873183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab23d1-9c4e-47e5-887c-3b6144fbbe0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:06.874623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab23d1-9c4e-47e5-887c-3b6144fbbe0f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:06.876215 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 572/1137] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:46:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:06.882104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a894cb2-c1cb-40e8-9ecd-8d8c293c8ce8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:06.979024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a894cb2-c1cb-40e8-9ecd-8d8c293c8ce8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:07.012668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fbb1c-2905-4eaf-8168-84dc4044a119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:07.013294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fbb1c-2905-4eaf-8168-84dc4044a119 None admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:07.013609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fbb1c-2905-4eaf-8168-84dc4044a119 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:07.013889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fbb1c-2905-4eaf-8168-84dc4044a119 None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:07.014581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459fbb1c-2905-4eaf-8168-84dc4044a119 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:07.016048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459fbb1c-2905-4eaf-8168-84dc4044a119 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:07.037315 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 566/1138] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 30 20:46:06 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:46:09.337684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4995956-8de8-498d-b428-62eb9a7c5f51 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:09.338210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4995956-8de8-498d-b428-62eb9a7c5f51 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:09.338323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4995956-8de8-498d-b428-62eb9a7c5f51 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:09.339609 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 573/1139] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:46:09.345630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba9584-d586-42ba-8c91-15676d117ef5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:09.346135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba9584-d586-42ba-8c91-15676d117ef5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:09.346231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba9584-d586-42ba-8c91-15676d117ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:09.365461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-dbba9584-d586-42ba-8c91-15676d117ef5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:46:09.366662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-dbba9584-d586-42ba-8c91-15676d117ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:46:09.374290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:09.434446 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 567/1140] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:46:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:46:09.459868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4995956-8de8-498d-b428-62eb9a7c5f51 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:09.490321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:09.560222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4995956-8de8-498d-b428-62eb9a7c5f51 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:09.594056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f240e85-5967-40f5-ad70-6ddc036b6cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:09.594634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f240e85-5967-40f5-ad70-6ddc036b6cbe None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:09.594918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f240e85-5967-40f5-ad70-6ddc036b6cbe None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:09.595194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f240e85-5967-40f5-ad70-6ddc036b6cbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:09.605798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f240e85-5967-40f5-ad70-6ddc036b6cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:46:09.610649 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-1f240e85-5967-40f5-ad70-6ddc036b6cbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:46:09.610649 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:46:09.610649 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:46:09.610649 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:46:09.610649 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:46:09.610649 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:46:09.610649 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:46:09.610649 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:46:09.610649 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:46:09.610649 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:46:09.610649 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:46:09.610649 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:46:09.610649 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:46:09.610649 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:46:09.610649 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:46:09.610649 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:46:09.611794 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:46:09.611794 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:46:09.611794 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:46:09.611794 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:46:09.611794 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:46:09.611794 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:46:09.611794 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:46:09.611794 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:46:09.611794 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:46:09.611794 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:46:09.611794 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:46:09.611794 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:46:09.611794 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:46:09.611794 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:46:09.611794 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:46:09.611794 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:46:09.612843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:46:09.612843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:46:09.612843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:46:09.612843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:46:09.612843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:46:09.612843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:46:09.612843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:46:09.612843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:46:09.612843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:46:09.612843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:46:09.612843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:46:09.612843 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:46:09.612843 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 574/1141] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:46:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:46:09.618798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba9584-d586-42ba-8c91-15676d117ef5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:09.715552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba9584-d586-42ba-8c91-15676d117ef5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:09.748405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bddc05-06d3-4ec8-976d-056327aa2970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:09.749012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bddc05-06d3-4ec8-976d-056327aa2970 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:09.749296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bddc05-06d3-4ec8-976d-056327aa2970 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:09.749573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bddc05-06d3-4ec8-976d-056327aa2970 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:09.750281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bddc05-06d3-4ec8-976d-056327aa2970 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:46:09.750585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bddc05-06d3-4ec8-976d-056327aa2970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:09.751994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bddc05-06d3-4ec8-976d-056327aa2970 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:09.759751 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 568/1142] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:46:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:09.765575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f240e85-5967-40f5-ad70-6ddc036b6cbe None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:09.856214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:09.865053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f240e85-5967-40f5-ad70-6ddc036b6cbe None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:09.898796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352aaa45-f172-48ea-b569-b6c2c7f53551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:09.899464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352aaa45-f172-48ea-b569-b6c2c7f53551 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:09.899752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352aaa45-f172-48ea-b569-b6c2c7f53551 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:09.900029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352aaa45-f172-48ea-b569-b6c2c7f53551 None admin] PATH_INFO: `/v3/users/45fa71ca8b414965abb0a383cca203f8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:09.918074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352aaa45-f172-48ea-b569-b6c2c7f53551 None admin] RBAC: Authorizing `identity:get_user(user_id=45fa71ca8b414965abb0a383cca203f8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:09.919566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352aaa45-f172-48ea-b569-b6c2c7f53551 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:09.921252 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 575/1143] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:46:09 2022] GET /identity/v3/users/45fa71ca8b414965abb0a383cca203f8 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:46:09.927127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bddc05-06d3-4ec8-976d-056327aa2970 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:09.930902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:10.025189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bddc05-06d3-4ec8-976d-056327aa2970 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:10.058265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85579e21-65c6-4138-8006-6bbbddffdcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:10.058890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85579e21-65c6-4138-8006-6bbbddffdcbb None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:10.059176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85579e21-65c6-4138-8006-6bbbddffdcbb None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:10.059494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85579e21-65c6-4138-8006-6bbbddffdcbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:10.125451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85579e21-65c6-4138-8006-6bbbddffdcbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:10.126863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85579e21-65c6-4138-8006-6bbbddffdcbb None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:10.129407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:10.230135 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 569/1144] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:46:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 30 20:46:10.236007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352aaa45-f172-48ea-b569-b6c2c7f53551 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:10.333520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352aaa45-f172-48ea-b569-b6c2c7f53551 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:10.366688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0db14-07bb-43d5-9c08-4b711fdfcede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:10.367391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0db14-07bb-43d5-9c08-4b711fdfcede None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:10.367623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0db14-07bb-43d5-9c08-4b711fdfcede None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:10.367896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0db14-07bb-43d5-9c08-4b711fdfcede None admin] PATH_INFO: `/v3/projects/9fec573c9db94e0189b73698525ef374` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:10.369027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0db14-07bb-43d5-9c08-4b711fdfcede None admin] RBAC: Authorizing `identity:get_project(project_id=9fec573c9db94e0189b73698525ef374)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:10.370717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0db14-07bb-43d5-9c08-4b711fdfcede None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:10.372398 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 576/1145] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:46:10 2022] GET /identity/v3/projects/9fec573c9db94e0189b73698525ef374 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:10.378672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85579e21-65c6-4138-8006-6bbbddffdcbb None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:10.482082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85579e21-65c6-4138-8006-6bbbddffdcbb None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:10.484479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:10.516722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c48e2f-77a5-4109-9548-ba2b8f7f4494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:10.517858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c48e2f-77a5-4109-9548-ba2b8f7f4494 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:10.518142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c48e2f-77a5-4109-9548-ba2b8f7f4494 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:10.518419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c48e2f-77a5-4109-9548-ba2b8f7f4494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:10.519203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c48e2f-77a5-4109-9548-ba2b8f7f4494 None admin] RBAC: Adding query filter params (role.id=3b89b89da98d4ec08a0587aa13832636, scope.project.id=9fec573c9db94e0189b73698525ef374, user.id=45fa71ca8b414965abb0a383cca203f8) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:46:10.519546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c48e2f-77a5-4109-9548-ba2b8f7f4494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:10.520976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c48e2f-77a5-4109-9548-ba2b8f7f4494 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:10.526223 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 570/1146] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:46:10 2022] GET /identity/v3/role_assignments?user.id=45fa71ca8b414965abb0a383cca203f8&scope.project.id=9fec573c9db94e0189b73698525ef374&role.id=3b89b89da98d4ec08a0587aa13832636 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:12.828974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ad9fe-be7b-4dc7-ae0e-488fc57975c7 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:12.829533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ad9fe-be7b-4dc7-ae0e-488fc57975c7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:12.829533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ad9fe-be7b-4dc7-ae0e-488fc57975c7 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:12.830863 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 577/1147] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:46:12.836183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbefe89-7e82-4698-8aa0-fb2819cd3bb2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:12.836616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbefe89-7e82-4698-8aa0-fb2819cd3bb2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:12.836720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbefe89-7e82-4698-8aa0-fb2819cd3bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:12.854760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-6bbefe89-7e82-4698-8aa0-fb2819cd3bb2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:46:12.855981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6bbefe89-7e82-4698-8aa0-fb2819cd3bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:46:12.920811 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 571/1148] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:46:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:46:12.944630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ad9fe-be7b-4dc7-ae0e-488fc57975c7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:12.969215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:13.051105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ad9fe-be7b-4dc7-ae0e-488fc57975c7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:13.084778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebd839-2953-44fe-9a26-e4882bc23064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:13.085366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebd839-2953-44fe-9a26-e4882bc23064 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:13.085651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebd839-2953-44fe-9a26-e4882bc23064 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:13.085928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebd839-2953-44fe-9a26-e4882bc23064 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:13.095838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebd839-2953-44fe-9a26-e4882bc23064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:46:13.100622 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-d3ebd839-2953-44fe-9a26-e4882bc23064 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:46:13.100622 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:46:13.100622 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:46:13.100622 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:46:13.100622 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:46:13.100622 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:46:13.100622 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:46:13.100622 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:46:13.100622 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:46:13.100622 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:46:13.100622 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:46:13.100622 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:46:13.100622 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:46:13.100622 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:46:13.100622 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:46:13.100622 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:46:13.101724 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:46:13.101724 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:46:13.101724 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:46:13.101724 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:46:13.101724 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:46:13.101724 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:46:13.101724 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:46:13.101724 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:46:13.101724 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:46:13.101724 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:46:13.101724 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:46:13.101724 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:46:13.101724 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:46:13.101724 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:46:13.101724 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:46:13.101724 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:46:13.102755 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:46:13.102755 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:46:13.102755 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:46:13.102755 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:46:13.102755 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:46:13.102755 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:46:13.102755 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:46:13.102755 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:46:13.102755 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:46:13.102755 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:46:13.102755 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:46:13.102755 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:46:13.102755 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 578/1149] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:46:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:46:13.108465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbefe89-7e82-4698-8aa0-fb2819cd3bb2 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:13.207983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:13.212602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbefe89-7e82-4698-8aa0-fb2819cd3bb2 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:13.247011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2c37e-dfff-46c4-8148-4957bb8e5b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:13.247665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2c37e-dfff-46c4-8148-4957bb8e5b74 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:13.247948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2c37e-dfff-46c4-8148-4957bb8e5b74 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:13.248225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2c37e-dfff-46c4-8148-4957bb8e5b74 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:13.248949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2c37e-dfff-46c4-8148-4957bb8e5b74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:46:13.249254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2c37e-dfff-46c4-8148-4957bb8e5b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:13.250622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2c37e-dfff-46c4-8148-4957bb8e5b74 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:13.259438 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 572/1150] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:46:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:13.265290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebd839-2953-44fe-9a26-e4882bc23064 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:13.342220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:13.363493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebd839-2953-44fe-9a26-e4882bc23064 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:13.397439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fa69f-6e42-45a2-9e9a-d91b23ca6e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:13.398061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fa69f-6e42-45a2-9e9a-d91b23ca6e9b None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:13.398346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fa69f-6e42-45a2-9e9a-d91b23ca6e9b None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:13.398624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fa69f-6e42-45a2-9e9a-d91b23ca6e9b None admin] PATH_INFO: `/v3/users/45fa71ca8b414965abb0a383cca203f8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:13.399800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fa69f-6e42-45a2-9e9a-d91b23ca6e9b None admin] RBAC: Authorizing `identity:get_user(user_id=45fa71ca8b414965abb0a383cca203f8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:13.401223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fa69f-6e42-45a2-9e9a-d91b23ca6e9b None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:13.402800 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 579/1151] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:46:13 2022] GET /identity/v3/users/45fa71ca8b414965abb0a383cca203f8 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:13.408635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2c37e-dfff-46c4-8148-4957bb8e5b74 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:13.507632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2c37e-dfff-46c4-8148-4957bb8e5b74 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:13.539493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8b45f-7483-4aec-b7fc-6583b6023ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:13.540124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8b45f-7483-4aec-b7fc-6583b6023ad2 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:13.540409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8b45f-7483-4aec-b7fc-6583b6023ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:13.540706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8b45f-7483-4aec-b7fc-6583b6023ad2 None admin] PATH_INFO: `/v3/projects/9fec573c9db94e0189b73698525ef374` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:13.541831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8b45f-7483-4aec-b7fc-6583b6023ad2 None admin] RBAC: Authorizing `identity:get_project(project_id=9fec573c9db94e0189b73698525ef374)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:13.543246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8b45f-7483-4aec-b7fc-6583b6023ad2 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:13.544911 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 573/1152] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:46:13 2022] GET /identity/v3/projects/9fec573c9db94e0189b73698525ef374 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:13.551627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fa69f-6e42-45a2-9e9a-d91b23ca6e9b None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:13.648350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fa69f-6e42-45a2-9e9a-d91b23ca6e9b None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:13.681391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab2737-0ccc-43d0-a533-ecf126a13826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:13.682047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab2737-0ccc-43d0-a533-ecf126a13826 None admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:13.682331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab2737-0ccc-43d0-a533-ecf126a13826 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:13.682609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab2737-0ccc-43d0-a533-ecf126a13826 None admin] PATH_INFO: `/v3/projects/9fec573c9db94e0189b73698525ef374/users/45fa71ca8b414965abb0a383cca203f8/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:13.684541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab2737-0ccc-43d0-a533-ecf126a13826 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fec573c9db94e0189b73698525ef374, user_id=45fa71ca8b414965abb0a383cca203f8, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:13.685956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab2737-0ccc-43d0-a533-ecf126a13826 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:13.699161 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 580/1153] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:46:13 2022] PUT /identity/v3/projects/9fec573c9db94e0189b73698525ef374/users/45fa71ca8b414965abb0a383cca203f8/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:46:15.898118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57aac63-3f41-4409-a131-4d7abea4fbf6 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:15.898644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57aac63-3f41-4409-a131-4d7abea4fbf6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:15.898738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57aac63-3f41-4409-a131-4d7abea4fbf6 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:15.900059 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 574/1154] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:46:15.905109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89ce34-5941-4973-893d-e8c529c9d696 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:15.905527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89ce34-5941-4973-893d-e8c529c9d696 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:15.905664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89ce34-5941-4973-893d-e8c529c9d696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:15.918375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:15.925021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7d89ce34-5941-4973-893d-e8c529c9d696 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:46:15.926501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7d89ce34-5941-4973-893d-e8c529c9d696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:46:16.000825 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 581/1155] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:46:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:46:16.026998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57aac63-3f41-4409-a131-4d7abea4fbf6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:16.056050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:16.133935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57aac63-3f41-4409-a131-4d7abea4fbf6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:16.166094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fec47b-f9e7-445c-a9eb-17b686b81ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:16.166669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fec47b-f9e7-445c-a9eb-17b686b81ad5 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:16.166952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fec47b-f9e7-445c-a9eb-17b686b81ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:16.167222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fec47b-f9e7-445c-a9eb-17b686b81ad5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:16.178044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fec47b-f9e7-445c-a9eb-17b686b81ad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:46:16.182791 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-a6fec47b-f9e7-445c-a9eb-17b686b81ad5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:46:16.182791 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:46:16.182791 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:46:16.182791 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:46:16.182791 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:46:16.182791 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:46:16.182791 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:46:16.182791 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:46:16.182791 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:46:16.182791 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:46:16.182791 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:46:16.182791 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:46:16.182791 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:46:16.182791 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:46:16.182791 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:46:16.182791 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:46:16.184023 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:46:16.184023 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:46:16.184023 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:46:16.184023 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:46:16.184023 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:46:16.184023 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:46:16.184023 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:46:16.184023 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:46:16.184023 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:46:16.184023 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:46:16.184023 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:46:16.184023 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:46:16.184023 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:46:16.184023 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:46:16.184023 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:46:16.184023 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:46:16.185216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:46:16.185216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:46:16.185216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:46:16.185216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:46:16.185216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:46:16.185216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:46:16.185216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:46:16.185216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:46:16.185216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:46:16.185216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:46:16.185216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:46:16.185216 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:46:16.185216 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 575/1156] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:46:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:46:16.190939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89ce34-5941-4973-893d-e8c529c9d696 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:16.287763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89ce34-5941-4973-893d-e8c529c9d696 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:16.323796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98681f-b834-41b6-8f74-44889358093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:16.324456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98681f-b834-41b6-8f74-44889358093c None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:16.324777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98681f-b834-41b6-8f74-44889358093c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:16.325054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98681f-b834-41b6-8f74-44889358093c None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:16.325794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98681f-b834-41b6-8f74-44889358093c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:46:16.326140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98681f-b834-41b6-8f74-44889358093c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:16.327699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98681f-b834-41b6-8f74-44889358093c None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:16.330418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:16.337311 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 582/1157] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:46:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:16.343206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fec47b-f9e7-445c-a9eb-17b686b81ad5 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:16.434109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:16.446841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fec47b-f9e7-445c-a9eb-17b686b81ad5 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:16.480694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c756b-732d-412c-90f8-dcf78661c963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:16.481339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c756b-732d-412c-90f8-dcf78661c963 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:16.481629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c756b-732d-412c-90f8-dcf78661c963 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:16.481912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c756b-732d-412c-90f8-dcf78661c963 None admin] PATH_INFO: `/v3/users/45fa71ca8b414965abb0a383cca203f8` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:16.483075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c756b-732d-412c-90f8-dcf78661c963 None admin] RBAC: Authorizing `identity:get_user(user_id=45fa71ca8b414965abb0a383cca203f8)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:16.484559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c756b-732d-412c-90f8-dcf78661c963 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:16.486851 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 576/1158] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:46:16 2022] GET /identity/v3/users/45fa71ca8b414965abb0a383cca203f8 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:16.492691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98681f-b834-41b6-8f74-44889358093c None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:16.588436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98681f-b834-41b6-8f74-44889358093c None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:16.620829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fe7a6-6490-4fa1-8f3c-d8f1ed498b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:16.621432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fe7a6-6490-4fa1-8f3c-d8f1ed498b07 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:16.621713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fe7a6-6490-4fa1-8f3c-d8f1ed498b07 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:16.621988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fe7a6-6490-4fa1-8f3c-d8f1ed498b07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:16.685757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:16.689843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fe7a6-6490-4fa1-8f3c-d8f1ed498b07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:16.691272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fe7a6-6490-4fa1-8f3c-d8f1ed498b07 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:16.787092 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 583/1159] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:46:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 30 20:46:16.793058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c756b-732d-412c-90f8-dcf78661c963 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:16.891132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c756b-732d-412c-90f8-dcf78661c963 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:16.924953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247d8b2-0389-4d60-8879-f20e1466670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:16.925582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247d8b2-0389-4d60-8879-f20e1466670a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:16.925868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247d8b2-0389-4d60-8879-f20e1466670a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:16.926148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247d8b2-0389-4d60-8879-f20e1466670a None admin] PATH_INFO: `/v3/projects/9fec573c9db94e0189b73698525ef374` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:16.927322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247d8b2-0389-4d60-8879-f20e1466670a None admin] RBAC: Authorizing `identity:get_project(project_id=9fec573c9db94e0189b73698525ef374)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:16.928759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247d8b2-0389-4d60-8879-f20e1466670a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:16.930405 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 577/1160] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:46:16 2022] GET /identity/v3/projects/9fec573c9db94e0189b73698525ef374 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:16.936520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fe7a6-6490-4fa1-8f3c-d8f1ed498b07 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:17.030711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:17.034734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fe7a6-6490-4fa1-8f3c-d8f1ed498b07 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:17.068490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c180726-df25-4085-bcd6-65171cc0b62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:17.069104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c180726-df25-4085-bcd6-65171cc0b62f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:17.069391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c180726-df25-4085-bcd6-65171cc0b62f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:17.069674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c180726-df25-4085-bcd6-65171cc0b62f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:17.070463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c180726-df25-4085-bcd6-65171cc0b62f None admin] RBAC: Adding query filter params (role.id=3b89b89da98d4ec08a0587aa13832636, scope.project.id=9fec573c9db94e0189b73698525ef374, user.id=45fa71ca8b414965abb0a383cca203f8) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:46:17.070773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c180726-df25-4085-bcd6-65171cc0b62f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:17.072227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c180726-df25-4085-bcd6-65171cc0b62f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:17.077825 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 584/1161] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:46:16 2022] GET /identity/v3/role_assignments?user.id=45fa71ca8b414965abb0a383cca203f8&scope.project.id=9fec573c9db94e0189b73698525ef374&role.id=3b89b89da98d4ec08a0587aa13832636 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:19.317421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc48c27-31b5-45a7-81b4-2a4fb8663c70 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:19.317980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc48c27-31b5-45a7-81b4-2a4fb8663c70 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:19.317980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc48c27-31b5-45a7-81b4-2a4fb8663c70 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:19.319350 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 578/1162] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:46:19.324385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7fced-956e-4945-851e-a0dc6cdaa939 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:19.324917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7fced-956e-4945-851e-a0dc6cdaa939 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:19.325088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7fced-956e-4945-851e-a0dc6cdaa939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:19.343769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-efc7fced-956e-4945-851e-a0dc6cdaa939 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:46:19.344969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-efc7fced-956e-4945-851e-a0dc6cdaa939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:46:19.410271 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 585/1163] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:46:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:46:19.434326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc48c27-31b5-45a7-81b4-2a4fb8663c70 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:19.460768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:19.536193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc48c27-31b5-45a7-81b4-2a4fb8663c70 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:19.569325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93471e2d-d427-4fb5-8aa2-736123ad5b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:19.569877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93471e2d-d427-4fb5-8aa2-736123ad5b58 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:19.570161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93471e2d-d427-4fb5-8aa2-736123ad5b58 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:19.570436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93471e2d-d427-4fb5-8aa2-736123ad5b58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:19.634642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93471e2d-d427-4fb5-8aa2-736123ad5b58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:19.636112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93471e2d-d427-4fb5-8aa2-736123ad5b58 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:19.659015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:19.731180 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 579/1164] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:46:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 30 20:46:19.737265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7fced-956e-4945-851e-a0dc6cdaa939 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:19.823756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:19.833161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7fced-956e-4945-851e-a0dc6cdaa939 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:19.865189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b27b08-c8bd-4bc2-be76-3b979760706f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:19.865822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27b08-c8bd-4bc2-be76-3b979760706f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:19.866105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27b08-c8bd-4bc2-be76-3b979760706f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:19.866384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27b08-c8bd-4bc2-be76-3b979760706f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:19.873083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b27b08-c8bd-4bc2-be76-3b979760706f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:19.874512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b27b08-c8bd-4bc2-be76-3b979760706f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:19.893093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-53b27b08-c8bd-4bc2-be76-3b979760706f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 30 20:46:19.893093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:46:19.893093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 30 20:46:19.893093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 30 20:46:19.893093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:46:19.893093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:46:19.893093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:46:19.893093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:46:19.893093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 30 20:46:19.893093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:46:19.893093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:46:19.893093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:46:19.893093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:46:19.893093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:46:19.893093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:46:19.893093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:46:19.893093 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:46:19.894381 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:46:19.894381 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:46:19.894381 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:46:19.894381 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:46:19.894381 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:46:19.894381 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:46:19.894381 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:46:19.894381 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:46:19.894381 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:46:19.894381 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:46:19.894381 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:46:19.894381 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:46:19.894381 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:46:19.894381 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:46:19.894381 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:46:19.894381 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:46:19.895580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:46:19.895580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:46:19.895580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:46:19.895580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:46:19.895580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:46:19.895580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:46:19.895580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:46:19.895580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:46:19.895580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:46:19.895580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:46:19.895580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 30 20:46:19.895580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:46:19.895580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 30 20:46:19.895580 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:46:19.895580 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 586/1165] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Jul 30 20:46:19 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:46:19.900184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93471e2d-d427-4fb5-8aa2-736123ad5b58 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:19.996406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93471e2d-d427-4fb5-8aa2-736123ad5b58 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:20.019933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:20.030798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52472dc7-6c92-442a-8463-ad2ec95dec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:20.031452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52472dc7-6c92-442a-8463-ad2ec95dec23 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:20.031743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52472dc7-6c92-442a-8463-ad2ec95dec23 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:20.032019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52472dc7-6c92-442a-8463-ad2ec95dec23 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:20.032707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52472dc7-6c92-442a-8463-ad2ec95dec23 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:46:20.033020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52472dc7-6c92-442a-8463-ad2ec95dec23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:20.034378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52472dc7-6c92-442a-8463-ad2ec95dec23 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:20.041362 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 580/1166] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Jul 30 20:46:19 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:22.245751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b7493-055a-4e4c-876c-b2ab7ea126cd None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:22.246269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b7493-055a-4e4c-876c-b2ab7ea126cd None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:22.246269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b7493-055a-4e4c-876c-b2ab7ea126cd None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:22.247568 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 587/1167] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:46:22.252745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d44f69-2414-4afd-80c0-a86471ae5fb4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:22.253142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d44f69-2414-4afd-80c0-a86471ae5fb4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:22.253302 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d44f69-2414-4afd-80c0-a86471ae5fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:22.271420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f3d44f69-2414-4afd-80c0-a86471ae5fb4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:46:22.272593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f3d44f69-2414-4afd-80c0-a86471ae5fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:46:22.338470 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 581/1168] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:46:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:46:22.362521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b7493-055a-4e4c-876c-b2ab7ea126cd None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:22.460321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b7493-055a-4e4c-876c-b2ab7ea126cd None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:22.492926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe75d1-701d-4557-85e1-6ed38776cc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:22.493538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe75d1-701d-4557-85e1-6ed38776cc15 None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:22.493825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe75d1-701d-4557-85e1-6ed38776cc15 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:22.494104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe75d1-701d-4557-85e1-6ed38776cc15 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:22.495067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe75d1-701d-4557-85e1-6ed38776cc15 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:22.496516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe75d1-701d-4557-85e1-6ed38776cc15 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:22.512437 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 588/1169] 10.222.0.17 () {60 vars in 1138 bytes} [Sat Jul 30 20:46:22 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:46:24.834317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0905a-6c25-40d4-948f-1bbb9d682269 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:24.834927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0905a-6c25-40d4-948f-1bbb9d682269 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:24.834927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0905a-6c25-40d4-948f-1bbb9d682269 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:24.836212 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 582/1170] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:46:24.841425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5d21a-f62e-4e84-8ef6-80ef7b068a09 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:24.841816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5d21a-f62e-4e84-8ef6-80ef7b068a09 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:24.841985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5d21a-f62e-4e84-8ef6-80ef7b068a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:24.860270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a1c5d21a-f62e-4e84-8ef6-80ef7b068a09 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:46:24.862045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a1c5d21a-f62e-4e84-8ef6-80ef7b068a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:46:24.869478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:24.928627 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 589/1171] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:46:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:46:24.953164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0905a-6c25-40d4-948f-1bbb9d682269 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:25.061951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0905a-6c25-40d4-948f-1bbb9d682269 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:25.078550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:25.095912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c654824-095a-4d9e-a42a-573412305022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:25.096482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c654824-095a-4d9e-a42a-573412305022 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:25.096765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c654824-095a-4d9e-a42a-573412305022 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:25.097038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c654824-095a-4d9e-a42a-573412305022 None admin] PATH_INFO: `/v3/domains/c3c84019757a4e3d9e9eea1c7c7b5bf3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:25.107139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c654824-095a-4d9e-a42a-573412305022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c3c84019757a4e3d9e9eea1c7c7b5bf3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:25.108609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c654824-095a-4d9e-a42a-573412305022 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:25.110203 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 583/1172] 10.222.0.17 () {56 vars in 1183 bytes} [Sat Jul 30 20:46:24 2022] GET /identity/v3/domains/c3c84019757a4e3d9e9eea1c7c7b5bf3 => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:25.116646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5d21a-f62e-4e84-8ef6-80ef7b068a09 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:25.211923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5d21a-f62e-4e84-8ef6-80ef7b068a09 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:25.245197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdb568-cf4d-4f98-bf73-eb7da4838d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:25.245802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdb568-cf4d-4f98-bf73-eb7da4838d05 None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:25.246083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdb568-cf4d-4f98-bf73-eb7da4838d05 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:25.246357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdb568-cf4d-4f98-bf73-eb7da4838d05 None admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:25.247037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbdb568-cf4d-4f98-bf73-eb7da4838d05 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:25.248480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbdb568-cf4d-4f98-bf73-eb7da4838d05 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:25.262756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:25.275143 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 590/1173] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 30 20:46:25 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:46:27.514655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9b861-0193-476c-8044-0f04bb4c18e7 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:27.515224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9b861-0193-476c-8044-0f04bb4c18e7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:27.515224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9b861-0193-476c-8044-0f04bb4c18e7 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:27.516620 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 584/1174] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:46:27.521844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af623a71-deaa-4cff-8bf6-961c88cc0e12 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:27.522223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af623a71-deaa-4cff-8bf6-961c88cc0e12 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:27.522401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af623a71-deaa-4cff-8bf6-961c88cc0e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:27.539938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-af623a71-deaa-4cff-8bf6-961c88cc0e12 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:46:27.541116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-af623a71-deaa-4cff-8bf6-961c88cc0e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:46:27.606682 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 591/1175] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:46:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:46:27.631967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9b861-0193-476c-8044-0f04bb4c18e7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:27.731886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9b861-0193-476c-8044-0f04bb4c18e7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:27.764045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc744e60-9b24-42e7-9668-5eb54200c5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:27.764729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc744e60-9b24-42e7-9668-5eb54200c5cd None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:27.764964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc744e60-9b24-42e7-9668-5eb54200c5cd None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:27.765239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc744e60-9b24-42e7-9668-5eb54200c5cd None admin] PATH_INFO: `/v3/domains/c3c84019757a4e3d9e9eea1c7c7b5bf3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:27.766386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc744e60-9b24-42e7-9668-5eb54200c5cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=c3c84019757a4e3d9e9eea1c7c7b5bf3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:27.768369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc744e60-9b24-42e7-9668-5eb54200c5cd None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:27.770076 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 585/1176] 10.222.0.17 () {56 vars in 1183 bytes} [Sat Jul 30 20:46:27 2022] GET /identity/v3/domains/c3c84019757a4e3d9e9eea1c7c7b5bf3 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:27.775903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af623a71-deaa-4cff-8bf6-961c88cc0e12 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:27.869450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af623a71-deaa-4cff-8bf6-961c88cc0e12 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:27.893560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:27.905401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75565f1-af8f-4b95-83ab-d2a7e0ebc519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:27.906057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75565f1-af8f-4b95-83ab-d2a7e0ebc519 None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:27.906342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75565f1-af8f-4b95-83ab-d2a7e0ebc519 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:27.906619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75565f1-af8f-4b95-83ab-d2a7e0ebc519 None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:27.907372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75565f1-af8f-4b95-83ab-d2a7e0ebc519 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:27.908802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75565f1-af8f-4b95-83ab-d2a7e0ebc519 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:27.929284 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 592/1177] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 30 20:46:27 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:46:30.205687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eb841-b82e-4fa1-9ddb-1b3b12cda3fd None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:30.206234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eb841-b82e-4fa1-9ddb-1b3b12cda3fd None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:30.206234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eb841-b82e-4fa1-9ddb-1b3b12cda3fd None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:30.207619 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 586/1178] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:46:30.212786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8645b71-eac9-444e-ae9b-b4925b41c5bc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:30.213182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8645b71-eac9-444e-ae9b-b4925b41c5bc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:30.213350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8645b71-eac9-444e-ae9b-b4925b41c5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:30.231528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c8645b71-eac9-444e-ae9b-b4925b41c5bc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:46:30.232718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c8645b71-eac9-444e-ae9b-b4925b41c5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:46:30.298730 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 593/1179] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:46:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:46:30.323168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eb841-b82e-4fa1-9ddb-1b3b12cda3fd None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:30.369349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:30.427028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eb841-b82e-4fa1-9ddb-1b3b12cda3fd None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:30.459666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca682134-7a6e-4f86-a80a-c506992866c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:30.460295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca682134-7a6e-4f86-a80a-c506992866c6 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:30.460580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca682134-7a6e-4f86-a80a-c506992866c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:30.460855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca682134-7a6e-4f86-a80a-c506992866c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:30.471661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca682134-7a6e-4f86-a80a-c506992866c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:46:30.476475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-ca682134-7a6e-4f86-a80a-c506992866c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:46:30.476475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:46:30.476475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:46:30.476475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:46:30.476475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:46:30.476475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:46:30.476475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:46:30.476475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:46:30.476475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:46:30.476475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:46:30.476475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:46:30.476475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:46:30.476475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:46:30.476475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:46:30.476475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:46:30.476475 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:46:30.477603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:46:30.477603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:46:30.477603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:46:30.477603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:46:30.477603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:46:30.477603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:46:30.477603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:46:30.477603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:46:30.477603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:46:30.477603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:46:30.477603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:46:30.477603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:46:30.477603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:46:30.477603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:46:30.477603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:46:30.477603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:46:30.478839 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:46:30.478839 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:46:30.478839 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:46:30.478839 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:46:30.478839 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:46:30.478839 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:46:30.478839 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:46:30.478839 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:46:30.478839 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:46:30.478839 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:46:30.478839 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:46:30.478839 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:46:30.478839 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 587/1180] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:46:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:46:30.484659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8645b71-eac9-444e-ae9b-b4925b41c5bc None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:30.580804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8645b71-eac9-444e-ae9b-b4925b41c5bc None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:30.591029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:30.615170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be6fff-fdd5-426c-a5e2-2f169c614c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:30.615813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be6fff-fdd5-426c-a5e2-2f169c614c91 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:30.616097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be6fff-fdd5-426c-a5e2-2f169c614c91 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:30.616370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be6fff-fdd5-426c-a5e2-2f169c614c91 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:30.617084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be6fff-fdd5-426c-a5e2-2f169c614c91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:46:30.617390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be6fff-fdd5-426c-a5e2-2f169c614c91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:30.618750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be6fff-fdd5-426c-a5e2-2f169c614c91 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:30.626916 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 594/1181] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:46:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:30.632603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca682134-7a6e-4f86-a80a-c506992866c6 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:30.740282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca682134-7a6e-4f86-a80a-c506992866c6 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:30.747261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:30.774141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3ac6d-51a4-4dd2-9c94-a04d82aa1131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:30.774786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3ac6d-51a4-4dd2-9c94-a04d82aa1131 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:30.775073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3ac6d-51a4-4dd2-9c94-a04d82aa1131 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:30.775388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3ac6d-51a4-4dd2-9c94-a04d82aa1131 None admin] PATH_INFO: `/v3/users/7077531437fe4d79b1a0ec6e9825c6cb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:30.788591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3ac6d-51a4-4dd2-9c94-a04d82aa1131 None admin] RBAC: Authorizing `identity:get_user(user_id=7077531437fe4d79b1a0ec6e9825c6cb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:30.790041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3ac6d-51a4-4dd2-9c94-a04d82aa1131 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:30.791726 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 588/1182] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:46:30 2022] GET /identity/v3/users/7077531437fe4d79b1a0ec6e9825c6cb => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:30.797471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be6fff-fdd5-426c-a5e2-2f169c614c91 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:30.899636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be6fff-fdd5-426c-a5e2-2f169c614c91 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:30.931755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bd588-24e1-463c-ae3d-03dbb41795de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:30.932369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bd588-24e1-463c-ae3d-03dbb41795de None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:30.932652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bd588-24e1-463c-ae3d-03dbb41795de None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:30.932925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bd588-24e1-463c-ae3d-03dbb41795de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:30.972776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:30.999745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bd588-24e1-463c-ae3d-03dbb41795de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:31.001205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bd588-24e1-463c-ae3d-03dbb41795de None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:31.110164 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 595/1183] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:46:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 30 20:46:31.116395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3ac6d-51a4-4dd2-9c94-a04d82aa1131 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:31.212658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3ac6d-51a4-4dd2-9c94-a04d82aa1131 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:31.245703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db450b-074a-4f84-8768-414c57f61235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:31.246334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db450b-074a-4f84-8768-414c57f61235 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:31.246623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db450b-074a-4f84-8768-414c57f61235 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:31.246903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db450b-074a-4f84-8768-414c57f61235 None admin] PATH_INFO: `/v3/projects/2b8f3d5b8e374e1a86a175189693644f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:31.248261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db450b-074a-4f84-8768-414c57f61235 None admin] RBAC: Authorizing `identity:get_project(project_id=2b8f3d5b8e374e1a86a175189693644f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:31.249684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db450b-074a-4f84-8768-414c57f61235 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:31.251980 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 589/1184] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:46:31 2022] GET /identity/v3/projects/2b8f3d5b8e374e1a86a175189693644f => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:31.258398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bd588-24e1-463c-ae3d-03dbb41795de None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:31.324618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:31.352332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bd588-24e1-463c-ae3d-03dbb41795de None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:31.388157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9ffa6-265e-4901-be2f-ca1f57886c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:31.388767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9ffa6-265e-4901-be2f-ca1f57886c4e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:31.389047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9ffa6-265e-4901-be2f-ca1f57886c4e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:31.389319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9ffa6-265e-4901-be2f-ca1f57886c4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:31.390086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9ffa6-265e-4901-be2f-ca1f57886c4e None admin] RBAC: Adding query filter params (role.id=3b89b89da98d4ec08a0587aa13832636, scope.project.id=2b8f3d5b8e374e1a86a175189693644f, user.id=7077531437fe4d79b1a0ec6e9825c6cb) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:46:31.390390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9ffa6-265e-4901-be2f-ca1f57886c4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:31.391867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9ffa6-265e-4901-be2f-ca1f57886c4e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:31.397157 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 596/1185] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:46:31 2022] GET /identity/v3/role_assignments?user.id=7077531437fe4d79b1a0ec6e9825c6cb&scope.project.id=2b8f3d5b8e374e1a86a175189693644f&role.id=3b89b89da98d4ec08a0587aa13832636 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:33.614383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064c4f0-e38b-469c-a124-ada8f00ee468 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:33.614947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064c4f0-e38b-469c-a124-ada8f00ee468 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:33.614947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064c4f0-e38b-469c-a124-ada8f00ee468 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:33.616411 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 590/1186] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:46:33.621914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb84ed7-6066-43a1-a21a-7c1804532c64 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:33.622314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb84ed7-6066-43a1-a21a-7c1804532c64 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:33.622478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb84ed7-6066-43a1-a21a-7c1804532c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:33.640826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0eb84ed7-6066-43a1-a21a-7c1804532c64 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:46:33.642023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0eb84ed7-6066-43a1-a21a-7c1804532c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:46:33.712136 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 597/1187] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:46:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:46:33.736619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064c4f0-e38b-469c-a124-ada8f00ee468 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:33.768009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:33.837077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064c4f0-e38b-469c-a124-ada8f00ee468 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:33.870599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07866ac4-2177-4769-9250-20566a95d10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:33.871169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07866ac4-2177-4769-9250-20566a95d10d None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:33.871495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07866ac4-2177-4769-9250-20566a95d10d None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:33.871797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07866ac4-2177-4769-9250-20566a95d10d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:33.881653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07866ac4-2177-4769-9250-20566a95d10d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:46:33.886453 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-07866ac4-2177-4769-9250-20566a95d10d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:46:33.886453 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:46:33.886453 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:46:33.886453 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:46:33.886453 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:46:33.886453 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:46:33.886453 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:46:33.886453 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:46:33.886453 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:46:33.886453 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:46:33.886453 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:46:33.886453 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:46:33.886453 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:46:33.886453 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:46:33.886453 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:46:33.886453 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:46:33.887558 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:46:33.887558 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:46:33.887558 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:46:33.887558 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:46:33.887558 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:46:33.887558 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:46:33.887558 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:46:33.887558 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:46:33.887558 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:46:33.887558 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:46:33.887558 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:46:33.887558 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:46:33.887558 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:46:33.887558 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:46:33.887558 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:46:33.887558 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:46:33.888529 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:46:33.888529 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:46:33.888529 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:46:33.888529 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:46:33.888529 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:46:33.888529 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:46:33.888529 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:46:33.888529 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:46:33.888529 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:46:33.888529 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:46:33.888529 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:46:33.888529 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:46:33.888529 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 591/1188] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:46:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:46:33.893656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb84ed7-6066-43a1-a21a-7c1804532c64 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:33.961250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:33.997209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb84ed7-6066-43a1-a21a-7c1804532c64 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:34.033936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63c133-0c3d-469f-bfa1-28c9ba7c56c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:34.034552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63c133-0c3d-469f-bfa1-28c9ba7c56c2 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:34.034835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63c133-0c3d-469f-bfa1-28c9ba7c56c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:34.035112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63c133-0c3d-469f-bfa1-28c9ba7c56c2 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:34.035853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e63c133-0c3d-469f-bfa1-28c9ba7c56c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:46:34.036158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e63c133-0c3d-469f-bfa1-28c9ba7c56c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:34.037521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e63c133-0c3d-469f-bfa1-28c9ba7c56c2 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:34.045243 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 598/1189] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:46:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:34.051808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07866ac4-2177-4769-9250-20566a95d10d None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:34.141349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:34.150071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07866ac4-2177-4769-9250-20566a95d10d None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:34.183701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d3dbf-e6d1-4e10-8349-0bfbcd903c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:34.184336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d3dbf-e6d1-4e10-8349-0bfbcd903c38 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:34.184623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d3dbf-e6d1-4e10-8349-0bfbcd903c38 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:34.184903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d3dbf-e6d1-4e10-8349-0bfbcd903c38 None admin] PATH_INFO: `/v3/users/7077531437fe4d79b1a0ec6e9825c6cb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:34.186059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d3dbf-e6d1-4e10-8349-0bfbcd903c38 None admin] RBAC: Authorizing `identity:get_user(user_id=7077531437fe4d79b1a0ec6e9825c6cb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:34.187524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d3dbf-e6d1-4e10-8349-0bfbcd903c38 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:34.189142 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 592/1190] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:46:34 2022] GET /identity/v3/users/7077531437fe4d79b1a0ec6e9825c6cb => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:34.194973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63c133-0c3d-469f-bfa1-28c9ba7c56c2 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:34.295238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63c133-0c3d-469f-bfa1-28c9ba7c56c2 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:34.321226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:34.329303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594b7c4-f7ea-4eb5-a756-f58180d03be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:34.329934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594b7c4-f7ea-4eb5-a756-f58180d03be4 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:34.330216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594b7c4-f7ea-4eb5-a756-f58180d03be4 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:34.330490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594b7c4-f7ea-4eb5-a756-f58180d03be4 None admin] PATH_INFO: `/v3/projects/2b8f3d5b8e374e1a86a175189693644f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:34.331657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594b7c4-f7ea-4eb5-a756-f58180d03be4 None admin] RBAC: Authorizing `identity:get_project(project_id=2b8f3d5b8e374e1a86a175189693644f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:34.333091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594b7c4-f7ea-4eb5-a756-f58180d03be4 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:34.334732 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 599/1191] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:46:34 2022] GET /identity/v3/projects/2b8f3d5b8e374e1a86a175189693644f => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:34.341087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d3dbf-e6d1-4e10-8349-0bfbcd903c38 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:34.441045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d3dbf-e6d1-4e10-8349-0bfbcd903c38 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:34.473883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a9e85-b78d-48ca-ae34-dea47abf8edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:34.474546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a9e85-b78d-48ca-ae34-dea47abf8edd None admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:34.474830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a9e85-b78d-48ca-ae34-dea47abf8edd None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:34.475109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a9e85-b78d-48ca-ae34-dea47abf8edd None admin] PATH_INFO: `/v3/projects/2b8f3d5b8e374e1a86a175189693644f/users/7077531437fe4d79b1a0ec6e9825c6cb/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:34.477081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a9e85-b78d-48ca-ae34-dea47abf8edd None admin] RBAC: Authorizing `identity:create_grant(project_id=2b8f3d5b8e374e1a86a175189693644f, user_id=7077531437fe4d79b1a0ec6e9825c6cb, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:34.478519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a9e85-b78d-48ca-ae34-dea47abf8edd None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:34.491576 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 593/1192] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:46:34 2022] PUT /identity/v3/projects/2b8f3d5b8e374e1a86a175189693644f/users/7077531437fe4d79b1a0ec6e9825c6cb/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 20:46:36.699857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71760f-ac77-4afc-a23f-af5ddad14e19 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:36.700410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71760f-ac77-4afc-a23f-af5ddad14e19 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:36.700410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71760f-ac77-4afc-a23f-af5ddad14e19 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:36.701740 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 600/1193] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:46:36.707420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad9fe0-f5f8-4c22-a34f-286c91d6c714 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:36.707824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad9fe0-f5f8-4c22-a34f-286c91d6c714 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:36.707972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad9fe0-f5f8-4c22-a34f-286c91d6c714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:36.726229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bfad9fe0-f5f8-4c22-a34f-286c91d6c714 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:46:36.727435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bfad9fe0-f5f8-4c22-a34f-286c91d6c714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:46:36.740929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:36.792686 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 594/1194] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:46:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:46:36.817038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71760f-ac77-4afc-a23f-af5ddad14e19 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:36.916728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71760f-ac77-4afc-a23f-af5ddad14e19 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:36.950359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e2dbf-0dd4-421f-bf4b-32389c8d087c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:36.950928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e2dbf-0dd4-421f-bf4b-32389c8d087c None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:36.951207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e2dbf-0dd4-421f-bf4b-32389c8d087c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:36.951507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e2dbf-0dd4-421f-bf4b-32389c8d087c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:36.961992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e2dbf-0dd4-421f-bf4b-32389c8d087c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:46:36.967068 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-838e2dbf-0dd4-421f-bf4b-32389c8d087c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:46:36.967068 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:46:36.967068 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:46:36.967068 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:46:36.967068 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:46:36.967068 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:46:36.967068 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:46:36.967068 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:46:36.967068 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:46:36.967068 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:46:36.967068 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:46:36.967068 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:46:36.967068 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:46:36.967068 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:46:36.967068 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:46:36.967068 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:46:36.968030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:46:36.968030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:46:36.968030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:46:36.968030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:46:36.968030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:46:36.968030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:46:36.968030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:46:36.968030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:46:36.968030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:46:36.968030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:46:36.968030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:46:36.968030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:46:36.968030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:46:36.968030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:46:36.968030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:46:36.968030 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:46:36.968914 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:46:36.968914 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:46:36.968914 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:46:36.968914 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:46:36.968914 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:46:36.968914 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:46:36.968914 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:46:36.968914 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:46:36.968914 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:46:36.968914 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:46:36.968914 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:46:36.968914 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:46:36.968914 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 601/1195] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:46:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:46:36.975075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad9fe0-f5f8-4c22-a34f-286c91d6c714 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:37.072854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad9fe0-f5f8-4c22-a34f-286c91d6c714 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:37.105638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c954e6c-aa05-4282-8f7f-7b1bf4780a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:37.106252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c954e6c-aa05-4282-8f7f-7b1bf4780a67 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:37.106538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c954e6c-aa05-4282-8f7f-7b1bf4780a67 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:37.106812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c954e6c-aa05-4282-8f7f-7b1bf4780a67 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:37.107560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c954e6c-aa05-4282-8f7f-7b1bf4780a67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:46:37.107869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c954e6c-aa05-4282-8f7f-7b1bf4780a67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:37.109240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c954e6c-aa05-4282-8f7f-7b1bf4780a67 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:37.117603 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 595/1196] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:46:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:37.123646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e2dbf-0dd4-421f-bf4b-32389c8d087c None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:37.178672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:37.222225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e2dbf-0dd4-421f-bf4b-32389c8d087c None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:37.254467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea9654-f88b-4a47-8bf9-31e8156870e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:37.255101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea9654-f88b-4a47-8bf9-31e8156870e8 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:37.255419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea9654-f88b-4a47-8bf9-31e8156870e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:37.255705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea9654-f88b-4a47-8bf9-31e8156870e8 None admin] PATH_INFO: `/v3/users/7077531437fe4d79b1a0ec6e9825c6cb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:37.256933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea9654-f88b-4a47-8bf9-31e8156870e8 None admin] RBAC: Authorizing `identity:get_user(user_id=7077531437fe4d79b1a0ec6e9825c6cb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:37.258370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea9654-f88b-4a47-8bf9-31e8156870e8 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:37.259978 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 602/1197] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 30 20:46:37 2022] GET /identity/v3/users/7077531437fe4d79b1a0ec6e9825c6cb => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:37.265606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c954e6c-aa05-4282-8f7f-7b1bf4780a67 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:37.280964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:37.363146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c954e6c-aa05-4282-8f7f-7b1bf4780a67 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:37.395976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a5d32-783d-410a-af45-17d5e2801d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:37.396618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a5d32-783d-410a-af45-17d5e2801d3e None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:37.396904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a5d32-783d-410a-af45-17d5e2801d3e None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:37.397182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a5d32-783d-410a-af45-17d5e2801d3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:37.464033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a5d32-783d-410a-af45-17d5e2801d3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:37.465478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a5d32-783d-410a-af45-17d5e2801d3e None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:37.478647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:37.562557 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 596/1198] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:46:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 30 20:46:37.570091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea9654-f88b-4a47-8bf9-31e8156870e8 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:37.667477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea9654-f88b-4a47-8bf9-31e8156870e8 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:37.690911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:37.701619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e5967-b837-4d41-af03-7acdc510268f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:37.702248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e5967-b837-4d41-af03-7acdc510268f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:37.702528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e5967-b837-4d41-af03-7acdc510268f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:37.702802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e5967-b837-4d41-af03-7acdc510268f None admin] PATH_INFO: `/v3/projects/2b8f3d5b8e374e1a86a175189693644f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:37.703988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e5967-b837-4d41-af03-7acdc510268f None admin] RBAC: Authorizing `identity:get_project(project_id=2b8f3d5b8e374e1a86a175189693644f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:37.705413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e5967-b837-4d41-af03-7acdc510268f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:37.707048 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 603/1199] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 30 20:46:37 2022] GET /identity/v3/projects/2b8f3d5b8e374e1a86a175189693644f => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:37.713169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a5d32-783d-410a-af45-17d5e2801d3e None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:46:37.808752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a5d32-783d-410a-af45-17d5e2801d3e None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:46:37.821499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:37.842081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29caa6fe-96c9-4e31-9ff3-070a6a60b742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:46:37.842713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caa6fe-96c9-4e31-9ff3-070a6a60b742 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:46:37.842995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caa6fe-96c9-4e31-9ff3-070a6a60b742 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:46:37.843267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caa6fe-96c9-4e31-9ff3-070a6a60b742 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:46:37.844578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29caa6fe-96c9-4e31-9ff3-070a6a60b742 None admin] RBAC: Adding query filter params (role.id=3b89b89da98d4ec08a0587aa13832636, scope.project.id=2b8f3d5b8e374e1a86a175189693644f, user.id=7077531437fe4d79b1a0ec6e9825c6cb) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:46:37.844895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29caa6fe-96c9-4e31-9ff3-070a6a60b742 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:46:37.846314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29caa6fe-96c9-4e31-9ff3-070a6a60b742 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:46:37.851985 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 597/1200] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:46:37 2022] GET /identity/v3/role_assignments?user.id=7077531437fe4d79b1a0ec6e9825c6cb&scope.project.id=2b8f3d5b8e374e1a86a175189693644f&role.id=3b89b89da98d4ec08a0587aa13832636 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:46:47.697492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:46:47.849498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=12 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:39.263125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e2ba1-004e-4fb9-9467-57eff5629a3e None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:39.263814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e2ba1-004e-4fb9-9467-57eff5629a3e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:39.263814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e2ba1-004e-4fb9-9467-57eff5629a3e None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:39.265046 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 604/1201] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:47:39.271416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2ddcd-42ce-46e0-b48e-1ba420638834 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:39.271416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2ddcd-42ce-46e0-b48e-1ba420638834 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:39.271416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2ddcd-42ce-46e0-b48e-1ba420638834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:39.293800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e8e2ddcd-42ce-46e0-b48e-1ba420638834 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:47:39.295922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e8e2ddcd-42ce-46e0-b48e-1ba420638834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:47:39.375602 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 598/1202] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:47:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:47:39.402505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e2ba1-004e-4fb9-9467-57eff5629a3e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:39.557295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e2ba1-004e-4fb9-9467-57eff5629a3e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:39.595955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d233ca6-be8f-4985-a553-cd64c740cd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:39.596629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d233ca6-be8f-4985-a553-cd64c740cd0d None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:39.596913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d233ca6-be8f-4985-a553-cd64c740cd0d None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:39.597187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d233ca6-be8f-4985-a553-cd64c740cd0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:39.610361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d233ca6-be8f-4985-a553-cd64c740cd0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:39.612021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d233ca6-be8f-4985-a553-cd64c740cd0d None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:39.631783 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-6d233ca6-be8f-4985-a553-cd64c740cd0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:47:39.631783 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:39.631783 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:39.631783 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:39.631783 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:39.631783 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:39.631783 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:39.631783 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:39.631783 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:39.631783 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:39.631783 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:39.631783 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:39.631783 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:47:39.631783 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:47:39.631783 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:47:39.633124 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:47:39.633124 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:39.633124 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:39.633124 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:39.633124 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:39.633124 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:39.633124 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:39.633124 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:39.633124 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:39.633124 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:39.633124 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:39.633124 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:39.633124 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:39.633124 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:39.633124 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:39.633124 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:39.633124 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:39.634200 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:47:39.634200 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:47:39.634200 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:47:39.634200 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:47:39.634200 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 605/1203] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:47:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:47:39.639988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2ddcd-42ce-46e0-b48e-1ba420638834 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:39.770064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2ddcd-42ce-46e0-b48e-1ba420638834 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:39.809545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:39.816739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08bf1a3-2656-4e05-8cb6-0ecc21726cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:39.817724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bf1a3-2656-4e05-8cb6-0ecc21726cd7 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:39.818082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bf1a3-2656-4e05-8cb6-0ecc21726cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:39.818436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bf1a3-2656-4e05-8cb6-0ecc21726cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:39.819231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08bf1a3-2656-4e05-8cb6-0ecc21726cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:39.819577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08bf1a3-2656-4e05-8cb6-0ecc21726cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:39.821294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08bf1a3-2656-4e05-8cb6-0ecc21726cd7 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:39.836418 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 599/1204] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:39.842674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d233ca6-be8f-4985-a553-cd64c740cd0d None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:39.917576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:39.977080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d233ca6-be8f-4985-a553-cd64c740cd0d None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:40.024881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80663a01-7279-423a-bce4-ff4e6515d039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:40.025857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80663a01-7279-423a-bce4-ff4e6515d039 None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:40.026186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80663a01-7279-423a-bce4-ff4e6515d039 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:40.026433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80663a01-7279-423a-bce4-ff4e6515d039 None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:40.027158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80663a01-7279-423a-bce4-ff4e6515d039 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:40.028637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80663a01-7279-423a-bce4-ff4e6515d039 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:40.062321 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 606/1205] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 30 20:47:39 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 20:47:42.612062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f06eea-24f2-41b8-9a01-e799e7d4f9a8 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:42.612624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f06eea-24f2-41b8-9a01-e799e7d4f9a8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:42.612624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f06eea-24f2-41b8-9a01-e799e7d4f9a8 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:42.614103 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 600/1206] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:47:42.620247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb83ee-4518-43c9-8b4d-38a0646cfcd9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:42.621812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb83ee-4518-43c9-8b4d-38a0646cfcd9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:42.621812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb83ee-4518-43c9-8b4d-38a0646cfcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:42.643842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0dbb83ee-4518-43c9-8b4d-38a0646cfcd9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:47:42.645190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0dbb83ee-4518-43c9-8b4d-38a0646cfcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:47:42.729932 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 607/1207] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:47:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:47:42.760210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f06eea-24f2-41b8-9a01-e799e7d4f9a8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:42.882689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f06eea-24f2-41b8-9a01-e799e7d4f9a8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:42.927362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31b9f6-305d-4b46-a680-44f025903f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:42.928043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31b9f6-305d-4b46-a680-44f025903f8b None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:42.928355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31b9f6-305d-4b46-a680-44f025903f8b None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:42.928618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31b9f6-305d-4b46-a680-44f025903f8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:42.939497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31b9f6-305d-4b46-a680-44f025903f8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:47:42.944248 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-1b31b9f6-305d-4b46-a680-44f025903f8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:47:42.944248 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:42.944248 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:42.944248 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:42.944248 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:42.944248 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:42.944248 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:42.944248 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:42.944248 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:42.944248 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:42.944248 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:42.944248 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:42.944248 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:47:42.944248 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:47:42.944248 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:47:42.944248 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:47:42.945346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:47:42.945346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:47:42.945346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:47:42.945346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:47:42.945346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:42.945346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:42.945346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:42.945346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:42.945346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:42.945346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:42.945346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:42.945346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:42.945346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:42.945346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:42.945346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:42.945346 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:42.946244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:42.946244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:42.946244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:42.946244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:42.946244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:47:42.946244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:47:42.946244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:47:42.946244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:47:42.946244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:47:42.946244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:47:42.946244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:47:42.946244 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:47:42.946244 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 601/1208] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:47:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:47:42.953099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb83ee-4518-43c9-8b4d-38a0646cfcd9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:43.006860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:43.086943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb83ee-4518-43c9-8b4d-38a0646cfcd9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:43.126848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40ee43-1ef7-40a3-9817-110de7774ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:43.127605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40ee43-1ef7-40a3-9817-110de7774ddf None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:43.127889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40ee43-1ef7-40a3-9817-110de7774ddf None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:43.128228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40ee43-1ef7-40a3-9817-110de7774ddf None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:43.128905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40ee43-1ef7-40a3-9817-110de7774ddf None admin] RBAC: Adding query filter params (name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:43.129206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40ee43-1ef7-40a3-9817-110de7774ddf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:43.130734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40ee43-1ef7-40a3-9817-110de7774ddf None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:43.141128 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 608/1209] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:47:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:43.146866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31b9f6-305d-4b46-a680-44f025903f8b None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:43.221341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:43.277761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31b9f6-305d-4b46-a680-44f025903f8b None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:43.317255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735b3f4-47b1-4427-979b-a343419c2096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:43.317989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735b3f4-47b1-4427-979b-a343419c2096 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:43.318333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735b3f4-47b1-4427-979b-a343419c2096 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:43.318723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735b3f4-47b1-4427-979b-a343419c2096 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:43.333291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735b3f4-47b1-4427-979b-a343419c2096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:43.335565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735b3f4-47b1-4427-979b-a343419c2096 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:43.354101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-f735b3f4-47b1-4427-979b-a343419c2096 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:47:43.354101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:43.354101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:43.354101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:43.354101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:43.354101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:43.354101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:43.354101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:43.354101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:43.354101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:43.354101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:43.354101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:43.354101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:47:43.354101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:47:43.354101 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:47:43.355139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:47:43.355139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:43.355139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:43.355139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:43.355139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:43.355139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:43.355139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:43.355139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:43.355139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:43.355139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:43.355139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:43.355139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:43.355139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:43.355139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:43.355139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:43.355139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:43.355139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:43.356164 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:47:43.356164 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:47:43.356164 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:47:43.356164 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:47:43.356164 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 602/1210] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:47:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:47:43.362078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40ee43-1ef7-40a3-9817-110de7774ddf None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:43.478735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:43.485301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40ee43-1ef7-40a3-9817-110de7774ddf None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:43.525580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623aa92b-c963-405d-8254-c1bc7a1c984a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:43.526210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623aa92b-c963-405d-8254-c1bc7a1c984a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:43.526497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623aa92b-c963-405d-8254-c1bc7a1c984a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:43.526780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623aa92b-c963-405d-8254-c1bc7a1c984a None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:43.527506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623aa92b-c963-405d-8254-c1bc7a1c984a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:43.527815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623aa92b-c963-405d-8254-c1bc7a1c984a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:43.529203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623aa92b-c963-405d-8254-c1bc7a1c984a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:43.541588 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 609/1211] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:43.548436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735b3f4-47b1-4427-979b-a343419c2096 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:43.677107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735b3f4-47b1-4427-979b-a343419c2096 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:43.679330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:43.721507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78007047-3225-41aa-b020-a605a6a42642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:43.722434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78007047-3225-41aa-b020-a605a6a42642 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:43.722878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78007047-3225-41aa-b020-a605a6a42642 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:43.723191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78007047-3225-41aa-b020-a605a6a42642 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:43.732289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78007047-3225-41aa-b020-a605a6a42642 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:43.733943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78007047-3225-41aa-b020-a605a6a42642 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:43.748620 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-78007047-3225-41aa-b020-a605a6a42642 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 30 20:47:43.748620 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:43.748620 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:43.748620 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:43.748620 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:43.748620 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:43.748620 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:43.748620 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:43.748620 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:43.748620 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:43.748620 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:43.748620 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:43.748620 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:47:43.748620 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:47:43.748620 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:47:43.748620 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:47:43.750600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:43.750600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:43.750600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:47:43.750600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:47:43.750600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:47:43.750600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:47:43.750600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:43.750600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:43.750600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:43.750600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:43.750600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:43.750600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:43.750600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:43.750600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:43.750600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:43.750600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:43.750600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:43.750600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:43.751628 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:43.751628 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:43.751628 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:47:43.751628 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:47:43.751628 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:47:43.751628 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:47:43.751628 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:47:43.751628 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:47:43.751628 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 30 20:47:43.751628 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:47:43.751628 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 603/1212] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:47:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:47:43.756934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623aa92b-c963-405d-8254-c1bc7a1c984a None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:43.868921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623aa92b-c963-405d-8254-c1bc7a1c984a None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:43.907207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408e8f3-7a16-4ad4-9ba6-135bdc8ebd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:43.907856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408e8f3-7a16-4ad4-9ba6-135bdc8ebd52 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:43.908262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408e8f3-7a16-4ad4-9ba6-135bdc8ebd52 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:43.908393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408e8f3-7a16-4ad4-9ba6-135bdc8ebd52 None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:43.909190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408e8f3-7a16-4ad4-9ba6-135bdc8ebd52 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:43.909481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408e8f3-7a16-4ad4-9ba6-135bdc8ebd52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:43.910898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408e8f3-7a16-4ad4-9ba6-135bdc8ebd52 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:43.932086 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 610/1213] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Jul 30 20:47:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:43.938007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78007047-3225-41aa-b020-a605a6a42642 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:44.065359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78007047-3225-41aa-b020-a605a6a42642 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:44.114071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9b4b2-7327-4714-aaff-0ccfcdf41fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:44.114703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9b4b2-7327-4714-aaff-0ccfcdf41fb4 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:44.114994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9b4b2-7327-4714-aaff-0ccfcdf41fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:44.115275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9b4b2-7327-4714-aaff-0ccfcdf41fb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:44.150924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:44.193444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9b4b2-7327-4714-aaff-0ccfcdf41fb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:44.194892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9b4b2-7327-4714-aaff-0ccfcdf41fb4 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:44.303148 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 604/1214] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:47:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 30 20:47:44.306231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408e8f3-7a16-4ad4-9ba6-135bdc8ebd52 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:44.326031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:44.424828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408e8f3-7a16-4ad4-9ba6-135bdc8ebd52 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:44.459683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56796454-9496-430c-9288-6ac562c5f750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:44.460388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56796454-9496-430c-9288-6ac562c5f750 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:44.460647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56796454-9496-430c-9288-6ac562c5f750 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:44.460928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56796454-9496-430c-9288-6ac562c5f750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:44.472214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56796454-9496-430c-9288-6ac562c5f750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:44.473828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56796454-9496-430c-9288-6ac562c5f750 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:44.489539 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-56796454-9496-430c-9288-6ac562c5f750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:47:44.489539 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:44.489539 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:44.489539 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:44.489539 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:44.489539 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:44.489539 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:44.489539 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:44.489539 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:44.489539 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:44.489539 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:44.489539 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:44.489539 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:47:44.489539 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:47:44.489539 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:47:44.490505 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:47:44.490505 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:44.490505 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:44.490505 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:44.490505 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:44.490505 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:44.490505 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:44.490505 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:44.490505 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:44.490505 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:44.490505 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:44.490505 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:44.490505 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:44.490505 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:44.490505 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:44.490505 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:44.490505 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:44.491805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:47:44.491805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:47:44.491805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:47:44.491805 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:47:44.491805 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 611/1215] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:47:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:47:44.497176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9b4b2-7327-4714-aaff-0ccfcdf41fb4 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:44.564345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:44.606419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9b4b2-7327-4714-aaff-0ccfcdf41fb4 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:44.644511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931b2ee-7cb0-4daf-acfb-06753b1886c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:44.645286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931b2ee-7cb0-4daf-acfb-06753b1886c2 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:44.645729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931b2ee-7cb0-4daf-acfb-06753b1886c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:44.646149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931b2ee-7cb0-4daf-acfb-06753b1886c2 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:44.647017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931b2ee-7cb0-4daf-acfb-06753b1886c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:44.647501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931b2ee-7cb0-4daf-acfb-06753b1886c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:44.649226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931b2ee-7cb0-4daf-acfb-06753b1886c2 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:44.666915 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 605/1216] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:44.668156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56796454-9496-430c-9288-6ac562c5f750 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:44.751977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:44.795122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56796454-9496-430c-9288-6ac562c5f750 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:44.837459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22a4c8-feb0-44ac-9ec8-12e1ce1a8dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:44.838306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22a4c8-feb0-44ac-9ec8-12e1ce1a8dbd None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:44.838654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22a4c8-feb0-44ac-9ec8-12e1ce1a8dbd None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:44.839000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22a4c8-feb0-44ac-9ec8-12e1ce1a8dbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:44.846979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22a4c8-feb0-44ac-9ec8-12e1ce1a8dbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:44.848478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22a4c8-feb0-44ac-9ec8-12e1ce1a8dbd None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:44.862812 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-1b22a4c8-feb0-44ac-9ec8-12e1ce1a8dbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:47:44.862812 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:44.862812 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:44.862812 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:44.862812 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:44.862812 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:44.862812 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:44.862812 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:44.862812 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:44.862812 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:44.862812 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:44.862812 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:44.862812 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:47:44.862812 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:47:44.862812 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:47:44.864032 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:47:44.864032 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:44.864032 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:44.864032 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:44.864032 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:44.864032 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:44.864032 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:44.864032 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:44.864032 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:44.864032 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:44.864032 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:44.864032 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:44.864032 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:44.864032 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:44.864032 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:44.864032 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:44.864032 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:44.865126 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:47:44.865126 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:47:44.865126 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:47:44.865126 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:47:44.865126 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:47:44.865126 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:47:44.865126 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:47:44.865126 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:47:44.865126 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 612/1217] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:47:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:47:44.870477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931b2ee-7cb0-4daf-acfb-06753b1886c2 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:45.007651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931b2ee-7cb0-4daf-acfb-06753b1886c2 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:45.036381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:45.056690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bdf1a-7091-4fb6-a898-582fbef60b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:45.057334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bdf1a-7091-4fb6-a898-582fbef60b70 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:45.057629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bdf1a-7091-4fb6-a898-582fbef60b70 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:45.057895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bdf1a-7091-4fb6-a898-582fbef60b70 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:45.058680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bdf1a-7091-4fb6-a898-582fbef60b70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:45.058988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bdf1a-7091-4fb6-a898-582fbef60b70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:45.060519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bdf1a-7091-4fb6-a898-582fbef60b70 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:45.079569 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 606/1218] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:47:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:45.081638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22a4c8-feb0-44ac-9ec8-12e1ce1a8dbd None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:45.201004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22a4c8-feb0-44ac-9ec8-12e1ce1a8dbd None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:45.236260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:45.242937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1409a-ab7b-47ee-ae86-601431081384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:45.243669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1409a-ab7b-47ee-ae86-601431081384 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:45.244014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1409a-ab7b-47ee-ae86-601431081384 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:45.244329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1409a-ab7b-47ee-ae86-601431081384 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:45.245444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1409a-ab7b-47ee-ae86-601431081384 None admin] RBAC: Adding query filter params (role.id=50fb737d5edf48298d0a6061ba652acb, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=2d1bd6b5950c4f9890a133dfd5bea4d9) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:45.245753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1409a-ab7b-47ee-ae86-601431081384 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:45.247276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1409a-ab7b-47ee-ae86-601431081384 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:45.254361 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 613/1219] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:47:45 2022] GET /identity/v3/role_assignments?user.id=2d1bd6b5950c4f9890a133dfd5bea4d9&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=50fb737d5edf48298d0a6061ba652acb => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:47.488528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfd203-2231-4038-b48a-07135894820b None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:47.489130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfd203-2231-4038-b48a-07135894820b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:47.489130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfd203-2231-4038-b48a-07135894820b None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:47.490414 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 607/1220] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:47:47.496068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392da5e-04d2-4a51-941e-33cb9e3cace9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:47.496675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392da5e-04d2-4a51-941e-33cb9e3cace9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:47.496675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392da5e-04d2-4a51-941e-33cb9e3cace9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:47.523498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a392da5e-04d2-4a51-941e-33cb9e3cace9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:47:47.524181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a392da5e-04d2-4a51-941e-33cb9e3cace9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:47:47.598352 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 614/1221] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:47:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:47:47.622585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcfd203-2231-4038-b48a-07135894820b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:47.747315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcfd203-2231-4038-b48a-07135894820b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:47.786183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4933625-8601-405d-a9a4-f4842fb9d607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:47.786835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4933625-8601-405d-a9a4-f4842fb9d607 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:47.787113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4933625-8601-405d-a9a4-f4842fb9d607 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:47.787462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4933625-8601-405d-a9a4-f4842fb9d607 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:47.801704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4933625-8601-405d-a9a4-f4842fb9d607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:47:47.807106 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-c4933625-8601-405d-a9a4-f4842fb9d607 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:47:47.807106 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:47.807106 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:47.807106 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:47.807106 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:47.807106 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:47.807106 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:47.807106 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:47.807106 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:47.807106 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:47.807106 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:47.807106 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:47.807106 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:47:47.807106 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:47:47.807106 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:47:47.807106 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:47:47.808139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:47:47.808139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:47:47.808139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:47:47.808139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:47:47.808139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:47.808139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:47.808139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:47.808139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:47.808139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:47.808139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:47.808139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:47.808139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:47.808139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:47.808139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:47.808139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:47.808139 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:47.808982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:47.808982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:47.808982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:47.808982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:47.808982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:47:47.808982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:47:47.808982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:47:47.808982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:47:47.808982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:47:47.808982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:47:47.808982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:47:47.808982 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:47:47.808982 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 608/1222] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:47:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:47:47.814457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392da5e-04d2-4a51-941e-33cb9e3cace9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:47.945355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392da5e-04d2-4a51-941e-33cb9e3cace9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:47.973918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:47.984424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85843a27-814f-452f-bcd7-00d6622c0a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:47.985145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85843a27-814f-452f-bcd7-00d6622c0a35 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:47.986213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85843a27-814f-452f-bcd7-00d6622c0a35 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:47.986213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85843a27-814f-452f-bcd7-00d6622c0a35 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:47.986595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85843a27-814f-452f-bcd7-00d6622c0a35 None admin] RBAC: Adding query filter params (name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:47.986992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85843a27-814f-452f-bcd7-00d6622c0a35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:47.988427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85843a27-814f-452f-bcd7-00d6622c0a35 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:47.998864 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 615/1223] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:47:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:48.005446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4933625-8601-405d-a9a4-f4842fb9d607 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:48.061959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:48.124882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4933625-8601-405d-a9a4-f4842fb9d607 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:48.164456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1806295-b804-4a74-9962-f68e7a61a4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:48.165109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1806295-b804-4a74-9962-f68e7a61a4c8 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:48.165395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1806295-b804-4a74-9962-f68e7a61a4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:48.165671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1806295-b804-4a74-9962-f68e7a61a4c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:48.178527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1806295-b804-4a74-9962-f68e7a61a4c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:48.180266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1806295-b804-4a74-9962-f68e7a61a4c8 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:48.200100 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-b1806295-b804-4a74-9962-f68e7a61a4c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:47:48.200100 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:48.200100 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:48.200100 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:48.200100 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:48.200100 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:48.200100 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:48.200100 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:48.200100 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:48.200100 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:48.200100 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:48.200100 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:48.200100 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:47:48.200100 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:47:48.200100 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:47:48.201349 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:47:48.201349 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:48.201349 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:48.201349 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:48.201349 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:48.201349 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:48.201349 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:48.201349 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:48.201349 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:48.201349 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:48.201349 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:48.201349 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:48.201349 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:48.201349 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:48.201349 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:48.201349 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:48.201349 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:48.202459 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:47:48.202459 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:47:48.202459 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:47:48.202459 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:47:48.202459 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 609/1224] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:47:48.208175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85843a27-814f-452f-bcd7-00d6622c0a35 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:48.339042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85843a27-814f-452f-bcd7-00d6622c0a35 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:48.379667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40231d14-8459-43f0-9688-f8788aa1608c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:48.380524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40231d14-8459-43f0-9688-f8788aa1608c None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:48.380829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40231d14-8459-43f0-9688-f8788aa1608c None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:48.381115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40231d14-8459-43f0-9688-f8788aa1608c None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:48.381985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40231d14-8459-43f0-9688-f8788aa1608c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:48.382324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40231d14-8459-43f0-9688-f8788aa1608c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:48.384190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40231d14-8459-43f0-9688-f8788aa1608c None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:48.399480 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 616/1225] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:48.405416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1806295-b804-4a74-9962-f68e7a61a4c8 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:48.519061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:48.528144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1806295-b804-4a74-9962-f68e7a61a4c8 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:48.567331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b95b9-4488-48fb-83ab-fb48161239f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:48.568124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b95b9-4488-48fb-83ab-fb48161239f9 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:48.568393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b95b9-4488-48fb-83ab-fb48161239f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:48.568746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b95b9-4488-48fb-83ab-fb48161239f9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:48.578145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b95b9-4488-48fb-83ab-fb48161239f9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:48.579728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b95b9-4488-48fb-83ab-fb48161239f9 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:48.593804 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-eb0b95b9-4488-48fb-83ab-fb48161239f9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 30 20:47:48.593804 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:48.593804 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:48.593804 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:48.593804 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:48.593804 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:48.593804 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:48.593804 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:48.593804 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:48.593804 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:48.593804 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:48.593804 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:48.593804 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:47:48.593804 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:47:48.593804 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:47:48.593804 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:47:48.594936 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:48.594936 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:48.594936 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:47:48.594936 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:47:48.594936 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:47:48.594936 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:47:48.594936 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:48.594936 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:48.594936 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:48.594936 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:48.594936 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:48.594936 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:48.594936 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:48.594936 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:48.594936 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:48.594936 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:48.594936 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:48.594936 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:48.596273 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:48.596273 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:48.596273 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:47:48.596273 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:47:48.596273 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:47:48.596273 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:47:48.596273 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:47:48.596273 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:47:48.596273 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 30 20:47:48.596273 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:47:48.596273 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 610/1226] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:47:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:47:48.601149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40231d14-8459-43f0-9688-f8788aa1608c None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:48.655442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:48.719942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40231d14-8459-43f0-9688-f8788aa1608c None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:48.757322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a97c0-044a-4b9c-9b09-fe4f51e1dee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:48.758011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a97c0-044a-4b9c-9b09-fe4f51e1dee7 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:48.758356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a97c0-044a-4b9c-9b09-fe4f51e1dee7 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:48.758632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a97c0-044a-4b9c-9b09-fe4f51e1dee7 None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:48.759508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a97c0-044a-4b9c-9b09-fe4f51e1dee7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:48.759869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a97c0-044a-4b9c-9b09-fe4f51e1dee7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:48.761346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a97c0-044a-4b9c-9b09-fe4f51e1dee7 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:48.781797 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 617/1227] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Jul 30 20:47:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:48.788701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b95b9-4488-48fb-83ab-fb48161239f9 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:48.898651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b95b9-4488-48fb-83ab-fb48161239f9 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:48.939844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10d0f2-9b3d-40a0-a0ec-590dfe55e0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:48.940495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10d0f2-9b3d-40a0-a0ec-590dfe55e0c3 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:48.940778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10d0f2-9b3d-40a0-a0ec-590dfe55e0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:48.941056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10d0f2-9b3d-40a0-a0ec-590dfe55e0c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:48.952027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10d0f2-9b3d-40a0-a0ec-590dfe55e0c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:48.953467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10d0f2-9b3d-40a0-a0ec-590dfe55e0c3 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:48.968045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-9a10d0f2-9b3d-40a0-a0ec-590dfe55e0c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:47:48.968045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:48.968045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:48.968045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:48.968045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:48.968045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:48.968045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:48.968045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:48.968045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:48.968045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:48.968045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:48.968045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:48.968045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:47:48.968045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:47:48.968045 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:47:48.969332 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:47:48.969332 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:48.969332 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:48.969332 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:48.969332 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:48.969332 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:48.969332 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:48.969332 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:48.969332 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:48.969332 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:48.969332 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:48.969332 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:48.969332 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:48.969332 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:48.969332 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:48.969332 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:48.969332 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:48.970620 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:47:48.970620 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:47:48.970620 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:47:48.970620 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:47:48.970620 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 611/1228] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:47:48.975625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a97c0-044a-4b9c-9b09-fe4f51e1dee7 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:49.083185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a97c0-044a-4b9c-9b09-fe4f51e1dee7 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:49.085554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:49.118917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772b409-4112-476e-ba09-97d6695ede96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:49.119571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772b409-4112-476e-ba09-97d6695ede96 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:49.120115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772b409-4112-476e-ba09-97d6695ede96 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:49.120389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772b409-4112-476e-ba09-97d6695ede96 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:49.121076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772b409-4112-476e-ba09-97d6695ede96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:49.121377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772b409-4112-476e-ba09-97d6695ede96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:49.122734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772b409-4112-476e-ba09-97d6695ede96 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:49.134832 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 618/1229] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:49.140980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10d0f2-9b3d-40a0-a0ec-590dfe55e0c3 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:49.150982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:49.260783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10d0f2-9b3d-40a0-a0ec-590dfe55e0c3 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:49.298941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07edd68-8c1b-4d69-a1ee-650246f0dc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:49.299805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07edd68-8c1b-4d69-a1ee-650246f0dc95 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:49.300078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07edd68-8c1b-4d69-a1ee-650246f0dc95 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:49.300749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07edd68-8c1b-4d69-a1ee-650246f0dc95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:49.308075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07edd68-8c1b-4d69-a1ee-650246f0dc95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:49.309702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07edd68-8c1b-4d69-a1ee-650246f0dc95 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:49.323217 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-f07edd68-8c1b-4d69-a1ee-650246f0dc95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:47:49.323217 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:49.323217 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:49.323217 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:49.323217 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:49.323217 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:49.323217 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:49.323217 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:49.323217 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:49.323217 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:49.323217 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:49.323217 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:49.323217 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:47:49.323217 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:47:49.323217 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:47:49.324329 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:47:49.324329 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:49.324329 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:49.324329 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:49.324329 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:49.324329 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:49.324329 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:49.324329 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:49.324329 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:49.324329 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:49.324329 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:49.324329 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:49.324329 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:49.324329 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:49.324329 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:49.324329 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:49.324329 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:49.325407 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:47:49.325407 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:47:49.325407 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:47:49.325407 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:47:49.325407 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:47:49.325407 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:47:49.325407 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:47:49.325407 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:47:49.325407 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 612/1230] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:47:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:47:49.330997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772b409-4112-476e-ba09-97d6695ede96 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:49.444471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772b409-4112-476e-ba09-97d6695ede96 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:49.480885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c7302-4478-4619-b61b-b77166c7ad10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:49.481726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c7302-4478-4619-b61b-b77166c7ad10 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:49.482030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c7302-4478-4619-b61b-b77166c7ad10 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:49.482979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c7302-4478-4619-b61b-b77166c7ad10 None admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:49.483785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c7302-4478-4619-b61b-b77166c7ad10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:49.484103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c7302-4478-4619-b61b-b77166c7ad10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:49.485539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c7302-4478-4619-b61b-b77166c7ad10 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:49.501480 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 619/1231] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:47:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:49.507955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07edd68-8c1b-4d69-a1ee-650246f0dc95 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:49.591313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:49.631050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07edd68-8c1b-4d69-a1ee-650246f0dc95 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:49.674189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c897c-f8df-4736-9b2f-a1ef9e657b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:49.675758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c897c-f8df-4736-9b2f-a1ef9e657b8c None admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:49.676155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c897c-f8df-4736-9b2f-a1ef9e657b8c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:49.676480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c897c-f8df-4736-9b2f-a1ef9e657b8c None admin] PATH_INFO: `/v3/projects/ec96772eef284ab3913f9628b136be7a/users/2d1bd6b5950c4f9890a133dfd5bea4d9/roles/50fb737d5edf48298d0a6061ba652acb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:49.696119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c897c-f8df-4736-9b2f-a1ef9e657b8c None admin] RBAC: Authorizing `identity:create_grant(project_id=ec96772eef284ab3913f9628b136be7a, user_id=2d1bd6b5950c4f9890a133dfd5bea4d9, role_id=50fb737d5edf48298d0a6061ba652acb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:49.697547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c897c-f8df-4736-9b2f-a1ef9e657b8c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:49.712960 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 613/1232] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:47:49 2022] PUT /identity/v3/projects/ec96772eef284ab3913f9628b136be7a/users/2d1bd6b5950c4f9890a133dfd5bea4d9/roles/50fb737d5edf48298d0a6061ba652acb => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 20:47:51.966329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d0534-0fdf-4076-84a1-623084c1b938 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:51.967480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d0534-0fdf-4076-84a1-623084c1b938 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:51.967480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d0534-0fdf-4076-84a1-623084c1b938 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:51.968967 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 620/1233] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:47:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:47:51.975787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6940b-76f7-4276-b9d0-3786bdadb9d9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:51.976495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6940b-76f7-4276-b9d0-3786bdadb9d9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:51.976495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6940b-76f7-4276-b9d0-3786bdadb9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:52.001484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c5e6940b-76f7-4276-b9d0-3786bdadb9d9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:47:52.003338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c5e6940b-76f7-4276-b9d0-3786bdadb9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:47:52.089337 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 614/1234] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:47:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:47:52.118313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d0534-0fdf-4076-84a1-623084c1b938 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:52.146382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:52.245737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d0534-0fdf-4076-84a1-623084c1b938 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:52.286253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff19a22-be9d-460f-a17b-f8e63d730405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:52.286908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff19a22-be9d-460f-a17b-f8e63d730405 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:52.287193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff19a22-be9d-460f-a17b-f8e63d730405 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:52.287563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff19a22-be9d-460f-a17b-f8e63d730405 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:52.298115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff19a22-be9d-460f-a17b-f8e63d730405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:47:52.302948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-8ff19a22-be9d-460f-a17b-f8e63d730405 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:47:52.302948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:52.302948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:52.302948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:52.302948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:52.302948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:52.302948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:52.302948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:52.302948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:52.302948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:52.302948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:52.302948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:52.302948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:47:52.302948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:47:52.302948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:47:52.302948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:47:52.304234 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:47:52.304234 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:47:52.304234 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:47:52.304234 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:47:52.304234 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:52.304234 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:52.304234 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:52.304234 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:52.304234 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:52.304234 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:52.304234 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:52.304234 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:52.304234 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:52.304234 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:52.304234 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:52.304234 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:52.305445 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:52.305445 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:52.305445 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:52.305445 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:52.305445 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:47:52.305445 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:47:52.305445 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:47:52.305445 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:47:52.305445 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:47:52.305445 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:47:52.305445 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 30 20:47:52.305445 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:47:52.305445 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 621/1235] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 30 20:47:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:47:52.310630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6940b-76f7-4276-b9d0-3786bdadb9d9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:52.370351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:52.430972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6940b-76f7-4276-b9d0-3786bdadb9d9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:52.469908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3299a3-6f18-4538-b8f7-ad3f737c718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:52.470540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3299a3-6f18-4538-b8f7-ad3f737c718d None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:52.470827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3299a3-6f18-4538-b8f7-ad3f737c718d None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:52.471143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3299a3-6f18-4538-b8f7-ad3f737c718d None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:52.471904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3299a3-6f18-4538-b8f7-ad3f737c718d None admin] RBAC: Adding query filter params (name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:52.472212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3299a3-6f18-4538-b8f7-ad3f737c718d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:52.473585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3299a3-6f18-4538-b8f7-ad3f737c718d None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:52.483663 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 615/1236] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 30 20:47:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:52.489685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff19a22-be9d-460f-a17b-f8e63d730405 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:52.590069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:52.612576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff19a22-be9d-460f-a17b-f8e63d730405 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:52.655087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d68b44-05b5-45df-87f6-cd42ed38738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:52.655771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d68b44-05b5-45df-87f6-cd42ed38738b None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:52.656058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d68b44-05b5-45df-87f6-cd42ed38738b None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:52.656336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d68b44-05b5-45df-87f6-cd42ed38738b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:52.666953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d68b44-05b5-45df-87f6-cd42ed38738b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:52.668449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d68b44-05b5-45df-87f6-cd42ed38738b None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:52.684110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-75d68b44-05b5-45df-87f6-cd42ed38738b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:47:52.684110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:52.684110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:52.684110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:52.684110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:52.684110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:52.684110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:52.684110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:52.684110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:52.684110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:52.684110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:52.684110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:52.684110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:47:52.684110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:47:52.684110 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:47:52.685172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:47:52.685172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:52.685172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:52.685172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:52.685172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:52.685172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:52.685172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:52.685172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:52.685172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:52.685172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:52.685172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:52.685172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:52.685172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:52.685172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:52.685172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:52.685172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:52.685172 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:52.691494 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:47:52.691494 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:47:52.691494 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:47:52.691494 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:47:52.691494 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 622/1237] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:47:52.692000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3299a3-6f18-4538-b8f7-ad3f737c718d None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:52.805078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3299a3-6f18-4538-b8f7-ad3f737c718d None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:52.814560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:52.841154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b21641-c22f-4442-b85b-5271200b408b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:52.842190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b21641-c22f-4442-b85b-5271200b408b None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:52.842472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b21641-c22f-4442-b85b-5271200b408b None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:52.842743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b21641-c22f-4442-b85b-5271200b408b None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:52.843473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b21641-c22f-4442-b85b-5271200b408b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:52.843783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b21641-c22f-4442-b85b-5271200b408b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:52.845129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b21641-c22f-4442-b85b-5271200b408b None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:52.858657 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 616/1238] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:52.864467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d68b44-05b5-45df-87f6-cd42ed38738b None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:52.977240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d68b44-05b5-45df-87f6-cd42ed38738b None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:53.019451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d1c12-b72c-43fe-a3d4-e69bbc4cdf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:53.019993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d1c12-b72c-43fe-a3d4-e69bbc4cdf7d None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:53.020276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d1c12-b72c-43fe-a3d4-e69bbc4cdf7d None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:53.020553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d1c12-b72c-43fe-a3d4-e69bbc4cdf7d None admin] PATH_INFO: `/v3/users/placement` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:53.023495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:53.029282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d1c12-b72c-43fe-a3d4-e69bbc4cdf7d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:53.030912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d1c12-b72c-43fe-a3d4-e69bbc4cdf7d None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:53.043388 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-195d1c12-b72c-43fe-a3d4-e69bbc4cdf7d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 30 20:47:53.043388 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:53.043388 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:53.043388 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:53.043388 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:53.043388 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:53.043388 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:53.043388 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:53.043388 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:53.043388 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:53.043388 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:53.043388 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:53.043388 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:47:53.043388 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:47:53.043388 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:47:53.043388 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:47:53.044555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:53.044555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:53.044555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:47:53.044555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:47:53.044555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:47:53.044555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:47:53.044555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:53.044555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:53.044555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:53.044555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:53.044555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:53.044555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:53.044555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:53.044555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:53.044555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:53.044555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:53.044555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:53.044555 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:53.046302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:53.046302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:53.046302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:47:53.046302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:47:53.046302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:47:53.046302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:47:53.046302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:47:53.046302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:47:53.046302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 30 20:47:53.046302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:47:53.047423 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 623/1239] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:47:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:47:53.050858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b21641-c22f-4442-b85b-5271200b408b None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:53.153465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b21641-c22f-4442-b85b-5271200b408b None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:53.190738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5ca10-a4d6-4549-bc97-d2898d249240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:53.191275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5ca10-a4d6-4549-bc97-d2898d249240 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:53.191588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5ca10-a4d6-4549-bc97-d2898d249240 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:53.191866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5ca10-a4d6-4549-bc97-d2898d249240 None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:53.192666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5ca10-a4d6-4549-bc97-d2898d249240 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:53.193013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5ca10-a4d6-4549-bc97-d2898d249240 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:53.194456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5ca10-a4d6-4549-bc97-d2898d249240 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:53.213198 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 617/1240] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Jul 30 20:47:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:53.219342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d1c12-b72c-43fe-a3d4-e69bbc4cdf7d None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:53.351556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d1c12-b72c-43fe-a3d4-e69bbc4cdf7d None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:53.390917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bf776-a789-4ec8-b92d-57d19e7fb0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:53.391813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bf776-a789-4ec8-b92d-57d19e7fb0f5 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:53.392292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bf776-a789-4ec8-b92d-57d19e7fb0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:53.392747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bf776-a789-4ec8-b92d-57d19e7fb0f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:53.467933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:53.476817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bf776-a789-4ec8-b92d-57d19e7fb0f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:53.479064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bf776-a789-4ec8-b92d-57d19e7fb0f5 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:53.607992 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 624/1241] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:47:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 30 20:47:53.613907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5ca10-a4d6-4549-bc97-d2898d249240 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:53.652176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:53.741331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5ca10-a4d6-4549-bc97-d2898d249240 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:53.782944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278f5d2-1b9b-426d-bbcb-d9046c978692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:53.783987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278f5d2-1b9b-426d-bbcb-d9046c978692 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:53.784307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278f5d2-1b9b-426d-bbcb-d9046c978692 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:53.784596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278f5d2-1b9b-426d-bbcb-d9046c978692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:53.795778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278f5d2-1b9b-426d-bbcb-d9046c978692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:53.797351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278f5d2-1b9b-426d-bbcb-d9046c978692 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:53.813551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-a278f5d2-1b9b-426d-bbcb-d9046c978692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:47:53.813551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:53.813551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:53.813551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:53.813551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:53.813551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:53.813551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:53.813551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:53.813551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:53.813551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:53.813551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:53.813551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:53.813551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:47:53.813551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:47:53.813551 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:47:53.814572 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:47:53.814572 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:53.814572 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:53.814572 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:53.814572 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:53.814572 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:53.814572 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:53.814572 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:53.814572 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:53.814572 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:53.814572 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:53.814572 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:53.814572 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:53.814572 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:53.814572 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:53.814572 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:53.814572 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:53.815522 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:47:53.815522 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:47:53.815522 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:47:53.815522 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:47:53.815522 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 618/1242] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:47:53.820760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bf776-a789-4ec8-b92d-57d19e7fb0f5 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:53.916608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:53.924638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bf776-a789-4ec8-b92d-57d19e7fb0f5 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:53.962696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18c522-7de4-4267-a4a8-de53191fd68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:53.963370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18c522-7de4-4267-a4a8-de53191fd68e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:53.963653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18c522-7de4-4267-a4a8-de53191fd68e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:53.963932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18c522-7de4-4267-a4a8-de53191fd68e None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:53.964686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18c522-7de4-4267-a4a8-de53191fd68e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:53.964993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18c522-7de4-4267-a4a8-de53191fd68e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:53.966354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18c522-7de4-4267-a4a8-de53191fd68e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:53.978335 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 625/1243] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:53.985183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278f5d2-1b9b-426d-bbcb-d9046c978692 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:54.072848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:54.096525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278f5d2-1b9b-426d-bbcb-d9046c978692 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:54.142435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a850678-f77e-445c-a101-f79be8f8c70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:54.143079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850678-f77e-445c-a101-f79be8f8c70c None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:54.143389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850678-f77e-445c-a101-f79be8f8c70c None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:54.143668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850678-f77e-445c-a101-f79be8f8c70c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:54.150780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a850678-f77e-445c-a101-f79be8f8c70c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:54.152286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a850678-f77e-445c-a101-f79be8f8c70c None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:54.164277 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-8a850678-f77e-445c-a101-f79be8f8c70c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:47:54.164277 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:54.164277 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:54.164277 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:54.164277 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:54.164277 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:54.164277 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:54.164277 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:54.164277 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:54.164277 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:54.164277 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:54.164277 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:54.164277 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:47:54.164277 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:47:54.164277 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:47:54.165509 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:47:54.165509 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:54.165509 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:54.165509 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:54.165509 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:54.165509 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:54.165509 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:54.165509 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:54.165509 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:54.165509 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:54.165509 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:54.165509 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:54.165509 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:54.165509 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:54.165509 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:54.165509 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:54.165509 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:54.166877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:47:54.166877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:47:54.166877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:47:54.166877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:47:54.166877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:47:54.166877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:47:54.166877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:47:54.166877 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:47:54.166877 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 619/1244] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:47:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:47:54.172221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18c522-7de4-4267-a4a8-de53191fd68e None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:54.281218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18c522-7de4-4267-a4a8-de53191fd68e None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:54.316747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959305a-5259-40aa-a2ea-ac75bfdae81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:54.317379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959305a-5259-40aa-a2ea-ac75bfdae81a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:54.317658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959305a-5259-40aa-a2ea-ac75bfdae81a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:54.317931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959305a-5259-40aa-a2ea-ac75bfdae81a None admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:54.318687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959305a-5259-40aa-a2ea-ac75bfdae81a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:54.318986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959305a-5259-40aa-a2ea-ac75bfdae81a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:54.320462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959305a-5259-40aa-a2ea-ac75bfdae81a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:54.333023 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 626/1245] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:47:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:47:54.339597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a850678-f77e-445c-a101-f79be8f8c70c None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:54.449946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a850678-f77e-445c-a101-f79be8f8c70c None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:54.488903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc12d90-6414-46da-982e-3ffe6f60f88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:54.489573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc12d90-6414-46da-982e-3ffe6f60f88d None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:54.489900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc12d90-6414-46da-982e-3ffe6f60f88d None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:54.490258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc12d90-6414-46da-982e-3ffe6f60f88d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:54.491000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc12d90-6414-46da-982e-3ffe6f60f88d None admin] RBAC: Adding query filter params (role.id=50fb737d5edf48298d0a6061ba652acb, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=2d1bd6b5950c4f9890a133dfd5bea4d9) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:54.491330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc12d90-6414-46da-982e-3ffe6f60f88d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:54.492862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc12d90-6414-46da-982e-3ffe6f60f88d None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:54.499980 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 620/1246] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:47:54 2022] GET /identity/v3/role_assignments?user.id=2d1bd6b5950c4f9890a133dfd5bea4d9&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=50fb737d5edf48298d0a6061ba652acb => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:47:57.018953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab718d10-611b-4e46-ae9f-b05ed0c536ab None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:57.019567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab718d10-611b-4e46-ae9f-b05ed0c536ab None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:57.019567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab718d10-611b-4e46-ae9f-b05ed0c536ab None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:57.020905 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 627/1247] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:47:57.027739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9f937-6bdd-4598-9e12-dd92cdf28f35 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:57.028271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9f937-6bdd-4598-9e12-dd92cdf28f35 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:57.028271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9f937-6bdd-4598-9e12-dd92cdf28f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:57.035547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:57.050691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-56a9f937-6bdd-4598-9e12-dd92cdf28f35 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:47:57.052618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-56a9f937-6bdd-4598-9e12-dd92cdf28f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:47:57.136866 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 621/1248] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:47:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:47:57.165226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab718d10-611b-4e46-ae9f-b05ed0c536ab None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:57.189587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:57.303069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab718d10-611b-4e46-ae9f-b05ed0c536ab None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:57.340779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e991ee3-4198-4154-828a-22a090fb577a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:57.341427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e991ee3-4198-4154-828a-22a090fb577a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:57.341711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e991ee3-4198-4154-828a-22a090fb577a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:57.342091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e991ee3-4198-4154-828a-22a090fb577a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:57.354222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e991ee3-4198-4154-828a-22a090fb577a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:47:57.360980 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-5e991ee3-4198-4154-828a-22a090fb577a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:47:57.360980 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:57.360980 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:57.360980 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:57.360980 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:57.360980 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:57.360980 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:57.360980 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:57.360980 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:57.360980 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:57.360980 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:57.360980 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:57.360980 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:47:57.360980 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:47:57.360980 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:47:57.360980 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:47:57.362082 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:47:57.362082 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:47:57.362082 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:47:57.362082 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:47:57.362082 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:57.362082 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:57.362082 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:57.362082 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:57.362082 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:57.362082 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:57.362082 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:57.362082 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:57.362082 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:57.362082 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:57.362082 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:57.362082 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:57.362947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:57.362947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:57.362947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:57.362947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:57.362947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:47:57.362947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:47:57.362947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:47:57.362947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:47:57.362947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:47:57.362947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:47:57.362947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:47:57.362947 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:47:57.362947 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 628/1249] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:47:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 30 20:47:57.369598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9f937-6bdd-4598-9e12-dd92cdf28f35 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:57.472504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9f937-6bdd-4598-9e12-dd92cdf28f35 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:57.503600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:57.510220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531053c-ebef-4f96-983a-a5cfef81cf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:57.510935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531053c-ebef-4f96-983a-a5cfef81cf77 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:57.511236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531053c-ebef-4f96-983a-a5cfef81cf77 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:57.511586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531053c-ebef-4f96-983a-a5cfef81cf77 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:57.512446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531053c-ebef-4f96-983a-a5cfef81cf77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:57.512784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531053c-ebef-4f96-983a-a5cfef81cf77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:57.514771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531053c-ebef-4f96-983a-a5cfef81cf77 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:57.523527 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 622/1250] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:47:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:57.530158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e991ee3-4198-4154-828a-22a090fb577a None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:57.626338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:57.656449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e991ee3-4198-4154-828a-22a090fb577a None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:57.704950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15614e-d3ce-40ab-913f-92a7ef7ef82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:57.705793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15614e-d3ce-40ab-913f-92a7ef7ef82e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:57.706113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15614e-d3ce-40ab-913f-92a7ef7ef82e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:57.706419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15614e-d3ce-40ab-913f-92a7ef7ef82e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:57.718922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15614e-d3ce-40ab-913f-92a7ef7ef82e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:57.721048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15614e-d3ce-40ab-913f-92a7ef7ef82e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:57.738700 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-8e15614e-d3ce-40ab-913f-92a7ef7ef82e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:47:57.738700 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:57.738700 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:57.738700 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:57.738700 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:57.738700 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:57.738700 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:57.738700 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:57.738700 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:57.738700 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:57.738700 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:57.738700 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:57.738700 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:47:57.738700 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:47:57.738700 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:47:57.739885 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:47:57.739885 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:57.739885 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:57.739885 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:57.739885 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:57.739885 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:57.739885 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:57.739885 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:57.739885 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:57.739885 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:57.739885 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:57.739885 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:57.739885 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:57.739885 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:57.739885 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:57.739885 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:57.739885 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:57.741024 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:47:57.741024 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:47:57.741024 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:47:57.741024 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:47:57.743435 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 629/1251] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:47:57.746277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531053c-ebef-4f96-983a-a5cfef81cf77 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:57.858287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531053c-ebef-4f96-983a-a5cfef81cf77 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:57.896407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0fbde-85c6-472c-8989-6c0b8cfa1a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:57.897105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0fbde-85c6-472c-8989-6c0b8cfa1a8e None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:57.897550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0fbde-85c6-472c-8989-6c0b8cfa1a8e None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:57.898067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0fbde-85c6-472c-8989-6c0b8cfa1a8e None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:57.899336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e0fbde-85c6-472c-8989-6c0b8cfa1a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:57.899842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e0fbde-85c6-472c-8989-6c0b8cfa1a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:57.901860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e0fbde-85c6-472c-8989-6c0b8cfa1a8e None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:57.917294 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 623/1252] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:57.923464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15614e-d3ce-40ab-913f-92a7ef7ef82e None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:58.040994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15614e-d3ce-40ab-913f-92a7ef7ef82e None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:58.069678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:58.080107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce66df-600e-4431-bc99-329aceeeed22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:58.080866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce66df-600e-4431-bc99-329aceeeed22 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:58.081230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce66df-600e-4431-bc99-329aceeeed22 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:58.081526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce66df-600e-4431-bc99-329aceeeed22 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:58.092057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce66df-600e-4431-bc99-329aceeeed22 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:58.093517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce66df-600e-4431-bc99-329aceeeed22 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:58.107218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-f0ce66df-600e-4431-bc99-329aceeeed22 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 30 20:47:58.107218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:58.107218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:58.107218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:58.107218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:58.107218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:58.107218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:58.107218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:58.107218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:58.107218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:58.107218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:58.107218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:58.107218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:47:58.107218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:47:58.107218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:47:58.107218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:47:58.108572 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:58.108572 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:58.108572 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:47:58.108572 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:47:58.108572 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:47:58.108572 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:47:58.108572 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:58.108572 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:58.108572 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:58.108572 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:58.108572 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:58.108572 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:58.108572 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:58.108572 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:58.108572 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:58.108572 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:58.108572 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:58.108572 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:58.109538 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:58.109538 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:58.109538 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:47:58.109538 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:47:58.109538 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:47:58.109538 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:47:58.109538 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:47:58.109538 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:47:58.109538 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 30 20:47:58.109538 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:47:58.109538 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 630/1253] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:47:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:47:58.115198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0fbde-85c6-472c-8989-6c0b8cfa1a8e None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:58.176886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:58.229438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0fbde-85c6-472c-8989-6c0b8cfa1a8e None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:58.270062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39733e60-20bc-4c6a-8674-e0d6209abf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:58.270790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39733e60-20bc-4c6a-8674-e0d6209abf71 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:58.271070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39733e60-20bc-4c6a-8674-e0d6209abf71 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:58.271368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39733e60-20bc-4c6a-8674-e0d6209abf71 None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:58.272255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39733e60-20bc-4c6a-8674-e0d6209abf71 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:58.272625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39733e60-20bc-4c6a-8674-e0d6209abf71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:58.274131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39733e60-20bc-4c6a-8674-e0d6209abf71 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:58.293216 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 624/1254] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Jul 30 20:47:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:58.299537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce66df-600e-4431-bc99-329aceeeed22 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:58.427556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce66df-600e-4431-bc99-329aceeeed22 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:58.464408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ed1a4-3964-4c1f-bbe7-d4f7d4dad17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:58.465027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ed1a4-3964-4c1f-bbe7-d4f7d4dad17a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:58.465312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ed1a4-3964-4c1f-bbe7-d4f7d4dad17a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:58.465588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ed1a4-3964-4c1f-bbe7-d4f7d4dad17a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:58.528455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:58.543393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ed1a4-3964-4c1f-bbe7-d4f7d4dad17a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:58.544845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ed1a4-3964-4c1f-bbe7-d4f7d4dad17a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:58.651567 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 631/1255] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:47:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 30 20:47:58.658095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39733e60-20bc-4c6a-8674-e0d6209abf71 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:58.781279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39733e60-20bc-4c6a-8674-e0d6209abf71 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:58.794456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:58.817509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2516c91-973a-42ed-a6ff-24b5713bfec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:58.818149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2516c91-973a-42ed-a6ff-24b5713bfec4 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:58.818431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2516c91-973a-42ed-a6ff-24b5713bfec4 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:58.818704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2516c91-973a-42ed-a6ff-24b5713bfec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:58.829729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2516c91-973a-42ed-a6ff-24b5713bfec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:58.831251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2516c91-973a-42ed-a6ff-24b5713bfec4 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:58.846420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-d2516c91-973a-42ed-a6ff-24b5713bfec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:47:58.846420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:58.846420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:58.846420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:58.846420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:58.846420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:58.846420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:58.846420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:58.846420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:58.846420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:58.846420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:58.846420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:58.846420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:47:58.846420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:47:58.846420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:47:58.847444 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:47:58.847444 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:58.847444 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:58.847444 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:58.847444 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:58.847444 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:58.847444 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:58.847444 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:58.847444 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:58.847444 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:58.847444 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:58.847444 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:58.847444 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:58.847444 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:58.847444 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:58.847444 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:58.847444 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:58.848357 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:47:58.848357 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:47:58.848357 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:47:58.848357 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:47:58.848357 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 625/1256] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:47:58.853485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ed1a4-3964-4c1f-bbe7-d4f7d4dad17a None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:58.955804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:58.969969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ed1a4-3964-4c1f-bbe7-d4f7d4dad17a None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:59.012992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febec25-a588-495d-b490-77245e17f6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:59.013652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febec25-a588-495d-b490-77245e17f6b0 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:59.013937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febec25-a588-495d-b490-77245e17f6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:59.014221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febec25-a588-495d-b490-77245e17f6b0 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:59.014905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febec25-a588-495d-b490-77245e17f6b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:59.015204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febec25-a588-495d-b490-77245e17f6b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:59.018405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febec25-a588-495d-b490-77245e17f6b0 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:59.030676 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 632/1257] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:59.036721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2516c91-973a-42ed-a6ff-24b5713bfec4 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:59.154598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2516c91-973a-42ed-a6ff-24b5713bfec4 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:59.192353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a76bd-f9c7-4b98-9f69-c0726ad7dc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:59.193026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a76bd-f9c7-4b98-9f69-c0726ad7dc8e None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:59.193320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a76bd-f9c7-4b98-9f69-c0726ad7dc8e None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:59.193595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a76bd-f9c7-4b98-9f69-c0726ad7dc8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:59.201321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a76bd-f9c7-4b98-9f69-c0726ad7dc8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:59.202811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a76bd-f9c7-4b98-9f69-c0726ad7dc8e None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:59.215335 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-714a76bd-f9c7-4b98-9f69-c0726ad7dc8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:47:59.215335 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:47:59.215335 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:47:59.215335 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:47:59.215335 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:47:59.215335 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:47:59.215335 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:47:59.215335 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:47:59.215335 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:47:59.215335 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:47:59.215335 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:47:59.215335 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:47:59.215335 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:47:59.215335 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:47:59.215335 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:47:59.216431 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:47:59.216431 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:47:59.216431 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:47:59.216431 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:47:59.216431 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:47:59.216431 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:47:59.216431 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:47:59.216431 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:47:59.216431 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:47:59.216431 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:47:59.216431 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:47:59.216431 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:47:59.216431 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:47:59.216431 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:47:59.216431 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:47:59.216431 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:47:59.216431 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:47:59.217495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:47:59.217495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:47:59.217495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:47:59.217495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:47:59.217495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:47:59.217495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:47:59.217495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:47:59.217495 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:47:59.217495 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 626/1258] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:47:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:47:59.222755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febec25-a588-495d-b490-77245e17f6b0 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:59.331883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febec25-a588-495d-b490-77245e17f6b0 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:59.367901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a1b83-3e91-4afd-85e8-42f7c9df484f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:59.368535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a1b83-3e91-4afd-85e8-42f7c9df484f None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:59.368820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a1b83-3e91-4afd-85e8-42f7c9df484f None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:59.369099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a1b83-3e91-4afd-85e8-42f7c9df484f None admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:59.369862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a1b83-3e91-4afd-85e8-42f7c9df484f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:59.370430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a1b83-3e91-4afd-85e8-42f7c9df484f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:59.371897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a1b83-3e91-4afd-85e8-42f7c9df484f None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:59.384531 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 633/1259] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:47:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:47:59.390715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a76bd-f9c7-4b98-9f69-c0726ad7dc8e None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:47:59.418279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:47:59.499504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a76bd-f9c7-4b98-9f69-c0726ad7dc8e None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:47:59.534294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb29610-dfbf-4ac6-a92c-0f33c4e9f76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:47:59.534953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb29610-dfbf-4ac6-a92c-0f33c4e9f76a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:47:59.535242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb29610-dfbf-4ac6-a92c-0f33c4e9f76a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:47:59.535556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb29610-dfbf-4ac6-a92c-0f33c4e9f76a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:47:59.536368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb29610-dfbf-4ac6-a92c-0f33c4e9f76a None admin] RBAC: Adding query filter params (role.id=3b89b89da98d4ec08a0587aa13832636, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=2d1bd6b5950c4f9890a133dfd5bea4d9) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:47:59.536682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb29610-dfbf-4ac6-a92c-0f33c4e9f76a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:47:59.538139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb29610-dfbf-4ac6-a92c-0f33c4e9f76a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:47:59.547466 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 627/1260] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:47:59 2022] GET /identity/v3/role_assignments?user.id=2d1bd6b5950c4f9890a133dfd5bea4d9&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=3b89b89da98d4ec08a0587aa13832636 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:48:01.854848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a0d31-3566-424c-ba23-b67ffcf21419 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:01.855402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a0d31-3566-424c-ba23-b67ffcf21419 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:01.855497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a0d31-3566-424c-ba23-b67ffcf21419 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:01.856778 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 634/1261] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:48:01.862499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c32f64-6f52-4b09-85bb-03a3c9e67328 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:01.862942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c32f64-6f52-4b09-85bb-03a3c9e67328 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:01.863035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c32f64-6f52-4b09-85bb-03a3c9e67328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:01.881003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-78c32f64-6f52-4b09-85bb-03a3c9e67328 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:48:01.882170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-78c32f64-6f52-4b09-85bb-03a3c9e67328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:48:01.946228 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 628/1262] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:48:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:48:01.970732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a0d31-3566-424c-ba23-b67ffcf21419 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:01.981442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:02.076927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a0d31-3566-424c-ba23-b67ffcf21419 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:02.112325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a588d-7d72-4697-bb88-f05946741c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:02.112894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a588d-7d72-4697-bb88-f05946741c57 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:02.113181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a588d-7d72-4697-bb88-f05946741c57 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:02.113555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a588d-7d72-4697-bb88-f05946741c57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:02.124464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a588d-7d72-4697-bb88-f05946741c57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:48:02.129314 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-4a1a588d-7d72-4697-bb88-f05946741c57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:48:02.129314 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:48:02.129314 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:48:02.129314 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:48:02.129314 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:48:02.129314 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:48:02.129314 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:48:02.129314 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:48:02.129314 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:48:02.129314 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:48:02.129314 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:48:02.129314 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:48:02.129314 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:48:02.129314 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:48:02.129314 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:48:02.129314 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:48:02.130428 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:48:02.130428 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:48:02.130428 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:48:02.130428 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:48:02.130428 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:48:02.130428 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:48:02.130428 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:48:02.130428 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:48:02.130428 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:48:02.130428 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:48:02.130428 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:48:02.130428 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:48:02.130428 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:48:02.130428 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:48:02.130428 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:48:02.130428 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:48:02.131517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:48:02.131517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:48:02.131517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:48:02.131517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:48:02.131517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:48:02.131517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:48:02.131517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:48:02.131517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:48:02.131517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:48:02.131517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:48:02.131517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:48:02.131517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:48:02.131517 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 635/1263] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:48:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:48:02.136515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c32f64-6f52-4b09-85bb-03a3c9e67328 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:02.155718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:02.235572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c32f64-6f52-4b09-85bb-03a3c9e67328 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:02.269258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e4510-6c9f-4141-bbba-fb6d652bb4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:02.269873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e4510-6c9f-4141-bbba-fb6d652bb4e4 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:02.270156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e4510-6c9f-4141-bbba-fb6d652bb4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:02.270432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e4510-6c9f-4141-bbba-fb6d652bb4e4 None admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:02.271145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e4510-6c9f-4141-bbba-fb6d652bb4e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:48:02.271483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e4510-6c9f-4141-bbba-fb6d652bb4e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:02.272858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e4510-6c9f-4141-bbba-fb6d652bb4e4 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:02.280852 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 629/1264] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:48:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:48:02.286447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a588d-7d72-4697-bb88-f05946741c57 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:02.354656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:02.398254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a588d-7d72-4697-bb88-f05946741c57 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:02.431885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57b72c-d9c9-40de-9de8-d85216430021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:02.432520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57b72c-d9c9-40de-9de8-d85216430021 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:02.432811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57b72c-d9c9-40de-9de8-d85216430021 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:02.433087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57b72c-d9c9-40de-9de8-d85216430021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:02.442790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57b72c-d9c9-40de-9de8-d85216430021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:02.444276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57b72c-d9c9-40de-9de8-d85216430021 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:02.458437 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-3e57b72c-d9c9-40de-9de8-d85216430021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:48:02.458437 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:48:02.458437 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:48:02.458437 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:48:02.458437 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:48:02.458437 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:48:02.458437 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:48:02.458437 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:48:02.458437 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:48:02.458437 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:48:02.458437 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:48:02.458437 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:48:02.458437 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:48:02.458437 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:48:02.458437 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:48:02.459507 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:48:02.459507 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:48:02.459507 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:48:02.459507 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:48:02.459507 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:48:02.459507 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:48:02.459507 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:48:02.459507 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:48:02.459507 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:48:02.459507 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:48:02.459507 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:48:02.459507 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:48:02.459507 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:48:02.459507 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:48:02.459507 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:48:02.459507 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:48:02.459507 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:48:02.460618 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:48:02.460618 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:48:02.460618 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:48:02.460618 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:48:02.460618 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 636/1265] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:48:02.465325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e4510-6c9f-4141-bbba-fb6d652bb4e4 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:02.545910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:02.564638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e4510-6c9f-4141-bbba-fb6d652bb4e4 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:02.597266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13399b-f71f-447b-a8ae-938a5abc43d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:02.597877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13399b-f71f-447b-a8ae-938a5abc43d7 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:02.598164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13399b-f71f-447b-a8ae-938a5abc43d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:02.598443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13399b-f71f-447b-a8ae-938a5abc43d7 None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:02.599129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13399b-f71f-447b-a8ae-938a5abc43d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:48:02.599472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13399b-f71f-447b-a8ae-938a5abc43d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:02.600840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13399b-f71f-447b-a8ae-938a5abc43d7 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:02.612846 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 630/1266] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:48:02.618426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57b72c-d9c9-40de-9de8-d85216430021 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:02.727102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57b72c-d9c9-40de-9de8-d85216430021 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:02.750730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:02.765533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501388fb-cd94-4c96-aab9-4e9c1f048e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:02.766169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501388fb-cd94-4c96-aab9-4e9c1f048e31 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:02.766451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501388fb-cd94-4c96-aab9-4e9c1f048e31 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:02.766730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501388fb-cd94-4c96-aab9-4e9c1f048e31 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:02.773994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501388fb-cd94-4c96-aab9-4e9c1f048e31 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:02.775469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501388fb-cd94-4c96-aab9-4e9c1f048e31 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:02.786937 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-501388fb-cd94-4c96-aab9-4e9c1f048e31 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 30 20:48:02.786937 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:48:02.786937 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:48:02.786937 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:48:02.786937 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:48:02.786937 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:48:02.786937 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:48:02.786937 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:48:02.786937 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:48:02.786937 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:48:02.786937 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:48:02.786937 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:48:02.786937 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:48:02.786937 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:48:02.786937 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:48:02.786937 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:48:02.788087 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:48:02.788087 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:48:02.788087 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:48:02.788087 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:48:02.788087 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:48:02.788087 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:48:02.788087 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:48:02.788087 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:48:02.788087 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:48:02.788087 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:48:02.788087 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:48:02.788087 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:48:02.788087 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:48:02.788087 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:48:02.788087 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:48:02.788087 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:48:02.788087 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:48:02.788087 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:48:02.789331 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:48:02.789331 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:48:02.789331 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:48:02.789331 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:48:02.789331 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:48:02.789331 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:48:02.789331 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:48:02.789331 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:48:02.789331 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 30 20:48:02.789331 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:48:02.789331 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 637/1267] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:48:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:48:02.793962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13399b-f71f-447b-a8ae-938a5abc43d7 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:02.890204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13399b-f71f-447b-a8ae-938a5abc43d7 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:02.922695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b2e06-8355-4853-ae21-ae1dff982a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:02.923322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b2e06-8355-4853-ae21-ae1dff982a9a None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:02.923609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b2e06-8355-4853-ae21-ae1dff982a9a None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:02.923882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b2e06-8355-4853-ae21-ae1dff982a9a None admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:02.924660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b2e06-8355-4853-ae21-ae1dff982a9a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:48:02.924964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b2e06-8355-4853-ae21-ae1dff982a9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:02.926380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b2e06-8355-4853-ae21-ae1dff982a9a None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:02.934716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:02.944087 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 631/1268] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Jul 30 20:48:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:48:02.949698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501388fb-cd94-4c96-aab9-4e9c1f048e31 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:03.048336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501388fb-cd94-4c96-aab9-4e9c1f048e31 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:03.080734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7d380-7a46-4b3b-8ad9-0d52f939d676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:03.081367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7d380-7a46-4b3b-8ad9-0d52f939d676 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:03.081649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7d380-7a46-4b3b-8ad9-0d52f939d676 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:03.081925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7d380-7a46-4b3b-8ad9-0d52f939d676 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:03.092548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7d380-7a46-4b3b-8ad9-0d52f939d676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:03.093983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7d380-7a46-4b3b-8ad9-0d52f939d676 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:03.108239 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-49e7d380-7a46-4b3b-8ad9-0d52f939d676 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:48:03.108239 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:48:03.108239 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:48:03.108239 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:48:03.108239 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:48:03.108239 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:48:03.108239 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:48:03.108239 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:48:03.108239 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:48:03.108239 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:48:03.108239 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:48:03.108239 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:48:03.108239 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:48:03.108239 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:48:03.108239 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:48:03.109286 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:48:03.109286 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:48:03.109286 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:48:03.109286 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:48:03.109286 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:48:03.109286 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:48:03.109286 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:48:03.109286 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:48:03.109286 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:48:03.109286 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:48:03.109286 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:48:03.109286 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:48:03.109286 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:48:03.109286 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:48:03.109286 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:48:03.109286 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:48:03.109286 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:48:03.110522 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:48:03.110522 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:48:03.110522 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:48:03.110522 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:48:03.110522 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 638/1269] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:48:03.115153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b2e06-8355-4853-ae21-ae1dff982a9a None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:03.216329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b2e06-8355-4853-ae21-ae1dff982a9a None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:03.249233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48edaa61-3590-4484-a9d3-b457382912fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:03.249785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edaa61-3590-4484-a9d3-b457382912fa None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:03.250069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edaa61-3590-4484-a9d3-b457382912fa None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:03.250344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edaa61-3590-4484-a9d3-b457382912fa None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:03.251025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edaa61-3590-4484-a9d3-b457382912fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:48:03.251412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edaa61-3590-4484-a9d3-b457382912fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:03.252776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edaa61-3590-4484-a9d3-b457382912fa None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:03.264296 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 632/1270] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:48:03.269830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7d380-7a46-4b3b-8ad9-0d52f939d676 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:03.300077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:03.368929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7d380-7a46-4b3b-8ad9-0d52f939d676 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:03.408021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437669c7-d9ed-4fb7-be56-7e65f6844050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:03.408654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437669c7-d9ed-4fb7-be56-7e65f6844050 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:03.408936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437669c7-d9ed-4fb7-be56-7e65f6844050 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:03.409208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437669c7-d9ed-4fb7-be56-7e65f6844050 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:03.415793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437669c7-d9ed-4fb7-be56-7e65f6844050 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:03.417223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437669c7-d9ed-4fb7-be56-7e65f6844050 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:03.428588 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-437669c7-d9ed-4fb7-be56-7e65f6844050 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:48:03.428588 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:48:03.428588 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:48:03.428588 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:48:03.428588 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:48:03.428588 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:48:03.428588 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:48:03.428588 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:48:03.428588 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:48:03.428588 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:48:03.428588 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:48:03.428588 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:48:03.428588 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:48:03.428588 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:48:03.428588 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:48:03.429531 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:48:03.429531 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:48:03.429531 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:48:03.429531 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:48:03.429531 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:48:03.429531 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:48:03.429531 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:48:03.429531 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:48:03.429531 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:48:03.429531 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:48:03.429531 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:48:03.429531 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:48:03.429531 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:48:03.429531 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:48:03.429531 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:48:03.429531 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:48:03.429531 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:48:03.430545 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:48:03.430545 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:48:03.430545 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:48:03.430545 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:48:03.430545 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:48:03.430545 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:48:03.430545 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:48:03.430545 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:48:03.430545 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 639/1271] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:48:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:48:03.436382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48edaa61-3590-4484-a9d3-b457382912fa None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:03.493039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:03.534715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48edaa61-3590-4484-a9d3-b457382912fa None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:03.568428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b030466-a40b-4e14-870d-0405f75bc773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:03.569051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b030466-a40b-4e14-870d-0405f75bc773 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:03.569319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b030466-a40b-4e14-870d-0405f75bc773 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:03.569594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b030466-a40b-4e14-870d-0405f75bc773 None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:03.570334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b030466-a40b-4e14-870d-0405f75bc773 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:48:03.570635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b030466-a40b-4e14-870d-0405f75bc773 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:03.572079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b030466-a40b-4e14-870d-0405f75bc773 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:03.583706 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 633/1272] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:48:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:48:03.589665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437669c7-d9ed-4fb7-be56-7e65f6844050 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:03.689107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:03.701550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437669c7-d9ed-4fb7-be56-7e65f6844050 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:03.733311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b69d0-2cb9-4722-bc7a-7257dbf3c5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:03.733977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b69d0-2cb9-4722-bc7a-7257dbf3c5f5 None admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:03.734260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b69d0-2cb9-4722-bc7a-7257dbf3c5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:03.734536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b69d0-2cb9-4722-bc7a-7257dbf3c5f5 None admin] PATH_INFO: `/v3/projects/ec96772eef284ab3913f9628b136be7a/users/2d1bd6b5950c4f9890a133dfd5bea4d9/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:03.736463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b69d0-2cb9-4722-bc7a-7257dbf3c5f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec96772eef284ab3913f9628b136be7a, user_id=2d1bd6b5950c4f9890a133dfd5bea4d9, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:03.737894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b69d0-2cb9-4722-bc7a-7257dbf3c5f5 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:03.750810 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 640/1273] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 30 20:48:03 2022] PUT /identity/v3/projects/ec96772eef284ab3913f9628b136be7a/users/2d1bd6b5950c4f9890a133dfd5bea4d9/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:48:05.957382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f013e-1d6d-4b3c-9df9-ccfa421a799d None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:05.957925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f013e-1d6d-4b3c-9df9-ccfa421a799d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:05.957925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f013e-1d6d-4b3c-9df9-ccfa421a799d None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:05.959278 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 634/1274] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:48:05.964323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38959494-cdb4-4db6-a019-42fe5c197143 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:05.964748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38959494-cdb4-4db6-a019-42fe5c197143 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:05.964879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38959494-cdb4-4db6-a019-42fe5c197143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:05.983093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-38959494-cdb4-4db6-a019-42fe5c197143 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:48:05.984322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-38959494-cdb4-4db6-a019-42fe5c197143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:48:06.051986 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 641/1275] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:48:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:48:06.077510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f013e-1d6d-4b3c-9df9-ccfa421a799d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:06.184044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f013e-1d6d-4b3c-9df9-ccfa421a799d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:06.202616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:06.219081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a6d30-02d8-461c-863d-5f125b8e43b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:06.219691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a6d30-02d8-461c-863d-5f125b8e43b9 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:06.219978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a6d30-02d8-461c-863d-5f125b8e43b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:06.220255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a6d30-02d8-461c-863d-5f125b8e43b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:06.230128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a6d30-02d8-461c-863d-5f125b8e43b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 20:48:06.234942 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-cf1a6d30-02d8-461c-863d-5f125b8e43b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:48:06.234942 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:48:06.234942 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:48:06.234942 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:48:06.234942 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:48:06.234942 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:48:06.234942 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:48:06.234942 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:48:06.234942 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:48:06.234942 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:48:06.234942 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:48:06.234942 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:48:06.234942 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 30 20:48:06.234942 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 30 20:48:06.234942 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 30 20:48:06.234942 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 30 20:48:06.236051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 20:48:06.236051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 20:48:06.236051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 20:48:06.236051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 20:48:06.236051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:48:06.236051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:48:06.236051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:48:06.236051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:48:06.236051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:48:06.236051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:48:06.236051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:48:06.236051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:48:06.236051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:48:06.236051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:48:06.236051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:48:06.236051 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:48:06.242729 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:48:06.242729 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:48:06.242729 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:48:06.242729 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:48:06.242729 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 20:48:06.242729 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 20:48:06.242729 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 20:48:06.242729 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 20:48:06.242729 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 20:48:06.242729 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 20:48:06.242729 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 30 20:48:06.242729 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:48:06.242729 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 635/1276] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 30 20:48:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:48:06.243626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38959494-cdb4-4db6-a019-42fe5c197143 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:06.323186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:06.342445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38959494-cdb4-4db6-a019-42fe5c197143 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:06.375989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418099d-5e85-4e74-b363-3afc2613e078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:06.376606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418099d-5e85-4e74-b363-3afc2613e078 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:06.376888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418099d-5e85-4e74-b363-3afc2613e078 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:06.377162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418099d-5e85-4e74-b363-3afc2613e078 None admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:06.377869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418099d-5e85-4e74-b363-3afc2613e078 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:48:06.378170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418099d-5e85-4e74-b363-3afc2613e078 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:06.379545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418099d-5e85-4e74-b363-3afc2613e078 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:06.387331 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 642/1277] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 30 20:48:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:48:06.393664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a6d30-02d8-461c-863d-5f125b8e43b9 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:06.489971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a6d30-02d8-461c-863d-5f125b8e43b9 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:06.522473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6470029-3091-43dd-b0b5-55da6b075ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:06.523102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6470029-3091-43dd-b0b5-55da6b075ed8 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:06.523408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6470029-3091-43dd-b0b5-55da6b075ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:06.523684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6470029-3091-43dd-b0b5-55da6b075ed8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:06.533868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6470029-3091-43dd-b0b5-55da6b075ed8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:06.535314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6470029-3091-43dd-b0b5-55da6b075ed8 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:06.549526 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-f6470029-3091-43dd-b0b5-55da6b075ed8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:48:06.549526 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:48:06.549526 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:48:06.549526 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:48:06.549526 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:48:06.549526 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:48:06.549526 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:48:06.549526 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:48:06.549526 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:48:06.549526 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:48:06.549526 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:48:06.549526 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:48:06.549526 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:48:06.549526 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:48:06.549526 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:48:06.550600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:48:06.550600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:48:06.550600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:48:06.550600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:48:06.550600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:48:06.550600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:48:06.550600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:48:06.550600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:48:06.550600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:48:06.550600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:48:06.550600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:48:06.550600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:48:06.550600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:48:06.550600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:48:06.550600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:48:06.550600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:48:06.550600 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:48:06.551832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:48:06.551832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:48:06.551832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:48:06.551832 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:48:06.551832 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 636/1278] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:48:06.556340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418099d-5e85-4e74-b363-3afc2613e078 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:06.655169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418099d-5e85-4e74-b363-3afc2613e078 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:06.692670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c779cef-9e93-40f3-a3f3-eb505b56dc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:06.693368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c779cef-9e93-40f3-a3f3-eb505b56dc75 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:06.693757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c779cef-9e93-40f3-a3f3-eb505b56dc75 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:06.694098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c779cef-9e93-40f3-a3f3-eb505b56dc75 None admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:06.694963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c779cef-9e93-40f3-a3f3-eb505b56dc75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:48:06.695329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c779cef-9e93-40f3-a3f3-eb505b56dc75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:06.696936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c779cef-9e93-40f3-a3f3-eb505b56dc75 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:06.711601 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 643/1279] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:48:06.717418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6470029-3091-43dd-b0b5-55da6b075ed8 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:06.749314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:06.816846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6470029-3091-43dd-b0b5-55da6b075ed8 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:06.849152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a781b03-a33d-4374-bdb3-4b22c8a27822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:06.849785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a781b03-a33d-4374-bdb3-4b22c8a27822 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:06.850068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a781b03-a33d-4374-bdb3-4b22c8a27822 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:06.850343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a781b03-a33d-4374-bdb3-4b22c8a27822 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:06.857681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a781b03-a33d-4374-bdb3-4b22c8a27822 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:06.859140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a781b03-a33d-4374-bdb3-4b22c8a27822 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:06.870072 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-4a781b03-a33d-4374-bdb3-4b22c8a27822 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 30 20:48:06.870072 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:48:06.870072 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:48:06.870072 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:48:06.870072 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:48:06.870072 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:48:06.870072 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:48:06.870072 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:48:06.870072 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:48:06.870072 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:48:06.870072 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:48:06.870072 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:48:06.870072 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 20:48:06.870072 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 20:48:06.870072 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 20:48:06.870072 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 20:48:06.871261 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:48:06.871261 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:48:06.871261 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 20:48:06.871261 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:48:06.871261 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 20:48:06.871261 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 20:48:06.871261 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:48:06.871261 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:48:06.871261 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:48:06.871261 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:48:06.871261 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:48:06.871261 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:48:06.871261 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:48:06.871261 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:48:06.871261 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:48:06.871261 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:48:06.871261 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:48:06.871261 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:48:06.872544 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:48:06.872544 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:48:06.872544 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 20:48:06.872544 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 20:48:06.872544 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 20:48:06.872544 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 20:48:06.872544 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 20:48:06.872544 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 20:48:06.872544 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 30 20:48:06.872544 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:48:06.872544 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 637/1280] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:48:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:48:06.877838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c779cef-9e93-40f3-a3f3-eb505b56dc75 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:06.881605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:06.974795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c779cef-9e93-40f3-a3f3-eb505b56dc75 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:07.010684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eb190-a0bc-4aa9-a0e1-03259f272ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:07.011247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eb190-a0bc-4aa9-a0e1-03259f272ed3 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:07.011566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eb190-a0bc-4aa9-a0e1-03259f272ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:07.011843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eb190-a0bc-4aa9-a0e1-03259f272ed3 None admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:07.012642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eb190-a0bc-4aa9-a0e1-03259f272ed3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:48:07.012950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eb190-a0bc-4aa9-a0e1-03259f272ed3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:07.015026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eb190-a0bc-4aa9-a0e1-03259f272ed3 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:07.031818 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 644/1281] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Jul 30 20:48:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:48:07.037615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a781b03-a33d-4374-bdb3-4b22c8a27822 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:07.127438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:07.137071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a781b03-a33d-4374-bdb3-4b22c8a27822 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:07.170468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fd748-32b8-4003-a5c0-07cf8ddccfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:07.171132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fd748-32b8-4003-a5c0-07cf8ddccfb3 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:07.171453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fd748-32b8-4003-a5c0-07cf8ddccfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:07.171740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fd748-32b8-4003-a5c0-07cf8ddccfb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:07.237617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fd748-32b8-4003-a5c0-07cf8ddccfb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:07.239059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fd748-32b8-4003-a5c0-07cf8ddccfb3 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:07.325214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:07.337008 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 638/1282] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 30 20:48:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 30 20:48:07.342810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eb190-a0bc-4aa9-a0e1-03259f272ed3 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:07.403774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:07.443953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eb190-a0bc-4aa9-a0e1-03259f272ed3 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:07.477119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8786e-7b0e-42a5-951e-694d60d63476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:07.477748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8786e-7b0e-42a5-951e-694d60d63476 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:07.478029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8786e-7b0e-42a5-951e-694d60d63476 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:07.478309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8786e-7b0e-42a5-951e-694d60d63476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:07.488623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8786e-7b0e-42a5-951e-694d60d63476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:07.490053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8786e-7b0e-42a5-951e-694d60d63476 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:07.504984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-a5e8786e-7b0e-42a5-951e-694d60d63476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:48:07.504984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:48:07.504984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:48:07.504984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:48:07.504984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:48:07.504984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:48:07.504984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:48:07.504984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:48:07.504984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:48:07.504984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:48:07.504984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:48:07.504984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:48:07.504984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 20:48:07.504984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 20:48:07.504984 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 20:48:07.506063 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 20:48:07.506063 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:48:07.506063 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:48:07.506063 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:48:07.506063 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:48:07.506063 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:48:07.506063 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:48:07.506063 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:48:07.506063 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:48:07.506063 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:48:07.506063 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:48:07.506063 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:48:07.506063 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:48:07.506063 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:48:07.506063 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:48:07.506063 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:48:07.506063 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:48:07.507132 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 30 20:48:07.507132 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 20:48:07.507132 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 30 20:48:07.507132 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:48:07.507132 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 645/1283] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:48:07.511895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fd748-32b8-4003-a5c0-07cf8ddccfb3 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:07.608091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fd748-32b8-4003-a5c0-07cf8ddccfb3 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:07.640739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43799d-8b0a-46f7-8c32-a143ecc128ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:07.641349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43799d-8b0a-46f7-8c32-a143ecc128ac None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:07.641633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43799d-8b0a-46f7-8c32-a143ecc128ac None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:07.641910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43799d-8b0a-46f7-8c32-a143ecc128ac None admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:07.642598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43799d-8b0a-46f7-8c32-a143ecc128ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:48:07.642899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43799d-8b0a-46f7-8c32-a143ecc128ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:07.644304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43799d-8b0a-46f7-8c32-a143ecc128ac None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:07.655643 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 639/1284] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 30 20:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:48:07.661471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8786e-7b0e-42a5-951e-694d60d63476 None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:07.763278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8786e-7b0e-42a5-951e-694d60d63476 None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:07.776793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:07.800354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacf9a3-cfa8-44b4-b01f-8aec5dc5df2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:07.800994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacf9a3-cfa8-44b4-b01f-8aec5dc5df2e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:07.801280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacf9a3-cfa8-44b4-b01f-8aec5dc5df2e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:07.801559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacf9a3-cfa8-44b4-b01f-8aec5dc5df2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:07.808050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacf9a3-cfa8-44b4-b01f-8aec5dc5df2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:07.809490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacf9a3-cfa8-44b4-b01f-8aec5dc5df2e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:07.821067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-3dacf9a3-cfa8-44b4-b01f-8aec5dc5df2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:48:07.821067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:48:07.821067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:48:07.821067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:48:07.821067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:48:07.821067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:48:07.821067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:48:07.821067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:48:07.821067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:48:07.821067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:48:07.821067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:48:07.821067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:48:07.821067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 30 20:48:07.821067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 30 20:48:07.821067 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 30 20:48:07.822118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 30 20:48:07.822118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:48:07.822118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:48:07.822118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:48:07.822118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:48:07.822118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:48:07.822118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:48:07.822118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:48:07.822118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 20:48:07.822118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:48:07.822118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:48:07.822118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:48:07.822118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:48:07.822118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:48:07.822118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:48:07.822118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:48:07.822118 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:48:07.823154 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 30 20:48:07.823154 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 30 20:48:07.823154 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 20:48:07.823154 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 20:48:07.823154 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 20:48:07.823154 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 20:48:07.823154 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 30 20:48:07.823154 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 20:48:07.823154 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 646/1285] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 30 20:48:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:48:07.828680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43799d-8b0a-46f7-8c32-a143ecc128ac None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:07.876722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:07.925698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43799d-8b0a-46f7-8c32-a143ecc128ac None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:07.958003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c702f-e5e7-4a44-a014-a07b17b7834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:07.958665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c702f-e5e7-4a44-a014-a07b17b7834b None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:07.958973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c702f-e5e7-4a44-a014-a07b17b7834b None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:07.959246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c702f-e5e7-4a44-a014-a07b17b7834b None admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:07.960017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c702f-e5e7-4a44-a014-a07b17b7834b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:48:07.960322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c702f-e5e7-4a44-a014-a07b17b7834b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:07.961789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c702f-e5e7-4a44-a014-a07b17b7834b None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:07.973597 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 640/1286] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 30 20:48:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:48:07.979383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacf9a3-cfa8-44b4-b01f-8aec5dc5df2e None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:08.078182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacf9a3-cfa8-44b4-b01f-8aec5dc5df2e None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:08.110432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918923d-8217-4a66-b79a-8f458b2853d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:08.111038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918923d-8217-4a66-b79a-8f458b2853d7 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:08.111338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918923d-8217-4a66-b79a-8f458b2853d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:08.111619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918923d-8217-4a66-b79a-8f458b2853d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:08.112387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918923d-8217-4a66-b79a-8f458b2853d7 None admin] RBAC: Adding query filter params (role.id=3b89b89da98d4ec08a0587aa13832636, scope.project.id=ec96772eef284ab3913f9628b136be7a, user.id=2d1bd6b5950c4f9890a133dfd5bea4d9) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:48:08.112690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918923d-8217-4a66-b79a-8f458b2853d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:08.114095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918923d-8217-4a66-b79a-8f458b2853d7 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:08.119769 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 647/1287] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 30 20:48:07 2022] GET /identity/v3/role_assignments?user.id=2d1bd6b5950c4f9890a133dfd5bea4d9&scope.project.id=ec96772eef284ab3913f9628b136be7a&role.id=3b89b89da98d4ec08a0587aa13832636 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:48:10.346885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e433b4d-ade4-4477-8988-104bd373ff6b None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:10.347457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e433b4d-ade4-4477-8988-104bd373ff6b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:10.347457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e433b4d-ade4-4477-8988-104bd373ff6b None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:10.348810 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 641/1288] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:48:10.354079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0503b1-243f-47c6-b4c2-f241e5e269b8 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:10.354533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0503b1-243f-47c6-b4c2-f241e5e269b8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:10.354639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0503b1-243f-47c6-b4c2-f241e5e269b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:10.373588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8c0503b1-243f-47c6-b4c2-f241e5e269b8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:48:10.374764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8c0503b1-243f-47c6-b4c2-f241e5e269b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:48:10.403266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:10.442136 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 648/1289] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:48:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:48:10.465075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e433b4d-ade4-4477-8988-104bd373ff6b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:10.564851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e433b4d-ade4-4477-8988-104bd373ff6b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:10.575178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:10.598495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecad83-850f-4782-8b0d-04706da06df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:10.599070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecad83-850f-4782-8b0d-04706da06df2 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:10.599381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecad83-850f-4782-8b0d-04706da06df2 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:10.599658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecad83-850f-4782-8b0d-04706da06df2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:10.600275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecad83-850f-4782-8b0d-04706da06df2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:10.601633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecad83-850f-4782-8b0d-04706da06df2 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:10.610253 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-e9ecad83-850f-4782-8b0d-04706da06df2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 30 20:48:10.610253 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:48:10.610253 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:48:10.610253 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:48:10.610253 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:48:10.610253 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:48:10.610253 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:48:10.610253 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:48:10.610253 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 30 20:48:10.610253 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:48:10.610253 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:48:10.610253 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:48:10.610253 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:48:10.610253 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:48:10.610253 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:48:10.610253 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:48:10.610253 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:48:10.611491 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:48:10.611491 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:48:10.611491 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:48:10.611491 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:48:10.611491 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:48:10.611491 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:48:10.611491 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:48:10.611491 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:48:10.611491 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:48:10.611491 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:48:10.611491 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:48:10.611491 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:48:10.611491 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:48:10.611491 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:48:10.611491 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:48:10.611491 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:48:10.612552 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:48:10.612552 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:48:10.612552 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:48:10.612552 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:48:10.612552 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:48:10.612552 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:48:10.612552 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:48:10.612552 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:48:10.612552 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:48:10.612552 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:48:10.612552 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:48:10.612552 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:48:10.612552 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 30 20:48:10.612552 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:48:10.612552 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 642/1290] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Jul 30 20:48:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:48:10.617885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0503b1-243f-47c6-b4c2-f241e5e269b8 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:10.723838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0503b1-243f-47c6-b4c2-f241e5e269b8 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:10.762104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a4bb9-8759-4cd5-82a2-60a3972305a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:10.762720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a4bb9-8759-4cd5-82a2-60a3972305a2 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:10.762999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a4bb9-8759-4cd5-82a2-60a3972305a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:10.763268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a4bb9-8759-4cd5-82a2-60a3972305a2 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:10.764527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a4bb9-8759-4cd5-82a2-60a3972305a2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:48:10.764826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a4bb9-8759-4cd5-82a2-60a3972305a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:10.766183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a4bb9-8759-4cd5-82a2-60a3972305a2 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:10.770875 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 649/1291] 10.222.0.17 () {56 vars in 1116 bytes} [Sat Jul 30 20:48:10 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:48:10.776750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecad83-850f-4782-8b0d-04706da06df2 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:10.874059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecad83-850f-4782-8b0d-04706da06df2 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:10.906850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50634b-6a4b-41b6-a9d6-c544363e3980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:10.907490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50634b-6a4b-41b6-a9d6-c544363e3980 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:10.907781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50634b-6a4b-41b6-a9d6-c544363e3980 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:10.908062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50634b-6a4b-41b6-a9d6-c544363e3980 None admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:10.908734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50634b-6a4b-41b6-a9d6-c544363e3980 None admin] RBAC: Adding query filter params (type=placement) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:48:10.909042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50634b-6a4b-41b6-a9d6-c544363e3980 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:10.910402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50634b-6a4b-41b6-a9d6-c544363e3980 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:10.914700 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 643/1292] 10.222.0.17 () {56 vars in 1116 bytes} [Sat Jul 30 20:48:10 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:48:13.090848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc6a44-9eff-4841-a29b-a88a2c8ad1e2 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:13.091364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc6a44-9eff-4841-a29b-a88a2c8ad1e2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:13.091457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc6a44-9eff-4841-a29b-a88a2c8ad1e2 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:13.093279 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 650/1293] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:48:13.098337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea995e8-fc44-4c04-8d91-bf2081225184 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:13.098738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea995e8-fc44-4c04-8d91-bf2081225184 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:13.098893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea995e8-fc44-4c04-8d91-bf2081225184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:13.117238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-eea995e8-fc44-4c04-8d91-bf2081225184 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:48:13.118434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-eea995e8-fc44-4c04-8d91-bf2081225184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:48:13.146968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:13.184009 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 644/1294] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:48:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 30 20:48:13.208684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc6a44-9eff-4841-a29b-a88a2c8ad1e2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:13.239492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:13.309386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc6a44-9eff-4841-a29b-a88a2c8ad1e2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:13.342338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6add509-9031-49aa-b930-987e30524a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:13.342949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6add509-9031-49aa-b930-987e30524a18 None admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:13.343236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6add509-9031-49aa-b930-987e30524a18 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:13.343544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6add509-9031-49aa-b930-987e30524a18 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:13.344234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6add509-9031-49aa-b930-987e30524a18 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:13.345599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6add509-9031-49aa-b930-987e30524a18 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:13.359598 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 651/1295] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 30 20:48:13 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:48:15.570491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4215e5-e26f-4b87-9797-ee3bd9f14191 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:15.571058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4215e5-e26f-4b87-9797-ee3bd9f14191 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:15.571058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4215e5-e26f-4b87-9797-ee3bd9f14191 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:15.572436 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 645/1296] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:48:15.577629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e884e-3d42-43a6-895f-1f3a39740564 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:15.578027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e884e-3d42-43a6-895f-1f3a39740564 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:15.578195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e884e-3d42-43a6-895f-1f3a39740564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:15.595942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4f4e884e-3d42-43a6-895f-1f3a39740564 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:48:15.597133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4f4e884e-3d42-43a6-895f-1f3a39740564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:48:15.671353 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 652/1297] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:48:15 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:48:15.695988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4215e5-e26f-4b87-9797-ee3bd9f14191 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:15.800636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4215e5-e26f-4b87-9797-ee3bd9f14191 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:15.839110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e36fa-df9e-40b7-9da1-97b32c481db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:15.839700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e36fa-df9e-40b7-9da1-97b32c481db3 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:15.839985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e36fa-df9e-40b7-9da1-97b32c481db3 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:15.840265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e36fa-df9e-40b7-9da1-97b32c481db3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:15.840897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e36fa-df9e-40b7-9da1-97b32c481db3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:15.842838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e36fa-df9e-40b7-9da1-97b32c481db3 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:15.851606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-a85e36fa-df9e-40b7-9da1-97b32c481db3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 30 20:48:15.851606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:48:15.851606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:48:15.851606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:48:15.851606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:48:15.851606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:48:15.851606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:48:15.851606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:48:15.851606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 30 20:48:15.851606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:48:15.851606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:48:15.851606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:48:15.851606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:48:15.851606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:48:15.851606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:48:15.851606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:48:15.851606 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:48:15.852762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:48:15.852762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:48:15.852762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:48:15.852762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:48:15.852762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:48:15.852762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:48:15.852762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:48:15.852762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:48:15.852762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:48:15.852762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:48:15.852762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:48:15.852762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:48:15.852762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:48:15.852762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:48:15.852762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:48:15.852762 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:48:15.853715 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:48:15.853715 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:48:15.853715 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:48:15.853715 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:48:15.853715 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:48:15.853715 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:48:15.853715 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:48:15.853715 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:48:15.853715 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:48:15.853715 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:48:15.853715 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:48:15.853715 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:48:15.853715 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 30 20:48:15.853715 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:48:15.853715 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 646/1298] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Jul 30 20:48:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:48:15.859473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e884e-3d42-43a6-895f-1f3a39740564 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:15.877718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:15.955361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e884e-3d42-43a6-895f-1f3a39740564 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:15.988396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733ab3d-9cce-436f-96bf-0f35c109508e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:15.989004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733ab3d-9cce-436f-96bf-0f35c109508e None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:15.989285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733ab3d-9cce-436f-96bf-0f35c109508e None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:15.989557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733ab3d-9cce-436f-96bf-0f35c109508e None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:15.990224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733ab3d-9cce-436f-96bf-0f35c109508e None admin] RBAC: Adding query filter params (name=placement) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:48:15.990527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733ab3d-9cce-436f-96bf-0f35c109508e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:15.991936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733ab3d-9cce-436f-96bf-0f35c109508e None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:15.998033 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 653/1299] 10.222.0.17 () {56 vars in 1116 bytes} [Sat Jul 30 20:48:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:48:16.003981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e36fa-df9e-40b7-9da1-97b32c481db3 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:16.035319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:16.104157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e36fa-df9e-40b7-9da1-97b32c481db3 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:16.137633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414e087-f62c-4049-b4f0-fc5640db62f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:16.138899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414e087-f62c-4049-b4f0-fc5640db62f2 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:16.139113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414e087-f62c-4049-b4f0-fc5640db62f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:16.139425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414e087-f62c-4049-b4f0-fc5640db62f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:16.140183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414e087-f62c-4049-b4f0-fc5640db62f2 None admin] RBAC: Adding query filter params (interface=public, service_id=935873e0d33b4421828f37f2c401482e, region_id=RegionOne) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:48:16.140494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414e087-f62c-4049-b4f0-fc5640db62f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:16.141867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414e087-f62c-4049-b4f0-fc5640db62f2 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:16.147539 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 647/1300] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Jul 30 20:48:16 2022] GET /identity/v3/endpoints?service_id=935873e0d33b4421828f37f2c401482e&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:48:16.153177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733ab3d-9cce-436f-96bf-0f35c109508e None admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:16.234211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:16.251988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733ab3d-9cce-436f-96bf-0f35c109508e None admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:16.284858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3f6d6-1174-4dbf-8505-ad6dc9bdab9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:16.285459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3f6d6-1174-4dbf-8505-ad6dc9bdab9a None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:16.285736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3f6d6-1174-4dbf-8505-ad6dc9bdab9a None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:16.286006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3f6d6-1174-4dbf-8505-ad6dc9bdab9a None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:16.286646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3f6d6-1174-4dbf-8505-ad6dc9bdab9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:16.288023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3f6d6-1174-4dbf-8505-ad6dc9bdab9a None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:16.294576 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 654/1301] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Jul 30 20:48:16 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 20:48:18.482588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baba2dd-a39b-4518-8641-08cca6679b0f None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:18.483142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baba2dd-a39b-4518-8641-08cca6679b0f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:18.483142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baba2dd-a39b-4518-8641-08cca6679b0f None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:18.484512 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 648/1302] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:48:18.489713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da520b5-8660-4f57-9434-2dfeaf6f55ca None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:18.490106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da520b5-8660-4f57-9434-2dfeaf6f55ca None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:18.490276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da520b5-8660-4f57-9434-2dfeaf6f55ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:18.508225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8da520b5-8660-4f57-9434-2dfeaf6f55ca None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:48:18.509448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8da520b5-8660-4f57-9434-2dfeaf6f55ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:48:18.574066 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 655/1303] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:48:18 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 20:48:18.598782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baba2dd-a39b-4518-8641-08cca6679b0f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:18.697335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:18.704265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baba2dd-a39b-4518-8641-08cca6679b0f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:18.736746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27f62c-cefe-4338-a574-2d292a5adbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:18.737323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27f62c-cefe-4338-a574-2d292a5adbf9 None admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:18.737608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27f62c-cefe-4338-a574-2d292a5adbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:18.737891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27f62c-cefe-4338-a574-2d292a5adbf9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:18.738508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27f62c-cefe-4338-a574-2d292a5adbf9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:18.739901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27f62c-cefe-4338-a574-2d292a5adbf9 None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:18.749340 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-0a27f62c-cefe-4338-a574-2d292a5adbf9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 30 20:48:18.749340 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:48:18.749340 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 20:48:18.749340 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 20:48:18.749340 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 20:48:18.749340 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 20:48:18.749340 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 20:48:18.749340 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:48:18.749340 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 30 20:48:18.749340 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:48:18.749340 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 20:48:18.749340 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:48:18.749340 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 20:48:18.749340 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 20:48:18.749340 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 20:48:18.749340 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 20:48:18.749340 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 20:48:18.750477 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 20:48:18.750477 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 20:48:18.750477 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 20:48:18.750477 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 20:48:18.750477 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 20:48:18.750477 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 20:48:18.750477 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 20:48:18.750477 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 20:48:18.750477 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 20:48:18.750477 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 20:48:18.750477 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 20:48:18.750477 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 20:48:18.750477 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 20:48:18.750477 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 20:48:18.750477 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 20:48:18.750477 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 20:48:18.751383 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 20:48:18.751383 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 20:48:18.751383 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 20:48:18.751383 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 20:48:18.751383 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 20:48:18.751383 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 20:48:18.751383 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 20:48:18.751383 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 20:48:18.751383 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 20:48:18.751383 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 20:48:18.751383 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 20:48:18.751383 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 20:48:18.751383 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 30 20:48:18.751383 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 20:48:18.751383 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 649/1304] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Jul 30 20:48:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 20:48:18.757300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da520b5-8660-4f57-9434-2dfeaf6f55ca None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:18.830764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:18.853455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da520b5-8660-4f57-9434-2dfeaf6f55ca None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:18.890554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d046fe-9569-4334-af85-89de31761be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:18.891176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d046fe-9569-4334-af85-89de31761be3 None admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:18.891499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d046fe-9569-4334-af85-89de31761be3 None admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:18.891781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d046fe-9569-4334-af85-89de31761be3 None admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:18.892458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d046fe-9569-4334-af85-89de31761be3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:48:18.892766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d046fe-9569-4334-af85-89de31761be3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:18.894136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d046fe-9569-4334-af85-89de31761be3 None admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:18.899283 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 656/1305] 10.222.0.17 () {56 vars in 1116 bytes} [Sat Jul 30 20:48:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:48:18.905661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27f62c-cefe-4338-a574-2d292a5adbf9 None admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:48:19.004416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27f62c-cefe-4338-a574-2d292a5adbf9 None admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:48:19.037715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3422e34-9c6b-45fa-800b-9604c27531ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:48:19.038325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3422e34-9c6b-45fa-800b-9604c27531ea None admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:48:19.038607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3422e34-9c6b-45fa-800b-9604c27531ea None admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:48:19.038879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3422e34-9c6b-45fa-800b-9604c27531ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:48:19.039607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3422e34-9c6b-45fa-800b-9604c27531ea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:48:19.040955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3422e34-9c6b-45fa-800b-9604c27531ea None admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:48:19.059695 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 650/1306] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 20:48:18 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:48:28.896263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=30 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:48:29.055964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:30.110010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e445e5-12e2-45d4-8a56-6d226ef25c01 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:30.110595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e445e5-12e2-45d4-8a56-6d226ef25c01 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:30.110595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e445e5-12e2-45d4-8a56-6d226ef25c01 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:30.115802 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 657/1307] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:49:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:49:30.117277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e586-4a3e-4e4c-8184-b0070cc9892b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:30.117749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e586-4a3e-4e4c-8184-b0070cc9892b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:30.117921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e586-4a3e-4e4c-8184-b0070cc9892b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:30.206784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-93b4e586-4a3e-4e4c-8184-b0070cc9892b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:49:30.208385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-93b4e586-4a3e-4e4c-8184-b0070cc9892b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:30.343867 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 651/1308] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 20:49:30.376842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca8ef8-924f-4799-a4f0-6e3211dc95e4 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:30.377193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca8ef8-924f-4799-a4f0-6e3211dc95e4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:30.377406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca8ef8-924f-4799-a4f0-6e3211dc95e4 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:30.379050 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 658/1309] 10.222.0.17 () {54 vars in 965 bytes} [Sat Jul 30 20:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:49:30.385582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d44b3d-faeb-461d-b9b7-08db4f79d21d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:30.386025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d44b3d-faeb-461d-b9b7-08db4f79d21d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:30.386415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d44b3d-faeb-461d-b9b7-08db4f79d21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:30.479042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-54d44b3d-faeb-461d-b9b7-08db4f79d21d None None] MFA Rules not processed for user `4a886ccf9590432caf209526410a7b53`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:49:30.480542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-54d44b3d-faeb-461d-b9b7-08db4f79d21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:30.503002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:30.568702 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 652/1310] 10.222.0.17 () {58 vars in 1062 bytes} [Sat Jul 30 20:49:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:49:30.579808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca8ef8-924f-4799-a4f0-6e3211dc95e4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:49:30.581942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2cca8ef8-924f-4799-a4f0-6e3211dc95e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:30.760175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca8ef8-924f-4799-a4f0-6e3211dc95e4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:49:30.868235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d206eb-1e84-47f4-8e14-b5a6df60c2bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:49:30.868989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d206eb-1e84-47f4-8e14-b5a6df60c2bd service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:30.869381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d206eb-1e84-47f4-8e14-b5a6df60c2bd service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:30.869766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d206eb-1e84-47f4-8e14-b5a6df60c2bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:30.872564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-46d206eb-1e84-47f4-8e14-b5a6df60c2bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:30.933413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:30.997616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d206eb-1e84-47f4-8e14-b5a6df60c2bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:49:30.999197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d206eb-1e84-47f4-8e14-b5a6df60c2bd service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:49:31.019112 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 659/1311] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:49:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:49:33.585637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3082f6-6015-41f7-b6fa-8e3354447786 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:33.586526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3082f6-6015-41f7-b6fa-8e3354447786 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:33.586822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3082f6-6015-41f7-b6fa-8e3354447786 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:33.592085 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 653/1312] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:49:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:49:33.593444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dced12-fc4a-4366-b76a-7082d5213607 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:33.593852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dced12-fc4a-4366-b76a-7082d5213607 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:33.594002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dced12-fc4a-4366-b76a-7082d5213607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:33.677232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-49dced12-fc4a-4366-b76a-7082d5213607 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:49:33.678638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-49dced12-fc4a-4366-b76a-7082d5213607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:33.795227 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 660/1313] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 20:49:33.837490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3082f6-6015-41f7-b6fa-8e3354447786 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:49:33.839039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ff3082f6-6015-41f7-b6fa-8e3354447786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:33.955221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3082f6-6015-41f7-b6fa-8e3354447786 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:49:34.029801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:34.032603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a06e7-f465-4543-a769-030e74f77b82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:49:34.033425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a06e7-f465-4543-a769-030e74f77b82 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:34.033901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a06e7-f465-4543-a769-030e74f77b82 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:34.034375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a06e7-f465-4543-a769-030e74f77b82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:34.036305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-297a06e7-f465-4543-a769-030e74f77b82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:34.144853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a06e7-f465-4543-a769-030e74f77b82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:49:34.146425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a06e7-f465-4543-a769-030e74f77b82 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:49:34.166617 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 654/1314] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:49:36.761333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a54758-4249-40d6-ac4c-cf39184b16b5 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:36.761881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a54758-4249-40d6-ac4c-cf39184b16b5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:36.761977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a54758-4249-40d6-ac4c-cf39184b16b5 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:36.763257 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 661/1315] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:49:36.768446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689353c-c56a-4155-9424-3d4eda1238de None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:36.768875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689353c-c56a-4155-9424-3d4eda1238de None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:36.769010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689353c-c56a-4155-9424-3d4eda1238de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:36.844089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f689353c-c56a-4155-9424-3d4eda1238de None None] MFA Rules not processed for user `9e9636a0c442469e88a4bc0a1fd199b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:49:36.845327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f689353c-c56a-4155-9424-3d4eda1238de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:36.897753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:36.944476 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 655/1316] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:49:36 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:49:36.990484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a54758-4249-40d6-ac4c-cf39184b16b5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:49:36.992084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-93a54758-4249-40d6-ac4c-cf39184b16b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:37.002717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:37.103752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a54758-4249-40d6-ac4c-cf39184b16b5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:49:37.187647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78a2d1-8798-49cd-9c4d-562075d5151a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:49:37.188182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78a2d1-8798-49cd-9c4d-562075d5151a service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:37.188462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78a2d1-8798-49cd-9c4d-562075d5151a service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:37.188734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78a2d1-8798-49cd-9c4d-562075d5151a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:37.190333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2e78a2d1-8798-49cd-9c4d-562075d5151a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:37.252309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:37.301844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78a2d1-8798-49cd-9c4d-562075d5151a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:49:37.303280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78a2d1-8798-49cd-9c4d-562075d5151a service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:49:37.322541 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 662/1317] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:49:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:49:40.078574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee111f5-6c62-4c91-9370-2ceaae5b3bfd None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:40.079093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee111f5-6c62-4c91-9370-2ceaae5b3bfd None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:40.079213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee111f5-6c62-4c91-9370-2ceaae5b3bfd None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:40.080503 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 656/1318] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:49:40.085477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bb776-3279-4192-a9bf-ece181266145 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:40.085894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bb776-3279-4192-a9bf-ece181266145 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:40.086037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bb776-3279-4192-a9bf-ece181266145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:40.157913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-907bb776-3279-4192-a9bf-ece181266145 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:49:40.159103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-907bb776-3279-4192-a9bf-ece181266145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:40.253657 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 663/1319] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:49:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:49:40.308489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d3857-13f5-4b05-843b-4111735ca0e8 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:40.309373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d3857-13f5-4b05-843b-4111735ca0e8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:40.309677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d3857-13f5-4b05-843b-4111735ca0e8 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:40.311054 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 657/1320] 10.222.0.17 () {54 vars in 965 bytes} [Sat Jul 30 20:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:49:40.316984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8728c-14ee-4af0-8f53-a89b09ccc012 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:40.317273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8728c-14ee-4af0-8f53-a89b09ccc012 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:40.317550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8728c-14ee-4af0-8f53-a89b09ccc012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:40.338833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:40.392362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-afd8728c-14ee-4af0-8f53-a89b09ccc012 None None] MFA Rules not processed for user `4a886ccf9590432caf209526410a7b53`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:49:40.393576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-afd8728c-14ee-4af0-8f53-a89b09ccc012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:40.467252 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 664/1321] 10.222.0.17 () {58 vars in 1062 bytes} [Sat Jul 30 20:49:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:49:40.476078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d3857-13f5-4b05-843b-4111735ca0e8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:49:40.477595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6c3d3857-13f5-4b05-843b-4111735ca0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:40.579898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d3857-13f5-4b05-843b-4111735ca0e8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:49:40.654536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5200652-b4fe-4027-a1c9-0c0840bd510a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:49:40.655161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5200652-b4fe-4027-a1c9-0c0840bd510a service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:40.655475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5200652-b4fe-4027-a1c9-0c0840bd510a service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:40.655751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5200652-b4fe-4027-a1c9-0c0840bd510a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:40.657375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d5200652-b4fe-4027-a1c9-0c0840bd510a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:40.664733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:40.767636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5200652-b4fe-4027-a1c9-0c0840bd510a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:49:40.769076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5200652-b4fe-4027-a1c9-0c0840bd510a service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:49:40.786661 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 658/1322] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:49:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:49:44.159613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca85410-6a99-41f1-89cd-51eea8920aec None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:44.160143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca85410-6a99-41f1-89cd-51eea8920aec None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:44.160143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca85410-6a99-41f1-89cd-51eea8920aec None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:44.161509 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 665/1323] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:49:44.166576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a83c0c-06cd-4367-9041-bc625c666759 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:44.167016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a83c0c-06cd-4367-9041-bc625c666759 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:44.167259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a83c0c-06cd-4367-9041-bc625c666759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:44.234864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-44a83c0c-06cd-4367-9041-bc625c666759 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:49:44.236096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-44a83c0c-06cd-4367-9041-bc625c666759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:44.295754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:44.334162 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 659/1324] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:49:44.371272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca85410-6a99-41f1-89cd-51eea8920aec None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:49:44.373127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5ca85410-6a99-41f1-89cd-51eea8920aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:44.475282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca85410-6a99-41f1-89cd-51eea8920aec None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:49:44.488102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:44.550458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b7799-1312-4afa-97a7-5567d6e5b295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:49:44.550990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b7799-1312-4afa-97a7-5567d6e5b295 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:44.551269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b7799-1312-4afa-97a7-5567d6e5b295 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:44.551569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b7799-1312-4afa-97a7-5567d6e5b295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:44.553161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6a8b7799-1312-4afa-97a7-5567d6e5b295 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:44.665796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b7799-1312-4afa-97a7-5567d6e5b295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:49:44.667242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b7799-1312-4afa-97a7-5567d6e5b295 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:49:44.690794 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 666/1325] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:49:46.948111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abde19-a153-4e7c-8c26-a95f0214d9c6 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:46.948661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abde19-a153-4e7c-8c26-a95f0214d9c6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:46.948661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abde19-a153-4e7c-8c26-a95f0214d9c6 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:46.950534 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 660/1326] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:49:46.955613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73347c5b-505b-49f6-8404-6e1586e6cb22 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:46.956036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73347c5b-505b-49f6-8404-6e1586e6cb22 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:46.956175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73347c5b-505b-49f6-8404-6e1586e6cb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:47.013586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:47.032788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-73347c5b-505b-49f6-8404-6e1586e6cb22 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:49:47.034034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-73347c5b-505b-49f6-8404-6e1586e6cb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:47.131622 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 667/1327] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:49:47.168702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abde19-a153-4e7c-8c26-a95f0214d9c6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:49:47.170449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b7abde19-a153-4e7c-8c26-a95f0214d9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:47.276206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abde19-a153-4e7c-8c26-a95f0214d9c6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:49:47.352529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e11c85-8ecd-4839-9512-79afd84d6db0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:49:47.353156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e11c85-8ecd-4839-9512-79afd84d6db0 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:47.353443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e11c85-8ecd-4839-9512-79afd84d6db0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:47.353717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e11c85-8ecd-4839-9512-79afd84d6db0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:47.355973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f9e11c85-8ecd-4839-9512-79afd84d6db0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:47.373549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:47.470276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e11c85-8ecd-4839-9512-79afd84d6db0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:49:47.471748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e11c85-8ecd-4839-9512-79afd84d6db0 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:49:47.490760 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 661/1328] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:49:49.773737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeea8cd-81e0-493b-bdde-49d62ea72303 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:49.774274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeea8cd-81e0-493b-bdde-49d62ea72303 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:49.774274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeea8cd-81e0-493b-bdde-49d62ea72303 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:49.775611 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 668/1329] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:49:49.781349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3e45a-5fd8-4e9f-b3fa-d206761fa4c3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:49.781750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3e45a-5fd8-4e9f-b3fa-d206761fa4c3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:49.782057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3e45a-5fd8-4e9f-b3fa-d206761fa4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:49.848173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-cdf3e45a-5fd8-4e9f-b3fa-d206761fa4c3 None None] MFA Rules not processed for user `9e9636a0c442469e88a4bc0a1fd199b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:49:49.849385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cdf3e45a-5fd8-4e9f-b3fa-d206761fa4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:49.914133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:49.950946 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 662/1330] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:49:49 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:49:49.989760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeea8cd-81e0-493b-bdde-49d62ea72303 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:49:49.991346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cfeea8cd-81e0-493b-bdde-49d62ea72303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:50.097154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeea8cd-81e0-493b-bdde-49d62ea72303 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:49:50.116970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:50.174437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea83b53-578d-4fbd-9bd5-03929e0656d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:49:50.175064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea83b53-578d-4fbd-9bd5-03929e0656d6 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:50.175383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea83b53-578d-4fbd-9bd5-03929e0656d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:50.175748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea83b53-578d-4fbd-9bd5-03929e0656d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:50.177385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8ea83b53-578d-4fbd-9bd5-03929e0656d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:50.294496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea83b53-578d-4fbd-9bd5-03929e0656d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:49:50.295974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea83b53-578d-4fbd-9bd5-03929e0656d6 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:49:50.315197 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 669/1331] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:49:49 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:49:52.831733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9bfe2-e6a5-43a3-8dbd-6418d4d6d516 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:52.832215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9bfe2-e6a5-43a3-8dbd-6418d4d6d516 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:52.832310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9bfe2-e6a5-43a3-8dbd-6418d4d6d516 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:52.833620 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 663/1332] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:49:52.839020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79661329-51e4-41ad-9ae5-78b9b4b5fe83 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:52.839985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79661329-51e4-41ad-9ae5-78b9b4b5fe83 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:52.840159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79661329-51e4-41ad-9ae5-78b9b4b5fe83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:52.903961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:52.912745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-79661329-51e4-41ad-9ae5-78b9b4b5fe83 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:49:52.914358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-79661329-51e4-41ad-9ae5-78b9b4b5fe83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:53.040344 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 670/1333] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:49:53.077759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9bfe2-e6a5-43a3-8dbd-6418d4d6d516 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:49:53.079250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c5a9bfe2-e6a5-43a3-8dbd-6418d4d6d516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:53.188460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9bfe2-e6a5-43a3-8dbd-6418d4d6d516 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:49:53.262616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7d4c0-072e-4657-90a6-5f66f33774ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:49:53.263231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7d4c0-072e-4657-90a6-5f66f33774ba service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:53.263545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7d4c0-072e-4657-90a6-5f66f33774ba service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:53.263820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7d4c0-072e-4657-90a6-5f66f33774ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:53.265421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-acd7d4c0-072e-4657-90a6-5f66f33774ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:53.292206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:53.377454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7d4c0-072e-4657-90a6-5f66f33774ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:49:53.378832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7d4c0-072e-4657-90a6-5f66f33774ba service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:49:53.396727 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 664/1334] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:49:55.689574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bfce1-5e01-4b2e-a8e8-0d387bf7d7d0 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:55.690124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bfce1-5e01-4b2e-a8e8-0d387bf7d7d0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:55.690124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bfce1-5e01-4b2e-a8e8-0d387bf7d7d0 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:55.691462 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 671/1335] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:49:55.696755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbf7c3-76df-4b35-942a-3335ae14788f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:55.697214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbf7c3-76df-4b35-942a-3335ae14788f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:55.697311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbf7c3-76df-4b35-942a-3335ae14788f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:55.763586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-29fbf7c3-76df-4b35-942a-3335ae14788f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:49:55.764798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-29fbf7c3-76df-4b35-942a-3335ae14788f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:55.837234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:55.859785 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 665/1336] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:49:55.901570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bfce1-5e01-4b2e-a8e8-0d387bf7d7d0 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:49:55.903126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f63bfce1-5e01-4b2e-a8e8-0d387bf7d7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:56.008758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bfce1-5e01-4b2e-a8e8-0d387bf7d7d0 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:49:56.036614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:56.081459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32d9f6-423d-419a-8aea-7638b5d0fa67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:49:56.082072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32d9f6-423d-419a-8aea-7638b5d0fa67 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:56.082352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32d9f6-423d-419a-8aea-7638b5d0fa67 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:56.082624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32d9f6-423d-419a-8aea-7638b5d0fa67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:56.084265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7c32d9f6-423d-419a-8aea-7638b5d0fa67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:56.190926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32d9f6-423d-419a-8aea-7638b5d0fa67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:49:56.192375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32d9f6-423d-419a-8aea-7638b5d0fa67 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:49:56.210391 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 672/1337] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:49:58.808757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e139e9b-4ce6-4cb3-99aa-e4388cc1bc23 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:58.809422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e139e9b-4ce6-4cb3-99aa-e4388cc1bc23 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:58.809422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e139e9b-4ce6-4cb3-99aa-e4388cc1bc23 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:58.810670 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 666/1338] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:49:58.816098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154e654-0a05-4b7a-9abd-4763187ef3bd None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:58.816509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154e654-0a05-4b7a-9abd-4763187ef3bd None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:58.816729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154e654-0a05-4b7a-9abd-4763187ef3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:58.895951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5154e654-0a05-4b7a-9abd-4763187ef3bd None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:49:58.898538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5154e654-0a05-4b7a-9abd-4763187ef3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:58.907526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:58.999854 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 673/1339] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:49:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:49:59.039181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e139e9b-4ce6-4cb3-99aa-e4388cc1bc23 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:49:59.040754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5e139e9b-4ce6-4cb3-99aa-e4388cc1bc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:59.146087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e139e9b-4ce6-4cb3-99aa-e4388cc1bc23 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:49:59.225386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1eaf5-8fbe-44e5-a925-db2a83c19e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:49:59.226003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1eaf5-8fbe-44e5-a925-db2a83c19e5e service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:49:59.226284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1eaf5-8fbe-44e5-a925-db2a83c19e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:49:59.226552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1eaf5-8fbe-44e5-a925-db2a83c19e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:49:59.228358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fec1eaf5-8fbe-44e5-a925-db2a83c19e5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:49:59.265938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:49:59.341213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1eaf5-8fbe-44e5-a925-db2a83c19e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:49:59.342652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1eaf5-8fbe-44e5-a925-db2a83c19e5e service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:49:59.361320 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 667/1340] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:49:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:50:03.725381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8692937-3676-4937-bdc1-72969aac760d None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:03.725913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8692937-3676-4937-bdc1-72969aac760d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:03.725913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8692937-3676-4937-bdc1-72969aac760d None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:03.727206 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 674/1341] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:03.733009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba09586-dcbb-4b5f-9bee-8f6b46f9e24c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:03.733461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba09586-dcbb-4b5f-9bee-8f6b46f9e24c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:03.733559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba09586-dcbb-4b5f-9bee-8f6b46f9e24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:03.801919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9ba09586-dcbb-4b5f-9bee-8f6b46f9e24c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:03.803127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9ba09586-dcbb-4b5f-9bee-8f6b46f9e24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:03.888668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:03.900693 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 668/1342] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:03.941596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8692937-3676-4937-bdc1-72969aac760d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:50:03.943135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a8692937-3676-4937-bdc1-72969aac760d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:04.051237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8692937-3676-4937-bdc1-72969aac760d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:50:04.093898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:04.130517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f9c79-2fe5-4bcf-a4ee-34868b5affd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:50:04.131141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f9c79-2fe5-4bcf-a4ee-34868b5affd5 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:04.131457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f9c79-2fe5-4bcf-a4ee-34868b5affd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:04.131737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f9c79-2fe5-4bcf-a4ee-34868b5affd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:04.133352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-311f9c79-2fe5-4bcf-a4ee-34868b5affd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:04.247536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f9c79-2fe5-4bcf-a4ee-34868b5affd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:50:04.248960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f9c79-2fe5-4bcf-a4ee-34868b5affd5 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:50:04.267487 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 675/1343] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:50:07.126326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc4e42-3ef0-49b7-8fe0-04ca8d68031b None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:07.126877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc4e42-3ef0-49b7-8fe0-04ca8d68031b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:07.126877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc4e42-3ef0-49b7-8fe0-04ca8d68031b None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:07.128302 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 669/1344] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:07.133600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f74726-a516-48df-864e-af22bc6655c3 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:07.134031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f74726-a516-48df-864e-af22bc6655c3 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:07.134166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f74726-a516-48df-864e-af22bc6655c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:07.200856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-96f74726-a516-48df-864e-af22bc6655c3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:07.202088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-96f74726-a516-48df-864e-af22bc6655c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:07.220070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:07.301548 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 676/1345] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:50:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:07.340043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc4e42-3ef0-49b7-8fe0-04ca8d68031b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:50:07.341588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-11fc4e42-3ef0-49b7-8fe0-04ca8d68031b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:07.447959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc4e42-3ef0-49b7-8fe0-04ca8d68031b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:50:07.527183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fb385-901c-485f-bb23-ee22b5a696b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:50:07.527841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fb385-901c-485f-bb23-ee22b5a696b8 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:07.528125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fb385-901c-485f-bb23-ee22b5a696b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:07.528400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fb385-901c-485f-bb23-ee22b5a696b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:07.530044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-579fb385-901c-485f-bb23-ee22b5a696b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:07.575642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:07.644821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579fb385-901c-485f-bb23-ee22b5a696b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:50:07.646259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579fb385-901c-485f-bb23-ee22b5a696b8 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:50:07.664656 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 670/1346] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:50:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:50:12.088608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4e49c-d2cb-4475-8cc8-07e1bf8d6107 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:12.089666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4e49c-d2cb-4475-8cc8-07e1bf8d6107 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:12.089666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4e49c-d2cb-4475-8cc8-07e1bf8d6107 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:12.091088 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 677/1347] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:12.096464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e66e12-b61e-4403-a7a9-50ed2546d76c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:12.096908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e66e12-b61e-4403-a7a9-50ed2546d76c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:12.097035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e66e12-b61e-4403-a7a9-50ed2546d76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:12.162774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-71e66e12-b61e-4403-a7a9-50ed2546d76c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:12.164016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-71e66e12-b61e-4403-a7a9-50ed2546d76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:12.260455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:12.263973 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 671/1348] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:12.303746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4e49c-d2cb-4475-8cc8-07e1bf8d6107 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:50:12.305438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a7f4e49c-d2cb-4475-8cc8-07e1bf8d6107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:12.427734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4e49c-d2cb-4475-8cc8-07e1bf8d6107 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:50:12.479176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:12.508523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf38000-84a0-47bc-a6c7-557af5ceabd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:50:12.509155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf38000-84a0-47bc-a6c7-557af5ceabd4 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:12.509441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf38000-84a0-47bc-a6c7-557af5ceabd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:12.509717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf38000-84a0-47bc-a6c7-557af5ceabd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:12.511505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-eaf38000-84a0-47bc-a6c7-557af5ceabd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:12.625257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf38000-84a0-47bc-a6c7-557af5ceabd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:50:12.626709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf38000-84a0-47bc-a6c7-557af5ceabd4 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:50:12.645420 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 678/1349] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:50:17.999572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d4873-719c-4035-a31f-4ba0edfd8d9c None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:18.000417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d4873-719c-4035-a31f-4ba0edfd8d9c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:18.001023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d4873-719c-4035-a31f-4ba0edfd8d9c None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:18.002951 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 672/1350] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 20:50:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:18.010223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc260b95-915b-4fcb-a7de-38ec08a8e807 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:18.016172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc260b95-915b-4fcb-a7de-38ec08a8e807 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:18.016648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc260b95-915b-4fcb-a7de-38ec08a8e807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:18.124188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-cc260b95-915b-4fcb-a7de-38ec08a8e807 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:18.125545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cc260b95-915b-4fcb-a7de-38ec08a8e807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:18.145241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:18.251993 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 679/1351] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 20:50:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 20:50:22.630487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa6e4f-13e3-4ca5-b8ac-56ad42c21934 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:22.631021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa6e4f-13e3-4ca5-b8ac-56ad42c21934 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:22.631021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa6e4f-13e3-4ca5-b8ac-56ad42c21934 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:22.632794 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 673/1352] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 20:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:22.638434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b05a31-f606-4e76-944b-cedc208e76c2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:22.640652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b05a31-f606-4e76-944b-cedc208e76c2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:22.640951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b05a31-f606-4e76-944b-cedc208e76c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:22.729068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d2b05a31-f606-4e76-944b-cedc208e76c2 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:22.730734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d2b05a31-f606-4e76-944b-cedc208e76c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:22.807459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:22.848793 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 680/1353] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 20:50:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:24.348688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93c3d3-f747-4ad0-aef5-c2e5131e42a9 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:24.349357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93c3d3-f747-4ad0-aef5-c2e5131e42a9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:24.349357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93c3d3-f747-4ad0-aef5-c2e5131e42a9 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:24.350627 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 674/1354] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 20:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:24.355918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d45657-7dfa-4ba1-905a-9ca1568b78c1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:24.356381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d45657-7dfa-4ba1-905a-9ca1568b78c1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:24.356494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d45657-7dfa-4ba1-905a-9ca1568b78c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:24.437265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-90d45657-7dfa-4ba1-905a-9ca1568b78c1 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:24.438478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-90d45657-7dfa-4ba1-905a-9ca1568b78c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:24.555670 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 681/1355] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 20:50:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:28.283468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd5d62-0a3a-4911-866d-f1c6e3def2c9 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:28.284521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd5d62-0a3a-4911-866d-f1c6e3def2c9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:28.285012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd5d62-0a3a-4911-866d-f1c6e3def2c9 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:28.293187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf30067-87ce-426f-80e2-3770ebe286dc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:28.294063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf30067-87ce-426f-80e2-3770ebe286dc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:28.295202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf30067-87ce-426f-80e2-3770ebe286dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:28.297225 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 675/1356] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:50:28 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:28.335341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:28.369286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1bf30067-87ce-426f-80e2-3770ebe286dc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:28.370554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1bf30067-87ce-426f-80e2-3770ebe286dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:28.471424 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 682/1357] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:28.527649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299bba1-78dc-4425-97e2-686f86d80787 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:28.527970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299bba1-78dc-4425-97e2-686f86d80787 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:28.528768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299bba1-78dc-4425-97e2-686f86d80787 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:28.530316 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 676/1358] 10.222.0.17 () {54 vars in 962 bytes} [Sat Jul 30 20:50:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:28.545366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ba67d-fe58-4c50-930f-8578b2f8d9c9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:28.547830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ba67d-fe58-4c50-930f-8578b2f8d9c9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:28.548347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ba67d-fe58-4c50-930f-8578b2f8d9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:28.632041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b82ba67d-fe58-4c50-930f-8578b2f8d9c9 None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:28.633561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b82ba67d-fe58-4c50-930f-8578b2f8d9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:28.686653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:28.759336 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 683/1359] 10.222.0.17 () {58 vars in 1059 bytes} [Sat Jul 30 20:50:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:28.767865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299bba1-78dc-4425-97e2-686f86d80787 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:50:28.769385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b299bba1-78dc-4425-97e2-686f86d80787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:28.928433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299bba1-78dc-4425-97e2-686f86d80787 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:50:29.014256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:29.058179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421c6a3-e5a5-4027-9623-00c9ba74d29b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:50:29.058810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421c6a3-e5a5-4027-9623-00c9ba74d29b service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:29.059098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421c6a3-e5a5-4027-9623-00c9ba74d29b service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:29.059412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421c6a3-e5a5-4027-9623-00c9ba74d29b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:29.061045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c421c6a3-e5a5-4027-9623-00c9ba74d29b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:29.165420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421c6a3-e5a5-4027-9623-00c9ba74d29b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:50:29.166966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421c6a3-e5a5-4027-9623-00c9ba74d29b service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:50:29.188722 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 677/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:50:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 20:50:31.669792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459259d3-aedf-4f09-80a6-5c1802f75517 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:31.670368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459259d3-aedf-4f09-80a6-5c1802f75517 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:31.670368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459259d3-aedf-4f09-80a6-5c1802f75517 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:31.671946 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 684/1361] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:31.677174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c4b25-f381-4f5a-8e98-808662a97b12 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:31.677673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c4b25-f381-4f5a-8e98-808662a97b12 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:31.677773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c4b25-f381-4f5a-8e98-808662a97b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:31.750213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5d6c4b25-f381-4f5a-8e98-808662a97b12 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:31.751599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5d6c4b25-f381-4f5a-8e98-808662a97b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:31.797298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:31.877753 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 678/1362] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:31.927355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459259d3-aedf-4f09-80a6-5c1802f75517 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:50:31.929039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-459259d3-aedf-4f09-80a6-5c1802f75517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:32.131117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459259d3-aedf-4f09-80a6-5c1802f75517 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:50:32.141875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:32.259126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41c1da-3b74-4e1b-b347-067edeace7e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:50:32.259896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41c1da-3b74-4e1b-b347-067edeace7e2 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:32.260278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41c1da-3b74-4e1b-b347-067edeace7e2 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:32.260616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41c1da-3b74-4e1b-b347-067edeace7e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:32.262303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dc41c1da-3b74-4e1b-b347-067edeace7e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:32.380531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41c1da-3b74-4e1b-b347-067edeace7e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:50:32.382077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41c1da-3b74-4e1b-b347-067edeace7e2 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:50:32.403217 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 685/1363] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:50:34.971611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894e134-a48f-447f-b0c5-8fb7c12f1081 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:34.972161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894e134-a48f-447f-b0c5-8fb7c12f1081 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:34.972403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894e134-a48f-447f-b0c5-8fb7c12f1081 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:34.974191 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 679/1364] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:34.980596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaba380-66af-4518-bf2d-cca007ace1d8 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:34.981118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaba380-66af-4518-bf2d-cca007ace1d8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:34.981202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaba380-66af-4518-bf2d-cca007ace1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:35.003762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:35.065693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-efaba380-66af-4518-bf2d-cca007ace1d8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:35.066918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-efaba380-66af-4518-bf2d-cca007ace1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:35.208076 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 686/1365] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:35.255475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1e722-f7af-4806-a5f0-e83ff9b9bfca None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:35.255961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1e722-f7af-4806-a5f0-e83ff9b9bfca None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:35.256337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1e722-f7af-4806-a5f0-e83ff9b9bfca None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:35.257776 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 680/1366] 10.222.0.17 () {54 vars in 962 bytes} [Sat Jul 30 20:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:35.263406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c21243-aebe-4024-a0cc-0835ba7836f2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:35.263706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c21243-aebe-4024-a0cc-0835ba7836f2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:35.263986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c21243-aebe-4024-a0cc-0835ba7836f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:35.348057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-43c21243-aebe-4024-a0cc-0835ba7836f2 None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:35.349293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-43c21243-aebe-4024-a0cc-0835ba7836f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:35.387171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:35.481479 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 687/1367] 10.222.0.17 () {58 vars in 1059 bytes} [Sat Jul 30 20:50:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:35.489131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1e722-f7af-4806-a5f0-e83ff9b9bfca None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:50:35.490854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-10f1e722-f7af-4806-a5f0-e83ff9b9bfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:35.708447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1e722-f7af-4806-a5f0-e83ff9b9bfca None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:50:35.730106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:35.830545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c7d9b-17cf-45ea-9a2c-aefa83da12cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:50:35.831376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c7d9b-17cf-45ea-9a2c-aefa83da12cb service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:35.831779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c7d9b-17cf-45ea-9a2c-aefa83da12cb service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:35.832160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c7d9b-17cf-45ea-9a2c-aefa83da12cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:35.834081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-955c7d9b-17cf-45ea-9a2c-aefa83da12cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:35.939063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c7d9b-17cf-45ea-9a2c-aefa83da12cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:50:35.940943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c7d9b-17cf-45ea-9a2c-aefa83da12cb service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:50:35.960937 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 681/1368] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:50:38.637113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5a1f6-7f80-4de4-92a6-54311b80c669 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:38.637555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5a1f6-7f80-4de4-92a6-54311b80c669 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:38.637775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5a1f6-7f80-4de4-92a6-54311b80c669 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:38.639939 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 688/1369] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:38.645236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1fdb0-3f7b-43c7-8bce-e538c112a970 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:38.645679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1fdb0-3f7b-43c7-8bce-e538c112a970 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:38.645788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1fdb0-3f7b-43c7-8bce-e538c112a970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:38.703873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:38.766927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1ca1fdb0-3f7b-43c7-8bce-e538c112a970 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:38.768514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1ca1fdb0-3f7b-43c7-8bce-e538c112a970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:38.882400 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 682/1370] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:38.930541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5a1f6-7f80-4de4-92a6-54311b80c669 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:50:38.932451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4ba5a1f6-7f80-4de4-92a6-54311b80c669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:39.105931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:39.111264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5a1f6-7f80-4de4-92a6-54311b80c669 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:50:39.234060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ce76f-4a13-405a-9604-ac2f6340f7bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:50:39.234779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ce76f-4a13-405a-9604-ac2f6340f7bd service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:39.235355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ce76f-4a13-405a-9604-ac2f6340f7bd service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:39.235744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ce76f-4a13-405a-9604-ac2f6340f7bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:39.237583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-662ce76f-4a13-405a-9604-ac2f6340f7bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:39.345514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ce76f-4a13-405a-9604-ac2f6340f7bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:50:39.347444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ce76f-4a13-405a-9604-ac2f6340f7bd service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:50:39.369104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:39.387756 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 689/1371] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:50:40.579382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b63f4b-7225-4ad8-823a-9726e140766f None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:40.592889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b63f4b-7225-4ad8-823a-9726e140766f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:40.592889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b63f4b-7225-4ad8-823a-9726e140766f None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:40.592889 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 683/1372] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:40.593217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67595245-1ae5-4475-8b60-9f4e419f8ac3 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:40.593217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67595245-1ae5-4475-8b60-9f4e419f8ac3 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:40.593217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67595245-1ae5-4475-8b60-9f4e419f8ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:40.656804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-67595245-1ae5-4475-8b60-9f4e419f8ac3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:40.658372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-67595245-1ae5-4475-8b60-9f4e419f8ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:40.772626 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 690/1373] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:41.091917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd78aa1-13a7-4875-9848-08c0b6706ef9 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:41.092372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd78aa1-13a7-4875-9848-08c0b6706ef9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:41.092729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd78aa1-13a7-4875-9848-08c0b6706ef9 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:41.094160 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 684/1374] 10.222.0.17 () {54 vars in 964 bytes} [Sat Jul 30 20:50:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:41.099571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb71cfb-3657-4d81-a1ba-41d542ff6349 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:41.099946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb71cfb-3657-4d81-a1ba-41d542ff6349 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:41.100297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb71cfb-3657-4d81-a1ba-41d542ff6349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:41.190131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-edb71cfb-3657-4d81-a1ba-41d542ff6349 None None] MFA Rules not processed for user `1656aa416bc146f486e71517e476773a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:41.191387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-edb71cfb-3657-4d81-a1ba-41d542ff6349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:41.214796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:41.276442 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 691/1375] 10.222.0.17 () {58 vars in 1061 bytes} [Sat Jul 30 20:50:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:41.285031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd78aa1-13a7-4875-9848-08c0b6706ef9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:50:41.287117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1fd78aa1-13a7-4875-9848-08c0b6706ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:41.427054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd78aa1-13a7-4875-9848-08c0b6706ef9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:50:41.432114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:41.511181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290bef1-0ba1-4b3b-a68b-ddd7bc8a83c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:50:41.511851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290bef1-0ba1-4b3b-a68b-ddd7bc8a83c9 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:41.512140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290bef1-0ba1-4b3b-a68b-ddd7bc8a83c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:41.512420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290bef1-0ba1-4b3b-a68b-ddd7bc8a83c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:41.514094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8290bef1-0ba1-4b3b-a68b-ddd7bc8a83c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:41.637173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290bef1-0ba1-4b3b-a68b-ddd7bc8a83c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:50:41.638630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290bef1-0ba1-4b3b-a68b-ddd7bc8a83c9 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:50:41.660654 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 685/1376] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:50:41.905575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23ee53-b1fc-4d9e-843f-e32c03e8abf8 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:41.906152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23ee53-b1fc-4d9e-843f-e32c03e8abf8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:41.906152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23ee53-b1fc-4d9e-843f-e32c03e8abf8 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:41.907400 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 692/1377] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:41.912821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae109db-7940-41f1-ac92-7ecd5fa3cb97 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:41.913116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae109db-7940-41f1-ac92-7ecd5fa3cb97 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:41.913427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae109db-7940-41f1-ac92-7ecd5fa3cb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:41.961339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:41.986083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7ae109db-7940-41f1-ac92-7ecd5fa3cb97 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:41.987321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7ae109db-7940-41f1-ac92-7ecd5fa3cb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:42.097030 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 686/1378] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:42.144017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23ee53-b1fc-4d9e-843f-e32c03e8abf8 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:50:42.145551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3d23ee53-b1fc-4d9e-843f-e32c03e8abf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:42.491767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23ee53-b1fc-4d9e-843f-e32c03e8abf8 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:50:42.491767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:42.513667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30b584-da89-4e2e-a4fb-3055a2ec113e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:50:42.515683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30b584-da89-4e2e-a4fb-3055a2ec113e service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:42.515683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30b584-da89-4e2e-a4fb-3055a2ec113e service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:42.515683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30b584-da89-4e2e-a4fb-3055a2ec113e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:42.518049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3e30b584-da89-4e2e-a4fb-3055a2ec113e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:42.670725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30b584-da89-4e2e-a4fb-3055a2ec113e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:50:42.672411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30b584-da89-4e2e-a4fb-3055a2ec113e service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:50:42.694891 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 693/1379] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:50:45.135984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb16d23-10e3-4c96-85de-336979f7e1e8 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:45.136578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb16d23-10e3-4c96-85de-336979f7e1e8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:45.136578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb16d23-10e3-4c96-85de-336979f7e1e8 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:45.137903 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 687/1380] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:45.143390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ad47e-d976-40c7-94a4-d7a48fb0b020 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:45.143850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ad47e-d976-40c7-94a4-d7a48fb0b020 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:45.143956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ad47e-d976-40c7-94a4-d7a48fb0b020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:45.185351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:45.211200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c70ad47e-d976-40c7-94a4-d7a48fb0b020 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:45.212452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c70ad47e-d976-40c7-94a4-d7a48fb0b020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:45.318431 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 694/1381] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:45.366437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb16d23-10e3-4c96-85de-336979f7e1e8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:50:45.367995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bcb16d23-10e3-4c96-85de-336979f7e1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:45.512341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:45.564105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb16d23-10e3-4c96-85de-336979f7e1e8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:50:45.695780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880dcfe-d8be-49de-a0d0-8bd3c655ca65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:50:45.696330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880dcfe-d8be-49de-a0d0-8bd3c655ca65 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:45.696608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880dcfe-d8be-49de-a0d0-8bd3c655ca65 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:45.696878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880dcfe-d8be-49de-a0d0-8bd3c655ca65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:45.699173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8880dcfe-d8be-49de-a0d0-8bd3c655ca65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:45.800420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:45.805448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880dcfe-d8be-49de-a0d0-8bd3c655ca65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:50:45.808422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880dcfe-d8be-49de-a0d0-8bd3c655ca65 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:50:45.829245 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 688/1382] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:50:48.111123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed760b85-7252-42d5-93bc-ffe7d1eb2e7d None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:48.111778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed760b85-7252-42d5-93bc-ffe7d1eb2e7d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:48.111778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed760b85-7252-42d5-93bc-ffe7d1eb2e7d None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:48.115347 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 695/1383] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:48.118500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c156c4-95a6-4407-9db0-a7c66359e9ea None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:48.118966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c156c4-95a6-4407-9db0-a7c66359e9ea None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:48.119051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c156c4-95a6-4407-9db0-a7c66359e9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:48.194017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e8c156c4-95a6-4407-9db0-a7c66359e9ea None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:48.195225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e8c156c4-95a6-4407-9db0-a7c66359e9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:48.302072 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 689/1384] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:48.347697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed760b85-7252-42d5-93bc-ffe7d1eb2e7d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:50:48.349311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ed760b85-7252-42d5-93bc-ffe7d1eb2e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:48.479505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:48.537624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed760b85-7252-42d5-93bc-ffe7d1eb2e7d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:50:48.668602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901d889-acff-489a-ac75-2feb737342ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:50:48.669229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901d889-acff-489a-ac75-2feb737342ee service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:48.669512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901d889-acff-489a-ac75-2feb737342ee service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:48.669794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901d889-acff-489a-ac75-2feb737342ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:48.671428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8901d889-acff-489a-ac75-2feb737342ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:48.761401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:48.779388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901d889-acff-489a-ac75-2feb737342ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:50:48.781949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901d889-acff-489a-ac75-2feb737342ee service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:50:48.799885 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 696/1385] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:50:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:50:51.506836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570af404-c405-45c4-9302-46aecf4300e7 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:51.507541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570af404-c405-45c4-9302-46aecf4300e7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:51.507809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570af404-c405-45c4-9302-46aecf4300e7 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:51.510674 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 690/1386] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:50:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:51.516234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4773e2-b5fb-44ff-9fe3-766d8c3c1356 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:51.516785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4773e2-b5fb-44ff-9fe3-766d8c3c1356 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:51.516785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4773e2-b5fb-44ff-9fe3-766d8c3c1356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:51.587949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3a4773e2-b5fb-44ff-9fe3-766d8c3c1356 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:51.589751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3a4773e2-b5fb-44ff-9fe3-766d8c3c1356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:51.699041 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 697/1387] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:51.755915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570af404-c405-45c4-9302-46aecf4300e7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:50:51.757655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-570af404-c405-45c4-9302-46aecf4300e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:51.818421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:51.941331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570af404-c405-45c4-9302-46aecf4300e7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:50:52.070223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5a4d5-1270-42cb-9493-ebd904e0a29a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:50:52.070845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5a4d5-1270-42cb-9493-ebd904e0a29a service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:52.071127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5a4d5-1270-42cb-9493-ebd904e0a29a service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:52.071439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5a4d5-1270-42cb-9493-ebd904e0a29a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:52.073067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fbc5a4d5-1270-42cb-9493-ebd904e0a29a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:52.085316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:52.171395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5a4d5-1270-42cb-9493-ebd904e0a29a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:50:52.173003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5a4d5-1270-42cb-9493-ebd904e0a29a service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:50:52.191592 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 691/1388] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:50:54.648258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044459ce-d75e-4360-9e7e-1df1812fd30e None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:54.648955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044459ce-d75e-4360-9e7e-1df1812fd30e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:54.648955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044459ce-d75e-4360-9e7e-1df1812fd30e None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:54.650165 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 698/1389] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:54.655866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb16048-6e05-4fe1-9f17-450bfaed1dda None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:54.656556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb16048-6e05-4fe1-9f17-450bfaed1dda None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:54.656556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb16048-6e05-4fe1-9f17-450bfaed1dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:54.733760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8eb16048-6e05-4fe1-9f17-450bfaed1dda None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:54.735240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8eb16048-6e05-4fe1-9f17-450bfaed1dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:54.837383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:54.851698 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 692/1390] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:54.906723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044459ce-d75e-4360-9e7e-1df1812fd30e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:50:54.908292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-044459ce-d75e-4360-9e7e-1df1812fd30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:54.970153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:55.073634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044459ce-d75e-4360-9e7e-1df1812fd30e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:50:55.190733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e901a-69f8-4fd9-89fd-90e767ae534f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:50:55.191275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e901a-69f8-4fd9-89fd-90e767ae534f service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:55.191580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e901a-69f8-4fd9-89fd-90e767ae534f service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:55.191860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e901a-69f8-4fd9-89fd-90e767ae534f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:55.193483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-da7e901a-69f8-4fd9-89fd-90e767ae534f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:55.205828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:55.306371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e901a-69f8-4fd9-89fd-90e767ae534f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:50:55.308840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e901a-69f8-4fd9-89fd-90e767ae534f service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:50:55.327540 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 699/1391] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:50:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:50:57.727243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1ea8d-1add-4618-8a0f-ee73e71295ba None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:57.727961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1ea8d-1add-4618-8a0f-ee73e71295ba None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:57.727961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1ea8d-1add-4618-8a0f-ee73e71295ba None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:57.729812 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 693/1392] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:50:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:57.730209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd8d63-27ba-49fd-b08a-738133098293 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:57.730657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd8d63-27ba-49fd-b08a-738133098293 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:57.730760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd8d63-27ba-49fd-b08a-738133098293 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:57.732198 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 700/1393] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:57.734867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805ab64-008f-4490-981f-67ca9dac8190 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:57.735162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805ab64-008f-4490-981f-67ca9dac8190 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:57.735476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805ab64-008f-4490-981f-67ca9dac8190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:57.737133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c6fce-71d0-488c-9162-5d095c4c503f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:57.737421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c6fce-71d0-488c-9162-5d095c4c503f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:57.737700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c6fce-71d0-488c-9162-5d095c4c503f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:57.801873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0805ab64-008f-4490-981f-67ca9dac8190 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:57.803095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0805ab64-008f-4490-981f-67ca9dac8190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:57.804964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1c1c6fce-71d0-488c-9162-5d095c4c503f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:57.806163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1c1c6fce-71d0-488c-9162-5d095c4c503f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:57.892335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:57.900011 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 694/1394] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:57.905852 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 701/1395] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 20:50:57.946240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805ab64-008f-4490-981f-67ca9dac8190 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:50:57.947637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0805ab64-008f-4490-981f-67ca9dac8190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:57.963421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1c6f0-c1eb-42e5-8a55-bbbc4ab92b35 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:57.964523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1c6f0-c1eb-42e5-8a55-bbbc4ab92b35 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:57.964815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1c6f0-c1eb-42e5-8a55-bbbc4ab92b35 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:57.966238 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 702/1396] 10.222.0.17 () {54 vars in 966 bytes} [Sat Jul 30 20:50:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:50:57.971268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf7e9f-f413-4045-8760-a1ccd9f18886 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:57.971583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf7e9f-f413-4045-8760-a1ccd9f18886 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:57.971897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf7e9f-f413-4045-8760-a1ccd9f18886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:58.027756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:58.052022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-dddf7e9f-f413-4045-8760-a1ccd9f18886 None None] MFA Rules not processed for user `60d1fa32e98f45128f990a107db45eae`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:58.053229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dddf7e9f-f413-4045-8760-a1ccd9f18886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:58.073297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805ab64-008f-4490-981f-67ca9dac8190 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:50:58.131000 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 703/1397] 10.222.0.17 () {58 vars in 1063 bytes} [Sat Jul 30 20:50:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:58.138528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf7e9f-f413-4045-8760-a1ccd9f18886 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:50:58.145953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf7e9f-f413-4045-8760-a1ccd9f18886 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:50:58.190416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc133285-d45a-4d02-90e7-7d10575b27d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:50:58.191034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc133285-d45a-4d02-90e7-7d10575b27d5 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:58.191347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc133285-d45a-4d02-90e7-7d10575b27d5 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:58.191623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc133285-d45a-4d02-90e7-7d10575b27d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:58.193239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cc133285-d45a-4d02-90e7-7d10575b27d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:58.221344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc83c62-633a-4771-b50a-8b868e8dd11c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:50:58.221972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc83c62-633a-4771-b50a-8b868e8dd11c service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:58.222256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc83c62-633a-4771-b50a-8b868e8dd11c service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:58.222538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc83c62-633a-4771-b50a-8b868e8dd11c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:58.224201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8cc83c62-633a-4771-b50a-8b868e8dd11c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:58.226599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:58.262518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:58.291526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc133285-d45a-4d02-90e7-7d10575b27d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:50:58.293118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc133285-d45a-4d02-90e7-7d10575b27d5 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:50:58.311519 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 695/1398] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:50:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:50:58.339446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc83c62-633a-4771-b50a-8b868e8dd11c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:50:58.341535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc83c62-633a-4771-b50a-8b868e8dd11c service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:50:58.363892 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 704/1399] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 20:50:58.955329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057efcf1-22f3-4897-b9ea-fb0faf59e7f9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:58.955797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057efcf1-22f3-4897-b9ea-fb0faf59e7f9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:58.955910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057efcf1-22f3-4897-b9ea-fb0faf59e7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:59.025430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-057efcf1-22f3-4897-b9ea-fb0faf59e7f9 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:59.026715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-057efcf1-22f3-4897-b9ea-fb0faf59e7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:59.112525 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 696/1400] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 20:50:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:59.159446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdccf9-4897-4af0-b4e1-4fa0c22a36f6 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:59.159920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdccf9-4897-4af0-b4e1-4fa0c22a36f6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:59.160142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdccf9-4897-4af0-b4e1-4fa0c22a36f6 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:59.161694 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 705/1401] 10.222.0.17 () {54 vars in 943 bytes} [Sat Jul 30 20:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:50:59.168647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f41f5-be2b-4c7e-892b-088cf7d61e6f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:59.168942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f41f5-be2b-4c7e-892b-088cf7d61e6f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:59.169222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f41f5-be2b-4c7e-892b-088cf7d61e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:59.239395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:59.249782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-715f41f5-be2b-4c7e-892b-088cf7d61e6f None None] MFA Rules not processed for user `2181960e3bed4031889d6e72a721e151`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:50:59.251012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-715f41f5-be2b-4c7e-892b-088cf7d61e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:59.361718 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 697/1402] 10.222.0.17 () {58 vars in 1040 bytes} [Sat Jul 30 20:50:59 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:50:59.371051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdccf9-4897-4af0-b4e1-4fa0c22a36f6 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:50:59.372646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-eabdccf9-4897-4af0-b4e1-4fa0c22a36f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:59.474795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:59.521211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdccf9-4897-4af0-b4e1-4fa0c22a36f6 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:50:59.626293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dec64-ca7f-4c91-b81c-3694592b4d31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:50:59.626824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dec64-ca7f-4c91-b81c-3694592b4d31 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:50:59.627104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dec64-ca7f-4c91-b81c-3694592b4d31 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:50:59.627411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dec64-ca7f-4c91-b81c-3694592b4d31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:50:59.629044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4b4dec64-ca7f-4c91-b81c-3694592b4d31 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:50:59.715403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dec64-ca7f-4c91-b81c-3694592b4d31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:50:59.717028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dec64-ca7f-4c91-b81c-3694592b4d31 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:50:59.726636 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 706/1403] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 20:50:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 20:51:00.632475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb2703-6620-4528-896d-eec504a50a34 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:00.633174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb2703-6620-4528-896d-eec504a50a34 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:00.633174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb2703-6620-4528-896d-eec504a50a34 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:00.635011 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 698/1404] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:51:00.640192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48d174-a9e2-4bc4-be91-7039a4167339 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:00.640698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48d174-a9e2-4bc4-be91-7039a4167339 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:00.640804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48d174-a9e2-4bc4-be91-7039a4167339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:00.646303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:00.734086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ae48d174-a9e2-4bc4-be91-7039a4167339 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:51:00.736152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ae48d174-a9e2-4bc4-be91-7039a4167339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:00.857840 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 707/1405] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:51:00.916531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb2703-6620-4528-896d-eec504a50a34 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:51:00.918078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-76fb2703-6620-4528-896d-eec504a50a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:01.054024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:01.097750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb2703-6620-4528-896d-eec504a50a34 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:51:01.221691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3cd72a-0854-4437-b809-fa27777806b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:51:01.222224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cd72a-0854-4437-b809-fa27777806b2 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:01.222508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cd72a-0854-4437-b809-fa27777806b2 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:01.222786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cd72a-0854-4437-b809-fa27777806b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:01.224475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ad3cd72a-0854-4437-b809-fa27777806b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:01.303004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:01.320454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3cd72a-0854-4437-b809-fa27777806b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:51:01.322788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3cd72a-0854-4437-b809-fa27777806b2 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:51:01.342934 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 699/1406] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:51:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:03.714424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbb9be-eedd-4799-bbde-ffe805006aac None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:03.715142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbb9be-eedd-4799-bbde-ffe805006aac None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:03.715257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbb9be-eedd-4799-bbde-ffe805006aac None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:03.717066 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 708/1407] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:51:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:51:03.722383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e98b96-3f35-4508-bdd6-0f36de975611 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:03.722888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e98b96-3f35-4508-bdd6-0f36de975611 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:03.722989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e98b96-3f35-4508-bdd6-0f36de975611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:03.797915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-82e98b96-3f35-4508-bdd6-0f36de975611 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:51:03.799124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-82e98b96-3f35-4508-bdd6-0f36de975611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:03.904572 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 700/1408] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:51:03.950694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbb9be-eedd-4799-bbde-ffe805006aac None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:51:03.952262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-83dbb9be-eedd-4799-bbde-ffe805006aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:04.049785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:04.136514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbb9be-eedd-4799-bbde-ffe805006aac None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:51:04.271614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d6127-5330-4bf8-aa10-862e76ab28f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:51:04.272239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d6127-5330-4bf8-aa10-862e76ab28f3 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:04.272516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d6127-5330-4bf8-aa10-862e76ab28f3 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:04.272839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d6127-5330-4bf8-aa10-862e76ab28f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:04.274641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2a6d6127-5330-4bf8-aa10-862e76ab28f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:04.334409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:04.382745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d6127-5330-4bf8-aa10-862e76ab28f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:51:04.384908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d6127-5330-4bf8-aa10-862e76ab28f3 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:51:04.403261 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 709/1409] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:13.902664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=77 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:14.400880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=25 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:23.094578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf47df5-3fa9-4fff-8841-6cf0ece5d9a9 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:23.095151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf47df5-3fa9-4fff-8841-6cf0ece5d9a9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:23.095151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf47df5-3fa9-4fff-8841-6cf0ece5d9a9 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:23.096532 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 701/1410] 10.222.0.17 () {54 vars in 918 bytes} [Sat Jul 30 20:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:51:23.101788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b7479-eadd-4802-aa05-e9f824df55cc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:23.102234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b7479-eadd-4802-aa05-e9f824df55cc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:23.102345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b7479-eadd-4802-aa05-e9f824df55cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:23.178003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-666b7479-eadd-4802-aa05-e9f824df55cc None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:51:23.179168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-666b7479-eadd-4802-aa05-e9f824df55cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:23.285927 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 710/1411] 10.222.0.17 () {58 vars in 1015 bytes} [Sat Jul 30 20:51:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:51:23.300680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c7103-7147-45ce-b5d0-8108dba96184 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:23.301071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c7103-7147-45ce-b5d0-8108dba96184 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:23.301435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c7103-7147-45ce-b5d0-8108dba96184 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:23.302795 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 702/1412] 10.222.0.17 () {54 vars in 918 bytes} [Sat Jul 30 20:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:51:23.308297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccf67b-4016-446e-b4dc-710615981026 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:23.308609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccf67b-4016-446e-b4dc-710615981026 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:23.308882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccf67b-4016-446e-b4dc-710615981026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:23.380096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:23.383138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f2ccf67b-4016-446e-b4dc-710615981026 None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:51:23.384919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f2ccf67b-4016-446e-b4dc-710615981026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:23.499205 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 711/1413] 10.222.0.17 () {58 vars in 1015 bytes} [Sat Jul 30 20:51:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 20:51:26.246874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46572348-be29-4489-b92d-1b3c732ba349 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:26.247470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46572348-be29-4489-b92d-1b3c732ba349 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:26.247470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46572348-be29-4489-b92d-1b3c732ba349 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:26.249115 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 30 20:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:51:26.254231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7ce4f-d57e-4f45-9acd-0195182e3316 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:26.254694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7ce4f-d57e-4f45-9acd-0195182e3316 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:26.254810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7ce4f-d57e-4f45-9acd-0195182e3316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:26.321865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-80b7ce4f-d57e-4f45-9acd-0195182e3316 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:51:26.323082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-80b7ce4f-d57e-4f45-9acd-0195182e3316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:26.381054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:26.423589 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 30 20:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:51:26.468354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46572348-be29-4489-b92d-1b3c732ba349 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:51:26.470330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-46572348-be29-4489-b92d-1b3c732ba349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:26.621499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46572348-be29-4489-b92d-1b3c732ba349 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:51:26.698213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:26.740174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e5253-b028-4f1c-9a7e-1f6f3d9998e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:51:26.740801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e5253-b028-4f1c-9a7e-1f6f3d9998e6 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:26.741088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e5253-b028-4f1c-9a7e-1f6f3d9998e6 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:26.741369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e5253-b028-4f1c-9a7e-1f6f3d9998e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:26.743045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-293e5253-b028-4f1c-9a7e-1f6f3d9998e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:26.831555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e5253-b028-4f1c-9a7e-1f6f3d9998e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:51:26.833149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e5253-b028-4f1c-9a7e-1f6f3d9998e6 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:51:26.851454 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 704/1416] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:27.811447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da6510-3bec-47a6-bd2b-114a5a7ca979 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:27.812030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da6510-3bec-47a6-bd2b-114a5a7ca979 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:27.812030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da6510-3bec-47a6-bd2b-114a5a7ca979 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:27.813425 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 30 20:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:51:27.818393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cefd0-5fcf-43ae-b5b8-79b2450c6e8f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:27.818842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cefd0-5fcf-43ae-b5b8-79b2450c6e8f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:27.818958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cefd0-5fcf-43ae-b5b8-79b2450c6e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:27.894654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-306cefd0-5fcf-43ae-b5b8-79b2450c6e8f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:51:27.895883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-306cefd0-5fcf-43ae-b5b8-79b2450c6e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:27.923039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:27.999388 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 30 20:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 20:51:28.211095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da6510-3bec-47a6-bd2b-114a5a7ca979 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:51:28.213353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-26da6510-3bec-47a6-bd2b-114a5a7ca979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:28.365355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da6510-3bec-47a6-bd2b-114a5a7ca979 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:51:28.405399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:28.480689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176e987-2bf3-4ace-a033-dacdb4cb2547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:51:28.481234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176e987-2bf3-4ace-a033-dacdb4cb2547 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:28.481516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176e987-2bf3-4ace-a033-dacdb4cb2547 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:28.481788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176e987-2bf3-4ace-a033-dacdb4cb2547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:28.483440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e176e987-2bf3-4ace-a033-dacdb4cb2547 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:28.574751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176e987-2bf3-4ace-a033-dacdb4cb2547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:51:28.576631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176e987-2bf3-4ace-a033-dacdb4cb2547 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:51:28.594793 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 714/1419] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:29.497279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4119b-100c-4333-9711-fcd0586696b2 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:29.497816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4119b-100c-4333-9711-fcd0586696b2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:29.497816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4119b-100c-4333-9711-fcd0586696b2 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:29.499365 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 30 20:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:51:29.504328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8a9d8-2bcc-410c-919a-6a11534ffb24 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:29.504757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8a9d8-2bcc-410c-919a-6a11534ffb24 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:29.504889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8a9d8-2bcc-410c-919a-6a11534ffb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:29.560257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:29.582508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-53b8a9d8-2bcc-410c-919a-6a11534ffb24 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:51:29.583775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-53b8a9d8-2bcc-410c-919a-6a11534ffb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:29.688894 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 30 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:51:29.846179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4119b-100c-4333-9711-fcd0586696b2 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:51:29.847773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b8b4119b-100c-4333-9711-fcd0586696b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:29.995577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4119b-100c-4333-9711-fcd0586696b2 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:51:30.008438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:30.113915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725206c-8de7-41aa-992d-54d8e6355e9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:51:30.114437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725206c-8de7-41aa-992d-54d8e6355e9c service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:30.114720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725206c-8de7-41aa-992d-54d8e6355e9c service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:30.114996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725206c-8de7-41aa-992d-54d8e6355e9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:30.116686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3725206c-8de7-41aa-992d-54d8e6355e9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:30.203992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725206c-8de7-41aa-992d-54d8e6355e9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:51:30.205611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725206c-8de7-41aa-992d-54d8e6355e9c service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:51:30.223723 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 707/1422] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:31.113470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2a163-6f79-42c0-9a9e-b66a9fae98a9 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:31.114041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2a163-6f79-42c0-9a9e-b66a9fae98a9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:31.114041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2a163-6f79-42c0-9a9e-b66a9fae98a9 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:31.115379 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 30 20:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:51:31.120915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b6f4f-9187-48ec-a451-ed683e5512a1 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:31.121367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b6f4f-9187-48ec-a451-ed683e5512a1 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:31.121465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b6f4f-9187-48ec-a451-ed683e5512a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:31.142166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:31.198120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-656b6f4f-9187-48ec-a451-ed683e5512a1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:51:31.199242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-656b6f4f-9187-48ec-a451-ed683e5512a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:31.295527 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 30 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:51:31.458133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2a163-6f79-42c0-9a9e-b66a9fae98a9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:51:31.459606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cfe2a163-6f79-42c0-9a9e-b66a9fae98a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:31.569376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:31.606482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2a163-6f79-42c0-9a9e-b66a9fae98a9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:51:31.724188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782003a-6f05-41e3-9961-968ecbf50873 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:51:31.724733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782003a-6f05-41e3-9961-968ecbf50873 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:31.725013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782003a-6f05-41e3-9961-968ecbf50873 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:31.725284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782003a-6f05-41e3-9961-968ecbf50873 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:31.726885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c782003a-6f05-41e3-9961-968ecbf50873 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:31.801376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:31.814855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782003a-6f05-41e3-9961-968ecbf50873 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:51:31.816467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782003a-6f05-41e3-9961-968ecbf50873 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:51:31.834309 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 717/1425] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:32.695568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05796ed-c519-4881-a476-bfb7942fcdde None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:32.696109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05796ed-c519-4881-a476-bfb7942fcdde None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:32.696109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05796ed-c519-4881-a476-bfb7942fcdde None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:32.697393 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 30 20:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:51:32.702436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99714fa1-3404-439c-9920-c613ffb3170d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:32.702844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99714fa1-3404-439c-9920-c613ffb3170d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:32.702980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99714fa1-3404-439c-9920-c613ffb3170d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:32.779428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-99714fa1-3404-439c-9920-c613ffb3170d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:51:32.780647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-99714fa1-3404-439c-9920-c613ffb3170d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:32.877360 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 30 20:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:51:33.037716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05796ed-c519-4881-a476-bfb7942fcdde None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:51:33.039235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b05796ed-c519-4881-a476-bfb7942fcdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:33.121843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:33.182370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05796ed-c519-4881-a476-bfb7942fcdde None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:51:33.292874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd53247-263e-46f1-9a99-845628129318 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:51:33.293422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd53247-263e-46f1-9a99-845628129318 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:33.293708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd53247-263e-46f1-9a99-845628129318 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:33.293985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd53247-263e-46f1-9a99-845628129318 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:33.295631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1fd53247-263e-46f1-9a99-845628129318 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:33.344605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:33.391713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd53247-263e-46f1-9a99-845628129318 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:51:33.393311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd53247-263e-46f1-9a99-845628129318 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:51:33.411212 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 710/1428] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:51:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:34.238667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9bf04-48d5-482f-b2ba-73a92136d333 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:34.239132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9bf04-48d5-482f-b2ba-73a92136d333 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:34.239243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9bf04-48d5-482f-b2ba-73a92136d333 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:34.240602 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 30 20:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:51:34.246256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab88fc-282a-4152-ac8d-0c46d2f6e45d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:34.246657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab88fc-282a-4152-ac8d-0c46d2f6e45d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:34.246823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab88fc-282a-4152-ac8d-0c46d2f6e45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:34.322473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bdab88fc-282a-4152-ac8d-0c46d2f6e45d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:51:34.323731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bdab88fc-282a-4152-ac8d-0c46d2f6e45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:34.419606 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 30 20:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:51:34.578729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9bf04-48d5-482f-b2ba-73a92136d333 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:51:34.580314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e0b9bf04-48d5-482f-b2ba-73a92136d333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:34.629503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:34.726283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9bf04-48d5-482f-b2ba-73a92136d333 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:51:34.838900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57733ad-84d5-4be3-a310-d0949b7cd183 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:51:34.839467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57733ad-84d5-4be3-a310-d0949b7cd183 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:34.839752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57733ad-84d5-4be3-a310-d0949b7cd183 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:34.840025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57733ad-84d5-4be3-a310-d0949b7cd183 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:34.841623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a57733ad-84d5-4be3-a310-d0949b7cd183 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:34.848361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:34.930325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57733ad-84d5-4be3-a310-d0949b7cd183 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:51:34.931954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57733ad-84d5-4be3-a310-d0949b7cd183 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:51:34.949896 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 720/1431] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:35.760785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c0860-0db5-449c-8a79-0acef0859045 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:35.761357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c0860-0db5-449c-8a79-0acef0859045 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:35.761357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c0860-0db5-449c-8a79-0acef0859045 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:35.762671 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 30 20:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:51:35.767742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbbdfb-d238-4b09-8156-d7c085f981b9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:35.768214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbbdfb-d238-4b09-8156-d7c085f981b9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:35.768313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbbdfb-d238-4b09-8156-d7c085f981b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:35.843500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ffdbbdfb-d238-4b09-8156-d7c085f981b9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:51:35.844697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ffdbbdfb-d238-4b09-8156-d7c085f981b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:35.910940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:35.939747 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 30 20:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:51:36.098758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c0860-0db5-449c-8a79-0acef0859045 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:51:36.100313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6c6c0860-0db5-449c-8a79-0acef0859045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:36.118385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:36.245552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c0860-0db5-449c-8a79-0acef0859045 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:51:36.330960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:36.361382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec2bd1-60f3-4671-845e-6ed66d61667d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:51:36.361944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec2bd1-60f3-4671-845e-6ed66d61667d service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:36.362226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec2bd1-60f3-4671-845e-6ed66d61667d service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:36.362499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec2bd1-60f3-4671-845e-6ed66d61667d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:36.364139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5cec2bd1-60f3-4671-845e-6ed66d61667d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:36.452447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec2bd1-60f3-4671-845e-6ed66d61667d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:51:36.454030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec2bd1-60f3-4671-845e-6ed66d61667d service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:51:36.472111 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 713/1434] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:37.298672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c1326-5a18-4ad1-b943-a2ee079cc95a None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:37.299196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c1326-5a18-4ad1-b943-a2ee079cc95a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:37.299196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c1326-5a18-4ad1-b943-a2ee079cc95a None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:37.300511 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 30 20:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:51:37.305943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82764eab-bb1e-4d8b-902c-f747787e5a28 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:37.306353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82764eab-bb1e-4d8b-902c-f747787e5a28 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:37.306510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82764eab-bb1e-4d8b-902c-f747787e5a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:37.382155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-82764eab-bb1e-4d8b-902c-f747787e5a28 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:51:37.383461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-82764eab-bb1e-4d8b-902c-f747787e5a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:37.425025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:37.480757 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 30 20:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:51:37.640319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c1326-5a18-4ad1-b943-a2ee079cc95a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:51:37.641846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6b5c1326-5a18-4ad1-b943-a2ee079cc95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:37.796126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c1326-5a18-4ad1-b943-a2ee079cc95a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:51:37.854703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:37.920151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96789b-c10f-430f-a8df-16674b9e8143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:51:37.920703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96789b-c10f-430f-a8df-16674b9e8143 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:37.920988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96789b-c10f-430f-a8df-16674b9e8143 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:37.921265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96789b-c10f-430f-a8df-16674b9e8143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:37.922914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1b96789b-c10f-430f-a8df-16674b9e8143 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:38.014258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96789b-c10f-430f-a8df-16674b9e8143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:51:38.015907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96789b-c10f-430f-a8df-16674b9e8143 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:51:38.034374 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 723/1437] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:38.840474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17e225-bcc8-4cd4-9867-c88a1fbc8f03 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:38.841046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17e225-bcc8-4cd4-9867-c88a1fbc8f03 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:38.841046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17e225-bcc8-4cd4-9867-c88a1fbc8f03 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:38.842457 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 30 20:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:51:38.847380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1043a-39df-4937-aaa9-de6b1a4d9206 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:38.847815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1043a-39df-4937-aaa9-de6b1a4d9206 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:38.847996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1043a-39df-4937-aaa9-de6b1a4d9206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:38.931866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-85c1043a-39df-4937-aaa9-de6b1a4d9206 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:51:38.933081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-85c1043a-39df-4937-aaa9-de6b1a4d9206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:38.935097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:39.029863 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 30 20:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:51:39.189561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17e225-bcc8-4cd4-9867-c88a1fbc8f03 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:51:39.191020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cc17e225-bcc8-4cd4-9867-c88a1fbc8f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:39.334677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17e225-bcc8-4cd4-9867-c88a1fbc8f03 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:51:39.362018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:39.453104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e2052-6aa4-4ad6-b832-5d0fa73d1998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:51:39.453639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e2052-6aa4-4ad6-b832-5d0fa73d1998 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:39.453920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e2052-6aa4-4ad6-b832-5d0fa73d1998 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:39.454195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e2052-6aa4-4ad6-b832-5d0fa73d1998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:39.455851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-862e2052-6aa4-4ad6-b832-5d0fa73d1998 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:39.544295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e2052-6aa4-4ad6-b832-5d0fa73d1998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:51:39.545887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e2052-6aa4-4ad6-b832-5d0fa73d1998 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:51:39.563859 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 716/1440] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:41.667071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe4412-925a-4bfc-9776-015508180def None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:41.667683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe4412-925a-4bfc-9776-015508180def None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:41.667683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe4412-925a-4bfc-9776-015508180def None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:41.669043 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 30 20:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:51:41.674530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf241e-c0e6-4497-9fd4-43612536a28c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:41.674952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf241e-c0e6-4497-9fd4-43612536a28c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:41.675087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf241e-c0e6-4497-9fd4-43612536a28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:41.717500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:41.754084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-fdcf241e-c0e6-4497-9fd4-43612536a28c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:51:41.755351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fdcf241e-c0e6-4497-9fd4-43612536a28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:41.851778 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 30 20:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:51:41.892209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe4412-925a-4bfc-9776-015508180def None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:51:41.893747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e6fe4412-925a-4bfc-9776-015508180def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:41.994915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe4412-925a-4bfc-9776-015508180def None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:51:42.030498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:42.087496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9716017-b800-4a12-9225-38f881bb979f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:51:42.088125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9716017-b800-4a12-9225-38f881bb979f service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:42.088411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9716017-b800-4a12-9225-38f881bb979f service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:42.088686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9716017-b800-4a12-9225-38f881bb979f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:42.090323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d9716017-b800-4a12-9225-38f881bb979f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:42.203370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9716017-b800-4a12-9225-38f881bb979f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:51:42.204755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9716017-b800-4a12-9225-38f881bb979f service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:51:42.224883 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 726/1443] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:44.713291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91d94-a6a5-4d38-b908-0bfc1219bdf7 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:44.713876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91d94-a6a5-4d38-b908-0bfc1219bdf7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:44.713876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91d94-a6a5-4d38-b908-0bfc1219bdf7 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:44.715201 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 30 20:51:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:51:44.720551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1c58d-06b1-4d11-a4c5-c2d1219ed14a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:44.720956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1c58d-06b1-4d11-a4c5-c2d1219ed14a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:44.721102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1c58d-06b1-4d11-a4c5-c2d1219ed14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:44.791179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a7d1c58d-06b1-4d11-a4c5-c2d1219ed14a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:51:44.792443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a7d1c58d-06b1-4d11-a4c5-c2d1219ed14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:44.805742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:44.889491 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 30 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:51:44.928972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae91d94-a6a5-4d38-b908-0bfc1219bdf7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:51:44.931157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6ae91d94-a6a5-4d38-b908-0bfc1219bdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:45.034790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae91d94-a6a5-4d38-b908-0bfc1219bdf7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:51:45.047492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:45.111280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38184b0-e306-4581-b7e1-3d83ce24e554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:51:45.111929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38184b0-e306-4581-b7e1-3d83ce24e554 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:45.112212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38184b0-e306-4581-b7e1-3d83ce24e554 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:45.112486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38184b0-e306-4581-b7e1-3d83ce24e554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:45.114118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d38184b0-e306-4581-b7e1-3d83ce24e554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:45.229883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38184b0-e306-4581-b7e1-3d83ce24e554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:51:45.231350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38184b0-e306-4581-b7e1-3d83ce24e554 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:51:45.249519 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 719/1446] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:47.808091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfd51b-3824-4dc8-992f-d680f7f423ed None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:47.808668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfd51b-3824-4dc8-992f-d680f7f423ed None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:47.808668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfd51b-3824-4dc8-992f-d680f7f423ed None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:47.810037 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 30 20:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:51:47.815266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876c2ec-26c8-4064-8343-27a168ada5a7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:47.815757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876c2ec-26c8-4064-8343-27a168ada5a7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:47.815866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876c2ec-26c8-4064-8343-27a168ada5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:47.864842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:47.884032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3876c2ec-26c8-4064-8343-27a168ada5a7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:51:47.885233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3876c2ec-26c8-4064-8343-27a168ada5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:47.980646 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 30 20:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 20:51:48.020492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfd51b-3824-4dc8-992f-d680f7f423ed None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:51:48.022010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-68cfd51b-3824-4dc8-992f-d680f7f423ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:48.125389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfd51b-3824-4dc8-992f-d680f7f423ed None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:51:48.165431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:48.198439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a15b12-4da1-4ada-864b-b63baf75e621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:51:48.199054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a15b12-4da1-4ada-864b-b63baf75e621 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:48.199363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a15b12-4da1-4ada-864b-b63baf75e621 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:48.199642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a15b12-4da1-4ada-864b-b63baf75e621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:48.201244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b7a15b12-4da1-4ada-864b-b63baf75e621 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:48.310116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a15b12-4da1-4ada-864b-b63baf75e621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:51:48.311596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a15b12-4da1-4ada-864b-b63baf75e621 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:51:48.330102 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 729/1449] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:50.707669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3b4dc-1e01-4bbd-940e-c1dfcbfbc645 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:50.708204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3b4dc-1e01-4bbd-940e-c1dfcbfbc645 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:50.708204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3b4dc-1e01-4bbd-940e-c1dfcbfbc645 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:50.709503 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 30 20:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:51:50.715423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d68e58-6494-429f-8e57-f306e6584388 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:50.715857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d68e58-6494-429f-8e57-f306e6584388 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:50.716008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d68e58-6494-429f-8e57-f306e6584388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:50.782805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-40d68e58-6494-429f-8e57-f306e6584388 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:51:50.784033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-40d68e58-6494-429f-8e57-f306e6584388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:50.804369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:50.880775 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 30 20:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:51:50.921841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3b4dc-1e01-4bbd-940e-c1dfcbfbc645 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:51:50.923425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b8f3b4dc-1e01-4bbd-940e-c1dfcbfbc645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:51.026066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3b4dc-1e01-4bbd-940e-c1dfcbfbc645 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:51:51.045820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:51.099090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f70a6-1fe2-4d02-882c-329b590d03f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:51:51.099746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f70a6-1fe2-4d02-882c-329b590d03f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:51.100036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f70a6-1fe2-4d02-882c-329b590d03f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:51.100313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f70a6-1fe2-4d02-882c-329b590d03f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:51.102538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c35f70a6-1fe2-4d02-882c-329b590d03f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:51.215946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f70a6-1fe2-4d02-882c-329b590d03f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:51:51.217419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f70a6-1fe2-4d02-882c-329b590d03f5 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:51:51.235424 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 722/1452] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:53.592499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed8e5c-5c9a-4683-8cae-d8f1266a88cb None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:53.593051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed8e5c-5c9a-4683-8cae-d8f1266a88cb None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:53.593051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed8e5c-5c9a-4683-8cae-d8f1266a88cb None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:53.594428 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 30 20:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:51:53.599984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1537624-f336-4f7e-aa37-0748263e2350 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:53.600429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1537624-f336-4f7e-aa37-0748263e2350 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:53.600535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1537624-f336-4f7e-aa37-0748263e2350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:53.666329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:53.669210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e1537624-f336-4f7e-aa37-0748263e2350 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:51:53.671044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e1537624-f336-4f7e-aa37-0748263e2350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:53.767638 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 30 20:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:51:53.807498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed8e5c-5c9a-4683-8cae-d8f1266a88cb None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:51:53.809073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-10ed8e5c-5c9a-4683-8cae-d8f1266a88cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:53.914325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed8e5c-5c9a-4683-8cae-d8f1266a88cb None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:51:53.962265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:53.986531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48b1c5-0ac2-46c6-806d-deda233a72f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:51:53.987147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48b1c5-0ac2-46c6-806d-deda233a72f7 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:53.987462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48b1c5-0ac2-46c6-806d-deda233a72f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:53.987738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48b1c5-0ac2-46c6-806d-deda233a72f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:53.989343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0b48b1c5-0ac2-46c6-806d-deda233a72f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:54.098278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48b1c5-0ac2-46c6-806d-deda233a72f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:51:54.099786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48b1c5-0ac2-46c6-806d-deda233a72f7 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:51:54.118134 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 732/1455] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:56.396121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011c100-5a15-4cec-bdb0-591ff7102996 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:56.396701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011c100-5a15-4cec-bdb0-591ff7102996 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:56.396701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011c100-5a15-4cec-bdb0-591ff7102996 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:56.398013 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 30 20:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:51:56.403746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46518ce2-37dd-4d30-8622-52307824bc53 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:56.404164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46518ce2-37dd-4d30-8622-52307824bc53 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:56.404309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46518ce2-37dd-4d30-8622-52307824bc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:56.470575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-46518ce2-37dd-4d30-8622-52307824bc53 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:51:56.471818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-46518ce2-37dd-4d30-8622-52307824bc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:56.501160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:56.570180 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 30 20:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:51:56.610464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011c100-5a15-4cec-bdb0-591ff7102996 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:51:56.611998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e011c100-5a15-4cec-bdb0-591ff7102996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:56.716806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011c100-5a15-4cec-bdb0-591ff7102996 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:51:56.744184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:56.789262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9966205-ff3a-4eee-97d4-7143d559a404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:51:56.789869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9966205-ff3a-4eee-97d4-7143d559a404 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:56.790148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9966205-ff3a-4eee-97d4-7143d559a404 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:56.790420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9966205-ff3a-4eee-97d4-7143d559a404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:56.792059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d9966205-ff3a-4eee-97d4-7143d559a404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:56.904330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9966205-ff3a-4eee-97d4-7143d559a404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:51:56.905662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9966205-ff3a-4eee-97d4-7143d559a404 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:51:56.923358 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 725/1458] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:51:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:59.231602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c1c71-15f3-4874-83a6-caeda336c5d1 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:59.232108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c1c71-15f3-4874-83a6-caeda336c5d1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:59.232228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c1c71-15f3-4874-83a6-caeda336c5d1 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:59.233503 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 30 20:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:51:59.238790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d4587-b058-4df1-aaec-ea0935e10c2f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:59.239210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d4587-b058-4df1-aaec-ea0935e10c2f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:59.239425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d4587-b058-4df1-aaec-ea0935e10c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:59.306110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f86d4587-b058-4df1-aaec-ea0935e10c2f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:51:59.307261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f86d4587-b058-4df1-aaec-ea0935e10c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:59.315615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:59.405446 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 30 20:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:51:59.444321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c1c71-15f3-4874-83a6-caeda336c5d1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:51:59.445851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8c6c1c71-15f3-4874-83a6-caeda336c5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:59.549168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c1c71-15f3-4874-83a6-caeda336c5d1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:51:59.603818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:59.622151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6602e8c-ae80-4300-8742-69ac612eb149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:51:59.622772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6602e8c-ae80-4300-8742-69ac612eb149 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:51:59.623327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6602e8c-ae80-4300-8742-69ac612eb149 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:51:59.623611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6602e8c-ae80-4300-8742-69ac612eb149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:51:59.625238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c6602e8c-ae80-4300-8742-69ac612eb149 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:51:59.732844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6602e8c-ae80-4300-8742-69ac612eb149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:51:59.734284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6602e8c-ae80-4300-8742-69ac612eb149 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:51:59.752883 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 735/1461] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:51:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:52:02.064831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a452ace-99bb-4fb2-9edf-7a39a58a12cf None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:02.065375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a452ace-99bb-4fb2-9edf-7a39a58a12cf None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:02.065472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a452ace-99bb-4fb2-9edf-7a39a58a12cf None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:02.066763 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 30 20:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:52:02.072027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4e8ca-6ba5-423b-8dad-188fa97a8921 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:02.072479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4e8ca-6ba5-423b-8dad-188fa97a8921 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:02.072581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4e8ca-6ba5-423b-8dad-188fa97a8921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:02.138462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5ef4e8ca-6ba5-423b-8dad-188fa97a8921 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:52:02.139752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5ef4e8ca-6ba5-423b-8dad-188fa97a8921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:02.180241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:02.239881 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 30 20:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:52:02.279699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a452ace-99bb-4fb2-9edf-7a39a58a12cf None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:52:02.281234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5a452ace-99bb-4fb2-9edf-7a39a58a12cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:02.385439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a452ace-99bb-4fb2-9edf-7a39a58a12cf None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:52:02.422086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:02.457676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dcfdc-e472-4af2-983c-69f90db4ad42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:52:02.458290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dcfdc-e472-4af2-983c-69f90db4ad42 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:02.458580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dcfdc-e472-4af2-983c-69f90db4ad42 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:02.458852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dcfdc-e472-4af2-983c-69f90db4ad42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:02.460511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f55dcfdc-e472-4af2-983c-69f90db4ad42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:02.568593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dcfdc-e472-4af2-983c-69f90db4ad42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:52:02.570033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dcfdc-e472-4af2-983c-69f90db4ad42 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:52:02.588536 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 728/1464] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:52:04.854941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f543c2-59bc-49fe-9223-050409fcd76a None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:04.855679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f543c2-59bc-49fe-9223-050409fcd76a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:04.855679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f543c2-59bc-49fe-9223-050409fcd76a None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:04.856869 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 30 20:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:52:04.862198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a026f-8089-411d-a39c-75497d7fce78 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:04.862670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a026f-8089-411d-a39c-75497d7fce78 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:04.862782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a026f-8089-411d-a39c-75497d7fce78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:04.929864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-776a026f-8089-411d-a39c-75497d7fce78 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:52:04.931086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-776a026f-8089-411d-a39c-75497d7fce78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:04.954917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:05.034874 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 30 20:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:52:05.073600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f543c2-59bc-49fe-9223-050409fcd76a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:52:05.075133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c9f543c2-59bc-49fe-9223-050409fcd76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:05.178759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f543c2-59bc-49fe-9223-050409fcd76a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:52:05.245558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:05.253262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54456a8d-c852-469c-98b5-2479d45e9747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:52:05.253884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54456a8d-c852-469c-98b5-2479d45e9747 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:05.254171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54456a8d-c852-469c-98b5-2479d45e9747 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:05.254448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54456a8d-c852-469c-98b5-2479d45e9747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:05.256115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-54456a8d-c852-469c-98b5-2479d45e9747 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:05.364521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54456a8d-c852-469c-98b5-2479d45e9747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:52:05.365958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54456a8d-c852-469c-98b5-2479d45e9747 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:52:05.384214 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 738/1467] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:52:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:52:07.652798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15960ba-3636-48e3-a620-7a9b7f95ff7d None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:07.653376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15960ba-3636-48e3-a620-7a9b7f95ff7d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:07.653376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15960ba-3636-48e3-a620-7a9b7f95ff7d None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:07.654720 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 30 20:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:52:07.660035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64729fc0-a936-40d3-a505-e7c7b48a98f5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:07.660490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64729fc0-a936-40d3-a505-e7c7b48a98f5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:07.660600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64729fc0-a936-40d3-a505-e7c7b48a98f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:07.731781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-64729fc0-a936-40d3-a505-e7c7b48a98f5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:52:07.732990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-64729fc0-a936-40d3-a505-e7c7b48a98f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:07.781658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:07.830620 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 30 20:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:52:07.869142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15960ba-3636-48e3-a620-7a9b7f95ff7d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:52:07.870982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e15960ba-3636-48e3-a620-7a9b7f95ff7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:07.983929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15960ba-3636-48e3-a620-7a9b7f95ff7d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:52:08.034396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:08.061798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd3da7-b55d-4517-ba2d-44d7a3c7acf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:52:08.062421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd3da7-b55d-4517-ba2d-44d7a3c7acf3 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:08.062708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd3da7-b55d-4517-ba2d-44d7a3c7acf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:08.062988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd3da7-b55d-4517-ba2d-44d7a3c7acf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:08.064667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a2bd3da7-b55d-4517-ba2d-44d7a3c7acf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:08.172485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd3da7-b55d-4517-ba2d-44d7a3c7acf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:52:08.173967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd3da7-b55d-4517-ba2d-44d7a3c7acf3 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:52:08.192500 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 731/1470] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:52:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:52:17.828823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=22 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:18.190213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=66 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:32.134991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a850b4d-e05d-4983-801c-a96aac49d9c4 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:32.135591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a850b4d-e05d-4983-801c-a96aac49d9c4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:32.135899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a850b4d-e05d-4983-801c-a96aac49d9c4 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:32.138172 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 740/1471] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:52:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 20:52:32.143545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8ad89-9ff4-440a-8e73-759a1c8205d4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:32.143978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8ad89-9ff4-440a-8e73-759a1c8205d4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:32.144094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8ad89-9ff4-440a-8e73-759a1c8205d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:32.211058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a8f8ad89-9ff4-440a-8e73-759a1c8205d4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:52:32.212290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a8f8ad89-9ff4-440a-8e73-759a1c8205d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:32.307902 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 732/1472] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:52:32.355697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d542d4-8f40-40c2-be84-77a55cef331f None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:32.355983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d542d4-8f40-40c2-be84-77a55cef331f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:32.356255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d542d4-8f40-40c2-be84-77a55cef331f None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:32.357576 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 741/1473] 10.222.0.17 () {54 vars in 966 bytes} [Sat Jul 30 20:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:52:32.362328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee016f-280d-4eff-937f-8fe13c10e435 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:32.362625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee016f-280d-4eff-937f-8fe13c10e435 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:32.362906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee016f-280d-4eff-937f-8fe13c10e435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:32.439240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-fcee016f-280d-4eff-937f-8fe13c10e435 None None] MFA Rules not processed for user `60d1fa32e98f45128f990a107db45eae`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:52:32.440412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fcee016f-280d-4eff-937f-8fe13c10e435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:32.461281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:32.520215 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 733/1474] 10.222.0.17 () {58 vars in 1063 bytes} [Sat Jul 30 20:52:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:52:32.527926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d542d4-8f40-40c2-be84-77a55cef331f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:52:32.529504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b1d542d4-8f40-40c2-be84-77a55cef331f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:32.633398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d542d4-8f40-40c2-be84-77a55cef331f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:52:32.707118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31412ebe-1eb4-4b91-90b8-58da7465118f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:52:32.707705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31412ebe-1eb4-4b91-90b8-58da7465118f service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:32.707994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31412ebe-1eb4-4b91-90b8-58da7465118f service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:32.708272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31412ebe-1eb4-4b91-90b8-58da7465118f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:32.710451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-31412ebe-1eb4-4b91-90b8-58da7465118f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:32.764821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:32.821470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31412ebe-1eb4-4b91-90b8-58da7465118f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:52:32.823417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31412ebe-1eb4-4b91-90b8-58da7465118f service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:52:32.842478 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 742/1475] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:52:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:52:35.201332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776879db-64fe-458d-8792-1e3bf50a6ed9 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:35.201947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776879db-64fe-458d-8792-1e3bf50a6ed9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:35.201947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776879db-64fe-458d-8792-1e3bf50a6ed9 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:35.204009 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 734/1476] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:52:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:52:35.209326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739cbf2-ec85-49bc-86cd-53522f19eb3e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:35.210405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739cbf2-ec85-49bc-86cd-53522f19eb3e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:35.210520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739cbf2-ec85-49bc-86cd-53522f19eb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:35.276702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c739cbf2-ec85-49bc-86cd-53522f19eb3e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:52:35.277841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c739cbf2-ec85-49bc-86cd-53522f19eb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:35.388771 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 743/1477] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:52:35.413123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776879db-64fe-458d-8792-1e3bf50a6ed9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:52:35.414657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-776879db-64fe-458d-8792-1e3bf50a6ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:35.542100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776879db-64fe-458d-8792-1e3bf50a6ed9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:52:35.591616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:35.637872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709b639-b37c-4786-9f48-943369b4fe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:52:35.638490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709b639-b37c-4786-9f48-943369b4fe48 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:35.638768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709b639-b37c-4786-9f48-943369b4fe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:35.639039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709b639-b37c-4786-9f48-943369b4fe48 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:35.639764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709b639-b37c-4786-9f48-943369b4fe48 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:52:35.641572 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-1709b639-b37c-4786-9f48-943369b4fe48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 20:52:35.641572 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 20:52:35.641572 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 20:52:35.642715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709b639-b37c-4786-9f48-943369b4fe48 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:52:35.662294 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 735/1478] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 30 20:52:35 2022] GET /identity/v3/projects => generated 2553 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 20:52:37.925492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418603d-df84-4900-9ea8-1c1cbcede93f None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:37.926080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418603d-df84-4900-9ea8-1c1cbcede93f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:37.926080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418603d-df84-4900-9ea8-1c1cbcede93f None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:37.927484 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 744/1479] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:52:37.933024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceede65a-c7ba-4e94-834d-9c0aa65df6d1 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:37.933489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceede65a-c7ba-4e94-834d-9c0aa65df6d1 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:37.933612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceede65a-c7ba-4e94-834d-9c0aa65df6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:38.003916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ceede65a-c7ba-4e94-834d-9c0aa65df6d1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:52:38.005202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ceede65a-c7ba-4e94-834d-9c0aa65df6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:38.113144 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 736/1480] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:52:38.168580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418603d-df84-4900-9ea8-1c1cbcede93f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:52:38.170293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e418603d-df84-4900-9ea8-1c1cbcede93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:38.181780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:38.324386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418603d-df84-4900-9ea8-1c1cbcede93f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:52:38.403644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:38.437729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8989c-b959-4391-89c1-fc57f002a013 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:52:38.438274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8989c-b959-4391-89c1-fc57f002a013 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:38.438558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8989c-b959-4391-89c1-fc57f002a013 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:38.438837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8989c-b959-4391-89c1-fc57f002a013 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:38.440491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-79b8989c-b959-4391-89c1-fc57f002a013 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:38.530221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8989c-b959-4391-89c1-fc57f002a013 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:52:38.531864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8989c-b959-4391-89c1-fc57f002a013 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:52:38.550160 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 745/1481] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:52:41.050347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab0818-ba50-419e-91f7-509c56d92982 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:41.050902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab0818-ba50-419e-91f7-509c56d92982 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:41.051020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab0818-ba50-419e-91f7-509c56d92982 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:41.052327 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 737/1482] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:52:41.059173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636b534-a759-4c5e-84ea-f407f0ed1365 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:41.059730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636b534-a759-4c5e-84ea-f407f0ed1365 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:41.060239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636b534-a759-4c5e-84ea-f407f0ed1365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:41.132554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e636b534-a759-4c5e-84ea-f407f0ed1365 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:52:41.133773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e636b534-a759-4c5e-84ea-f407f0ed1365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:41.182887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:41.232981 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 746/1483] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:52:41.271530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab0818-ba50-419e-91f7-509c56d92982 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:52:41.273116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-12ab0818-ba50-419e-91f7-509c56d92982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:41.296912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:41.385615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab0818-ba50-419e-91f7-509c56d92982 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:52:41.460600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634e6e9-4624-413c-848e-093ac52f48fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:52:41.461219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634e6e9-4624-413c-848e-093ac52f48fc service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:41.461506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634e6e9-4624-413c-848e-093ac52f48fc service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:41.461796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634e6e9-4624-413c-848e-093ac52f48fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:41.463434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3634e6e9-4624-413c-848e-093ac52f48fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:41.539505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:41.575202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634e6e9-4624-413c-848e-093ac52f48fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:52:41.576709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634e6e9-4624-413c-848e-093ac52f48fc service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:52:41.595086 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 738/1484] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:52:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:52:44.192188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccaefa-06e6-47fd-9c28-f57c25d222b4 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:44.192787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccaefa-06e6-47fd-9c28-f57c25d222b4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:44.192787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccaefa-06e6-47fd-9c28-f57c25d222b4 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:44.194646 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 747/1485] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:52:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:52:44.200052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ad4b3-2dc2-4d42-be8c-a31c4da5778e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:44.200497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ad4b3-2dc2-4d42-be8c-a31c4da5778e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:44.200601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ad4b3-2dc2-4d42-be8c-a31c4da5778e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:44.274937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bd6ad4b3-2dc2-4d42-be8c-a31c4da5778e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:52:44.276242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bd6ad4b3-2dc2-4d42-be8c-a31c4da5778e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:44.375391 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 739/1486] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:52:44.416526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccaefa-06e6-47fd-9c28-f57c25d222b4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:52:44.418106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6bccaefa-06e6-47fd-9c28-f57c25d222b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:44.522328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccaefa-06e6-47fd-9c28-f57c25d222b4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:52:44.597855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:44.599717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4cf92-cf42-4cd1-84b9-a11f1ddeca53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:52:44.600927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4cf92-cf42-4cd1-84b9-a11f1ddeca53 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:44.601403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4cf92-cf42-4cd1-84b9-a11f1ddeca53 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:44.601725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4cf92-cf42-4cd1-84b9-a11f1ddeca53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:44.603703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ebc4cf92-cf42-4cd1-84b9-a11f1ddeca53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:44.713420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4cf92-cf42-4cd1-84b9-a11f1ddeca53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:52:44.714865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4cf92-cf42-4cd1-84b9-a11f1ddeca53 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:52:44.733132 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 748/1487] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:52:47.068577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e634c4c-5350-44ae-bf0c-fadb6e1b7606 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:47.069166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e634c4c-5350-44ae-bf0c-fadb6e1b7606 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:47.069166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e634c4c-5350-44ae-bf0c-fadb6e1b7606 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:47.070591 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 740/1488] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:52:47.075728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9b3fd-b018-43ff-9507-f807a2a3b0b1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:47.076133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9b3fd-b018-43ff-9507-f807a2a3b0b1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:47.076284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9b3fd-b018-43ff-9507-f807a2a3b0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:47.140116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-cce9b3fd-b018-43ff-9507-f807a2a3b0b1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:52:47.141309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cce9b3fd-b018-43ff-9507-f807a2a3b0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:47.192419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:47.236361 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 749/1489] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:52:47.277926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e634c4c-5350-44ae-bf0c-fadb6e1b7606 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:52:47.279561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4e634c4c-5350-44ae-bf0c-fadb6e1b7606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:47.316184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:47.386385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e634c4c-5350-44ae-bf0c-fadb6e1b7606 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:52:47.458232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d6608-3c62-412b-ba7d-928c57319c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:52:47.458850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d6608-3c62-412b-ba7d-928c57319c1f service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:47.459677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d6608-3c62-412b-ba7d-928c57319c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:47.459954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d6608-3c62-412b-ba7d-928c57319c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:47.461581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-926d6608-3c62-412b-ba7d-928c57319c1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:47.542088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:47.571792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d6608-3c62-412b-ba7d-928c57319c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:52:47.573244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d6608-3c62-412b-ba7d-928c57319c1f service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:52:47.591707 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 741/1490] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:52:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:52:50.017954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de322f-3a0a-477c-b2d1-f7bc3c566074 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:50.018460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de322f-3a0a-477c-b2d1-f7bc3c566074 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:50.018577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de322f-3a0a-477c-b2d1-f7bc3c566074 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:50.019902 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 750/1491] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 30 20:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:52:50.025290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf04a8-9e26-4531-82c7-f4aef173ba00 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:50.025741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf04a8-9e26-4531-82c7-f4aef173ba00 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:50.025835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf04a8-9e26-4531-82c7-f4aef173ba00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:50.095214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0bdf04a8-9e26-4531-82c7-f4aef173ba00 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:52:50.096441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0bdf04a8-9e26-4531-82c7-f4aef173ba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:50.190488 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 742/1492] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 30 20:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:52:50.231141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de322f-3a0a-477c-b2d1-f7bc3c566074 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:52:50.232768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-81de322f-3a0a-477c-b2d1-f7bc3c566074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:50.339799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de322f-3a0a-477c-b2d1-f7bc3c566074 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:52:50.413039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be196dc-dad5-4a13-9e4e-477ac42fc731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:52:50.413660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be196dc-dad5-4a13-9e4e-477ac42fc731 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:52:50.413944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be196dc-dad5-4a13-9e4e-477ac42fc731 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:52:50.414222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be196dc-dad5-4a13-9e4e-477ac42fc731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:52:50.415871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1be196dc-dad5-4a13-9e4e-477ac42fc731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:52:50.424907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:50.527099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be196dc-dad5-4a13-9e4e-477ac42fc731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:52:50.528618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be196dc-dad5-4a13-9e4e-477ac42fc731 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:52:50.546868 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 751/1493] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:52:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:53:00.188688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=82 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:53:00.544510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=50 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:54:42.395643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5bfe8-9795-42c7-8c89-f8d71ea5762d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:54:42.396227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5bfe8-9795-42c7-8c89-f8d71ea5762d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:54:42.396227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5bfe8-9795-42c7-8c89-f8d71ea5762d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:54:42.476314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-68f5bfe8-9795-42c7-8c89-f8d71ea5762d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:54:42.477536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-68f5bfe8-9795-42c7-8c89-f8d71ea5762d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:54:42.581535 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 743/1494] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 20:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:54:42.590193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a8ced-2e81-460c-8d49-257dd1a68b75 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:54:42.590699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a8ced-2e81-460c-8d49-257dd1a68b75 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:54:42.590806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a8ced-2e81-460c-8d49-257dd1a68b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:54:42.611630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4f7a8ced-2e81-460c-8d49-257dd1a68b75 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:54:42.612884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4f7a8ced-2e81-460c-8d49-257dd1a68b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:54:42.621365 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 752/1495] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 20:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:54:42.626461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5bfe8-9795-42c7-8c89-f8d71ea5762d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:54:42.636663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5bfe8-9795-42c7-8c89-f8d71ea5762d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:54:42.641273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d403a-8f16-486c-bc83-531e84d77393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:54:42.641879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d403a-8f16-486c-bc83-531e84d77393 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:54:42.642168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d403a-8f16-486c-bc83-531e84d77393 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:54:42.642445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d403a-8f16-486c-bc83-531e84d77393 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:54:42.643144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d403a-8f16-486c-bc83-531e84d77393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 20:54:42.643488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d403a-8f16-486c-bc83-531e84d77393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:54:42.645116 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-714d403a-8f16-486c-bc83-531e84d77393 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 20:54:42.645116 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 20:54:42.645116 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 20:54:42.646049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d403a-8f16-486c-bc83-531e84d77393 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:54:42.657334 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 744/1496] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 20:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 20:54:42.665626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a8ced-2e81-460c-8d49-257dd1a68b75 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:54:42.674747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a8ced-2e81-460c-8d49-257dd1a68b75 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:54:42.679388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782cf8c-182c-49dd-91d1-ce611250ccfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:54:42.679991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782cf8c-182c-49dd-91d1-ce611250ccfb admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:54:42.680278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782cf8c-182c-49dd-91d1-ce611250ccfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:54:42.680559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782cf8c-182c-49dd-91d1-ce611250ccfb admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:54:42.681214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782cf8c-182c-49dd-91d1-ce611250ccfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:54:42.682997 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-1782cf8c-182c-49dd-91d1-ce611250ccfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 20:54:42.682997 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 20:54:42.682997 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 20:54:42.684233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782cf8c-182c-49dd-91d1-ce611250ccfb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:54:42.722256 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 753/1497] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 20:54:42 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:54:42.726653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d403a-8f16-486c-bc83-531e84d77393 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:54:42.736601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d403a-8f16-486c-bc83-531e84d77393 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:54:42.787731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:54:42.795319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8368183-00c7-45f4-b71f-963418a351b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:54:42.795975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8368183-00c7-45f4-b71f-963418a351b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:54:42.796266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8368183-00c7-45f4-b71f-963418a351b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:54:42.796548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8368183-00c7-45f4-b71f-963418a351b9 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:54:42.797247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8368183-00c7-45f4-b71f-963418a351b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:54:42.798297 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-b8368183-00c7-45f4-b71f-963418a351b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 20:54:42.798297 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 20:54:42.798297 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 20:54:42.799542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8368183-00c7-45f4-b71f-963418a351b9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:54:42.821642 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 745/1498] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 20:54:42 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 20:54:42.825757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782cf8c-182c-49dd-91d1-ce611250ccfb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:54:42.835866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782cf8c-182c-49dd-91d1-ce611250ccfb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:54:42.840510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087d712-d021-4e21-9f16-da5fbeeca53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:54:42.841116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087d712-d021-4e21-9f16-da5fbeeca53e admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:54:42.841396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087d712-d021-4e21-9f16-da5fbeeca53e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:54:42.841667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087d712-d021-4e21-9f16-da5fbeeca53e admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:54:42.842358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087d712-d021-4e21-9f16-da5fbeeca53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:54:42.843402 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-6087d712-d021-4e21-9f16-da5fbeeca53e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 20:54:42.843402 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 20:54:42.843402 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 20:54:42.844282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087d712-d021-4e21-9f16-da5fbeeca53e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:54:42.857323 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 754/1499] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 20:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 20:54:42.861413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8368183-00c7-45f4-b71f-963418a351b9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:54:42.871828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8368183-00c7-45f4-b71f-963418a351b9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:54:42.876750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d10cbc-6512-4bc7-a6c6-ca9b678d5bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:54:42.877357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d10cbc-6512-4bc7-a6c6-ca9b678d5bdc admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:54:42.877644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d10cbc-6512-4bc7-a6c6-ca9b678d5bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:54:42.877923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d10cbc-6512-4bc7-a6c6-ca9b678d5bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:54:42.879236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d10cbc-6512-4bc7-a6c6-ca9b678d5bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:54:42.880453 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-08d10cbc-6512-4bc7-a6c6-ca9b678d5bdc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 20:54:42.880453 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 20:54:42.880453 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 20:54:42.881166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d10cbc-6512-4bc7-a6c6-ca9b678d5bdc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:54:42.894387 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 746/1500] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 20:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 20:54:42.898452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087d712-d021-4e21-9f16-da5fbeeca53e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:54:42.908324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087d712-d021-4e21-9f16-da5fbeeca53e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:54:42.913206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44605095-3471-4b0b-8dda-389103c75ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:54:42.913855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44605095-3471-4b0b-8dda-389103c75ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:54:42.914138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44605095-3471-4b0b-8dda-389103c75ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:54:42.914415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44605095-3471-4b0b-8dda-389103c75ae2 admin admin] PATH_INFO: `/v3/projects/fcd42d769b39411a9ca4645eb055faa2/users/81c60dbbd98d41018fbbcb2d3e28323a/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:54:42.929364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44605095-3471-4b0b-8dda-389103c75ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd42d769b39411a9ca4645eb055faa2, user_id=81c60dbbd98d41018fbbcb2d3e28323a, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:54:42.930394 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-44605095-3471-4b0b-8dda-389103c75ae2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 20:54:42.930394 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 20:54:42.930394 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 20:54:42.932387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44605095-3471-4b0b-8dda-389103c75ae2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:54:42.944956 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 755/1501] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 20:54:42 2022] PUT /identity/v3/projects/fcd42d769b39411a9ca4645eb055faa2/users/81c60dbbd98d41018fbbcb2d3e28323a/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:54:42.957411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0b423-ac1c-4b41-a7ff-a015f7d5875f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:54:42.957701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0b423-ac1c-4b41-a7ff-a015f7d5875f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:54:42.957977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0b423-ac1c-4b41-a7ff-a015f7d5875f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:54:42.989489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-dfc0b423-ac1c-4b41-a7ff-a015f7d5875f None None] MFA Rules not processed for user `81c60dbbd98d41018fbbcb2d3e28323a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:54:42.990718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-dfc0b423-ac1c-4b41-a7ff-a015f7d5875f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:54:43.055434 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 747/1502] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 20:54:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:54:43.069231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae4610-f1cd-4bd7-b309-c52eac7a86df None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:54:43.069551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae4610-f1cd-4bd7-b309-c52eac7a86df None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:54:43.069833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae4610-f1cd-4bd7-b309-c52eac7a86df None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:54:43.071161 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 756/1503] 10.222.0.17 () {54 vars in 964 bytes} [Sat Jul 30 20:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:54:43.075842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faab558-c4f9-4ef7-99c4-d48456fe83d5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:54:43.076136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faab558-c4f9-4ef7-99c4-d48456fe83d5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:54:43.076418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faab558-c4f9-4ef7-99c4-d48456fe83d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:54:43.135895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1faab558-c4f9-4ef7-99c4-d48456fe83d5 None None] MFA Rules not processed for user `1656aa416bc146f486e71517e476773a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:54:43.137148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1faab558-c4f9-4ef7-99c4-d48456fe83d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:54:43.210990 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 748/1504] 10.222.0.17 () {58 vars in 1061 bytes} [Sat Jul 30 20:54:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:54:43.218340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae4610-f1cd-4bd7-b309-c52eac7a86df None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:54:43.229457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae4610-f1cd-4bd7-b309-c52eac7a86df None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:54:43.233044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4f690-8f03-4be9-a083-bc4c544a2627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:54:43.233649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4f690-8f03-4be9-a083-bc4c544a2627 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:54:43.233934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4f690-8f03-4be9-a083-bc4c544a2627 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:54:43.234210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4f690-8f03-4be9-a083-bc4c544a2627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:54:43.242909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4f690-8f03-4be9-a083-bc4c544a2627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:54:43.244372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4f690-8f03-4be9-a083-bc4c544a2627 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:54:43.253322 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 757/1505] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:54:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:54:43.303986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3da465-90f6-4675-bb6b-19260c2acf80 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:54:43.304278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3da465-90f6-4675-bb6b-19260c2acf80 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:54:43.304558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3da465-90f6-4675-bb6b-19260c2acf80 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:54:43.305822 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 749/1506] 10.222.0.17 () {52 vars in 830 bytes} [Sat Jul 30 20:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:54:43.309370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4f690-8f03-4be9-a083-bc4c544a2627 service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:54:43.370651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4f690-8f03-4be9-a083-bc4c544a2627 service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:54:43.375536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf052b96-b60e-472b-9718-06eb9bca1380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:54:43.376169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf052b96-b60e-472b-9718-06eb9bca1380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:54:43.376450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf052b96-b60e-472b-9718-06eb9bca1380 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:54:43.376723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf052b96-b60e-472b-9718-06eb9bca1380 admin admin] PATH_INFO: `/v3/users/81c60dbbd98d41018fbbcb2d3e28323a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:54:43.377865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf052b96-b60e-472b-9718-06eb9bca1380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81c60dbbd98d41018fbbcb2d3e28323a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:54:43.378903 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-bf052b96-b60e-472b-9718-06eb9bca1380 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 20:54:43.378903 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 20:54:43.378903 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 20:54:43.380135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf052b96-b60e-472b-9718-06eb9bca1380 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:54:43.445521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bf052b96-b60e-472b-9718-06eb9bca1380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81c60dbbd98d41018fbbcb2d3e28323a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 20:54:43.446164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bf052b96-b60e-472b-9718-06eb9bca1380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81c60dbbd98d41018fbbcb2d3e28323a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 20:54:43.468875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bf052b96-b60e-472b-9718-06eb9bca1380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81c60dbbd98d41018fbbcb2d3e28323a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 20:54:43.469582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bf052b96-b60e-472b-9718-06eb9bca1380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81c60dbbd98d41018fbbcb2d3e28323a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 20:54:43.479261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bf052b96-b60e-472b-9718-06eb9bca1380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81c60dbbd98d41018fbbcb2d3e28323a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 20:54:43.490350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:54:43.502230 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 758/1507] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 20:54:43 2022] DELETE /identity/v3/users/81c60dbbd98d41018fbbcb2d3e28323a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:54:43.506657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ada703-4b74-47bc-9bde-0466aa4c378b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:54:43.507132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ada703-4b74-47bc-9bde-0466aa4c378b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:54:43.507246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ada703-4b74-47bc-9bde-0466aa4c378b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:54:43.527389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c5ada703-4b74-47bc-9bde-0466aa4c378b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:54:43.528650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c5ada703-4b74-47bc-9bde-0466aa4c378b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:54:43.538479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:54:43.588339 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 750/1508] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 20:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:54:43.598485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf052b96-b60e-472b-9718-06eb9bca1380 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:54:43.599999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bf052b96-b60e-472b-9718-06eb9bca1380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:54:43.677224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf052b96-b60e-472b-9718-06eb9bca1380 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:54:43.680952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df589e-7766-494b-91e8-d73150d3c5c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:54:43.681577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df589e-7766-494b-91e8-d73150d3c5c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:54:43.681864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df589e-7766-494b-91e8-d73150d3c5c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:54:43.682144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df589e-7766-494b-91e8-d73150d3c5c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:54:43.691049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df589e-7766-494b-91e8-d73150d3c5c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:54:43.692516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df589e-7766-494b-91e8-d73150d3c5c6 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:54:43.701836 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 759/1509] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:54:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 20:54:44.065371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ada703-4b74-47bc-9bde-0466aa4c378b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:54:44.066928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c5ada703-4b74-47bc-9bde-0466aa4c378b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:54:44.079085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ada703-4b74-47bc-9bde-0466aa4c378b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:54:44.084147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c63bb1-3f1c-423c-a9a9-8dd9ec3e5fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:54:44.084773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c63bb1-3f1c-423c-a9a9-8dd9ec3e5fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:54:44.085069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c63bb1-3f1c-423c-a9a9-8dd9ec3e5fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:54:44.085362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c63bb1-3f1c-423c-a9a9-8dd9ec3e5fd5 admin admin] PATH_INFO: `/v3/projects/fcd42d769b39411a9ca4645eb055faa2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:54:44.086536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c63bb1-3f1c-423c-a9a9-8dd9ec3e5fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcd42d769b39411a9ca4645eb055faa2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:54:44.087633 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-40c63bb1-3f1c-423c-a9a9-8dd9ec3e5fd5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 20:54:44.087633 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 20:54:44.087633 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 20:54:44.088827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c63bb1-3f1c-423c-a9a9-8dd9ec3e5fd5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:54:44.149746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-40c63bb1-3f1c-423c-a9a9-8dd9ec3e5fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcd42d769b39411a9ca4645eb055faa2', 'request_id': 'req-40c63bb1-3f1c-423c-a9a9-8dd9ec3e5fd5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 20:54:44.163470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-40c63bb1-3f1c-423c-a9a9-8dd9ec3e5fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcd42d769b39411a9ca4645eb055faa2', 'request_id': 'req-40c63bb1-3f1c-423c-a9a9-8dd9ec3e5fd5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 20:54:44.173558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-40c63bb1-3f1c-423c-a9a9-8dd9ec3e5fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcd42d769b39411a9ca4645eb055faa2', 'request_id': 'req-40c63bb1-3f1c-423c-a9a9-8dd9ec3e5fd5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 20:54:44.185621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-40c63bb1-3f1c-423c-a9a9-8dd9ec3e5fd5 admin admin] The token cache is being invalidate because project fcd42d769b39411a9ca4645eb055faa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 20:54:44.185906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-40c63bb1-3f1c-423c-a9a9-8dd9ec3e5fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 20:54:44.186542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-40c63bb1-3f1c-423c-a9a9-8dd9ec3e5fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 20:54:44.188184 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 751/1510] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 20:54:44 2022] DELETE /identity/v3/projects/fcd42d769b39411a9ca4645eb055faa2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 20:54:53.697793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=38 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:54:54.182473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:57:51.974901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caf292-143a-429b-a1c5-f02eeb7a817b None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:57:51.975579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caf292-143a-429b-a1c5-f02eeb7a817b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:57:51.975579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caf292-143a-429b-a1c5-f02eeb7a817b None None] PATH_INFO: `/v3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:57:51.976789 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 760/1511] 10.222.0.47 () {54 vars in 925 bytes} [Sat Jul 30 20:57:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:57:52.015012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181e7a-e67b-407b-8155-69328946b9c4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:57:52.015500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181e7a-e67b-407b-8155-69328946b9c4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:57:52.015680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181e7a-e67b-407b-8155-69328946b9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:57:52.070257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-04181e7a-e67b-407b-8155-69328946b9c4 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:57:52.071724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-04181e7a-e67b-407b-8155-69328946b9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:57:52.150179 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 752/1512] 10.222.0.47 () {58 vars in 1015 bytes} [Sat Jul 30 20:57:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 20:57:53.085454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb83aad-85e5-49f3-a1dd-e3e00b990efb None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:57:53.086019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb83aad-85e5-49f3-a1dd-e3e00b990efb None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:57:53.086129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb83aad-85e5-49f3-a1dd-e3e00b990efb None None] PATH_INFO: `/v3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:57:53.087503 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 761/1513] 10.222.0.48 () {54 vars in 925 bytes} [Sat Jul 30 20:57:53 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 20:57:53.093496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0a153-6edf-48a6-b34d-0bfbd0874e58 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:57:53.093933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0a153-6edf-48a6-b34d-0bfbd0874e58 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:57:53.094055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0a153-6edf-48a6-b34d-0bfbd0874e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:57:53.113764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8ee0a153-6edf-48a6-b34d-0bfbd0874e58 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:57:53.114946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8ee0a153-6edf-48a6-b34d-0bfbd0874e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:57:53.123694 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 753/1514] 10.222.0.48 () {58 vars in 1015 bytes} [Sat Jul 30 20:57:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:57:56.125569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eafe3-9aeb-43ba-8ece-9c2d12a76e3c None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:57:56.126099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eafe3-9aeb-43ba-8ece-9c2d12a76e3c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:57:56.126099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eafe3-9aeb-43ba-8ece-9c2d12a76e3c None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:57:56.128047 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 762/1515] 10.222.0.17 () {54 vars in 961 bytes} [Sat Jul 30 20:57:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:57:56.133103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab5930-d83e-4812-b8f0-d54c271f70dc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:57:56.133547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab5930-d83e-4812-b8f0-d54c271f70dc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:57:56.133660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab5930-d83e-4812-b8f0-d54c271f70dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:57:56.153136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f2ab5930-d83e-4812-b8f0-d54c271f70dc None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:57:56.154336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f2ab5930-d83e-4812-b8f0-d54c271f70dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:57:56.163078 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 754/1516] 10.222.0.17 () {58 vars in 1058 bytes} [Sat Jul 30 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:57:56.170570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248eafe3-9aeb-43ba-8ece-9c2d12a76e3c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:57:56.184505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248eafe3-9aeb-43ba-8ece-9c2d12a76e3c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:57:56.190229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735ba88-4275-4828-a35a-c4384794d21c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:57:56.190835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735ba88-4275-4828-a35a-c4384794d21c service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:57:56.191126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735ba88-4275-4828-a35a-c4384794d21c service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:57:56.191450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735ba88-4275-4828-a35a-c4384794d21c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:57:56.199731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735ba88-4275-4828-a35a-c4384794d21c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:57:56.201326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735ba88-4275-4828-a35a-c4384794d21c service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:57:56.211198 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 763/1517] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:57:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:57:56.782052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab5930-d83e-4812-b8f0-d54c271f70dc None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:57:56.791899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab5930-d83e-4812-b8f0-d54c271f70dc None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:57:56.797170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f5f3f-7b0c-4673-a028-7b8b1959e148 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:57:56.797721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f5f3f-7b0c-4673-a028-7b8b1959e148 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:57:56.798003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f5f3f-7b0c-4673-a028-7b8b1959e148 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:57:56.798279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f5f3f-7b0c-4673-a028-7b8b1959e148 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:57:56.806761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f5f3f-7b0c-4673-a028-7b8b1959e148 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:57:56.808397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f5f3f-7b0c-4673-a028-7b8b1959e148 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:57:56.818849 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 755/1518] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:57:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:58:06.207111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:58:06.814388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=56 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:58:32.287478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a4e85-0532-42e5-afee-cfef5eb9cf87 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:58:32.288040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a4e85-0532-42e5-afee-cfef5eb9cf87 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:58:32.288040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a4e85-0532-42e5-afee-cfef5eb9cf87 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:58:32.289651 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 764/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 30 20:58:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:58:32.294949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471cb37-3751-4e77-8a9f-106ebb552a40 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:58:32.295464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471cb37-3751-4e77-8a9f-106ebb552a40 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:58:32.295653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471cb37-3751-4e77-8a9f-106ebb552a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:58:32.316627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5471cb37-3751-4e77-8a9f-106ebb552a40 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:58:32.317883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5471cb37-3751-4e77-8a9f-106ebb552a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:58:32.378525 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 756/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 30 20:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:58:32.540787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a4e85-0532-42e5-afee-cfef5eb9cf87 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:58:32.542451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-073a4e85-0532-42e5-afee-cfef5eb9cf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:58:32.644274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a4e85-0532-42e5-afee-cfef5eb9cf87 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:58:32.650336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e842b6b-451a-4523-b107-0ad9f74831c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:58:32.650955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e842b6b-451a-4523-b107-0ad9f74831c9 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:58:32.651245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e842b6b-451a-4523-b107-0ad9f74831c9 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:58:32.651565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e842b6b-451a-4523-b107-0ad9f74831c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:58:32.659639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e842b6b-451a-4523-b107-0ad9f74831c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:58:32.661236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e842b6b-451a-4523-b107-0ad9f74831c9 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:58:32.670502 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 765/1521] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:58:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:58:33.521540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a963d93-5172-4aa3-892d-1d23972b9883 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:58:33.522133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a963d93-5172-4aa3-892d-1d23972b9883 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:58:33.522237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a963d93-5172-4aa3-892d-1d23972b9883 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:58:33.523749 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 30 20:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:58:33.528573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3bebf-ef52-4b95-8c57-65e731744896 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:58:33.529023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3bebf-ef52-4b95-8c57-65e731744896 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:58:33.529305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3bebf-ef52-4b95-8c57-65e731744896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:58:33.552156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-04a3bebf-ef52-4b95-8c57-65e731744896 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:58:33.553428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-04a3bebf-ef52-4b95-8c57-65e731744896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:58:33.561515 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 30 20:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 20:58:33.732865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a963d93-5172-4aa3-892d-1d23972b9883 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:58:33.748014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a963d93-5172-4aa3-892d-1d23972b9883 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:58:33.753589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4610b-c610-401e-8633-42709a0d1afb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:58:33.754198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4610b-c610-401e-8633-42709a0d1afb service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:58:33.755114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4610b-c610-401e-8633-42709a0d1afb service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:58:33.755439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4610b-c610-401e-8633-42709a0d1afb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:58:33.763531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4610b-c610-401e-8633-42709a0d1afb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:58:33.765119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4610b-c610-401e-8633-42709a0d1afb service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:58:33.774686 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 758/1524] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:58:37.748116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abbf4c-aa74-4915-8314-b9485507ec39 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:58:37.748689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abbf4c-aa74-4915-8314-b9485507ec39 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:58:37.748689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abbf4c-aa74-4915-8314-b9485507ec39 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:58:37.750015 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 30 20:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:58:37.755095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836d09b-38c0-4df3-8b98-eb2071cff8d5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:58:37.755554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836d09b-38c0-4df3-8b98-eb2071cff8d5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:58:37.755698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836d09b-38c0-4df3-8b98-eb2071cff8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:58:37.775355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2836d09b-38c0-4df3-8b98-eb2071cff8d5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:58:37.776562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2836d09b-38c0-4df3-8b98-eb2071cff8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:58:37.784375 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 30 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:58:37.822689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abbf4c-aa74-4915-8314-b9485507ec39 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:58:37.824605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c6abbf4c-aa74-4915-8314-b9485507ec39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:58:37.884890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abbf4c-aa74-4915-8314-b9485507ec39 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:58:37.888393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfde74c-0cb2-4522-a2ef-698157f3ec7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:58:37.889003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfde74c-0cb2-4522-a2ef-698157f3ec7d service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:58:37.889303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfde74c-0cb2-4522-a2ef-698157f3ec7d service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:58:37.889578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfde74c-0cb2-4522-a2ef-698157f3ec7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:58:37.898781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfde74c-0cb2-4522-a2ef-698157f3ec7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:58:37.900227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfde74c-0cb2-4522-a2ef-698157f3ec7d service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:58:37.909411 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 768/1527] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:58:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 20:58:40.156518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c76790-39bc-4874-b6e2-5b0968ff9e6e None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:58:40.157050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c76790-39bc-4874-b6e2-5b0968ff9e6e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:58:40.157050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c76790-39bc-4874-b6e2-5b0968ff9e6e None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:58:40.158425 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 30 20:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:58:40.164107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36e4e2-ad72-46d9-bc86-2d72241cb635 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:58:40.164579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36e4e2-ad72-46d9-bc86-2d72241cb635 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:58:40.164695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36e4e2-ad72-46d9-bc86-2d72241cb635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:58:40.183778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7a36e4e2-ad72-46d9-bc86-2d72241cb635 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:58:40.184967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7a36e4e2-ad72-46d9-bc86-2d72241cb635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:58:40.192812 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 30 20:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:58:40.231426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c76790-39bc-4874-b6e2-5b0968ff9e6e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 20:58:40.233185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b3c76790-39bc-4874-b6e2-5b0968ff9e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:58:40.246437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c76790-39bc-4874-b6e2-5b0968ff9e6e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 20:58:40.250195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00423828-1363-4ae9-bdbf-63eee3d80647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 20:58:40.250805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00423828-1363-4ae9-bdbf-63eee3d80647 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:58:40.251092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00423828-1363-4ae9-bdbf-63eee3d80647 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:58:40.251410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00423828-1363-4ae9-bdbf-63eee3d80647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:58:40.260807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00423828-1363-4ae9-bdbf-63eee3d80647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 20:58:40.262238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00423828-1363-4ae9-bdbf-63eee3d80647 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 20:58:40.271635 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 761/1530] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 20:58:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 20:58:50.178575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=78 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:58:50.267491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=42 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:59:32.458351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca0810-76bc-46f3-8ed6-d2eeb3056cb1 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:59:32.458878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca0810-76bc-46f3-8ed6-d2eeb3056cb1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:59:32.458878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca0810-76bc-46f3-8ed6-d2eeb3056cb1 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:59:32.460271 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 770/1531] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 20:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 20:59:32.465765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6485f5e-5962-48d7-b8e7-2cef355c5ae2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 20:59:32.466225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6485f5e-5962-48d7-b8e7-2cef355c5ae2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 20:59:32.466329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6485f5e-5962-48d7-b8e7-2cef355c5ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 20:59:32.486528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c6485f5e-5962-48d7-b8e7-2cef355c5ae2 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 20:59:32.487783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c6485f5e-5962-48d7-b8e7-2cef355c5ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 20:59:32.497053 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 762/1532] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 20:59:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 20:59:42.481784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:10.866688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387d854-1b00-4926-a22a-90878b39b88a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:10.868020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387d854-1b00-4926-a22a-90878b39b88a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:10.868020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387d854-1b00-4926-a22a-90878b39b88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:10.891890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a387d854-1b00-4926-a22a-90878b39b88a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:10.893095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a387d854-1b00-4926-a22a-90878b39b88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:10.906218 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 771/1533] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:10.918008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7726bf-50ed-4515-90ef-9e03f639f74f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:10.918550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7726bf-50ed-4515-90ef-9e03f639f74f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:10.918550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7726bf-50ed-4515-90ef-9e03f639f74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:10.944022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7c7726bf-50ed-4515-90ef-9e03f639f74f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:10.945385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7c7726bf-50ed-4515-90ef-9e03f639f74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:10.958581 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 763/1534] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:00:10.963767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387d854-1b00-4926-a22a-90878b39b88a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:10.974401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387d854-1b00-4926-a22a-90878b39b88a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:10.983636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f48d4-77e5-421d-9220-d78b196aba28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:10.984265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f48d4-77e5-421d-9220-d78b196aba28 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:10.984549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f48d4-77e5-421d-9220-d78b196aba28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:10.984821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f48d4-77e5-421d-9220-d78b196aba28 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:10.985522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f48d4-77e5-421d-9220-d78b196aba28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:00:10.985822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f48d4-77e5-421d-9220-d78b196aba28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:10.986856 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-cf9f48d4-77e5-421d-9220-d78b196aba28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:10.986856 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:00:10.986856 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:00:10.987779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f48d4-77e5-421d-9220-d78b196aba28 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:11.009705 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 772/1535] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:00:11.020859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7726bf-50ed-4515-90ef-9e03f639f74f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:11.030979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7726bf-50ed-4515-90ef-9e03f639f74f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:11.041530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868df4b-6ae1-41e2-9db7-12fe7fa16a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:11.042416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868df4b-6ae1-41e2-9db7-12fe7fa16a39 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:11.042723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868df4b-6ae1-41e2-9db7-12fe7fa16a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:11.042982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868df4b-6ae1-41e2-9db7-12fe7fa16a39 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:11.043714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868df4b-6ae1-41e2-9db7-12fe7fa16a39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:11.045046 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-c868df4b-6ae1-41e2-9db7-12fe7fa16a39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:11.045046 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:00:11.045046 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:00:11.046317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868df4b-6ae1-41e2-9db7-12fe7fa16a39 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:11.086499 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 764/1536] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:11 2022] POST /identity/v3/projects => generated 401 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:11.096376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f48d4-77e5-421d-9220-d78b196aba28 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:11.110035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f48d4-77e5-421d-9220-d78b196aba28 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:11.190308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d36f39-3b46-4a88-ae6e-f1b3e888f6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:11.190782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d36f39-3b46-4a88-ae6e-f1b3e888f6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:11.191110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d36f39-3b46-4a88-ae6e-f1b3e888f6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:11.191508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d36f39-3b46-4a88-ae6e-f1b3e888f6b8 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:11.192246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d36f39-3b46-4a88-ae6e-f1b3e888f6b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:11.193493 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-13d36f39-3b46-4a88-ae6e-f1b3e888f6b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:11.193493 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:00:11.193493 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:00:11.194700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d36f39-3b46-4a88-ae6e-f1b3e888f6b8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:11.224592 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 773/1537] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:11 2022] POST /identity/v3/users => generated 301 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:11.231711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868df4b-6ae1-41e2-9db7-12fe7fa16a39 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:11.243262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868df4b-6ae1-41e2-9db7-12fe7fa16a39 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:11.252399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6418cf-544e-4e92-adf3-b9074f58ec1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:11.253048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6418cf-544e-4e92-adf3-b9074f58ec1a admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:11.253329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6418cf-544e-4e92-adf3-b9074f58ec1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:11.253604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6418cf-544e-4e92-adf3-b9074f58ec1a admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:11.254312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6418cf-544e-4e92-adf3-b9074f58ec1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:11.255980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6418cf-544e-4e92-adf3-b9074f58ec1a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:11.273199 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 765/1538] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:11.278600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d36f39-3b46-4a88-ae6e-f1b3e888f6b8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:11.290728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d36f39-3b46-4a88-ae6e-f1b3e888f6b8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:11.300182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0f9db-ecf7-44f9-9151-cbb2a876ebc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:11.300840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0f9db-ecf7-44f9-9151-cbb2a876ebc0 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:11.301122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0f9db-ecf7-44f9-9151-cbb2a876ebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:11.301399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0f9db-ecf7-44f9-9151-cbb2a876ebc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:11.302115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0f9db-ecf7-44f9-9151-cbb2a876ebc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:11.303774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0f9db-ecf7-44f9-9151-cbb2a876ebc0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:11.321652 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 774/1539] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:11.326324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6418cf-544e-4e92-adf3-b9074f58ec1a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:11.337903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6418cf-544e-4e92-adf3-b9074f58ec1a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:11.344878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ffa0c0-d9be-4990-bf26-dbfaaf9250d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:11.345572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffa0c0-d9be-4990-bf26-dbfaaf9250d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:11.345854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffa0c0-d9be-4990-bf26-dbfaaf9250d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:11.346133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffa0c0-d9be-4990-bf26-dbfaaf9250d0 admin admin] PATH_INFO: `/v3/projects/246567397fcd42e29113f1549d475ed0/users/b63995cd710642ab97651b02b16cd883/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:11.363944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ffa0c0-d9be-4990-bf26-dbfaaf9250d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=246567397fcd42e29113f1549d475ed0, user_id=b63995cd710642ab97651b02b16cd883, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:11.364992 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-84ffa0c0-d9be-4990-bf26-dbfaaf9250d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:11.364992 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:00:11.364992 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:00:11.366942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ffa0c0-d9be-4990-bf26-dbfaaf9250d0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:11.386800 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 766/1540] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:11 2022] PUT /identity/v3/projects/246567397fcd42e29113f1549d475ed0/users/b63995cd710642ab97651b02b16cd883/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:11.409878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b2590-7227-4e40-891d-e78b6ef99718 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:11.410207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b2590-7227-4e40-891d-e78b6ef99718 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:11.410459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b2590-7227-4e40-891d-e78b6ef99718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:11.450829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3e6b2590-7227-4e40-891d-e78b6ef99718 None None] MFA Rules not processed for user `b63995cd710642ab97651b02b16cd883`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:11.453038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3e6b2590-7227-4e40-891d-e78b6ef99718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:11.540377 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 775/1541] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:11.546497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ffa0c0-d9be-4990-bf26-dbfaaf9250d0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:11.638235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ffa0c0-d9be-4990-bf26-dbfaaf9250d0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:11.649804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b6a28-156b-4709-956d-6129616af185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:11.650448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b6a28-156b-4709-956d-6129616af185 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:11.650724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b6a28-156b-4709-956d-6129616af185 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:11.650990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b6a28-156b-4709-956d-6129616af185 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:11.651704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b6a28-156b-4709-956d-6129616af185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:11.653628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b6a28-156b-4709-956d-6129616af185 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:11.697302 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 767/1542] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:11 2022] POST /identity/v3/projects => generated 401 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:11.701938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b2590-7227-4e40-891d-e78b6ef99718 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:11.714433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193cadf-ae47-418f-8161-f7be7281f549 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:11.714720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193cadf-ae47-418f-8161-f7be7281f549 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:11.715001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193cadf-ae47-418f-8161-f7be7281f549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:11.718663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b2590-7227-4e40-891d-e78b6ef99718 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:11.766923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4193cadf-ae47-418f-8161-f7be7281f549 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:11.767250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4193cadf-ae47-418f-8161-f7be7281f549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:11.821152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:11.845011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b73992-d2fd-4208-90d5-dc0e83a0e4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:11.845520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b73992-d2fd-4208-90d5-dc0e83a0e4bb admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:11.845804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b73992-d2fd-4208-90d5-dc0e83a0e4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:11.846126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b73992-d2fd-4208-90d5-dc0e83a0e4bb admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:11.846795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b73992-d2fd-4208-90d5-dc0e83a0e4bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:11.853572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b73992-d2fd-4208-90d5-dc0e83a0e4bb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:11.900424 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 776/1543] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:11 2022] POST /identity/v3/users => generated 307 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:11.901771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea0bc5-c9d0-4ce2-8f69-d7369e5f1af5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:11.902034 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 768/1544] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:11.902144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea0bc5-c9d0-4ce2-8f69-d7369e5f1af5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:11.902334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea0bc5-c9d0-4ce2-8f69-d7369e5f1af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:11.903329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939292f-883b-4912-9708-befd07712b80 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:11.903614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939292f-883b-4912-9708-befd07712b80 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:11.903940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939292f-883b-4912-9708-befd07712b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:11.936191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3939292f-883b-4912-9708-befd07712b80 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:11.936892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-78ea0bc5-c9d0-4ce2-8f69-d7369e5f1af5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:11.937400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3939292f-883b-4912-9708-befd07712b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:11.939122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-78ea0bc5-c9d0-4ce2-8f69-d7369e5f1af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:11.947106 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 769/1545] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:11.948351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e91e2f-3b13-4bc7-9fc7-68c12f4ffda5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:11.948637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e91e2f-3b13-4bc7-9fc7-68c12f4ffda5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:11.948907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e91e2f-3b13-4bc7-9fc7-68c12f4ffda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:11.954015 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 777/1546] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:11.955439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea0bc5-c9d0-4ce2-8f69-d7369e5f1af5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:11.968888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea0bc5-c9d0-4ce2-8f69-d7369e5f1af5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:11.971613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d7e91e2f-3b13-4bc7-9fc7-68c12f4ffda5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:11.972831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d7e91e2f-3b13-4bc7-9fc7-68c12f4ffda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:11.975261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ba66c-bfff-4234-b82b-1fb8439c7214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:11.976085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ba66c-bfff-4234-b82b-1fb8439c7214 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:11.976568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ba66c-bfff-4234-b82b-1fb8439c7214 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:11.976846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ba66c-bfff-4234-b82b-1fb8439c7214 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:11.977555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ba66c-bfff-4234-b82b-1fb8439c7214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:11.979339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ba66c-bfff-4234-b82b-1fb8439c7214 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:11.982393 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 770/1547] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:11.984055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db340e6c-5da0-4253-aab3-b0fcad233e6c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:11.984477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db340e6c-5da0-4253-aab3-b0fcad233e6c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:11.984822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db340e6c-5da0-4253-aab3-b0fcad233e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:11.993796 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 778/1548] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:11.999065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3d83f-3f91-41b9-91f0-f7b05f3ea6a1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:11.999065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3d83f-3f91-41b9-91f0-f7b05f3ea6a1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:11.999065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3d83f-3f91-41b9-91f0-f7b05f3ea6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.012530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-db340e6c-5da0-4253-aab3-b0fcad233e6c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:12.013966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-db340e6c-5da0-4253-aab3-b0fcad233e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:12.022079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-98b3d83f-3f91-41b9-91f0-f7b05f3ea6a1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:12.022735 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 771/1549] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:12.024915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-98b3d83f-3f91-41b9-91f0-f7b05f3ea6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:12.025068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2127502-24fa-4f85-9e17-ac5dc77102df None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.025068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2127502-24fa-4f85-9e17-ac5dc77102df None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.025068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2127502-24fa-4f85-9e17-ac5dc77102df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.031679 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 779/1550] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:12.032887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f12bf-b821-4576-aa7a-2a5e8c526b23 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.033172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f12bf-b821-4576-aa7a-2a5e8c526b23 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.033448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f12bf-b821-4576-aa7a-2a5e8c526b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.033551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:12.052546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d2127502-24fa-4f85-9e17-ac5dc77102df None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:12.053658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d2127502-24fa-4f85-9e17-ac5dc77102df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:12.054783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7c7f12bf-b821-4576-aa7a-2a5e8c526b23 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:12.055965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7c7f12bf-b821-4576-aa7a-2a5e8c526b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:12.061967 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 772/1551] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:12.062984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3984f-5383-42f5-9881-eae396c43604 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.063277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3984f-5383-42f5-9881-eae396c43604 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.063685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3984f-5383-42f5-9881-eae396c43604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.071458 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 780/1552] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:12.079820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb55756-5ffa-42a5-9762-6cf042387180 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.080339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb55756-5ffa-42a5-9762-6cf042387180 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.080977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb55756-5ffa-42a5-9762-6cf042387180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.087825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c5a3984f-5383-42f5-9881-eae396c43604 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:12.088756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c5a3984f-5383-42f5-9881-eae396c43604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:12.097623 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 773/1553] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:12.098648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428bb4a-86f5-45d2-93d6-e06455329194 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.098926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428bb4a-86f5-45d2-93d6-e06455329194 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.102215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428bb4a-86f5-45d2-93d6-e06455329194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.108127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bfb55756-5ffa-42a5-9762-6cf042387180 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:12.108928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bfb55756-5ffa-42a5-9762-6cf042387180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:12.118218 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 781/1554] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:12.119006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb55756-5ffa-42a5-9762-6cf042387180 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.120818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c428bb4a-86f5-45d2-93d6-e06455329194 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:12.122278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c428bb4a-86f5-45d2-93d6-e06455329194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:12.129875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb55756-5ffa-42a5-9762-6cf042387180 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.131099 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 774/1555] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:12.132475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff90aa-96b7-4315-aca3-dabe67747c31 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.132815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff90aa-96b7-4315-aca3-dabe67747c31 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.133096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff90aa-96b7-4315-aca3-dabe67747c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.137033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe42b0a-50b1-43f2-824c-dddc2adbe902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.138002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe42b0a-50b1-43f2-824c-dddc2adbe902 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.138002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe42b0a-50b1-43f2-824c-dddc2adbe902 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.138246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe42b0a-50b1-43f2-824c-dddc2adbe902 admin admin] PATH_INFO: `/v3/projects/89f80036653349488d845a112edad062/users/70b634c119834495994f1374e54e9c83/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.155069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-91ff90aa-96b7-4315-aca3-dabe67747c31 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:12.156309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-91ff90aa-96b7-4315-aca3-dabe67747c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:12.164927 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 775/1556] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:12.165688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff90aa-96b7-4315-aca3-dabe67747c31 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.165917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe42b0a-50b1-43f2-824c-dddc2adbe902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f80036653349488d845a112edad062, user_id=70b634c119834495994f1374e54e9c83, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.168600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe42b0a-50b1-43f2-824c-dddc2adbe902 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.175617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff90aa-96b7-4315-aca3-dabe67747c31 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.181998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef4ebe-d9cd-430b-9a3a-972f13415ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.182603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef4ebe-d9cd-430b-9a3a-972f13415ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.182887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef4ebe-d9cd-430b-9a3a-972f13415ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.183159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef4ebe-d9cd-430b-9a3a-972f13415ed4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.183879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef4ebe-d9cd-430b-9a3a-972f13415ed4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:00:12.184189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef4ebe-d9cd-430b-9a3a-972f13415ed4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.185772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef4ebe-d9cd-430b-9a3a-972f13415ed4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.189832 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 782/1557] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:12 2022] PUT /identity/v3/projects/89f80036653349488d845a112edad062/users/70b634c119834495994f1374e54e9c83/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:12.191068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe33a8b-08b7-4156-803d-8fbbd9154388 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.191404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe33a8b-08b7-4156-803d-8fbbd9154388 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.191689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe33a8b-08b7-4156-803d-8fbbd9154388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.200875 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 776/1558] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:00:12.201843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef4ebe-d9cd-430b-9a3a-972f13415ed4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.213393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ebe33a8b-08b7-4156-803d-8fbbd9154388 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:12.214476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef4ebe-d9cd-430b-9a3a-972f13415ed4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.214595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ebe33a8b-08b7-4156-803d-8fbbd9154388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:12.271599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb34e6-5e52-43b9-b6ac-689f1c1ea9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.272225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb34e6-5e52-43b9-b6ac-689f1c1ea9af admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.272509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb34e6-5e52-43b9-b6ac-689f1c1ea9af admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.272788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb34e6-5e52-43b9-b6ac-689f1c1ea9af admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.274045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb34e6-5e52-43b9-b6ac-689f1c1ea9af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:00:12.274346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb34e6-5e52-43b9-b6ac-689f1c1ea9af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.275963 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 783/1559] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:12.276083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb34e6-5e52-43b9-b6ac-689f1c1ea9af admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.276966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe33a8b-08b7-4156-803d-8fbbd9154388 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.286272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe33a8b-08b7-4156-803d-8fbbd9154388 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.296519 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 777/1560] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:00:12.296519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854765b-1a22-45bc-b810-6b5b851ba3a6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.296519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854765b-1a22-45bc-b810-6b5b851ba3a6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.296519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854765b-1a22-45bc-b810-6b5b851ba3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.296868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f47ef-26fb-4b13-b264-661e3b502dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.296868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f47ef-26fb-4b13-b264-661e3b502dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.296868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f47ef-26fb-4b13-b264-661e3b502dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.296868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f47ef-26fb-4b13-b264-661e3b502dd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.297205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f47ef-26fb-4b13-b264-661e3b502dd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:00:12.297205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f47ef-26fb-4b13-b264-661e3b502dd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.297205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f47ef-26fb-4b13-b264-661e3b502dd7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.314410 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 784/1561] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:00:12.314410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f47ef-26fb-4b13-b264-661e3b502dd7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.314684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8854765b-1a22-45bc-b810-6b5b851ba3a6 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:12.314684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8854765b-1a22-45bc-b810-6b5b851ba3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:12.325556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f47ef-26fb-4b13-b264-661e3b502dd7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.325766 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 778/1562] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:12.326712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854765b-1a22-45bc-b810-6b5b851ba3a6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.330853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a11db-d7d3-4fca-ba01-36fb5b313884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.331806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a11db-d7d3-4fca-ba01-36fb5b313884 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.332184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a11db-d7d3-4fca-ba01-36fb5b313884 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.332605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a11db-d7d3-4fca-ba01-36fb5b313884 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.333301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a11db-d7d3-4fca-ba01-36fb5b313884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:00:12.333611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a11db-d7d3-4fca-ba01-36fb5b313884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.335226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a11db-d7d3-4fca-ba01-36fb5b313884 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.337491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854765b-1a22-45bc-b810-6b5b851ba3a6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.342162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bf967-510e-4b11-9644-6bd5ada9a21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.342777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bf967-510e-4b11-9644-6bd5ada9a21e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.343060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bf967-510e-4b11-9644-6bd5ada9a21e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.343379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bf967-510e-4b11-9644-6bd5ada9a21e admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.344078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bf967-510e-4b11-9644-6bd5ada9a21e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:00:12.344383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bf967-510e-4b11-9644-6bd5ada9a21e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.346006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bf967-510e-4b11-9644-6bd5ada9a21e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.348775 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 785/1563] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:00:12.349720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a11db-d7d3-4fca-ba01-36fb5b313884 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.359884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a11db-d7d3-4fca-ba01-36fb5b313884 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.364411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab044a-32e1-43f8-a76d-44f624e16adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.372203 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 779/1564] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:00:12.372357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab044a-32e1-43f8-a76d-44f624e16adf admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.372357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab044a-32e1-43f8-a76d-44f624e16adf admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.372357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab044a-32e1-43f8-a76d-44f624e16adf admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.372595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bf967-510e-4b11-9644-6bd5ada9a21e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.372690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab044a-32e1-43f8-a76d-44f624e16adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.372690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab044a-32e1-43f8-a76d-44f624e16adf admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.381611 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 786/1565] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:12.382440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab044a-32e1-43f8-a76d-44f624e16adf admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.383657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bf967-510e-4b11-9644-6bd5ada9a21e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.388458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c4184-0673-49fa-998a-8cedbe9dcdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.389286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c4184-0673-49fa-998a-8cedbe9dcdd2 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.389575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c4184-0673-49fa-998a-8cedbe9dcdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.389848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c4184-0673-49fa-998a-8cedbe9dcdd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.390536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c4184-0673-49fa-998a-8cedbe9dcdd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.392471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c4184-0673-49fa-998a-8cedbe9dcdd2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.395834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab044a-32e1-43f8-a76d-44f624e16adf admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.401259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83234b3-21a9-48d5-a1f3-3184238b3d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.401865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83234b3-21a9-48d5-a1f3-3184238b3d26 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.402157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83234b3-21a9-48d5-a1f3-3184238b3d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.402437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83234b3-21a9-48d5-a1f3-3184238b3d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.403134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83234b3-21a9-48d5-a1f3-3184238b3d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:00:12.403486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83234b3-21a9-48d5-a1f3-3184238b3d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.405086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83234b3-21a9-48d5-a1f3-3184238b3d26 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.418667 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 787/1566] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:00:12.419273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83234b3-21a9-48d5-a1f3-3184238b3d26 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.421196 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 780/1567] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:12.422169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c4184-0673-49fa-998a-8cedbe9dcdd2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.432366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83234b3-21a9-48d5-a1f3-3184238b3d26 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.456825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:12.488650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c4184-0673-49fa-998a-8cedbe9dcdd2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.491594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a035bbc-8bfe-4bc3-9241-4244c35d2d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.492891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a035bbc-8bfe-4bc3-9241-4244c35d2d4a admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.493177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a035bbc-8bfe-4bc3-9241-4244c35d2d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.493450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a035bbc-8bfe-4bc3-9241-4244c35d2d4a admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.494109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a035bbc-8bfe-4bc3-9241-4244c35d2d4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.494923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1f26a-8ac4-4823-953e-0f5c92e2c3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.495606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1f26a-8ac4-4823-953e-0f5c92e2c3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.496180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1f26a-8ac4-4823-953e-0f5c92e2c3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.496287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a035bbc-8bfe-4bc3-9241-4244c35d2d4a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.496462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1f26a-8ac4-4823-953e-0f5c92e2c3c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.497109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1f26a-8ac4-4823-953e-0f5c92e2c3c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.499003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1f26a-8ac4-4823-953e-0f5c92e2c3c1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.520104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:12.524069 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 788/1568] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:12.524891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a035bbc-8bfe-4bc3-9241-4244c35d2d4a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.531211 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 781/1569] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/projects => generated 397 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:12.532101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1f26a-8ac4-4823-953e-0f5c92e2c3c1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.592277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a035bbc-8bfe-4bc3-9241-4244c35d2d4a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.596038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1f26a-8ac4-4823-953e-0f5c92e2c3c1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.597937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5eb87f-3fab-4b01-a96a-a2bac86b8356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.598586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5eb87f-3fab-4b01-a96a-a2bac86b8356 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.598905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5eb87f-3fab-4b01-a96a-a2bac86b8356 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.599200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5eb87f-3fab-4b01-a96a-a2bac86b8356 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.600529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5eb87f-3fab-4b01-a96a-a2bac86b8356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:00:12.601104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5eb87f-3fab-4b01-a96a-a2bac86b8356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.602411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57065e4d-7a26-4ae5-87c6-f26fc25c3f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.603036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57065e4d-7a26-4ae5-87c6-f26fc25c3f9a admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.603392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57065e4d-7a26-4ae5-87c6-f26fc25c3f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.603704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57065e4d-7a26-4ae5-87c6-f26fc25c3f9a admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.604149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5eb87f-3fab-4b01-a96a-a2bac86b8356 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.604443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57065e4d-7a26-4ae5-87c6-f26fc25c3f9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.606927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57065e4d-7a26-4ae5-87c6-f26fc25c3f9a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.618778 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 789/1570] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:00:12.619764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5eb87f-3fab-4b01-a96a-a2bac86b8356 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.632405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5eb87f-3fab-4b01-a96a-a2bac86b8356 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.637473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fba464-764f-4fc1-b102-d457ebd386ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.638077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fba464-764f-4fc1-b102-d457ebd386ed admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.638363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fba464-764f-4fc1-b102-d457ebd386ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.638640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fba464-764f-4fc1-b102-d457ebd386ed admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.639332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fba464-764f-4fc1-b102-d457ebd386ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.642671 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 782/1571] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:12.642671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57065e4d-7a26-4ae5-87c6-f26fc25c3f9a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.642886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fba464-764f-4fc1-b102-d457ebd386ed admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.674394 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 790/1572] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:12.674394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fba464-764f-4fc1-b102-d457ebd386ed admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.705583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57065e4d-7a26-4ae5-87c6-f26fc25c3f9a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.735238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fba464-764f-4fc1-b102-d457ebd386ed admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.740128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0747a0e-d56a-4296-8cfe-c1b9322f9edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.740687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0747a0e-d56a-4296-8cfe-c1b9322f9edf admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.740967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0747a0e-d56a-4296-8cfe-c1b9322f9edf admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.741238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0747a0e-d56a-4296-8cfe-c1b9322f9edf admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.741897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0747a0e-d56a-4296-8cfe-c1b9322f9edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.744040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0747a0e-d56a-4296-8cfe-c1b9322f9edf admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.762397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f66a79-db47-4957-9660-e23c001ed8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.763074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f66a79-db47-4957-9660-e23c001ed8b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.763395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f66a79-db47-4957-9660-e23c001ed8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.763691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f66a79-db47-4957-9660-e23c001ed8b7 admin admin] PATH_INFO: `/v3/projects/89f80036653349488d845a112edad062/users/70b634c119834495994f1374e54e9c83/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.765623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f66a79-db47-4957-9660-e23c001ed8b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f80036653349488d845a112edad062, user_id=70b634c119834495994f1374e54e9c83, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.768341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f66a79-db47-4957-9660-e23c001ed8b7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.770559 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 791/1573] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:12.771480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0747a0e-d56a-4296-8cfe-c1b9322f9edf admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.779766 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 783/1574] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:12 2022] PUT /identity/v3/projects/89f80036653349488d845a112edad062/users/70b634c119834495994f1374e54e9c83/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:12.780627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f66a79-db47-4957-9660-e23c001ed8b7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.788474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:12.819300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:12.843011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0747a0e-d56a-4296-8cfe-c1b9322f9edf admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.853928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f66a79-db47-4957-9660-e23c001ed8b7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.858607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff258e74-2337-447a-98ad-8bba4718586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.859233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff258e74-2337-447a-98ad-8bba4718586d admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.859565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff258e74-2337-447a-98ad-8bba4718586d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.859847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff258e74-2337-447a-98ad-8bba4718586d admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.860690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff258e74-2337-447a-98ad-8bba4718586d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.862724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff258e74-2337-447a-98ad-8bba4718586d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.885206 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 784/1575] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:12.885834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff258e74-2337-447a-98ad-8bba4718586d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.897608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff258e74-2337-447a-98ad-8bba4718586d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.901539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23b116-88f6-4be9-b1d0-645afa0ff094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.902204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23b116-88f6-4be9-b1d0-645afa0ff094 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.902488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23b116-88f6-4be9-b1d0-645afa0ff094 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.902765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23b116-88f6-4be9-b1d0-645afa0ff094 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.902901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7270cff-6137-4f5a-a3be-4ecf9bbb3af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.903464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23b116-88f6-4be9-b1d0-645afa0ff094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.903569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7270cff-6137-4f5a-a3be-4ecf9bbb3af2 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.903784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7270cff-6137-4f5a-a3be-4ecf9bbb3af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.904064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7270cff-6137-4f5a-a3be-4ecf9bbb3af2 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.904722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7270cff-6137-4f5a-a3be-4ecf9bbb3af2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.905387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23b116-88f6-4be9-b1d0-645afa0ff094 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.906619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7270cff-6137-4f5a-a3be-4ecf9bbb3af2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.927541 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 792/1576] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:12.928429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23b116-88f6-4be9-b1d0-645afa0ff094 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.932817 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 785/1577] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/users => generated 299 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:12.936482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7270cff-6137-4f5a-a3be-4ecf9bbb3af2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.940484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23b116-88f6-4be9-b1d0-645afa0ff094 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.945240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608ea71-2b44-43e2-8654-fc126c0312f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.945864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608ea71-2b44-43e2-8654-fc126c0312f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.946149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608ea71-2b44-43e2-8654-fc126c0312f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.946426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608ea71-2b44-43e2-8654-fc126c0312f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.947082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608ea71-2b44-43e2-8654-fc126c0312f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.947427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7270cff-6137-4f5a-a3be-4ecf9bbb3af2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:12.949017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608ea71-2b44-43e2-8654-fc126c0312f7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.952351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd53e48-b70d-4f6a-b0fe-f65afca6169f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:12.953009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd53e48-b70d-4f6a-b0fe-f65afca6169f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:12.953297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd53e48-b70d-4f6a-b0fe-f65afca6169f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:12.953837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd53e48-b70d-4f6a-b0fe-f65afca6169f admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:12.954525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd53e48-b70d-4f6a-b0fe-f65afca6169f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:12.956562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd53e48-b70d-4f6a-b0fe-f65afca6169f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:12.980775 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 786/1578] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/users => generated 289 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:12.985007 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 793/1579] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:12.985007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608ea71-2b44-43e2-8654-fc126c0312f7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.985209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd53e48-b70d-4f6a-b0fe-f65afca6169f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:12.995118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd53e48-b70d-4f6a-b0fe-f65afca6169f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.048069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608ea71-2b44-43e2-8654-fc126c0312f7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.052818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c495ae-4b38-42dd-af8e-bd2e888eab69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.053556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c495ae-4b38-42dd-af8e-bd2e888eab69 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.053846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c495ae-4b38-42dd-af8e-bd2e888eab69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.054121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c495ae-4b38-42dd-af8e-bd2e888eab69 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.054812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c495ae-4b38-42dd-af8e-bd2e888eab69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.055872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69afc20-2286-4e3a-a6f5-0ff373be7fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.056496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69afc20-2286-4e3a-a6f5-0ff373be7fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.056775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c495ae-4b38-42dd-af8e-bd2e888eab69 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.056871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69afc20-2286-4e3a-a6f5-0ff373be7fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.057044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69afc20-2286-4e3a-a6f5-0ff373be7fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.057695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69afc20-2286-4e3a-a6f5-0ff373be7fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.059646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69afc20-2286-4e3a-a6f5-0ff373be7fc1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.084328 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 794/1580] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:13.084328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62ca4c-50ff-4570-aac7-650755cddc32 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.084328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62ca4c-50ff-4570-aac7-650755cddc32 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.084649 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 787/1581] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:12 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:13.084754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62ca4c-50ff-4570-aac7-650755cddc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.084834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69afc20-2286-4e3a-a6f5-0ff373be7fc1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.095255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69afc20-2286-4e3a-a6f5-0ff373be7fc1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.100027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d055d68-688e-4260-9e4f-5a36bcf002e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.100629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d055d68-688e-4260-9e4f-5a36bcf002e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.100913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d055d68-688e-4260-9e4f-5a36bcf002e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.101194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d055d68-688e-4260-9e4f-5a36bcf002e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.102437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d055d68-688e-4260-9e4f-5a36bcf002e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.104203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d055d68-688e-4260-9e4f-5a36bcf002e8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.108050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:13.111439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8f62ca4c-50ff-4570-aac7-650755cddc32 None None] MFA Rules not processed for user `70b634c119834495994f1374e54e9c83`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:13.113379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8f62ca4c-50ff-4570-aac7-650755cddc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:13.117667 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 788/1582] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:13.118742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d055d68-688e-4260-9e4f-5a36bcf002e8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.130226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d055d68-688e-4260-9e4f-5a36bcf002e8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.134975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad592f17-430b-4e44-aec5-af14e5914cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.135601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad592f17-430b-4e44-aec5-af14e5914cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.135889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad592f17-430b-4e44-aec5-af14e5914cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.136165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad592f17-430b-4e44-aec5-af14e5914cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.136842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad592f17-430b-4e44-aec5-af14e5914cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.138420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad592f17-430b-4e44-aec5-af14e5914cd7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.148098 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 789/1583] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:13.149048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad592f17-430b-4e44-aec5-af14e5914cd7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.158537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad592f17-430b-4e44-aec5-af14e5914cd7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.163129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70c762-4217-400a-b66f-ac4a563ea5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.163751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70c762-4217-400a-b66f-ac4a563ea5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.164575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70c762-4217-400a-b66f-ac4a563ea5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.164857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70c762-4217-400a-b66f-ac4a563ea5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.165514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70c762-4217-400a-b66f-ac4a563ea5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.167108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70c762-4217-400a-b66f-ac4a563ea5c8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.176995 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 790/1584] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:13.177935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70c762-4217-400a-b66f-ac4a563ea5c8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.187964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70c762-4217-400a-b66f-ac4a563ea5c8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.193456 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 795/1585] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:13.193456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62ca4c-50ff-4570-aac7-650755cddc32 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.193676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7e769-0f2c-4ca9-bb33-0bbe953a05c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.193849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7e769-0f2c-4ca9-bb33-0bbe953a05c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.194165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7e769-0f2c-4ca9-bb33-0bbe953a05c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.194448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7e769-0f2c-4ca9-bb33-0bbe953a05c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.195315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7e769-0f2c-4ca9-bb33-0bbe953a05c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.196800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7e769-0f2c-4ca9-bb33-0bbe953a05c3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.201307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62ca4c-50ff-4570-aac7-650755cddc32 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.205975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b60ba-a1d0-44d1-8231-ab45733896ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.206769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b60ba-a1d0-44d1-8231-ab45733896ed admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.206859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b60ba-a1d0-44d1-8231-ab45733896ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.207159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b60ba-a1d0-44d1-8231-ab45733896ed admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.207857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b60ba-a1d0-44d1-8231-ab45733896ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.209780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b60ba-a1d0-44d1-8231-ab45733896ed admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.211696 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 791/1586] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:13.212622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7e769-0f2c-4ca9-bb33-0bbe953a05c3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.223234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7e769-0f2c-4ca9-bb33-0bbe953a05c3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.228928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fcd54-c3b7-49b9-b28a-983a9e514a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.229582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fcd54-c3b7-49b9-b28a-983a9e514a33 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.229895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fcd54-c3b7-49b9-b28a-983a9e514a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.230322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fcd54-c3b7-49b9-b28a-983a9e514a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.230944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fcd54-c3b7-49b9-b28a-983a9e514a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.232714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fcd54-c3b7-49b9-b28a-983a9e514a33 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.236896 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 796/1587] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:13 2022] POST /identity/v3/users => generated 292 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:13.241220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b60ba-a1d0-44d1-8231-ab45733896ed admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.246811 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 792/1588] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:13.246811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fcd54-c3b7-49b9-b28a-983a9e514a33 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.252073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b60ba-a1d0-44d1-8231-ab45733896ed admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.254446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fcd54-c3b7-49b9-b28a-983a9e514a33 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.256637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399e5ba-829c-4450-b7a2-66a477bf7d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.257242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399e5ba-829c-4450-b7a2-66a477bf7d11 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.257531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399e5ba-829c-4450-b7a2-66a477bf7d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.257856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399e5ba-829c-4450-b7a2-66a477bf7d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.258548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399e5ba-829c-4450-b7a2-66a477bf7d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.259612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a287bfc-27c0-4563-a41e-56b7b228f331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.260168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399e5ba-829c-4450-b7a2-66a477bf7d11 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.260273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a287bfc-27c0-4563-a41e-56b7b228f331 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.260474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a287bfc-27c0-4563-a41e-56b7b228f331 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.260750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a287bfc-27c0-4563-a41e-56b7b228f331 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.261423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a287bfc-27c0-4563-a41e-56b7b228f331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.262974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a287bfc-27c0-4563-a41e-56b7b228f331 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.270168 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 797/1589] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:13.271083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399e5ba-829c-4450-b7a2-66a477bf7d11 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.277062 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 793/1590] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:13.277062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a287bfc-27c0-4563-a41e-56b7b228f331 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.281555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399e5ba-829c-4450-b7a2-66a477bf7d11 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.284287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:13.286556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41077dd-8dd7-4b2a-8b1a-8bb00ffa6994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.287167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41077dd-8dd7-4b2a-8b1a-8bb00ffa6994 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.287487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41077dd-8dd7-4b2a-8b1a-8bb00ffa6994 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.287766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41077dd-8dd7-4b2a-8b1a-8bb00ffa6994 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.288542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a287bfc-27c0-4563-a41e-56b7b228f331 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.288664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41077dd-8dd7-4b2a-8b1a-8bb00ffa6994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.290670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41077dd-8dd7-4b2a-8b1a-8bb00ffa6994 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.295227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806713dc-dd5e-47ad-8ca4-08ec54546bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.295890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806713dc-dd5e-47ad-8ca4-08ec54546bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.296161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806713dc-dd5e-47ad-8ca4-08ec54546bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.296443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806713dc-dd5e-47ad-8ca4-08ec54546bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.297133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806713dc-dd5e-47ad-8ca4-08ec54546bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.298723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806713dc-dd5e-47ad-8ca4-08ec54546bf6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.301974 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 798/1591] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:13.306061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b2ecf-bc01-45d5-868e-dc99ebfafbc7 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.306061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b2ecf-bc01-45d5-868e-dc99ebfafbc7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.306061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b2ecf-bc01-45d5-868e-dc99ebfafbc7 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.306061 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 799/1592] 10.222.0.17 () {54 vars in 962 bytes} [Sat Jul 30 21:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:00:13.310753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b2ecf-bc01-45d5-868e-dc99ebfafbc7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.311068 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 794/1593] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:13.311916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806713dc-dd5e-47ad-8ca4-08ec54546bf6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.324808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806713dc-dd5e-47ad-8ca4-08ec54546bf6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.326359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b2ecf-bc01-45d5-868e-dc99ebfafbc7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.329472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedf979-3ade-4f14-9d28-b13cb77ac8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.330086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedf979-3ade-4f14-9d28-b13cb77ac8bb admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.330375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedf979-3ade-4f14-9d28-b13cb77ac8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.330654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedf979-3ade-4f14-9d28-b13cb77ac8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.331166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e08704-fd24-4e28-af41-fd86e17033fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.331373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eedf979-3ade-4f14-9d28-b13cb77ac8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.331818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e08704-fd24-4e28-af41-fd86e17033fb admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.332118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e08704-fd24-4e28-af41-fd86e17033fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.332368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e08704-fd24-4e28-af41-fd86e17033fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.332971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eedf979-3ade-4f14-9d28-b13cb77ac8bb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.333061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e08704-fd24-4e28-af41-fd86e17033fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.334621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e08704-fd24-4e28-af41-fd86e17033fb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.343102 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 795/1594] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:13.344012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedf979-3ade-4f14-9d28-b13cb77ac8bb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.344933 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 800/1595] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:13.345706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e08704-fd24-4e28-af41-fd86e17033fb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.355107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedf979-3ade-4f14-9d28-b13cb77ac8bb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.356058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e08704-fd24-4e28-af41-fd86e17033fb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.359855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6441df-92a2-4635-82cf-919fb0875e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.360465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6441df-92a2-4635-82cf-919fb0875e95 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.360585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02aa7eb-29f1-42af-9313-a12aee5404c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.360753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6441df-92a2-4635-82cf-919fb0875e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.361036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6441df-92a2-4635-82cf-919fb0875e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.361150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02aa7eb-29f1-42af-9313-a12aee5404c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.361415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02aa7eb-29f1-42af-9313-a12aee5404c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.361737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02aa7eb-29f1-42af-9313-a12aee5404c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.361842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6441df-92a2-4635-82cf-919fb0875e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.362427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02aa7eb-29f1-42af-9313-a12aee5404c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.363427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6441df-92a2-4635-82cf-919fb0875e95 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.364039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02aa7eb-29f1-42af-9313-a12aee5404c6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.375165 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 801/1596] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:13.378514 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 796/1597] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:13.378647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02aa7eb-29f1-42af-9313-a12aee5404c6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.378731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6441df-92a2-4635-82cf-919fb0875e95 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.387501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6441df-92a2-4635-82cf-919fb0875e95 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.388353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02aa7eb-29f1-42af-9313-a12aee5404c6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.392380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a250c6-8ebb-42b6-b7d9-459e6e19822e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.393078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a250c6-8ebb-42b6-b7d9-459e6e19822e admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.393281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb702ce9-c002-40b5-bc7b-9e9d3a77d6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.394005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a250c6-8ebb-42b6-b7d9-459e6e19822e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.394102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb702ce9-c002-40b5-bc7b-9e9d3a77d6b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.394296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb702ce9-c002-40b5-bc7b-9e9d3a77d6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.394399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a250c6-8ebb-42b6-b7d9-459e6e19822e admin admin] PATH_INFO: `/v3/projects/2f87eeda7c9a434988b863bf4cb4aac5/users/9f72dcea32a247a0acf5de5e051172a1/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.394573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb702ce9-c002-40b5-bc7b-9e9d3a77d6b3 admin admin] PATH_INFO: `/v3/projects/cd1b52c6bed8447e9ddd28b7ddd5ad63/users/2ae4c3f8eff14a678504413fa7148941/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.411509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a250c6-8ebb-42b6-b7d9-459e6e19822e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f87eeda7c9a434988b863bf4cb4aac5, user_id=9f72dcea32a247a0acf5de5e051172a1, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.412032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb702ce9-c002-40b5-bc7b-9e9d3a77d6b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1b52c6bed8447e9ddd28b7ddd5ad63, user_id=2ae4c3f8eff14a678504413fa7148941, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.414832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a250c6-8ebb-42b6-b7d9-459e6e19822e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.415263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb702ce9-c002-40b5-bc7b-9e9d3a77d6b3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.432754 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 802/1599] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:13 2022] PUT /identity/v3/projects/cd1b52c6bed8447e9ddd28b7ddd5ad63/users/2ae4c3f8eff14a678504413fa7148941/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:13.434132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaf545-2bb0-4c57-ba5d-dd07e21761d4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.434427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaf545-2bb0-4c57-ba5d-dd07e21761d4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.434708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaf545-2bb0-4c57-ba5d-dd07e21761d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.439439 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 797/1599] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:13 2022] PUT /identity/v3/projects/2f87eeda7c9a434988b863bf4cb4aac5/users/9f72dcea32a247a0acf5de5e051172a1/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:13.440450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a250c6-8ebb-42b6-b7d9-459e6e19822e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.485790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-defaf545-2bb0-4c57-ba5d-dd07e21761d4 None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:13.486575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-defaf545-2bb0-4c57-ba5d-dd07e21761d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:13.512685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a250c6-8ebb-42b6-b7d9-459e6e19822e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.540101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:13.557368 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 803/1600] 10.222.0.17 () {58 vars in 1059 bytes} [Sat Jul 30 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:13.558168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defaf545-2bb0-4c57-ba5d-dd07e21761d4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.573071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8144bb9-6189-4763-a8cd-bc84ec1d1c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.573770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8144bb9-6189-4763-a8cd-bc84ec1d1c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.574057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8144bb9-6189-4763-a8cd-bc84ec1d1c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.574334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8144bb9-6189-4763-a8cd-bc84ec1d1c3d admin admin] PATH_INFO: `/v3/projects/603b48785619497baa6cf515d2154c72/users/0e4da74f5cab4cb3b8f0cbd3a57ba858/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.589053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8144bb9-6189-4763-a8cd-bc84ec1d1c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=603b48785619497baa6cf515d2154c72, user_id=0e4da74f5cab4cb3b8f0cbd3a57ba858, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.591742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8144bb9-6189-4763-a8cd-bc84ec1d1c3d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.606276 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 798/1601] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:13 2022] PUT /identity/v3/projects/603b48785619497baa6cf515d2154c72/users/0e4da74f5cab4cb3b8f0cbd3a57ba858/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:13.607271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8144bb9-6189-4763-a8cd-bc84ec1d1c3d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.628123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defaf545-2bb0-4c57-ba5d-dd07e21761d4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.648014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:13.671225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8144bb9-6189-4763-a8cd-bc84ec1d1c3d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.676022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e3300-6bd9-45bb-8fc4-a24245919897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.676650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e3300-6bd9-45bb-8fc4-a24245919897 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.676936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e3300-6bd9-45bb-8fc4-a24245919897 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.677220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e3300-6bd9-45bb-8fc4-a24245919897 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.677922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e3300-6bd9-45bb-8fc4-a24245919897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.679592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e3300-6bd9-45bb-8fc4-a24245919897 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.686642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca609990-3134-404f-bd13-56636d96e0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.687340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca609990-3134-404f-bd13-56636d96e0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.687633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca609990-3134-404f-bd13-56636d96e0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.687916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca609990-3134-404f-bd13-56636d96e0e4 admin admin] PATH_INFO: `/v3/projects/90b1500a858541a9b3ff58c218737af4/users/00ba1ceba6654cbd8cd4b48615f20759/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.689349 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 799/1602] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:13.690127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e3300-6bd9-45bb-8fc4-a24245919897 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.699682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e3300-6bd9-45bb-8fc4-a24245919897 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.704375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfefeb-c6fc-4e36-a9bc-5282e7325037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.705047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfefeb-c6fc-4e36-a9bc-5282e7325037 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.705165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca609990-3134-404f-bd13-56636d96e0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90b1500a858541a9b3ff58c218737af4, user_id=00ba1ceba6654cbd8cd4b48615f20759, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.705339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfefeb-c6fc-4e36-a9bc-5282e7325037 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.705618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfefeb-c6fc-4e36-a9bc-5282e7325037 admin admin] PATH_INFO: `/v3/projects/6e222c39108c4ab787d3576d5215aeea/users/93ee771e50474e268eae2fed07e43fe7/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.707942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca609990-3134-404f-bd13-56636d96e0e4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.733750 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 804/1603] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:13 2022] PUT /identity/v3/projects/90b1500a858541a9b3ff58c218737af4/users/00ba1ceba6654cbd8cd4b48615f20759/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:13.733924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfefeb-c6fc-4e36-a9bc-5282e7325037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e222c39108c4ab787d3576d5215aeea, user_id=93ee771e50474e268eae2fed07e43fe7, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.734036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca609990-3134-404f-bd13-56636d96e0e4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.734129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfefeb-c6fc-4e36-a9bc-5282e7325037 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.745486 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 800/1604] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:13 2022] PUT /identity/v3/projects/6e222c39108c4ab787d3576d5215aeea/users/93ee771e50474e268eae2fed07e43fe7/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:13.747187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de26e8-e95a-4567-820d-40058b2b9360 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.747665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de26e8-e95a-4567-820d-40058b2b9360 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.748112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de26e8-e95a-4567-820d-40058b2b9360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.778037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d3de26e8-e95a-4567-820d-40058b2b9360 None None] MFA Rules not processed for user `9f72dcea32a247a0acf5de5e051172a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:13.779208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d3de26e8-e95a-4567-820d-40058b2b9360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:13.787521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca609990-3134-404f-bd13-56636d96e0e4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.813921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:13.849290 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 801/1605] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:13.850414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088df8d-f62b-41a4-8ee5-392d97712ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.850537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e87abb-db0f-47b4-b63a-168fc94e91f3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.850823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e87abb-db0f-47b4-b63a-168fc94e91f3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.851093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e87abb-db0f-47b4-b63a-168fc94e91f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.851212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088df8d-f62b-41a4-8ee5-392d97712ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.851556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088df8d-f62b-41a4-8ee5-392d97712ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.851855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088df8d-f62b-41a4-8ee5-392d97712ddb admin admin] PATH_INFO: `/v3/projects/7e4dfaf867064cf5ae93785ae4224b37/users/4fbaf50b739d49c0b60b515322d42b8d/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.867688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088df8d-f62b-41a4-8ee5-392d97712ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4dfaf867064cf5ae93785ae4224b37, user_id=4fbaf50b739d49c0b60b515322d42b8d, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:13.870564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088df8d-f62b-41a4-8ee5-392d97712ddb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:13.883636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-97e87abb-db0f-47b4-b63a-168fc94e91f3 None None] MFA Rules not processed for user `2ae4c3f8eff14a678504413fa7148941`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:13.884849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-97e87abb-db0f-47b4-b63a-168fc94e91f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:13.887143 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 805/1606] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:13 2022] PUT /identity/v3/projects/7e4dfaf867064cf5ae93785ae4224b37/users/4fbaf50b739d49c0b60b515322d42b8d/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:13.892976 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088df8d-f62b-41a4-8ee5-392d97712ddb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:13.950833 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 802/1607] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:13.951987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20273004-5cad-423e-8a77-63e8c004b75d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.952282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20273004-5cad-423e-8a77-63e8c004b75d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.952570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20273004-5cad-423e-8a77-63e8c004b75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.967801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088df8d-f62b-41a4-8ee5-392d97712ddb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:13.973645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e337ed-2e08-45de-897a-e1f48df7ed70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:13.974470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e337ed-2e08-45de-897a-e1f48df7ed70 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:13.974753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e337ed-2e08-45de-897a-e1f48df7ed70 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:13.975025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e337ed-2e08-45de-897a-e1f48df7ed70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:13.980804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-20273004-5cad-423e-8a77-63e8c004b75d None None] MFA Rules not processed for user `0e4da74f5cab4cb3b8f0cbd3a57ba858`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:13.982259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-20273004-5cad-423e-8a77-63e8c004b75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:14.009991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:14.042375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e337ed-2e08-45de-897a-e1f48df7ed70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:14.044026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e337ed-2e08-45de-897a-e1f48df7ed70 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:14.053948 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 806/1608] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:13 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:14.054700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e337ed-2e08-45de-897a-e1f48df7ed70 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:14.061580 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 803/1609] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:14.064769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce594f30-c358-4ac5-a1b6-663d9f654aad None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:14.065330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce594f30-c358-4ac5-a1b6-663d9f654aad None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:14.065781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce594f30-c358-4ac5-a1b6-663d9f654aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:14.097003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ce594f30-c358-4ac5-a1b6-663d9f654aad None None] MFA Rules not processed for user `00ba1ceba6654cbd8cd4b48615f20759`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:14.098593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ce594f30-c358-4ac5-a1b6-663d9f654aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:14.100955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:14.122711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e337ed-2e08-45de-897a-e1f48df7ed70 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:14.128860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc7074-8fb2-4822-869b-36b0d78db2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:14.129668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc7074-8fb2-4822-869b-36b0d78db2e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:14.129957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc7074-8fb2-4822-869b-36b0d78db2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:14.130237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc7074-8fb2-4822-869b-36b0d78db2e4 admin admin] PATH_INFO: `/v3/projects/e80c1509c60d46bda7b1c4793260ab40/users/f724ca9bef02478da3b1696b379dc027/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:14.147092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc7074-8fb2-4822-869b-36b0d78db2e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80c1509c60d46bda7b1c4793260ab40, user_id=f724ca9bef02478da3b1696b379dc027, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:14.150637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc7074-8fb2-4822-869b-36b0d78db2e4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:14.164623 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 807/1610] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:14 2022] PUT /identity/v3/projects/e80c1509c60d46bda7b1c4793260ab40/users/f724ca9bef02478da3b1696b379dc027/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:14.165864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9705e09-1de4-4c26-a4c8-2c5827a32a97 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:14.166148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9705e09-1de4-4c26-a4c8-2c5827a32a97 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:14.166647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9705e09-1de4-4c26-a4c8-2c5827a32a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:14.173772 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 804/1611] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:14.174421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce594f30-c358-4ac5-a1b6-663d9f654aad None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:14.190059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce594f30-c358-4ac5-a1b6-663d9f654aad None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:14.207332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e9705e09-1de4-4c26-a4c8-2c5827a32a97 None None] MFA Rules not processed for user `93ee771e50474e268eae2fed07e43fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:14.208632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e9705e09-1de4-4c26-a4c8-2c5827a32a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:14.249589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83d5ce-5fc2-440d-b153-45fa7de8878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:14.250238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83d5ce-5fc2-440d-b153-45fa7de8878d admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:14.250523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83d5ce-5fc2-440d-b153-45fa7de8878d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:14.250800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83d5ce-5fc2-440d-b153-45fa7de8878d admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:14.251496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83d5ce-5fc2-440d-b153-45fa7de8878d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:14.253396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83d5ce-5fc2-440d-b153-45fa7de8878d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:14.285024 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 808/1612] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:14.285357 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 805/1613] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:14 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:14.285357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83d5ce-5fc2-440d-b153-45fa7de8878d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:14.286092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571521a-4bcf-43f5-9a78-13eeaa77b3f7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:14.286400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571521a-4bcf-43f5-9a78-13eeaa77b3f7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:14.286689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571521a-4bcf-43f5-9a78-13eeaa77b3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:14.332469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7571521a-4bcf-43f5-9a78-13eeaa77b3f7 None None] MFA Rules not processed for user `4fbaf50b739d49c0b60b515322d42b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:14.333752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7571521a-4bcf-43f5-9a78-13eeaa77b3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:14.335472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:14.378313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83d5ce-5fc2-440d-b153-45fa7de8878d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:14.385028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f44e2-4c46-4eff-b260-27b90d2e435e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:14.385653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f44e2-4c46-4eff-b260-27b90d2e435e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:14.385934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f44e2-4c46-4eff-b260-27b90d2e435e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:14.386206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f44e2-4c46-4eff-b260-27b90d2e435e admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:14.386873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f44e2-4c46-4eff-b260-27b90d2e435e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:14.388800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f44e2-4c46-4eff-b260-27b90d2e435e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:14.415941 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 809/1614] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:14.416134 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 806/1615] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:14 2022] POST /identity/v3/projects => generated 393 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:14.419715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571521a-4bcf-43f5-9a78-13eeaa77b3f7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:14.419850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c5aaa-2c00-48d4-b418-b72044a0e232 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:14.419850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c5aaa-2c00-48d4-b418-b72044a0e232 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:14.419850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c5aaa-2c00-48d4-b418-b72044a0e232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:14.430568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571521a-4bcf-43f5-9a78-13eeaa77b3f7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:14.446285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-158c5aaa-2c00-48d4-b418-b72044a0e232 None None] MFA Rules not processed for user `f724ca9bef02478da3b1696b379dc027`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:14.447527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-158c5aaa-2c00-48d4-b418-b72044a0e232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:14.474375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:14.488673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf7b57-54fd-48cd-a621-08152aaf288b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:14.489489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf7b57-54fd-48cd-a621-08152aaf288b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:14.489964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf7b57-54fd-48cd-a621-08152aaf288b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:14.490195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf7b57-54fd-48cd-a621-08152aaf288b admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:14.490876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf7b57-54fd-48cd-a621-08152aaf288b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:14.493546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf7b57-54fd-48cd-a621-08152aaf288b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:14.513601 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 807/1616] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:14.514247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c5aaa-2c00-48d4-b418-b72044a0e232 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:14.527381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c5aaa-2c00-48d4-b418-b72044a0e232 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:14.530947 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 810/1617] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:14 2022] POST /identity/v3/projects => generated 395 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:14.530947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf7b57-54fd-48cd-a621-08152aaf288b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:14.590076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741f1c9-5cdd-4ced-bf06-04fb66a7044e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:14.590704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741f1c9-5cdd-4ced-bf06-04fb66a7044e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:14.590996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741f1c9-5cdd-4ced-bf06-04fb66a7044e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:14.591273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741f1c9-5cdd-4ced-bf06-04fb66a7044e admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:14.591963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741f1c9-5cdd-4ced-bf06-04fb66a7044e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:14.593870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741f1c9-5cdd-4ced-bf06-04fb66a7044e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:14.602479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf7b57-54fd-48cd-a621-08152aaf288b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:14.607334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bfaf9-a3ad-432a-bd66-383dcbb67a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:14.608022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bfaf9-a3ad-432a-bd66-383dcbb67a22 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:14.608247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bfaf9-a3ad-432a-bd66-383dcbb67a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:14.608527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bfaf9-a3ad-432a-bd66-383dcbb67a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:14.609361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36bfaf9-a3ad-432a-bd66-383dcbb67a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:14.611397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36bfaf9-a3ad-432a-bd66-383dcbb67a22 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:14.622875 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 808/1618] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:14 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:14.623607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741f1c9-5cdd-4ced-bf06-04fb66a7044e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:14.640649 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 811/1619] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:14 2022] POST /identity/v3/projects => generated 389 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:14.641751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110aa26d-40ed-4996-b9f3-4bb7ba9ec124 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:14.642045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110aa26d-40ed-4996-b9f3-4bb7ba9ec124 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:14.642324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110aa26d-40ed-4996-b9f3-4bb7ba9ec124 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:14.643740 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 812/1620] 10.222.0.17 () {54 vars in 962 bytes} [Sat Jul 30 21:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:00:14.648125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110aa26d-40ed-4996-b9f3-4bb7ba9ec124 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:14.668259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:14.698670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741f1c9-5cdd-4ced-bf06-04fb66a7044e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:14.715498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110aa26d-40ed-4996-b9f3-4bb7ba9ec124 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:14.720134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85791617-1005-438b-a7d0-6a88ce46d3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:14.720756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85791617-1005-438b-a7d0-6a88ce46d3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:14.721043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85791617-1005-438b-a7d0-6a88ce46d3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:14.721325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85791617-1005-438b-a7d0-6a88ce46d3f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:14.721988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85791617-1005-438b-a7d0-6a88ce46d3f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:14.723938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85791617-1005-438b-a7d0-6a88ce46d3f4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:14.754997 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 813/1621] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:14 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:14.755877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85791617-1005-438b-a7d0-6a88ce46d3f4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:14.758915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66aa169-1ae0-4b26-9820-cb77601e46b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:14.759639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66aa169-1ae0-4b26-9820-cb77601e46b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:14.759934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66aa169-1ae0-4b26-9820-cb77601e46b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:14.760214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66aa169-1ae0-4b26-9820-cb77601e46b4 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:14.760884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66aa169-1ae0-4b26-9820-cb77601e46b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:14.762814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66aa169-1ae0-4b26-9820-cb77601e46b4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:14.786742 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 809/1622] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:14 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:14.786742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66aa169-1ae0-4b26-9820-cb77601e46b4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:14.794689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66aa169-1ae0-4b26-9820-cb77601e46b4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:14.806579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:14.826762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85791617-1005-438b-a7d0-6a88ce46d3f4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:14.831421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017fda1-a430-4fa6-a952-aec4072ea6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:14.832041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017fda1-a430-4fa6-a952-aec4072ea6dd admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:14.832324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017fda1-a430-4fa6-a952-aec4072ea6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:14.832599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017fda1-a430-4fa6-a952-aec4072ea6dd admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:14.833249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017fda1-a430-4fa6-a952-aec4072ea6dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:14.835359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017fda1-a430-4fa6-a952-aec4072ea6dd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:14.854860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b993e3-e6e7-4eb3-b161-b56080afee73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:14.855463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b993e3-e6e7-4eb3-b161-b56080afee73 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:14.855741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b993e3-e6e7-4eb3-b161-b56080afee73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:14.856028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b993e3-e6e7-4eb3-b161-b56080afee73 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:14.856702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b993e3-e6e7-4eb3-b161-b56080afee73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:14.856806 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 814/1623] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:14 2022] POST /identity/v3/users => generated 303 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:14.857551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017fda1-a430-4fa6-a952-aec4072ea6dd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:14.858610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b993e3-e6e7-4eb3-b161-b56080afee73 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:14.867990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017fda1-a430-4fa6-a952-aec4072ea6dd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:14.873240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d282e88-12ce-43a1-ae7b-3860f1e3317c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:14.873859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d282e88-12ce-43a1-ae7b-3860f1e3317c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:14.874195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d282e88-12ce-43a1-ae7b-3860f1e3317c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:14.874550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d282e88-12ce-43a1-ae7b-3860f1e3317c admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:14.875190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d282e88-12ce-43a1-ae7b-3860f1e3317c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:14.877377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d282e88-12ce-43a1-ae7b-3860f1e3317c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:14.890656 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 810/1624] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:14 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:14.891447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b993e3-e6e7-4eb3-b161-b56080afee73 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:14.902544 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 815/1625] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:14 2022] POST /identity/v3/users => generated 304 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:14.903781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d282e88-12ce-43a1-ae7b-3860f1e3317c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:14.918933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d282e88-12ce-43a1-ae7b-3860f1e3317c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:14.953558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:14.958951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b993e3-e6e7-4eb3-b161-b56080afee73 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:14.964804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23307d3-42c8-412a-ac87-48279239f7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:14.965471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23307d3-42c8-412a-ac87-48279239f7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:14.965753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23307d3-42c8-412a-ac87-48279239f7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:14.966118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23307d3-42c8-412a-ac87-48279239f7b4 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:14.966766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23307d3-42c8-412a-ac87-48279239f7b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:14.969176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23307d3-42c8-412a-ac87-48279239f7b4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:14.986502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26317c-3a92-4469-8057-bea06b63d785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:14.987135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26317c-3a92-4469-8057-bea06b63d785 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:14.987486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26317c-3a92-4469-8057-bea06b63d785 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:14.987767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26317c-3a92-4469-8057-bea06b63d785 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:14.988439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26317c-3a92-4469-8057-bea06b63d785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:14.990367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26317c-3a92-4469-8057-bea06b63d785 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:14.995564 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 811/1626] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:14 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:15.000324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757d347-0a5e-4fb0-b45c-d7b87442199c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.000324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757d347-0a5e-4fb0-b45c-d7b87442199c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.000534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757d347-0a5e-4fb0-b45c-d7b87442199c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.021091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7757d347-0a5e-4fb0-b45c-d7b87442199c None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:15.022301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7757d347-0a5e-4fb0-b45c-d7b87442199c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:15.049524 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 816/1627] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:14 2022] POST /identity/v3/users => generated 301 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:15.050481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26317c-3a92-4469-8057-bea06b63d785 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.060300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26317c-3a92-4469-8057-bea06b63d785 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.065149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2a340-b8b0-4a37-82d1-6d0551c45f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.065802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2a340-b8b0-4a37-82d1-6d0551c45f1a admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.066082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2a340-b8b0-4a37-82d1-6d0551c45f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.066357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2a340-b8b0-4a37-82d1-6d0551c45f1a admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.067239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2a340-b8b0-4a37-82d1-6d0551c45f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.069044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2a340-b8b0-4a37-82d1-6d0551c45f1a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.091576 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 817/1628] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:15 2022] POST /identity/v3/users => generated 297 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:15.092465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2a340-b8b0-4a37-82d1-6d0551c45f1a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.098736 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 812/1629] 10.222.0.17 () {58 vars in 1059 bytes} [Sat Jul 30 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:15.099692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757d347-0a5e-4fb0-b45c-d7b87442199c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.103069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2a340-b8b0-4a37-82d1-6d0551c45f1a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.108219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15640066-4464-4854-a953-6084c23da0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.109049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15640066-4464-4854-a953-6084c23da0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.109338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15640066-4464-4854-a953-6084c23da0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.109615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15640066-4464-4854-a953-6084c23da0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.110313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15640066-4464-4854-a953-6084c23da0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.110765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757d347-0a5e-4fb0-b45c-d7b87442199c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.111947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15640066-4464-4854-a953-6084c23da0c8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.116220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8884e-7ab9-4f44-826c-feb48ef677e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.116825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8884e-7ab9-4f44-826c-feb48ef677e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.117113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8884e-7ab9-4f44-826c-feb48ef677e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.117388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8884e-7ab9-4f44-826c-feb48ef677e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.118078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8884e-7ab9-4f44-826c-feb48ef677e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.119697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8884e-7ab9-4f44-826c-feb48ef677e0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.124323 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 818/1630] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:15.125115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15640066-4464-4854-a953-6084c23da0c8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.133389 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 813/1631] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:15.133389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8884e-7ab9-4f44-826c-feb48ef677e0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.138346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15640066-4464-4854-a953-6084c23da0c8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.140838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8884e-7ab9-4f44-826c-feb48ef677e0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.143458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45986d-9053-4568-941e-8315ea7ced1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.144117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45986d-9053-4568-941e-8315ea7ced1b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.144436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45986d-9053-4568-941e-8315ea7ced1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.144716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45986d-9053-4568-941e-8315ea7ced1b admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.145424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45986d-9053-4568-941e-8315ea7ced1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.145524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4824292-cb62-4b15-a1a1-db7bd80fcc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.146090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4824292-cb62-4b15-a1a1-db7bd80fcc94 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.146379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4824292-cb62-4b15-a1a1-db7bd80fcc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.146674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4824292-cb62-4b15-a1a1-db7bd80fcc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.147381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4824292-cb62-4b15-a1a1-db7bd80fcc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.147465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45986d-9053-4568-941e-8315ea7ced1b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.149440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4824292-cb62-4b15-a1a1-db7bd80fcc94 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.162233 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 814/1632] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:15.162233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4824292-cb62-4b15-a1a1-db7bd80fcc94 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.170605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4824292-cb62-4b15-a1a1-db7bd80fcc94 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.173549 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 819/1633] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:15 2022] POST /identity/v3/users => generated 297 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:15.174395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45986d-9053-4568-941e-8315ea7ced1b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.178098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e33dd8-434d-48a4-9de7-b8e3f10d9342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.178707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e33dd8-434d-48a4-9de7-b8e3f10d9342 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.179092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e33dd8-434d-48a4-9de7-b8e3f10d9342 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.179425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e33dd8-434d-48a4-9de7-b8e3f10d9342 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.180117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e33dd8-434d-48a4-9de7-b8e3f10d9342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.181746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e33dd8-434d-48a4-9de7-b8e3f10d9342 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.185788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45986d-9053-4568-941e-8315ea7ced1b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.190446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20ba63-941f-4c9e-8f02-ba209b295326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.191045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20ba63-941f-4c9e-8f02-ba209b295326 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.191390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20ba63-941f-4c9e-8f02-ba209b295326 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.191669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20ba63-941f-4c9e-8f02-ba209b295326 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.192587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20ba63-941f-4c9e-8f02-ba209b295326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.192703 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 815/1634] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:15.193229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e33dd8-434d-48a4-9de7-b8e3f10d9342 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.194189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20ba63-941f-4c9e-8f02-ba209b295326 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.202820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e33dd8-434d-48a4-9de7-b8e3f10d9342 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.208328 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 820/1635] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:15.208328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20ba63-941f-4c9e-8f02-ba209b295326 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.210208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7718b86-3566-435f-800e-e713c3080bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.211377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7718b86-3566-435f-800e-e713c3080bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.211670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7718b86-3566-435f-800e-e713c3080bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.211953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7718b86-3566-435f-800e-e713c3080bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.212646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7718b86-3566-435f-800e-e713c3080bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.214278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7718b86-3566-435f-800e-e713c3080bb6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.220483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20ba63-941f-4c9e-8f02-ba209b295326 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.225210 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 816/1636] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:15.226120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7718b86-3566-435f-800e-e713c3080bb6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.230033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2c997-959d-4c04-a0c4-b4ba1319f1c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.230656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2c997-959d-4c04-a0c4-b4ba1319f1c3 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.230947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2c997-959d-4c04-a0c4-b4ba1319f1c3 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.231231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2c997-959d-4c04-a0c4-b4ba1319f1c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.236524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7718b86-3566-435f-800e-e713c3080bb6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.241090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ef0d9-7906-4521-bb3d-2d5e19a84c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.241727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ef0d9-7906-4521-bb3d-2d5e19a84c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.242061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ef0d9-7906-4521-bb3d-2d5e19a84c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.242344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ef0d9-7906-4521-bb3d-2d5e19a84c05 admin admin] PATH_INFO: `/v3/projects/093c5163138a4e30b656d37de5fa6e34/users/218aa51821c74c179a5ea500e929e765/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.257242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ef0d9-7906-4521-bb3d-2d5e19a84c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=093c5163138a4e30b656d37de5fa6e34, user_id=218aa51821c74c179a5ea500e929e765, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.260429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ef0d9-7906-4521-bb3d-2d5e19a84c05 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.274047 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 817/1637] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:15 2022] PUT /identity/v3/projects/093c5163138a4e30b656d37de5fa6e34/users/218aa51821c74c179a5ea500e929e765/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:15.274894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ef0d9-7906-4521-bb3d-2d5e19a84c05 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.277803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=85,keystone:INSERT=15 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:15.292514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2c997-959d-4c04-a0c4-b4ba1319f1c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.294223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2c997-959d-4c04-a0c4-b4ba1319f1c3 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.303678 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 821/1638] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:15 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:15.304538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2c997-959d-4c04-a0c4-b4ba1319f1c3 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.314306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2c997-959d-4c04-a0c4-b4ba1319f1c3 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.340727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ef0d9-7906-4521-bb3d-2d5e19a84c05 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.345819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9f897-ccc6-4f02-ae8b-0a4b3543233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.346508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9f897-ccc6-4f02-ae8b-0a4b3543233d admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.347184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9f897-ccc6-4f02-ae8b-0a4b3543233d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.347515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9f897-ccc6-4f02-ae8b-0a4b3543233d admin admin] PATH_INFO: `/v3/projects/8aa936cca6ab4515ab2e7fe95c5a88dd/users/ae22ffc246c149f590746541765a235d/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.361052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:15.365547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9f897-ccc6-4f02-ae8b-0a4b3543233d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa936cca6ab4515ab2e7fe95c5a88dd, user_id=ae22ffc246c149f590746541765a235d, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.368774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9f897-ccc6-4f02-ae8b-0a4b3543233d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.380492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb52bb-a72f-4ed1-88df-da1c8f677841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.381176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb52bb-a72f-4ed1-88df-da1c8f677841 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.381522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb52bb-a72f-4ed1-88df-da1c8f677841 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.381814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb52bb-a72f-4ed1-88df-da1c8f677841 admin admin] PATH_INFO: `/v3/projects/3881e3e74f1440439e1a547ca96653ca/users/d7f4831e593d4e1591f84887c02d7d54/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.384508 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 818/1639] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:15 2022] PUT /identity/v3/projects/8aa936cca6ab4515ab2e7fe95c5a88dd/users/ae22ffc246c149f590746541765a235d/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:15.385070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9f897-ccc6-4f02-ae8b-0a4b3543233d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.401313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb52bb-a72f-4ed1-88df-da1c8f677841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3881e3e74f1440439e1a547ca96653ca, user_id=d7f4831e593d4e1591f84887c02d7d54, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.404269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb52bb-a72f-4ed1-88df-da1c8f677841 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.418193 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 822/1640] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:15 2022] PUT /identity/v3/projects/3881e3e74f1440439e1a547ca96653ca/users/d7f4831e593d4e1591f84887c02d7d54/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:15.418829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb52bb-a72f-4ed1-88df-da1c8f677841 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.461495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9f897-ccc6-4f02-ae8b-0a4b3543233d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.483468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb52bb-a72f-4ed1-88df-da1c8f677841 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.488273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c668c-bbbb-4b3f-b960-7f47410410ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.488984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c668c-bbbb-4b3f-b960-7f47410410ab admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.489273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c668c-bbbb-4b3f-b960-7f47410410ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.489555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c668c-bbbb-4b3f-b960-7f47410410ab admin admin] PATH_INFO: `/v3/projects/6fb829f854e141608eabae2e92e4a67a/users/37ab6d2c416e4f39945577268bd89bde/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.505625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c668c-bbbb-4b3f-b960-7f47410410ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb829f854e141608eabae2e92e4a67a, user_id=37ab6d2c416e4f39945577268bd89bde, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.508375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c668c-bbbb-4b3f-b960-7f47410410ab admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.522273 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 823/1641] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:15 2022] PUT /identity/v3/projects/6fb829f854e141608eabae2e92e4a67a/users/37ab6d2c416e4f39945577268bd89bde/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:15.523084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c668c-bbbb-4b3f-b960-7f47410410ab admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.532926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780fee0-4089-43c9-821b-becb4fde4df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.533578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780fee0-4089-43c9-821b-becb4fde4df3 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.533868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780fee0-4089-43c9-821b-becb4fde4df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.534148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780fee0-4089-43c9-821b-becb4fde4df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.534851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780fee0-4089-43c9-821b-becb4fde4df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.536546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780fee0-4089-43c9-821b-becb4fde4df3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.553418 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 819/1642] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:15.554364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780fee0-4089-43c9-821b-becb4fde4df3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.571346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780fee0-4089-43c9-821b-becb4fde4df3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.587406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:15.600268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c668c-bbbb-4b3f-b960-7f47410410ab admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.606106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef37249-3932-4062-8c30-a3a9cdddebfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.606867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef37249-3932-4062-8c30-a3a9cdddebfd admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.607216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef37249-3932-4062-8c30-a3a9cdddebfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.607593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef37249-3932-4062-8c30-a3a9cdddebfd admin admin] PATH_INFO: `/v3/projects/ebf176735f054d2ea9300d40fa8671c8/users/031c01115e984a92b0141f752b38681a/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.625393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef37249-3932-4062-8c30-a3a9cdddebfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf176735f054d2ea9300d40fa8671c8, user_id=031c01115e984a92b0141f752b38681a, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.628353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef37249-3932-4062-8c30-a3a9cdddebfd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.636046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b0c63-22f3-4198-938d-fb41547010ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.636736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b0c63-22f3-4198-938d-fb41547010ac admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.637033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b0c63-22f3-4198-938d-fb41547010ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.637298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b0c63-22f3-4198-938d-fb41547010ac admin admin] PATH_INFO: `/v3/projects/2c9849891d2f4a5ea7cfb60fe1707d62/users/614c619e121e473a9c091f6dea2718bf/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.657154 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 824/1643] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:15 2022] PUT /identity/v3/projects/ebf176735f054d2ea9300d40fa8671c8/users/031c01115e984a92b0141f752b38681a/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:15.659035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef37249-3932-4062-8c30-a3a9cdddebfd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.663379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b0c63-22f3-4198-938d-fb41547010ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9849891d2f4a5ea7cfb60fe1707d62, user_id=614c619e121e473a9c091f6dea2718bf, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.666812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b0c63-22f3-4198-938d-fb41547010ac admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.682524 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 820/1644] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:15 2022] PUT /identity/v3/projects/2c9849891d2f4a5ea7cfb60fe1707d62/users/614c619e121e473a9c091f6dea2718bf/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:15.683852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b0c63-22f3-4198-938d-fb41547010ac admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.713839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:15.740707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef37249-3932-4062-8c30-a3a9cdddebfd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.777205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b0c63-22f3-4198-938d-fb41547010ac admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.782201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a7160-5522-48e8-ba60-308378ed9902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.782834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a7160-5522-48e8-ba60-308378ed9902 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.783084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a7160-5522-48e8-ba60-308378ed9902 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.783398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a7160-5522-48e8-ba60-308378ed9902 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.784104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a7160-5522-48e8-ba60-308378ed9902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.785675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a7160-5522-48e8-ba60-308378ed9902 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.797977 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 821/1645] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:15.798712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a7160-5522-48e8-ba60-308378ed9902 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.811597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a7160-5522-48e8-ba60-308378ed9902 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.815732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ced660-90db-4741-9f9a-6c4bf7945216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.819156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43c951-265b-4b6a-bdf8-44f4835739d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.819818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43c951-265b-4b6a-bdf8-44f4835739d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.820140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43c951-265b-4b6a-bdf8-44f4835739d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.820436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43c951-265b-4b6a-bdf8-44f4835739d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.820859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ced660-90db-4741-9f9a-6c4bf7945216 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.821127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43c951-265b-4b6a-bdf8-44f4835739d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.821238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ced660-90db-4741-9f9a-6c4bf7945216 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.821514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ced660-90db-4741-9f9a-6c4bf7945216 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.822255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ced660-90db-4741-9f9a-6c4bf7945216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.822717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43c951-265b-4b6a-bdf8-44f4835739d2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.823897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ced660-90db-4741-9f9a-6c4bf7945216 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.836753 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 822/1646] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:15.836753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43c951-265b-4b6a-bdf8-44f4835739d2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.839193 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 825/1647] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:15.840899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ced660-90db-4741-9f9a-6c4bf7945216 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.845746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43c951-265b-4b6a-bdf8-44f4835739d2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.850018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ced660-90db-4741-9f9a-6c4bf7945216 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.850419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d405df1-4164-4688-818f-646bd3a691c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.851067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d405df1-4164-4688-818f-646bd3a691c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.852074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d405df1-4164-4688-818f-646bd3a691c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.852327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d405df1-4164-4688-818f-646bd3a691c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.853017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d405df1-4164-4688-818f-646bd3a691c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.854617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d405df1-4164-4688-818f-646bd3a691c7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.855564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224522a6-f299-48ba-aa25-dde9494f1ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.856387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224522a6-f299-48ba-aa25-dde9494f1ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.856750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224522a6-f299-48ba-aa25-dde9494f1ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.857178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224522a6-f299-48ba-aa25-dde9494f1ba6 admin admin] PATH_INFO: `/v3/projects/07cebc379e1a4bd49e6538c94890489b/users/8334ca58e05b43a088428a5b34497444/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.878218 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 823/1648] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:15.878218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d405df1-4164-4688-818f-646bd3a691c7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.879775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224522a6-f299-48ba-aa25-dde9494f1ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07cebc379e1a4bd49e6538c94890489b, user_id=8334ca58e05b43a088428a5b34497444, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.882737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224522a6-f299-48ba-aa25-dde9494f1ba6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.886747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d405df1-4164-4688-818f-646bd3a691c7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.891790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49723948-76cb-42e7-b6f0-32293c2b2897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.892437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49723948-76cb-42e7-b6f0-32293c2b2897 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.892723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49723948-76cb-42e7-b6f0-32293c2b2897 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.893007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49723948-76cb-42e7-b6f0-32293c2b2897 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.893697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49723948-76cb-42e7-b6f0-32293c2b2897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.895433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49723948-76cb-42e7-b6f0-32293c2b2897 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.896034 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 826/1649] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:15 2022] PUT /identity/v3/projects/07cebc379e1a4bd49e6538c94890489b/users/8334ca58e05b43a088428a5b34497444/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:15.896845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224522a6-f299-48ba-aa25-dde9494f1ba6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.909676 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 824/1650] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:15.909676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49723948-76cb-42e7-b6f0-32293c2b2897 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:15.919538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49723948-76cb-42e7-b6f0-32293c2b2897 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.958087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:15.971059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224522a6-f299-48ba-aa25-dde9494f1ba6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:15.976604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f793e-7df3-4dd8-a0ca-5a5ece3882d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.977235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f793e-7df3-4dd8-a0ca-5a5ece3882d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.977522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f793e-7df3-4dd8-a0ca-5a5ece3882d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.977797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f793e-7df3-4dd8-a0ca-5a5ece3882d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.978497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f793e-7df3-4dd8-a0ca-5a5ece3882d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.980164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f793e-7df3-4dd8-a0ca-5a5ece3882d3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.980813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da249b5-8bde-4003-99c8-79ce60352f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:15.981709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da249b5-8bde-4003-99c8-79ce60352f2b admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:15.982058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da249b5-8bde-4003-99c8-79ce60352f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:15.982815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da249b5-8bde-4003-99c8-79ce60352f2b admin admin] PATH_INFO: `/v3/projects/8aa936cca6ab4515ab2e7fe95c5a88dd/users/ae22ffc246c149f590746541765a235d/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:15.984625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da249b5-8bde-4003-99c8-79ce60352f2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa936cca6ab4515ab2e7fe95c5a88dd, user_id=ae22ffc246c149f590746541765a235d, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:15.987489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da249b5-8bde-4003-99c8-79ce60352f2b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:15.994713 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 827/1651] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:15.994713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f793e-7df3-4dd8-a0ca-5a5ece3882d3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:16.005111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f793e-7df3-4dd8-a0ca-5a5ece3882d3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:16.005877 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 825/1652] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:15 2022] PUT /identity/v3/projects/8aa936cca6ab4515ab2e7fe95c5a88dd/users/ae22ffc246c149f590746541765a235d/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:16.006698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da249b5-8bde-4003-99c8-79ce60352f2b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:16.096114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24832a-487a-41d7-8626-9845a31f6842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:16.096980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24832a-487a-41d7-8626-9845a31f6842 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:16.097240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24832a-487a-41d7-8626-9845a31f6842 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:16.097581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24832a-487a-41d7-8626-9845a31f6842 admin admin] PATH_INFO: `/v3/projects/3881e3e74f1440439e1a547ca96653ca/users/d7f4831e593d4e1591f84887c02d7d54/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:16.099812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24832a-487a-41d7-8626-9845a31f6842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3881e3e74f1440439e1a547ca96653ca, user_id=d7f4831e593d4e1591f84887c02d7d54, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:16.103446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24832a-487a-41d7-8626-9845a31f6842 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:16.104107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da249b5-8bde-4003-99c8-79ce60352f2b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:16.109086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce08d7-4851-473d-95bf-670c05e84094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:16.109768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce08d7-4851-473d-95bf-670c05e84094 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:16.110061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce08d7-4851-473d-95bf-670c05e84094 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:16.110345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce08d7-4851-473d-95bf-670c05e84094 admin admin] PATH_INFO: `/v3/projects/093c5163138a4e30b656d37de5fa6e34/users/218aa51821c74c179a5ea500e929e765/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:16.112363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce08d7-4851-473d-95bf-670c05e84094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=093c5163138a4e30b656d37de5fa6e34, user_id=218aa51821c74c179a5ea500e929e765, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:16.115339 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 828/1653] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:15 2022] PUT /identity/v3/projects/3881e3e74f1440439e1a547ca96653ca/users/d7f4831e593d4e1591f84887c02d7d54/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:16.115462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce08d7-4851-473d-95bf-670c05e84094 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:16.116189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24832a-487a-41d7-8626-9845a31f6842 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:16.126976 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 826/1654] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:16 2022] PUT /identity/v3/projects/093c5163138a4e30b656d37de5fa6e34/users/218aa51821c74c179a5ea500e929e765/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:16.127792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce08d7-4851-473d-95bf-670c05e84094 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:16.142879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:16.194080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24832a-487a-41d7-8626-9845a31f6842 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:16.197182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce08d7-4851-473d-95bf-670c05e84094 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:16.198860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ac117-841c-4813-af8a-fa3c1d60e5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:16.199564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ac117-841c-4813-af8a-fa3c1d60e5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:16.199853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ac117-841c-4813-af8a-fa3c1d60e5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:16.200138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ac117-841c-4813-af8a-fa3c1d60e5f7 admin admin] PATH_INFO: `/v3/users/b63995cd710642ab97651b02b16cd883` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:16.201297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ac117-841c-4813-af8a-fa3c1d60e5f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b63995cd710642ab97651b02b16cd883)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:16.201903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d680a97-10d7-47f5-bd00-5a8eee02bd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:16.202581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d680a97-10d7-47f5-bd00-5a8eee02bd48 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:16.202871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d680a97-10d7-47f5-bd00-5a8eee02bd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:16.203155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d680a97-10d7-47f5-bd00-5a8eee02bd48 admin admin] PATH_INFO: `/v3/projects/6fb829f854e141608eabae2e92e4a67a/users/37ab6d2c416e4f39945577268bd89bde/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:16.203255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ac117-841c-4813-af8a-fa3c1d60e5f7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:16.205140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d680a97-10d7-47f5-bd00-5a8eee02bd48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb829f854e141608eabae2e92e4a67a, user_id=37ab6d2c416e4f39945577268bd89bde, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:16.207842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d680a97-10d7-47f5-bd00-5a8eee02bd48 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:16.218203 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 827/1655] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:16 2022] PUT /identity/v3/projects/6fb829f854e141608eabae2e92e4a67a/users/37ab6d2c416e4f39945577268bd89bde/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:16.227489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d680a97-10d7-47f5-bd00-5a8eee02bd48 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:16.262558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2a7ac117-841c-4813-af8a-fa3c1d60e5f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b63995cd710642ab97651b02b16cd883'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:16.263237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2a7ac117-841c-4813-af8a-fa3c1d60e5f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b63995cd710642ab97651b02b16cd883'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:16.275471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2a7ac117-841c-4813-af8a-fa3c1d60e5f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b63995cd710642ab97651b02b16cd883'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:16.276137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2a7ac117-841c-4813-af8a-fa3c1d60e5f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b63995cd710642ab97651b02b16cd883'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:16.284752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2a7ac117-841c-4813-af8a-fa3c1d60e5f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b63995cd710642ab97651b02b16cd883'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:16.286234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d680a97-10d7-47f5-bd00-5a8eee02bd48 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:16.291511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572997f5-e843-42c7-914f-eba63884373c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:16.292134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572997f5-e843-42c7-914f-eba63884373c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:16.292419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572997f5-e843-42c7-914f-eba63884373c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:16.292699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572997f5-e843-42c7-914f-eba63884373c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:16.293412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572997f5-e843-42c7-914f-eba63884373c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:16.294990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572997f5-e843-42c7-914f-eba63884373c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:16.298112 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 829/1656] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:00:16 2022] DELETE /identity/v3/users/b63995cd710642ab97651b02b16cd883 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:16.298882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ac117-841c-4813-af8a-fa3c1d60e5f7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:16.300280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2a7ac117-841c-4813-af8a-fa3c1d60e5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:16.305997 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 828/1657] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:16.306964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572997f5-e843-42c7-914f-eba63884373c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:16.309825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:16.310298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-572997f5-e843-42c7-914f-eba63884373c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:16.323421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572997f5-e843-42c7-914f-eba63884373c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:16.376847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ac117-841c-4813-af8a-fa3c1d60e5f7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:16.381490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6725f3e-34f5-479c-9998-060694875275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:16.381641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcc354-f3cd-4275-b8ed-1b0ba36cbab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:16.382184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6725f3e-34f5-479c-9998-060694875275 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:16.382289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcc354-f3cd-4275-b8ed-1b0ba36cbab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:16.382518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6725f3e-34f5-479c-9998-060694875275 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:16.382624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcc354-f3cd-4275-b8ed-1b0ba36cbab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:16.382793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcc354-f3cd-4275-b8ed-1b0ba36cbab3 admin admin] PATH_INFO: `/v3/projects/ebf176735f054d2ea9300d40fa8671c8/users/031c01115e984a92b0141f752b38681a/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:16.382883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6725f3e-34f5-479c-9998-060694875275 admin admin] PATH_INFO: `/v3/projects/2c9849891d2f4a5ea7cfb60fe1707d62/users/614c619e121e473a9c091f6dea2718bf/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:16.384830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcc354-f3cd-4275-b8ed-1b0ba36cbab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf176735f054d2ea9300d40fa8671c8, user_id=031c01115e984a92b0141f752b38681a, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:16.384929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6725f3e-34f5-479c-9998-060694875275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9849891d2f4a5ea7cfb60fe1707d62, user_id=614c619e121e473a9c091f6dea2718bf, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:16.387498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcc354-f3cd-4275-b8ed-1b0ba36cbab3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:16.387592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6725f3e-34f5-479c-9998-060694875275 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:16.398194 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 830/1658] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:16 2022] PUT /identity/v3/projects/ebf176735f054d2ea9300d40fa8671c8/users/031c01115e984a92b0141f752b38681a/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:16.398333 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 829/1659] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:16 2022] PUT /identity/v3/projects/2c9849891d2f4a5ea7cfb60fe1707d62/users/614c619e121e473a9c091f6dea2718bf/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:16.399511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f8993-911d-4fab-a5c3-68d1ba6c7511 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:16.399768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586022d-f871-4605-9113-bd976235781f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:16.399858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f8993-911d-4fab-a5c3-68d1ba6c7511 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:16.400056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586022d-f871-4605-9113-bd976235781f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:16.400279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f8993-911d-4fab-a5c3-68d1ba6c7511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:16.400368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586022d-f871-4605-9113-bd976235781f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:16.430118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4586022d-f871-4605-9113-bd976235781f None None] MFA Rules not processed for user `ae22ffc246c149f590746541765a235d`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:16.431408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4586022d-f871-4605-9113-bd976235781f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:16.437152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-437f8993-911d-4fab-a5c3-68d1ba6c7511 None None] MFA Rules not processed for user `d7f4831e593d4e1591f84887c02d7d54`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:16.438351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-437f8993-911d-4fab-a5c3-68d1ba6c7511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:16.458917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:16.502570 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 831/1660] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:16.504183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e0a58-3574-4845-8eb8-b61b4c5127ec None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:16.504471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e0a58-3574-4845-8eb8-b61b4c5127ec None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:16.504794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e0a58-3574-4845-8eb8-b61b4c5127ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:16.509637 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 830/1661] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:16.510988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdd3b8-5b14-4fc0-bcad-b283b02cdfa8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:16.511276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdd3b8-5b14-4fc0-bcad-b283b02cdfa8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:16.511595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdd3b8-5b14-4fc0-bcad-b283b02cdfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:16.540145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0b7e0a58-3574-4845-8eb8-b61b4c5127ec None None] MFA Rules not processed for user `218aa51821c74c179a5ea500e929e765`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:16.540843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9cfdd3b8-5b14-4fc0-bcad-b283b02cdfa8 None None] MFA Rules not processed for user `37ab6d2c416e4f39945577268bd89bde`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:16.541372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0b7e0a58-3574-4845-8eb8-b61b4c5127ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:16.542046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9cfdd3b8-5b14-4fc0-bcad-b283b02cdfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:16.611910 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 832/1662] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:16.615337 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 831/1663] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:16.615337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdd3b8-5b14-4fc0-bcad-b283b02cdfa8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:16.617087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9cfdd3b8-5b14-4fc0-bcad-b283b02cdfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:16.618218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f55ac-4281-4ee0-b180-b8de74f99c90 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:16.618514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f55ac-4281-4ee0-b180-b8de74f99c90 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:16.618803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f55ac-4281-4ee0-b180-b8de74f99c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:16.632492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:16.640323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9e7f55ac-4281-4ee0-b180-b8de74f99c90 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:16.642165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9e7f55ac-4281-4ee0-b180-b8de74f99c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:16.684877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdd3b8-5b14-4fc0-bcad-b283b02cdfa8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:16.689469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8942c1d-2904-43ae-a8dd-a94747b59f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:16.690236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8942c1d-2904-43ae-a8dd-a94747b59f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:16.690594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8942c1d-2904-43ae-a8dd-a94747b59f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:16.690875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8942c1d-2904-43ae-a8dd-a94747b59f1c admin admin] PATH_INFO: `/v3/projects/07cebc379e1a4bd49e6538c94890489b/users/8334ca58e05b43a088428a5b34497444/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:16.692848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8942c1d-2904-43ae-a8dd-a94747b59f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=07cebc379e1a4bd49e6538c94890489b, user_id=8334ca58e05b43a088428a5b34497444, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:16.695565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8942c1d-2904-43ae-a8dd-a94747b59f1c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:16.702157 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 833/1664] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:16.703476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efa8e1-d1cd-4fe7-836b-0bdb0d051f6b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:16.703764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efa8e1-d1cd-4fe7-836b-0bdb0d051f6b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:16.704038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efa8e1-d1cd-4fe7-836b-0bdb0d051f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:16.706540 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 832/1665] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:16 2022] PUT /identity/v3/projects/07cebc379e1a4bd49e6538c94890489b/users/8334ca58e05b43a088428a5b34497444/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:16.712829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda7744-9d54-42b4-8c2d-3c12525bac27 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:16.713117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda7744-9d54-42b4-8c2d-3c12525bac27 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:16.713397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda7744-9d54-42b4-8c2d-3c12525bac27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:16.738682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-41efa8e1-d1cd-4fe7-836b-0bdb0d051f6b None None] MFA Rules not processed for user `614c619e121e473a9c091f6dea2718bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:16.739937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-41efa8e1-d1cd-4fe7-836b-0bdb0d051f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:16.741258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1bda7744-9d54-42b4-8c2d-3c12525bac27 None None] MFA Rules not processed for user `031c01115e984a92b0141f752b38681a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:16.742452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1bda7744-9d54-42b4-8c2d-3c12525bac27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:16.768704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:16.810473 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 834/1666] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:16.811349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efa8e1-d1cd-4fe7-836b-0bdb0d051f6b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:16.822275 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 833/1667] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:16.822440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-41efa8e1-d1cd-4fe7-836b-0bdb0d051f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:16.822519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda7744-9d54-42b4-8c2d-3c12525bac27 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:16.822519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1bda7744-9d54-42b4-8c2d-3c12525bac27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:16.889673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efa8e1-d1cd-4fe7-836b-0bdb0d051f6b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:16.895599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af8f66-8521-4707-8824-47a9591f3683 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:16.896310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af8f66-8521-4707-8824-47a9591f3683 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:16.896693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af8f66-8521-4707-8824-47a9591f3683 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:16.896978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af8f66-8521-4707-8824-47a9591f3683 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:16.901710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda7744-9d54-42b4-8c2d-3c12525bac27 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:16.907413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec278a6-cacb-47ec-891b-6b987e3a9084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:16.908109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec278a6-cacb-47ec-891b-6b987e3a9084 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:16.908402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec278a6-cacb-47ec-891b-6b987e3a9084 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:16.908680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec278a6-cacb-47ec-891b-6b987e3a9084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:16.927369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:16.958877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af8f66-8521-4707-8824-47a9591f3683 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:16.960437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af8f66-8521-4707-8824-47a9591f3683 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:16.969222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec278a6-cacb-47ec-891b-6b987e3a9084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:16.970869 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 835/1668] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:16.970998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec278a6-cacb-47ec-891b-6b987e3a9084 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:16.971597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af8f66-8521-4707-8824-47a9591f3683 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:16.972902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-05af8f66-8521-4707-8824-47a9591f3683 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:16.984595 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 834/1669] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:16.986809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d68262-7dfb-4113-8dd2-f6a71a5985e9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:16.987112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d68262-7dfb-4113-8dd2-f6a71a5985e9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:16.987424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d68262-7dfb-4113-8dd2-f6a71a5985e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:17.032635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f3d68262-7dfb-4113-8dd2-f6a71a5985e9 None None] MFA Rules not processed for user `8334ca58e05b43a088428a5b34497444`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:17.033857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f3d68262-7dfb-4113-8dd2-f6a71a5985e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:17.039661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af8f66-8521-4707-8824-47a9591f3683 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:17.043477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b3083-d6bd-41f1-ba2b-4dcf5ec7165f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:17.044171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b3083-d6bd-41f1-ba2b-4dcf5ec7165f service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:17.044458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b3083-d6bd-41f1-ba2b-4dcf5ec7165f service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:17.044737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b3083-d6bd-41f1-ba2b-4dcf5ec7165f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:17.100999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:17.118188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b3083-d6bd-41f1-ba2b-4dcf5ec7165f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:17.119661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b3083-d6bd-41f1-ba2b-4dcf5ec7165f service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:17.126347 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 835/1670] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:17.127694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b0842-b3eb-4c84-8ac2-0074a2e518df None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:17.128035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b0842-b3eb-4c84-8ac2-0074a2e518df None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:17.128297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b0842-b3eb-4c84-8ac2-0074a2e518df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:17.131493 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 836/1671] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:17.133229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b3083-d6bd-41f1-ba2b-4dcf5ec7165f service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:17.146987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b3083-d6bd-41f1-ba2b-4dcf5ec7165f service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:17.148811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-863b0842-b3eb-4c84-8ac2-0074a2e518df None None] MFA Rules not processed for user `93ee771e50474e268eae2fed07e43fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:17.150042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-863b0842-b3eb-4c84-8ac2-0074a2e518df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:17.153600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c5ef2-52b5-4119-bf3a-bca997b6ae7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:17.154343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c5ef2-52b5-4119-bf3a-bca997b6ae7d service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:17.154735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c5ef2-52b5-4119-bf3a-bca997b6ae7d service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:17.155649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c5ef2-52b5-4119-bf3a-bca997b6ae7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:17.217772 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 836/1672] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:17.219573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b0842-b3eb-4c84-8ac2-0074a2e518df None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:17.230342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c5ef2-52b5-4119-bf3a-bca997b6ae7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:17.232609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c5ef2-52b5-4119-bf3a-bca997b6ae7d service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:17.236088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b0842-b3eb-4c84-8ac2-0074a2e518df None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:17.243122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48322ee-b2d0-4fce-a9e0-40f879a56c71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:17.243781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48322ee-b2d0-4fce-a9e0-40f879a56c71 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:17.244064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48322ee-b2d0-4fce-a9e0-40f879a56c71 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:17.244343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48322ee-b2d0-4fce-a9e0-40f879a56c71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:17.244921 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 837/1673] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:17.310957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c5ef2-52b5-4119-bf3a-bca997b6ae7d service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:17.316015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48322ee-b2d0-4fce-a9e0-40f879a56c71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:17.317735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48322ee-b2d0-4fce-a9e0-40f879a56c71 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:17.324904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c5ef2-52b5-4119-bf3a-bca997b6ae7d service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:17.329352 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 837/1674] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:17.331510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bced3-bf85-4659-ac0c-5f4835689f22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:17.332203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bced3-bf85-4659-ac0c-5f4835689f22 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:17.332582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bced3-bf85-4659-ac0c-5f4835689f22 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:17.333536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bced3-bf85-4659-ac0c-5f4835689f22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:17.340777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:17.344959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bced3-bf85-4659-ac0c-5f4835689f22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:17.346676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bced3-bf85-4659-ac0c-5f4835689f22 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:17.362885 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 838/1675] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:00:17.449311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48322ee-b2d0-4fce-a9e0-40f879a56c71 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:17.462853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48322ee-b2d0-4fce-a9e0-40f879a56c71 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:17.467640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7fe44-b386-4c1b-8a1c-f3bab567b4cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:17.468522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7fe44-b386-4c1b-8a1c-f3bab567b4cb service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:17.468790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7fe44-b386-4c1b-8a1c-f3bab567b4cb service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:17.469099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7fe44-b386-4c1b-8a1c-f3bab567b4cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:17.480938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7fe44-b386-4c1b-8a1c-f3bab567b4cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:17.483279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7fe44-b386-4c1b-8a1c-f3bab567b4cb service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:17.486337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bced3-bf85-4659-ac0c-5f4835689f22 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:17.489617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d74bced3-bf85-4659-ac0c-5f4835689f22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:17.495349 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 838/1676] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:17.509598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bced3-bf85-4659-ac0c-5f4835689f22 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:17.516165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1aa05-9046-4fac-98bb-4bbfa8fdde3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:17.516560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1aa05-9046-4fac-98bb-4bbfa8fdde3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:17.516943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1aa05-9046-4fac-98bb-4bbfa8fdde3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:17.517340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1aa05-9046-4fac-98bb-4bbfa8fdde3d admin admin] PATH_INFO: `/v3/projects/246567397fcd42e29113f1549d475ed0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:17.518644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1aa05-9046-4fac-98bb-4bbfa8fdde3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=246567397fcd42e29113f1549d475ed0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:17.519944 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-22b1aa05-9046-4fac-98bb-4bbfa8fdde3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:17.519944 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:00:17.519944 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:00:17.523983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1aa05-9046-4fac-98bb-4bbfa8fdde3d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:17.552566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7fe44-b386-4c1b-8a1c-f3bab567b4cb service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:17.565033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7fe44-b386-4c1b-8a1c-f3bab567b4cb service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:17.571719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466f890-603b-49b2-ace5-96441a9aaf26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:17.572342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466f890-603b-49b2-ace5-96441a9aaf26 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:17.572769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466f890-603b-49b2-ace5-96441a9aaf26 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:17.573038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466f890-603b-49b2-ace5-96441a9aaf26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:17.574879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c466f890-603b-49b2-ace5-96441a9aaf26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:17.587713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466f890-603b-49b2-ace5-96441a9aaf26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:17.589338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466f890-603b-49b2-ace5-96441a9aaf26 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:17.599226 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 839/1677] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:00:17.615114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-22b1aa05-9046-4fac-98bb-4bbfa8fdde3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '246567397fcd42e29113f1549d475ed0', 'request_id': 'req-22b1aa05-9046-4fac-98bb-4bbfa8fdde3d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:17.624760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-22b1aa05-9046-4fac-98bb-4bbfa8fdde3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '246567397fcd42e29113f1549d475ed0', 'request_id': 'req-22b1aa05-9046-4fac-98bb-4bbfa8fdde3d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:17.637742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-22b1aa05-9046-4fac-98bb-4bbfa8fdde3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '246567397fcd42e29113f1549d475ed0', 'request_id': 'req-22b1aa05-9046-4fac-98bb-4bbfa8fdde3d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:17.639546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09417ce-ed9d-47c8-8d9b-31cf20cbbab5 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:17.640059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09417ce-ed9d-47c8-8d9b-31cf20cbbab5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:17.640540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09417ce-ed9d-47c8-8d9b-31cf20cbbab5 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:17.642384 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 840/1678] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:00:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 21:00:17.646846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d52680-c279-4eae-9cb3-7cc538ebee85 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:17.647411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d52680-c279-4eae-9cb3-7cc538ebee85 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:17.647812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d52680-c279-4eae-9cb3-7cc538ebee85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:17.658114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-22b1aa05-9046-4fac-98bb-4bbfa8fdde3d admin admin] The token cache is being invalidate because project 246567397fcd42e29113f1549d475ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:00:17.658409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-22b1aa05-9046-4fac-98bb-4bbfa8fdde3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:17.659085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-22b1aa05-9046-4fac-98bb-4bbfa8fdde3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:17.661056 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 839/1679] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:00:17 2022] DELETE /identity/v3/projects/246567397fcd42e29113f1549d475ed0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:17.665201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1aa05-9046-4fac-98bb-4bbfa8fdde3d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:17.666540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-22b1aa05-9046-4fac-98bb-4bbfa8fdde3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:17.671742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-75d52680-c279-4eae-9cb3-7cc538ebee85 None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:17.673193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-75d52680-c279-4eae-9cb3-7cc538ebee85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:17.725344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:17.738078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1aa05-9046-4fac-98bb-4bbfa8fdde3d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:17.744035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282e7db-36f1-4538-8d55-a42c057c754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:17.744699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282e7db-36f1-4538-8d55-a42c057c754d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:17.744983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282e7db-36f1-4538-8d55-a42c057c754d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:17.745265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282e7db-36f1-4538-8d55-a42c057c754d admin admin] PATH_INFO: `/v3/users/70b634c119834495994f1374e54e9c83` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:17.746704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282e7db-36f1-4538-8d55-a42c057c754d admin admin] RBAC: Authorizing `identity:delete_user(user_id=70b634c119834495994f1374e54e9c83)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:17.748693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282e7db-36f1-4538-8d55-a42c057c754d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:17.749731 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 841/1680] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:00:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:00:17.762585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d52680-c279-4eae-9cb3-7cc538ebee85 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:17.764107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-75d52680-c279-4eae-9cb3-7cc538ebee85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:17.815503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6282e7db-36f1-4538-8d55-a42c057c754d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70b634c119834495994f1374e54e9c83'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:17.816916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6282e7db-36f1-4538-8d55-a42c057c754d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70b634c119834495994f1374e54e9c83'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:17.830858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6282e7db-36f1-4538-8d55-a42c057c754d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70b634c119834495994f1374e54e9c83'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:17.831928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6282e7db-36f1-4538-8d55-a42c057c754d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70b634c119834495994f1374e54e9c83'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:17.844575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6282e7db-36f1-4538-8d55-a42c057c754d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70b634c119834495994f1374e54e9c83'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:17.854293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:17.860322 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 840/1681] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:00:17 2022] DELETE /identity/v3/users/70b634c119834495994f1374e54e9c83 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:17.866264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d52680-c279-4eae-9cb3-7cc538ebee85 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:17.869523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a2109-f6c2-4cf5-b9af-eb376e213b25 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:17.870728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a2109-f6c2-4cf5-b9af-eb376e213b25 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:17.871786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a2109-f6c2-4cf5-b9af-eb376e213b25 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:17.874090 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 841/1682] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:00:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:00:17.880005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbf50c-5177-4000-a9b6-d5876840db4b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:17.880659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbf50c-5177-4000-a9b6-d5876840db4b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:17.880837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbf50c-5177-4000-a9b6-d5876840db4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:17.905176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-84fbf50c-5177-4000-a9b6-d5876840db4b None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:17.907414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-84fbf50c-5177-4000-a9b6-d5876840db4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:17.923637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881c169-30c6-4355-a853-c55a0d927183 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:17.924375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881c169-30c6-4355-a853-c55a0d927183 service glance] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:17.925028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881c169-30c6-4355-a853-c55a0d927183 service glance] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:17.925028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881c169-30c6-4355-a853-c55a0d927183 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:17.927258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4881c169-30c6-4355-a853-c55a0d927183 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:17.984344 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 842/1683] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:00:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:18.009130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a385e77-56b4-496f-8d1a-3acda0d26a08 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:18.009424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a385e77-56b4-496f-8d1a-3acda0d26a08 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:18.009707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a385e77-56b4-496f-8d1a-3acda0d26a08 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:18.011061 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 843/1684] 10.222.0.17 () {54 vars in 961 bytes} [Sat Jul 30 21:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 21:00:18.016422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ba612-7386-4c0f-9802-0892656fb2e5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:18.016954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ba612-7386-4c0f-9802-0892656fb2e5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:18.017613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ba612-7386-4c0f-9802-0892656fb2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:18.020862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881c169-30c6-4355-a853-c55a0d927183 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:18.022309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881c169-30c6-4355-a853-c55a0d927183 service glance] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:18.039649 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 842/1685] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:00:18.054753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d47ba612-7386-4c0f-9802-0892656fb2e5 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:18.056562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d47ba612-7386-4c0f-9802-0892656fb2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:18.067064 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 844/1686] 10.222.0.17 () {58 vars in 1058 bytes} [Sat Jul 30 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:18.079439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881c169-30c6-4355-a853-c55a0d927183 service glance] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:18.092598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881c169-30c6-4355-a853-c55a0d927183 service glance] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:18.098267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1ef6b-d89c-4d72-8eb8-8eb0f3b9ea16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:18.098891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1ef6b-d89c-4d72-8eb8-8eb0f3b9ea16 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:18.099190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1ef6b-d89c-4d72-8eb8-8eb0f3b9ea16 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:18.099518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1ef6b-d89c-4d72-8eb8-8eb0f3b9ea16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:18.109236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1ef6b-d89c-4d72-8eb8-8eb0f3b9ea16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:18.110821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1ef6b-d89c-4d72-8eb8-8eb0f3b9ea16 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:18.122077 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 843/1687] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:18.197458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ba612-7386-4c0f-9802-0892656fb2e5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:18.200272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d47ba612-7386-4c0f-9802-0892656fb2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:18.316784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ba612-7386-4c0f-9802-0892656fb2e5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:18.322478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc567a6-1a7e-491e-b40a-86564a36ba35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:18.323220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc567a6-1a7e-491e-b40a-86564a36ba35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:18.323616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc567a6-1a7e-491e-b40a-86564a36ba35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:18.323960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc567a6-1a7e-491e-b40a-86564a36ba35 admin admin] PATH_INFO: `/v3/projects/89f80036653349488d845a112edad062` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:18.325241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc567a6-1a7e-491e-b40a-86564a36ba35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f80036653349488d845a112edad062)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:18.328198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc567a6-1a7e-491e-b40a-86564a36ba35 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:18.387879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5dc567a6-1a7e-491e-b40a-86564a36ba35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f80036653349488d845a112edad062', 'request_id': 'req-5dc567a6-1a7e-491e-b40a-86564a36ba35'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:18.399814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5dc567a6-1a7e-491e-b40a-86564a36ba35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f80036653349488d845a112edad062', 'request_id': 'req-5dc567a6-1a7e-491e-b40a-86564a36ba35'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:18.406638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5dc567a6-1a7e-491e-b40a-86564a36ba35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f80036653349488d845a112edad062', 'request_id': 'req-5dc567a6-1a7e-491e-b40a-86564a36ba35'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:18.419858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5dc567a6-1a7e-491e-b40a-86564a36ba35 admin admin] The token cache is being invalidate because project 89f80036653349488d845a112edad062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:00:18.419858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5dc567a6-1a7e-491e-b40a-86564a36ba35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:18.419858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5dc567a6-1a7e-491e-b40a-86564a36ba35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:18.422745 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 845/1688] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:00:18 2022] DELETE /identity/v3/projects/89f80036653349488d845a112edad062 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:18.433064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ab64b-800d-4bda-a1fe-ad34b996d60f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:18.433064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ab64b-800d-4bda-a1fe-ad34b996d60f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:18.433064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ab64b-800d-4bda-a1fe-ad34b996d60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:18.457548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc567a6-1a7e-491e-b40a-86564a36ba35 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:18.459448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5dc567a6-1a7e-491e-b40a-86564a36ba35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:18.461611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1a1ab64b-800d-4bda-a1fe-ad34b996d60f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:18.463063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1a1ab64b-800d-4bda-a1fe-ad34b996d60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:18.469335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:18.489797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:18.567037 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 844/1689] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:18.568151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ab64b-800d-4bda-a1fe-ad34b996d60f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:18.570728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1a1ab64b-800d-4bda-a1fe-ad34b996d60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:18.574734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc567a6-1a7e-491e-b40a-86564a36ba35 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:18.580983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d69345-a86f-4231-a4ec-5ca7f697e384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:18.581824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d69345-a86f-4231-a4ec-5ca7f697e384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:18.582506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d69345-a86f-4231-a4ec-5ca7f697e384 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:18.582889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d69345-a86f-4231-a4ec-5ca7f697e384 admin admin] PATH_INFO: `/v3/users/2ae4c3f8eff14a678504413fa7148941` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:18.584244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d69345-a86f-4231-a4ec-5ca7f697e384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae4c3f8eff14a678504413fa7148941)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:18.584889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ab64b-800d-4bda-a1fe-ad34b996d60f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:18.587913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d69345-a86f-4231-a4ec-5ca7f697e384 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:18.590717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7f795-9bc0-44f9-8199-34a02d1c9a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:18.591457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7f795-9bc0-44f9-8199-34a02d1c9a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:18.591788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7f795-9bc0-44f9-8199-34a02d1c9a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:18.592586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7f795-9bc0-44f9-8199-34a02d1c9a29 admin admin] PATH_INFO: `/v3/users/9f72dcea32a247a0acf5de5e051172a1` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:18.593863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7f795-9bc0-44f9-8199-34a02d1c9a29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f72dcea32a247a0acf5de5e051172a1)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:18.596476 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-27f7f795-9bc0-44f9-8199-34a02d1c9a29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:18.596476 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:00:18.596476 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:00:18.598132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7f795-9bc0-44f9-8199-34a02d1c9a29 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:18.694776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59d69345-a86f-4231-a4ec-5ca7f697e384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae4c3f8eff14a678504413fa7148941'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:18.696321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59d69345-a86f-4231-a4ec-5ca7f697e384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae4c3f8eff14a678504413fa7148941'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:18.713867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-27f7f795-9bc0-44f9-8199-34a02d1c9a29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f72dcea32a247a0acf5de5e051172a1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:18.716422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59d69345-a86f-4231-a4ec-5ca7f697e384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae4c3f8eff14a678504413fa7148941'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:18.717153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59d69345-a86f-4231-a4ec-5ca7f697e384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae4c3f8eff14a678504413fa7148941'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:18.726709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59d69345-a86f-4231-a4ec-5ca7f697e384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae4c3f8eff14a678504413fa7148941'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:18.746459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-27f7f795-9bc0-44f9-8199-34a02d1c9a29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f72dcea32a247a0acf5de5e051172a1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:18.747165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-27f7f795-9bc0-44f9-8199-34a02d1c9a29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f72dcea32a247a0acf5de5e051172a1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:18.755992 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 846/1690] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:00:18 2022] DELETE /identity/v3/users/2ae4c3f8eff14a678504413fa7148941 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:18.758601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00b4a6-0de4-4da0-bb88-946baa8540df None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:18.758901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00b4a6-0de4-4da0-bb88-946baa8540df None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:18.759326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00b4a6-0de4-4da0-bb88-946baa8540df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:18.765799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-27f7f795-9bc0-44f9-8199-34a02d1c9a29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f72dcea32a247a0acf5de5e051172a1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:18.766645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-27f7f795-9bc0-44f9-8199-34a02d1c9a29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f72dcea32a247a0acf5de5e051172a1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:18.787345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0f00b4a6-0de4-4da0-bb88-946baa8540df None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:18.789103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0f00b4a6-0de4-4da0-bb88-946baa8540df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:18.798038 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 845/1691] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:00:18 2022] DELETE /identity/v3/users/9f72dcea32a247a0acf5de5e051172a1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:18.798038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7f795-9bc0-44f9-8199-34a02d1c9a29 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:18.798251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-27f7f795-9bc0-44f9-8199-34a02d1c9a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:18.884149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7f795-9bc0-44f9-8199-34a02d1c9a29 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:18.887484 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 847/1692] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:18.890072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1063d63-a1f6-4653-a15e-b835ede70757 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:18.890366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1063d63-a1f6-4653-a15e-b835ede70757 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:18.890643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1063d63-a1f6-4653-a15e-b835ede70757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:18.893656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bba14-8647-4efa-a573-9cbcc5414ac9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:18.894618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bba14-8647-4efa-a573-9cbcc5414ac9 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:18.895245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bba14-8647-4efa-a573-9cbcc5414ac9 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:18.895758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bba14-8647-4efa-a573-9cbcc5414ac9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:18.898373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-875bba14-8647-4efa-a573-9cbcc5414ac9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:18.920189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b1063d63-a1f6-4653-a15e-b835ede70757 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:18.921431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b1063d63-a1f6-4653-a15e-b835ede70757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:18.926119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bba14-8647-4efa-a573-9cbcc5414ac9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:18.928183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bba14-8647-4efa-a573-9cbcc5414ac9 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:18.947371 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 846/1693] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:18.948823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1012a7-dd63-4db9-912b-c45e68a32479 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:18.949114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1012a7-dd63-4db9-912b-c45e68a32479 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:18.949392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1012a7-dd63-4db9-912b-c45e68a32479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:18.965506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:18.973746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ae1012a7-dd63-4db9-912b-c45e68a32479 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:18.976917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ae1012a7-dd63-4db9-912b-c45e68a32479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:18.998796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:19.002902 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 848/1694] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:19.004342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1063d63-a1f6-4653-a15e-b835ede70757 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:19.028995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1063d63-a1f6-4653-a15e-b835ede70757 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:19.041108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95671c4-85f8-4c6b-9b57-e4f03976ff92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:19.041787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95671c4-85f8-4c6b-9b57-e4f03976ff92 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:19.042076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95671c4-85f8-4c6b-9b57-e4f03976ff92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:19.044900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95671c4-85f8-4c6b-9b57-e4f03976ff92 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:19.045866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95671c4-85f8-4c6b-9b57-e4f03976ff92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:00:19.046191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95671c4-85f8-4c6b-9b57-e4f03976ff92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:19.047879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95671c4-85f8-4c6b-9b57-e4f03976ff92 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:19.069384 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 849/1695] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:00:19.072142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95671c4-85f8-4c6b-9b57-e4f03976ff92 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:19.083160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e95671c4-85f8-4c6b-9b57-e4f03976ff92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:19.094861 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 847/1696] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:19.098816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1012a7-dd63-4db9-912b-c45e68a32479 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:19.106605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ae1012a7-dd63-4db9-912b-c45e68a32479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:19.202961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95671c4-85f8-4c6b-9b57-e4f03976ff92 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:19.208415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234b6ec-5f34-470e-aaeb-367ff04b8c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:19.209447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234b6ec-5f34-470e-aaeb-367ff04b8c0e service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:19.209762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234b6ec-5f34-470e-aaeb-367ff04b8c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:19.210002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234b6ec-5f34-470e-aaeb-367ff04b8c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:19.214603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1012a7-dd63-4db9-912b-c45e68a32479 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:19.220444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234b6ec-5f34-470e-aaeb-367ff04b8c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:19.222025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234b6ec-5f34-470e-aaeb-367ff04b8c0e service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:19.222526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5f43e-30fd-42ae-bca0-adb73e6e58b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:19.223371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5f43e-30fd-42ae-bca0-adb73e6e58b8 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:19.224051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5f43e-30fd-42ae-bca0-adb73e6e58b8 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:19.224545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5f43e-30fd-42ae-bca0-adb73e6e58b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:19.227754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bbf5f43e-30fd-42ae-bca0-adb73e6e58b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:19.234377 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 850/1697] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:19.235051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234b6ec-5f34-470e-aaeb-367ff04b8c0e service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:19.246894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234b6ec-5f34-470e-aaeb-367ff04b8c0e service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:19.252096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ded299-9b58-4667-a923-b9d438012224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:19.252653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ded299-9b58-4667-a923-b9d438012224 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:19.252941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ded299-9b58-4667-a923-b9d438012224 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:19.253217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ded299-9b58-4667-a923-b9d438012224 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:19.254006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ded299-9b58-4667-a923-b9d438012224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:19.256007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ded299-9b58-4667-a923-b9d438012224 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:19.298225 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 851/1698] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:19 2022] POST /identity/v3/projects => generated 409 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:19.302927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ded299-9b58-4667-a923-b9d438012224 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:19.319073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5f43e-30fd-42ae-bca0-adb73e6e58b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:19.321311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5f43e-30fd-42ae-bca0-adb73e6e58b8 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:19.352658 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 848/1699] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:19.354584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbdf2e-e9e6-4571-acc6-a4eac29c837a None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:19.354973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbdf2e-e9e6-4571-acc6-a4eac29c837a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:19.355489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbdf2e-e9e6-4571-acc6-a4eac29c837a None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:19.356976 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 849/1700] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:00:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:00:19.357800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbdf2e-e9e6-4571-acc6-a4eac29c837a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:19.384535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ded299-9b58-4667-a923-b9d438012224 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:19.389477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632935e-7101-4114-a4b7-0de8bb33f89f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:19.390253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632935e-7101-4114-a4b7-0de8bb33f89f service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:19.390508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632935e-7101-4114-a4b7-0de8bb33f89f service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:19.390788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632935e-7101-4114-a4b7-0de8bb33f89f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:19.427807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:19.447818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbdf2e-e9e6-4571-acc6-a4eac29c837a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:19.454541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51d429-7309-452b-8696-3f118e561522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:19.455625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51d429-7309-452b-8696-3f118e561522 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:19.456207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51d429-7309-452b-8696-3f118e561522 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:19.456600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51d429-7309-452b-8696-3f118e561522 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:19.457631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51d429-7309-452b-8696-3f118e561522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:19.459872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51d429-7309-452b-8696-3f118e561522 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:19.464785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:19.466063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632935e-7101-4114-a4b7-0de8bb33f89f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:19.475267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632935e-7101-4114-a4b7-0de8bb33f89f service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:19.496610 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 852/1701] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:19.498860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e9d2c-af57-4f83-9650-863e009eb730 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:19.499163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e9d2c-af57-4f83-9650-863e009eb730 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:19.499700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e9d2c-af57-4f83-9650-863e009eb730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:19.522550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6d2e9d2c-af57-4f83-9650-863e009eb730 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:19.524489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6d2e9d2c-af57-4f83-9650-863e009eb730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:19.542600 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 850/1702] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:19 2022] POST /identity/v3/users => generated 305 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:19.545840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51d429-7309-452b-8696-3f118e561522 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:19.570486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51d429-7309-452b-8696-3f118e561522 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:19.583945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaabbbf-c6af-4262-8c56-04903c1eda45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:19.584685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaabbbf-c6af-4262-8c56-04903c1eda45 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:19.585034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaabbbf-c6af-4262-8c56-04903c1eda45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:19.585327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaabbbf-c6af-4262-8c56-04903c1eda45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:19.586666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaabbbf-c6af-4262-8c56-04903c1eda45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:19.588606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaabbbf-c6af-4262-8c56-04903c1eda45 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:19.607064 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 851/1703] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:19.611739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaabbbf-c6af-4262-8c56-04903c1eda45 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:19.638619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaabbbf-c6af-4262-8c56-04903c1eda45 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:19.638968 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 853/1704] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:00:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:19.645567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f65e6-d3ec-44fc-9dd4-f5c939c4e2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:19.646322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f65e6-d3ec-44fc-9dd4-f5c939c4e2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:19.646666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f65e6-d3ec-44fc-9dd4-f5c939c4e2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:19.647005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f65e6-d3ec-44fc-9dd4-f5c939c4e2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:19.647764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f65e6-d3ec-44fc-9dd4-f5c939c4e2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:19.650505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f65e6-d3ec-44fc-9dd4-f5c939c4e2f0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:19.673104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e9d2c-af57-4f83-9650-863e009eb730 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:19.674614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6d2e9d2c-af57-4f83-9650-863e009eb730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:19.689626 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 852/1705] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:00:19.690770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f65e6-d3ec-44fc-9dd4-f5c939c4e2f0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:19.695707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e9d2c-af57-4f83-9650-863e009eb730 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:19.706397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f65e6-d3ec-44fc-9dd4-f5c939c4e2f0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:19.712062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0379e-e7c6-494c-a2a0-2e3bbb365d8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:19.712708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0379e-e7c6-494c-a2a0-2e3bbb365d8d service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:19.713072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0379e-e7c6-494c-a2a0-2e3bbb365d8d service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:19.713334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0379e-e7c6-494c-a2a0-2e3bbb365d8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:19.714953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe1a42-dc12-4f77-b0d4-f9e4322007ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:19.716024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe1a42-dc12-4f77-b0d4-f9e4322007ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:19.716703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe1a42-dc12-4f77-b0d4-f9e4322007ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:19.717200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe1a42-dc12-4f77-b0d4-f9e4322007ff admin admin] PATH_INFO: `/v3/projects/67d32a6472ff40aa8e83b8fbb931fcd8/users/a60da9ceedcb484c80c56ad3b6bb7366/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:19.738199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0379e-e7c6-494c-a2a0-2e3bbb365d8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:19.740157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0379e-e7c6-494c-a2a0-2e3bbb365d8d service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:19.752600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe1a42-dc12-4f77-b0d4-f9e4322007ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=67d32a6472ff40aa8e83b8fbb931fcd8, user_id=a60da9ceedcb484c80c56ad3b6bb7366, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:19.756512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe1a42-dc12-4f77-b0d4-f9e4322007ff admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:19.769421 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 854/1706] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:19.771714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0379e-e7c6-494c-a2a0-2e3bbb365d8d service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:19.773906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-65f0379e-e7c6-494c-a2a0-2e3bbb365d8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:19.785269 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 853/1707] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:19 2022] PUT /identity/v3/projects/67d32a6472ff40aa8e83b8fbb931fcd8/users/a60da9ceedcb484c80c56ad3b6bb7366/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:19.796922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e693b97-4d52-4e40-9ba5-c2cf4d83c844 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:19.797289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e693b97-4d52-4e40-9ba5-c2cf4d83c844 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:19.797760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e693b97-4d52-4e40-9ba5-c2cf4d83c844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:19.813125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0379e-e7c6-494c-a2a0-2e3bbb365d8d service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:19.864610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2e693b97-4d52-4e40-9ba5-c2cf4d83c844 None None] MFA Rules not processed for user `a60da9ceedcb484c80c56ad3b6bb7366`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:19.865904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2e693b97-4d52-4e40-9ba5-c2cf4d83c844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:19.939200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49b76e-ee57-4489-9a0c-40444b036ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:19.939200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49b76e-ee57-4489-9a0c-40444b036ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:19.939200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49b76e-ee57-4489-9a0c-40444b036ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:19.939200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49b76e-ee57-4489-9a0c-40444b036ebd admin admin] PATH_INFO: `/v3/projects/cd1b52c6bed8447e9ddd28b7ddd5ad63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:19.939667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49b76e-ee57-4489-9a0c-40444b036ebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd1b52c6bed8447e9ddd28b7ddd5ad63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:19.941473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49b76e-ee57-4489-9a0c-40444b036ebd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:20.009940 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 854/1708] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:00:20.013834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45ff8a-afbb-4385-a7a1-b7ddb6307818 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:20.013834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45ff8a-afbb-4385-a7a1-b7ddb6307818 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:20.013834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45ff8a-afbb-4385-a7a1-b7ddb6307818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:20.042892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4c49b76e-ee57-4489-9a0c-40444b036ebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd1b52c6bed8447e9ddd28b7ddd5ad63', 'request_id': 'req-4c49b76e-ee57-4489-9a0c-40444b036ebd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:20.052164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4c49b76e-ee57-4489-9a0c-40444b036ebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd1b52c6bed8447e9ddd28b7ddd5ad63', 'request_id': 'req-4c49b76e-ee57-4489-9a0c-40444b036ebd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:20.053541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3b45ff8a-afbb-4385-a7a1-b7ddb6307818 None None] MFA Rules not processed for user `f724ca9bef02478da3b1696b379dc027`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:20.055319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3b45ff8a-afbb-4385-a7a1-b7ddb6307818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:20.066478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4c49b76e-ee57-4489-9a0c-40444b036ebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd1b52c6bed8447e9ddd28b7ddd5ad63', 'request_id': 'req-4c49b76e-ee57-4489-9a0c-40444b036ebd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:20.078989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4c49b76e-ee57-4489-9a0c-40444b036ebd admin admin] The token cache is being invalidate because project cd1b52c6bed8447e9ddd28b7ddd5ad63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:00:20.079607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4c49b76e-ee57-4489-9a0c-40444b036ebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:20.081437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4c49b76e-ee57-4489-9a0c-40444b036ebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:20.085179 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 855/1709] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:00:19 2022] DELETE /identity/v3/projects/cd1b52c6bed8447e9ddd28b7ddd5ad63 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:20.086643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b90e0-fa0a-430e-987a-7e57201996d0 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:20.086936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b90e0-fa0a-430e-987a-7e57201996d0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:20.087230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b90e0-fa0a-430e-987a-7e57201996d0 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:20.093995 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 856/1710] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:00:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:00:20.095626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b90e0-fa0a-430e-987a-7e57201996d0 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:20.099263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f17b90e0-fa0a-430e-987a-7e57201996d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:20.122471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:20.189422 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 855/1711] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:20.190857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45ff8a-afbb-4385-a7a1-b7ddb6307818 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:20.192473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3b45ff8a-afbb-4385-a7a1-b7ddb6307818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:20.233834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b90e0-fa0a-430e-987a-7e57201996d0 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:20.239329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fe074-1a16-40b8-93d4-9203629a36e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:20.240012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fe074-1a16-40b8-93d4-9203629a36e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:20.240296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fe074-1a16-40b8-93d4-9203629a36e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:20.240571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fe074-1a16-40b8-93d4-9203629a36e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:20.241368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fe074-1a16-40b8-93d4-9203629a36e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:20.243481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fe074-1a16-40b8-93d4-9203629a36e8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:20.258356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:20.278434 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 857/1712] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:20 2022] POST /identity/v3/projects => generated 409 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:20.279679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd11c1-6440-4c08-9f89-ba112366978b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:20.279972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd11c1-6440-4c08-9f89-ba112366978b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:20.280250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd11c1-6440-4c08-9f89-ba112366978b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:20.303013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-83fd11c1-6440-4c08-9f89-ba112366978b None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:20.304321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-83fd11c1-6440-4c08-9f89-ba112366978b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:20.308653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45ff8a-afbb-4385-a7a1-b7ddb6307818 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:20.377420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f75437-c5ab-4bb6-a029-9f368743e223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:20.378079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f75437-c5ab-4bb6-a029-9f368743e223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:20.378515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f75437-c5ab-4bb6-a029-9f368743e223 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:20.378805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f75437-c5ab-4bb6-a029-9f368743e223 admin admin] PATH_INFO: `/v3/users/ae22ffc246c149f590746541765a235d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:20.380031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f75437-c5ab-4bb6-a029-9f368743e223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae22ffc246c149f590746541765a235d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:20.380927 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 858/1713] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:00:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:20.381586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd11c1-6440-4c08-9f89-ba112366978b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:20.382924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-83fd11c1-6440-4c08-9f89-ba112366978b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:20.385054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f75437-c5ab-4bb6-a029-9f368743e223 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:20.397753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd11c1-6440-4c08-9f89-ba112366978b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:20.403201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d11b47-f446-4091-96fe-552092008bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:20.403904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d11b47-f446-4091-96fe-552092008bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:20.404179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d11b47-f446-4091-96fe-552092008bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:20.404479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d11b47-f446-4091-96fe-552092008bb8 admin admin] PATH_INFO: `/v3/projects/2f87eeda7c9a434988b863bf4cb4aac5` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:20.405661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d11b47-f446-4091-96fe-552092008bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f87eeda7c9a434988b863bf4cb4aac5)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:20.412087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d11b47-f446-4091-96fe-552092008bb8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:20.456941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46f75437-c5ab-4bb6-a029-9f368743e223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae22ffc246c149f590746541765a235d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:20.471023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46f75437-c5ab-4bb6-a029-9f368743e223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae22ffc246c149f590746541765a235d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:20.471874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46f75437-c5ab-4bb6-a029-9f368743e223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae22ffc246c149f590746541765a235d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:20.472608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-09d11b47-f446-4091-96fe-552092008bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f87eeda7c9a434988b863bf4cb4aac5', 'request_id': 'req-09d11b47-f446-4091-96fe-552092008bb8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:20.480572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46f75437-c5ab-4bb6-a029-9f368743e223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae22ffc246c149f590746541765a235d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:20.481443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46f75437-c5ab-4bb6-a029-9f368743e223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae22ffc246c149f590746541765a235d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:20.481673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-09d11b47-f446-4091-96fe-552092008bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f87eeda7c9a434988b863bf4cb4aac5', 'request_id': 'req-09d11b47-f446-4091-96fe-552092008bb8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:20.488711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-09d11b47-f446-4091-96fe-552092008bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f87eeda7c9a434988b863bf4cb4aac5', 'request_id': 'req-09d11b47-f446-4091-96fe-552092008bb8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:20.500533 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 856/1714] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:00:20 2022] DELETE /identity/v3/users/ae22ffc246c149f590746541765a235d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:20.501816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f75437-c5ab-4bb6-a029-9f368743e223 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:20.503435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-46f75437-c5ab-4bb6-a029-9f368743e223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:20.504459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-09d11b47-f446-4091-96fe-552092008bb8 admin admin] The token cache is being invalidate because project 2f87eeda7c9a434988b863bf4cb4aac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:00:20.504459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-09d11b47-f446-4091-96fe-552092008bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:20.505253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-09d11b47-f446-4091-96fe-552092008bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:20.507069 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 859/1715] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:00:20 2022] DELETE /identity/v3/projects/2f87eeda7c9a434988b863bf4cb4aac5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:20.507941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d11b47-f446-4091-96fe-552092008bb8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:20.509328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-09d11b47-f446-4091-96fe-552092008bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:20.521515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:20.581349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:20.601782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d11b47-f446-4091-96fe-552092008bb8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:20.608414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f75437-c5ab-4bb6-a029-9f368743e223 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:20.615316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf03f7e-853b-4f24-a125-090fb7463b65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:20.616010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf03f7e-853b-4f24-a125-090fb7463b65 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:20.616305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf03f7e-853b-4f24-a125-090fb7463b65 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:20.616586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf03f7e-853b-4f24-a125-090fb7463b65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:20.619144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-baf03f7e-853b-4f24-a125-090fb7463b65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:20.699895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf03f7e-853b-4f24-a125-090fb7463b65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:20.701988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf03f7e-853b-4f24-a125-090fb7463b65 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:20.706402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f9d1c-0df5-4871-bc35-650129d1e983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:20.707107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f9d1c-0df5-4871-bc35-650129d1e983 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:20.707523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f9d1c-0df5-4871-bc35-650129d1e983 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:20.707873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f9d1c-0df5-4871-bc35-650129d1e983 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:20.708938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f9d1c-0df5-4871-bc35-650129d1e983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:20.712108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f9d1c-0df5-4871-bc35-650129d1e983 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:20.728223 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 857/1716] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:20.729104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf03f7e-853b-4f24-a125-090fb7463b65 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:20.732232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-baf03f7e-853b-4f24-a125-090fb7463b65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:20.748562 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 860/1717] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:20 2022] POST /identity/v3/users => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:20.748979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f9d1c-0df5-4871-bc35-650129d1e983 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:20.756316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e77f9d1c-0df5-4871-bc35-650129d1e983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:20.784953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f9d1c-0df5-4871-bc35-650129d1e983 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:20.791704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a109d-67f7-4f8a-b9f7-95cd5b46d462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:20.792856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a109d-67f7-4f8a-b9f7-95cd5b46d462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:20.792968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a109d-67f7-4f8a-b9f7-95cd5b46d462 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:20.793389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a109d-67f7-4f8a-b9f7-95cd5b46d462 admin admin] PATH_INFO: `/v3/users/218aa51821c74c179a5ea500e929e765` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:20.795089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a109d-67f7-4f8a-b9f7-95cd5b46d462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=218aa51821c74c179a5ea500e929e765)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:20.797546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a109d-67f7-4f8a-b9f7-95cd5b46d462 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:20.834463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf03f7e-853b-4f24-a125-090fb7463b65 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:20.839537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b85236-20ff-4435-975c-08c5ef284371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:20.840490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b85236-20ff-4435-975c-08c5ef284371 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:20.840781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b85236-20ff-4435-975c-08c5ef284371 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:20.841065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b85236-20ff-4435-975c-08c5ef284371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:20.843222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-86b85236-20ff-4435-975c-08c5ef284371 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:20.862985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b85236-20ff-4435-975c-08c5ef284371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:20.868930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b85236-20ff-4435-975c-08c5ef284371 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:20.881151 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 858/1718] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:20.883537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ac6a109d-67f7-4f8a-b9f7-95cd5b46d462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '218aa51821c74c179a5ea500e929e765'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:20.884229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ac6a109d-67f7-4f8a-b9f7-95cd5b46d462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '218aa51821c74c179a5ea500e929e765'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:20.884553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b85236-20ff-4435-975c-08c5ef284371 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:20.898561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b85236-20ff-4435-975c-08c5ef284371 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:20.898757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ac6a109d-67f7-4f8a-b9f7-95cd5b46d462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '218aa51821c74c179a5ea500e929e765'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:20.899879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ac6a109d-67f7-4f8a-b9f7-95cd5b46d462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '218aa51821c74c179a5ea500e929e765'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:20.904729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48717cc6-8335-4acb-95e3-b5d405f6f646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:20.905463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48717cc6-8335-4acb-95e3-b5d405f6f646 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:20.905862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48717cc6-8335-4acb-95e3-b5d405f6f646 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:20.906211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48717cc6-8335-4acb-95e3-b5d405f6f646 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:20.907128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48717cc6-8335-4acb-95e3-b5d405f6f646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:20.908645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ac6a109d-67f7-4f8a-b9f7-95cd5b46d462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '218aa51821c74c179a5ea500e929e765'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:20.908954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48717cc6-8335-4acb-95e3-b5d405f6f646 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:20.919984 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 859/1719] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:20.919984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48717cc6-8335-4acb-95e3-b5d405f6f646 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:20.924271 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 861/1720] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:00:20 2022] DELETE /identity/v3/users/218aa51821c74c179a5ea500e929e765 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:20.924989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a109d-67f7-4f8a-b9f7-95cd5b46d462 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:20.926713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ac6a109d-67f7-4f8a-b9f7-95cd5b46d462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:20.928327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-48717cc6-8335-4acb-95e3-b5d405f6f646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:20.949240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48717cc6-8335-4acb-95e3-b5d405f6f646 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:20.957728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:21.006410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a109d-67f7-4f8a-b9f7-95cd5b46d462 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:21.021466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0beec8-f913-4c74-97b6-22e98f334e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:21.022143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0beec8-f913-4c74-97b6-22e98f334e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:21.022429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0beec8-f913-4c74-97b6-22e98f334e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:21.022705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0beec8-f913-4c74-97b6-22e98f334e48 admin admin] PATH_INFO: `/v3/projects/8aa936cca6ab4515ab2e7fe95c5a88dd` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:21.025503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0beec8-f913-4c74-97b6-22e98f334e48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aa936cca6ab4515ab2e7fe95c5a88dd)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:21.027955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0beec8-f913-4c74-97b6-22e98f334e48 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:21.059984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09169f-8971-41b7-8d64-b597da0e1cbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:21.060948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09169f-8971-41b7-8d64-b597da0e1cbb service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:21.061572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09169f-8971-41b7-8d64-b597da0e1cbb service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:21.061867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09169f-8971-41b7-8d64-b597da0e1cbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:21.064747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7b09169f-8971-41b7-8d64-b597da0e1cbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:21.098390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:21.134632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3f0beec8-f913-4c74-97b6-22e98f334e48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aa936cca6ab4515ab2e7fe95c5a88dd', 'request_id': 'req-3f0beec8-f913-4c74-97b6-22e98f334e48'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:21.160380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3f0beec8-f913-4c74-97b6-22e98f334e48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aa936cca6ab4515ab2e7fe95c5a88dd', 'request_id': 'req-3f0beec8-f913-4c74-97b6-22e98f334e48'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:21.174145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3f0beec8-f913-4c74-97b6-22e98f334e48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aa936cca6ab4515ab2e7fe95c5a88dd', 'request_id': 'req-3f0beec8-f913-4c74-97b6-22e98f334e48'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:21.180716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09169f-8971-41b7-8d64-b597da0e1cbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:21.182613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09169f-8971-41b7-8d64-b597da0e1cbb service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:21.190601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3f0beec8-f913-4c74-97b6-22e98f334e48 admin admin] The token cache is being invalidate because project 8aa936cca6ab4515ab2e7fe95c5a88dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:00:21.190897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3f0beec8-f913-4c74-97b6-22e98f334e48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:21.191915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3f0beec8-f913-4c74-97b6-22e98f334e48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:21.194432 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 862/1721] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:00:20 2022] DELETE /identity/v3/projects/8aa936cca6ab4515ab2e7fe95c5a88dd => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:21.196068 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 860/1722] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:21.200017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1bbb2-bcd6-43a3-b108-bb637249c6ee None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:21.200561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1bbb2-bcd6-43a3-b108-bb637249c6ee None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:21.201034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1bbb2-bcd6-43a3-b108-bb637249c6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:21.206941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0beec8-f913-4c74-97b6-22e98f334e48 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:21.211187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3f0beec8-f913-4c74-97b6-22e98f334e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:21.252905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ecd1bbb2-bcd6-43a3-b108-bb637249c6ee None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:21.256266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ecd1bbb2-bcd6-43a3-b108-bb637249c6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:21.414116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0beec8-f913-4c74-97b6-22e98f334e48 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:21.427249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318bc6b-bcab-42c5-852d-a32a26883a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:21.427979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318bc6b-bcab-42c5-852d-a32a26883a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:21.428265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318bc6b-bcab-42c5-852d-a32a26883a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:21.428544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318bc6b-bcab-42c5-852d-a32a26883a83 admin admin] PATH_INFO: `/v3/projects/263cdea67dc24a41800ec4bd32d32719/users/d8d6aa44f2bc4ca6aefcb83b1f41096f/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:21.431607 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 861/1723] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:21.432857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1bbb2-bcd6-43a3-b108-bb637249c6ee None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:21.434551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ecd1bbb2-bcd6-43a3-b108-bb637249c6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:21.454187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1bbb2-bcd6-43a3-b108-bb637249c6ee None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:21.460870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2fc67-bf88-41d3-aa97-58584dcba754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:21.461199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318bc6b-bcab-42c5-852d-a32a26883a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=263cdea67dc24a41800ec4bd32d32719, user_id=d8d6aa44f2bc4ca6aefcb83b1f41096f, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:21.462325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2fc67-bf88-41d3-aa97-58584dcba754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:21.462866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2fc67-bf88-41d3-aa97-58584dcba754 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:21.463406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2fc67-bf88-41d3-aa97-58584dcba754 admin admin] PATH_INFO: `/v3/projects/093c5163138a4e30b656d37de5fa6e34` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:21.464285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318bc6b-bcab-42c5-852d-a32a26883a83 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:21.466668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2fc67-bf88-41d3-aa97-58584dcba754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=093c5163138a4e30b656d37de5fa6e34)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:21.470597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2fc67-bf88-41d3-aa97-58584dcba754 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:21.494274 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 863/1724] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:21 2022] PUT /identity/v3/projects/263cdea67dc24a41800ec4bd32d32719/users/d8d6aa44f2bc4ca6aefcb83b1f41096f/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:21.496890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864076d-7a77-4950-ba2c-ac1e111ffee8 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:21.496890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864076d-7a77-4950-ba2c-ac1e111ffee8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:21.497419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864076d-7a77-4950-ba2c-ac1e111ffee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:21.527552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9864076d-7a77-4950-ba2c-ac1e111ffee8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:21.528912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9864076d-7a77-4950-ba2c-ac1e111ffee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:21.551109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c0d2fc67-bf88-41d3-aa97-58584dcba754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '093c5163138a4e30b656d37de5fa6e34', 'request_id': 'req-c0d2fc67-bf88-41d3-aa97-58584dcba754'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:21.560748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c0d2fc67-bf88-41d3-aa97-58584dcba754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '093c5163138a4e30b656d37de5fa6e34', 'request_id': 'req-c0d2fc67-bf88-41d3-aa97-58584dcba754'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:21.567978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:21.582923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c0d2fc67-bf88-41d3-aa97-58584dcba754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '093c5163138a4e30b656d37de5fa6e34', 'request_id': 'req-c0d2fc67-bf88-41d3-aa97-58584dcba754'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:21.600385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c0d2fc67-bf88-41d3-aa97-58584dcba754 admin admin] The token cache is being invalidate because project 093c5163138a4e30b656d37de5fa6e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:00:21.601944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c0d2fc67-bf88-41d3-aa97-58584dcba754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:21.604423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c0d2fc67-bf88-41d3-aa97-58584dcba754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:21.611494 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 862/1725] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:00:21 2022] DELETE /identity/v3/projects/093c5163138a4e30b656d37de5fa6e34 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:21.611494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2fc67-bf88-41d3-aa97-58584dcba754 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:21.613545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c0d2fc67-bf88-41d3-aa97-58584dcba754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:21.631978 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 864/1726] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:21.635504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f79ce4-b10d-411b-90f3-0ab8c87beba1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:21.635504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f79ce4-b10d-411b-90f3-0ab8c87beba1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:21.635504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f79ce4-b10d-411b-90f3-0ab8c87beba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:21.657854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c0f79ce4-b10d-411b-90f3-0ab8c87beba1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:21.659719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c0f79ce4-b10d-411b-90f3-0ab8c87beba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:21.685908 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 865/1727] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:21.685908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e420a3b-6551-43b5-9169-5e9975206212 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:21.685908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e420a3b-6551-43b5-9169-5e9975206212 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:21.685908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e420a3b-6551-43b5-9169-5e9975206212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:21.688000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:21.723187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2fc67-bf88-41d3-aa97-58584dcba754 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:21.729139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269d8fc-806c-4305-9f0c-ca912e4b4d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:21.729785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269d8fc-806c-4305-9f0c-ca912e4b4d16 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:21.730072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269d8fc-806c-4305-9f0c-ca912e4b4d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:21.730368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269d8fc-806c-4305-9f0c-ca912e4b4d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:21.731132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269d8fc-806c-4305-9f0c-ca912e4b4d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:21.733058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269d8fc-806c-4305-9f0c-ca912e4b4d16 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:21.756913 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 863/1728] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:21.758428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269d8fc-806c-4305-9f0c-ca912e4b4d16 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:21.784449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269d8fc-806c-4305-9f0c-ca912e4b4d16 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:21.792286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a98685-971e-4879-a133-6770469c08e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:21.793726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a98685-971e-4879-a133-6770469c08e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:21.794601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a98685-971e-4879-a133-6770469c08e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:21.794904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a98685-971e-4879-a133-6770469c08e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:21.796370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a98685-971e-4879-a133-6770469c08e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:00:21.796682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a98685-971e-4879-a133-6770469c08e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:21.797079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4e420a3b-6551-43b5-9169-5e9975206212 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:21.798571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4e420a3b-6551-43b5-9169-5e9975206212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:21.798693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a98685-971e-4879-a133-6770469c08e9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:21.832826 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 864/1729] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:00:21.834481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6056a-ad81-4f83-bb49-f966dd7511c3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:21.834963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6056a-ad81-4f83-bb49-f966dd7511c3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:21.836038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6056a-ad81-4f83-bb49-f966dd7511c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:21.885595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a9f6056a-ad81-4f83-bb49-f966dd7511c3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:21.887282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a9f6056a-ad81-4f83-bb49-f966dd7511c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:21.898841 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 865/1730] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:21.900336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6056a-ad81-4f83-bb49-f966dd7511c3 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:21.923561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6056a-ad81-4f83-bb49-f966dd7511c3 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:21.938338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95d525-a9ec-47c7-b4d6-b6fe087d169f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:21.939168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95d525-a9ec-47c7-b4d6-b6fe087d169f admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:21.939779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95d525-a9ec-47c7-b4d6-b6fe087d169f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:21.940119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95d525-a9ec-47c7-b4d6-b6fe087d169f admin admin] PATH_INFO: `/v3/projects/263cdea67dc24a41800ec4bd32d32719/users/d8d6aa44f2bc4ca6aefcb83b1f41096f/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:21.945427 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 866/1731] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:00:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:21.946423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e420a3b-6551-43b5-9169-5e9975206212 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:21.959235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95d525-a9ec-47c7-b4d6-b6fe087d169f admin admin] RBAC: Authorizing `identity:create_grant(project_id=263cdea67dc24a41800ec4bd32d32719, user_id=d8d6aa44f2bc4ca6aefcb83b1f41096f, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:21.968453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95d525-a9ec-47c7-b4d6-b6fe087d169f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:21.968572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e420a3b-6551-43b5-9169-5e9975206212 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:21.987855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba4ced-300a-4e99-9266-e2e35e3fd5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:21.987855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba4ced-300a-4e99-9266-e2e35e3fd5fe admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:21.987855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba4ced-300a-4e99-9266-e2e35e3fd5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:21.987855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba4ced-300a-4e99-9266-e2e35e3fd5fe admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:21.988215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba4ced-300a-4e99-9266-e2e35e3fd5fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:21.988215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba4ced-300a-4e99-9266-e2e35e3fd5fe admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:22.045902 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 867/1733] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:21 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:22.045902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba4ced-300a-4e99-9266-e2e35e3fd5fe admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:22.050671 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 866/1733] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:21 2022] PUT /identity/v3/projects/263cdea67dc24a41800ec4bd32d32719/users/d8d6aa44f2bc4ca6aefcb83b1f41096f/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:22.050807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95d525-a9ec-47c7-b4d6-b6fe087d169f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:22.138963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95d525-a9ec-47c7-b4d6-b6fe087d169f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:22.147048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184a716-5030-4b98-9f42-51a2bb0c276c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:22.148036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184a716-5030-4b98-9f42-51a2bb0c276c admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:22.154964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba4ced-300a-4e99-9266-e2e35e3fd5fe admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:22.158377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184a716-5030-4b98-9f42-51a2bb0c276c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:22.158920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184a716-5030-4b98-9f42-51a2bb0c276c admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:22.159747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184a716-5030-4b98-9f42-51a2bb0c276c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:22.164852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4c362-9065-437b-ba43-12e0c9b8b7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:22.165833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4c362-9065-437b-ba43-12e0c9b8b7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:22.167083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4c362-9065-437b-ba43-12e0c9b8b7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:22.167394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4c362-9065-437b-ba43-12e0c9b8b7a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:22.168117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4c362-9065-437b-ba43-12e0c9b8b7a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:00:22.168430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4c362-9065-437b-ba43-12e0c9b8b7a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:22.168532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184a716-5030-4b98-9f42-51a2bb0c276c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:22.170058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4c362-9065-437b-ba43-12e0c9b8b7a5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:22.194816 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 868/1734] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:00:22.194816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e5698-f7dd-40e2-8aac-775968370adb None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:22.194816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e5698-f7dd-40e2-8aac-775968370adb None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:22.195540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e5698-f7dd-40e2-8aac-775968370adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:22.214549 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 867/1735] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:22 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:22.214549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184a716-5030-4b98-9f42-51a2bb0c276c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:22.215151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4184a716-5030-4b98-9f42-51a2bb0c276c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:22.250307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:22.280878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e30e5698-f7dd-40e2-8aac-775968370adb None None] MFA Rules not processed for user `d8d6aa44f2bc4ca6aefcb83b1f41096f`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:22.284279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e30e5698-f7dd-40e2-8aac-775968370adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:22.395055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184a716-5030-4b98-9f42-51a2bb0c276c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:22.408949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46f6fc-2721-47cb-bb1b-730d405cc368 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:22.412389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46f6fc-2721-47cb-bb1b-730d405cc368 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:22.414658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46f6fc-2721-47cb-bb1b-730d405cc368 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:22.415166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46f6fc-2721-47cb-bb1b-730d405cc368 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:22.436732 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 869/1736] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:22 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:22.442667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e5698-f7dd-40e2-8aac-775968370adb None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:22.449450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:22.454597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e5698-f7dd-40e2-8aac-775968370adb None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:22.459522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a7ac2-7861-4567-8dbb-67e2ce819abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:22.461035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a7ac2-7861-4567-8dbb-67e2ce819abe admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:22.461325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a7ac2-7861-4567-8dbb-67e2ce819abe admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:22.461633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a7ac2-7861-4567-8dbb-67e2ce819abe admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:22.462315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a7ac2-7861-4567-8dbb-67e2ce819abe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:22.464291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a7ac2-7861-4567-8dbb-67e2ce819abe admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:22.525495 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 870/1737] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:22 2022] POST /identity/v3/projects => generated 393 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:22.526467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a7ac2-7861-4567-8dbb-67e2ce819abe admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:22.551873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46f6fc-2721-47cb-bb1b-730d405cc368 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:22.553616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46f6fc-2721-47cb-bb1b-730d405cc368 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:22.595248 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 868/1738] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:00:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:00:22.596820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46f6fc-2721-47cb-bb1b-730d405cc368 service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:22.598790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9a46f6fc-2721-47cb-bb1b-730d405cc368 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:22.677437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a7ac2-7861-4567-8dbb-67e2ce819abe admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:22.715795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b7b94-3db1-4b87-bad0-757056f43698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:22.716492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b7b94-3db1-4b87-bad0-757056f43698 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:22.717893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b7b94-3db1-4b87-bad0-757056f43698 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:22.718205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b7b94-3db1-4b87-bad0-757056f43698 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:22.723932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b7b94-3db1-4b87-bad0-757056f43698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:22.729199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b7b94-3db1-4b87-bad0-757056f43698 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:22.771057 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 871/1739] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:22.776911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b7b94-3db1-4b87-bad0-757056f43698 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:22.820369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b7b94-3db1-4b87-bad0-757056f43698 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:22.832783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90bec2-668f-4ee6-8ee4-29d2056de164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:22.837669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90bec2-668f-4ee6-8ee4-29d2056de164 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:22.837978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90bec2-668f-4ee6-8ee4-29d2056de164 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:22.842426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46f6fc-2721-47cb-bb1b-730d405cc368 service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:22.846118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90bec2-668f-4ee6-8ee4-29d2056de164 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:22.846995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90bec2-668f-4ee6-8ee4-29d2056de164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:22.849208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90bec2-668f-4ee6-8ee4-29d2056de164 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:22.920070 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 872/1740] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:22 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:22.921138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90bec2-668f-4ee6-8ee4-29d2056de164 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:22.942879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90bec2-668f-4ee6-8ee4-29d2056de164 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:22.962043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca261139-1ef1-45f4-87ba-a7d61fec2c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:22.962613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca261139-1ef1-45f4-87ba-a7d61fec2c89 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:22.962899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca261139-1ef1-45f4-87ba-a7d61fec2c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:22.964282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca261139-1ef1-45f4-87ba-a7d61fec2c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:22.964282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca261139-1ef1-45f4-87ba-a7d61fec2c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:22.966894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca261139-1ef1-45f4-87ba-a7d61fec2c89 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:23.018110 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 873/1741] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:23.018921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca261139-1ef1-45f4-87ba-a7d61fec2c89 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:23.036649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed2f69-1c65-44a5-966c-b4d91432aecc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:23.037336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed2f69-1c65-44a5-966c-b4d91432aecc service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:23.037924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed2f69-1c65-44a5-966c-b4d91432aecc service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:23.038438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed2f69-1c65-44a5-966c-b4d91432aecc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:23.049153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca261139-1ef1-45f4-87ba-a7d61fec2c89 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:23.066001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ea7d6-6f20-456f-93e3-e582d0e0e289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:23.066839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ea7d6-6f20-456f-93e3-e582d0e0e289 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:23.067282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ea7d6-6f20-456f-93e3-e582d0e0e289 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:23.067750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ea7d6-6f20-456f-93e3-e582d0e0e289 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:23.068536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ea7d6-6f20-456f-93e3-e582d0e0e289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:23.072036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ea7d6-6f20-456f-93e3-e582d0e0e289 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:23.103415 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 874/1742] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:23.104631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ea7d6-6f20-456f-93e3-e582d0e0e289 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:23.127456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ea7d6-6f20-456f-93e3-e582d0e0e289 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:23.150983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a1846-4479-4ca5-92f1-a511c3904a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:23.151731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a1846-4479-4ca5-92f1-a511c3904a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:23.152005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a1846-4479-4ca5-92f1-a511c3904a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:23.152204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:23.152320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a1846-4479-4ca5-92f1-a511c3904a0e admin admin] PATH_INFO: `/v3/projects/81fb262c72e0468e92246bf31d93a204/users/96815c6776f1464a8b6350b4a52d4548/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:23.180641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed2f69-1c65-44a5-966c-b4d91432aecc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:23.182494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed2f69-1c65-44a5-966c-b4d91432aecc service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:23.214738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a1846-4479-4ca5-92f1-a511c3904a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=81fb262c72e0468e92246bf31d93a204, user_id=96815c6776f1464a8b6350b4a52d4548, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:23.221750 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 869/1743] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:22 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:23.223404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed2f69-1c65-44a5-966c-b4d91432aecc service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:23.223733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a1846-4479-4ca5-92f1-a511c3904a0e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:23.261936 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 875/1744] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:23 2022] PUT /identity/v3/projects/81fb262c72e0468e92246bf31d93a204/users/96815c6776f1464a8b6350b4a52d4548/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:23.262619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a1846-4479-4ca5-92f1-a511c3904a0e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:23.272635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4b6a1846-4479-4ca5-92f1-a511c3904a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:23.283654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:23.287013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed2f69-1c65-44a5-966c-b4d91432aecc service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:23.393902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a1846-4479-4ca5-92f1-a511c3904a0e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:23.399800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995fcb3-a8ae-4086-b2ec-478d46cc1df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:23.400700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995fcb3-a8ae-4086-b2ec-478d46cc1df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:23.401088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995fcb3-a8ae-4086-b2ec-478d46cc1df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:23.401458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995fcb3-a8ae-4086-b2ec-478d46cc1df4 admin admin] PATH_INFO: `/v3/users/00ba1ceba6654cbd8cd4b48615f20759` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:23.402772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995fcb3-a8ae-4086-b2ec-478d46cc1df4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00ba1ceba6654cbd8cd4b48615f20759)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:23.404963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995fcb3-a8ae-4086-b2ec-478d46cc1df4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:23.464024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3995fcb3-a8ae-4086-b2ec-478d46cc1df4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00ba1ceba6654cbd8cd4b48615f20759'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:23.465051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3995fcb3-a8ae-4086-b2ec-478d46cc1df4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00ba1ceba6654cbd8cd4b48615f20759'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:23.470854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bb4e8-47c3-4efb-97ba-dd791d681a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:23.472281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bb4e8-47c3-4efb-97ba-dd791d681a3e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:23.472655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bb4e8-47c3-4efb-97ba-dd791d681a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:23.473564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bb4e8-47c3-4efb-97ba-dd791d681a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:23.474443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bb4e8-47c3-4efb-97ba-dd791d681a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:23.477482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bb4e8-47c3-4efb-97ba-dd791d681a3e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:23.484730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3995fcb3-a8ae-4086-b2ec-478d46cc1df4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00ba1ceba6654cbd8cd4b48615f20759'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:23.486228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3995fcb3-a8ae-4086-b2ec-478d46cc1df4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00ba1ceba6654cbd8cd4b48615f20759'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:23.493910 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 870/1745] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:23.501165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3995fcb3-a8ae-4086-b2ec-478d46cc1df4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00ba1ceba6654cbd8cd4b48615f20759'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:23.501855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3728e-12db-41c8-aa29-d177a4302b99 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:23.502160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3728e-12db-41c8-aa29-d177a4302b99 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:23.502448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3728e-12db-41c8-aa29-d177a4302b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:23.520252 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 876/1746] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:00:23 2022] DELETE /identity/v3/users/00ba1ceba6654cbd8cd4b48615f20759 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:23.522070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995fcb3-a8ae-4086-b2ec-478d46cc1df4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:23.524781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3995fcb3-a8ae-4086-b2ec-478d46cc1df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:23.532585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c9b3728e-12db-41c8-aa29-d177a4302b99 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:23.534198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c9b3728e-12db-41c8-aa29-d177a4302b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:23.627196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995fcb3-a8ae-4086-b2ec-478d46cc1df4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:23.634197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8cb6f-7da9-4b07-af19-b6ee454b3009 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:23.634841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8cb6f-7da9-4b07-af19-b6ee454b3009 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:23.635107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8cb6f-7da9-4b07-af19-b6ee454b3009 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:23.635416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8cb6f-7da9-4b07-af19-b6ee454b3009 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:23.637317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2ac8cb6f-7da9-4b07-af19-b6ee454b3009 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:23.665210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:23.692078 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 871/1747] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:23.693810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3728e-12db-41c8-aa29-d177a4302b99 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:23.696695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c9b3728e-12db-41c8-aa29-d177a4302b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:23.720574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3728e-12db-41c8-aa29-d177a4302b99 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:23.744439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bdc85-6420-4a2c-84e4-688e9a8751eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:23.746190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bdc85-6420-4a2c-84e4-688e9a8751eb admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:23.746476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bdc85-6420-4a2c-84e4-688e9a8751eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:23.747116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bdc85-6420-4a2c-84e4-688e9a8751eb admin admin] PATH_INFO: `/v3/projects/57aa45c38d22411da538ff9c6533d5fa/users/125f370710a141bc8921c64a8ca24b53/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:23.768648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8cb6f-7da9-4b07-af19-b6ee454b3009 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:23.770970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8cb6f-7da9-4b07-af19-b6ee454b3009 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:23.785487 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 877/1748] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:23 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:23.786876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9bbe6-d71a-4620-b0df-683c3a8fbfd8 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:23.787235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9bbe6-d71a-4620-b0df-683c3a8fbfd8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:23.787652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9bbe6-d71a-4620-b0df-683c3a8fbfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:23.811205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bdc85-6420-4a2c-84e4-688e9a8751eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=57aa45c38d22411da538ff9c6533d5fa, user_id=125f370710a141bc8921c64a8ca24b53, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:23.829547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bdc85-6420-4a2c-84e4-688e9a8751eb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:23.863896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e4b9bbe6-d71a-4620-b0df-683c3a8fbfd8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:23.865981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e4b9bbe6-d71a-4620-b0df-683c3a8fbfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:23.901023 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 872/1749] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:23 2022] PUT /identity/v3/projects/57aa45c38d22411da538ff9c6533d5fa/users/125f370710a141bc8921c64a8ca24b53/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:23.903175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bdc85-6420-4a2c-84e4-688e9a8751eb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:23.915186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8b2bdc85-6420-4a2c-84e4-688e9a8751eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:24.003216 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 878/1750] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:24.007614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea7a70-1a4e-4d78-a703-7f2a73e1a1ed None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:24.007928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea7a70-1a4e-4d78-a703-7f2a73e1a1ed None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:24.008257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea7a70-1a4e-4d78-a703-7f2a73e1a1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:24.059495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bdc85-6420-4a2c-84e4-688e9a8751eb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:24.083919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17b0e9-d563-45b5-8902-271a6428dd24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:24.084578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17b0e9-d563-45b5-8902-271a6428dd24 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:24.085030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17b0e9-d563-45b5-8902-271a6428dd24 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:24.085144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17b0e9-d563-45b5-8902-271a6428dd24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:24.088610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-24ea7a70-1a4e-4d78-a703-7f2a73e1a1ed None None] MFA Rules not processed for user `4a886ccf9590432caf209526410a7b53`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:24.090283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-24ea7a70-1a4e-4d78-a703-7f2a73e1a1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:24.098792 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 879/1751] 10.222.0.48 () {58 vars in 1015 bytes} [Sat Jul 30 21:00:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:24.099451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea7a70-1a4e-4d78-a703-7f2a73e1a1ed None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:24.101688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-24ea7a70-1a4e-4d78-a703-7f2a73e1a1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:24.119260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17b0e9-d563-45b5-8902-271a6428dd24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:24.122201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17b0e9-d563-45b5-8902-271a6428dd24 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:24.133512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea7a70-1a4e-4d78-a703-7f2a73e1a1ed None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:24.138240 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 873/1752] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:24.141536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740dcef-0c3f-49ec-aa3b-5da2aa409bf9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:24.141918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740dcef-0c3f-49ec-aa3b-5da2aa409bf9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:24.142285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740dcef-0c3f-49ec-aa3b-5da2aa409bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:24.156275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:24.174108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a7e83-feed-41bd-8d21-ce881f29678d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:24.174788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a7e83-feed-41bd-8d21-ce881f29678d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:24.175073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a7e83-feed-41bd-8d21-ce881f29678d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:24.178513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a7e83-feed-41bd-8d21-ce881f29678d admin admin] PATH_INFO: `/v3/users/a60da9ceedcb484c80c56ad3b6bb7366` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:24.186327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a7e83-feed-41bd-8d21-ce881f29678d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a60da9ceedcb484c80c56ad3b6bb7366)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:24.196829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a7e83-feed-41bd-8d21-ce881f29678d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:24.197527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1740dcef-0c3f-49ec-aa3b-5da2aa409bf9 None None] MFA Rules not processed for user `125f370710a141bc8921c64a8ca24b53`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:24.199631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1740dcef-0c3f-49ec-aa3b-5da2aa409bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:24.313474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5f5a7e83-feed-41bd-8d21-ce881f29678d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a60da9ceedcb484c80c56ad3b6bb7366'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:24.314172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5f5a7e83-feed-41bd-8d21-ce881f29678d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a60da9ceedcb484c80c56ad3b6bb7366'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:24.327259 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 874/1753] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:24.328476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740dcef-0c3f-49ec-aa3b-5da2aa409bf9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:24.341654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5f5a7e83-feed-41bd-8d21-ce881f29678d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a60da9ceedcb484c80c56ad3b6bb7366'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:24.342737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5f5a7e83-feed-41bd-8d21-ce881f29678d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a60da9ceedcb484c80c56ad3b6bb7366'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:24.354205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740dcef-0c3f-49ec-aa3b-5da2aa409bf9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:24.354495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5f5a7e83-feed-41bd-8d21-ce881f29678d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a60da9ceedcb484c80c56ad3b6bb7366'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:24.371493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9cefd-5fae-4402-b79a-96d83a7b4033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:24.372629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9cefd-5fae-4402-b79a-96d83a7b4033 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:24.373129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9cefd-5fae-4402-b79a-96d83a7b4033 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:24.373635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9cefd-5fae-4402-b79a-96d83a7b4033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:24.374621 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 880/1754] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:00:24 2022] DELETE /identity/v3/users/a60da9ceedcb484c80c56ad3b6bb7366 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:24.375447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a7e83-feed-41bd-8d21-ce881f29678d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:24.379008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5f5a7e83-feed-41bd-8d21-ce881f29678d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:24.385164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9ba9cefd-5fae-4402-b79a-96d83a7b4033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:24.405623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:24.413876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9cefd-5fae-4402-b79a-96d83a7b4033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:24.417769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9cefd-5fae-4402-b79a-96d83a7b4033 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:24.445435 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 875/1755] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:24.448586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9cefd-5fae-4402-b79a-96d83a7b4033 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:24.454322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9ba9cefd-5fae-4402-b79a-96d83a7b4033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:24.476393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9cefd-5fae-4402-b79a-96d83a7b4033 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:24.499877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a7e83-feed-41bd-8d21-ce881f29678d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:24.510342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be8a27-388b-49c9-acc1-2869e1800f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:24.511082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be8a27-388b-49c9-acc1-2869e1800f63 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:24.511326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be8a27-388b-49c9-acc1-2869e1800f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:24.511615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be8a27-388b-49c9-acc1-2869e1800f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:24.514543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f3be8a27-388b-49c9-acc1-2869e1800f63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:24.533895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be8a27-388b-49c9-acc1-2869e1800f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:24.536312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be8a27-388b-49c9-acc1-2869e1800f63 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:24.547452 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 881/1756] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:24.549260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2417d-75bb-4e2e-855b-7ceffbadc42b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:24.549663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2417d-75bb-4e2e-855b-7ceffbadc42b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:24.550043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2417d-75bb-4e2e-855b-7ceffbadc42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:24.596857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5fc2417d-75bb-4e2e-855b-7ceffbadc42b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:24.598696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5fc2417d-75bb-4e2e-855b-7ceffbadc42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:24.605992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed24ab-4837-4823-88a0-76c0ef2c311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:24.606772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed24ab-4837-4823-88a0-76c0ef2c311d admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:24.607094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed24ab-4837-4823-88a0-76c0ef2c311d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:24.607365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed24ab-4837-4823-88a0-76c0ef2c311d admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:24.608156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed24ab-4837-4823-88a0-76c0ef2c311d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:24.613899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed24ab-4837-4823-88a0-76c0ef2c311d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:24.614717 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 882/1757] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:24.638527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2417d-75bb-4e2e-855b-7ceffbadc42b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:24.640248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5fc2417d-75bb-4e2e-855b-7ceffbadc42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:24.660135 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 876/1758] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:24 2022] POST /identity/v3/projects => generated 391 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:24.676972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed24ab-4837-4823-88a0-76c0ef2c311d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:24.677265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2417d-75bb-4e2e-855b-7ceffbadc42b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:24.849417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed24ab-4837-4823-88a0-76c0ef2c311d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:24.871321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf79c7-8a31-40e8-9803-026e841306e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:24.871321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf79c7-8a31-40e8-9803-026e841306e3 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:24.871321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf79c7-8a31-40e8-9803-026e841306e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:24.871321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf79c7-8a31-40e8-9803-026e841306e3 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:24.871743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf79c7-8a31-40e8-9803-026e841306e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:24.873201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf79c7-8a31-40e8-9803-026e841306e3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:24.887580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:24.923189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a574e-0006-4121-bb87-02a9772c084a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:24.924027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a574e-0006-4121-bb87-02a9772c084a service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:24.924315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a574e-0006-4121-bb87-02a9772c084a service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:24.924586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a574e-0006-4121-bb87-02a9772c084a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:24.930430 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 877/1759] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:24 2022] POST /identity/v3/users => generated 302 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:24.932044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf79c7-8a31-40e8-9803-026e841306e3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:24.952843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a574e-0006-4121-bb87-02a9772c084a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:24.954347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a574e-0006-4121-bb87-02a9772c084a service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:24.959823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf79c7-8a31-40e8-9803-026e841306e3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:24.981955 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 883/1760] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:00:24.982990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b52f7d-37c4-4dde-bee8-1ba6b5c6fa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:24.983688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b52f7d-37c4-4dde-bee8-1ba6b5c6fa8d admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:24.983969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b52f7d-37c4-4dde-bee8-1ba6b5c6fa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:24.984245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b52f7d-37c4-4dde-bee8-1ba6b5c6fa8d admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:24.984960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b52f7d-37c4-4dde-bee8-1ba6b5c6fa8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:24.986587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b52f7d-37c4-4dde-bee8-1ba6b5c6fa8d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:25.019850 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 878/1761] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:25.021806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a574e-0006-4121-bb87-02a9772c084a service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:25.056636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a574e-0006-4121-bb87-02a9772c084a service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:25.069243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be884ddd-7612-448a-b103-b55f0114f42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:25.070490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be884ddd-7612-448a-b103-b55f0114f42a admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:25.071234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be884ddd-7612-448a-b103-b55f0114f42a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:25.082312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be884ddd-7612-448a-b103-b55f0114f42a admin admin] PATH_INFO: `/v3/projects/c0ac473ab1ae41bfaf7da86ca5dce6ee/users/e3545d91d8f84d32b769d9f442be9085/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:25.135259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be884ddd-7612-448a-b103-b55f0114f42a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ac473ab1ae41bfaf7da86ca5dce6ee, user_id=e3545d91d8f84d32b769d9f442be9085, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:25.138412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be884ddd-7612-448a-b103-b55f0114f42a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:25.175776 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 884/1762] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:25 2022] PUT /identity/v3/projects/c0ac473ab1ae41bfaf7da86ca5dce6ee/users/e3545d91d8f84d32b769d9f442be9085/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:00:25.180939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be884ddd-7612-448a-b103-b55f0114f42a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:25.181278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d787199-77f6-4264-96c1-ac48cd16e3a7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:25.181790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d787199-77f6-4264-96c1-ac48cd16e3a7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:25.182261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d787199-77f6-4264-96c1-ac48cd16e3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:25.221715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7d787199-77f6-4264-96c1-ac48cd16e3a7 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:25.223393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7d787199-77f6-4264-96c1-ac48cd16e3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:25.338293 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 879/1763] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:00:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:00:25.357334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d787199-77f6-4264-96c1-ac48cd16e3a7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:25.363608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7d787199-77f6-4264-96c1-ac48cd16e3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:25.384722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be884ddd-7612-448a-b103-b55f0114f42a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:25.395582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d2729-d77a-4feb-9cf2-6b2287c63cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:25.395582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d2729-d77a-4feb-9cf2-6b2287c63cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:25.395582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d2729-d77a-4feb-9cf2-6b2287c63cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:25.395582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d2729-d77a-4feb-9cf2-6b2287c63cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:25.396081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d2729-d77a-4feb-9cf2-6b2287c63cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:25.396081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d2729-d77a-4feb-9cf2-6b2287c63cf0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:25.419461 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 885/1764] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:25.424089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d2729-d77a-4feb-9cf2-6b2287c63cf0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:25.450558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d2729-d77a-4feb-9cf2-6b2287c63cf0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:25.464192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92906229-35bb-470c-98ab-484b510f9e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:25.465063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92906229-35bb-470c-98ab-484b510f9e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:25.465544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92906229-35bb-470c-98ab-484b510f9e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:25.465808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92906229-35bb-470c-98ab-484b510f9e40 admin admin] PATH_INFO: `/v3/projects/c0ac473ab1ae41bfaf7da86ca5dce6ee/users/e3545d91d8f84d32b769d9f442be9085/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:25.471530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92906229-35bb-470c-98ab-484b510f9e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ac473ab1ae41bfaf7da86ca5dce6ee, user_id=e3545d91d8f84d32b769d9f442be9085, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:25.474699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92906229-35bb-470c-98ab-484b510f9e40 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:25.487009 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 886/1765] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:25 2022] PUT /identity/v3/projects/c0ac473ab1ae41bfaf7da86ca5dce6ee/users/e3545d91d8f84d32b769d9f442be9085/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:25.499054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a31f1e-2b35-49b1-b949-f898c99c9d99 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:25.499479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a31f1e-2b35-49b1-b949-f898c99c9d99 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:25.499656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a31f1e-2b35-49b1-b949-f898c99c9d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:25.507114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d787199-77f6-4264-96c1-ac48cd16e3a7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:25.535324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:25.545995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-40a31f1e-2b35-49b1-b949-f898c99c9d99 None None] MFA Rules not processed for user `e3545d91d8f84d32b769d9f442be9085`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:25.549430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-40a31f1e-2b35-49b1-b949-f898c99c9d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:25.648283 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 887/1766] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:00:25.663806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a31f1e-2b35-49b1-b949-f898c99c9d99 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:25.669484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2737a-755e-4bcb-913c-ee4f580c8180 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:25.670133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2737a-755e-4bcb-913c-ee4f580c8180 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:25.670588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2737a-755e-4bcb-913c-ee4f580c8180 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:25.670874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2737a-755e-4bcb-913c-ee4f580c8180 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:25.717290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:25.774891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2737a-755e-4bcb-913c-ee4f580c8180 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:25.777328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2737a-755e-4bcb-913c-ee4f580c8180 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:25.788423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a31f1e-2b35-49b1-b949-f898c99c9d99 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:25.793898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35fbb8-3f59-4586-b4c9-c663fd7f7139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:25.794658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35fbb8-3f59-4586-b4c9-c663fd7f7139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:25.794944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35fbb8-3f59-4586-b4c9-c663fd7f7139 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:25.795283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35fbb8-3f59-4586-b4c9-c663fd7f7139 admin admin] PATH_INFO: `/v3/users/125f370710a141bc8921c64a8ca24b53` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:25.796675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35fbb8-3f59-4586-b4c9-c663fd7f7139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=125f370710a141bc8921c64a8ca24b53)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:25.798554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35fbb8-3f59-4586-b4c9-c663fd7f7139 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:25.804566 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 880/1767] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:00:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 30 21:00:25.885534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0a35fbb8-3f59-4586-b4c9-c663fd7f7139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '125f370710a141bc8921c64a8ca24b53'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:25.887925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0a35fbb8-3f59-4586-b4c9-c663fd7f7139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '125f370710a141bc8921c64a8ca24b53'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:25.924911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0a35fbb8-3f59-4586-b4c9-c663fd7f7139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '125f370710a141bc8921c64a8ca24b53'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:25.928140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0a35fbb8-3f59-4586-b4c9-c663fd7f7139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '125f370710a141bc8921c64a8ca24b53'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:25.947212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0a35fbb8-3f59-4586-b4c9-c663fd7f7139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '125f370710a141bc8921c64a8ca24b53'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:25.989597 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 888/1768] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:00:25 2022] DELETE /identity/v3/users/125f370710a141bc8921c64a8ca24b53 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:00:25.995182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10841f11-92b3-416e-a0f2-c92897053a82 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:25.997014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10841f11-92b3-416e-a0f2-c92897053a82 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:25.998001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10841f11-92b3-416e-a0f2-c92897053a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:26.056206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-10841f11-92b3-416e-a0f2-c92897053a82 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:26.061414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-10841f11-92b3-416e-a0f2-c92897053a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:26.269968 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 881/1769] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:26.287798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35fbb8-3f59-4586-b4c9-c663fd7f7139 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:26.289848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0a35fbb8-3f59-4586-b4c9-c663fd7f7139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:26.338283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:26.376147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10841f11-92b3-416e-a0f2-c92897053a82 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:26.378182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-10841f11-92b3-416e-a0f2-c92897053a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:26.401740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10841f11-92b3-416e-a0f2-c92897053a82 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:26.420347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd2c15-e626-47ee-b009-da578a9865a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:26.421027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd2c15-e626-47ee-b009-da578a9865a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:26.421307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd2c15-e626-47ee-b009-da578a9865a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:26.421580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd2c15-e626-47ee-b009-da578a9865a3 admin admin] PATH_INFO: `/v3/projects/90b1500a858541a9b3ff58c218737af4` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:26.424675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd2c15-e626-47ee-b009-da578a9865a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90b1500a858541a9b3ff58c218737af4)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:26.426679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd2c15-e626-47ee-b009-da578a9865a3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:26.543406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-afcd2c15-e626-47ee-b009-da578a9865a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90b1500a858541a9b3ff58c218737af4', 'request_id': 'req-afcd2c15-e626-47ee-b009-da578a9865a3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:26.552310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-afcd2c15-e626-47ee-b009-da578a9865a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90b1500a858541a9b3ff58c218737af4', 'request_id': 'req-afcd2c15-e626-47ee-b009-da578a9865a3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:26.574550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-afcd2c15-e626-47ee-b009-da578a9865a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90b1500a858541a9b3ff58c218737af4', 'request_id': 'req-afcd2c15-e626-47ee-b009-da578a9865a3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:26.602228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-afcd2c15-e626-47ee-b009-da578a9865a3 admin admin] The token cache is being invalidate because project 90b1500a858541a9b3ff58c218737af4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:00:26.602595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-afcd2c15-e626-47ee-b009-da578a9865a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:26.603489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-afcd2c15-e626-47ee-b009-da578a9865a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:26.605672 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 882/1770] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:00:26 2022] DELETE /identity/v3/projects/90b1500a858541a9b3ff58c218737af4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:00:26.606496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd2c15-e626-47ee-b009-da578a9865a3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:26.622861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-afcd2c15-e626-47ee-b009-da578a9865a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:26.629657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35fbb8-3f59-4586-b4c9-c663fd7f7139 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:26.796475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1a27e-3cf7-40f3-bf12-7a32f30e577d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:26.797141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1a27e-3cf7-40f3-bf12-7a32f30e577d service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:26.797436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1a27e-3cf7-40f3-bf12-7a32f30e577d service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:26.799005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1a27e-3cf7-40f3-bf12-7a32f30e577d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:26.806614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0af1a27e-3cf7-40f3-bf12-7a32f30e577d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:26.841586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:26.872122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd2c15-e626-47ee-b009-da578a9865a3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:26.880965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c7954-039d-4444-a3a9-40882d487845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:26.882868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c7954-039d-4444-a3a9-40882d487845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:26.883333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c7954-039d-4444-a3a9-40882d487845 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:26.883857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c7954-039d-4444-a3a9-40882d487845 admin admin] PATH_INFO: `/v3/projects/67d32a6472ff40aa8e83b8fbb931fcd8` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:26.885787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c7954-039d-4444-a3a9-40882d487845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67d32a6472ff40aa8e83b8fbb931fcd8)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:26.889305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c7954-039d-4444-a3a9-40882d487845 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:26.965438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1a27e-3cf7-40f3-bf12-7a32f30e577d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:26.967452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1a27e-3cf7-40f3-bf12-7a32f30e577d service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:26.987153 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 889/1771] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:00:26.988424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1a27e-3cf7-40f3-bf12-7a32f30e577d service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:26.991084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0af1a27e-3cf7-40f3-bf12-7a32f30e577d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:27.002794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9a5c7954-039d-4444-a3a9-40882d487845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67d32a6472ff40aa8e83b8fbb931fcd8', 'request_id': 'req-9a5c7954-039d-4444-a3a9-40882d487845'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:27.009826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1a27e-3cf7-40f3-bf12-7a32f30e577d service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:27.023060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9a5c7954-039d-4444-a3a9-40882d487845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67d32a6472ff40aa8e83b8fbb931fcd8', 'request_id': 'req-9a5c7954-039d-4444-a3a9-40882d487845'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:27.035064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9a5c7954-039d-4444-a3a9-40882d487845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67d32a6472ff40aa8e83b8fbb931fcd8', 'request_id': 'req-9a5c7954-039d-4444-a3a9-40882d487845'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:27.059731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9a5c7954-039d-4444-a3a9-40882d487845 admin admin] The token cache is being invalidate because project 67d32a6472ff40aa8e83b8fbb931fcd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:00:27.060361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9a5c7954-039d-4444-a3a9-40882d487845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:27.061149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9a5c7954-039d-4444-a3a9-40882d487845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:27.065447 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 883/1772] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:00:26 2022] DELETE /identity/v3/projects/67d32a6472ff40aa8e83b8fbb931fcd8 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:27.069586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c7954-039d-4444-a3a9-40882d487845 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:27.073194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9a5c7954-039d-4444-a3a9-40882d487845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:27.150879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31679e7-f3c7-441d-a539-cd47f63899e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:27.151598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31679e7-f3c7-441d-a539-cd47f63899e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:27.151882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31679e7-f3c7-441d-a539-cd47f63899e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:27.152158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31679e7-f3c7-441d-a539-cd47f63899e4 admin admin] PATH_INFO: `/v3/users/37ab6d2c416e4f39945577268bd89bde` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:27.154326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31679e7-f3c7-441d-a539-cd47f63899e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ab6d2c416e4f39945577268bd89bde)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:27.156885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31679e7-f3c7-441d-a539-cd47f63899e4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:27.226633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:27.265320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c7954-039d-4444-a3a9-40882d487845 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:27.275633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d31679e7-f3c7-441d-a539-cd47f63899e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ab6d2c416e4f39945577268bd89bde'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:27.276985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d31679e7-f3c7-441d-a539-cd47f63899e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ab6d2c416e4f39945577268bd89bde'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:27.282135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c963b-6907-4d5b-a0e9-1d62778c450e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:27.282135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c963b-6907-4d5b-a0e9-1d62778c450e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:27.284800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c963b-6907-4d5b-a0e9-1d62778c450e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:27.285137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c963b-6907-4d5b-a0e9-1d62778c450e admin admin] PATH_INFO: `/v3/users/d8d6aa44f2bc4ca6aefcb83b1f41096f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:27.288443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c963b-6907-4d5b-a0e9-1d62778c450e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d6aa44f2bc4ca6aefcb83b1f41096f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:27.298369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c963b-6907-4d5b-a0e9-1d62778c450e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:27.327732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d31679e7-f3c7-441d-a539-cd47f63899e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ab6d2c416e4f39945577268bd89bde'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:27.345980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d31679e7-f3c7-441d-a539-cd47f63899e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ab6d2c416e4f39945577268bd89bde'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:27.373888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d31679e7-f3c7-441d-a539-cd47f63899e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ab6d2c416e4f39945577268bd89bde'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:27.415324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-188c963b-6907-4d5b-a0e9-1d62778c450e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d6aa44f2bc4ca6aefcb83b1f41096f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:27.430089 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 890/1773] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:00:26 2022] DELETE /identity/v3/users/37ab6d2c416e4f39945577268bd89bde => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:27.445880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-188c963b-6907-4d5b-a0e9-1d62778c450e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d6aa44f2bc4ca6aefcb83b1f41096f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:27.447358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-188c963b-6907-4d5b-a0e9-1d62778c450e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d6aa44f2bc4ca6aefcb83b1f41096f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:27.465576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-188c963b-6907-4d5b-a0e9-1d62778c450e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d6aa44f2bc4ca6aefcb83b1f41096f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:27.467560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-188c963b-6907-4d5b-a0e9-1d62778c450e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d6aa44f2bc4ca6aefcb83b1f41096f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:27.497527 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 884/1774] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:00:27 2022] DELETE /identity/v3/users/d8d6aa44f2bc4ca6aefcb83b1f41096f => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:27.745176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bef9ea-e421-44cd-a78c-797dd510d458 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:27.746022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bef9ea-e421-44cd-a78c-797dd510d458 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:27.746022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bef9ea-e421-44cd-a78c-797dd510d458 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:27.748195 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 891/1775] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:00:27.796253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f704fae-1144-45e4-923a-ba45a2c77447 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:27.796537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f704fae-1144-45e4-923a-ba45a2c77447 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:27.796872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f704fae-1144-45e4-923a-ba45a2c77447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:27.813455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:27.881319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3f704fae-1144-45e4-923a-ba45a2c77447 None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:27.882558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3f704fae-1144-45e4-923a-ba45a2c77447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:28.138752 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 885/1776] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:00:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:28.376199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bef9ea-e421-44cd-a78c-797dd510d458 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:28.378327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-60bef9ea-e421-44cd-a78c-797dd510d458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:28.423861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bef9ea-e421-44cd-a78c-797dd510d458 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:28.440302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a921a1-3d80-4203-938d-e6fdd66f566a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:28.441378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a921a1-3d80-4203-938d-e6fdd66f566a service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:28.442394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a921a1-3d80-4203-938d-e6fdd66f566a service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:28.442850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a921a1-3d80-4203-938d-e6fdd66f566a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:28.464219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a921a1-3d80-4203-938d-e6fdd66f566a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:28.466269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a921a1-3d80-4203-938d-e6fdd66f566a service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:28.504113 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 892/1777] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:28.685883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f704fae-1144-45e4-923a-ba45a2c77447 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:28.687398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3f704fae-1144-45e4-923a-ba45a2c77447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:28.936807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f704fae-1144-45e4-923a-ba45a2c77447 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:28.948426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ba1fc-663d-45be-8b16-d4cc5347cf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:28.948426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ba1fc-663d-45be-8b16-d4cc5347cf00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:28.948426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ba1fc-663d-45be-8b16-d4cc5347cf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:28.948426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ba1fc-663d-45be-8b16-d4cc5347cf00 admin admin] PATH_INFO: `/v3/projects/6fb829f854e141608eabae2e92e4a67a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:28.965746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ba1fc-663d-45be-8b16-d4cc5347cf00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fb829f854e141608eabae2e92e4a67a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:28.966839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ba1fc-663d-45be-8b16-d4cc5347cf00 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:29.072168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f24ba1fc-663d-45be-8b16-d4cc5347cf00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb829f854e141608eabae2e92e4a67a', 'request_id': 'req-f24ba1fc-663d-45be-8b16-d4cc5347cf00'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:29.079657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f24ba1fc-663d-45be-8b16-d4cc5347cf00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb829f854e141608eabae2e92e4a67a', 'request_id': 'req-f24ba1fc-663d-45be-8b16-d4cc5347cf00'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:29.091625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f24ba1fc-663d-45be-8b16-d4cc5347cf00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb829f854e141608eabae2e92e4a67a', 'request_id': 'req-f24ba1fc-663d-45be-8b16-d4cc5347cf00'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:29.105710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f24ba1fc-663d-45be-8b16-d4cc5347cf00 admin admin] The token cache is being invalidate because project 6fb829f854e141608eabae2e92e4a67a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:00:29.106572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f24ba1fc-663d-45be-8b16-d4cc5347cf00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:29.107700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f24ba1fc-663d-45be-8b16-d4cc5347cf00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:29.109987 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 886/1778] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:00:28 2022] DELETE /identity/v3/projects/6fb829f854e141608eabae2e92e4a67a => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:29.114884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b92ff4-4d1b-4f71-a34e-8809cb3942e9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:29.115466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b92ff4-4d1b-4f71-a34e-8809cb3942e9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:29.115629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b92ff4-4d1b-4f71-a34e-8809cb3942e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:29.172694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c9b92ff4-4d1b-4f71-a34e-8809cb3942e9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:29.174179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c9b92ff4-4d1b-4f71-a34e-8809cb3942e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:29.352046 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 893/1779] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:29.364963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fed19-bc41-448d-89e0-336eb1afc21a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:29.365314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fed19-bc41-448d-89e0-336eb1afc21a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:29.365557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fed19-bc41-448d-89e0-336eb1afc21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:29.449153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-797fed19-bc41-448d-89e0-336eb1afc21a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:29.450993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-797fed19-bc41-448d-89e0-336eb1afc21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:29.492745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b92ff4-4d1b-4f71-a34e-8809cb3942e9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:29.497713 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 887/1780] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:29.510217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b92ff4-4d1b-4f71-a34e-8809cb3942e9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:29.520726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a634732-db49-47e9-863d-765537177cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:29.521623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a634732-db49-47e9-863d-765537177cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:29.522036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a634732-db49-47e9-863d-765537177cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:29.523628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a634732-db49-47e9-863d-765537177cc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:29.524692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a634732-db49-47e9-863d-765537177cc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:00:29.525279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a634732-db49-47e9-863d-765537177cc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:29.528428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a634732-db49-47e9-863d-765537177cc8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:29.580135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797fed19-bc41-448d-89e0-336eb1afc21a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:29.582293 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 894/1781] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:00:29.590683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797fed19-bc41-448d-89e0-336eb1afc21a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:29.599585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5027c84-e750-456a-9e92-61979932161c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:29.600234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5027c84-e750-456a-9e92-61979932161c admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:29.600528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5027c84-e750-456a-9e92-61979932161c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:29.600858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5027c84-e750-456a-9e92-61979932161c admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:29.601547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5027c84-e750-456a-9e92-61979932161c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:29.603511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5027c84-e750-456a-9e92-61979932161c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:29.642884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:29.655966 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 888/1782] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:29 2022] POST /identity/v3/projects => generated 405 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:29.660019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a634732-db49-47e9-863d-765537177cc8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:29.690168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a634732-db49-47e9-863d-765537177cc8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:29.879771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966c8a5-30c1-42a3-9b98-8ae689dfb390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:29.885233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5027c84-e750-456a-9e92-61979932161c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:29.885806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966c8a5-30c1-42a3-9b98-8ae689dfb390 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:29.886423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966c8a5-30c1-42a3-9b98-8ae689dfb390 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:29.886727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966c8a5-30c1-42a3-9b98-8ae689dfb390 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:29.888615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c5027c84-e750-456a-9e92-61979932161c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:29.889152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966c8a5-30c1-42a3-9b98-8ae689dfb390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:29.893489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966c8a5-30c1-42a3-9b98-8ae689dfb390 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:29.920544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5027c84-e750-456a-9e92-61979932161c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:29.988334 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 895/1783] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:29 2022] POST /identity/v3/users => generated 303 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:29.989119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966c8a5-30c1-42a3-9b98-8ae689dfb390 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:29.989807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376c288-868e-4f83-b7dc-6b756e9a5190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:29.996166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376c288-868e-4f83-b7dc-6b756e9a5190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:29.997729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376c288-868e-4f83-b7dc-6b756e9a5190 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:29.998261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376c288-868e-4f83-b7dc-6b756e9a5190 admin admin] PATH_INFO: `/v3/projects/57aa45c38d22411da538ff9c6533d5fa` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:30.006530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376c288-868e-4f83-b7dc-6b756e9a5190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57aa45c38d22411da538ff9c6533d5fa)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:30.010657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376c288-868e-4f83-b7dc-6b756e9a5190 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:30.019442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:30.034953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966c8a5-30c1-42a3-9b98-8ae689dfb390 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:30.052163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27400042-0ca1-4b25-a803-9a7cf6b8ce49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:30.055252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27400042-0ca1-4b25-a803-9a7cf6b8ce49 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:30.055598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27400042-0ca1-4b25-a803-9a7cf6b8ce49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:30.055883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27400042-0ca1-4b25-a803-9a7cf6b8ce49 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:30.056619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27400042-0ca1-4b25-a803-9a7cf6b8ce49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:30.063450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27400042-0ca1-4b25-a803-9a7cf6b8ce49 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:30.090030 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 896/1784] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:30.098560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27400042-0ca1-4b25-a803-9a7cf6b8ce49 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:30.148466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27400042-0ca1-4b25-a803-9a7cf6b8ce49 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:30.166553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4376c288-868e-4f83-b7dc-6b756e9a5190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57aa45c38d22411da538ff9c6533d5fa', 'request_id': 'req-4376c288-868e-4f83-b7dc-6b756e9a5190'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:30.201362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4376c288-868e-4f83-b7dc-6b756e9a5190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57aa45c38d22411da538ff9c6533d5fa', 'request_id': 'req-4376c288-868e-4f83-b7dc-6b756e9a5190'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:30.234855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4376c288-868e-4f83-b7dc-6b756e9a5190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57aa45c38d22411da538ff9c6533d5fa', 'request_id': 'req-4376c288-868e-4f83-b7dc-6b756e9a5190'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:30.261215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4376c288-868e-4f83-b7dc-6b756e9a5190 admin admin] The token cache is being invalidate because project 57aa45c38d22411da538ff9c6533d5fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:00:30.261561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4376c288-868e-4f83-b7dc-6b756e9a5190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:30.262827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4376c288-868e-4f83-b7dc-6b756e9a5190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:30.266692 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 889/1785] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:00:29 2022] DELETE /identity/v3/projects/57aa45c38d22411da538ff9c6533d5fa => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:00:30.268636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376c288-868e-4f83-b7dc-6b756e9a5190 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:30.274707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4376c288-868e-4f83-b7dc-6b756e9a5190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:30.330620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c2ad9-f523-4543-8a6d-81137da8c5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:30.331318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c2ad9-f523-4543-8a6d-81137da8c5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:30.331613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c2ad9-f523-4543-8a6d-81137da8c5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:30.331912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c2ad9-f523-4543-8a6d-81137da8c5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:30.332608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c2ad9-f523-4543-8a6d-81137da8c5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:30.340406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c2ad9-f523-4543-8a6d-81137da8c5e6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:30.379876 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 897/1786] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:30.385511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85249e10-30d3-4339-abf9-c45d854aeba1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:30.385755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85249e10-30d3-4339-abf9-c45d854aeba1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:30.386071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85249e10-30d3-4339-abf9-c45d854aeba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:30.438156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-85249e10-30d3-4339-abf9-c45d854aeba1 None None] MFA Rules not processed for user `4a886ccf9590432caf209526410a7b53`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:30.439485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-85249e10-30d3-4339-abf9-c45d854aeba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:30.488659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376c288-868e-4f83-b7dc-6b756e9a5190 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:30.506373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732d246-a822-433f-89de-2ddf6d23ef01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:30.507194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732d246-a822-433f-89de-2ddf6d23ef01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:30.507491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732d246-a822-433f-89de-2ddf6d23ef01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:30.507776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732d246-a822-433f-89de-2ddf6d23ef01 admin admin] PATH_INFO: `/v3/projects/263cdea67dc24a41800ec4bd32d32719` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:30.509027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732d246-a822-433f-89de-2ddf6d23ef01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=263cdea67dc24a41800ec4bd32d32719)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:30.510969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732d246-a822-433f-89de-2ddf6d23ef01 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:30.560682 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 898/1787] 10.222.0.47 () {58 vars in 1015 bytes} [Sat Jul 30 21:00:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:30.562486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85249e10-30d3-4339-abf9-c45d854aeba1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:30.564046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-85249e10-30d3-4339-abf9-c45d854aeba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:30.579621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85249e10-30d3-4339-abf9-c45d854aeba1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:30.584790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e985a7-7e51-4b28-ae13-7749baf93c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:30.585598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e985a7-7e51-4b28-ae13-7749baf93c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:30.585834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e985a7-7e51-4b28-ae13-7749baf93c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:30.586141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e985a7-7e51-4b28-ae13-7749baf93c56 admin admin] PATH_INFO: `/v3/users/e3545d91d8f84d32b769d9f442be9085` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:30.587499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e985a7-7e51-4b28-ae13-7749baf93c56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3545d91d8f84d32b769d9f442be9085)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:30.589752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e985a7-7e51-4b28-ae13-7749baf93c56 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:30.631762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0732d246-a822-433f-89de-2ddf6d23ef01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '263cdea67dc24a41800ec4bd32d32719', 'request_id': 'req-0732d246-a822-433f-89de-2ddf6d23ef01'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:30.641908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0732d246-a822-433f-89de-2ddf6d23ef01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '263cdea67dc24a41800ec4bd32d32719', 'request_id': 'req-0732d246-a822-433f-89de-2ddf6d23ef01'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:30.660671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0732d246-a822-433f-89de-2ddf6d23ef01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '263cdea67dc24a41800ec4bd32d32719', 'request_id': 'req-0732d246-a822-433f-89de-2ddf6d23ef01'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:30.675961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-43e985a7-7e51-4b28-ae13-7749baf93c56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3545d91d8f84d32b769d9f442be9085'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:30.676707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-43e985a7-7e51-4b28-ae13-7749baf93c56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3545d91d8f84d32b769d9f442be9085'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:30.678180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0732d246-a822-433f-89de-2ddf6d23ef01 admin admin] The token cache is being invalidate because project 263cdea67dc24a41800ec4bd32d32719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:00:30.678475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0732d246-a822-433f-89de-2ddf6d23ef01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:30.680792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0732d246-a822-433f-89de-2ddf6d23ef01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:30.688238 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 890/1788] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:00:30 2022] DELETE /identity/v3/projects/263cdea67dc24a41800ec4bd32d32719 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:30.688238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732d246-a822-433f-89de-2ddf6d23ef01 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:30.688238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0732d246-a822-433f-89de-2ddf6d23ef01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:30.694191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-43e985a7-7e51-4b28-ae13-7749baf93c56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3545d91d8f84d32b769d9f442be9085'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:30.695187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-43e985a7-7e51-4b28-ae13-7749baf93c56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3545d91d8f84d32b769d9f442be9085'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:30.708813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-43e985a7-7e51-4b28-ae13-7749baf93c56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3545d91d8f84d32b769d9f442be9085'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:30.729442 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 899/1789] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:00:30 2022] DELETE /identity/v3/users/e3545d91d8f84d32b769d9f442be9085 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:30.730438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e985a7-7e51-4b28-ae13-7749baf93c56 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:30.732089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-43e985a7-7e51-4b28-ae13-7749baf93c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:30.750077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:30.750325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:30.838902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e985a7-7e51-4b28-ae13-7749baf93c56 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:30.846131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7748e-6739-4257-b6e4-b3169e1e445a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:30.846896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7748e-6739-4257-b6e4-b3169e1e445a service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:30.847203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7748e-6739-4257-b6e4-b3169e1e445a service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:30.847523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7748e-6739-4257-b6e4-b3169e1e445a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:30.850152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a6e7748e-6739-4257-b6e4-b3169e1e445a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:30.864314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7748e-6739-4257-b6e4-b3169e1e445a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:30.865985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7748e-6739-4257-b6e4-b3169e1e445a service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:30.884284 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 900/1790] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:30.892193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2af07a-ac09-40a7-95ec-d00588df46ec None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:30.893938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2af07a-ac09-40a7-95ec-d00588df46ec None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:30.894265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2af07a-ac09-40a7-95ec-d00588df46ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:30.921284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732d246-a822-433f-89de-2ddf6d23ef01 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:30.948892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fd2af07a-ac09-40a7-95ec-d00588df46ec None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:30.950219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fd2af07a-ac09-40a7-95ec-d00588df46ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:31.143984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3f147-5d45-4c33-bac9-5c66e567c676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:31.148429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3f147-5d45-4c33-bac9-5c66e567c676 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:31.148715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3f147-5d45-4c33-bac9-5c66e567c676 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:31.151734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3f147-5d45-4c33-bac9-5c66e567c676 admin admin] PATH_INFO: `/v3/projects/ecb96d24370c4d089b55465608aa89ca/users/df90dd2310f44c4b9b80bbb897a2ea1e/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:31.178493 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 901/1791] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:31.186588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca3d3d-64f8-4727-9492-f6a99db4d726 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:31.186974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca3d3d-64f8-4727-9492-f6a99db4d726 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:31.187387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca3d3d-64f8-4727-9492-f6a99db4d726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:31.212587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4dca3d3d-64f8-4727-9492-f6a99db4d726 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:31.214599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4dca3d3d-64f8-4727-9492-f6a99db4d726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:31.216901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3f147-5d45-4c33-bac9-5c66e567c676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb96d24370c4d089b55465608aa89ca, user_id=df90dd2310f44c4b9b80bbb897a2ea1e, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:31.223764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3f147-5d45-4c33-bac9-5c66e567c676 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:31.229315 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 902/1792] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:31.230423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca3d3d-64f8-4727-9492-f6a99db4d726 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:31.241285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca3d3d-64f8-4727-9492-f6a99db4d726 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:31.249130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16365b85-ca3f-4724-a24c-ffa56a37a0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:31.250477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16365b85-ca3f-4724-a24c-ffa56a37a0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:31.250882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16365b85-ca3f-4724-a24c-ffa56a37a0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:31.251577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16365b85-ca3f-4724-a24c-ffa56a37a0e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:31.252400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16365b85-ca3f-4724-a24c-ffa56a37a0e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:00:31.252817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16365b85-ca3f-4724-a24c-ffa56a37a0e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:31.255189 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 891/1793] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:30 2022] PUT /identity/v3/projects/ecb96d24370c4d089b55465608aa89ca/users/df90dd2310f44c4b9b80bbb897a2ea1e/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:31.255838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16365b85-ca3f-4724-a24c-ffa56a37a0e3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:31.262906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f36b50-58df-475e-8af8-716eb29c65d8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:31.263754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f36b50-58df-475e-8af8-716eb29c65d8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:31.264196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f36b50-58df-475e-8af8-716eb29c65d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:31.277789 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 903/1794] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:00:31.279483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16365b85-ca3f-4724-a24c-ffa56a37a0e3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:31.295081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16365b85-ca3f-4724-a24c-ffa56a37a0e3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:31.362419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f8f36b50-58df-475e-8af8-716eb29c65d8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:31.364608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f8f36b50-58df-475e-8af8-716eb29c65d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:31.496883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fccde-3714-47a0-8ea0-343acef5dbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:31.497546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fccde-3714-47a0-8ea0-343acef5dbb7 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:31.497840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fccde-3714-47a0-8ea0-343acef5dbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:31.501107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fccde-3714-47a0-8ea0-343acef5dbb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:31.502382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fccde-3714-47a0-8ea0-343acef5dbb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:31.506688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fccde-3714-47a0-8ea0-343acef5dbb7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:31.557219 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 892/1795] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:31.578454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f36b50-58df-475e-8af8-716eb29c65d8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:31.578929 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 904/1796] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:31 2022] POST /identity/v3/projects => generated 387 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:31.599257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f36b50-58df-475e-8af8-716eb29c65d8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:31.640845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fccde-3714-47a0-8ea0-343acef5dbb7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:31.648316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-679fccde-3714-47a0-8ea0-343acef5dbb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:31.713763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:31.721860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:31.760331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a6fc1-c596-4b20-bd0c-5c6202615d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:31.762093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a6fc1-c596-4b20-bd0c-5c6202615d3f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:31.762093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a6fc1-c596-4b20-bd0c-5c6202615d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:31.762093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a6fc1-c596-4b20-bd0c-5c6202615d3f admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:31.762376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a6fc1-c596-4b20-bd0c-5c6202615d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:31.764328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a6fc1-c596-4b20-bd0c-5c6202615d3f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:31.837395 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 893/1797] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:31 2022] POST /identity/v3/users => generated 294 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:31.841446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a6fc1-c596-4b20-bd0c-5c6202615d3f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:31.844464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fccde-3714-47a0-8ea0-343acef5dbb7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:31.857175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cb7ae-61f8-4a3e-ba01-d8286b9804a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:31.861722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cb7ae-61f8-4a3e-ba01-d8286b9804a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:31.862156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cb7ae-61f8-4a3e-ba01-d8286b9804a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:31.862549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cb7ae-61f8-4a3e-ba01-d8286b9804a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:31.884508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a6fc1-c596-4b20-bd0c-5c6202615d3f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:31.888351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cb7ae-61f8-4a3e-ba01-d8286b9804a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:31.890580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cb7ae-61f8-4a3e-ba01-d8286b9804a3 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:31.905169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6cd10-c603-4027-9159-4ad9eb1496f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:31.906184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6cd10-c603-4027-9159-4ad9eb1496f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:31.906635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6cd10-c603-4027-9159-4ad9eb1496f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:31.907065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6cd10-c603-4027-9159-4ad9eb1496f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:31.908444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6cd10-c603-4027-9159-4ad9eb1496f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:31.911542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6cd10-c603-4027-9159-4ad9eb1496f8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:31.915388 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 905/1798] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:31.945019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cb7ae-61f8-4a3e-ba01-d8286b9804a3 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:31.946256 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 894/1799] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:31.974344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cb7ae-61f8-4a3e-ba01-d8286b9804a3 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:31.987087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36a8f9-cbbb-4960-b791-4fc26bbf288b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:31.988654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36a8f9-cbbb-4960-b791-4fc26bbf288b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:31.989630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36a8f9-cbbb-4960-b791-4fc26bbf288b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:31.990514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36a8f9-cbbb-4960-b791-4fc26bbf288b admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:31.992875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36a8f9-cbbb-4960-b791-4fc26bbf288b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:32.001888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36a8f9-cbbb-4960-b791-4fc26bbf288b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:32.042661 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 906/1800] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:32.043447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6cd10-c603-4027-9159-4ad9eb1496f8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:32.062728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6cd10-c603-4027-9159-4ad9eb1496f8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:32.072299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc657eb-cedf-4c04-9cb8-866ebc9357b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:32.082085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc657eb-cedf-4c04-9cb8-866ebc9357b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:32.082915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc657eb-cedf-4c04-9cb8-866ebc9357b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:32.084168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc657eb-cedf-4c04-9cb8-866ebc9357b3 admin admin] PATH_INFO: `/v3/projects/0e047bc76bc845649a0b0704a4931f7d/users/950f96b926474852acb90a959e369999/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:32.111207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc657eb-cedf-4c04-9cb8-866ebc9357b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e047bc76bc845649a0b0704a4931f7d, user_id=950f96b926474852acb90a959e369999, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:32.117443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc657eb-cedf-4c04-9cb8-866ebc9357b3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:32.190554 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 895/1801] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:32 2022] PUT /identity/v3/projects/0e047bc76bc845649a0b0704a4931f7d/users/950f96b926474852acb90a959e369999/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:32.201404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768ee55-840a-4b33-9181-3d63cccf43dc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:32.202182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768ee55-840a-4b33-9181-3d63cccf43dc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:32.202182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768ee55-840a-4b33-9181-3d63cccf43dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:32.259816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0768ee55-840a-4b33-9181-3d63cccf43dc None None] MFA Rules not processed for user `950f96b926474852acb90a959e369999`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:32.262182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0768ee55-840a-4b33-9181-3d63cccf43dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:32.492029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc657eb-cedf-4c04-9cb8-866ebc9357b3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:32.493975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-afc657eb-cedf-4c04-9cb8-866ebc9357b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:32.529393 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 907/1802] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:32.536494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768ee55-840a-4b33-9181-3d63cccf43dc None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:32.736164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc657eb-cedf-4c04-9cb8-866ebc9357b3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:32.758767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0cf8f-e9fc-437f-8a9e-8abbee93cd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:32.766276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0cf8f-e9fc-437f-8a9e-8abbee93cd16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:32.770110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0cf8f-e9fc-437f-8a9e-8abbee93cd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:32.772173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0cf8f-e9fc-437f-8a9e-8abbee93cd16 admin admin] PATH_INFO: `/v3/projects/c0ac473ab1ae41bfaf7da86ca5dce6ee` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:32.777529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0cf8f-e9fc-437f-8a9e-8abbee93cd16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0ac473ab1ae41bfaf7da86ca5dce6ee)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:32.782180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0cf8f-e9fc-437f-8a9e-8abbee93cd16 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:32.841846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768ee55-840a-4b33-9181-3d63cccf43dc None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:32.850030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3360cd-f258-4aa0-a4ec-eeaef2597454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:32.850773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3360cd-f258-4aa0-a4ec-eeaef2597454 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:32.851067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3360cd-f258-4aa0-a4ec-eeaef2597454 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:32.851362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3360cd-f258-4aa0-a4ec-eeaef2597454 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:32.852066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3360cd-f258-4aa0-a4ec-eeaef2597454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:32.859224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3360cd-f258-4aa0-a4ec-eeaef2597454 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:32.931528 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 908/1803] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:32 2022] POST /identity/v3/projects => generated 385 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:32.932733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3360cd-f258-4aa0-a4ec-eeaef2597454 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:32.985839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:33.114077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-91d0cf8f-e9fc-437f-8a9e-8abbee93cd16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ac473ab1ae41bfaf7da86ca5dce6ee', 'request_id': 'req-91d0cf8f-e9fc-437f-8a9e-8abbee93cd16'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:33.157075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-91d0cf8f-e9fc-437f-8a9e-8abbee93cd16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ac473ab1ae41bfaf7da86ca5dce6ee', 'request_id': 'req-91d0cf8f-e9fc-437f-8a9e-8abbee93cd16'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:33.157533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3360cd-f258-4aa0-a4ec-eeaef2597454 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:33.198552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-91d0cf8f-e9fc-437f-8a9e-8abbee93cd16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ac473ab1ae41bfaf7da86ca5dce6ee', 'request_id': 'req-91d0cf8f-e9fc-437f-8a9e-8abbee93cd16'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:33.253110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-91d0cf8f-e9fc-437f-8a9e-8abbee93cd16 admin admin] The token cache is being invalidate because project c0ac473ab1ae41bfaf7da86ca5dce6ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:00:33.255529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-91d0cf8f-e9fc-437f-8a9e-8abbee93cd16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:33.259481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-91d0cf8f-e9fc-437f-8a9e-8abbee93cd16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:33.265777 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 896/1804] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:00:32 2022] DELETE /identity/v3/projects/c0ac473ab1ae41bfaf7da86ca5dce6ee => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:33.271232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5460b73-34cf-4a55-a7c8-8b54606ec533 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:33.272494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5460b73-34cf-4a55-a7c8-8b54606ec533 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:33.273739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5460b73-34cf-4a55-a7c8-8b54606ec533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:33.325419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e5460b73-34cf-4a55-a7c8-8b54606ec533 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:33.327834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e5460b73-34cf-4a55-a7c8-8b54606ec533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:33.346275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea43d6-c904-4e85-a87e-aacc84715f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:33.349787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea43d6-c904-4e85-a87e-aacc84715f05 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:33.351316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea43d6-c904-4e85-a87e-aacc84715f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:33.351880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea43d6-c904-4e85-a87e-aacc84715f05 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:33.353548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea43d6-c904-4e85-a87e-aacc84715f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:33.355780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea43d6-c904-4e85-a87e-aacc84715f05 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:33.375986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:33.404753 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 909/1805] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:32 2022] POST /identity/v3/users => generated 299 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:33.408399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea43d6-c904-4e85-a87e-aacc84715f05 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:33.411699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2cea43d6-c904-4e85-a87e-aacc84715f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:33.453397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea43d6-c904-4e85-a87e-aacc84715f05 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:33.461232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0cf56-b757-4754-b15a-642a689fefd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:33.463257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0cf56-b757-4754-b15a-642a689fefd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:33.463761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0cf56-b757-4754-b15a-642a689fefd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:33.464752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0cf56-b757-4754-b15a-642a689fefd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:33.466648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0cf56-b757-4754-b15a-642a689fefd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:33.467267 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 897/1806] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:33.469632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0cf56-b757-4754-b15a-642a689fefd0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:33.477545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821710f-7512-41c4-abaa-dac26e6ff155 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:33.477869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821710f-7512-41c4-abaa-dac26e6ff155 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:33.478358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821710f-7512-41c4-abaa-dac26e6ff155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:33.488558 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 910/1807] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:00:33.498132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0cf56-b757-4754-b15a-642a689fefd0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:33.547221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0cf56-b757-4754-b15a-642a689fefd0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:33.551479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3821710f-7512-41c4-abaa-dac26e6ff155 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:33.556145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3821710f-7512-41c4-abaa-dac26e6ff155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:33.568062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0370f-45da-4419-8ce9-32f733c832ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:33.568773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0370f-45da-4419-8ce9-32f733c832ea admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:33.569065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0370f-45da-4419-8ce9-32f733c832ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:33.569386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0370f-45da-4419-8ce9-32f733c832ea admin admin] PATH_INFO: `/v3/projects/b93ad6350bfb456dbee1e76756e6b178/users/d75b01a28d5c40cb8f6570015c7cb807/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:33.589378 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 898/1808] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:33.595132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821710f-7512-41c4-abaa-dac26e6ff155 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:33.613417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821710f-7512-41c4-abaa-dac26e6ff155 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:33.621611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c836694-04c5-49d6-82d9-a929badf519e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:33.622419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c836694-04c5-49d6-82d9-a929badf519e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:33.622721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c836694-04c5-49d6-82d9-a929badf519e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:33.623019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c836694-04c5-49d6-82d9-a929badf519e admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:33.623733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c836694-04c5-49d6-82d9-a929badf519e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:00:33.624038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c836694-04c5-49d6-82d9-a929badf519e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:33.625740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c836694-04c5-49d6-82d9-a929badf519e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:33.644268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0370f-45da-4419-8ce9-32f733c832ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93ad6350bfb456dbee1e76756e6b178, user_id=d75b01a28d5c40cb8f6570015c7cb807, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:33.647716 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 899/1809] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:00:33.648004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0370f-45da-4419-8ce9-32f733c832ea admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:33.648652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c836694-04c5-49d6-82d9-a929badf519e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:33.662870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c836694-04c5-49d6-82d9-a929badf519e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:33.677451 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 911/1810] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:33 2022] PUT /identity/v3/projects/b93ad6350bfb456dbee1e76756e6b178/users/d75b01a28d5c40cb8f6570015c7cb807/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:33.679899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0370f-45da-4419-8ce9-32f733c832ea admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:33.799216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bf85b-7628-4cef-b2d1-9ace22ff0cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:33.800549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bf85b-7628-4cef-b2d1-9ace22ff0cac admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:33.801903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bf85b-7628-4cef-b2d1-9ace22ff0cac admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:33.803451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bf85b-7628-4cef-b2d1-9ace22ff0cac admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:33.804197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bf85b-7628-4cef-b2d1-9ace22ff0cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:33.809515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bf85b-7628-4cef-b2d1-9ace22ff0cac admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:33.828295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0370f-45da-4419-8ce9-32f733c832ea admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:33.841171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac7fdd-cb00-494c-81f4-c3128b1250eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:33.843278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac7fdd-cb00-494c-81f4-c3128b1250eb admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:33.843605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac7fdd-cb00-494c-81f4-c3128b1250eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:33.844638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac7fdd-cb00-494c-81f4-c3128b1250eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:33.845984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac7fdd-cb00-494c-81f4-c3128b1250eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:33.848880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac7fdd-cb00-494c-81f4-c3128b1250eb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:33.874658 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 900/1811] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:33 2022] POST /identity/v3/projects => generated 391 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:33.876145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bf85b-7628-4cef-b2d1-9ace22ff0cac admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:33.884815 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 912/1812] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:33.885731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac7fdd-cb00-494c-81f4-c3128b1250eb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:33.906527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac7fdd-cb00-494c-81f4-c3128b1250eb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:33.989643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:34.060857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bf85b-7628-4cef-b2d1-9ace22ff0cac admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:34.071241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086ca41-18fe-48c8-88ec-bf1dc02f32ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:34.071964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9809b4-f784-4000-9ad2-11eddd1d90c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:34.072605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9809b4-f784-4000-9ad2-11eddd1d90c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:34.072893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9809b4-f784-4000-9ad2-11eddd1d90c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:34.073175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9809b4-f784-4000-9ad2-11eddd1d90c4 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:34.074052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086ca41-18fe-48c8-88ec-bf1dc02f32ed admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:34.074533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086ca41-18fe-48c8-88ec-bf1dc02f32ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:34.074635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086ca41-18fe-48c8-88ec-bf1dc02f32ed admin admin] PATH_INFO: `/v3/projects/b93ad6350bfb456dbee1e76756e6b178/users/d75b01a28d5c40cb8f6570015c7cb807/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:34.075853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9809b4-f784-4000-9ad2-11eddd1d90c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:34.078478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9809b4-f784-4000-9ad2-11eddd1d90c4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:34.082276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086ca41-18fe-48c8-88ec-bf1dc02f32ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93ad6350bfb456dbee1e76756e6b178, user_id=d75b01a28d5c40cb8f6570015c7cb807, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:34.087566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086ca41-18fe-48c8-88ec-bf1dc02f32ed admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:34.121935 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 913/1813] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:33 2022] PUT /identity/v3/projects/b93ad6350bfb456dbee1e76756e6b178/users/d75b01a28d5c40cb8f6570015c7cb807/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:34.127086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872c6e1-30f9-4490-ad3f-88f640c0d4e1 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:34.127382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872c6e1-30f9-4490-ad3f-88f640c0d4e1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:34.127631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872c6e1-30f9-4490-ad3f-88f640c0d4e1 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:34.132560 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 914/1814] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:00:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:00:34.133948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615070e9-8810-42ab-88c3-f08a8dfa8100 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:34.134245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615070e9-8810-42ab-88c3-f08a8dfa8100 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:34.134671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615070e9-8810-42ab-88c3-f08a8dfa8100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:34.136395 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 901/1815] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:33 2022] POST /identity/v3/users => generated 296 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:34.142699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9809b4-f784-4000-9ad2-11eddd1d90c4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:34.168599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9809b4-f784-4000-9ad2-11eddd1d90c4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:34.224006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-615070e9-8810-42ab-88c3-f08a8dfa8100 None None] MFA Rules not processed for user `d75b01a28d5c40cb8f6570015c7cb807`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:34.225730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-615070e9-8810-42ab-88c3-f08a8dfa8100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:34.237101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:34.322322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc44067-7ebb-4972-8439-9c30b090da8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:34.323849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc44067-7ebb-4972-8439-9c30b090da8b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:34.324145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc44067-7ebb-4972-8439-9c30b090da8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:34.325260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc44067-7ebb-4972-8439-9c30b090da8b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:34.327426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc44067-7ebb-4972-8439-9c30b090da8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:34.330449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc44067-7ebb-4972-8439-9c30b090da8b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:34.355876 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 902/1816] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:34.365865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f10480-722e-45f0-bd1e-38799da902fa None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:34.366216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f10480-722e-45f0-bd1e-38799da902fa None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:34.366514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f10480-722e-45f0-bd1e-38799da902fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:34.413168 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 915/1817] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:34.414235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615070e9-8810-42ab-88c3-f08a8dfa8100 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:34.433912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615070e9-8810-42ab-88c3-f08a8dfa8100 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:34.434504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-64f10480-722e-45f0-bd1e-38799da902fa None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:34.440136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-64f10480-722e-45f0-bd1e-38799da902fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:34.441148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307db0db-9ae5-4ae0-8964-c4bdb02b7285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:34.441907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307db0db-9ae5-4ae0-8964-c4bdb02b7285 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:34.442195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307db0db-9ae5-4ae0-8964-c4bdb02b7285 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:34.442595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307db0db-9ae5-4ae0-8964-c4bdb02b7285 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:34.447172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307db0db-9ae5-4ae0-8964-c4bdb02b7285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:34.449893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307db0db-9ae5-4ae0-8964-c4bdb02b7285 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:34.469161 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 916/1818] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:34.476379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab67834-0f53-4d09-a355-a9ef5d74ea8f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:34.476847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab67834-0f53-4d09-a355-a9ef5d74ea8f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:34.477140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab67834-0f53-4d09-a355-a9ef5d74ea8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:34.508180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6ab67834-0f53-4d09-a355-a9ef5d74ea8f None None] MFA Rules not processed for user `950f96b926474852acb90a959e369999`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:34.509451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6ab67834-0f53-4d09-a355-a9ef5d74ea8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:34.601894 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 903/1819] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:00:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:34.603025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f10480-722e-45f0-bd1e-38799da902fa None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:34.621624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f10480-722e-45f0-bd1e-38799da902fa None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:34.648072 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 917/1820] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:34.654457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab67834-0f53-4d09-a355-a9ef5d74ea8f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:34.655900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6ab67834-0f53-4d09-a355-a9ef5d74ea8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:34.665919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b006a70-32a8-4e18-9bf1-d46f56597d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:34.667672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b006a70-32a8-4e18-9bf1-d46f56597d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:34.668442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b006a70-32a8-4e18-9bf1-d46f56597d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:34.670135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b006a70-32a8-4e18-9bf1-d46f56597d4b admin admin] PATH_INFO: `/v3/projects/816dcaaad4684af5bd76a391ac2b8d72/users/c16cf1cd0a0c42bba262a054fb1b0d95/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:34.689675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab67834-0f53-4d09-a355-a9ef5d74ea8f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:34.694083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b006a70-32a8-4e18-9bf1-d46f56597d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=816dcaaad4684af5bd76a391ac2b8d72, user_id=c16cf1cd0a0c42bba262a054fb1b0d95, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:34.698215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b006a70-32a8-4e18-9bf1-d46f56597d4b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:34.707391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8ead7-f6d3-4a50-ad41-1816ca5bb3a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:34.708420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8ead7-f6d3-4a50-ad41-1816ca5bb3a4 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:34.708934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8ead7-f6d3-4a50-ad41-1816ca5bb3a4 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:34.709704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8ead7-f6d3-4a50-ad41-1816ca5bb3a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:34.715260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8de8ead7-f6d3-4a50-ad41-1816ca5bb3a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:34.731269 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 904/1821] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:34 2022] PUT /identity/v3/projects/816dcaaad4684af5bd76a391ac2b8d72/users/c16cf1cd0a0c42bba262a054fb1b0d95/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:34.739131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8ead7-f6d3-4a50-ad41-1816ca5bb3a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:34.742573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6668-cf20-47c9-8014-36020d665f4b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:34.742999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6668-cf20-47c9-8014-36020d665f4b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:34.743519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6668-cf20-47c9-8014-36020d665f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:34.752478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8ead7-f6d3-4a50-ad41-1816ca5bb3a4 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:34.787633 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 918/1822] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:34.810191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bcbd6668-cf20-47c9-8014-36020d665f4b None None] MFA Rules not processed for user `c16cf1cd0a0c42bba262a054fb1b0d95`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:34.811941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bcbd6668-cf20-47c9-8014-36020d665f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:34.908172 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 905/1823] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:34.914216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8ead7-f6d3-4a50-ad41-1816ca5bb3a4 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:34.939597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8ead7-f6d3-4a50-ad41-1816ca5bb3a4 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:35.002954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:35.083872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1420853-67b2-4e0b-8af5-d8552fda8c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:35.084889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1420853-67b2-4e0b-8af5-d8552fda8c6f admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:35.085184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1420853-67b2-4e0b-8af5-d8552fda8c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:35.085468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1420853-67b2-4e0b-8af5-d8552fda8c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:35.086153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1420853-67b2-4e0b-8af5-d8552fda8c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:35.088202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1420853-67b2-4e0b-8af5-d8552fda8c6f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:35.148847 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 919/1824] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:34 2022] POST /identity/v3/projects => generated 395 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:35.154324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd6668-cf20-47c9-8014-36020d665f4b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:35.182551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd6668-cf20-47c9-8014-36020d665f4b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:35.223280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:35.327411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1420853-67b2-4e0b-8af5-d8552fda8c6f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:35.333955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b1420853-67b2-4e0b-8af5-d8552fda8c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:35.422199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da5720-9cbd-4c88-9c33-0dd703f01a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:35.422857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da5720-9cbd-4c88-9c33-0dd703f01a75 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:35.423155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da5720-9cbd-4c88-9c33-0dd703f01a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:35.423465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da5720-9cbd-4c88-9c33-0dd703f01a75 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:35.424262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da5720-9cbd-4c88-9c33-0dd703f01a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:35.430422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da5720-9cbd-4c88-9c33-0dd703f01a75 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:35.488810 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 906/1825] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:35 2022] POST /identity/v3/users => generated 304 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:35.491842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da5720-9cbd-4c88-9c33-0dd703f01a75 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:35.524640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da5720-9cbd-4c88-9c33-0dd703f01a75 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:35.532025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1420853-67b2-4e0b-8af5-d8552fda8c6f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:35.542104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dc342-112f-4116-947e-1cfabdf9c1cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:35.543030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dc342-112f-4116-947e-1cfabdf9c1cc service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:35.543586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dc342-112f-4116-947e-1cfabdf9c1cc service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:35.544075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dc342-112f-4116-947e-1cfabdf9c1cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:35.545168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91830a-6653-4c58-9f20-491e9d91fad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:35.547494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91830a-6653-4c58-9f20-491e9d91fad5 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:35.548053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91830a-6653-4c58-9f20-491e9d91fad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:35.548547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91830a-6653-4c58-9f20-491e9d91fad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:35.549677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91830a-6653-4c58-9f20-491e9d91fad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:35.551764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91830a-6653-4c58-9f20-491e9d91fad5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:35.575844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dc342-112f-4116-947e-1cfabdf9c1cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:35.577503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dc342-112f-4116-947e-1cfabdf9c1cc service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:35.594269 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 907/1826] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:35.595230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91830a-6653-4c58-9f20-491e9d91fad5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:35.616230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91830a-6653-4c58-9f20-491e9d91fad5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:35.627423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a2555-025b-4fc0-bcab-6b35a0ec45b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:35.629333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a2555-025b-4fc0-bcab-6b35a0ec45b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:35.629629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a2555-025b-4fc0-bcab-6b35a0ec45b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:35.629912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a2555-025b-4fc0-bcab-6b35a0ec45b9 admin admin] PATH_INFO: `/v3/projects/6506925ae56e414f93379ae5a37b8811/users/799a8e9bcd1445179f59672d7efdbb9b/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:35.655939 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 920/1827] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:00:35.663946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a2555-025b-4fc0-bcab-6b35a0ec45b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6506925ae56e414f93379ae5a37b8811, user_id=799a8e9bcd1445179f59672d7efdbb9b, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:35.668693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a2555-025b-4fc0-bcab-6b35a0ec45b9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:35.728209 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 908/1828] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:35 2022] PUT /identity/v3/projects/6506925ae56e414f93379ae5a37b8811/users/799a8e9bcd1445179f59672d7efdbb9b/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:35.729420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dc342-112f-4116-947e-1cfabdf9c1cc service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:35.755712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dc342-112f-4116-947e-1cfabdf9c1cc service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:36.058506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fa950-c9c0-4999-a59f-4abfa7ddb150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:36.059941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fa950-c9c0-4999-a59f-4abfa7ddb150 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:36.060253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fa950-c9c0-4999-a59f-4abfa7ddb150 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:36.060649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fa950-c9c0-4999-a59f-4abfa7ddb150 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:36.061268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fa950-c9c0-4999-a59f-4abfa7ddb150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:36.065211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fa950-c9c0-4999-a59f-4abfa7ddb150 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:36.090089 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 921/1829] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:36.093256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a2555-025b-4fc0-bcab-6b35a0ec45b9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:36.105457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a2555-025b-4fc0-bcab-6b35a0ec45b9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:36.118775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953db29f-a771-42e2-bc85-85682a7fdccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:36.120590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953db29f-a771-42e2-bc85-85682a7fdccf admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:36.121138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953db29f-a771-42e2-bc85-85682a7fdccf admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:36.121425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953db29f-a771-42e2-bc85-85682a7fdccf admin admin] PATH_INFO: `/v3/projects/6506925ae56e414f93379ae5a37b8811/users/799a8e9bcd1445179f59672d7efdbb9b/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:36.127581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953db29f-a771-42e2-bc85-85682a7fdccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6506925ae56e414f93379ae5a37b8811, user_id=799a8e9bcd1445179f59672d7efdbb9b, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:36.130253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953db29f-a771-42e2-bc85-85682a7fdccf admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:36.171166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b333993-69bc-4083-b550-6007fc9d4ac8 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:36.171491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b333993-69bc-4083-b550-6007fc9d4ac8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:36.171789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b333993-69bc-4083-b550-6007fc9d4ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:36.179189 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 909/1830] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:36 2022] PUT /identity/v3/projects/6506925ae56e414f93379ae5a37b8811/users/799a8e9bcd1445179f59672d7efdbb9b/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:00:36.240117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2b333993-69bc-4083-b550-6007fc9d4ac8 None None] MFA Rules not processed for user `799a8e9bcd1445179f59672d7efdbb9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:36.241486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2b333993-69bc-4083-b550-6007fc9d4ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:36.307249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:36.457638 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 922/1831] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:37.647478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953db29f-a771-42e2-bc85-85682a7fdccf admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:37.905211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953db29f-a771-42e2-bc85-85682a7fdccf admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:37.945628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3873a2-11c4-4626-b42c-6960eecd7fdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:37.950214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3873a2-11c4-4626-b42c-6960eecd7fdb service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:37.950536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3873a2-11c4-4626-b42c-6960eecd7fdb service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:37.950823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3873a2-11c4-4626-b42c-6960eecd7fdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:37.970459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3873a2-11c4-4626-b42c-6960eecd7fdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:37.981790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3873a2-11c4-4626-b42c-6960eecd7fdb service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:38.018441 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 910/1832] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:00:38.498410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fe38e-6f14-4dd7-a3cf-1e4865099c25 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:38.499569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fe38e-6f14-4dd7-a3cf-1e4865099c25 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:38.501437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fe38e-6f14-4dd7-a3cf-1e4865099c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:38.580824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a04fe38e-6f14-4dd7-a3cf-1e4865099c25 None None] MFA Rules not processed for user `96815c6776f1464a8b6350b4a52d4548`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:38.582727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a04fe38e-6f14-4dd7-a3cf-1e4865099c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:38.753802 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 923/1833] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:38 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:38.758940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3873a2-11c4-4626-b42c-6960eecd7fdb service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:38.760796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0f3873a2-11c4-4626-b42c-6960eecd7fdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:38.905883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:38.949430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3873a2-11c4-4626-b42c-6960eecd7fdb service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:38.960590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491773c1-7f97-4782-82d0-f60e4dfc09b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:38.961249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491773c1-7f97-4782-82d0-f60e4dfc09b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:38.961539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491773c1-7f97-4782-82d0-f60e4dfc09b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:38.961820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491773c1-7f97-4782-82d0-f60e4dfc09b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:38.965802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491773c1-7f97-4782-82d0-f60e4dfc09b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:38.972068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491773c1-7f97-4782-82d0-f60e4dfc09b4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:39.033231 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 911/1834] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:38 2022] POST /identity/v3/projects => generated 371 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:39.035088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fe38e-6f14-4dd7-a3cf-1e4865099c25 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:39.053825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fe38e-6f14-4dd7-a3cf-1e4865099c25 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:39.198964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c402f-23ce-4bca-a53f-bdc17d2c7cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:39.199640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c402f-23ce-4bca-a53f-bdc17d2c7cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:39.199928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c402f-23ce-4bca-a53f-bdc17d2c7cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:39.200210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c402f-23ce-4bca-a53f-bdc17d2c7cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:39.201177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c402f-23ce-4bca-a53f-bdc17d2c7cd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:39.213532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c402f-23ce-4bca-a53f-bdc17d2c7cd0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:39.258485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491773c1-7f97-4782-82d0-f60e4dfc09b4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:39.284463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491773c1-7f97-4782-82d0-f60e4dfc09b4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:39.310336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7db3a-658a-413f-892d-7ae788db5296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:39.321536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7db3a-658a-413f-892d-7ae788db5296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:39.322091 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 924/1835] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:39 2022] POST /identity/v3/users => generated 292 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:39.323226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c402f-23ce-4bca-a53f-bdc17d2c7cd0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:39.323728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7db3a-658a-413f-892d-7ae788db5296 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:39.323884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7db3a-658a-413f-892d-7ae788db5296 admin admin] PATH_INFO: `/v3/users/c16cf1cd0a0c42bba262a054fb1b0d95` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:39.325472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7db3a-658a-413f-892d-7ae788db5296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16cf1cd0a0c42bba262a054fb1b0d95)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:39.336009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7db3a-658a-413f-892d-7ae788db5296 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:39.349780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c402f-23ce-4bca-a53f-bdc17d2c7cd0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:39.373192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bb81a-80b9-4752-911c-4cbde47cc2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:39.373831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bb81a-80b9-4752-911c-4cbde47cc2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:39.374121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bb81a-80b9-4752-911c-4cbde47cc2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:39.374406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bb81a-80b9-4752-911c-4cbde47cc2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:39.375115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bb81a-80b9-4752-911c-4cbde47cc2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:39.378955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bb81a-80b9-4752-911c-4cbde47cc2e5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:39.406439 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 925/1836] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:39.412902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bb81a-80b9-4752-911c-4cbde47cc2e5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:39.441631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bb81a-80b9-4752-911c-4cbde47cc2e5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:39.449807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cdc7db3a-658a-413f-892d-7ae788db5296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16cf1cd0a0c42bba262a054fb1b0d95'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:39.453683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167073b0-6008-44a9-a67e-6dbbeb475d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:39.458648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167073b0-6008-44a9-a67e-6dbbeb475d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:39.459407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167073b0-6008-44a9-a67e-6dbbeb475d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:39.460314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167073b0-6008-44a9-a67e-6dbbeb475d8e admin admin] PATH_INFO: `/v3/projects/fb68cb235ba44602a694baa9e3d4b352/users/b4237892fec840cf987708cb717d5a3c/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:39.481737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cdc7db3a-658a-413f-892d-7ae788db5296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16cf1cd0a0c42bba262a054fb1b0d95'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:39.483335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cdc7db3a-658a-413f-892d-7ae788db5296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16cf1cd0a0c42bba262a054fb1b0d95'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:39.490851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167073b0-6008-44a9-a67e-6dbbeb475d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb68cb235ba44602a694baa9e3d4b352, user_id=b4237892fec840cf987708cb717d5a3c, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:39.498424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167073b0-6008-44a9-a67e-6dbbeb475d8e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:39.501151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cdc7db3a-658a-413f-892d-7ae788db5296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16cf1cd0a0c42bba262a054fb1b0d95'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:39.502013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cdc7db3a-658a-413f-892d-7ae788db5296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16cf1cd0a0c42bba262a054fb1b0d95'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:39.516584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:39.532286 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 912/1837] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:00:39 2022] DELETE /identity/v3/users/c16cf1cd0a0c42bba262a054fb1b0d95 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:00:39.532478 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 926/1838] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:39 2022] PUT /identity/v3/projects/fb68cb235ba44602a694baa9e3d4b352/users/b4237892fec840cf987708cb717d5a3c/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:39.534602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7509f-d53d-4b22-8b25-364509f3a257 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:39.535684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167073b0-6008-44a9-a67e-6dbbeb475d8e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:39.536398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7509f-d53d-4b22-8b25-364509f3a257 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:39.536985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7509f-d53d-4b22-8b25-364509f3a257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:39.540934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-167073b0-6008-44a9-a67e-6dbbeb475d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:39.608141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-faf7509f-d53d-4b22-8b25-364509f3a257 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:39.609825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-faf7509f-d53d-4b22-8b25-364509f3a257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:39.664495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167073b0-6008-44a9-a67e-6dbbeb475d8e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:39.753740 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 913/1839] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:39.754808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7509f-d53d-4b22-8b25-364509f3a257 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:39.756427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-faf7509f-d53d-4b22-8b25-364509f3a257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:39.819894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48aa9b-450e-403c-b4a7-38efd1934b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:39.820864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48aa9b-450e-403c-b4a7-38efd1934b3c admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:39.821267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48aa9b-450e-403c-b4a7-38efd1934b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:39.821667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48aa9b-450e-403c-b4a7-38efd1934b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:39.822642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48aa9b-450e-403c-b4a7-38efd1934b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:39.825071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48aa9b-450e-403c-b4a7-38efd1934b3c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:39.838763 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 927/1840] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:39.841944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:39.843407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48aa9b-450e-403c-b4a7-38efd1934b3c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:39.863255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48aa9b-450e-403c-b4a7-38efd1934b3c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:39.880315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7509f-d53d-4b22-8b25-364509f3a257 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:39.882335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628428d-96d6-49af-9fd6-855fecb8dcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:39.883188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628428d-96d6-49af-9fd6-855fecb8dcfa admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:39.883776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628428d-96d6-49af-9fd6-855fecb8dcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:39.884172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628428d-96d6-49af-9fd6-855fecb8dcfa admin admin] PATH_INFO: `/v3/projects/fb68cb235ba44602a694baa9e3d4b352/users/b4237892fec840cf987708cb717d5a3c/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:39.888138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628428d-96d6-49af-9fd6-855fecb8dcfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb68cb235ba44602a694baa9e3d4b352, user_id=b4237892fec840cf987708cb717d5a3c, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:39.889690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09adbd37-963d-45e0-9abf-e1711b1c7377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:39.890728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adbd37-963d-45e0-9abf-e1711b1c7377 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:39.891263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adbd37-963d-45e0-9abf-e1711b1c7377 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:39.891802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adbd37-963d-45e0-9abf-e1711b1c7377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:39.906918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09adbd37-963d-45e0-9abf-e1711b1c7377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:39.909328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09adbd37-963d-45e0-9abf-e1711b1c7377 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:39.916856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628428d-96d6-49af-9fd6-855fecb8dcfa admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:39.947981 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 914/1841] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:39.953169 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 928/1842] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:39 2022] PUT /identity/v3/projects/fb68cb235ba44602a694baa9e3d4b352/users/b4237892fec840cf987708cb717d5a3c/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:41.905562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09adbd37-963d-45e0-9abf-e1711b1c7377 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:41.910251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-09adbd37-963d-45e0-9abf-e1711b1c7377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:42.008501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09adbd37-963d-45e0-9abf-e1711b1c7377 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:42.201143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470a1be-d6f2-44a1-b745-63573459707f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:42.201818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470a1be-d6f2-44a1-b745-63573459707f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:42.202099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470a1be-d6f2-44a1-b745-63573459707f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:42.202371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470a1be-d6f2-44a1-b745-63573459707f admin admin] PATH_INFO: `/v3/projects/816dcaaad4684af5bd76a391ac2b8d72` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:42.204425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470a1be-d6f2-44a1-b745-63573459707f admin admin] RBAC: Authorizing `identity:delete_project(project_id=816dcaaad4684af5bd76a391ac2b8d72)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:42.206329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470a1be-d6f2-44a1-b745-63573459707f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:42.342831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0470a1be-d6f2-44a1-b745-63573459707f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816dcaaad4684af5bd76a391ac2b8d72', 'request_id': 'req-0470a1be-d6f2-44a1-b745-63573459707f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:42.355552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0470a1be-d6f2-44a1-b745-63573459707f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816dcaaad4684af5bd76a391ac2b8d72', 'request_id': 'req-0470a1be-d6f2-44a1-b745-63573459707f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:42.371340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0470a1be-d6f2-44a1-b745-63573459707f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816dcaaad4684af5bd76a391ac2b8d72', 'request_id': 'req-0470a1be-d6f2-44a1-b745-63573459707f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:42.390389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0470a1be-d6f2-44a1-b745-63573459707f admin admin] The token cache is being invalidate because project 816dcaaad4684af5bd76a391ac2b8d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:00:42.390701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0470a1be-d6f2-44a1-b745-63573459707f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:42.391441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0470a1be-d6f2-44a1-b745-63573459707f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:42.398570 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 915/1843] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:00:41 2022] DELETE /identity/v3/projects/816dcaaad4684af5bd76a391ac2b8d72 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:42.399859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628428d-96d6-49af-9fd6-855fecb8dcfa admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:42.402471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0628428d-96d6-49af-9fd6-855fecb8dcfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:42.420028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628428d-96d6-49af-9fd6-855fecb8dcfa admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:42.566692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8cba32-93d1-4159-ad87-ba0cbe94423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:42.569859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cba32-93d1-4159-ad87-ba0cbe94423d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:42.570202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cba32-93d1-4159-ad87-ba0cbe94423d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:42.570487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cba32-93d1-4159-ad87-ba0cbe94423d admin admin] PATH_INFO: `/v3/users/799a8e9bcd1445179f59672d7efdbb9b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:42.574396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8cba32-93d1-4159-ad87-ba0cbe94423d admin admin] RBAC: Authorizing `identity:delete_user(user_id=799a8e9bcd1445179f59672d7efdbb9b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:42.579446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8cba32-93d1-4159-ad87-ba0cbe94423d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:42.698344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:42.737419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1a8cba32-93d1-4159-ad87-ba0cbe94423d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '799a8e9bcd1445179f59672d7efdbb9b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:42.738472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1a8cba32-93d1-4159-ad87-ba0cbe94423d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '799a8e9bcd1445179f59672d7efdbb9b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:42.789291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1a8cba32-93d1-4159-ad87-ba0cbe94423d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '799a8e9bcd1445179f59672d7efdbb9b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:42.799835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1a8cba32-93d1-4159-ad87-ba0cbe94423d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '799a8e9bcd1445179f59672d7efdbb9b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:42.812121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1a8cba32-93d1-4159-ad87-ba0cbe94423d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '799a8e9bcd1445179f59672d7efdbb9b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:42.832649 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 929/1844] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:00:42 2022] DELETE /identity/v3/users/799a8e9bcd1445179f59672d7efdbb9b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:43.689483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470a1be-d6f2-44a1-b745-63573459707f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:43.711276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470a1be-d6f2-44a1-b745-63573459707f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:44.263988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e3a06-bdd2-45a6-9882-cc7b56f3b1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:44.266726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e3a06-bdd2-45a6-9882-cc7b56f3b1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:44.267941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e3a06-bdd2-45a6-9882-cc7b56f3b1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:44.268244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e3a06-bdd2-45a6-9882-cc7b56f3b1e6 admin admin] PATH_INFO: `/v3/projects/6506925ae56e414f93379ae5a37b8811` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:44.277914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e3a06-bdd2-45a6-9882-cc7b56f3b1e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6506925ae56e414f93379ae5a37b8811)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:44.280254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e3a06-bdd2-45a6-9882-cc7b56f3b1e6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:44.332403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:44.443507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d27e3a06-bdd2-45a6-9882-cc7b56f3b1e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6506925ae56e414f93379ae5a37b8811', 'request_id': 'req-d27e3a06-bdd2-45a6-9882-cc7b56f3b1e6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:44.461170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d27e3a06-bdd2-45a6-9882-cc7b56f3b1e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6506925ae56e414f93379ae5a37b8811', 'request_id': 'req-d27e3a06-bdd2-45a6-9882-cc7b56f3b1e6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:44.482022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d27e3a06-bdd2-45a6-9882-cc7b56f3b1e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6506925ae56e414f93379ae5a37b8811', 'request_id': 'req-d27e3a06-bdd2-45a6-9882-cc7b56f3b1e6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:44.506149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d27e3a06-bdd2-45a6-9882-cc7b56f3b1e6 admin admin] The token cache is being invalidate because project 6506925ae56e414f93379ae5a37b8811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:00:44.506984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d27e3a06-bdd2-45a6-9882-cc7b56f3b1e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:44.509518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d27e3a06-bdd2-45a6-9882-cc7b56f3b1e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:00:44.516085 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 916/1845] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:00:43 2022] DELETE /identity/v3/projects/6506925ae56e414f93379ae5a37b8811 => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:44.517877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ece7b-d94b-4e33-a1d1-6d4d2dca09bf None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:44.518741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ece7b-d94b-4e33-a1d1-6d4d2dca09bf None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:44.519174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ece7b-d94b-4e33-a1d1-6d4d2dca09bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:44.561965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-482ece7b-d94b-4e33-a1d1-6d4d2dca09bf None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:44.564153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-482ece7b-d94b-4e33-a1d1-6d4d2dca09bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:44.711156 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 930/1846] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:44.713415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f595d-fd88-4e81-9a31-f7a656d77912 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:44.714301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f595d-fd88-4e81-9a31-f7a656d77912 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:44.714729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f595d-fd88-4e81-9a31-f7a656d77912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:44.772552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-fc3f595d-fd88-4e81-9a31-f7a656d77912 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:44.775063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fc3f595d-fd88-4e81-9a31-f7a656d77912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:44.816835 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 917/1847] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:44.817738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ece7b-d94b-4e33-a1d1-6d4d2dca09bf None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:44.832974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ece7b-d94b-4e33-a1d1-6d4d2dca09bf None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:44.844077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a387ef1-34dc-4ba1-b0c9-78d7a2a56210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:44.844726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a387ef1-34dc-4ba1-b0c9-78d7a2a56210 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:44.845013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a387ef1-34dc-4ba1-b0c9-78d7a2a56210 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:44.845290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a387ef1-34dc-4ba1-b0c9-78d7a2a56210 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:44.846007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a387ef1-34dc-4ba1-b0c9-78d7a2a56210 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:00:44.846314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a387ef1-34dc-4ba1-b0c9-78d7a2a56210 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:44.847979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a387ef1-34dc-4ba1-b0c9-78d7a2a56210 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:44.878971 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 931/1848] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:00:44.884099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f595d-fd88-4e81-9a31-f7a656d77912 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:44.899046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f595d-fd88-4e81-9a31-f7a656d77912 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:44.914830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd82084-0e85-4cc4-8460-58f0c25d5ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:44.916024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd82084-0e85-4cc4-8460-58f0c25d5ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:44.916318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd82084-0e85-4cc4-8460-58f0c25d5ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:44.916597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd82084-0e85-4cc4-8460-58f0c25d5ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:44.917867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd82084-0e85-4cc4-8460-58f0c25d5ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:44.922487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd82084-0e85-4cc4-8460-58f0c25d5ab0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:45.012709 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 918/1849] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:44 2022] POST /identity/v3/projects => generated 395 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:45.013793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a387ef1-34dc-4ba1-b0c9-78d7a2a56210 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:45.031567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a387ef1-34dc-4ba1-b0c9-78d7a2a56210 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:45.212014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243cc1d-d9e6-4e7d-a2ce-5246bb21837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:45.212657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243cc1d-d9e6-4e7d-a2ce-5246bb21837d admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:45.212958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243cc1d-d9e6-4e7d-a2ce-5246bb21837d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:45.213236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243cc1d-d9e6-4e7d-a2ce-5246bb21837d admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:45.213947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243cc1d-d9e6-4e7d-a2ce-5246bb21837d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:45.220004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243cc1d-d9e6-4e7d-a2ce-5246bb21837d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:45.282439 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 932/1850] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:45 2022] POST /identity/v3/users => generated 298 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:45.287108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd82084-0e85-4cc4-8460-58f0c25d5ab0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:45.304506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd82084-0e85-4cc4-8460-58f0c25d5ab0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:45.316946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b8e4c-8a1b-4792-b755-cc63100802d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:45.325561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b8e4c-8a1b-4792-b755-cc63100802d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:45.325993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b8e4c-8a1b-4792-b755-cc63100802d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:45.326398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b8e4c-8a1b-4792-b755-cc63100802d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:45.327268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b8e4c-8a1b-4792-b755-cc63100802d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:45.329040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b8e4c-8a1b-4792-b755-cc63100802d1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:45.361907 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 919/1851] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:45.362833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243cc1d-d9e6-4e7d-a2ce-5246bb21837d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:45.377415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243cc1d-d9e6-4e7d-a2ce-5246bb21837d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:45.394715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c22b3-2b56-47c1-bbe7-c5d3b0d31b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:45.395545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c22b3-2b56-47c1-bbe7-c5d3b0d31b9e admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:45.395874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c22b3-2b56-47c1-bbe7-c5d3b0d31b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:45.396689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c22b3-2b56-47c1-bbe7-c5d3b0d31b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:45.399250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c22b3-2b56-47c1-bbe7-c5d3b0d31b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:45.405394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c22b3-2b56-47c1-bbe7-c5d3b0d31b9e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:45.445312 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 933/1852] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:45.450234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b8e4c-8a1b-4792-b755-cc63100802d1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:45.489812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b8e4c-8a1b-4792-b755-cc63100802d1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:45.515412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f391721-87c3-4915-a3d7-81658b21fe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:45.519209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f391721-87c3-4915-a3d7-81658b21fe42 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:45.519828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f391721-87c3-4915-a3d7-81658b21fe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:45.520316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f391721-87c3-4915-a3d7-81658b21fe42 admin admin] PATH_INFO: `/v3/projects/bfb74be507694713821cb1a68619f9e2/users/46d7264a2f63436bb8519cd8cec6d9f5/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:45.556887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f391721-87c3-4915-a3d7-81658b21fe42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb74be507694713821cb1a68619f9e2, user_id=46d7264a2f63436bb8519cd8cec6d9f5, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:45.562510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f391721-87c3-4915-a3d7-81658b21fe42 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:45.595244 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 920/1853] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:45 2022] PUT /identity/v3/projects/bfb74be507694713821cb1a68619f9e2/users/46d7264a2f63436bb8519cd8cec6d9f5/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:45.596904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69344ec3-588e-48aa-b023-c6bdc2c40848 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:45.597392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69344ec3-588e-48aa-b023-c6bdc2c40848 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:45.597558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69344ec3-588e-48aa-b023-c6bdc2c40848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:45.651432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-69344ec3-588e-48aa-b023-c6bdc2c40848 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:45.652724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-69344ec3-588e-48aa-b023-c6bdc2c40848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:45.682498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:45.822555 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 934/1854] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:45.873662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f391721-87c3-4915-a3d7-81658b21fe42 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:45.876550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8f391721-87c3-4915-a3d7-81658b21fe42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:46.025401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f391721-87c3-4915-a3d7-81658b21fe42 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:46.037929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a64c80-194c-4745-a69d-582e8428b580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:46.038909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a64c80-194c-4745-a69d-582e8428b580 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:46.039327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a64c80-194c-4745-a69d-582e8428b580 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:46.040541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a64c80-194c-4745-a69d-582e8428b580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:46.066060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a64c80-194c-4745-a69d-582e8428b580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:46.067904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a64c80-194c-4745-a69d-582e8428b580 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:46.085499 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 921/1855] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:46.255901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fdeea-3a16-4f39-b8e4-8e6210a4d0fc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:46.256522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fdeea-3a16-4f39-b8e4-8e6210a4d0fc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:46.257158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fdeea-3a16-4f39-b8e4-8e6210a4d0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:46.326313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-638fdeea-3a16-4f39-b8e4-8e6210a4d0fc None None] MFA Rules not processed for user `df90dd2310f44c4b9b80bbb897a2ea1e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:46.327681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-638fdeea-3a16-4f39-b8e4-8e6210a4d0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:46.478930 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 935/1856] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:46 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:46.483787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a64c80-194c-4745-a69d-582e8428b580 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:46.485636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e1a64c80-194c-4745-a69d-582e8428b580 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:46.507904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a64c80-194c-4745-a69d-582e8428b580 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:46.515169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63821411-fea1-48e1-9175-8f19b5459178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:46.516160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63821411-fea1-48e1-9175-8f19b5459178 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:46.516520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63821411-fea1-48e1-9175-8f19b5459178 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:46.517084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63821411-fea1-48e1-9175-8f19b5459178 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:46.518110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63821411-fea1-48e1-9175-8f19b5459178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:46.521345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63821411-fea1-48e1-9175-8f19b5459178 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:46.591450 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 922/1857] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:46 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:46.595726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638fdeea-3a16-4f39-b8e4-8e6210a4d0fc None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:46.609680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638fdeea-3a16-4f39-b8e4-8e6210a4d0fc None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:46.707717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8488b-34e0-4dbf-aa25-986bdbad8216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:46.709177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8488b-34e0-4dbf-aa25-986bdbad8216 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:46.710309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8488b-34e0-4dbf-aa25-986bdbad8216 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:46.710878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8488b-34e0-4dbf-aa25-986bdbad8216 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:46.712540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8488b-34e0-4dbf-aa25-986bdbad8216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:46.717608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8488b-34e0-4dbf-aa25-986bdbad8216 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:46.807072 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 936/1858] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:46 2022] POST /identity/v3/users => generated 309 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:46.808611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63821411-fea1-48e1-9175-8f19b5459178 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:46.825857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63821411-fea1-48e1-9175-8f19b5459178 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:46.834337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2fbaf-935c-460e-aa59-0283633c9708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:46.835694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2fbaf-935c-460e-aa59-0283633c9708 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:46.836037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2fbaf-935c-460e-aa59-0283633c9708 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:46.836299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2fbaf-935c-460e-aa59-0283633c9708 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:46.837240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2fbaf-935c-460e-aa59-0283633c9708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:46.839369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2fbaf-935c-460e-aa59-0283633c9708 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:46.868989 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 923/1859] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:46.870295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8488b-34e0-4dbf-aa25-986bdbad8216 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:46.888792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8488b-34e0-4dbf-aa25-986bdbad8216 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:46.903351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f310e0-359a-48c6-8209-3a348086ed44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:46.904055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f310e0-359a-48c6-8209-3a348086ed44 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:46.904338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f310e0-359a-48c6-8209-3a348086ed44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:46.904623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f310e0-359a-48c6-8209-3a348086ed44 admin admin] PATH_INFO: `/v3/projects/0f3b364fece44c149bd44364b36602cd/users/dd9dab47e195457e8506a71a7a2aa913/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:46.954910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f310e0-359a-48c6-8209-3a348086ed44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3b364fece44c149bd44364b36602cd, user_id=dd9dab47e195457e8506a71a7a2aa913, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:46.957696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f310e0-359a-48c6-8209-3a348086ed44 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:47.009787 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 937/1860] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:46 2022] PUT /identity/v3/projects/0f3b364fece44c149bd44364b36602cd/users/dd9dab47e195457e8506a71a7a2aa913/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:47.013670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2fbaf-935c-460e-aa59-0283633c9708 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:47.039559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2fbaf-935c-460e-aa59-0283633c9708 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:47.065626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:47.252620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb3f13-e3ee-4459-8dab-0365e8616a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:47.253647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb3f13-e3ee-4459-8dab-0365e8616a4a admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:47.254140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb3f13-e3ee-4459-8dab-0365e8616a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:47.254648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb3f13-e3ee-4459-8dab-0365e8616a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:47.255671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb3f13-e3ee-4459-8dab-0365e8616a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:47.257599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb3f13-e3ee-4459-8dab-0365e8616a4a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:47.274810 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 924/1861] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:47.279106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f310e0-359a-48c6-8209-3a348086ed44 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:47.297853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f310e0-359a-48c6-8209-3a348086ed44 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:47.304566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22db110-7d04-4580-ad5f-01c1068bd636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:47.305807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22db110-7d04-4580-ad5f-01c1068bd636 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:47.306297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22db110-7d04-4580-ad5f-01c1068bd636 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:47.306882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22db110-7d04-4580-ad5f-01c1068bd636 admin admin] PATH_INFO: `/v3/projects/0f3b364fece44c149bd44364b36602cd/users/dd9dab47e195457e8506a71a7a2aa913/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:47.309673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22db110-7d04-4580-ad5f-01c1068bd636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3b364fece44c149bd44364b36602cd, user_id=dd9dab47e195457e8506a71a7a2aa913, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:47.314552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22db110-7d04-4580-ad5f-01c1068bd636 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:47.322286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:47.343827 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 938/1862] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:47 2022] PUT /identity/v3/projects/0f3b364fece44c149bd44364b36602cd/users/dd9dab47e195457e8506a71a7a2aa913/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:51.760688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d6b91-2871-4d36-b4ca-b36434b750f5 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:51.761316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d6b91-2871-4d36-b4ca-b36434b750f5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:51.761762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d6b91-2871-4d36-b4ca-b36434b750f5 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:51.764020 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 925/1863] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:00:51.952933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba075eff-dec8-4b1a-b07f-f01f94d29824 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:51.953408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba075eff-dec8-4b1a-b07f-f01f94d29824 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:51.953483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba075eff-dec8-4b1a-b07f-f01f94d29824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:51.988792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ba075eff-dec8-4b1a-b07f-f01f94d29824 None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:51.991868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ba075eff-dec8-4b1a-b07f-f01f94d29824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:52.111217 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 939/1864] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:00:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:52.212427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d6b91-2871-4d36-b4ca-b36434b750f5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:52.216066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a31d6b91-2871-4d36-b4ca-b36434b750f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:52.261124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d6b91-2871-4d36-b4ca-b36434b750f5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:52.283585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99574505-b4cc-48eb-a803-dffa9493db02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:52.286592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99574505-b4cc-48eb-a803-dffa9493db02 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:52.287593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99574505-b4cc-48eb-a803-dffa9493db02 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:52.290173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99574505-b4cc-48eb-a803-dffa9493db02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:52.318734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99574505-b4cc-48eb-a803-dffa9493db02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:52.321128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a85b3c-16ed-456c-bdca-27c444481a29 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:52.321128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a85b3c-16ed-456c-bdca-27c444481a29 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:52.321128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a85b3c-16ed-456c-bdca-27c444481a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:52.330010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99574505-b4cc-48eb-a803-dffa9493db02 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:52.363951 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 926/1865] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:52.379052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-01a85b3c-16ed-456c-bdca-27c444481a29 None None] MFA Rules not processed for user `b4237892fec840cf987708cb717d5a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:52.381253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-01a85b3c-16ed-456c-bdca-27c444481a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:52.492593 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 940/1866] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:52 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:00:52.507244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09b85d-fa54-4c27-86ae-e481ed805d4e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:52.507585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09b85d-fa54-4c27-86ae-e481ed805d4e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:52.507867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09b85d-fa54-4c27-86ae-e481ed805d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:52.546241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1b09b85d-fa54-4c27-86ae-e481ed805d4e None None] MFA Rules not processed for user `96815c6776f1464a8b6350b4a52d4548`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:52.558391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1b09b85d-fa54-4c27-86ae-e481ed805d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:52.734081 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 927/1867] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:52.743271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a85b3c-16ed-456c-bdca-27c444481a29 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:52.759659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a85b3c-16ed-456c-bdca-27c444481a29 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:52.766017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c990f-0fb4-4384-ba6e-d7ce3e3e9b53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:52.766983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c990f-0fb4-4384-ba6e-d7ce3e3e9b53 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:52.766983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c990f-0fb4-4384-ba6e-d7ce3e3e9b53 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:52.767310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c990f-0fb4-4384-ba6e-d7ce3e3e9b53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:52.769644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e25c990f-0fb4-4384-ba6e-d7ce3e3e9b53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:52.781768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c990f-0fb4-4384-ba6e-d7ce3e3e9b53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:52.783575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c990f-0fb4-4384-ba6e-d7ce3e3e9b53 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:52.795125 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 941/1868] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:53.271341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37d19a-21cd-4674-848d-30586266a898 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:53.273391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37d19a-21cd-4674-848d-30586266a898 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:53.274042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37d19a-21cd-4674-848d-30586266a898 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:53.282485 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 928/1869] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:00:53 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:00:53.289095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993ef6d-ca92-410f-8642-c9cd5da19cfe None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:53.289514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993ef6d-ca92-410f-8642-c9cd5da19cfe None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:53.289668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993ef6d-ca92-410f-8642-c9cd5da19cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:53.319604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7993ef6d-ca92-410f-8642-c9cd5da19cfe None None] MFA Rules not processed for user `4a886ccf9590432caf209526410a7b53`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:53.321126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7993ef6d-ca92-410f-8642-c9cd5da19cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:53.450992 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 942/1870] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:00:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:53.463414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37d19a-21cd-4674-848d-30586266a898 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:53.466342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cc37d19a-21cd-4674-848d-30586266a898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:53.490330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37d19a-21cd-4674-848d-30586266a898 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:53.501778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3b02b-7ce9-4a80-9ae0-a41347732bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:53.502786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3b02b-7ce9-4a80-9ae0-a41347732bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:53.503435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3b02b-7ce9-4a80-9ae0-a41347732bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:53.503926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3b02b-7ce9-4a80-9ae0-a41347732bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:53.515658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3b02b-7ce9-4a80-9ae0-a41347732bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:53.517590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3b02b-7ce9-4a80-9ae0-a41347732bd0 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:53.538263 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 929/1871] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:00:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:58.706048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee949c-d752-4e72-9231-7c4da1291900 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:58.706568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee949c-d752-4e72-9231-7c4da1291900 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:58.706568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee949c-d752-4e72-9231-7c4da1291900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:58.774593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:58.790891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-85ee949c-d752-4e72-9231-7c4da1291900 None None] MFA Rules not processed for user `46d7264a2f63436bb8519cd8cec6d9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:00:58.792114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-85ee949c-d752-4e72-9231-7c4da1291900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:00:59.045638 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 943/1872] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:00:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:00:59.050612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3b02b-7ce9-4a80-9ae0-a41347732bd0 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:59.262550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3b02b-7ce9-4a80-9ae0-a41347732bd0 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:59.268986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807a2bd-436a-4846-8a7e-8c3849892e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:59.269638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807a2bd-436a-4846-8a7e-8c3849892e94 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:59.269924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807a2bd-436a-4846-8a7e-8c3849892e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:59.270840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807a2bd-436a-4846-8a7e-8c3849892e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:59.271615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807a2bd-436a-4846-8a7e-8c3849892e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:59.274130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807a2bd-436a-4846-8a7e-8c3849892e94 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:59.328099 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 930/1873] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:00:59 2022] POST /identity/v3/projects => generated 397 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:59.332228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee949c-d752-4e72-9231-7c4da1291900 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:59.348175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee949c-d752-4e72-9231-7c4da1291900 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:59.557984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba950349-855f-47e5-a092-b7efc3ce469b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:59.559062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba950349-855f-47e5-a092-b7efc3ce469b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:59.560505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba950349-855f-47e5-a092-b7efc3ce469b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:59.560937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba950349-855f-47e5-a092-b7efc3ce469b admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:59.561867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba950349-855f-47e5-a092-b7efc3ce469b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:59.564086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba950349-855f-47e5-a092-b7efc3ce469b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:59.606150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807a2bd-436a-4846-8a7e-8c3849892e94 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:59.622645 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 944/1874] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:00:59 2022] POST /identity/v3/users => generated 305 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:00:59.626333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807a2bd-436a-4846-8a7e-8c3849892e94 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:59.640185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922da6ac-2ae3-4a81-98a1-402ade93f5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:59.641174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922da6ac-2ae3-4a81-98a1-402ade93f5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:59.641613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922da6ac-2ae3-4a81-98a1-402ade93f5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:59.642040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922da6ac-2ae3-4a81-98a1-402ade93f5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:59.643507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922da6ac-2ae3-4a81-98a1-402ade93f5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:59.645532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922da6ac-2ae3-4a81-98a1-402ade93f5c0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:59.652085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:59.676293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba950349-855f-47e5-a092-b7efc3ce469b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:59.687707 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 931/1875] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:00:59.695063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba950349-855f-47e5-a092-b7efc3ce469b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:59.702904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd760e-1d65-49c3-9c66-1686ec78c95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:59.704142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd760e-1d65-49c3-9c66-1686ec78c95a admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:59.704686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd760e-1d65-49c3-9c66-1686ec78c95a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:59.705192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd760e-1d65-49c3-9c66-1686ec78c95a admin admin] PATH_INFO: `/v3/projects/ea652869c07c47f19dff281474c15054/users/4ed9345c92b74253ae7c4c15f4457ae0/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:59.742581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd760e-1d65-49c3-9c66-1686ec78c95a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea652869c07c47f19dff281474c15054, user_id=4ed9345c92b74253ae7c4c15f4457ae0, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:59.748423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd760e-1d65-49c3-9c66-1686ec78c95a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:00:59.788758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922da6ac-2ae3-4a81-98a1-402ade93f5c0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:00:59.789714 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 945/1876] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:00:59 2022] PUT /identity/v3/projects/ea652869c07c47f19dff281474c15054/users/4ed9345c92b74253ae7c4c15f4457ae0/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:00:59.815600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922da6ac-2ae3-4a81-98a1-402ade93f5c0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:00:59.988557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1efd8c-f94b-42ba-b87f-4a268c96492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:00:59.989158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1efd8c-f94b-42ba-b87f-4a268c96492b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:00:59.989596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1efd8c-f94b-42ba-b87f-4a268c96492b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:00:59.990407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1efd8c-f94b-42ba-b87f-4a268c96492b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:00:59.991125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1efd8c-f94b-42ba-b87f-4a268c96492b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:00:59.992978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1efd8c-f94b-42ba-b87f-4a268c96492b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:00.018668 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 932/1877] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:00.020419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd760e-1d65-49c3-9c66-1686ec78c95a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:00.036976 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd760e-1d65-49c3-9c66-1686ec78c95a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:00.043719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ff24c-bbd5-4159-9aa7-60157ae808e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:00.044619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ff24c-bbd5-4159-9aa7-60157ae808e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:00.044905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ff24c-bbd5-4159-9aa7-60157ae808e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:00.045185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ff24c-bbd5-4159-9aa7-60157ae808e1 admin admin] PATH_INFO: `/v3/projects/ea652869c07c47f19dff281474c15054/users/4ed9345c92b74253ae7c4c15f4457ae0/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:00.047450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ff24c-bbd5-4159-9aa7-60157ae808e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea652869c07c47f19dff281474c15054, user_id=4ed9345c92b74253ae7c4c15f4457ae0, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:00.055052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ff24c-bbd5-4159-9aa7-60157ae808e1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:00.093078 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 946/1878] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:00 2022] PUT /identity/v3/projects/ea652869c07c47f19dff281474c15054/users/4ed9345c92b74253ae7c4c15f4457ae0/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:00.116365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1efd8c-f94b-42ba-b87f-4a268c96492b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:00.119304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9b1efd8c-f94b-42ba-b87f-4a268c96492b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:00.366261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1efd8c-f94b-42ba-b87f-4a268c96492b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:00.487494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9c726-f546-4d4a-b6f3-06fb17495164 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:00.490688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9c726-f546-4d4a-b6f3-06fb17495164 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:00.491642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9c726-f546-4d4a-b6f3-06fb17495164 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:00.492892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9c726-f546-4d4a-b6f3-06fb17495164 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:00.499662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-59b9c726-f546-4d4a-b6f3-06fb17495164 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:00.591930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:00.659032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9c726-f546-4d4a-b6f3-06fb17495164 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:00.660717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9c726-f546-4d4a-b6f3-06fb17495164 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:00.674869 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 933/1879] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:01.594538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ff24c-bbd5-4159-9aa7-60157ae808e1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:01.616587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ff24c-bbd5-4159-9aa7-60157ae808e1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:01.623746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ef396-e17d-4e65-b778-a437033d51c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:01.624812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ef396-e17d-4e65-b778-a437033d51c3 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:01.625220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ef396-e17d-4e65-b778-a437033d51c3 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:01.625661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ef396-e17d-4e65-b778-a437033d51c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:01.627818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-463ef396-e17d-4e65-b778-a437033d51c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:01.721603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:01.745899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ef396-e17d-4e65-b778-a437033d51c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:01.751424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ef396-e17d-4e65-b778-a437033d51c3 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:01.771766 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 947/1880] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:01.929121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c1211-573c-4e0f-851e-7f86eb09c293 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:01.929694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c1211-573c-4e0f-851e-7f86eb09c293 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:01.929694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c1211-573c-4e0f-851e-7f86eb09c293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:01.963478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ab5c1211-573c-4e0f-851e-7f86eb09c293 None None] MFA Rules not processed for user `4a886ccf9590432caf209526410a7b53`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:01.964793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ab5c1211-573c-4e0f-851e-7f86eb09c293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:01.993455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9704a-535e-48ec-8760-496813812bd0 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:01.993864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9704a-535e-48ec-8760-496813812bd0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:01.994006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9704a-535e-48ec-8760-496813812bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:02.054067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-70f9704a-535e-48ec-8760-496813812bd0 None None] MFA Rules not processed for user `dd9dab47e195457e8506a71a7a2aa913`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:02.055434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-70f9704a-535e-48ec-8760-496813812bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:02.081509 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 934/1881] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:01:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:02.163211 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 948/1882] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:01 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:01:02.295335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c1211-573c-4e0f-851e-7f86eb09c293 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:02.306507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c1211-573c-4e0f-851e-7f86eb09c293 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:02.312028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a76523-144e-4944-a7fa-eb9fa4fd6c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:02.312935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a76523-144e-4944-a7fa-eb9fa4fd6c56 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:02.313510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a76523-144e-4944-a7fa-eb9fa4fd6c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:02.314105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a76523-144e-4944-a7fa-eb9fa4fd6c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:02.330012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a76523-144e-4944-a7fa-eb9fa4fd6c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:02.333181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a76523-144e-4944-a7fa-eb9fa4fd6c56 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:02.356420 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 935/1883] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:03.807773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed184e-a51b-4223-b58b-b0b40344253f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:03.808776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed184e-a51b-4223-b58b-b0b40344253f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:03.809343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed184e-a51b-4223-b58b-b0b40344253f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:03.860545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-15ed184e-a51b-4223-b58b-b0b40344253f None None] MFA Rules not processed for user `950f96b926474852acb90a959e369999`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:03.864225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-15ed184e-a51b-4223-b58b-b0b40344253f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:04.046685 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 949/1884] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:07.664581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a7899-834d-4065-ad34-fb4445104f8e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:07.665104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a7899-834d-4065-ad34-fb4445104f8e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:07.665278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a7899-834d-4065-ad34-fb4445104f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:07.696101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d73a7899-834d-4065-ad34-fb4445104f8e None None] MFA Rules not processed for user `93ee771e50474e268eae2fed07e43fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:07.697723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d73a7899-834d-4065-ad34-fb4445104f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:07.868352 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 936/1885] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:08.661878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed184e-a51b-4223-b58b-b0b40344253f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:08.665107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-15ed184e-a51b-4223-b58b-b0b40344253f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:08.851822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed184e-a51b-4223-b58b-b0b40344253f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:08.870940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ba7a1-95c5-463c-a2a0-a73097c3bac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:08.872021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ba7a1-95c5-463c-a2a0-a73097c3bac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:08.872559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ba7a1-95c5-463c-a2a0-a73097c3bac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:08.873036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ba7a1-95c5-463c-a2a0-a73097c3bac0 admin admin] PATH_INFO: `/v3/users/4fbaf50b739d49c0b60b515322d42b8d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:08.877360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ba7a1-95c5-463c-a2a0-a73097c3bac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fbaf50b739d49c0b60b515322d42b8d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:08.879682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ba7a1-95c5-463c-a2a0-a73097c3bac0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:08.927905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:08.979429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-615ba7a1-95c5-463c-a2a0-a73097c3bac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fbaf50b739d49c0b60b515322d42b8d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:08.980637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-615ba7a1-95c5-463c-a2a0-a73097c3bac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fbaf50b739d49c0b60b515322d42b8d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:09.016972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-615ba7a1-95c5-463c-a2a0-a73097c3bac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fbaf50b739d49c0b60b515322d42b8d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:09.020064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-615ba7a1-95c5-463c-a2a0-a73097c3bac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fbaf50b739d49c0b60b515322d42b8d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:09.055457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-615ba7a1-95c5-463c-a2a0-a73097c3bac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fbaf50b739d49c0b60b515322d42b8d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:09.115935 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 950/1886] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:08 2022] DELETE /identity/v3/users/4fbaf50b739d49c0b60b515322d42b8d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:09.120061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7a3e6-e5ba-4ef0-8df3-ee323cdb2977 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:09.120933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7a3e6-e5ba-4ef0-8df3-ee323cdb2977 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:09.121132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7a3e6-e5ba-4ef0-8df3-ee323cdb2977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:09.208855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3be7a3e6-e5ba-4ef0-8df3-ee323cdb2977 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:09.210260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3be7a3e6-e5ba-4ef0-8df3-ee323cdb2977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:09.428667 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 937/1887] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:09.450036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ba7a1-95c5-463c-a2a0-a73097c3bac0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:09.451985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-615ba7a1-95c5-463c-a2a0-a73097c3bac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:09.616047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ba7a1-95c5-463c-a2a0-a73097c3bac0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:09.625785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7cb67-9820-44cf-b783-e2645f89bc82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:09.626981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7cb67-9820-44cf-b783-e2645f89bc82 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:09.627275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7cb67-9820-44cf-b783-e2645f89bc82 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:09.634928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7cb67-9820-44cf-b783-e2645f89bc82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:09.669991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7cb67-9820-44cf-b783-e2645f89bc82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:09.676849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7cb67-9820-44cf-b783-e2645f89bc82 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:09.721270 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 951/1888] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:12.518567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7a3e6-e5ba-4ef0-8df3-ee323cdb2977 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:12.520893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3be7a3e6-e5ba-4ef0-8df3-ee323cdb2977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:12.545554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7a3e6-e5ba-4ef0-8df3-ee323cdb2977 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:12.570204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d6d83-aa50-4ea2-8cde-cc17e745e38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:12.570890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d6d83-aa50-4ea2-8cde-cc17e745e38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:12.571178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d6d83-aa50-4ea2-8cde-cc17e745e38b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:12.571652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d6d83-aa50-4ea2-8cde-cc17e745e38b admin admin] PATH_INFO: `/v3/projects/7e4dfaf867064cf5ae93785ae4224b37` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:12.583143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d6d83-aa50-4ea2-8cde-cc17e745e38b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e4dfaf867064cf5ae93785ae4224b37)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:12.586185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d6d83-aa50-4ea2-8cde-cc17e745e38b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:12.592785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:12.728713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da5d6d83-aa50-4ea2-8cde-cc17e745e38b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e4dfaf867064cf5ae93785ae4224b37', 'request_id': 'req-da5d6d83-aa50-4ea2-8cde-cc17e745e38b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:12.757531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da5d6d83-aa50-4ea2-8cde-cc17e745e38b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e4dfaf867064cf5ae93785ae4224b37', 'request_id': 'req-da5d6d83-aa50-4ea2-8cde-cc17e745e38b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:12.782396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da5d6d83-aa50-4ea2-8cde-cc17e745e38b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e4dfaf867064cf5ae93785ae4224b37', 'request_id': 'req-da5d6d83-aa50-4ea2-8cde-cc17e745e38b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:12.801269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da5d6d83-aa50-4ea2-8cde-cc17e745e38b admin admin] The token cache is being invalidate because project 7e4dfaf867064cf5ae93785ae4224b37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:12.801771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da5d6d83-aa50-4ea2-8cde-cc17e745e38b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:12.803401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da5d6d83-aa50-4ea2-8cde-cc17e745e38b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:12.805520 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 938/1889] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:12 2022] DELETE /identity/v3/projects/7e4dfaf867064cf5ae93785ae4224b37 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:12.810880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7cb67-9820-44cf-b783-e2645f89bc82 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:12.829487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7cb67-9820-44cf-b783-e2645f89bc82 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:12.927806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3c6a1-0c80-458d-aa99-696078117574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:12.928872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3c6a1-0c80-458d-aa99-696078117574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:12.929631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3c6a1-0c80-458d-aa99-696078117574 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:12.930307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3c6a1-0c80-458d-aa99-696078117574 admin admin] PATH_INFO: `/v3/users/614c619e121e473a9c091f6dea2718bf` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:12.932205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3c6a1-0c80-458d-aa99-696078117574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=614c619e121e473a9c091f6dea2718bf)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:12.948975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3c6a1-0c80-458d-aa99-696078117574 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:12.950309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d6d83-aa50-4ea2-8cde-cc17e745e38b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:12.952015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-da5d6d83-aa50-4ea2-8cde-cc17e745e38b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:12.996112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d6d83-aa50-4ea2-8cde-cc17e745e38b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:13.006532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f33ced-787d-49aa-a72b-c0b6dee6241b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:13.007906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f33ced-787d-49aa-a72b-c0b6dee6241b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:13.008360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f33ced-787d-49aa-a72b-c0b6dee6241b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:13.008826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f33ced-787d-49aa-a72b-c0b6dee6241b admin admin] PATH_INFO: `/v3/users/0e4da74f5cab4cb3b8f0cbd3a57ba858` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:13.014134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f33ced-787d-49aa-a72b-c0b6dee6241b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e4da74f5cab4cb3b8f0cbd3a57ba858)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:13.017054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f33ced-787d-49aa-a72b-c0b6dee6241b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:13.048989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:13.079223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7fe3c6a1-0c80-458d-aa99-696078117574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '614c619e121e473a9c091f6dea2718bf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:13.080236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7fe3c6a1-0c80-458d-aa99-696078117574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '614c619e121e473a9c091f6dea2718bf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:13.103947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7fe3c6a1-0c80-458d-aa99-696078117574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '614c619e121e473a9c091f6dea2718bf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:13.105574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7fe3c6a1-0c80-458d-aa99-696078117574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '614c619e121e473a9c091f6dea2718bf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:13.116872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7fe3c6a1-0c80-458d-aa99-696078117574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '614c619e121e473a9c091f6dea2718bf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:13.140392 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 952/1890] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:12 2022] DELETE /identity/v3/users/614c619e121e473a9c091f6dea2718bf => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:13.174085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-09f33ced-787d-49aa-a72b-c0b6dee6241b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e4da74f5cab4cb3b8f0cbd3a57ba858'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:13.215625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-09f33ced-787d-49aa-a72b-c0b6dee6241b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e4da74f5cab4cb3b8f0cbd3a57ba858'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:13.216501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-09f33ced-787d-49aa-a72b-c0b6dee6241b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e4da74f5cab4cb3b8f0cbd3a57ba858'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:13.226721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-09f33ced-787d-49aa-a72b-c0b6dee6241b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e4da74f5cab4cb3b8f0cbd3a57ba858'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:13.232374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-09f33ced-787d-49aa-a72b-c0b6dee6241b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e4da74f5cab4cb3b8f0cbd3a57ba858'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:13.269877 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 939/1891] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:12 2022] DELETE /identity/v3/users/0e4da74f5cab4cb3b8f0cbd3a57ba858 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:13.283413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bcec3-70c8-48e9-8800-47c5ec8bb4e3 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:13.283413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bcec3-70c8-48e9-8800-47c5ec8bb4e3 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:13.283413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bcec3-70c8-48e9-8800-47c5ec8bb4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:13.327839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-935bcec3-70c8-48e9-8800-47c5ec8bb4e3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:13.329118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-935bcec3-70c8-48e9-8800-47c5ec8bb4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:13.488182 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 953/1892] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:13.530188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f33ced-787d-49aa-a72b-c0b6dee6241b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:13.532677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-09f33ced-787d-49aa-a72b-c0b6dee6241b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:13.654577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f33ced-787d-49aa-a72b-c0b6dee6241b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:13.659644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4d222-7114-4e3c-bc10-ab9dca893912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:13.661344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4d222-7114-4e3c-bc10-ab9dca893912 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:13.662497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4d222-7114-4e3c-bc10-ab9dca893912 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:13.663135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4d222-7114-4e3c-bc10-ab9dca893912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:13.680078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4d222-7114-4e3c-bc10-ab9dca893912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:13.684070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4d222-7114-4e3c-bc10-ab9dca893912 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:13.704019 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 940/1893] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:01:13.946244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf6ec7-ff2d-4818-86b0-f31a5ddfd26a None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:13.947228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf6ec7-ff2d-4818-86b0-f31a5ddfd26a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:13.947705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf6ec7-ff2d-4818-86b0-f31a5ddfd26a None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:13.949237 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 954/1894] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 21:01:14.054534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6683e21-3085-4846-aa0d-9c377a21ccb5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:14.055051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6683e21-3085-4846-aa0d-9c377a21ccb5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:14.055526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6683e21-3085-4846-aa0d-9c377a21ccb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:14.066786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:14.089475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e6683e21-3085-4846-aa0d-9c377a21ccb5 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:14.090998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e6683e21-3085-4846-aa0d-9c377a21ccb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:14.203882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf6ec7-ff2d-4818-86b0-f31a5ddfd26a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:14.205882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-15cf6ec7-ff2d-4818-86b0-f31a5ddfd26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:14.249731 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 941/1895] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:01:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:14.295508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6683e21-3085-4846-aa0d-9c377a21ccb5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:14.297905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e6683e21-3085-4846-aa0d-9c377a21ccb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:14.303313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf6ec7-ff2d-4818-86b0-f31a5ddfd26a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:14.309756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ab8fd-116f-4f56-82da-7b8cf70c7fb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:14.310954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ab8fd-116f-4f56-82da-7b8cf70c7fb0 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:14.310954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ab8fd-116f-4f56-82da-7b8cf70c7fb0 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:14.311131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ab8fd-116f-4f56-82da-7b8cf70c7fb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:14.313650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-782ab8fd-116f-4f56-82da-7b8cf70c7fb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:14.331196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6683e21-3085-4846-aa0d-9c377a21ccb5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:14.348807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de3c4e-bf81-4ef9-bec9-c6d8e2bc9159 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:14.349461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de3c4e-bf81-4ef9-bec9-c6d8e2bc9159 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:14.349751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de3c4e-bf81-4ef9-bec9-c6d8e2bc9159 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:14.350313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de3c4e-bf81-4ef9-bec9-c6d8e2bc9159 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:14.363192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de3c4e-bf81-4ef9-bec9-c6d8e2bc9159 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:14.365955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de3c4e-bf81-4ef9-bec9-c6d8e2bc9159 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:14.383223 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 942/1896] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:01:14.430028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:14.448932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ab8fd-116f-4f56-82da-7b8cf70c7fb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:14.451055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ab8fd-116f-4f56-82da-7b8cf70c7fb0 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:14.467985 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 955/1897] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:14 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:01:14.706507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de3c4e-bf81-4ef9-bec9-c6d8e2bc9159 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:14.708141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a9de3c4e-bf81-4ef9-bec9-c6d8e2bc9159 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:14.742207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de3c4e-bf81-4ef9-bec9-c6d8e2bc9159 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:14.754219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20348ed3-87dd-4083-8061-86380179f74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:14.754951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20348ed3-87dd-4083-8061-86380179f74c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:14.755215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20348ed3-87dd-4083-8061-86380179f74c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:14.755716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20348ed3-87dd-4083-8061-86380179f74c admin admin] PATH_INFO: `/v3/users/f724ca9bef02478da3b1696b379dc027` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:14.757103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20348ed3-87dd-4083-8061-86380179f74c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f724ca9bef02478da3b1696b379dc027)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:14.759209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20348ed3-87dd-4083-8061-86380179f74c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:14.860933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-20348ed3-87dd-4083-8061-86380179f74c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f724ca9bef02478da3b1696b379dc027'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:14.884959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-20348ed3-87dd-4083-8061-86380179f74c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f724ca9bef02478da3b1696b379dc027'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:14.886822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-20348ed3-87dd-4083-8061-86380179f74c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f724ca9bef02478da3b1696b379dc027'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:14.934689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-20348ed3-87dd-4083-8061-86380179f74c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f724ca9bef02478da3b1696b379dc027'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:14.936593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-20348ed3-87dd-4083-8061-86380179f74c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f724ca9bef02478da3b1696b379dc027'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:14.975151 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 943/1898] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:14 2022] DELETE /identity/v3/users/f724ca9bef02478da3b1696b379dc027 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:14.980460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d55474-f829-4afd-9790-ee278de6068b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:14.980940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d55474-f829-4afd-9790-ee278de6068b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:14.981050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d55474-f829-4afd-9790-ee278de6068b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:14.987966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20348ed3-87dd-4083-8061-86380179f74c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:14.989779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-20348ed3-87dd-4083-8061-86380179f74c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:15.023537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-96d55474-f829-4afd-9790-ee278de6068b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:15.025107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-96d55474-f829-4afd-9790-ee278de6068b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:15.122449 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 956/1899] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:15.155841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d55474-f829-4afd-9790-ee278de6068b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:15.157669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-96d55474-f829-4afd-9790-ee278de6068b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:15.193002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20348ed3-87dd-4083-8061-86380179f74c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:15.202242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de1c5e-1448-40ee-89c0-23b908a9badf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:15.202914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de1c5e-1448-40ee-89c0-23b908a9badf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:15.203195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de1c5e-1448-40ee-89c0-23b908a9badf admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:15.203516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de1c5e-1448-40ee-89c0-23b908a9badf admin admin] PATH_INFO: `/v3/projects/603b48785619497baa6cf515d2154c72` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:15.205410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de1c5e-1448-40ee-89c0-23b908a9badf admin admin] RBAC: Authorizing `identity:delete_project(project_id=603b48785619497baa6cf515d2154c72)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:15.207355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de1c5e-1448-40ee-89c0-23b908a9badf admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:15.209704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:15.320600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d55474-f829-4afd-9790-ee278de6068b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:15.329307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f0de1c5e-1448-40ee-89c0-23b908a9badf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '603b48785619497baa6cf515d2154c72', 'request_id': 'req-f0de1c5e-1448-40ee-89c0-23b908a9badf'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:15.341277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f0de1c5e-1448-40ee-89c0-23b908a9badf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '603b48785619497baa6cf515d2154c72', 'request_id': 'req-f0de1c5e-1448-40ee-89c0-23b908a9badf'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:15.352956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f0de1c5e-1448-40ee-89c0-23b908a9badf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '603b48785619497baa6cf515d2154c72', 'request_id': 'req-f0de1c5e-1448-40ee-89c0-23b908a9badf'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:15.388568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f0de1c5e-1448-40ee-89c0-23b908a9badf admin admin] The token cache is being invalidate because project 603b48785619497baa6cf515d2154c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:15.390580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f0de1c5e-1448-40ee-89c0-23b908a9badf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:15.394354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f0de1c5e-1448-40ee-89c0-23b908a9badf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:15.400243 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 944/1900] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:14 2022] DELETE /identity/v3/projects/603b48785619497baa6cf515d2154c72 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:01:15.404299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de1c5e-1448-40ee-89c0-23b908a9badf admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:15.406583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f0de1c5e-1448-40ee-89c0-23b908a9badf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:15.500860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08903b92-e5f2-4c97-9c7f-6621dd1e40f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:15.501513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08903b92-e5f2-4c97-9c7f-6621dd1e40f4 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:15.501800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08903b92-e5f2-4c97-9c7f-6621dd1e40f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:15.502796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08903b92-e5f2-4c97-9c7f-6621dd1e40f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:15.510523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-08903b92-e5f2-4c97-9c7f-6621dd1e40f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:15.566822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de1c5e-1448-40ee-89c0-23b908a9badf admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:15.578972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea306fd7-aaf4-4160-adae-54d8f35d4fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:15.580111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea306fd7-aaf4-4160-adae-54d8f35d4fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:15.580408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea306fd7-aaf4-4160-adae-54d8f35d4fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:15.580695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea306fd7-aaf4-4160-adae-54d8f35d4fb3 admin admin] PATH_INFO: `/v3/users/d7f4831e593d4e1591f84887c02d7d54` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:15.582379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea306fd7-aaf4-4160-adae-54d8f35d4fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f4831e593d4e1591f84887c02d7d54)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:15.585259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea306fd7-aaf4-4160-adae-54d8f35d4fb3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:15.648915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08903b92-e5f2-4c97-9c7f-6621dd1e40f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:15.652934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08903b92-e5f2-4c97-9c7f-6621dd1e40f4 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:15.674684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:15.693356 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 957/1901] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:01:15.695748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ea306fd7-aaf4-4160-adae-54d8f35d4fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f4831e593d4e1591f84887c02d7d54'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:15.696992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9e0d2-5560-42bd-a87c-8a341745c286 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:15.697693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9e0d2-5560-42bd-a87c-8a341745c286 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:15.699640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9e0d2-5560-42bd-a87c-8a341745c286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:15.736652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ea306fd7-aaf4-4160-adae-54d8f35d4fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f4831e593d4e1591f84887c02d7d54'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:15.738091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ea306fd7-aaf4-4160-adae-54d8f35d4fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f4831e593d4e1591f84887c02d7d54'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:15.758061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ea306fd7-aaf4-4160-adae-54d8f35d4fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f4831e593d4e1591f84887c02d7d54'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:15.761326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ea306fd7-aaf4-4160-adae-54d8f35d4fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f4831e593d4e1591f84887c02d7d54'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:15.782389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-33d9e0d2-5560-42bd-a87c-8a341745c286 None None] MFA Rules not processed for user `4ed9345c92b74253ae7c4c15f4457ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:15.800743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-33d9e0d2-5560-42bd-a87c-8a341745c286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:15.803893 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 945/1902] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:15 2022] DELETE /identity/v3/users/d7f4831e593d4e1591f84887c02d7d54 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:01:15.930352 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 958/1903] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:15.941794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382fb60-fe36-4514-924f-2644bd5ecefc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:15.942113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382fb60-fe36-4514-924f-2644bd5ecefc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:15.942940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382fb60-fe36-4514-924f-2644bd5ecefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:15.984836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e382fb60-fe36-4514-924f-2644bd5ecefc None None] MFA Rules not processed for user `46d7264a2f63436bb8519cd8cec6d9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:15.986196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e382fb60-fe36-4514-924f-2644bd5ecefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:15.993177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:16.107562 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 946/1904] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:16.206357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9e0d2-5560-42bd-a87c-8a341745c286 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:16.208440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-33d9e0d2-5560-42bd-a87c-8a341745c286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:16.327176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382fb60-fe36-4514-924f-2644bd5ecefc None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:16.328713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e382fb60-fe36-4514-924f-2644bd5ecefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:16.396458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9e0d2-5560-42bd-a87c-8a341745c286 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:16.414401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155794f-f86a-422c-8d8e-f8552adc7369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:16.416473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155794f-f86a-422c-8d8e-f8552adc7369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:16.416473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155794f-f86a-422c-8d8e-f8552adc7369 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:16.416473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155794f-f86a-422c-8d8e-f8552adc7369 admin admin] PATH_INFO: `/v3/projects/2c9849891d2f4a5ea7cfb60fe1707d62` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:16.418310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155794f-f86a-422c-8d8e-f8552adc7369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c9849891d2f4a5ea7cfb60fe1707d62)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:16.420145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155794f-f86a-422c-8d8e-f8552adc7369 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:16.519214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382fb60-fe36-4514-924f-2644bd5ecefc None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:16.529446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15a4f9-836b-4e2c-8fc3-4eeb93d451f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:16.530238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15a4f9-836b-4e2c-8fc3-4eeb93d451f9 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:16.530531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15a4f9-836b-4e2c-8fc3-4eeb93d451f9 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:16.530810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15a4f9-836b-4e2c-8fc3-4eeb93d451f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:16.541771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3b15a4f9-836b-4e2c-8fc3-4eeb93d451f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:16.564750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d155794f-f86a-422c-8d8e-f8552adc7369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c9849891d2f4a5ea7cfb60fe1707d62', 'request_id': 'req-d155794f-f86a-422c-8d8e-f8552adc7369'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:16.567645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15a4f9-836b-4e2c-8fc3-4eeb93d451f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:16.569066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15a4f9-836b-4e2c-8fc3-4eeb93d451f9 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:16.590216 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 947/1905] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:01:16.590395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d155794f-f86a-422c-8d8e-f8552adc7369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c9849891d2f4a5ea7cfb60fe1707d62', 'request_id': 'req-d155794f-f86a-422c-8d8e-f8552adc7369'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:16.602570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d155794f-f86a-422c-8d8e-f8552adc7369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c9849891d2f4a5ea7cfb60fe1707d62', 'request_id': 'req-d155794f-f86a-422c-8d8e-f8552adc7369'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:16.628198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d155794f-f86a-422c-8d8e-f8552adc7369 admin admin] The token cache is being invalidate because project 2c9849891d2f4a5ea7cfb60fe1707d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:16.628641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d155794f-f86a-422c-8d8e-f8552adc7369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:16.630432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d155794f-f86a-422c-8d8e-f8552adc7369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:16.633016 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 959/1906] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:16 2022] DELETE /identity/v3/projects/2c9849891d2f4a5ea7cfb60fe1707d62 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:16.637804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe584d-c6ac-469b-b997-b6a33c078edb None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:16.638100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe584d-c6ac-469b-b997-b6a33c078edb None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:16.638386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe584d-c6ac-469b-b997-b6a33c078edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:16.679484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-cffe584d-c6ac-469b-b997-b6a33c078edb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:16.683943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cffe584d-c6ac-469b-b997-b6a33c078edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:16.825707 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 948/1907] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:16.834928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3fcee-0464-4407-b27b-d346f9268fd9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:16.835804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3fcee-0464-4407-b27b-d346f9268fd9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:16.836467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3fcee-0464-4407-b27b-d346f9268fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:16.874956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-13b3fcee-0464-4407-b27b-d346f9268fd9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:16.877366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-13b3fcee-0464-4407-b27b-d346f9268fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:16.900793 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 960/1908] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:16.905268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe584d-c6ac-469b-b997-b6a33c078edb None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:16.922141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe584d-c6ac-469b-b997-b6a33c078edb None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:16.949669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4095c-152f-4f53-b715-e2628bfc7b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:16.950332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4095c-152f-4f53-b715-e2628bfc7b31 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:16.950618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4095c-152f-4f53-b715-e2628bfc7b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:16.950896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4095c-152f-4f53-b715-e2628bfc7b31 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:16.951648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4095c-152f-4f53-b715-e2628bfc7b31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:01:16.952177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4095c-152f-4f53-b715-e2628bfc7b31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:16.953806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4095c-152f-4f53-b715-e2628bfc7b31 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:16.989104 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 949/1909] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:01:16.991432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3fcee-0464-4407-b27b-d346f9268fd9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:17.009037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3fcee-0464-4407-b27b-d346f9268fd9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:17.020167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcd9fc-5d96-47ea-9ec3-3660caa224c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:17.021479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcd9fc-5d96-47ea-9ec3-3660caa224c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:17.021865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcd9fc-5d96-47ea-9ec3-3660caa224c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:17.022281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcd9fc-5d96-47ea-9ec3-3660caa224c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:17.022971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcd9fc-5d96-47ea-9ec3-3660caa224c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:17.027556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcd9fc-5d96-47ea-9ec3-3660caa224c9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:17.030289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4095c-152f-4f53-b715-e2628bfc7b31 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:17.031145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b8a4095c-152f-4f53-b715-e2628bfc7b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:17.036483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:17.050912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4095c-152f-4f53-b715-e2628bfc7b31 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:17.067004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc132c-8361-4f99-92e0-000057bb42a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:17.068193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc132c-8361-4f99-92e0-000057bb42a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:17.068483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc132c-8361-4f99-92e0-000057bb42a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:17.068770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc132c-8361-4f99-92e0-000057bb42a2 admin admin] PATH_INFO: `/v3/projects/e80c1509c60d46bda7b1c4793260ab40` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:17.071384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc132c-8361-4f99-92e0-000057bb42a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e80c1509c60d46bda7b1c4793260ab40)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:17.073332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc132c-8361-4f99-92e0-000057bb42a2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:17.085061 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 961/1910] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:16 2022] POST /identity/v3/projects => generated 369 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:17.091904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcd9fc-5d96-47ea-9ec3-3660caa224c9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:17.125390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:17.173688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cacc132c-8361-4f99-92e0-000057bb42a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e80c1509c60d46bda7b1c4793260ab40', 'request_id': 'req-cacc132c-8361-4f99-92e0-000057bb42a2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:17.194098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cacc132c-8361-4f99-92e0-000057bb42a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e80c1509c60d46bda7b1c4793260ab40', 'request_id': 'req-cacc132c-8361-4f99-92e0-000057bb42a2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:17.206872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cacc132c-8361-4f99-92e0-000057bb42a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e80c1509c60d46bda7b1c4793260ab40', 'request_id': 'req-cacc132c-8361-4f99-92e0-000057bb42a2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:17.223477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcd9fc-5d96-47ea-9ec3-3660caa224c9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:17.228733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cacc132c-8361-4f99-92e0-000057bb42a2 admin admin] The token cache is being invalidate because project e80c1509c60d46bda7b1c4793260ab40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:17.229039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cacc132c-8361-4f99-92e0-000057bb42a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:17.230038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cacc132c-8361-4f99-92e0-000057bb42a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:17.234447 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 950/1911] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:17 2022] DELETE /identity/v3/projects/e80c1509c60d46bda7b1c4793260ab40 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:01:17.236052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc132c-8361-4f99-92e0-000057bb42a2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:17.237627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cacc132c-8361-4f99-92e0-000057bb42a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:17.297977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef4c98-567d-4895-8952-4d8174d90002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:17.298711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef4c98-567d-4895-8952-4d8174d90002 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:17.299343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef4c98-567d-4895-8952-4d8174d90002 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:17.299456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef4c98-567d-4895-8952-4d8174d90002 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:17.300281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef4c98-567d-4895-8952-4d8174d90002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:17.304177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef4c98-567d-4895-8952-4d8174d90002 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:17.348914 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 962/1912] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:17 2022] POST /identity/v3/users => generated 285 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:01:17.351158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef4c98-567d-4895-8952-4d8174d90002 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:17.351925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc132c-8361-4f99-92e0-000057bb42a2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:17.355236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e9ef4c98-567d-4895-8952-4d8174d90002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:17.364764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bfc88-8050-4401-9a51-231e70492278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:17.365813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bfc88-8050-4401-9a51-231e70492278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:17.366168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bfc88-8050-4401-9a51-231e70492278 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:17.366355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bfc88-8050-4401-9a51-231e70492278 admin admin] PATH_INFO: `/v3/users/8334ca58e05b43a088428a5b34497444` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:17.370246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9bfc88-8050-4401-9a51-231e70492278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8334ca58e05b43a088428a5b34497444)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:17.371784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef4c98-567d-4895-8952-4d8174d90002 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:17.376435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9bfc88-8050-4401-9a51-231e70492278 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:17.377466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95d8d2-c27f-4d68-b596-b67276d85dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:17.378322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95d8d2-c27f-4d68-b596-b67276d85dfa admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:17.378778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95d8d2-c27f-4d68-b596-b67276d85dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:17.379356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95d8d2-c27f-4d68-b596-b67276d85dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:17.381006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95d8d2-c27f-4d68-b596-b67276d85dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:17.383026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95d8d2-c27f-4d68-b596-b67276d85dfa admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:17.402451 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 963/1913] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:17.404039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95d8d2-c27f-4d68-b596-b67276d85dfa admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:17.416580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95d8d2-c27f-4d68-b596-b67276d85dfa admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:17.423588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed29a5f-7bbe-4df3-995d-5d26feb4aefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:17.424502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed29a5f-7bbe-4df3-995d-5d26feb4aefa admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:17.424931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed29a5f-7bbe-4df3-995d-5d26feb4aefa admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:17.425361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed29a5f-7bbe-4df3-995d-5d26feb4aefa admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:17.427306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed29a5f-7bbe-4df3-995d-5d26feb4aefa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:17.429584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed29a5f-7bbe-4df3-995d-5d26feb4aefa admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:17.450463 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 964/1914] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:17.452065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed29a5f-7bbe-4df3-995d-5d26feb4aefa admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:17.465963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed29a5f-7bbe-4df3-995d-5d26feb4aefa admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:17.470398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd9bfc88-8050-4401-9a51-231e70492278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8334ca58e05b43a088428a5b34497444'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:17.477179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4047892-3f72-4031-bb3a-c89a60f35876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:17.481443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4047892-3f72-4031-bb3a-c89a60f35876 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:17.482071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4047892-3f72-4031-bb3a-c89a60f35876 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:17.482606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4047892-3f72-4031-bb3a-c89a60f35876 admin admin] PATH_INFO: `/v3/projects/b11b98285223491db28e9a9c4ec68a5c/users/94bcc5e0237a41e8a12762698eeff0cb/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:17.496628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd9bfc88-8050-4401-9a51-231e70492278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8334ca58e05b43a088428a5b34497444'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:17.497404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd9bfc88-8050-4401-9a51-231e70492278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8334ca58e05b43a088428a5b34497444'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:17.511643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd9bfc88-8050-4401-9a51-231e70492278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8334ca58e05b43a088428a5b34497444'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:17.516528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd9bfc88-8050-4401-9a51-231e70492278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8334ca58e05b43a088428a5b34497444'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:17.522076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4047892-3f72-4031-bb3a-c89a60f35876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b11b98285223491db28e9a9c4ec68a5c, user_id=94bcc5e0237a41e8a12762698eeff0cb, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:17.527453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4047892-3f72-4031-bb3a-c89a60f35876 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:17.545432 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 951/1915] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:17 2022] DELETE /identity/v3/users/8334ca58e05b43a088428a5b34497444 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:17.568586 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 965/1916] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:17 2022] PUT /identity/v3/projects/b11b98285223491db28e9a9c4ec68a5c/users/94bcc5e0237a41e8a12762698eeff0cb/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:17.569114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5ef9c-47d5-44a8-80db-42454fc11381 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:17.569420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5ef9c-47d5-44a8-80db-42454fc11381 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:17.569578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5ef9c-47d5-44a8-80db-42454fc11381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:17.605090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-16e5ef9c-47d5-44a8-80db-42454fc11381 None None] MFA Rules not processed for user `94bcc5e0237a41e8a12762698eeff0cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:17.606260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-16e5ef9c-47d5-44a8-80db-42454fc11381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:17.657666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:17.809523 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 952/1917] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:17.810270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4047892-3f72-4031-bb3a-c89a60f35876 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:17.812217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f4047892-3f72-4031-bb3a-c89a60f35876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:17.865761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:17.894765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4047892-3f72-4031-bb3a-c89a60f35876 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:17.900912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232d2ab-2a4b-4493-b3c2-73de45c17611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:17.901832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232d2ab-2a4b-4493-b3c2-73de45c17611 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:17.902155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232d2ab-2a4b-4493-b3c2-73de45c17611 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:17.902540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232d2ab-2a4b-4493-b3c2-73de45c17611 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:17.903478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232d2ab-2a4b-4493-b3c2-73de45c17611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:17.905714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232d2ab-2a4b-4493-b3c2-73de45c17611 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:17.943161 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 966/1918] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:17 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:17.943671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5ef9c-47d5-44a8-80db-42454fc11381 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:17.958380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5ef9c-47d5-44a8-80db-42454fc11381 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:18.055439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c5402-0123-4e45-be8c-5474d0682b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:18.056286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c5402-0123-4e45-be8c-5474d0682b9d admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:18.056663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c5402-0123-4e45-be8c-5474d0682b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:18.057059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c5402-0123-4e45-be8c-5474d0682b9d admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:18.057860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c5402-0123-4e45-be8c-5474d0682b9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:18.060319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c5402-0123-4e45-be8c-5474d0682b9d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:18.096460 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 953/1919] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:17 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:01:18.097981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232d2ab-2a4b-4493-b3c2-73de45c17611 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:18.113473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232d2ab-2a4b-4493-b3c2-73de45c17611 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:18.125066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc280810-8826-4675-aa47-3240f01f4661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:18.125762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc280810-8826-4675-aa47-3240f01f4661 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:18.126054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc280810-8826-4675-aa47-3240f01f4661 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:18.126335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc280810-8826-4675-aa47-3240f01f4661 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:18.127040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc280810-8826-4675-aa47-3240f01f4661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:18.134254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc280810-8826-4675-aa47-3240f01f4661 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:18.158509 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 967/1920] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:18.163704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c5402-0123-4e45-be8c-5474d0682b9d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:18.176095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c5402-0123-4e45-be8c-5474d0682b9d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:18.182353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c614a3-001e-4c97-a496-5f9d9d8177f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:18.183857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c614a3-001e-4c97-a496-5f9d9d8177f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:18.184389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c614a3-001e-4c97-a496-5f9d9d8177f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:18.184775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c614a3-001e-4c97-a496-5f9d9d8177f8 admin admin] PATH_INFO: `/v3/projects/6b30fb99b7ce45b3a3ffe8d88bad0a1e/users/d5127fddc4364123a8da57e5a309d9bd/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:18.212281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c614a3-001e-4c97-a496-5f9d9d8177f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b30fb99b7ce45b3a3ffe8d88bad0a1e, user_id=d5127fddc4364123a8da57e5a309d9bd, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:18.216774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c614a3-001e-4c97-a496-5f9d9d8177f8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:18.241200 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 954/1921] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:18 2022] PUT /identity/v3/projects/6b30fb99b7ce45b3a3ffe8d88bad0a1e/users/d5127fddc4364123a8da57e5a309d9bd/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:18.241423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc280810-8826-4675-aa47-3240f01f4661 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:18.260988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc280810-8826-4675-aa47-3240f01f4661 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:18.368984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703cfde-0168-438f-bcbd-6c3d5380186c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:18.369193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703cfde-0168-438f-bcbd-6c3d5380186c admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:18.369480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703cfde-0168-438f-bcbd-6c3d5380186c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:18.369761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703cfde-0168-438f-bcbd-6c3d5380186c admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:18.371664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703cfde-0168-438f-bcbd-6c3d5380186c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:18.373587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703cfde-0168-438f-bcbd-6c3d5380186c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:18.387824 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 968/1922] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:18.391797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c614a3-001e-4c97-a496-5f9d9d8177f8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:18.408475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c614a3-001e-4c97-a496-5f9d9d8177f8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:18.419162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e931e33-958d-4179-8364-82ed315ad087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:18.421491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e931e33-958d-4179-8364-82ed315ad087 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:18.422348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e931e33-958d-4179-8364-82ed315ad087 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:18.422650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e931e33-958d-4179-8364-82ed315ad087 admin admin] PATH_INFO: `/v3/projects/6b30fb99b7ce45b3a3ffe8d88bad0a1e/users/d5127fddc4364123a8da57e5a309d9bd/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:18.429550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e931e33-958d-4179-8364-82ed315ad087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b30fb99b7ce45b3a3ffe8d88bad0a1e, user_id=d5127fddc4364123a8da57e5a309d9bd, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:18.444392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e931e33-958d-4179-8364-82ed315ad087 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:18.465672 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 955/1923] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:18 2022] PUT /identity/v3/projects/6b30fb99b7ce45b3a3ffe8d88bad0a1e/users/d5127fddc4364123a8da57e5a309d9bd/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:18.476254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca26f5-eaa3-4353-a3ec-68adf65568c5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:18.476626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca26f5-eaa3-4353-a3ec-68adf65568c5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:18.476978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca26f5-eaa3-4353-a3ec-68adf65568c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:18.507005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e931e33-958d-4179-8364-82ed315ad087 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:18.511898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8e931e33-958d-4179-8364-82ed315ad087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:18.584735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3bca26f5-eaa3-4353-a3ec-68adf65568c5 None None] MFA Rules not processed for user `d5127fddc4364123a8da57e5a309d9bd`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:18.588604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3bca26f5-eaa3-4353-a3ec-68adf65568c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:18.682678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e931e33-958d-4179-8364-82ed315ad087 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:18.698124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd30e4-012e-4c81-9b80-df3a4a532434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:18.699049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd30e4-012e-4c81-9b80-df3a4a532434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:18.699649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd30e4-012e-4c81-9b80-df3a4a532434 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:18.700074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd30e4-012e-4c81-9b80-df3a4a532434 admin admin] PATH_INFO: `/v3/projects/3881e3e74f1440439e1a547ca96653ca` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:18.704932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd30e4-012e-4c81-9b80-df3a4a532434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3881e3e74f1440439e1a547ca96653ca)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:18.707235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd30e4-012e-4c81-9b80-df3a4a532434 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:18.736659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:18.815584 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 969/1924] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:18 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:18.815584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b8e8f-cabc-47e5-9581-7b8de7761bfd None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:18.815584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b8e8f-cabc-47e5-9581-7b8de7761bfd None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:18.815584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b8e8f-cabc-47e5-9581-7b8de7761bfd None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:18.820085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fffd30e4-012e-4c81-9b80-df3a4a532434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3881e3e74f1440439e1a547ca96653ca', 'request_id': 'req-fffd30e4-012e-4c81-9b80-df3a4a532434'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:18.826443 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 970/1925] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:01:18 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:01:18.828607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1b3ee-6347-4857-94d5-5e16d65461c8 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:18.828607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1b3ee-6347-4857-94d5-5e16d65461c8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:18.829016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1b3ee-6347-4857-94d5-5e16d65461c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:18.837992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fffd30e4-012e-4c81-9b80-df3a4a532434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3881e3e74f1440439e1a547ca96653ca', 'request_id': 'req-fffd30e4-012e-4c81-9b80-df3a4a532434'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:18.861332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fffd30e4-012e-4c81-9b80-df3a4a532434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3881e3e74f1440439e1a547ca96653ca', 'request_id': 'req-fffd30e4-012e-4c81-9b80-df3a4a532434'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:18.895859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a0e1b3ee-6347-4857-94d5-5e16d65461c8 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:18.902018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fffd30e4-012e-4c81-9b80-df3a4a532434 admin admin] The token cache is being invalidate because project 3881e3e74f1440439e1a547ca96653ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:18.902328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fffd30e4-012e-4c81-9b80-df3a4a532434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:18.905895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a0e1b3ee-6347-4857-94d5-5e16d65461c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:18.906190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fffd30e4-012e-4c81-9b80-df3a4a532434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:18.910559 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 956/1926] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:18 2022] DELETE /identity/v3/projects/3881e3e74f1440439e1a547ca96653ca => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:18.914427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd30e4-012e-4c81-9b80-df3a4a532434 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:18.916451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fffd30e4-012e-4c81-9b80-df3a4a532434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:19.000552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:19.125539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd30e4-012e-4c81-9b80-df3a4a532434 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:19.146420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3fcfb-ef06-43e1-ad2b-e34872e52cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:19.147195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3fcfb-ef06-43e1-ad2b-e34872e52cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:19.147534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3fcfb-ef06-43e1-ad2b-e34872e52cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:19.147905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3fcfb-ef06-43e1-ad2b-e34872e52cf3 admin admin] PATH_INFO: `/v3/projects/07cebc379e1a4bd49e6538c94890489b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:19.153914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3fcfb-ef06-43e1-ad2b-e34872e52cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07cebc379e1a4bd49e6538c94890489b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:19.164153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3fcfb-ef06-43e1-ad2b-e34872e52cf3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:19.293748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0cf3fcfb-ef06-43e1-ad2b-e34872e52cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07cebc379e1a4bd49e6538c94890489b', 'request_id': 'req-0cf3fcfb-ef06-43e1-ad2b-e34872e52cf3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:19.336036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0cf3fcfb-ef06-43e1-ad2b-e34872e52cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07cebc379e1a4bd49e6538c94890489b', 'request_id': 'req-0cf3fcfb-ef06-43e1-ad2b-e34872e52cf3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:19.359015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0cf3fcfb-ef06-43e1-ad2b-e34872e52cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07cebc379e1a4bd49e6538c94890489b', 'request_id': 'req-0cf3fcfb-ef06-43e1-ad2b-e34872e52cf3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:19.372059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0cf3fcfb-ef06-43e1-ad2b-e34872e52cf3 admin admin] The token cache is being invalidate because project 07cebc379e1a4bd49e6538c94890489b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:19.372459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0cf3fcfb-ef06-43e1-ad2b-e34872e52cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:19.373707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0cf3fcfb-ef06-43e1-ad2b-e34872e52cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:19.376065 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 957/1927] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:18 2022] DELETE /identity/v3/projects/07cebc379e1a4bd49e6538c94890489b => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:19.377850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb82c0f-ee6e-4ee2-9196-b628a4d381ca None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:19.380897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb82c0f-ee6e-4ee2-9196-b628a4d381ca None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:19.381275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb82c0f-ee6e-4ee2-9196-b628a4d381ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:19.428402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2eb82c0f-ee6e-4ee2-9196-b628a4d381ca None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:19.432634 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 971/1928] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:01:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 605 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:19.437257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2eb82c0f-ee6e-4ee2-9196-b628a4d381ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:19.437871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1b3ee-6347-4857-94d5-5e16d65461c8 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:19.440661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a0e1b3ee-6347-4857-94d5-5e16d65461c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:19.488166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:19.594092 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 958/1929] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:19.595566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda668a8-21d1-4c47-9bbb-c866410901c6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:19.595855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda668a8-21d1-4c47-9bbb-c866410901c6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:19.596121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda668a8-21d1-4c47-9bbb-c866410901c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:19.615006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1b3ee-6347-4857-94d5-5e16d65461c8 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:19.649888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-cda668a8-21d1-4c47-9bbb-c866410901c6 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:19.651596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cda668a8-21d1-4c47-9bbb-c866410901c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:19.670932 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 959/1930] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:19.672594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda668a8-21d1-4c47-9bbb-c866410901c6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:19.677213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cda668a8-21d1-4c47-9bbb-c866410901c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:19.762178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53836783-2940-43df-a141-ac1f77126f70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:19.763322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53836783-2940-43df-a141-ac1f77126f70 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:19.764701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53836783-2940-43df-a141-ac1f77126f70 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:19.765121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53836783-2940-43df-a141-ac1f77126f70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:19.769435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-53836783-2940-43df-a141-ac1f77126f70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:19.818019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda668a8-21d1-4c47-9bbb-c866410901c6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:19.824280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38a73a-541f-43c6-bb64-7db0c2d50cd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:19.825467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38a73a-541f-43c6-bb64-7db0c2d50cd5 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:19.826540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38a73a-541f-43c6-bb64-7db0c2d50cd5 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:19.826540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38a73a-541f-43c6-bb64-7db0c2d50cd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:19.839357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38a73a-541f-43c6-bb64-7db0c2d50cd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:19.841435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38a73a-541f-43c6-bb64-7db0c2d50cd5 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:19.858739 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 960/1931] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:19.860665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9b76d-f5a2-435a-a75b-539c6a9ddfb1 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:19.861147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9b76d-f5a2-435a-a75b-539c6a9ddfb1 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:19.861500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9b76d-f5a2-435a-a75b-539c6a9ddfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:19.863934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53836783-2940-43df-a141-ac1f77126f70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:19.866351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53836783-2940-43df-a141-ac1f77126f70 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:19.872622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:19.886936 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 972/1932] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:19.888855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f4028-cb8f-4b30-a084-24d08d1990f3 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:19.889401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f4028-cb8f-4b30-a084-24d08d1990f3 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:19.890668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f4028-cb8f-4b30-a084-24d08d1990f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:19.916075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e51f4028-cb8f-4b30-a084-24d08d1990f3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:19.917982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e51f4028-cb8f-4b30-a084-24d08d1990f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:19.924417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-20e9b76d-f5a2-435a-a75b-539c6a9ddfb1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:19.928058 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 973/1933] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:19.928829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-20e9b76d-f5a2-435a-a75b-539c6a9ddfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:19.934102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f4028-cb8f-4b30-a084-24d08d1990f3 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:19.948355 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 961/1934] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:19.951114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9b76d-f5a2-435a-a75b-539c6a9ddfb1 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:19.961908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f4028-cb8f-4b30-a084-24d08d1990f3 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:19.970093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66063678-c538-4214-8666-e62c10f4f667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:19.970802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66063678-c538-4214-8666-e62c10f4f667 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:19.970995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66063678-c538-4214-8666-e62c10f4f667 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:19.971277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66063678-c538-4214-8666-e62c10f4f667 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:19.972017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66063678-c538-4214-8666-e62c10f4f667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:01:19.972420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66063678-c538-4214-8666-e62c10f4f667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:19.974772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66063678-c538-4214-8666-e62c10f4f667 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:19.996346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9b76d-f5a2-435a-a75b-539c6a9ddfb1 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:19.996561 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 974/1935] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:01:19.999733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66063678-c538-4214-8666-e62c10f4f667 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:20.010462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa0614-79cf-4e58-bc0a-aee995a3e72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:20.010462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa0614-79cf-4e58-bc0a-aee995a3e72f admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:20.010462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa0614-79cf-4e58-bc0a-aee995a3e72f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:20.010462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa0614-79cf-4e58-bc0a-aee995a3e72f admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:20.010775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa0614-79cf-4e58-bc0a-aee995a3e72f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:01:20.010775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa0614-79cf-4e58-bc0a-aee995a3e72f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:20.011409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa0614-79cf-4e58-bc0a-aee995a3e72f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:20.017401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66063678-c538-4214-8666-e62c10f4f667 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:20.023527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bca1fb-8578-455e-a3f9-d1e6f216f897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:20.024239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bca1fb-8578-455e-a3f9-d1e6f216f897 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:20.024635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bca1fb-8578-455e-a3f9-d1e6f216f897 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:20.025048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bca1fb-8578-455e-a3f9-d1e6f216f897 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:20.025812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bca1fb-8578-455e-a3f9-d1e6f216f897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:20.027986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bca1fb-8578-455e-a3f9-d1e6f216f897 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:20.034036 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 962/1936] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:01:20.035120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa0614-79cf-4e58-bc0a-aee995a3e72f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:20.060183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa0614-79cf-4e58-bc0a-aee995a3e72f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:20.072069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6aca2d-5d9e-458a-8155-832fcd750b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:20.072778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6aca2d-5d9e-458a-8155-832fcd750b5b admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:20.073080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6aca2d-5d9e-458a-8155-832fcd750b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:20.074683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6aca2d-5d9e-458a-8155-832fcd750b5b admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:20.075418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6aca2d-5d9e-458a-8155-832fcd750b5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:20.077371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6aca2d-5d9e-458a-8155-832fcd750b5b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:20.088770 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 975/1937] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:19 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:01:20.094165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bca1fb-8578-455e-a3f9-d1e6f216f897 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:20.137405 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 963/1938] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:20 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:20.141418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6aca2d-5d9e-458a-8155-832fcd750b5b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:20.275561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bca1fb-8578-455e-a3f9-d1e6f216f897 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:20.337365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6aca2d-5d9e-458a-8155-832fcd750b5b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:20.343701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ffea0-eeb1-4994-8bea-009a24cfd974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:20.344627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ffea0-eeb1-4994-8bea-009a24cfd974 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:20.345163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ffea0-eeb1-4994-8bea-009a24cfd974 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:20.345632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ffea0-eeb1-4994-8bea-009a24cfd974 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:20.346883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ffea0-eeb1-4994-8bea-009a24cfd974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:20.349776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ffea0-eeb1-4994-8bea-009a24cfd974 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:20.366988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d79fe1-1628-48c9-b548-b49a8fc056e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:20.368012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d79fe1-1628-48c9-b548-b49a8fc056e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:20.368389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d79fe1-1628-48c9-b548-b49a8fc056e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:20.368781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d79fe1-1628-48c9-b548-b49a8fc056e6 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:20.369475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d79fe1-1628-48c9-b548-b49a8fc056e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:20.372350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d79fe1-1628-48c9-b548-b49a8fc056e6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:20.399484 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 964/1939] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:20 2022] POST /identity/v3/users => generated 292 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:20.400541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ffea0-eeb1-4994-8bea-009a24cfd974 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:20.403767 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 976/1940] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:20 2022] POST /identity/v3/users => generated 287 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:20.405196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d79fe1-1628-48c9-b548-b49a8fc056e6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:20.407794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:20.418509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d79fe1-1628-48c9-b548-b49a8fc056e6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:20.428333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d643a-8c58-4a99-8ae7-424188555f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:20.431081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d643a-8c58-4a99-8ae7-424188555f82 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:20.431407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d643a-8c58-4a99-8ae7-424188555f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:20.431869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d643a-8c58-4a99-8ae7-424188555f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:20.432417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d643a-8c58-4a99-8ae7-424188555f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:20.439329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d643a-8c58-4a99-8ae7-424188555f82 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:20.477630 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 977/1941] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:20.480289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d643a-8c58-4a99-8ae7-424188555f82 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:20.503633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d643a-8c58-4a99-8ae7-424188555f82 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:20.518766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4533d6-6ba0-451e-bda2-18be732bd30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:20.519625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4533d6-6ba0-451e-bda2-18be732bd30f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:20.521933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4533d6-6ba0-451e-bda2-18be732bd30f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:20.521933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4533d6-6ba0-451e-bda2-18be732bd30f admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:20.522485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4533d6-6ba0-451e-bda2-18be732bd30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:20.524149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4533d6-6ba0-451e-bda2-18be732bd30f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:20.559788 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 978/1942] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:20.562878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4533d6-6ba0-451e-bda2-18be732bd30f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:20.577982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ffea0-eeb1-4994-8bea-009a24cfd974 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:20.591219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4533d6-6ba0-451e-bda2-18be732bd30f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:20.591405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e52b55-14da-47fe-919d-7393ec5e808a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:20.591714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e52b55-14da-47fe-919d-7393ec5e808a service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:20.592164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e52b55-14da-47fe-919d-7393ec5e808a service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:20.592544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e52b55-14da-47fe-919d-7393ec5e808a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:20.596342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c5e52b55-14da-47fe-919d-7393ec5e808a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:20.604585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2c991-5003-42be-86e5-8e60506e79c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:20.605410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2c991-5003-42be-86e5-8e60506e79c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:20.605632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2c991-5003-42be-86e5-8e60506e79c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:20.605912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2c991-5003-42be-86e5-8e60506e79c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:20.608821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2c991-5003-42be-86e5-8e60506e79c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:20.611948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2c991-5003-42be-86e5-8e60506e79c6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:20.622664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e52b55-14da-47fe-919d-7393ec5e808a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:20.625967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e52b55-14da-47fe-919d-7393ec5e808a service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:20.642628 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 979/1943] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:20.643982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2c991-5003-42be-86e5-8e60506e79c6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:20.666949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2c991-5003-42be-86e5-8e60506e79c6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:20.670439 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 965/1944] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:20.671593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e52b55-14da-47fe-919d-7393ec5e808a service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:20.685448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3d6ff-dfff-42ec-82cc-7578f1347bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:20.686088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3d6ff-dfff-42ec-82cc-7578f1347bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:20.686398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3d6ff-dfff-42ec-82cc-7578f1347bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:20.687168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3d6ff-dfff-42ec-82cc-7578f1347bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:20.687521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3d6ff-dfff-42ec-82cc-7578f1347bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:20.692332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3d6ff-dfff-42ec-82cc-7578f1347bc9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:20.699500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e52b55-14da-47fe-919d-7393ec5e808a service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:20.716635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46f7cd-1c69-4fe0-9237-c502fb913e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:20.717336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46f7cd-1c69-4fe0-9237-c502fb913e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:20.717629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46f7cd-1c69-4fe0-9237-c502fb913e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:20.717916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46f7cd-1c69-4fe0-9237-c502fb913e81 admin admin] PATH_INFO: `/v3/projects/abc6efebdb4849548820530eea98d05f/users/aee3c04430664163b58310d2cad9ab03/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:20.736940 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 980/1945] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:20.736940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3d6ff-dfff-42ec-82cc-7578f1347bc9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:20.738086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-71b3d6ff-dfff-42ec-82cc-7578f1347bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:20.764526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46f7cd-1c69-4fe0-9237-c502fb913e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc6efebdb4849548820530eea98d05f, user_id=aee3c04430664163b58310d2cad9ab03, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:20.767247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46f7cd-1c69-4fe0-9237-c502fb913e81 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:20.778299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3d6ff-dfff-42ec-82cc-7578f1347bc9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:20.803403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abdcc1-2f81-4ba5-a188-8022f6b171da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:20.804139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abdcc1-2f81-4ba5-a188-8022f6b171da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:20.804429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abdcc1-2f81-4ba5-a188-8022f6b171da admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:20.804733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abdcc1-2f81-4ba5-a188-8022f6b171da admin admin] PATH_INFO: `/v3/users/94bcc5e0237a41e8a12762698eeff0cb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:20.809347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abdcc1-2f81-4ba5-a188-8022f6b171da admin admin] RBAC: Authorizing `identity:delete_user(user_id=94bcc5e0237a41e8a12762698eeff0cb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:20.811450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abdcc1-2f81-4ba5-a188-8022f6b171da admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:20.817203 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 966/1946] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:20 2022] PUT /identity/v3/projects/abc6efebdb4849548820530eea98d05f/users/aee3c04430664163b58310d2cad9ab03/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:20.817871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46f7cd-1c69-4fe0-9237-c502fb913e81 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:20.819978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:20.934400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-55abdcc1-2f81-4ba5-a188-8022f6b171da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94bcc5e0237a41e8a12762698eeff0cb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:20.935802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-55abdcc1-2f81-4ba5-a188-8022f6b171da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94bcc5e0237a41e8a12762698eeff0cb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:20.966228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-55abdcc1-2f81-4ba5-a188-8022f6b171da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94bcc5e0237a41e8a12762698eeff0cb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:20.967260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-55abdcc1-2f81-4ba5-a188-8022f6b171da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94bcc5e0237a41e8a12762698eeff0cb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:20.988418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-55abdcc1-2f81-4ba5-a188-8022f6b171da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94bcc5e0237a41e8a12762698eeff0cb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:21.023641 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 981/1947] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:20 2022] DELETE /identity/v3/users/94bcc5e0237a41e8a12762698eeff0cb => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:21.026854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291ebde-fa9c-49e4-a32f-6010ef6d478b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:21.027880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291ebde-fa9c-49e4-a32f-6010ef6d478b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:21.028428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291ebde-fa9c-49e4-a32f-6010ef6d478b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:21.052063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46f7cd-1c69-4fe0-9237-c502fb913e81 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:21.100467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d291ebde-fa9c-49e4-a32f-6010ef6d478b None None] MFA Rules not processed for user `aee3c04430664163b58310d2cad9ab03`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:21.110360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d291ebde-fa9c-49e4-a32f-6010ef6d478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:21.156455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffbb93-3dfb-4255-9690-e85df7a2126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:21.157163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffbb93-3dfb-4255-9690-e85df7a2126e admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:21.162127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffbb93-3dfb-4255-9690-e85df7a2126e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:21.162127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffbb93-3dfb-4255-9690-e85df7a2126e admin admin] PATH_INFO: `/v3/projects/9ff369bca42e476ea62555a278e6c39e/users/58be8ea1ebdb4317bd2da2ef8c6ddc79/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:21.245991 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 982/1948] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:21.247662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80a98b-1042-496d-969c-2e5de407cd71 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:21.248061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80a98b-1042-496d-969c-2e5de407cd71 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:21.248462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80a98b-1042-496d-969c-2e5de407cd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:21.253316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ffbb93-3dfb-4255-9690-e85df7a2126e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ff369bca42e476ea62555a278e6c39e, user_id=58be8ea1ebdb4317bd2da2ef8c6ddc79, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:21.269374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ffbb93-3dfb-4255-9690-e85df7a2126e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:21.275432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1d80a98b-1042-496d-969c-2e5de407cd71 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:21.277295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1d80a98b-1042-496d-969c-2e5de407cd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:21.290917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:21.292272 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 983/1949] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:21.299043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80a98b-1042-496d-969c-2e5de407cd71 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:21.300666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1d80a98b-1042-496d-969c-2e5de407cd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:21.301037 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 967/1950] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:20 2022] PUT /identity/v3/projects/9ff369bca42e476ea62555a278e6c39e/users/58be8ea1ebdb4317bd2da2ef8c6ddc79/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:21.304853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffbb93-3dfb-4255-9690-e85df7a2126e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:21.308556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a1ffbb93-3dfb-4255-9690-e85df7a2126e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:21.478403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80a98b-1042-496d-969c-2e5de407cd71 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:21.519010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffbb93-3dfb-4255-9690-e85df7a2126e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:21.526000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:21.548981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678872df-9895-493c-a81d-97ca0d0bb8e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:21.550120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678872df-9895-493c-a81d-97ca0d0bb8e4 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:21.550599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678872df-9895-493c-a81d-97ca0d0bb8e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:21.551056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678872df-9895-493c-a81d-97ca0d0bb8e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:21.644892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84896ec1-6b6b-4df3-a8cc-bf0c573c4f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:21.647350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84896ec1-6b6b-4df3-a8cc-bf0c573c4f82 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:21.648039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84896ec1-6b6b-4df3-a8cc-bf0c573c4f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:21.648594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84896ec1-6b6b-4df3-a8cc-bf0c573c4f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:21.736534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678872df-9895-493c-a81d-97ca0d0bb8e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:21.744313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678872df-9895-493c-a81d-97ca0d0bb8e4 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:21.782420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84896ec1-6b6b-4df3-a8cc-bf0c573c4f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:21.786611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84896ec1-6b6b-4df3-a8cc-bf0c573c4f82 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:21.797674 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 968/1951] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:01:21.801132 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 984/1952] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:21.802975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa51eec-678a-46e4-b83c-bd64f569f29d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:21.803464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa51eec-678a-46e4-b83c-bd64f569f29d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:21.803741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33aa38-6272-4c9a-a7fe-cb0b5c72564e None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:21.803866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa51eec-678a-46e4-b83c-bd64f569f29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:21.804402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33aa38-6272-4c9a-a7fe-cb0b5c72564e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:21.805367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33aa38-6272-4c9a-a7fe-cb0b5c72564e None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:21.807329 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 985/1953] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:01:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:01:21.813042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef5cfc-36ba-4fd2-b3df-873beecf5e01 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:21.813655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef5cfc-36ba-4fd2-b3df-873beecf5e01 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:21.814138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef5cfc-36ba-4fd2-b3df-873beecf5e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:21.841585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-23ef5cfc-36ba-4fd2-b3df-873beecf5e01 None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:21.843669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-23ef5cfc-36ba-4fd2-b3df-873beecf5e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:21.914354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9fa51eec-678a-46e4-b83c-bd64f569f29d None None] MFA Rules not processed for user `58be8ea1ebdb4317bd2da2ef8c6ddc79`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:21.915656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9fa51eec-678a-46e4-b83c-bd64f569f29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:21.950276 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 986/1954] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:01:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:01:22.016519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef5cfc-36ba-4fd2-b3df-873beecf5e01 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:22.019847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-23ef5cfc-36ba-4fd2-b3df-873beecf5e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:22.037752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef5cfc-36ba-4fd2-b3df-873beecf5e01 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:22.042068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c88331-ce06-47ed-8020-b00401101f01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:22.043461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c88331-ce06-47ed-8020-b00401101f01 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:22.043461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c88331-ce06-47ed-8020-b00401101f01 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:22.043750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c88331-ce06-47ed-8020-b00401101f01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:22.060757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c88331-ce06-47ed-8020-b00401101f01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:22.062147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c88331-ce06-47ed-8020-b00401101f01 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:22.082297 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 987/1955] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:22.088860 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 969/1956] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:22.093687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c88331-ce06-47ed-8020-b00401101f01 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:22.096296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d9c88331-ce06-47ed-8020-b00401101f01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:22.122971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c88331-ce06-47ed-8020-b00401101f01 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:22.132568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249e079-6ca4-4554-bf4f-65a88ce953d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:22.133320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249e079-6ca4-4554-bf4f-65a88ce953d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:22.133624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249e079-6ca4-4554-bf4f-65a88ce953d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:22.133951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249e079-6ca4-4554-bf4f-65a88ce953d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:22.134643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249e079-6ca4-4554-bf4f-65a88ce953d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:22.137031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249e079-6ca4-4554-bf4f-65a88ce953d8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:22.178327 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 988/1957] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:22 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:22.183428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa51eec-678a-46e4-b83c-bd64f569f29d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:22.204479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa51eec-678a-46e4-b83c-bd64f569f29d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:22.262843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:22.298034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82508ab-623a-429b-a39c-99bdc081f05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:22.299502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82508ab-623a-429b-a39c-99bdc081f05c admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:22.299897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82508ab-623a-429b-a39c-99bdc081f05c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:22.300485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82508ab-623a-429b-a39c-99bdc081f05c admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:22.301347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82508ab-623a-429b-a39c-99bdc081f05c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:22.304181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82508ab-623a-429b-a39c-99bdc081f05c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:22.349851 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 970/1958] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:22 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:22.354483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249e079-6ca4-4554-bf4f-65a88ce953d8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:22.370592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249e079-6ca4-4554-bf4f-65a88ce953d8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:22.372377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10c8ce-5da4-43be-8eb9-51a08312add2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:22.372902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10c8ce-5da4-43be-8eb9-51a08312add2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:22.373369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10c8ce-5da4-43be-8eb9-51a08312add2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:22.387176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae31390-3dec-46cb-8554-d51554d014d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:22.389098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae31390-3dec-46cb-8554-d51554d014d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:22.389383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae31390-3dec-46cb-8554-d51554d014d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:22.389758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae31390-3dec-46cb-8554-d51554d014d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:22.393091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae31390-3dec-46cb-8554-d51554d014d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:22.394782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae31390-3dec-46cb-8554-d51554d014d0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:22.423921 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 989/1959] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:22.424834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae31390-3dec-46cb-8554-d51554d014d0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:22.425229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2f10c8ce-5da4-43be-8eb9-51a08312add2 None None] MFA Rules not processed for user `4a886ccf9590432caf209526410a7b53`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:22.426681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2f10c8ce-5da4-43be-8eb9-51a08312add2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:22.436638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae31390-3dec-46cb-8554-d51554d014d0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:22.441854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56dd2b-7d8a-4377-8975-cfd99d36ab3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:22.442957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56dd2b-7d8a-4377-8975-cfd99d36ab3b admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:22.443512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56dd2b-7d8a-4377-8975-cfd99d36ab3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:22.444191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56dd2b-7d8a-4377-8975-cfd99d36ab3b admin admin] PATH_INFO: `/v3/projects/04d65c13ce1f471996088f484f2fe8f7/users/27ce06337525440b95c319af204809d1/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:22.464237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56dd2b-7d8a-4377-8975-cfd99d36ab3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d65c13ce1f471996088f484f2fe8f7, user_id=27ce06337525440b95c319af204809d1, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:22.467484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56dd2b-7d8a-4377-8975-cfd99d36ab3b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:22.472673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:22.494528 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 990/1960] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:22 2022] PUT /identity/v3/projects/04d65c13ce1f471996088f484f2fe8f7/users/27ce06337525440b95c319af204809d1/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:22.496041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56dd2b-7d8a-4377-8975-cfd99d36ab3b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:22.509595 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 971/1961] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:01:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:22.549798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10c8ce-5da4-43be-8eb9-51a08312add2 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:22.559512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10c8ce-5da4-43be-8eb9-51a08312add2 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:22.587190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56dd2b-7d8a-4377-8975-cfd99d36ab3b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:22.593416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed550d8-c2af-4533-b148-82b71ae7d4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:22.594224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed550d8-c2af-4533-b148-82b71ae7d4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:22.594888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed550d8-c2af-4533-b148-82b71ae7d4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:22.594888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed550d8-c2af-4533-b148-82b71ae7d4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:22.595766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed550d8-c2af-4533-b148-82b71ae7d4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:22.598054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed550d8-c2af-4533-b148-82b71ae7d4b8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:22.623370 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 991/1962] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:22.624982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed550d8-c2af-4533-b148-82b71ae7d4b8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:22.626651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c6a93-d55c-4f03-9394-dd27d566d49e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:22.627590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6a93-d55c-4f03-9394-dd27d566d49e service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:22.628069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6a93-d55c-4f03-9394-dd27d566d49e service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:22.628593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6a93-d55c-4f03-9394-dd27d566d49e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:22.637422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c6a93-d55c-4f03-9394-dd27d566d49e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:22.639231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c6a93-d55c-4f03-9394-dd27d566d49e service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:22.647090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed550d8-c2af-4533-b148-82b71ae7d4b8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:22.652552 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 972/1963] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:01:22.653961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c6a93-d55c-4f03-9394-dd27d566d49e service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:22.656372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f078879-c53d-4864-a666-e81633cd82f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:22.656735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ec1c6a93-d55c-4f03-9394-dd27d566d49e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:22.657078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f078879-c53d-4864-a666-e81633cd82f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:22.657377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f078879-c53d-4864-a666-e81633cd82f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:22.657644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f078879-c53d-4864-a666-e81633cd82f3 admin admin] PATH_INFO: `/v3/projects/04d65c13ce1f471996088f484f2fe8f7/users/27ce06337525440b95c319af204809d1/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:22.659751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f078879-c53d-4864-a666-e81633cd82f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d65c13ce1f471996088f484f2fe8f7, user_id=27ce06337525440b95c319af204809d1, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:22.663368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f078879-c53d-4864-a666-e81633cd82f3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:22.676580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c6a93-d55c-4f03-9394-dd27d566d49e service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:22.685810 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 992/1964] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:22 2022] PUT /identity/v3/projects/04d65c13ce1f471996088f484f2fe8f7/users/27ce06337525440b95c319af204809d1/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:22.689857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0f4c1-da07-4e25-8be7-a406af0e2bec None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:22.689857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0f4c1-da07-4e25-8be7-a406af0e2bec None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:22.689857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0f4c1-da07-4e25-8be7-a406af0e2bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:22.761110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-eed0f4c1-da07-4e25-8be7-a406af0e2bec None None] MFA Rules not processed for user `27ce06337525440b95c319af204809d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:22.764865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-eed0f4c1-da07-4e25-8be7-a406af0e2bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:22.818468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5571cad-b3cb-4b6e-bbfb-6f76c271aa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:22.819235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5571cad-b3cb-4b6e-bbfb-6f76c271aa64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:22.819742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5571cad-b3cb-4b6e-bbfb-6f76c271aa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:22.821208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5571cad-b3cb-4b6e-bbfb-6f76c271aa64 admin admin] PATH_INFO: `/v3/projects/b11b98285223491db28e9a9c4ec68a5c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:22.822131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5571cad-b3cb-4b6e-bbfb-6f76c271aa64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b11b98285223491db28e9a9c4ec68a5c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:22.824171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5571cad-b3cb-4b6e-bbfb-6f76c271aa64 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:22.869943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:22.910391 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 993/1965] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:01:22.925824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e5571cad-b3cb-4b6e-bbfb-6f76c271aa64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b11b98285223491db28e9a9c4ec68a5c', 'request_id': 'req-e5571cad-b3cb-4b6e-bbfb-6f76c271aa64'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:22.933267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e5571cad-b3cb-4b6e-bbfb-6f76c271aa64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b11b98285223491db28e9a9c4ec68a5c', 'request_id': 'req-e5571cad-b3cb-4b6e-bbfb-6f76c271aa64'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:22.943010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e5571cad-b3cb-4b6e-bbfb-6f76c271aa64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b11b98285223491db28e9a9c4ec68a5c', 'request_id': 'req-e5571cad-b3cb-4b6e-bbfb-6f76c271aa64'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:22.953891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0f4c1-da07-4e25-8be7-a406af0e2bec None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:22.956752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-eed0f4c1-da07-4e25-8be7-a406af0e2bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:22.960746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e5571cad-b3cb-4b6e-bbfb-6f76c271aa64 admin admin] The token cache is being invalidate because project b11b98285223491db28e9a9c4ec68a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:22.961721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e5571cad-b3cb-4b6e-bbfb-6f76c271aa64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:22.962422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e5571cad-b3cb-4b6e-bbfb-6f76c271aa64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:22.967568 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 973/1966] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:22 2022] DELETE /identity/v3/projects/b11b98285223491db28e9a9c4ec68a5c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:22.968443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5571cad-b3cb-4b6e-bbfb-6f76c271aa64 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:22.970212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e5571cad-b3cb-4b6e-bbfb-6f76c271aa64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:22.984826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0f4c1-da07-4e25-8be7-a406af0e2bec None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:23.103131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5571cad-b3cb-4b6e-bbfb-6f76c271aa64 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:23.103555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6a0d3-b62d-4bcf-91c4-38ecad6a4951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:23.104318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6a0d3-b62d-4bcf-91c4-38ecad6a4951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:23.104978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6a0d3-b62d-4bcf-91c4-38ecad6a4951 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:23.105508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6a0d3-b62d-4bcf-91c4-38ecad6a4951 admin admin] PATH_INFO: `/v3/users/aee3c04430664163b58310d2cad9ab03` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:23.107461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6a0d3-b62d-4bcf-91c4-38ecad6a4951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aee3c04430664163b58310d2cad9ab03)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:23.109371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6a0d3-b62d-4bcf-91c4-38ecad6a4951 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:23.119334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:23.133262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73115c8a-842d-473f-a602-f0410a3b17a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:23.134920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73115c8a-842d-473f-a602-f0410a3b17a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:23.135825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73115c8a-842d-473f-a602-f0410a3b17a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:23.136324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73115c8a-842d-473f-a602-f0410a3b17a5 admin admin] PATH_INFO: `/v3/users/d5127fddc4364123a8da57e5a309d9bd` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:23.139165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73115c8a-842d-473f-a602-f0410a3b17a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5127fddc4364123a8da57e5a309d9bd)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:23.142990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73115c8a-842d-473f-a602-f0410a3b17a5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:23.193539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ff6a0d3-b62d-4bcf-91c4-38ecad6a4951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aee3c04430664163b58310d2cad9ab03'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:23.194390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ff6a0d3-b62d-4bcf-91c4-38ecad6a4951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aee3c04430664163b58310d2cad9ab03'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:23.219455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ff6a0d3-b62d-4bcf-91c4-38ecad6a4951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aee3c04430664163b58310d2cad9ab03'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:23.220028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ff6a0d3-b62d-4bcf-91c4-38ecad6a4951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aee3c04430664163b58310d2cad9ab03'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:23.231419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ff6a0d3-b62d-4bcf-91c4-38ecad6a4951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aee3c04430664163b58310d2cad9ab03'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:23.244211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-73115c8a-842d-473f-a602-f0410a3b17a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5127fddc4364123a8da57e5a309d9bd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:23.262593 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 994/1967] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:22 2022] DELETE /identity/v3/users/aee3c04430664163b58310d2cad9ab03 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:23.267880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d79c08-7268-4c62-9082-f79ec5a3dbdb None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:23.268330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d79c08-7268-4c62-9082-f79ec5a3dbdb None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:23.268934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d79c08-7268-4c62-9082-f79ec5a3dbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:23.281862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-73115c8a-842d-473f-a602-f0410a3b17a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5127fddc4364123a8da57e5a309d9bd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:23.282990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-73115c8a-842d-473f-a602-f0410a3b17a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5127fddc4364123a8da57e5a309d9bd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:23.298478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-73115c8a-842d-473f-a602-f0410a3b17a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5127fddc4364123a8da57e5a309d9bd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:23.300931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-77d79c08-7268-4c62-9082-f79ec5a3dbdb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:23.302771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-77d79c08-7268-4c62-9082-f79ec5a3dbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:23.304701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-73115c8a-842d-473f-a602-f0410a3b17a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5127fddc4364123a8da57e5a309d9bd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:23.331777 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 974/1968] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:22 2022] DELETE /identity/v3/users/d5127fddc4364123a8da57e5a309d9bd => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:23.438821 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 995/1969] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:23.474636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73115c8a-842d-473f-a602-f0410a3b17a5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:23.479132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-73115c8a-842d-473f-a602-f0410a3b17a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:23.531528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:23.589436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73115c8a-842d-473f-a602-f0410a3b17a5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:23.594022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fd60f-d625-4bb2-bbec-71e0eb028e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:23.594921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fd60f-d625-4bb2-bbec-71e0eb028e34 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:23.594921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fd60f-d625-4bb2-bbec-71e0eb028e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:23.596115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fd60f-d625-4bb2-bbec-71e0eb028e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:23.622832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d79c08-7268-4c62-9082-f79ec5a3dbdb None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:23.625159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-77d79c08-7268-4c62-9082-f79ec5a3dbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:23.698795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fd60f-d625-4bb2-bbec-71e0eb028e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:23.700379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fd60f-d625-4bb2-bbec-71e0eb028e34 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:23.716384 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 975/1970] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:23.783788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d79c08-7268-4c62-9082-f79ec5a3dbdb None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:23.810689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:23.884909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962141ff-b125-47e1-ac40-5a1a02314f54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:23.886188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962141ff-b125-47e1-ac40-5a1a02314f54 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:23.886818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962141ff-b125-47e1-ac40-5a1a02314f54 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:23.887567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962141ff-b125-47e1-ac40-5a1a02314f54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:23.890731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-962141ff-b125-47e1-ac40-5a1a02314f54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:24.013686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962141ff-b125-47e1-ac40-5a1a02314f54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:24.015568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962141ff-b125-47e1-ac40-5a1a02314f54 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:24.038464 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 996/1971] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:23 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:24.312105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fd60f-d625-4bb2-bbec-71e0eb028e34 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:24.314295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bf7fd60f-d625-4bb2-bbec-71e0eb028e34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:24.350743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fd60f-d625-4bb2-bbec-71e0eb028e34 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:24.357102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd8f5b-6eec-48a2-9230-aca7100b652d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:24.357768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd8f5b-6eec-48a2-9230-aca7100b652d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:24.358049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd8f5b-6eec-48a2-9230-aca7100b652d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:24.359186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd8f5b-6eec-48a2-9230-aca7100b652d admin admin] PATH_INFO: `/v3/projects/6b30fb99b7ce45b3a3ffe8d88bad0a1e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:24.360685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd8f5b-6eec-48a2-9230-aca7100b652d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b30fb99b7ce45b3a3ffe8d88bad0a1e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:24.362925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd8f5b-6eec-48a2-9230-aca7100b652d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:24.445704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1dcd8f5b-6eec-48a2-9230-aca7100b652d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b30fb99b7ce45b3a3ffe8d88bad0a1e', 'request_id': 'req-1dcd8f5b-6eec-48a2-9230-aca7100b652d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:24.454226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1dcd8f5b-6eec-48a2-9230-aca7100b652d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b30fb99b7ce45b3a3ffe8d88bad0a1e', 'request_id': 'req-1dcd8f5b-6eec-48a2-9230-aca7100b652d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:24.466376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1dcd8f5b-6eec-48a2-9230-aca7100b652d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b30fb99b7ce45b3a3ffe8d88bad0a1e', 'request_id': 'req-1dcd8f5b-6eec-48a2-9230-aca7100b652d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:24.483443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1dcd8f5b-6eec-48a2-9230-aca7100b652d admin admin] The token cache is being invalidate because project 6b30fb99b7ce45b3a3ffe8d88bad0a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:24.484050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1dcd8f5b-6eec-48a2-9230-aca7100b652d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:24.485253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1dcd8f5b-6eec-48a2-9230-aca7100b652d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:24.490452 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 976/1972] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:24 2022] DELETE /identity/v3/projects/6b30fb99b7ce45b3a3ffe8d88bad0a1e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:24.493239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165f916-84ed-4bc0-839d-10e10e387ce4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:24.493538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165f916-84ed-4bc0-839d-10e10e387ce4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:24.494017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165f916-84ed-4bc0-839d-10e10e387ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:24.523370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2165f916-84ed-4bc0-839d-10e10e387ce4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:24.524778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2165f916-84ed-4bc0-839d-10e10e387ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:24.624366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd8f5b-6eec-48a2-9230-aca7100b652d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:24.626296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1dcd8f5b-6eec-48a2-9230-aca7100b652d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:24.721474 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 997/1973] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:24.728544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72bfb7-8d5d-45e1-a5aa-060351050b35 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:24.728843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72bfb7-8d5d-45e1-a5aa-060351050b35 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:24.729125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72bfb7-8d5d-45e1-a5aa-060351050b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:24.792669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ba72bfb7-8d5d-45e1-a5aa-060351050b35 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:24.795178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ba72bfb7-8d5d-45e1-a5aa-060351050b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:24.823070 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 998/1974] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:24.827271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72bfb7-8d5d-45e1-a5aa-060351050b35 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:24.840739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:24.855159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72bfb7-8d5d-45e1-a5aa-060351050b35 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:24.865330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7bc7b-69ed-4c3f-b728-0a4e304e3dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:24.866522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7bc7b-69ed-4c3f-b728-0a4e304e3dff admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:24.867244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7bc7b-69ed-4c3f-b728-0a4e304e3dff admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:24.867843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7bc7b-69ed-4c3f-b728-0a4e304e3dff admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:24.868852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7bc7b-69ed-4c3f-b728-0a4e304e3dff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:01:24.869503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7bc7b-69ed-4c3f-b728-0a4e304e3dff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:24.874576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7bc7b-69ed-4c3f-b728-0a4e304e3dff admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:24.883350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd8f5b-6eec-48a2-9230-aca7100b652d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:24.898103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eba73-135c-464b-a250-cfc8e83bd313 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:24.898806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eba73-135c-464b-a250-cfc8e83bd313 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:24.899595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eba73-135c-464b-a250-cfc8e83bd313 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:24.899873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eba73-135c-464b-a250-cfc8e83bd313 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:24.901236 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 999/1975] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:01:24.904312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f43eba73-135c-464b-a250-cfc8e83bd313 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:24.905333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7bc7b-69ed-4c3f-b728-0a4e304e3dff admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:24.928750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7bc7b-69ed-4c3f-b728-0a4e304e3dff admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:24.937691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8114d-8646-458e-9d1c-c29772bc2483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:24.938940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8114d-8646-458e-9d1c-c29772bc2483 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:24.939415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8114d-8646-458e-9d1c-c29772bc2483 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:24.940331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8114d-8646-458e-9d1c-c29772bc2483 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:24.941167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8114d-8646-458e-9d1c-c29772bc2483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:24.947009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8114d-8646-458e-9d1c-c29772bc2483 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:25.001389 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1000/1976] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:24 2022] POST /identity/v3/projects => generated 401 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:25.006469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8114d-8646-458e-9d1c-c29772bc2483 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:25.029343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eba73-135c-464b-a250-cfc8e83bd313 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:25.031229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eba73-135c-464b-a250-cfc8e83bd313 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:25.063756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:25.071102 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 977/1977] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:25.234884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8114d-8646-458e-9d1c-c29772bc2483 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:25.245683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33883e51-bdc4-45d8-ba63-e763f07461bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:25.246432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33883e51-bdc4-45d8-ba63-e763f07461bb admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:25.246784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33883e51-bdc4-45d8-ba63-e763f07461bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:25.247163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33883e51-bdc4-45d8-ba63-e763f07461bb admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:25.247986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33883e51-bdc4-45d8-ba63-e763f07461bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:25.250092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33883e51-bdc4-45d8-ba63-e763f07461bb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:25.282334 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1001/1978] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:25 2022] POST /identity/v3/users => generated 301 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:25.286757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eba73-135c-464b-a250-cfc8e83bd313 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:25.299096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eba73-135c-464b-a250-cfc8e83bd313 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:25.305612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67786d3-cb53-4a7b-bf6c-f433083ca507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:25.306544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67786d3-cb53-4a7b-bf6c-f433083ca507 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:25.306544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67786d3-cb53-4a7b-bf6c-f433083ca507 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:25.307030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67786d3-cb53-4a7b-bf6c-f433083ca507 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:25.309104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67786d3-cb53-4a7b-bf6c-f433083ca507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:25.311104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67786d3-cb53-4a7b-bf6c-f433083ca507 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:25.343963 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 978/1979] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:25.345543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33883e51-bdc4-45d8-ba63-e763f07461bb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:25.368623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33883e51-bdc4-45d8-ba63-e763f07461bb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:25.376615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b27306-344a-45f8-87ba-11d662556e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:25.377607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b27306-344a-45f8-87ba-11d662556e20 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:25.378233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b27306-344a-45f8-87ba-11d662556e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:25.378713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b27306-344a-45f8-87ba-11d662556e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:25.380254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b27306-344a-45f8-87ba-11d662556e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:25.382429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b27306-344a-45f8-87ba-11d662556e20 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:25.398069 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1002/1980] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:01:25.410750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67786d3-cb53-4a7b-bf6c-f433083ca507 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:25.428307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b27306-344a-45f8-87ba-11d662556e20 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:25.433089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67786d3-cb53-4a7b-bf6c-f433083ca507 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:25.434852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c9b27306-344a-45f8-87ba-11d662556e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:25.465298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603600c-ab27-418f-913c-9820fdaf20fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:25.466857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603600c-ab27-418f-913c-9820fdaf20fd admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:25.469349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603600c-ab27-418f-913c-9820fdaf20fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:25.469891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603600c-ab27-418f-913c-9820fdaf20fd admin admin] PATH_INFO: `/v3/projects/8413d2ad29eb484886bae680d1d1a82b/users/b2a05aa5d80844848bf57f6ca093e582/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:25.510962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b27306-344a-45f8-87ba-11d662556e20 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:25.525859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab94aa-13e5-4b0b-9d30-8e19b4c451ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:25.529005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab94aa-13e5-4b0b-9d30-8e19b4c451ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:25.529005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab94aa-13e5-4b0b-9d30-8e19b4c451ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:25.529668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab94aa-13e5-4b0b-9d30-8e19b4c451ed admin admin] PATH_INFO: `/v3/projects/abc6efebdb4849548820530eea98d05f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:25.532428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab94aa-13e5-4b0b-9d30-8e19b4c451ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=abc6efebdb4849548820530eea98d05f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:25.536868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab94aa-13e5-4b0b-9d30-8e19b4c451ed admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:25.537293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603600c-ab27-418f-913c-9820fdaf20fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8413d2ad29eb484886bae680d1d1a82b, user_id=b2a05aa5d80844848bf57f6ca093e582, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:25.546241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603600c-ab27-418f-913c-9820fdaf20fd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:25.588141 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 979/1981] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:25 2022] PUT /identity/v3/projects/8413d2ad29eb484886bae680d1d1a82b/users/b2a05aa5d80844848bf57f6ca093e582/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:25.596033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390fef5-47aa-4143-8cf6-c2a238f70cf8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:25.596325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390fef5-47aa-4143-8cf6-c2a238f70cf8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:25.596612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390fef5-47aa-4143-8cf6-c2a238f70cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:25.665912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b390fef5-47aa-4143-8cf6-c2a238f70cf8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:25.667321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b390fef5-47aa-4143-8cf6-c2a238f70cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:25.683591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9dab94aa-13e5-4b0b-9d30-8e19b4c451ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc6efebdb4849548820530eea98d05f', 'request_id': 'req-9dab94aa-13e5-4b0b-9d30-8e19b4c451ed'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:25.697375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9dab94aa-13e5-4b0b-9d30-8e19b4c451ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc6efebdb4849548820530eea98d05f', 'request_id': 'req-9dab94aa-13e5-4b0b-9d30-8e19b4c451ed'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:25.707596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9dab94aa-13e5-4b0b-9d30-8e19b4c451ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc6efebdb4849548820530eea98d05f', 'request_id': 'req-9dab94aa-13e5-4b0b-9d30-8e19b4c451ed'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:25.724859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9dab94aa-13e5-4b0b-9d30-8e19b4c451ed admin admin] The token cache is being invalidate because project abc6efebdb4849548820530eea98d05f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:25.725524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9dab94aa-13e5-4b0b-9d30-8e19b4c451ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:25.726137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9dab94aa-13e5-4b0b-9d30-8e19b4c451ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:25.728808 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1003/1982] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:25 2022] DELETE /identity/v3/projects/abc6efebdb4849548820530eea98d05f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:25.735199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18dfbe-d90c-4c06-8afc-cc6c7202722c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:25.736197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18dfbe-d90c-4c06-8afc-cc6c7202722c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:25.736197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18dfbe-d90c-4c06-8afc-cc6c7202722c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:25.773128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-dc18dfbe-d90c-4c06-8afc-cc6c7202722c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:25.774891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dc18dfbe-d90c-4c06-8afc-cc6c7202722c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:25.794026 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 980/1983] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:25.795281 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1004/1984] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:25.809748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db371634-cc41-4b2e-a50e-3d39cd95ef4e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:25.810731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db371634-cc41-4b2e-a50e-3d39cd95ef4e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:25.811071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db371634-cc41-4b2e-a50e-3d39cd95ef4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:25.836547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-db371634-cc41-4b2e-a50e-3d39cd95ef4e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:25.838044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-db371634-cc41-4b2e-a50e-3d39cd95ef4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:25.847744 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 981/1985] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:25.852663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18dfbe-d90c-4c06-8afc-cc6c7202722c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:25.861308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db371634-cc41-4b2e-a50e-3d39cd95ef4e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:25.866778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18dfbe-d90c-4c06-8afc-cc6c7202722c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:25.867865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-db371634-cc41-4b2e-a50e-3d39cd95ef4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:25.880440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e3846-da92-4f7a-bfa3-2d76cab1d105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:25.882745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e3846-da92-4f7a-bfa3-2d76cab1d105 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:25.883141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e3846-da92-4f7a-bfa3-2d76cab1d105 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:25.884532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e3846-da92-4f7a-bfa3-2d76cab1d105 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:25.885615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e3846-da92-4f7a-bfa3-2d76cab1d105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:01:25.886234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e3846-da92-4f7a-bfa3-2d76cab1d105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:25.888992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e3846-da92-4f7a-bfa3-2d76cab1d105 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:25.905733 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1005/1986] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:01:25.911440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e3846-da92-4f7a-bfa3-2d76cab1d105 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:25.927693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e3846-da92-4f7a-bfa3-2d76cab1d105 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:25.932885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90365836-1dfc-4f96-9237-8917d53fd0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:25.933541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90365836-1dfc-4f96-9237-8917d53fd0f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:25.934002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90365836-1dfc-4f96-9237-8917d53fd0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:25.934287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90365836-1dfc-4f96-9237-8917d53fd0f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:25.934967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90365836-1dfc-4f96-9237-8917d53fd0f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:25.936972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90365836-1dfc-4f96-9237-8917d53fd0f7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:25.980792 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1006/1987] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:25 2022] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:25.982297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90365836-1dfc-4f96-9237-8917d53fd0f7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:25.985665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db371634-cc41-4b2e-a50e-3d39cd95ef4e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:25.999213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:26.029691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:26.076637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90365836-1dfc-4f96-9237-8917d53fd0f7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:26.082066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b9787-5749-4616-9ec8-53b84208491b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:26.082730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b9787-5749-4616-9ec8-53b84208491b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:26.083030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b9787-5749-4616-9ec8-53b84208491b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:26.083320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b9787-5749-4616-9ec8-53b84208491b admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:26.084037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b9787-5749-4616-9ec8-53b84208491b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:26.085975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b9787-5749-4616-9ec8-53b84208491b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:26.092178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95d548-f3ac-4326-8888-62014831b9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:26.092862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95d548-f3ac-4326-8888-62014831b9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:26.093152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95d548-f3ac-4326-8888-62014831b9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:26.093423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95d548-f3ac-4326-8888-62014831b9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:26.105426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95d548-f3ac-4326-8888-62014831b9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:26.107017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95d548-f3ac-4326-8888-62014831b9f8 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:26.111352 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1007/1988] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:25 2022] POST /identity/v3/users => generated 291 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:26.111352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b9787-5749-4616-9ec8-53b84208491b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:26.114998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cb2b9787-5749-4616-9ec8-53b84208491b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:26.119067 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 982/1989] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:26.120113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95d548-f3ac-4326-8888-62014831b9f8 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:26.130827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95d548-f3ac-4326-8888-62014831b9f8 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:26.136004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f4a0e-7ffe-4662-a1c9-03657e49bcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:26.136813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f4a0e-7ffe-4662-a1c9-03657e49bcfa admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:26.137418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f4a0e-7ffe-4662-a1c9-03657e49bcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:26.138073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f4a0e-7ffe-4662-a1c9-03657e49bcfa admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:26.139030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b9787-5749-4616-9ec8-53b84208491b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:26.139157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f4a0e-7ffe-4662-a1c9-03657e49bcfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:26.141119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f4a0e-7ffe-4662-a1c9-03657e49bcfa admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:26.147983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e09e35-d633-4938-ba9c-b713c26f3c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:26.148912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e09e35-d633-4938-ba9c-b713c26f3c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:26.149886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e09e35-d633-4938-ba9c-b713c26f3c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:26.150275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e09e35-d633-4938-ba9c-b713c26f3c0b admin admin] PATH_INFO: `/v3/users/58be8ea1ebdb4317bd2da2ef8c6ddc79` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:26.152384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e09e35-d633-4938-ba9c-b713c26f3c0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=58be8ea1ebdb4317bd2da2ef8c6ddc79)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:26.154432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e09e35-d633-4938-ba9c-b713c26f3c0b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:26.154923 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 983/1990] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:26.159980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f4a0e-7ffe-4662-a1c9-03657e49bcfa admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:26.178568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f4a0e-7ffe-4662-a1c9-03657e49bcfa admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:26.190356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500d97d-8ddf-4138-87b0-5a25492073af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:26.193145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500d97d-8ddf-4138-87b0-5a25492073af admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:26.193674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500d97d-8ddf-4138-87b0-5a25492073af admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:26.194969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500d97d-8ddf-4138-87b0-5a25492073af admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:26.195962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500d97d-8ddf-4138-87b0-5a25492073af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:26.198583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500d97d-8ddf-4138-87b0-5a25492073af admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:26.219032 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 984/1991] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:26.219993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500d97d-8ddf-4138-87b0-5a25492073af admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:26.233899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500d97d-8ddf-4138-87b0-5a25492073af admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:26.238522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e5e09e35-d633-4938-ba9c-b713c26f3c0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58be8ea1ebdb4317bd2da2ef8c6ddc79'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:26.239974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e5e09e35-d633-4938-ba9c-b713c26f3c0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58be8ea1ebdb4317bd2da2ef8c6ddc79'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:26.240283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a03a9-bf25-44c9-ab49-99801b7290be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:26.241095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a03a9-bf25-44c9-ab49-99801b7290be admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:26.241385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a03a9-bf25-44c9-ab49-99801b7290be admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:26.241717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a03a9-bf25-44c9-ab49-99801b7290be admin admin] PATH_INFO: `/v3/projects/32746695eeb9487a94bf759ac613da59/users/966cb451debd4586864e543000824981/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:26.263407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e5e09e35-d633-4938-ba9c-b713c26f3c0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58be8ea1ebdb4317bd2da2ef8c6ddc79'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:26.263652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a03a9-bf25-44c9-ab49-99801b7290be admin admin] RBAC: Authorizing `identity:create_grant(project_id=32746695eeb9487a94bf759ac613da59, user_id=966cb451debd4586864e543000824981, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:26.264568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e5e09e35-d633-4938-ba9c-b713c26f3c0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58be8ea1ebdb4317bd2da2ef8c6ddc79'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:26.266399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a03a9-bf25-44c9-ab49-99801b7290be admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:26.276725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e5e09e35-d633-4938-ba9c-b713c26f3c0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58be8ea1ebdb4317bd2da2ef8c6ddc79'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:26.295588 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 985/1992] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:26 2022] PUT /identity/v3/projects/32746695eeb9487a94bf759ac613da59/users/966cb451debd4586864e543000824981/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:26.297317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b334001-df6b-4bbb-b86f-f563251843bd None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:26.297793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b334001-df6b-4bbb-b86f-f563251843bd None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:26.298254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b334001-df6b-4bbb-b86f-f563251843bd None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:26.300110 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 986/1993] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:01:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:01:26.302119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd84970-6b05-4998-920f-48d2bb142521 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:26.302598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd84970-6b05-4998-920f-48d2bb142521 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:26.303197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd84970-6b05-4998-920f-48d2bb142521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:26.308483 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1008/1994] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:26 2022] DELETE /identity/v3/users/58be8ea1ebdb4317bd2da2ef8c6ddc79 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:26.310489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214b1e1-f307-4ada-9357-15f174e68759 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:26.310846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214b1e1-f307-4ada-9357-15f174e68759 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:26.311240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214b1e1-f307-4ada-9357-15f174e68759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:26.336574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a214b1e1-f307-4ada-9357-15f174e68759 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:26.337983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a214b1e1-f307-4ada-9357-15f174e68759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:26.339492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bbd84970-6b05-4998-920f-48d2bb142521 None None] MFA Rules not processed for user `966cb451debd4586864e543000824981`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:26.340889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bbd84970-6b05-4998-920f-48d2bb142521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:26.416915 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1009/1995] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:26.418485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a90ac-5de0-4aea-ae40-48a70131f956 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:26.418776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a90ac-5de0-4aea-ae40-48a70131f956 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:26.419082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a90ac-5de0-4aea-ae40-48a70131f956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:26.446254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-616a90ac-5de0-4aea-ae40-48a70131f956 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:26.456382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-616a90ac-5de0-4aea-ae40-48a70131f956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:26.460207 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 987/1996] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:26.460962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd84970-6b05-4998-920f-48d2bb142521 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:26.465043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bbd84970-6b05-4998-920f-48d2bb142521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:26.531262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:26.535773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd84970-6b05-4998-920f-48d2bb142521 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:26.556058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e295c5-dc32-4a79-9caf-76933003a5d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:26.560656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e295c5-dc32-4a79-9caf-76933003a5d1 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:26.560953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e295c5-dc32-4a79-9caf-76933003a5d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:26.561316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e295c5-dc32-4a79-9caf-76933003a5d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:26.593584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e295c5-dc32-4a79-9caf-76933003a5d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:26.595341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e295c5-dc32-4a79-9caf-76933003a5d1 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:26.602812 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1010/1997] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:01:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:26.603816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a90ac-5de0-4aea-ae40-48a70131f956 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:26.605392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-616a90ac-5de0-4aea-ae40-48a70131f956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:26.608325 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 988/1998] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:26.609898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e295c5-dc32-4a79-9caf-76933003a5d1 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:26.611490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-88e295c5-dc32-4a79-9caf-76933003a5d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:26.632019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:26.638117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e295c5-dc32-4a79-9caf-76933003a5d1 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:26.641656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a90ac-5de0-4aea-ae40-48a70131f956 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:26.644825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17245d1d-6386-47e3-840b-8d992ab705b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:26.645635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17245d1d-6386-47e3-840b-8d992ab705b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:26.646190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17245d1d-6386-47e3-840b-8d992ab705b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:26.646567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17245d1d-6386-47e3-840b-8d992ab705b0 admin admin] PATH_INFO: `/v3/users/df90dd2310f44c4b9b80bbb897a2ea1e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:26.648707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17245d1d-6386-47e3-840b-8d992ab705b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df90dd2310f44c4b9b80bbb897a2ea1e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:26.651370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17245d1d-6386-47e3-840b-8d992ab705b0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:26.657230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da945a1a-f66f-411a-bd07-dbdf08af8fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:26.659676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da945a1a-f66f-411a-bd07-dbdf08af8fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:26.660068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da945a1a-f66f-411a-bd07-dbdf08af8fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:26.660992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da945a1a-f66f-411a-bd07-dbdf08af8fc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:26.662115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da945a1a-f66f-411a-bd07-dbdf08af8fc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:26.664506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da945a1a-f66f-411a-bd07-dbdf08af8fc0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:26.715129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-17245d1d-6386-47e3-840b-8d992ab705b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df90dd2310f44c4b9b80bbb897a2ea1e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:26.732451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-17245d1d-6386-47e3-840b-8d992ab705b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df90dd2310f44c4b9b80bbb897a2ea1e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:26.733743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-17245d1d-6386-47e3-840b-8d992ab705b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df90dd2310f44c4b9b80bbb897a2ea1e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:26.747709 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1011/1999] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:26 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:26.749557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da945a1a-f66f-411a-bd07-dbdf08af8fc0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:26.752931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-17245d1d-6386-47e3-840b-8d992ab705b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df90dd2310f44c4b9b80bbb897a2ea1e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:26.753871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-17245d1d-6386-47e3-840b-8d992ab705b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df90dd2310f44c4b9b80bbb897a2ea1e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:26.755405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-da945a1a-f66f-411a-bd07-dbdf08af8fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:26.779586 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 989/2000] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:26 2022] DELETE /identity/v3/users/df90dd2310f44c4b9b80bbb897a2ea1e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:26.779586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17245d1d-6386-47e3-840b-8d992ab705b0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:26.782457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-17245d1d-6386-47e3-840b-8d992ab705b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:26.902259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da945a1a-f66f-411a-bd07-dbdf08af8fc0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:26.953906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17245d1d-6386-47e3-840b-8d992ab705b0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:26.971178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9a212-e27e-43ab-80fd-ee785b408a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:26.973900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9a212-e27e-43ab-80fd-ee785b408a5d admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:26.974209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9a212-e27e-43ab-80fd-ee785b408a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:26.974497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9a212-e27e-43ab-80fd-ee785b408a5d admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:26.976562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9a212-e27e-43ab-80fd-ee785b408a5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:26.983264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9a212-e27e-43ab-80fd-ee785b408a5d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:27.024414 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 990/2001] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:26 2022] POST /identity/v3/users => generated 298 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:27.028303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9a212-e27e-43ab-80fd-ee785b408a5d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:27.029328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ec5ce-443c-4d8d-9ec4-5d7ffbac8920 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:27.029973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ec5ce-443c-4d8d-9ec4-5d7ffbac8920 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:27.030252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ec5ce-443c-4d8d-9ec4-5d7ffbac8920 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:27.030530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ec5ce-443c-4d8d-9ec4-5d7ffbac8920 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:27.037469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ed9ec5ce-443c-4d8d-9ec4-5d7ffbac8920 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:27.059264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9a212-e27e-43ab-80fd-ee785b408a5d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:27.061858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ec5ce-443c-4d8d-9ec4-5d7ffbac8920 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:27.067110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31229db1-b494-427e-b326-0dcf8beba527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:27.068047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31229db1-b494-427e-b326-0dcf8beba527 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:27.068513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31229db1-b494-427e-b326-0dcf8beba527 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:27.068996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31229db1-b494-427e-b326-0dcf8beba527 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:27.069884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31229db1-b494-427e-b326-0dcf8beba527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:27.072792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31229db1-b494-427e-b326-0dcf8beba527 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:27.083621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ec5ce-443c-4d8d-9ec4-5d7ffbac8920 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:27.100708 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 991/2002] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:27.106614 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1012/2003] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:27.107846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31229db1-b494-427e-b326-0dcf8beba527 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:27.119154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31229db1-b494-427e-b326-0dcf8beba527 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:27.125961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943abffc-4cb2-4623-9246-46513a48e392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:27.128259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943abffc-4cb2-4623-9246-46513a48e392 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:27.128628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943abffc-4cb2-4623-9246-46513a48e392 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:27.129380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943abffc-4cb2-4623-9246-46513a48e392 admin admin] PATH_INFO: `/v3/projects/0be7f2948db342d3868a273f82ca700b/users/8e03f7b6f3f5430d8dee2f84a1a559c9/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:27.149227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943abffc-4cb2-4623-9246-46513a48e392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be7f2948db342d3868a273f82ca700b, user_id=8e03f7b6f3f5430d8dee2f84a1a559c9, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:27.153257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943abffc-4cb2-4623-9246-46513a48e392 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:27.174857 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 992/2004] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:27 2022] PUT /identity/v3/projects/0be7f2948db342d3868a273f82ca700b/users/8e03f7b6f3f5430d8dee2f84a1a559c9/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:27.176844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ec5ce-443c-4d8d-9ec4-5d7ffbac8920 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:27.194263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ec5ce-443c-4d8d-9ec4-5d7ffbac8920 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:27.256491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:27.282615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732764a-5182-4852-99a4-fa6aa7b8fd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:27.283151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732764a-5182-4852-99a4-fa6aa7b8fd1b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:27.283414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732764a-5182-4852-99a4-fa6aa7b8fd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:27.283703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732764a-5182-4852-99a4-fa6aa7b8fd1b admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:27.284397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732764a-5182-4852-99a4-fa6aa7b8fd1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:27.286051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732764a-5182-4852-99a4-fa6aa7b8fd1b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:27.304272 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1013/2005] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:27.304835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943abffc-4cb2-4623-9246-46513a48e392 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:27.316348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943abffc-4cb2-4623-9246-46513a48e392 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:27.321909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2e948-1fe8-4d99-99b2-f5700c62dbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:27.322703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2e948-1fe8-4d99-99b2-f5700c62dbff admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:27.322866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2e948-1fe8-4d99-99b2-f5700c62dbff admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:27.323399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2e948-1fe8-4d99-99b2-f5700c62dbff admin admin] PATH_INFO: `/v3/projects/0be7f2948db342d3868a273f82ca700b/users/8e03f7b6f3f5430d8dee2f84a1a559c9/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:27.325269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2e948-1fe8-4d99-99b2-f5700c62dbff admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be7f2948db342d3868a273f82ca700b, user_id=8e03f7b6f3f5430d8dee2f84a1a559c9, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:27.327993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2e948-1fe8-4d99-99b2-f5700c62dbff admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:27.342346 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 993/2006] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:27 2022] PUT /identity/v3/projects/0be7f2948db342d3868a273f82ca700b/users/8e03f7b6f3f5430d8dee2f84a1a559c9/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:01:27.353107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfb253-2b9f-4c02-8656-1b6536e43039 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:27.353690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfb253-2b9f-4c02-8656-1b6536e43039 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:27.354324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfb253-2b9f-4c02-8656-1b6536e43039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:27.394603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-abcfb253-2b9f-4c02-8656-1b6536e43039 None None] MFA Rules not processed for user `8e03f7b6f3f5430d8dee2f84a1a559c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:27.396217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-abcfb253-2b9f-4c02-8656-1b6536e43039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:27.559912 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1014/2007] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:27.652445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2e948-1fe8-4d99-99b2-f5700c62dbff admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:27.654953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c7d2e948-1fe8-4d99-99b2-f5700c62dbff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:27.698512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:27.833131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2e948-1fe8-4d99-99b2-f5700c62dbff admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:27.844409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788848d-f074-4cc5-ad57-6268804a7a99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:27.845326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788848d-f074-4cc5-ad57-6268804a7a99 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:27.845617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788848d-f074-4cc5-ad57-6268804a7a99 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:27.845946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788848d-f074-4cc5-ad57-6268804a7a99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:27.849059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b788848d-f074-4cc5-ad57-6268804a7a99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:27.960766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788848d-f074-4cc5-ad57-6268804a7a99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:27.963717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788848d-f074-4cc5-ad57-6268804a7a99 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:27.991566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfb253-2b9f-4c02-8656-1b6536e43039 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:27.992434 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 994/2008] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:01:27.996330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-abcfb253-2b9f-4c02-8656-1b6536e43039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:28.024495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788848d-f074-4cc5-ad57-6268804a7a99 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:28.240551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfb253-2b9f-4c02-8656-1b6536e43039 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:28.247083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788848d-f074-4cc5-ad57-6268804a7a99 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:28.259008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd59ce-05ff-40af-8a12-1c77e706167a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:28.263771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd59ce-05ff-40af-8a12-1c77e706167a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:28.264097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd59ce-05ff-40af-8a12-1c77e706167a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:28.266973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd59ce-05ff-40af-8a12-1c77e706167a admin admin] PATH_INFO: `/v3/projects/ecb96d24370c4d089b55465608aa89ca` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:28.268772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd59ce-05ff-40af-8a12-1c77e706167a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb96d24370c4d089b55465608aa89ca)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:28.282526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc1248-2dc0-4192-ae9c-9483d297b2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:28.288072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc1248-2dc0-4192-ae9c-9483d297b2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:28.288399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc1248-2dc0-4192-ae9c-9483d297b2de admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:28.288713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc1248-2dc0-4192-ae9c-9483d297b2de admin admin] PATH_INFO: `/v3/users/966cb451debd4586864e543000824981` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:28.290452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd59ce-05ff-40af-8a12-1c77e706167a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:28.292340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc1248-2dc0-4192-ae9c-9483d297b2de admin admin] RBAC: Authorizing `identity:delete_user(user_id=966cb451debd4586864e543000824981)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:28.297596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc1248-2dc0-4192-ae9c-9483d297b2de admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:28.401033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-54fc1248-2dc0-4192-ae9c-9483d297b2de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966cb451debd4586864e543000824981'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:28.401258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-eadd59ce-05ff-40af-8a12-1c77e706167a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb96d24370c4d089b55465608aa89ca', 'request_id': 'req-eadd59ce-05ff-40af-8a12-1c77e706167a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:28.412579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-eadd59ce-05ff-40af-8a12-1c77e706167a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb96d24370c4d089b55465608aa89ca', 'request_id': 'req-eadd59ce-05ff-40af-8a12-1c77e706167a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:28.416525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:28.425346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-eadd59ce-05ff-40af-8a12-1c77e706167a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb96d24370c4d089b55465608aa89ca', 'request_id': 'req-eadd59ce-05ff-40af-8a12-1c77e706167a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:28.428087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:28.451260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-eadd59ce-05ff-40af-8a12-1c77e706167a admin admin] The token cache is being invalidate because project ecb96d24370c4d089b55465608aa89ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:28.451608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-eadd59ce-05ff-40af-8a12-1c77e706167a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:28.452352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-eadd59ce-05ff-40af-8a12-1c77e706167a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:28.454036 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1015/2009] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:27 2022] DELETE /identity/v3/projects/ecb96d24370c4d089b55465608aa89ca => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:28.456463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd59ce-05ff-40af-8a12-1c77e706167a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:28.461214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-54fc1248-2dc0-4192-ae9c-9483d297b2de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966cb451debd4586864e543000824981'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:28.462030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-eadd59ce-05ff-40af-8a12-1c77e706167a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:28.462402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-54fc1248-2dc0-4192-ae9c-9483d297b2de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966cb451debd4586864e543000824981'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:28.478744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-54fc1248-2dc0-4192-ae9c-9483d297b2de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966cb451debd4586864e543000824981'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:28.481682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-54fc1248-2dc0-4192-ae9c-9483d297b2de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966cb451debd4586864e543000824981'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:28.530258 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 995/2010] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:28 2022] DELETE /identity/v3/users/966cb451debd4586864e543000824981 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:28.532210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc1248-2dc0-4192-ae9c-9483d297b2de admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:28.534464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-54fc1248-2dc0-4192-ae9c-9483d297b2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:28.563302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd59ce-05ff-40af-8a12-1c77e706167a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:28.651141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc1248-2dc0-4192-ae9c-9483d297b2de admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:28.659934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050cdeb-784b-447a-8a77-899d83db8a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:28.660720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050cdeb-784b-447a-8a77-899d83db8a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:28.660978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050cdeb-784b-447a-8a77-899d83db8a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:28.661669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050cdeb-784b-447a-8a77-899d83db8a8b admin admin] PATH_INFO: `/v3/users/dd9dab47e195457e8506a71a7a2aa913` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:28.663078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050cdeb-784b-447a-8a77-899d83db8a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd9dab47e195457e8506a71a7a2aa913)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:28.665197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050cdeb-784b-447a-8a77-899d83db8a8b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:28.670882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf42107-18c0-4e72-b61b-c8e3c2f6088d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:28.671616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf42107-18c0-4e72-b61b-c8e3c2f6088d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:28.672055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf42107-18c0-4e72-b61b-c8e3c2f6088d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:28.672342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf42107-18c0-4e72-b61b-c8e3c2f6088d admin admin] PATH_INFO: `/v3/projects/9ff369bca42e476ea62555a278e6c39e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:28.674780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf42107-18c0-4e72-b61b-c8e3c2f6088d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ff369bca42e476ea62555a278e6c39e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:28.679173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf42107-18c0-4e72-b61b-c8e3c2f6088d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:28.734114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6050cdeb-784b-447a-8a77-899d83db8a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd9dab47e195457e8506a71a7a2aa913'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:28.752132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6050cdeb-784b-447a-8a77-899d83db8a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd9dab47e195457e8506a71a7a2aa913'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:28.752911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6050cdeb-784b-447a-8a77-899d83db8a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd9dab47e195457e8506a71a7a2aa913'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:28.762244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6050cdeb-784b-447a-8a77-899d83db8a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd9dab47e195457e8506a71a7a2aa913'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:28.763013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6050cdeb-784b-447a-8a77-899d83db8a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd9dab47e195457e8506a71a7a2aa913'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:28.763887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ccf42107-18c0-4e72-b61b-c8e3c2f6088d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ff369bca42e476ea62555a278e6c39e', 'request_id': 'req-ccf42107-18c0-4e72-b61b-c8e3c2f6088d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:28.778806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ccf42107-18c0-4e72-b61b-c8e3c2f6088d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ff369bca42e476ea62555a278e6c39e', 'request_id': 'req-ccf42107-18c0-4e72-b61b-c8e3c2f6088d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:28.782026 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 996/2011] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:28 2022] DELETE /identity/v3/users/dd9dab47e195457e8506a71a7a2aa913 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:28.785178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521056c3-fe8f-487d-9a3d-287a2f8a9def None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:28.785178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521056c3-fe8f-487d-9a3d-287a2f8a9def None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:28.785178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521056c3-fe8f-487d-9a3d-287a2f8a9def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:28.796746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ccf42107-18c0-4e72-b61b-c8e3c2f6088d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ff369bca42e476ea62555a278e6c39e', 'request_id': 'req-ccf42107-18c0-4e72-b61b-c8e3c2f6088d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:28.812054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-521056c3-fe8f-487d-9a3d-287a2f8a9def None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:28.814334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-521056c3-fe8f-487d-9a3d-287a2f8a9def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:28.830283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ccf42107-18c0-4e72-b61b-c8e3c2f6088d admin admin] The token cache is being invalidate because project 9ff369bca42e476ea62555a278e6c39e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:28.830606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ccf42107-18c0-4e72-b61b-c8e3c2f6088d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:28.833051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ccf42107-18c0-4e72-b61b-c8e3c2f6088d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:28.836324 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1016/2012] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:28 2022] DELETE /identity/v3/projects/9ff369bca42e476ea62555a278e6c39e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:28.840887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf42107-18c0-4e72-b61b-c8e3c2f6088d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:28.842838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ccf42107-18c0-4e72-b61b-c8e3c2f6088d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:28.894134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:28.922981 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 997/2013] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:28.944794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521056c3-fe8f-487d-9a3d-287a2f8a9def None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:28.946551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-521056c3-fe8f-487d-9a3d-287a2f8a9def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:28.993970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:29.049946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf42107-18c0-4e72-b61b-c8e3c2f6088d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:29.056862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0191abf-e04b-45b5-96ad-f77f85505679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:29.057691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191abf-e04b-45b5-96ad-f77f85505679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:29.057979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191abf-e04b-45b5-96ad-f77f85505679 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:29.058328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191abf-e04b-45b5-96ad-f77f85505679 admin admin] PATH_INFO: `/v3/users/27ce06337525440b95c319af204809d1` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:29.059576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0191abf-e04b-45b5-96ad-f77f85505679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ce06337525440b95c319af204809d1)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:29.061590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0191abf-e04b-45b5-96ad-f77f85505679 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:29.068033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521056c3-fe8f-487d-9a3d-287a2f8a9def None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:29.072888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f514cb0-75eb-454e-b9b4-f843f6d38b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:29.073375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f514cb0-75eb-454e-b9b4-f843f6d38b44 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:29.073667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f514cb0-75eb-454e-b9b4-f843f6d38b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:29.073965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f514cb0-75eb-454e-b9b4-f843f6d38b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:29.084504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f514cb0-75eb-454e-b9b4-f843f6d38b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:29.085967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f514cb0-75eb-454e-b9b4-f843f6d38b44 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:29.097086 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 998/2014] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:01:29.136386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d0191abf-e04b-45b5-96ad-f77f85505679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ce06337525440b95c319af204809d1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:29.138240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d0191abf-e04b-45b5-96ad-f77f85505679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ce06337525440b95c319af204809d1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:29.171864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d0191abf-e04b-45b5-96ad-f77f85505679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ce06337525440b95c319af204809d1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:29.173011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d0191abf-e04b-45b5-96ad-f77f85505679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ce06337525440b95c319af204809d1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:29.193395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d0191abf-e04b-45b5-96ad-f77f85505679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ce06337525440b95c319af204809d1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:29.227496 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1017/2015] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:28 2022] DELETE /identity/v3/users/27ce06337525440b95c319af204809d1 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:29.488072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f514cb0-75eb-454e-b9b4-f843f6d38b44 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:29.489815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8f514cb0-75eb-454e-b9b4-f843f6d38b44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:29.533772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f514cb0-75eb-454e-b9b4-f843f6d38b44 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:29.738416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9070563-e7bd-45d3-bcf4-17b8d86676e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:29.747097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9070563-e7bd-45d3-bcf4-17b8d86676e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:29.747487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9070563-e7bd-45d3-bcf4-17b8d86676e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:29.748039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9070563-e7bd-45d3-bcf4-17b8d86676e6 admin admin] PATH_INFO: `/v3/projects/0f3b364fece44c149bd44364b36602cd` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:29.750960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9070563-e7bd-45d3-bcf4-17b8d86676e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f3b364fece44c149bd44364b36602cd)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:29.754538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9070563-e7bd-45d3-bcf4-17b8d86676e6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:29.873670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b9070563-e7bd-45d3-bcf4-17b8d86676e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f3b364fece44c149bd44364b36602cd', 'request_id': 'req-b9070563-e7bd-45d3-bcf4-17b8d86676e6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:29.883321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b9070563-e7bd-45d3-bcf4-17b8d86676e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f3b364fece44c149bd44364b36602cd', 'request_id': 'req-b9070563-e7bd-45d3-bcf4-17b8d86676e6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:29.903936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0191abf-e04b-45b5-96ad-f77f85505679 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:29.906377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d0191abf-e04b-45b5-96ad-f77f85505679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:29.912784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b9070563-e7bd-45d3-bcf4-17b8d86676e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f3b364fece44c149bd44364b36602cd', 'request_id': 'req-b9070563-e7bd-45d3-bcf4-17b8d86676e6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:29.937481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0191abf-e04b-45b5-96ad-f77f85505679 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:29.939715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b9070563-e7bd-45d3-bcf4-17b8d86676e6 admin admin] The token cache is being invalidate because project 0f3b364fece44c149bd44364b36602cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:29.940172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b9070563-e7bd-45d3-bcf4-17b8d86676e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:29.941407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b9070563-e7bd-45d3-bcf4-17b8d86676e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:29.947677 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 999/2016] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:29 2022] DELETE /identity/v3/projects/0f3b364fece44c149bd44364b36602cd => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:29.953998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bb1df-9585-4417-9956-0f11b22513a7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:29.955217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bb1df-9585-4417-9956-0f11b22513a7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:29.955761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bb1df-9585-4417-9956-0f11b22513a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:30.015625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8e8bb1df-9585-4417-9956-0f11b22513a7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:30.016925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8e8bb1df-9585-4417-9956-0f11b22513a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:30.082128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:30.084928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d07e9-e20b-4878-96b2-2c3caa5b8337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:30.085838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d07e9-e20b-4878-96b2-2c3caa5b8337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:30.086196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d07e9-e20b-4878-96b2-2c3caa5b8337 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:30.086547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d07e9-e20b-4878-96b2-2c3caa5b8337 admin admin] PATH_INFO: `/v3/projects/32746695eeb9487a94bf759ac613da59` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:30.088203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d07e9-e20b-4878-96b2-2c3caa5b8337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32746695eeb9487a94bf759ac613da59)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:30.090448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d07e9-e20b-4878-96b2-2c3caa5b8337 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:30.192268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7e8d07e9-e20b-4878-96b2-2c3caa5b8337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32746695eeb9487a94bf759ac613da59', 'request_id': 'req-7e8d07e9-e20b-4878-96b2-2c3caa5b8337'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:30.202529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:30.214856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7e8d07e9-e20b-4878-96b2-2c3caa5b8337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32746695eeb9487a94bf759ac613da59', 'request_id': 'req-7e8d07e9-e20b-4878-96b2-2c3caa5b8337'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:30.234380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7e8d07e9-e20b-4878-96b2-2c3caa5b8337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32746695eeb9487a94bf759ac613da59', 'request_id': 'req-7e8d07e9-e20b-4878-96b2-2c3caa5b8337'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:30.241905 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1000/2017] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:01:30.241905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bb1df-9585-4417-9956-0f11b22513a7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:30.248125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8e8bb1df-9585-4417-9956-0f11b22513a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:30.290451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7e8d07e9-e20b-4878-96b2-2c3caa5b8337 admin admin] The token cache is being invalidate because project 32746695eeb9487a94bf759ac613da59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:30.290750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7e8d07e9-e20b-4878-96b2-2c3caa5b8337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:30.291460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7e8d07e9-e20b-4878-96b2-2c3caa5b8337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:30.292593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bb1df-9585-4417-9956-0f11b22513a7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:30.293292 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1018/2018] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:29 2022] DELETE /identity/v3/projects/32746695eeb9487a94bf759ac613da59 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:30.294555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486130f9-67a8-4ea2-b14d-7dbfe1cf2975 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:30.294843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486130f9-67a8-4ea2-b14d-7dbfe1cf2975 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:30.295120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486130f9-67a8-4ea2-b14d-7dbfe1cf2975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:30.338464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-486130f9-67a8-4ea2-b14d-7dbfe1cf2975 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:30.345137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-486130f9-67a8-4ea2-b14d-7dbfe1cf2975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:30.454135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68307ddc-5080-4584-a591-de78616028bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:30.456016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68307ddc-5080-4584-a591-de78616028bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:30.456502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68307ddc-5080-4584-a591-de78616028bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:30.456999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68307ddc-5080-4584-a591-de78616028bf admin admin] PATH_INFO: `/v3/projects/04d65c13ce1f471996088f484f2fe8f7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:30.459047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68307ddc-5080-4584-a591-de78616028bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d65c13ce1f471996088f484f2fe8f7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:30.462540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68307ddc-5080-4584-a591-de78616028bf admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:30.467118 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1019/2019] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:30.467118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486130f9-67a8-4ea2-b14d-7dbfe1cf2975 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:30.467118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-486130f9-67a8-4ea2-b14d-7dbfe1cf2975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:30.485860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486130f9-67a8-4ea2-b14d-7dbfe1cf2975 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:30.491702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621dd11-7fde-4d24-9976-80cdc9093b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:30.492471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621dd11-7fde-4d24-9976-80cdc9093b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:30.492835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621dd11-7fde-4d24-9976-80cdc9093b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:30.493306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621dd11-7fde-4d24-9976-80cdc9093b62 admin admin] PATH_INFO: `/v3/users/8e03f7b6f3f5430d8dee2f84a1a559c9` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:30.495483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621dd11-7fde-4d24-9976-80cdc9093b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e03f7b6f3f5430d8dee2f84a1a559c9)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:30.498684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621dd11-7fde-4d24-9976-80cdc9093b62 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:30.552335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-68307ddc-5080-4584-a591-de78616028bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d65c13ce1f471996088f484f2fe8f7', 'request_id': 'req-68307ddc-5080-4584-a591-de78616028bf'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:30.565345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-68307ddc-5080-4584-a591-de78616028bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d65c13ce1f471996088f484f2fe8f7', 'request_id': 'req-68307ddc-5080-4584-a591-de78616028bf'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:30.580678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-68307ddc-5080-4584-a591-de78616028bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d65c13ce1f471996088f484f2fe8f7', 'request_id': 'req-68307ddc-5080-4584-a591-de78616028bf'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:30.603150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-68307ddc-5080-4584-a591-de78616028bf admin admin] The token cache is being invalidate because project 04d65c13ce1f471996088f484f2fe8f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:30.603654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-68307ddc-5080-4584-a591-de78616028bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:30.605403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-68307ddc-5080-4584-a591-de78616028bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:30.607483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0621dd11-7fde-4d24-9976-80cdc9093b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e03f7b6f3f5430d8dee2f84a1a559c9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:30.607877 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1001/2020] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:30 2022] DELETE /identity/v3/projects/04d65c13ce1f471996088f484f2fe8f7 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:30.609478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68307ddc-5080-4584-a591-de78616028bf admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:30.611165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-68307ddc-5080-4584-a591-de78616028bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:30.611583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0621dd11-7fde-4d24-9976-80cdc9093b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e03f7b6f3f5430d8dee2f84a1a559c9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:30.654017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0621dd11-7fde-4d24-9976-80cdc9093b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e03f7b6f3f5430d8dee2f84a1a559c9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:30.655084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0621dd11-7fde-4d24-9976-80cdc9093b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e03f7b6f3f5430d8dee2f84a1a559c9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:30.685219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0621dd11-7fde-4d24-9976-80cdc9093b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e03f7b6f3f5430d8dee2f84a1a559c9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:30.725397 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1020/2021] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:30 2022] DELETE /identity/v3/users/8e03f7b6f3f5430d8dee2f84a1a559c9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:30.725397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cb3fc-a530-4d66-9be0-7d56292fe15d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:30.725397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cb3fc-a530-4d66-9be0-7d56292fe15d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:30.725397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cb3fc-a530-4d66-9be0-7d56292fe15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:30.755562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:30.771346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68307ddc-5080-4584-a591-de78616028bf admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:30.777299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ad3cb3fc-a530-4d66-9be0-7d56292fe15d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:30.779512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ad3cb3fc-a530-4d66-9be0-7d56292fe15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:30.883209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:30.909012 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1021/2022] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:30.917655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50b838-4d54-456b-ae32-055447ec750a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:30.918221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50b838-4d54-456b-ae32-055447ec750a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:30.918680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50b838-4d54-456b-ae32-055447ec750a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:30.933953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e3fb6-adb8-434b-9024-9bc2018abb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:30.934950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e3fb6-adb8-434b-9024-9bc2018abb5c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:30.935968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e3fb6-adb8-434b-9024-9bc2018abb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:30.936281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e3fb6-adb8-434b-9024-9bc2018abb5c admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:30.937283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e3fb6-adb8-434b-9024-9bc2018abb5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:01:30.937655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e3fb6-adb8-434b-9024-9bc2018abb5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:30.940692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e3fb6-adb8-434b-9024-9bc2018abb5c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:30.966661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7f50b838-4d54-456b-ae32-055447ec750a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:30.967955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7f50b838-4d54-456b-ae32-055447ec750a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:30.974590 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1002/2023] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:01:30.979253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e3fb6-adb8-434b-9024-9bc2018abb5c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:30.981735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-411e3fb6-adb8-434b-9024-9bc2018abb5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:30.999711 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1022/2024] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:31.000935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50b838-4d54-456b-ae32-055447ec750a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:31.010975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e3fb6-adb8-434b-9024-9bc2018abb5c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:31.014482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ba597-cbaa-4b85-be12-f976ee65b1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:31.015685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba597-cbaa-4b85-be12-f976ee65b1db admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:31.016073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba597-cbaa-4b85-be12-f976ee65b1db admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:31.016477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba597-cbaa-4b85-be12-f976ee65b1db admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:31.018220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ba597-cbaa-4b85-be12-f976ee65b1db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:31.022099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ba597-cbaa-4b85-be12-f976ee65b1db admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:31.022923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50b838-4d54-456b-ae32-055447ec750a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:31.028131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e507d-1f7f-4f9b-985e-97dd3e16a3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:31.029079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e507d-1f7f-4f9b-985e-97dd3e16a3bd admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:31.029596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e507d-1f7f-4f9b-985e-97dd3e16a3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:31.030083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e507d-1f7f-4f9b-985e-97dd3e16a3bd admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:31.031029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e507d-1f7f-4f9b-985e-97dd3e16a3bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:01:31.031596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e507d-1f7f-4f9b-985e-97dd3e16a3bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:31.033737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e507d-1f7f-4f9b-985e-97dd3e16a3bd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:31.049976 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1023/2025] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:01:31.054860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e507d-1f7f-4f9b-985e-97dd3e16a3bd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:31.069909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e507d-1f7f-4f9b-985e-97dd3e16a3bd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:31.076685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a814c-e91a-499e-b770-9c03c51d0a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:31.077816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a814c-e91a-499e-b770-9c03c51d0a1f admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:31.078114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a814c-e91a-499e-b770-9c03c51d0a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:31.082807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a814c-e91a-499e-b770-9c03c51d0a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:31.082981 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1003/2026] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:30 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:31.083207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a814c-e91a-499e-b770-9c03c51d0a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:31.084051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a814c-e91a-499e-b770-9c03c51d0a1f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:31.085169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ba597-cbaa-4b85-be12-f976ee65b1db admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:31.140059 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1024/2027] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:31 2022] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:31.145435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a814c-e91a-499e-b770-9c03c51d0a1f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:31.262665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a814c-e91a-499e-b770-9c03c51d0a1f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:31.274623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c7aab-ae66-4b9e-a794-81b223c7938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:31.275268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c7aab-ae66-4b9e-a794-81b223c7938c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:31.276024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c7aab-ae66-4b9e-a794-81b223c7938c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:31.276024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c7aab-ae66-4b9e-a794-81b223c7938c admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:31.276521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c7aab-ae66-4b9e-a794-81b223c7938c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:31.280825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c7aab-ae66-4b9e-a794-81b223c7938c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:31.293941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ba597-cbaa-4b85-be12-f976ee65b1db admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:31.305221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff0f87-ec34-4abe-aed0-2ac81a07234c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:31.305874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff0f87-ec34-4abe-aed0-2ac81a07234c admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:31.306161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff0f87-ec34-4abe-aed0-2ac81a07234c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:31.306440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff0f87-ec34-4abe-aed0-2ac81a07234c admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:31.307383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff0f87-ec34-4abe-aed0-2ac81a07234c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:31.323075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff0f87-ec34-4abe-aed0-2ac81a07234c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:31.353650 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1025/2028] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:31 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:31.358527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c7aab-ae66-4b9e-a794-81b223c7938c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:31.387317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c7aab-ae66-4b9e-a794-81b223c7938c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:31.395403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f8f26-8c21-40e0-8a73-7ca53a569d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:31.396287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f8f26-8c21-40e0-8a73-7ca53a569d89 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:31.396807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f8f26-8c21-40e0-8a73-7ca53a569d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:31.397294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f8f26-8c21-40e0-8a73-7ca53a569d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:31.398375 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1004/2029] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:31 2022] POST /identity/v3/users => generated 291 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:31.398724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f8f26-8c21-40e0-8a73-7ca53a569d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:31.400983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f8f26-8c21-40e0-8a73-7ca53a569d89 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:31.405987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff0f87-ec34-4abe-aed0-2ac81a07234c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:31.418183 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1026/2030] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:31.422271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f8f26-8c21-40e0-8a73-7ca53a569d89 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:31.443394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff0f87-ec34-4abe-aed0-2ac81a07234c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:31.444516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f8f26-8c21-40e0-8a73-7ca53a569d89 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:31.453505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fce510-4ff4-4e9f-975c-cd63258cf0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:31.454557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fce510-4ff4-4e9f-975c-cd63258cf0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:31.455545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f6f81-a240-439a-b2aa-8409b0552fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:31.456353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f6f81-a240-439a-b2aa-8409b0552fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:31.456648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f6f81-a240-439a-b2aa-8409b0552fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:31.456975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fce510-4ff4-4e9f-975c-cd63258cf0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:31.458199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f6f81-a240-439a-b2aa-8409b0552fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:31.458647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fce510-4ff4-4e9f-975c-cd63258cf0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:31.458998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f6f81-a240-439a-b2aa-8409b0552fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:31.460444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fce510-4ff4-4e9f-975c-cd63258cf0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:31.460857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f6f81-a240-439a-b2aa-8409b0552fd2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:31.463042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fce510-4ff4-4e9f-975c-cd63258cf0a6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:31.479937 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1027/2031] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:31.483476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fce510-4ff4-4e9f-975c-cd63258cf0a6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:31.490838 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1005/2032] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:31.496047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f6f81-a240-439a-b2aa-8409b0552fd2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:31.497711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fce510-4ff4-4e9f-975c-cd63258cf0a6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:31.504095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a089341-cc88-47ed-ae3a-7819349ffae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:31.505280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a089341-cc88-47ed-ae3a-7819349ffae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:31.506243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a089341-cc88-47ed-ae3a-7819349ffae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:31.506751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a089341-cc88-47ed-ae3a-7819349ffae1 admin admin] PATH_INFO: `/v3/projects/ff7bd6e94c0e4dd19031469571cfd844/users/9ead5ffce65e49c1a87fe7028c9ec10e/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:31.520474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f6f81-a240-439a-b2aa-8409b0552fd2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:31.528951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a089341-cc88-47ed-ae3a-7819349ffae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7bd6e94c0e4dd19031469571cfd844, user_id=9ead5ffce65e49c1a87fe7028c9ec10e, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:31.532102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a089341-cc88-47ed-ae3a-7819349ffae1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:31.536738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edce6d2-62f0-4b5b-9c7a-014d93dfbdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:31.537614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edce6d2-62f0-4b5b-9c7a-014d93dfbdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:31.537908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edce6d2-62f0-4b5b-9c7a-014d93dfbdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:31.539558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edce6d2-62f0-4b5b-9c7a-014d93dfbdf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:31.542273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edce6d2-62f0-4b5b-9c7a-014d93dfbdf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:31.547319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edce6d2-62f0-4b5b-9c7a-014d93dfbdf3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:31.561938 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1028/2033] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:31 2022] PUT /identity/v3/projects/ff7bd6e94c0e4dd19031469571cfd844/users/9ead5ffce65e49c1a87fe7028c9ec10e/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:31.580086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f65d1-5913-4528-a2b4-aa81e8334572 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:31.580517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f65d1-5913-4528-a2b4-aa81e8334572 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:31.580900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f65d1-5913-4528-a2b4-aa81e8334572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:31.590107 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1006/2034] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:31.591379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edce6d2-62f0-4b5b-9c7a-014d93dfbdf3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:31.619893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edce6d2-62f0-4b5b-9c7a-014d93dfbdf3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:31.643222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-524f65d1-5913-4528-a2b4-aa81e8334572 None None] MFA Rules not processed for user `9ead5ffce65e49c1a87fe7028c9ec10e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:31.645737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-524f65d1-5913-4528-a2b4-aa81e8334572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:31.740171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:31.773281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:31.780589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab2ffc-5852-4e00-a9fd-146cc5aa3d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:31.781158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab2ffc-5852-4e00-a9fd-146cc5aa3d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:31.781401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab2ffc-5852-4e00-a9fd-146cc5aa3d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:31.781927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab2ffc-5852-4e00-a9fd-146cc5aa3d45 admin admin] PATH_INFO: `/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7/users/1f7977e44d4b4ad6b5b2e40317492629/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:31.844264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab2ffc-5852-4e00-a9fd-146cc5aa3d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e9a9bafd714ea0b51c28c6ff4accc7, user_id=1f7977e44d4b4ad6b5b2e40317492629, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:31.845407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab2ffc-5852-4e00-a9fd-146cc5aa3d45 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:31.857718 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1029/2035] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:31.863146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f65d1-5913-4528-a2b4-aa81e8334572 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:31.891088 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1007/2036] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:31 2022] PUT /identity/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7/users/1f7977e44d4b4ad6b5b2e40317492629/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:31.901819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744bd34-7248-4282-843f-31676475f757 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:31.902128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744bd34-7248-4282-843f-31676475f757 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:31.902412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744bd34-7248-4282-843f-31676475f757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:31.913330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f65d1-5913-4528-a2b4-aa81e8334572 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:32.008357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2744bd34-7248-4282-843f-31676475f757 None None] MFA Rules not processed for user `1f7977e44d4b4ad6b5b2e40317492629`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:32.009729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2744bd34-7248-4282-843f-31676475f757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:32.086807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea9e8b-e29e-4992-b539-ff37de01968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:32.087546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea9e8b-e29e-4992-b539-ff37de01968d admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:32.087878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea9e8b-e29e-4992-b539-ff37de01968d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:32.088158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea9e8b-e29e-4992-b539-ff37de01968d admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:32.088928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea9e8b-e29e-4992-b539-ff37de01968d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:32.091258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea9e8b-e29e-4992-b539-ff37de01968d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:32.129930 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1030/2037] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:31 2022] POST /identity/v3/projects => generated 387 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:32.134369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea9e8b-e29e-4992-b539-ff37de01968d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:32.245385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea9e8b-e29e-4992-b539-ff37de01968d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:32.247947 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1008/2038] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:01:32.252552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744bd34-7248-4282-843f-31676475f757 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:32.257796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073b4d9-ada0-4435-8434-311664160299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:32.258565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b4d9-ada0-4435-8434-311664160299 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:32.258954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b4d9-ada0-4435-8434-311664160299 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:32.259378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b4d9-ada0-4435-8434-311664160299 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:32.260213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073b4d9-ada0-4435-8434-311664160299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:32.262460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073b4d9-ada0-4435-8434-311664160299 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:32.303769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744bd34-7248-4282-843f-31676475f757 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:32.320187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e299f5-7278-4f6e-ab81-e4ce794954c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:32.322258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e299f5-7278-4f6e-ab81-e4ce794954c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:32.322692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e299f5-7278-4f6e-ab81-e4ce794954c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:32.322978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e299f5-7278-4f6e-ab81-e4ce794954c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:32.325876 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1031/2039] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:32 2022] POST /identity/v3/users => generated 300 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:32.326817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073b4d9-ada0-4435-8434-311664160299 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:32.329088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e299f5-7278-4f6e-ab81-e4ce794954c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:32.335678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e299f5-7278-4f6e-ab81-e4ce794954c9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:32.336222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6073b4d9-ada0-4435-8434-311664160299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:32.357231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073b4d9-ada0-4435-8434-311664160299 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:32.372298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33c23c-06ff-47e1-93d5-a0581676dfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:32.373118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33c23c-06ff-47e1-93d5-a0581676dfc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:32.373510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33c23c-06ff-47e1-93d5-a0581676dfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:32.373896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33c23c-06ff-47e1-93d5-a0581676dfc4 admin admin] PATH_INFO: `/v3/projects/0be7f2948db342d3868a273f82ca700b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:32.375232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33c23c-06ff-47e1-93d5-a0581676dfc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be7f2948db342d3868a273f82ca700b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:32.377380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33c23c-06ff-47e1-93d5-a0581676dfc4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:32.401017 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1009/2040] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:32 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:32.401449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e299f5-7278-4f6e-ab81-e4ce794954c9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:32.481841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e33c23c-06ff-47e1-93d5-a0581676dfc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be7f2948db342d3868a273f82ca700b', 'request_id': 'req-4e33c23c-06ff-47e1-93d5-a0581676dfc4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:32.486507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:32.496626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e33c23c-06ff-47e1-93d5-a0581676dfc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be7f2948db342d3868a273f82ca700b', 'request_id': 'req-4e33c23c-06ff-47e1-93d5-a0581676dfc4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:32.519922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e33c23c-06ff-47e1-93d5-a0581676dfc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be7f2948db342d3868a273f82ca700b', 'request_id': 'req-4e33c23c-06ff-47e1-93d5-a0581676dfc4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:32.544422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e33c23c-06ff-47e1-93d5-a0581676dfc4 admin admin] The token cache is being invalidate because project 0be7f2948db342d3868a273f82ca700b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:32.544618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e33c23c-06ff-47e1-93d5-a0581676dfc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:32.545360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e33c23c-06ff-47e1-93d5-a0581676dfc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:32.550685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e299f5-7278-4f6e-ab81-e4ce794954c9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:32.551468 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1032/2041] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:32 2022] DELETE /identity/v3/projects/0be7f2948db342d3868a273f82ca700b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:32.552178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33c23c-06ff-47e1-93d5-a0581676dfc4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:32.553641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4e33c23c-06ff-47e1-93d5-a0581676dfc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:32.640825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:32.677695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33c23c-06ff-47e1-93d5-a0581676dfc4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:32.681053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8dcef0-aba3-4b1f-be01-355b64c52e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:32.681744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dcef0-aba3-4b1f-be01-355b64c52e03 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:32.682506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dcef0-aba3-4b1f-be01-355b64c52e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:32.682506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dcef0-aba3-4b1f-be01-355b64c52e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:32.683099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8dcef0-aba3-4b1f-be01-355b64c52e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:32.684997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8dcef0-aba3-4b1f-be01-355b64c52e03 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:32.691973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6bfcf-6568-4a69-a857-ed04dbb7da82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:32.692622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6bfcf-6568-4a69-a857-ed04dbb7da82 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:32.692954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6bfcf-6568-4a69-a857-ed04dbb7da82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:32.693508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6bfcf-6568-4a69-a857-ed04dbb7da82 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:32.694201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6bfcf-6568-4a69-a857-ed04dbb7da82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:32.696412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6bfcf-6568-4a69-a857-ed04dbb7da82 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:32.698006 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1010/2042] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:32.699221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e29cba-4d06-4021-97c5-5ed7d9971e7e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:32.699574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e29cba-4d06-4021-97c5-5ed7d9971e7e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:32.699840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e29cba-4d06-4021-97c5-5ed7d9971e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:32.732658 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1033/2043] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:32 2022] POST /identity/v3/users => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:32.732658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6bfcf-6568-4a69-a857-ed04dbb7da82 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:32.733661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4de6bfcf-6568-4a69-a857-ed04dbb7da82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:32.739188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c5e29cba-4d06-4021-97c5-5ed7d9971e7e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:32.747756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c5e29cba-4d06-4021-97c5-5ed7d9971e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:32.750228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6bfcf-6568-4a69-a857-ed04dbb7da82 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:32.756203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa4b46-ff41-404d-a70c-165cd78f7c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:32.756893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa4b46-ff41-404d-a70c-165cd78f7c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:32.757313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa4b46-ff41-404d-a70c-165cd78f7c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:32.757605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa4b46-ff41-404d-a70c-165cd78f7c7b admin admin] PATH_INFO: `/v3/projects/276e47b9c5bf488fa69b8e429c328cbf/users/a4b87dcc4fd645c89ae095a2a6a378f4/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:32.775556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa4b46-ff41-404d-a70c-165cd78f7c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=276e47b9c5bf488fa69b8e429c328cbf, user_id=a4b87dcc4fd645c89ae095a2a6a378f4, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:32.779303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa4b46-ff41-404d-a70c-165cd78f7c7b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:32.785122 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1011/2044] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:32.786749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e29cba-4d06-4021-97c5-5ed7d9971e7e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:32.803705 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1034/2045] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:32 2022] PUT /identity/v3/projects/276e47b9c5bf488fa69b8e429c328cbf/users/a4b87dcc4fd645c89ae095a2a6a378f4/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:32.805163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b11b8-83a3-4cf7-86b0-0b0e45afc693 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:32.805461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b11b8-83a3-4cf7-86b0-0b0e45afc693 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:32.805739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b11b8-83a3-4cf7-86b0-0b0e45afc693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:32.810693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e29cba-4d06-4021-97c5-5ed7d9971e7e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:32.829690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-263b11b8-83a3-4cf7-86b0-0b0e45afc693 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:32.832311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-263b11b8-83a3-4cf7-86b0-0b0e45afc693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:32.914611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e9ae1-8453-4cef-8596-5c4573115e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:32.915448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e9ae1-8453-4cef-8596-5c4573115e34 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:32.915764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e9ae1-8453-4cef-8596-5c4573115e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:32.920755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e9ae1-8453-4cef-8596-5c4573115e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:32.923426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e9ae1-8453-4cef-8596-5c4573115e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:32.927729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e9ae1-8453-4cef-8596-5c4573115e34 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:32.955981 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1012/2046] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:32.975354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e9ae1-8453-4cef-8596-5c4573115e34 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:32.991649 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1035/2047] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:32.992899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b11b8-83a3-4cf7-86b0-0b0e45afc693 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:33.004639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b11b8-83a3-4cf7-86b0-0b0e45afc693 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:33.014130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e9ae1-8453-4cef-8596-5c4573115e34 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:33.020322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f5012-62d8-4728-ba9b-406723584db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:33.021063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f5012-62d8-4728-ba9b-406723584db9 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:33.021431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f5012-62d8-4728-ba9b-406723584db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:33.021831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f5012-62d8-4728-ba9b-406723584db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:33.022037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eeadbc-7a92-45fa-855a-9341bc758dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:33.022600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f5012-62d8-4728-ba9b-406723584db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:33.022826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeadbc-7a92-45fa-855a-9341bc758dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:33.023123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeadbc-7a92-45fa-855a-9341bc758dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:33.023485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeadbc-7a92-45fa-855a-9341bc758dcb admin admin] PATH_INFO: `/v3/projects/d11e2bfd5060402bbf2770a6f85accef/users/5019c7e61b604023a14f43054cd8e4d9/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:33.024598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f5012-62d8-4728-ba9b-406723584db9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:33.040828 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1013/2048] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:33.041769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f5012-62d8-4728-ba9b-406723584db9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:33.054560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f5012-62d8-4728-ba9b-406723584db9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:33.061246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eeadbc-7a92-45fa-855a-9341bc758dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11e2bfd5060402bbf2770a6f85accef, user_id=5019c7e61b604023a14f43054cd8e4d9, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:33.069184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eeadbc-7a92-45fa-855a-9341bc758dcb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:33.073407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e220d-97b3-4605-95a2-27928cc40d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:33.074057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e220d-97b3-4605-95a2-27928cc40d9b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:33.074338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e220d-97b3-4605-95a2-27928cc40d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:33.074630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e220d-97b3-4605-95a2-27928cc40d9b admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:33.075489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e220d-97b3-4605-95a2-27928cc40d9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:01:33.075793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e220d-97b3-4605-95a2-27928cc40d9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:33.077388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e220d-97b3-4605-95a2-27928cc40d9b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:33.092586 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1014/2049] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:01:33.093409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e220d-97b3-4605-95a2-27928cc40d9b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:33.109666 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1036/2050] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:32 2022] PUT /identity/v3/projects/d11e2bfd5060402bbf2770a6f85accef/users/5019c7e61b604023a14f43054cd8e4d9/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:33.110604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eeadbc-7a92-45fa-855a-9341bc758dcb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:33.119158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e220d-97b3-4605-95a2-27928cc40d9b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:33.176671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:33.254663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eeadbc-7a92-45fa-855a-9341bc758dcb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:33.256011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75f8bc-33cc-4fa3-a5c9-e3baa24af217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:33.256706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75f8bc-33cc-4fa3-a5c9-e3baa24af217 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:33.256986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75f8bc-33cc-4fa3-a5c9-e3baa24af217 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:33.257265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75f8bc-33cc-4fa3-a5c9-e3baa24af217 admin admin] PATH_INFO: `/v3/projects/276e47b9c5bf488fa69b8e429c328cbf/users/a4b87dcc4fd645c89ae095a2a6a378f4/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:33.261525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75f8bc-33cc-4fa3-a5c9-e3baa24af217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=276e47b9c5bf488fa69b8e429c328cbf, user_id=a4b87dcc4fd645c89ae095a2a6a378f4, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:33.265813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75f8bc-33cc-4fa3-a5c9-e3baa24af217 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:33.268909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c94c04-cb05-4844-baa6-ebfc0e9cf980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:33.270049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c94c04-cb05-4844-baa6-ebfc0e9cf980 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:33.270341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c94c04-cb05-4844-baa6-ebfc0e9cf980 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:33.270612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c94c04-cb05-4844-baa6-ebfc0e9cf980 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:33.271318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c94c04-cb05-4844-baa6-ebfc0e9cf980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:33.273422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c94c04-cb05-4844-baa6-ebfc0e9cf980 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:33.302168 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1015/2051] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:33 2022] PUT /identity/v3/projects/276e47b9c5bf488fa69b8e429c328cbf/users/a4b87dcc4fd645c89ae095a2a6a378f4/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:33.303232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75f8bc-33cc-4fa3-a5c9-e3baa24af217 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:33.349669 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1037/2052] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:33 2022] POST /identity/v3/projects => generated 387 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:33.351102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1c626-b93e-404a-8e6b-8f8d73b4b8be None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:33.351441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1c626-b93e-404a-8e6b-8f8d73b4b8be None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:33.351731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1c626-b93e-404a-8e6b-8f8d73b4b8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:33.388001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e6b1c626-b93e-404a-8e6b-8f8d73b4b8be None None] MFA Rules not processed for user `a4b87dcc4fd645c89ae095a2a6a378f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:33.390506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e6b1c626-b93e-404a-8e6b-8f8d73b4b8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:33.422231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:33.503105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75f8bc-33cc-4fa3-a5c9-e3baa24af217 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:33.587046 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1038/2053] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:33.587046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1c626-b93e-404a-8e6b-8f8d73b4b8be None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:33.702466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890d16b-2fbe-45f7-b44a-2b4c23baf1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:33.703127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890d16b-2fbe-45f7-b44a-2b4c23baf1ae admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:33.703447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890d16b-2fbe-45f7-b44a-2b4c23baf1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:33.709080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890d16b-2fbe-45f7-b44a-2b4c23baf1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:33.709284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890d16b-2fbe-45f7-b44a-2b4c23baf1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:33.710852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890d16b-2fbe-45f7-b44a-2b4c23baf1ae admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:33.739031 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1016/2054] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:33.741060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890d16b-2fbe-45f7-b44a-2b4c23baf1ae admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:33.744609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1890d16b-2fbe-45f7-b44a-2b4c23baf1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:33.776704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1c626-b93e-404a-8e6b-8f8d73b4b8be None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:33.783905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a1f8d-8495-4e55-84c8-93de1e1fff9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:33.785282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1f8d-8495-4e55-84c8-93de1e1fff9f admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:33.785942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1f8d-8495-4e55-84c8-93de1e1fff9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:33.786676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1f8d-8495-4e55-84c8-93de1e1fff9f admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:33.789047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a1f8d-8495-4e55-84c8-93de1e1fff9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:33.791726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a1f8d-8495-4e55-84c8-93de1e1fff9f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:33.825445 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1039/2055] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:33 2022] POST /identity/v3/users => generated 294 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:33.826613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a1f8d-8495-4e55-84c8-93de1e1fff9f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:33.861913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a1f8d-8495-4e55-84c8-93de1e1fff9f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:33.875100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8125a9b-0659-451c-bca0-5734d7bd1ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:33.875993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8125a9b-0659-451c-bca0-5734d7bd1ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:33.876523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8125a9b-0659-451c-bca0-5734d7bd1ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:33.877020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8125a9b-0659-451c-bca0-5734d7bd1ea6 admin admin] PATH_INFO: `/v3/projects/d11e2bfd5060402bbf2770a6f85accef/users/5019c7e61b604023a14f43054cd8e4d9/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:33.880787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8125a9b-0659-451c-bca0-5734d7bd1ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11e2bfd5060402bbf2770a6f85accef, user_id=5019c7e61b604023a14f43054cd8e4d9, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:33.884181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8125a9b-0659-451c-bca0-5734d7bd1ea6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:33.894631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890d16b-2fbe-45f7-b44a-2b4c23baf1ae admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:33.904088 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1040/2056] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:33 2022] PUT /identity/v3/projects/d11e2bfd5060402bbf2770a6f85accef/users/5019c7e61b604023a14f43054cd8e4d9/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:33.909125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8125a9b-0659-451c-bca0-5734d7bd1ea6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:33.963729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:34.072145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae8cd8-aaff-4f34-9c5b-d2f1c21dbd1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:34.074243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae8cd8-aaff-4f34-9c5b-d2f1c21dbd1d service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:34.074889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae8cd8-aaff-4f34-9c5b-d2f1c21dbd1d service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:34.076903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae8cd8-aaff-4f34-9c5b-d2f1c21dbd1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:34.121422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:34.123349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8125a9b-0659-451c-bca0-5734d7bd1ea6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:34.152000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41382504-16ba-4967-9c38-c5d339bd85d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:34.152287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41382504-16ba-4967-9c38-c5d339bd85d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:34.152522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41382504-16ba-4967-9c38-c5d339bd85d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:34.152807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41382504-16ba-4967-9c38-c5d339bd85d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:34.156275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41382504-16ba-4967-9c38-c5d339bd85d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:34.163080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41382504-16ba-4967-9c38-c5d339bd85d5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:34.189130 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1041/2057] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:34.197710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454c9c0-e079-487b-abdb-5033eeedae4e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:34.197710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454c9c0-e079-487b-abdb-5033eeedae4e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:34.198500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454c9c0-e079-487b-abdb-5033eeedae4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:34.264395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae8cd8-aaff-4f34-9c5b-d2f1c21dbd1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:34.266057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae8cd8-aaff-4f34-9c5b-d2f1c21dbd1d service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:34.284793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a454c9c0-e079-487b-abdb-5033eeedae4e None None] MFA Rules not processed for user `5019c7e61b604023a14f43054cd8e4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:34.288870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a454c9c0-e079-487b-abdb-5033eeedae4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:34.302451 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1017/2058] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:34.304772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae8cd8-aaff-4f34-9c5b-d2f1c21dbd1d service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:34.354776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae8cd8-aaff-4f34-9c5b-d2f1c21dbd1d service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:34.375563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ded8b-9a0f-4dea-a226-9e4b93a768e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:34.376200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ded8b-9a0f-4dea-a226-9e4b93a768e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:34.376492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ded8b-9a0f-4dea-a226-9e4b93a768e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:34.376772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ded8b-9a0f-4dea-a226-9e4b93a768e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:34.377479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ded8b-9a0f-4dea-a226-9e4b93a768e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:34.381606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ded8b-9a0f-4dea-a226-9e4b93a768e9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:34.413585 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1018/2059] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:34.418070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ded8b-9a0f-4dea-a226-9e4b93a768e9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:34.434376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ded8b-9a0f-4dea-a226-9e4b93a768e9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:34.451723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43049e5-d43f-43e8-bfd7-193ee9ddd7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:34.452566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43049e5-d43f-43e8-bfd7-193ee9ddd7c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:34.452961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43049e5-d43f-43e8-bfd7-193ee9ddd7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:34.453380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43049e5-d43f-43e8-bfd7-193ee9ddd7c3 admin admin] PATH_INFO: `/v3/projects/622c703ef9e841af98f739e091f174a3/users/fab82c0aad8043b989b8d1b7bebd57a6/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:34.496192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43049e5-d43f-43e8-bfd7-193ee9ddd7c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=622c703ef9e841af98f739e091f174a3, user_id=fab82c0aad8043b989b8d1b7bebd57a6, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:34.502980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43049e5-d43f-43e8-bfd7-193ee9ddd7c3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:34.519434 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1042/2060] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:34.532722 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1019/2061] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:34 2022] PUT /identity/v3/projects/622c703ef9e841af98f739e091f174a3/users/fab82c0aad8043b989b8d1b7bebd57a6/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:34.545407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d55f9f-6550-4668-9710-46f04d568451 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:34.546590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d55f9f-6550-4668-9710-46f04d568451 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:34.546590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d55f9f-6550-4668-9710-46f04d568451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:34.600619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e6d55f9f-6550-4668-9710-46f04d568451 None None] MFA Rules not processed for user `fab82c0aad8043b989b8d1b7bebd57a6`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:34.602106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e6d55f9f-6550-4668-9710-46f04d568451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:34.690769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43049e5-d43f-43e8-bfd7-193ee9ddd7c3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:34.693933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c43049e5-d43f-43e8-bfd7-193ee9ddd7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:34.713908 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1043/2062] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:34.718014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d55f9f-6550-4668-9710-46f04d568451 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:34.756317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:34.797212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43049e5-d43f-43e8-bfd7-193ee9ddd7c3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:34.806424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357ef34-d662-4751-bd40-7eb1fa4ad007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:34.807074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357ef34-d662-4751-bd40-7eb1fa4ad007 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:34.807392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357ef34-d662-4751-bd40-7eb1fa4ad007 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:34.807677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357ef34-d662-4751-bd40-7eb1fa4ad007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:34.809573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d55f9f-6550-4668-9710-46f04d568451 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:34.810014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6357ef34-d662-4751-bd40-7eb1fa4ad007 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:34.814840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d056e-8d6d-4353-a60a-9369bb21f377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:34.815714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d056e-8d6d-4353-a60a-9369bb21f377 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:34.816105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d056e-8d6d-4353-a60a-9369bb21f377 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:34.817049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d056e-8d6d-4353-a60a-9369bb21f377 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:34.817995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d056e-8d6d-4353-a60a-9369bb21f377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:34.820401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d056e-8d6d-4353-a60a-9369bb21f377 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:34.879813 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1044/2063] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:34 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:34.886904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d056e-8d6d-4353-a60a-9369bb21f377 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:34.895886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357ef34-d662-4751-bd40-7eb1fa4ad007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:34.898193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357ef34-d662-4751-bd40-7eb1fa4ad007 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:34.909662 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1020/2064] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:34.911541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357ef34-d662-4751-bd40-7eb1fa4ad007 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:34.923998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357ef34-d662-4751-bd40-7eb1fa4ad007 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:34.949366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:35.025024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d056e-8d6d-4353-a60a-9369bb21f377 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:35.040621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0316d-8ef6-4a6d-9ec8-538197699514 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:35.041265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0316d-8ef6-4a6d-9ec8-538197699514 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:35.041550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0316d-8ef6-4a6d-9ec8-538197699514 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:35.041830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0316d-8ef6-4a6d-9ec8-538197699514 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:35.051908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe992bd-f6ea-4a51-ba80-a3d827b6ceab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:35.052666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe992bd-f6ea-4a51-ba80-a3d827b6ceab admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:35.053085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe992bd-f6ea-4a51-ba80-a3d827b6ceab admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:35.053532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe992bd-f6ea-4a51-ba80-a3d827b6ceab admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:35.054226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe992bd-f6ea-4a51-ba80-a3d827b6ceab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:35.056360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe992bd-f6ea-4a51-ba80-a3d827b6ceab admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:35.105742 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1021/2065] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:34 2022] POST /identity/v3/users => generated 300 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:35.111647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe992bd-f6ea-4a51-ba80-a3d827b6ceab admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:35.148977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe992bd-f6ea-4a51-ba80-a3d827b6ceab admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:35.161509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0316d-8ef6-4a6d-9ec8-538197699514 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:35.163699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0316d-8ef6-4a6d-9ec8-538197699514 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:35.164567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5b6f9-9dba-4e9d-99c7-afb1b6ab5b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:35.167514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5b6f9-9dba-4e9d-99c7-afb1b6ab5b4f admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:35.167931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5b6f9-9dba-4e9d-99c7-afb1b6ab5b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:35.168287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5b6f9-9dba-4e9d-99c7-afb1b6ab5b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:35.177032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5b6f9-9dba-4e9d-99c7-afb1b6ab5b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:35.180004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5b6f9-9dba-4e9d-99c7-afb1b6ab5b4f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:35.186020 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1045/2066] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:01:35.209814 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1022/2067] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:35.212431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807e72a-08e9-4b96-aca3-c196b399c0af None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:35.213877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807e72a-08e9-4b96-aca3-c196b399c0af None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:35.214015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5b6f9-9dba-4e9d-99c7-afb1b6ab5b4f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:35.214608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807e72a-08e9-4b96-aca3-c196b399c0af None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:35.219232 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1046/2068] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:01:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:01:35.224273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807e72a-08e9-4b96-aca3-c196b399c0af None None] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:01:35.227269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5b6f9-9dba-4e9d-99c7-afb1b6ab5b4f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:35.233128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1ec19-d78d-48eb-8549-0423ad2bdce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:35.234164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1ec19-d78d-48eb-8549-0423ad2bdce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:35.234522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1ec19-d78d-48eb-8549-0423ad2bdce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:35.235133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1ec19-d78d-48eb-8549-0423ad2bdce3 admin admin] PATH_INFO: `/v3/projects/0652d1910792484e8d5c084ef02766fb/users/34fdfb1eb67e44f9badd56e590d3d09e/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:35.265006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1ec19-d78d-48eb-8549-0423ad2bdce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0652d1910792484e8d5c084ef02766fb, user_id=34fdfb1eb67e44f9badd56e590d3d09e, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:35.268525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1ec19-d78d-48eb-8549-0423ad2bdce3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:35.284129 ncdv-master-1 devstack@keystone.service[91086]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-e807e72a-08e9-4b96-aca3-c196b399c0af None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 30 21:01:35.284480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807e72a-08e9-4b96-aca3-c196b399c0af None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:35.297992 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1023/2069] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:35 2022] PUT /identity/v3/projects/0652d1910792484e8d5c084ef02766fb/users/34fdfb1eb67e44f9badd56e590d3d09e/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:35.302454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1ec19-d78d-48eb-8549-0423ad2bdce3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:35.312903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807e72a-08e9-4b96-aca3-c196b399c0af None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:35.409454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:35.470707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1ec19-d78d-48eb-8549-0423ad2bdce3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:35.492144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0af66-b6c5-45d9-ba27-920e2559b05c tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5019c7e61b604023a14f43054cd8e4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd11e2bfd5060402bbf2770a6f85accef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:35.493374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0af66-b6c5-45d9-ba27-920e2559b05c tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:35.493819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0af66-b6c5-45d9-ba27-920e2559b05c tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:35.494187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0af66-b6c5-45d9-ba27-920e2559b05c tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] PATH_INFO: `/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:35.495363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d961fa-d620-49ac-b5e1-368938f70420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:35.496298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0af66-b6c5-45d9-ba27-920e2559b05c tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: Authorizing `identity:get_project(project_id=05e9a9bafd714ea0b51c28c6ff4accc7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:35.500826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d961fa-d620-49ac-b5e1-368938f70420 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:35.501151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d961fa-d620-49ac-b5e1-368938f70420 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:35.501438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d961fa-d620-49ac-b5e1-368938f70420 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:35.504699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d961fa-d620-49ac-b5e1-368938f70420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:35.510854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0af66-b6c5-45d9-ba27-920e2559b05c tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:35.511432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d961fa-d620-49ac-b5e1-368938f70420 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:35.526426 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1047/2070] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:01:35 2022] GET /identity/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7 => generated 381 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:01:35.547784 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1024/2071] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:01:35.551881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0af66-b6c5-45d9-ba27-920e2559b05c tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:35.582989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0af66-b6c5-45d9-ba27-920e2559b05c tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:35.606363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3e612-c79e-4127-aedb-2a388dfefba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:35.607277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3e612-c79e-4127-aedb-2a388dfefba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:35.608458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3e612-c79e-4127-aedb-2a388dfefba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:35.608809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3e612-c79e-4127-aedb-2a388dfefba5 admin admin] PATH_INFO: `/v3/projects/0652d1910792484e8d5c084ef02766fb/users/34fdfb1eb67e44f9badd56e590d3d09e/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:35.615650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3e612-c79e-4127-aedb-2a388dfefba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0652d1910792484e8d5c084ef02766fb, user_id=34fdfb1eb67e44f9badd56e590d3d09e, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:35.619546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3e612-c79e-4127-aedb-2a388dfefba5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:35.638629 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1048/2072] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:35 2022] PUT /identity/v3/projects/0652d1910792484e8d5c084ef02766fb/users/34fdfb1eb67e44f9badd56e590d3d09e/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:35.649377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87522cab-5200-4687-9c65-a372b873b598 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:35.650963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a7b36-df0a-475a-b95d-a1505b84dc70 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:35.651320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a7b36-df0a-475a-b95d-a1505b84dc70 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:35.651614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87522cab-5200-4687-9c65-a372b873b598 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:35.651731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a7b36-df0a-475a-b95d-a1505b84dc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:35.656526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87522cab-5200-4687-9c65-a372b873b598 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:35.658513 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1025/2073] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:01:35 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:01:35.673744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87522cab-5200-4687-9c65-a372b873b598 None None] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:01:35.725236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5b3a7b36-df0a-475a-b95d-a1505b84dc70 None None] MFA Rules not processed for user `34fdfb1eb67e44f9badd56e590d3d09e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:35.726391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5b3a7b36-df0a-475a-b95d-a1505b84dc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:35.803716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:35.845937 ncdv-master-1 devstack@keystone.service[91085]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-87522cab-5200-4687-9c65-a372b873b598 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 30 21:01:35.846810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87522cab-5200-4687-9c65-a372b873b598 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:35.950102 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1049/2074] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:36.029979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87522cab-5200-4687-9c65-a372b873b598 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:36.036057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35282fac-b580-4f0a-96ee-f3a03ab8d203 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5019c7e61b604023a14f43054cd8e4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd11e2bfd5060402bbf2770a6f85accef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:36.036861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35282fac-b580-4f0a-96ee-f3a03ab8d203 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:36.037161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35282fac-b580-4f0a-96ee-f3a03ab8d203 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:36.037446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35282fac-b580-4f0a-96ee-f3a03ab8d203 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] PATH_INFO: `/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:36.038654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35282fac-b580-4f0a-96ee-f3a03ab8d203 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: Authorizing `identity:get_project(project_id=05e9a9bafd714ea0b51c28c6ff4accc7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:36.040780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35282fac-b580-4f0a-96ee-f3a03ab8d203 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:36.043903 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1026/2075] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:01:35 2022] GET /identity/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7 => generated 381 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:01:36.194122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14638f-4539-4188-9e8a-022a7025f06d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:36.194417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14638f-4539-4188-9e8a-022a7025f06d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:36.195810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14638f-4539-4188-9e8a-022a7025f06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:36.242082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0a14638f-4539-4188-9e8a-022a7025f06d None None] MFA Rules not processed for user `1f7977e44d4b4ad6b5b2e40317492629`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:36.243364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0a14638f-4539-4188-9e8a-022a7025f06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:36.400739 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1050/2076] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:36.665549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35282fac-b580-4f0a-96ee-f3a03ab8d203 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:36.680245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35282fac-b580-4f0a-96ee-f3a03ab8d203 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:36.686637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873075b-324d-4a43-8778-e0a50f2de303 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:36.687271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873075b-324d-4a43-8778-e0a50f2de303 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:36.687761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873075b-324d-4a43-8778-e0a50f2de303 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:36.687923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873075b-324d-4a43-8778-e0a50f2de303 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:36.700203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873075b-324d-4a43-8778-e0a50f2de303 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:36.701815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873075b-324d-4a43-8778-e0a50f2de303 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:36.718016 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1027/2077] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:36.788200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14638f-4539-4188-9e8a-022a7025f06d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:36.816120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14638f-4539-4188-9e8a-022a7025f06d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:36.829359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a0292-221a-48bd-bd8b-6a45ffc099d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:36.830015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a0292-221a-48bd-bd8b-6a45ffc099d8 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:36.830291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a0292-221a-48bd-bd8b-6a45ffc099d8 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:36.830573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a0292-221a-48bd-bd8b-6a45ffc099d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:36.832979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-915a0292-221a-48bd-bd8b-6a45ffc099d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:36.847220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873075b-324d-4a43-8778-e0a50f2de303 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:36.860698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a0292-221a-48bd-bd8b-6a45ffc099d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:36.860912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873075b-324d-4a43-8778-e0a50f2de303 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:36.863075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a0292-221a-48bd-bd8b-6a45ffc099d8 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:36.868109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494efdf4-6182-4019-847f-53eca7bf8727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:36.869211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494efdf4-6182-4019-847f-53eca7bf8727 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:36.869824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494efdf4-6182-4019-847f-53eca7bf8727 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:36.870558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494efdf4-6182-4019-847f-53eca7bf8727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:36.873306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-494efdf4-6182-4019-847f-53eca7bf8727 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:36.882374 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1051/2078] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:36.969734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494efdf4-6182-4019-847f-53eca7bf8727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:36.971395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494efdf4-6182-4019-847f-53eca7bf8727 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:36.984613 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1028/2079] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:01:37.260215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b2898-2695-4b81-8678-b5e93431d609 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:37.260508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b2898-2695-4b81-8678-b5e93431d609 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:37.260965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b2898-2695-4b81-8678-b5e93431d609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:37.306069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6d8b2898-2695-4b81-8678-b5e93431d609 None None] MFA Rules not processed for user `b2a05aa5d80844848bf57f6ca093e582`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:37.308309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6d8b2898-2695-4b81-8678-b5e93431d609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:37.381524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:37.433850 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1052/2080] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:01:37.436673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494efdf4-6182-4019-847f-53eca7bf8727 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:37.438623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-494efdf4-6182-4019-847f-53eca7bf8727 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:37.529439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494efdf4-6182-4019-847f-53eca7bf8727 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:37.541598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192de41-1696-4475-88d3-649c13e0b31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:37.542256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192de41-1696-4475-88d3-649c13e0b31e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:37.542549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192de41-1696-4475-88d3-649c13e0b31e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:37.542908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192de41-1696-4475-88d3-649c13e0b31e admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:37.544088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192de41-1696-4475-88d3-649c13e0b31e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:37.547042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192de41-1696-4475-88d3-649c13e0b31e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:37.606233 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1029/2081] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:37 2022] POST /identity/v3/projects => generated 401 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:37.607007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b2898-2695-4b81-8678-b5e93431d609 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:37.652696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b2898-2695-4b81-8678-b5e93431d609 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:37.793379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e357859-0476-4bce-85bd-b8cba35cf86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:37.794651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e357859-0476-4bce-85bd-b8cba35cf86c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:37.794946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e357859-0476-4bce-85bd-b8cba35cf86c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:37.795255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e357859-0476-4bce-85bd-b8cba35cf86c admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:37.796298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e357859-0476-4bce-85bd-b8cba35cf86c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:37.799015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e357859-0476-4bce-85bd-b8cba35cf86c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:37.828705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192de41-1696-4475-88d3-649c13e0b31e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:37.839752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:37.844384 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1053/2082] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:37 2022] POST /identity/v3/users => generated 307 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:37.849246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e357859-0476-4bce-85bd-b8cba35cf86c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:37.860934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e357859-0476-4bce-85bd-b8cba35cf86c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:37.868336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725380a-c6f8-4c13-921f-bbf8f37872df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:37.869455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725380a-c6f8-4c13-921f-bbf8f37872df admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:37.869752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725380a-c6f8-4c13-921f-bbf8f37872df admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:37.870035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725380a-c6f8-4c13-921f-bbf8f37872df admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:37.871033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725380a-c6f8-4c13-921f-bbf8f37872df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:37.872839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725380a-c6f8-4c13-921f-bbf8f37872df admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:37.885503 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1054/2083] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:01:37.890764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725380a-c6f8-4c13-921f-bbf8f37872df admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:37.909121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725380a-c6f8-4c13-921f-bbf8f37872df admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:37.916023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9948ac-dbac-4506-a8af-fe8832f86e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:37.916705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9948ac-dbac-4506-a8af-fe8832f86e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:37.917049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9948ac-dbac-4506-a8af-fe8832f86e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:37.917383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9948ac-dbac-4506-a8af-fe8832f86e83 admin admin] PATH_INFO: `/v3/projects/d021c316a57b4d4a877832776b5ef265/users/1a356e21a90c407a9569cc57d5530e4c/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:37.936535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9948ac-dbac-4506-a8af-fe8832f86e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d021c316a57b4d4a877832776b5ef265, user_id=1a356e21a90c407a9569cc57d5530e4c, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:37.938656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192de41-1696-4475-88d3-649c13e0b31e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:37.940689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9948ac-dbac-4506-a8af-fe8832f86e83 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:37.944475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21119d66-ebf5-4fbc-8d08-db8172f2ba87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:37.945107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21119d66-ebf5-4fbc-8d08-db8172f2ba87 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:37.945391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21119d66-ebf5-4fbc-8d08-db8172f2ba87 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:37.945667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21119d66-ebf5-4fbc-8d08-db8172f2ba87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:37.962251 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1055/2084] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:37 2022] PUT /identity/v3/projects/d021c316a57b4d4a877832776b5ef265/users/1a356e21a90c407a9569cc57d5530e4c/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:37.965584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9948ac-dbac-4506-a8af-fe8832f86e83 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:38.057192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21119d66-ebf5-4fbc-8d08-db8172f2ba87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:38.059850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21119d66-ebf5-4fbc-8d08-db8172f2ba87 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:38.077062 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1030/2085] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:38.077476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9948ac-dbac-4506-a8af-fe8832f86e83 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:38.082928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc113560-08cf-4875-90c8-3d50cc557d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:38.084525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc113560-08cf-4875-90c8-3d50cc557d96 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:38.085132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc113560-08cf-4875-90c8-3d50cc557d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:38.085493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc113560-08cf-4875-90c8-3d50cc557d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:38.087122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc113560-08cf-4875-90c8-3d50cc557d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:38.090668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc113560-08cf-4875-90c8-3d50cc557d96 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:38.107195 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1056/2086] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:01:38.112201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21119d66-ebf5-4fbc-8d08-db8172f2ba87 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:38.118777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005694e-3b9d-474d-ae2c-8080dbecc24f None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:38.119071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005694e-3b9d-474d-ae2c-8080dbecc24f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:38.119394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005694e-3b9d-474d-ae2c-8080dbecc24f None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:38.122129 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1057/2087] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:01:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:01:38.126279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21119d66-ebf5-4fbc-8d08-db8172f2ba87 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:38.127274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005694e-3b9d-474d-ae2c-8080dbecc24f None None] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:01:38.133227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570725c-bf5f-41cc-bb05-2a8472cd1440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:38.134001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570725c-bf5f-41cc-bb05-2a8472cd1440 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:38.134367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570725c-bf5f-41cc-bb05-2a8472cd1440 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:38.135396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570725c-bf5f-41cc-bb05-2a8472cd1440 admin admin] PATH_INFO: `/v3/projects/d021c316a57b4d4a877832776b5ef265/users/1a356e21a90c407a9569cc57d5530e4c/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:38.138012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570725c-bf5f-41cc-bb05-2a8472cd1440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d021c316a57b4d4a877832776b5ef265, user_id=1a356e21a90c407a9569cc57d5530e4c, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:38.141546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570725c-bf5f-41cc-bb05-2a8472cd1440 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:38.157975 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1031/2088] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:38 2022] PUT /identity/v3/projects/d021c316a57b4d4a877832776b5ef265/users/1a356e21a90c407a9569cc57d5530e4c/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:38.163919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:38.240648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005694e-3b9d-474d-ae2c-8080dbecc24f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:38.416145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005694e-3b9d-474d-ae2c-8080dbecc24f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:38.516722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e4b53-e880-49e6-ad9f-d8f7e209bdd9 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5019c7e61b604023a14f43054cd8e4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd11e2bfd5060402bbf2770a6f85accef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:38.518106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e4b53-e880-49e6-ad9f-d8f7e209bdd9 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:38.518551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e4b53-e880-49e6-ad9f-d8f7e209bdd9 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:38.520414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e4b53-e880-49e6-ad9f-d8f7e209bdd9 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] PATH_INFO: `/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:38.522015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e4b53-e880-49e6-ad9f-d8f7e209bdd9 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: Authorizing `identity:get_project(project_id=05e9a9bafd714ea0b51c28c6ff4accc7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:38.524560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e4b53-e880-49e6-ad9f-d8f7e209bdd9 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:38.526891 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1058/2089] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:01:38 2022] GET /identity/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7 => generated 381 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:01:38.808801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570725c-bf5f-41cc-bb05-2a8472cd1440 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:38.810555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9570725c-bf5f-41cc-bb05-2a8472cd1440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:38.919588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfe4fe-7d56-4b27-b585-95d51bdf105c None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:38.920199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfe4fe-7d56-4b27-b585-95d51bdf105c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:38.920784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfe4fe-7d56-4b27-b585-95d51bdf105c None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:38.924436 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1059/2090] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:01:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 21:01:38.940459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c483c-61d4-41ff-882c-c2efed16901b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:38.942188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c483c-61d4-41ff-882c-c2efed16901b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:38.943040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c483c-61d4-41ff-882c-c2efed16901b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:38.965460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570725c-bf5f-41cc-bb05-2a8472cd1440 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:38.976567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd6bb8-f2a1-4d03-8669-adaba89b9efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:38.977951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd6bb8-f2a1-4d03-8669-adaba89b9efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:38.978146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bf6c483c-61d4-41ff-882c-c2efed16901b None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:38.979010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd6bb8-f2a1-4d03-8669-adaba89b9efe admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:38.979418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bf6c483c-61d4-41ff-882c-c2efed16901b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:38.980361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd6bb8-f2a1-4d03-8669-adaba89b9efe admin admin] PATH_INFO: `/v3/users/93ee771e50474e268eae2fed07e43fe7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:38.983664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd6bb8-f2a1-4d03-8669-adaba89b9efe admin admin] RBAC: Authorizing `identity:delete_user(user_id=93ee771e50474e268eae2fed07e43fe7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:38.988806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd6bb8-f2a1-4d03-8669-adaba89b9efe admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:39.066888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:39.092426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-74fd6bb8-f2a1-4d03-8669-adaba89b9efe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93ee771e50474e268eae2fed07e43fe7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:39.106131 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1060/2091] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:01:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:39.111421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-74fd6bb8-f2a1-4d03-8669-adaba89b9efe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93ee771e50474e268eae2fed07e43fe7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:39.115136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-74fd6bb8-f2a1-4d03-8669-adaba89b9efe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93ee771e50474e268eae2fed07e43fe7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:39.123242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5bf3f-bfb4-45bf-b540-b5ddd61d71d7 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:39.124816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5bf3f-bfb4-45bf-b540-b5ddd61d71d7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:39.126241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5bf3f-bfb4-45bf-b540-b5ddd61d71d7 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:39.129790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-74fd6bb8-f2a1-4d03-8669-adaba89b9efe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93ee771e50474e268eae2fed07e43fe7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:39.130230 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1061/2092] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:01:39 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:01:39.130959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-74fd6bb8-f2a1-4d03-8669-adaba89b9efe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93ee771e50474e268eae2fed07e43fe7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:39.134173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5bf3f-bfb4-45bf-b540-b5ddd61d71d7 None None] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:01:39.136813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0ea5bf3f-bfb4-45bf-b540-b5ddd61d71d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:39.145213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:39.153614 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1032/2093] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:38 2022] DELETE /identity/v3/users/93ee771e50474e268eae2fed07e43fe7 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:39.154721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd6bb8-f2a1-4d03-8669-adaba89b9efe admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:39.157686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-74fd6bb8-f2a1-4d03-8669-adaba89b9efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:39.269856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd6bb8-f2a1-4d03-8669-adaba89b9efe admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:39.274646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5bf3f-bfb4-45bf-b540-b5ddd61d71d7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:39.276636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0ea5bf3f-bfb4-45bf-b540-b5ddd61d71d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:39.277650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edb116-3c56-4926-b0d8-0c0745c8f9d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:39.278550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edb116-3c56-4926-b0d8-0c0745c8f9d7 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:39.278847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edb116-3c56-4926-b0d8-0c0745c8f9d7 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:39.279146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edb116-3c56-4926-b0d8-0c0745c8f9d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:39.292339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-41edb116-3c56-4926-b0d8-0c0745c8f9d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:39.296196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5bf3f-bfb4-45bf-b540-b5ddd61d71d7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:39.313755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edb116-3c56-4926-b0d8-0c0745c8f9d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:39.315627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edb116-3c56-4926-b0d8-0c0745c8f9d7 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:39.333127 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1033/2094] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:39.334648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301e883-f697-4ea2-bf47-7b5bef0b7dbc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:39.334945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301e883-f697-4ea2-bf47-7b5bef0b7dbc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:39.335225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301e883-f697-4ea2-bf47-7b5bef0b7dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:39.359982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0301e883-f697-4ea2-bf47-7b5bef0b7dbc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:39.361540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0301e883-f697-4ea2-bf47-7b5bef0b7dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:39.456905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5635e0-61c6-4ea7-ad03-2b46de880430 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5019c7e61b604023a14f43054cd8e4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd11e2bfd5060402bbf2770a6f85accef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:39.457799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5635e0-61c6-4ea7-ad03-2b46de880430 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:39.458141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5635e0-61c6-4ea7-ad03-2b46de880430 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:39.458549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5635e0-61c6-4ea7-ad03-2b46de880430 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] PATH_INFO: `/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:39.459935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5635e0-61c6-4ea7-ad03-2b46de880430 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: Authorizing `identity:get_project(project_id=05e9a9bafd714ea0b51c28c6ff4accc7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:39.462267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5635e0-61c6-4ea7-ad03-2b46de880430 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:39.465428 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1062/2095] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:01:39 2022] GET /identity/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7 => generated 381 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:01:39.539327 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1034/2096] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:39.547054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5635e0-61c6-4ea7-ad03-2b46de880430 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:39.552508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8f5635e0-61c6-4ea7-ad03-2b46de880430 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:39.711270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5635e0-61c6-4ea7-ad03-2b46de880430 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:39.717913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84ad4f-dafb-4668-8ebf-c19d00c75544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:39.718104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84ad4f-dafb-4668-8ebf-c19d00c75544 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:39.718336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84ad4f-dafb-4668-8ebf-c19d00c75544 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:39.719725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84ad4f-dafb-4668-8ebf-c19d00c75544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:39.734642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84ad4f-dafb-4668-8ebf-c19d00c75544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:39.738494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84ad4f-dafb-4668-8ebf-c19d00c75544 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:39.771559 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1063/2097] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:40.184477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301e883-f697-4ea2-bf47-7b5bef0b7dbc None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:40.186725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0301e883-f697-4ea2-bf47-7b5bef0b7dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:40.216954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301e883-f697-4ea2-bf47-7b5bef0b7dbc None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:40.224140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf1506-0711-45c0-8683-1480d280b9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:40.224940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf1506-0711-45c0-8683-1480d280b9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:40.225478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf1506-0711-45c0-8683-1480d280b9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:40.225901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf1506-0711-45c0-8683-1480d280b9ac admin admin] PATH_INFO: `/v3/projects/6e222c39108c4ab787d3576d5215aeea` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:40.229096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf1506-0711-45c0-8683-1480d280b9ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e222c39108c4ab787d3576d5215aeea)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:40.231100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf1506-0711-45c0-8683-1480d280b9ac admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:40.293575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:40.310576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7dcf1506-0711-45c0-8683-1480d280b9ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e222c39108c4ab787d3576d5215aeea', 'request_id': 'req-7dcf1506-0711-45c0-8683-1480d280b9ac'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:40.319688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7dcf1506-0711-45c0-8683-1480d280b9ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e222c39108c4ab787d3576d5215aeea', 'request_id': 'req-7dcf1506-0711-45c0-8683-1480d280b9ac'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:40.330921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7dcf1506-0711-45c0-8683-1480d280b9ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e222c39108c4ab787d3576d5215aeea', 'request_id': 'req-7dcf1506-0711-45c0-8683-1480d280b9ac'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:40.366399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7dcf1506-0711-45c0-8683-1480d280b9ac admin admin] The token cache is being invalidate because project 6e222c39108c4ab787d3576d5215aeea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:40.368078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7dcf1506-0711-45c0-8683-1480d280b9ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:40.368555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7dcf1506-0711-45c0-8683-1480d280b9ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:40.371655 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1035/2098] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:40 2022] DELETE /identity/v3/projects/6e222c39108c4ab787d3576d5215aeea => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:40.375834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84ad4f-dafb-4668-8ebf-c19d00c75544 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:40.393943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84ad4f-dafb-4668-8ebf-c19d00c75544 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:40.492814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07cb15-c18e-44e0-be2b-df88369f1251 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:40.493454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07cb15-c18e-44e0-be2b-df88369f1251 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:40.493919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07cb15-c18e-44e0-be2b-df88369f1251 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:40.497087 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1036/2099] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:01:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 21:01:40.512933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07cb15-c18e-44e0-be2b-df88369f1251 None None] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:01:40.516057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6f07cb15-c18e-44e0-be2b-df88369f1251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:40.516277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:40.551469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be998d60-cb7f-4fe0-94a2-60a090bd7848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:40.552276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be998d60-cb7f-4fe0-94a2-60a090bd7848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:40.552511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be998d60-cb7f-4fe0-94a2-60a090bd7848 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:40.552872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be998d60-cb7f-4fe0-94a2-60a090bd7848 admin admin] PATH_INFO: `/v3/users/031c01115e984a92b0141f752b38681a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:40.554173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be998d60-cb7f-4fe0-94a2-60a090bd7848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=031c01115e984a92b0141f752b38681a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:40.560607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be998d60-cb7f-4fe0-94a2-60a090bd7848 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:40.651353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-be998d60-cb7f-4fe0-94a2-60a090bd7848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '031c01115e984a92b0141f752b38681a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:40.653091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-be998d60-cb7f-4fe0-94a2-60a090bd7848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '031c01115e984a92b0141f752b38681a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:40.676190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-be998d60-cb7f-4fe0-94a2-60a090bd7848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '031c01115e984a92b0141f752b38681a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:40.676974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-be998d60-cb7f-4fe0-94a2-60a090bd7848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '031c01115e984a92b0141f752b38681a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:40.694646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07cb15-c18e-44e0-be2b-df88369f1251 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:40.694784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-be998d60-cb7f-4fe0-94a2-60a090bd7848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '031c01115e984a92b0141f752b38681a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:40.698313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6f07cb15-c18e-44e0-be2b-df88369f1251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:40.739478 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1064/2100] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:40 2022] DELETE /identity/v3/users/031c01115e984a92b0141f752b38681a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:40.860063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07cb15-c18e-44e0-be2b-df88369f1251 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:40.955436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e30538-a25d-4a80-8215-0dd1c8b2088d tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5019c7e61b604023a14f43054cd8e4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd11e2bfd5060402bbf2770a6f85accef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:40.958385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e30538-a25d-4a80-8215-0dd1c8b2088d tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:40.958867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e30538-a25d-4a80-8215-0dd1c8b2088d tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:40.959549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e30538-a25d-4a80-8215-0dd1c8b2088d tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] PATH_INFO: `/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:40.964254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e30538-a25d-4a80-8215-0dd1c8b2088d tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: Authorizing `identity:get_project(project_id=05e9a9bafd714ea0b51c28c6ff4accc7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:40.966758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e30538-a25d-4a80-8215-0dd1c8b2088d tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:40.982742 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1037/2101] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:01:40 2022] GET /identity/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7 => generated 381 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:01:41.219580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009cf66-6709-4c40-b0e4-ef41c1ae9df7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:41.219879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009cf66-6709-4c40-b0e4-ef41c1ae9df7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:41.220683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009cf66-6709-4c40-b0e4-ef41c1ae9df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:41.275898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2009cf66-6709-4c40-b0e4-ef41c1ae9df7 None None] MFA Rules not processed for user `1f7977e44d4b4ad6b5b2e40317492629`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:41.280635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2009cf66-6709-4c40-b0e4-ef41c1ae9df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:41.406709 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1065/2102] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:41.679422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e30538-a25d-4a80-8215-0dd1c8b2088d tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:41.688576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d4e30538-a25d-4a80-8215-0dd1c8b2088d tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:41.690881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:41.874426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e30538-a25d-4a80-8215-0dd1c8b2088d tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:41.890349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8838d42-a411-4a6c-aa18-0d685baf35ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:41.891418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8838d42-a411-4a6c-aa18-0d685baf35ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:41.891858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8838d42-a411-4a6c-aa18-0d685baf35ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:41.892723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8838d42-a411-4a6c-aa18-0d685baf35ed admin admin] PATH_INFO: `/v3/projects/ebf176735f054d2ea9300d40fa8671c8` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:41.896448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8838d42-a411-4a6c-aa18-0d685baf35ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebf176735f054d2ea9300d40fa8671c8)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:41.899910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8838d42-a411-4a6c-aa18-0d685baf35ed admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:41.996673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b8838d42-a411-4a6c-aa18-0d685baf35ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebf176735f054d2ea9300d40fa8671c8', 'request_id': 'req-b8838d42-a411-4a6c-aa18-0d685baf35ed'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:42.010459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b8838d42-a411-4a6c-aa18-0d685baf35ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebf176735f054d2ea9300d40fa8671c8', 'request_id': 'req-b8838d42-a411-4a6c-aa18-0d685baf35ed'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:42.022784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b8838d42-a411-4a6c-aa18-0d685baf35ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebf176735f054d2ea9300d40fa8671c8', 'request_id': 'req-b8838d42-a411-4a6c-aa18-0d685baf35ed'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:42.040282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b8838d42-a411-4a6c-aa18-0d685baf35ed admin admin] The token cache is being invalidate because project ebf176735f054d2ea9300d40fa8671c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:42.040965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b8838d42-a411-4a6c-aa18-0d685baf35ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:42.041667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b8838d42-a411-4a6c-aa18-0d685baf35ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:42.044573 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1038/2103] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:41 2022] DELETE /identity/v3/projects/ebf176735f054d2ea9300d40fa8671c8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:42.051688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5924329-829f-4fa1-811a-6bee43d9d767 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:42.052227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5924329-829f-4fa1-811a-6bee43d9d767 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:42.052316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5924329-829f-4fa1-811a-6bee43d9d767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:42.100416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c5924329-829f-4fa1-811a-6bee43d9d767 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:42.102237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c5924329-829f-4fa1-811a-6bee43d9d767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:42.282189 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1066/2104] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:42.286381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c13d08-96cf-4703-a1f7-721156b2ca23 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:42.286902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c13d08-96cf-4703-a1f7-721156b2ca23 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:42.287373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c13d08-96cf-4703-a1f7-721156b2ca23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:42.342982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-11c13d08-96cf-4703-a1f7-721156b2ca23 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:42.346488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-11c13d08-96cf-4703-a1f7-721156b2ca23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:42.371676 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1039/2105] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:42.375771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5924329-829f-4fa1-811a-6bee43d9d767 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:42.401942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5924329-829f-4fa1-811a-6bee43d9d767 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:42.407599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627aa34-75b2-4643-8566-668a281ae525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:42.408493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627aa34-75b2-4643-8566-668a281ae525 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:42.408786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627aa34-75b2-4643-8566-668a281ae525 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:42.409673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627aa34-75b2-4643-8566-668a281ae525 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:42.410441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627aa34-75b2-4643-8566-668a281ae525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:01:42.410754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627aa34-75b2-4643-8566-668a281ae525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:42.417686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627aa34-75b2-4643-8566-668a281ae525 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:42.420006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:42.454256 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1067/2106] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:01:42.455266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c13d08-96cf-4703-a1f7-721156b2ca23 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:42.467908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c13d08-96cf-4703-a1f7-721156b2ca23 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:42.476794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314a910-9e67-4109-ac78-1e5890caaac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:42.477880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314a910-9e67-4109-ac78-1e5890caaac5 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:42.478372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314a910-9e67-4109-ac78-1e5890caaac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:42.478965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314a910-9e67-4109-ac78-1e5890caaac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:42.480539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314a910-9e67-4109-ac78-1e5890caaac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:42.482847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314a910-9e67-4109-ac78-1e5890caaac5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:42.559088 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1040/2107] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:42 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:42.560908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627aa34-75b2-4643-8566-668a281ae525 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:42.572671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627aa34-75b2-4643-8566-668a281ae525 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:42.740661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ce43a-de9c-4c55-b11f-f36899884478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:42.741736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ce43a-de9c-4c55-b11f-f36899884478 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:42.742514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ce43a-de9c-4c55-b11f-f36899884478 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:42.744999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ce43a-de9c-4c55-b11f-f36899884478 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:42.747647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ce43a-de9c-4c55-b11f-f36899884478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:42.751128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ce43a-de9c-4c55-b11f-f36899884478 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:42.786898 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1068/2108] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:42 2022] POST /identity/v3/users => generated 296 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:42.791441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314a910-9e67-4109-ac78-1e5890caaac5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:42.796633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ce43a-de9c-4c55-b11f-f36899884478 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:42.808092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-295ce43a-de9c-4c55-b11f-f36899884478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:42.820038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314a910-9e67-4109-ac78-1e5890caaac5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:42.860426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ce43a-de9c-4c55-b11f-f36899884478 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:42.876519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b9272-fde7-453f-8fa5-5f2bcc1180a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:42.877632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b9272-fde7-453f-8fa5-5f2bcc1180a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:42.888298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b9272-fde7-453f-8fa5-5f2bcc1180a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:42.888720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b9272-fde7-453f-8fa5-5f2bcc1180a5 admin admin] PATH_INFO: `/v3/users/9ead5ffce65e49c1a87fe7028c9ec10e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:42.890553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dacfe-5436-4ce5-a342-3df3818836b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:42.891577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b9272-fde7-453f-8fa5-5f2bcc1180a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ead5ffce65e49c1a87fe7028c9ec10e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:42.893536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dacfe-5436-4ce5-a342-3df3818836b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:42.893897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dacfe-5436-4ce5-a342-3df3818836b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:42.896468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b9272-fde7-453f-8fa5-5f2bcc1180a5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:42.898132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dacfe-5436-4ce5-a342-3df3818836b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:42.900724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80dacfe-5436-4ce5-a342-3df3818836b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:42.907029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80dacfe-5436-4ce5-a342-3df3818836b3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:42.981509 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1041/2109] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:42.986888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691de80f-b442-4c6a-8aa9-098b5f286595 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:42.987554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691de80f-b442-4c6a-8aa9-098b5f286595 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:42.988899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691de80f-b442-4c6a-8aa9-098b5f286595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:43.020563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-691de80f-b442-4c6a-8aa9-098b5f286595 None None] MFA Rules not processed for user `96815c6776f1464a8b6350b4a52d4548`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:43.023404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-691de80f-b442-4c6a-8aa9-098b5f286595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:43.083790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-733b9272-fde7-453f-8fa5-5f2bcc1180a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ead5ffce65e49c1a87fe7028c9ec10e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:43.084518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-733b9272-fde7-453f-8fa5-5f2bcc1180a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ead5ffce65e49c1a87fe7028c9ec10e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:43.139973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-733b9272-fde7-453f-8fa5-5f2bcc1180a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ead5ffce65e49c1a87fe7028c9ec10e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:43.140765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-733b9272-fde7-453f-8fa5-5f2bcc1180a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ead5ffce65e49c1a87fe7028c9ec10e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:43.167732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-733b9272-fde7-453f-8fa5-5f2bcc1180a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ead5ffce65e49c1a87fe7028c9ec10e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:43.174813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:43.209913 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1042/2110] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:43.211090 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1069/2111] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:42 2022] DELETE /identity/v3/users/9ead5ffce65e49c1a87fe7028c9ec10e => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:43.215186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691de80f-b442-4c6a-8aa9-098b5f286595 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:43.215513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd1644-7ce2-4823-975a-ecf663f1962e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:43.215819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd1644-7ce2-4823-975a-ecf663f1962e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:43.216102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd1644-7ce2-4823-975a-ecf663f1962e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:43.218797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-691de80f-b442-4c6a-8aa9-098b5f286595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:43.264699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691de80f-b442-4c6a-8aa9-098b5f286595 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:43.265869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-77dd1644-7ce2-4823-975a-ecf663f1962e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:43.267145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-77dd1644-7ce2-4823-975a-ecf663f1962e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:43.402240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:43.419108 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1070/2112] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:01:43.420841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f39634-b70a-4384-b0b0-520b55c2ab48 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:43.422370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f39634-b70a-4384-b0b0-520b55c2ab48 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:43.422826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f39634-b70a-4384-b0b0-520b55c2ab48 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:43.429303 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1071/2113] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:01:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:01:43.429961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781d0d2-bd79-4038-8768-ac934ee903e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:43.431389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781d0d2-bd79-4038-8768-ac934ee903e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:43.432187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781d0d2-bd79-4038-8768-ac934ee903e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:43.433133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781d0d2-bd79-4038-8768-ac934ee903e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:43.434108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781d0d2-bd79-4038-8768-ac934ee903e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:43.436062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781d0d2-bd79-4038-8768-ac934ee903e0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:43.436222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f39634-b70a-4384-b0b0-520b55c2ab48 None None] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:01:43.438047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e5f39634-b70a-4384-b0b0-520b55c2ab48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:43.451108 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1043/2114] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:43.455237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781d0d2-bd79-4038-8768-ac934ee903e0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:43.458024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f781d0d2-bd79-4038-8768-ac934ee903e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:43.596720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781d0d2-bd79-4038-8768-ac934ee903e0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:43.608596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5df158-418f-4433-a616-df823e234204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:43.611022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5df158-418f-4433-a616-df823e234204 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:43.612514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5df158-418f-4433-a616-df823e234204 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:43.613736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5df158-418f-4433-a616-df823e234204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:43.625856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f39634-b70a-4384-b0b0-520b55c2ab48 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:43.628342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e5f39634-b70a-4384-b0b0-520b55c2ab48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:43.641593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5df158-418f-4433-a616-df823e234204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:43.643532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5df158-418f-4433-a616-df823e234204 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:43.671968 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1044/2115] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:01:43.673214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5df158-418f-4433-a616-df823e234204 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:43.699462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5df158-418f-4433-a616-df823e234204 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:43.716927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f330d52-d642-4855-a47d-507565d0c67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:43.720197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f330d52-d642-4855-a47d-507565d0c67c admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:43.720530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f330d52-d642-4855-a47d-507565d0c67c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:43.720840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f330d52-d642-4855-a47d-507565d0c67c admin admin] PATH_INFO: `/v3/projects/30c86afcd3804982b67c880e35232547/users/9209dce9071b465393680fb6c5b0d409/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:43.774950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f330d52-d642-4855-a47d-507565d0c67c admin admin] RBAC: Authorizing `identity:create_grant(project_id=30c86afcd3804982b67c880e35232547, user_id=9209dce9071b465393680fb6c5b0d409, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:43.782058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f330d52-d642-4855-a47d-507565d0c67c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:43.798843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f39634-b70a-4384-b0b0-520b55c2ab48 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:43.818782 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1045/2116] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:43 2022] PUT /identity/v3/projects/30c86afcd3804982b67c880e35232547/users/9209dce9071b465393680fb6c5b0d409/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:43.821836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ea725-3caf-40c8-b2e6-1bf569c94348 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:43.823363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ea725-3caf-40c8-b2e6-1bf569c94348 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:43.823933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ea725-3caf-40c8-b2e6-1bf569c94348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:43.957186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-271ea725-3caf-40c8-b2e6-1bf569c94348 None None] MFA Rules not processed for user `9209dce9071b465393680fb6c5b0d409`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:43.958453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-271ea725-3caf-40c8-b2e6-1bf569c94348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:44.040462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a749fd0-ad42-4ae7-b765-5b8fe6eec398 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5019c7e61b604023a14f43054cd8e4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd11e2bfd5060402bbf2770a6f85accef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:44.043427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a749fd0-ad42-4ae7-b765-5b8fe6eec398 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:44.043758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a749fd0-ad42-4ae7-b765-5b8fe6eec398 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:44.045197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a749fd0-ad42-4ae7-b765-5b8fe6eec398 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] PATH_INFO: `/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:44.048756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a749fd0-ad42-4ae7-b765-5b8fe6eec398 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: Authorizing `identity:get_project(project_id=05e9a9bafd714ea0b51c28c6ff4accc7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:44.057092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a749fd0-ad42-4ae7-b765-5b8fe6eec398 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:44.061497 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1072/2117] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:01:43 2022] GET /identity/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7 => generated 381 bytes in 626 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:01:44.081491 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1046/2118] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:44.086841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a749fd0-ad42-4ae7-b765-5b8fe6eec398 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:44.178440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:44.218330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a749fd0-ad42-4ae7-b765-5b8fe6eec398 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:44.235177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c7880-8690-4d5e-81ee-12993b990067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:44.235927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c7880-8690-4d5e-81ee-12993b990067 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:44.236322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c7880-8690-4d5e-81ee-12993b990067 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:44.236663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c7880-8690-4d5e-81ee-12993b990067 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:44.239362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c7880-8690-4d5e-81ee-12993b990067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:44.243406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c7880-8690-4d5e-81ee-12993b990067 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:44.301960 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1073/2119] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:44 2022] POST /identity/v3/projects => generated 389 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:44.307209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ea725-3caf-40c8-b2e6-1bf569c94348 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:44.316578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:44.322165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac28137-ab7d-4f8e-8e31-dab9a77f054a None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:44.322468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac28137-ab7d-4f8e-8e31-dab9a77f054a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:44.322760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac28137-ab7d-4f8e-8e31-dab9a77f054a None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:44.324471 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1074/2120] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:01:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:01:44.329421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ea725-3caf-40c8-b2e6-1bf569c94348 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:44.335040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac28137-ab7d-4f8e-8e31-dab9a77f054a None None] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:01:44.477564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac28137-ab7d-4f8e-8e31-dab9a77f054a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:44.524397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fffc6-3de9-429d-9a65-b7e9a65a7049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:44.525170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fffc6-3de9-429d-9a65-b7e9a65a7049 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:44.525437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fffc6-3de9-429d-9a65-b7e9a65a7049 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:44.525719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fffc6-3de9-429d-9a65-b7e9a65a7049 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:44.528974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fffc6-3de9-429d-9a65-b7e9a65a7049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:44.533839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fffc6-3de9-429d-9a65-b7e9a65a7049 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:44.582055 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1047/2121] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:44 2022] POST /identity/v3/users => generated 301 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:44.591993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fffc6-3de9-429d-9a65-b7e9a65a7049 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:44.606379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac28137-ab7d-4f8e-8e31-dab9a77f054a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:44.615037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb6e92-81c4-4232-a992-3cc23074147e tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5019c7e61b604023a14f43054cd8e4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd11e2bfd5060402bbf2770a6f85accef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:44.616081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb6e92-81c4-4232-a992-3cc23074147e tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:44.617400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb6e92-81c4-4232-a992-3cc23074147e tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:44.617778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb6e92-81c4-4232-a992-3cc23074147e tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] PATH_INFO: `/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:44.621137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb6e92-81c4-4232-a992-3cc23074147e tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: Authorizing `identity:get_project(project_id=05e9a9bafd714ea0b51c28c6ff4accc7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:44.624016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb6e92-81c4-4232-a992-3cc23074147e tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:44.627280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fffc6-3de9-429d-9a65-b7e9a65a7049 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:44.638791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afae7f1-8025-45a9-b686-87c22abc8502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:44.639042 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1075/2122] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:01:44 2022] GET /identity/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7 => generated 381 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:01:44.639896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afae7f1-8025-45a9-b686-87c22abc8502 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:44.640270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afae7f1-8025-45a9-b686-87c22abc8502 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:44.640950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afae7f1-8025-45a9-b686-87c22abc8502 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:44.642233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afae7f1-8025-45a9-b686-87c22abc8502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:44.650350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afae7f1-8025-45a9-b686-87c22abc8502 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:44.678544 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1048/2123] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:44.684077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb6e92-81c4-4232-a992-3cc23074147e tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:44.706969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb6e92-81c4-4232-a992-3cc23074147e tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:44.716011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04d4d7-5af2-48cc-bbfc-832618ce3b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:44.718816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04d4d7-5af2-48cc-bbfc-832618ce3b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:44.719415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04d4d7-5af2-48cc-bbfc-832618ce3b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:44.720785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04d4d7-5af2-48cc-bbfc-832618ce3b0a admin admin] PATH_INFO: `/v3/projects/0be0ad724d6847f1bc9f51de4d604cad/users/92808d1e2b094e85a0771d962b736417/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:44.752498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04d4d7-5af2-48cc-bbfc-832618ce3b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be0ad724d6847f1bc9f51de4d604cad, user_id=92808d1e2b094e85a0771d962b736417, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:44.757372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04d4d7-5af2-48cc-bbfc-832618ce3b0a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:44.787333 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1076/2124] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:44 2022] PUT /identity/v3/projects/0be0ad724d6847f1bc9f51de4d604cad/users/92808d1e2b094e85a0771d962b736417/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:44.790125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afae7f1-8025-45a9-b686-87c22abc8502 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:44.793888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04d4d7-5af2-48cc-bbfc-832618ce3b0a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:44.798838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5f04d4d7-5af2-48cc-bbfc-832618ce3b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:44.807855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afae7f1-8025-45a9-b686-87c22abc8502 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:44.937732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eba529-6b24-4ae3-85be-fdd83ab7312f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:44.938696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eba529-6b24-4ae3-85be-fdd83ab7312f admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:44.939757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eba529-6b24-4ae3-85be-fdd83ab7312f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:44.939757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eba529-6b24-4ae3-85be-fdd83ab7312f admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:44.940689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eba529-6b24-4ae3-85be-fdd83ab7312f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:44.943160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eba529-6b24-4ae3-85be-fdd83ab7312f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:44.950975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:45.014014 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1049/2125] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:45.016072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0aaa1-8269-4b9c-ba2c-82c2cdbdf9bc None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:45.016934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0aaa1-8269-4b9c-ba2c-82c2cdbdf9bc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:45.017414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0aaa1-8269-4b9c-ba2c-82c2cdbdf9bc None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:45.022534 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1050/2126] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:01:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:01:45.023901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0aaa1-8269-4b9c-ba2c-82c2cdbdf9bc None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:45.030510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d7b0aaa1-8269-4b9c-ba2c-82c2cdbdf9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:45.042131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04d4d7-5af2-48cc-bbfc-832618ce3b0a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:45.049834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383396cb-f1cc-4119-94b7-934c408500a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:45.050343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383396cb-f1cc-4119-94b7-934c408500a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:45.050634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383396cb-f1cc-4119-94b7-934c408500a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:45.050921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383396cb-f1cc-4119-94b7-934c408500a5 admin admin] PATH_INFO: `/v3/users/950f96b926474852acb90a959e369999` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:45.053341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383396cb-f1cc-4119-94b7-934c408500a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=950f96b926474852acb90a959e369999)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:45.057871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383396cb-f1cc-4119-94b7-934c408500a5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:45.074605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0aaa1-8269-4b9c-ba2c-82c2cdbdf9bc None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:45.088752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e034e84-d270-434f-a876-c62d6d34be2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:45.089701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e034e84-d270-434f-a876-c62d6d34be2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:45.089996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e034e84-d270-434f-a876-c62d6d34be2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:45.090281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e034e84-d270-434f-a876-c62d6d34be2d admin admin] PATH_INFO: `/v3/projects/ff7bd6e94c0e4dd19031469571cfd844` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:45.093813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e034e84-d270-434f-a876-c62d6d34be2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff7bd6e94c0e4dd19031469571cfd844)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:45.095811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e034e84-d270-434f-a876-c62d6d34be2d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:45.171787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-383396cb-f1cc-4119-94b7-934c408500a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '950f96b926474852acb90a959e369999'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:45.173010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-383396cb-f1cc-4119-94b7-934c408500a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '950f96b926474852acb90a959e369999'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:45.197677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4e034e84-d270-434f-a876-c62d6d34be2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff7bd6e94c0e4dd19031469571cfd844', 'request_id': 'req-4e034e84-d270-434f-a876-c62d6d34be2d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:45.199372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-383396cb-f1cc-4119-94b7-934c408500a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '950f96b926474852acb90a959e369999'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:45.201835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-383396cb-f1cc-4119-94b7-934c408500a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '950f96b926474852acb90a959e369999'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:45.212746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4e034e84-d270-434f-a876-c62d6d34be2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff7bd6e94c0e4dd19031469571cfd844', 'request_id': 'req-4e034e84-d270-434f-a876-c62d6d34be2d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:45.218069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-383396cb-f1cc-4119-94b7-934c408500a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '950f96b926474852acb90a959e369999'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:45.229494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4e034e84-d270-434f-a876-c62d6d34be2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff7bd6e94c0e4dd19031469571cfd844', 'request_id': 'req-4e034e84-d270-434f-a876-c62d6d34be2d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:45.243523 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1077/2127] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:44 2022] DELETE /identity/v3/users/950f96b926474852acb90a959e369999 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:01:45.244493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383396cb-f1cc-4119-94b7-934c408500a5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:45.247234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-383396cb-f1cc-4119-94b7-934c408500a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:45.253224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4e034e84-d270-434f-a876-c62d6d34be2d admin admin] The token cache is being invalidate because project ff7bd6e94c0e4dd19031469571cfd844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:45.254631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4e034e84-d270-434f-a876-c62d6d34be2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:45.257372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4e034e84-d270-434f-a876-c62d6d34be2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:45.260788 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1051/2128] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:45 2022] DELETE /identity/v3/projects/ff7bd6e94c0e4dd19031469571cfd844 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:45.261673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e034e84-d270-434f-a876-c62d6d34be2d admin admin] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:01:45.264212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4e034e84-d270-434f-a876-c62d6d34be2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:45.278692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:45.398332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383396cb-f1cc-4119-94b7-934c408500a5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:45.408168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fbdbd-ee9f-4512-b0ca-1d8a2862b8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:45.408880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fbdbd-ee9f-4512-b0ca-1d8a2862b8ab admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:45.409170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fbdbd-ee9f-4512-b0ca-1d8a2862b8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:45.409455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fbdbd-ee9f-4512-b0ca-1d8a2862b8ab admin admin] PATH_INFO: `/v3/projects/0be0ad724d6847f1bc9f51de4d604cad/users/92808d1e2b094e85a0771d962b736417/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:45.410615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e034e84-d270-434f-a876-c62d6d34be2d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:45.412279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4e034e84-d270-434f-a876-c62d6d34be2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:45.414745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fbdbd-ee9f-4512-b0ca-1d8a2862b8ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be0ad724d6847f1bc9f51de4d604cad, user_id=92808d1e2b094e85a0771d962b736417, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:45.420669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fbdbd-ee9f-4512-b0ca-1d8a2862b8ab admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:45.446704 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1078/2129] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:45 2022] PUT /identity/v3/projects/0be0ad724d6847f1bc9f51de4d604cad/users/92808d1e2b094e85a0771d962b736417/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:45.457980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67204a3a-ad03-4941-a11b-99afeae44e83 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:45.458284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67204a3a-ad03-4941-a11b-99afeae44e83 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:45.458549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67204a3a-ad03-4941-a11b-99afeae44e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:45.505729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-67204a3a-ad03-4941-a11b-99afeae44e83 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:45.507049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-67204a3a-ad03-4941-a11b-99afeae44e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:45.520657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e034e84-d270-434f-a876-c62d6d34be2d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:45.602293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7bfcc-8024-4f22-b343-c1e0230e5591 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5019c7e61b604023a14f43054cd8e4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd11e2bfd5060402bbf2770a6f85accef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:45.603144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7bfcc-8024-4f22-b343-c1e0230e5591 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:45.603478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7bfcc-8024-4f22-b343-c1e0230e5591 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:45.603878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7bfcc-8024-4f22-b343-c1e0230e5591 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] PATH_INFO: `/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:45.605715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7bfcc-8024-4f22-b343-c1e0230e5591 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: Authorizing `identity:get_project(project_id=05e9a9bafd714ea0b51c28c6ff4accc7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:45.608336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7bfcc-8024-4f22-b343-c1e0230e5591 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:45.611667 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1052/2130] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:01:45 2022] GET /identity/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7 => generated 381 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:01:45.612769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7bfcc-8024-4f22-b343-c1e0230e5591 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:45.614759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-59f7bfcc-8024-4f22-b343-c1e0230e5591 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:45.617089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:45.663657 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1079/2131] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:45.665139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca81be-0551-49ab-870f-3f8538cf6ead None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:45.665430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca81be-0551-49ab-870f-3f8538cf6ead None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:45.665714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca81be-0551-49ab-870f-3f8538cf6ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:45.724368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c3ca81be-0551-49ab-870f-3f8538cf6ead None None] MFA Rules not processed for user `92808d1e2b094e85a0771d962b736417`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:45.725712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c3ca81be-0551-49ab-870f-3f8538cf6ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:45.794574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:45.843861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7bfcc-8024-4f22-b343-c1e0230e5591 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:45.860207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc38745-7d3d-4873-9fbe-58f5a1269851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:45.860981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc38745-7d3d-4873-9fbe-58f5a1269851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:45.861394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc38745-7d3d-4873-9fbe-58f5a1269851 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:45.861750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc38745-7d3d-4873-9fbe-58f5a1269851 admin admin] PATH_INFO: `/v3/users/a4b87dcc4fd645c89ae095a2a6a378f4` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:45.867586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc38745-7d3d-4873-9fbe-58f5a1269851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b87dcc4fd645c89ae095a2a6a378f4)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:45.871568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc38745-7d3d-4873-9fbe-58f5a1269851 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:45.938615 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1080/2132] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:45.945241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca81be-0551-49ab-870f-3f8538cf6ead None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:45.947260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c3ca81be-0551-49ab-870f-3f8538cf6ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:46.081820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ffc38745-7d3d-4873-9fbe-58f5a1269851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b87dcc4fd645c89ae095a2a6a378f4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:46.119843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca81be-0551-49ab-870f-3f8538cf6ead None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:46.128950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9e0ba-cf1c-46a8-afeb-48c83526fa28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:46.130224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9e0ba-cf1c-46a8-afeb-48c83526fa28 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:46.130623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9e0ba-cf1c-46a8-afeb-48c83526fa28 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:46.130984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9e0ba-cf1c-46a8-afeb-48c83526fa28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:46.143736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ffc38745-7d3d-4873-9fbe-58f5a1269851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b87dcc4fd645c89ae095a2a6a378f4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:46.145617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ffc38745-7d3d-4873-9fbe-58f5a1269851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b87dcc4fd645c89ae095a2a6a378f4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:46.166603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ffc38745-7d3d-4873-9fbe-58f5a1269851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b87dcc4fd645c89ae095a2a6a378f4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:46.168215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ffc38745-7d3d-4873-9fbe-58f5a1269851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b87dcc4fd645c89ae095a2a6a378f4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:46.190382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9e0ba-cf1c-46a8-afeb-48c83526fa28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:46.192111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9e0ba-cf1c-46a8-afeb-48c83526fa28 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:46.203142 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1053/2133] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:45 2022] DELETE /identity/v3/users/a4b87dcc4fd645c89ae095a2a6a378f4 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:46.207317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b845ef-b8a1-4804-86ac-1f258951e6c9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:46.209645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b845ef-b8a1-4804-86ac-1f258951e6c9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:46.209989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b845ef-b8a1-4804-86ac-1f258951e6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:46.236773 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1081/2134] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:46.263783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-08b845ef-b8a1-4804-86ac-1f258951e6c9 None None] MFA Rules not processed for user `1f7977e44d4b4ad6b5b2e40317492629`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:46.268036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-08b845ef-b8a1-4804-86ac-1f258951e6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:46.416662 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1054/2135] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:46.566732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9e0ba-cf1c-46a8-afeb-48c83526fa28 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:46.568713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-54a9e0ba-cf1c-46a8-afeb-48c83526fa28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:46.602894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b845ef-b8a1-4804-86ac-1f258951e6c9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:46.604349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-08b845ef-b8a1-4804-86ac-1f258951e6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:46.760234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b845ef-b8a1-4804-86ac-1f258951e6c9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:46.773557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9c559-137d-452b-8869-9b13d7a29500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:46.775156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9c559-137d-452b-8869-9b13d7a29500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:46.775875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9c559-137d-452b-8869-9b13d7a29500 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:46.775875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9c559-137d-452b-8869-9b13d7a29500 admin admin] PATH_INFO: `/v3/users/fab82c0aad8043b989b8d1b7bebd57a6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:46.780184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9c559-137d-452b-8869-9b13d7a29500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fab82c0aad8043b989b8d1b7bebd57a6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:46.786703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9c559-137d-452b-8869-9b13d7a29500 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:46.791652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9e0ba-cf1c-46a8-afeb-48c83526fa28 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:46.815006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:46.815233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:46.885272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-42a9c559-137d-452b-8869-9b13d7a29500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fab82c0aad8043b989b8d1b7bebd57a6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:46.919006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e706e-bd18-4952-a673-e680f22efa10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:46.919763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e706e-bd18-4952-a673-e680f22efa10 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:46.919973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e706e-bd18-4952-a673-e680f22efa10 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:46.920264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e706e-bd18-4952-a673-e680f22efa10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:46.924947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-42a9c559-137d-452b-8869-9b13d7a29500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fab82c0aad8043b989b8d1b7bebd57a6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:46.925793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e32e706e-bd18-4952-a673-e680f22efa10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:46.926051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-42a9c559-137d-452b-8869-9b13d7a29500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fab82c0aad8043b989b8d1b7bebd57a6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:46.942038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-42a9c559-137d-452b-8869-9b13d7a29500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fab82c0aad8043b989b8d1b7bebd57a6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:46.942800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-42a9c559-137d-452b-8869-9b13d7a29500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fab82c0aad8043b989b8d1b7bebd57a6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:46.981529 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1055/2136] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:46 2022] DELETE /identity/v3/users/fab82c0aad8043b989b8d1b7bebd57a6 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:46.998225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6bd33-9e11-4493-a7cf-a794da1fa02c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:47.001291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6bd33-9e11-4493-a7cf-a794da1fa02c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:47.001837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6bd33-9e11-4493-a7cf-a794da1fa02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:47.041066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e706e-bd18-4952-a673-e680f22efa10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:47.042716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e706e-bd18-4952-a673-e680f22efa10 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:47.051178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-35e6bd33-9e11-4493-a7cf-a794da1fa02c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:47.053200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-35e6bd33-9e11-4493-a7cf-a794da1fa02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:47.055514 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1082/2137] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:47.185148 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1056/2138] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:47.340304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e706e-bd18-4952-a673-e680f22efa10 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:47.342973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e32e706e-bd18-4952-a673-e680f22efa10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:47.373453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6bd33-9e11-4493-a7cf-a794da1fa02c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:47.375456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-35e6bd33-9e11-4493-a7cf-a794da1fa02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:47.402595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6bd33-9e11-4493-a7cf-a794da1fa02c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:47.415684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1b22b-f6f9-4dfb-9237-3434b8a1b1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:47.420131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1b22b-f6f9-4dfb-9237-3434b8a1b1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:47.421418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1b22b-f6f9-4dfb-9237-3434b8a1b1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:47.421918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1b22b-f6f9-4dfb-9237-3434b8a1b1bf admin admin] PATH_INFO: `/v3/projects/0e047bc76bc845649a0b0704a4931f7d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:47.428749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1b22b-f6f9-4dfb-9237-3434b8a1b1bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e047bc76bc845649a0b0704a4931f7d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:47.437040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1b22b-f6f9-4dfb-9237-3434b8a1b1bf admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:47.522107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c5e1b22b-f6f9-4dfb-9237-3434b8a1b1bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e047bc76bc845649a0b0704a4931f7d', 'request_id': 'req-c5e1b22b-f6f9-4dfb-9237-3434b8a1b1bf'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:47.530555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c5e1b22b-f6f9-4dfb-9237-3434b8a1b1bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e047bc76bc845649a0b0704a4931f7d', 'request_id': 'req-c5e1b22b-f6f9-4dfb-9237-3434b8a1b1bf'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:47.540143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c5e1b22b-f6f9-4dfb-9237-3434b8a1b1bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e047bc76bc845649a0b0704a4931f7d', 'request_id': 'req-c5e1b22b-f6f9-4dfb-9237-3434b8a1b1bf'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:47.556509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c5e1b22b-f6f9-4dfb-9237-3434b8a1b1bf admin admin] The token cache is being invalidate because project 0e047bc76bc845649a0b0704a4931f7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:47.556885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c5e1b22b-f6f9-4dfb-9237-3434b8a1b1bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:47.557665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c5e1b22b-f6f9-4dfb-9237-3434b8a1b1bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:47.559937 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1057/2139] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:47 2022] DELETE /identity/v3/projects/0e047bc76bc845649a0b0704a4931f7d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:01:47.561530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed920c2-cf8e-4300-9db9-602141a63e11 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:47.561893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed920c2-cf8e-4300-9db9-602141a63e11 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:47.562427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed920c2-cf8e-4300-9db9-602141a63e11 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:47.564068 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1058/2140] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:01:47.567221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed920c2-cf8e-4300-9db9-602141a63e11 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:47.571832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e706e-bd18-4952-a673-e680f22efa10 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:47.573042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-aed920c2-cf8e-4300-9db9-602141a63e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:47.604561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:47.688953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed920c2-cf8e-4300-9db9-602141a63e11 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:47.695834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9049692-8920-4cc4-a58c-cfd5621bd80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:47.696647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9049692-8920-4cc4-a58c-cfd5621bd80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:47.697007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9049692-8920-4cc4-a58c-cfd5621bd80f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:47.697364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9049692-8920-4cc4-a58c-cfd5621bd80f admin admin] PATH_INFO: `/v3/users/d75b01a28d5c40cb8f6570015c7cb807` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:47.699569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9049692-8920-4cc4-a58c-cfd5621bd80f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75b01a28d5c40cb8f6570015c7cb807)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:47.702097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9049692-8920-4cc4-a58c-cfd5621bd80f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:47.714168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca4309-5942-477c-a30a-61b9104387cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:47.715044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca4309-5942-477c-a30a-61b9104387cb service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:47.715539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca4309-5942-477c-a30a-61b9104387cb service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:47.715828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca4309-5942-477c-a30a-61b9104387cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:47.719524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ccca4309-5942-477c-a30a-61b9104387cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:47.770115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca4309-5942-477c-a30a-61b9104387cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:47.784205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca4309-5942-477c-a30a-61b9104387cb service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:47.790697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d9049692-8920-4cc4-a58c-cfd5621bd80f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75b01a28d5c40cb8f6570015c7cb807'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:47.818074 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1083/2141] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:47.820253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca4309-5942-477c-a30a-61b9104387cb service neutron] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:01:47.823629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ccca4309-5942-477c-a30a-61b9104387cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:47.844821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d9049692-8920-4cc4-a58c-cfd5621bd80f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75b01a28d5c40cb8f6570015c7cb807'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:47.846658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d9049692-8920-4cc4-a58c-cfd5621bd80f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75b01a28d5c40cb8f6570015c7cb807'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:47.854178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:47.890089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d9049692-8920-4cc4-a58c-cfd5621bd80f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75b01a28d5c40cb8f6570015c7cb807'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:47.892002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d9049692-8920-4cc4-a58c-cfd5621bd80f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75b01a28d5c40cb8f6570015c7cb807'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:47.928007 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1059/2142] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:47 2022] DELETE /identity/v3/users/d75b01a28d5c40cb8f6570015c7cb807 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:47.929557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9049692-8920-4cc4-a58c-cfd5621bd80f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:47.937661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d9049692-8920-4cc4-a58c-cfd5621bd80f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:48.029637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca4309-5942-477c-a30a-61b9104387cb service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:48.032343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ccca4309-5942-477c-a30a-61b9104387cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:48.167273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9049692-8920-4cc4-a58c-cfd5621bd80f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:48.189562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801ab6c-0528-48a6-9555-1d5da1eab965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:48.190245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801ab6c-0528-48a6-9555-1d5da1eab965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:48.190501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801ab6c-0528-48a6-9555-1d5da1eab965 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:48.190829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801ab6c-0528-48a6-9555-1d5da1eab965 admin admin] PATH_INFO: `/v3/projects/276e47b9c5bf488fa69b8e429c328cbf` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:48.192152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801ab6c-0528-48a6-9555-1d5da1eab965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=276e47b9c5bf488fa69b8e429c328cbf)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:48.194043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801ab6c-0528-48a6-9555-1d5da1eab965 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:48.215321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca4309-5942-477c-a30a-61b9104387cb service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:48.252050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:48.272290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9801ab6c-0528-48a6-9555-1d5da1eab965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '276e47b9c5bf488fa69b8e429c328cbf', 'request_id': 'req-9801ab6c-0528-48a6-9555-1d5da1eab965'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:48.281517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9801ab6c-0528-48a6-9555-1d5da1eab965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '276e47b9c5bf488fa69b8e429c328cbf', 'request_id': 'req-9801ab6c-0528-48a6-9555-1d5da1eab965'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:48.295261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9801ab6c-0528-48a6-9555-1d5da1eab965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '276e47b9c5bf488fa69b8e429c328cbf', 'request_id': 'req-9801ab6c-0528-48a6-9555-1d5da1eab965'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:48.309424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9801ab6c-0528-48a6-9555-1d5da1eab965 admin admin] The token cache is being invalidate because project 276e47b9c5bf488fa69b8e429c328cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:48.309735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9801ab6c-0528-48a6-9555-1d5da1eab965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:48.310420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9801ab6c-0528-48a6-9555-1d5da1eab965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:48.325388 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1060/2143] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:47 2022] DELETE /identity/v3/projects/276e47b9c5bf488fa69b8e429c328cbf => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:48.330666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87120cd-8f06-4677-815c-47be79975ceb None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:48.330916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87120cd-8f06-4677-815c-47be79975ceb None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:48.331278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87120cd-8f06-4677-815c-47be79975ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:48.378062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a87120cd-8f06-4677-815c-47be79975ceb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:48.379484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a87120cd-8f06-4677-815c-47be79975ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:48.386302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f069952-017a-4f16-9af2-eca9e79e673e tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5019c7e61b604023a14f43054cd8e4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd11e2bfd5060402bbf2770a6f85accef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:48.387143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f069952-017a-4f16-9af2-eca9e79e673e tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:48.387642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f069952-017a-4f16-9af2-eca9e79e673e tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:48.388659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f069952-017a-4f16-9af2-eca9e79e673e tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] PATH_INFO: `/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:48.394951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f069952-017a-4f16-9af2-eca9e79e673e tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: Authorizing `identity:get_project(project_id=05e9a9bafd714ea0b51c28c6ff4accc7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:48.399417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f069952-017a-4f16-9af2-eca9e79e673e tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:48.405122 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1084/2144] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:01:47 2022] GET /identity/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7 => generated 381 bytes in 586 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:01:48.482217 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1061/2145] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:48.484843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b318258-c265-41e0-afd0-95488d6fef50 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:48.485142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b318258-c265-41e0-afd0-95488d6fef50 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:48.485427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b318258-c265-41e0-afd0-95488d6fef50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:48.513567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8b318258-c265-41e0-afd0-95488d6fef50 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:48.514939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8b318258-c265-41e0-afd0-95488d6fef50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:48.550005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdb5cc-f4d9-49de-8fd7-3b417011fdcf None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:48.550947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdb5cc-f4d9-49de-8fd7-3b417011fdcf None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:48.551234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdb5cc-f4d9-49de-8fd7-3b417011fdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:48.570931 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1085/2146] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:48.572329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b318258-c265-41e0-afd0-95488d6fef50 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:48.589080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b318258-c265-41e0-afd0-95488d6fef50 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:48.595087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933cb11-053f-4ff8-afb1-9d9d2f975c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:48.595887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933cb11-053f-4ff8-afb1-9d9d2f975c6e admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:48.596093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933cb11-053f-4ff8-afb1-9d9d2f975c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:48.596383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933cb11-053f-4ff8-afb1-9d9d2f975c6e admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:48.597716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933cb11-053f-4ff8-afb1-9d9d2f975c6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:01:48.598205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933cb11-053f-4ff8-afb1-9d9d2f975c6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:48.601319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933cb11-053f-4ff8-afb1-9d9d2f975c6e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:48.621435 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1086/2147] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:01:48.624191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a2cdb5cc-f4d9-49de-8fd7-3b417011fdcf None None] MFA Rules not processed for user `1a356e21a90c407a9569cc57d5530e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:48.625488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a2cdb5cc-f4d9-49de-8fd7-3b417011fdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:48.628918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933cb11-053f-4ff8-afb1-9d9d2f975c6e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:48.672469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933cb11-053f-4ff8-afb1-9d9d2f975c6e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:48.697821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0f2cc-5a73-4e2a-9392-87592eb33207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:48.698604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0f2cc-5a73-4e2a-9392-87592eb33207 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:48.698897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0f2cc-5a73-4e2a-9392-87592eb33207 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:48.699176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0f2cc-5a73-4e2a-9392-87592eb33207 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:48.700136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0f2cc-5a73-4e2a-9392-87592eb33207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:48.702081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0f2cc-5a73-4e2a-9392-87592eb33207 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:48.789626 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1087/2148] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:48 2022] POST /identity/v3/projects => generated 409 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:48.789626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0f2cc-5a73-4e2a-9392-87592eb33207 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:48.809121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-38c0f2cc-5a73-4e2a-9392-87592eb33207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:48.840252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:48.862486 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1062/2149] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:48 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:48.864637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdb5cc-f4d9-49de-8fd7-3b417011fdcf None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:48.892734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdb5cc-f4d9-49de-8fd7-3b417011fdcf None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:48.959340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0f2cc-5a73-4e2a-9392-87592eb33207 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:48.967188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5480c4-48ec-4e8b-8e91-e1a1644317bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:48.969134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5480c4-48ec-4e8b-8e91-e1a1644317bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:48.969616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5480c4-48ec-4e8b-8e91-e1a1644317bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:48.970050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5480c4-48ec-4e8b-8e91-e1a1644317bd admin admin] PATH_INFO: `/v3/users/9209dce9071b465393680fb6c5b0d409` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:48.971583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5480c4-48ec-4e8b-8e91-e1a1644317bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9209dce9071b465393680fb6c5b0d409)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:48.974353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5480c4-48ec-4e8b-8e91-e1a1644317bd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:48.976202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:49.013655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe653e-b768-4eba-831b-353a71e7ad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:49.014635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe653e-b768-4eba-831b-353a71e7ad8b admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:49.015710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe653e-b768-4eba-831b-353a71e7ad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:49.016222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe653e-b768-4eba-831b-353a71e7ad8b admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:49.018100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe653e-b768-4eba-831b-353a71e7ad8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:49.022199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe653e-b768-4eba-831b-353a71e7ad8b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:49.067659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1d5480c4-48ec-4e8b-8e91-e1a1644317bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9209dce9071b465393680fb6c5b0d409'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:49.068560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1d5480c4-48ec-4e8b-8e91-e1a1644317bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9209dce9071b465393680fb6c5b0d409'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:49.073876 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1063/2150] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:48 2022] POST /identity/v3/users => generated 305 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:49.080243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe653e-b768-4eba-831b-353a71e7ad8b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:49.083483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-78fe653e-b768-4eba-831b-353a71e7ad8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:49.101338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1d5480c4-48ec-4e8b-8e91-e1a1644317bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9209dce9071b465393680fb6c5b0d409'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:49.103273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1d5480c4-48ec-4e8b-8e91-e1a1644317bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9209dce9071b465393680fb6c5b0d409'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:49.109272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe653e-b768-4eba-831b-353a71e7ad8b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:49.116339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1d5480c4-48ec-4e8b-8e91-e1a1644317bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9209dce9071b465393680fb6c5b0d409'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:49.116577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf14eb3-f4d2-4608-b95e-2b4c790e3422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:49.117265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf14eb3-f4d2-4608-b95e-2b4c790e3422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:49.117557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf14eb3-f4d2-4608-b95e-2b4c790e3422 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:49.118171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf14eb3-f4d2-4608-b95e-2b4c790e3422 admin admin] PATH_INFO: `/v3/projects/b93ad6350bfb456dbee1e76756e6b178` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:49.120440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf14eb3-f4d2-4608-b95e-2b4c790e3422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b93ad6350bfb456dbee1e76756e6b178)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:49.123366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf14eb3-f4d2-4608-b95e-2b4c790e3422 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:49.153214 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1088/2151] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:48 2022] DELETE /identity/v3/users/9209dce9071b465393680fb6c5b0d409 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:49.154100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5480c4-48ec-4e8b-8e91-e1a1644317bd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:49.157810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1d5480c4-48ec-4e8b-8e91-e1a1644317bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:49.210977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5bf14eb3-f4d2-4608-b95e-2b4c790e3422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b93ad6350bfb456dbee1e76756e6b178', 'request_id': 'req-5bf14eb3-f4d2-4608-b95e-2b4c790e3422'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:49.227138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5bf14eb3-f4d2-4608-b95e-2b4c790e3422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b93ad6350bfb456dbee1e76756e6b178', 'request_id': 'req-5bf14eb3-f4d2-4608-b95e-2b4c790e3422'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:49.245403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5bf14eb3-f4d2-4608-b95e-2b4c790e3422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b93ad6350bfb456dbee1e76756e6b178', 'request_id': 'req-5bf14eb3-f4d2-4608-b95e-2b4c790e3422'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:49.266594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5bf14eb3-f4d2-4608-b95e-2b4c790e3422 admin admin] The token cache is being invalidate because project b93ad6350bfb456dbee1e76756e6b178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:49.267255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5bf14eb3-f4d2-4608-b95e-2b4c790e3422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:49.268268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5bf14eb3-f4d2-4608-b95e-2b4c790e3422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:49.270479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5480c4-48ec-4e8b-8e91-e1a1644317bd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:49.275533 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1064/2152] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:49 2022] DELETE /identity/v3/projects/b93ad6350bfb456dbee1e76756e6b178 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:49.275533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf14eb3-f4d2-4608-b95e-2b4c790e3422 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:49.279358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5bf14eb3-f4d2-4608-b95e-2b4c790e3422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:49.321433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:49.365937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36066b1c-1e66-4af5-9603-3e8a51b19598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:49.366822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36066b1c-1e66-4af5-9603-3e8a51b19598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:49.367311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36066b1c-1e66-4af5-9603-3e8a51b19598 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:49.367609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36066b1c-1e66-4af5-9603-3e8a51b19598 admin admin] PATH_INFO: `/v3/users/1f7977e44d4b4ad6b5b2e40317492629` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:49.369307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36066b1c-1e66-4af5-9603-3e8a51b19598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f7977e44d4b4ad6b5b2e40317492629)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:49.373312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36066b1c-1e66-4af5-9603-3e8a51b19598 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:49.409633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf14eb3-f4d2-4608-b95e-2b4c790e3422 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:49.425857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f59595-de7c-4dae-8d56-1cc69bedb8b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:49.428136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f59595-de7c-4dae-8d56-1cc69bedb8b5 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:49.429696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f59595-de7c-4dae-8d56-1cc69bedb8b5 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:49.430287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f59595-de7c-4dae-8d56-1cc69bedb8b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:49.433619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-95f59595-de7c-4dae-8d56-1cc69bedb8b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:49.443096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-36066b1c-1e66-4af5-9603-3e8a51b19598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f7977e44d4b4ad6b5b2e40317492629'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:49.444498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-36066b1c-1e66-4af5-9603-3e8a51b19598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f7977e44d4b4ad6b5b2e40317492629'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:49.463546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-36066b1c-1e66-4af5-9603-3e8a51b19598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f7977e44d4b4ad6b5b2e40317492629'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:49.464665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-36066b1c-1e66-4af5-9603-3e8a51b19598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f7977e44d4b4ad6b5b2e40317492629'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:49.475690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-36066b1c-1e66-4af5-9603-3e8a51b19598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f7977e44d4b4ad6b5b2e40317492629'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:49.496602 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1089/2153] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:49 2022] DELETE /identity/v3/users/1f7977e44d4b4ad6b5b2e40317492629 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:49.497526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36066b1c-1e66-4af5-9603-3e8a51b19598 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:49.499923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-36066b1c-1e66-4af5-9603-3e8a51b19598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:49.536808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f59595-de7c-4dae-8d56-1cc69bedb8b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:49.542014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f59595-de7c-4dae-8d56-1cc69bedb8b5 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:49.549133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:49.576209 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1065/2154] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:49.579405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f59595-de7c-4dae-8d56-1cc69bedb8b5 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:49.585774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-95f59595-de7c-4dae-8d56-1cc69bedb8b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:49.608220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f59595-de7c-4dae-8d56-1cc69bedb8b5 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:49.622887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36066b1c-1e66-4af5-9603-3e8a51b19598 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:49.627889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87de79-8638-4379-b16a-b9388adda867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:49.629419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87de79-8638-4379-b16a-b9388adda867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:49.629706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87de79-8638-4379-b16a-b9388adda867 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:49.629986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87de79-8638-4379-b16a-b9388adda867 admin admin] PATH_INFO: `/v3/projects/622c703ef9e841af98f739e091f174a3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:49.631251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87de79-8638-4379-b16a-b9388adda867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=622c703ef9e841af98f739e091f174a3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:49.633235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87de79-8638-4379-b16a-b9388adda867 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:49.690141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-be87de79-8638-4379-b16a-b9388adda867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '622c703ef9e841af98f739e091f174a3', 'request_id': 'req-be87de79-8638-4379-b16a-b9388adda867'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:49.702176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-be87de79-8638-4379-b16a-b9388adda867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '622c703ef9e841af98f739e091f174a3', 'request_id': 'req-be87de79-8638-4379-b16a-b9388adda867'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:49.704874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:49.707324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd09768-7795-4b0e-9859-4d0cbe93c960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:49.707862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd09768-7795-4b0e-9859-4d0cbe93c960 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:49.708142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd09768-7795-4b0e-9859-4d0cbe93c960 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:49.708421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd09768-7795-4b0e-9859-4d0cbe93c960 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:49.709129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd09768-7795-4b0e-9859-4d0cbe93c960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:49.712491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd09768-7795-4b0e-9859-4d0cbe93c960 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:49.716434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-be87de79-8638-4379-b16a-b9388adda867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '622c703ef9e841af98f739e091f174a3', 'request_id': 'req-be87de79-8638-4379-b16a-b9388adda867'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:49.732791 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1066/2155] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:49.733207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-be87de79-8638-4379-b16a-b9388adda867 admin admin] The token cache is being invalidate because project 622c703ef9e841af98f739e091f174a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:49.733411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-be87de79-8638-4379-b16a-b9388adda867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:49.734732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-be87de79-8638-4379-b16a-b9388adda867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:49.736749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ded5-f018-48c1-a263-9e63dddb3e62 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:49.737479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ded5-f018-48c1-a263-9e63dddb3e62 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:49.738121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ded5-f018-48c1-a263-9e63dddb3e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:49.739744 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1090/2156] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:49 2022] DELETE /identity/v3/projects/622c703ef9e841af98f739e091f174a3 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:49.741315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c72f0-c7cd-481a-b6c7-ace042a97261 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:49.741598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c72f0-c7cd-481a-b6c7-ace042a97261 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:49.741939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c72f0-c7cd-481a-b6c7-ace042a97261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:49.779347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-304c72f0-c7cd-481a-b6c7-ace042a97261 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:49.780748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-304c72f0-c7cd-481a-b6c7-ace042a97261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:49.787389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d378ded5-f018-48c1-a263-9e63dddb3e62 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:49.788532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d378ded5-f018-48c1-a263-9e63dddb3e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:49.856268 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1067/2157] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:49.857779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82197b96-6b8b-4e01-b3e6-667253aae433 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:49.858067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82197b96-6b8b-4e01-b3e6-667253aae433 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:49.858343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82197b96-6b8b-4e01-b3e6-667253aae433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:49.892306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-82197b96-6b8b-4e01-b3e6-667253aae433 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:49.893544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-82197b96-6b8b-4e01-b3e6-667253aae433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:49.911619 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1091/2158] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:49.915574 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1068/2159] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:49.915854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c72f0-c7cd-481a-b6c7-ace042a97261 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:49.916632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82197b96-6b8b-4e01-b3e6-667253aae433 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:49.918627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-304c72f0-c7cd-481a-b6c7-ace042a97261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:49.918758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-82197b96-6b8b-4e01-b3e6-667253aae433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:49.945616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82197b96-6b8b-4e01-b3e6-667253aae433 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:49.963772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9e07f-f52b-4cc9-b12d-77a65e6478fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:49.964888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9e07f-f52b-4cc9-b12d-77a65e6478fe admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:49.965333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9e07f-f52b-4cc9-b12d-77a65e6478fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:49.965913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9e07f-f52b-4cc9-b12d-77a65e6478fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:49.966865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9e07f-f52b-4cc9-b12d-77a65e6478fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:49.971341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9e07f-f52b-4cc9-b12d-77a65e6478fe admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:50.018090 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1069/2160] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:50.019549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9e07f-f52b-4cc9-b12d-77a65e6478fe admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:50.025838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-68c9e07f-f52b-4cc9-b12d-77a65e6478fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:50.059519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9e07f-f52b-4cc9-b12d-77a65e6478fe admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:50.076537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc081560-ac9a-4240-85db-8e19ba3d0c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:50.077532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc081560-ac9a-4240-85db-8e19ba3d0c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:50.079742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc081560-ac9a-4240-85db-8e19ba3d0c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:50.080033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc081560-ac9a-4240-85db-8e19ba3d0c77 admin admin] PATH_INFO: `/v3/users/34fdfb1eb67e44f9badd56e590d3d09e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:50.083771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc081560-ac9a-4240-85db-8e19ba3d0c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34fdfb1eb67e44f9badd56e590d3d09e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:50.089123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc081560-ac9a-4240-85db-8e19ba3d0c77 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:50.103663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c72f0-c7cd-481a-b6c7-ace042a97261 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:50.132087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadbb55-ea10-47ea-88cf-376e7210b7e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:50.132891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadbb55-ea10-47ea-88cf-376e7210b7e5 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:50.133281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadbb55-ea10-47ea-88cf-376e7210b7e5 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:50.133659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadbb55-ea10-47ea-88cf-376e7210b7e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:50.135729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2cadbb55-ea10-47ea-88cf-376e7210b7e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:50.197090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bc081560-ac9a-4240-85db-8e19ba3d0c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34fdfb1eb67e44f9badd56e590d3d09e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:50.223445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bc081560-ac9a-4240-85db-8e19ba3d0c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34fdfb1eb67e44f9badd56e590d3d09e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:50.225022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bc081560-ac9a-4240-85db-8e19ba3d0c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34fdfb1eb67e44f9badd56e590d3d09e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:50.236707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:50.237858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cadbb55-ea10-47ea-88cf-376e7210b7e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:50.239989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cadbb55-ea10-47ea-88cf-376e7210b7e5 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:50.240966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bc081560-ac9a-4240-85db-8e19ba3d0c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34fdfb1eb67e44f9badd56e590d3d09e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:50.242243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bc081560-ac9a-4240-85db-8e19ba3d0c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34fdfb1eb67e44f9badd56e590d3d09e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:50.257917 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1092/2161] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:49 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:50.258706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadbb55-ea10-47ea-88cf-376e7210b7e5 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:50.260700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2cadbb55-ea10-47ea-88cf-376e7210b7e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:50.264579 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1070/2162] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:50 2022] DELETE /identity/v3/users/34fdfb1eb67e44f9badd56e590d3d09e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:50.268048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc5201-03ba-4aaf-a097-630d187bfd65 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:50.268645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc5201-03ba-4aaf-a097-630d187bfd65 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:50.270041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc5201-03ba-4aaf-a097-630d187bfd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:50.294630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:50.315699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b2fc5201-03ba-4aaf-a097-630d187bfd65 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:50.321219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b2fc5201-03ba-4aaf-a097-630d187bfd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:50.422160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadbb55-ea10-47ea-88cf-376e7210b7e5 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:50.505792 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1071/2163] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:50.506796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc5201-03ba-4aaf-a097-630d187bfd65 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:50.508301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b2fc5201-03ba-4aaf-a097-630d187bfd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:50.563485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bdc3a6-370a-4e7b-93d4-0d2c8dd71017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:50.564179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdc3a6-370a-4e7b-93d4-0d2c8dd71017 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:50.564665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdc3a6-370a-4e7b-93d4-0d2c8dd71017 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:50.565007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdc3a6-370a-4e7b-93d4-0d2c8dd71017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:50.567647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-11bdc3a6-370a-4e7b-93d4-0d2c8dd71017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:50.603406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bdc3a6-370a-4e7b-93d4-0d2c8dd71017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:50.604782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bdc3a6-370a-4e7b-93d4-0d2c8dd71017 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:50.630701 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1093/2164] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:50.632349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bdc3a6-370a-4e7b-93d4-0d2c8dd71017 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:50.637079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-11bdc3a6-370a-4e7b-93d4-0d2c8dd71017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:50.665444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bdc3a6-370a-4e7b-93d4-0d2c8dd71017 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:50.667675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc5201-03ba-4aaf-a097-630d187bfd65 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:50.673880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749f51a-8865-48e9-818f-49d1d6d30279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:50.678204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749f51a-8865-48e9-818f-49d1d6d30279 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:50.678642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749f51a-8865-48e9-818f-49d1d6d30279 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:50.679551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dfa93-1427-48e2-ac7d-efb5efa17e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:50.679967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749f51a-8865-48e9-818f-49d1d6d30279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:50.681835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dfa93-1427-48e2-ac7d-efb5efa17e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:50.682513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dfa93-1427-48e2-ac7d-efb5efa17e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:50.683469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dfa93-1427-48e2-ac7d-efb5efa17e2d admin admin] PATH_INFO: `/v3/projects/c6e36ee8bd784bdea8aa1f7bec70b796/users/68142e14d77c4c1e8249d90cd3e8c1fa/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:50.683953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3749f51a-8865-48e9-818f-49d1d6d30279 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:50.722418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749f51a-8865-48e9-818f-49d1d6d30279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:50.724407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749f51a-8865-48e9-818f-49d1d6d30279 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:50.732756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66dfa93-1427-48e2-ac7d-efb5efa17e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e36ee8bd784bdea8aa1f7bec70b796, user_id=68142e14d77c4c1e8249d90cd3e8c1fa, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:50.737587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66dfa93-1427-48e2-ac7d-efb5efa17e2d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:50.752111 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1072/2165] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:50.752869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749f51a-8865-48e9-818f-49d1d6d30279 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:50.763335 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1094/2166] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:50 2022] PUT /identity/v3/projects/c6e36ee8bd784bdea8aa1f7bec70b796/users/68142e14d77c4c1e8249d90cd3e8c1fa/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:50.778406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ca97f-483a-46ce-845c-ec12991bf13b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:50.779036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ca97f-483a-46ce-845c-ec12991bf13b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:50.779592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ca97f-483a-46ce-845c-ec12991bf13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:50.797164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749f51a-8865-48e9-818f-49d1d6d30279 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:50.830230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e33ca97f-483a-46ce-845c-ec12991bf13b None None] MFA Rules not processed for user `68142e14d77c4c1e8249d90cd3e8c1fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:50.832286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e33ca97f-483a-46ce-845c-ec12991bf13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:50.935137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04efd32-dbfd-42b1-94ff-671c41933096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:50.936015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04efd32-dbfd-42b1-94ff-671c41933096 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:50.936298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04efd32-dbfd-42b1-94ff-671c41933096 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:50.938010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04efd32-dbfd-42b1-94ff-671c41933096 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:50.952001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04efd32-dbfd-42b1-94ff-671c41933096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:01:50.953273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04efd32-dbfd-42b1-94ff-671c41933096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:50.957887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04efd32-dbfd-42b1-94ff-671c41933096 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:50.984859 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1073/2167] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:01:50.989431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04efd32-dbfd-42b1-94ff-671c41933096 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:50.995431 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1095/2168] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:50 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:50.996364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ca97f-483a-46ce-845c-ec12991bf13b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:51.015691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ca97f-483a-46ce-845c-ec12991bf13b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:51.016712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04efd32-dbfd-42b1-94ff-671c41933096 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:51.026702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bc519-300e-446d-a26e-838f30bde8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:51.027856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bc519-300e-446d-a26e-838f30bde8b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:51.027957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bc519-300e-446d-a26e-838f30bde8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:51.028276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bc519-300e-446d-a26e-838f30bde8b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:51.028905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bc519-300e-446d-a26e-838f30bde8b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:51.030682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16609a-42f7-490a-a45c-71972a6f491e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:51.032265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16609a-42f7-490a-a45c-71972a6f491e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:51.032744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16609a-42f7-490a-a45c-71972a6f491e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:51.032862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bc519-300e-446d-a26e-838f30bde8b3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:51.033521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16609a-42f7-490a-a45c-71972a6f491e admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:51.034506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16609a-42f7-490a-a45c-71972a6f491e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:51.036701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16609a-42f7-490a-a45c-71972a6f491e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:51.074658 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1096/2169] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:50 2022] POST /identity/v3/projects => generated 405 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:51.083776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bc519-300e-446d-a26e-838f30bde8b3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:51.129925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:51.130280 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1074/2170] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:50 2022] POST /identity/v3/projects => generated 401 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:51.133374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16609a-42f7-490a-a45c-71972a6f491e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:51.147101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:51.277281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16609a-42f7-490a-a45c-71972a6f491e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:51.283263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67588681-920e-4783-907d-df9401974d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:51.283875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67588681-920e-4783-907d-df9401974d8e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:51.284158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67588681-920e-4783-907d-df9401974d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:51.284479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67588681-920e-4783-907d-df9401974d8e admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:51.285160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67588681-920e-4783-907d-df9401974d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:51.287260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67588681-920e-4783-907d-df9401974d8e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:51.290064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bc519-300e-446d-a26e-838f30bde8b3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:51.295909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdb58f-d12d-4de5-83d9-13217779c840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:51.296660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdb58f-d12d-4de5-83d9-13217779c840 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:51.297016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdb58f-d12d-4de5-83d9-13217779c840 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:51.297368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdb58f-d12d-4de5-83d9-13217779c840 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:51.298193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdb58f-d12d-4de5-83d9-13217779c840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:51.300971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdb58f-d12d-4de5-83d9-13217779c840 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:51.319000 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1075/2171] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:51 2022] POST /identity/v3/users => generated 301 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:51.323389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67588681-920e-4783-907d-df9401974d8e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:51.336713 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1097/2172] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:51 2022] POST /identity/v3/users => generated 309 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:51.336713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdb58f-d12d-4de5-83d9-13217779c840 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:51.336946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67588681-920e-4783-907d-df9401974d8e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:51.339158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c0bdb58f-d12d-4de5-83d9-13217779c840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:51.343007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fae04-8de5-47d1-a3d4-3111f162b173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:51.344782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fae04-8de5-47d1-a3d4-3111f162b173 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:51.344782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fae04-8de5-47d1-a3d4-3111f162b173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:51.344782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fae04-8de5-47d1-a3d4-3111f162b173 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:51.345511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fae04-8de5-47d1-a3d4-3111f162b173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:51.347734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fae04-8de5-47d1-a3d4-3111f162b173 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:51.359191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdb58f-d12d-4de5-83d9-13217779c840 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:51.365478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf79493-e061-479d-8522-bee6272b733b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:51.366376 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1076/2173] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:01:51.367463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fae04-8de5-47d1-a3d4-3111f162b173 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:51.370389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf79493-e061-479d-8522-bee6272b733b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:51.370633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf79493-e061-479d-8522-bee6272b733b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:51.370920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf79493-e061-479d-8522-bee6272b733b admin admin] PATH_INFO: `/v3/projects/0652d1910792484e8d5c084ef02766fb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:51.372444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf79493-e061-479d-8522-bee6272b733b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0652d1910792484e8d5c084ef02766fb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:51.381114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fae04-8de5-47d1-a3d4-3111f162b173 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:51.386576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac239799-918a-40cf-8184-d2c0055c46bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:51.387227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac239799-918a-40cf-8184-d2c0055c46bc admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:51.387836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac239799-918a-40cf-8184-d2c0055c46bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:51.387997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf79493-e061-479d-8522-bee6272b733b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:51.388246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac239799-918a-40cf-8184-d2c0055c46bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:51.389021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac239799-918a-40cf-8184-d2c0055c46bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:51.391205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac239799-918a-40cf-8184-d2c0055c46bc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:51.415853 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1077/2174] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:51.416884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac239799-918a-40cf-8184-d2c0055c46bc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:51.435051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac239799-918a-40cf-8184-d2c0055c46bc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:51.441444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723512c-7f11-4b17-8929-f4d05a6b5419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:51.442336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723512c-7f11-4b17-8929-f4d05a6b5419 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:51.442757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723512c-7f11-4b17-8929-f4d05a6b5419 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:51.443122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723512c-7f11-4b17-8929-f4d05a6b5419 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:51.444012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723512c-7f11-4b17-8929-f4d05a6b5419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:51.445627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723512c-7f11-4b17-8929-f4d05a6b5419 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:51.457840 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1078/2175] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:51.458753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723512c-7f11-4b17-8929-f4d05a6b5419 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:51.481139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723512c-7f11-4b17-8929-f4d05a6b5419 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:51.503442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cdf79493-e061-479d-8522-bee6272b733b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0652d1910792484e8d5c084ef02766fb', 'request_id': 'req-cdf79493-e061-479d-8522-bee6272b733b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:51.520777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cdf79493-e061-479d-8522-bee6272b733b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0652d1910792484e8d5c084ef02766fb', 'request_id': 'req-cdf79493-e061-479d-8522-bee6272b733b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:51.546475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cdf79493-e061-479d-8522-bee6272b733b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0652d1910792484e8d5c084ef02766fb', 'request_id': 'req-cdf79493-e061-479d-8522-bee6272b733b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:51.565140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cdf79493-e061-479d-8522-bee6272b733b admin admin] The token cache is being invalidate because project 0652d1910792484e8d5c084ef02766fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:51.565823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cdf79493-e061-479d-8522-bee6272b733b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:51.566916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cdf79493-e061-479d-8522-bee6272b733b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:51.569728 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1098/2176] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:51 2022] DELETE /identity/v3/projects/0652d1910792484e8d5c084ef02766fb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:51.570774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf79493-e061-479d-8522-bee6272b733b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:51.572563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cdf79493-e061-479d-8522-bee6272b733b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:51.586958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222c124-7247-4dcc-b97e-2f57ac9d87f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:51.588074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222c124-7247-4dcc-b97e-2f57ac9d87f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:51.588574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222c124-7247-4dcc-b97e-2f57ac9d87f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:51.589047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222c124-7247-4dcc-b97e-2f57ac9d87f5 admin admin] PATH_INFO: `/v3/projects/509e418052584bd0b6b9da5735109d0c/users/fc88f95a97e24c6f836ef5ba592d6fc7/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:51.606019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222c124-7247-4dcc-b97e-2f57ac9d87f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=509e418052584bd0b6b9da5735109d0c, user_id=fc88f95a97e24c6f836ef5ba592d6fc7, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:51.609135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222c124-7247-4dcc-b97e-2f57ac9d87f5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:51.634171 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1079/2177] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:51 2022] PUT /identity/v3/projects/509e418052584bd0b6b9da5735109d0c/users/fc88f95a97e24c6f836ef5ba592d6fc7/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:51.636945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332112b-24f1-4679-a775-2cd21d697275 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:51.637481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332112b-24f1-4679-a775-2cd21d697275 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:51.637786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332112b-24f1-4679-a775-2cd21d697275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:51.665689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3332112b-24f1-4679-a775-2cd21d697275 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:51.666931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3332112b-24f1-4679-a775-2cd21d697275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:51.705601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf79493-e061-479d-8522-bee6272b733b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:51.729968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:51.763011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:51.771941 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1080/2178] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:51.773091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332112b-24f1-4679-a775-2cd21d697275 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:51.776036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3332112b-24f1-4679-a775-2cd21d697275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:51.802584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332112b-24f1-4679-a775-2cd21d697275 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:51.814682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e029476-e670-4e48-aaad-af60a2df6842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:51.814936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020fac0-219c-4e9e-bb88-5d8804400d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:51.816276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020fac0-219c-4e9e-bb88-5d8804400d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:51.816276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020fac0-219c-4e9e-bb88-5d8804400d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:51.816614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e029476-e670-4e48-aaad-af60a2df6842 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:51.816770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020fac0-219c-4e9e-bb88-5d8804400d34 admin admin] PATH_INFO: `/v3/projects/2282b704d7a040d785c8b90286ca9116/users/9a8dc3e3d50349a1964b714ffe3f5ca7/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:51.816885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e029476-e670-4e48-aaad-af60a2df6842 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:51.816885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e029476-e670-4e48-aaad-af60a2df6842 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:51.817275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e029476-e670-4e48-aaad-af60a2df6842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:51.819086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e029476-e670-4e48-aaad-af60a2df6842 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:51.841684 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1081/2179] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:51.842181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020fac0-219c-4e9e-bb88-5d8804400d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2282b704d7a040d785c8b90286ca9116, user_id=9a8dc3e3d50349a1964b714ffe3f5ca7, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:51.842783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e029476-e670-4e48-aaad-af60a2df6842 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:51.844925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4e029476-e670-4e48-aaad-af60a2df6842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:51.846629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020fac0-219c-4e9e-bb88-5d8804400d34 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:51.859505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e029476-e670-4e48-aaad-af60a2df6842 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:51.876144 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1099/2180] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:51 2022] PUT /identity/v3/projects/2282b704d7a040d785c8b90286ca9116/users/9a8dc3e3d50349a1964b714ffe3f5ca7/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:51.877790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b8f4b-204c-4923-a3b7-6ae972c6de24 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:51.878120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b8f4b-204c-4923-a3b7-6ae972c6de24 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:51.878402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b8f4b-204c-4923-a3b7-6ae972c6de24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:51.921679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c60b8f4b-204c-4923-a3b7-6ae972c6de24 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:51.924682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c60b8f4b-204c-4923-a3b7-6ae972c6de24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:51.935819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d326e-e91f-4145-a2b3-23911723263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:51.936748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d326e-e91f-4145-a2b3-23911723263a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:51.937039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d326e-e91f-4145-a2b3-23911723263a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:51.937318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d326e-e91f-4145-a2b3-23911723263a admin admin] PATH_INFO: `/v3/projects/30c86afcd3804982b67c880e35232547` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:51.938618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d326e-e91f-4145-a2b3-23911723263a admin admin] RBAC: Authorizing `identity:delete_project(project_id=30c86afcd3804982b67c880e35232547)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:51.940904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d326e-e91f-4145-a2b3-23911723263a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:52.045447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ee1d326e-e91f-4145-a2b3-23911723263a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30c86afcd3804982b67c880e35232547', 'request_id': 'req-ee1d326e-e91f-4145-a2b3-23911723263a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:52.066606 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1100/2181] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:52.068141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b8f4b-204c-4923-a3b7-6ae972c6de24 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:52.081010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b8f4b-204c-4923-a3b7-6ae972c6de24 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:52.086906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ee1d326e-e91f-4145-a2b3-23911723263a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30c86afcd3804982b67c880e35232547', 'request_id': 'req-ee1d326e-e91f-4145-a2b3-23911723263a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:52.098978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ee1d326e-e91f-4145-a2b3-23911723263a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30c86afcd3804982b67c880e35232547', 'request_id': 'req-ee1d326e-e91f-4145-a2b3-23911723263a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:52.142206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ee1d326e-e91f-4145-a2b3-23911723263a admin admin] The token cache is being invalidate because project 30c86afcd3804982b67c880e35232547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:52.142645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ee1d326e-e91f-4145-a2b3-23911723263a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:52.143752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ee1d326e-e91f-4145-a2b3-23911723263a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:52.150722 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1082/2182] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:51 2022] DELETE /identity/v3/projects/30c86afcd3804982b67c880e35232547 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:52.152390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dcba4-1981-4092-8125-85f3dcf357d8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:52.152788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dcba4-1981-4092-8125-85f3dcf357d8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:52.153172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dcba4-1981-4092-8125-85f3dcf357d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:52.211469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-762dcba4-1981-4092-8125-85f3dcf357d8 None None] MFA Rules not processed for user `9a8dc3e3d50349a1964b714ffe3f5ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:52.215760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-762dcba4-1981-4092-8125-85f3dcf357d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:52.225383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4df13-5c84-46fe-ab0e-d33636526285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:52.230828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4df13-5c84-46fe-ab0e-d33636526285 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:52.232319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4df13-5c84-46fe-ab0e-d33636526285 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:52.233412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4df13-5c84-46fe-ab0e-d33636526285 admin admin] PATH_INFO: `/v3/projects/509e418052584bd0b6b9da5735109d0c/users/fc88f95a97e24c6f836ef5ba592d6fc7/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:52.238121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4df13-5c84-46fe-ab0e-d33636526285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=509e418052584bd0b6b9da5735109d0c, user_id=fc88f95a97e24c6f836ef5ba592d6fc7, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:52.249179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4df13-5c84-46fe-ab0e-d33636526285 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:52.279549 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1101/2183] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:52 2022] PUT /identity/v3/projects/509e418052584bd0b6b9da5735109d0c/users/fc88f95a97e24c6f836ef5ba592d6fc7/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:52.281059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4df13-5c84-46fe-ab0e-d33636526285 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:52.283595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-40a4df13-5c84-46fe-ab0e-d33636526285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:52.441894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4df13-5c84-46fe-ab0e-d33636526285 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:52.445771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:52.450287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469246bc-13d2-4c1f-9d2d-487a54c7768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:52.452466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469246bc-13d2-4c1f-9d2d-487a54c7768b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:52.452969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469246bc-13d2-4c1f-9d2d-487a54c7768b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:52.453663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469246bc-13d2-4c1f-9d2d-487a54c7768b admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:52.454534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469246bc-13d2-4c1f-9d2d-487a54c7768b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:01:52.455006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469246bc-13d2-4c1f-9d2d-487a54c7768b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:52.460406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469246bc-13d2-4c1f-9d2d-487a54c7768b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:52.463635 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1083/2184] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:52.464326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dcba4-1981-4092-8125-85f3dcf357d8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:52.467836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:52.474489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-762dcba4-1981-4092-8125-85f3dcf357d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:52.493276 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1102/2185] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:01:52.494665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dcba4-1981-4092-8125-85f3dcf357d8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:52.495555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dc3c6-47a8-4b9e-9285-550031f8ee4b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:52.495850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dc3c6-47a8-4b9e-9285-550031f8ee4b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:52.496128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dc3c6-47a8-4b9e-9285-550031f8ee4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:52.502995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ac778-8b42-444b-bcaf-6e97daf1be95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:52.504652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ac778-8b42-444b-bcaf-6e97daf1be95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:52.505166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ac778-8b42-444b-bcaf-6e97daf1be95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:52.505906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ac778-8b42-444b-bcaf-6e97daf1be95 admin admin] PATH_INFO: `/v3/users/92808d1e2b094e85a0771d962b736417` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:52.508974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ac778-8b42-444b-bcaf-6e97daf1be95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92808d1e2b094e85a0771d962b736417)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:52.512121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ac778-8b42-444b-bcaf-6e97daf1be95 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:52.535178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c11dc3c6-47a8-4b9e-9285-550031f8ee4b None None] MFA Rules not processed for user `fc88f95a97e24c6f836ef5ba592d6fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:52.536652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c11dc3c6-47a8-4b9e-9285-550031f8ee4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:52.599817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b38ac778-8b42-444b-bcaf-6e97daf1be95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92808d1e2b094e85a0771d962b736417'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:52.638425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b38ac778-8b42-444b-bcaf-6e97daf1be95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92808d1e2b094e85a0771d962b736417'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:52.639801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b38ac778-8b42-444b-bcaf-6e97daf1be95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92808d1e2b094e85a0771d962b736417'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:52.658255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b38ac778-8b42-444b-bcaf-6e97daf1be95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92808d1e2b094e85a0771d962b736417'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:52.660833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b38ac778-8b42-444b-bcaf-6e97daf1be95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92808d1e2b094e85a0771d962b736417'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:52.668036 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1103/2186] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:52 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:52.670432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dc3c6-47a8-4b9e-9285-550031f8ee4b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:52.673291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c11dc3c6-47a8-4b9e-9285-550031f8ee4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:52.694028 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1084/2187] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:52 2022] DELETE /identity/v3/users/92808d1e2b094e85a0771d962b736417 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:52.697103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dc3c6-47a8-4b9e-9285-550031f8ee4b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:52.698326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ac778-8b42-444b-bcaf-6e97daf1be95 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:52.699952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b38ac778-8b42-444b-bcaf-6e97daf1be95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:52.803770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db95ab-cc09-42e0-8bad-62962602173e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:52.804664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db95ab-cc09-42e0-8bad-62962602173e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:52.805125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db95ab-cc09-42e0-8bad-62962602173e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:52.805556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db95ab-cc09-42e0-8bad-62962602173e admin admin] PATH_INFO: `/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:52.807274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db95ab-cc09-42e0-8bad-62962602173e admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e9a9bafd714ea0b51c28c6ff4accc7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:52.814410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db95ab-cc09-42e0-8bad-62962602173e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:52.859634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ac778-8b42-444b-bcaf-6e97daf1be95 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:52.868465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbe333-1028-457b-82cf-5f4b50ac4bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:52.869242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbe333-1028-457b-82cf-5f4b50ac4bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:52.870903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbe333-1028-457b-82cf-5f4b50ac4bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:52.871198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbe333-1028-457b-82cf-5f4b50ac4bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:52.872122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbe333-1028-457b-82cf-5f4b50ac4bd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:52.885849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbe333-1028-457b-82cf-5f4b50ac4bd5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:52.898093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-90db95ab-cc09-42e0-8bad-62962602173e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e9a9bafd714ea0b51c28c6ff4accc7', 'request_id': 'req-90db95ab-cc09-42e0-8bad-62962602173e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:52.917243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-90db95ab-cc09-42e0-8bad-62962602173e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e9a9bafd714ea0b51c28c6ff4accc7', 'request_id': 'req-90db95ab-cc09-42e0-8bad-62962602173e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:52.934094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-90db95ab-cc09-42e0-8bad-62962602173e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e9a9bafd714ea0b51c28c6ff4accc7', 'request_id': 'req-90db95ab-cc09-42e0-8bad-62962602173e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:52.951426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-90db95ab-cc09-42e0-8bad-62962602173e admin admin] The token cache is being invalidate because project 05e9a9bafd714ea0b51c28c6ff4accc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:52.951724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-90db95ab-cc09-42e0-8bad-62962602173e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:52.953206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-90db95ab-cc09-42e0-8bad-62962602173e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:52.955732 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1104/2188] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:52 2022] DELETE /identity/v3/projects/05e9a9bafd714ea0b51c28c6ff4accc7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:52.956904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db95ab-cc09-42e0-8bad-62962602173e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:52.957544 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1085/2189] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:52 2022] POST /identity/v3/projects => generated 403 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:52.960250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbe333-1028-457b-82cf-5f4b50ac4bd5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:52.961899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6dfbe333-1028-457b-82cf-5f4b50ac4bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:52.963508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-90db95ab-cc09-42e0-8bad-62962602173e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:52.979097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:53.098094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db95ab-cc09-42e0-8bad-62962602173e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:53.134119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:53.195302 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbe333-1028-457b-82cf-5f4b50ac4bd5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:53.210159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3214e-78b9-4715-8e18-4f035945113a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:53.212310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3214e-78b9-4715-8e18-4f035945113a service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:53.214493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3214e-78b9-4715-8e18-4f035945113a service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:53.215722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3214e-78b9-4715-8e18-4f035945113a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:53.219254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-40c3214e-78b9-4715-8e18-4f035945113a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:53.231916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd164ba2-b55d-45fa-aa7b-1bad881c5326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:53.233640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd164ba2-b55d-45fa-aa7b-1bad881c5326 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:53.234019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd164ba2-b55d-45fa-aa7b-1bad881c5326 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:53.234683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd164ba2-b55d-45fa-aa7b-1bad881c5326 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:53.236684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd164ba2-b55d-45fa-aa7b-1bad881c5326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:53.241375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd164ba2-b55d-45fa-aa7b-1bad881c5326 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:53.280104 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1105/2190] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:52 2022] POST /identity/v3/projects => generated 373 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:53.281161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd164ba2-b55d-45fa-aa7b-1bad881c5326 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:53.285487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bd164ba2-b55d-45fa-aa7b-1bad881c5326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:53.362295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3214e-78b9-4715-8e18-4f035945113a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:53.372231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3214e-78b9-4715-8e18-4f035945113a service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:53.396974 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1086/2191] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:52 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:53.398073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3214e-78b9-4715-8e18-4f035945113a service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:53.401177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-40c3214e-78b9-4715-8e18-4f035945113a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:53.422665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3214e-78b9-4715-8e18-4f035945113a service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:53.430693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387a4d8-aa1d-44b7-9182-5c18a47539d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:53.432634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387a4d8-aa1d-44b7-9182-5c18a47539d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:53.433131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387a4d8-aa1d-44b7-9182-5c18a47539d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:53.433655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387a4d8-aa1d-44b7-9182-5c18a47539d6 admin admin] PATH_INFO: `/v3/users/5019c7e61b604023a14f43054cd8e4d9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:53.433834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd164ba2-b55d-45fa-aa7b-1bad881c5326 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:53.435319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387a4d8-aa1d-44b7-9182-5c18a47539d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5019c7e61b604023a14f43054cd8e4d9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:53.437568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387a4d8-aa1d-44b7-9182-5c18a47539d6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:53.447132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e199a-ca80-400e-8894-e8802ee4caf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:53.448432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e199a-ca80-400e-8894-e8802ee4caf2 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:53.448432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e199a-ca80-400e-8894-e8802ee4caf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:53.448432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e199a-ca80-400e-8894-e8802ee4caf2 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:53.449210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e199a-ca80-400e-8894-e8802ee4caf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:53.453108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e199a-ca80-400e-8894-e8802ee4caf2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:53.502455 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1106/2192] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:53 2022] POST /identity/v3/users => generated 308 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:53.504613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e199a-ca80-400e-8894-e8802ee4caf2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:53.523110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d387a4d8-aa1d-44b7-9182-5c18a47539d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5019c7e61b604023a14f43054cd8e4d9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:53.524239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e199a-ca80-400e-8894-e8802ee4caf2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:53.537953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68397d-9164-4b5a-a3c4-4cb97a7d79b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:53.538719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68397d-9164-4b5a-a3c4-4cb97a7d79b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:53.539004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68397d-9164-4b5a-a3c4-4cb97a7d79b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:53.540497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68397d-9164-4b5a-a3c4-4cb97a7d79b7 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:53.542437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68397d-9164-4b5a-a3c4-4cb97a7d79b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:53.545759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d387a4d8-aa1d-44b7-9182-5c18a47539d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5019c7e61b604023a14f43054cd8e4d9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:53.546900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d387a4d8-aa1d-44b7-9182-5c18a47539d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5019c7e61b604023a14f43054cd8e4d9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:53.548044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68397d-9164-4b5a-a3c4-4cb97a7d79b7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:53.557130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d387a4d8-aa1d-44b7-9182-5c18a47539d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5019c7e61b604023a14f43054cd8e4d9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:53.558479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d387a4d8-aa1d-44b7-9182-5c18a47539d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5019c7e61b604023a14f43054cd8e4d9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:53.580557 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1087/2193] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:53 2022] DELETE /identity/v3/users/5019c7e61b604023a14f43054cd8e4d9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:53.582399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387a4d8-aa1d-44b7-9182-5c18a47539d6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:53.584923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d387a4d8-aa1d-44b7-9182-5c18a47539d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:53.597297 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1107/2194] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:53 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:53.597297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68397d-9164-4b5a-a3c4-4cb97a7d79b7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:53.601008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ea68397d-9164-4b5a-a3c4-4cb97a7d79b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:53.635484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:53.666765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:53.676838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387a4d8-aa1d-44b7-9182-5c18a47539d6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:53.684586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454daa3-0965-4784-ba0d-22366835ef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:53.685520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454daa3-0965-4784-ba0d-22366835ef27 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:53.686418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454daa3-0965-4784-ba0d-22366835ef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:53.686815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454daa3-0965-4784-ba0d-22366835ef27 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:53.688428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454daa3-0965-4784-ba0d-22366835ef27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:53.690392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454daa3-0965-4784-ba0d-22366835ef27 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:53.703799 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1088/2195] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:53.705162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454daa3-0965-4784-ba0d-22366835ef27 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:53.708401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1454daa3-0965-4784-ba0d-22366835ef27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:53.723253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454daa3-0965-4784-ba0d-22366835ef27 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:53.729778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0da9a-1d66-4d3d-b398-1514d31cba0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:53.730802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0da9a-1d66-4d3d-b398-1514d31cba0e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:53.731211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0da9a-1d66-4d3d-b398-1514d31cba0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:53.731592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0da9a-1d66-4d3d-b398-1514d31cba0e admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:53.732469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0da9a-1d66-4d3d-b398-1514d31cba0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:53.734364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0da9a-1d66-4d3d-b398-1514d31cba0e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:53.770856 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1089/2196] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:53.770856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0da9a-1d66-4d3d-b398-1514d31cba0e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:53.784979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0da9a-1d66-4d3d-b398-1514d31cba0e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:53.789389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68397d-9164-4b5a-a3c4-4cb97a7d79b7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:53.791383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a017c1-0fcc-48ab-b5af-48933874fb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:53.792708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a017c1-0fcc-48ab-b5af-48933874fb67 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:53.793370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a017c1-0fcc-48ab-b5af-48933874fb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:53.793816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a017c1-0fcc-48ab-b5af-48933874fb67 admin admin] PATH_INFO: `/v3/projects/7a07e4e5480d482cb79f386337e0c00b/users/0666095c0f6c4718abcb6cf4f2e0faf9/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:53.828962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a017c1-0fcc-48ab-b5af-48933874fb67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a07e4e5480d482cb79f386337e0c00b, user_id=0666095c0f6c4718abcb6cf4f2e0faf9, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:53.832973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a017c1-0fcc-48ab-b5af-48933874fb67 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:53.863757 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1090/2197] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:53 2022] PUT /identity/v3/projects/7a07e4e5480d482cb79f386337e0c00b/users/0666095c0f6c4718abcb6cf4f2e0faf9/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:53.865680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a017c1-0fcc-48ab-b5af-48933874fb67 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:53.956067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a017c1-0fcc-48ab-b5af-48933874fb67 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:53.961126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e816bb5-d0e0-4762-8d76-9b9f6e9bad22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:53.961557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34642223-4485-4a31-bbd8-a1b717409027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:53.961917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e816bb5-d0e0-4762-8d76-9b9f6e9bad22 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:53.962248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34642223-4485-4a31-bbd8-a1b717409027 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:53.962358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e816bb5-d0e0-4762-8d76-9b9f6e9bad22 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:53.962536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34642223-4485-4a31-bbd8-a1b717409027 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:53.962639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e816bb5-d0e0-4762-8d76-9b9f6e9bad22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:53.962805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34642223-4485-4a31-bbd8-a1b717409027 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:53.963544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34642223-4485-4a31-bbd8-a1b717409027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:53.964639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9e816bb5-d0e0-4762-8d76-9b9f6e9bad22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:53.965526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34642223-4485-4a31-bbd8-a1b717409027 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:53.982787 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1091/2198] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:53.982787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34642223-4485-4a31-bbd8-a1b717409027 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:53.992958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34642223-4485-4a31-bbd8-a1b717409027 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:54.007378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc2082-3ecb-4fe5-ab27-58a0c836f436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:54.007378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc2082-3ecb-4fe5-ab27-58a0c836f436 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:54.007378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc2082-3ecb-4fe5-ab27-58a0c836f436 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:54.007378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc2082-3ecb-4fe5-ab27-58a0c836f436 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:54.011350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc2082-3ecb-4fe5-ab27-58a0c836f436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:54.011350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc2082-3ecb-4fe5-ab27-58a0c836f436 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:54.023401 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1092/2199] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:54.024406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc2082-3ecb-4fe5-ab27-58a0c836f436 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:54.037020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc2082-3ecb-4fe5-ab27-58a0c836f436 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:54.044914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f267c-4bed-4969-beb3-89836e716958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:54.045777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f267c-4bed-4969-beb3-89836e716958 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:54.046063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f267c-4bed-4969-beb3-89836e716958 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:54.046339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f267c-4bed-4969-beb3-89836e716958 admin admin] PATH_INFO: `/v3/projects/1e4074c1cefd4a39aec074466a3f6397/users/7c25e4232a504fa5b42ab27ec4481f36/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:54.071723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f267c-4bed-4969-beb3-89836e716958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4074c1cefd4a39aec074466a3f6397, user_id=7c25e4232a504fa5b42ab27ec4481f36, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:54.075867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f267c-4bed-4969-beb3-89836e716958 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:54.092640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e816bb5-d0e0-4762-8d76-9b9f6e9bad22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:54.094198 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1093/2200] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:54 2022] PUT /identity/v3/projects/1e4074c1cefd4a39aec074466a3f6397/users/7c25e4232a504fa5b42ab27ec4481f36/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:54.095033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f267c-4bed-4969-beb3-89836e716958 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:54.104165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e816bb5-d0e0-4762-8d76-9b9f6e9bad22 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:54.131604 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1108/2201] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:53 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:54.132758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15fc8e-b176-4e8c-b4e3-c5431c58c561 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:54.132758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15fc8e-b176-4e8c-b4e3-c5431c58c561 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:54.132888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15fc8e-b176-4e8c-b4e3-c5431c58c561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:54.190488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f267c-4bed-4969-beb3-89836e716958 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:54.198453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f72ae-7b00-4af5-a815-07f1a95d7726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:54.199506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f72ae-7b00-4af5-a815-07f1a95d7726 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:54.199964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f72ae-7b00-4af5-a815-07f1a95d7726 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:54.200181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f72ae-7b00-4af5-a815-07f1a95d7726 admin admin] PATH_INFO: `/v3/projects/7a07e4e5480d482cb79f386337e0c00b/users/0666095c0f6c4718abcb6cf4f2e0faf9/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:54.202797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f72ae-7b00-4af5-a815-07f1a95d7726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a07e4e5480d482cb79f386337e0c00b, user_id=0666095c0f6c4718abcb6cf4f2e0faf9, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:54.210942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f72ae-7b00-4af5-a815-07f1a95d7726 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:54.240643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2f15fc8e-b176-4e8c-b4e3-c5431c58c561 None None] MFA Rules not processed for user `7c25e4232a504fa5b42ab27ec4481f36`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:54.243518 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1094/2202] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:54 2022] PUT /identity/v3/projects/7a07e4e5480d482cb79f386337e0c00b/users/0666095c0f6c4718abcb6cf4f2e0faf9/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:54.255248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2f15fc8e-b176-4e8c-b4e3-c5431c58c561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:54.256218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f72ae-7b00-4af5-a815-07f1a95d7726 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:54.261503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9f3f72ae-7b00-4af5-a815-07f1a95d7726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:54.302103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:54.358852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:54.397167 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1109/2203] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:54.398449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b05d5e-5958-4367-9caa-3ae46caef187 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:54.398746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b05d5e-5958-4367-9caa-3ae46caef187 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:54.399033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b05d5e-5958-4367-9caa-3ae46caef187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:54.403874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f72ae-7b00-4af5-a815-07f1a95d7726 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:54.409557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa43302-7df1-4851-b7b7-a9762f01f9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:54.410288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa43302-7df1-4851-b7b7-a9762f01f9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:54.410644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa43302-7df1-4851-b7b7-a9762f01f9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:54.410995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa43302-7df1-4851-b7b7-a9762f01f9aa admin admin] PATH_INFO: `/v3/projects/0be0ad724d6847f1bc9f51de4d604cad` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:54.412307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa43302-7df1-4851-b7b7-a9762f01f9aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be0ad724d6847f1bc9f51de4d604cad)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:54.415263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa43302-7df1-4851-b7b7-a9762f01f9aa admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:54.429296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-11b05d5e-5958-4367-9caa-3ae46caef187 None None] MFA Rules not processed for user `0666095c0f6c4718abcb6cf4f2e0faf9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:54.431667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-11b05d5e-5958-4367-9caa-3ae46caef187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:54.481182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2fa43302-7df1-4851-b7b7-a9762f01f9aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be0ad724d6847f1bc9f51de4d604cad', 'request_id': 'req-2fa43302-7df1-4851-b7b7-a9762f01f9aa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:54.494789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2fa43302-7df1-4851-b7b7-a9762f01f9aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be0ad724d6847f1bc9f51de4d604cad', 'request_id': 'req-2fa43302-7df1-4851-b7b7-a9762f01f9aa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:54.508425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2fa43302-7df1-4851-b7b7-a9762f01f9aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be0ad724d6847f1bc9f51de4d604cad', 'request_id': 'req-2fa43302-7df1-4851-b7b7-a9762f01f9aa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:54.521966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2fa43302-7df1-4851-b7b7-a9762f01f9aa admin admin] The token cache is being invalidate because project 0be0ad724d6847f1bc9f51de4d604cad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:54.522489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2fa43302-7df1-4851-b7b7-a9762f01f9aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:54.523364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2fa43302-7df1-4851-b7b7-a9762f01f9aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:54.527322 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1095/2204] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:54 2022] DELETE /identity/v3/projects/0be0ad724d6847f1bc9f51de4d604cad => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:54.528720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa43302-7df1-4851-b7b7-a9762f01f9aa admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:54.530284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2fa43302-7df1-4851-b7b7-a9762f01f9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:54.541216 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1110/2205] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:54.542615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b05d5e-5958-4367-9caa-3ae46caef187 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:54.558697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b05d5e-5958-4367-9caa-3ae46caef187 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:54.633036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa43302-7df1-4851-b7b7-a9762f01f9aa admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:54.652377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b995d-4485-45bf-afcf-20ca0f0e436e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:54.655459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b995d-4485-45bf-afcf-20ca0f0e436e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:54.656093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b995d-4485-45bf-afcf-20ca0f0e436e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:54.656916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b995d-4485-45bf-afcf-20ca0f0e436e admin admin] PATH_INFO: `/v3/users/68142e14d77c4c1e8249d90cd3e8c1fa` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:54.658837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b995d-4485-45bf-afcf-20ca0f0e436e admin admin] RBAC: Authorizing `identity:delete_user(user_id=68142e14d77c4c1e8249d90cd3e8c1fa)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:54.661655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b995d-4485-45bf-afcf-20ca0f0e436e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:54.670812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278d086-929a-4923-96e9-690f867683e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:54.671811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278d086-929a-4923-96e9-690f867683e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:54.672253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278d086-929a-4923-96e9-690f867683e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:54.672640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278d086-929a-4923-96e9-690f867683e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:54.673532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278d086-929a-4923-96e9-690f867683e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:54.676789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278d086-929a-4923-96e9-690f867683e0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:54.707409 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1111/2206] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:54 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:54.708343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894259-d94c-4d1f-b6e9-4ac156c14cdc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:54.708637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894259-d94c-4d1f-b6e9-4ac156c14cdc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:54.708919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894259-d94c-4d1f-b6e9-4ac156c14cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:54.722817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:54.725702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a03b995d-4485-45bf-afcf-20ca0f0e436e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68142e14d77c4c1e8249d90cd3e8c1fa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:54.728565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5a894259-d94c-4d1f-b6e9-4ac156c14cdc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:54.729833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5a894259-d94c-4d1f-b6e9-4ac156c14cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:54.740420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a03b995d-4485-45bf-afcf-20ca0f0e436e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68142e14d77c4c1e8249d90cd3e8c1fa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:54.741122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a03b995d-4485-45bf-afcf-20ca0f0e436e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68142e14d77c4c1e8249d90cd3e8c1fa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:54.749489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a03b995d-4485-45bf-afcf-20ca0f0e436e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68142e14d77c4c1e8249d90cd3e8c1fa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:54.750227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a03b995d-4485-45bf-afcf-20ca0f0e436e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68142e14d77c4c1e8249d90cd3e8c1fa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:54.763314 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1096/2207] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:54 2022] DELETE /identity/v3/users/68142e14d77c4c1e8249d90cd3e8c1fa => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:54.764375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b995d-4485-45bf-afcf-20ca0f0e436e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:54.765800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a03b995d-4485-45bf-afcf-20ca0f0e436e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:54.779876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:54.798054 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1112/2208] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:54.799130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a894259-d94c-4d1f-b6e9-4ac156c14cdc None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:54.800892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5a894259-d94c-4d1f-b6e9-4ac156c14cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:54.813119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a894259-d94c-4d1f-b6e9-4ac156c14cdc None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:54.841795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b995d-4485-45bf-afcf-20ca0f0e436e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:54.847891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196f140-4e25-44d5-ae1b-1c41de2e0bbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:54.848518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196f140-4e25-44d5-ae1b-1c41de2e0bbb service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:54.848802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196f140-4e25-44d5-ae1b-1c41de2e0bbb service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:54.849076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196f140-4e25-44d5-ae1b-1c41de2e0bbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:54.850998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9196f140-4e25-44d5-ae1b-1c41de2e0bbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:54.872752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a55431-0c86-4a78-a206-f0baf628c274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:54.873429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a55431-0c86-4a78-a206-f0baf628c274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:54.873711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a55431-0c86-4a78-a206-f0baf628c274 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:54.873988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a55431-0c86-4a78-a206-f0baf628c274 admin admin] PATH_INFO: `/v3/projects/d11e2bfd5060402bbf2770a6f85accef` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:54.875153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a55431-0c86-4a78-a206-f0baf628c274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d11e2bfd5060402bbf2770a6f85accef)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:54.877094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a55431-0c86-4a78-a206-f0baf628c274 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:54.924418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196f140-4e25-44d5-ae1b-1c41de2e0bbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:54.927016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196f140-4e25-44d5-ae1b-1c41de2e0bbb service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:54.935078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5a55431-0c86-4a78-a206-f0baf628c274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11e2bfd5060402bbf2770a6f85accef', 'request_id': 'req-a5a55431-0c86-4a78-a206-f0baf628c274'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:54.939180 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1097/2209] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:54 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:54.944015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764bf5f-0953-4372-934a-6e4c2b924519 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:54.944505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764bf5f-0953-4372-934a-6e4c2b924519 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:54.944797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764bf5f-0953-4372-934a-6e4c2b924519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:54.956094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5a55431-0c86-4a78-a206-f0baf628c274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11e2bfd5060402bbf2770a6f85accef', 'request_id': 'req-a5a55431-0c86-4a78-a206-f0baf628c274'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:54.970313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8764bf5f-0953-4372-934a-6e4c2b924519 None None] MFA Rules not processed for user `b2a05aa5d80844848bf57f6ca093e582`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:54.972587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8764bf5f-0953-4372-934a-6e4c2b924519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:54.976160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5a55431-0c86-4a78-a206-f0baf628c274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11e2bfd5060402bbf2770a6f85accef', 'request_id': 'req-a5a55431-0c86-4a78-a206-f0baf628c274'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:54.997136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5a55431-0c86-4a78-a206-f0baf628c274 admin admin] The token cache is being invalidate because project d11e2bfd5060402bbf2770a6f85accef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:54.997532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5a55431-0c86-4a78-a206-f0baf628c274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:54.998590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5a55431-0c86-4a78-a206-f0baf628c274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:55.000747 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1113/2210] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:54 2022] DELETE /identity/v3/projects/d11e2bfd5060402bbf2770a6f85accef => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:55.001480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a55431-0c86-4a78-a206-f0baf628c274 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:55.002866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a5a55431-0c86-4a78-a206-f0baf628c274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:55.094429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:55.118205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a55431-0c86-4a78-a206-f0baf628c274 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:55.120707 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1098/2211] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:55.122305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b83ff-54ac-4631-b69d-66e9ff7bb9fc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:55.122614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b83ff-54ac-4631-b69d-66e9ff7bb9fc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:55.122860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b83ff-54ac-4631-b69d-66e9ff7bb9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:55.130081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c2723-4d88-4d5f-a116-2b7352a89b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:55.130953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c2723-4d88-4d5f-a116-2b7352a89b62 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:55.131419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c2723-4d88-4d5f-a116-2b7352a89b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:55.131775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c2723-4d88-4d5f-a116-2b7352a89b62 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:55.132782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c2723-4d88-4d5f-a116-2b7352a89b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:55.136432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c2723-4d88-4d5f-a116-2b7352a89b62 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:55.146526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-524b83ff-54ac-4631-b69d-66e9ff7bb9fc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:55.147940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-524b83ff-54ac-4631-b69d-66e9ff7bb9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:55.161494 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1099/2212] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:55.163247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f5041-d285-47e3-b62c-947941622045 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:55.163947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f5041-d285-47e3-b62c-947941622045 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:55.164520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f5041-d285-47e3-b62c-947941622045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:55.177544 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1114/2213] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:55 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:55.178662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319f80a-66ca-4aa6-9522-02b99099301e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:55.180440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319f80a-66ca-4aa6-9522-02b99099301e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:55.181031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319f80a-66ca-4aa6-9522-02b99099301e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:55.196144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-669f5041-d285-47e3-b62c-947941622045 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:55.197737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-669f5041-d285-47e3-b62c-947941622045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:55.208465 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1100/2214] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:55.210434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f5041-d285-47e3-b62c-947941622045 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:55.223811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f5041-d285-47e3-b62c-947941622045 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:55.229336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3319f80a-66ca-4aa6-9522-02b99099301e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:55.233512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3319f80a-66ca-4aa6-9522-02b99099301e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:55.235967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35a968-9ded-4165-8ba1-c2e19f49a8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:55.236822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35a968-9ded-4165-8ba1-c2e19f49a8fb admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:55.236977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35a968-9ded-4165-8ba1-c2e19f49a8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:55.238466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35a968-9ded-4165-8ba1-c2e19f49a8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:55.241442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35a968-9ded-4165-8ba1-c2e19f49a8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:55.245334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35a968-9ded-4165-8ba1-c2e19f49a8fb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:55.257159 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1115/2215] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:55.259611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319f80a-66ca-4aa6-9522-02b99099301e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:55.265421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3319f80a-66ca-4aa6-9522-02b99099301e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:55.278413 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1101/2216] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:55.279456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35a968-9ded-4165-8ba1-c2e19f49a8fb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:55.282434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:55.318050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35a968-9ded-4165-8ba1-c2e19f49a8fb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:55.332375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd756cb-51a0-4fe0-a575-700c8a356162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:55.333012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd756cb-51a0-4fe0-a575-700c8a356162 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:55.333339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd756cb-51a0-4fe0-a575-700c8a356162 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:55.333550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd756cb-51a0-4fe0-a575-700c8a356162 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:55.334259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd756cb-51a0-4fe0-a575-700c8a356162 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:01:55.334565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd756cb-51a0-4fe0-a575-700c8a356162 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:55.336209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd756cb-51a0-4fe0-a575-700c8a356162 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:55.375054 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1102/2217] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:01:55.379741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3976077-3f58-4b2f-971c-dc14700ebd55 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:55.380039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3976077-3f58-4b2f-971c-dc14700ebd55 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:55.380323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3976077-3f58-4b2f-971c-dc14700ebd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:55.404855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d3976077-3f58-4b2f-971c-dc14700ebd55 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:55.408648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d3976077-3f58-4b2f-971c-dc14700ebd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:55.429352 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1103/2218] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:55.430367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3976077-3f58-4b2f-971c-dc14700ebd55 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:55.431432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319f80a-66ca-4aa6-9522-02b99099301e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:55.445519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4eceda-1121-4ee5-8d21-90972c5cf9a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:55.446345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4eceda-1121-4ee5-8d21-90972c5cf9a4 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:55.446652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4eceda-1121-4ee5-8d21-90972c5cf9a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:55.447054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4eceda-1121-4ee5-8d21-90972c5cf9a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:55.454985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3976077-3f58-4b2f-971c-dc14700ebd55 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:55.465489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4eceda-1121-4ee5-8d21-90972c5cf9a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:55.466691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1e3a4-0210-494a-85b9-bd66350d2642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:55.467177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4eceda-1121-4ee5-8d21-90972c5cf9a4 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:55.467616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1e3a4-0210-494a-85b9-bd66350d2642 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:55.468021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1e3a4-0210-494a-85b9-bd66350d2642 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:55.468399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1e3a4-0210-494a-85b9-bd66350d2642 admin admin] PATH_INFO: `/v3/projects/236565d242de4eafae9d660b65dfec2b/users/fe7ebedd731a466db8928af5ee72ca11/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:55.483338 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1116/2219] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:55.484821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4eceda-1121-4ee5-8d21-90972c5cf9a4 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:55.488375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1e3a4-0210-494a-85b9-bd66350d2642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=236565d242de4eafae9d660b65dfec2b, user_id=fe7ebedd731a466db8928af5ee72ca11, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:55.491505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1e3a4-0210-494a-85b9-bd66350d2642 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:55.514333 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1104/2220] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:55 2022] PUT /identity/v3/projects/236565d242de4eafae9d660b65dfec2b/users/fe7ebedd731a466db8928af5ee72ca11/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:55.518426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1e3a4-0210-494a-85b9-bd66350d2642 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:55.526316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4eceda-1121-4ee5-8d21-90972c5cf9a4 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:55.646407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1e3a4-0210-494a-85b9-bd66350d2642 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:55.654958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156367be-169c-4646-9c1d-7710e51a70e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:55.655868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156367be-169c-4646-9c1d-7710e51a70e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:55.656338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156367be-169c-4646-9c1d-7710e51a70e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:55.656805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156367be-169c-4646-9c1d-7710e51a70e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:55.658231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156367be-169c-4646-9c1d-7710e51a70e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:01:55.658772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156367be-169c-4646-9c1d-7710e51a70e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:55.661211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156367be-169c-4646-9c1d-7710e51a70e9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:55.691458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99543e6a-51a3-4190-99ee-a29c8291a58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:55.691713 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1105/2221] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:01:55.692264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99543e6a-51a3-4190-99ee-a29c8291a58b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:55.692614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99543e6a-51a3-4190-99ee-a29c8291a58b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:55.692847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156367be-169c-4646-9c1d-7710e51a70e9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:55.692981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99543e6a-51a3-4190-99ee-a29c8291a58b admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:55.693833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99543e6a-51a3-4190-99ee-a29c8291a58b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:55.697150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99543e6a-51a3-4190-99ee-a29c8291a58b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:55.709499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156367be-169c-4646-9c1d-7710e51a70e9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:55.715736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55477f7a-9945-45d7-9a0e-8df66f827db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:55.716587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55477f7a-9945-45d7-9a0e-8df66f827db6 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:55.717253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55477f7a-9945-45d7-9a0e-8df66f827db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:55.717608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55477f7a-9945-45d7-9a0e-8df66f827db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:55.718574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55477f7a-9945-45d7-9a0e-8df66f827db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:55.722577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55477f7a-9945-45d7-9a0e-8df66f827db6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:55.743136 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1106/2223] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:55.743349 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1117/2223] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:55 2022] POST /identity/v3/projects => generated 375 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:55.743441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55477f7a-9945-45d7-9a0e-8df66f827db6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:55.743517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99543e6a-51a3-4190-99ee-a29c8291a58b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:55.758204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55477f7a-9945-45d7-9a0e-8df66f827db6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:55.839943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254eda0-d131-4e2e-8715-d2ceef942682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:55.840964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254eda0-d131-4e2e-8715-d2ceef942682 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:55.842084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254eda0-d131-4e2e-8715-d2ceef942682 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:55.842449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254eda0-d131-4e2e-8715-d2ceef942682 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:55.844146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254eda0-d131-4e2e-8715-d2ceef942682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:55.846598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254eda0-d131-4e2e-8715-d2ceef942682 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:55.868241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99543e6a-51a3-4190-99ee-a29c8291a58b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:55.872069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:55.875685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7d47e-7735-476b-8eec-a2670635f7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:55.876877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7d47e-7735-476b-8eec-a2670635f7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:55.877383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7d47e-7735-476b-8eec-a2670635f7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:55.877784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7d47e-7735-476b-8eec-a2670635f7a8 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:55.879345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7d47e-7735-476b-8eec-a2670635f7a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:55.881491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7d47e-7735-476b-8eec-a2670635f7a8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:55.887798 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1107/2224] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:55 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:55.889045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254eda0-d131-4e2e-8715-d2ceef942682 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:55.921270 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1118/2225] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:55 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:55.921768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7d47e-7735-476b-8eec-a2670635f7a8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:55.935329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7d47e-7735-476b-8eec-a2670635f7a8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:55.961859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:55.988941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254eda0-d131-4e2e-8715-d2ceef942682 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:56.010608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f83a36-6189-4780-9bce-53194b70e46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:56.011334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f83a36-6189-4780-9bce-53194b70e46b admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:56.012189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f83a36-6189-4780-9bce-53194b70e46b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:56.012482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f83a36-6189-4780-9bce-53194b70e46b admin admin] PATH_INFO: `/v3/projects/236565d242de4eafae9d660b65dfec2b/users/fe7ebedd731a466db8928af5ee72ca11/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:56.017307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f83a36-6189-4780-9bce-53194b70e46b admin admin] RBAC: Authorizing `identity:create_grant(project_id=236565d242de4eafae9d660b65dfec2b, user_id=fe7ebedd731a466db8928af5ee72ca11, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:56.021985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f83a36-6189-4780-9bce-53194b70e46b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:56.040961 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1108/2226] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:55 2022] PUT /identity/v3/projects/236565d242de4eafae9d660b65dfec2b/users/fe7ebedd731a466db8928af5ee72ca11/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:56.042206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f83a36-6189-4780-9bce-53194b70e46b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:56.062412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f62c46-7abb-4a37-a5c8-8bc582a4a570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:56.063630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f62c46-7abb-4a37-a5c8-8bc582a4a570 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:56.064154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f62c46-7abb-4a37-a5c8-8bc582a4a570 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:56.064644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f62c46-7abb-4a37-a5c8-8bc582a4a570 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:56.066215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f62c46-7abb-4a37-a5c8-8bc582a4a570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:56.078535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f62c46-7abb-4a37-a5c8-8bc582a4a570 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:56.109571 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1119/2227] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:55 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:56.111217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7db65-d818-4ced-bbdc-0a36b00c67f2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:56.111635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7db65-d818-4ced-bbdc-0a36b00c67f2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:56.112055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7db65-d818-4ced-bbdc-0a36b00c67f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:56.158384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ede7db65-d818-4ced-bbdc-0a36b00c67f2 None None] MFA Rules not processed for user `fe7ebedd731a466db8928af5ee72ca11`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:56.160901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ede7db65-d818-4ced-bbdc-0a36b00c67f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:56.225060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f83a36-6189-4780-9bce-53194b70e46b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:56.244621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b0a08-a483-4d28-b62e-9848e3c4e3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:56.246170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b0a08-a483-4d28-b62e-9848e3c4e3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:56.246817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b0a08-a483-4d28-b62e-9848e3c4e3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:56.247228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b0a08-a483-4d28-b62e-9848e3c4e3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:56.248065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b0a08-a483-4d28-b62e-9848e3c4e3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:56.254819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b0a08-a483-4d28-b62e-9848e3c4e3e3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:56.271565 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1109/2228] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:56.272828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b0a08-a483-4d28-b62e-9848e3c4e3e3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:56.285071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b0a08-a483-4d28-b62e-9848e3c4e3e3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:56.316082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6456bd1-bd12-4493-857d-c1e9ed29f008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:56.316979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6456bd1-bd12-4493-857d-c1e9ed29f008 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:56.317184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6456bd1-bd12-4493-857d-c1e9ed29f008 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:56.317685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6456bd1-bd12-4493-857d-c1e9ed29f008 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:56.318541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6456bd1-bd12-4493-857d-c1e9ed29f008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:56.322587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6456bd1-bd12-4493-857d-c1e9ed29f008 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:56.335847 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1120/2229] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:56.343700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7db65-d818-4ced-bbdc-0a36b00c67f2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:56.352560 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1110/2230] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:56.353417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6456bd1-bd12-4493-857d-c1e9ed29f008 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:56.358610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7db65-d818-4ced-bbdc-0a36b00c67f2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:56.361141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e6456bd1-bd12-4493-857d-c1e9ed29f008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:56.366794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b195ed6-8a18-4b3f-9d7b-26b0d80ff787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:56.367546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b195ed6-8a18-4b3f-9d7b-26b0d80ff787 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:56.367847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b195ed6-8a18-4b3f-9d7b-26b0d80ff787 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:56.368151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b195ed6-8a18-4b3f-9d7b-26b0d80ff787 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:56.368857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b195ed6-8a18-4b3f-9d7b-26b0d80ff787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:56.371386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b195ed6-8a18-4b3f-9d7b-26b0d80ff787 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:56.381862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6456bd1-bd12-4493-857d-c1e9ed29f008 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:56.389329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40024728-d0f8-4072-ba0a-a9073693470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:56.390058 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1121/2231] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:56.390908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40024728-d0f8-4072-ba0a-a9073693470c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:56.391025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b195ed6-8a18-4b3f-9d7b-26b0d80ff787 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:56.391567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40024728-d0f8-4072-ba0a-a9073693470c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:56.392081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40024728-d0f8-4072-ba0a-a9073693470c admin admin] PATH_INFO: `/v3/projects/c6e36ee8bd784bdea8aa1f7bec70b796` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:56.394309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40024728-d0f8-4072-ba0a-a9073693470c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e36ee8bd784bdea8aa1f7bec70b796)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:56.397366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40024728-d0f8-4072-ba0a-a9073693470c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:56.406643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6b195ed6-8a18-4b3f-9d7b-26b0d80ff787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:56.484790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-40024728-d0f8-4072-ba0a-a9073693470c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e36ee8bd784bdea8aa1f7bec70b796', 'request_id': 'req-40024728-d0f8-4072-ba0a-a9073693470c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:56.494571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-40024728-d0f8-4072-ba0a-a9073693470c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e36ee8bd784bdea8aa1f7bec70b796', 'request_id': 'req-40024728-d0f8-4072-ba0a-a9073693470c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:56.507308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-40024728-d0f8-4072-ba0a-a9073693470c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e36ee8bd784bdea8aa1f7bec70b796', 'request_id': 'req-40024728-d0f8-4072-ba0a-a9073693470c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:56.521655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:56.527379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-40024728-d0f8-4072-ba0a-a9073693470c admin admin] The token cache is being invalidate because project c6e36ee8bd784bdea8aa1f7bec70b796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:56.527781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-40024728-d0f8-4072-ba0a-a9073693470c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:56.530322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-40024728-d0f8-4072-ba0a-a9073693470c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:56.536978 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1111/2232] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:56 2022] DELETE /identity/v3/projects/c6e36ee8bd784bdea8aa1f7bec70b796 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:56.537953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40024728-d0f8-4072-ba0a-a9073693470c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:56.541077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-40024728-d0f8-4072-ba0a-a9073693470c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:56.574667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b195ed6-8a18-4b3f-9d7b-26b0d80ff787 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:56.614811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:56.631210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40024728-d0f8-4072-ba0a-a9073693470c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:56.639426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730dc83-0454-426f-af51-51420c909643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:56.640094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730dc83-0454-426f-af51-51420c909643 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:56.641236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730dc83-0454-426f-af51-51420c909643 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:56.641519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730dc83-0454-426f-af51-51420c909643 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:56.642243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730dc83-0454-426f-af51-51420c909643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:56.646495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730dc83-0454-426f-af51-51420c909643 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:56.662659 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1112/2233] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:56.664889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730dc83-0454-426f-af51-51420c909643 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:56.668171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f730dc83-0454-426f-af51-51420c909643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:56.683728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c9608-f63e-4653-b293-adab1d9c76b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:56.684496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c9608-f63e-4653-b293-adab1d9c76b0 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:56.684960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c9608-f63e-4653-b293-adab1d9c76b0 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:56.685123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c9608-f63e-4653-b293-adab1d9c76b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:56.687638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8f1c9608-f63e-4653-b293-adab1d9c76b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:56.689484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730dc83-0454-426f-af51-51420c909643 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:56.697686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdb131-797a-4dce-84f1-9c9e91b255c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:56.698733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdb131-797a-4dce-84f1-9c9e91b255c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:56.699010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdb131-797a-4dce-84f1-9c9e91b255c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:56.699481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdb131-797a-4dce-84f1-9c9e91b255c0 admin admin] PATH_INFO: `/v3/projects/adf4314354ea4f54a022211569ff95e8/users/689862aa8b9745279b6a819735392e23/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:56.720202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdb131-797a-4dce-84f1-9c9e91b255c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf4314354ea4f54a022211569ff95e8, user_id=689862aa8b9745279b6a819735392e23, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:56.725243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdb131-797a-4dce-84f1-9c9e91b255c0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:56.744517 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1113/2234] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:56 2022] PUT /identity/v3/projects/adf4314354ea4f54a022211569ff95e8/users/689862aa8b9745279b6a819735392e23/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:56.746838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdb131-797a-4dce-84f1-9c9e91b255c0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:56.748859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-edcdb131-797a-4dce-84f1-9c9e91b255c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:56.792294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c9608-f63e-4653-b293-adab1d9c76b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:56.793980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c9608-f63e-4653-b293-adab1d9c76b0 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:56.807728 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1122/2235] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:56.820342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c9608-f63e-4653-b293-adab1d9c76b0 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:56.823645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8f1c9608-f63e-4653-b293-adab1d9c76b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:56.853613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c9608-f63e-4653-b293-adab1d9c76b0 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:56.888120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdb131-797a-4dce-84f1-9c9e91b255c0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:56.907122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3576c41-f855-4eab-adab-59dc560974e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:56.907825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3576c41-f855-4eab-adab-59dc560974e0 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:56.908092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3576c41-f855-4eab-adab-59dc560974e0 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:56.908368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3576c41-f855-4eab-adab-59dc560974e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:56.921164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e3576c41-f855-4eab-adab-59dc560974e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:56.948736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92d2ce-72ee-40ea-ad04-a856bfd58618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:56.949462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92d2ce-72ee-40ea-ad04-a856bfd58618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:56.950287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92d2ce-72ee-40ea-ad04-a856bfd58618 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:56.950699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92d2ce-72ee-40ea-ad04-a856bfd58618 admin admin] PATH_INFO: `/v3/users/fc88f95a97e24c6f836ef5ba592d6fc7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:56.952202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92d2ce-72ee-40ea-ad04-a856bfd58618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc88f95a97e24c6f836ef5ba592d6fc7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:56.954339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92d2ce-72ee-40ea-ad04-a856bfd58618 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:57.042014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3576c41-f855-4eab-adab-59dc560974e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:57.048524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3576c41-f855-4eab-adab-59dc560974e0 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:57.071253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bb92d2ce-72ee-40ea-ad04-a856bfd58618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc88f95a97e24c6f836ef5ba592d6fc7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:57.072083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bb92d2ce-72ee-40ea-ad04-a856bfd58618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc88f95a97e24c6f836ef5ba592d6fc7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:57.092353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:57.104358 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1114/2236] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:56 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:57.105062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3576c41-f855-4eab-adab-59dc560974e0 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:57.119557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bb92d2ce-72ee-40ea-ad04-a856bfd58618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc88f95a97e24c6f836ef5ba592d6fc7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:57.121199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bb92d2ce-72ee-40ea-ad04-a856bfd58618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc88f95a97e24c6f836ef5ba592d6fc7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:57.143043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3576c41-f855-4eab-adab-59dc560974e0 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:57.155252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bb92d2ce-72ee-40ea-ad04-a856bfd58618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc88f95a97e24c6f836ef5ba592d6fc7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:57.157200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b15da8-0fbd-4fbc-82ca-d4addd412dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:57.163395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b15da8-0fbd-4fbc-82ca-d4addd412dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:57.163693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b15da8-0fbd-4fbc-82ca-d4addd412dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:57.163979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b15da8-0fbd-4fbc-82ca-d4addd412dbe admin admin] PATH_INFO: `/v3/projects/7f71035a2ae04a76a9e82b6ccd3759cc/users/794f1a4f424d4b71a23649a4d178df28/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:57.176418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:57.182415 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1123/2237] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:56 2022] DELETE /identity/v3/users/fc88f95a97e24c6f836ef5ba592d6fc7 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:57.184386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a058fea-e6ea-498f-8809-bd40a19b321c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:57.186603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a058fea-e6ea-498f-8809-bd40a19b321c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:57.187663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a058fea-e6ea-498f-8809-bd40a19b321c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:57.207076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b15da8-0fbd-4fbc-82ca-d4addd412dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f71035a2ae04a76a9e82b6ccd3759cc, user_id=794f1a4f424d4b71a23649a4d178df28, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:57.221705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b15da8-0fbd-4fbc-82ca-d4addd412dbe admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:57.229111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3a058fea-e6ea-498f-8809-bd40a19b321c None None] MFA Rules not processed for user `689862aa8b9745279b6a819735392e23`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:57.230561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3a058fea-e6ea-498f-8809-bd40a19b321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:57.248312 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1115/2238] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:57 2022] PUT /identity/v3/projects/7f71035a2ae04a76a9e82b6ccd3759cc/users/794f1a4f424d4b71a23649a4d178df28/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:57.255451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b15da8-0fbd-4fbc-82ca-d4addd412dbe admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:57.263139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-85b15da8-0fbd-4fbc-82ca-d4addd412dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:57.348572 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1124/2239] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:57.349519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a058fea-e6ea-498f-8809-bd40a19b321c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:57.355526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3a058fea-e6ea-498f-8809-bd40a19b321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:57.406954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b15da8-0fbd-4fbc-82ca-d4addd412dbe admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:57.419830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e3eed-ff36-4923-94aa-0b3191c0bdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:57.420455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e3eed-ff36-4923-94aa-0b3191c0bdb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:57.420746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e3eed-ff36-4923-94aa-0b3191c0bdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:57.421030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e3eed-ff36-4923-94aa-0b3191c0bdb2 admin admin] PATH_INFO: `/v3/users/9a8dc3e3d50349a1964b714ffe3f5ca7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:57.425617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e3eed-ff36-4923-94aa-0b3191c0bdb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a8dc3e3d50349a1964b714ffe3f5ca7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:57.427775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e3eed-ff36-4923-94aa-0b3191c0bdb2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:57.524918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a058fea-e6ea-498f-8809-bd40a19b321c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:57.534781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9f1e3eed-ff36-4923-94aa-0b3191c0bdb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a8dc3e3d50349a1964b714ffe3f5ca7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:57.549524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9f1e3eed-ff36-4923-94aa-0b3191c0bdb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a8dc3e3d50349a1964b714ffe3f5ca7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:57.550907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9f1e3eed-ff36-4923-94aa-0b3191c0bdb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a8dc3e3d50349a1964b714ffe3f5ca7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:57.559732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9f1e3eed-ff36-4923-94aa-0b3191c0bdb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a8dc3e3d50349a1964b714ffe3f5ca7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:57.560577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9f1e3eed-ff36-4923-94aa-0b3191c0bdb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a8dc3e3d50349a1964b714ffe3f5ca7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:57.603640 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1116/2240] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:57 2022] DELETE /identity/v3/users/9a8dc3e3d50349a1964b714ffe3f5ca7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:57.606650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a028674-1899-4710-8785-36a5428bd5e3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:57.606948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a028674-1899-4710-8785-36a5428bd5e3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:57.607227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a028674-1899-4710-8785-36a5428bd5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:57.626438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:57.648723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996c197-5065-4220-93e3-70c2e7d509e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:57.649832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996c197-5065-4220-93e3-70c2e7d509e6 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:57.650514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996c197-5065-4220-93e3-70c2e7d509e6 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:57.650965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996c197-5065-4220-93e3-70c2e7d509e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:57.653109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7996c197-5065-4220-93e3-70c2e7d509e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:57.697874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5a028674-1899-4710-8785-36a5428bd5e3 None None] MFA Rules not processed for user `794f1a4f424d4b71a23649a4d178df28`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:57.701553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5a028674-1899-4710-8785-36a5428bd5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:57.795435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996c197-5065-4220-93e3-70c2e7d509e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:57.800964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996c197-5065-4220-93e3-70c2e7d509e6 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:57.822587 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1125/2241] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:57.823984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996c197-5065-4220-93e3-70c2e7d509e6 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:57.825412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7996c197-5065-4220-93e3-70c2e7d509e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:57.856508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996c197-5065-4220-93e3-70c2e7d509e6 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:57.905834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:57.950168 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1117/2242] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:57.954696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad4dff-c00b-454d-a116-c1d8b4df8d7d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:57.955141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad4dff-c00b-454d-a116-c1d8b4df8d7d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:57.956675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad4dff-c00b-454d-a116-c1d8b4df8d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:58.003510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-44ad4dff-c00b-454d-a116-c1d8b4df8d7d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:58.005213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-44ad4dff-c00b-454d-a116-c1d8b4df8d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:58.050225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c1130-0717-404d-a947-5d2705e56e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:58.051001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c1130-0717-404d-a947-5d2705e56e9d admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:58.051495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c1130-0717-404d-a947-5d2705e56e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:58.051849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c1130-0717-404d-a947-5d2705e56e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:58.052595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c1130-0717-404d-a947-5d2705e56e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:58.055315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c1130-0717-404d-a947-5d2705e56e9d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:58.097453 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1126/2243] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:57 2022] POST /identity/v3/projects => generated 373 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:58.098498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c1130-0717-404d-a947-5d2705e56e9d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:58.100454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-887c1130-0717-404d-a947-5d2705e56e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:58.145753 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1118/2244] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:58.145753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad4dff-c00b-454d-a116-c1d8b4df8d7d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:58.160872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad4dff-c00b-454d-a116-c1d8b4df8d7d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:58.208284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c1130-0717-404d-a947-5d2705e56e9d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:58.243831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afbcaa-cb5f-41d6-ad0d-70ba8278c5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:58.244482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afbcaa-cb5f-41d6-ad0d-70ba8278c5b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:58.244766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afbcaa-cb5f-41d6-ad0d-70ba8278c5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:58.245293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afbcaa-cb5f-41d6-ad0d-70ba8278c5b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:58.245972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afbcaa-cb5f-41d6-ad0d-70ba8278c5b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:58.247932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afbcaa-cb5f-41d6-ad0d-70ba8278c5b2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:58.300800 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1127/2245] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:58 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:58.301664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afbcaa-cb5f-41d6-ad0d-70ba8278c5b2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:58.303591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-47afbcaa-cb5f-41d6-ad0d-70ba8278c5b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:58.317573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:58.324111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3748ae-a619-4e99-90e2-c4098e401d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:58.324903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3748ae-a619-4e99-90e2-c4098e401d3b admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:58.325580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3748ae-a619-4e99-90e2-c4098e401d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:58.325873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3748ae-a619-4e99-90e2-c4098e401d3b admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:58.326551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3748ae-a619-4e99-90e2-c4098e401d3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:58.328944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3748ae-a619-4e99-90e2-c4098e401d3b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:58.381471 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1119/2246] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:58 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:58.397344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3748ae-a619-4e99-90e2-c4098e401d3b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:58.401626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afbcaa-cb5f-41d6-ad0d-70ba8278c5b2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:58.402886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bd3748ae-a619-4e99-90e2-c4098e401d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:58.409667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9224f0-c5ae-427a-b64f-efe7736a101b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:58.411246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9224f0-c5ae-427a-b64f-efe7736a101b service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:58.411777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9224f0-c5ae-427a-b64f-efe7736a101b service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:58.412254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9224f0-c5ae-427a-b64f-efe7736a101b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:58.435947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3748ae-a619-4e99-90e2-c4098e401d3b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:58.579702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9224f0-c5ae-427a-b64f-efe7736a101b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:58.581301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9224f0-c5ae-427a-b64f-efe7736a101b service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:58.598951 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1128/2247] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:58.600392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f4968-1bfa-4a9c-b363-60e594c72174 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:58.600776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f4968-1bfa-4a9c-b363-60e594c72174 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:58.601058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f4968-1bfa-4a9c-b363-60e594c72174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:58.607390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45e8a5-fa83-4541-a0cb-d6f1bff4e19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:58.609270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45e8a5-fa83-4541-a0cb-d6f1bff4e19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:58.609565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45e8a5-fa83-4541-a0cb-d6f1bff4e19d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:58.609858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45e8a5-fa83-4541-a0cb-d6f1bff4e19d admin admin] PATH_INFO: `/v3/projects/509e418052584bd0b6b9da5735109d0c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:58.617705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45e8a5-fa83-4541-a0cb-d6f1bff4e19d admin admin] RBAC: Authorizing `identity:delete_project(project_id=509e418052584bd0b6b9da5735109d0c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:58.619767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45e8a5-fa83-4541-a0cb-d6f1bff4e19d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:58.622080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7a2f4968-1bfa-4a9c-b363-60e594c72174 None None] MFA Rules not processed for user `46d7264a2f63436bb8519cd8cec6d9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:58.623315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7a2f4968-1bfa-4a9c-b363-60e594c72174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:58.689924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:58.715666 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1129/2248] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:58.718676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f4968-1bfa-4a9c-b363-60e594c72174 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:58.723037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb45e8a5-fa83-4541-a0cb-d6f1bff4e19d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509e418052584bd0b6b9da5735109d0c', 'request_id': 'req-fb45e8a5-fa83-4541-a0cb-d6f1bff4e19d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:58.738050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb45e8a5-fa83-4541-a0cb-d6f1bff4e19d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509e418052584bd0b6b9da5735109d0c', 'request_id': 'req-fb45e8a5-fa83-4541-a0cb-d6f1bff4e19d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:58.745629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f4968-1bfa-4a9c-b363-60e594c72174 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:58.754589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb45e8a5-fa83-4541-a0cb-d6f1bff4e19d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509e418052584bd0b6b9da5735109d0c', 'request_id': 'req-fb45e8a5-fa83-4541-a0cb-d6f1bff4e19d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:58.777377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb45e8a5-fa83-4541-a0cb-d6f1bff4e19d admin admin] The token cache is being invalidate because project 509e418052584bd0b6b9da5735109d0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:01:58.777752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb45e8a5-fa83-4541-a0cb-d6f1bff4e19d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:58.778380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb45e8a5-fa83-4541-a0cb-d6f1bff4e19d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:58.780986 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1120/2249] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:01:58 2022] DELETE /identity/v3/projects/509e418052584bd0b6b9da5735109d0c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:58.781903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45e8a5-fa83-4541-a0cb-d6f1bff4e19d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:58.784078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fb45e8a5-fa83-4541-a0cb-d6f1bff4e19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:58.876435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ee104-7efc-4db6-8d35-070dc3a7d640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:58.878014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ee104-7efc-4db6-8d35-070dc3a7d640 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:58.878366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ee104-7efc-4db6-8d35-070dc3a7d640 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:58.878652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ee104-7efc-4db6-8d35-070dc3a7d640 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:58.879606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ee104-7efc-4db6-8d35-070dc3a7d640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:58.882068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ee104-7efc-4db6-8d35-070dc3a7d640 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:58.889518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45e8a5-fa83-4541-a0cb-d6f1bff4e19d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:58.895087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071acf2-73a0-4769-b3ea-51f3e705cfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:58.895495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:58.896202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071acf2-73a0-4769-b3ea-51f3e705cfdf admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:58.896641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071acf2-73a0-4769-b3ea-51f3e705cfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:58.897056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071acf2-73a0-4769-b3ea-51f3e705cfdf admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:58.897980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071acf2-73a0-4769-b3ea-51f3e705cfdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:58.900742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071acf2-73a0-4769-b3ea-51f3e705cfdf admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:58.918187 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1121/2250] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:58.919329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071acf2-73a0-4769-b3ea-51f3e705cfdf admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:58.921309 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1130/2251] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:58 2022] POST /identity/v3/users => generated 295 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:58.923676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8071acf2-73a0-4769-b3ea-51f3e705cfdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:58.924399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0233b-275b-458e-a29f-6f8f15903b85 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:58.925471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0233b-275b-458e-a29f-6f8f15903b85 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:58.925731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0233b-275b-458e-a29f-6f8f15903b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:58.945801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071acf2-73a0-4769-b3ea-51f3e705cfdf admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:58.952503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15998414-2072-498d-91e3-c54e2f700832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:58.953439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15998414-2072-498d-91e3-c54e2f700832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:58.953891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15998414-2072-498d-91e3-c54e2f700832 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:58.954463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15998414-2072-498d-91e3-c54e2f700832 admin admin] PATH_INFO: `/v3/users/7c25e4232a504fa5b42ab27ec4481f36` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:58.955958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15998414-2072-498d-91e3-c54e2f700832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c25e4232a504fa5b42ab27ec4481f36)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:58.956082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-46a0233b-275b-458e-a29f-6f8f15903b85 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:58.957315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-46a0233b-275b-458e-a29f-6f8f15903b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:58.959187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15998414-2072-498d-91e3-c54e2f700832 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:58.975698 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1131/2252] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:58.975698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0233b-275b-458e-a29f-6f8f15903b85 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:58.991589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0233b-275b-458e-a29f-6f8f15903b85 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:59.010421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e7525-d619-45e6-b42b-090ba8f996b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:59.010421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e7525-d619-45e6-b42b-090ba8f996b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:59.010421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e7525-d619-45e6-b42b-090ba8f996b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:59.010421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e7525-d619-45e6-b42b-090ba8f996b4 admin admin] PATH_INFO: `/v3/projects/eb418d06586b4b27a6f2f5be6104a8d9/users/20211b47da794347a4e37218144a8982/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:59.061840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e7525-d619-45e6-b42b-090ba8f996b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb418d06586b4b27a6f2f5be6104a8d9, user_id=20211b47da794347a4e37218144a8982, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:59.069493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e7525-d619-45e6-b42b-090ba8f996b4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:59.077642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-15998414-2072-498d-91e3-c54e2f700832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c25e4232a504fa5b42ab27ec4481f36'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:59.121645 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1132/2253] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:58 2022] PUT /identity/v3/projects/eb418d06586b4b27a6f2f5be6104a8d9/users/20211b47da794347a4e37218144a8982/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:59.122767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e7525-d619-45e6-b42b-090ba8f996b4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:59.127256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4d8e7525-d619-45e6-b42b-090ba8f996b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:59.135710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-15998414-2072-498d-91e3-c54e2f700832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c25e4232a504fa5b42ab27ec4481f36'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:59.138536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-15998414-2072-498d-91e3-c54e2f700832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c25e4232a504fa5b42ab27ec4481f36'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:59.153738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-15998414-2072-498d-91e3-c54e2f700832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c25e4232a504fa5b42ab27ec4481f36'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:59.154048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-15998414-2072-498d-91e3-c54e2f700832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c25e4232a504fa5b42ab27ec4481f36'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:01:59.181129 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1122/2254] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:01:58 2022] DELETE /identity/v3/users/7c25e4232a504fa5b42ab27ec4481f36 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:59.181129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ac369-d4ec-46d1-afb6-e2e4e415b590 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:59.181129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ac369-d4ec-46d1-afb6-e2e4e415b590 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:59.181129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ac369-d4ec-46d1-afb6-e2e4e415b590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:59.211431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ef7ac369-d4ec-46d1-afb6-e2e4e415b590 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:59.213151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ef7ac369-d4ec-46d1-afb6-e2e4e415b590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:59.264155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e7525-d619-45e6-b42b-090ba8f996b4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:59.265030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:59.344294 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1123/2255] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:59.354198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ac369-d4ec-46d1-afb6-e2e4e415b590 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:59.356016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ef7ac369-d4ec-46d1-afb6-e2e4e415b590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:59.357064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccfd22-b304-4c3f-abb3-e181c4c400ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:59.358016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccfd22-b304-4c3f-abb3-e181c4c400ba admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:59.358451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccfd22-b304-4c3f-abb3-e181c4c400ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:59.358878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccfd22-b304-4c3f-abb3-e181c4c400ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:59.360010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccfd22-b304-4c3f-abb3-e181c4c400ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:59.361867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccfd22-b304-4c3f-abb3-e181c4c400ba admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:59.380452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ac369-d4ec-46d1-afb6-e2e4e415b590 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:59.386668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e6ac4-6545-4110-afb1-2853130791ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:59.387403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e6ac4-6545-4110-afb1-2853130791ba admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:59.388541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e6ac4-6545-4110-afb1-2853130791ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:59.388823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e6ac4-6545-4110-afb1-2853130791ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:59.389541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e6ac4-6545-4110-afb1-2853130791ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:59.391319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e6ac4-6545-4110-afb1-2853130791ba admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:59.400188 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1133/2256] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:59.400188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cad58-790e-486f-b47c-6a1091329383 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:59.400188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cad58-790e-486f-b47c-6a1091329383 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:59.400188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cad58-790e-486f-b47c-6a1091329383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:59.411420 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1124/2257] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:59.411420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e6ac4-6545-4110-afb1-2853130791ba admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:59.423727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e6ac4-6545-4110-afb1-2853130791ba admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:59.429423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e451344-99e5-47de-b921-673f60a5345b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:59.430052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e451344-99e5-47de-b921-673f60a5345b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:59.430370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e451344-99e5-47de-b921-673f60a5345b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:59.430647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e451344-99e5-47de-b921-673f60a5345b admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:59.431399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e451344-99e5-47de-b921-673f60a5345b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:01:59.431715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e451344-99e5-47de-b921-673f60a5345b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:59.433394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e451344-99e5-47de-b921-673f60a5345b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:59.455678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4e4cad58-790e-486f-b47c-6a1091329383 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:59.458147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4e4cad58-790e-486f-b47c-6a1091329383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:59.461991 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1125/2258] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:01:59.462842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e451344-99e5-47de-b921-673f60a5345b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:59.466845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6e451344-99e5-47de-b921-673f60a5345b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:59.477914 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1134/2259] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:59.479441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cad58-790e-486f-b47c-6a1091329383 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:59.490576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e451344-99e5-47de-b921-673f60a5345b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:59.493183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cad58-790e-486f-b47c-6a1091329383 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:59.495946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6a78c-2b85-40f4-a9d6-8ea9f71e479d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:59.496669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6a78c-2b85-40f4-a9d6-8ea9f71e479d admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:59.496984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6a78c-2b85-40f4-a9d6-8ea9f71e479d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:59.497217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6a78c-2b85-40f4-a9d6-8ea9f71e479d admin admin] PATH_INFO: `/v3/projects/51761955ec724fd187b41d085bdb4c4d/users/5cd2968d1b7b4cfb9c2bad0e453208f3/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:59.498991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af5321-76b2-4c53-9250-ccdd6c963cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:59.500111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af5321-76b2-4c53-9250-ccdd6c963cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:59.500595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af5321-76b2-4c53-9250-ccdd6c963cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:59.501907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af5321-76b2-4c53-9250-ccdd6c963cfc admin admin] PATH_INFO: `/v3/projects/eb418d06586b4b27a6f2f5be6104a8d9/users/20211b47da794347a4e37218144a8982/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:59.504230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af5321-76b2-4c53-9250-ccdd6c963cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb418d06586b4b27a6f2f5be6104a8d9, user_id=20211b47da794347a4e37218144a8982, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:59.507775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af5321-76b2-4c53-9250-ccdd6c963cfc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:59.514080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6a78c-2b85-40f4-a9d6-8ea9f71e479d admin admin] RBAC: Authorizing `identity:create_grant(project_id=51761955ec724fd187b41d085bdb4c4d, user_id=5cd2968d1b7b4cfb9c2bad0e453208f3, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:59.516910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6a78c-2b85-40f4-a9d6-8ea9f71e479d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:59.521712 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1135/2260] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:59 2022] PUT /identity/v3/projects/eb418d06586b4b27a6f2f5be6104a8d9/users/20211b47da794347a4e37218144a8982/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:59.522680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af5321-76b2-4c53-9250-ccdd6c963cfc admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:59.538395 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1126/2261] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:59 2022] PUT /identity/v3/projects/51761955ec724fd187b41d085bdb4c4d/users/5cd2968d1b7b4cfb9c2bad0e453208f3/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:01:59.539930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6a78c-2b85-40f4-a9d6-8ea9f71e479d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:59.542688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e8a6a78c-2b85-40f4-a9d6-8ea9f71e479d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:59.590228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:59.612745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af5321-76b2-4c53-9250-ccdd6c963cfc admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:59.616459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6a78c-2b85-40f4-a9d6-8ea9f71e479d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:59.620871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8e249-9ed4-4751-b32a-5278ecb78159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:59.621590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8e249-9ed4-4751-b32a-5278ecb78159 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:59.622071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8e249-9ed4-4751-b32a-5278ecb78159 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:59.622546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8e249-9ed4-4751-b32a-5278ecb78159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:59.688878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d862db6-ece2-4d5f-bc56-014680222ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:59.689676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d862db6-ece2-4d5f-bc56-014680222ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:59.690064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d862db6-ece2-4d5f-bc56-014680222ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:59.691000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d862db6-ece2-4d5f-bc56-014680222ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:59.691846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d862db6-ece2-4d5f-bc56-014680222ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:59.694093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d862db6-ece2-4d5f-bc56-014680222ee1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:59.712664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8e249-9ed4-4751-b32a-5278ecb78159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:59.716707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8e249-9ed4-4751-b32a-5278ecb78159 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:59.727249 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1136/2262] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:01:59 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:59.728783 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1127/2263] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:01:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:59.729476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8abe21-d456-4374-9552-580a65457561 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:59.729607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8e249-9ed4-4751-b32a-5278ecb78159 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:59.730751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8abe21-d456-4374-9552-580a65457561 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:59.731245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8abe21-d456-4374-9552-580a65457561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:59.744234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8e249-9ed4-4751-b32a-5278ecb78159 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:59.765434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1a8abe21-d456-4374-9552-580a65457561 None None] MFA Rules not processed for user `20211b47da794347a4e37218144a8982`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:01:59.767389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1a8abe21-d456-4374-9552-580a65457561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:01:59.775456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:59.858939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10500c1-4e5e-46dd-bb0a-883cdf4c043b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:59.859912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10500c1-4e5e-46dd-bb0a-883cdf4c043b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:59.860934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10500c1-4e5e-46dd-bb0a-883cdf4c043b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:59.861376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10500c1-4e5e-46dd-bb0a-883cdf4c043b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:59.863602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10500c1-4e5e-46dd-bb0a-883cdf4c043b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:59.866332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10500c1-4e5e-46dd-bb0a-883cdf4c043b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:59.885416 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1128/2264] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:01:59.886696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10500c1-4e5e-46dd-bb0a-883cdf4c043b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:59.899273 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1137/2265] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:01:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:01:59.900408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8abe21-d456-4374-9552-580a65457561 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:01:59.909739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10500c1-4e5e-46dd-bb0a-883cdf4c043b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:59.921202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e41b7-6d98-441d-bba7-660186a4acc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:59.925775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e41b7-6d98-441d-bba7-660186a4acc9 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:59.929705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e41b7-6d98-441d-bba7-660186a4acc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:59.930417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e41b7-6d98-441d-bba7-660186a4acc9 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:59.931774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e41b7-6d98-441d-bba7-660186a4acc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:59.937891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e41b7-6d98-441d-bba7-660186a4acc9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:59.946771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8abe21-d456-4374-9552-580a65457561 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:01:59.960172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfa8cc-cf92-491f-962f-fe754f30ed5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:01:59.962321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfa8cc-cf92-491f-962f-fe754f30ed5b admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:01:59.962577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfa8cc-cf92-491f-962f-fe754f30ed5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:01:59.963111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfa8cc-cf92-491f-962f-fe754f30ed5b admin admin] PATH_INFO: `/v3/projects/51761955ec724fd187b41d085bdb4c4d/users/5cd2968d1b7b4cfb9c2bad0e453208f3/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:01:59.967936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfa8cc-cf92-491f-962f-fe754f30ed5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=51761955ec724fd187b41d085bdb4c4d, user_id=5cd2968d1b7b4cfb9c2bad0e453208f3, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:01:59.971451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfa8cc-cf92-491f-962f-fe754f30ed5b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:01:59.984634 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1129/2266] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:01:59 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:01:59.985673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e41b7-6d98-441d-bba7-660186a4acc9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:00.013075 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1138/2267] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:01:59 2022] PUT /identity/v3/projects/51761955ec724fd187b41d085bdb4c4d/users/5cd2968d1b7b4cfb9c2bad0e453208f3/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:00.016277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfa8cc-cf92-491f-962f-fe754f30ed5b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:00.021450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-12cfa8cc-cf92-491f-962f-fe754f30ed5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:00.024996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e41b7-6d98-441d-bba7-660186a4acc9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:00.136995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:00.166843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfa8cc-cf92-491f-962f-fe754f30ed5b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:00.177000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbc852-6b42-4b74-9918-13d1c2f39c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:00.178078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbc852-6b42-4b74-9918-13d1c2f39c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:00.178544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbc852-6b42-4b74-9918-13d1c2f39c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:00.178973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbc852-6b42-4b74-9918-13d1c2f39c88 admin admin] PATH_INFO: `/v3/projects/2282b704d7a040d785c8b90286ca9116` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:00.180647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbc852-6b42-4b74-9918-13d1c2f39c88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2282b704d7a040d785c8b90286ca9116)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:00.183442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbc852-6b42-4b74-9918-13d1c2f39c88 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:00.233872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8f9d3-511f-41f1-9f32-719692ef4fba tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:00.234503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8f9d3-511f-41f1-9f32-719692ef4fba tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:00.234788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8f9d3-511f-41f1-9f32-719692ef4fba tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:00.235068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8f9d3-511f-41f1-9f32-719692ef4fba tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:00.235798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8f9d3-511f-41f1-9f32-719692ef4fba tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:00.236103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8f9d3-511f-41f1-9f32-719692ef4fba tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:00.238287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8f9d3-511f-41f1-9f32-719692ef4fba tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:00.267472 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1130/2268] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:00.268403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8f9d3-511f-41f1-9f32-719692ef4fba tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:00.289599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8f9d3-511f-41f1-9f32-719692ef4fba tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:00.331847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c5dbc852-6b42-4b74-9918-13d1c2f39c88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2282b704d7a040d785c8b90286ca9116', 'request_id': 'req-c5dbc852-6b42-4b74-9918-13d1c2f39c88'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:00.359857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c5dbc852-6b42-4b74-9918-13d1c2f39c88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2282b704d7a040d785c8b90286ca9116', 'request_id': 'req-c5dbc852-6b42-4b74-9918-13d1c2f39c88'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:00.390565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c5dbc852-6b42-4b74-9918-13d1c2f39c88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2282b704d7a040d785c8b90286ca9116', 'request_id': 'req-c5dbc852-6b42-4b74-9918-13d1c2f39c88'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:00.411213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c5dbc852-6b42-4b74-9918-13d1c2f39c88 admin admin] The token cache is being invalidate because project 2282b704d7a040d785c8b90286ca9116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:00.411624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c5dbc852-6b42-4b74-9918-13d1c2f39c88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:00.418462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c5dbc852-6b42-4b74-9918-13d1c2f39c88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:00.421275 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1139/2269] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:00 2022] DELETE /identity/v3/projects/2282b704d7a040d785c8b90286ca9116 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:00.426633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf196374-a156-4b22-b7be-50aa7393bc49 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:00.426922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf196374-a156-4b22-b7be-50aa7393bc49 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:00.427203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf196374-a156-4b22-b7be-50aa7393bc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:00.453265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f2d68-3871-459e-8f6c-7903210c6517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:00.454737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f2d68-3871-459e-8f6c-7903210c6517 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:00.455331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f2d68-3871-459e-8f6c-7903210c6517 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:00.456050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f2d68-3871-459e-8f6c-7903210c6517 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:00.457076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f2d68-3871-459e-8f6c-7903210c6517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:00.459617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f2d68-3871-459e-8f6c-7903210c6517 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:00.475926 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1131/2270] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:00.476901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f2d68-3871-459e-8f6c-7903210c6517 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:00.481280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3d5f2d68-3871-459e-8f6c-7903210c6517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:00.500741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bf196374-a156-4b22-b7be-50aa7393bc49 None None] MFA Rules not processed for user `5cd2968d1b7b4cfb9c2bad0e453208f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:00.501956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bf196374-a156-4b22-b7be-50aa7393bc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:00.533459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:00.575648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f2d68-3871-459e-8f6c-7903210c6517 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:00.582993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ec104-7485-4340-a737-a3fbdd6d5b04 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:00.584017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ec104-7485-4340-a737-a3fbdd6d5b04 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:00.584319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ec104-7485-4340-a737-a3fbdd6d5b04 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:00.584725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ec104-7485-4340-a737-a3fbdd6d5b04 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:00.585572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ec104-7485-4340-a737-a3fbdd6d5b04 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:00.589391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ec104-7485-4340-a737-a3fbdd6d5b04 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:00.631048 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1140/2271] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:00.631979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf196374-a156-4b22-b7be-50aa7393bc49 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:00.633634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bf196374-a156-4b22-b7be-50aa7393bc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:00.667784 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1132/2272] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:00 2022] POST /identity/v3/projects => generated 371 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:00.669599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ec104-7485-4340-a737-a3fbdd6d5b04 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:00.672229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2c0ec104-7485-4340-a737-a3fbdd6d5b04 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:00.674124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf196374-a156-4b22-b7be-50aa7393bc49 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:00.752293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eeb993-b96c-45e0-8eec-3f1598fa7565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:00.753282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eeb993-b96c-45e0-8eec-3f1598fa7565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:00.753803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eeb993-b96c-45e0-8eec-3f1598fa7565 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:00.754383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eeb993-b96c-45e0-8eec-3f1598fa7565 admin admin] PATH_INFO: `/v3/projects/1e4074c1cefd4a39aec074466a3f6397` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:00.756384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eeb993-b96c-45e0-8eec-3f1598fa7565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e4074c1cefd4a39aec074466a3f6397)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:00.758819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eeb993-b96c-45e0-8eec-3f1598fa7565 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:00.772619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:00.804674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ec104-7485-4340-a737-a3fbdd6d5b04 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:00.816666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb4eca-e1e1-46a4-9544-f8841ecfbf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:00.817444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb4eca-e1e1-46a4-9544-f8841ecfbf69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:00.818188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb4eca-e1e1-46a4-9544-f8841ecfbf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:00.818614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb4eca-e1e1-46a4-9544-f8841ecfbf69 admin admin] PATH_INFO: `/v3/users/0666095c0f6c4718abcb6cf4f2e0faf9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:00.820226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb4eca-e1e1-46a4-9544-f8841ecfbf69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0666095c0f6c4718abcb6cf4f2e0faf9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:00.822388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb4eca-e1e1-46a4-9544-f8841ecfbf69 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:00.867590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-12eeb993-b96c-45e0-8eec-3f1598fa7565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e4074c1cefd4a39aec074466a3f6397', 'request_id': 'req-12eeb993-b96c-45e0-8eec-3f1598fa7565'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:00.880236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-12eeb993-b96c-45e0-8eec-3f1598fa7565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e4074c1cefd4a39aec074466a3f6397', 'request_id': 'req-12eeb993-b96c-45e0-8eec-3f1598fa7565'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:00.891017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-12eeb993-b96c-45e0-8eec-3f1598fa7565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e4074c1cefd4a39aec074466a3f6397', 'request_id': 'req-12eeb993-b96c-45e0-8eec-3f1598fa7565'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:00.905801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-12eeb993-b96c-45e0-8eec-3f1598fa7565 admin admin] The token cache is being invalidate because project 1e4074c1cefd4a39aec074466a3f6397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:00.906372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-12eeb993-b96c-45e0-8eec-3f1598fa7565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:00.907112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-12eeb993-b96c-45e0-8eec-3f1598fa7565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:00.912268 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1141/2273] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:00 2022] DELETE /identity/v3/projects/1e4074c1cefd4a39aec074466a3f6397 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:00.912268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eeb993-b96c-45e0-8eec-3f1598fa7565 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:00.917519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-12eeb993-b96c-45e0-8eec-3f1598fa7565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:00.929094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6aeb4eca-e1e1-46a4-9544-f8841ecfbf69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0666095c0f6c4718abcb6cf4f2e0faf9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:00.954807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6aeb4eca-e1e1-46a4-9544-f8841ecfbf69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0666095c0f6c4718abcb6cf4f2e0faf9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:00.972983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6aeb4eca-e1e1-46a4-9544-f8841ecfbf69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0666095c0f6c4718abcb6cf4f2e0faf9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:00.985582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6aeb4eca-e1e1-46a4-9544-f8841ecfbf69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0666095c0f6c4718abcb6cf4f2e0faf9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:00.986616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6aeb4eca-e1e1-46a4-9544-f8841ecfbf69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0666095c0f6c4718abcb6cf4f2e0faf9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:01.006986 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1133/2274] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:00 2022] DELETE /identity/v3/users/0666095c0f6c4718abcb6cf4f2e0faf9 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:01.008636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792db62-f1f3-451c-bc0b-5b0c2a9a5015 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:01.008977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792db62-f1f3-451c-bc0b-5b0c2a9a5015 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:01.009261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792db62-f1f3-451c-bc0b-5b0c2a9a5015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:01.033323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d792db62-f1f3-451c-bc0b-5b0c2a9a5015 None None] MFA Rules not processed for user `794f1a4f424d4b71a23649a4d178df28`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:01.035952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d792db62-f1f3-451c-bc0b-5b0c2a9a5015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:01.053524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eeb993-b96c-45e0-8eec-3f1598fa7565 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:01.099147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:01.137268 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1134/2275] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:01.138278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792db62-f1f3-451c-bc0b-5b0c2a9a5015 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:01.145615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d792db62-f1f3-451c-bc0b-5b0c2a9a5015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:01.180929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1fa19-ce55-47c0-abab-4f0910f91915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:01.182131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1fa19-ce55-47c0-abab-4f0910f91915 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:01.182569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1fa19-ce55-47c0-abab-4f0910f91915 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:01.182996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1fa19-ce55-47c0-abab-4f0910f91915 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:01.183916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1fa19-ce55-47c0-abab-4f0910f91915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:01.186795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1fa19-ce55-47c0-abab-4f0910f91915 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:01.208188 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1142/2276] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:01.214138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1fa19-ce55-47c0-abab-4f0910f91915 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:01.223212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-77d1fa19-ce55-47c0-abab-4f0910f91915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:01.245578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1fa19-ce55-47c0-abab-4f0910f91915 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:01.256985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbda9e5-48b5-4cf3-9bc1-c0fc0664a12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:01.257988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbda9e5-48b5-4cf3-9bc1-c0fc0664a12c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:01.259157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbda9e5-48b5-4cf3-9bc1-c0fc0664a12c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:01.259494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbda9e5-48b5-4cf3-9bc1-c0fc0664a12c admin admin] PATH_INFO: `/v3/users/fe7ebedd731a466db8928af5ee72ca11` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:01.261443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbda9e5-48b5-4cf3-9bc1-c0fc0664a12c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7ebedd731a466db8928af5ee72ca11)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:01.264996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbda9e5-48b5-4cf3-9bc1-c0fc0664a12c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:01.294196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792db62-f1f3-451c-bc0b-5b0c2a9a5015 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:01.313983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0a4ac-2eb4-489b-bc80-d2f8d61b4170 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:01.314635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0a4ac-2eb4-489b-bc80-d2f8d61b4170 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:01.315852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0a4ac-2eb4-489b-bc80-d2f8d61b4170 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:01.315852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0a4ac-2eb4-489b-bc80-d2f8d61b4170 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:01.316469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0a4ac-2eb4-489b-bc80-d2f8d61b4170 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:01.316786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0a4ac-2eb4-489b-bc80-d2f8d61b4170 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:01.318420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0a4ac-2eb4-489b-bc80-d2f8d61b4170 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:01.333764 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1135/2277] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:01.334579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0a4ac-2eb4-489b-bc80-d2f8d61b4170 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:01.339877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-eba0a4ac-2eb4-489b-bc80-d2f8d61b4170 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:01.347890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:01.366147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bcbda9e5-48b5-4cf3-9bc1-c0fc0664a12c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7ebedd731a466db8928af5ee72ca11'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:01.369468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bcbda9e5-48b5-4cf3-9bc1-c0fc0664a12c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7ebedd731a466db8928af5ee72ca11'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:01.400963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bcbda9e5-48b5-4cf3-9bc1-c0fc0664a12c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7ebedd731a466db8928af5ee72ca11'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:01.401737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bcbda9e5-48b5-4cf3-9bc1-c0fc0664a12c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7ebedd731a466db8928af5ee72ca11'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:01.414835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bcbda9e5-48b5-4cf3-9bc1-c0fc0664a12c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7ebedd731a466db8928af5ee72ca11'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:01.442224 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1143/2278] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:01 2022] DELETE /identity/v3/users/fe7ebedd731a466db8928af5ee72ca11 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:01.448976 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbda9e5-48b5-4cf3-9bc1-c0fc0664a12c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:01.451981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bcbda9e5-48b5-4cf3-9bc1-c0fc0664a12c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:01.465615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0a4ac-2eb4-489b-bc80-d2f8d61b4170 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:01.551238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbda9e5-48b5-4cf3-9bc1-c0fc0664a12c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:01.559634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6188d8-47b3-457b-94ee-2b34ab91d29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:01.560331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6188d8-47b3-457b-94ee-2b34ab91d29b admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:01.561824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6188d8-47b3-457b-94ee-2b34ab91d29b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:01.562463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6188d8-47b3-457b-94ee-2b34ab91d29b admin admin] PATH_INFO: `/v3/projects/edd031b24c9e4401bbcbe78e11ed7a6f/users/c9fa37569c0b40dda5ee332c28aab5b3/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:01.574030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4eeed8-f215-4ebe-9302-1af927279734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:01.575194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eeed8-f215-4ebe-9302-1af927279734 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:01.575662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eeed8-f215-4ebe-9302-1af927279734 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:01.576118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eeed8-f215-4ebe-9302-1af927279734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:01.579035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6e4eeed8-f215-4ebe-9302-1af927279734 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:01.596181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6188d8-47b3-457b-94ee-2b34ab91d29b admin admin] RBAC: Authorizing `identity:create_grant(project_id=edd031b24c9e4401bbcbe78e11ed7a6f, user_id=c9fa37569c0b40dda5ee332c28aab5b3, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:01.598901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6188d8-47b3-457b-94ee-2b34ab91d29b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:01.602309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:01.628744 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1144/2279] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:01 2022] PUT /identity/v3/projects/edd031b24c9e4401bbcbe78e11ed7a6f/users/c9fa37569c0b40dda5ee332c28aab5b3/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:01.631677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6188d8-47b3-457b-94ee-2b34ab91d29b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:01.638203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3e6188d8-47b3-457b-94ee-2b34ab91d29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:01.689514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4eeed8-f215-4ebe-9302-1af927279734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:01.692786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4eeed8-f215-4ebe-9302-1af927279734 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:01.708899 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1136/2280] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:01.709882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4eeed8-f215-4ebe-9302-1af927279734 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:01.715516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6e4eeed8-f215-4ebe-9302-1af927279734 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:01.736419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4eeed8-f215-4ebe-9302-1af927279734 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:01.799260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6188d8-47b3-457b-94ee-2b34ab91d29b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:01.807357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73422f07-56f2-442e-a288-6641eef9b2dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:01.808338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73422f07-56f2-442e-a288-6641eef9b2dc service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:01.808451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73422f07-56f2-442e-a288-6641eef9b2dc service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:01.808808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73422f07-56f2-442e-a288-6641eef9b2dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:01.811459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-73422f07-56f2-442e-a288-6641eef9b2dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:01.866816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab136b1-3cd0-481f-a9f8-75032b1cef29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:01.867526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab136b1-3cd0-481f-a9f8-75032b1cef29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:01.867816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab136b1-3cd0-481f-a9f8-75032b1cef29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:01.868350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab136b1-3cd0-481f-a9f8-75032b1cef29 admin admin] PATH_INFO: `/v3/projects/7a07e4e5480d482cb79f386337e0c00b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:01.870444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab136b1-3cd0-481f-a9f8-75032b1cef29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a07e4e5480d482cb79f386337e0c00b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:01.872811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab136b1-3cd0-481f-a9f8-75032b1cef29 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:01.879488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:01.928338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73422f07-56f2-442e-a288-6641eef9b2dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:01.931197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73422f07-56f2-442e-a288-6641eef9b2dc service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:01.945425 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1145/2281] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:01.947363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d93f7e-81dd-403d-b541-990e7e638264 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:01.947742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d93f7e-81dd-403d-b541-990e7e638264 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:01.948529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d93f7e-81dd-403d-b541-990e7e638264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:01.955957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1ab136b1-3cd0-481f-a9f8-75032b1cef29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a07e4e5480d482cb79f386337e0c00b', 'request_id': 'req-1ab136b1-3cd0-481f-a9f8-75032b1cef29'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:01.964985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1ab136b1-3cd0-481f-a9f8-75032b1cef29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a07e4e5480d482cb79f386337e0c00b', 'request_id': 'req-1ab136b1-3cd0-481f-a9f8-75032b1cef29'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:01.979121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1ab136b1-3cd0-481f-a9f8-75032b1cef29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a07e4e5480d482cb79f386337e0c00b', 'request_id': 'req-1ab136b1-3cd0-481f-a9f8-75032b1cef29'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:01.988540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-00d93f7e-81dd-403d-b541-990e7e638264 None None] MFA Rules not processed for user `c9fa37569c0b40dda5ee332c28aab5b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:01.989928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-00d93f7e-81dd-403d-b541-990e7e638264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:01.998153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1ab136b1-3cd0-481f-a9f8-75032b1cef29 admin admin] The token cache is being invalidate because project 7a07e4e5480d482cb79f386337e0c00b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:01.998919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1ab136b1-3cd0-481f-a9f8-75032b1cef29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:02.000730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1ab136b1-3cd0-481f-a9f8-75032b1cef29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:02.001903 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1137/2282] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:01 2022] DELETE /identity/v3/projects/7a07e4e5480d482cb79f386337e0c00b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:02.007673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96506bc2-d47a-4152-b3d2-255e673ad6fa None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:02.007955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96506bc2-d47a-4152-b3d2-255e673ad6fa None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:02.008232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96506bc2-d47a-4152-b3d2-255e673ad6fa None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:02.018254 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1138/2283] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:02:02 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:02:02.018254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93981e9-7ad7-4048-86b7-da206fbd6115 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:02.018254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93981e9-7ad7-4048-86b7-da206fbd6115 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:02.018254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93981e9-7ad7-4048-86b7-da206fbd6115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:02.040967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d93981e9-7ad7-4048-86b7-da206fbd6115 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:02.042252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d93981e9-7ad7-4048-86b7-da206fbd6115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:02.092470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:02.109687 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1146/2284] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:02.110596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d93f7e-81dd-403d-b541-990e7e638264 None None] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:02:02.113655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-00d93f7e-81dd-403d-b541-990e7e638264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:02.144379 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1139/2285] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:02.150827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93981e9-7ad7-4048-86b7-da206fbd6115 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:02.152506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d93981e9-7ad7-4048-86b7-da206fbd6115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:02.199401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93981e9-7ad7-4048-86b7-da206fbd6115 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:02.208824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31038b-6f1b-4023-979d-ce6e1b63411f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:02.209473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31038b-6f1b-4023-979d-ce6e1b63411f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:02.209809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31038b-6f1b-4023-979d-ce6e1b63411f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:02.210023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31038b-6f1b-4023-979d-ce6e1b63411f admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:02.210747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31038b-6f1b-4023-979d-ce6e1b63411f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:02.212743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31038b-6f1b-4023-979d-ce6e1b63411f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:02.257159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d93f7e-81dd-403d-b541-990e7e638264 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:02.258379 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1140/2286] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:02 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:02.258542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-00d93f7e-81dd-403d-b541-990e7e638264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:02.259599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31038b-6f1b-4023-979d-ce6e1b63411f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:02.262035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2c31038b-6f1b-4023-979d-ce6e1b63411f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:02.338725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:02.369804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d93f7e-81dd-403d-b541-990e7e638264 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:02.388801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31038b-6f1b-4023-979d-ce6e1b63411f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:02.396355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5d104-8e7a-486b-918f-5f43828a99d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:02.397088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5d104-8e7a-486b-918f-5f43828a99d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:02.397661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5d104-8e7a-486b-918f-5f43828a99d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:02.398468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5d104-8e7a-486b-918f-5f43828a99d5 admin admin] PATH_INFO: `/v3/projects/236565d242de4eafae9d660b65dfec2b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:02.399992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5d104-8e7a-486b-918f-5f43828a99d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=236565d242de4eafae9d660b65dfec2b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:02.403213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5d104-8e7a-486b-918f-5f43828a99d5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:02.481981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3b6d0-7781-424c-83ff-17d2aaeb7fe5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:02.483565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3b6d0-7781-424c-83ff-17d2aaeb7fe5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:02.484045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3b6d0-7781-424c-83ff-17d2aaeb7fe5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:02.484431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3b6d0-7781-424c-83ff-17d2aaeb7fe5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/projects/1636951001054e278919006d65686c32` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:02.485886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3b6d0-7781-424c-83ff-17d2aaeb7fe5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:get_project(project_id=1636951001054e278919006d65686c32)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:02.488297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3b6d0-7781-424c-83ff-17d2aaeb7fe5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:02.490612 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1147/2287] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:02:02 2022] GET /identity/v3/projects/1636951001054e278919006d65686c32 => generated 371 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:02.492075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc4ce4-5560-425f-8ceb-17db23d17337 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:02.492464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc4ce4-5560-425f-8ceb-17db23d17337 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:02.492849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc4ce4-5560-425f-8ceb-17db23d17337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:02.500904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-19a5d104-8e7a-486b-918f-5f43828a99d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '236565d242de4eafae9d660b65dfec2b', 'request_id': 'req-19a5d104-8e7a-486b-918f-5f43828a99d5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:02.519704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-19a5d104-8e7a-486b-918f-5f43828a99d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '236565d242de4eafae9d660b65dfec2b', 'request_id': 'req-19a5d104-8e7a-486b-918f-5f43828a99d5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:02.520131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-45fc4ce4-5560-425f-8ceb-17db23d17337 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:02.521494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-45fc4ce4-5560-425f-8ceb-17db23d17337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:02.537531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-19a5d104-8e7a-486b-918f-5f43828a99d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '236565d242de4eafae9d660b65dfec2b', 'request_id': 'req-19a5d104-8e7a-486b-918f-5f43828a99d5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:02.553775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-19a5d104-8e7a-486b-918f-5f43828a99d5 admin admin] The token cache is being invalidate because project 236565d242de4eafae9d660b65dfec2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:02.554083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-19a5d104-8e7a-486b-918f-5f43828a99d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:02.555531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-19a5d104-8e7a-486b-918f-5f43828a99d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:02.559555 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1141/2288] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:02 2022] DELETE /identity/v3/projects/236565d242de4eafae9d660b65dfec2b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:02.560900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5d104-8e7a-486b-918f-5f43828a99d5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:02.564524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-19a5d104-8e7a-486b-918f-5f43828a99d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:02.640929 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1148/2289] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:02.642274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d24a8-ebad-4860-a878-a180e98a7389 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:02.642562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d24a8-ebad-4860-a878-a180e98a7389 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:02.642840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d24a8-ebad-4860-a878-a180e98a7389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:02.663974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:02.671363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-029d24a8-ebad-4860-a878-a180e98a7389 None None] MFA Rules not processed for user `794f1a4f424d4b71a23649a4d178df28`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:02.672719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-029d24a8-ebad-4860-a878-a180e98a7389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:02.689382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5d104-8e7a-486b-918f-5f43828a99d5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:02.707571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470afa8f-482a-4fd5-a8ee-d1c7b324cc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:02.708008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470afa8f-482a-4fd5-a8ee-d1c7b324cc12 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:02.708359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470afa8f-482a-4fd5-a8ee-d1c7b324cc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:02.711281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470afa8f-482a-4fd5-a8ee-d1c7b324cc12 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:02.712110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470afa8f-482a-4fd5-a8ee-d1c7b324cc12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:02.718989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470afa8f-482a-4fd5-a8ee-d1c7b324cc12 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:02.765995 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1142/2290] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:02 2022] POST /identity/v3/users => generated 295 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:02.765995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901f552-bbdc-4f0d-a50a-b857a7af6782 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:02.765995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901f552-bbdc-4f0d-a50a-b857a7af6782 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:02.765995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901f552-bbdc-4f0d-a50a-b857a7af6782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:02.798168 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1149/2291] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:02.799762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d24a8-ebad-4860-a878-a180e98a7389 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:02.812762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d24a8-ebad-4860-a878-a180e98a7389 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:02.818075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3901f552-bbdc-4f0d-a50a-b857a7af6782 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:02.819508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52405d2-bac4-4acc-a962-fa2635792cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:02.820227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3901f552-bbdc-4f0d-a50a-b857a7af6782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:02.820689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52405d2-bac4-4acc-a962-fa2635792cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:02.821308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52405d2-bac4-4acc-a962-fa2635792cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:02.821786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52405d2-bac4-4acc-a962-fa2635792cc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:02.822686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52405d2-bac4-4acc-a962-fa2635792cc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:02.823420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52405d2-bac4-4acc-a962-fa2635792cc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:02.825376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52405d2-bac4-4acc-a962-fa2635792cc6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:02.844292 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1150/2292] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:02.845944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52405d2-bac4-4acc-a962-fa2635792cc6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:02.859380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52405d2-bac4-4acc-a962-fa2635792cc6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:02.863383 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1143/2293] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:02.867364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901f552-bbdc-4f0d-a50a-b857a7af6782 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:02.883092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aace9e-74ad-4299-8d02-59d38ab4ac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:02.883564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aace9e-74ad-4299-8d02-59d38ab4ac4e admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:02.884239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aace9e-74ad-4299-8d02-59d38ab4ac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:02.884239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aace9e-74ad-4299-8d02-59d38ab4ac4e admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:02.885118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aace9e-74ad-4299-8d02-59d38ab4ac4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:02.887453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aace9e-74ad-4299-8d02-59d38ab4ac4e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:02.888746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901f552-bbdc-4f0d-a50a-b857a7af6782 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:02.897968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a870f1-b44d-425a-a698-de63af7bf985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:02.898202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a870f1-b44d-425a-a698-de63af7bf985 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:02.898553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a870f1-b44d-425a-a698-de63af7bf985 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:02.898933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a870f1-b44d-425a-a698-de63af7bf985 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:02.899787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a870f1-b44d-425a-a698-de63af7bf985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:02.904006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a870f1-b44d-425a-a698-de63af7bf985 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:02.905982 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1151/2294] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:02.908897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b106731-203e-41d5-9f46-8c2363bf7c43 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:02.909169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b106731-203e-41d5-9f46-8c2363bf7c43 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:02.909355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b106731-203e-41d5-9f46-8c2363bf7c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:02.933267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0b106731-203e-41d5-9f46-8c2363bf7c43 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:02.944866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0b106731-203e-41d5-9f46-8c2363bf7c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:02.952658 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1144/2295] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:02 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:02.954193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760b8da-9dd1-458d-9301-22256e514f3e None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:02.954613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760b8da-9dd1-458d-9301-22256e514f3e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:02.954987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760b8da-9dd1-458d-9301-22256e514f3e None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:02.957513 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1152/2296] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:02.958688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b106731-203e-41d5-9f46-8c2363bf7c43 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:02.969816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b106731-203e-41d5-9f46-8c2363bf7c43 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:02.970446 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1145/2297] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:02:02 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:02:02.972918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760b8da-9dd1-458d-9301-22256e514f3e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:02.983939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:03.055884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0a223-e6a8-4bda-a809-4c96548ca3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:03.057133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0a223-e6a8-4bda-a809-4c96548ca3e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:03.057711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0a223-e6a8-4bda-a809-4c96548ca3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:03.063355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0a223-e6a8-4bda-a809-4c96548ca3e0 admin admin] PATH_INFO: `/v3/projects/2c02809c27a9408196c9c786844fcd00/users/f30b0cdda320406cbceb41bd29c42f6e/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:03.082398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760b8da-9dd1-458d-9301-22256e514f3e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:03.096970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da943901-67ec-4a42-b53a-a406e9477b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:03.099735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da943901-67ec-4a42-b53a-a406e9477b64 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:03.100983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da943901-67ec-4a42-b53a-a406e9477b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:03.101372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da943901-67ec-4a42-b53a-a406e9477b64 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:03.102001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0a223-e6a8-4bda-a809-4c96548ca3e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c02809c27a9408196c9c786844fcd00, user_id=f30b0cdda320406cbceb41bd29c42f6e, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:03.103188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da943901-67ec-4a42-b53a-a406e9477b64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:03.105677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0a223-e6a8-4bda-a809-4c96548ca3e0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:03.108097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da943901-67ec-4a42-b53a-a406e9477b64 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:03.131415 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1153/2298] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:02 2022] PUT /identity/v3/projects/2c02809c27a9408196c9c786844fcd00/users/f30b0cdda320406cbceb41bd29c42f6e/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:03.131415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0a223-e6a8-4bda-a809-4c96548ca3e0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:03.163390 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1146/2299] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:02 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:03.165212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da943901-67ec-4a42-b53a-a406e9477b64 admin admin] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:02:03.167533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-da943901-67ec-4a42-b53a-a406e9477b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:03.238875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0a223-e6a8-4bda-a809-4c96548ca3e0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:03.245246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fcc31-40fa-4b4b-853c-bd1eea69d92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:03.246023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fcc31-40fa-4b4b-853c-bd1eea69d92a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:03.246415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fcc31-40fa-4b4b-853c-bd1eea69d92a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:03.246933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fcc31-40fa-4b4b-853c-bd1eea69d92a admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:03.248520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fcc31-40fa-4b4b-853c-bd1eea69d92a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:03.248949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fcc31-40fa-4b4b-853c-bd1eea69d92a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:03.250694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fcc31-40fa-4b4b-853c-bd1eea69d92a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:03.279072 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1154/2300] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:03.281273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fcc31-40fa-4b4b-853c-bd1eea69d92a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:03.321161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fcc31-40fa-4b4b-853c-bd1eea69d92a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:03.330775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1772d-49c1-46b4-9005-faa9b67b735f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:03.331010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1772d-49c1-46b4-9005-faa9b67b735f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:03.331336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1772d-49c1-46b4-9005-faa9b67b735f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:03.331705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1772d-49c1-46b4-9005-faa9b67b735f admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:03.332419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1772d-49c1-46b4-9005-faa9b67b735f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:03.334202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1772d-49c1-46b4-9005-faa9b67b735f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:03.348977 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1155/2301] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:03.349795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1772d-49c1-46b4-9005-faa9b67b735f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:03.357826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da943901-67ec-4a42-b53a-a406e9477b64 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:03.360624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-da943901-67ec-4a42-b53a-a406e9477b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:03.374321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1772d-49c1-46b4-9005-faa9b67b735f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:03.385390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e6fc9-4e8a-4570-9655-a4854c2a6b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:03.386030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e6fc9-4e8a-4570-9655-a4854c2a6b74 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:03.386313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e6fc9-4e8a-4570-9655-a4854c2a6b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:03.386592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e6fc9-4e8a-4570-9655-a4854c2a6b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:03.387313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e6fc9-4e8a-4570-9655-a4854c2a6b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:03.395789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e6fc9-4e8a-4570-9655-a4854c2a6b74 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:03.408221 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1156/2302] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:03.416794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e6fc9-4e8a-4570-9655-a4854c2a6b74 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:03.432221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e6fc9-4e8a-4570-9655-a4854c2a6b74 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:03.437964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90373bd2-eabb-4bb5-af20-08cd060b77bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:03.438765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90373bd2-eabb-4bb5-af20-08cd060b77bd admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:03.439514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90373bd2-eabb-4bb5-af20-08cd060b77bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:03.439640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90373bd2-eabb-4bb5-af20-08cd060b77bd admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:03.440492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90373bd2-eabb-4bb5-af20-08cd060b77bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:03.442544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90373bd2-eabb-4bb5-af20-08cd060b77bd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:03.480923 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1157/2303] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:03 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:03.482548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90373bd2-eabb-4bb5-af20-08cd060b77bd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:03.492002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:03.574920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da943901-67ec-4a42-b53a-a406e9477b64 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:03.595621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:03.627613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90373bd2-eabb-4bb5-af20-08cd060b77bd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:03.636322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba29ba-85fa-47a2-8154-f1d514ab796c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:03.637204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba29ba-85fa-47a2-8154-f1d514ab796c admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:03.637498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba29ba-85fa-47a2-8154-f1d514ab796c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:03.637784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba29ba-85fa-47a2-8154-f1d514ab796c admin admin] PATH_INFO: `/v3/projects/2c02809c27a9408196c9c786844fcd00/users/f30b0cdda320406cbceb41bd29c42f6e/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:03.639975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba29ba-85fa-47a2-8154-f1d514ab796c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c02809c27a9408196c9c786844fcd00, user_id=f30b0cdda320406cbceb41bd29c42f6e, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:03.642745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba29ba-85fa-47a2-8154-f1d514ab796c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:03.669375 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1158/2304] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:03 2022] PUT /identity/v3/projects/2c02809c27a9408196c9c786844fcd00/users/f30b0cdda320406cbceb41bd29c42f6e/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:03.669375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba29ba-85fa-47a2-8154-f1d514ab796c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:03.696529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d069e-04ab-4374-be6f-7ab9ffea12ea tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:03.697167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d069e-04ab-4374-be6f-7ab9ffea12ea tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:03.697470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d069e-04ab-4374-be6f-7ab9ffea12ea tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:03.697896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d069e-04ab-4374-be6f-7ab9ffea12ea tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/projects/1636951001054e278919006d65686c32` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:03.699194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d069e-04ab-4374-be6f-7ab9ffea12ea tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:get_project(project_id=1636951001054e278919006d65686c32)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:03.702188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d069e-04ab-4374-be6f-7ab9ffea12ea tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:03.704058 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1147/2305] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:02:03 2022] GET /identity/v3/projects/1636951001054e278919006d65686c32 => generated 371 bytes in 540 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:03.704820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d069e-04ab-4374-be6f-7ab9ffea12ea tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:03.717514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d069e-04ab-4374-be6f-7ab9ffea12ea tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:03.806976 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba29ba-85fa-47a2-8154-f1d514ab796c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:03.827906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fdaaa-245c-479a-be4c-0946feede786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:03.829072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fdaaa-245c-479a-be4c-0946feede786 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:03.829432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fdaaa-245c-479a-be4c-0946feede786 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:03.831815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fdaaa-245c-479a-be4c-0946feede786 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:03.832715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738fdaaa-245c-479a-be4c-0946feede786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:03.834603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738fdaaa-245c-479a-be4c-0946feede786 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:03.862866 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1159/2306] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:03.864483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1d07b-e332-4e38-bed3-3f8a219de073 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:03.864782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1d07b-e332-4e38-bed3-3f8a219de073 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:03.865061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1d07b-e332-4e38-bed3-3f8a219de073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:03.870353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc60f31-dd63-4ed5-b549-983afd6e5fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:03.870998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc60f31-dd63-4ed5-b549-983afd6e5fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:03.871281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc60f31-dd63-4ed5-b549-983afd6e5fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:03.871578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc60f31-dd63-4ed5-b549-983afd6e5fc7 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:03.872354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc60f31-dd63-4ed5-b549-983afd6e5fc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:03.874494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc60f31-dd63-4ed5-b549-983afd6e5fc7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:03.917568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1fd1d07b-e332-4e38-bed3-3f8a219de073 None None] MFA Rules not processed for user `f30b0cdda320406cbceb41bd29c42f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:03.920210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1fd1d07b-e332-4e38-bed3-3f8a219de073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:03.923510 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1148/2307] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:03 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:03.924798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc60f31-dd63-4ed5-b549-983afd6e5fc7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:03.942808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc60f31-dd63-4ed5-b549-983afd6e5fc7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:03.950661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290bffe-6b42-4502-b8c3-d91069721b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:03.951392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290bffe-6b42-4502-b8c3-d91069721b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:03.951793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290bffe-6b42-4502-b8c3-d91069721b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:03.952145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290bffe-6b42-4502-b8c3-d91069721b98 admin admin] PATH_INFO: `/v3/projects/cfc4b787c95143c0b9d6f53832e324f1/users/f8b35ab211584884a72057fa31184836/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:03.983992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290bffe-6b42-4502-b8c3-d91069721b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc4b787c95143c0b9d6f53832e324f1, user_id=f8b35ab211584884a72057fa31184836, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:03.987546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290bffe-6b42-4502-b8c3-d91069721b98 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:04.025871 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1149/2308] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:03 2022] PUT /identity/v3/projects/cfc4b787c95143c0b9d6f53832e324f1/users/f8b35ab211584884a72057fa31184836/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:04.026843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290bffe-6b42-4502-b8c3-d91069721b98 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:04.102547 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1160/2309] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:04.104383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40c177-3b45-4dee-b30e-720435b2586b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:04.104509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40c177-3b45-4dee-b30e-720435b2586b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:04.104858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40c177-3b45-4dee-b30e-720435b2586b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:04.111133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:04.140108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-cd40c177-3b45-4dee-b30e-720435b2586b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:04.142326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cd40c177-3b45-4dee-b30e-720435b2586b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:04.145828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290bffe-6b42-4502-b8c3-d91069721b98 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:04.152262 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1161/2310] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:04.163817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a65ac-3f8d-4782-88aa-96836165c37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:04.164461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a65ac-3f8d-4782-88aa-96836165c37b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:04.164747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a65ac-3f8d-4782-88aa-96836165c37b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:04.165024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a65ac-3f8d-4782-88aa-96836165c37b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:04.165900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a65ac-3f8d-4782-88aa-96836165c37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:04.168420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a65ac-3f8d-4782-88aa-96836165c37b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:04.190560 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1150/2311] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:04.194575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40c177-3b45-4dee-b30e-720435b2586b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:04.206146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40c177-3b45-4dee-b30e-720435b2586b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:04.211461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f93430-883b-43ea-8cb4-42e18709d42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:04.212144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f93430-883b-43ea-8cb4-42e18709d42a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:04.212671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f93430-883b-43ea-8cb4-42e18709d42a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:04.212961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f93430-883b-43ea-8cb4-42e18709d42a admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:04.213769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f93430-883b-43ea-8cb4-42e18709d42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:04.215600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f93430-883b-43ea-8cb4-42e18709d42a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:04.228456 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1162/2312] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:04.232963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a65ac-3f8d-4782-88aa-96836165c37b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:04.248947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a65ac-3f8d-4782-88aa-96836165c37b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:04.255943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6258b-17d4-42cd-bc4b-1e9ab1fef05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:04.255943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6258b-17d4-42cd-bc4b-1e9ab1fef05a admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:04.256370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6258b-17d4-42cd-bc4b-1e9ab1fef05a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:04.256751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6258b-17d4-42cd-bc4b-1e9ab1fef05a admin admin] PATH_INFO: `/v3/projects/da09bc123439479492a4d1028bd2d0f2/users/386884d9aa4f43fcaa46a884466fac25/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:04.275612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6258b-17d4-42cd-bc4b-1e9ab1fef05a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da09bc123439479492a4d1028bd2d0f2, user_id=386884d9aa4f43fcaa46a884466fac25, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:04.278702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6258b-17d4-42cd-bc4b-1e9ab1fef05a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:04.305110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f93430-883b-43ea-8cb4-42e18709d42a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:04.307228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-27f93430-883b-43ea-8cb4-42e18709d42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:04.345283 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1151/2313] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:04 2022] PUT /identity/v3/projects/da09bc123439479492a4d1028bd2d0f2/users/386884d9aa4f43fcaa46a884466fac25/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:04.348529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39670c7-fb27-4f71-90a6-5bd45c0ccafe None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:04.348920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39670c7-fb27-4f71-90a6-5bd45c0ccafe None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:04.349300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39670c7-fb27-4f71-90a6-5bd45c0ccafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:04.407244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d39670c7-fb27-4f71-90a6-5bd45c0ccafe None None] MFA Rules not processed for user `386884d9aa4f43fcaa46a884466fac25`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:04.409415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d39670c7-fb27-4f71-90a6-5bd45c0ccafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:04.450566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:04.463614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f93430-883b-43ea-8cb4-42e18709d42a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:04.583415 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1152/2314] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:04.584504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39670c7-fb27-4f71-90a6-5bd45c0ccafe None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:04.585229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b013e-b671-438a-80a8-cd2c3018ef6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:04.585956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b013e-b671-438a-80a8-cd2c3018ef6b service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:04.586247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b013e-b671-438a-80a8-cd2c3018ef6b service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:04.586526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b013e-b671-438a-80a8-cd2c3018ef6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:04.589914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d39670c7-fb27-4f71-90a6-5bd45c0ccafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:04.696462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b013e-b671-438a-80a8-cd2c3018ef6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:04.697936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b013e-b671-438a-80a8-cd2c3018ef6b service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:04.713537 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1163/2315] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:02:04.714216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b013e-b671-438a-80a8-cd2c3018ef6b service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:04.731264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b013e-b671-438a-80a8-cd2c3018ef6b service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:04.733004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39670c7-fb27-4f71-90a6-5bd45c0ccafe None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:04.740585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5149b-19c1-4421-9ca2-7ca28ed8467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:04.741626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5149b-19c1-4421-9ca2-7ca28ed8467a admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:04.741915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5149b-19c1-4421-9ca2-7ca28ed8467a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:04.742195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5149b-19c1-4421-9ca2-7ca28ed8467a admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:04.742903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5149b-19c1-4421-9ca2-7ca28ed8467a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:04.745914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5149b-19c1-4421-9ca2-7ca28ed8467a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:04.750829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c170e4-c9ba-4fc9-ab11-5164fe115497 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:04.751475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c170e4-c9ba-4fc9-ab11-5164fe115497 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:04.751761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c170e4-c9ba-4fc9-ab11-5164fe115497 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:04.752040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c170e4-c9ba-4fc9-ab11-5164fe115497 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:04.796381 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1164/2316] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:04 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:04.800471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5149b-19c1-4421-9ca2-7ca28ed8467a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:04.861174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:04.897923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c170e4-c9ba-4fc9-ab11-5164fe115497 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:04.902925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c170e4-c9ba-4fc9-ab11-5164fe115497 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:04.921509 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1153/2317] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:04.963135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5149b-19c1-4421-9ca2-7ca28ed8467a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:04.980979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98c65e-e955-4a0a-a1d5-7ab86c8b39e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:04.981727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98c65e-e955-4a0a-a1d5-7ab86c8b39e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:04.982038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98c65e-e955-4a0a-a1d5-7ab86c8b39e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:04.982320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98c65e-e955-4a0a-a1d5-7ab86c8b39e5 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:04.983163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98c65e-e955-4a0a-a1d5-7ab86c8b39e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:04.986112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98c65e-e955-4a0a-a1d5-7ab86c8b39e5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:05.056155 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1165/2318] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:04 2022] POST /identity/v3/users => generated 298 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:02:05.060401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c170e4-c9ba-4fc9-ab11-5164fe115497 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:05.079578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd9cd6-9b45-4217-90a8-f07143d6c164 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:05.080010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd9cd6-9b45-4217-90a8-f07143d6c164 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:05.080536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd9cd6-9b45-4217-90a8-f07143d6c164 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:05.085239 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1166/2319] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:02:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:02:05.088023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c170e4-c9ba-4fc9-ab11-5164fe115497 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:05.092945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd9cd6-9b45-4217-90a8-f07143d6c164 None None] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:02:05.100430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cd7fc-3788-4773-b4ac-ab672e10b99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:05.101906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cd7fc-3788-4773-b4ac-ab672e10b99c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:05.102188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cd7fc-3788-4773-b4ac-ab672e10b99c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:05.103561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cd7fc-3788-4773-b4ac-ab672e10b99c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:05.104151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cd7fc-3788-4773-b4ac-ab672e10b99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:05.107946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cd7fc-3788-4773-b4ac-ab672e10b99c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:05.125122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:05.163364 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1154/2320] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:02:05.166373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cd7fc-3788-4773-b4ac-ab672e10b99c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:05.189689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cd7fc-3788-4773-b4ac-ab672e10b99c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:05.195538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68241cff-113b-4c0f-9aea-6f0bdb70d51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:05.196295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68241cff-113b-4c0f-9aea-6f0bdb70d51c admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:05.196701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68241cff-113b-4c0f-9aea-6f0bdb70d51c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:05.197171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68241cff-113b-4c0f-9aea-6f0bdb70d51c admin admin] PATH_INFO: `/v3/projects/430dbaa2f2484d08866690ece4e3e666/users/db31e74649434808ba7f9bb78eab10af/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:05.207850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd9cd6-9b45-4217-90a8-f07143d6c164 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:05.219960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68241cff-113b-4c0f-9aea-6f0bdb70d51c admin admin] RBAC: Authorizing `identity:create_grant(project_id=430dbaa2f2484d08866690ece4e3e666, user_id=db31e74649434808ba7f9bb78eab10af, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:05.224160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68241cff-113b-4c0f-9aea-6f0bdb70d51c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:05.283382 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1155/2321] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:05 2022] PUT /identity/v3/projects/430dbaa2f2484d08866690ece4e3e666/users/db31e74649434808ba7f9bb78eab10af/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:05.294091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68241cff-113b-4c0f-9aea-6f0bdb70d51c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:05.322914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd9cd6-9b45-4217-90a8-f07143d6c164 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:05.416678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68241cff-113b-4c0f-9aea-6f0bdb70d51c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:05.426500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9477d0-3cc1-42cd-a4b5-e5e774976671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:05.427082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9477d0-3cc1-42cd-a4b5-e5e774976671 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:05.427400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9477d0-3cc1-42cd-a4b5-e5e774976671 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:05.427681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9477d0-3cc1-42cd-a4b5-e5e774976671 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:05.428382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9477d0-3cc1-42cd-a4b5-e5e774976671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:05.430059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9477d0-3cc1-42cd-a4b5-e5e774976671 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:05.446457 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1156/2322] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:05.447539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9477d0-3cc1-42cd-a4b5-e5e774976671 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:05.447986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7ecf1-1ee6-471d-a66c-9e0b955435a8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:05.448812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7ecf1-1ee6-471d-a66c-9e0b955435a8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:05.449101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7ecf1-1ee6-471d-a66c-9e0b955435a8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:05.449379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7ecf1-1ee6-471d-a66c-9e0b955435a8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/projects/1636951001054e278919006d65686c32` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:05.451835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7ecf1-1ee6-471d-a66c-9e0b955435a8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:get_project(project_id=1636951001054e278919006d65686c32)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:05.458118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7ecf1-1ee6-471d-a66c-9e0b955435a8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:05.463571 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1167/2323] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:02:05 2022] GET /identity/v3/projects/1636951001054e278919006d65686c32 => generated 371 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:05.473682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9477d0-3cc1-42cd-a4b5-e5e774976671 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:05.481848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f50090-357f-466c-a1bb-5f3a38c8a48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:05.482995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f50090-357f-466c-a1bb-5f3a38c8a48d admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:05.483330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f50090-357f-466c-a1bb-5f3a38c8a48d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:05.483630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f50090-357f-466c-a1bb-5f3a38c8a48d admin admin] PATH_INFO: `/v3/projects/430dbaa2f2484d08866690ece4e3e666/users/db31e74649434808ba7f9bb78eab10af/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:05.485985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f50090-357f-466c-a1bb-5f3a38c8a48d admin admin] RBAC: Authorizing `identity:create_grant(project_id=430dbaa2f2484d08866690ece4e3e666, user_id=db31e74649434808ba7f9bb78eab10af, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:05.490392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f50090-357f-466c-a1bb-5f3a38c8a48d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:05.500862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7ecf1-1ee6-471d-a66c-9e0b955435a8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:05.517069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7ecf1-1ee6-471d-a66c-9e0b955435a8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:05.527448 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1157/2324] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:05 2022] PUT /identity/v3/projects/430dbaa2f2484d08866690ece4e3e666/users/db31e74649434808ba7f9bb78eab10af/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:05.536235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57c618-7cff-4bb6-8de2-436e46ca613e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:05.536539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57c618-7cff-4bb6-8de2-436e46ca613e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:05.536796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57c618-7cff-4bb6-8de2-436e46ca613e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:05.589147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-fe57c618-7cff-4bb6-8de2-436e46ca613e None None] MFA Rules not processed for user `db31e74649434808ba7f9bb78eab10af`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:05.590578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fe57c618-7cff-4bb6-8de2-436e46ca613e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:05.643342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe0ecc-4b57-42f7-ab73-185018ff7fa0 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:05.644016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe0ecc-4b57-42f7-ab73-185018ff7fa0 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:05.644301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe0ecc-4b57-42f7-ab73-185018ff7fa0 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:05.644578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe0ecc-4b57-42f7-ab73-185018ff7fa0 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/projects/1636951001054e278919006d65686c32` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:05.647444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe0ecc-4b57-42f7-ab73-185018ff7fa0 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1636951001054e278919006d65686c32)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:05.649705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe0ecc-4b57-42f7-ab73-185018ff7fa0 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:05.662930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:05.747366 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1158/2325] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:05.763765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2fe0ecc-4b57-42f7-ab73-185018ff7fa0 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1636951001054e278919006d65686c32', 'request_id': 'req-c2fe0ecc-4b57-42f7-ab73-185018ff7fa0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:05.779132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2fe0ecc-4b57-42f7-ab73-185018ff7fa0 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1636951001054e278919006d65686c32', 'request_id': 'req-c2fe0ecc-4b57-42f7-ab73-185018ff7fa0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:05.789448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2fe0ecc-4b57-42f7-ab73-185018ff7fa0 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1636951001054e278919006d65686c32', 'request_id': 'req-c2fe0ecc-4b57-42f7-ab73-185018ff7fa0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:05.815556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2fe0ecc-4b57-42f7-ab73-185018ff7fa0 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] The token cache is being invalidate because project 1636951001054e278919006d65686c32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:05.816191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2fe0ecc-4b57-42f7-ab73-185018ff7fa0 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:05.817189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2fe0ecc-4b57-42f7-ab73-185018ff7fa0 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:05.821182 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1168/2326] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:05 2022] DELETE /identity/v3/projects/1636951001054e278919006d65686c32 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:05.952727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57c618-7cff-4bb6-8de2-436e46ca613e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:05.981827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:06.092983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57c618-7cff-4bb6-8de2-436e46ca613e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:06.208469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d339b4-1ce6-4b9c-a5d6-9c0cfb69ff21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:06.209875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d339b4-1ce6-4b9c-a5d6-9c0cfb69ff21 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:06.210231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d339b4-1ce6-4b9c-a5d6-9c0cfb69ff21 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:06.210528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d339b4-1ce6-4b9c-a5d6-9c0cfb69ff21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:06.212515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-88d339b4-1ce6-4b9c-a5d6-9c0cfb69ff21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:06.311505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d339b4-1ce6-4b9c-a5d6-9c0cfb69ff21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:06.313602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d339b4-1ce6-4b9c-a5d6-9c0cfb69ff21 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:06.336338 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1159/2327] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:06.497013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dca89-7bd1-44b5-8fda-1dc3049030d5 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:06.498014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dca89-7bd1-44b5-8fda-1dc3049030d5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:06.498480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dca89-7bd1-44b5-8fda-1dc3049030d5 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:06.500118 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1169/2328] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:02:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:02:06.506277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d339b4-1ce6-4b9c-a5d6-9c0cfb69ff21 service nova] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:02:06.508160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-88d339b4-1ce6-4b9c-a5d6-9c0cfb69ff21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:06.525929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d339b4-1ce6-4b9c-a5d6-9c0cfb69ff21 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:06.527792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-88d339b4-1ce6-4b9c-a5d6-9c0cfb69ff21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:06.593916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:06.642058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d339b4-1ce6-4b9c-a5d6-9c0cfb69ff21 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:06.650810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85f219-61c4-4c66-88a7-81ced78fb8ab tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:06.651374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85f219-61c4-4c66-88a7-81ced78fb8ab tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:06.651674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85f219-61c4-4c66-88a7-81ced78fb8ab tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:06.651955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85f219-61c4-4c66-88a7-81ced78fb8ab tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/projects/adf4314354ea4f54a022211569ff95e8` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:06.653597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85f219-61c4-4c66-88a7-81ced78fb8ab tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:get_project(project_id=adf4314354ea4f54a022211569ff95e8)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:06.656857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85f219-61c4-4c66-88a7-81ced78fb8ab tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:06.659701 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1160/2329] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:02:06 2022] GET /identity/v3/projects/adf4314354ea4f54a022211569ff95e8 => generated 375 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:06.678381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91dca89-7bd1-44b5-8fda-1dc3049030d5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:06.702301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91dca89-7bd1-44b5-8fda-1dc3049030d5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:06.714635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719dc4b3-6d18-4453-a51a-e2fa64c56526 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:06.715268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dc4b3-6d18-4453-a51a-e2fa64c56526 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:06.715574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dc4b3-6d18-4453-a51a-e2fa64c56526 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:06.715847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dc4b3-6d18-4453-a51a-e2fa64c56526 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:06.716555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719dc4b3-6d18-4453-a51a-e2fa64c56526 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:06.716875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719dc4b3-6d18-4453-a51a-e2fa64c56526 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:06.718491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719dc4b3-6d18-4453-a51a-e2fa64c56526 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:06.745791 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1170/2330] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:06.746199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85f219-61c4-4c66-88a7-81ced78fb8ab tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:06.761941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85f219-61c4-4c66-88a7-81ced78fb8ab tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:06.791640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3af0a-a39f-4dbf-bc57-943090acc1ba tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:06.792602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3af0a-a39f-4dbf-bc57-943090acc1ba tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:06.792860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3af0a-a39f-4dbf-bc57-943090acc1ba tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:06.793155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3af0a-a39f-4dbf-bc57-943090acc1ba tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:06.794630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3af0a-a39f-4dbf-bc57-943090acc1ba tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:06.800470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3af0a-a39f-4dbf-bc57-943090acc1ba tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:06.843673 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1161/2331] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:06 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:06.847602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719dc4b3-6d18-4453-a51a-e2fa64c56526 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:06.862833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719dc4b3-6d18-4453-a51a-e2fa64c56526 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:06.964434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac1083-bd66-4306-93d3-dfbae6cd4a5f tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:06.965110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac1083-bd66-4306-93d3-dfbae6cd4a5f tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:06.965355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac1083-bd66-4306-93d3-dfbae6cd4a5f tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:06.965647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac1083-bd66-4306-93d3-dfbae6cd4a5f tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:06.966336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac1083-bd66-4306-93d3-dfbae6cd4a5f tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:06.966782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac1083-bd66-4306-93d3-dfbae6cd4a5f tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:06.970519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac1083-bd66-4306-93d3-dfbae6cd4a5f tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:06.987947 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1171/2332] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:07.196845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2498a-7dec-42c4-81cc-51b4e545c2cd None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:07.197291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2498a-7dec-42c4-81cc-51b4e545c2cd None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:07.197559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2498a-7dec-42c4-81cc-51b4e545c2cd None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:07.199256 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1162/2333] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:02:07.206712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c80d84-f56c-43c5-9c62-290a77e32d29 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:07.207556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c80d84-f56c-43c5-9c62-290a77e32d29 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:07.207556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c80d84-f56c-43c5-9c62-290a77e32d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:07.241671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-33c80d84-f56c-43c5-9c62-290a77e32d29 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:07.242981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-33c80d84-f56c-43c5-9c62-290a77e32d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:07.317986 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1172/2334] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:02:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:07.345056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2498a-7dec-42c4-81cc-51b4e545c2cd None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:07.348243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-def2498a-7dec-42c4-81cc-51b4e545c2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:07.374213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2498a-7dec-42c4-81cc-51b4e545c2cd None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:07.387173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9240e-4e27-4da4-98eb-8846b9f7a99d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:07.387965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9240e-4e27-4da4-98eb-8846b9f7a99d service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:07.388256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9240e-4e27-4da4-98eb-8846b9f7a99d service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:07.388536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9240e-4e27-4da4-98eb-8846b9f7a99d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:07.402936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9240e-4e27-4da4-98eb-8846b9f7a99d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:07.411809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9240e-4e27-4da4-98eb-8846b9f7a99d service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:07.442650 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1163/2335] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:07.779278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e6d3-30e7-41f8-bf28-11b1d3db8ada None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:07.780797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e6d3-30e7-41f8-bf28-11b1d3db8ada None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:07.781549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e6d3-30e7-41f8-bf28-11b1d3db8ada None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:07.785444 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1173/2336] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:02:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:02:07.796435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9240e-4e27-4da4-98eb-8846b9f7a99d service placement] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:02:07.945941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9240e-4e27-4da4-98eb-8846b9f7a99d service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:07.971681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9240e-4e27-4da4-98eb-8846b9f7a99d service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:07.979655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92d7a3-f529-406c-8706-0810e13fe49b tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:07.980737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92d7a3-f529-406c-8706-0810e13fe49b tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:07.981226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92d7a3-f529-406c-8706-0810e13fe49b tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:07.981739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92d7a3-f529-406c-8706-0810e13fe49b tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/projects/66a22f3ac1fc4302a21fa129e6b02d05` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:07.983489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92d7a3-f529-406c-8706-0810e13fe49b tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:get_project(project_id=66a22f3ac1fc4302a21fa129e6b02d05)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:07.986277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92d7a3-f529-406c-8706-0810e13fe49b tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:07.988998 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1164/2337] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:02:07 2022] GET /identity/v3/projects/66a22f3ac1fc4302a21fa129e6b02d05 => generated 371 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:09.328729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb2717-85d7-4b6c-b36b-3bf8c152feb7 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:09.329220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb2717-85d7-4b6c-b36b-3bf8c152feb7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:09.329883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb2717-85d7-4b6c-b36b-3bf8c152feb7 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:09.331901 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1174/2338] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:02:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:02:09.337331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92d7a3-f529-406c-8706-0810e13fe49b tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:02:09.356504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92d7a3-f529-406c-8706-0810e13fe49b tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:09.371881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92d7a3-f529-406c-8706-0810e13fe49b tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:09.379074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac539ae-3065-403f-bebb-510337d21c3c tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:09.379853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac539ae-3065-403f-bebb-510337d21c3c tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:09.380214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac539ae-3065-403f-bebb-510337d21c3c tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:09.380602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac539ae-3065-403f-bebb-510337d21c3c tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/projects/66a22f3ac1fc4302a21fa129e6b02d05` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:09.382195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac539ae-3065-403f-bebb-510337d21c3c tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:get_project(project_id=66a22f3ac1fc4302a21fa129e6b02d05)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:09.384719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac539ae-3065-403f-bebb-510337d21c3c tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:09.387071 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1165/2339] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:02:09 2022] GET /identity/v3/projects/66a22f3ac1fc4302a21fa129e6b02d05 => generated 371 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:09.448879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb2717-85d7-4b6c-b36b-3bf8c152feb7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:09.472875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb2717-85d7-4b6c-b36b-3bf8c152feb7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:09.494390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451be95-0771-4b1c-a724-f1bfdeddcfbb tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:09.495324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451be95-0771-4b1c-a724-f1bfdeddcfbb tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:09.496061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451be95-0771-4b1c-a724-f1bfdeddcfbb tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:09.496349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451be95-0771-4b1c-a724-f1bfdeddcfbb tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:09.497326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451be95-0771-4b1c-a724-f1bfdeddcfbb tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:09.497540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451be95-0771-4b1c-a724-f1bfdeddcfbb tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:09.499172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451be95-0771-4b1c-a724-f1bfdeddcfbb tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:09.516357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:09.533771 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1175/2340] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:09.536441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac539ae-3065-403f-bebb-510337d21c3c tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:09.550087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac539ae-3065-403f-bebb-510337d21c3c tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:09.564312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e5fa9-47a2-410b-b4bb-0953cbe75ba8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:09.565491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e5fa9-47a2-410b-b4bb-0953cbe75ba8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:09.569203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e5fa9-47a2-410b-b4bb-0953cbe75ba8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:09.570455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e5fa9-47a2-410b-b4bb-0953cbe75ba8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:09.570455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e5fa9-47a2-410b-b4bb-0953cbe75ba8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:09.572244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e5fa9-47a2-410b-b4bb-0953cbe75ba8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:09.611648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451be95-0771-4b1c-a724-f1bfdeddcfbb tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:09.613399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2451be95-0771-4b1c-a724-f1bfdeddcfbb tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:09.644488 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1166/2341] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:09 2022] POST /identity/v3/users => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:09.652036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e5fa9-47a2-410b-b4bb-0953cbe75ba8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:09.696921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e5fa9-47a2-410b-b4bb-0953cbe75ba8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:09.718494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42457273-034b-484d-be8c-6f0cf4c2d92e tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:09.719163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42457273-034b-484d-be8c-6f0cf4c2d92e tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:09.721858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42457273-034b-484d-be8c-6f0cf4c2d92e tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:09.721858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42457273-034b-484d-be8c-6f0cf4c2d92e tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:09.722262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42457273-034b-484d-be8c-6f0cf4c2d92e tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:09.722604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42457273-034b-484d-be8c-6f0cf4c2d92e tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:09.730375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42457273-034b-484d-be8c-6f0cf4c2d92e tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:09.778013 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1167/2342] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:02:09.837207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451be95-0771-4b1c-a724-f1bfdeddcfbb tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:09.849985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb35922-3253-4d7e-bd97-766d07d6704e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:09.851227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb35922-3253-4d7e-bd97-766d07d6704e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:09.851692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb35922-3253-4d7e-bd97-766d07d6704e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:09.852140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb35922-3253-4d7e-bd97-766d07d6704e admin admin] PATH_INFO: `/v3/users/c9fa37569c0b40dda5ee332c28aab5b3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:09.855450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb35922-3253-4d7e-bd97-766d07d6704e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9fa37569c0b40dda5ee332c28aab5b3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:09.857618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb35922-3253-4d7e-bd97-766d07d6704e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:09.981218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0cb35922-3253-4d7e-bd97-766d07d6704e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9fa37569c0b40dda5ee332c28aab5b3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:09.982118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0cb35922-3253-4d7e-bd97-766d07d6704e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9fa37569c0b40dda5ee332c28aab5b3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:10.023539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0cb35922-3253-4d7e-bd97-766d07d6704e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9fa37569c0b40dda5ee332c28aab5b3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:10.025008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0cb35922-3253-4d7e-bd97-766d07d6704e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9fa37569c0b40dda5ee332c28aab5b3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:10.041569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0cb35922-3253-4d7e-bd97-766d07d6704e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9fa37569c0b40dda5ee332c28aab5b3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:10.070499 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1176/2343] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:09 2022] DELETE /identity/v3/users/c9fa37569c0b40dda5ee332c28aab5b3 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:10.074044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c93a94-0dfd-41b1-af84-e896fefaaa0f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:10.074910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c93a94-0dfd-41b1-af84-e896fefaaa0f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:10.075373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c93a94-0dfd-41b1-af84-e896fefaaa0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:10.115021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-13c93a94-0dfd-41b1-af84-e896fefaaa0f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:10.116832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-13c93a94-0dfd-41b1-af84-e896fefaaa0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:10.232514 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1168/2344] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:10.289777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb35922-3253-4d7e-bd97-766d07d6704e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:10.291862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0cb35922-3253-4d7e-bd97-766d07d6704e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:10.388103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7151d9-0b1e-4e62-bac4-db66372d6c13 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:10.390024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7151d9-0b1e-4e62-bac4-db66372d6c13 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:10.390562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7151d9-0b1e-4e62-bac4-db66372d6c13 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:10.394141 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1169/2345] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:02:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:02:10.400527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7151d9-0b1e-4e62-bac4-db66372d6c13 None None] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:02:10.404049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-db7151d9-0b1e-4e62-bac4-db66372d6c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:10.407391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb35922-3253-4d7e-bd97-766d07d6704e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:10.414976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:10.419637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dbbb7-02d5-412e-bea9-0ec71987a943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:10.421029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dbbb7-02d5-412e-bea9-0ec71987a943 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:10.421468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dbbb7-02d5-412e-bea9-0ec71987a943 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:10.421922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dbbb7-02d5-412e-bea9-0ec71987a943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:10.446750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dbbb7-02d5-412e-bea9-0ec71987a943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:10.448682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dbbb7-02d5-412e-bea9-0ec71987a943 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:10.480695 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1177/2346] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:10.552052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7151d9-0b1e-4e62-bac4-db66372d6c13 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:10.553681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-db7151d9-0b1e-4e62-bac4-db66372d6c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:10.629228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7151d9-0b1e-4e62-bac4-db66372d6c13 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:10.640740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d3c19-2911-4dd3-9a18-cf5c26edbb78 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:10.641820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d3c19-2911-4dd3-9a18-cf5c26edbb78 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:10.642786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d3c19-2911-4dd3-9a18-cf5c26edbb78 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:10.643787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d3c19-2911-4dd3-9a18-cf5c26edbb78 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/projects/66a22f3ac1fc4302a21fa129e6b02d05` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:10.645264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d3c19-2911-4dd3-9a18-cf5c26edbb78 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:get_project(project_id=66a22f3ac1fc4302a21fa129e6b02d05)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:10.648493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d3c19-2911-4dd3-9a18-cf5c26edbb78 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:10.651629 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1170/2347] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:02:10 2022] GET /identity/v3/projects/66a22f3ac1fc4302a21fa129e6b02d05 => generated 371 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:10.896676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69de9cb-b171-482a-acac-44c2395cec03 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:10.896829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69de9cb-b171-482a-acac-44c2395cec03 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:10.897082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69de9cb-b171-482a-acac-44c2395cec03 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:10.898438 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1178/2348] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:02:10.909373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d3c19-2911-4dd3-9a18-cf5c26edbb78 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:02:10.944529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d3c19-2911-4dd3-9a18-cf5c26edbb78 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:10.983919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d3c19-2911-4dd3-9a18-cf5c26edbb78 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:10.994150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c22628-5d55-4134-9191-dde932b83b16 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:10.995498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c22628-5d55-4134-9191-dde932b83b16 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:10.996037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c22628-5d55-4134-9191-dde932b83b16 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:10.996399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c22628-5d55-4134-9191-dde932b83b16 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/projects/66a22f3ac1fc4302a21fa129e6b02d05` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:10.998853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c22628-5d55-4134-9191-dde932b83b16 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:get_project(project_id=66a22f3ac1fc4302a21fa129e6b02d05)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:11.002076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c22628-5d55-4134-9191-dde932b83b16 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:11.016824 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1171/2349] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:02:10 2022] GET /identity/v3/projects/66a22f3ac1fc4302a21fa129e6b02d05 => generated 371 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:11.048541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69de9cb-b171-482a-acac-44c2395cec03 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:11.076658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69de9cb-b171-482a-acac-44c2395cec03 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:11.083879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608767b-458a-4eb9-a5d6-6eb23794b3a5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:11.085158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608767b-458a-4eb9-a5d6-6eb23794b3a5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:11.085597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608767b-458a-4eb9-a5d6-6eb23794b3a5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:11.086050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608767b-458a-4eb9-a5d6-6eb23794b3a5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/users/43946045d67a47bb8a98d284c359d50c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:11.120479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608767b-458a-4eb9-a5d6-6eb23794b3a5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:delete_user(user_id=43946045d67a47bb8a98d284c359d50c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:11.122851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608767b-458a-4eb9-a5d6-6eb23794b3a5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:11.129871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:11.263916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e608767b-458a-4eb9-a5d6-6eb23794b3a5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43946045d67a47bb8a98d284c359d50c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:11.264605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e608767b-458a-4eb9-a5d6-6eb23794b3a5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43946045d67a47bb8a98d284c359d50c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:11.281556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e608767b-458a-4eb9-a5d6-6eb23794b3a5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43946045d67a47bb8a98d284c359d50c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:11.282689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e608767b-458a-4eb9-a5d6-6eb23794b3a5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43946045d67a47bb8a98d284c359d50c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:11.294642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e608767b-458a-4eb9-a5d6-6eb23794b3a5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43946045d67a47bb8a98d284c359d50c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:11.339333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c22628-5d55-4134-9191-dde932b83b16 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:11.341868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-06c22628-5d55-4134-9191-dde932b83b16 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:11.352355 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1179/2350] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:11 2022] DELETE /identity/v3/users/43946045d67a47bb8a98d284c359d50c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:11.360861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608767b-458a-4eb9-a5d6-6eb23794b3a5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:11.362787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e608767b-458a-4eb9-a5d6-6eb23794b3a5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:11.382095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c22628-5d55-4134-9191-dde932b83b16 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:11.504251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39735452-3ff9-4eca-8748-98efe4386ae4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:11.504952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39735452-3ff9-4eca-8748-98efe4386ae4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:11.505355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39735452-3ff9-4eca-8748-98efe4386ae4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:11.505648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39735452-3ff9-4eca-8748-98efe4386ae4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/projects/66a22f3ac1fc4302a21fa129e6b02d05` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:11.508501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39735452-3ff9-4eca-8748-98efe4386ae4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:delete_project(project_id=66a22f3ac1fc4302a21fa129e6b02d05)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:11.510454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39735452-3ff9-4eca-8748-98efe4386ae4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:11.546330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608767b-458a-4eb9-a5d6-6eb23794b3a5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:11.563515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244d41a-97a1-4aec-8b14-0365e11a09ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:11.564584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244d41a-97a1-4aec-8b14-0365e11a09ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:11.565510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244d41a-97a1-4aec-8b14-0365e11a09ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:11.565888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244d41a-97a1-4aec-8b14-0365e11a09ac admin admin] PATH_INFO: `/v3/projects/edd031b24c9e4401bbcbe78e11ed7a6f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:11.568219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244d41a-97a1-4aec-8b14-0365e11a09ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=edd031b24c9e4401bbcbe78e11ed7a6f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:11.570747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244d41a-97a1-4aec-8b14-0365e11a09ac admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:11.588277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:11.614410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-39735452-3ff9-4eca-8748-98efe4386ae4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a22f3ac1fc4302a21fa129e6b02d05', 'request_id': 'req-39735452-3ff9-4eca-8748-98efe4386ae4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:11.626104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-39735452-3ff9-4eca-8748-98efe4386ae4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a22f3ac1fc4302a21fa129e6b02d05', 'request_id': 'req-39735452-3ff9-4eca-8748-98efe4386ae4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:11.644230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-39735452-3ff9-4eca-8748-98efe4386ae4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a22f3ac1fc4302a21fa129e6b02d05', 'request_id': 'req-39735452-3ff9-4eca-8748-98efe4386ae4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:11.661909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-39735452-3ff9-4eca-8748-98efe4386ae4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] The token cache is being invalidate because project 66a22f3ac1fc4302a21fa129e6b02d05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:11.662326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-39735452-3ff9-4eca-8748-98efe4386ae4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:11.665131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-39735452-3ff9-4eca-8748-98efe4386ae4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:11.668965 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1172/2351] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:11 2022] DELETE /identity/v3/projects/66a22f3ac1fc4302a21fa129e6b02d05 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:11.669955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39735452-3ff9-4eca-8748-98efe4386ae4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:11.675995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-39735452-3ff9-4eca-8748-98efe4386ae4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:11.712286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b244d41a-97a1-4aec-8b14-0365e11a09ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edd031b24c9e4401bbcbe78e11ed7a6f', 'request_id': 'req-b244d41a-97a1-4aec-8b14-0365e11a09ac'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:11.731377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b244d41a-97a1-4aec-8b14-0365e11a09ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edd031b24c9e4401bbcbe78e11ed7a6f', 'request_id': 'req-b244d41a-97a1-4aec-8b14-0365e11a09ac'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:11.740046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b244d41a-97a1-4aec-8b14-0365e11a09ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edd031b24c9e4401bbcbe78e11ed7a6f', 'request_id': 'req-b244d41a-97a1-4aec-8b14-0365e11a09ac'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:11.775111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b244d41a-97a1-4aec-8b14-0365e11a09ac admin admin] The token cache is being invalidate because project edd031b24c9e4401bbcbe78e11ed7a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:11.775796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b244d41a-97a1-4aec-8b14-0365e11a09ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:11.776658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b244d41a-97a1-4aec-8b14-0365e11a09ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:11.778884 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1180/2352] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:11 2022] DELETE /identity/v3/projects/edd031b24c9e4401bbcbe78e11ed7a6f => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:11.782636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244d41a-97a1-4aec-8b14-0365e11a09ac admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:11.784272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b244d41a-97a1-4aec-8b14-0365e11a09ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:11.811642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:11.822071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39735452-3ff9-4eca-8748-98efe4386ae4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:11.897960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726b244-76d1-4911-a15d-f59a2ffe259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:11.899026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726b244-76d1-4911-a15d-f59a2ffe259a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:11.901216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726b244-76d1-4911-a15d-f59a2ffe259a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:11.901682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726b244-76d1-4911-a15d-f59a2ffe259a admin admin] PATH_INFO: `/v3/users/386884d9aa4f43fcaa46a884466fac25` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:11.904973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726b244-76d1-4911-a15d-f59a2ffe259a admin admin] RBAC: Authorizing `identity:delete_user(user_id=386884d9aa4f43fcaa46a884466fac25)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:11.909275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726b244-76d1-4911-a15d-f59a2ffe259a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:11.917810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244d41a-97a1-4aec-8b14-0365e11a09ac admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:11.933109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1f8cb-6716-4112-b85a-fb660943e368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:11.933904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1f8cb-6716-4112-b85a-fb660943e368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:11.934303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1f8cb-6716-4112-b85a-fb660943e368 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:11.934856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1f8cb-6716-4112-b85a-fb660943e368 admin admin] PATH_INFO: `/v3/users/f30b0cdda320406cbceb41bd29c42f6e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:11.936863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1f8cb-6716-4112-b85a-fb660943e368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f30b0cdda320406cbceb41bd29c42f6e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:11.941489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1f8cb-6716-4112-b85a-fb660943e368 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:12.021780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8726b244-76d1-4911-a15d-f59a2ffe259a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '386884d9aa4f43fcaa46a884466fac25'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:12.052524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e3a1f8cb-6716-4112-b85a-fb660943e368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f30b0cdda320406cbceb41bd29c42f6e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:12.055411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e3a1f8cb-6716-4112-b85a-fb660943e368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f30b0cdda320406cbceb41bd29c42f6e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:12.056596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8726b244-76d1-4911-a15d-f59a2ffe259a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '386884d9aa4f43fcaa46a884466fac25'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:12.058759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8726b244-76d1-4911-a15d-f59a2ffe259a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '386884d9aa4f43fcaa46a884466fac25'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:12.066884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:12.079803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8726b244-76d1-4911-a15d-f59a2ffe259a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '386884d9aa4f43fcaa46a884466fac25'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:12.085121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8726b244-76d1-4911-a15d-f59a2ffe259a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '386884d9aa4f43fcaa46a884466fac25'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:12.085391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e3a1f8cb-6716-4112-b85a-fb660943e368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f30b0cdda320406cbceb41bd29c42f6e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:12.093597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e3a1f8cb-6716-4112-b85a-fb660943e368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f30b0cdda320406cbceb41bd29c42f6e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:12.113937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e3a1f8cb-6716-4112-b85a-fb660943e368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f30b0cdda320406cbceb41bd29c42f6e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:12.117048 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1173/2353] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:11 2022] DELETE /identity/v3/users/386884d9aa4f43fcaa46a884466fac25 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:12.123442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7852c-d4ca-41b9-8936-a72203415d55 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:12.124005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7852c-d4ca-41b9-8936-a72203415d55 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:12.124571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7852c-d4ca-41b9-8936-a72203415d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:12.129303 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1181/2354] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:11 2022] DELETE /identity/v3/users/f30b0cdda320406cbceb41bd29c42f6e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:02:12.161525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-fae7852c-d4ca-41b9-8936-a72203415d55 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:12.162927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fae7852c-d4ca-41b9-8936-a72203415d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:12.280054 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1174/2355] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:02:12.301309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a41ecc-1922-466e-a48d-0a27a5c421c9 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:12.302040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a41ecc-1922-466e-a48d-0a27a5c421c9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:12.302538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a41ecc-1922-466e-a48d-0a27a5c421c9 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:12.304224 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1182/2356] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:02:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:02:12.311422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7852c-d4ca-41b9-8936-a72203415d55 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:12.319738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fae7852c-d4ca-41b9-8936-a72203415d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:12.352381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a41ecc-1922-466e-a48d-0a27a5c421c9 None None] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:02:12.354568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f3a41ecc-1922-466e-a48d-0a27a5c421c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:12.464336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7852c-d4ca-41b9-8936-a72203415d55 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:12.473949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cee4fe-316d-4703-a670-0634ad0923db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:12.475957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cee4fe-316d-4703-a670-0634ad0923db service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:12.476249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cee4fe-316d-4703-a670-0634ad0923db service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:12.476593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cee4fe-316d-4703-a670-0634ad0923db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:12.500049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cee4fe-316d-4703-a670-0634ad0923db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:12.501590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cee4fe-316d-4703-a670-0634ad0923db service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:12.525170 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1175/2357] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:12.527713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a41ecc-1922-466e-a48d-0a27a5c421c9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:12.529736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f3a41ecc-1922-466e-a48d-0a27a5c421c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:12.602493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:12.687563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a41ecc-1922-466e-a48d-0a27a5c421c9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:12.701290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b974e9c-0c04-4090-98c0-8f53997a22b2 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:12.701966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b974e9c-0c04-4090-98c0-8f53997a22b2 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:12.702258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b974e9c-0c04-4090-98c0-8f53997a22b2 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:12.702538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b974e9c-0c04-4090-98c0-8f53997a22b2 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/projects/adf4314354ea4f54a022211569ff95e8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:12.705172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b974e9c-0c04-4090-98c0-8f53997a22b2 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:get_project(project_id=adf4314354ea4f54a022211569ff95e8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:12.707531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b974e9c-0c04-4090-98c0-8f53997a22b2 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:12.709339 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1183/2358] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:02:12 2022] GET /identity/v3/projects/adf4314354ea4f54a022211569ff95e8 => generated 375 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:13.270800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fd565-c9d6-4389-9ce0-31ca64a3d7c5 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:13.270800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fd565-c9d6-4389-9ce0-31ca64a3d7c5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:13.270800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fd565-c9d6-4389-9ce0-31ca64a3d7c5 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:13.270800 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1176/2359] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:02:13.275143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b974e9c-0c04-4090-98c0-8f53997a22b2 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:02:13.277200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2b974e9c-0c04-4090-98c0-8f53997a22b2 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:13.296130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b974e9c-0c04-4090-98c0-8f53997a22b2 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:13.309402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b974e9c-0c04-4090-98c0-8f53997a22b2 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:13.316079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83eeab-9276-4555-993f-dfa94bde33a8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:13.316990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83eeab-9276-4555-993f-dfa94bde33a8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:13.317448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83eeab-9276-4555-993f-dfa94bde33a8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:13.317877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83eeab-9276-4555-993f-dfa94bde33a8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/projects/adf4314354ea4f54a022211569ff95e8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:13.319411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83eeab-9276-4555-993f-dfa94bde33a8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:get_project(project_id=adf4314354ea4f54a022211569ff95e8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:13.322002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83eeab-9276-4555-993f-dfa94bde33a8 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:13.324685 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1184/2360] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:02:13 2022] GET /identity/v3/projects/adf4314354ea4f54a022211569ff95e8 => generated 375 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:13.702981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fd565-c9d6-4389-9ce0-31ca64a3d7c5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:13.708834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0e3fd565-c9d6-4389-9ce0-31ca64a3d7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:13.743682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fd565-c9d6-4389-9ce0-31ca64a3d7c5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:13.757426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a10f9b-728f-410e-8a45-abe8e1372247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:13.758298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a10f9b-728f-410e-8a45-abe8e1372247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:13.758591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a10f9b-728f-410e-8a45-abe8e1372247 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:13.758836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a10f9b-728f-410e-8a45-abe8e1372247 admin admin] PATH_INFO: `/v3/projects/2c02809c27a9408196c9c786844fcd00` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:13.760189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a10f9b-728f-410e-8a45-abe8e1372247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c02809c27a9408196c9c786844fcd00)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:13.762352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a10f9b-728f-410e-8a45-abe8e1372247 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:13.855618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93a10f9b-728f-410e-8a45-abe8e1372247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c02809c27a9408196c9c786844fcd00', 'request_id': 'req-93a10f9b-728f-410e-8a45-abe8e1372247'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:13.866491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93a10f9b-728f-410e-8a45-abe8e1372247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c02809c27a9408196c9c786844fcd00', 'request_id': 'req-93a10f9b-728f-410e-8a45-abe8e1372247'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:13.881032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93a10f9b-728f-410e-8a45-abe8e1372247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c02809c27a9408196c9c786844fcd00', 'request_id': 'req-93a10f9b-728f-410e-8a45-abe8e1372247'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:13.901150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93a10f9b-728f-410e-8a45-abe8e1372247 admin admin] The token cache is being invalidate because project 2c02809c27a9408196c9c786844fcd00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:13.901555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93a10f9b-728f-410e-8a45-abe8e1372247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:13.904280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93a10f9b-728f-410e-8a45-abe8e1372247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:13.907092 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1177/2361] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:13 2022] DELETE /identity/v3/projects/2c02809c27a9408196c9c786844fcd00 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:13.912142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8602692-869c-4195-86f3-04d7c3d3525f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:13.912671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8602692-869c-4195-86f3-04d7c3d3525f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:13.912774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8602692-869c-4195-86f3-04d7c3d3525f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:13.941737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e8602692-869c-4195-86f3-04d7c3d3525f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:13.943239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e8602692-869c-4195-86f3-04d7c3d3525f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:14.034255 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1185/2362] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:14.044260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8abf4d-f7b5-495f-bcc5-ad2f5b647eb6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:14.044260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8abf4d-f7b5-495f-bcc5-ad2f5b647eb6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:14.044559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8abf4d-f7b5-495f-bcc5-ad2f5b647eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:14.078121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-af8abf4d-f7b5-495f-bcc5-ad2f5b647eb6 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:14.080045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-af8abf4d-f7b5-495f-bcc5-ad2f5b647eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:14.093464 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1178/2363] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:14.098251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8602692-869c-4195-86f3-04d7c3d3525f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:14.113153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8602692-869c-4195-86f3-04d7c3d3525f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:14.124801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9582a6-7bce-405f-afab-961b873c0fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:14.124801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9582a6-7bce-405f-afab-961b873c0fdd admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:14.124801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9582a6-7bce-405f-afab-961b873c0fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:14.125174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9582a6-7bce-405f-afab-961b873c0fdd admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:14.126008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9582a6-7bce-405f-afab-961b873c0fdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:14.126145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9582a6-7bce-405f-afab-961b873c0fdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:14.128320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9582a6-7bce-405f-afab-961b873c0fdd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:14.152678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8abf4d-f7b5-495f-bcc5-ad2f5b647eb6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:14.153071 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1186/2364] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:14.175578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8abf4d-f7b5-495f-bcc5-ad2f5b647eb6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:14.188478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95a5b0-84d2-4573-abf8-5bd705033aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:14.190222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95a5b0-84d2-4573-abf8-5bd705033aaf admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:14.190222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95a5b0-84d2-4573-abf8-5bd705033aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:14.190222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95a5b0-84d2-4573-abf8-5bd705033aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:14.191720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95a5b0-84d2-4573-abf8-5bd705033aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:14.195556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95a5b0-84d2-4573-abf8-5bd705033aaf admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:14.210862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:14.246471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581202c-0c86-47aa-bedb-6a9c651e83c0 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:14.246763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581202c-0c86-47aa-bedb-6a9c651e83c0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:14.247046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581202c-0c86-47aa-bedb-6a9c651e83c0 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:14.248883 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1187/2365] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:02:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 21:02:14.254456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581202c-0c86-47aa-bedb-6a9c651e83c0 None None] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:02:14.258711 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1179/2366] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:14 2022] POST /identity/v3/projects => generated 391 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:02:14.260170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2581202c-0c86-47aa-bedb-6a9c651e83c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:14.261966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95a5b0-84d2-4573-abf8-5bd705033aaf admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:14.367499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95a5b0-84d2-4573-abf8-5bd705033aaf admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:14.374167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a142efd-37f5-4c3c-b75b-de3b6a894684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:14.375073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a142efd-37f5-4c3c-b75b-de3b6a894684 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:14.375547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a142efd-37f5-4c3c-b75b-de3b6a894684 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:14.376031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a142efd-37f5-4c3c-b75b-de3b6a894684 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:14.376891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a142efd-37f5-4c3c-b75b-de3b6a894684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:14.379698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a142efd-37f5-4c3c-b75b-de3b6a894684 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:14.390755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581202c-0c86-47aa-bedb-6a9c651e83c0 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:14.392488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2581202c-0c86-47aa-bedb-6a9c651e83c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:14.410264 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1180/2367] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:14 2022] POST /identity/v3/users => generated 296 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:14.411682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a142efd-37f5-4c3c-b75b-de3b6a894684 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:14.415633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2a142efd-37f5-4c3c-b75b-de3b6a894684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:14.435171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a142efd-37f5-4c3c-b75b-de3b6a894684 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:14.465127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e04c0-ddc2-424c-ad7c-078bd1786dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:14.465813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e04c0-ddc2-424c-ad7c-078bd1786dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:14.466096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e04c0-ddc2-424c-ad7c-078bd1786dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:14.466389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e04c0-ddc2-424c-ad7c-078bd1786dbe admin admin] PATH_INFO: `/v3/projects/da09bc123439479492a4d1028bd2d0f2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:14.468699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e04c0-ddc2-424c-ad7c-078bd1786dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=da09bc123439479492a4d1028bd2d0f2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:14.477177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e04c0-ddc2-424c-ad7c-078bd1786dbe admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:14.503829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:14.555561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-040e04c0-ddc2-424c-ad7c-078bd1786dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da09bc123439479492a4d1028bd2d0f2', 'request_id': 'req-040e04c0-ddc2-424c-ad7c-078bd1786dbe'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:14.557331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581202c-0c86-47aa-bedb-6a9c651e83c0 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:14.571928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-040e04c0-ddc2-424c-ad7c-078bd1786dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da09bc123439479492a4d1028bd2d0f2', 'request_id': 'req-040e04c0-ddc2-424c-ad7c-078bd1786dbe'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:14.590708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-040e04c0-ddc2-424c-ad7c-078bd1786dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da09bc123439479492a4d1028bd2d0f2', 'request_id': 'req-040e04c0-ddc2-424c-ad7c-078bd1786dbe'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:14.610474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-040e04c0-ddc2-424c-ad7c-078bd1786dbe admin admin] The token cache is being invalidate because project da09bc123439479492a4d1028bd2d0f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:14.610780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-040e04c0-ddc2-424c-ad7c-078bd1786dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:14.613531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-040e04c0-ddc2-424c-ad7c-078bd1786dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:14.615703 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1181/2368] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:14 2022] DELETE /identity/v3/projects/da09bc123439479492a4d1028bd2d0f2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:14.617726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e04c0-ddc2-424c-ad7c-078bd1786dbe admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:14.630836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-040e04c0-ddc2-424c-ad7c-078bd1786dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:14.688176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c01b3-9bfe-40e1-b1e9-8a77173ffe2b tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20211b47da794347a4e37218144a8982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb418d06586b4b27a6f2f5be6104a8d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:14.689424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c01b3-9bfe-40e1-b1e9-8a77173ffe2b tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:14.689424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c01b3-9bfe-40e1-b1e9-8a77173ffe2b tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:14.690183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c01b3-9bfe-40e1-b1e9-8a77173ffe2b tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] PATH_INFO: `/v3/projects/adf4314354ea4f54a022211569ff95e8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:14.691830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c01b3-9bfe-40e1-b1e9-8a77173ffe2b tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorizing `identity:get_project(project_id=adf4314354ea4f54a022211569ff95e8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:14.693929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c01b3-9bfe-40e1-b1e9-8a77173ffe2b tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:14.696041 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1188/2369] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:02:14 2022] GET /identity/v3/projects/adf4314354ea4f54a022211569ff95e8 => generated 375 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:02:14.696737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c01b3-9bfe-40e1-b1e9-8a77173ffe2b tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:14.703606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3e8c01b3-9bfe-40e1-b1e9-8a77173ffe2b tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:14.797652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:14.817198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e04c0-ddc2-424c-ad7c-078bd1786dbe admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:14.845558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b95fe-964e-4bfa-a023-73961b04e69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:14.850304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b95fe-964e-4bfa-a023-73961b04e69e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:14.853320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b95fe-964e-4bfa-a023-73961b04e69e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:14.853622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b95fe-964e-4bfa-a023-73961b04e69e admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:14.856974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b95fe-964e-4bfa-a023-73961b04e69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:14.869034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b95fe-964e-4bfa-a023-73961b04e69e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:14.932120 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1182/2370] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:14.933159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b95fe-964e-4bfa-a023-73961b04e69e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:14.958695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b95fe-964e-4bfa-a023-73961b04e69e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:14.973816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363c4a8-b52b-4adf-8df6-ff97253358a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:14.975391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363c4a8-b52b-4adf-8df6-ff97253358a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:14.980289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363c4a8-b52b-4adf-8df6-ff97253358a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:14.980601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363c4a8-b52b-4adf-8df6-ff97253358a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:14.981330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363c4a8-b52b-4adf-8df6-ff97253358a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:14.983233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363c4a8-b52b-4adf-8df6-ff97253358a0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:15.015314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c01b3-9bfe-40e1-b1e9-8a77173ffe2b tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:15.040932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bccf7-cba2-4463-9449-a507a3571941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:15.041263 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1183/2371] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:15.043238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363c4a8-b52b-4adf-8df6-ff97253358a0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:15.044524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bccf7-cba2-4463-9449-a507a3571941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:15.045112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bccf7-cba2-4463-9449-a507a3571941 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:15.045112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bccf7-cba2-4463-9449-a507a3571941 admin admin] PATH_INFO: `/v3/users/db31e74649434808ba7f9bb78eab10af` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:15.049759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bccf7-cba2-4463-9449-a507a3571941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db31e74649434808ba7f9bb78eab10af)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:15.051858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bccf7-cba2-4463-9449-a507a3571941 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:15.076751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363c4a8-b52b-4adf-8df6-ff97253358a0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:15.094666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45701f08-9a91-4145-8257-bc5866d4d0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:15.095469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45701f08-9a91-4145-8257-bc5866d4d0c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:15.095742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45701f08-9a91-4145-8257-bc5866d4d0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:15.096071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45701f08-9a91-4145-8257-bc5866d4d0c1 admin admin] PATH_INFO: `/v3/projects/36e6bd716c304f16a8e22197b0d1b6ee/users/a7ef6de63d3f4a909d313e2838199e8d/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:15.163745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45701f08-9a91-4145-8257-bc5866d4d0c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e6bd716c304f16a8e22197b0d1b6ee, user_id=a7ef6de63d3f4a909d313e2838199e8d, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:15.172990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45701f08-9a91-4145-8257-bc5866d4d0c1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:15.241999 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1184/2372] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:15 2022] PUT /identity/v3/projects/36e6bd716c304f16a8e22197b0d1b6ee/users/a7ef6de63d3f4a909d313e2838199e8d/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:15.245892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c005d-ea67-4338-90db-a4672410c953 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:15.247607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c005d-ea67-4338-90db-a4672410c953 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:15.248533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c005d-ea67-4338-90db-a4672410c953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:15.255405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-439bccf7-cba2-4463-9449-a507a3571941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db31e74649434808ba7f9bb78eab10af'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:15.256261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-439bccf7-cba2-4463-9449-a507a3571941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db31e74649434808ba7f9bb78eab10af'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:15.295673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-439bccf7-cba2-4463-9449-a507a3571941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db31e74649434808ba7f9bb78eab10af'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:15.298113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-439bccf7-cba2-4463-9449-a507a3571941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db31e74649434808ba7f9bb78eab10af'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:15.322591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-439bccf7-cba2-4463-9449-a507a3571941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db31e74649434808ba7f9bb78eab10af'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:15.341140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-911c005d-ea67-4338-90db-a4672410c953 None None] MFA Rules not processed for user `f8b35ab211584884a72057fa31184836`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:15.350418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-911c005d-ea67-4338-90db-a4672410c953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:15.352773 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1189/2373] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:14 2022] DELETE /identity/v3/users/db31e74649434808ba7f9bb78eab10af => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:15.357236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7698e-c1ba-4983-800f-5b7a872ea422 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:15.357531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7698e-c1ba-4983-800f-5b7a872ea422 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:15.357814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7698e-c1ba-4983-800f-5b7a872ea422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:15.413269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:15.446008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-98d7698e-c1ba-4983-800f-5b7a872ea422 None None] MFA Rules not processed for user `a7ef6de63d3f4a909d313e2838199e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:15.447552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-98d7698e-c1ba-4983-800f-5b7a872ea422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:15.540290 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1185/2374] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:15.542168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c005d-ea67-4338-90db-a4672410c953 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:15.547569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-911c005d-ea67-4338-90db-a4672410c953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:15.616988 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1190/2375] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:15.618228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7698e-c1ba-4983-800f-5b7a872ea422 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:15.620043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-98d7698e-c1ba-4983-800f-5b7a872ea422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:15.675685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c005d-ea67-4338-90db-a4672410c953 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:15.681811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbade0-8c74-4b27-bc8a-191daaf6226b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:15.682536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbade0-8c74-4b27-bc8a-191daaf6226b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:15.682826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbade0-8c74-4b27-bc8a-191daaf6226b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:15.683185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbade0-8c74-4b27-bc8a-191daaf6226b admin admin] PATH_INFO: `/v3/users/689862aa8b9745279b6a819735392e23` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:15.684459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbade0-8c74-4b27-bc8a-191daaf6226b admin admin] RBAC: Authorizing `identity:delete_user(user_id=689862aa8b9745279b6a819735392e23)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:15.686446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbade0-8c74-4b27-bc8a-191daaf6226b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:15.782559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33dbade0-8c74-4b27-bc8a-191daaf6226b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '689862aa8b9745279b6a819735392e23'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:15.794509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:15.795083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7698e-c1ba-4983-800f-5b7a872ea422 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:15.809852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd0c1e-4369-414d-903d-f4fcd6666e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:15.813552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd0c1e-4369-414d-903d-f4fcd6666e5c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:15.816358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd0c1e-4369-414d-903d-f4fcd6666e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:15.816845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd0c1e-4369-414d-903d-f4fcd6666e5c admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:15.819694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd0c1e-4369-414d-903d-f4fcd6666e5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:15.825369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd0c1e-4369-414d-903d-f4fcd6666e5c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:15.831767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33dbade0-8c74-4b27-bc8a-191daaf6226b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '689862aa8b9745279b6a819735392e23'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:15.833035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33dbade0-8c74-4b27-bc8a-191daaf6226b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '689862aa8b9745279b6a819735392e23'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:15.860308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33dbade0-8c74-4b27-bc8a-191daaf6226b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '689862aa8b9745279b6a819735392e23'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:15.862251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33dbade0-8c74-4b27-bc8a-191daaf6226b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '689862aa8b9745279b6a819735392e23'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:15.913966 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1186/2376] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:15 2022] DELETE /identity/v3/users/689862aa8b9745279b6a819735392e23 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:15.914901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbade0-8c74-4b27-bc8a-191daaf6226b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:15.920678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-33dbade0-8c74-4b27-bc8a-191daaf6226b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:15.978932 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1191/2377] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:15 2022] POST /identity/v3/projects => generated 383 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:15.980725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668cbcf-4aff-44d7-b854-cddcd1694c74 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:15.986180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668cbcf-4aff-44d7-b854-cddcd1694c74 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:15.986544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668cbcf-4aff-44d7-b854-cddcd1694c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:16.040104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9668cbcf-4aff-44d7-b854-cddcd1694c74 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:16.042591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9668cbcf-4aff-44d7-b854-cddcd1694c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:16.131322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbade0-8c74-4b27-bc8a-191daaf6226b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:16.179013 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1192/2378] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:16.180086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668cbcf-4aff-44d7-b854-cddcd1694c74 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:16.189260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9668cbcf-4aff-44d7-b854-cddcd1694c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:16.200995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586937b1-48f3-46dc-8125-ec8264c86624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:16.201650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586937b1-48f3-46dc-8125-ec8264c86624 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:16.201981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586937b1-48f3-46dc-8125-ec8264c86624 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:16.202799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586937b1-48f3-46dc-8125-ec8264c86624 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:16.203627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586937b1-48f3-46dc-8125-ec8264c86624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:16.205917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668cbcf-4aff-44d7-b854-cddcd1694c74 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:16.206402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586937b1-48f3-46dc-8125-ec8264c86624 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:16.215682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08d2c0-f55b-4769-b934-d1b31818616c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:16.216499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08d2c0-f55b-4769-b934-d1b31818616c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:16.216886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08d2c0-f55b-4769-b934-d1b31818616c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:16.217265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08d2c0-f55b-4769-b934-d1b31818616c admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:16.218615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08d2c0-f55b-4769-b934-d1b31818616c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:16.221582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08d2c0-f55b-4769-b934-d1b31818616c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:16.253285 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1193/2379] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:16 2022] POST /identity/v3/users => generated 298 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:16.254335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08d2c0-f55b-4769-b934-d1b31818616c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:16.256222 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1187/2380] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:15 2022] POST /identity/v3/projects => generated 389 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:16.257322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586937b1-48f3-46dc-8125-ec8264c86624 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:16.258206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8b08d2c0-f55b-4769-b934-d1b31818616c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:16.274854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:16.350953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586937b1-48f3-46dc-8125-ec8264c86624 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:16.352753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08d2c0-f55b-4769-b934-d1b31818616c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:16.358000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b067ce3-758d-4a3d-981f-92c8e8ed31dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:16.358694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b067ce3-758d-4a3d-981f-92c8e8ed31dd admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:16.358978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b067ce3-758d-4a3d-981f-92c8e8ed31dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:16.359253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b067ce3-758d-4a3d-981f-92c8e8ed31dd admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:16.359956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b067ce3-758d-4a3d-981f-92c8e8ed31dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:16.363039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b067ce3-758d-4a3d-981f-92c8e8ed31dd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:16.372954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:16.396861 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1188/2381] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:16 2022] POST /identity/v3/users => generated 301 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:16.397826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b067ce3-758d-4a3d-981f-92c8e8ed31dd admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:16.412290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b067ce3-758d-4a3d-981f-92c8e8ed31dd admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:16.418422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e0976-5339-4236-b435-6e6488f39c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:16.419377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e0976-5339-4236-b435-6e6488f39c6c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:16.419665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e0976-5339-4236-b435-6e6488f39c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:16.419939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e0976-5339-4236-b435-6e6488f39c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:16.421740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e0976-5339-4236-b435-6e6488f39c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:16.422592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb0f6d-7c0a-4931-8917-2e336e50a697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:16.424776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e0976-5339-4236-b435-6e6488f39c6c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:16.426830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb0f6d-7c0a-4931-8917-2e336e50a697 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:16.428293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb0f6d-7c0a-4931-8917-2e336e50a697 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:16.428832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb0f6d-7c0a-4931-8917-2e336e50a697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:16.439040 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1189/2382] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:16.440753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb0f6d-7c0a-4931-8917-2e336e50a697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:16.443977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb0f6d-7c0a-4931-8917-2e336e50a697 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:16.444254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e0976-5339-4236-b435-6e6488f39c6c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:16.457133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e0976-5339-4236-b435-6e6488f39c6c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:16.462020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8180aa-8ca6-4fd3-ba6d-cbb895fc0169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:16.462796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8180aa-8ca6-4fd3-ba6d-cbb895fc0169 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:16.463249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8180aa-8ca6-4fd3-ba6d-cbb895fc0169 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:16.463558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8180aa-8ca6-4fd3-ba6d-cbb895fc0169 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:16.464602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8180aa-8ca6-4fd3-ba6d-cbb895fc0169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:16.466414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8180aa-8ca6-4fd3-ba6d-cbb895fc0169 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:16.473922 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1194/2383] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:16.475246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb0f6d-7c0a-4931-8917-2e336e50a697 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:16.480796 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1190/2384] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:16.485135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8180aa-8ca6-4fd3-ba6d-cbb895fc0169 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:16.494090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb0f6d-7c0a-4931-8917-2e336e50a697 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:16.499338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8180aa-8ca6-4fd3-ba6d-cbb895fc0169 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:16.508504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c581f51-fa70-4726-b37f-2c4183f8c09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:16.509328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c581f51-fa70-4726-b37f-2c4183f8c09b admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:16.509685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c581f51-fa70-4726-b37f-2c4183f8c09b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:16.510048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c581f51-fa70-4726-b37f-2c4183f8c09b admin admin] PATH_INFO: `/v3/projects/5d8a52c497be45eebf5405ad2a9439d0/users/9fe8994bceca43abbb270d373f0e1ad6/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:16.512754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe64a29-426b-437b-a1a5-2cf1f470deaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:16.513883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe64a29-426b-437b-a1a5-2cf1f470deaf admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:16.514406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe64a29-426b-437b-a1a5-2cf1f470deaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:16.514902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe64a29-426b-437b-a1a5-2cf1f470deaf admin admin] PATH_INFO: `/v3/projects/6ed49ee4eca649a4a75640c7a5b12026/users/e486b81cb41f4535bbe9e89ebffdaa04/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:16.540388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c581f51-fa70-4726-b37f-2c4183f8c09b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8a52c497be45eebf5405ad2a9439d0, user_id=9fe8994bceca43abbb270d373f0e1ad6, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:16.544337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c581f51-fa70-4726-b37f-2c4183f8c09b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:16.548945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe64a29-426b-437b-a1a5-2cf1f470deaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed49ee4eca649a4a75640c7a5b12026, user_id=e486b81cb41f4535bbe9e89ebffdaa04, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:16.552050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe64a29-426b-437b-a1a5-2cf1f470deaf admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:16.564980 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1191/2385] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:16 2022] PUT /identity/v3/projects/5d8a52c497be45eebf5405ad2a9439d0/users/9fe8994bceca43abbb270d373f0e1ad6/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:16.569696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c581f51-fa70-4726-b37f-2c4183f8c09b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:16.581757 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1195/2386] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:16 2022] PUT /identity/v3/projects/6ed49ee4eca649a4a75640c7a5b12026/users/e486b81cb41f4535bbe9e89ebffdaa04/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:16.587637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe64a29-426b-437b-a1a5-2cf1f470deaf admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:16.713597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c581f51-fa70-4726-b37f-2c4183f8c09b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:16.728100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe64a29-426b-437b-a1a5-2cf1f470deaf admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:16.735439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540bdc9-d4e2-494d-8845-566e4d74ae40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:16.736210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540bdc9-d4e2-494d-8845-566e4d74ae40 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:16.736653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540bdc9-d4e2-494d-8845-566e4d74ae40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:16.737119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540bdc9-d4e2-494d-8845-566e4d74ae40 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:16.738348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540bdc9-d4e2-494d-8845-566e4d74ae40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:16.740213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540bdc9-d4e2-494d-8845-566e4d74ae40 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:16.740356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4500da-7872-47e8-876c-2b9fb24a4d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:16.740652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4500da-7872-47e8-876c-2b9fb24a4d3d admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:16.740954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4500da-7872-47e8-876c-2b9fb24a4d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:16.741245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4500da-7872-47e8-876c-2b9fb24a4d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:16.741971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4500da-7872-47e8-876c-2b9fb24a4d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:16.747580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4500da-7872-47e8-876c-2b9fb24a4d3d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:16.754872 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1196/2387] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:16.758804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540bdc9-d4e2-494d-8845-566e4d74ae40 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:16.763871 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1192/2388] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:16.768653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4500da-7872-47e8-876c-2b9fb24a4d3d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:16.774217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540bdc9-d4e2-494d-8845-566e4d74ae40 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:16.780621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb60ba-ebb0-42a6-91ff-21a6c478b645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:16.781592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb60ba-ebb0-42a6-91ff-21a6c478b645 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:16.781944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb60ba-ebb0-42a6-91ff-21a6c478b645 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:16.782296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb60ba-ebb0-42a6-91ff-21a6c478b645 admin admin] PATH_INFO: `/v3/projects/6ed49ee4eca649a4a75640c7a5b12026/users/e486b81cb41f4535bbe9e89ebffdaa04/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:16.785536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb60ba-ebb0-42a6-91ff-21a6c478b645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed49ee4eca649a4a75640c7a5b12026, user_id=e486b81cb41f4535bbe9e89ebffdaa04, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:16.788543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb60ba-ebb0-42a6-91ff-21a6c478b645 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:16.790557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4500da-7872-47e8-876c-2b9fb24a4d3d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:16.801189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b60799-825b-45e0-ba3f-88dff212c49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:16.801976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b60799-825b-45e0-ba3f-88dff212c49f admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:16.802389 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1197/2389] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:16 2022] PUT /identity/v3/projects/6ed49ee4eca649a4a75640c7a5b12026/users/e486b81cb41f4535bbe9e89ebffdaa04/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:02:16.803598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b60799-825b-45e0-ba3f-88dff212c49f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:16.803894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b60799-825b-45e0-ba3f-88dff212c49f admin admin] PATH_INFO: `/v3/projects/5d8a52c497be45eebf5405ad2a9439d0/users/9fe8994bceca43abbb270d373f0e1ad6/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:16.811772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b60799-825b-45e0-ba3f-88dff212c49f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8a52c497be45eebf5405ad2a9439d0, user_id=9fe8994bceca43abbb270d373f0e1ad6, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:16.816597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b60799-825b-45e0-ba3f-88dff212c49f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:16.842951 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1193/2390] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:16 2022] PUT /identity/v3/projects/5d8a52c497be45eebf5405ad2a9439d0/users/9fe8994bceca43abbb270d373f0e1ad6/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:16.854136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab09d5-d9fb-4699-8bb3-aa3a1d202381 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:16.854437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab09d5-d9fb-4699-8bb3-aa3a1d202381 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:16.854721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab09d5-d9fb-4699-8bb3-aa3a1d202381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:16.889300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9eab09d5-d9fb-4699-8bb3-aa3a1d202381 None None] MFA Rules not processed for user `9fe8994bceca43abbb270d373f0e1ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:16.890770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9eab09d5-d9fb-4699-8bb3-aa3a1d202381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:16.908105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:17.004371 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1198/2391] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:17.317720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b60799-825b-45e0-ba3f-88dff212c49f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:17.319572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-27b60799-825b-45e0-ba3f-88dff212c49f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:17.333733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab09d5-d9fb-4699-8bb3-aa3a1d202381 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:17.335322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9eab09d5-d9fb-4699-8bb3-aa3a1d202381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:17.517398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab09d5-d9fb-4699-8bb3-aa3a1d202381 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:17.522979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b60799-825b-45e0-ba3f-88dff212c49f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:17.526618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c7df1-4a69-4265-969d-1db2ad22136e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:17.527980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c7df1-4a69-4265-969d-1db2ad22136e service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:17.529270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c7df1-4a69-4265-969d-1db2ad22136e service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:17.529587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c7df1-4a69-4265-969d-1db2ad22136e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:17.532788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-902c7df1-4a69-4265-969d-1db2ad22136e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:17.542836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06cc15-5cf0-4f3d-aecc-a3d798fb0661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:17.544816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06cc15-5cf0-4f3d-aecc-a3d798fb0661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:17.545539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06cc15-5cf0-4f3d-aecc-a3d798fb0661 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:17.546578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06cc15-5cf0-4f3d-aecc-a3d798fb0661 admin admin] PATH_INFO: `/v3/projects/430dbaa2f2484d08866690ece4e3e666` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:17.549215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06cc15-5cf0-4f3d-aecc-a3d798fb0661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=430dbaa2f2484d08866690ece4e3e666)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:17.552938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06cc15-5cf0-4f3d-aecc-a3d798fb0661 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:17.604445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=5,keystone:SELECT=93,keystone:DELETE=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:17.635051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fd06cc15-5cf0-4f3d-aecc-a3d798fb0661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '430dbaa2f2484d08866690ece4e3e666', 'request_id': 'req-fd06cc15-5cf0-4f3d-aecc-a3d798fb0661'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:17.646011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c7df1-4a69-4265-969d-1db2ad22136e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:17.649875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c7df1-4a69-4265-969d-1db2ad22136e service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:17.650453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fd06cc15-5cf0-4f3d-aecc-a3d798fb0661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '430dbaa2f2484d08866690ece4e3e666', 'request_id': 'req-fd06cc15-5cf0-4f3d-aecc-a3d798fb0661'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:17.665795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fd06cc15-5cf0-4f3d-aecc-a3d798fb0661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '430dbaa2f2484d08866690ece4e3e666', 'request_id': 'req-fd06cc15-5cf0-4f3d-aecc-a3d798fb0661'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:17.683841 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1199/2392] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:17.687163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c7df1-4a69-4265-969d-1db2ad22136e service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:17.690220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-902c7df1-4a69-4265-969d-1db2ad22136e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:17.711223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c7df1-4a69-4265-969d-1db2ad22136e service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:17.733930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fd06cc15-5cf0-4f3d-aecc-a3d798fb0661 admin admin] The token cache is being invalidate because project 430dbaa2f2484d08866690ece4e3e666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:17.733930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fd06cc15-5cf0-4f3d-aecc-a3d798fb0661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:17.736700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fd06cc15-5cf0-4f3d-aecc-a3d798fb0661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:17.743030 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1194/2393] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:17 2022] DELETE /identity/v3/projects/430dbaa2f2484d08866690ece4e3e666 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:17.744501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a796fc7-ae43-4a62-a76c-9d859aa8af92 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:17.745114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a796fc7-ae43-4a62-a76c-9d859aa8af92 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:17.745292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a796fc7-ae43-4a62-a76c-9d859aa8af92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:17.805119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2a796fc7-ae43-4a62-a76c-9d859aa8af92 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:17.808022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2a796fc7-ae43-4a62-a76c-9d859aa8af92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:17.837481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:17.884053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47654662-909e-40b8-9d43-314b788a464c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:17.884769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47654662-909e-40b8-9d43-314b788a464c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:17.885088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47654662-909e-40b8-9d43-314b788a464c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:17.885366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47654662-909e-40b8-9d43-314b788a464c admin admin] PATH_INFO: `/v3/projects/adf4314354ea4f54a022211569ff95e8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:17.889318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47654662-909e-40b8-9d43-314b788a464c admin admin] RBAC: Authorizing `identity:delete_project(project_id=adf4314354ea4f54a022211569ff95e8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:17.891860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47654662-909e-40b8-9d43-314b788a464c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:17.928028 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1195/2394] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:17.930209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f489a47-75e0-4869-9d8d-c5377138b92e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:17.930723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f489a47-75e0-4869-9d8d-c5377138b92e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:17.931120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f489a47-75e0-4869-9d8d-c5377138b92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:17.967921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7f489a47-75e0-4869-9d8d-c5377138b92e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:17.969542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7f489a47-75e0-4869-9d8d-c5377138b92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:17.988616 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1196/2395] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:17.992722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f489a47-75e0-4869-9d8d-c5377138b92e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:18.015058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f489a47-75e0-4869-9d8d-c5377138b92e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:18.040444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-47654662-909e-40b8-9d43-314b788a464c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adf4314354ea4f54a022211569ff95e8', 'request_id': 'req-47654662-909e-40b8-9d43-314b788a464c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:18.071694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-47654662-909e-40b8-9d43-314b788a464c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adf4314354ea4f54a022211569ff95e8', 'request_id': 'req-47654662-909e-40b8-9d43-314b788a464c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:18.079829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-47654662-909e-40b8-9d43-314b788a464c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adf4314354ea4f54a022211569ff95e8', 'request_id': 'req-47654662-909e-40b8-9d43-314b788a464c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:18.101877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-47654662-909e-40b8-9d43-314b788a464c admin admin] The token cache is being invalidate because project adf4314354ea4f54a022211569ff95e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:18.102601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-47654662-909e-40b8-9d43-314b788a464c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:18.102957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-47654662-909e-40b8-9d43-314b788a464c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:18.104707 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1200/2396] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:17 2022] DELETE /identity/v3/projects/adf4314354ea4f54a022211569ff95e8 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:18.108577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47654662-909e-40b8-9d43-314b788a464c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:18.110789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-47654662-909e-40b8-9d43-314b788a464c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:18.209520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb95ba9-edb5-4636-8f6c-15b3753c5c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:18.210910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb95ba9-edb5-4636-8f6c-15b3753c5c51 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:18.211993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb95ba9-edb5-4636-8f6c-15b3753c5c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:18.212278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb95ba9-edb5-4636-8f6c-15b3753c5c51 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:18.213173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb95ba9-edb5-4636-8f6c-15b3753c5c51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:18.213499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb95ba9-edb5-4636-8f6c-15b3753c5c51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:18.216248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb95ba9-edb5-4636-8f6c-15b3753c5c51 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:18.235009 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1197/2397] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:18.237091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb95ba9-edb5-4636-8f6c-15b3753c5c51 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:18.239861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5fb95ba9-edb5-4636-8f6c-15b3753c5c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:18.248416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47654662-909e-40b8-9d43-314b788a464c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:18.263596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145c464-8835-46c6-920b-5eb35ed709d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:18.264749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145c464-8835-46c6-920b-5eb35ed709d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:18.264749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145c464-8835-46c6-920b-5eb35ed709d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:18.264977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145c464-8835-46c6-920b-5eb35ed709d0 admin admin] PATH_INFO: `/v3/users/20211b47da794347a4e37218144a8982` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:18.266041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145c464-8835-46c6-920b-5eb35ed709d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20211b47da794347a4e37218144a8982)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:18.268067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145c464-8835-46c6-920b-5eb35ed709d0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:18.270994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb95ba9-edb5-4636-8f6c-15b3753c5c51 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:18.290339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c829d-29b3-4f21-8d95-abc0ae0ad234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:18.291124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c829d-29b3-4f21-8d95-abc0ae0ad234 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:18.292456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c829d-29b3-4f21-8d95-abc0ae0ad234 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:18.292806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c829d-29b3-4f21-8d95-abc0ae0ad234 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:18.295886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c829d-29b3-4f21-8d95-abc0ae0ad234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:18.301062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c829d-29b3-4f21-8d95-abc0ae0ad234 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:18.368657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3145c464-8835-46c6-920b-5eb35ed709d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20211b47da794347a4e37218144a8982'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:18.369381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3145c464-8835-46c6-920b-5eb35ed709d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20211b47da794347a4e37218144a8982'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:18.380478 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1198/2398] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:18 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:18.384960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c829d-29b3-4f21-8d95-abc0ae0ad234 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:18.391218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3145c464-8835-46c6-920b-5eb35ed709d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20211b47da794347a4e37218144a8982'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:18.392382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3145c464-8835-46c6-920b-5eb35ed709d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20211b47da794347a4e37218144a8982'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:18.392711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ff5c829d-29b3-4f21-8d95-abc0ae0ad234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:18.414585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3145c464-8835-46c6-920b-5eb35ed709d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20211b47da794347a4e37218144a8982'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:18.421033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:18.439922 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1201/2399] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:18 2022] DELETE /identity/v3/users/20211b47da794347a4e37218144a8982 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:02:18.451499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:18.591111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c829d-29b3-4f21-8d95-abc0ae0ad234 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:18.727172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb555bb-1eac-45e6-b1a4-c1d7d7c5fedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:18.729194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb555bb-1eac-45e6-b1a4-c1d7d7c5fedb admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:18.729690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb555bb-1eac-45e6-b1a4-c1d7d7c5fedb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:18.730208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb555bb-1eac-45e6-b1a4-c1d7d7c5fedb admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:18.731388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb555bb-1eac-45e6-b1a4-c1d7d7c5fedb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:18.736200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb555bb-1eac-45e6-b1a4-c1d7d7c5fedb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:18.777665 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1199/2400] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:18 2022] POST /identity/v3/users => generated 291 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:18.782132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145c464-8835-46c6-920b-5eb35ed709d0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:18.802237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145c464-8835-46c6-920b-5eb35ed709d0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:18.808272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73d448-1c89-4440-8135-9b0da319203b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:18.808913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73d448-1c89-4440-8135-9b0da319203b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:18.809199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73d448-1c89-4440-8135-9b0da319203b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:18.809480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73d448-1c89-4440-8135-9b0da319203b admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:18.810256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73d448-1c89-4440-8135-9b0da319203b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:18.812324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73d448-1c89-4440-8135-9b0da319203b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:18.852296 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1202/2401] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:18.855808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb555bb-1eac-45e6-b1a4-c1d7d7c5fedb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:18.871678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb555bb-1eac-45e6-b1a4-c1d7d7c5fedb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:18.883359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933b774-b0ae-4e77-8ee0-43be1b1f389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:18.884309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933b774-b0ae-4e77-8ee0-43be1b1f389b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:18.884617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933b774-b0ae-4e77-8ee0-43be1b1f389b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:18.885071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933b774-b0ae-4e77-8ee0-43be1b1f389b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:18.885793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933b774-b0ae-4e77-8ee0-43be1b1f389b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:18.888804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933b774-b0ae-4e77-8ee0-43be1b1f389b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:18.918594 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1200/2402] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:18.919880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73d448-1c89-4440-8135-9b0da319203b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:18.945467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73d448-1c89-4440-8135-9b0da319203b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:18.954296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd91d3-2138-41ef-9673-edc1e8b58fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:18.955888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd91d3-2138-41ef-9673-edc1e8b58fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:18.955888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd91d3-2138-41ef-9673-edc1e8b58fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:18.956187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd91d3-2138-41ef-9673-edc1e8b58fb3 admin admin] PATH_INFO: `/v3/projects/9801478266e943c4bdb05ee7422fdba3/users/4d04d9b8be4140e89c7d786b8cfbeeb2/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:19.001633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd91d3-2138-41ef-9673-edc1e8b58fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9801478266e943c4bdb05ee7422fdba3, user_id=4d04d9b8be4140e89c7d786b8cfbeeb2, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:19.005292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd91d3-2138-41ef-9673-edc1e8b58fb3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:19.047970 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1203/2403] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:18 2022] PUT /identity/v3/projects/9801478266e943c4bdb05ee7422fdba3/users/4d04d9b8be4140e89c7d786b8cfbeeb2/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:02:19.050209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d282276-546e-45fb-b9ed-8f496c7e3012 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:19.050660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d282276-546e-45fb-b9ed-8f496c7e3012 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:19.050758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d282276-546e-45fb-b9ed-8f496c7e3012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:19.117151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4d282276-546e-45fb-b9ed-8f496c7e3012 None None] MFA Rules not processed for user `4d04d9b8be4140e89c7d786b8cfbeeb2`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:19.118268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4d282276-546e-45fb-b9ed-8f496c7e3012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:19.291750 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1201/2404] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:19.292455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd91d3-2138-41ef-9673-edc1e8b58fb3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:19.435255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd91d3-2138-41ef-9673-edc1e8b58fb3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:19.448571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc77a6-1cd6-4a18-b48c-167f223f4f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:19.449548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc77a6-1cd6-4a18-b48c-167f223f4f42 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:19.450025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc77a6-1cd6-4a18-b48c-167f223f4f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:19.450408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc77a6-1cd6-4a18-b48c-167f223f4f42 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:19.451188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc77a6-1cd6-4a18-b48c-167f223f4f42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:19.457085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc77a6-1cd6-4a18-b48c-167f223f4f42 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:19.527709 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1204/2405] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:19 2022] POST /identity/v3/projects => generated 381 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:19.528619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d282276-546e-45fb-b9ed-8f496c7e3012 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:19.548762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d282276-546e-45fb-b9ed-8f496c7e3012 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:19.628556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:19.676730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa410c-5092-4822-8bdc-e089a0df5acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:19.677382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa410c-5092-4822-8bdc-e089a0df5acc admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:19.677667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa410c-5092-4822-8bdc-e089a0df5acc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:19.677944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa410c-5092-4822-8bdc-e089a0df5acc admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:19.678622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa410c-5092-4822-8bdc-e089a0df5acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:19.680743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa410c-5092-4822-8bdc-e089a0df5acc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:19.730370 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1202/2406] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:19 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:19.735763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc77a6-1cd6-4a18-b48c-167f223f4f42 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:19.753013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc77a6-1cd6-4a18-b48c-167f223f4f42 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:19.756807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa410c-5092-4822-8bdc-e089a0df5acc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:19.759497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b9fa410c-5092-4822-8bdc-e089a0df5acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:19.766622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217e121-ef90-4515-951c-991eec45cbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:19.768065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217e121-ef90-4515-951c-991eec45cbce admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:19.768520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217e121-ef90-4515-951c-991eec45cbce admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:19.768921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217e121-ef90-4515-951c-991eec45cbce admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:19.769790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217e121-ef90-4515-951c-991eec45cbce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:19.771755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217e121-ef90-4515-951c-991eec45cbce admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:19.777779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa410c-5092-4822-8bdc-e089a0df5acc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:19.796466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06096af0-9ed7-4369-94c8-5cd4ed30df87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:19.797142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06096af0-9ed7-4369-94c8-5cd4ed30df87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:19.797426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06096af0-9ed7-4369-94c8-5cd4ed30df87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:19.797701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06096af0-9ed7-4369-94c8-5cd4ed30df87 admin admin] PATH_INFO: `/v3/projects/eb418d06586b4b27a6f2f5be6104a8d9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:19.798969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06096af0-9ed7-4369-94c8-5cd4ed30df87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb418d06586b4b27a6f2f5be6104a8d9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:19.800185 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1205/2407] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:19.800965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06096af0-9ed7-4369-94c8-5cd4ed30df87 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:19.806049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217e121-ef90-4515-951c-991eec45cbce admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:19.847953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217e121-ef90-4515-951c-991eec45cbce admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:19.870878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbdec0-ad6b-4ac5-89a7-943e4b161ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:19.871845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbdec0-ad6b-4ac5-89a7-943e4b161ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:19.873365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbdec0-ad6b-4ac5-89a7-943e4b161ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:19.873918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbdec0-ad6b-4ac5-89a7-943e4b161ac5 admin admin] PATH_INFO: `/v3/projects/8eacf79fe25d43bdac73630d2313deb6/users/2d978b8a8d2e4bb4bc3c45efd1b35833/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:19.914696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-06096af0-9ed7-4369-94c8-5cd4ed30df87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb418d06586b4b27a6f2f5be6104a8d9', 'request_id': 'req-06096af0-9ed7-4369-94c8-5cd4ed30df87'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:19.928498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbdec0-ad6b-4ac5-89a7-943e4b161ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eacf79fe25d43bdac73630d2313deb6, user_id=2d978b8a8d2e4bb4bc3c45efd1b35833, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:19.930368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-06096af0-9ed7-4369-94c8-5cd4ed30df87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb418d06586b4b27a6f2f5be6104a8d9', 'request_id': 'req-06096af0-9ed7-4369-94c8-5cd4ed30df87'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:19.931665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbdec0-ad6b-4ac5-89a7-943e4b161ac5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:19.944044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-06096af0-9ed7-4369-94c8-5cd4ed30df87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb418d06586b4b27a6f2f5be6104a8d9', 'request_id': 'req-06096af0-9ed7-4369-94c8-5cd4ed30df87'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:19.961123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-06096af0-9ed7-4369-94c8-5cd4ed30df87 admin admin] The token cache is being invalidate because project eb418d06586b4b27a6f2f5be6104a8d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:19.961416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-06096af0-9ed7-4369-94c8-5cd4ed30df87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:19.962196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-06096af0-9ed7-4369-94c8-5cd4ed30df87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:19.969572 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1203/2408] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:19 2022] DELETE /identity/v3/projects/eb418d06586b4b27a6f2f5be6104a8d9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:19.970070 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1206/2409] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:19 2022] PUT /identity/v3/projects/8eacf79fe25d43bdac73630d2313deb6/users/2d978b8a8d2e4bb4bc3c45efd1b35833/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:19.973356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea0aaf-5666-4c4e-b372-e45cc366d256 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:19.973664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea0aaf-5666-4c4e-b372-e45cc366d256 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:19.975318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea0aaf-5666-4c4e-b372-e45cc366d256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:19.976253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbdec0-ad6b-4ac5-89a7-943e4b161ac5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:19.981274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-67cbdec0-ad6b-4ac5-89a7-943e4b161ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:20.037086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-95ea0aaf-5666-4c4e-b372-e45cc366d256 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:20.038383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-95ea0aaf-5666-4c4e-b372-e45cc366d256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:20.152528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbdec0-ad6b-4ac5-89a7-943e4b161ac5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:20.168016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8b538-0c66-4951-b320-1c1b7acadc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:20.168826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8b538-0c66-4951-b320-1c1b7acadc38 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:20.169263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8b538-0c66-4951-b320-1c1b7acadc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:20.169788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8b538-0c66-4951-b320-1c1b7acadc38 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:20.170837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8b538-0c66-4951-b320-1c1b7acadc38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:20.172869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8b538-0c66-4951-b320-1c1b7acadc38 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:20.224489 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1207/2410] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:20.225714 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1204/2411] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:20.229154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8b538-0c66-4951-b320-1c1b7acadc38 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:20.234001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e96f4-c221-489a-afe4-a4aef22420f8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:20.234305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e96f4-c221-489a-afe4-a4aef22420f8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:20.234801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e96f4-c221-489a-afe4-a4aef22420f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:20.256317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8b538-0c66-4951-b320-1c1b7acadc38 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:20.273165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f494736-c8e8-4300-918c-e82b0ca21d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:20.274203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f494736-c8e8-4300-918c-e82b0ca21d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:20.274686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f494736-c8e8-4300-918c-e82b0ca21d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:20.275272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f494736-c8e8-4300-918c-e82b0ca21d72 admin admin] PATH_INFO: `/v3/projects/8eacf79fe25d43bdac73630d2313deb6/users/2d978b8a8d2e4bb4bc3c45efd1b35833/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:20.279270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9d9e96f4-c221-489a-afe4-a4aef22420f8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:20.280292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f494736-c8e8-4300-918c-e82b0ca21d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eacf79fe25d43bdac73630d2313deb6, user_id=2d978b8a8d2e4bb4bc3c45efd1b35833, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:20.283132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f494736-c8e8-4300-918c-e82b0ca21d72 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:20.284723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9d9e96f4-c221-489a-afe4-a4aef22420f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:20.289905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:20.304811 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1205/2412] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:02:20.309536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e96f4-c221-489a-afe4-a4aef22420f8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:20.331802 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1208/2413] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:20 2022] PUT /identity/v3/projects/8eacf79fe25d43bdac73630d2313deb6/users/2d978b8a8d2e4bb4bc3c45efd1b35833/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:20.335522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984effd1-0035-4c3f-9f3e-88142106320a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:20.335818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984effd1-0035-4c3f-9f3e-88142106320a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:20.336108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984effd1-0035-4c3f-9f3e-88142106320a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:20.345017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e96f4-c221-489a-afe4-a4aef22420f8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:20.418968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-984effd1-0035-4c3f-9f3e-88142106320a None None] MFA Rules not processed for user `2d978b8a8d2e4bb4bc3c45efd1b35833`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:20.420157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-984effd1-0035-4c3f-9f3e-88142106320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:20.477666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:20.511666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d88959-61fe-4a1f-b783-f949f2a6c9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:20.511958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d88959-61fe-4a1f-b783-f949f2a6c9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:20.512114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d88959-61fe-4a1f-b783-f949f2a6c9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:20.512397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d88959-61fe-4a1f-b783-f949f2a6c9e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:20.513113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d88959-61fe-4a1f-b783-f949f2a6c9e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:20.513419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d88959-61fe-4a1f-b783-f949f2a6c9e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:20.515051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d88959-61fe-4a1f-b783-f949f2a6c9e8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:20.536635 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1206/2414] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:20.542228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d88959-61fe-4a1f-b783-f949f2a6c9e8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:20.566571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d88959-61fe-4a1f-b783-f949f2a6c9e8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:20.576525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17368512-e1fd-4234-b8fe-552076dbf602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:20.578447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17368512-e1fd-4234-b8fe-552076dbf602 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:20.579525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17368512-e1fd-4234-b8fe-552076dbf602 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:20.586224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17368512-e1fd-4234-b8fe-552076dbf602 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:20.591555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17368512-e1fd-4234-b8fe-552076dbf602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:20.596911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17368512-e1fd-4234-b8fe-552076dbf602 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:20.618722 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1209/2415] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:20.697394 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1207/2416] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:20 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:20.698658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984effd1-0035-4c3f-9f3e-88142106320a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:20.715896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984effd1-0035-4c3f-9f3e-88142106320a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:20.827890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356a2be-de72-4327-ac57-fbfb5b3908cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:20.828483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356a2be-de72-4327-ac57-fbfb5b3908cc admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:20.828771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356a2be-de72-4327-ac57-fbfb5b3908cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:20.829050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356a2be-de72-4327-ac57-fbfb5b3908cc admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:20.829722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356a2be-de72-4327-ac57-fbfb5b3908cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:20.831775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356a2be-de72-4327-ac57-fbfb5b3908cc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:20.888822 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1210/2417] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:20 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:20.889781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17368512-e1fd-4234-b8fe-552076dbf602 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:20.906543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17368512-e1fd-4234-b8fe-552076dbf602 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:20.920777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ea3f0-316e-4af3-a7e5-c478d03c1213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:20.921490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ea3f0-316e-4af3-a7e5-c478d03c1213 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:20.921664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ea3f0-316e-4af3-a7e5-c478d03c1213 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:20.921921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ea3f0-316e-4af3-a7e5-c478d03c1213 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:20.922635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ea3f0-316e-4af3-a7e5-c478d03c1213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:20.924936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ea3f0-316e-4af3-a7e5-c478d03c1213 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:20.948087 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1208/2418] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:02:20.952004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356a2be-de72-4327-ac57-fbfb5b3908cc admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:20.963251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356a2be-de72-4327-ac57-fbfb5b3908cc admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:20.976304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ea3f0-316e-4af3-a7e5-c478d03c1213 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:20.978378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bc3f6-fde6-4995-8006-025419d64b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:20.978808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1a4ea3f0-316e-4af3-a7e5-c478d03c1213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:20.979452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bc3f6-fde6-4995-8006-025419d64b57 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:20.979909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bc3f6-fde6-4995-8006-025419d64b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:20.980324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bc3f6-fde6-4995-8006-025419d64b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:20.981178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bc3f6-fde6-4995-8006-025419d64b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:20.982945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bc3f6-fde6-4995-8006-025419d64b57 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:21.023029 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1211/2419] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:21.024361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bc3f6-fde6-4995-8006-025419d64b57 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:21.054530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bc3f6-fde6-4995-8006-025419d64b57 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:21.073190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8397aeb-3b09-4c3c-b4e1-a1cea55d9998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:21.073993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8397aeb-3b09-4c3c-b4e1-a1cea55d9998 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:21.074287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8397aeb-3b09-4c3c-b4e1-a1cea55d9998 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:21.074732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8397aeb-3b09-4c3c-b4e1-a1cea55d9998 admin admin] PATH_INFO: `/v3/projects/f4d5ac688fd34360bfce58c047219682/users/3c003128a6c94bcc81a483123579c96b/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:21.109622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8397aeb-3b09-4c3c-b4e1-a1cea55d9998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d5ac688fd34360bfce58c047219682, user_id=3c003128a6c94bcc81a483123579c96b, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:21.112439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8397aeb-3b09-4c3c-b4e1-a1cea55d9998 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:21.151333 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1212/2420] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:21 2022] PUT /identity/v3/projects/f4d5ac688fd34360bfce58c047219682/users/3c003128a6c94bcc81a483123579c96b/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:21.152528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ea3f0-316e-4af3-a7e5-c478d03c1213 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:21.153156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9779a-d25e-4c37-8c01-4c2ace99c64e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:21.153449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9779a-d25e-4c37-8c01-4c2ace99c64e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:21.153837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9779a-d25e-4c37-8c01-4c2ace99c64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:21.214524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0df9779a-d25e-4c37-8c01-4c2ace99c64e None None] MFA Rules not processed for user `3c003128a6c94bcc81a483123579c96b`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:21.215897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0df9779a-d25e-4c37-8c01-4c2ace99c64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:21.273615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:21.309288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2d184-54aa-497f-a328-f5b6c83960da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:21.309946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2d184-54aa-497f-a328-f5b6c83960da service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:21.310235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2d184-54aa-497f-a328-f5b6c83960da service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:21.310568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2d184-54aa-497f-a328-f5b6c83960da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:21.407823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:21.426255 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1213/2421] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:21.430539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9779a-d25e-4c37-8c01-4c2ace99c64e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:21.451908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2d184-54aa-497f-a328-f5b6c83960da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:21.453540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2d184-54aa-497f-a328-f5b6c83960da service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:21.472457 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1209/2422] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:02:21.585884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9779a-d25e-4c37-8c01-4c2ace99c64e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:21.597837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a781a48-c81a-4af7-a5a0-829a12e33fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:21.598487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a781a48-c81a-4af7-a5a0-829a12e33fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:21.598775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a781a48-c81a-4af7-a5a0-829a12e33fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:21.599061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a781a48-c81a-4af7-a5a0-829a12e33fe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:21.599768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a781a48-c81a-4af7-a5a0-829a12e33fe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:21.601714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a781a48-c81a-4af7-a5a0-829a12e33fe0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:21.668518 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1214/2423] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:21 2022] POST /identity/v3/projects => generated 375 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:02:21.672633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2d184-54aa-497f-a328-f5b6c83960da service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:21.687008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2d184-54aa-497f-a328-f5b6c83960da service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:21.805632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c9854-8172-4e63-aa8c-eadda6b12657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:21.806499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c9854-8172-4e63-aa8c-eadda6b12657 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:21.807113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c9854-8172-4e63-aa8c-eadda6b12657 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:21.807632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c9854-8172-4e63-aa8c-eadda6b12657 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:21.808728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c9854-8172-4e63-aa8c-eadda6b12657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:21.812119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c9854-8172-4e63-aa8c-eadda6b12657 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:21.892470 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1210/2424] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:21 2022] POST /identity/v3/users => generated 294 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:21.896021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a781a48-c81a-4af7-a5a0-829a12e33fe0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:21.914177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a781a48-c81a-4af7-a5a0-829a12e33fe0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:21.937869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf581a3-d07f-4495-aea3-782abddb89ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:21.938309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf581a3-d07f-4495-aea3-782abddb89ef admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:21.938594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf581a3-d07f-4495-aea3-782abddb89ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:21.938926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf581a3-d07f-4495-aea3-782abddb89ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:21.940636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf581a3-d07f-4495-aea3-782abddb89ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:21.942388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf581a3-d07f-4495-aea3-782abddb89ef admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:21.985239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c9854-8172-4e63-aa8c-eadda6b12657 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:21.986949 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1215/2425] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:22.025594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c9854-8172-4e63-aa8c-eadda6b12657 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:22.033441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9830775-6f52-4f3d-9fdd-1691b964fe80 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:22.033942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9830775-6f52-4f3d-9fdd-1691b964fe80 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:22.034441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9830775-6f52-4f3d-9fdd-1691b964fe80 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:22.036680 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1216/2426] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:02:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 21:02:22.040944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aef1db-d336-4b07-b31e-4ab0cdb29f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:22.042625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aef1db-d336-4b07-b31e-4ab0cdb29f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:22.043637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aef1db-d336-4b07-b31e-4ab0cdb29f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:22.044834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aef1db-d336-4b07-b31e-4ab0cdb29f23 admin admin] PATH_INFO: `/v3/projects/da06340e93044f73ad4f789f9da91045/users/705b910f230c498fa7b95300b9ee1a59/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:22.056377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433166c-eab8-4a3c-88bc-cb1298509e63 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:22.056862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433166c-eab8-4a3c-88bc-cb1298509e63 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:22.057292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433166c-eab8-4a3c-88bc-cb1298509e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:22.105199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8433166c-eab8-4a3c-88bc-cb1298509e63 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:22.106875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aef1db-d336-4b07-b31e-4ab0cdb29f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da06340e93044f73ad4f789f9da91045, user_id=705b910f230c498fa7b95300b9ee1a59, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:22.107448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8433166c-eab8-4a3c-88bc-cb1298509e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:22.117357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aef1db-d336-4b07-b31e-4ab0cdb29f23 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:22.159734 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1211/2427] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:21 2022] PUT /identity/v3/projects/da06340e93044f73ad4f789f9da91045/users/705b910f230c498fa7b95300b9ee1a59/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:22.164269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aef1db-d336-4b07-b31e-4ab0cdb29f23 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:22.274195 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1217/2428] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:02:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:22.309247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aef1db-d336-4b07-b31e-4ab0cdb29f23 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:22.321568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433166c-eab8-4a3c-88bc-cb1298509e63 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:22.322695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598adb8-ba2a-4e67-8069-299b18c2b3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:22.323394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598adb8-ba2a-4e67-8069-299b18c2b3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:22.323750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598adb8-ba2a-4e67-8069-299b18c2b3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:22.323956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598adb8-ba2a-4e67-8069-299b18c2b3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:22.324667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598adb8-ba2a-4e67-8069-299b18c2b3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:22.326010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8433166c-eab8-4a3c-88bc-cb1298509e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:22.326446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598adb8-ba2a-4e67-8069-299b18c2b3c4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:22.337711 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1212/2429] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:22.342256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598adb8-ba2a-4e67-8069-299b18c2b3c4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:22.353760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598adb8-ba2a-4e67-8069-299b18c2b3c4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:22.360025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e4554-9a2d-485d-b2ad-38179267f26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:22.360715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e4554-9a2d-485d-b2ad-38179267f26c admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:22.370931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e4554-9a2d-485d-b2ad-38179267f26c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:22.370931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e4554-9a2d-485d-b2ad-38179267f26c admin admin] PATH_INFO: `/v3/projects/da06340e93044f73ad4f789f9da91045/users/705b910f230c498fa7b95300b9ee1a59/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:22.371238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433166c-eab8-4a3c-88bc-cb1298509e63 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:22.373079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e4554-9a2d-485d-b2ad-38179267f26c admin admin] RBAC: Authorizing `identity:create_grant(project_id=da06340e93044f73ad4f789f9da91045, user_id=705b910f230c498fa7b95300b9ee1a59, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:22.401067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e4554-9a2d-485d-b2ad-38179267f26c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:22.434264 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1213/2430] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:22 2022] PUT /identity/v3/projects/da06340e93044f73ad4f789f9da91045/users/705b910f230c498fa7b95300b9ee1a59/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:22.444032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edfce8-e19b-4f32-9593-9d8acd4108ac None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:22.451328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edfce8-e19b-4f32-9593-9d8acd4108ac None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:22.451716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edfce8-e19b-4f32-9593-9d8acd4108ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:22.466975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:22.505254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-98edfce8-e19b-4f32-9593-9d8acd4108ac None None] MFA Rules not processed for user `705b910f230c498fa7b95300b9ee1a59`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:22.506672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-98edfce8-e19b-4f32-9593-9d8acd4108ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:22.525309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:22.541579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051f63d-19f5-4bc1-8be6-5734d42144a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:22.542163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051f63d-19f5-4bc1-8be6-5734d42144a4 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:22.542451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051f63d-19f5-4bc1-8be6-5734d42144a4 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:22.542730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051f63d-19f5-4bc1-8be6-5734d42144a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:22.560023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051f63d-19f5-4bc1-8be6-5734d42144a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:22.562146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051f63d-19f5-4bc1-8be6-5734d42144a4 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:22.578042 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1218/2431] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:22.589341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051f63d-19f5-4bc1-8be6-5734d42144a4 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:22.650554 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1214/2432] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:22.652249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edfce8-e19b-4f32-9593-9d8acd4108ac None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:22.669440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edfce8-e19b-4f32-9593-9d8acd4108ac None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:22.677177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99924e-924e-4005-b865-3ff88c86b367 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705b910f230c498fa7b95300b9ee1a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da06340e93044f73ad4f789f9da91045', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:22.678464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99924e-924e-4005-b865-3ff88c86b367 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:22.678856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99924e-924e-4005-b865-3ff88c86b367 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:22.680432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99924e-924e-4005-b865-3ff88c86b367 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:22.681980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99924e-924e-4005-b865-3ff88c86b367 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:22.683017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99924e-924e-4005-b865-3ff88c86b367 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:22.685444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99924e-924e-4005-b865-3ff88c86b367 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:22.739955 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1215/2433] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:22.741461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99924e-924e-4005-b865-3ff88c86b367 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:22.749786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051f63d-19f5-4bc1-8be6-5734d42144a4 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:22.765894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99924e-924e-4005-b865-3ff88c86b367 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:22.781892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f219c-8cd8-48a7-b45b-d76b64a40ca0 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705b910f230c498fa7b95300b9ee1a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da06340e93044f73ad4f789f9da91045', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:22.782704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f219c-8cd8-48a7-b45b-d76b64a40ca0 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:22.785288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f219c-8cd8-48a7-b45b-d76b64a40ca0 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:22.785288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f219c-8cd8-48a7-b45b-d76b64a40ca0 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:22.788388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f219c-8cd8-48a7-b45b-d76b64a40ca0 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:22.792506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f219c-8cd8-48a7-b45b-d76b64a40ca0 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:22.850833 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1216/2434] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:22 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:22.851776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f219c-8cd8-48a7-b45b-d76b64a40ca0 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:22.885680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947148e-62df-4605-a446-b8af82fd5c65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:22.888033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947148e-62df-4605-a446-b8af82fd5c65 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:22.888310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947148e-62df-4605-a446-b8af82fd5c65 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:22.889101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947148e-62df-4605-a446-b8af82fd5c65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:22.893642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6947148e-62df-4605-a446-b8af82fd5c65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:22.949819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f219c-8cd8-48a7-b45b-d76b64a40ca0 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:22.956837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef034cd-a40d-4dca-a6a5-69877f311479 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705b910f230c498fa7b95300b9ee1a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da06340e93044f73ad4f789f9da91045', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:22.957489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef034cd-a40d-4dca-a6a5-69877f311479 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:22.958058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef034cd-a40d-4dca-a6a5-69877f311479 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:22.958453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef034cd-a40d-4dca-a6a5-69877f311479 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:22.959366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef034cd-a40d-4dca-a6a5-69877f311479 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:22.959691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef034cd-a40d-4dca-a6a5-69877f311479 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:22.962145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef034cd-a40d-4dca-a6a5-69877f311479 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:22.980813 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1217/2435] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:22.993079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:23.023704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947148e-62df-4605-a446-b8af82fd5c65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:23.025481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947148e-62df-4605-a446-b8af82fd5c65 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:23.037750 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1219/2436] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:23.565886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e67ad-a616-4cfa-96d4-9700abb2f0f1 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:23.566869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e67ad-a616-4cfa-96d4-9700abb2f0f1 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:23.567274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e67ad-a616-4cfa-96d4-9700abb2f0f1 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:23.568766 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1218/2437] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:02:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:02:23.577460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df7c2e-33ce-4e79-a486-4c1663a4d214 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:23.578093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df7c2e-33ce-4e79-a486-4c1663a4d214 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:23.578589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df7c2e-33ce-4e79-a486-4c1663a4d214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:23.619182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a4df7c2e-33ce-4e79-a486-4c1663a4d214 None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:23.621493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a4df7c2e-33ce-4e79-a486-4c1663a4d214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:23.760146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e67ad-a616-4cfa-96d4-9700abb2f0f1 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:23.761976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-269e67ad-a616-4cfa-96d4-9700abb2f0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:23.765729 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1220/2438] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:02:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:02:23.840666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e67ad-a616-4cfa-96d4-9700abb2f0f1 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:23.853115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd91da5-715a-4e6d-9176-4273627a8b84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:23.855600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd91da5-715a-4e6d-9176-4273627a8b84 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:23.855910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd91da5-715a-4e6d-9176-4273627a8b84 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:23.856261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd91da5-715a-4e6d-9176-4273627a8b84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:23.873535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd91da5-715a-4e6d-9176-4273627a8b84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:23.875184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd91da5-715a-4e6d-9176-4273627a8b84 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:23.903575 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1219/2439] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:02:23.912472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dad39d-0149-4ddd-a0a5-e3054537fc25 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:23.913166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dad39d-0149-4ddd-a0a5-e3054537fc25 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:23.913776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dad39d-0149-4ddd-a0a5-e3054537fc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:23.939611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b9dad39d-0149-4ddd-a0a5-e3054537fc25 None None] MFA Rules not processed for user `4a886ccf9590432caf209526410a7b53`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:23.941811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b9dad39d-0149-4ddd-a0a5-e3054537fc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:23.964150 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1221/2440] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:02:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:23.965641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd91da5-715a-4e6d-9176-4273627a8b84 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:23.978530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd91da5-715a-4e6d-9176-4273627a8b84 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:23.985243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38b45a-9cff-4d75-b8c4-c3193faa5abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:23.989549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38b45a-9cff-4d75-b8c4-c3193faa5abe service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:23.990094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38b45a-9cff-4d75-b8c4-c3193faa5abe service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:23.990865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38b45a-9cff-4d75-b8c4-c3193faa5abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:24.009879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38b45a-9cff-4d75-b8c4-c3193faa5abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:24.009879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38b45a-9cff-4d75-b8c4-c3193faa5abe service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:24.019270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:24.042020 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1220/2441] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:24.201916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dad39d-0149-4ddd-a0a5-e3054537fc25 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:24.390875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dad39d-0149-4ddd-a0a5-e3054537fc25 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:24.402726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811cfa8-a08e-40c7-ae6e-6f09927c3087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:24.403660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811cfa8-a08e-40c7-ae6e-6f09927c3087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:24.404485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811cfa8-a08e-40c7-ae6e-6f09927c3087 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:24.404485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811cfa8-a08e-40c7-ae6e-6f09927c3087 admin admin] PATH_INFO: `/v3/users/4d04d9b8be4140e89c7d786b8cfbeeb2` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:24.405910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811cfa8-a08e-40c7-ae6e-6f09927c3087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d04d9b8be4140e89c7d786b8cfbeeb2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:24.408373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811cfa8-a08e-40c7-ae6e-6f09927c3087 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:24.524517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1811cfa8-a08e-40c7-ae6e-6f09927c3087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d04d9b8be4140e89c7d786b8cfbeeb2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:24.525424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1811cfa8-a08e-40c7-ae6e-6f09927c3087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d04d9b8be4140e89c7d786b8cfbeeb2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:24.550444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1811cfa8-a08e-40c7-ae6e-6f09927c3087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d04d9b8be4140e89c7d786b8cfbeeb2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:24.551660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1811cfa8-a08e-40c7-ae6e-6f09927c3087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d04d9b8be4140e89c7d786b8cfbeeb2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:24.566025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1811cfa8-a08e-40c7-ae6e-6f09927c3087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d04d9b8be4140e89c7d786b8cfbeeb2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:24.576531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:24.589289 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1222/2442] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:24 2022] DELETE /identity/v3/users/4d04d9b8be4140e89c7d786b8cfbeeb2 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:02:24.593830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d9841-5b65-4ce2-9b13-3cd2742a149d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:24.594660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d9841-5b65-4ce2-9b13-3cd2742a149d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:24.595074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d9841-5b65-4ce2-9b13-3cd2742a149d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:24.638799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-012d9841-5b65-4ce2-9b13-3cd2742a149d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:24.642866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-012d9841-5b65-4ce2-9b13-3cd2742a149d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:24.678159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811cfa8-a08e-40c7-ae6e-6f09927c3087 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:24.679646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1811cfa8-a08e-40c7-ae6e-6f09927c3087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:24.835489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811cfa8-a08e-40c7-ae6e-6f09927c3087 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:24.844608 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1221/2443] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:24.846791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d9841-5b65-4ce2-9b13-3cd2742a149d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:24.849836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-012d9841-5b65-4ce2-9b13-3cd2742a149d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:24.858923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9186f4-de9a-4eae-8103-a724152ff98e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:24.859611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9186f4-de9a-4eae-8103-a724152ff98e service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:24.859902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9186f4-de9a-4eae-8103-a724152ff98e service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:24.863036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9186f4-de9a-4eae-8103-a724152ff98e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:24.880208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-db9186f4-de9a-4eae-8103-a724152ff98e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:24.980877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d9841-5b65-4ce2-9b13-3cd2742a149d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:24.988988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa6189-8de5-4f21-af8a-e9673cedbb9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:24.989771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa6189-8de5-4f21-af8a-e9673cedbb9b service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:24.989911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa6189-8de5-4f21-af8a-e9673cedbb9b service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:24.990172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa6189-8de5-4f21-af8a-e9673cedbb9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:25.029702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa6189-8de5-4f21-af8a-e9673cedbb9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:25.031188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa6189-8de5-4f21-af8a-e9673cedbb9b service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:25.044167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9186f4-de9a-4eae-8103-a724152ff98e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:25.046182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9186f4-de9a-4eae-8103-a724152ff98e service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:25.062605 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1222/2444] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:25.063580 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1223/2445] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:25.095078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c12fb0-18c7-43c3-920e-8b1bef82c7b8 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:25.095917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c12fb0-18c7-43c3-920e-8b1bef82c7b8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:25.096252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c12fb0-18c7-43c3-920e-8b1bef82c7b8 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:25.097540 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1223/2446] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:02:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:02:25.104268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9186f4-de9a-4eae-8103-a724152ff98e service nova] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:02:25.118500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9186f4-de9a-4eae-8103-a724152ff98e service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:25.130685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9186f4-de9a-4eae-8103-a724152ff98e service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:25.141842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c9016-8754-424f-9e76-790b9a55b1b5 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705b910f230c498fa7b95300b9ee1a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da06340e93044f73ad4f789f9da91045', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:25.142875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c9016-8754-424f-9e76-790b9a55b1b5 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:25.143357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c9016-8754-424f-9e76-790b9a55b1b5 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:25.144038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c9016-8754-424f-9e76-790b9a55b1b5 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] PATH_INFO: `/v3/projects/4d6f6bd9a1474ee1afd21a8b0af48cc0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:25.145623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c9016-8754-424f-9e76-790b9a55b1b5 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorizing `identity:get_project(project_id=4d6f6bd9a1474ee1afd21a8b0af48cc0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:25.148548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c9016-8754-424f-9e76-790b9a55b1b5 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:25.154907 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1224/2447] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:02:25 2022] GET /identity/v3/projects/4d6f6bd9a1474ee1afd21a8b0af48cc0 => generated 369 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:25.721012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c12fb0-18c7-43c3-920e-8b1bef82c7b8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:25.722985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-42c12fb0-18c7-43c3-920e-8b1bef82c7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:25.779424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c12fb0-18c7-43c3-920e-8b1bef82c7b8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:25.787983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec4ac5-e0fb-4ce6-a6c3-bfc47af82f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:25.788950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec4ac5-e0fb-4ce6-a6c3-bfc47af82f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:25.789343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec4ac5-e0fb-4ce6-a6c3-bfc47af82f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:25.789682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec4ac5-e0fb-4ce6-a6c3-bfc47af82f99 admin admin] PATH_INFO: `/v3/projects/9801478266e943c4bdb05ee7422fdba3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:25.791678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec4ac5-e0fb-4ce6-a6c3-bfc47af82f99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9801478266e943c4bdb05ee7422fdba3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:25.793920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec4ac5-e0fb-4ce6-a6c3-bfc47af82f99 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:25.920418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71e68f-e197-4bfc-9039-128251135853 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:25.921036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71e68f-e197-4bfc-9039-128251135853 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:25.921036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71e68f-e197-4bfc-9039-128251135853 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:25.922791 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1225/2448] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:02:25.924938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33ec4ac5-e0fb-4ce6-a6c3-bfc47af82f99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9801478266e943c4bdb05ee7422fdba3', 'request_id': 'req-33ec4ac5-e0fb-4ce6-a6c3-bfc47af82f99'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:25.932681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71e68f-e197-4bfc-9039-128251135853 None None] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:02:25.935703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33ec4ac5-e0fb-4ce6-a6c3-bfc47af82f99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9801478266e943c4bdb05ee7422fdba3', 'request_id': 'req-33ec4ac5-e0fb-4ce6-a6c3-bfc47af82f99'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:25.949402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33ec4ac5-e0fb-4ce6-a6c3-bfc47af82f99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9801478266e943c4bdb05ee7422fdba3', 'request_id': 'req-33ec4ac5-e0fb-4ce6-a6c3-bfc47af82f99'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:25.966748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33ec4ac5-e0fb-4ce6-a6c3-bfc47af82f99 admin admin] The token cache is being invalidate because project 9801478266e943c4bdb05ee7422fdba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:25.967060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33ec4ac5-e0fb-4ce6-a6c3-bfc47af82f99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:25.967802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33ec4ac5-e0fb-4ce6-a6c3-bfc47af82f99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:25.974132 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1224/2449] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:25 2022] DELETE /identity/v3/projects/9801478266e943c4bdb05ee7422fdba3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:25.976207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec4ac5-e0fb-4ce6-a6c3-bfc47af82f99 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:25.978561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-33ec4ac5-e0fb-4ce6-a6c3-bfc47af82f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:26.024875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:26.044617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71e68f-e197-4bfc-9039-128251135853 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:26.075503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:26.088450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec4ac5-e0fb-4ce6-a6c3-bfc47af82f99 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:26.118430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7ccad-4617-4327-aa8f-48506cd0edd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:26.119412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7ccad-4617-4327-aa8f-48506cd0edd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:26.120778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7ccad-4617-4327-aa8f-48506cd0edd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:26.121273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7ccad-4617-4327-aa8f-48506cd0edd2 admin admin] PATH_INFO: `/v3/users/2d978b8a8d2e4bb4bc3c45efd1b35833` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:26.122779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7ccad-4617-4327-aa8f-48506cd0edd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d978b8a8d2e4bb4bc3c45efd1b35833)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:26.130194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7ccad-4617-4327-aa8f-48506cd0edd2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:26.188877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71e68f-e197-4bfc-9039-128251135853 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:26.202680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835d281-3186-45bd-895a-17edca48d129 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705b910f230c498fa7b95300b9ee1a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da06340e93044f73ad4f789f9da91045', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:26.203446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835d281-3186-45bd-895a-17edca48d129 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:26.203799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835d281-3186-45bd-895a-17edca48d129 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:26.204151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835d281-3186-45bd-895a-17edca48d129 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] PATH_INFO: `/v3/projects/4d6f6bd9a1474ee1afd21a8b0af48cc0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:26.206160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835d281-3186-45bd-895a-17edca48d129 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorizing `identity:get_project(project_id=4d6f6bd9a1474ee1afd21a8b0af48cc0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:26.208439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835d281-3186-45bd-895a-17edca48d129 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:26.212621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e6e7ccad-4617-4327-aa8f-48506cd0edd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d978b8a8d2e4bb4bc3c45efd1b35833'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:26.222318 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1226/2450] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:02:25 2022] GET /identity/v3/projects/4d6f6bd9a1474ee1afd21a8b0af48cc0 => generated 369 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:02:26.239264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e6e7ccad-4617-4327-aa8f-48506cd0edd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d978b8a8d2e4bb4bc3c45efd1b35833'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:26.254145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e6e7ccad-4617-4327-aa8f-48506cd0edd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d978b8a8d2e4bb4bc3c45efd1b35833'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:26.264837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835d281-3186-45bd-895a-17edca48d129 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:26.267617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3835d281-3186-45bd-895a-17edca48d129 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:26.291926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e6e7ccad-4617-4327-aa8f-48506cd0edd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d978b8a8d2e4bb4bc3c45efd1b35833'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:26.293891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e6e7ccad-4617-4327-aa8f-48506cd0edd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d978b8a8d2e4bb4bc3c45efd1b35833'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:26.310884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835d281-3186-45bd-895a-17edca48d129 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:26.317963 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1225/2451] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:25 2022] DELETE /identity/v3/users/2d978b8a8d2e4bb4bc3c45efd1b35833 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:26.323767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe80b6-460a-430a-9874-9d6938c30257 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705b910f230c498fa7b95300b9ee1a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da06340e93044f73ad4f789f9da91045', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:26.324625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe80b6-460a-430a-9874-9d6938c30257 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:26.324733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe80b6-460a-430a-9874-9d6938c30257 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:26.324964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe80b6-460a-430a-9874-9d6938c30257 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:26.325751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe80b6-460a-430a-9874-9d6938c30257 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:26.326054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe80b6-460a-430a-9874-9d6938c30257 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:26.327731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe80b6-460a-430a-9874-9d6938c30257 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:26.353558 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1227/2452] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:26.357732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7ccad-4617-4327-aa8f-48506cd0edd2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:26.359119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e6e7ccad-4617-4327-aa8f-48506cd0edd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:26.440150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30111846-5385-4f78-a54c-0dbb97480f68 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:26.440957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30111846-5385-4f78-a54c-0dbb97480f68 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:26.441358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30111846-5385-4f78-a54c-0dbb97480f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:26.495781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-30111846-5385-4f78-a54c-0dbb97480f68 None None] MFA Rules not processed for user `794f1a4f424d4b71a23649a4d178df28`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:26.497097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-30111846-5385-4f78-a54c-0dbb97480f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:26.509217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7ccad-4617-4327-aa8f-48506cd0edd2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:26.515808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a3a73-2356-4cb2-8144-bc7d76f3cd10 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705b910f230c498fa7b95300b9ee1a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da06340e93044f73ad4f789f9da91045', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:26.516603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3a73-2356-4cb2-8144-bc7d76f3cd10 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:26.516898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3a73-2356-4cb2-8144-bc7d76f3cd10 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:26.517857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3a73-2356-4cb2-8144-bc7d76f3cd10 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:26.518567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a3a73-2356-4cb2-8144-bc7d76f3cd10 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:26.520878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a3a73-2356-4cb2-8144-bc7d76f3cd10 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:26.560255 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1226/2453] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:26 2022] POST /identity/v3/users => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:26.581748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a3a73-2356-4cb2-8144-bc7d76f3cd10 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:26.603822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a3a73-2356-4cb2-8144-bc7d76f3cd10 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:26.609371 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1228/2454] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:26.622995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df54de-2c6c-48af-99b8-62bcf1b82282 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705b910f230c498fa7b95300b9ee1a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da06340e93044f73ad4f789f9da91045', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:26.626964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df54de-2c6c-48af-99b8-62bcf1b82282 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:26.627902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df54de-2c6c-48af-99b8-62bcf1b82282 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:26.628196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df54de-2c6c-48af-99b8-62bcf1b82282 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:26.629579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df54de-2c6c-48af-99b8-62bcf1b82282 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:26.634098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df54de-2c6c-48af-99b8-62bcf1b82282 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:26.636032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df54de-2c6c-48af-99b8-62bcf1b82282 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:26.669590 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1227/2455] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:26.991591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30111846-5385-4f78-a54c-0dbb97480f68 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:27.000267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-30111846-5385-4f78-a54c-0dbb97480f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:27.123006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30111846-5385-4f78-a54c-0dbb97480f68 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:27.131462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db755d-baa1-41bb-8fa9-365c9f0cb894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:27.132306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db755d-baa1-41bb-8fa9-365c9f0cb894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:27.132426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db755d-baa1-41bb-8fa9-365c9f0cb894 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:27.132657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db755d-baa1-41bb-8fa9-365c9f0cb894 admin admin] PATH_INFO: `/v3/projects/8eacf79fe25d43bdac73630d2313deb6` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:27.133841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db755d-baa1-41bb-8fa9-365c9f0cb894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eacf79fe25d43bdac73630d2313deb6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:27.135820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db755d-baa1-41bb-8fa9-365c9f0cb894 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:27.214301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e7db755d-baa1-41bb-8fa9-365c9f0cb894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eacf79fe25d43bdac73630d2313deb6', 'request_id': 'req-e7db755d-baa1-41bb-8fa9-365c9f0cb894'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:27.221299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:27.227230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e7db755d-baa1-41bb-8fa9-365c9f0cb894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eacf79fe25d43bdac73630d2313deb6', 'request_id': 'req-e7db755d-baa1-41bb-8fa9-365c9f0cb894'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:27.239940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e7db755d-baa1-41bb-8fa9-365c9f0cb894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eacf79fe25d43bdac73630d2313deb6', 'request_id': 'req-e7db755d-baa1-41bb-8fa9-365c9f0cb894'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:27.277149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e7db755d-baa1-41bb-8fa9-365c9f0cb894 admin admin] The token cache is being invalidate because project 8eacf79fe25d43bdac73630d2313deb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:27.277611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e7db755d-baa1-41bb-8fa9-365c9f0cb894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:27.280153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e7db755d-baa1-41bb-8fa9-365c9f0cb894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:27.283857 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1229/2456] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:26 2022] DELETE /identity/v3/projects/8eacf79fe25d43bdac73630d2313deb6 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:27.289100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3c669-2b78-4da2-a6c7-c85ebca420c6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:27.289569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3c669-2b78-4da2-a6c7-c85ebca420c6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:27.289696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3c669-2b78-4da2-a6c7-c85ebca420c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:27.317257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b0d3c669-2b78-4da2-a6c7-c85ebca420c6 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:27.324240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b0d3c669-2b78-4da2-a6c7-c85ebca420c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:27.346805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:27.432737 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1228/2457] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:27.441456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f7849-3645-4a8d-ba0f-a515a82d34d4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:27.441745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f7849-3645-4a8d-ba0f-a515a82d34d4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:27.442023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f7849-3645-4a8d-ba0f-a515a82d34d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:27.505852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63863e-8131-4eb4-be38-ed424f8d7e28 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:27.506407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63863e-8131-4eb4-be38-ed424f8d7e28 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:27.506867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63863e-8131-4eb4-be38-ed424f8d7e28 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:27.510160 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1229/2458] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:02:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:02:27.517378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-707f7849-3645-4a8d-ba0f-a515a82d34d4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:27.518633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-707f7849-3645-4a8d-ba0f-a515a82d34d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:27.548170 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1230/2459] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:27.556409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63863e-8131-4eb4-be38-ed424f8d7e28 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:27.559416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f7849-3645-4a8d-ba0f-a515a82d34d4 None None] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:02:27.563975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-707f7849-3645-4a8d-ba0f-a515a82d34d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:27.596064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63863e-8131-4eb4-be38-ed424f8d7e28 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:27.613517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d75c7c-3e4a-46b8-b7b5-15d675f5f9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:27.617094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d75c7c-3e4a-46b8-b7b5-15d675f5f9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:27.617388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d75c7c-3e4a-46b8-b7b5-15d675f5f9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:27.617675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d75c7c-3e4a-46b8-b7b5-15d675f5f9d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:27.620066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d75c7c-3e4a-46b8-b7b5-15d675f5f9d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:27.626784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d75c7c-3e4a-46b8-b7b5-15d675f5f9d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:27.628489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d75c7c-3e4a-46b8-b7b5-15d675f5f9d1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:27.670742 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1230/2460] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:27.672878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d75c7c-3e4a-46b8-b7b5-15d675f5f9d1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:27.714836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d75c7c-3e4a-46b8-b7b5-15d675f5f9d1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:27.733093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99b4b6-58c3-46c4-9ab6-703a3fdaef91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:27.733758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99b4b6-58c3-46c4-9ab6-703a3fdaef91 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:27.734047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99b4b6-58c3-46c4-9ab6-703a3fdaef91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:27.734329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99b4b6-58c3-46c4-9ab6-703a3fdaef91 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:27.735321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99b4b6-58c3-46c4-9ab6-703a3fdaef91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:27.741282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99b4b6-58c3-46c4-9ab6-703a3fdaef91 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:27.745308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f7849-3645-4a8d-ba0f-a515a82d34d4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:27.749514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-707f7849-3645-4a8d-ba0f-a515a82d34d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:27.809809 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1231/2461] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:27 2022] POST /identity/v3/projects => generated 399 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:27.814528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99b4b6-58c3-46c4-9ab6-703a3fdaef91 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:27.938338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f7849-3645-4a8d-ba0f-a515a82d34d4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:27.946527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99b4b6-58c3-46c4-9ab6-703a3fdaef91 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:27.960551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5d52c-899c-4ffb-acda-68b861310703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:27.961200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5d52c-899c-4ffb-acda-68b861310703 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:27.961485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5d52c-899c-4ffb-acda-68b861310703 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:27.961764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5d52c-899c-4ffb-acda-68b861310703 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:27.962441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5d52c-899c-4ffb-acda-68b861310703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:27.966927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5d52c-899c-4ffb-acda-68b861310703 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:28.025932 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1232/2462] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:27 2022] POST /identity/v3/users => generated 300 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:28.029950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5d52c-899c-4ffb-acda-68b861310703 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:28.041522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5d52c-899c-4ffb-acda-68b861310703 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:28.047271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc0c6f-90e8-469f-be06-036b2897ae5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:28.049095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc0c6f-90e8-469f-be06-036b2897ae5f admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:28.049095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc0c6f-90e8-469f-be06-036b2897ae5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:28.049598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc0c6f-90e8-469f-be06-036b2897ae5f admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:28.050443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc0c6f-90e8-469f-be06-036b2897ae5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:28.052656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc0c6f-90e8-469f-be06-036b2897ae5f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:28.055030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea26dd-3f8a-4de5-94b0-55e81dab9955 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705b910f230c498fa7b95300b9ee1a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da06340e93044f73ad4f789f9da91045', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:28.056072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea26dd-3f8a-4de5-94b0-55e81dab9955 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:28.056249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea26dd-3f8a-4de5-94b0-55e81dab9955 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:28.056543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea26dd-3f8a-4de5-94b0-55e81dab9955 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] PATH_INFO: `/v3/projects/4d6f6bd9a1474ee1afd21a8b0af48cc0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:28.058484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea26dd-3f8a-4de5-94b0-55e81dab9955 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorizing `identity:get_project(project_id=4d6f6bd9a1474ee1afd21a8b0af48cc0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:28.061690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea26dd-3f8a-4de5-94b0-55e81dab9955 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:28.067852 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1233/2463] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:28.075641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc0c6f-90e8-469f-be06-036b2897ae5f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:28.080403 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1231/2464] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:02:27 2022] GET /identity/v3/projects/4d6f6bd9a1474ee1afd21a8b0af48cc0 => generated 369 bytes in 520 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:28.089082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc0c6f-90e8-469f-be06-036b2897ae5f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:28.094680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefef0ba-1fa2-4747-b7cb-6cec9a76d584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:28.096049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefef0ba-1fa2-4747-b7cb-6cec9a76d584 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:28.096429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefef0ba-1fa2-4747-b7cb-6cec9a76d584 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:28.097136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefef0ba-1fa2-4747-b7cb-6cec9a76d584 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:28.097941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefef0ba-1fa2-4747-b7cb-6cec9a76d584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:28.099777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefef0ba-1fa2-4747-b7cb-6cec9a76d584 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:28.118100 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1234/2465] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:28.122599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea26dd-3f8a-4de5-94b0-55e81dab9955 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:28.138897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea26dd-3f8a-4de5-94b0-55e81dab9955 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:28.154897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed84b9-8194-4578-b9ff-afe80987de3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:28.155396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed84b9-8194-4578-b9ff-afe80987de3f admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:28.155800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed84b9-8194-4578-b9ff-afe80987de3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:28.156318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed84b9-8194-4578-b9ff-afe80987de3f admin admin] PATH_INFO: `/v3/projects/8deb5dbf70f6412cbf8ac59ead5a9458/users/fd423d778b194bfcb727a5209690445c/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:28.198147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd368b1c-1563-42c4-937e-948e86656ed5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:28.198262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd368b1c-1563-42c4-937e-948e86656ed5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:28.198516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd368b1c-1563-42c4-937e-948e86656ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:28.200911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed84b9-8194-4578-b9ff-afe80987de3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8deb5dbf70f6412cbf8ac59ead5a9458, user_id=fd423d778b194bfcb727a5209690445c, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:28.203832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed84b9-8194-4578-b9ff-afe80987de3f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:28.206706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:28.231126 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1232/2466] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:28 2022] PUT /identity/v3/projects/8deb5dbf70f6412cbf8ac59ead5a9458/users/fd423d778b194bfcb727a5209690445c/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:28.242954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444f6c-5817-41ab-ad35-add88bf053d4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:28.243425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444f6c-5817-41ab-ad35-add88bf053d4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:28.243819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444f6c-5817-41ab-ad35-add88bf053d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:28.277452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bd368b1c-1563-42c4-937e-948e86656ed5 None None] MFA Rules not processed for user `e486b81cb41f4535bbe9e89ebffdaa04`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:28.283966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bd368b1c-1563-42c4-937e-948e86656ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:28.292316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-22444f6c-5817-41ab-ad35-add88bf053d4 None None] MFA Rules not processed for user `fd423d778b194bfcb727a5209690445c`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:28.294287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-22444f6c-5817-41ab-ad35-add88bf053d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:28.407080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:28.472400 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1235/2467] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:28.480186 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1233/2468] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:28.485337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd368b1c-1563-42c4-937e-948e86656ed5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:28.631526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd368b1c-1563-42c4-937e-948e86656ed5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:28.637589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb5ffd-1848-4d37-966b-7981e58b814e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:28.638899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb5ffd-1848-4d37-966b-7981e58b814e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:28.640034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb5ffd-1848-4d37-966b-7981e58b814e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:28.640401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb5ffd-1848-4d37-966b-7981e58b814e admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:28.641282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb5ffd-1848-4d37-966b-7981e58b814e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:28.654593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb5ffd-1848-4d37-966b-7981e58b814e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:28.744299 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1236/2469] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:28 2022] POST /identity/v3/projects => generated 397 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:28.747955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22444f6c-5817-41ab-ad35-add88bf053d4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:28.769956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22444f6c-5817-41ab-ad35-add88bf053d4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:28.887955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921380f-d679-4794-9a39-bdb3010f2962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:28.889101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921380f-d679-4794-9a39-bdb3010f2962 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:28.890061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921380f-d679-4794-9a39-bdb3010f2962 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:28.890564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921380f-d679-4794-9a39-bdb3010f2962 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:28.891853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921380f-d679-4794-9a39-bdb3010f2962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:28.902299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921380f-d679-4794-9a39-bdb3010f2962 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:28.943475 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1234/2470] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:28 2022] POST /identity/v3/users => generated 305 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:28.947781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb5ffd-1848-4d37-966b-7981e58b814e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:28.967540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb5ffd-1848-4d37-966b-7981e58b814e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:28.986603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00144c6a-5d85-4c86-a8e2-d2b6bf8dcdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:28.987690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00144c6a-5d85-4c86-a8e2-d2b6bf8dcdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:28.988128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00144c6a-5d85-4c86-a8e2-d2b6bf8dcdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:28.988461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00144c6a-5d85-4c86-a8e2-d2b6bf8dcdd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:28.989312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00144c6a-5d85-4c86-a8e2-d2b6bf8dcdd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:28.991331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00144c6a-5d85-4c86-a8e2-d2b6bf8dcdd9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:29.011902 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1237/2471] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:29.016644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921380f-d679-4794-9a39-bdb3010f2962 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:29.030649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921380f-d679-4794-9a39-bdb3010f2962 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:29.041712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b8ea4-cc39-4df4-abe7-7b85703b03fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:29.042399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b8ea4-cc39-4df4-abe7-7b85703b03fa admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:29.042675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b8ea4-cc39-4df4-abe7-7b85703b03fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:29.042962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b8ea4-cc39-4df4-abe7-7b85703b03fa admin admin] PATH_INFO: `/v3/projects/d18572c631c540dd8fda667bde89bf25/users/60517c0cc1c647dd993e3c3cb945ac1a/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:29.065246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b8ea4-cc39-4df4-abe7-7b85703b03fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18572c631c540dd8fda667bde89bf25, user_id=60517c0cc1c647dd993e3c3cb945ac1a, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:29.069700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b8ea4-cc39-4df4-abe7-7b85703b03fa admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:29.090938 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1235/2472] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:29 2022] PUT /identity/v3/projects/d18572c631c540dd8fda667bde89bf25/users/60517c0cc1c647dd993e3c3cb945ac1a/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:29.094647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00144c6a-5d85-4c86-a8e2-d2b6bf8dcdd9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:29.136252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00144c6a-5d85-4c86-a8e2-d2b6bf8dcdd9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:29.202505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abb7ec-65ba-436c-9c25-3ecd359a441a None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:29.202980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abb7ec-65ba-436c-9c25-3ecd359a441a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:29.203651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abb7ec-65ba-436c-9c25-3ecd359a441a None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:29.206922 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1236/2473] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:02:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:02:29.226856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abb7ec-65ba-436c-9c25-3ecd359a441a None None] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:02:29.229384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-20abb7ec-65ba-436c-9c25-3ecd359a441a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:29.267949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354169f-de2a-4da6-b6a4-0f51897ebe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:29.269089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354169f-de2a-4da6-b6a4-0f51897ebe64 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:29.269921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354169f-de2a-4da6-b6a4-0f51897ebe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:29.271079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354169f-de2a-4da6-b6a4-0f51897ebe64 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:29.272567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354169f-de2a-4da6-b6a4-0f51897ebe64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:29.275542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354169f-de2a-4da6-b6a4-0f51897ebe64 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:29.295332 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1238/2474] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:02:29.300212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354169f-de2a-4da6-b6a4-0f51897ebe64 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:29.347087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:29.393150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:29.404191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abb7ec-65ba-436c-9c25-3ecd359a441a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:29.427535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354169f-de2a-4da6-b6a4-0f51897ebe64 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:29.435142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d2530-105c-4d8f-9eb9-1f65aea1e2cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:29.435924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d2530-105c-4d8f-9eb9-1f65aea1e2cd service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:29.436328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d2530-105c-4d8f-9eb9-1f65aea1e2cd service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:29.436678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d2530-105c-4d8f-9eb9-1f65aea1e2cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:29.439709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9a5d2530-105c-4d8f-9eb9-1f65aea1e2cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:29.529208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abb7ec-65ba-436c-9c25-3ecd359a441a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:29.535263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d60310-3f23-45e9-a0fc-c84af558f426 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705b910f230c498fa7b95300b9ee1a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da06340e93044f73ad4f789f9da91045', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:29.536165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d60310-3f23-45e9-a0fc-c84af558f426 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:29.536452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d60310-3f23-45e9-a0fc-c84af558f426 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:29.536735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d60310-3f23-45e9-a0fc-c84af558f426 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] PATH_INFO: `/v3/projects/4d6f6bd9a1474ee1afd21a8b0af48cc0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:29.538738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d60310-3f23-45e9-a0fc-c84af558f426 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorizing `identity:get_project(project_id=4d6f6bd9a1474ee1afd21a8b0af48cc0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:29.541740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d60310-3f23-45e9-a0fc-c84af558f426 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:29.544057 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1237/2475] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:02:29 2022] GET /identity/v3/projects/4d6f6bd9a1474ee1afd21a8b0af48cc0 => generated 369 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:29.545837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d60310-3f23-45e9-a0fc-c84af558f426 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:29.558190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d60310-3f23-45e9-a0fc-c84af558f426 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:29.564416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b36728-c70f-4844-8a7c-862c47cc2f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:29.565337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b36728-c70f-4844-8a7c-862c47cc2f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:29.565960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b36728-c70f-4844-8a7c-862c47cc2f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:29.566232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b36728-c70f-4844-8a7c-862c47cc2f55 admin admin] PATH_INFO: `/v3/projects/d18572c631c540dd8fda667bde89bf25/users/60517c0cc1c647dd993e3c3cb945ac1a/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:29.567212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d2530-105c-4d8f-9eb9-1f65aea1e2cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:29.568600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b36728-c70f-4844-8a7c-862c47cc2f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18572c631c540dd8fda667bde89bf25, user_id=60517c0cc1c647dd993e3c3cb945ac1a, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:29.569640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d2530-105c-4d8f-9eb9-1f65aea1e2cd service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:29.571699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b36728-c70f-4844-8a7c-862c47cc2f55 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:29.587454 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1238/2476] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:29 2022] PUT /identity/v3/projects/d18572c631c540dd8fda667bde89bf25/users/60517c0cc1c647dd993e3c3cb945ac1a/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:29.608157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b36728-c70f-4844-8a7c-862c47cc2f55 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:29.629505 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1239/2477] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:29.668211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c22f5-183c-46cf-9662-dec532fae898 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:29.668495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c22f5-183c-46cf-9662-dec532fae898 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:29.669047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c22f5-183c-46cf-9662-dec532fae898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:29.718230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-aa6c22f5-183c-46cf-9662-dec532fae898 None None] MFA Rules not processed for user `60517c0cc1c647dd993e3c3cb945ac1a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:29.719280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-aa6c22f5-183c-46cf-9662-dec532fae898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:29.774476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b36728-c70f-4844-8a7c-862c47cc2f55 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:29.785463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534db617-10c1-46fa-b227-efd30657e4af tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705b910f230c498fa7b95300b9ee1a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da06340e93044f73ad4f789f9da91045', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:29.786714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534db617-10c1-46fa-b227-efd30657e4af tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:29.787556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534db617-10c1-46fa-b227-efd30657e4af tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:29.787862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534db617-10c1-46fa-b227-efd30657e4af tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] PATH_INFO: `/v3/users/06191d3198294fe69ddc234ad730578b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:29.828496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534db617-10c1-46fa-b227-efd30657e4af tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorizing `identity:delete_user(user_id=06191d3198294fe69ddc234ad730578b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:29.834058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534db617-10c1-46fa-b227-efd30657e4af tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:29.879900 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1240/2478] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:02:29.938497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-534db617-10c1-46fa-b227-efd30657e4af tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06191d3198294fe69ddc234ad730578b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:29.940250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-534db617-10c1-46fa-b227-efd30657e4af tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06191d3198294fe69ddc234ad730578b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:29.956580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:29.958837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-534db617-10c1-46fa-b227-efd30657e4af tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06191d3198294fe69ddc234ad730578b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:29.959833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-534db617-10c1-46fa-b227-efd30657e4af tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06191d3198294fe69ddc234ad730578b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:29.981422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-534db617-10c1-46fa-b227-efd30657e4af tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06191d3198294fe69ddc234ad730578b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:30.020685 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1239/2479] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:29 2022] DELETE /identity/v3/users/06191d3198294fe69ddc234ad730578b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:02:30.025339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c22f5-183c-46cf-9662-dec532fae898 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:30.035030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534db617-10c1-46fa-b227-efd30657e4af tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:30.039821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c22f5-183c-46cf-9662-dec532fae898 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:30.040539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-534db617-10c1-46fa-b227-efd30657e4af tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:30.128661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120efe8c-9331-495f-93f3-a4083b6023fd tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705b910f230c498fa7b95300b9ee1a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da06340e93044f73ad4f789f9da91045', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:30.129588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120efe8c-9331-495f-93f3-a4083b6023fd tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:30.130004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120efe8c-9331-495f-93f3-a4083b6023fd tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:30.130336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120efe8c-9331-495f-93f3-a4083b6023fd tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] PATH_INFO: `/v3/projects/4d6f6bd9a1474ee1afd21a8b0af48cc0` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:30.132031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120efe8c-9331-495f-93f3-a4083b6023fd tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4d6f6bd9a1474ee1afd21a8b0af48cc0)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:30.134080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120efe8c-9331-495f-93f3-a4083b6023fd tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:30.162173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534db617-10c1-46fa-b227-efd30657e4af tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:30.183796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7e605-71f1-4e22-adb2-017391a786e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:30.184905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7e605-71f1-4e22-adb2-017391a786e4 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:30.185652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7e605-71f1-4e22-adb2-017391a786e4 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:30.186078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:30.186570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7e605-71f1-4e22-adb2-017391a786e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:30.190833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-98f7e605-71f1-4e22-adb2-017391a786e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:30.285870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-120efe8c-9331-495f-93f3-a4083b6023fd tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d6f6bd9a1474ee1afd21a8b0af48cc0', 'request_id': 'req-120efe8c-9331-495f-93f3-a4083b6023fd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:30.293514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-120efe8c-9331-495f-93f3-a4083b6023fd tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d6f6bd9a1474ee1afd21a8b0af48cc0', 'request_id': 'req-120efe8c-9331-495f-93f3-a4083b6023fd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:30.305533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-120efe8c-9331-495f-93f3-a4083b6023fd tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d6f6bd9a1474ee1afd21a8b0af48cc0', 'request_id': 'req-120efe8c-9331-495f-93f3-a4083b6023fd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:30.324240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-120efe8c-9331-495f-93f3-a4083b6023fd tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] The token cache is being invalidate because project 4d6f6bd9a1474ee1afd21a8b0af48cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:30.325263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7e605-71f1-4e22-adb2-017391a786e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:30.326876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7e605-71f1-4e22-adb2-017391a786e4 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:30.327434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-120efe8c-9331-495f-93f3-a4083b6023fd tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:30.328468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-120efe8c-9331-495f-93f3-a4083b6023fd tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:30.332093 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1241/2480] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:30 2022] DELETE /identity/v3/projects/4d6f6bd9a1474ee1afd21a8b0af48cc0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:02:30.337994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120efe8c-9331-495f-93f3-a4083b6023fd tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:30.340587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-120efe8c-9331-495f-93f3-a4083b6023fd tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:30.342211 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1240/2481] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:30.450880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120efe8c-9331-495f-93f3-a4083b6023fd tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:30.457250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e41a0-d923-468e-9806-f17b0ae6aca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:30.457841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e41a0-d923-468e-9806-f17b0ae6aca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:30.458128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e41a0-d923-468e-9806-f17b0ae6aca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:30.458410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e41a0-d923-468e-9806-f17b0ae6aca7 admin admin] PATH_INFO: `/v3/users/3c003128a6c94bcc81a483123579c96b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:30.459644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e41a0-d923-468e-9806-f17b0ae6aca7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c003128a6c94bcc81a483123579c96b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:30.462095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e41a0-d923-468e-9806-f17b0ae6aca7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:30.529632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b41e41a0-d923-468e-9806-f17b0ae6aca7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c003128a6c94bcc81a483123579c96b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:30.545838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b41e41a0-d923-468e-9806-f17b0ae6aca7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c003128a6c94bcc81a483123579c96b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:30.546933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b41e41a0-d923-468e-9806-f17b0ae6aca7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c003128a6c94bcc81a483123579c96b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:30.558083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b41e41a0-d923-468e-9806-f17b0ae6aca7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c003128a6c94bcc81a483123579c96b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:30.559447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b41e41a0-d923-468e-9806-f17b0ae6aca7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c003128a6c94bcc81a483123579c96b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:30.625683 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1242/2482] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:30 2022] DELETE /identity/v3/users/3c003128a6c94bcc81a483123579c96b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:02:30.631015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbf8e2-c92c-4cc5-8d23-3647c2bbfc79 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:30.631015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbf8e2-c92c-4cc5-8d23-3647c2bbfc79 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:30.631466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbf8e2-c92c-4cc5-8d23-3647c2bbfc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:30.733927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c8fbf8e2-c92c-4cc5-8d23-3647c2bbfc79 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:30.740026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c8fbf8e2-c92c-4cc5-8d23-3647c2bbfc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:30.850783 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1241/2483] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:30.904777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e41a0-d923-468e-9806-f17b0ae6aca7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:30.906633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b41e41a0-d923-468e-9806-f17b0ae6aca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:30.944610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:31.017142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e41a0-d923-468e-9806-f17b0ae6aca7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:31.022127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940b239-cfab-414f-9241-f507cb8bb0da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:31.022714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940b239-cfab-414f-9241-f507cb8bb0da service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:31.023048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940b239-cfab-414f-9241-f507cb8bb0da service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:31.023361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940b239-cfab-414f-9241-f507cb8bb0da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:31.035071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940b239-cfab-414f-9241-f507cb8bb0da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:31.036636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940b239-cfab-414f-9241-f507cb8bb0da service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:31.049765 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1243/2484] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:31.072013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbf8e2-c92c-4cc5-8d23-3647c2bbfc79 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:31.073857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c8fbf8e2-c92c-4cc5-8d23-3647c2bbfc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:31.113137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:31.190555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbf8e2-c92c-4cc5-8d23-3647c2bbfc79 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:31.197508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd89066-5bea-415d-81ff-e78f897d839b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:31.198146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd89066-5bea-415d-81ff-e78f897d839b service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:31.198486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd89066-5bea-415d-81ff-e78f897d839b service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:31.198734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd89066-5bea-415d-81ff-e78f897d839b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:31.201695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9fd89066-5bea-415d-81ff-e78f897d839b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:31.356362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd89066-5bea-415d-81ff-e78f897d839b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:31.358505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd89066-5bea-415d-81ff-e78f897d839b service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:31.386484 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1242/2485] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:32.407822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940b239-cfab-414f-9241-f507cb8bb0da service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:32.409816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d940b239-cfab-414f-9241-f507cb8bb0da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:32.433039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940b239-cfab-414f-9241-f507cb8bb0da service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:32.438747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5c969-88ee-4883-a0a3-651cbb36bfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:32.440314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5c969-88ee-4883-a0a3-651cbb36bfdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:32.440844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5c969-88ee-4883-a0a3-651cbb36bfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:32.441338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5c969-88ee-4883-a0a3-651cbb36bfdf admin admin] PATH_INFO: `/v3/users/fd423d778b194bfcb727a5209690445c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:32.443026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5c969-88ee-4883-a0a3-651cbb36bfdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd423d778b194bfcb727a5209690445c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:32.445613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5c969-88ee-4883-a0a3-651cbb36bfdf admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:32.509863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43d5c969-88ee-4883-a0a3-651cbb36bfdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd423d778b194bfcb727a5209690445c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:32.525731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43d5c969-88ee-4883-a0a3-651cbb36bfdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd423d778b194bfcb727a5209690445c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:32.526818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43d5c969-88ee-4883-a0a3-651cbb36bfdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd423d778b194bfcb727a5209690445c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:32.536112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43d5c969-88ee-4883-a0a3-651cbb36bfdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd423d778b194bfcb727a5209690445c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:32.537120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43d5c969-88ee-4883-a0a3-651cbb36bfdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd423d778b194bfcb727a5209690445c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:32.571873 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1244/2486] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:32 2022] DELETE /identity/v3/users/fd423d778b194bfcb727a5209690445c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:32.576361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26dadd-0804-4935-a80b-7f88ab1a4cc1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:32.577636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26dadd-0804-4935-a80b-7f88ab1a4cc1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:32.578095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26dadd-0804-4935-a80b-7f88ab1a4cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:32.605042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fb26dadd-0804-4935-a80b-7f88ab1a4cc1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:32.606194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fb26dadd-0804-4935-a80b-7f88ab1a4cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:32.698864 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1243/2487] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:32.731668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5c969-88ee-4883-a0a3-651cbb36bfdf admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:32.733244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-43d5c969-88ee-4883-a0a3-651cbb36bfdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:32.843457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5c969-88ee-4883-a0a3-651cbb36bfdf admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:32.848750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3351d36-a814-4266-8894-aad10e6a131d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:32.849560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3351d36-a814-4266-8894-aad10e6a131d service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:32.850248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3351d36-a814-4266-8894-aad10e6a131d service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:32.850248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3351d36-a814-4266-8894-aad10e6a131d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:32.865528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3351d36-a814-4266-8894-aad10e6a131d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:32.867096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3351d36-a814-4266-8894-aad10e6a131d service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:32.881653 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1245/2488] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:33.073073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26dadd-0804-4935-a80b-7f88ab1a4cc1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:33.075690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fb26dadd-0804-4935-a80b-7f88ab1a4cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:33.114726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26dadd-0804-4935-a80b-7f88ab1a4cc1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:33.125983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0bd7b-70c1-499c-a166-eb19134f7bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:33.127267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0bd7b-70c1-499c-a166-eb19134f7bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:33.127730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0bd7b-70c1-499c-a166-eb19134f7bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:33.128097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0bd7b-70c1-499c-a166-eb19134f7bcb admin admin] PATH_INFO: `/v3/projects/f4d5ac688fd34360bfce58c047219682` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:33.129530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0bd7b-70c1-499c-a166-eb19134f7bcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d5ac688fd34360bfce58c047219682)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:33.132197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0bd7b-70c1-499c-a166-eb19134f7bcb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:33.202013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:33.207006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-81f0bd7b-70c1-499c-a166-eb19134f7bcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d5ac688fd34360bfce58c047219682', 'request_id': 'req-81f0bd7b-70c1-499c-a166-eb19134f7bcb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:33.217887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-81f0bd7b-70c1-499c-a166-eb19134f7bcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d5ac688fd34360bfce58c047219682', 'request_id': 'req-81f0bd7b-70c1-499c-a166-eb19134f7bcb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:33.229184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-81f0bd7b-70c1-499c-a166-eb19134f7bcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d5ac688fd34360bfce58c047219682', 'request_id': 'req-81f0bd7b-70c1-499c-a166-eb19134f7bcb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:33.249392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-81f0bd7b-70c1-499c-a166-eb19134f7bcb admin admin] The token cache is being invalidate because project f4d5ac688fd34360bfce58c047219682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:33.249704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-81f0bd7b-70c1-499c-a166-eb19134f7bcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:33.250515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-81f0bd7b-70c1-499c-a166-eb19134f7bcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:33.252722 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1244/2489] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:33 2022] DELETE /identity/v3/projects/f4d5ac688fd34360bfce58c047219682 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:33.256967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3351d36-a814-4266-8894-aad10e6a131d service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:33.275609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3351d36-a814-4266-8894-aad10e6a131d service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:33.343932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:33.393494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356204c8-ae77-4a56-a559-c28af73fe35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:33.394303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356204c8-ae77-4a56-a559-c28af73fe35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:33.394597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356204c8-ae77-4a56-a559-c28af73fe35b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:33.394882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356204c8-ae77-4a56-a559-c28af73fe35b admin admin] PATH_INFO: `/v3/users/705b910f230c498fa7b95300b9ee1a59` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:33.399102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356204c8-ae77-4a56-a559-c28af73fe35b admin admin] RBAC: Authorizing `identity:delete_user(user_id=705b910f230c498fa7b95300b9ee1a59)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:33.401836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356204c8-ae77-4a56-a559-c28af73fe35b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:33.492401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-356204c8-ae77-4a56-a559-c28af73fe35b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '705b910f230c498fa7b95300b9ee1a59'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:33.529806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-356204c8-ae77-4a56-a559-c28af73fe35b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '705b910f230c498fa7b95300b9ee1a59'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:33.531735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-356204c8-ae77-4a56-a559-c28af73fe35b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '705b910f230c498fa7b95300b9ee1a59'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:33.555323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-356204c8-ae77-4a56-a559-c28af73fe35b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '705b910f230c498fa7b95300b9ee1a59'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:33.556075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-356204c8-ae77-4a56-a559-c28af73fe35b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '705b910f230c498fa7b95300b9ee1a59'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:33.583635 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1246/2490] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:33 2022] DELETE /identity/v3/users/705b910f230c498fa7b95300b9ee1a59 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:34.169403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0bd7b-70c1-499c-a166-eb19134f7bcb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:34.170931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-81f0bd7b-70c1-499c-a166-eb19134f7bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:34.197221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0bd7b-70c1-499c-a166-eb19134f7bcb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:34.198315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356204c8-ae77-4a56-a559-c28af73fe35b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:34.201330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-356204c8-ae77-4a56-a559-c28af73fe35b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:34.345779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bffb59-0fd6-4413-bc20-90dfc21a3a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:34.346457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bffb59-0fd6-4413-bc20-90dfc21a3a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:34.346748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bffb59-0fd6-4413-bc20-90dfc21a3a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:34.347083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bffb59-0fd6-4413-bc20-90dfc21a3a50 admin admin] PATH_INFO: `/v3/users/a7ef6de63d3f4a909d313e2838199e8d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:34.348458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bffb59-0fd6-4413-bc20-90dfc21a3a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ef6de63d3f4a909d313e2838199e8d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:34.353966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bffb59-0fd6-4413-bc20-90dfc21a3a50 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:34.359502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356204c8-ae77-4a56-a559-c28af73fe35b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:34.376032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da725695-fd88-466c-a4cc-74b21a3550b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:34.378361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da725695-fd88-466c-a4cc-74b21a3550b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:34.378702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da725695-fd88-466c-a4cc-74b21a3550b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:34.378986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da725695-fd88-466c-a4cc-74b21a3550b5 admin admin] PATH_INFO: `/v3/projects/8deb5dbf70f6412cbf8ac59ead5a9458` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:34.391759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da725695-fd88-466c-a4cc-74b21a3550b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8deb5dbf70f6412cbf8ac59ead5a9458)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:34.391759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da725695-fd88-466c-a4cc-74b21a3550b5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:34.455538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2bffb59-0fd6-4413-bc20-90dfc21a3a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ef6de63d3f4a909d313e2838199e8d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:34.456615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2bffb59-0fd6-4413-bc20-90dfc21a3a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ef6de63d3f4a909d313e2838199e8d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:34.477484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da725695-fd88-466c-a4cc-74b21a3550b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8deb5dbf70f6412cbf8ac59ead5a9458', 'request_id': 'req-da725695-fd88-466c-a4cc-74b21a3550b5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:34.484661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2bffb59-0fd6-4413-bc20-90dfc21a3a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ef6de63d3f4a909d313e2838199e8d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:34.485376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da725695-fd88-466c-a4cc-74b21a3550b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8deb5dbf70f6412cbf8ac59ead5a9458', 'request_id': 'req-da725695-fd88-466c-a4cc-74b21a3550b5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:34.486646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2bffb59-0fd6-4413-bc20-90dfc21a3a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ef6de63d3f4a909d313e2838199e8d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:34.490169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:34.500110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da725695-fd88-466c-a4cc-74b21a3550b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8deb5dbf70f6412cbf8ac59ead5a9458', 'request_id': 'req-da725695-fd88-466c-a4cc-74b21a3550b5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:34.502357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2bffb59-0fd6-4413-bc20-90dfc21a3a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ef6de63d3f4a909d313e2838199e8d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:34.519984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da725695-fd88-466c-a4cc-74b21a3550b5 admin admin] The token cache is being invalidate because project 8deb5dbf70f6412cbf8ac59ead5a9458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:34.520346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da725695-fd88-466c-a4cc-74b21a3550b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:34.521419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da725695-fd88-466c-a4cc-74b21a3550b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:34.526844 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1247/2491] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:34 2022] DELETE /identity/v3/projects/8deb5dbf70f6412cbf8ac59ead5a9458 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:34.530328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c4496-e4f8-4bd7-bb77-dfb9e3832913 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:34.533855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c4496-e4f8-4bd7-bb77-dfb9e3832913 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:34.534915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c4496-e4f8-4bd7-bb77-dfb9e3832913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:34.537651 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1245/2492] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:34 2022] DELETE /identity/v3/users/a7ef6de63d3f4a909d313e2838199e8d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:34.538418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bffb59-0fd6-4413-bc20-90dfc21a3a50 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:34.542253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c2bffb59-0fd6-4413-bc20-90dfc21a3a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:34.569718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ed3c4496-e4f8-4bd7-bb77-dfb9e3832913 None None] MFA Rules not processed for user `f8b35ab211584884a72057fa31184836`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:34.571427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ed3c4496-e4f8-4bd7-bb77-dfb9e3832913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:34.612388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:34.634938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bffb59-0fd6-4413-bc20-90dfc21a3a50 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:34.647882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28eff04-0ebb-41d1-aefd-267b41d397d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:34.648680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eff04-0ebb-41d1-aefd-267b41d397d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:34.649157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eff04-0ebb-41d1-aefd-267b41d397d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:34.649506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eff04-0ebb-41d1-aefd-267b41d397d0 admin admin] PATH_INFO: `/v3/users/60517c0cc1c647dd993e3c3cb945ac1a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:34.653859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28eff04-0ebb-41d1-aefd-267b41d397d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60517c0cc1c647dd993e3c3cb945ac1a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:34.663603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28eff04-0ebb-41d1-aefd-267b41d397d0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:34.711252 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1248/2493] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:34.711252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076cc06-72d3-4527-bd2c-39a6f31dadf3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:34.711252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076cc06-72d3-4527-bd2c-39a6f31dadf3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:34.711252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076cc06-72d3-4527-bd2c-39a6f31dadf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:34.736938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c28eff04-0ebb-41d1-aefd-267b41d397d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60517c0cc1c647dd993e3c3cb945ac1a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:34.738682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c28eff04-0ebb-41d1-aefd-267b41d397d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60517c0cc1c647dd993e3c3cb945ac1a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:34.747894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b076cc06-72d3-4527-bd2c-39a6f31dadf3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:34.751804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b076cc06-72d3-4527-bd2c-39a6f31dadf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:34.753683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c28eff04-0ebb-41d1-aefd-267b41d397d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60517c0cc1c647dd993e3c3cb945ac1a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:34.754524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c28eff04-0ebb-41d1-aefd-267b41d397d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60517c0cc1c647dd993e3c3cb945ac1a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:34.765902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c28eff04-0ebb-41d1-aefd-267b41d397d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60517c0cc1c647dd993e3c3cb945ac1a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:34.776654 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1249/2494] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:34.782196 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1246/2495] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:34 2022] DELETE /identity/v3/users/60517c0cc1c647dd993e3c3cb945ac1a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:34.793046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076cc06-72d3-4527-bd2c-39a6f31dadf3 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:34.794741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b076cc06-72d3-4527-bd2c-39a6f31dadf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:34.801321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28eff04-0ebb-41d1-aefd-267b41d397d0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:34.802989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c28eff04-0ebb-41d1-aefd-267b41d397d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:34.881916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28eff04-0ebb-41d1-aefd-267b41d397d0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:34.888439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b494d4-ff79-45da-a67b-dfa0cfbbdba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:34.889111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b494d4-ff79-45da-a67b-dfa0cfbbdba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:34.889401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b494d4-ff79-45da-a67b-dfa0cfbbdba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:34.889684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b494d4-ff79-45da-a67b-dfa0cfbbdba0 admin admin] PATH_INFO: `/v3/projects/da06340e93044f73ad4f789f9da91045` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:34.891410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b494d4-ff79-45da-a67b-dfa0cfbbdba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da06340e93044f73ad4f789f9da91045)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:34.894063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b494d4-ff79-45da-a67b-dfa0cfbbdba0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:34.937484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076cc06-72d3-4527-bd2c-39a6f31dadf3 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:34.978544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d0b494d4-ff79-45da-a67b-dfa0cfbbdba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da06340e93044f73ad4f789f9da91045', 'request_id': 'req-d0b494d4-ff79-45da-a67b-dfa0cfbbdba0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:35.003597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d0b494d4-ff79-45da-a67b-dfa0cfbbdba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da06340e93044f73ad4f789f9da91045', 'request_id': 'req-d0b494d4-ff79-45da-a67b-dfa0cfbbdba0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:35.021292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d0b494d4-ff79-45da-a67b-dfa0cfbbdba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da06340e93044f73ad4f789f9da91045', 'request_id': 'req-d0b494d4-ff79-45da-a67b-dfa0cfbbdba0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:35.041498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b1bd1-984a-4252-8fc4-1a7e86aebbbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:35.042891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b1bd1-984a-4252-8fc4-1a7e86aebbbb service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:35.043086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b1bd1-984a-4252-8fc4-1a7e86aebbbb service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:35.043390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b1bd1-984a-4252-8fc4-1a7e86aebbbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:35.056377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d0b494d4-ff79-45da-a67b-dfa0cfbbdba0 admin admin] The token cache is being invalidate because project da06340e93044f73ad4f789f9da91045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:35.056819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d0b494d4-ff79-45da-a67b-dfa0cfbbdba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:35.057456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d0b494d4-ff79-45da-a67b-dfa0cfbbdba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:35.059483 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1247/2496] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:34 2022] DELETE /identity/v3/projects/da06340e93044f73ad4f789f9da91045 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:35.066886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef1316-93c1-43cf-879d-0766acbb9439 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:35.068807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef1316-93c1-43cf-879d-0766acbb9439 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:35.069115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef1316-93c1-43cf-879d-0766acbb9439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:35.072982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b1bd1-984a-4252-8fc4-1a7e86aebbbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:35.075046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b1bd1-984a-4252-8fc4-1a7e86aebbbb service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:35.087899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:35.103408 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1250/2497] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:35.106598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-96ef1316-93c1-43cf-879d-0766acbb9439 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:35.113200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-96ef1316-93c1-43cf-879d-0766acbb9439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:35.188035 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1248/2498] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:35.198844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19d8a7-9683-44b6-9dec-4a6325ef27a4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:35.202157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19d8a7-9683-44b6-9dec-4a6325ef27a4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:35.202613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19d8a7-9683-44b6-9dec-4a6325ef27a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:35.250733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0d19d8a7-9683-44b6-9dec-4a6325ef27a4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:35.252081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0d19d8a7-9683-44b6-9dec-4a6325ef27a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:35.269004 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1251/2499] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:35.273986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef1316-93c1-43cf-879d-0766acbb9439 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:35.287840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef1316-93c1-43cf-879d-0766acbb9439 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:35.297600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec17502-9568-49f1-9084-22e16c17f694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:35.298668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec17502-9568-49f1-9084-22e16c17f694 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:35.299462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec17502-9568-49f1-9084-22e16c17f694 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:35.299760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec17502-9568-49f1-9084-22e16c17f694 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:35.300658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec17502-9568-49f1-9084-22e16c17f694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:35.301092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec17502-9568-49f1-9084-22e16c17f694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:35.302973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec17502-9568-49f1-9084-22e16c17f694 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:35.323682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b078b-bcce-423d-baa0-8c210d2f86ba None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:35.324736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b078b-bcce-423d-baa0-8c210d2f86ba None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:35.325942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b078b-bcce-423d-baa0-8c210d2f86ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:35.327999 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1249/2500] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:35.333327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec17502-9568-49f1-9084-22e16c17f694 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:35.351190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec17502-9568-49f1-9084-22e16c17f694 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:35.359989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac392a-e3a0-4ec7-bfe4-e63b16005095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:35.360853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac392a-e3a0-4ec7-bfe4-e63b16005095 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:35.361236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac392a-e3a0-4ec7-bfe4-e63b16005095 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:35.361612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac392a-e3a0-4ec7-bfe4-e63b16005095 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:35.362504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac392a-e3a0-4ec7-bfe4-e63b16005095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:35.364755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac392a-e3a0-4ec7-bfe4-e63b16005095 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:35.371901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2b6b078b-bcce-423d-baa0-8c210d2f86ba None None] MFA Rules not processed for user `96815c6776f1464a8b6350b4a52d4548`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:35.375089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2b6b078b-bcce-423d-baa0-8c210d2f86ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:35.419427 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1250/2501] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:35 2022] POST /identity/v3/projects => generated 409 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:35.419427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac392a-e3a0-4ec7-bfe4-e63b16005095 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:35.419827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dcac392a-e3a0-4ec7-bfe4-e63b16005095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:35.449620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:35.481979 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1252/2502] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:35.483633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b078b-bcce-423d-baa0-8c210d2f86ba None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:35.496265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b078b-bcce-423d-baa0-8c210d2f86ba None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:35.530455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac392a-e3a0-4ec7-bfe4-e63b16005095 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:35.539557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d151c79-b8ac-4a80-9fa3-f7446043c887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:35.540414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d151c79-b8ac-4a80-9fa3-f7446043c887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:35.542020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d151c79-b8ac-4a80-9fa3-f7446043c887 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:35.543474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d151c79-b8ac-4a80-9fa3-f7446043c887 admin admin] PATH_INFO: `/v3/projects/d18572c631c540dd8fda667bde89bf25` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:35.545727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d151c79-b8ac-4a80-9fa3-f7446043c887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18572c631c540dd8fda667bde89bf25)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:35.549825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d151c79-b8ac-4a80-9fa3-f7446043c887 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:35.615494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff388d8-6843-42d4-aea6-2974a1f34bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:35.617070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff388d8-6843-42d4-aea6-2974a1f34bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:35.618302 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff388d8-6843-42d4-aea6-2974a1f34bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:35.618761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff388d8-6843-42d4-aea6-2974a1f34bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:35.623599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff388d8-6843-42d4-aea6-2974a1f34bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:35.627887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff388d8-6843-42d4-aea6-2974a1f34bf0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:35.629356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3d151c79-b8ac-4a80-9fa3-f7446043c887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18572c631c540dd8fda667bde89bf25', 'request_id': 'req-3d151c79-b8ac-4a80-9fa3-f7446043c887'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:35.642726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3d151c79-b8ac-4a80-9fa3-f7446043c887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18572c631c540dd8fda667bde89bf25', 'request_id': 'req-3d151c79-b8ac-4a80-9fa3-f7446043c887'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:35.650080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3d151c79-b8ac-4a80-9fa3-f7446043c887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18572c631c540dd8fda667bde89bf25', 'request_id': 'req-3d151c79-b8ac-4a80-9fa3-f7446043c887'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:35.658514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:35.665304 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1253/2503] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:35 2022] POST /identity/v3/users => generated 305 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:35.666304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff388d8-6843-42d4-aea6-2974a1f34bf0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:35.668202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7ff388d8-6843-42d4-aea6-2974a1f34bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:35.668895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3d151c79-b8ac-4a80-9fa3-f7446043c887 admin admin] The token cache is being invalidate because project d18572c631c540dd8fda667bde89bf25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:35.669386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3d151c79-b8ac-4a80-9fa3-f7446043c887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:35.670507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3d151c79-b8ac-4a80-9fa3-f7446043c887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:35.672755 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1251/2504] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:35 2022] DELETE /identity/v3/projects/d18572c631c540dd8fda667bde89bf25 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:35.674500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d151c79-b8ac-4a80-9fa3-f7446043c887 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:35.675927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3d151c79-b8ac-4a80-9fa3-f7446043c887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:35.687322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff388d8-6843-42d4-aea6-2974a1f34bf0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:35.761117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d151c79-b8ac-4a80-9fa3-f7446043c887 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:35.767981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5d690-5a86-4b79-ac93-468192255773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:35.768962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5d690-5a86-4b79-ac93-468192255773 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:35.769343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5d690-5a86-4b79-ac93-468192255773 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:35.769491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4e8fb-c681-4615-ba0e-bf51ed4faeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:35.769829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5d690-5a86-4b79-ac93-468192255773 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:35.770281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4e8fb-c681-4615-ba0e-bf51ed4faeed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:35.770659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4e8fb-c681-4615-ba0e-bf51ed4faeed admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:35.770974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4e8fb-c681-4615-ba0e-bf51ed4faeed admin admin] PATH_INFO: `/v3/projects/36e6bd716c304f16a8e22197b0d1b6ee` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:35.772037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5d690-5a86-4b79-ac93-468192255773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:35.772229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4e8fb-c681-4615-ba0e-bf51ed4faeed admin admin] RBAC: Authorizing `identity:delete_project(project_id=36e6bd716c304f16a8e22197b0d1b6ee)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:35.774095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5d690-5a86-4b79-ac93-468192255773 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:35.774304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4e8fb-c681-4615-ba0e-bf51ed4faeed admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:35.795052 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1252/2505] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:35.795052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fedbe0-27aa-4adf-9d35-8ea1ed02dfde None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:35.795052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fedbe0-27aa-4adf-9d35-8ea1ed02dfde None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:35.795052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fedbe0-27aa-4adf-9d35-8ea1ed02dfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:35.825006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-82fedbe0-27aa-4adf-9d35-8ea1ed02dfde None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:35.827321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-82fedbe0-27aa-4adf-9d35-8ea1ed02dfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:35.842282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-02a4e8fb-c681-4615-ba0e-bf51ed4faeed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36e6bd716c304f16a8e22197b0d1b6ee', 'request_id': 'req-02a4e8fb-c681-4615-ba0e-bf51ed4faeed'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:35.861761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-02a4e8fb-c681-4615-ba0e-bf51ed4faeed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36e6bd716c304f16a8e22197b0d1b6ee', 'request_id': 'req-02a4e8fb-c681-4615-ba0e-bf51ed4faeed'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:35.878585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-02a4e8fb-c681-4615-ba0e-bf51ed4faeed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36e6bd716c304f16a8e22197b0d1b6ee', 'request_id': 'req-02a4e8fb-c681-4615-ba0e-bf51ed4faeed'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:35.904406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-02a4e8fb-c681-4615-ba0e-bf51ed4faeed admin admin] The token cache is being invalidate because project 36e6bd716c304f16a8e22197b0d1b6ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:35.904703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-02a4e8fb-c681-4615-ba0e-bf51ed4faeed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:35.906491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-02a4e8fb-c681-4615-ba0e-bf51ed4faeed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:35.908910 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1254/2506] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:35 2022] DELETE /identity/v3/projects/36e6bd716c304f16a8e22197b0d1b6ee => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:35.909998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4e8fb-c681-4615-ba0e-bf51ed4faeed admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:35.911310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-02a4e8fb-c681-4615-ba0e-bf51ed4faeed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:35.917492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:35.952615 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1253/2507] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:35.954917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fedbe0-27aa-4adf-9d35-8ea1ed02dfde None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:35.956436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-82fedbe0-27aa-4adf-9d35-8ea1ed02dfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:35.970968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fedbe0-27aa-4adf-9d35-8ea1ed02dfde None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:35.978097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cadd30-a7d7-487d-91f5-4bd676e6db3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:35.978754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cadd30-a7d7-487d-91f5-4bd676e6db3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:35.979516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cadd30-a7d7-487d-91f5-4bd676e6db3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:35.979516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cadd30-a7d7-487d-91f5-4bd676e6db3b admin admin] PATH_INFO: `/v3/users/9fe8994bceca43abbb270d373f0e1ad6` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:35.986851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cadd30-a7d7-487d-91f5-4bd676e6db3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe8994bceca43abbb270d373f0e1ad6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:35.989191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cadd30-a7d7-487d-91f5-4bd676e6db3b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:36.044624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4e8fb-c681-4615-ba0e-bf51ed4faeed admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:36.054500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2f500-ffca-4fbd-ae8e-8a43f45074aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:36.055918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2f500-ffca-4fbd-ae8e-8a43f45074aa admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:36.056458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2f500-ffca-4fbd-ae8e-8a43f45074aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:36.056458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2f500-ffca-4fbd-ae8e-8a43f45074aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:36.057153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2f500-ffca-4fbd-ae8e-8a43f45074aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:36.059001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2f500-ffca-4fbd-ae8e-8a43f45074aa admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:36.076227 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1255/2508] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:36.080600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282d9bd-28e9-4156-bfd0-b34baf1e8c8c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:36.080892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282d9bd-28e9-4156-bfd0-b34baf1e8c8c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:36.081336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282d9bd-28e9-4156-bfd0-b34baf1e8c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:36.109079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4282d9bd-28e9-4156-bfd0-b34baf1e8c8c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:36.109965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e2cadd30-a7d7-487d-91f5-4bd676e6db3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe8994bceca43abbb270d373f0e1ad6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:36.111075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4282d9bd-28e9-4156-bfd0-b34baf1e8c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:36.111196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e2cadd30-a7d7-487d-91f5-4bd676e6db3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe8994bceca43abbb270d373f0e1ad6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:36.127130 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1256/2509] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:36.128023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282d9bd-28e9-4156-bfd0-b34baf1e8c8c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:36.129392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4282d9bd-28e9-4156-bfd0-b34baf1e8c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:36.152711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282d9bd-28e9-4156-bfd0-b34baf1e8c8c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:36.157580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e2cadd30-a7d7-487d-91f5-4bd676e6db3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe8994bceca43abbb270d373f0e1ad6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:36.158535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e2cadd30-a7d7-487d-91f5-4bd676e6db3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe8994bceca43abbb270d373f0e1ad6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:36.167271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62661e-fc10-4964-ab93-ff03efc34374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:36.169102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62661e-fc10-4964-ab93-ff03efc34374 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:36.169354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62661e-fc10-4964-ab93-ff03efc34374 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:36.169637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62661e-fc10-4964-ab93-ff03efc34374 admin admin] PATH_INFO: `/v3/projects/1516fbb4ae424aaa851e170db91b19b5/users/23042bc0bd64415eb904b016ca2977c7/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:36.170042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e2cadd30-a7d7-487d-91f5-4bd676e6db3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe8994bceca43abbb270d373f0e1ad6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:36.189397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62661e-fc10-4964-ab93-ff03efc34374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1516fbb4ae424aaa851e170db91b19b5, user_id=23042bc0bd64415eb904b016ca2977c7, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:36.192429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62661e-fc10-4964-ab93-ff03efc34374 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:36.204459 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1254/2510] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:35 2022] DELETE /identity/v3/users/9fe8994bceca43abbb270d373f0e1ad6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:36.205150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cadd30-a7d7-487d-91f5-4bd676e6db3b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:36.232612 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1257/2511] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:36 2022] PUT /identity/v3/projects/1516fbb4ae424aaa851e170db91b19b5/users/23042bc0bd64415eb904b016ca2977c7/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:36.234238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845100a-5e6b-4fda-b33d-163845679223 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:36.234547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845100a-5e6b-4fda-b33d-163845679223 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:36.234693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:36.234827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845100a-5e6b-4fda-b33d-163845679223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:36.272536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2845100a-5e6b-4fda-b33d-163845679223 None None] MFA Rules not processed for user `23042bc0bd64415eb904b016ca2977c7`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:36.274714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2845100a-5e6b-4fda-b33d-163845679223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:36.350239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cadd30-a7d7-487d-91f5-4bd676e6db3b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:36.395278 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1258/2512] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:36 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:36.400174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845100a-5e6b-4fda-b33d-163845679223 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:36.436272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f0f12-fad8-4342-96bf-d04bfb623841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:36.437093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f0f12-fad8-4342-96bf-d04bfb623841 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:36.437448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f0f12-fad8-4342-96bf-d04bfb623841 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:36.437901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f0f12-fad8-4342-96bf-d04bfb623841 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:36.438797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f0f12-fad8-4342-96bf-d04bfb623841 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:36.439231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f0f12-fad8-4342-96bf-d04bfb623841 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:36.441476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f0f12-fad8-4342-96bf-d04bfb623841 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:36.461257 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1255/2513] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:36.467006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f0f12-fad8-4342-96bf-d04bfb623841 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:36.479171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f0f12-fad8-4342-96bf-d04bfb623841 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:36.484506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf52eb5-feef-49e7-82ad-b5a553fe70d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:36.486606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf52eb5-feef-49e7-82ad-b5a553fe70d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:36.486977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf52eb5-feef-49e7-82ad-b5a553fe70d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:36.487773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf52eb5-feef-49e7-82ad-b5a553fe70d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:36.488537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf52eb5-feef-49e7-82ad-b5a553fe70d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:36.490911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf52eb5-feef-49e7-82ad-b5a553fe70d9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:36.550276 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1256/2514] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:36 2022] POST /identity/v3/projects => generated 395 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:36.551358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf52eb5-feef-49e7-82ad-b5a553fe70d9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:36.564581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:36.573709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845100a-5e6b-4fda-b33d-163845679223 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:36.650971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf52eb5-feef-49e7-82ad-b5a553fe70d9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:36.663452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5935f84-7f85-4a32-a8a4-e5856a80e453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:36.666044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5935f84-7f85-4a32-a8a4-e5856a80e453 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:36.667706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5935f84-7f85-4a32-a8a4-e5856a80e453 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:36.668408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5935f84-7f85-4a32-a8a4-e5856a80e453 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:36.672007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5935f84-7f85-4a32-a8a4-e5856a80e453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:36.674931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5935f84-7f85-4a32-a8a4-e5856a80e453 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:36.700994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed9408-dfe9-458a-9966-35d313217849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:36.703201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed9408-dfe9-458a-9966-35d313217849 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:36.705538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed9408-dfe9-458a-9966-35d313217849 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:36.705846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed9408-dfe9-458a-9966-35d313217849 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:36.707991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed9408-dfe9-458a-9966-35d313217849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:36.714248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed9408-dfe9-458a-9966-35d313217849 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:36.718660 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1257/2515] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:36 2022] POST /identity/v3/users => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:36.719776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5935f84-7f85-4a32-a8a4-e5856a80e453 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:36.730825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5935f84-7f85-4a32-a8a4-e5856a80e453 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:36.736403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5e778-4519-4207-82ef-29cf6c1032b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:36.737035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5e778-4519-4207-82ef-29cf6c1032b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:36.737323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5e778-4519-4207-82ef-29cf6c1032b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:36.737600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5e778-4519-4207-82ef-29cf6c1032b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:36.738319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5e778-4519-4207-82ef-29cf6c1032b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:36.740108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5e778-4519-4207-82ef-29cf6c1032b7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:36.752091 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1258/2516] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:36.756396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5e778-4519-4207-82ef-29cf6c1032b7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:36.763244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:36.769345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5e778-4519-4207-82ef-29cf6c1032b7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:36.778665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c5d29-b3d0-4ef1-8ca1-84973c744d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:36.779278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c5d29-b3d0-4ef1-8ca1-84973c744d0f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:36.779628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c5d29-b3d0-4ef1-8ca1-84973c744d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:36.779968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c5d29-b3d0-4ef1-8ca1-84973c744d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:36.783730 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1259/2517] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:36 2022] POST /identity/v3/projects => generated 409 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:36.785963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c5d29-b3d0-4ef1-8ca1-84973c744d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:36.786463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed9408-dfe9-458a-9966-35d313217849 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:36.788010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c5d29-b3d0-4ef1-8ca1-84973c744d0f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:36.802935 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1259/2518] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:36.809984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c5d29-b3d0-4ef1-8ca1-84973c744d0f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:36.821266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c5d29-b3d0-4ef1-8ca1-84973c744d0f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:36.898537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde08b-bb17-4645-b767-7202080da335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:36.899307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde08b-bb17-4645-b767-7202080da335 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:36.899599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde08b-bb17-4645-b767-7202080da335 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:36.899956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde08b-bb17-4645-b767-7202080da335 admin admin] PATH_INFO: `/v3/projects/b0afe6bde6aa4c1dbe9a01c553ee801f/users/e4b9f2d931d64de6a0ecdb1082102adb/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:36.939112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafde08b-bb17-4645-b767-7202080da335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0afe6bde6aa4c1dbe9a01c553ee801f, user_id=e4b9f2d931d64de6a0ecdb1082102adb, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:36.947063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafde08b-bb17-4645-b767-7202080da335 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:36.995729 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1260/2519] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:36 2022] PUT /identity/v3/projects/b0afe6bde6aa4c1dbe9a01c553ee801f/users/e4b9f2d931d64de6a0ecdb1082102adb/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:36.995729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde08b-bb17-4645-b767-7202080da335 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:36.997830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-eafde08b-bb17-4645-b767-7202080da335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:37.010547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed9408-dfe9-458a-9966-35d313217849 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:37.088640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde08b-bb17-4645-b767-7202080da335 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:37.096084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97266958-39cd-4502-879d-0851068613f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:37.097076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97266958-39cd-4502-879d-0851068613f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:37.097557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97266958-39cd-4502-879d-0851068613f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:37.098118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97266958-39cd-4502-879d-0851068613f8 admin admin] PATH_INFO: `/v3/projects/5d8a52c497be45eebf5405ad2a9439d0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:37.100594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97266958-39cd-4502-879d-0851068613f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8a52c497be45eebf5405ad2a9439d0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:37.103737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97266958-39cd-4502-879d-0851068613f8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:37.150817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0d385-c312-46b6-8acf-daad7aa3ee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:37.151693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0d385-c312-46b6-8acf-daad7aa3ee3e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:37.152960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0d385-c312-46b6-8acf-daad7aa3ee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:37.153466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0d385-c312-46b6-8acf-daad7aa3ee3e admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:37.155256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0d385-c312-46b6-8acf-daad7aa3ee3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:37.160648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0d385-c312-46b6-8acf-daad7aa3ee3e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:37.211566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-97266958-39cd-4502-879d-0851068613f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8a52c497be45eebf5405ad2a9439d0', 'request_id': 'req-97266958-39cd-4502-879d-0851068613f8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:37.214986 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1260/2520] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:36 2022] POST /identity/v3/users => generated 311 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:37.217258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a3dae-55cb-4801-848d-9e6affb7d856 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:37.217547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a3dae-55cb-4801-848d-9e6affb7d856 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:37.217831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a3dae-55cb-4801-848d-9e6affb7d856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:37.238664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-97266958-39cd-4502-879d-0851068613f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8a52c497be45eebf5405ad2a9439d0', 'request_id': 'req-97266958-39cd-4502-879d-0851068613f8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:37.247980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-97266958-39cd-4502-879d-0851068613f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8a52c497be45eebf5405ad2a9439d0', 'request_id': 'req-97266958-39cd-4502-879d-0851068613f8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:37.266389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-97266958-39cd-4502-879d-0851068613f8 admin admin] The token cache is being invalidate because project 5d8a52c497be45eebf5405ad2a9439d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:37.266836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-97266958-39cd-4502-879d-0851068613f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:37.267673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-97266958-39cd-4502-879d-0851068613f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:37.269749 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1261/2521] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:36 2022] DELETE /identity/v3/projects/5d8a52c497be45eebf5405ad2a9439d0 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:37.270563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97266958-39cd-4502-879d-0851068613f8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:37.272172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-97266958-39cd-4502-879d-0851068613f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:37.283096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:37.294662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3c4a3dae-55cb-4801-848d-9e6affb7d856 None None] MFA Rules not processed for user `e4b9f2d931d64de6a0ecdb1082102adb`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:37.296693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3c4a3dae-55cb-4801-848d-9e6affb7d856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:37.319064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:37.418109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97266958-39cd-4502-879d-0851068613f8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:37.433699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610746a-4cca-452c-9aa8-c760741bcc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:37.434992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610746a-4cca-452c-9aa8-c760741bcc5c admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:37.436200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610746a-4cca-452c-9aa8-c760741bcc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:37.436867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610746a-4cca-452c-9aa8-c760741bcc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:37.437968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610746a-4cca-452c-9aa8-c760741bcc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:37.441208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610746a-4cca-452c-9aa8-c760741bcc5c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:37.459264 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1262/2522] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:37.459264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a45486-b982-4ddc-8768-63d40b8451ae None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:37.459264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a45486-b982-4ddc-8768-63d40b8451ae None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:37.459264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a45486-b982-4ddc-8768-63d40b8451ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:37.465006 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1261/2523] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:37.472082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a3dae-55cb-4801-848d-9e6affb7d856 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:37.487666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a3a45486-b982-4ddc-8768-63d40b8451ae None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:37.490839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a3a45486-b982-4ddc-8768-63d40b8451ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:37.508251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a3dae-55cb-4801-848d-9e6affb7d856 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:37.516007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdfc1a-0d93-4841-894e-270f7bd24418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:37.518715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdfc1a-0d93-4841-894e-270f7bd24418 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:37.519186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdfc1a-0d93-4841-894e-270f7bd24418 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:37.520634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdfc1a-0d93-4841-894e-270f7bd24418 admin admin] PATH_INFO: `/v3/projects/2b3a75ad6a9745bb94d779b8a6b2871c/users/a52e11e7c2d0429484b74d3117ba6c00/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:37.524758 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1263/2524] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:37.530126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a45486-b982-4ddc-8768-63d40b8451ae None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:37.552545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a3a45486-b982-4ddc-8768-63d40b8451ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:37.585345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdfc1a-0d93-4841-894e-270f7bd24418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3a75ad6a9745bb94d779b8a6b2871c, user_id=a52e11e7c2d0429484b74d3117ba6c00, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:37.588366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdfc1a-0d93-4841-894e-270f7bd24418 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:37.603363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a45486-b982-4ddc-8768-63d40b8451ae None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:37.622758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26600acb-7ead-4880-9ed5-00bc30d9f76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:37.623971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26600acb-7ead-4880-9ed5-00bc30d9f76f admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:37.625035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26600acb-7ead-4880-9ed5-00bc30d9f76f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:37.625587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26600acb-7ead-4880-9ed5-00bc30d9f76f admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:37.628283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26600acb-7ead-4880-9ed5-00bc30d9f76f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:37.631782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26600acb-7ead-4880-9ed5-00bc30d9f76f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:37.632697 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1262/2525] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:37 2022] PUT /identity/v3/projects/2b3a75ad6a9745bb94d779b8a6b2871c/users/a52e11e7c2d0429484b74d3117ba6c00/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:37.634239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658b575-1596-4430-8a6f-5e832072febe None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:37.634647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658b575-1596-4430-8a6f-5e832072febe None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:37.635082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658b575-1596-4430-8a6f-5e832072febe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:37.670214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f658b575-1596-4430-8a6f-5e832072febe None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:37.671687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f658b575-1596-4430-8a6f-5e832072febe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:37.690271 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1264/2526] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:37 2022] POST /identity/v3/projects => generated 395 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:37.691319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26600acb-7ead-4880-9ed5-00bc30d9f76f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:37.795432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26600acb-7ead-4880-9ed5-00bc30d9f76f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:37.807649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4345e9-e2ce-4301-8d6c-8a7a5ed04933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:37.808343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4345e9-e2ce-4301-8d6c-8a7a5ed04933 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:37.808845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4345e9-e2ce-4301-8d6c-8a7a5ed04933 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:37.809248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4345e9-e2ce-4301-8d6c-8a7a5ed04933 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:37.809960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4345e9-e2ce-4301-8d6c-8a7a5ed04933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:37.811716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4345e9-e2ce-4301-8d6c-8a7a5ed04933 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:37.827960 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1263/2527] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:37.831515 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1265/2528] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:37.832872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4345e9-e2ce-4301-8d6c-8a7a5ed04933 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:37.834942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658b575-1596-4430-8a6f-5e832072febe None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:37.846861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4345e9-e2ce-4301-8d6c-8a7a5ed04933 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:37.854759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ebb1d-5448-46cf-9760-5a4bda56fc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:37.856343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ebb1d-5448-46cf-9760-5a4bda56fc44 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:37.856530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ebb1d-5448-46cf-9760-5a4bda56fc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:37.856894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ebb1d-5448-46cf-9760-5a4bda56fc44 admin admin] PATH_INFO: `/v3/projects/2b3a75ad6a9745bb94d779b8a6b2871c/users/a52e11e7c2d0429484b74d3117ba6c00/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:37.859585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ebb1d-5448-46cf-9760-5a4bda56fc44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3a75ad6a9745bb94d779b8a6b2871c, user_id=a52e11e7c2d0429484b74d3117ba6c00, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:37.863403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658b575-1596-4430-8a6f-5e832072febe None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:37.864738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ebb1d-5448-46cf-9760-5a4bda56fc44 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:37.874489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee0367-b015-44be-90ea-d78716fb9fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:37.879474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee0367-b015-44be-90ea-d78716fb9fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:37.879857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee0367-b015-44be-90ea-d78716fb9fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:37.880213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee0367-b015-44be-90ea-d78716fb9fb5 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:37.881028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee0367-b015-44be-90ea-d78716fb9fb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:37.885849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee0367-b015-44be-90ea-d78716fb9fb5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:37.890747 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1266/2529] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:37 2022] PUT /identity/v3/projects/2b3a75ad6a9745bb94d779b8a6b2871c/users/a52e11e7c2d0429484b74d3117ba6c00/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:37.893175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ebb1d-5448-46cf-9760-5a4bda56fc44 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:37.934364 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1264/2530] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:37 2022] POST /identity/v3/users => generated 304 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:37.939493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dae744-5d49-4a15-86b6-bfc807436f71 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:37.940002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dae744-5d49-4a15-86b6-bfc807436f71 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:37.940396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dae744-5d49-4a15-86b6-bfc807436f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:38.008817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e9dae744-5d49-4a15-86b6-bfc807436f71 None None] MFA Rules not processed for user `a52e11e7c2d0429484b74d3117ba6c00`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:38.008978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:38.010695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e9dae744-5d49-4a15-86b6-bfc807436f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:38.015601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ebb1d-5448-46cf-9760-5a4bda56fc44 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:38.021961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba6bf0-a017-437d-998f-761dfce54b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:38.023028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba6bf0-a017-437d-998f-761dfce54b77 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:38.023455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba6bf0-a017-437d-998f-761dfce54b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:38.023834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba6bf0-a017-437d-998f-761dfce54b77 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:38.024777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba6bf0-a017-437d-998f-761dfce54b77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:38.025202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba6bf0-a017-437d-998f-761dfce54b77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:38.026937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba6bf0-a017-437d-998f-761dfce54b77 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:38.043911 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1267/2531] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:38.049997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba6bf0-a017-437d-998f-761dfce54b77 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:38.067543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba6bf0-a017-437d-998f-761dfce54b77 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:38.074379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47514fd9-fb06-4b8a-ad41-3c58b6fe825a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:38.075197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47514fd9-fb06-4b8a-ad41-3c58b6fe825a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:38.075665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47514fd9-fb06-4b8a-ad41-3c58b6fe825a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:38.076183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47514fd9-fb06-4b8a-ad41-3c58b6fe825a admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:38.077083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47514fd9-fb06-4b8a-ad41-3c58b6fe825a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:38.079760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47514fd9-fb06-4b8a-ad41-3c58b6fe825a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:38.093302 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1268/2532] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:38.094432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47514fd9-fb06-4b8a-ad41-3c58b6fe825a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:38.107187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47514fd9-fb06-4b8a-ad41-3c58b6fe825a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:38.114025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ad370-db63-4740-9af0-719cff9df4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:38.114495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ad370-db63-4740-9af0-719cff9df4f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:38.114898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ad370-db63-4740-9af0-719cff9df4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:38.115412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ad370-db63-4740-9af0-719cff9df4f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:38.116399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ad370-db63-4740-9af0-719cff9df4f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:38.119115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ad370-db63-4740-9af0-719cff9df4f1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:38.180818 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1269/2533] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:38 2022] POST /identity/v3/projects => generated 411 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:38.182077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ad370-db63-4740-9af0-719cff9df4f1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:38.199323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:38.212246 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1265/2534] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:37 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:38.214829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dae744-5d49-4a15-86b6-bfc807436f71 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:38.227630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dae744-5d49-4a15-86b6-bfc807436f71 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:38.283435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ad370-db63-4740-9af0-719cff9df4f1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:38.288845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03454e-517a-451c-a49f-412fe823b655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:38.289717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03454e-517a-451c-a49f-412fe823b655 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:38.290114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03454e-517a-451c-a49f-412fe823b655 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:38.291878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03454e-517a-451c-a49f-412fe823b655 admin admin] PATH_INFO: `/v3/projects/ff5c9bc01f33450e9670f5fd5bdf556f/users/1d40a8830d3a44c2b9c9661843a65929/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:38.312052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03454e-517a-451c-a49f-412fe823b655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff5c9bc01f33450e9670f5fd5bdf556f, user_id=1d40a8830d3a44c2b9c9661843a65929, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:38.315167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03454e-517a-451c-a49f-412fe823b655 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:38.329702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b0ccc-43bc-4fcb-b6db-a21e0ab39ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:38.330706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b0ccc-43bc-4fcb-b6db-a21e0ab39ade admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:38.331173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b0ccc-43bc-4fcb-b6db-a21e0ab39ade admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:38.331972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b0ccc-43bc-4fcb-b6db-a21e0ab39ade admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:38.332994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b0ccc-43bc-4fcb-b6db-a21e0ab39ade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:38.335046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b0ccc-43bc-4fcb-b6db-a21e0ab39ade admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:38.335209 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1270/2535] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:38 2022] PUT /identity/v3/projects/ff5c9bc01f33450e9670f5fd5bdf556f/users/1d40a8830d3a44c2b9c9661843a65929/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:38.336213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03454e-517a-451c-a49f-412fe823b655 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:38.361958 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1266/2536] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:38 2022] POST /identity/v3/users => generated 306 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:38.362601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b0ccc-43bc-4fcb-b6db-a21e0ab39ade admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:38.378138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b0ccc-43bc-4fcb-b6db-a21e0ab39ade admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:38.411163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03454e-517a-451c-a49f-412fe823b655 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:38.417616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08faf2-fd48-496d-959b-853e648a2bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:38.418354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08faf2-fd48-496d-959b-853e648a2bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:38.418712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08faf2-fd48-496d-959b-853e648a2bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:38.419585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08faf2-fd48-496d-959b-853e648a2bc2 admin admin] PATH_INFO: `/v3/users/23042bc0bd64415eb904b016ca2977c7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:38.424055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08faf2-fd48-496d-959b-853e648a2bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23042bc0bd64415eb904b016ca2977c7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:38.426508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08faf2-fd48-496d-959b-853e648a2bc2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:38.451824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d72c6-f3c6-4078-9d8f-650eadfb17a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:38.453242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d72c6-f3c6-4078-9d8f-650eadfb17a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:38.453242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d72c6-f3c6-4078-9d8f-650eadfb17a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:38.453242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d72c6-f3c6-4078-9d8f-650eadfb17a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:38.453701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d72c6-f3c6-4078-9d8f-650eadfb17a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:38.461149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d72c6-f3c6-4078-9d8f-650eadfb17a7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:38.484400 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1267/2537] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:38.484400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d72c6-f3c6-4078-9d8f-650eadfb17a7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:38.502270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d72c6-f3c6-4078-9d8f-650eadfb17a7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:38.508335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035cf21-1550-4087-93ac-fdaef92c27f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:38.509230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035cf21-1550-4087-93ac-fdaef92c27f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:38.509584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035cf21-1550-4087-93ac-fdaef92c27f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:38.509867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035cf21-1550-4087-93ac-fdaef92c27f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:38.510572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035cf21-1550-4087-93ac-fdaef92c27f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:38.512209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035cf21-1550-4087-93ac-fdaef92c27f7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:38.529568 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1268/2538] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:38.531535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035cf21-1550-4087-93ac-fdaef92c27f7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:38.543965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035cf21-1550-4087-93ac-fdaef92c27f7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:38.549529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249f256-f00b-46b5-a78d-c69c5b73787f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:38.550303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249f256-f00b-46b5-a78d-c69c5b73787f admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:38.550684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249f256-f00b-46b5-a78d-c69c5b73787f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:38.550907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249f256-f00b-46b5-a78d-c69c5b73787f admin admin] PATH_INFO: `/v3/projects/ff5c9bc01f33450e9670f5fd5bdf556f/users/1d40a8830d3a44c2b9c9661843a65929/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:38.553523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249f256-f00b-46b5-a78d-c69c5b73787f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff5c9bc01f33450e9670f5fd5bdf556f, user_id=1d40a8830d3a44c2b9c9661843a65929, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:38.556290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249f256-f00b-46b5-a78d-c69c5b73787f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:38.557432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:38.563144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8a08faf2-fd48-496d-959b-853e648a2bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23042bc0bd64415eb904b016ca2977c7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:38.564778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8a08faf2-fd48-496d-959b-853e648a2bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23042bc0bd64415eb904b016ca2977c7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:38.578974 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1269/2539] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:38 2022] PUT /identity/v3/projects/ff5c9bc01f33450e9670f5fd5bdf556f/users/1d40a8830d3a44c2b9c9661843a65929/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:38.579827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249f256-f00b-46b5-a78d-c69c5b73787f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:38.590141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7249f256-f00b-46b5-a78d-c69c5b73787f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:38.600322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8a08faf2-fd48-496d-959b-853e648a2bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23042bc0bd64415eb904b016ca2977c7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:38.601297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8a08faf2-fd48-496d-959b-853e648a2bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23042bc0bd64415eb904b016ca2977c7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:38.625396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8a08faf2-fd48-496d-959b-853e648a2bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23042bc0bd64415eb904b016ca2977c7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:38.652039 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1271/2540] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:38 2022] DELETE /identity/v3/users/23042bc0bd64415eb904b016ca2977c7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:38.653336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace752f-1b80-4524-bf6c-9303f1f9071e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:38.653622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace752f-1b80-4524-bf6c-9303f1f9071e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:38.654052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace752f-1b80-4524-bf6c-9303f1f9071e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:38.698222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0ace752f-1b80-4524-bf6c-9303f1f9071e None None] MFA Rules not processed for user `1d40a8830d3a44c2b9c9661843a65929`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:38.700306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0ace752f-1b80-4524-bf6c-9303f1f9071e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:38.743842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249f256-f00b-46b5-a78d-c69c5b73787f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:38.754210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:38.814686 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1272/2541] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:38.816653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77282bd9-0f9e-4b03-baf8-fa706c72c6ef None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:38.817314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77282bd9-0f9e-4b03-baf8-fa706c72c6ef None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:38.817729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77282bd9-0f9e-4b03-baf8-fa706c72c6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:38.857834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-77282bd9-0f9e-4b03-baf8-fa706c72c6ef None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:38.859367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-77282bd9-0f9e-4b03-baf8-fa706c72c6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:38.905632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da02ed8-5b1b-492a-b24d-b526e7be7e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:38.907831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da02ed8-5b1b-492a-b24d-b526e7be7e17 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:38.908272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da02ed8-5b1b-492a-b24d-b526e7be7e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:38.908698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da02ed8-5b1b-492a-b24d-b526e7be7e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:38.909730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da02ed8-5b1b-492a-b24d-b526e7be7e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:38.912199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da02ed8-5b1b-492a-b24d-b526e7be7e17 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:38.952883 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1270/2542] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:38.957707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6c2a8-609b-4e81-8270-afce520e1dc4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:38.958241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6c2a8-609b-4e81-8270-afce520e1dc4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:38.958673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6c2a8-609b-4e81-8270-afce520e1dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:39.002828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0aa6c2a8-609b-4e81-8270-afce520e1dc4 None None] MFA Rules not processed for user `e4b9f2d931d64de6a0ecdb1082102adb`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:39.004441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0aa6c2a8-609b-4e81-8270-afce520e1dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:39.027281 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1273/2543] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:39.028184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77282bd9-0f9e-4b03-baf8-fa706c72c6ef None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:39.053432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77282bd9-0f9e-4b03-baf8-fa706c72c6ef None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:39.070905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd53cc7-3d9f-4ffd-911f-d99f1032cfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:39.071899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd53cc7-3d9f-4ffd-911f-d99f1032cfe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:39.072330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd53cc7-3d9f-4ffd-911f-d99f1032cfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:39.072777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd53cc7-3d9f-4ffd-911f-d99f1032cfe8 admin admin] PATH_INFO: `/v3/projects/0a256de385094348b6c03bcd2eab0d6f/users/85f0c582040c43b1b27791cb66656e9e/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:39.116448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd53cc7-3d9f-4ffd-911f-d99f1032cfe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a256de385094348b6c03bcd2eab0d6f, user_id=85f0c582040c43b1b27791cb66656e9e, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:39.120326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd53cc7-3d9f-4ffd-911f-d99f1032cfe8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:39.177033 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1274/2544] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:39 2022] PUT /identity/v3/projects/0a256de385094348b6c03bcd2eab0d6f/users/85f0c582040c43b1b27791cb66656e9e/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:39.178135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd53cc7-3d9f-4ffd-911f-d99f1032cfe8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:39.178750 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1271/2545] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:39.180792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d416a1-94ac-4158-97ec-cb39fc1ade57 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:39.182250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8cd53cc7-3d9f-4ffd-911f-d99f1032cfe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:39.183174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d416a1-94ac-4158-97ec-cb39fc1ade57 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:39.184018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d416a1-94ac-4158-97ec-cb39fc1ade57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:39.233102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-04d416a1-94ac-4158-97ec-cb39fc1ade57 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:39.234349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-04d416a1-94ac-4158-97ec-cb39fc1ade57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:39.252123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:39.330900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd53cc7-3d9f-4ffd-911f-d99f1032cfe8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:39.338771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37268b0-3157-4eba-94ca-5b00e78b1f8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:39.339448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37268b0-3157-4eba-94ca-5b00e78b1f8a service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:39.339737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37268b0-3157-4eba-94ca-5b00e78b1f8a service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:39.341340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37268b0-3157-4eba-94ca-5b00e78b1f8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:39.385154 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1272/2546] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:39.386176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d416a1-94ac-4158-97ec-cb39fc1ade57 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:39.392565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-04d416a1-94ac-4158-97ec-cb39fc1ade57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:39.444824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37268b0-3157-4eba-94ca-5b00e78b1f8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:39.446668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37268b0-3157-4eba-94ca-5b00e78b1f8a service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:39.457933 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1275/2547] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:39.459034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37268b0-3157-4eba-94ca-5b00e78b1f8a service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:39.460729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f37268b0-3157-4eba-94ca-5b00e78b1f8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:39.464464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:39.480669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37268b0-3157-4eba-94ca-5b00e78b1f8a service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:39.486543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ea70f-d052-4cd7-be8b-3954beae5b0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:39.487496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ea70f-d052-4cd7-be8b-3954beae5b0a service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:39.487953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ea70f-d052-4cd7-be8b-3954beae5b0a service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:39.488396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ea70f-d052-4cd7-be8b-3954beae5b0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:39.489334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d416a1-94ac-4158-97ec-cb39fc1ade57 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:39.500023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6e97b-1354-4c22-b5e0-5b44c9838cb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:39.500629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6e97b-1354-4c22-b5e0-5b44c9838cb9 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:39.500956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6e97b-1354-4c22-b5e0-5b44c9838cb9 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:39.501362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6e97b-1354-4c22-b5e0-5b44c9838cb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:39.502401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ea70f-d052-4cd7-be8b-3954beae5b0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:39.504235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ea70f-d052-4cd7-be8b-3954beae5b0a service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:39.504385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0fd6e97b-1354-4c22-b5e0-5b44c9838cb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:39.517935 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1276/2548] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:39.591162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6e97b-1354-4c22-b5e0-5b44c9838cb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:39.594349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6e97b-1354-4c22-b5e0-5b44c9838cb9 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:39.608504 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1273/2549] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:40.261054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ea70f-d052-4cd7-be8b-3954beae5b0a service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:40.263010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-214ea70f-d052-4cd7-be8b-3954beae5b0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:40.288588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ea70f-d052-4cd7-be8b-3954beae5b0a service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:40.309940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee22092-1fd7-41d3-ad8b-ee4778b51467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:40.310930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee22092-1fd7-41d3-ad8b-ee4778b51467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:40.311432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee22092-1fd7-41d3-ad8b-ee4778b51467 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:40.312392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee22092-1fd7-41d3-ad8b-ee4778b51467 admin admin] PATH_INFO: `/v3/projects/1516fbb4ae424aaa851e170db91b19b5` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:40.315697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee22092-1fd7-41d3-ad8b-ee4778b51467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1516fbb4ae424aaa851e170db91b19b5)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:40.318618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee22092-1fd7-41d3-ad8b-ee4778b51467 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:40.425383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7ee22092-1fd7-41d3-ad8b-ee4778b51467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1516fbb4ae424aaa851e170db91b19b5', 'request_id': 'req-7ee22092-1fd7-41d3-ad8b-ee4778b51467'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:40.445337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7ee22092-1fd7-41d3-ad8b-ee4778b51467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1516fbb4ae424aaa851e170db91b19b5', 'request_id': 'req-7ee22092-1fd7-41d3-ad8b-ee4778b51467'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:40.464774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7ee22092-1fd7-41d3-ad8b-ee4778b51467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1516fbb4ae424aaa851e170db91b19b5', 'request_id': 'req-7ee22092-1fd7-41d3-ad8b-ee4778b51467'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:40.491862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7ee22092-1fd7-41d3-ad8b-ee4778b51467 admin admin] The token cache is being invalidate because project 1516fbb4ae424aaa851e170db91b19b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:40.495212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7ee22092-1fd7-41d3-ad8b-ee4778b51467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:40.496263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7ee22092-1fd7-41d3-ad8b-ee4778b51467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:40.503207 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1277/2550] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:40 2022] DELETE /identity/v3/projects/1516fbb4ae424aaa851e170db91b19b5 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:40.510667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6e97b-1354-4c22-b5e0-5b44c9838cb9 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:40.525310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6e97b-1354-4c22-b5e0-5b44c9838cb9 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:40.627478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47adc5-8527-4e1b-ad2a-79f421275e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:40.640271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47adc5-8527-4e1b-ad2a-79f421275e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:40.640579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47adc5-8527-4e1b-ad2a-79f421275e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:40.641615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47adc5-8527-4e1b-ad2a-79f421275e28 admin admin] PATH_INFO: `/v3/users/a52e11e7c2d0429484b74d3117ba6c00` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:40.649597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47adc5-8527-4e1b-ad2a-79f421275e28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a52e11e7c2d0429484b74d3117ba6c00)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:40.651660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47adc5-8527-4e1b-ad2a-79f421275e28 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:40.742109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7a47adc5-8527-4e1b-ad2a-79f421275e28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a52e11e7c2d0429484b74d3117ba6c00'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:40.760297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7a47adc5-8527-4e1b-ad2a-79f421275e28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a52e11e7c2d0429484b74d3117ba6c00'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:40.761413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7a47adc5-8527-4e1b-ad2a-79f421275e28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a52e11e7c2d0429484b74d3117ba6c00'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:40.772072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7a47adc5-8527-4e1b-ad2a-79f421275e28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a52e11e7c2d0429484b74d3117ba6c00'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:40.773051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7a47adc5-8527-4e1b-ad2a-79f421275e28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a52e11e7c2d0429484b74d3117ba6c00'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:40.799908 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1274/2551] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:40 2022] DELETE /identity/v3/users/a52e11e7c2d0429484b74d3117ba6c00 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:02:42.435795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee22092-1fd7-41d3-ad8b-ee4778b51467 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:42.442761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7ee22092-1fd7-41d3-ad8b-ee4778b51467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:42.462016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee22092-1fd7-41d3-ad8b-ee4778b51467 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:42.519105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:42.581646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66abe1e-de51-4b6a-bb81-187b51c5c3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:42.585695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66abe1e-de51-4b6a-bb81-187b51c5c3a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:42.586246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66abe1e-de51-4b6a-bb81-187b51c5c3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:42.586941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66abe1e-de51-4b6a-bb81-187b51c5c3a0 admin admin] PATH_INFO: `/v3/projects/2b3a75ad6a9745bb94d779b8a6b2871c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:42.597876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66abe1e-de51-4b6a-bb81-187b51c5c3a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b3a75ad6a9745bb94d779b8a6b2871c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:42.602018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66abe1e-de51-4b6a-bb81-187b51c5c3a0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:42.707240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d66abe1e-de51-4b6a-bb81-187b51c5c3a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b3a75ad6a9745bb94d779b8a6b2871c', 'request_id': 'req-d66abe1e-de51-4b6a-bb81-187b51c5c3a0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:42.716888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d66abe1e-de51-4b6a-bb81-187b51c5c3a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b3a75ad6a9745bb94d779b8a6b2871c', 'request_id': 'req-d66abe1e-de51-4b6a-bb81-187b51c5c3a0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:42.725469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d66abe1e-de51-4b6a-bb81-187b51c5c3a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b3a75ad6a9745bb94d779b8a6b2871c', 'request_id': 'req-d66abe1e-de51-4b6a-bb81-187b51c5c3a0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:42.759246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d66abe1e-de51-4b6a-bb81-187b51c5c3a0 admin admin] The token cache is being invalidate because project 2b3a75ad6a9745bb94d779b8a6b2871c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:42.759584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d66abe1e-de51-4b6a-bb81-187b51c5c3a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:42.761069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d66abe1e-de51-4b6a-bb81-187b51c5c3a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:42.762770 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1278/2552] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:42 2022] DELETE /identity/v3/projects/2b3a75ad6a9745bb94d779b8a6b2871c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:42.769475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f617e8d-cad8-41eb-81ef-77619b7fd3de None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:42.770004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f617e8d-cad8-41eb-81ef-77619b7fd3de None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:42.770106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f617e8d-cad8-41eb-81ef-77619b7fd3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:42.795066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:42.803686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3f617e8d-cad8-41eb-81ef-77619b7fd3de None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:42.804929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3f617e8d-cad8-41eb-81ef-77619b7fd3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:42.913679 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1275/2553] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:42.916858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8fbec-3a61-4299-aef7-595de74c3c62 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:42.917957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8fbec-3a61-4299-aef7-595de74c3c62 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:42.918701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8fbec-3a61-4299-aef7-595de74c3c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:42.960752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-cae8fbec-3a61-4299-aef7-595de74c3c62 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:42.965434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cae8fbec-3a61-4299-aef7-595de74c3c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:42.986008 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1279/2554] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:42.987812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f617e8d-cad8-41eb-81ef-77619b7fd3de None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:43.012088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f617e8d-cad8-41eb-81ef-77619b7fd3de None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:43.023384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b20348-8f7b-497e-997f-5958f6705ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:43.024040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b20348-8f7b-497e-997f-5958f6705ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:43.024320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b20348-8f7b-497e-997f-5958f6705ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:43.024593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b20348-8f7b-497e-997f-5958f6705ff1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:43.025528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b20348-8f7b-497e-997f-5958f6705ff1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:43.025654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b20348-8f7b-497e-997f-5958f6705ff1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:43.027254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b20348-8f7b-497e-997f-5958f6705ff1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:43.047930 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1276/2555] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:43.050677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8fbec-3a61-4299-aef7-595de74c3c62 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:43.062771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8fbec-3a61-4299-aef7-595de74c3c62 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:43.068260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb10b5e-b2f3-4517-b452-0702404898d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:43.069085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb10b5e-b2f3-4517-b452-0702404898d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:43.069422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb10b5e-b2f3-4517-b452-0702404898d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:43.069704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb10b5e-b2f3-4517-b452-0702404898d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:43.070872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb10b5e-b2f3-4517-b452-0702404898d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:43.072864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb10b5e-b2f3-4517-b452-0702404898d0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:43.115373 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1280/2556] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:43 2022] POST /identity/v3/projects => generated 393 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:43.118017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b20348-8f7b-497e-997f-5958f6705ff1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:43.129859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b20348-8f7b-497e-997f-5958f6705ff1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:43.238397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9522314-1d66-4a4b-b9bc-558b3044fc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:43.239157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9522314-1d66-4a4b-b9bc-558b3044fc57 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:43.239628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9522314-1d66-4a4b-b9bc-558b3044fc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:43.240021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9522314-1d66-4a4b-b9bc-558b3044fc57 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:43.240955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9522314-1d66-4a4b-b9bc-558b3044fc57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:43.246166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9522314-1d66-4a4b-b9bc-558b3044fc57 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:43.289873 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1277/2557] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:43 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:43.291744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb10b5e-b2f3-4517-b452-0702404898d0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:43.324936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb10b5e-b2f3-4517-b452-0702404898d0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:43.336231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4983967-38ec-4bc0-9f8c-a7a86408126f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:43.336231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4983967-38ec-4bc0-9f8c-a7a86408126f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:43.337051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4983967-38ec-4bc0-9f8c-a7a86408126f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:43.339681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4983967-38ec-4bc0-9f8c-a7a86408126f admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:43.340893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4983967-38ec-4bc0-9f8c-a7a86408126f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:43.342793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4983967-38ec-4bc0-9f8c-a7a86408126f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:43.357676 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1281/2558] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:43.362575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9522314-1d66-4a4b-b9bc-558b3044fc57 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:43.375126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9522314-1d66-4a4b-b9bc-558b3044fc57 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:43.385334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d5f80-b3ad-433f-9566-35d801314408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:43.386397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d5f80-b3ad-433f-9566-35d801314408 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:43.386787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d5f80-b3ad-433f-9566-35d801314408 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:43.388426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d5f80-b3ad-433f-9566-35d801314408 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:43.389373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d5f80-b3ad-433f-9566-35d801314408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:43.391654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d5f80-b3ad-433f-9566-35d801314408 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:43.410574 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1278/2559] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:43.414417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4983967-38ec-4bc0-9f8c-a7a86408126f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:43.428471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4983967-38ec-4bc0-9f8c-a7a86408126f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:43.445057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885c7cb-81b8-4439-989f-d90b7df105a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:43.446508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885c7cb-81b8-4439-989f-d90b7df105a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:43.447426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885c7cb-81b8-4439-989f-d90b7df105a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:43.447930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885c7cb-81b8-4439-989f-d90b7df105a1 admin admin] PATH_INFO: `/v3/projects/fb71d28e098d4b0faedea05f4c73e6e6/users/d8506c8b759245a8b6b69089d30c6f7e/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:43.486091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885c7cb-81b8-4439-989f-d90b7df105a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb71d28e098d4b0faedea05f4c73e6e6, user_id=d8506c8b759245a8b6b69089d30c6f7e, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:43.489964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885c7cb-81b8-4439-989f-d90b7df105a1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:43.536367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b55285-ce56-40b9-be83-56c2bbcec0ac None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:43.536846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b55285-ce56-40b9-be83-56c2bbcec0ac None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:43.537574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b55285-ce56-40b9-be83-56c2bbcec0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:43.541843 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1282/2560] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:43 2022] PUT /identity/v3/projects/fb71d28e098d4b0faedea05f4c73e6e6/users/d8506c8b759245a8b6b69089d30c6f7e/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:02:43.558257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf71dc9-fcbf-4ad1-9bc2-c57578067cf3 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:43.559553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf71dc9-fcbf-4ad1-9bc2-c57578067cf3 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:43.560072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf71dc9-fcbf-4ad1-9bc2-c57578067cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:43.599265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9cf71dc9-fcbf-4ad1-9bc2-c57578067cf3 None None] MFA Rules not processed for user `46d7264a2f63436bb8519cd8cec6d9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:43.600880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9cf71dc9-fcbf-4ad1-9bc2-c57578067cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:43.604798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-70b55285-ce56-40b9-be83-56c2bbcec0ac None None] MFA Rules not processed for user `d8506c8b759245a8b6b69089d30c6f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:43.606972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-70b55285-ce56-40b9-be83-56c2bbcec0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:43.700205 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1279/2561] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:02:43.705724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b55285-ce56-40b9-be83-56c2bbcec0ac None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:43.714528 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1283/2562] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:02:43.717634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:43.820230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b55285-ce56-40b9-be83-56c2bbcec0ac None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:43.828580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b3875-8056-4ac7-9392-5d700e2faebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:43.829802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b3875-8056-4ac7-9392-5d700e2faebc admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:43.830090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b3875-8056-4ac7-9392-5d700e2faebc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:43.830366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b3875-8056-4ac7-9392-5d700e2faebc admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:43.850742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b3875-8056-4ac7-9392-5d700e2faebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:43.854201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b3875-8056-4ac7-9392-5d700e2faebc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:43.902319 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1280/2563] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:43 2022] POST /identity/v3/projects => generated 393 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:43.903856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf71dc9-fcbf-4ad1-9bc2-c57578067cf3 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:43.920179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf71dc9-fcbf-4ad1-9bc2-c57578067cf3 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:43.932493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:44.016910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a1a93-e640-48e3-8772-b100575a1396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:44.017862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a1a93-e640-48e3-8772-b100575a1396 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:44.018399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a1a93-e640-48e3-8772-b100575a1396 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:44.018779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a1a93-e640-48e3-8772-b100575a1396 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:44.019619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a1a93-e640-48e3-8772-b100575a1396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:44.022089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a1a93-e640-48e3-8772-b100575a1396 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:44.055909 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1284/2564] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:43 2022] POST /identity/v3/users => generated 303 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:44.056601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b3875-8056-4ac7-9392-5d700e2faebc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:44.070848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b3875-8056-4ac7-9392-5d700e2faebc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:44.096860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5661bd2-1e15-4946-a008-988abb8f3fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:44.098109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5661bd2-1e15-4946-a008-988abb8f3fbd admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:44.098109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5661bd2-1e15-4946-a008-988abb8f3fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:44.098109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5661bd2-1e15-4946-a008-988abb8f3fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:44.098935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5661bd2-1e15-4946-a008-988abb8f3fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:44.100655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5661bd2-1e15-4946-a008-988abb8f3fbd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:44.125178 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1281/2565] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:02:44.130237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a1a93-e640-48e3-8772-b100575a1396 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:44.147312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a1a93-e640-48e3-8772-b100575a1396 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:44.166758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf1b37-be9c-4156-979b-384329abe4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:44.167695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf1b37-be9c-4156-979b-384329abe4cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:44.168110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf1b37-be9c-4156-979b-384329abe4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:44.168496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf1b37-be9c-4156-979b-384329abe4cd admin admin] PATH_INFO: `/v3/projects/baaf155303074f2da715975a4eb0e3e7/users/d08b09fd20564df7a735b1bfb084e4e7/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:44.188998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf1b37-be9c-4156-979b-384329abe4cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=baaf155303074f2da715975a4eb0e3e7, user_id=d08b09fd20564df7a735b1bfb084e4e7, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:44.192364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf1b37-be9c-4156-979b-384329abe4cd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:44.223899 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1285/2566] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:44 2022] PUT /identity/v3/projects/baaf155303074f2da715975a4eb0e3e7/users/d08b09fd20564df7a735b1bfb084e4e7/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:44.225824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5661bd2-1e15-4946-a008-988abb8f3fbd admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:44.239266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5661bd2-1e15-4946-a008-988abb8f3fbd admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:44.351839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6aee5d-7882-45b3-804f-dfad35002ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:44.352670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6aee5d-7882-45b3-804f-dfad35002ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:44.353105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6aee5d-7882-45b3-804f-dfad35002ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:44.353526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6aee5d-7882-45b3-804f-dfad35002ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:44.354378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6aee5d-7882-45b3-804f-dfad35002ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:44.356579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6aee5d-7882-45b3-804f-dfad35002ac9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:44.369042 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1282/2567] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:44.373702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf1b37-be9c-4156-979b-384329abe4cd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:44.386565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf1b37-be9c-4156-979b-384329abe4cd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:44.392897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71826e8-bbd8-4009-93b2-08516242f016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:44.393708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71826e8-bbd8-4009-93b2-08516242f016 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:44.393992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71826e8-bbd8-4009-93b2-08516242f016 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:44.394272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71826e8-bbd8-4009-93b2-08516242f016 admin admin] PATH_INFO: `/v3/projects/baaf155303074f2da715975a4eb0e3e7/users/d08b09fd20564df7a735b1bfb084e4e7/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:44.396470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71826e8-bbd8-4009-93b2-08516242f016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baaf155303074f2da715975a4eb0e3e7, user_id=d08b09fd20564df7a735b1bfb084e4e7, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:44.400035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71826e8-bbd8-4009-93b2-08516242f016 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:44.417330 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1286/2568] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:44 2022] PUT /identity/v3/projects/baaf155303074f2da715975a4eb0e3e7/users/d08b09fd20564df7a735b1bfb084e4e7/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:44.429499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa07664-eee3-4a82-9821-b858671a9af8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:44.429787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa07664-eee3-4a82-9821-b858671a9af8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:44.430063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa07664-eee3-4a82-9821-b858671a9af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:44.475913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-eaa07664-eee3-4a82-9821-b858671a9af8 None None] MFA Rules not processed for user `d08b09fd20564df7a735b1bfb084e4e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:44.477270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-eaa07664-eee3-4a82-9821-b858671a9af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:44.561577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71826e8-bbd8-4009-93b2-08516242f016 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:44.564760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a71826e8-bbd8-4009-93b2-08516242f016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:44.567315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:44.587521 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1283/2569] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:44.664556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71826e8-bbd8-4009-93b2-08516242f016 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:44.672402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb2145-d3c9-45b9-8a84-4b6e22136d6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:44.673538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb2145-d3c9-45b9-8a84-4b6e22136d6c service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:44.673993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb2145-d3c9-45b9-8a84-4b6e22136d6c service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:44.674437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb2145-d3c9-45b9-8a84-4b6e22136d6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:44.676674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-02fb2145-d3c9-45b9-8a84-4b6e22136d6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:44.742376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb2145-d3c9-45b9-8a84-4b6e22136d6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:44.744015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb2145-d3c9-45b9-8a84-4b6e22136d6c service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:44.748483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:44.758096 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1287/2570] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:02:44.894541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa07664-eee3-4a82-9821-b858671a9af8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:44.909708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa07664-eee3-4a82-9821-b858671a9af8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:44.915155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5468e9-be2b-41a2-acc1-9e0fb21de833 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:44.915865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5468e9-be2b-41a2-acc1-9e0fb21de833 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:44.916197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5468e9-be2b-41a2-acc1-9e0fb21de833 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:44.916751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5468e9-be2b-41a2-acc1-9e0fb21de833 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:44.928202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5468e9-be2b-41a2-acc1-9e0fb21de833 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:44.934552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5468e9-be2b-41a2-acc1-9e0fb21de833 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:44.950136 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1284/2571] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:46.488867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb2145-d3c9-45b9-8a84-4b6e22136d6c service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:46.506537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb2145-d3c9-45b9-8a84-4b6e22136d6c service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:46.512383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdd58b-787b-422e-8f58-d741c2e7e328 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:46.513075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdd58b-787b-422e-8f58-d741c2e7e328 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:46.513421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdd58b-787b-422e-8f58-d741c2e7e328 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:46.513761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdd58b-787b-422e-8f58-d741c2e7e328 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:46.573015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdd58b-787b-422e-8f58-d741c2e7e328 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:46.574699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdd58b-787b-422e-8f58-d741c2e7e328 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:46.585212 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1288/2572] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:46.607709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5468e9-be2b-41a2-acc1-9e0fb21de833 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:46.727508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5468e9-be2b-41a2-acc1-9e0fb21de833 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:46.736108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90346783-2cfa-4708-8800-590cfcb34a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:46.737027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90346783-2cfa-4708-8800-590cfcb34a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:46.737469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90346783-2cfa-4708-8800-590cfcb34a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:46.737902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90346783-2cfa-4708-8800-590cfcb34a54 admin admin] PATH_INFO: `/v3/users/d8506c8b759245a8b6b69089d30c6f7e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:46.752233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90346783-2cfa-4708-8800-590cfcb34a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8506c8b759245a8b6b69089d30c6f7e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:46.757431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90346783-2cfa-4708-8800-590cfcb34a54 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:46.863946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-90346783-2cfa-4708-8800-590cfcb34a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8506c8b759245a8b6b69089d30c6f7e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:46.909177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-90346783-2cfa-4708-8800-590cfcb34a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8506c8b759245a8b6b69089d30c6f7e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:46.909818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-90346783-2cfa-4708-8800-590cfcb34a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8506c8b759245a8b6b69089d30c6f7e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:46.918496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-90346783-2cfa-4708-8800-590cfcb34a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8506c8b759245a8b6b69089d30c6f7e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:46.919799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-90346783-2cfa-4708-8800-590cfcb34a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8506c8b759245a8b6b69089d30c6f7e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:46.946982 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1285/2573] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:46 2022] DELETE /identity/v3/users/d8506c8b759245a8b6b69089d30c6f7e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:46.951352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1bdd4-f2af-4432-8555-8199934762fb None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:46.951624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1bdd4-f2af-4432-8555-8199934762fb None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:46.951903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1bdd4-f2af-4432-8555-8199934762fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:46.986949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d6b1bdd4-f2af-4432-8555-8199934762fb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:46.988386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d6b1bdd4-f2af-4432-8555-8199934762fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:47.125068 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1289/2574] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:47.153544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90346783-2cfa-4708-8800-590cfcb34a54 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:47.155261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-90346783-2cfa-4708-8800-590cfcb34a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:47.312927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90346783-2cfa-4708-8800-590cfcb34a54 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:47.323722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79ed29-072d-41b9-be23-d9918cb1c7a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:47.324430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79ed29-072d-41b9-be23-d9918cb1c7a0 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:47.324717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79ed29-072d-41b9-be23-d9918cb1c7a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:47.324993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79ed29-072d-41b9-be23-d9918cb1c7a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:47.351246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79ed29-072d-41b9-be23-d9918cb1c7a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:47.352737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79ed29-072d-41b9-be23-d9918cb1c7a0 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:47.377243 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1286/2575] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:47.933903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1bdd4-f2af-4432-8555-8199934762fb None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:47.935638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d6b1bdd4-f2af-4432-8555-8199934762fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:47.959414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1bdd4-f2af-4432-8555-8199934762fb None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:47.968388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df5d55-8cc6-49a3-8673-3005282b98bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:47.968764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df5d55-8cc6-49a3-8673-3005282b98bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:47.968943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df5d55-8cc6-49a3-8673-3005282b98bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:47.969417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df5d55-8cc6-49a3-8673-3005282b98bc admin admin] PATH_INFO: `/v3/projects/fb71d28e098d4b0faedea05f4c73e6e6` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:47.970788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df5d55-8cc6-49a3-8673-3005282b98bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb71d28e098d4b0faedea05f4c73e6e6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:47.973082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df5d55-8cc6-49a3-8673-3005282b98bc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:48.060805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-67df5d55-8cc6-49a3-8673-3005282b98bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb71d28e098d4b0faedea05f4c73e6e6', 'request_id': 'req-67df5d55-8cc6-49a3-8673-3005282b98bc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:48.072829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-67df5d55-8cc6-49a3-8673-3005282b98bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb71d28e098d4b0faedea05f4c73e6e6', 'request_id': 'req-67df5d55-8cc6-49a3-8673-3005282b98bc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:48.085710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-67df5d55-8cc6-49a3-8673-3005282b98bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb71d28e098d4b0faedea05f4c73e6e6', 'request_id': 'req-67df5d55-8cc6-49a3-8673-3005282b98bc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:48.103043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-67df5d55-8cc6-49a3-8673-3005282b98bc admin admin] The token cache is being invalidate because project fb71d28e098d4b0faedea05f4c73e6e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:48.103259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-67df5d55-8cc6-49a3-8673-3005282b98bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:48.105316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-67df5d55-8cc6-49a3-8673-3005282b98bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:48.114115 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1290/2576] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:47 2022] DELETE /identity/v3/projects/fb71d28e098d4b0faedea05f4c73e6e6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:48.115373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79ed29-072d-41b9-be23-d9918cb1c7a0 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:48.134036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79ed29-072d-41b9-be23-d9918cb1c7a0 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:48.145178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:48.319254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f1832-a3cb-4bbf-8243-0c94a6aaf05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:48.319967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f1832-a3cb-4bbf-8243-0c94a6aaf05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:48.320314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f1832-a3cb-4bbf-8243-0c94a6aaf05c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:48.321300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f1832-a3cb-4bbf-8243-0c94a6aaf05c admin admin] PATH_INFO: `/v3/users/d08b09fd20564df7a735b1bfb084e4e7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:48.323346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f1832-a3cb-4bbf-8243-0c94a6aaf05c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d08b09fd20564df7a735b1bfb084e4e7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:48.327793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f1832-a3cb-4bbf-8243-0c94a6aaf05c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:48.423804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1b3f1832-a3cb-4bbf-8243-0c94a6aaf05c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd08b09fd20564df7a735b1bfb084e4e7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:48.446776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1b3f1832-a3cb-4bbf-8243-0c94a6aaf05c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd08b09fd20564df7a735b1bfb084e4e7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:48.447887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1b3f1832-a3cb-4bbf-8243-0c94a6aaf05c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd08b09fd20564df7a735b1bfb084e4e7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:48.458670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1b3f1832-a3cb-4bbf-8243-0c94a6aaf05c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd08b09fd20564df7a735b1bfb084e4e7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:48.461082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1b3f1832-a3cb-4bbf-8243-0c94a6aaf05c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd08b09fd20564df7a735b1bfb084e4e7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:48.484041 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1287/2577] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:02:48 2022] DELETE /identity/v3/users/d08b09fd20564df7a735b1bfb084e4e7 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:49.051653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df5d55-8cc6-49a3-8673-3005282b98bc admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:49.053188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-67df5d55-8cc6-49a3-8673-3005282b98bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:49.106104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df5d55-8cc6-49a3-8673-3005282b98bc admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:49.174592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:49.270173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e331c4-15ad-4d50-808d-91d02ca1238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:49.271280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e331c4-15ad-4d50-808d-91d02ca1238c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:49.271828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e331c4-15ad-4d50-808d-91d02ca1238c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:49.272323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e331c4-15ad-4d50-808d-91d02ca1238c admin admin] PATH_INFO: `/v3/projects/baaf155303074f2da715975a4eb0e3e7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:49.273754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e331c4-15ad-4d50-808d-91d02ca1238c admin admin] RBAC: Authorizing `identity:delete_project(project_id=baaf155303074f2da715975a4eb0e3e7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:49.280541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e331c4-15ad-4d50-808d-91d02ca1238c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:49.352008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-13e331c4-15ad-4d50-808d-91d02ca1238c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baaf155303074f2da715975a4eb0e3e7', 'request_id': 'req-13e331c4-15ad-4d50-808d-91d02ca1238c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:49.371378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-13e331c4-15ad-4d50-808d-91d02ca1238c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baaf155303074f2da715975a4eb0e3e7', 'request_id': 'req-13e331c4-15ad-4d50-808d-91d02ca1238c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:49.377815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-13e331c4-15ad-4d50-808d-91d02ca1238c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baaf155303074f2da715975a4eb0e3e7', 'request_id': 'req-13e331c4-15ad-4d50-808d-91d02ca1238c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:49.399512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-13e331c4-15ad-4d50-808d-91d02ca1238c admin admin] The token cache is being invalidate because project baaf155303074f2da715975a4eb0e3e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:02:49.405714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-13e331c4-15ad-4d50-808d-91d02ca1238c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:49.407812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-13e331c4-15ad-4d50-808d-91d02ca1238c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:02:49.409806 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1291/2578] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:02:49 2022] DELETE /identity/v3/projects/baaf155303074f2da715975a4eb0e3e7 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:49.417528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db030d3f-4062-4ebd-a836-f7996e8e699e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:49.418068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db030d3f-4062-4ebd-a836-f7996e8e699e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:49.418068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db030d3f-4062-4ebd-a836-f7996e8e699e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:49.443657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-db030d3f-4062-4ebd-a836-f7996e8e699e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:49.445998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-db030d3f-4062-4ebd-a836-f7996e8e699e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:49.531360 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1288/2579] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:49.536615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c215b58-0fb5-469a-b99a-0fc0d6be8d6b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:49.537025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c215b58-0fb5-469a-b99a-0fc0d6be8d6b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:49.537429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c215b58-0fb5-469a-b99a-0fc0d6be8d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:49.586213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3c215b58-0fb5-469a-b99a-0fc0d6be8d6b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:49.587569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3c215b58-0fb5-469a-b99a-0fc0d6be8d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:49.597644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca3931-b9d8-493e-a085-073d929dabdf None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:49.599354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca3931-b9d8-493e-a085-073d929dabdf None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:49.599463 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1292/2580] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:49.599872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca3931-b9d8-493e-a085-073d929dabdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:49.606743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c215b58-0fb5-469a-b99a-0fc0d6be8d6b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:49.620902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c215b58-0fb5-469a-b99a-0fc0d6be8d6b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:49.628402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c9de2-4bc6-4c2a-b750-db3f63141030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:49.629156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c9de2-4bc6-4c2a-b750-db3f63141030 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:49.629445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c9de2-4bc6-4c2a-b750-db3f63141030 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:49.630797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c9de2-4bc6-4c2a-b750-db3f63141030 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:49.631603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c9de2-4bc6-4c2a-b750-db3f63141030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:02:49.631867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c9de2-4bc6-4c2a-b750-db3f63141030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:49.635047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c9de2-4bc6-4c2a-b750-db3f63141030 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:49.650581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2cca3931-b9d8-493e-a085-073d929dabdf None None] MFA Rules not processed for user `b2a05aa5d80844848bf57f6ca093e582`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:49.651961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2cca3931-b9d8-493e-a085-073d929dabdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:49.667080 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1293/2581] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:02:49.682370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c9de2-4bc6-4c2a-b750-db3f63141030 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:49.698222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:49.705677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c9de2-4bc6-4c2a-b750-db3f63141030 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:49.714717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2b351-f168-403a-b070-b3924ee25315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:49.715705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2b351-f168-403a-b070-b3924ee25315 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:49.716175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2b351-f168-403a-b070-b3924ee25315 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:49.716643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2b351-f168-403a-b070-b3924ee25315 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:49.717628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2b351-f168-403a-b070-b3924ee25315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:49.719954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2b351-f168-403a-b070-b3924ee25315 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:49.759406 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1289/2582] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:02:49.767335 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1294/2583] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:02:49 2022] POST /identity/v3/projects => generated 401 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:49.770637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca3931-b9d8-493e-a085-073d929dabdf None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:49.788168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca3931-b9d8-493e-a085-073d929dabdf None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:49.893309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424f447-8a3b-4307-9e9e-19364f4caaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:49.893946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424f447-8a3b-4307-9e9e-19364f4caaa3 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:49.894233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424f447-8a3b-4307-9e9e-19364f4caaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:49.894563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424f447-8a3b-4307-9e9e-19364f4caaa3 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:49.895399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424f447-8a3b-4307-9e9e-19364f4caaa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:49.898944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424f447-8a3b-4307-9e9e-19364f4caaa3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:49.935572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2b351-f168-403a-b070-b3924ee25315 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:49.935822 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1290/2584] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:02:49 2022] POST /identity/v3/users => generated 301 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:02:49.951646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2b351-f168-403a-b070-b3924ee25315 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:49.959547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22652ac2-f79b-4be9-a826-63254ed35a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:49.960834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22652ac2-f79b-4be9-a826-63254ed35a85 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:49.961327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22652ac2-f79b-4be9-a826-63254ed35a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:49.963115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22652ac2-f79b-4be9-a826-63254ed35a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:49.964998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22652ac2-f79b-4be9-a826-63254ed35a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:49.967191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22652ac2-f79b-4be9-a826-63254ed35a85 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:49.983905 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1295/2585] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:02:49.984588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424f447-8a3b-4307-9e9e-19364f4caaa3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:50.020459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424f447-8a3b-4307-9e9e-19364f4caaa3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:50.026234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085cfac-d650-41ca-847a-044aede0fa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:50.027946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085cfac-d650-41ca-847a-044aede0fa1d admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:50.029490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085cfac-d650-41ca-847a-044aede0fa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:50.029977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085cfac-d650-41ca-847a-044aede0fa1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:50.031135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085cfac-d650-41ca-847a-044aede0fa1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:50.035191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085cfac-d650-41ca-847a-044aede0fa1d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:50.092929 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1291/2586] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:02:50.097378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22652ac2-f79b-4be9-a826-63254ed35a85 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:50.111747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22652ac2-f79b-4be9-a826-63254ed35a85 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:50.117332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbe31d-6b42-4fba-b669-ea30de4d95fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:50.118076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbe31d-6b42-4fba-b669-ea30de4d95fa admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:50.118362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbe31d-6b42-4fba-b669-ea30de4d95fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:50.118667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbe31d-6b42-4fba-b669-ea30de4d95fa admin admin] PATH_INFO: `/v3/projects/1363f5fe83df486c98932c724ad93fc2/users/b24f7b4041c14620becd719b26e058d3/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:50.159964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbe31d-6b42-4fba-b669-ea30de4d95fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1363f5fe83df486c98932c724ad93fc2, user_id=b24f7b4041c14620becd719b26e058d3, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:50.162894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbe31d-6b42-4fba-b669-ea30de4d95fa admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:50.184691 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1296/2587] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:02:50 2022] PUT /identity/v3/projects/1363f5fe83df486c98932c724ad93fc2/users/b24f7b4041c14620becd719b26e058d3/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:02:50.190231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d95c5-1c4a-4592-a78d-72691ea7654e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:50.190525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d95c5-1c4a-4592-a78d-72691ea7654e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:50.190808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d95c5-1c4a-4592-a78d-72691ea7654e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:50.215708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-696d95c5-1c4a-4592-a78d-72691ea7654e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:50.216982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-696d95c5-1c4a-4592-a78d-72691ea7654e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:50.309756 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1292/2588] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:50.331507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbe31d-6b42-4fba-b669-ea30de4d95fa admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:50.334080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-84fbe31d-6b42-4fba-b669-ea30de4d95fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:50.428483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:50.481252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbe31d-6b42-4fba-b669-ea30de4d95fa admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:50.486387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc465b-de25-402c-ba78-752476ddc25a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:50.487112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc465b-de25-402c-ba78-752476ddc25a service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:50.487548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc465b-de25-402c-ba78-752476ddc25a service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:50.487929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc465b-de25-402c-ba78-752476ddc25a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:50.501139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc465b-de25-402c-ba78-752476ddc25a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:50.502696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc465b-de25-402c-ba78-752476ddc25a service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:50.518375 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1297/2589] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:55.338481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b881474-1d24-4289-a154-d698c3cea664 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:55.339042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b881474-1d24-4289-a154-d698c3cea664 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:55.339265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b881474-1d24-4289-a154-d698c3cea664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:55.452211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2b881474-1d24-4289-a154-d698c3cea664 None None] MFA Rules not processed for user `85f0c582040c43b1b27791cb66656e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:55.453559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2b881474-1d24-4289-a154-d698c3cea664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:55.537900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:55.574417 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1293/2590] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:55 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:55.648636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eac4b5-df7c-4884-a6f2-5089ccd89178 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:55.649761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eac4b5-df7c-4884-a6f2-5089ccd89178 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:55.650289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eac4b5-df7c-4884-a6f2-5089ccd89178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:55.675939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-65eac4b5-df7c-4884-a6f2-5089ccd89178 None None] MFA Rules not processed for user `85f0c582040c43b1b27791cb66656e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:02:55.678287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-65eac4b5-df7c-4884-a6f2-5089ccd89178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:55.689443 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1298/2591] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:02:55 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:02:55.732895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b881474-1d24-4289-a154-d698c3cea664 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:55.735977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2b881474-1d24-4289-a154-d698c3cea664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:55.887389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b881474-1d24-4289-a154-d698c3cea664 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:55.894528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310f06a-6b8c-495c-9726-46e9e0a728ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:55.895183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310f06a-6b8c-495c-9726-46e9e0a728ac service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:55.895513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310f06a-6b8c-495c-9726-46e9e0a728ac service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:55.895794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310f06a-6b8c-495c-9726-46e9e0a728ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:55.907433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310f06a-6b8c-495c-9726-46e9e0a728ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:55.909067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310f06a-6b8c-495c-9726-46e9e0a728ac service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:55.921664 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1294/2592] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:55 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:58.130163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eac4b5-df7c-4884-a6f2-5089ccd89178 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:58.132435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-65eac4b5-df7c-4884-a6f2-5089ccd89178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:58.241675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eac4b5-df7c-4884-a6f2-5089ccd89178 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:58.248013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8184355-c095-41a5-a5e5-be6ca37d1f64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:58.249073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8184355-c095-41a5-a5e5-be6ca37d1f64 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:58.249568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8184355-c095-41a5-a5e5-be6ca37d1f64 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:58.250723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8184355-c095-41a5-a5e5-be6ca37d1f64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:58.252999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e8184355-c095-41a5-a5e5-be6ca37d1f64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:58.274506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8184355-c095-41a5-a5e5-be6ca37d1f64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:58.278016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8184355-c095-41a5-a5e5-be6ca37d1f64 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:58.303138 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1299/2593] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:02:58.490984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310f06a-6b8c-495c-9726-46e9e0a728ac service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:02:58.494795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2310f06a-6b8c-495c-9726-46e9e0a728ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:58.556762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310f06a-6b8c-495c-9726-46e9e0a728ac service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:02:58.608256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65b452-9612-41a0-b385-f4e1d932c260 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:02:58.609177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65b452-9612-41a0-b385-f4e1d932c260 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:02:58.610108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65b452-9612-41a0-b385-f4e1d932c260 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:02:58.611502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65b452-9612-41a0-b385-f4e1d932c260 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:02:58.617204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1f65b452-9612-41a0-b385-f4e1d932c260 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:02:58.653106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65b452-9612-41a0-b385-f4e1d932c260 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:02:58.655477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65b452-9612-41a0-b385-f4e1d932c260 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:02:58.699480 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1295/2594] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:02:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:03:06.909284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e200a3-6840-46b5-9793-bfe69edd7072 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:06.909932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e200a3-6840-46b5-9793-bfe69edd7072 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:06.910050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e200a3-6840-46b5-9793-bfe69edd7072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:06.941167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-61e200a3-6840-46b5-9793-bfe69edd7072 None None] MFA Rules not processed for user `b24f7b4041c14620becd719b26e058d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:03:06.942495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-61e200a3-6840-46b5-9793-bfe69edd7072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:07.036800 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1300/2595] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:03:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:03:07.049964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65b452-9612-41a0-b385-f4e1d932c260 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:07.063253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65b452-9612-41a0-b385-f4e1d932c260 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:07.068775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732be2c-4566-405a-97e6-835371203d25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:07.069402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732be2c-4566-405a-97e6-835371203d25 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:07.069687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732be2c-4566-405a-97e6-835371203d25 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:07.069964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732be2c-4566-405a-97e6-835371203d25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:07.078663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732be2c-4566-405a-97e6-835371203d25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:07.080283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732be2c-4566-405a-97e6-835371203d25 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:07.089979 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1296/2596] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:03:07 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:03:10.581664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e200a3-6840-46b5-9793-bfe69edd7072 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:10.583263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-61e200a3-6840-46b5-9793-bfe69edd7072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:10.605228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e200a3-6840-46b5-9793-bfe69edd7072 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:10.614570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375faad-3591-4dd8-bd1a-15d9e6ea2ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:10.615532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375faad-3591-4dd8-bd1a-15d9e6ea2ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:10.616186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375faad-3591-4dd8-bd1a-15d9e6ea2ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:10.616671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375faad-3591-4dd8-bd1a-15d9e6ea2ee1 admin admin] PATH_INFO: `/v3/users/e4b9f2d931d64de6a0ecdb1082102adb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:10.620096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375faad-3591-4dd8-bd1a-15d9e6ea2ee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b9f2d931d64de6a0ecdb1082102adb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:10.623256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375faad-3591-4dd8-bd1a-15d9e6ea2ee1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:10.685656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:10.693001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5375faad-3591-4dd8-bd1a-15d9e6ea2ee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b9f2d931d64de6a0ecdb1082102adb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:10.693722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5375faad-3591-4dd8-bd1a-15d9e6ea2ee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b9f2d931d64de6a0ecdb1082102adb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:10.710650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5375faad-3591-4dd8-bd1a-15d9e6ea2ee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b9f2d931d64de6a0ecdb1082102adb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:10.711510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5375faad-3591-4dd8-bd1a-15d9e6ea2ee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b9f2d931d64de6a0ecdb1082102adb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:10.722571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5375faad-3591-4dd8-bd1a-15d9e6ea2ee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b9f2d931d64de6a0ecdb1082102adb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:10.746123 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1301/2597] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:03:10 2022] DELETE /identity/v3/users/e4b9f2d931d64de6a0ecdb1082102adb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:03:10.751917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45aa24-ab41-4e39-b870-21484dd3e7a4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:10.752400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45aa24-ab41-4e39-b870-21484dd3e7a4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:10.752604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45aa24-ab41-4e39-b870-21484dd3e7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:10.792600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bb45aa24-ab41-4e39-b870-21484dd3e7a4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:03:10.794209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bb45aa24-ab41-4e39-b870-21484dd3e7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:10.910025 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1297/2598] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:03:10.958207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375faad-3591-4dd8-bd1a-15d9e6ea2ee1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:10.960949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5375faad-3591-4dd8-bd1a-15d9e6ea2ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:11.093950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375faad-3591-4dd8-bd1a-15d9e6ea2ee1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:11.103247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2634a3-ff49-435f-86b2-f065adbde173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:11.103631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2634a3-ff49-435f-86b2-f065adbde173 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:11.104408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2634a3-ff49-435f-86b2-f065adbde173 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:11.105474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2634a3-ff49-435f-86b2-f065adbde173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:11.128759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2634a3-ff49-435f-86b2-f065adbde173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:11.131183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2634a3-ff49-435f-86b2-f065adbde173 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:11.145245 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1302/2599] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:03:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:03:11.721791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45aa24-ab41-4e39-b870-21484dd3e7a4 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:11.723466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bb45aa24-ab41-4e39-b870-21484dd3e7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:11.744060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45aa24-ab41-4e39-b870-21484dd3e7a4 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:11.756313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25edcc9-4ad2-4e24-a052-0b16e8973be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:11.758655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25edcc9-4ad2-4e24-a052-0b16e8973be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:11.759994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25edcc9-4ad2-4e24-a052-0b16e8973be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:11.760436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25edcc9-4ad2-4e24-a052-0b16e8973be0 admin admin] PATH_INFO: `/v3/projects/b0afe6bde6aa4c1dbe9a01c553ee801f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:11.762027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25edcc9-4ad2-4e24-a052-0b16e8973be0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0afe6bde6aa4c1dbe9a01c553ee801f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:11.764612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25edcc9-4ad2-4e24-a052-0b16e8973be0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:11.868604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:11.898836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a25edcc9-4ad2-4e24-a052-0b16e8973be0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'request_id': 'req-a25edcc9-4ad2-4e24-a052-0b16e8973be0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:11.909988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a25edcc9-4ad2-4e24-a052-0b16e8973be0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'request_id': 'req-a25edcc9-4ad2-4e24-a052-0b16e8973be0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:11.924349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a25edcc9-4ad2-4e24-a052-0b16e8973be0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'request_id': 'req-a25edcc9-4ad2-4e24-a052-0b16e8973be0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:11.946022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a25edcc9-4ad2-4e24-a052-0b16e8973be0 admin admin] The token cache is being invalidate because project b0afe6bde6aa4c1dbe9a01c553ee801f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:03:11.946614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a25edcc9-4ad2-4e24-a052-0b16e8973be0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:11.949077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a25edcc9-4ad2-4e24-a052-0b16e8973be0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:11.951607 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1298/2600] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:11 2022] DELETE /identity/v3/projects/b0afe6bde6aa4c1dbe9a01c553ee801f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:03:11.955931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2634a3-ff49-435f-86b2-f065adbde173 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:11.966822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2634a3-ff49-435f-86b2-f065adbde173 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:12.085024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c38b5-ff6f-481f-aab2-852e01238710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:12.086051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c38b5-ff6f-481f-aab2-852e01238710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:12.086492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c38b5-ff6f-481f-aab2-852e01238710 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:12.086958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c38b5-ff6f-481f-aab2-852e01238710 admin admin] PATH_INFO: `/v3/users/1d40a8830d3a44c2b9c9661843a65929` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:12.089095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c38b5-ff6f-481f-aab2-852e01238710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d40a8830d3a44c2b9c9661843a65929)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:12.092072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c38b5-ff6f-481f-aab2-852e01238710 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:12.172731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e3c38b5-ff6f-481f-aab2-852e01238710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d40a8830d3a44c2b9c9661843a65929'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:12.173979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e3c38b5-ff6f-481f-aab2-852e01238710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d40a8830d3a44c2b9c9661843a65929'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:12.186679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e3c38b5-ff6f-481f-aab2-852e01238710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d40a8830d3a44c2b9c9661843a65929'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:12.187600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e3c38b5-ff6f-481f-aab2-852e01238710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d40a8830d3a44c2b9c9661843a65929'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:12.189497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:12.196347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e3c38b5-ff6f-481f-aab2-852e01238710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d40a8830d3a44c2b9c9661843a65929'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:12.211851 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1303/2601] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:03:11 2022] DELETE /identity/v3/users/1d40a8830d3a44c2b9c9661843a65929 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:03:12.492631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25edcc9-4ad2-4e24-a052-0b16e8973be0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:12.494114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a25edcc9-4ad2-4e24-a052-0b16e8973be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:12.509209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25edcc9-4ad2-4e24-a052-0b16e8973be0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:12.582031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f14d4-2809-454c-93e8-4083776bcc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:12.582696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f14d4-2809-454c-93e8-4083776bcc2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:12.582978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f14d4-2809-454c-93e8-4083776bcc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:12.583258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f14d4-2809-454c-93e8-4083776bcc2d admin admin] PATH_INFO: `/v3/projects/ff5c9bc01f33450e9670f5fd5bdf556f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:12.584525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f14d4-2809-454c-93e8-4083776bcc2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff5c9bc01f33450e9670f5fd5bdf556f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:12.586474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f14d4-2809-454c-93e8-4083776bcc2d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:12.653401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-355f14d4-2809-454c-93e8-4083776bcc2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff5c9bc01f33450e9670f5fd5bdf556f', 'request_id': 'req-355f14d4-2809-454c-93e8-4083776bcc2d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:12.659868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-355f14d4-2809-454c-93e8-4083776bcc2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff5c9bc01f33450e9670f5fd5bdf556f', 'request_id': 'req-355f14d4-2809-454c-93e8-4083776bcc2d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:12.668794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-355f14d4-2809-454c-93e8-4083776bcc2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff5c9bc01f33450e9670f5fd5bdf556f', 'request_id': 'req-355f14d4-2809-454c-93e8-4083776bcc2d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:12.680374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-355f14d4-2809-454c-93e8-4083776bcc2d admin admin] The token cache is being invalidate because project ff5c9bc01f33450e9670f5fd5bdf556f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:03:12.680666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-355f14d4-2809-454c-93e8-4083776bcc2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:12.681293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-355f14d4-2809-454c-93e8-4083776bcc2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:12.682825 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1299/2602] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:12 2022] DELETE /identity/v3/projects/ff5c9bc01f33450e9670f5fd5bdf556f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:03:12.688402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162e745-3995-4a40-82b5-745c08b50801 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:12.688696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162e745-3995-4a40-82b5-745c08b50801 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:12.688971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162e745-3995-4a40-82b5-745c08b50801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:12.709927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d162e745-3995-4a40-82b5-745c08b50801 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:03:12.711417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d162e745-3995-4a40-82b5-745c08b50801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:12.779916 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1304/2603] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:03:12.787868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8761f4-2c86-429d-a630-f3303f0b7124 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:12.788371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8761f4-2c86-429d-a630-f3303f0b7124 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:12.788472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8761f4-2c86-429d-a630-f3303f0b7124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:12.812849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5e8761f4-2c86-429d-a630-f3303f0b7124 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:03:12.814437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5e8761f4-2c86-429d-a630-f3303f0b7124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:12.823892 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1300/2604] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:03:12.828159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162e745-3995-4a40-82b5-745c08b50801 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:12.838655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162e745-3995-4a40-82b5-745c08b50801 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:12.843854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3a076-42eb-418f-9a6a-423202495006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:12.844476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3a076-42eb-418f-9a6a-423202495006 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:12.844759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3a076-42eb-418f-9a6a-423202495006 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:12.845030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3a076-42eb-418f-9a6a-423202495006 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:12.845728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3a076-42eb-418f-9a6a-423202495006 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:03:12.846028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3a076-42eb-418f-9a6a-423202495006 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:12.847675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3a076-42eb-418f-9a6a-423202495006 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:12.867191 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1305/2605] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:03:12.872660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8761f4-2c86-429d-a630-f3303f0b7124 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:12.891087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8761f4-2c86-429d-a630-f3303f0b7124 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:12.896468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349894b-6316-4c26-9281-cb44a267a60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:12.897158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349894b-6316-4c26-9281-cb44a267a60c admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:12.897440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349894b-6316-4c26-9281-cb44a267a60c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:12.897898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349894b-6316-4c26-9281-cb44a267a60c admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:12.898582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349894b-6316-4c26-9281-cb44a267a60c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:12.900564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349894b-6316-4c26-9281-cb44a267a60c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:12.933979 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1301/2606] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:03:12 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:03:12.938828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3a076-42eb-418f-9a6a-423202495006 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:12.951015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3a076-42eb-418f-9a6a-423202495006 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:13.049940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fa390-7154-48f0-8a3a-1ce8ddd13317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:13.050667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fa390-7154-48f0-8a3a-1ce8ddd13317 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:13.050879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fa390-7154-48f0-8a3a-1ce8ddd13317 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:13.052031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fa390-7154-48f0-8a3a-1ce8ddd13317 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:13.052901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fa390-7154-48f0-8a3a-1ce8ddd13317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:13.055549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fa390-7154-48f0-8a3a-1ce8ddd13317 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:13.092039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349894b-6316-4c26-9281-cb44a267a60c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:13.100894 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1306/2607] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:03:12 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:03:13.110230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349894b-6316-4c26-9281-cb44a267a60c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:13.118096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846b78b-1599-4f07-919b-e06fcfc6b672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:13.119029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846b78b-1599-4f07-919b-e06fcfc6b672 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:13.120035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846b78b-1599-4f07-919b-e06fcfc6b672 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:13.120823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846b78b-1599-4f07-919b-e06fcfc6b672 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:13.122125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846b78b-1599-4f07-919b-e06fcfc6b672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:13.124624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846b78b-1599-4f07-919b-e06fcfc6b672 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:13.146665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fa390-7154-48f0-8a3a-1ce8ddd13317 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:13.155047 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1302/2608] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:03:13.163131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fa390-7154-48f0-8a3a-1ce8ddd13317 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:13.176083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c66b27-f458-480c-9c31-f2431af370dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:13.176885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c66b27-f458-480c-9c31-f2431af370dd admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:13.177180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c66b27-f458-480c-9c31-f2431af370dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:13.177605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c66b27-f458-480c-9c31-f2431af370dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:13.182813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c66b27-f458-480c-9c31-f2431af370dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:13.184514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c66b27-f458-480c-9c31-f2431af370dd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:13.212184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846b78b-1599-4f07-919b-e06fcfc6b672 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:13.222165 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1307/2609] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:03:13.226708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846b78b-1599-4f07-919b-e06fcfc6b672 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:13.238644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccb1c7-df0e-4336-b9df-6a335efb9e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:13.239480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccb1c7-df0e-4336-b9df-6a335efb9e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:13.239849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccb1c7-df0e-4336-b9df-6a335efb9e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:13.240204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccb1c7-df0e-4336-b9df-6a335efb9e72 admin admin] PATH_INFO: `/v3/projects/ae99b18c49be443e96955fd4ea16630f/users/dea0b28116c64ba8ad7d6f83e63762d7/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:13.281350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:13.294545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccb1c7-df0e-4336-b9df-6a335efb9e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae99b18c49be443e96955fd4ea16630f, user_id=dea0b28116c64ba8ad7d6f83e63762d7, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:13.303117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccb1c7-df0e-4336-b9df-6a335efb9e72 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:13.363522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d578a47-5056-418b-b8ab-041de5f5872a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:13.363672 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1303/2610] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:03:13 2022] PUT /identity/v3/projects/ae99b18c49be443e96955fd4ea16630f/users/dea0b28116c64ba8ad7d6f83e63762d7/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:03:13.364112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d578a47-5056-418b-b8ab-041de5f5872a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:13.364560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d578a47-5056-418b-b8ab-041de5f5872a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:13.424293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3d578a47-5056-418b-b8ab-041de5f5872a None None] MFA Rules not processed for user `dea0b28116c64ba8ad7d6f83e63762d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:03:13.425526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3d578a47-5056-418b-b8ab-041de5f5872a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:13.509277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:13.586511 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1308/2611] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:03:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:03:13.588705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccb1c7-df0e-4336-b9df-6a335efb9e72 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:13.681060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccb1c7-df0e-4336-b9df-6a335efb9e72 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:13.690927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5582bf-80b1-4837-b735-f39b4e786932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:13.691675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5582bf-80b1-4837-b735-f39b4e786932 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:13.692032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5582bf-80b1-4837-b735-f39b4e786932 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:13.692497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5582bf-80b1-4837-b735-f39b4e786932 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:13.693320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5582bf-80b1-4837-b735-f39b4e786932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:13.697518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5582bf-80b1-4837-b735-f39b4e786932 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:13.756736 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1304/2612] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:03:13 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:03:13.766893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d578a47-5056-418b-b8ab-041de5f5872a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:13.809769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d578a47-5056-418b-b8ab-041de5f5872a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:13.939810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fd16f-c5e4-4831-a69f-aec8d1127f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:13.940482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fd16f-c5e4-4831-a69f-aec8d1127f06 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:13.940806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fd16f-c5e4-4831-a69f-aec8d1127f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:13.941096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fd16f-c5e4-4831-a69f-aec8d1127f06 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:13.941855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fd16f-c5e4-4831-a69f-aec8d1127f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:13.943873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fd16f-c5e4-4831-a69f-aec8d1127f06 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:13.976320 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1309/2613] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:03:13 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:03:13.980089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5582bf-80b1-4837-b735-f39b4e786932 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:13.992632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5582bf-80b1-4837-b735-f39b4e786932 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:14.020897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb00d63-b7dc-4158-89f9-612c312636f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:14.021530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb00d63-b7dc-4158-89f9-612c312636f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:14.022109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb00d63-b7dc-4158-89f9-612c312636f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:14.022538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb00d63-b7dc-4158-89f9-612c312636f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:14.024119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb00d63-b7dc-4158-89f9-612c312636f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:14.027028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb00d63-b7dc-4158-89f9-612c312636f1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:14.055523 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1305/2614] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:03:14.058482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fd16f-c5e4-4831-a69f-aec8d1127f06 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:14.079788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fd16f-c5e4-4831-a69f-aec8d1127f06 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:14.097367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1527ec3-0a48-47d1-a447-aec9fab4142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:14.098267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1527ec3-0a48-47d1-a447-aec9fab4142d admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:14.098607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1527ec3-0a48-47d1-a447-aec9fab4142d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:14.098892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1527ec3-0a48-47d1-a447-aec9fab4142d admin admin] PATH_INFO: `/v3/projects/fdd5a5b366e441ba8a398ca5a98fcc88/users/aa9fb6bd059840d8afa3eb139d00c2af/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:14.137617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1527ec3-0a48-47d1-a447-aec9fab4142d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdd5a5b366e441ba8a398ca5a98fcc88, user_id=aa9fb6bd059840d8afa3eb139d00c2af, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:14.141396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1527ec3-0a48-47d1-a447-aec9fab4142d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:14.162578 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1310/2615] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:03:14 2022] PUT /identity/v3/projects/fdd5a5b366e441ba8a398ca5a98fcc88/users/aa9fb6bd059840d8afa3eb139d00c2af/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:03:14.166891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb00d63-b7dc-4158-89f9-612c312636f1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:14.191004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb00d63-b7dc-4158-89f9-612c312636f1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:14.286590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2863c-56a9-481b-974a-0530f64053fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:14.287231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2863c-56a9-481b-974a-0530f64053fe admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:14.287546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2863c-56a9-481b-974a-0530f64053fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:14.287819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2863c-56a9-481b-974a-0530f64053fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:14.288524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2863c-56a9-481b-974a-0530f64053fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:14.290574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2863c-56a9-481b-974a-0530f64053fe admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:14.305998 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1306/2616] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:03:14.307193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1527ec3-0a48-47d1-a447-aec9fab4142d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:14.326059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1527ec3-0a48-47d1-a447-aec9fab4142d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:14.331738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422fbca-b392-440d-b8c1-3eb3dde536ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:14.332445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422fbca-b392-440d-b8c1-3eb3dde536ea admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:14.332790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422fbca-b392-440d-b8c1-3eb3dde536ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:14.333073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422fbca-b392-440d-b8c1-3eb3dde536ea admin admin] PATH_INFO: `/v3/projects/fdd5a5b366e441ba8a398ca5a98fcc88/users/aa9fb6bd059840d8afa3eb139d00c2af/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:14.335403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422fbca-b392-440d-b8c1-3eb3dde536ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdd5a5b366e441ba8a398ca5a98fcc88, user_id=aa9fb6bd059840d8afa3eb139d00c2af, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:14.338739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422fbca-b392-440d-b8c1-3eb3dde536ea admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:14.367282 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1311/2617] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:03:14 2022] PUT /identity/v3/projects/fdd5a5b366e441ba8a398ca5a98fcc88/users/aa9fb6bd059840d8afa3eb139d00c2af/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:03:14.378674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76869eb4-c1d3-4906-b7ae-86ae882016bf None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:14.379055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76869eb4-c1d3-4906-b7ae-86ae882016bf None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:14.379372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76869eb4-c1d3-4906-b7ae-86ae882016bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:14.447152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-76869eb4-c1d3-4906-b7ae-86ae882016bf None None] MFA Rules not processed for user `aa9fb6bd059840d8afa3eb139d00c2af`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:03:14.447394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422fbca-b392-440d-b8c1-3eb3dde536ea admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:14.448537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-76869eb4-c1d3-4906-b7ae-86ae882016bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:14.449535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f422fbca-b392-440d-b8c1-3eb3dde536ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:14.573127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:14.581931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422fbca-b392-440d-b8c1-3eb3dde536ea admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:14.589364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0764d2c-9c1b-41e1-8acb-14c45c677e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:14.590399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0764d2c-9c1b-41e1-8acb-14c45c677e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:14.590842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0764d2c-9c1b-41e1-8acb-14c45c677e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:14.591280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0764d2c-9c1b-41e1-8acb-14c45c677e6e admin admin] PATH_INFO: `/v3/users/b24f7b4041c14620becd719b26e058d3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:14.597052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0764d2c-9c1b-41e1-8acb-14c45c677e6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b24f7b4041c14620becd719b26e058d3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:14.599579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0764d2c-9c1b-41e1-8acb-14c45c677e6e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:14.628464 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1307/2618] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:03:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:03:14.639036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf4f7a-618d-48d0-bbcf-70dfe2341f80 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:14.639350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf4f7a-618d-48d0-bbcf-70dfe2341f80 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:14.639636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf4f7a-618d-48d0-bbcf-70dfe2341f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:14.667138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9cdf4f7a-618d-48d0-bbcf-70dfe2341f80 None None] MFA Rules not processed for user `dea0b28116c64ba8ad7d6f83e63762d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:03:14.668717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9cdf4f7a-618d-48d0-bbcf-70dfe2341f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:14.682507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:14.718904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e0764d2c-9c1b-41e1-8acb-14c45c677e6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b24f7b4041c14620becd719b26e058d3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:14.719900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e0764d2c-9c1b-41e1-8acb-14c45c677e6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b24f7b4041c14620becd719b26e058d3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:14.756246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e0764d2c-9c1b-41e1-8acb-14c45c677e6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b24f7b4041c14620becd719b26e058d3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:14.757057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e0764d2c-9c1b-41e1-8acb-14c45c677e6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b24f7b4041c14620becd719b26e058d3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:14.764030 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1308/2619] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:03:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:03:14.784459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e0764d2c-9c1b-41e1-8acb-14c45c677e6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b24f7b4041c14620becd719b26e058d3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:14.809695 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1312/2620] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:03:14 2022] DELETE /identity/v3/users/b24f7b4041c14620becd719b26e058d3 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:03:15.068520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf4f7a-618d-48d0-bbcf-70dfe2341f80 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:15.071499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9cdf4f7a-618d-48d0-bbcf-70dfe2341f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:15.226478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf4f7a-618d-48d0-bbcf-70dfe2341f80 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:15.302355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0764d2c-9c1b-41e1-8acb-14c45c677e6e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:15.304831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e0764d2c-9c1b-41e1-8acb-14c45c677e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:15.339435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34924bf2-eb51-4b59-b892-7684d4c93f79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:15.340100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34924bf2-eb51-4b59-b892-7684d4c93f79 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:15.340717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34924bf2-eb51-4b59-b892-7684d4c93f79 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:15.341006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34924bf2-eb51-4b59-b892-7684d4c93f79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:15.345348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-34924bf2-eb51-4b59-b892-7684d4c93f79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:15.420119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:15.465722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0764d2c-9c1b-41e1-8acb-14c45c677e6e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:15.474610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241e859-838d-4880-9dd5-d15726335b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:15.475878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241e859-838d-4880-9dd5-d15726335b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:15.476518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241e859-838d-4880-9dd5-d15726335b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:15.477157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241e859-838d-4880-9dd5-d15726335b88 admin admin] PATH_INFO: `/v3/projects/1363f5fe83df486c98932c724ad93fc2` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:15.478917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241e859-838d-4880-9dd5-d15726335b88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1363f5fe83df486c98932c724ad93fc2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:15.479870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34924bf2-eb51-4b59-b892-7684d4c93f79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:15.481474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34924bf2-eb51-4b59-b892-7684d4c93f79 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:15.481739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241e859-838d-4880-9dd5-d15726335b88 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:15.495635 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1309/2621] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:03:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:03:15.564656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4241e859-838d-4880-9dd5-d15726335b88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1363f5fe83df486c98932c724ad93fc2', 'request_id': 'req-4241e859-838d-4880-9dd5-d15726335b88'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:15.578646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4241e859-838d-4880-9dd5-d15726335b88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1363f5fe83df486c98932c724ad93fc2', 'request_id': 'req-4241e859-838d-4880-9dd5-d15726335b88'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:15.596177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4241e859-838d-4880-9dd5-d15726335b88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1363f5fe83df486c98932c724ad93fc2', 'request_id': 'req-4241e859-838d-4880-9dd5-d15726335b88'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:15.616113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4241e859-838d-4880-9dd5-d15726335b88 admin admin] The token cache is being invalidate because project 1363f5fe83df486c98932c724ad93fc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:03:15.617165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4241e859-838d-4880-9dd5-d15726335b88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:15.619526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4241e859-838d-4880-9dd5-d15726335b88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:15.625186 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1313/2622] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:15 2022] DELETE /identity/v3/projects/1363f5fe83df486c98932c724ad93fc2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:03:15.631145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dd687-ddfc-4d04-b324-cd8987f8a843 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:15.631536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dd687-ddfc-4d04-b324-cd8987f8a843 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:15.631899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dd687-ddfc-4d04-b324-cd8987f8a843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:15.670653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-aa7dd687-ddfc-4d04-b324-cd8987f8a843 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:03:15.672520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-aa7dd687-ddfc-4d04-b324-cd8987f8a843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:15.818137 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1310/2623] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:03:15.913150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9157c9-afdb-42cb-87ce-54cf35b73916 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:15.916833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9157c9-afdb-42cb-87ce-54cf35b73916 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:15.917204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9157c9-afdb-42cb-87ce-54cf35b73916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:15.975453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8a9157c9-afdb-42cb-87ce-54cf35b73916 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:03:15.979886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8a9157c9-afdb-42cb-87ce-54cf35b73916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:16.027658 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1314/2624] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:03:16.032256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dd687-ddfc-4d04-b324-cd8987f8a843 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:16.045063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dd687-ddfc-4d04-b324-cd8987f8a843 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:16.052711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720313e5-0c3a-4cad-8087-f8405c929377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:16.053481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720313e5-0c3a-4cad-8087-f8405c929377 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:16.053827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720313e5-0c3a-4cad-8087-f8405c929377 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:16.055353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720313e5-0c3a-4cad-8087-f8405c929377 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:16.055838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720313e5-0c3a-4cad-8087-f8405c929377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:03:16.058573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720313e5-0c3a-4cad-8087-f8405c929377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:16.063916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720313e5-0c3a-4cad-8087-f8405c929377 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:16.125405 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1311/2625] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:03:16.130307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9157c9-afdb-42cb-87ce-54cf35b73916 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:16.145911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9157c9-afdb-42cb-87ce-54cf35b73916 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:16.151255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894e2e8-a580-4f1c-a82c-f7d856d1c1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:16.155869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894e2e8-a580-4f1c-a82c-f7d856d1c1f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:16.155869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894e2e8-a580-4f1c-a82c-f7d856d1c1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:16.155869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894e2e8-a580-4f1c-a82c-f7d856d1c1f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:16.156446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894e2e8-a580-4f1c-a82c-f7d856d1c1f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:16.158351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894e2e8-a580-4f1c-a82c-f7d856d1c1f4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:16.227610 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1315/2626] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:03:16 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:03:16.232176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720313e5-0c3a-4cad-8087-f8405c929377 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:16.250014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720313e5-0c3a-4cad-8087-f8405c929377 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:16.347966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b86d17-3262-4a8c-a64a-378e529c73df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:16.351845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b86d17-3262-4a8c-a64a-378e529c73df admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:16.352138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b86d17-3262-4a8c-a64a-378e529c73df admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:16.352420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b86d17-3262-4a8c-a64a-378e529c73df admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:16.353122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b86d17-3262-4a8c-a64a-378e529c73df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:16.359633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b86d17-3262-4a8c-a64a-378e529c73df admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:16.395526 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1312/2627] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:03:16 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:03:16.399419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894e2e8-a580-4f1c-a82c-f7d856d1c1f4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:16.413205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894e2e8-a580-4f1c-a82c-f7d856d1c1f4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:16.420593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c552419-672a-49d4-8e2b-6f6bc323f7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:16.421975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c552419-672a-49d4-8e2b-6f6bc323f7bd admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:16.422261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c552419-672a-49d4-8e2b-6f6bc323f7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:16.422535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c552419-672a-49d4-8e2b-6f6bc323f7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:16.423241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c552419-672a-49d4-8e2b-6f6bc323f7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:16.425050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c552419-672a-49d4-8e2b-6f6bc323f7bd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:16.432976 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:16.441795 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1316/2628] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:03:16.445930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b86d17-3262-4a8c-a64a-378e529c73df admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:16.469527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b86d17-3262-4a8c-a64a-378e529c73df admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:16.476566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeee6a1-c357-4630-8368-c41f4b774c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:16.477475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeee6a1-c357-4630-8368-c41f4b774c86 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:16.478084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeee6a1-c357-4630-8368-c41f4b774c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:16.478536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeee6a1-c357-4630-8368-c41f4b774c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:16.479548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeee6a1-c357-4630-8368-c41f4b774c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:16.481914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeee6a1-c357-4630-8368-c41f4b774c86 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:16.498538 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1313/2629] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:03:16.501106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c552419-672a-49d4-8e2b-6f6bc323f7bd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:16.511739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c552419-672a-49d4-8e2b-6f6bc323f7bd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:16.518956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd4229-e3f6-41c4-b8e8-f43e9264593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:16.519799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd4229-e3f6-41c4-b8e8-f43e9264593b admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:16.520081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd4229-e3f6-41c4-b8e8-f43e9264593b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:16.520399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd4229-e3f6-41c4-b8e8-f43e9264593b admin admin] PATH_INFO: `/v3/projects/12e516b713ea41b5a6586035cc755589/users/73d81ad63c23451f9d9235f1faba50d1/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:16.538007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd4229-e3f6-41c4-b8e8-f43e9264593b admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e516b713ea41b5a6586035cc755589, user_id=73d81ad63c23451f9d9235f1faba50d1, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:16.540769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd4229-e3f6-41c4-b8e8-f43e9264593b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:16.560853 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1317/2630] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:03:16 2022] PUT /identity/v3/projects/12e516b713ea41b5a6586035cc755589/users/73d81ad63c23451f9d9235f1faba50d1/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:03:16.571925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca319b19-bc2a-4796-b45a-d5bf66c8f5b6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:16.572217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca319b19-bc2a-4796-b45a-d5bf66c8f5b6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:16.572496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca319b19-bc2a-4796-b45a-d5bf66c8f5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:16.620977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ca319b19-bc2a-4796-b45a-d5bf66c8f5b6 None None] MFA Rules not processed for user `73d81ad63c23451f9d9235f1faba50d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:03:16.622337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ca319b19-bc2a-4796-b45a-d5bf66c8f5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:16.644583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:16.702450 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1314/2631] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:03:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:03:16.713583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d79b4f-3e34-42ab-b2fb-515dbac2df96 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:16.713879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d79b4f-3e34-42ab-b2fb-515dbac2df96 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:16.714159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d79b4f-3e34-42ab-b2fb-515dbac2df96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:16.737806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-21d79b4f-3e34-42ab-b2fb-515dbac2df96 None None] MFA Rules not processed for user `73d81ad63c23451f9d9235f1faba50d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:03:16.739046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-21d79b4f-3e34-42ab-b2fb-515dbac2df96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:16.746694 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1318/2632] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:03:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:03:16.762945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca319b19-bc2a-4796-b45a-d5bf66c8f5b6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:16.768272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ca319b19-bc2a-4796-b45a-d5bf66c8f5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:16.848555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca319b19-bc2a-4796-b45a-d5bf66c8f5b6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:16.854150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8534e-a585-42d9-b38b-8d78b6d86b01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:16.854769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8534e-a585-42d9-b38b-8d78b6d86b01 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:16.855052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8534e-a585-42d9-b38b-8d78b6d86b01 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:16.855379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8534e-a585-42d9-b38b-8d78b6d86b01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:16.864175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8534e-a585-42d9-b38b-8d78b6d86b01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:16.865746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8534e-a585-42d9-b38b-8d78b6d86b01 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:16.874850 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1315/2633] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:03:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:03:26.731246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=13,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:26.870725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=52 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:33.882669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d79b4f-3e34-42ab-b2fb-515dbac2df96 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:33.884287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-21d79b4f-3e34-42ab-b2fb-515dbac2df96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:33.964276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d79b4f-3e34-42ab-b2fb-515dbac2df96 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:33.972623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c2b77-967a-45f2-bfcc-85de519305d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:33.973522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c2b77-967a-45f2-bfcc-85de519305d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:33.973812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c2b77-967a-45f2-bfcc-85de519305d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:33.974141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c2b77-967a-45f2-bfcc-85de519305d6 admin admin] PATH_INFO: `/v3/users/85f0c582040c43b1b27791cb66656e9e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:33.975432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c2b77-967a-45f2-bfcc-85de519305d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85f0c582040c43b1b27791cb66656e9e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:33.977423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c2b77-967a-45f2-bfcc-85de519305d6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:34.035617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a50c2b77-967a-45f2-bfcc-85de519305d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85f0c582040c43b1b27791cb66656e9e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:34.036295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a50c2b77-967a-45f2-bfcc-85de519305d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85f0c582040c43b1b27791cb66656e9e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:34.053666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a50c2b77-967a-45f2-bfcc-85de519305d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85f0c582040c43b1b27791cb66656e9e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:34.055520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a50c2b77-967a-45f2-bfcc-85de519305d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85f0c582040c43b1b27791cb66656e9e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:34.065300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a50c2b77-967a-45f2-bfcc-85de519305d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85f0c582040c43b1b27791cb66656e9e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:34.086800 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1319/2634] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:03:33 2022] DELETE /identity/v3/users/85f0c582040c43b1b27791cb66656e9e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:03:34.355838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8534e-a585-42d9-b38b-8d78b6d86b01 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:34.398901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8534e-a585-42d9-b38b-8d78b6d86b01 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:34.540590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbeaca-8bf5-4b48-94aa-ea13aa2a2d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:34.541250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbeaca-8bf5-4b48-94aa-ea13aa2a2d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:34.541535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbeaca-8bf5-4b48-94aa-ea13aa2a2d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:34.541813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbeaca-8bf5-4b48-94aa-ea13aa2a2d17 admin admin] PATH_INFO: `/v3/projects/0a256de385094348b6c03bcd2eab0d6f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:34.543019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbeaca-8bf5-4b48-94aa-ea13aa2a2d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a256de385094348b6c03bcd2eab0d6f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:34.545365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbeaca-8bf5-4b48-94aa-ea13aa2a2d17 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:34.614256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-edcbeaca-8bf5-4b48-94aa-ea13aa2a2d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a256de385094348b6c03bcd2eab0d6f', 'request_id': 'req-edcbeaca-8bf5-4b48-94aa-ea13aa2a2d17'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:34.622859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-edcbeaca-8bf5-4b48-94aa-ea13aa2a2d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a256de385094348b6c03bcd2eab0d6f', 'request_id': 'req-edcbeaca-8bf5-4b48-94aa-ea13aa2a2d17'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:34.638820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88594d4-a9ba-4685-b02f-21848f419957 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:34.639782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88594d4-a9ba-4685-b02f-21848f419957 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:34.640182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88594d4-a9ba-4685-b02f-21848f419957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:34.641838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-edcbeaca-8bf5-4b48-94aa-ea13aa2a2d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a256de385094348b6c03bcd2eab0d6f', 'request_id': 'req-edcbeaca-8bf5-4b48-94aa-ea13aa2a2d17'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:34.660382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-edcbeaca-8bf5-4b48-94aa-ea13aa2a2d17 admin admin] The token cache is being invalidate because project 0a256de385094348b6c03bcd2eab0d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:03:34.661688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-edcbeaca-8bf5-4b48-94aa-ea13aa2a2d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:34.662721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-edcbeaca-8bf5-4b48-94aa-ea13aa2a2d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:03:34.668154 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1316/2635] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:34 2022] DELETE /identity/v3/projects/0a256de385094348b6c03bcd2eab0d6f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:03:34.668331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b88594d4-a9ba-4685-b02f-21848f419957 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:03:34.668331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b88594d4-a9ba-4685-b02f-21848f419957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:34.669709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332e972-abef-444c-a76b-a42f9d9d2f6b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:34.670008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332e972-abef-444c-a76b-a42f9d9d2f6b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:34.670327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332e972-abef-444c-a76b-a42f9d9d2f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:34.697428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0332e972-abef-444c-a76b-a42f9d9d2f6b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:03:34.698708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0332e972-abef-444c-a76b-a42f9d9d2f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:34.775698 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1320/2636] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:03:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:03:34.806163 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1317/2637] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:03:34.818616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cfbf0-565c-40ac-b2db-bfbf10799578 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:34.819212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cfbf0-565c-40ac-b2db-bfbf10799578 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:34.819768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cfbf0-565c-40ac-b2db-bfbf10799578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:34.837829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332e972-abef-444c-a76b-a42f9d9d2f6b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:34.839995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0332e972-abef-444c-a76b-a42f9d9d2f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:34.857010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-329cfbf0-565c-40ac-b2db-bfbf10799578 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:03:34.858456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-329cfbf0-565c-40ac-b2db-bfbf10799578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:34.869997 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1321/2638] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:03:34.875531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cfbf0-565c-40ac-b2db-bfbf10799578 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:34.883259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:34.885664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cfbf0-565c-40ac-b2db-bfbf10799578 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:34.892455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf7506-982d-4f7a-9e31-19ed9e866963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:34.893206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf7506-982d-4f7a-9e31-19ed9e866963 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:34.893580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf7506-982d-4f7a-9e31-19ed9e866963 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:34.893953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf7506-982d-4f7a-9e31-19ed9e866963 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:34.894997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf7506-982d-4f7a-9e31-19ed9e866963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:03:34.895483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf7506-982d-4f7a-9e31-19ed9e866963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:34.897656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf7506-982d-4f7a-9e31-19ed9e866963 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:34.911334 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1322/2639] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:03:34.916266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf7506-982d-4f7a-9e31-19ed9e866963 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:34.922702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:34.925746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332e972-abef-444c-a76b-a42f9d9d2f6b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:34.926490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf7506-982d-4f7a-9e31-19ed9e866963 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:34.931001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3742d9-831a-453d-825a-4066b31e42ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:34.931675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3742d9-831a-453d-825a-4066b31e42ed service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:34.931972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3742d9-831a-453d-825a-4066b31e42ed service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:34.932235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3742d9-831a-453d-825a-4066b31e42ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:34.933475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71118517-878f-44f5-9d69-a1526681c94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:34.935682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71118517-878f-44f5-9d69-a1526681c94c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:34.936576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71118517-878f-44f5-9d69-a1526681c94c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:34.937071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71118517-878f-44f5-9d69-a1526681c94c admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:34.938032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71118517-878f-44f5-9d69-a1526681c94c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:34.940853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71118517-878f-44f5-9d69-a1526681c94c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:34.941810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3742d9-831a-453d-825a-4066b31e42ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:34.943701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3742d9-831a-453d-825a-4066b31e42ed service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:34.953904 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1318/2640] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:03:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:03:34.978201 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1323/2641] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:03:34 2022] POST /identity/v3/projects => generated 363 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:03:34.987253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3742d9-831a-453d-825a-4066b31e42ed service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:35.029800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3742d9-831a-453d-825a-4066b31e42ed service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:35.180781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b88f7-b292-4999-bd7a-c73cb5258a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:35.181447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b88f7-b292-4999-bd7a-c73cb5258a78 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:35.181739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b88f7-b292-4999-bd7a-c73cb5258a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:35.182028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b88f7-b292-4999-bd7a-c73cb5258a78 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:35.182715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b88f7-b292-4999-bd7a-c73cb5258a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:35.184760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b88f7-b292-4999-bd7a-c73cb5258a78 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:35.233146 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1319/2642] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:03:34 2022] POST /identity/v3/users => generated 282 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:03:35.234762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71118517-878f-44f5-9d69-a1526681c94c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:35.255860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71118517-878f-44f5-9d69-a1526681c94c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:35.274757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1f645-d86d-412c-8184-3ac3e6a29702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:35.275450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1f645-d86d-412c-8184-3ac3e6a29702 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:35.278914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1f645-d86d-412c-8184-3ac3e6a29702 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:35.279245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1f645-d86d-412c-8184-3ac3e6a29702 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:35.280655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1f645-d86d-412c-8184-3ac3e6a29702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:35.282297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1f645-d86d-412c-8184-3ac3e6a29702 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:35.313128 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1324/2643] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:03:35.314396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b88f7-b292-4999-bd7a-c73cb5258a78 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:35.329504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b88f7-b292-4999-bd7a-c73cb5258a78 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:35.334871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5050d-64c2-400a-8718-760bad082dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:35.335718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5050d-64c2-400a-8718-760bad082dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:35.336072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5050d-64c2-400a-8718-760bad082dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:35.336423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5050d-64c2-400a-8718-760bad082dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:35.337196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5050d-64c2-400a-8718-760bad082dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:35.338874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5050d-64c2-400a-8718-760bad082dc9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:35.354142 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1320/2644] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:03:35.355923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1f645-d86d-412c-8184-3ac3e6a29702 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:35.366811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1f645-d86d-412c-8184-3ac3e6a29702 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:35.375461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d4148-bf30-44ef-aa9c-a20cc4f99d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:35.375461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d4148-bf30-44ef-aa9c-a20cc4f99d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:35.375461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d4148-bf30-44ef-aa9c-a20cc4f99d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:35.375461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d4148-bf30-44ef-aa9c-a20cc4f99d67 admin admin] PATH_INFO: `/v3/projects/afa530811f1f43aeb7957b6cd28d4653/users/8379e04d2b30488387b3eefab6669768/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:35.398718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d4148-bf30-44ef-aa9c-a20cc4f99d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa530811f1f43aeb7957b6cd28d4653, user_id=8379e04d2b30488387b3eefab6669768, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:35.400114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d4148-bf30-44ef-aa9c-a20cc4f99d67 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:35.425481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae8800-f28d-4596-8f77-9cee3182ead6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:35.429323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae8800-f28d-4596-8f77-9cee3182ead6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:35.429323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae8800-f28d-4596-8f77-9cee3182ead6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:35.431754 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1325/2645] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:03:35 2022] PUT /identity/v3/projects/afa530811f1f43aeb7957b6cd28d4653/users/8379e04d2b30488387b3eefab6669768/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:03:35.459324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-72ae8800-f28d-4596-8f77-9cee3182ead6 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:03:35.461801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-72ae8800-f28d-4596-8f77-9cee3182ead6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:35.559331 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1321/2646] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:03:35.568602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d4148-bf30-44ef-aa9c-a20cc4f99d67 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:35.571274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dd3d4148-bf30-44ef-aa9c-a20cc4f99d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:35.663416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d4148-bf30-44ef-aa9c-a20cc4f99d67 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:35.669014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f39206-9d75-4a33-b057-3af956819bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:35.671076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f39206-9d75-4a33-b057-3af956819bfb service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:35.671893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f39206-9d75-4a33-b057-3af956819bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:35.672427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f39206-9d75-4a33-b057-3af956819bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:35.683347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f39206-9d75-4a33-b057-3af956819bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:35.684728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f39206-9d75-4a33-b057-3af956819bfb service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:35.710074 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1326/2647] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:03:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:03:40.435666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae8800-f28d-4596-8f77-9cee3182ead6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:40.437806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-72ae8800-f28d-4596-8f77-9cee3182ead6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:40.564687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:40.648358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae8800-f28d-4596-8f77-9cee3182ead6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:40.667976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372f301-4faf-421e-9c7e-84f8a238900d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:40.668633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372f301-4faf-421e-9c7e-84f8a238900d service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:40.668918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372f301-4faf-421e-9c7e-84f8a238900d service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:40.669196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372f301-4faf-421e-9c7e-84f8a238900d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:40.675873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f372f301-4faf-421e-9c7e-84f8a238900d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:40.839252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372f301-4faf-421e-9c7e-84f8a238900d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:40.841074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372f301-4faf-421e-9c7e-84f8a238900d service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:40.856847 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1322/2648] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:03:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:03:42.286339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02922115-1549-4c5b-acf7-eb80c8a1f4c9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:42.286914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02922115-1549-4c5b-acf7-eb80c8a1f4c9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:42.287112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02922115-1549-4c5b-acf7-eb80c8a1f4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:42.334311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-02922115-1549-4c5b-acf7-eb80c8a1f4c9 None None] MFA Rules not processed for user `8379e04d2b30488387b3eefab6669768`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:03:42.336915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-02922115-1549-4c5b-acf7-eb80c8a1f4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:42.470265 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1327/2649] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:03:42 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:03:42.473905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b864f-34c5-498f-a527-770696b231fa None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:42.474408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b864f-34c5-498f-a527-770696b231fa None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:42.474504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b864f-34c5-498f-a527-770696b231fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:42.500773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9c4b864f-34c5-498f-a527-770696b231fa None None] MFA Rules not processed for user `8379e04d2b30488387b3eefab6669768`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:03:42.502479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9c4b864f-34c5-498f-a527-770696b231fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:42.516388 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1323/2650] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:03:42 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:03:42.523790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02922115-1549-4c5b-acf7-eb80c8a1f4c9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:42.525758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-02922115-1549-4c5b-acf7-eb80c8a1f4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:42.550850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02922115-1549-4c5b-acf7-eb80c8a1f4c9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:42.560107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e51800-4b35-43eb-9834-9c281dded09e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:42.560893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e51800-4b35-43eb-9834-9c281dded09e service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:42.561272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e51800-4b35-43eb-9834-9c281dded09e service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:42.561662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e51800-4b35-43eb-9834-9c281dded09e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:42.572804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e51800-4b35-43eb-9834-9c281dded09e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:42.575338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e51800-4b35-43eb-9834-9c281dded09e service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:42.591353 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1328/2651] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:03:42 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:03:43.709623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a6e24-68de-40f6-bda6-536ac4503774 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:43.710242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a6e24-68de-40f6-bda6-536ac4503774 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:43.710242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a6e24-68de-40f6-bda6-536ac4503774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:43.756554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d96a6e24-68de-40f6-bda6-536ac4503774 None None] MFA Rules not processed for user `f8b35ab211584884a72057fa31184836`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:03:43.766822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d96a6e24-68de-40f6-bda6-536ac4503774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:43.889922 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1324/2652] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:03:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:03:49.601156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02954964-aff1-4b90-b465-e9335ff22fdf None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:49.602975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02954964-aff1-4b90-b465-e9335ff22fdf None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:49.603480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02954964-aff1-4b90-b465-e9335ff22fdf None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:49.605153 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1329/2653] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:03:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:03:49.616701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c846778-f4b0-494e-baad-ff576b9fd552 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:49.647058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c846778-f4b0-494e-baad-ff576b9fd552 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:49.648254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c846778-f4b0-494e-baad-ff576b9fd552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:49.868588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0c846778-f4b0-494e-baad-ff576b9fd552 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:03:49.870129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0c846778-f4b0-494e-baad-ff576b9fd552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:50.049903 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1325/2654] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:03:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:03:50.087241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02954964-aff1-4b90-b465-e9335ff22fdf None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:50.089563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-02954964-aff1-4b90-b465-e9335ff22fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:50.118444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02954964-aff1-4b90-b465-e9335ff22fdf None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:50.126915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a0f4b-8a49-4e7f-935b-b450c1129346 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:50.128040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a0f4b-8a49-4e7f-935b-b450c1129346 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:50.128504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a0f4b-8a49-4e7f-935b-b450c1129346 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:50.128979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a0f4b-8a49-4e7f-935b-b450c1129346 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:50.157702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a0f4b-8a49-4e7f-935b-b450c1129346 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:50.159451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a0f4b-8a49-4e7f-935b-b450c1129346 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:50.180708 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1330/2655] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:03:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:03:52.261662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c846778-f4b0-494e-baad-ff576b9fd552 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:52.274519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c846778-f4b0-494e-baad-ff576b9fd552 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:52.280344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec76fe-6643-419d-97ea-6af627617c1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:52.280964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec76fe-6643-419d-97ea-6af627617c1f service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:52.281252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec76fe-6643-419d-97ea-6af627617c1f service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:52.281522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec76fe-6643-419d-97ea-6af627617c1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:52.283505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f5ec76fe-6643-419d-97ea-6af627617c1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:52.288625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:52.349520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec76fe-6643-419d-97ea-6af627617c1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:52.351108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec76fe-6643-419d-97ea-6af627617c1f service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:52.360957 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1326/2656] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:03:52 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:03:53.241854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e9fd0-427c-4bba-99d6-f5bb3a9e81e6 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:53.242317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e9fd0-427c-4bba-99d6-f5bb3a9e81e6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:53.242596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e9fd0-427c-4bba-99d6-f5bb3a9e81e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:53.269653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-dc9e9fd0-427c-4bba-99d6-f5bb3a9e81e6 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:03:53.273080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dc9e9fd0-427c-4bba-99d6-f5bb3a9e81e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:03:53.287918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:53.369373 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1331/2657] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:03:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:03:53.384646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec76fe-6643-419d-97ea-6af627617c1f service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:03:53.473791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec76fe-6643-419d-97ea-6af627617c1f service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:03:53.482695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65aaec-72d3-494d-9937-cb1177952043 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:03:53.483409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65aaec-72d3-494d-9937-cb1177952043 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:03:53.483675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65aaec-72d3-494d-9937-cb1177952043 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:03:53.483941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65aaec-72d3-494d-9937-cb1177952043 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:03:53.493207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65aaec-72d3-494d-9937-cb1177952043 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:03:53.495516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65aaec-72d3-494d-9937-cb1177952043 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:03:53.504609 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1327/2658] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:03:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:03.361369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=19 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:03.500978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=59 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:04.479776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dd8c3-92e0-4875-b40b-7bea6bfc880f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:04.482487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dd8c3-92e0-4875-b40b-7bea6bfc880f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:04.482797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dd8c3-92e0-4875-b40b-7bea6bfc880f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:04.517738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0d4dd8c3-92e0-4875-b40b-7bea6bfc880f None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:04.518908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0d4dd8c3-92e0-4875-b40b-7bea6bfc880f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:04.527353 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1332/2659] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:04:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:04.543204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65aaec-72d3-494d-9937-cb1177952043 service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:04.557877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65aaec-72d3-494d-9937-cb1177952043 service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:04.573714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcd797-05f6-47f9-989d-3333151a7b70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:04.574365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcd797-05f6-47f9-989d-3333151a7b70 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:04.574696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcd797-05f6-47f9-989d-3333151a7b70 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:04.576253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcd797-05f6-47f9-989d-3333151a7b70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:04.595886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcd797-05f6-47f9-989d-3333151a7b70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:04.600720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcd797-05f6-47f9-989d-3333151a7b70 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:04.625926 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1328/2660] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:04:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:06.333041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bdff3-43df-4613-a443-6fa17c2d5f1d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:06.333598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bdff3-43df-4613-a443-6fa17c2d5f1d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:06.333706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bdff3-43df-4613-a443-6fa17c2d5f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:06.388596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-318bdff3-43df-4613-a443-6fa17c2d5f1d None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:06.389856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-318bdff3-43df-4613-a443-6fa17c2d5f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:06.416386 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1333/2661] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:04:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:06.435537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcd797-05f6-47f9-989d-3333151a7b70 service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:06.451386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcd797-05f6-47f9-989d-3333151a7b70 service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:06.467770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4720217-5d65-4820-a308-1a81a80700ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:06.468674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4720217-5d65-4820-a308-1a81a80700ea service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:06.469127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4720217-5d65-4820-a308-1a81a80700ea service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:06.470920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4720217-5d65-4820-a308-1a81a80700ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:06.518671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4720217-5d65-4820-a308-1a81a80700ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:06.528629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4720217-5d65-4820-a308-1a81a80700ea service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:06.565521 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1329/2662] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:04:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:06.732931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced4f09-691c-4e92-9b8e-09eabfacfda9 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:06.733485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced4f09-691c-4e92-9b8e-09eabfacfda9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:06.734544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced4f09-691c-4e92-9b8e-09eabfacfda9 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:06.736826 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1334/2663] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:04:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:04:06.742577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1845418-1ac8-44d4-96a5-03b9a9bf47c0 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:06.745579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1845418-1ac8-44d4-96a5-03b9a9bf47c0 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:06.746106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1845418-1ac8-44d4-96a5-03b9a9bf47c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:06.802212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b1845418-1ac8-44d4-96a5-03b9a9bf47c0 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:06.804018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b1845418-1ac8-44d4-96a5-03b9a9bf47c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:06.831349 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1330/2664] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:04:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:06.883803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced4f09-691c-4e92-9b8e-09eabfacfda9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:06.885918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1ced4f09-691c-4e92-9b8e-09eabfacfda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:06.917395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced4f09-691c-4e92-9b8e-09eabfacfda9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:06.969031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8653df-3125-4957-abaf-f4df5532af21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:06.970887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8653df-3125-4957-abaf-f4df5532af21 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:06.971249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8653df-3125-4957-abaf-f4df5532af21 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:06.972645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8653df-3125-4957-abaf-f4df5532af21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:07.022616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8653df-3125-4957-abaf-f4df5532af21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:07.036800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8653df-3125-4957-abaf-f4df5532af21 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:07.089830 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1335/2665] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:04:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:04:16.788288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=15 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:17.066635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=12 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:19.802981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f119c3-ad7b-47f0-9ced-bab665ce07be None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:19.803533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f119c3-ad7b-47f0-9ced-bab665ce07be None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:19.803982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f119c3-ad7b-47f0-9ced-bab665ce07be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:19.829524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e8f119c3-ad7b-47f0-9ced-bab665ce07be None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:19.830684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e8f119c3-ad7b-47f0-9ced-bab665ce07be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:19.838981 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1331/2666] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:04:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:19.853334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8653df-3125-4957-abaf-f4df5532af21 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:19.866908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8653df-3125-4957-abaf-f4df5532af21 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:19.873862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d9ed4-37ba-49fb-bf87-e438ea4f003c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:19.875034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d9ed4-37ba-49fb-bf87-e438ea4f003c service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:19.875587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d9ed4-37ba-49fb-bf87-e438ea4f003c service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:19.876022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d9ed4-37ba-49fb-bf87-e438ea4f003c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:19.886180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d9ed4-37ba-49fb-bf87-e438ea4f003c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:19.888618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d9ed4-37ba-49fb-bf87-e438ea4f003c service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:19.903361 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1336/2667] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:04:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:20.520502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d28ea-cc6e-4edf-a024-fbb81c7747e6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:20.521120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d28ea-cc6e-4edf-a024-fbb81c7747e6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:20.521807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d28ea-cc6e-4edf-a024-fbb81c7747e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:20.541669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8b8d28ea-cc6e-4edf-a024-fbb81c7747e6 None None] MFA Rules not processed for user `8379e04d2b30488387b3eefab6669768`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:20.542908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8b8d28ea-cc6e-4edf-a024-fbb81c7747e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:20.556628 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1332/2668] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:20.911276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51efb9a-2c57-4a49-a08b-896bf9dd37e1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:20.911789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51efb9a-2c57-4a49-a08b-896bf9dd37e1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:20.912159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51efb9a-2c57-4a49-a08b-896bf9dd37e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:20.932391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c51efb9a-2c57-4a49-a08b-896bf9dd37e1 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:20.933823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c51efb9a-2c57-4a49-a08b-896bf9dd37e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:20.941072 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1337/2669] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:04:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:20.953912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d28ea-cc6e-4edf-a024-fbb81c7747e6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:20.967208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d28ea-cc6e-4edf-a024-fbb81c7747e6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:20.972347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f09f07-95fa-489f-bfec-88ea9a2ae3dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:20.972969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f09f07-95fa-489f-bfec-88ea9a2ae3dc service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:20.973256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f09f07-95fa-489f-bfec-88ea9a2ae3dc service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:20.973533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f09f07-95fa-489f-bfec-88ea9a2ae3dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:20.982208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f09f07-95fa-489f-bfec-88ea9a2ae3dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:20.983833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f09f07-95fa-489f-bfec-88ea9a2ae3dc service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:21.000223 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1333/2670] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:04:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:22.523179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416c3f-5dd4-4b6c-aba8-1f6aee2b82f6 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:22.523778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416c3f-5dd4-4b6c-aba8-1f6aee2b82f6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:22.523778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416c3f-5dd4-4b6c-aba8-1f6aee2b82f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:22.544995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-80416c3f-5dd4-4b6c-aba8-1f6aee2b82f6 None None] MFA Rules not processed for user `96815c6776f1464a8b6350b4a52d4548`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:22.546515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-80416c3f-5dd4-4b6c-aba8-1f6aee2b82f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:22.608681 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1338/2671] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:26.501673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f09f07-95fa-489f-bfec-88ea9a2ae3dc service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:26.503129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-94f09f07-95fa-489f-bfec-88ea9a2ae3dc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:26.518741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f09f07-95fa-489f-bfec-88ea9a2ae3dc service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:26.523669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f221a-eaba-4cc8-b4ee-c3a0963d54b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:26.524328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f221a-eaba-4cc8-b4ee-c3a0963d54b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:26.524613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f221a-eaba-4cc8-b4ee-c3a0963d54b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:26.524948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f221a-eaba-4cc8-b4ee-c3a0963d54b9 admin admin] PATH_INFO: `/v3/users/73d81ad63c23451f9d9235f1faba50d1` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:26.526150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f221a-eaba-4cc8-b4ee-c3a0963d54b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d81ad63c23451f9d9235f1faba50d1)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:26.528188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f221a-eaba-4cc8-b4ee-c3a0963d54b9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:26.674054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-377f221a-eaba-4cc8-b4ee-c3a0963d54b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d81ad63c23451f9d9235f1faba50d1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:26.719345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-377f221a-eaba-4cc8-b4ee-c3a0963d54b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d81ad63c23451f9d9235f1faba50d1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:26.724425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-377f221a-eaba-4cc8-b4ee-c3a0963d54b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d81ad63c23451f9d9235f1faba50d1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:26.749590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-377f221a-eaba-4cc8-b4ee-c3a0963d54b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d81ad63c23451f9d9235f1faba50d1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:26.755754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-377f221a-eaba-4cc8-b4ee-c3a0963d54b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d81ad63c23451f9d9235f1faba50d1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:26.794089 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1334/2672] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:04:26 2022] DELETE /identity/v3/users/73d81ad63c23451f9d9235f1faba50d1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:26.798812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84428f73-0fb8-48df-a3de-ed0fffebfcce None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:26.799824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84428f73-0fb8-48df-a3de-ed0fffebfcce None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:26.800843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84428f73-0fb8-48df-a3de-ed0fffebfcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:26.844505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-84428f73-0fb8-48df-a3de-ed0fffebfcce None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:26.846678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-84428f73-0fb8-48df-a3de-ed0fffebfcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:26.977438 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1339/2673] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:26.986858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f221a-eaba-4cc8-b4ee-c3a0963d54b9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:26.988338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-377f221a-eaba-4cc8-b4ee-c3a0963d54b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:27.149952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f221a-eaba-4cc8-b4ee-c3a0963d54b9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:27.173069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550da62-6d32-46bb-a19b-9e65c36d4d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:27.173835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550da62-6d32-46bb-a19b-9e65c36d4d27 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:27.174282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550da62-6d32-46bb-a19b-9e65c36d4d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:27.174573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550da62-6d32-46bb-a19b-9e65c36d4d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:27.197710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550da62-6d32-46bb-a19b-9e65c36d4d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:27.202227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550da62-6d32-46bb-a19b-9e65c36d4d27 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:27.244382 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1335/2674] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:04:28.046511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84428f73-0fb8-48df-a3de-ed0fffebfcce None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:28.048057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-84428f73-0fb8-48df-a3de-ed0fffebfcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:28.064134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84428f73-0fb8-48df-a3de-ed0fffebfcce None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:28.070087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9030b-4268-4188-ba2e-5b322cc1e004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:28.070987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9030b-4268-4188-ba2e-5b322cc1e004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:28.071869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9030b-4268-4188-ba2e-5b322cc1e004 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:28.073073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9030b-4268-4188-ba2e-5b322cc1e004 admin admin] PATH_INFO: `/v3/projects/12e516b713ea41b5a6586035cc755589` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:28.074927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9030b-4268-4188-ba2e-5b322cc1e004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12e516b713ea41b5a6586035cc755589)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:28.077134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9030b-4268-4188-ba2e-5b322cc1e004 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:28.236612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ddc9030b-4268-4188-ba2e-5b322cc1e004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12e516b713ea41b5a6586035cc755589', 'request_id': 'req-ddc9030b-4268-4188-ba2e-5b322cc1e004'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:28.255223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ddc9030b-4268-4188-ba2e-5b322cc1e004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12e516b713ea41b5a6586035cc755589', 'request_id': 'req-ddc9030b-4268-4188-ba2e-5b322cc1e004'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:28.271257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ddc9030b-4268-4188-ba2e-5b322cc1e004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12e516b713ea41b5a6586035cc755589', 'request_id': 'req-ddc9030b-4268-4188-ba2e-5b322cc1e004'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:28.300844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ddc9030b-4268-4188-ba2e-5b322cc1e004 admin admin] The token cache is being invalidate because project 12e516b713ea41b5a6586035cc755589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:04:28.306576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ddc9030b-4268-4188-ba2e-5b322cc1e004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:28.308034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ddc9030b-4268-4188-ba2e-5b322cc1e004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:28.311205 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1340/2675] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:28 2022] DELETE /identity/v3/projects/12e516b713ea41b5a6586035cc755589 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:28.316558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04976a1a-6dbf-4fcf-876d-4987f587ffca None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:28.317008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04976a1a-6dbf-4fcf-876d-4987f587ffca None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:28.317632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04976a1a-6dbf-4fcf-876d-4987f587ffca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:28.365808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-04976a1a-6dbf-4fcf-876d-4987f587ffca None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:28.369126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-04976a1a-6dbf-4fcf-876d-4987f587ffca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:28.468115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:28.535925 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1336/2676] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:28.546684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dfa20-f304-44b7-b323-2846092b131c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:28.547098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dfa20-f304-44b7-b323-2846092b131c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:28.549591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dfa20-f304-44b7-b323-2846092b131c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:28.643754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e46dfa20-f304-44b7-b323-2846092b131c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:28.648282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e46dfa20-f304-44b7-b323-2846092b131c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:28.685351 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1341/2677] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:28.688887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04976a1a-6dbf-4fcf-876d-4987f587ffca None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:28.705106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04976a1a-6dbf-4fcf-876d-4987f587ffca None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:28.710184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739110ca-db47-4cd3-b99c-4b12d25ca694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:28.710972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739110ca-db47-4cd3-b99c-4b12d25ca694 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:28.711266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739110ca-db47-4cd3-b99c-4b12d25ca694 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:28.711605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739110ca-db47-4cd3-b99c-4b12d25ca694 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:28.712331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739110ca-db47-4cd3-b99c-4b12d25ca694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:04:28.712643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739110ca-db47-4cd3-b99c-4b12d25ca694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:28.714380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739110ca-db47-4cd3-b99c-4b12d25ca694 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:28.753883 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1337/2678] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:04:28.758180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dfa20-f304-44b7-b323-2846092b131c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:28.765988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:28.774521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dfa20-f304-44b7-b323-2846092b131c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:28.791737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf083280-7627-4435-99ec-3321f80c0684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:28.792382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf083280-7627-4435-99ec-3321f80c0684 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:28.793665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf083280-7627-4435-99ec-3321f80c0684 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:28.793960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf083280-7627-4435-99ec-3321f80c0684 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:28.794638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf083280-7627-4435-99ec-3321f80c0684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:28.797848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf083280-7627-4435-99ec-3321f80c0684 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:28.850405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739110ca-db47-4cd3-b99c-4b12d25ca694 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:28.852177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-739110ca-db47-4cd3-b99c-4b12d25ca694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:28.854380 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1342/2679] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:04:28 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:04:28.860373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf083280-7627-4435-99ec-3321f80c0684 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:28.877203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739110ca-db47-4cd3-b99c-4b12d25ca694 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:29.008254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf083280-7627-4435-99ec-3321f80c0684 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:29.028541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd360f-8694-4259-8cb4-4d348499d8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:29.029202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd360f-8694-4259-8cb4-4d348499d8e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:29.029489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd360f-8694-4259-8cb4-4d348499d8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:29.029769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd360f-8694-4259-8cb4-4d348499d8e8 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:29.030448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd360f-8694-4259-8cb4-4d348499d8e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:29.032512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd360f-8694-4259-8cb4-4d348499d8e8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:29.076669 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1343/2680] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:04:28 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:04:29.081490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd360f-8694-4259-8cb4-4d348499d8e8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:29.082863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea3bb1-8545-4b78-9481-e8494bd4b972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:29.084290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea3bb1-8545-4b78-9481-e8494bd4b972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:29.084576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea3bb1-8545-4b78-9481-e8494bd4b972 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:29.084866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea3bb1-8545-4b78-9481-e8494bd4b972 admin admin] PATH_INFO: `/v3/users/794f1a4f424d4b71a23649a4d178df28` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:29.087711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea3bb1-8545-4b78-9481-e8494bd4b972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=794f1a4f424d4b71a23649a4d178df28)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:29.091174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea3bb1-8545-4b78-9481-e8494bd4b972 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:29.107809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd360f-8694-4259-8cb4-4d348499d8e8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:29.114118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3ff5d-c694-4eac-8036-e9759024f6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:29.115116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3ff5d-c694-4eac-8036-e9759024f6cb admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:29.115635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3ff5d-c694-4eac-8036-e9759024f6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:29.116127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3ff5d-c694-4eac-8036-e9759024f6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:29.117132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3ff5d-c694-4eac-8036-e9759024f6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:29.120127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3ff5d-c694-4eac-8036-e9759024f6cb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:29.137531 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1344/2681] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:04:29.138855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3ff5d-c694-4eac-8036-e9759024f6cb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:29.154552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3ff5d-c694-4eac-8036-e9759024f6cb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:29.162433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98422527-16fe-4b95-8583-8207aff65ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:29.163570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98422527-16fe-4b95-8583-8207aff65ffb admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:29.163982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98422527-16fe-4b95-8583-8207aff65ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:29.164333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98422527-16fe-4b95-8583-8207aff65ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:29.166025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98422527-16fe-4b95-8583-8207aff65ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:29.168979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98422527-16fe-4b95-8583-8207aff65ffb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:29.184918 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1345/2682] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:04:29.189298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98422527-16fe-4b95-8583-8207aff65ffb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:29.202398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98422527-16fe-4b95-8583-8207aff65ffb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:29.212318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4eaac8-4b08-47f9-8b20-800e019fc749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:29.213624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4eaac8-4b08-47f9-8b20-800e019fc749 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:29.214083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4eaac8-4b08-47f9-8b20-800e019fc749 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:29.214535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4eaac8-4b08-47f9-8b20-800e019fc749 admin admin] PATH_INFO: `/v3/projects/3b49b328c44040f0b5ae9b929e137b55/users/c8c95b7c11b24f13a2a7148a087d590e/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:29.218002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33ea3bb1-8545-4b78-9481-e8494bd4b972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '794f1a4f424d4b71a23649a4d178df28'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:29.247808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33ea3bb1-8545-4b78-9481-e8494bd4b972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '794f1a4f424d4b71a23649a4d178df28'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:29.252540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33ea3bb1-8545-4b78-9481-e8494bd4b972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '794f1a4f424d4b71a23649a4d178df28'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:29.259663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4eaac8-4b08-47f9-8b20-800e019fc749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b49b328c44040f0b5ae9b929e137b55, user_id=c8c95b7c11b24f13a2a7148a087d590e, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:29.263169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33ea3bb1-8545-4b78-9481-e8494bd4b972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '794f1a4f424d4b71a23649a4d178df28'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:29.264092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33ea3bb1-8545-4b78-9481-e8494bd4b972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '794f1a4f424d4b71a23649a4d178df28'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:29.274003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4eaac8-4b08-47f9-8b20-800e019fc749 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:29.307575 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1338/2683] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:04:28 2022] DELETE /identity/v3/users/794f1a4f424d4b71a23649a4d178df28 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:04:29.309003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea3bb1-8545-4b78-9481-e8494bd4b972 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:29.312604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-33ea3bb1-8545-4b78-9481-e8494bd4b972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:29.317873 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1346/2684] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:04:29 2022] PUT /identity/v3/projects/3b49b328c44040f0b5ae9b929e137b55/users/c8c95b7c11b24f13a2a7148a087d590e/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:29.319451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd9b91-8253-442a-b158-51f762e80763 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:29.320128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd9b91-8253-442a-b158-51f762e80763 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:29.320582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd9b91-8253-442a-b158-51f762e80763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:29.371910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3efd9b91-8253-442a-b158-51f762e80763 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:29.375716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3efd9b91-8253-442a-b158-51f762e80763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:29.494240 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1347/2685] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:29.496229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d31e9-9dc0-4423-b8e4-9086dd907ca6 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:29.497497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d31e9-9dc0-4423-b8e4-9086dd907ca6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:29.498035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d31e9-9dc0-4423-b8e4-9086dd907ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:29.511156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:29.520779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea3bb1-8545-4b78-9481-e8494bd4b972 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:29.537887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448307b0-38ed-4cf3-9979-9f471b466496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:29.537887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448307b0-38ed-4cf3-9979-9f471b466496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:29.537887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448307b0-38ed-4cf3-9979-9f471b466496 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:29.537887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448307b0-38ed-4cf3-9979-9f471b466496 admin admin] PATH_INFO: `/v3/users/dea0b28116c64ba8ad7d6f83e63762d7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:29.542473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448307b0-38ed-4cf3-9979-9f471b466496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dea0b28116c64ba8ad7d6f83e63762d7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:29.543831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4a5d31e9-9dc0-4423-b8e4-9086dd907ca6 None None] MFA Rules not processed for user `c8c95b7c11b24f13a2a7148a087d590e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:29.544552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448307b0-38ed-4cf3-9979-9f471b466496 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:29.545587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4a5d31e9-9dc0-4423-b8e4-9086dd907ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:29.564028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:29.672940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-448307b0-38ed-4cf3-9979-9f471b466496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dea0b28116c64ba8ad7d6f83e63762d7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:29.694847 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1348/2686] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:29.704196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-448307b0-38ed-4cf3-9979-9f471b466496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dea0b28116c64ba8ad7d6f83e63762d7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:29.707699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-448307b0-38ed-4cf3-9979-9f471b466496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dea0b28116c64ba8ad7d6f83e63762d7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:29.710053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d31e9-9dc0-4423-b8e4-9086dd907ca6 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:29.711776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4a5d31e9-9dc0-4423-b8e4-9086dd907ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:29.740946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-448307b0-38ed-4cf3-9979-9f471b466496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dea0b28116c64ba8ad7d6f83e63762d7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:29.742610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-448307b0-38ed-4cf3-9979-9f471b466496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dea0b28116c64ba8ad7d6f83e63762d7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:29.793524 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1339/2687] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:04:29 2022] DELETE /identity/v3/users/dea0b28116c64ba8ad7d6f83e63762d7 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:29.796316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8fef5-442f-4d28-9a37-742a3c75709a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:29.796459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8fef5-442f-4d28-9a37-742a3c75709a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:29.797084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8fef5-442f-4d28-9a37-742a3c75709a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:29.856702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f5e8fef5-442f-4d28-9a37-742a3c75709a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:29.858040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f5e8fef5-442f-4d28-9a37-742a3c75709a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:29.921521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d31e9-9dc0-4423-b8e4-9086dd907ca6 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:30.032525 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1340/2688] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:30.032525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8fef5-442f-4d28-9a37-742a3c75709a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:30.036749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f5e8fef5-442f-4d28-9a37-742a3c75709a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:30.093002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de888979-8ae8-4ff2-a94f-3d58f7d7c2e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:30.094171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de888979-8ae8-4ff2-a94f-3d58f7d7c2e1 service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:30.094171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de888979-8ae8-4ff2-a94f-3d58f7d7c2e1 service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:30.094465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de888979-8ae8-4ff2-a94f-3d58f7d7c2e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:30.098854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-de888979-8ae8-4ff2-a94f-3d58f7d7c2e1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:30.211980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de888979-8ae8-4ff2-a94f-3d58f7d7c2e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:30.212213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8fef5-442f-4d28-9a37-742a3c75709a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:30.214211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de888979-8ae8-4ff2-a94f-3d58f7d7c2e1 service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:30.216739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6784372-4d7b-4818-8c7f-ba9471ba1670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:30.219262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6784372-4d7b-4818-8c7f-ba9471ba1670 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:30.219262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6784372-4d7b-4818-8c7f-ba9471ba1670 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:30.219761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6784372-4d7b-4818-8c7f-ba9471ba1670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:30.223232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c6784372-4d7b-4818-8c7f-ba9471ba1670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:30.234276 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1349/2689] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:04:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:04:30.235635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de888979-8ae8-4ff2-a94f-3d58f7d7c2e1 service glance] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:30.237122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-de888979-8ae8-4ff2-a94f-3d58f7d7c2e1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:30.259523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de888979-8ae8-4ff2-a94f-3d58f7d7c2e1 service glance] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:30.266674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f13786-03be-4dee-a138-76c87acc4a23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:30.266674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f13786-03be-4dee-a138-76c87acc4a23 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:30.266674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f13786-03be-4dee-a138-76c87acc4a23 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:30.266674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f13786-03be-4dee-a138-76c87acc4a23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:30.281217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6784372-4d7b-4818-8c7f-ba9471ba1670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:30.283870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f13786-03be-4dee-a138-76c87acc4a23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:30.285631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f13786-03be-4dee-a138-76c87acc4a23 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:30.291403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6784372-4d7b-4818-8c7f-ba9471ba1670 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:30.316417 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1350/2690] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:04:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:04:30.321682 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1341/2691] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:04:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:04:31.108528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f13786-03be-4dee-a138-76c87acc4a23 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:31.111320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f0f13786-03be-4dee-a138-76c87acc4a23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:31.142320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f13786-03be-4dee-a138-76c87acc4a23 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:31.155902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2939bd-fd05-4598-9c0e-eeeb6a39c304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:31.159633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2939bd-fd05-4598-9c0e-eeeb6a39c304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:31.161048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2939bd-fd05-4598-9c0e-eeeb6a39c304 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:31.163472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2939bd-fd05-4598-9c0e-eeeb6a39c304 admin admin] PATH_INFO: `/v3/projects/ae99b18c49be443e96955fd4ea16630f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:31.166850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2939bd-fd05-4598-9c0e-eeeb6a39c304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae99b18c49be443e96955fd4ea16630f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:31.172336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2939bd-fd05-4598-9c0e-eeeb6a39c304 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:31.190143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:31.251085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6784372-4d7b-4818-8c7f-ba9471ba1670 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:31.252702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c6784372-4d7b-4818-8c7f-ba9471ba1670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:31.258276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2f2939bd-fd05-4598-9c0e-eeeb6a39c304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae99b18c49be443e96955fd4ea16630f', 'request_id': 'req-2f2939bd-fd05-4598-9c0e-eeeb6a39c304'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:31.272289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2f2939bd-fd05-4598-9c0e-eeeb6a39c304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae99b18c49be443e96955fd4ea16630f', 'request_id': 'req-2f2939bd-fd05-4598-9c0e-eeeb6a39c304'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:31.277399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6784372-4d7b-4818-8c7f-ba9471ba1670 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:31.287604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2f2939bd-fd05-4598-9c0e-eeeb6a39c304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae99b18c49be443e96955fd4ea16630f', 'request_id': 'req-2f2939bd-fd05-4598-9c0e-eeeb6a39c304'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:31.307847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2f2939bd-fd05-4598-9c0e-eeeb6a39c304 admin admin] The token cache is being invalidate because project ae99b18c49be443e96955fd4ea16630f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:04:31.307847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2f2939bd-fd05-4598-9c0e-eeeb6a39c304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:31.309536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2f2939bd-fd05-4598-9c0e-eeeb6a39c304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:31.313734 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1351/2692] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:31 2022] DELETE /identity/v3/projects/ae99b18c49be443e96955fd4ea16630f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:31.316808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2939bd-fd05-4598-9c0e-eeeb6a39c304 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:31.322525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2f2939bd-fd05-4598-9c0e-eeeb6a39c304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:31.335657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:31.524722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2939bd-fd05-4598-9c0e-eeeb6a39c304 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:31.541342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690a8b8-2d23-45e3-b0ef-d4793551014c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:31.542022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690a8b8-2d23-45e3-b0ef-d4793551014c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:31.542301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690a8b8-2d23-45e3-b0ef-d4793551014c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:31.542582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690a8b8-2d23-45e3-b0ef-d4793551014c admin admin] PATH_INFO: `/v3/users/aa9fb6bd059840d8afa3eb139d00c2af` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:31.544905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690a8b8-2d23-45e3-b0ef-d4793551014c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa9fb6bd059840d8afa3eb139d00c2af)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:31.546544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690a8b8-2d23-45e3-b0ef-d4793551014c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:31.556696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81ec0b-8c36-444e-981c-949ce831848c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:31.560059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81ec0b-8c36-444e-981c-949ce831848c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:31.560549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81ec0b-8c36-444e-981c-949ce831848c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:31.561028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81ec0b-8c36-444e-981c-949ce831848c admin admin] PATH_INFO: `/v3/projects/7f71035a2ae04a76a9e82b6ccd3759cc` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:31.562902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81ec0b-8c36-444e-981c-949ce831848c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f71035a2ae04a76a9e82b6ccd3759cc)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:31.565269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81ec0b-8c36-444e-981c-949ce831848c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:31.661470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1690a8b8-2d23-45e3-b0ef-d4793551014c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa9fb6bd059840d8afa3eb139d00c2af'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:31.662217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1690a8b8-2d23-45e3-b0ef-d4793551014c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa9fb6bd059840d8afa3eb139d00c2af'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:31.687004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1c81ec0b-8c36-444e-981c-949ce831848c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f71035a2ae04a76a9e82b6ccd3759cc', 'request_id': 'req-1c81ec0b-8c36-444e-981c-949ce831848c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:31.687913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1690a8b8-2d23-45e3-b0ef-d4793551014c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa9fb6bd059840d8afa3eb139d00c2af'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:31.695786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1690a8b8-2d23-45e3-b0ef-d4793551014c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa9fb6bd059840d8afa3eb139d00c2af'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:31.697024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1c81ec0b-8c36-444e-981c-949ce831848c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f71035a2ae04a76a9e82b6ccd3759cc', 'request_id': 'req-1c81ec0b-8c36-444e-981c-949ce831848c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:31.708279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1690a8b8-2d23-45e3-b0ef-d4793551014c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa9fb6bd059840d8afa3eb139d00c2af'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:31.713562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1c81ec0b-8c36-444e-981c-949ce831848c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f71035a2ae04a76a9e82b6ccd3759cc', 'request_id': 'req-1c81ec0b-8c36-444e-981c-949ce831848c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:31.734539 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1352/2693] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:04:31 2022] DELETE /identity/v3/users/aa9fb6bd059840d8afa3eb139d00c2af => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:04:31.734539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572e312-ce2d-413a-8f27-3a10602afd27 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:31.734539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572e312-ce2d-413a-8f27-3a10602afd27 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:31.734539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572e312-ce2d-413a-8f27-3a10602afd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:31.742669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1c81ec0b-8c36-444e-981c-949ce831848c admin admin] The token cache is being invalidate because project 7f71035a2ae04a76a9e82b6ccd3759cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:04:31.747613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1c81ec0b-8c36-444e-981c-949ce831848c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:31.750169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1c81ec0b-8c36-444e-981c-949ce831848c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:31.758465 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1342/2694] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:31 2022] DELETE /identity/v3/projects/7f71035a2ae04a76a9e82b6ccd3759cc => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:31.760516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81ec0b-8c36-444e-981c-949ce831848c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:31.762414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1c81ec0b-8c36-444e-981c-949ce831848c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:31.782334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6572e312-ce2d-413a-8f27-3a10602afd27 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:31.783631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6572e312-ce2d-413a-8f27-3a10602afd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:31.805321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:31.899718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81ec0b-8c36-444e-981c-949ce831848c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:31.944057 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1353/2695] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:04:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:31.986170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572e312-ce2d-413a-8f27-3a10602afd27 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:31.991308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6572e312-ce2d-413a-8f27-3a10602afd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:32.132851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:32.159221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633a0f9-244a-4f5c-b30b-5f2f3c0e39d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:32.161274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633a0f9-244a-4f5c-b30b-5f2f3c0e39d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:32.163389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633a0f9-244a-4f5c-b30b-5f2f3c0e39d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:32.163967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633a0f9-244a-4f5c-b30b-5f2f3c0e39d6 admin admin] PATH_INFO: `/v3/users/5cd2968d1b7b4cfb9c2bad0e453208f3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:32.171127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633a0f9-244a-4f5c-b30b-5f2f3c0e39d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cd2968d1b7b4cfb9c2bad0e453208f3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:32.176373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633a0f9-244a-4f5c-b30b-5f2f3c0e39d6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:32.188977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572e312-ce2d-413a-8f27-3a10602afd27 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:32.210802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a16c4-9f09-4e30-93cd-3f011c05976b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:32.213227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a16c4-9f09-4e30-93cd-3f011c05976b service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:32.214371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a16c4-9f09-4e30-93cd-3f011c05976b service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:32.216071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a16c4-9f09-4e30-93cd-3f011c05976b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:32.233820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a16c4-9f09-4e30-93cd-3f011c05976b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:32.235892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a16c4-9f09-4e30-93cd-3f011c05976b service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:32.246068 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1354/2696] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:04:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:32.290535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7633a0f9-244a-4f5c-b30b-5f2f3c0e39d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cd2968d1b7b4cfb9c2bad0e453208f3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:32.344446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7633a0f9-244a-4f5c-b30b-5f2f3c0e39d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cd2968d1b7b4cfb9c2bad0e453208f3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:32.346487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7633a0f9-244a-4f5c-b30b-5f2f3c0e39d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cd2968d1b7b4cfb9c2bad0e453208f3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:32.363802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7633a0f9-244a-4f5c-b30b-5f2f3c0e39d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cd2968d1b7b4cfb9c2bad0e453208f3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:32.365532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7633a0f9-244a-4f5c-b30b-5f2f3c0e39d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cd2968d1b7b4cfb9c2bad0e453208f3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:32.406962 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1343/2697] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:04:31 2022] DELETE /identity/v3/users/5cd2968d1b7b4cfb9c2bad0e453208f3 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:33.052902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a16c4-9f09-4e30-93cd-3f011c05976b service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:33.073206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a16c4-9f09-4e30-93cd-3f011c05976b service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:33.170558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8114072-3d5c-4486-bae1-a8a1c4be9da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:33.171797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8114072-3d5c-4486-bae1-a8a1c4be9da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:33.172472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8114072-3d5c-4486-bae1-a8a1c4be9da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:33.172960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8114072-3d5c-4486-bae1-a8a1c4be9da4 admin admin] PATH_INFO: `/v3/projects/51761955ec724fd187b41d085bdb4c4d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:33.174637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8114072-3d5c-4486-bae1-a8a1c4be9da4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51761955ec724fd187b41d085bdb4c4d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:33.179154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8114072-3d5c-4486-bae1-a8a1c4be9da4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:33.300366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c8114072-3d5c-4486-bae1-a8a1c4be9da4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51761955ec724fd187b41d085bdb4c4d', 'request_id': 'req-c8114072-3d5c-4486-bae1-a8a1c4be9da4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:33.306697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:33.331752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c8114072-3d5c-4486-bae1-a8a1c4be9da4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51761955ec724fd187b41d085bdb4c4d', 'request_id': 'req-c8114072-3d5c-4486-bae1-a8a1c4be9da4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:33.359965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c8114072-3d5c-4486-bae1-a8a1c4be9da4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51761955ec724fd187b41d085bdb4c4d', 'request_id': 'req-c8114072-3d5c-4486-bae1-a8a1c4be9da4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:33.386879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c8114072-3d5c-4486-bae1-a8a1c4be9da4 admin admin] The token cache is being invalidate because project 51761955ec724fd187b41d085bdb4c4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:04:33.387211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c8114072-3d5c-4486-bae1-a8a1c4be9da4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:33.393690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c8114072-3d5c-4486-bae1-a8a1c4be9da4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:33.398764 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1355/2698] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:33 2022] DELETE /identity/v3/projects/51761955ec724fd187b41d085bdb4c4d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:33.411861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9ccf4-7052-4115-a375-48fd8319d7c9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:33.411861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9ccf4-7052-4115-a375-48fd8319d7c9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:33.411861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9ccf4-7052-4115-a375-48fd8319d7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:33.439179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-52d9ccf4-7052-4115-a375-48fd8319d7c9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:33.440544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-52d9ccf4-7052-4115-a375-48fd8319d7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:33.539878 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1344/2699] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:33.543830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7b819-5700-456f-a6e1-62756c2e5aa9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:33.544302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7b819-5700-456f-a6e1-62756c2e5aa9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:33.544860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7b819-5700-456f-a6e1-62756c2e5aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:33.583249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1fe7b819-5700-456f-a6e1-62756c2e5aa9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:33.595366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1fe7b819-5700-456f-a6e1-62756c2e5aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:33.621963 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1356/2700] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:33.622153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9ccf4-7052-4115-a375-48fd8319d7c9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:33.622493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-52d9ccf4-7052-4115-a375-48fd8319d7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:33.634854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7b819-5700-456f-a6e1-62756c2e5aa9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:33.653449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9ccf4-7052-4115-a375-48fd8319d7c9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:33.659983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7b819-5700-456f-a6e1-62756c2e5aa9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:33.666076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14145b47-e3b7-4cb0-a74a-dd5b407b4e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:33.666893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14145b47-e3b7-4cb0-a74a-dd5b407b4e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:33.667344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14145b47-e3b7-4cb0-a74a-dd5b407b4e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:33.668761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14145b47-e3b7-4cb0-a74a-dd5b407b4e71 admin admin] PATH_INFO: `/v3/projects/fdd5a5b366e441ba8a398ca5a98fcc88` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:33.670272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14145b47-e3b7-4cb0-a74a-dd5b407b4e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdd5a5b366e441ba8a398ca5a98fcc88)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:33.676711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14145b47-e3b7-4cb0-a74a-dd5b407b4e71 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:33.677537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273253b-10ed-4a5e-a148-677e21d37d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:33.679838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273253b-10ed-4a5e-a148-677e21d37d01 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:33.680897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273253b-10ed-4a5e-a148-677e21d37d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:33.681740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273253b-10ed-4a5e-a148-677e21d37d01 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:33.682596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273253b-10ed-4a5e-a148-677e21d37d01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:04:33.684458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273253b-10ed-4a5e-a148-677e21d37d01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:33.687050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273253b-10ed-4a5e-a148-677e21d37d01 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:33.724593 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1357/2701] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:04:33.726042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273253b-10ed-4a5e-a148-677e21d37d01 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:33.747888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273253b-10ed-4a5e-a148-677e21d37d01 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:33.756227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7353557-a461-49e6-a621-992e75202440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:33.757058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7353557-a461-49e6-a621-992e75202440 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:33.757511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7353557-a461-49e6-a621-992e75202440 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:33.757890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7353557-a461-49e6-a621-992e75202440 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:33.758691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7353557-a461-49e6-a621-992e75202440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:33.760797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7353557-a461-49e6-a621-992e75202440 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:33.815898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-14145b47-e3b7-4cb0-a74a-dd5b407b4e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdd5a5b366e441ba8a398ca5a98fcc88', 'request_id': 'req-14145b47-e3b7-4cb0-a74a-dd5b407b4e71'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:33.839422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-14145b47-e3b7-4cb0-a74a-dd5b407b4e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdd5a5b366e441ba8a398ca5a98fcc88', 'request_id': 'req-14145b47-e3b7-4cb0-a74a-dd5b407b4e71'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:33.844296 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1358/2702] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:04:33 2022] POST /identity/v3/projects => generated 397 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:04:33.844755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7353557-a461-49e6-a621-992e75202440 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:33.874107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-14145b47-e3b7-4cb0-a74a-dd5b407b4e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdd5a5b366e441ba8a398ca5a98fcc88', 'request_id': 'req-14145b47-e3b7-4cb0-a74a-dd5b407b4e71'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:33.890892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:33.910524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-14145b47-e3b7-4cb0-a74a-dd5b407b4e71 admin admin] The token cache is being invalidate because project fdd5a5b366e441ba8a398ca5a98fcc88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:04:33.911000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-14145b47-e3b7-4cb0-a74a-dd5b407b4e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:33.913869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-14145b47-e3b7-4cb0-a74a-dd5b407b4e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:33.940631 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1345/2703] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:33 2022] DELETE /identity/v3/projects/fdd5a5b366e441ba8a398ca5a98fcc88 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:04:33.946648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62696ec4-8eef-4e38-b5b1-d1ba43cdd3f7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:33.951012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62696ec4-8eef-4e38-b5b1-d1ba43cdd3f7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:33.952748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62696ec4-8eef-4e38-b5b1-d1ba43cdd3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:34.057488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-62696ec4-8eef-4e38-b5b1-d1ba43cdd3f7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:34.059320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-62696ec4-8eef-4e38-b5b1-d1ba43cdd3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:34.096947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7353557-a461-49e6-a621-992e75202440 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:34.107219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340c9b1-802d-453f-9352-b21a969bd5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:34.109666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340c9b1-802d-453f-9352-b21a969bd5da admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:34.109961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340c9b1-802d-453f-9352-b21a969bd5da admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:34.110244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340c9b1-802d-453f-9352-b21a969bd5da admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:34.110924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340c9b1-802d-453f-9352-b21a969bd5da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:34.112926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340c9b1-802d-453f-9352-b21a969bd5da admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:34.164275 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1359/2704] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:04:33 2022] POST /identity/v3/users => generated 299 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:04:34.165684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61c00d-1eeb-43d6-b0bb-0c6e904a9c87 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:34.165978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61c00d-1eeb-43d6-b0bb-0c6e904a9c87 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:34.166267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61c00d-1eeb-43d6-b0bb-0c6e904a9c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:34.187811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0c61c00d-1eeb-43d6-b0bb-0c6e904a9c87 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:34.189071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0c61c00d-1eeb-43d6-b0bb-0c6e904a9c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:34.208111 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1346/2705] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:34.209436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62696ec4-8eef-4e38-b5b1-d1ba43cdd3f7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:34.211055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-62696ec4-8eef-4e38-b5b1-d1ba43cdd3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:34.225674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62696ec4-8eef-4e38-b5b1-d1ba43cdd3f7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:34.231500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80a52b-ff22-4924-9a2b-d0e609e38574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:34.232346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80a52b-ff22-4924-9a2b-d0e609e38574 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:34.232823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80a52b-ff22-4924-9a2b-d0e609e38574 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:34.233404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80a52b-ff22-4924-9a2b-d0e609e38574 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:34.234269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80a52b-ff22-4924-9a2b-d0e609e38574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:34.236121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80a52b-ff22-4924-9a2b-d0e609e38574 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:34.251252 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1347/2706] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:04:34.253092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067622b3-ba6c-4ea3-82eb-cb8a3fafc175 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:34.253781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067622b3-ba6c-4ea3-82eb-cb8a3fafc175 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:34.254238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067622b3-ba6c-4ea3-82eb-cb8a3fafc175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:34.296178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-067622b3-ba6c-4ea3-82eb-cb8a3fafc175 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:34.298267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-067622b3-ba6c-4ea3-82eb-cb8a3fafc175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:34.302034 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1360/2707] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:04:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:34.303032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61c00d-1eeb-43d6-b0bb-0c6e904a9c87 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:34.311786 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1348/2708] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:34.315856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067622b3-ba6c-4ea3-82eb-cb8a3fafc175 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:34.317435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61c00d-1eeb-43d6-b0bb-0c6e904a9c87 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:34.323594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f2eaa-839f-46cf-9782-804094af196a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:34.325218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f2eaa-839f-46cf-9782-804094af196a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:34.326479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f2eaa-839f-46cf-9782-804094af196a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:34.326844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f2eaa-839f-46cf-9782-804094af196a admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:34.327723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f2eaa-839f-46cf-9782-804094af196a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:34.330400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067622b3-ba6c-4ea3-82eb-cb8a3fafc175 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:34.331835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f2eaa-839f-46cf-9782-804094af196a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:34.343981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd95ce4-9288-4e43-a0c6-90051e12a74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:34.348155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd95ce4-9288-4e43-a0c6-90051e12a74b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:34.351995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd95ce4-9288-4e43-a0c6-90051e12a74b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:34.354077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd95ce4-9288-4e43-a0c6-90051e12a74b admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:34.354992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd95ce4-9288-4e43-a0c6-90051e12a74b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:04:34.356027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd95ce4-9288-4e43-a0c6-90051e12a74b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:34.359020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd95ce4-9288-4e43-a0c6-90051e12a74b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:34.359523 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1361/2709] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:04:34.360474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f2eaa-839f-46cf-9782-804094af196a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:34.366177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-288f2eaa-839f-46cf-9782-804094af196a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:34.390983 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1349/2710] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:04:34.392107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd95ce4-9288-4e43-a0c6-90051e12a74b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:34.407489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd95ce4-9288-4e43-a0c6-90051e12a74b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:34.413798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bdbf7-dd3c-4b34-9df1-c5910138f6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:34.415497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bdbf7-dd3c-4b34-9df1-c5910138f6e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:34.415844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bdbf7-dd3c-4b34-9df1-c5910138f6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:34.416138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bdbf7-dd3c-4b34-9df1-c5910138f6e9 admin admin] PATH_INFO: `/v3/projects/c4671c42e59f421192dea290a355021d/users/5b51cd5eda484fad9a901893f75d1b48/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:34.437102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1bdbf7-dd3c-4b34-9df1-c5910138f6e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4671c42e59f421192dea290a355021d, user_id=5b51cd5eda484fad9a901893f75d1b48, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:34.441871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1bdbf7-dd3c-4b34-9df1-c5910138f6e9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:34.446247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:34.459232 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1350/2711] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:04:34 2022] PUT /identity/v3/projects/c4671c42e59f421192dea290a355021d/users/5b51cd5eda484fad9a901893f75d1b48/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:34.460260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bdbf7-dd3c-4b34-9df1-c5910138f6e9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:34.608094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bdbf7-dd3c-4b34-9df1-c5910138f6e9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:34.615621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f759369-51f0-4894-87d6-8628097a7657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:34.616651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f759369-51f0-4894-87d6-8628097a7657 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:34.617403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f759369-51f0-4894-87d6-8628097a7657 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:34.617844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f759369-51f0-4894-87d6-8628097a7657 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:34.618695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f759369-51f0-4894-87d6-8628097a7657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:34.624185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f759369-51f0-4894-87d6-8628097a7657 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:34.635980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f2eaa-839f-46cf-9782-804094af196a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:34.708159 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1351/2712] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:04:34 2022] POST /identity/v3/projects => generated 381 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:04:34.710385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a8536-fd98-4aae-a080-aa5d0fbde7ff None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:34.710385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a8536-fd98-4aae-a080-aa5d0fbde7ff None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:34.710619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a8536-fd98-4aae-a080-aa5d0fbde7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:34.767383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ed5a8536-fd98-4aae-a080-aa5d0fbde7ff None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:34.768803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ed5a8536-fd98-4aae-a080-aa5d0fbde7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:34.802237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86616612-b4b6-448d-b386-38f14ef60034 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:34.803275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86616612-b4b6-448d-b386-38f14ef60034 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:34.806555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86616612-b4b6-448d-b386-38f14ef60034 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:34.807190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86616612-b4b6-448d-b386-38f14ef60034 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:34.828129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:34.886724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86616612-b4b6-448d-b386-38f14ef60034 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:34.890658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86616612-b4b6-448d-b386-38f14ef60034 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:34.906241 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1362/2713] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:04:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:34.913644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86616612-b4b6-448d-b386-38f14ef60034 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:34.942723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86616612-b4b6-448d-b386-38f14ef60034 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:35.050138 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1352/2714] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:35.060019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a8536-fd98-4aae-a080-aa5d0fbde7ff None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:35.063545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ed5a8536-fd98-4aae-a080-aa5d0fbde7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:35.192374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218a2cc-3ba5-4900-b2f9-1f83ba340bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:35.196564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218a2cc-3ba5-4900-b2f9-1f83ba340bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:35.197943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218a2cc-3ba5-4900-b2f9-1f83ba340bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:35.198417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218a2cc-3ba5-4900-b2f9-1f83ba340bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:35.201025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218a2cc-3ba5-4900-b2f9-1f83ba340bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:35.210538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218a2cc-3ba5-4900-b2f9-1f83ba340bc7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:35.244674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:35.248166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a8536-fd98-4aae-a080-aa5d0fbde7ff None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:35.264109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799439f-a339-4f83-afdf-818d54c8d10f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:35.265160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799439f-a339-4f83-afdf-818d54c8d10f service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:35.266375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799439f-a339-4f83-afdf-818d54c8d10f service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:35.280023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799439f-a339-4f83-afdf-818d54c8d10f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:35.281812 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1363/2715] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:04:34 2022] POST /identity/v3/users => generated 291 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:04:35.293184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218a2cc-3ba5-4900-b2f9-1f83ba340bc7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:35.317517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799439f-a339-4f83-afdf-818d54c8d10f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:35.319875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799439f-a339-4f83-afdf-818d54c8d10f service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:35.326355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218a2cc-3ba5-4900-b2f9-1f83ba340bc7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:35.345246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb92f1-453c-4196-85f6-1339ee708d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:35.345894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb92f1-453c-4196-85f6-1339ee708d05 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:35.346182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb92f1-453c-4196-85f6-1339ee708d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:35.346461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb92f1-453c-4196-85f6-1339ee708d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:35.347246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb92f1-453c-4196-85f6-1339ee708d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:35.353842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb92f1-453c-4196-85f6-1339ee708d05 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:35.394642 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1364/2716] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:04:35.394840 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1353/2717] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:04:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:04:35.396560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb92f1-453c-4196-85f6-1339ee708d05 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:35.440811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb92f1-453c-4196-85f6-1339ee708d05 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:35.451270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731c2e9-3ecb-4706-b3d8-6103e7affef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:35.455085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731c2e9-3ecb-4706-b3d8-6103e7affef2 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:35.455085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731c2e9-3ecb-4706-b3d8-6103e7affef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:35.455085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731c2e9-3ecb-4706-b3d8-6103e7affef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:35.455085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731c2e9-3ecb-4706-b3d8-6103e7affef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:35.455563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731c2e9-3ecb-4706-b3d8-6103e7affef2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:35.483709 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1365/2718] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:04:35.484899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799439f-a339-4f83-afdf-818d54c8d10f service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:35.496322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799439f-a339-4f83-afdf-818d54c8d10f service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:35.526260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec52d64-04cb-45a9-a1ab-a7a9397f0c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:35.527971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec52d64-04cb-45a9-a1ab-a7a9397f0c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:35.528263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec52d64-04cb-45a9-a1ab-a7a9397f0c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:35.531193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec52d64-04cb-45a9-a1ab-a7a9397f0c75 admin admin] PATH_INFO: `/v3/projects/3a50eb5e4a334562a71d4116fa94fbcf/users/d20ab89ea13c4611904cec244d37ba25/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:35.616228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec52d64-04cb-45a9-a1ab-a7a9397f0c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a50eb5e4a334562a71d4116fa94fbcf, user_id=d20ab89ea13c4611904cec244d37ba25, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:35.619318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec52d64-04cb-45a9-a1ab-a7a9397f0c75 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:35.654264 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1354/2719] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:04:35 2022] PUT /identity/v3/projects/3a50eb5e4a334562a71d4116fa94fbcf/users/d20ab89ea13c4611904cec244d37ba25/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:35.665213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ad508-2199-42b1-b4c8-b93fbcffec68 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:35.665213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ad508-2199-42b1-b4c8-b93fbcffec68 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:35.665633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ad508-2199-42b1-b4c8-b93fbcffec68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:35.723504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ed1ad508-2199-42b1-b4c8-b93fbcffec68 None None] MFA Rules not processed for user `d20ab89ea13c4611904cec244d37ba25`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:35.724795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ed1ad508-2199-42b1-b4c8-b93fbcffec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:35.912153 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1366/2720] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:35.913610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec52d64-04cb-45a9-a1ab-a7a9397f0c75 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:36.049415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec52d64-04cb-45a9-a1ab-a7a9397f0c75 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:36.055439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516588bf-ab69-4890-8db7-ca1316b28657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:36.056845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516588bf-ab69-4890-8db7-ca1316b28657 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:36.057377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516588bf-ab69-4890-8db7-ca1316b28657 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:36.057723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516588bf-ab69-4890-8db7-ca1316b28657 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:36.061320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516588bf-ab69-4890-8db7-ca1316b28657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:36.064530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516588bf-ab69-4890-8db7-ca1316b28657 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:36.111069 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1355/2721] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:04:35 2022] POST /identity/v3/projects => generated 381 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:04:36.114982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ad508-2199-42b1-b4c8-b93fbcffec68 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:36.142025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ad508-2199-42b1-b4c8-b93fbcffec68 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:36.249662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e219c6a-abfd-4f70-abe0-ee24a4e3bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:36.250363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e219c6a-abfd-4f70-abe0-ee24a4e3bb6b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:36.250655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e219c6a-abfd-4f70-abe0-ee24a4e3bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:36.251112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e219c6a-abfd-4f70-abe0-ee24a4e3bb6b admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:36.251877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e219c6a-abfd-4f70-abe0-ee24a4e3bb6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:36.254010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e219c6a-abfd-4f70-abe0-ee24a4e3bb6b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:36.289274 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1367/2722] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:04:36 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:04:36.294769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516588bf-ab69-4890-8db7-ca1316b28657 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:36.310646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516588bf-ab69-4890-8db7-ca1316b28657 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:36.322226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51ae08-8890-48bc-887f-becc3f384c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:36.322875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51ae08-8890-48bc-887f-becc3f384c86 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:36.323165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51ae08-8890-48bc-887f-becc3f384c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:36.325736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51ae08-8890-48bc-887f-becc3f384c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:36.326482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51ae08-8890-48bc-887f-becc3f384c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:36.334466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51ae08-8890-48bc-887f-becc3f384c86 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:36.361394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e219c6a-abfd-4f70-abe0-ee24a4e3bb6b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:36.362005 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1356/2723] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:04:36.378338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e219c6a-abfd-4f70-abe0-ee24a4e3bb6b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:36.391974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2788932-4197-4b48-b033-d9f8b7dd9bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:36.393023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2788932-4197-4b48-b033-d9f8b7dd9bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:36.393295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2788932-4197-4b48-b033-d9f8b7dd9bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:36.395069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2788932-4197-4b48-b033-d9f8b7dd9bc1 admin admin] PATH_INFO: `/v3/projects/015edf2ee05b47dbbaf477d89e57b47d/users/29334772c35f4ffeaca8c0533a5e7051/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:36.440973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2788932-4197-4b48-b033-d9f8b7dd9bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=015edf2ee05b47dbbaf477d89e57b47d, user_id=29334772c35f4ffeaca8c0533a5e7051, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:36.443688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2788932-4197-4b48-b033-d9f8b7dd9bc1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:36.494177 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1368/2724] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:04:36 2022] PUT /identity/v3/projects/015edf2ee05b47dbbaf477d89e57b47d/users/29334772c35f4ffeaca8c0533a5e7051/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:36.495715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51ae08-8890-48bc-887f-becc3f384c86 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:36.511596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51ae08-8890-48bc-887f-becc3f384c86 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:36.571645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:36.685753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43076a-5f22-4eff-97e7-3d54f253f76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:36.686471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43076a-5f22-4eff-97e7-3d54f253f76a admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:36.687482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43076a-5f22-4eff-97e7-3d54f253f76a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:36.687695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43076a-5f22-4eff-97e7-3d54f253f76a admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:36.688394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43076a-5f22-4eff-97e7-3d54f253f76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:36.690476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43076a-5f22-4eff-97e7-3d54f253f76a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:36.715581 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1357/2725] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:04:36.720538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2788932-4197-4b48-b033-d9f8b7dd9bc1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:36.736239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2788932-4197-4b48-b033-d9f8b7dd9bc1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:36.776668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd754bc-b48f-4ba1-acdf-f227f603599e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:36.777983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd754bc-b48f-4ba1-acdf-f227f603599e admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:36.783335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd754bc-b48f-4ba1-acdf-f227f603599e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:36.784046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd754bc-b48f-4ba1-acdf-f227f603599e admin admin] PATH_INFO: `/v3/projects/015edf2ee05b47dbbaf477d89e57b47d/users/29334772c35f4ffeaca8c0533a5e7051/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:36.799077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd754bc-b48f-4ba1-acdf-f227f603599e admin admin] RBAC: Authorizing `identity:create_grant(project_id=015edf2ee05b47dbbaf477d89e57b47d, user_id=29334772c35f4ffeaca8c0533a5e7051, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:36.802019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd754bc-b48f-4ba1-acdf-f227f603599e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:36.822034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00092e80-51d1-479c-9021-5866161bcdf2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:36.822709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00092e80-51d1-479c-9021-5866161bcdf2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:36.825153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00092e80-51d1-479c-9021-5866161bcdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:36.844358 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1369/2726] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:04:36 2022] PUT /identity/v3/projects/015edf2ee05b47dbbaf477d89e57b47d/users/29334772c35f4ffeaca8c0533a5e7051/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:36.846603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c339e-43a1-4f5a-be56-ab4daf1fe8f4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:36.846986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c339e-43a1-4f5a-be56-ab4daf1fe8f4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:36.847176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c339e-43a1-4f5a-be56-ab4daf1fe8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:36.870468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-00092e80-51d1-479c-9021-5866161bcdf2 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:36.871922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-00092e80-51d1-479c-9021-5866161bcdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:36.921424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:36.943069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-697c339e-43a1-4f5a-be56-ab4daf1fe8f4 None None] MFA Rules not processed for user `29334772c35f4ffeaca8c0533a5e7051`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:36.947967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-697c339e-43a1-4f5a-be56-ab4daf1fe8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:36.997132 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1358/2727] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:04:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:37.012148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00092e80-51d1-479c-9021-5866161bcdf2 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:37.147240 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1370/2728] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:04:37.149676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28438b37-e9f8-4b8f-a472-c66a84a39876 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:37.149981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28438b37-e9f8-4b8f-a472-c66a84a39876 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:37.150288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28438b37-e9f8-4b8f-a472-c66a84a39876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:37.191626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-28438b37-e9f8-4b8f-a472-c66a84a39876 None None] MFA Rules not processed for user `d20ab89ea13c4611904cec244d37ba25`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:37.193243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-28438b37-e9f8-4b8f-a472-c66a84a39876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:37.198110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00092e80-51d1-479c-9021-5866161bcdf2 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:37.211388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06f72f-3079-405b-88c1-c4bf420f8f97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:37.212641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06f72f-3079-405b-88c1-c4bf420f8f97 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:37.212787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06f72f-3079-405b-88c1-c4bf420f8f97 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:37.213188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06f72f-3079-405b-88c1-c4bf420f8f97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:37.235105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06f72f-3079-405b-88c1-c4bf420f8f97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:37.237990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06f72f-3079-405b-88c1-c4bf420f8f97 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:37.265053 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1359/2729] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:04:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:37.313030 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1371/2730] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:37.331120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06f72f-3079-405b-88c1-c4bf420f8f97 service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:37.333476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bf06f72f-3079-405b-88c1-c4bf420f8f97 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:37.446333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:37.505664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06f72f-3079-405b-88c1-c4bf420f8f97 service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:37.520732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705b785-eca6-4a86-a2fb-ea78fd103ea5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:37.520732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705b785-eca6-4a86-a2fb-ea78fd103ea5 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:37.520963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705b785-eca6-4a86-a2fb-ea78fd103ea5 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:37.521234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705b785-eca6-4a86-a2fb-ea78fd103ea5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:37.542330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705b785-eca6-4a86-a2fb-ea78fd103ea5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:37.545837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705b785-eca6-4a86-a2fb-ea78fd103ea5 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:37.587857 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1360/2731] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:04:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:04:37.882753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c30fc-9b50-4894-98fc-b05ad358249f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:37.884140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c30fc-9b50-4894-98fc-b05ad358249f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:37.884796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c30fc-9b50-4894-98fc-b05ad358249f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:37.902771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b25fd-9abc-4732-9bb7-0b9e7e034ebf None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:37.903098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b25fd-9abc-4732-9bb7-0b9e7e034ebf None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:37.903642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b25fd-9abc-4732-9bb7-0b9e7e034ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:37.915471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-651c30fc-9b50-4894-98fc-b05ad358249f None None] MFA Rules not processed for user `c8c95b7c11b24f13a2a7148a087d590e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:37.916736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-651c30fc-9b50-4894-98fc-b05ad358249f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:37.938692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a57b25fd-9abc-4732-9bb7-0b9e7e034ebf None None] MFA Rules not processed for user `46d7264a2f63436bb8519cd8cec6d9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:37.947823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a57b25fd-9abc-4732-9bb7-0b9e7e034ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:38.034697 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1372/2732] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:38.062885 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1361/2733] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:04:38.979785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fd71b-0ec8-4150-840c-f0598fc739c1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:38.980825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fd71b-0ec8-4150-840c-f0598fc739c1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:38.981351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fd71b-0ec8-4150-840c-f0598fc739c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:39.049353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e72fd71b-0ec8-4150-840c-f0598fc739c1 None None] MFA Rules not processed for user `c8c95b7c11b24f13a2a7148a087d590e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:39.070739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e72fd71b-0ec8-4150-840c-f0598fc739c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:39.101433 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1373/2734] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:47.804122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b25fd-9abc-4732-9bb7-0b9e7e034ebf None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:47.805807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a57b25fd-9abc-4732-9bb7-0b9e7e034ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:48.009054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b25fd-9abc-4732-9bb7-0b9e7e034ebf None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:48.017260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e4ce5-51c8-490b-8a80-eac7cd31a972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:48.018229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e4ce5-51c8-490b-8a80-eac7cd31a972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:48.018621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e4ce5-51c8-490b-8a80-eac7cd31a972 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:48.019001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e4ce5-51c8-490b-8a80-eac7cd31a972 admin admin] PATH_INFO: `/v3/users/b2a05aa5d80844848bf57f6ca093e582` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:48.020392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e4ce5-51c8-490b-8a80-eac7cd31a972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2a05aa5d80844848bf57f6ca093e582)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:48.022480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e4ce5-51c8-490b-8a80-eac7cd31a972 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:48.051737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:48.138950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-531e4ce5-51c8-490b-8a80-eac7cd31a972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2a05aa5d80844848bf57f6ca093e582'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:48.170146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-531e4ce5-51c8-490b-8a80-eac7cd31a972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2a05aa5d80844848bf57f6ca093e582'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:48.170917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-531e4ce5-51c8-490b-8a80-eac7cd31a972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2a05aa5d80844848bf57f6ca093e582'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:48.187164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-531e4ce5-51c8-490b-8a80-eac7cd31a972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2a05aa5d80844848bf57f6ca093e582'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:48.187940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-531e4ce5-51c8-490b-8a80-eac7cd31a972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2a05aa5d80844848bf57f6ca093e582'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:48.214102 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1362/2735] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:04:47 2022] DELETE /identity/v3/users/b2a05aa5d80844848bf57f6ca093e582 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:48.759138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fd71b-0ec8-4150-840c-f0598fc739c1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:48.826407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fd71b-0ec8-4150-840c-f0598fc739c1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:48.867637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:48.922211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bc21b-1893-43f0-95fc-d122e7d60d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:48.922949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bc21b-1893-43f0-95fc-d122e7d60d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:48.924312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bc21b-1893-43f0-95fc-d122e7d60d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:48.924605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bc21b-1893-43f0-95fc-d122e7d60d92 admin admin] PATH_INFO: `/v3/projects/8413d2ad29eb484886bae680d1d1a82b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:48.925923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bc21b-1893-43f0-95fc-d122e7d60d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8413d2ad29eb484886bae680d1d1a82b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:48.928291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bc21b-1893-43f0-95fc-d122e7d60d92 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:48.994552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ac7bc21b-1893-43f0-95fc-d122e7d60d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8413d2ad29eb484886bae680d1d1a82b', 'request_id': 'req-ac7bc21b-1893-43f0-95fc-d122e7d60d92'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:49.009320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ac7bc21b-1893-43f0-95fc-d122e7d60d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8413d2ad29eb484886bae680d1d1a82b', 'request_id': 'req-ac7bc21b-1893-43f0-95fc-d122e7d60d92'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:49.020701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ac7bc21b-1893-43f0-95fc-d122e7d60d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8413d2ad29eb484886bae680d1d1a82b', 'request_id': 'req-ac7bc21b-1893-43f0-95fc-d122e7d60d92'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:49.036673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ac7bc21b-1893-43f0-95fc-d122e7d60d92 admin admin] The token cache is being invalidate because project 8413d2ad29eb484886bae680d1d1a82b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:04:49.036673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ac7bc21b-1893-43f0-95fc-d122e7d60d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:49.037585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ac7bc21b-1893-43f0-95fc-d122e7d60d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:49.042078 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1374/2736] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:48 2022] DELETE /identity/v3/projects/8413d2ad29eb484886bae680d1d1a82b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:49.043867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e4ce5-51c8-490b-8a80-eac7cd31a972 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:49.045452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-531e4ce5-51c8-490b-8a80-eac7cd31a972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:49.060659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e4ce5-51c8-490b-8a80-eac7cd31a972 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:49.149768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c719fe-dccf-417f-8b8d-1c45dfd5ad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:49.150433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c719fe-dccf-417f-8b8d-1c45dfd5ad49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:49.150753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c719fe-dccf-417f-8b8d-1c45dfd5ad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:49.151057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c719fe-dccf-417f-8b8d-1c45dfd5ad49 admin admin] PATH_INFO: `/v3/users/1a356e21a90c407a9569cc57d5530e4c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:49.152911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c719fe-dccf-417f-8b8d-1c45dfd5ad49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a356e21a90c407a9569cc57d5530e4c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:49.155031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c719fe-dccf-417f-8b8d-1c45dfd5ad49 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:49.248760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-24c719fe-dccf-417f-8b8d-1c45dfd5ad49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a356e21a90c407a9569cc57d5530e4c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:49.276444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-24c719fe-dccf-417f-8b8d-1c45dfd5ad49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a356e21a90c407a9569cc57d5530e4c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:49.278353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-24c719fe-dccf-417f-8b8d-1c45dfd5ad49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a356e21a90c407a9569cc57d5530e4c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:49.288753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-24c719fe-dccf-417f-8b8d-1c45dfd5ad49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a356e21a90c407a9569cc57d5530e4c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:49.289564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-24c719fe-dccf-417f-8b8d-1c45dfd5ad49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a356e21a90c407a9569cc57d5530e4c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:49.315892 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1363/2737] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:04:49 2022] DELETE /identity/v3/users/1a356e21a90c407a9569cc57d5530e4c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:50.534413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bc21b-1893-43f0-95fc-d122e7d60d92 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:50.543753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ac7bc21b-1893-43f0-95fc-d122e7d60d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:50.592366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bc21b-1893-43f0-95fc-d122e7d60d92 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:50.742838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7afa7-65f9-4e3b-b6b1-c992bbf27c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:50.744145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7afa7-65f9-4e3b-b6b1-c992bbf27c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:50.744939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7afa7-65f9-4e3b-b6b1-c992bbf27c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:50.745439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7afa7-65f9-4e3b-b6b1-c992bbf27c66 admin admin] PATH_INFO: `/v3/projects/d021c316a57b4d4a877832776b5ef265` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:50.748830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7afa7-65f9-4e3b-b6b1-c992bbf27c66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d021c316a57b4d4a877832776b5ef265)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:50.752806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7afa7-65f9-4e3b-b6b1-c992bbf27c66 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:50.919559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-34c7afa7-65f9-4e3b-b6b1-c992bbf27c66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd021c316a57b4d4a877832776b5ef265', 'request_id': 'req-34c7afa7-65f9-4e3b-b6b1-c992bbf27c66'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:50.930879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-34c7afa7-65f9-4e3b-b6b1-c992bbf27c66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd021c316a57b4d4a877832776b5ef265', 'request_id': 'req-34c7afa7-65f9-4e3b-b6b1-c992bbf27c66'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:50.932609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:50.939946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-34c7afa7-65f9-4e3b-b6b1-c992bbf27c66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd021c316a57b4d4a877832776b5ef265', 'request_id': 'req-34c7afa7-65f9-4e3b-b6b1-c992bbf27c66'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:50.957545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-34c7afa7-65f9-4e3b-b6b1-c992bbf27c66 admin admin] The token cache is being invalidate because project d021c316a57b4d4a877832776b5ef265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:04:50.957982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-34c7afa7-65f9-4e3b-b6b1-c992bbf27c66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:50.958734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-34c7afa7-65f9-4e3b-b6b1-c992bbf27c66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:50.960773 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1375/2738] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:50 2022] DELETE /identity/v3/projects/d021c316a57b4d4a877832776b5ef265 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:50.965605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41488ea3-4a7a-42eb-afeb-959683bd089d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:50.966147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41488ea3-4a7a-42eb-afeb-959683bd089d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:50.967102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41488ea3-4a7a-42eb-afeb-959683bd089d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:51.009454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:51.175396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-41488ea3-4a7a-42eb-afeb-959683bd089d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:51.177157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-41488ea3-4a7a-42eb-afeb-959683bd089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:51.329185 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1364/2739] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:51.330158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22583a0-a9d4-4bd2-a4cb-0b42cfe7ef1e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:51.330456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22583a0-a9d4-4bd2-a4cb-0b42cfe7ef1e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:51.330741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22583a0-a9d4-4bd2-a4cb-0b42cfe7ef1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:51.358017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d22583a0-a9d4-4bd2-a4cb-0b42cfe7ef1e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:51.360942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d22583a0-a9d4-4bd2-a4cb-0b42cfe7ef1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:51.379040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41488ea3-4a7a-42eb-afeb-959683bd089d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:51.392550 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1376/2740] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:51.397296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41488ea3-4a7a-42eb-afeb-959683bd089d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:51.413099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbf0ac-8946-4bea-b8df-b81b166957f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:51.414050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbf0ac-8946-4bea-b8df-b81b166957f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:51.414710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbf0ac-8946-4bea-b8df-b81b166957f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:51.415200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbf0ac-8946-4bea-b8df-b81b166957f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:51.416575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbf0ac-8946-4bea-b8df-b81b166957f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:04:51.422536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbf0ac-8946-4bea-b8df-b81b166957f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:51.428064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbf0ac-8946-4bea-b8df-b81b166957f1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:51.457714 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1365/2741] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:04:51.462607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22583a0-a9d4-4bd2-a4cb-0b42cfe7ef1e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:51.479398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22583a0-a9d4-4bd2-a4cb-0b42cfe7ef1e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:51.492518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed12a39-6917-4ef0-84bc-630f68ea5c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:51.494536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed12a39-6917-4ef0-84bc-630f68ea5c39 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:51.496589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed12a39-6917-4ef0-84bc-630f68ea5c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:51.497062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed12a39-6917-4ef0-84bc-630f68ea5c39 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:51.498613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed12a39-6917-4ef0-84bc-630f68ea5c39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:51.501682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed12a39-6917-4ef0-84bc-630f68ea5c39 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:51.599766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbf0ac-8946-4bea-b8df-b81b166957f1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:51.601046 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1377/2742] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:04:51 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:04:51.613511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbf0ac-8946-4bea-b8df-b81b166957f1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:51.768884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffb033-7c43-4d33-a444-6e8f3713b2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:51.769535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffb033-7c43-4d33-a444-6e8f3713b2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:51.769822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffb033-7c43-4d33-a444-6e8f3713b2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:51.770099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffb033-7c43-4d33-a444-6e8f3713b2e9 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:51.770777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffb033-7c43-4d33-a444-6e8f3713b2e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:51.775002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffb033-7c43-4d33-a444-6e8f3713b2e9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:51.827517 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1366/2743] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:04:51 2022] POST /identity/v3/users => generated 290 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:04:51.831498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed12a39-6917-4ef0-84bc-630f68ea5c39 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:51.849009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed12a39-6917-4ef0-84bc-630f68ea5c39 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:51.859586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd7bbd-8ae7-424d-9a8f-0343577a807f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:51.860499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd7bbd-8ae7-424d-9a8f-0343577a807f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:51.860499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd7bbd-8ae7-424d-9a8f-0343577a807f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:51.860773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd7bbd-8ae7-424d-9a8f-0343577a807f admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:51.861491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd7bbd-8ae7-424d-9a8f-0343577a807f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:51.863126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd7bbd-8ae7-424d-9a8f-0343577a807f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:51.890436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffb033-7c43-4d33-a444-6e8f3713b2e9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:51.901620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffb033-7c43-4d33-a444-6e8f3713b2e9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:51.902887 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1378/2744] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:04:51.918506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5f750-bbfa-47b5-9e60-52c19d1cd7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:51.919243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5f750-bbfa-47b5-9e60-52c19d1cd7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:51.919462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5f750-bbfa-47b5-9e60-52c19d1cd7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:51.919743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5f750-bbfa-47b5-9e60-52c19d1cd7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:51.920452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5f750-bbfa-47b5-9e60-52c19d1cd7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:51.925910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5f750-bbfa-47b5-9e60-52c19d1cd7e1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:51.955681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd7bbd-8ae7-424d-9a8f-0343577a807f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:51.971271 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1367/2745] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:04:51.973627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd7bbd-8ae7-424d-9a8f-0343577a807f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:51.988459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bca85-0a34-4f97-9d4f-5e528004321d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:51.989172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bca85-0a34-4f97-9d4f-5e528004321d admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:51.989457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bca85-0a34-4f97-9d4f-5e528004321d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:51.989732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bca85-0a34-4f97-9d4f-5e528004321d admin admin] PATH_INFO: `/v3/projects/eb8ec3b3cd3f46409711bae2091a042f/users/db2f85b780b442199f50f8d6597724c5/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:52.032458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bca85-0a34-4f97-9d4f-5e528004321d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb8ec3b3cd3f46409711bae2091a042f, user_id=db2f85b780b442199f50f8d6597724c5, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:52.041703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bca85-0a34-4f97-9d4f-5e528004321d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:52.115463 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1379/2746] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:04:51 2022] PUT /identity/v3/projects/eb8ec3b3cd3f46409711bae2091a042f/users/db2f85b780b442199f50f8d6597724c5/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:04:52.128388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f02ed-593e-45c2-8ff9-c6c9fa79dd11 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:52.128684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f02ed-593e-45c2-8ff9-c6c9fa79dd11 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:52.128967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f02ed-593e-45c2-8ff9-c6c9fa79dd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:52.240883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-af7f02ed-593e-45c2-8ff9-c6c9fa79dd11 None None] MFA Rules not processed for user `db2f85b780b442199f50f8d6597724c5`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:52.244726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-af7f02ed-593e-45c2-8ff9-c6c9fa79dd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:52.345700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:52.381746 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1368/2747] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:52.383531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bca85-0a34-4f97-9d4f-5e528004321d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:52.486113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bca85-0a34-4f97-9d4f-5e528004321d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:52.510141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42da98-e8ec-46da-b850-2bc1dcb01ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:52.511974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42da98-e8ec-46da-b850-2bc1dcb01ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:52.512275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42da98-e8ec-46da-b850-2bc1dcb01ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:52.512559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42da98-e8ec-46da-b850-2bc1dcb01ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:52.513248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42da98-e8ec-46da-b850-2bc1dcb01ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:52.515355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42da98-e8ec-46da-b850-2bc1dcb01ac2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:52.569283 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1380/2748] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:04:52 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:04:52.570626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f02ed-593e-45c2-8ff9-c6c9fa79dd11 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:52.591172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f02ed-593e-45c2-8ff9-c6c9fa79dd11 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:52.673984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c4ede-a285-4e05-b2e3-5f57cb26d587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:52.674894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c4ede-a285-4e05-b2e3-5f57cb26d587 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:52.675403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c4ede-a285-4e05-b2e3-5f57cb26d587 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:52.675853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c4ede-a285-4e05-b2e3-5f57cb26d587 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:52.676930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c4ede-a285-4e05-b2e3-5f57cb26d587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:52.679268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c4ede-a285-4e05-b2e3-5f57cb26d587 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:52.718437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42da98-e8ec-46da-b850-2bc1dcb01ac2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:52.725538 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1369/2749] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:04:52 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:04:52.732116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42da98-e8ec-46da-b850-2bc1dcb01ac2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:52.739835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbfa99-6fd2-45b1-ae71-6b012c3940b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:52.740780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbfa99-6fd2-45b1-ae71-6b012c3940b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:52.741277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbfa99-6fd2-45b1-ae71-6b012c3940b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:52.741780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbfa99-6fd2-45b1-ae71-6b012c3940b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:52.742698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbfa99-6fd2-45b1-ae71-6b012c3940b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:52.745441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbfa99-6fd2-45b1-ae71-6b012c3940b9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:52.766739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c4ede-a285-4e05-b2e3-5f57cb26d587 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:52.780886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c4ede-a285-4e05-b2e3-5f57cb26d587 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:52.781799 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1381/2750] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:04:52.789169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcf3f0-0580-4cbf-8a8f-7b2ba0bd505d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:52.790276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcf3f0-0580-4cbf-8a8f-7b2ba0bd505d admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:52.791430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcf3f0-0580-4cbf-8a8f-7b2ba0bd505d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:52.791946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcf3f0-0580-4cbf-8a8f-7b2ba0bd505d admin admin] PATH_INFO: `/v3/projects/31319d222c05401486caf2960940293c/users/97a4935bcddd4cf1aa7af1c8d73a8ffd/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:52.813675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcf3f0-0580-4cbf-8a8f-7b2ba0bd505d admin admin] RBAC: Authorizing `identity:create_grant(project_id=31319d222c05401486caf2960940293c, user_id=97a4935bcddd4cf1aa7af1c8d73a8ffd, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:52.816779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcf3f0-0580-4cbf-8a8f-7b2ba0bd505d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:52.844977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbfa99-6fd2-45b1-ae71-6b012c3940b9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:52.852045 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1370/2751] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:04:52 2022] PUT /identity/v3/projects/31319d222c05401486caf2960940293c/users/97a4935bcddd4cf1aa7af1c8d73a8ffd/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:52.863866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbfa99-6fd2-45b1-ae71-6b012c3940b9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:52.932166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:52.948664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18aba7b-4822-496d-a60c-6eea947c0afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:52.949480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18aba7b-4822-496d-a60c-6eea947c0afd admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:52.950192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18aba7b-4822-496d-a60c-6eea947c0afd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:52.950701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18aba7b-4822-496d-a60c-6eea947c0afd admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:52.951735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18aba7b-4822-496d-a60c-6eea947c0afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:52.954355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18aba7b-4822-496d-a60c-6eea947c0afd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:52.972013 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1382/2752] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:04:52.974270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcf3f0-0580-4cbf-8a8f-7b2ba0bd505d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:52.989681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcf3f0-0580-4cbf-8a8f-7b2ba0bd505d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:53.008560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d176d59-eb76-4155-9888-3a34f1d060a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:53.009502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d176d59-eb76-4155-9888-3a34f1d060a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:53.010372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d176d59-eb76-4155-9888-3a34f1d060a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:53.010810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d176d59-eb76-4155-9888-3a34f1d060a4 admin admin] PATH_INFO: `/v3/projects/31319d222c05401486caf2960940293c/users/97a4935bcddd4cf1aa7af1c8d73a8ffd/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:53.013599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d176d59-eb76-4155-9888-3a34f1d060a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31319d222c05401486caf2960940293c, user_id=97a4935bcddd4cf1aa7af1c8d73a8ffd, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:53.017360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d176d59-eb76-4155-9888-3a34f1d060a4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:53.049492 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1371/2753] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:04:52 2022] PUT /identity/v3/projects/31319d222c05401486caf2960940293c/users/97a4935bcddd4cf1aa7af1c8d73a8ffd/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:53.051324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf52dd-73f3-408f-8a8e-c32aa3f3e0b0 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:53.051639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf52dd-73f3-408f-8a8e-c32aa3f3e0b0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:53.051926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf52dd-73f3-408f-8a8e-c32aa3f3e0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:53.128374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-76bf52dd-73f3-408f-8a8e-c32aa3f3e0b0 None None] MFA Rules not processed for user `97a4935bcddd4cf1aa7af1c8d73a8ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:53.130394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-76bf52dd-73f3-408f-8a8e-c32aa3f3e0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:53.270149 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1383/2754] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:53.492467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d176d59-eb76-4155-9888-3a34f1d060a4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:53.495020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3d176d59-eb76-4155-9888-3a34f1d060a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:53.657860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d176d59-eb76-4155-9888-3a34f1d060a4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:53.663854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c01c88-00fa-44c7-984d-6dd4dd6dd1cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:53.664501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c01c88-00fa-44c7-984d-6dd4dd6dd1cf service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:53.664794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c01c88-00fa-44c7-984d-6dd4dd6dd1cf service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:53.665077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c01c88-00fa-44c7-984d-6dd4dd6dd1cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:53.676852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c01c88-00fa-44c7-984d-6dd4dd6dd1cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:53.678504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c01c88-00fa-44c7-984d-6dd4dd6dd1cf service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:53.699456 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1372/2755] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:04:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:04:53.769014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d067748-66ca-4381-bd44-c1ef6cf87b2d None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:53.769535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d067748-66ca-4381-bd44-c1ef6cf87b2d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:53.769833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d067748-66ca-4381-bd44-c1ef6cf87b2d None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:53.771505 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1384/2756] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:04:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:04:53.776647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c01c88-00fa-44c7-984d-6dd4dd6dd1cf service nova] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:04:53.800572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c01c88-00fa-44c7-984d-6dd4dd6dd1cf service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:53.806898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:53.822230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c01c88-00fa-44c7-984d-6dd4dd6dd1cf service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:53.836354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f0030-235b-4d86-a719-cf346134b288 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97a4935bcddd4cf1aa7af1c8d73a8ffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31319d222c05401486caf2960940293c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:53.837312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f0030-235b-4d86-a719-cf346134b288 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:53.837681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f0030-235b-4d86-a719-cf346134b288 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:53.838057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f0030-235b-4d86-a719-cf346134b288 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] PATH_INFO: `/v3/projects/eb8ec3b3cd3f46409711bae2091a042f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:53.840345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f0030-235b-4d86-a719-cf346134b288 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] RBAC: Authorizing `identity:get_project(project_id=eb8ec3b3cd3f46409711bae2091a042f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:53.843486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f0030-235b-4d86-a719-cf346134b288 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:53.849124 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1373/2757] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:04:53 2022] GET /identity/v3/projects/eb8ec3b3cd3f46409711bae2091a042f => generated 379 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:04:53.897656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d067748-66ca-4381-bd44-c1ef6cf87b2d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:53.899427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9d067748-66ca-4381-bd44-c1ef6cf87b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:54.025239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d067748-66ca-4381-bd44-c1ef6cf87b2d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:54.031719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf18ac6-6402-4db0-ab2a-b526ce009b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:54.033047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf18ac6-6402-4db0-ab2a-b526ce009b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:54.033047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf18ac6-6402-4db0-ab2a-b526ce009b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:54.033047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf18ac6-6402-4db0-ab2a-b526ce009b6b admin admin] PATH_INFO: `/v3/users/f8b35ab211584884a72057fa31184836` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:54.034127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf18ac6-6402-4db0-ab2a-b526ce009b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b35ab211584884a72057fa31184836)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:54.036400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf18ac6-6402-4db0-ab2a-b526ce009b6b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:54.077142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f0030-235b-4d86-a719-cf346134b288 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:54.079539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2d7f0030-235b-4d86-a719-cf346134b288 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:54.119174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bdf18ac6-6402-4db0-ab2a-b526ce009b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b35ab211584884a72057fa31184836'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:54.120389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bdf18ac6-6402-4db0-ab2a-b526ce009b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b35ab211584884a72057fa31184836'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:54.140961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bdf18ac6-6402-4db0-ab2a-b526ce009b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b35ab211584884a72057fa31184836'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:54.141734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f0030-235b-4d86-a719-cf346134b288 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:54.143049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bdf18ac6-6402-4db0-ab2a-b526ce009b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b35ab211584884a72057fa31184836'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:54.148509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:54.161811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bdf18ac6-6402-4db0-ab2a-b526ce009b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b35ab211584884a72057fa31184836'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:54.167709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0a841-68ad-4b4d-ae08-8bdc618c4f89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:54.168536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0a841-68ad-4b4d-ae08-8bdc618c4f89 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:54.169203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0a841-68ad-4b4d-ae08-8bdc618c4f89 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:54.169978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0a841-68ad-4b4d-ae08-8bdc618c4f89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:54.172311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-02b0a841-68ad-4b4d-ae08-8bdc618c4f89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:54.188060 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1385/2758] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:04:53 2022] DELETE /identity/v3/users/f8b35ab211584884a72057fa31184836 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:54.190160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dd0fb-d1a6-49aa-9195-8c90fc3524cc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:54.190907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dd0fb-d1a6-49aa-9195-8c90fc3524cc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:54.191187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dd0fb-d1a6-49aa-9195-8c90fc3524cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:54.232815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c19dd0fb-d1a6-49aa-9195-8c90fc3524cc None None] MFA Rules not processed for user `5b51cd5eda484fad9a901893f75d1b48`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:54.234057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c19dd0fb-d1a6-49aa-9195-8c90fc3524cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:54.325631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0a841-68ad-4b4d-ae08-8bdc618c4f89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:54.325882 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1386/2759] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:54.327743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0a841-68ad-4b4d-ae08-8bdc618c4f89 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:54.363400 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1374/2760] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:04:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:04:54.404440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1390cd-4c2d-45d1-bbd2-b69c82c5287e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:54.404736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1390cd-4c2d-45d1-bbd2-b69c82c5287e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:54.405021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1390cd-4c2d-45d1-bbd2-b69c82c5287e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:54.429595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba86373-63f0-4080-ace8-bebedfafda2f None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:54.429888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba86373-63f0-4080-ace8-bebedfafda2f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:54.430171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba86373-63f0-4080-ace8-bebedfafda2f None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:54.431626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2e1390cd-4c2d-45d1-bbd2-b69c82c5287e None None] MFA Rules not processed for user `5b51cd5eda484fad9a901893f75d1b48`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:54.431785 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1375/2761] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 21:04:54.433821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2e1390cd-4c2d-45d1-bbd2-b69c82c5287e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:54.446061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba86373-63f0-4080-ace8-bebedfafda2f None None] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:04:54.446061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3ba86373-63f0-4080-ace8-bebedfafda2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:54.447214 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1387/2762] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:54.454110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1390cd-4c2d-45d1-bbd2-b69c82c5287e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:54.456356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2e1390cd-4c2d-45d1-bbd2-b69c82c5287e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:54.572392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba86373-63f0-4080-ace8-bebedfafda2f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:54.576532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3ba86373-63f0-4080-ace8-bebedfafda2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:54.659883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1390cd-4c2d-45d1-bbd2-b69c82c5287e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:54.680247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ffeb7-c452-4d35-baee-6b4c810c1ed3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:54.683032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ffeb7-c452-4d35-baee-6b4c810c1ed3 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:54.691385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ffeb7-c452-4d35-baee-6b4c810c1ed3 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:54.691385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ffeb7-c452-4d35-baee-6b4c810c1ed3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:54.721619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ffeb7-c452-4d35-baee-6b4c810c1ed3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:54.724219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ffeb7-c452-4d35-baee-6b4c810c1ed3 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:54.775525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba86373-63f0-4080-ace8-bebedfafda2f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:54.778537 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1388/2763] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:04:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:04:54.780442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ffeb7-c452-4d35-baee-6b4c810c1ed3 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:54.793683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ed0ffeb7-c452-4d35-baee-6b4c810c1ed3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:54.794114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65697ec8-439a-460a-be5d-81c9add8df52 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97a4935bcddd4cf1aa7af1c8d73a8ffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31319d222c05401486caf2960940293c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:54.795112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65697ec8-439a-460a-be5d-81c9add8df52 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:54.795522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65697ec8-439a-460a-be5d-81c9add8df52 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:54.796359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65697ec8-439a-460a-be5d-81c9add8df52 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] PATH_INFO: `/v3/projects/eb8ec3b3cd3f46409711bae2091a042f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:54.798456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65697ec8-439a-460a-be5d-81c9add8df52 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] RBAC: Authorizing `identity:get_project(project_id=eb8ec3b3cd3f46409711bae2091a042f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:54.801142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65697ec8-439a-460a-be5d-81c9add8df52 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:54.823536 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1376/2764] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:04:54 2022] GET /identity/v3/projects/eb8ec3b3cd3f46409711bae2091a042f => generated 379 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:04:54.942091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:54.952317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ffeb7-c452-4d35-baee-6b4c810c1ed3 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:54.964959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2323099-aa06-4408-8168-af6692a37771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:54.965816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2323099-aa06-4408-8168-af6692a37771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:54.966273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2323099-aa06-4408-8168-af6692a37771 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:54.966725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2323099-aa06-4408-8168-af6692a37771 admin admin] PATH_INFO: `/v3/projects/cfc4b787c95143c0b9d6f53832e324f1` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:54.968167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2323099-aa06-4408-8168-af6692a37771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc4b787c95143c0b9d6f53832e324f1)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:54.971283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2323099-aa06-4408-8168-af6692a37771 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:55.103117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f2323099-aa06-4408-8168-af6692a37771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc4b787c95143c0b9d6f53832e324f1', 'request_id': 'req-f2323099-aa06-4408-8168-af6692a37771'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:55.122107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f2323099-aa06-4408-8168-af6692a37771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc4b787c95143c0b9d6f53832e324f1', 'request_id': 'req-f2323099-aa06-4408-8168-af6692a37771'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:55.137631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f2323099-aa06-4408-8168-af6692a37771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc4b787c95143c0b9d6f53832e324f1', 'request_id': 'req-f2323099-aa06-4408-8168-af6692a37771'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:55.177390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f2323099-aa06-4408-8168-af6692a37771 admin admin] The token cache is being invalidate because project cfc4b787c95143c0b9d6f53832e324f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:04:55.177647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f2323099-aa06-4408-8168-af6692a37771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:55.187873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f2323099-aa06-4408-8168-af6692a37771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:55.189854 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1389/2765] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:54 2022] DELETE /identity/v3/projects/cfc4b787c95143c0b9d6f53832e324f1 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:55.194015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65697ec8-439a-460a-be5d-81c9add8df52 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:55.196869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-65697ec8-439a-460a-be5d-81c9add8df52 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:55.243721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65697ec8-439a-460a-be5d-81c9add8df52 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:55.364587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:55.443347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489f4c5-bfc0-41e5-b325-5fc46fc95609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:55.444680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489f4c5-bfc0-41e5-b325-5fc46fc95609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:55.445074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489f4c5-bfc0-41e5-b325-5fc46fc95609 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:55.445453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489f4c5-bfc0-41e5-b325-5fc46fc95609 admin admin] PATH_INFO: `/v3/users/e486b81cb41f4535bbe9e89ebffdaa04` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:55.447031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489f4c5-bfc0-41e5-b325-5fc46fc95609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e486b81cb41f4535bbe9e89ebffdaa04)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:55.449271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489f4c5-bfc0-41e5-b325-5fc46fc95609 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:55.578268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e489f4c5-bfc0-41e5-b325-5fc46fc95609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e486b81cb41f4535bbe9e89ebffdaa04'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:55.613320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e489f4c5-bfc0-41e5-b325-5fc46fc95609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e486b81cb41f4535bbe9e89ebffdaa04'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:55.613875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e489f4c5-bfc0-41e5-b325-5fc46fc95609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e486b81cb41f4535bbe9e89ebffdaa04'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:55.639106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e489f4c5-bfc0-41e5-b325-5fc46fc95609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e486b81cb41f4535bbe9e89ebffdaa04'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:55.641167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e489f4c5-bfc0-41e5-b325-5fc46fc95609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e486b81cb41f4535bbe9e89ebffdaa04'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:55.679412 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1377/2766] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:04:55 2022] DELETE /identity/v3/users/e486b81cb41f4535bbe9e89ebffdaa04 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:56.084932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2323099-aa06-4408-8168-af6692a37771 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:56.132891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2323099-aa06-4408-8168-af6692a37771 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:56.281016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c69ef3-9a37-402b-8046-df2e6248c545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:56.281762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c69ef3-9a37-402b-8046-df2e6248c545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:56.282060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c69ef3-9a37-402b-8046-df2e6248c545 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:56.296334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c69ef3-9a37-402b-8046-df2e6248c545 admin admin] PATH_INFO: `/v3/projects/6ed49ee4eca649a4a75640c7a5b12026` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:56.299401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c69ef3-9a37-402b-8046-df2e6248c545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed49ee4eca649a4a75640c7a5b12026)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:56.301352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c69ef3-9a37-402b-8046-df2e6248c545 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:56.411235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59c69ef3-9a37-402b-8046-df2e6248c545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed49ee4eca649a4a75640c7a5b12026', 'request_id': 'req-59c69ef3-9a37-402b-8046-df2e6248c545'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:56.427062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59c69ef3-9a37-402b-8046-df2e6248c545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed49ee4eca649a4a75640c7a5b12026', 'request_id': 'req-59c69ef3-9a37-402b-8046-df2e6248c545'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:56.436524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59c69ef3-9a37-402b-8046-df2e6248c545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed49ee4eca649a4a75640c7a5b12026', 'request_id': 'req-59c69ef3-9a37-402b-8046-df2e6248c545'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:56.455308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59c69ef3-9a37-402b-8046-df2e6248c545 admin admin] The token cache is being invalidate because project 6ed49ee4eca649a4a75640c7a5b12026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:04:56.456016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59c69ef3-9a37-402b-8046-df2e6248c545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:56.461149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59c69ef3-9a37-402b-8046-df2e6248c545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:56.466454 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1390/2767] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:56 2022] DELETE /identity/v3/projects/6ed49ee4eca649a4a75640c7a5b12026 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:56.472248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753e192-7399-482c-96d5-e6ea70717c19 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:56.472904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753e192-7399-482c-96d5-e6ea70717c19 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:56.473140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753e192-7399-482c-96d5-e6ea70717c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:56.523279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5753e192-7399-482c-96d5-e6ea70717c19 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:56.537058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5753e192-7399-482c-96d5-e6ea70717c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:56.628020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c69ef3-9a37-402b-8046-df2e6248c545 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:56.629831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-59c69ef3-9a37-402b-8046-df2e6248c545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:56.684604 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1378/2768] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:56.685888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:56.687883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9506d8-19ef-48dc-bc0a-688d6947412f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:56.688965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9506d8-19ef-48dc-bc0a-688d6947412f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:56.688965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9506d8-19ef-48dc-bc0a-688d6947412f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:56.729528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-fa9506d8-19ef-48dc-bc0a-688d6947412f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:56.731133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fa9506d8-19ef-48dc-bc0a-688d6947412f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:56.755587 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1379/2769] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:56.757452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9506d8-19ef-48dc-bc0a-688d6947412f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:56.790402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c69ef3-9a37-402b-8046-df2e6248c545 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:56.799468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60537953-a122-42d7-b030-31709042ad76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:56.800153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60537953-a122-42d7-b030-31709042ad76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:56.800418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60537953-a122-42d7-b030-31709042ad76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:56.800724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60537953-a122-42d7-b030-31709042ad76 admin admin] PATH_INFO: `/v3/users/db2f85b780b442199f50f8d6597724c5` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:56.808112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60537953-a122-42d7-b030-31709042ad76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db2f85b780b442199f50f8d6597724c5)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:56.813131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60537953-a122-42d7-b030-31709042ad76 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:56.824315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9506d8-19ef-48dc-bc0a-688d6947412f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:56.847119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e6660-4b0b-424f-9c03-cdfbda1a1027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:56.848363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e6660-4b0b-424f-9c03-cdfbda1a1027 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:56.849053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e6660-4b0b-424f-9c03-cdfbda1a1027 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:56.849756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e6660-4b0b-424f-9c03-cdfbda1a1027 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:56.851352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e6660-4b0b-424f-9c03-cdfbda1a1027 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:04:56.851902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e6660-4b0b-424f-9c03-cdfbda1a1027 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:56.856360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e6660-4b0b-424f-9c03-cdfbda1a1027 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:56.882215 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1380/2770] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:04:56.883885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e6660-4b0b-424f-9c03-cdfbda1a1027 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:56.920885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e6660-4b0b-424f-9c03-cdfbda1a1027 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:56.945773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5804d-e881-4323-a3bc-4b36c871b52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:56.946759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5804d-e881-4323-a3bc-4b36c871b52e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:56.947066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5804d-e881-4323-a3bc-4b36c871b52e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:56.947444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5804d-e881-4323-a3bc-4b36c871b52e admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:56.948288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5804d-e881-4323-a3bc-4b36c871b52e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:56.950011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-60537953-a122-42d7-b030-31709042ad76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db2f85b780b442199f50f8d6597724c5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:56.951225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5804d-e881-4323-a3bc-4b36c871b52e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:56.951768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-60537953-a122-42d7-b030-31709042ad76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db2f85b780b442199f50f8d6597724c5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:56.977789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-60537953-a122-42d7-b030-31709042ad76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db2f85b780b442199f50f8d6597724c5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:56.979971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-60537953-a122-42d7-b030-31709042ad76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db2f85b780b442199f50f8d6597724c5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:56.994009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-60537953-a122-42d7-b030-31709042ad76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db2f85b780b442199f50f8d6597724c5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:57.025082 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1391/2771] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:04:56 2022] DELETE /identity/v3/users/db2f85b780b442199f50f8d6597724c5 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:57.028443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c211a-05a1-4def-97af-8676c5674203 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:57.028966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c211a-05a1-4def-97af-8676c5674203 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:57.032661 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1381/2772] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:04:56 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:04:57.033229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c211a-05a1-4def-97af-8676c5674203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:57.038169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5804d-e881-4323-a3bc-4b36c871b52e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:57.040690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bae5804d-e881-4323-a3bc-4b36c871b52e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:57.061857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-756c211a-05a1-4def-97af-8676c5674203 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:57.063315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-756c211a-05a1-4def-97af-8676c5674203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:57.068631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:57.190842 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1392/2773] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:57.206481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c211a-05a1-4def-97af-8676c5674203 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:57.206481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-756c211a-05a1-4def-97af-8676c5674203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:57.229933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5804d-e881-4323-a3bc-4b36c871b52e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:57.238031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dabe11b-ee7f-43f8-8600-c9bbf0fd87c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:57.238786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabe11b-ee7f-43f8-8600-c9bbf0fd87c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:57.239142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabe11b-ee7f-43f8-8600-c9bbf0fd87c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:57.239526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabe11b-ee7f-43f8-8600-c9bbf0fd87c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:57.240271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dabe11b-ee7f-43f8-8600-c9bbf0fd87c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:57.242288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dabe11b-ee7f-43f8-8600-c9bbf0fd87c1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:57.281602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:57.319948 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1382/2774] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:04:57 2022] POST /identity/v3/users => generated 289 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:04:57.324412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dabe11b-ee7f-43f8-8600-c9bbf0fd87c1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:57.355676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dabe11b-ee7f-43f8-8600-c9bbf0fd87c1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:57.365287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c211a-05a1-4def-97af-8676c5674203 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:57.370478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b69e1f-d55b-481c-981d-aefed1600a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:57.372822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b69e1f-d55b-481c-981d-aefed1600a76 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:57.373358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b69e1f-d55b-481c-981d-aefed1600a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:57.373737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b69e1f-d55b-481c-981d-aefed1600a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:57.377099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b69e1f-d55b-481c-981d-aefed1600a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:57.379230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b69e1f-d55b-481c-981d-aefed1600a76 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:57.398126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5de68-620b-4ee5-8f1b-15cb0ea03039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:57.401680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5de68-620b-4ee5-8f1b-15cb0ea03039 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:57.402478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5de68-620b-4ee5-8f1b-15cb0ea03039 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:57.403742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5de68-620b-4ee5-8f1b-15cb0ea03039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:57.405681 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1383/2775] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:04:57.409148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b69e1f-d55b-481c-981d-aefed1600a76 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:57.431088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b69e1f-d55b-481c-981d-aefed1600a76 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:57.435615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5de68-620b-4ee5-8f1b-15cb0ea03039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:57.437568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5de68-620b-4ee5-8f1b-15cb0ea03039 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:57.445149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edd094-6329-4ef7-80de-e1e70975f69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:57.445894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edd094-6329-4ef7-80de-e1e70975f69e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:57.446256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edd094-6329-4ef7-80de-e1e70975f69e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:57.446826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edd094-6329-4ef7-80de-e1e70975f69e admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:57.447403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edd094-6329-4ef7-80de-e1e70975f69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:57.449724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edd094-6329-4ef7-80de-e1e70975f69e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:57.465185 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1393/2776] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:04:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:04:57.475132 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1384/2777] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:04:57.479334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5de68-620b-4ee5-8f1b-15cb0ea03039 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:57.503695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5de68-620b-4ee5-8f1b-15cb0ea03039 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:57.512734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e65b94-5d1f-4b4e-8530-4d703e866245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:57.513472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e65b94-5d1f-4b4e-8530-4d703e866245 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:57.514466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e65b94-5d1f-4b4e-8530-4d703e866245 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:57.514466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e65b94-5d1f-4b4e-8530-4d703e866245 admin admin] PATH_INFO: `/v3/projects/e42c5364a39747b69c18c6e6cc44e815/users/fbf76b231ffc44c691a0b60b685970f2/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:57.552107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e65b94-5d1f-4b4e-8530-4d703e866245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42c5364a39747b69c18c6e6cc44e815, user_id=fbf76b231ffc44c691a0b60b685970f2, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:57.554908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e65b94-5d1f-4b4e-8530-4d703e866245 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:57.584851 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1394/2778] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:04:57 2022] PUT /identity/v3/projects/e42c5364a39747b69c18c6e6cc44e815/users/fbf76b231ffc44c691a0b60b685970f2/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:57.596520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef87a26-3ae1-4ac5-8677-6dee41659308 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:57.597043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef87a26-3ae1-4ac5-8677-6dee41659308 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:57.597523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef87a26-3ae1-4ac5-8677-6dee41659308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:57.662480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2ef87a26-3ae1-4ac5-8677-6dee41659308 None None] MFA Rules not processed for user `fbf76b231ffc44c691a0b60b685970f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:57.663747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2ef87a26-3ae1-4ac5-8677-6dee41659308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:57.894900 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1385/2779] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:57.909186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e65b94-5d1f-4b4e-8530-4d703e866245 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:57.911550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-46e65b94-5d1f-4b4e-8530-4d703e866245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:58.061608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e65b94-5d1f-4b4e-8530-4d703e866245 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:58.070205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00df36-920c-4226-8c3d-1a97e36b8ea5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:58.071137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00df36-920c-4226-8c3d-1a97e36b8ea5 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:58.071623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00df36-920c-4226-8c3d-1a97e36b8ea5 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:58.072056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00df36-920c-4226-8c3d-1a97e36b8ea5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:58.094225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00df36-920c-4226-8c3d-1a97e36b8ea5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:58.096392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00df36-920c-4226-8c3d-1a97e36b8ea5 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:58.113429 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1395/2780] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:04:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:04:58.238237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef87a26-3ae1-4ac5-8677-6dee41659308 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:58.239866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2ef87a26-3ae1-4ac5-8677-6dee41659308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:58.398567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef87a26-3ae1-4ac5-8677-6dee41659308 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:58.410049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f865120-4733-48c5-bac1-bf9aba4a7e74 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:58.410672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f865120-4733-48c5-bac1-bf9aba4a7e74 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:58.410672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f865120-4733-48c5-bac1-bf9aba4a7e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:58.413304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60eaa8c-0b47-42b8-8439-64f96f7b8f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:58.414173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60eaa8c-0b47-42b8-8439-64f96f7b8f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:58.414864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60eaa8c-0b47-42b8-8439-64f96f7b8f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:58.419361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60eaa8c-0b47-42b8-8439-64f96f7b8f95 admin admin] PATH_INFO: `/v3/projects/eb8ec3b3cd3f46409711bae2091a042f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:58.421272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60eaa8c-0b47-42b8-8439-64f96f7b8f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb8ec3b3cd3f46409711bae2091a042f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:58.424405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60eaa8c-0b47-42b8-8439-64f96f7b8f95 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:58.459977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:58.481896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7f865120-4733-48c5-bac1-bf9aba4a7e74 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:58.484369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7f865120-4733-48c5-bac1-bf9aba4a7e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:58.541113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d60eaa8c-0b47-42b8-8439-64f96f7b8f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb8ec3b3cd3f46409711bae2091a042f', 'request_id': 'req-d60eaa8c-0b47-42b8-8439-64f96f7b8f95'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:58.559697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d60eaa8c-0b47-42b8-8439-64f96f7b8f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb8ec3b3cd3f46409711bae2091a042f', 'request_id': 'req-d60eaa8c-0b47-42b8-8439-64f96f7b8f95'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:58.565368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d60eaa8c-0b47-42b8-8439-64f96f7b8f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb8ec3b3cd3f46409711bae2091a042f', 'request_id': 'req-d60eaa8c-0b47-42b8-8439-64f96f7b8f95'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:58.587625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d60eaa8c-0b47-42b8-8439-64f96f7b8f95 admin admin] The token cache is being invalidate because project eb8ec3b3cd3f46409711bae2091a042f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:04:58.589747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d60eaa8c-0b47-42b8-8439-64f96f7b8f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:58.590794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d60eaa8c-0b47-42b8-8439-64f96f7b8f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:58.593907 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1386/2781] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:58 2022] DELETE /identity/v3/projects/eb8ec3b3cd3f46409711bae2091a042f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:04:58.613291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60eaa8c-0b47-42b8-8439-64f96f7b8f95 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:58.617097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d60eaa8c-0b47-42b8-8439-64f96f7b8f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:58.633555 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1396/2782] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:04:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:04:58.651721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f865120-4733-48c5-bac1-bf9aba4a7e74 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:04:58.653805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7f865120-4733-48c5-bac1-bf9aba4a7e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:58.686358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:58.824046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60eaa8c-0b47-42b8-8439-64f96f7b8f95 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:58.829366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e69b2-fb51-4019-b6d1-32fd97a0f28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:58.830047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f865120-4733-48c5-bac1-bf9aba4a7e74 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:04:58.830634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e69b2-fb51-4019-b6d1-32fd97a0f28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:58.831258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e69b2-fb51-4019-b6d1-32fd97a0f28c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:58.839331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e69b2-fb51-4019-b6d1-32fd97a0f28c admin admin] PATH_INFO: `/v3/users/97a4935bcddd4cf1aa7af1c8d73a8ffd` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:58.849555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e69b2-fb51-4019-b6d1-32fd97a0f28c admin admin] RBAC: Authorizing `identity:delete_user(user_id=97a4935bcddd4cf1aa7af1c8d73a8ffd)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:58.857741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e69b2-fb51-4019-b6d1-32fd97a0f28c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:59.008354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ff8e69b2-fb51-4019-b6d1-32fd97a0f28c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97a4935bcddd4cf1aa7af1c8d73a8ffd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:59.019829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282a411-5d07-4b53-93bd-94319ce2c308 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:04:59.020596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282a411-5d07-4b53-93bd-94319ce2c308 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:59.020888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282a411-5d07-4b53-93bd-94319ce2c308 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:59.021168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282a411-5d07-4b53-93bd-94319ce2c308 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:59.060805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ff8e69b2-fb51-4019-b6d1-32fd97a0f28c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97a4935bcddd4cf1aa7af1c8d73a8ffd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:59.064185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ff8e69b2-fb51-4019-b6d1-32fd97a0f28c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97a4935bcddd4cf1aa7af1c8d73a8ffd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:59.098931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ff8e69b2-fb51-4019-b6d1-32fd97a0f28c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97a4935bcddd4cf1aa7af1c8d73a8ffd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:59.099788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ff8e69b2-fb51-4019-b6d1-32fd97a0f28c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97a4935bcddd4cf1aa7af1c8d73a8ffd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:04:59.128706 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1387/2783] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:04:58 2022] DELETE /identity/v3/users/97a4935bcddd4cf1aa7af1c8d73a8ffd => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:04:59.149808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282a411-5d07-4b53-93bd-94319ce2c308 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:04:59.152762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282a411-5d07-4b53-93bd-94319ce2c308 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:04:59.177508 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1397/2784] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:04:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:59.583584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30888b92-49c6-416b-88a6-cf0bdcbb988e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:04:59.584763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30888b92-49c6-416b-88a6-cf0bdcbb988e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:04:59.585175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30888b92-49c6-416b-88a6-cf0bdcbb988e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:04:59.653085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-30888b92-49c6-416b-88a6-cf0bdcbb988e None None] MFA Rules not processed for user `fbf76b231ffc44c691a0b60b685970f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:04:59.654623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-30888b92-49c6-416b-88a6-cf0bdcbb988e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:04:59.683389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:59.901956 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1388/2785] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:04:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:00.474564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282a411-5d07-4b53-93bd-94319ce2c308 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:00.498644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282a411-5d07-4b53-93bd-94319ce2c308 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:00.707354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54749f30-b608-4436-9425-6e40f7ae0985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:00.709835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54749f30-b608-4436-9425-6e40f7ae0985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:00.710694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54749f30-b608-4436-9425-6e40f7ae0985 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:00.711472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54749f30-b608-4436-9425-6e40f7ae0985 admin admin] PATH_INFO: `/v3/projects/31319d222c05401486caf2960940293c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:00.713710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54749f30-b608-4436-9425-6e40f7ae0985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31319d222c05401486caf2960940293c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:00.717313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54749f30-b608-4436-9425-6e40f7ae0985 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:00.719666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:00.853707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-54749f30-b608-4436-9425-6e40f7ae0985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31319d222c05401486caf2960940293c', 'request_id': 'req-54749f30-b608-4436-9425-6e40f7ae0985'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:01.008677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-54749f30-b608-4436-9425-6e40f7ae0985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31319d222c05401486caf2960940293c', 'request_id': 'req-54749f30-b608-4436-9425-6e40f7ae0985'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:01.037127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-54749f30-b608-4436-9425-6e40f7ae0985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31319d222c05401486caf2960940293c', 'request_id': 'req-54749f30-b608-4436-9425-6e40f7ae0985'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:01.067142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-54749f30-b608-4436-9425-6e40f7ae0985 admin admin] The token cache is being invalidate because project 31319d222c05401486caf2960940293c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:05:01.068454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-54749f30-b608-4436-9425-6e40f7ae0985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:01.069477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-54749f30-b608-4436-9425-6e40f7ae0985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:01.077533 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1398/2786] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:00 2022] DELETE /identity/v3/projects/31319d222c05401486caf2960940293c => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:01.080054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42690857-9672-4039-8174-951ab0529028 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:01.080918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42690857-9672-4039-8174-951ab0529028 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:01.080918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42690857-9672-4039-8174-951ab0529028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:01.160158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-42690857-9672-4039-8174-951ab0529028 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:01.162321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-42690857-9672-4039-8174-951ab0529028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:01.215208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f4f2d-2deb-4ebf-8bf1-2e91b51ab3fa None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:01.215524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f4f2d-2deb-4ebf-8bf1-2e91b51ab3fa None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:01.215802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f4f2d-2deb-4ebf-8bf1-2e91b51ab3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:01.288968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-313f4f2d-2deb-4ebf-8bf1-2e91b51ab3fa None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:01.295307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-313f4f2d-2deb-4ebf-8bf1-2e91b51ab3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:01.384542 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1389/2787] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:05:01.390268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e97e32-e254-42ae-9ca3-797b1af49fb5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:01.390268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e97e32-e254-42ae-9ca3-797b1af49fb5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:01.390527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e97e32-e254-42ae-9ca3-797b1af49fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:01.477508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-89e97e32-e254-42ae-9ca3-797b1af49fb5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:01.496393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-89e97e32-e254-42ae-9ca3-797b1af49fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:01.501447 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1399/2788] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:05:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:05:01.512996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f4f2d-2deb-4ebf-8bf1-2e91b51ab3fa None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:01.516124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-313f4f2d-2deb-4ebf-8bf1-2e91b51ab3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:01.527840 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1390/2789] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:01.533328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e97e32-e254-42ae-9ca3-797b1af49fb5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:01.567083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e97e32-e254-42ae-9ca3-797b1af49fb5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:01.581110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b79b4c-4cf9-4ed0-b425-7abfe88798ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:01.582036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b79b4c-4cf9-4ed0-b425-7abfe88798ec admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:01.582372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b79b4c-4cf9-4ed0-b425-7abfe88798ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:01.582647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b79b4c-4cf9-4ed0-b425-7abfe88798ec admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:01.583628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b79b4c-4cf9-4ed0-b425-7abfe88798ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:05:01.583934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b79b4c-4cf9-4ed0-b425-7abfe88798ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:01.585814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b79b4c-4cf9-4ed0-b425-7abfe88798ec admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:01.603525 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1391/2790] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:05:01.609965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b79b4c-4cf9-4ed0-b425-7abfe88798ec admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:01.644461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b79b4c-4cf9-4ed0-b425-7abfe88798ec admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:01.654951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6fd8b-830b-46eb-8e01-6a8a05ce012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:01.656196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6fd8b-830b-46eb-8e01-6a8a05ce012c admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:01.657002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6fd8b-830b-46eb-8e01-6a8a05ce012c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:01.657540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6fd8b-830b-46eb-8e01-6a8a05ce012c admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:01.660668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6fd8b-830b-46eb-8e01-6a8a05ce012c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:01.670183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6fd8b-830b-46eb-8e01-6a8a05ce012c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:01.701411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f4f2d-2deb-4ebf-8bf1-2e91b51ab3fa None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:01.733150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce074db-abce-4bdd-b61a-8fc924a56691 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:01.734890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce074db-abce-4bdd-b61a-8fc924a56691 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:01.735913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce074db-abce-4bdd-b61a-8fc924a56691 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:01.736194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce074db-abce-4bdd-b61a-8fc924a56691 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:01.770542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce074db-abce-4bdd-b61a-8fc924a56691 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:01.774362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce074db-abce-4bdd-b61a-8fc924a56691 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:01.778371 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1392/2791] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:05:01 2022] POST /identity/v3/projects => generated 395 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:05:01.787732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6fd8b-830b-46eb-8e01-6a8a05ce012c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:01.798379 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1400/2792] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:05:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:05:01.962368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6fd8b-830b-46eb-8e01-6a8a05ce012c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:01.985895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1d855-fd87-4cfe-afa8-df1ee4e87f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:01.987164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1d855-fd87-4cfe-afa8-df1ee4e87f54 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:01.988747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1d855-fd87-4cfe-afa8-df1ee4e87f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:02.032410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1d855-fd87-4cfe-afa8-df1ee4e87f54 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:02.035019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1d855-fd87-4cfe-afa8-df1ee4e87f54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:02.037758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1d855-fd87-4cfe-afa8-df1ee4e87f54 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:02.076204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce074db-abce-4bdd-b61a-8fc924a56691 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:02.078477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6ce074db-abce-4bdd-b61a-8fc924a56691 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:02.091155 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1393/2793] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:05:01 2022] POST /identity/v3/users => generated 298 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:05:02.095215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1d855-fd87-4cfe-afa8-df1ee4e87f54 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:02.114847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1d855-fd87-4cfe-afa8-df1ee4e87f54 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:02.115027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce074db-abce-4bdd-b61a-8fc924a56691 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:02.125318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5b147-81a6-4671-84b3-59b921f4cb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:02.126836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5b147-81a6-4671-84b3-59b921f4cb51 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:02.128234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5b147-81a6-4671-84b3-59b921f4cb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:02.128697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5b147-81a6-4671-84b3-59b921f4cb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:02.128910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0a606-c2d7-4e0e-b9a8-8ffc7d0761ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:02.129756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0a606-c2d7-4e0e-b9a8-8ffc7d0761ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:02.129978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5b147-81a6-4671-84b3-59b921f4cb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:02.130380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0a606-c2d7-4e0e-b9a8-8ffc7d0761ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:02.130794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0a606-c2d7-4e0e-b9a8-8ffc7d0761ef admin admin] PATH_INFO: `/v3/users/fbf76b231ffc44c691a0b60b685970f2` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:02.132193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5b147-81a6-4671-84b3-59b921f4cb51 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:02.132602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0a606-c2d7-4e0e-b9a8-8ffc7d0761ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf76b231ffc44c691a0b60b685970f2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:02.135569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0a606-c2d7-4e0e-b9a8-8ffc7d0761ef admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:02.147951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:02.159543 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1394/2794] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:05:02.165562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5b147-81a6-4671-84b3-59b921f4cb51 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:02.183995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5b147-81a6-4671-84b3-59b921f4cb51 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:02.194584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb2581-f05b-4b2b-8930-457e73f3df61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:02.195298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb2581-f05b-4b2b-8930-457e73f3df61 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:02.195975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb2581-f05b-4b2b-8930-457e73f3df61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:02.195975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb2581-f05b-4b2b-8930-457e73f3df61 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:02.196807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb2581-f05b-4b2b-8930-457e73f3df61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:02.204765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb2581-f05b-4b2b-8930-457e73f3df61 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:02.218429 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1395/2795] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:05:02.220866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb2581-f05b-4b2b-8930-457e73f3df61 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:02.223048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:02.233508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb2581-f05b-4b2b-8930-457e73f3df61 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:02.256562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984e65b-c4fb-4469-b323-96fb470f52a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:02.257544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984e65b-c4fb-4469-b323-96fb470f52a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:02.257839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984e65b-c4fb-4469-b323-96fb470f52a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:02.258333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984e65b-c4fb-4469-b323-96fb470f52a9 admin admin] PATH_INFO: `/v3/projects/4b9fd68002104013828f37ce3bda24e8/users/efe8f31b2ffb49f39095e630ff4a0d1b/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:02.301546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984e65b-c4fb-4469-b323-96fb470f52a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9fd68002104013828f37ce3bda24e8, user_id=efe8f31b2ffb49f39095e630ff4a0d1b, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:02.308401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984e65b-c4fb-4469-b323-96fb470f52a9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:02.328683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-41e0a606-c2d7-4e0e-b9a8-8ffc7d0761ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf76b231ffc44c691a0b60b685970f2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:02.329903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-41e0a606-c2d7-4e0e-b9a8-8ffc7d0761ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf76b231ffc44c691a0b60b685970f2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:02.351948 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1396/2796] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:05:02 2022] PUT /identity/v3/projects/4b9fd68002104013828f37ce3bda24e8/users/efe8f31b2ffb49f39095e630ff4a0d1b/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:05:02.356122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-41e0a606-c2d7-4e0e-b9a8-8ffc7d0761ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf76b231ffc44c691a0b60b685970f2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:02.359737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b66cb9-ddae-4c29-bf6c-9be918a63165 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:02.360126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b66cb9-ddae-4c29-bf6c-9be918a63165 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:02.360487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b66cb9-ddae-4c29-bf6c-9be918a63165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:02.362337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-41e0a606-c2d7-4e0e-b9a8-8ffc7d0761ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf76b231ffc44c691a0b60b685970f2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:02.384775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-41e0a606-c2d7-4e0e-b9a8-8ffc7d0761ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf76b231ffc44c691a0b60b685970f2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:02.410046 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1401/2797] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:05:02 2022] DELETE /identity/v3/users/fbf76b231ffc44c691a0b60b685970f2 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:02.416707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a5e54-87c8-43cf-9018-7f8800027206 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:02.417004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a5e54-87c8-43cf-9018-7f8800027206 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:02.417333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-55b66cb9-ddae-4c29-bf6c-9be918a63165 None None] MFA Rules not processed for user `efe8f31b2ffb49f39095e630ff4a0d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:02.417453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a5e54-87c8-43cf-9018-7f8800027206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:02.418703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-55b66cb9-ddae-4c29-bf6c-9be918a63165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:02.452675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fb2a5e54-87c8-43cf-9018-7f8800027206 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:02.455767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fb2a5e54-87c8-43cf-9018-7f8800027206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:02.576659 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1397/2798] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:05:02.578087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b66cb9-ddae-4c29-bf6c-9be918a63165 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:02.579705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-55b66cb9-ddae-4c29-bf6c-9be918a63165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:02.618859 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1402/2799] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:02.628000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a5e54-87c8-43cf-9018-7f8800027206 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:02.630104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fb2a5e54-87c8-43cf-9018-7f8800027206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:02.697866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b66cb9-ddae-4c29-bf6c-9be918a63165 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:02.708948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9535f8-c47e-41a5-ae43-13fb02dbcbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:02.709567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9535f8-c47e-41a5-ae43-13fb02dbcbf2 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:02.709856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9535f8-c47e-41a5-ae43-13fb02dbcbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:02.710136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9535f8-c47e-41a5-ae43-13fb02dbcbf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:02.710885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9535f8-c47e-41a5-ae43-13fb02dbcbf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:02.712859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9535f8-c47e-41a5-ae43-13fb02dbcbf2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:02.782775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a5e54-87c8-43cf-9018-7f8800027206 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:02.792325 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1398/2800] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:05:02 2022] POST /identity/v3/projects => generated 395 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:05:02.793547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9535f8-c47e-41a5-ae43-13fb02dbcbf2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:02.911039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b04a0-4957-4b7b-afaa-cc51380790e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:02.912354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b04a0-4957-4b7b-afaa-cc51380790e3 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:02.912903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b04a0-4957-4b7b-afaa-cc51380790e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:02.913271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b04a0-4957-4b7b-afaa-cc51380790e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:02.920501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:02.935343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:02.995559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9535f8-c47e-41a5-ae43-13fb02dbcbf2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:03.012633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2820ff-7e1d-441d-a1f7-698e6304ba78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:03.013460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2820ff-7e1d-441d-a1f7-698e6304ba78 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:03.013750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2820ff-7e1d-441d-a1f7-698e6304ba78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:03.015560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2820ff-7e1d-441d-a1f7-698e6304ba78 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:03.016367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2820ff-7e1d-441d-a1f7-698e6304ba78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:03.020078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2820ff-7e1d-441d-a1f7-698e6304ba78 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:03.053887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b04a0-4957-4b7b-afaa-cc51380790e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:03.054497 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1399/2801] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:05:02 2022] POST /identity/v3/users => generated 304 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:05:03.055383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2820ff-7e1d-441d-a1f7-698e6304ba78 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:03.055995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b04a0-4957-4b7b-afaa-cc51380790e3 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:03.057601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3a2820ff-7e1d-441d-a1f7-698e6304ba78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:03.074267 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1403/2802] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:05:03.075218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b04a0-4957-4b7b-afaa-cc51380790e3 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:03.092154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b04a0-4957-4b7b-afaa-cc51380790e3 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:03.098850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd4eb0-a34d-4918-a275-a35ebe7710c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:03.100843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd4eb0-a34d-4918-a275-a35ebe7710c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:03.101084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd4eb0-a34d-4918-a275-a35ebe7710c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:03.101505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd4eb0-a34d-4918-a275-a35ebe7710c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:03.102504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd4eb0-a34d-4918-a275-a35ebe7710c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:03.105613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd4eb0-a34d-4918-a275-a35ebe7710c8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:03.123848 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1404/2803] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:05:03.129059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd4eb0-a34d-4918-a275-a35ebe7710c8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:03.157570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd4eb0-a34d-4918-a275-a35ebe7710c8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:03.166038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc681ac5-663f-4e39-b160-60854d2b70cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:03.166925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc681ac5-663f-4e39-b160-60854d2b70cc admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:03.167746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc681ac5-663f-4e39-b160-60854d2b70cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:03.168057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc681ac5-663f-4e39-b160-60854d2b70cc admin admin] PATH_INFO: `/v3/projects/8c3514fe4e0a46d0b3b5e667c39a75ae/users/96e78fcd0a6646c19cbc129cd003dc3b/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:03.210234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc681ac5-663f-4e39-b160-60854d2b70cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3514fe4e0a46d0b3b5e667c39a75ae, user_id=96e78fcd0a6646c19cbc129cd003dc3b, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:03.213668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc681ac5-663f-4e39-b160-60854d2b70cc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:03.242551 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1405/2804] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:05:03 2022] PUT /identity/v3/projects/8c3514fe4e0a46d0b3b5e667c39a75ae/users/96e78fcd0a6646c19cbc129cd003dc3b/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:03.249624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc681ac5-663f-4e39-b160-60854d2b70cc admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:03.267322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2820ff-7e1d-441d-a1f7-698e6304ba78 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:03.385954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc681ac5-663f-4e39-b160-60854d2b70cc admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:03.394915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b552641-fa85-40cd-8a99-add9fac0adc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:03.395720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b552641-fa85-40cd-8a99-add9fac0adc7 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:03.396012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b552641-fa85-40cd-8a99-add9fac0adc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:03.396316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b552641-fa85-40cd-8a99-add9fac0adc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:03.397198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b552641-fa85-40cd-8a99-add9fac0adc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:03.399499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b552641-fa85-40cd-8a99-add9fac0adc7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:03.416510 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1406/2805] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:05:03.421680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b552641-fa85-40cd-8a99-add9fac0adc7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:03.440051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b552641-fa85-40cd-8a99-add9fac0adc7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:03.446757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a234e-1b73-450f-bfc4-177792338127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:03.447453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a234e-1b73-450f-bfc4-177792338127 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:03.453514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a234e-1b73-450f-bfc4-177792338127 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:03.453514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a234e-1b73-450f-bfc4-177792338127 admin admin] PATH_INFO: `/v3/projects/8c3514fe4e0a46d0b3b5e667c39a75ae/users/96e78fcd0a6646c19cbc129cd003dc3b/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:03.453514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a234e-1b73-450f-bfc4-177792338127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3514fe4e0a46d0b3b5e667c39a75ae, user_id=96e78fcd0a6646c19cbc129cd003dc3b, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:03.455547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a234e-1b73-450f-bfc4-177792338127 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:03.476115 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1407/2806] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:05:03 2022] PUT /identity/v3/projects/8c3514fe4e0a46d0b3b5e667c39a75ae/users/96e78fcd0a6646c19cbc129cd003dc3b/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:03.486581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017da991-d873-4efd-9e90-88c2116c9a2f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:03.486883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017da991-d873-4efd-9e90-88c2116c9a2f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:03.487193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017da991-d873-4efd-9e90-88c2116c9a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:03.525855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e805bd-a684-4e83-84bc-fbc94b669a9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:03.526693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e805bd-a684-4e83-84bc-fbc94b669a9d service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:03.527336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e805bd-a684-4e83-84bc-fbc94b669a9d service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:03.527479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e805bd-a684-4e83-84bc-fbc94b669a9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:03.540604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-16e805bd-a684-4e83-84bc-fbc94b669a9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:03.626901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-017da991-d873-4efd-9e90-88c2116c9a2f None None] MFA Rules not processed for user `96e78fcd0a6646c19cbc129cd003dc3b`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:03.634163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-017da991-d873-4efd-9e90-88c2116c9a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:03.786739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e805bd-a684-4e83-84bc-fbc94b669a9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:03.787175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:03.789543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e805bd-a684-4e83-84bc-fbc94b669a9d service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:03.806625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:03.820324 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1400/2807] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 765 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:05:03.943680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e805bd-a684-4e83-84bc-fbc94b669a9d service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:03.945759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-16e805bd-a684-4e83-84bc-fbc94b669a9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:03.966425 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1408/2808] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:03.975646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017da991-d873-4efd-9e90-88c2116c9a2f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:04.002728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e805bd-a684-4e83-84bc-fbc94b669a9d service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:04.127180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017da991-d873-4efd-9e90-88c2116c9a2f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:04.132988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfe8c2-b39b-43d7-9a3e-f87d1d43d05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:04.133704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe8c2-b39b-43d7-9a3e-f87d1d43d05b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:04.134019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe8c2-b39b-43d7-9a3e-f87d1d43d05b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:04.134298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe8c2-b39b-43d7-9a3e-f87d1d43d05b admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:04.134973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfe8c2-b39b-43d7-9a3e-f87d1d43d05b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:04.140649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfe8c2-b39b-43d7-9a3e-f87d1d43d05b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:04.175023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c22068-1260-4684-9d98-eb22226bf536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:04.176173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c22068-1260-4684-9d98-eb22226bf536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:04.176810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c22068-1260-4684-9d98-eb22226bf536 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:04.177337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c22068-1260-4684-9d98-eb22226bf536 admin admin] PATH_INFO: `/v3/projects/e42c5364a39747b69c18c6e6cc44e815` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:04.180213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c22068-1260-4684-9d98-eb22226bf536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e42c5364a39747b69c18c6e6cc44e815)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:04.182648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c22068-1260-4684-9d98-eb22226bf536 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:04.240922 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1409/2809] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:05:03 2022] POST /identity/v3/projects => generated 395 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:05:04.247356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfe8c2-b39b-43d7-9a3e-f87d1d43d05b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:04.302224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f5c22068-1260-4684-9d98-eb22226bf536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e42c5364a39747b69c18c6e6cc44e815', 'request_id': 'req-f5c22068-1260-4684-9d98-eb22226bf536'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:04.316123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f5c22068-1260-4684-9d98-eb22226bf536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e42c5364a39747b69c18c6e6cc44e815', 'request_id': 'req-f5c22068-1260-4684-9d98-eb22226bf536'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:04.329764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f5c22068-1260-4684-9d98-eb22226bf536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e42c5364a39747b69c18c6e6cc44e815', 'request_id': 'req-f5c22068-1260-4684-9d98-eb22226bf536'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:04.377234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f5c22068-1260-4684-9d98-eb22226bf536 admin admin] The token cache is being invalidate because project e42c5364a39747b69c18c6e6cc44e815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:05:04.377234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f5c22068-1260-4684-9d98-eb22226bf536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:04.380393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f5c22068-1260-4684-9d98-eb22226bf536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:04.382506 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1401/2810] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:03 2022] DELETE /identity/v3/projects/e42c5364a39747b69c18c6e6cc44e815 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:05:04.402539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64f90e-3340-4a41-b5b5-1616d457e2dc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:04.406234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64f90e-3340-4a41-b5b5-1616d457e2dc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:04.406600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64f90e-3340-4a41-b5b5-1616d457e2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:04.447870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ed64f90e-3340-4a41-b5b5-1616d457e2dc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:04.450428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ed64f90e-3340-4a41-b5b5-1616d457e2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:04.460576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfe8c2-b39b-43d7-9a3e-f87d1d43d05b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:04.553573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d497d-2817-4073-b275-398ecd3202e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:04.554247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d497d-2817-4073-b275-398ecd3202e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:04.554608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d497d-2817-4073-b275-398ecd3202e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:04.554885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d497d-2817-4073-b275-398ecd3202e5 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:04.555633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d497d-2817-4073-b275-398ecd3202e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:04.559157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d497d-2817-4073-b275-398ecd3202e5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:04.582777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:04.611525 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1410/2811] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:05:04 2022] POST /identity/v3/users => generated 298 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:05:04.611741 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1402/2812] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:04.612152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275e4ee-503f-4f2a-aae9-ad501aab071c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:04.612354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275e4ee-503f-4f2a-aae9-ad501aab071c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:04.612595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275e4ee-503f-4f2a-aae9-ad501aab071c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:04.637385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64f90e-3340-4a41-b5b5-1616d457e2dc None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:04.637385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ed64f90e-3340-4a41-b5b5-1616d457e2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:04.650861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64f90e-3340-4a41-b5b5-1616d457e2dc None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:04.658490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087134cd-b5a3-4b47-b82b-45d457ae4162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:04.664287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6275e4ee-503f-4f2a-aae9-ad501aab071c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:04.665230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087134cd-b5a3-4b47-b82b-45d457ae4162 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:04.665514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087134cd-b5a3-4b47-b82b-45d457ae4162 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:04.665797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087134cd-b5a3-4b47-b82b-45d457ae4162 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:04.667380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087134cd-b5a3-4b47-b82b-45d457ae4162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:04.669580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087134cd-b5a3-4b47-b82b-45d457ae4162 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:04.670511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6275e4ee-503f-4f2a-aae9-ad501aab071c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:04.690476 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1403/2813] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:05:04.695180 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1411/2814] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:04.698727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087134cd-b5a3-4b47-b82b-45d457ae4162 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:04.705683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275e4ee-503f-4f2a-aae9-ad501aab071c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:04.713338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087134cd-b5a3-4b47-b82b-45d457ae4162 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:04.715972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275e4ee-503f-4f2a-aae9-ad501aab071c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:04.720341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d457c2-bbe3-4247-ae60-42dc662a39b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:04.721332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d457c2-bbe3-4247-ae60-42dc662a39b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:04.721778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d457c2-bbe3-4247-ae60-42dc662a39b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:04.722422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d457c2-bbe3-4247-ae60-42dc662a39b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:04.723369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d457c2-bbe3-4247-ae60-42dc662a39b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:04.723681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276a1ec-0059-43f0-b379-8598f7e7f356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:04.724443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276a1ec-0059-43f0-b379-8598f7e7f356 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:04.724875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276a1ec-0059-43f0-b379-8598f7e7f356 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:04.725150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276a1ec-0059-43f0-b379-8598f7e7f356 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:04.725969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276a1ec-0059-43f0-b379-8598f7e7f356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:05:04.726221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d457c2-bbe3-4247-ae60-42dc662a39b0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:04.726342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276a1ec-0059-43f0-b379-8598f7e7f356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:04.729361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276a1ec-0059-43f0-b379-8598f7e7f356 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:04.760694 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1412/2815] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:05:04.763690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276a1ec-0059-43f0-b379-8598f7e7f356 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:04.769836 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1404/2816] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:05:04.770142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d457c2-bbe3-4247-ae60-42dc662a39b0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:04.781910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276a1ec-0059-43f0-b379-8598f7e7f356 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:04.785494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d457c2-bbe3-4247-ae60-42dc662a39b0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:04.791329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619d6c4-d90b-4112-9e63-6e5d3b640e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:04.793313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619d6c4-d90b-4112-9e63-6e5d3b640e7e admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:04.793313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619d6c4-d90b-4112-9e63-6e5d3b640e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:04.793743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b2ec5-212e-423e-8869-a485a7f65031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:04.794314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b2ec5-212e-423e-8869-a485a7f65031 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:04.794775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b2ec5-212e-423e-8869-a485a7f65031 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:04.795167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b2ec5-212e-423e-8869-a485a7f65031 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:04.795913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b2ec5-212e-423e-8869-a485a7f65031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:04.798381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b2ec5-212e-423e-8869-a485a7f65031 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:04.803120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619d6c4-d90b-4112-9e63-6e5d3b640e7e admin admin] PATH_INFO: `/v3/projects/98216049978b4ec59b313fa005651b51/users/be4e00bebaf0410087202ab5be3251f3/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:04.810252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:04.853984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619d6c4-d90b-4112-9e63-6e5d3b640e7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=98216049978b4ec59b313fa005651b51, user_id=be4e00bebaf0410087202ab5be3251f3, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:04.858524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619d6c4-d90b-4112-9e63-6e5d3b640e7e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:04.886186 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1405/2817] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:05:04 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:05:04.886671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b2ec5-212e-423e-8869-a485a7f65031 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:04.888808 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1413/2818] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:05:04 2022] PUT /identity/v3/projects/98216049978b4ec59b313fa005651b51/users/be4e00bebaf0410087202ab5be3251f3/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:04.903981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0ac2e-6d39-42e1-b95d-7dd190a9d941 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:04.904483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0ac2e-6d39-42e1-b95d-7dd190a9d941 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:04.905164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0ac2e-6d39-42e1-b95d-7dd190a9d941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:04.970687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-96b0ac2e-6d39-42e1-b95d-7dd190a9d941 None None] MFA Rules not processed for user `be4e00bebaf0410087202ab5be3251f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:04.973537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-96b0ac2e-6d39-42e1-b95d-7dd190a9d941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:05.024473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b2ec5-212e-423e-8869-a485a7f65031 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:05.032633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272295a-b441-42b0-8de5-8a26664adb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:05.036785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272295a-b441-42b0-8de5-8a26664adb07 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:05.037151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272295a-b441-42b0-8de5-8a26664adb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:05.037503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272295a-b441-42b0-8de5-8a26664adb07 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:05.038267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272295a-b441-42b0-8de5-8a26664adb07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:05.040325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272295a-b441-42b0-8de5-8a26664adb07 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:05.093734 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1406/2819] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:05:04 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:05:05.097863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272295a-b441-42b0-8de5-8a26664adb07 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:05.114425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272295a-b441-42b0-8de5-8a26664adb07 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:05.126228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b81c4c-cb56-4577-8fac-193ea8468453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:05.127546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b81c4c-cb56-4577-8fac-193ea8468453 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:05.128655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b81c4c-cb56-4577-8fac-193ea8468453 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:05.129462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b81c4c-cb56-4577-8fac-193ea8468453 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:05.132502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b81c4c-cb56-4577-8fac-193ea8468453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:05.135036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b81c4c-cb56-4577-8fac-193ea8468453 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:05.151230 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1414/2820] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:05:05.157428 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1407/2821] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:05:05.161474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0ac2e-6d39-42e1-b95d-7dd190a9d941 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:05.175731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0ac2e-6d39-42e1-b95d-7dd190a9d941 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:05.182482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eff1cd-a392-4a3a-83e9-644128ef9a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:05.183007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eff1cd-a392-4a3a-83e9-644128ef9a78 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:05.183941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eff1cd-a392-4a3a-83e9-644128ef9a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:05.184218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eff1cd-a392-4a3a-83e9-644128ef9a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:05.184927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eff1cd-a392-4a3a-83e9-644128ef9a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:05.186694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eff1cd-a392-4a3a-83e9-644128ef9a78 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:05.214747 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1415/2822] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:05:05.220270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b81c4c-cb56-4577-8fac-193ea8468453 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:05.232953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b81c4c-cb56-4577-8fac-193ea8468453 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:05.238691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd78f37-c9e1-4669-bda5-542f9eb8aa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:05.239466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd78f37-c9e1-4669-bda5-542f9eb8aa5f admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:05.240376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd78f37-c9e1-4669-bda5-542f9eb8aa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:05.240707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd78f37-c9e1-4669-bda5-542f9eb8aa5f admin admin] PATH_INFO: `/v3/projects/2f684cc4b6d44b398d3c6cd0e8aac7b0/users/1906745af3e24906adf16c6c68e12968/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:05.264797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd78f37-c9e1-4669-bda5-542f9eb8aa5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f684cc4b6d44b398d3c6cd0e8aac7b0, user_id=1906745af3e24906adf16c6c68e12968, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:05.268631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd78f37-c9e1-4669-bda5-542f9eb8aa5f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:05.291894 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1408/2823] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:05:05 2022] PUT /identity/v3/projects/2f684cc4b6d44b398d3c6cd0e8aac7b0/users/1906745af3e24906adf16c6c68e12968/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:05:05.294176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e79771-9da6-4cd7-8baf-d9ba03e7f520 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:05.294467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e79771-9da6-4cd7-8baf-d9ba03e7f520 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:05.294741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e79771-9da6-4cd7-8baf-d9ba03e7f520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:05.322729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a2e79771-9da6-4cd7-8baf-d9ba03e7f520 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:05.324133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a2e79771-9da6-4cd7-8baf-d9ba03e7f520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:05.378378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd78f37-c9e1-4669-bda5-542f9eb8aa5f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:05.380335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-abd78f37-c9e1-4669-bda5-542f9eb8aa5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:05.426719 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1416/2824] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:05.440705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e79771-9da6-4cd7-8baf-d9ba03e7f520 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:05.442609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a2e79771-9da6-4cd7-8baf-d9ba03e7f520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:05.496924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:05.528528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e79771-9da6-4cd7-8baf-d9ba03e7f520 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:05.533004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc87d41-5dc2-433c-8b78-b9913c033117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:05.533721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc87d41-5dc2-433c-8b78-b9913c033117 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:05.534075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc87d41-5dc2-433c-8b78-b9913c033117 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:05.534424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc87d41-5dc2-433c-8b78-b9913c033117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:05.547276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc87d41-5dc2-433c-8b78-b9913c033117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:05.548858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc87d41-5dc2-433c-8b78-b9913c033117 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:05.552384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd78f37-c9e1-4669-bda5-542f9eb8aa5f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:05.562371 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1417/2825] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:05:05.565717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af770fcb-ba3f-4e25-9a93-3bfd7d427d7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:05.566463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af770fcb-ba3f-4e25-9a93-3bfd7d427d7d service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:05.566694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af770fcb-ba3f-4e25-9a93-3bfd7d427d7d service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:05.566976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af770fcb-ba3f-4e25-9a93-3bfd7d427d7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:05.572071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-af770fcb-ba3f-4e25-9a93-3bfd7d427d7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:05.667586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:05.718846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af770fcb-ba3f-4e25-9a93-3bfd7d427d7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:05.721402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af770fcb-ba3f-4e25-9a93-3bfd7d427d7d service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:05.756397 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1409/2826] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:05:05.823493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db293455-286d-4098-aa4a-f1a4c8ae240e None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:05.824104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db293455-286d-4098-aa4a-f1a4c8ae240e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:05.824104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db293455-286d-4098-aa4a-f1a4c8ae240e None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:05.825971 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1418/2827] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:05:05.835403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af770fcb-ba3f-4e25-9a93-3bfd7d427d7d service nova] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:05:05.852292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af770fcb-ba3f-4e25-9a93-3bfd7d427d7d service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:05.865058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af770fcb-ba3f-4e25-9a93-3bfd7d427d7d service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:05.873261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e65850-7720-4873-904e-a850ceb5f44d tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e78fcd0a6646c19cbc129cd003dc3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c3514fe4e0a46d0b3b5e667c39a75ae', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:05.874191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e65850-7720-4873-904e-a850ceb5f44d tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:05.874555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e65850-7720-4873-904e-a850ceb5f44d tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:05.874908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e65850-7720-4873-904e-a850ceb5f44d tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] PATH_INFO: `/v3/projects/4b9fd68002104013828f37ce3bda24e8` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:05.876252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e65850-7720-4873-904e-a850ceb5f44d tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] RBAC: Authorizing `identity:get_project(project_id=4b9fd68002104013828f37ce3bda24e8)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:05.879433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e65850-7720-4873-904e-a850ceb5f44d tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:05.886840 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1410/2828] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:05:05 2022] GET /identity/v3/projects/4b9fd68002104013828f37ce3bda24e8 => generated 395 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:05:05.930157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f94378-8882-4054-a13a-04393de0a46a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:05.930447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f94378-8882-4054-a13a-04393de0a46a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:05.930726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f94378-8882-4054-a13a-04393de0a46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:05.940011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c371d-c21a-4cd1-8887-39ec3c01ec5e None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:05.941802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c371d-c21a-4cd1-8887-39ec3c01ec5e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:05.942256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c371d-c21a-4cd1-8887-39ec3c01ec5e None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:05.944338 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1411/2829] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:05:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 21:05:05.951922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c371d-c21a-4cd1-8887-39ec3c01ec5e None None] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:05:05.963946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-35f94378-8882-4054-a13a-04393de0a46a None None] MFA Rules not processed for user `d20ab89ea13c4611904cec244d37ba25`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:05.965908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-35f94378-8882-4054-a13a-04393de0a46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:05.973837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c371d-c21a-4cd1-8887-39ec3c01ec5e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:05.994135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c371d-c21a-4cd1-8887-39ec3c01ec5e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:05.998478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfc30d-a353-453e-965b-93f10e3c6094 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e78fcd0a6646c19cbc129cd003dc3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c3514fe4e0a46d0b3b5e667c39a75ae', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:05.998478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfc30d-a353-453e-965b-93f10e3c6094 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:05.999833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfc30d-a353-453e-965b-93f10e3c6094 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:05.999833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfc30d-a353-453e-965b-93f10e3c6094 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] PATH_INFO: `/v3/projects/4b9fd68002104013828f37ce3bda24e8` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:06.000938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfc30d-a353-453e-965b-93f10e3c6094 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] RBAC: Authorizing `identity:get_project(project_id=4b9fd68002104013828f37ce3bda24e8)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:06.003180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfc30d-a353-453e-965b-93f10e3c6094 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:06.006655 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1412/2830] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:05:05 2022] GET /identity/v3/projects/4b9fd68002104013828f37ce3bda24e8 => generated 395 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:05:06.066146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e7384-b65b-4daa-a9bb-6579fdcc244d None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:06.066529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e7384-b65b-4daa-a9bb-6579fdcc244d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:06.066815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e7384-b65b-4daa-a9bb-6579fdcc244d None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:06.068206 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1413/2831] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 21:05:06.086247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e7384-b65b-4daa-a9bb-6579fdcc244d None None] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:05:06.090314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ed2e7384-b65b-4daa-a9bb-6579fdcc244d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:06.114820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e7384-b65b-4daa-a9bb-6579fdcc244d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:06.115830 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1419/2832] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:06.130917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e7384-b65b-4daa-a9bb-6579fdcc244d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:06.138072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9873bb-6a7c-461a-81af-df05edc1fbef tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e78fcd0a6646c19cbc129cd003dc3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c3514fe4e0a46d0b3b5e667c39a75ae', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:06.139157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9873bb-6a7c-461a-81af-df05edc1fbef tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:06.139501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9873bb-6a7c-461a-81af-df05edc1fbef tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:06.140464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9873bb-6a7c-461a-81af-df05edc1fbef tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] PATH_INFO: `/v3/projects/4b9fd68002104013828f37ce3bda24e8` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:06.143008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9873bb-6a7c-461a-81af-df05edc1fbef tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] RBAC: Authorizing `identity:get_project(project_id=4b9fd68002104013828f37ce3bda24e8)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:06.145063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9873bb-6a7c-461a-81af-df05edc1fbef tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:06.160641 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1414/2833] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:05:06 2022] GET /identity/v3/projects/4b9fd68002104013828f37ce3bda24e8 => generated 395 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:05:07.268059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f94378-8882-4054-a13a-04393de0a46a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:07.290466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f94378-8882-4054-a13a-04393de0a46a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:07.305657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9c792-6bd9-4986-9587-c02548edafa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:07.306386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9c792-6bd9-4986-9587-c02548edafa2 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:07.306676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9c792-6bd9-4986-9587-c02548edafa2 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:07.306953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9c792-6bd9-4986-9587-c02548edafa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:07.315621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a3d9c792-6bd9-4986-9587-c02548edafa2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:07.475700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9c792-6bd9-4986-9587-c02548edafa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:07.480918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9c792-6bd9-4986-9587-c02548edafa2 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:07.525654 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1420/2834] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:05:08.165894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c85be1-65f4-4bfb-ad57-54343c7d1844 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:08.168474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c85be1-65f4-4bfb-ad57-54343c7d1844 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:08.169061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c85be1-65f4-4bfb-ad57-54343c7d1844 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:08.170719 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1415/2835] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:05:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:05:08.179146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9c792-6bd9-4986-9587-c02548edafa2 service nova] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:05:08.196011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9c792-6bd9-4986-9587-c02548edafa2 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:08.220570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9c792-6bd9-4986-9587-c02548edafa2 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:08.235067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398200a1-a93d-4d68-a8f9-fb5e915fb6e0 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e78fcd0a6646c19cbc129cd003dc3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c3514fe4e0a46d0b3b5e667c39a75ae', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:08.236104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398200a1-a93d-4d68-a8f9-fb5e915fb6e0 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:08.236521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398200a1-a93d-4d68-a8f9-fb5e915fb6e0 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:08.239255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398200a1-a93d-4d68-a8f9-fb5e915fb6e0 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] PATH_INFO: `/v3/projects/4b9fd68002104013828f37ce3bda24e8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:08.241548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398200a1-a93d-4d68-a8f9-fb5e915fb6e0 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] RBAC: Authorizing `identity:get_project(project_id=4b9fd68002104013828f37ce3bda24e8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:08.247251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398200a1-a93d-4d68-a8f9-fb5e915fb6e0 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:08.255391 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1421/2836] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:05:08 2022] GET /identity/v3/projects/4b9fd68002104013828f37ce3bda24e8 => generated 395 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:05:09.388513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c75fd4-9f1f-4663-8f9e-a32a6307c499 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:09.389639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c75fd4-9f1f-4663-8f9e-a32a6307c499 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:09.390140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c75fd4-9f1f-4663-8f9e-a32a6307c499 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:09.394950 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1416/2837] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:05:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:05:09.401325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398200a1-a93d-4d68-a8f9-fb5e915fb6e0 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:05:09.423144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398200a1-a93d-4d68-a8f9-fb5e915fb6e0 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:09.441231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398200a1-a93d-4d68-a8f9-fb5e915fb6e0 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:09.453281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecaaa95-8ab8-4451-9c5f-3c656b6c7c6e tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e78fcd0a6646c19cbc129cd003dc3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c3514fe4e0a46d0b3b5e667c39a75ae', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:09.454036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaaa95-8ab8-4451-9c5f-3c656b6c7c6e tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:09.455318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaaa95-8ab8-4451-9c5f-3c656b6c7c6e tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:09.455681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaaa95-8ab8-4451-9c5f-3c656b6c7c6e tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] PATH_INFO: `/v3/projects/4b9fd68002104013828f37ce3bda24e8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:09.458949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecaaa95-8ab8-4451-9c5f-3c656b6c7c6e tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] RBAC: Authorizing `identity:get_project(project_id=4b9fd68002104013828f37ce3bda24e8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:09.463266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecaaa95-8ab8-4451-9c5f-3c656b6c7c6e tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:09.482491 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1422/2838] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:05:09 2022] GET /identity/v3/projects/4b9fd68002104013828f37ce3bda24e8 => generated 395 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:05:11.520874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30dae3-7edf-43ee-87d6-fb835524e7f4 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:11.521997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30dae3-7edf-43ee-87d6-fb835524e7f4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:11.522574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30dae3-7edf-43ee-87d6-fb835524e7f4 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:11.524614 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1417/2839] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:05:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:05:11.531869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecaaa95-8ab8-4451-9c5f-3c656b6c7c6e tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:05:11.549966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecaaa95-8ab8-4451-9c5f-3c656b6c7c6e tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:11.585947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecaaa95-8ab8-4451-9c5f-3c656b6c7c6e tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:11.596784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b5363-4f8e-4c96-8e30-342fa42baa05 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e78fcd0a6646c19cbc129cd003dc3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c3514fe4e0a46d0b3b5e667c39a75ae', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:11.597731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b5363-4f8e-4c96-8e30-342fa42baa05 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:11.598091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b5363-4f8e-4c96-8e30-342fa42baa05 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:11.598449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b5363-4f8e-4c96-8e30-342fa42baa05 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] PATH_INFO: `/v3/projects/98216049978b4ec59b313fa005651b51` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:11.600440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b5363-4f8e-4c96-8e30-342fa42baa05 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] RBAC: Authorizing `identity:get_project(project_id=98216049978b4ec59b313fa005651b51)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:11.608467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b5363-4f8e-4c96-8e30-342fa42baa05 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:11.612176 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1423/2840] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:05:11 2022] GET /identity/v3/projects/98216049978b4ec59b313fa005651b51 => generated 395 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:05:12.099436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30dae3-7edf-43ee-87d6-fb835524e7f4 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:12.125348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30dae3-7edf-43ee-87d6-fb835524e7f4 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:12.138167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fd801-8f8d-4982-86b3-f71f086dfa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:12.138920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fd801-8f8d-4982-86b3-f71f086dfa1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:12.143247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fd801-8f8d-4982-86b3-f71f086dfa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:12.143854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fd801-8f8d-4982-86b3-f71f086dfa1a admin admin] PATH_INFO: `/v3/users/efe8f31b2ffb49f39095e630ff4a0d1b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:12.147866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fd801-8f8d-4982-86b3-f71f086dfa1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=efe8f31b2ffb49f39095e630ff4a0d1b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:12.156429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fd801-8f8d-4982-86b3-f71f086dfa1a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:12.259154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e4fd801-8f8d-4982-86b3-f71f086dfa1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efe8f31b2ffb49f39095e630ff4a0d1b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:12.293737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e4fd801-8f8d-4982-86b3-f71f086dfa1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efe8f31b2ffb49f39095e630ff4a0d1b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:12.295595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e4fd801-8f8d-4982-86b3-f71f086dfa1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efe8f31b2ffb49f39095e630ff4a0d1b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:12.333397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e4fd801-8f8d-4982-86b3-f71f086dfa1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efe8f31b2ffb49f39095e630ff4a0d1b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:12.334912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e4fd801-8f8d-4982-86b3-f71f086dfa1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efe8f31b2ffb49f39095e630ff4a0d1b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:12.394485 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1418/2841] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:05:12 2022] DELETE /identity/v3/users/efe8f31b2ffb49f39095e630ff4a0d1b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:12.403378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acba8ec-65f0-4333-97b5-d32d137c8976 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:12.403378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acba8ec-65f0-4333-97b5-d32d137c8976 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:12.406704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acba8ec-65f0-4333-97b5-d32d137c8976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:12.467539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0acba8ec-65f0-4333-97b5-d32d137c8976 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:12.469313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0acba8ec-65f0-4333-97b5-d32d137c8976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:12.565865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:12.589014 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1424/2842] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:12.596454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fd801-8f8d-4982-86b3-f71f086dfa1a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:12.599137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1e4fd801-8f8d-4982-86b3-f71f086dfa1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:12.799534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fd801-8f8d-4982-86b3-f71f086dfa1a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:12.809450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a9bf8-b12d-4122-ab0c-89a8d3429f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:12.812241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a9bf8-b12d-4122-ab0c-89a8d3429f84 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:12.812817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a9bf8-b12d-4122-ab0c-89a8d3429f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:12.814615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a9bf8-b12d-4122-ab0c-89a8d3429f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:12.864119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a9bf8-b12d-4122-ab0c-89a8d3429f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:12.865846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a9bf8-b12d-4122-ab0c-89a8d3429f84 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:12.906606 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1419/2843] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:05:12.945451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aff48e-5327-4b43-8aec-044a30edff47 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:12.946098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aff48e-5327-4b43-8aec-044a30edff47 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:12.946805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aff48e-5327-4b43-8aec-044a30edff47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:12.996347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e6aff48e-5327-4b43-8aec-044a30edff47 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:13.003231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e6aff48e-5327-4b43-8aec-044a30edff47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:13.067224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa04da7-6265-43c1-b91f-d9a95cfb3fa2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:13.067520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa04da7-6265-43c1-b91f-d9a95cfb3fa2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:13.068053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa04da7-6265-43c1-b91f-d9a95cfb3fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:13.114267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-afa04da7-6265-43c1-b91f-d9a95cfb3fa2 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:13.115843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-afa04da7-6265-43c1-b91f-d9a95cfb3fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:13.148569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:13.187035 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1425/2844] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:05:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:13.206880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aff48e-5327-4b43-8aec-044a30edff47 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:13.208183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e6aff48e-5327-4b43-8aec-044a30edff47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:13.238166 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1420/2845] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:05:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:05:13.263413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa04da7-6265-43c1-b91f-d9a95cfb3fa2 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:13.266303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-afa04da7-6265-43c1-b91f-d9a95cfb3fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:13.430406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aff48e-5327-4b43-8aec-044a30edff47 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:13.460203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4897d-40ee-4301-b208-7662770f2131 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:13.461812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4897d-40ee-4301-b208-7662770f2131 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:13.462276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4897d-40ee-4301-b208-7662770f2131 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:13.462716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4897d-40ee-4301-b208-7662770f2131 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:13.496532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa04da7-6265-43c1-b91f-d9a95cfb3fa2 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:13.501698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4897d-40ee-4301-b208-7662770f2131 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:13.505059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4897d-40ee-4301-b208-7662770f2131 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:13.509663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3295090-aafb-4561-b9d1-e0eb4bb5441c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:13.509663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3295090-aafb-4561-b9d1-e0eb4bb5441c service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:13.509965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3295090-aafb-4561-b9d1-e0eb4bb5441c service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:13.512011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3295090-aafb-4561-b9d1-e0eb4bb5441c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:13.537962 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1426/2846] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:05:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:05:13.539911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3295090-aafb-4561-b9d1-e0eb4bb5441c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:13.546121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3295090-aafb-4561-b9d1-e0eb4bb5441c service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:13.573012 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1421/2847] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:05:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:05:14.394627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4897d-40ee-4301-b208-7662770f2131 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:14.396240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-44e4897d-40ee-4301-b208-7662770f2131 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:14.458394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4897d-40ee-4301-b208-7662770f2131 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:14.479997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ece97-52c6-426d-8ebb-860ada277f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:14.480637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ece97-52c6-426d-8ebb-860ada277f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:14.483171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ece97-52c6-426d-8ebb-860ada277f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:14.484434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ece97-52c6-426d-8ebb-860ada277f84 admin admin] PATH_INFO: `/v3/projects/4b9fd68002104013828f37ce3bda24e8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:14.503687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ece97-52c6-426d-8ebb-860ada277f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9fd68002104013828f37ce3bda24e8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:14.517815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ece97-52c6-426d-8ebb-860ada277f84 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:14.721646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-503ece97-52c6-426d-8ebb-860ada277f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9fd68002104013828f37ce3bda24e8', 'request_id': 'req-503ece97-52c6-426d-8ebb-860ada277f84'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:14.740933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-503ece97-52c6-426d-8ebb-860ada277f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9fd68002104013828f37ce3bda24e8', 'request_id': 'req-503ece97-52c6-426d-8ebb-860ada277f84'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:14.780671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-503ece97-52c6-426d-8ebb-860ada277f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9fd68002104013828f37ce3bda24e8', 'request_id': 'req-503ece97-52c6-426d-8ebb-860ada277f84'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:14.823694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-503ece97-52c6-426d-8ebb-860ada277f84 admin admin] The token cache is being invalidate because project 4b9fd68002104013828f37ce3bda24e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:05:14.824960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-503ece97-52c6-426d-8ebb-860ada277f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:14.825902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-503ece97-52c6-426d-8ebb-860ada277f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:14.832853 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1427/2848] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:14 2022] DELETE /identity/v3/projects/4b9fd68002104013828f37ce3bda24e8 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:14.837162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3295090-aafb-4561-b9d1-e0eb4bb5441c service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:14.885154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3295090-aafb-4561-b9d1-e0eb4bb5441c service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:15.084484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846eb74-3601-46fe-8fa0-323010cd3b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:15.085324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846eb74-3601-46fe-8fa0-323010cd3b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:15.085793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846eb74-3601-46fe-8fa0-323010cd3b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:15.086076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846eb74-3601-46fe-8fa0-323010cd3b55 admin admin] PATH_INFO: `/v3/users/96e78fcd0a6646c19cbc129cd003dc3b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:15.092460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846eb74-3601-46fe-8fa0-323010cd3b55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96e78fcd0a6646c19cbc129cd003dc3b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:15.097312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846eb74-3601-46fe-8fa0-323010cd3b55 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:15.222729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f846eb74-3601-46fe-8fa0-323010cd3b55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96e78fcd0a6646c19cbc129cd003dc3b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:15.254661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:15.272770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f846eb74-3601-46fe-8fa0-323010cd3b55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96e78fcd0a6646c19cbc129cd003dc3b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:15.275516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f846eb74-3601-46fe-8fa0-323010cd3b55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96e78fcd0a6646c19cbc129cd003dc3b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:15.292857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f846eb74-3601-46fe-8fa0-323010cd3b55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96e78fcd0a6646c19cbc129cd003dc3b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:15.295352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f846eb74-3601-46fe-8fa0-323010cd3b55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96e78fcd0a6646c19cbc129cd003dc3b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:15.329738 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1422/2849] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:05:14 2022] DELETE /identity/v3/users/96e78fcd0a6646c19cbc129cd003dc3b => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:16.201707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ece97-52c6-426d-8ebb-860ada277f84 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:16.203869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-503ece97-52c6-426d-8ebb-860ada277f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:16.224507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ece97-52c6-426d-8ebb-860ada277f84 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:16.265591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:16.404074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85414f60-4e35-43cc-a060-f98ea265f982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:16.405615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85414f60-4e35-43cc-a060-f98ea265f982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:16.405909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85414f60-4e35-43cc-a060-f98ea265f982 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:16.408844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85414f60-4e35-43cc-a060-f98ea265f982 admin admin] PATH_INFO: `/v3/projects/8c3514fe4e0a46d0b3b5e667c39a75ae` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:16.410581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85414f60-4e35-43cc-a060-f98ea265f982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c3514fe4e0a46d0b3b5e667c39a75ae)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:16.412640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85414f60-4e35-43cc-a060-f98ea265f982 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:16.560083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-85414f60-4e35-43cc-a060-f98ea265f982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c3514fe4e0a46d0b3b5e667c39a75ae', 'request_id': 'req-85414f60-4e35-43cc-a060-f98ea265f982'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:16.577281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-85414f60-4e35-43cc-a060-f98ea265f982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c3514fe4e0a46d0b3b5e667c39a75ae', 'request_id': 'req-85414f60-4e35-43cc-a060-f98ea265f982'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:16.600518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-85414f60-4e35-43cc-a060-f98ea265f982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c3514fe4e0a46d0b3b5e667c39a75ae', 'request_id': 'req-85414f60-4e35-43cc-a060-f98ea265f982'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:16.637671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-85414f60-4e35-43cc-a060-f98ea265f982 admin admin] The token cache is being invalidate because project 8c3514fe4e0a46d0b3b5e667c39a75ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:05:16.637965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-85414f60-4e35-43cc-a060-f98ea265f982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:16.642782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-85414f60-4e35-43cc-a060-f98ea265f982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:16.648902 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1428/2850] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:16 2022] DELETE /identity/v3/projects/8c3514fe4e0a46d0b3b5e667c39a75ae => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:05:16.652959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846eb74-3601-46fe-8fa0-323010cd3b55 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:16.657027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f846eb74-3601-46fe-8fa0-323010cd3b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:16.686779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846eb74-3601-46fe-8fa0-323010cd3b55 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:16.895381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b9356-6065-4aab-abef-cad7cbade673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:16.896505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b9356-6065-4aab-abef-cad7cbade673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:16.896939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b9356-6065-4aab-abef-cad7cbade673 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:16.897327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b9356-6065-4aab-abef-cad7cbade673 admin admin] PATH_INFO: `/v3/users/be4e00bebaf0410087202ab5be3251f3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:16.898728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b9356-6065-4aab-abef-cad7cbade673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be4e00bebaf0410087202ab5be3251f3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:16.900807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b9356-6065-4aab-abef-cad7cbade673 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:17.031480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-672b9356-6065-4aab-abef-cad7cbade673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be4e00bebaf0410087202ab5be3251f3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:17.082457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-672b9356-6065-4aab-abef-cad7cbade673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be4e00bebaf0410087202ab5be3251f3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:17.084465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-672b9356-6065-4aab-abef-cad7cbade673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be4e00bebaf0410087202ab5be3251f3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:17.110960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-672b9356-6065-4aab-abef-cad7cbade673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be4e00bebaf0410087202ab5be3251f3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:17.116446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-672b9356-6065-4aab-abef-cad7cbade673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be4e00bebaf0410087202ab5be3251f3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:17.158937 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1423/2851] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:05:16 2022] DELETE /identity/v3/users/be4e00bebaf0410087202ab5be3251f3 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:17.804594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85414f60-4e35-43cc-a060-f98ea265f982 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:17.806486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-85414f60-4e35-43cc-a060-f98ea265f982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:17.846016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85414f60-4e35-43cc-a060-f98ea265f982 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:17.980139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72638f-af68-4d99-8620-3c82dc20209f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:17.981238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72638f-af68-4d99-8620-3c82dc20209f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:17.981762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72638f-af68-4d99-8620-3c82dc20209f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:17.982532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72638f-af68-4d99-8620-3c82dc20209f admin admin] PATH_INFO: `/v3/projects/98216049978b4ec59b313fa005651b51` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:17.984183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72638f-af68-4d99-8620-3c82dc20209f admin admin] RBAC: Authorizing `identity:delete_project(project_id=98216049978b4ec59b313fa005651b51)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:17.986632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72638f-af68-4d99-8620-3c82dc20209f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:18.074536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:18.082034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fd72638f-af68-4d99-8620-3c82dc20209f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98216049978b4ec59b313fa005651b51', 'request_id': 'req-fd72638f-af68-4d99-8620-3c82dc20209f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:18.099853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fd72638f-af68-4d99-8620-3c82dc20209f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98216049978b4ec59b313fa005651b51', 'request_id': 'req-fd72638f-af68-4d99-8620-3c82dc20209f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:18.119132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fd72638f-af68-4d99-8620-3c82dc20209f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98216049978b4ec59b313fa005651b51', 'request_id': 'req-fd72638f-af68-4d99-8620-3c82dc20209f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:18.162327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fd72638f-af68-4d99-8620-3c82dc20209f admin admin] The token cache is being invalidate because project 98216049978b4ec59b313fa005651b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:05:18.162327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fd72638f-af68-4d99-8620-3c82dc20209f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:18.163715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fd72638f-af68-4d99-8620-3c82dc20209f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:18.170019 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1429/2852] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:17 2022] DELETE /identity/v3/projects/98216049978b4ec59b313fa005651b51 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:18.175965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827bfda-fed3-4ec7-9d28-c0c6fc3b70be None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:18.176487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827bfda-fed3-4ec7-9d28-c0c6fc3b70be None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:18.176571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827bfda-fed3-4ec7-9d28-c0c6fc3b70be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:18.216815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1827bfda-fed3-4ec7-9d28-c0c6fc3b70be None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:18.221811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1827bfda-fed3-4ec7-9d28-c0c6fc3b70be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:18.396827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:18.440599 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1424/2853] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:18.451674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccde30-d76e-458a-a12c-b0083cf1c986 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:18.452243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccde30-d76e-458a-a12c-b0083cf1c986 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:18.452681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccde30-d76e-458a-a12c-b0083cf1c986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:18.495311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0bccde30-d76e-458a-a12c-b0083cf1c986 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:18.497110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0bccde30-d76e-458a-a12c-b0083cf1c986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:18.522008 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1430/2854] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:18.526148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827bfda-fed3-4ec7-9d28-c0c6fc3b70be None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:18.546890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827bfda-fed3-4ec7-9d28-c0c6fc3b70be None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:18.567851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada72e9-80c6-4b93-ac6d-cc0e2ca5069f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:18.568817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada72e9-80c6-4b93-ac6d-cc0e2ca5069f admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:18.569289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada72e9-80c6-4b93-ac6d-cc0e2ca5069f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:18.569822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada72e9-80c6-4b93-ac6d-cc0e2ca5069f admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:18.570746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada72e9-80c6-4b93-ac6d-cc0e2ca5069f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:05:18.571213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada72e9-80c6-4b93-ac6d-cc0e2ca5069f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:18.573128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada72e9-80c6-4b93-ac6d-cc0e2ca5069f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:18.607798 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1425/2855] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:05:18.612804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccde30-d76e-458a-a12c-b0083cf1c986 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:18.625906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccde30-d76e-458a-a12c-b0083cf1c986 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:18.639881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed5d42-181d-4331-a605-6de9f79d122e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:18.640532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed5d42-181d-4331-a605-6de9f79d122e admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:18.640817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed5d42-181d-4331-a605-6de9f79d122e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:18.641094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed5d42-181d-4331-a605-6de9f79d122e admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:18.641790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed5d42-181d-4331-a605-6de9f79d122e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:18.643727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed5d42-181d-4331-a605-6de9f79d122e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:18.707322 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1431/2856] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:05:18 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:05:18.711157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada72e9-80c6-4b93-ac6d-cc0e2ca5069f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:18.726047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada72e9-80c6-4b93-ac6d-cc0e2ca5069f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:18.881029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec89759-e8c4-4d63-9d64-d5e73a9617cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:18.884051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89759-e8c4-4d63-9d64-d5e73a9617cd admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:18.884416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89759-e8c4-4d63-9d64-d5e73a9617cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:18.884733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89759-e8c4-4d63-9d64-d5e73a9617cd admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:18.885649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec89759-e8c4-4d63-9d64-d5e73a9617cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:18.887990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec89759-e8c4-4d63-9d64-d5e73a9617cd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:18.926868 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1426/2857] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:05:18 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:05:18.930787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed5d42-181d-4331-a605-6de9f79d122e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:18.943068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed5d42-181d-4331-a605-6de9f79d122e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:18.949024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefa0a2-e1e5-4b82-b3e0-3f233d58f635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:18.949994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefa0a2-e1e5-4b82-b3e0-3f233d58f635 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:18.950508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefa0a2-e1e5-4b82-b3e0-3f233d58f635 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:18.951260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefa0a2-e1e5-4b82-b3e0-3f233d58f635 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:18.952238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefa0a2-e1e5-4b82-b3e0-3f233d58f635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:18.954080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefa0a2-e1e5-4b82-b3e0-3f233d58f635 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:18.969572 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1432/2858] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:05:18.970511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec89759-e8c4-4d63-9d64-d5e73a9617cd admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:18.982456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec89759-e8c4-4d63-9d64-d5e73a9617cd admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:19.005205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96926a7-2af3-413f-bf40-c9602f5e2070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:19.009435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96926a7-2af3-413f-bf40-c9602f5e2070 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:19.010038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96926a7-2af3-413f-bf40-c9602f5e2070 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:19.010563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96926a7-2af3-413f-bf40-c9602f5e2070 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:19.011631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96926a7-2af3-413f-bf40-c9602f5e2070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:19.013568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96926a7-2af3-413f-bf40-c9602f5e2070 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:19.040243 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1427/2859] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:05:19.045101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefa0a2-e1e5-4b82-b3e0-3f233d58f635 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:19.057349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefa0a2-e1e5-4b82-b3e0-3f233d58f635 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:19.074051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd7f37-970a-4795-8a5e-5b4dcb81f547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:19.075170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd7f37-970a-4795-8a5e-5b4dcb81f547 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:19.075720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd7f37-970a-4795-8a5e-5b4dcb81f547 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:19.076248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd7f37-970a-4795-8a5e-5b4dcb81f547 admin admin] PATH_INFO: `/v3/projects/a87a227ec1bd439ab5104ae3e388d4e5/users/b0018ce9f4b443fab80cad7ec4286d6a/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:19.103907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd7f37-970a-4795-8a5e-5b4dcb81f547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a87a227ec1bd439ab5104ae3e388d4e5, user_id=b0018ce9f4b443fab80cad7ec4286d6a, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:19.107562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd7f37-970a-4795-8a5e-5b4dcb81f547 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:19.133508 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1433/2860] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:05:19 2022] PUT /identity/v3/projects/a87a227ec1bd439ab5104ae3e388d4e5/users/b0018ce9f4b443fab80cad7ec4286d6a/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:19.145646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f37d95-d7bd-429e-8c33-ca84fdc6af13 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:19.145948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f37d95-d7bd-429e-8c33-ca84fdc6af13 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:19.146092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f37d95-d7bd-429e-8c33-ca84fdc6af13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:19.207084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c5f37d95-d7bd-429e-8c33-ca84fdc6af13 None None] MFA Rules not processed for user `b0018ce9f4b443fab80cad7ec4286d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:19.208205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c5f37d95-d7bd-429e-8c33-ca84fdc6af13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:19.384335 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1428/2861] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:19.399591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd7f37-970a-4795-8a5e-5b4dcb81f547 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:19.503979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd7f37-970a-4795-8a5e-5b4dcb81f547 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:19.513395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d87c8-92ab-42a3-8512-fc40c012ff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:19.514271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d87c8-92ab-42a3-8512-fc40c012ff55 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:19.514566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d87c8-92ab-42a3-8512-fc40c012ff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:19.515322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d87c8-92ab-42a3-8512-fc40c012ff55 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:19.515850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d87c8-92ab-42a3-8512-fc40c012ff55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:19.517901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d87c8-92ab-42a3-8512-fc40c012ff55 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:19.569636 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1434/2862] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:05:19 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:05:19.573975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f37d95-d7bd-429e-8c33-ca84fdc6af13 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:19.586034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f37d95-d7bd-429e-8c33-ca84fdc6af13 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:19.673472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:19.691025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bddf8-13c1-47e9-9ff7-238840006ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:19.692028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bddf8-13c1-47e9-9ff7-238840006ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:19.692479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bddf8-13c1-47e9-9ff7-238840006ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:19.692942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bddf8-13c1-47e9-9ff7-238840006ad1 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:19.693799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bddf8-13c1-47e9-9ff7-238840006ad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:19.695969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bddf8-13c1-47e9-9ff7-238840006ad1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:19.810875 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1429/2863] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:05:19 2022] POST /identity/v3/users => generated 292 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:05:19.815658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d87c8-92ab-42a3-8512-fc40c012ff55 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:19.829232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d87c8-92ab-42a3-8512-fc40c012ff55 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:19.837153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcde16-da45-49b9-9703-082a7efd8ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:19.837816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcde16-da45-49b9-9703-082a7efd8ebb admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:19.838102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcde16-da45-49b9-9703-082a7efd8ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:19.838379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcde16-da45-49b9-9703-082a7efd8ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:19.839094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcde16-da45-49b9-9703-082a7efd8ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:19.841597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcde16-da45-49b9-9703-082a7efd8ebb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:19.863910 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1435/2864] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:05:19.872316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bddf8-13c1-47e9-9ff7-238840006ad1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:19.897833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bddf8-13c1-47e9-9ff7-238840006ad1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:19.906431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cec2f9-bc4a-46eb-be7d-cd0e24e016c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:19.907618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cec2f9-bc4a-46eb-be7d-cd0e24e016c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:19.908102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cec2f9-bc4a-46eb-be7d-cd0e24e016c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:19.908579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cec2f9-bc4a-46eb-be7d-cd0e24e016c2 admin admin] PATH_INFO: `/v3/projects/207319ff497340ffa48acb201a00e922/users/4edcd705fe9a4626aa12eb2ac3caf849/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:19.928200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cec2f9-bc4a-46eb-be7d-cd0e24e016c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=207319ff497340ffa48acb201a00e922, user_id=4edcd705fe9a4626aa12eb2ac3caf849, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:19.931055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cec2f9-bc4a-46eb-be7d-cd0e24e016c2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:19.953222 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1430/2865] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:05:19 2022] PUT /identity/v3/projects/207319ff497340ffa48acb201a00e922/users/4edcd705fe9a4626aa12eb2ac3caf849/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:19.957220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcde16-da45-49b9-9703-082a7efd8ebb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:19.974542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcde16-da45-49b9-9703-082a7efd8ebb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:20.080485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:20.123377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6e033-f3de-4cc4-9cda-e24191941b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:20.123377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6e033-f3de-4cc4-9cda-e24191941b7c admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:20.123377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6e033-f3de-4cc4-9cda-e24191941b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:20.123377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6e033-f3de-4cc4-9cda-e24191941b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:20.123961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6e033-f3de-4cc4-9cda-e24191941b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:20.125244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6e033-f3de-4cc4-9cda-e24191941b7c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:20.154378 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1436/2866] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:05:20.157037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cec2f9-bc4a-46eb-be7d-cd0e24e016c2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:20.172904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cec2f9-bc4a-46eb-be7d-cd0e24e016c2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:20.177781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54056c59-a6d1-40b8-8208-9e309280a42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:20.178621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54056c59-a6d1-40b8-8208-9e309280a42a admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:20.178925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54056c59-a6d1-40b8-8208-9e309280a42a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:20.179208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54056c59-a6d1-40b8-8208-9e309280a42a admin admin] PATH_INFO: `/v3/projects/207319ff497340ffa48acb201a00e922/users/4edcd705fe9a4626aa12eb2ac3caf849/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:20.182080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54056c59-a6d1-40b8-8208-9e309280a42a admin admin] RBAC: Authorizing `identity:create_grant(project_id=207319ff497340ffa48acb201a00e922, user_id=4edcd705fe9a4626aa12eb2ac3caf849, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:20.185944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54056c59-a6d1-40b8-8208-9e309280a42a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:20.220831 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1431/2867] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:05:20 2022] PUT /identity/v3/projects/207319ff497340ffa48acb201a00e922/users/4edcd705fe9a4626aa12eb2ac3caf849/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:20.221788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b7fb9-a54a-43b2-8bc6-0df5e9496002 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:20.221993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b7fb9-a54a-43b2-8bc6-0df5e9496002 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:20.222271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b7fb9-a54a-43b2-8bc6-0df5e9496002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:20.284618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8b1b7fb9-a54a-43b2-8bc6-0df5e9496002 None None] MFA Rules not processed for user `4edcd705fe9a4626aa12eb2ac3caf849`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:20.286151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8b1b7fb9-a54a-43b2-8bc6-0df5e9496002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:20.450022 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1437/2868] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:20 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:24.465119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54056c59-a6d1-40b8-8208-9e309280a42a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:24.467695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-54056c59-a6d1-40b8-8208-9e309280a42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:24.653314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54056c59-a6d1-40b8-8208-9e309280a42a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:24.668957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18901f68-3bb0-48ba-9749-8745bacc3813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:24.671084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18901f68-3bb0-48ba-9749-8745bacc3813 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:24.671475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18901f68-3bb0-48ba-9749-8745bacc3813 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:24.672778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18901f68-3bb0-48ba-9749-8745bacc3813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:24.680632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-18901f68-3bb0-48ba-9749-8745bacc3813 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:24.730352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18901f68-3bb0-48ba-9749-8745bacc3813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:24.739512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18901f68-3bb0-48ba-9749-8745bacc3813 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:24.773727 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1432/2869] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:05:25.056960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00918d-7eb6-4da0-bfea-7c50fddf4003 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:25.057486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00918d-7eb6-4da0-bfea-7c50fddf4003 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:25.062926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00918d-7eb6-4da0-bfea-7c50fddf4003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:25.143498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1b00918d-7eb6-4da0-bfea-7c50fddf4003 None None] MFA Rules not processed for user `1906745af3e24906adf16c6c68e12968`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:25.149276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1b00918d-7eb6-4da0-bfea-7c50fddf4003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:25.318082 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1438/2870] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:28.735610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18901f68-3bb0-48ba-9749-8745bacc3813 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:28.738194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-18901f68-3bb0-48ba-9749-8745bacc3813 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:28.746583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00918d-7eb6-4da0-bfea-7c50fddf4003 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:28.748196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1b00918d-7eb6-4da0-bfea-7c50fddf4003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:28.816591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00918d-7eb6-4da0-bfea-7c50fddf4003 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:28.816814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18901f68-3bb0-48ba-9749-8745bacc3813 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:28.821023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45fccf-4bb2-437e-8368-bda0576da3ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:28.821221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d982f-7ca7-4ffc-b4b3-1db8037ce7d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:28.821660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45fccf-4bb2-437e-8368-bda0576da3ab service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:28.821853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d982f-7ca7-4ffc-b4b3-1db8037ce7d6 service glance] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:28.821967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45fccf-4bb2-437e-8368-bda0576da3ab service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:28.822140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d982f-7ca7-4ffc-b4b3-1db8037ce7d6 service glance] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:28.822262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45fccf-4bb2-437e-8368-bda0576da3ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:28.822416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d982f-7ca7-4ffc-b4b3-1db8037ce7d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:28.824733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0a45fccf-4bb2-437e-8368-bda0576da3ab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:28.824926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e19d982f-7ca7-4ffc-b4b3-1db8037ce7d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:28.832422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:28.903800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:28.919249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45fccf-4bb2-437e-8368-bda0576da3ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:28.921003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45fccf-4bb2-437e-8368-bda0576da3ab service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:28.923818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d982f-7ca7-4ffc-b4b3-1db8037ce7d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:28.925681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d982f-7ca7-4ffc-b4b3-1db8037ce7d6 service glance] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:28.934243 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1439/2871] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:05:28.943404 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1433/2872] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:05:29.503276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45fccf-4bb2-437e-8368-bda0576da3ab service glance] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:29.504924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0a45fccf-4bb2-437e-8368-bda0576da3ab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:29.530761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45fccf-4bb2-437e-8368-bda0576da3ab service glance] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:29.537064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fe355-43f2-4ce5-8777-d004c02a33dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:29.538362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fe355-43f2-4ce5-8777-d004c02a33dc service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:29.538857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fe355-43f2-4ce5-8777-d004c02a33dc service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:29.539325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fe355-43f2-4ce5-8777-d004c02a33dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:29.549884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fe355-43f2-4ce5-8777-d004c02a33dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:29.551981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fe355-43f2-4ce5-8777-d004c02a33dc service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:29.563855 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1440/2873] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:29 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:05:29.625032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d982f-7ca7-4ffc-b4b3-1db8037ce7d6 service glance] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:29.637245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d982f-7ca7-4ffc-b4b3-1db8037ce7d6 service glance] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:29.643205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13453bd0-6207-4989-8368-cd85ac209557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:29.645064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13453bd0-6207-4989-8368-cd85ac209557 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:29.645584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13453bd0-6207-4989-8368-cd85ac209557 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:29.646085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13453bd0-6207-4989-8368-cd85ac209557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:29.660286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13453bd0-6207-4989-8368-cd85ac209557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:29.664352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13453bd0-6207-4989-8368-cd85ac209557 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:29.676091 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1434/2874] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:05:30.359602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fe355-43f2-4ce5-8777-d004c02a33dc service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:30.371137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fe355-43f2-4ce5-8777-d004c02a33dc service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:30.376357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b36544-cbff-42af-93ff-75d7e734a0eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:30.377115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b36544-cbff-42af-93ff-75d7e734a0eb service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:30.377653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b36544-cbff-42af-93ff-75d7e734a0eb service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:30.378189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b36544-cbff-42af-93ff-75d7e734a0eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:30.384215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-40b36544-cbff-42af-93ff-75d7e734a0eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:30.395518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b36544-cbff-42af-93ff-75d7e734a0eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:30.397091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b36544-cbff-42af-93ff-75d7e734a0eb service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:30.407986 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1441/2875] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:05:31.729196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152220d2-ee09-49e4-b972-9e08e845c0f3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:31.730501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152220d2-ee09-49e4-b972-9e08e845c0f3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:31.731145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152220d2-ee09-49e4-b972-9e08e845c0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:31.754770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-152220d2-ee09-49e4-b972-9e08e845c0f3 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:31.756397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-152220d2-ee09-49e4-b972-9e08e845c0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:31.834058 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1435/2876] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:05:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:05:31.856771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b36544-cbff-42af-93ff-75d7e734a0eb service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:31.858319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-40b36544-cbff-42af-93ff-75d7e734a0eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:31.943228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b36544-cbff-42af-93ff-75d7e734a0eb service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:31.951239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7473d-2cac-4357-8018-ce676700c8b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:31.951965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7473d-2cac-4357-8018-ce676700c8b1 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:31.952250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7473d-2cac-4357-8018-ce676700c8b1 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:31.952526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7473d-2cac-4357-8018-ce676700c8b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:31.962161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7473d-2cac-4357-8018-ce676700c8b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:31.963820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7473d-2cac-4357-8018-ce676700c8b1 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:31.973071 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1442/2877] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:05:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:05:32.740444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f53656-5aab-4abe-ab69-94a9396c8ddc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:32.742795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f53656-5aab-4abe-ab69-94a9396c8ddc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:32.743463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f53656-5aab-4abe-ab69-94a9396c8ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:32.774165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b6f53656-5aab-4abe-ab69-94a9396c8ddc None None] MFA Rules not processed for user `8379e04d2b30488387b3eefab6669768`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:32.775464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b6f53656-5aab-4abe-ab69-94a9396c8ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:32.817309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7473d-2cac-4357-8018-ce676700c8b1 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:32.877608 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1436/2878] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:32 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:32.947683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:32.954137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7473d-2cac-4357-8018-ce676700c8b1 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:32.959895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95584d0-4d0e-4700-b7c6-2ece523d669f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:32.960871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95584d0-4d0e-4700-b7c6-2ece523d669f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:32.961330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95584d0-4d0e-4700-b7c6-2ece523d669f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:32.961772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95584d0-4d0e-4700-b7c6-2ece523d669f admin admin] PATH_INFO: `/v3/users/b0018ce9f4b443fab80cad7ec4286d6a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:32.963179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95584d0-4d0e-4700-b7c6-2ece523d669f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0018ce9f4b443fab80cad7ec4286d6a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:32.968413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95584d0-4d0e-4700-b7c6-2ece523d669f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:33.067883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b95584d0-4d0e-4700-b7c6-2ece523d669f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0018ce9f4b443fab80cad7ec4286d6a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:33.068565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b95584d0-4d0e-4700-b7c6-2ece523d669f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0018ce9f4b443fab80cad7ec4286d6a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:33.094968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b95584d0-4d0e-4700-b7c6-2ece523d669f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0018ce9f4b443fab80cad7ec4286d6a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:33.095865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b95584d0-4d0e-4700-b7c6-2ece523d669f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0018ce9f4b443fab80cad7ec4286d6a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:33.108757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b95584d0-4d0e-4700-b7c6-2ece523d669f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0018ce9f4b443fab80cad7ec4286d6a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:33.137126 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1443/2879] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:05:32 2022] DELETE /identity/v3/users/b0018ce9f4b443fab80cad7ec4286d6a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:33.141901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6591a-f6b5-4914-ac74-b290be9e4dbf None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:33.142466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6591a-f6b5-4914-ac74-b290be9e4dbf None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:33.143085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6591a-f6b5-4914-ac74-b290be9e4dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:33.173203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e4d6591a-f6b5-4914-ac74-b290be9e4dbf None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:33.175182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e4d6591a-f6b5-4914-ac74-b290be9e4dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:33.272735 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1437/2880] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:33.282688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95584d0-4d0e-4700-b7c6-2ece523d669f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:33.284250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b95584d0-4d0e-4700-b7c6-2ece523d669f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:33.389115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95584d0-4d0e-4700-b7c6-2ece523d669f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:33.401613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32167d-0208-48b5-a9d3-a2265e4507ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:33.402258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32167d-0208-48b5-a9d3-a2265e4507ec service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:33.402543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32167d-0208-48b5-a9d3-a2265e4507ec service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:33.402823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32167d-0208-48b5-a9d3-a2265e4507ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:33.414542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32167d-0208-48b5-a9d3-a2265e4507ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:33.416172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32167d-0208-48b5-a9d3-a2265e4507ec service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:33.428534 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1444/2881] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:05:34.071126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6591a-f6b5-4914-ac74-b290be9e4dbf None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:34.073154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e4d6591a-f6b5-4914-ac74-b290be9e4dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:34.115648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6591a-f6b5-4914-ac74-b290be9e4dbf None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:34.122022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45065d-1906-4a3e-a410-538333542660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:34.122903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45065d-1906-4a3e-a410-538333542660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:34.123318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45065d-1906-4a3e-a410-538333542660 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:34.123787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45065d-1906-4a3e-a410-538333542660 admin admin] PATH_INFO: `/v3/projects/a87a227ec1bd439ab5104ae3e388d4e5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:34.126391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45065d-1906-4a3e-a410-538333542660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a87a227ec1bd439ab5104ae3e388d4e5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:34.128507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45065d-1906-4a3e-a410-538333542660 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:34.164013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:34.234783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bd45065d-1906-4a3e-a410-538333542660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a87a227ec1bd439ab5104ae3e388d4e5', 'request_id': 'req-bd45065d-1906-4a3e-a410-538333542660'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:34.241404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32167d-0208-48b5-a9d3-a2265e4507ec service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:34.243066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fc32167d-0208-48b5-a9d3-a2265e4507ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:34.252043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bd45065d-1906-4a3e-a410-538333542660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a87a227ec1bd439ab5104ae3e388d4e5', 'request_id': 'req-bd45065d-1906-4a3e-a410-538333542660'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:34.262528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bd45065d-1906-4a3e-a410-538333542660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a87a227ec1bd439ab5104ae3e388d4e5', 'request_id': 'req-bd45065d-1906-4a3e-a410-538333542660'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:34.276293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bd45065d-1906-4a3e-a410-538333542660 admin admin] The token cache is being invalidate because project a87a227ec1bd439ab5104ae3e388d4e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:05:34.277252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bd45065d-1906-4a3e-a410-538333542660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:34.277905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bd45065d-1906-4a3e-a410-538333542660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:34.280275 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1438/2882] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:34 2022] DELETE /identity/v3/projects/a87a227ec1bd439ab5104ae3e388d4e5 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:34.284559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45065d-1906-4a3e-a410-538333542660 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:34.286771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bd45065d-1906-4a3e-a410-538333542660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:34.407494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32167d-0208-48b5-a9d3-a2265e4507ec service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:34.434338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:34.460455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45065d-1906-4a3e-a410-538333542660 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:34.467911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc459d-38c9-4970-b813-ea3ba9379e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:34.468822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc459d-38c9-4970-b813-ea3ba9379e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:34.469114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc459d-38c9-4970-b813-ea3ba9379e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:34.469397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc459d-38c9-4970-b813-ea3ba9379e81 admin admin] PATH_INFO: `/v3/users/4edcd705fe9a4626aa12eb2ac3caf849` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:34.471842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc459d-38c9-4970-b813-ea3ba9379e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4edcd705fe9a4626aa12eb2ac3caf849)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:34.474008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc459d-38c9-4970-b813-ea3ba9379e81 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:34.497538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59912f3-ed1d-4a0f-84da-b6aced20f55a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:34.498454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59912f3-ed1d-4a0f-84da-b6aced20f55a service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:34.498900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59912f3-ed1d-4a0f-84da-b6aced20f55a service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:34.499360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59912f3-ed1d-4a0f-84da-b6aced20f55a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:34.502721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a59912f3-ed1d-4a0f-84da-b6aced20f55a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:34.524868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59912f3-ed1d-4a0f-84da-b6aced20f55a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:34.533597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59912f3-ed1d-4a0f-84da-b6aced20f55a service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:34.549380 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1445/2883] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:05:34.576808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b8fc459d-38c9-4970-b813-ea3ba9379e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4edcd705fe9a4626aa12eb2ac3caf849'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:34.592811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b8fc459d-38c9-4970-b813-ea3ba9379e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4edcd705fe9a4626aa12eb2ac3caf849'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:34.594047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b8fc459d-38c9-4970-b813-ea3ba9379e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4edcd705fe9a4626aa12eb2ac3caf849'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:34.609432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b8fc459d-38c9-4970-b813-ea3ba9379e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4edcd705fe9a4626aa12eb2ac3caf849'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:34.610198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b8fc459d-38c9-4970-b813-ea3ba9379e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4edcd705fe9a4626aa12eb2ac3caf849'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:34.628353 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1439/2884] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:05:34 2022] DELETE /identity/v3/users/4edcd705fe9a4626aa12eb2ac3caf849 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:35.710713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59912f3-ed1d-4a0f-84da-b6aced20f55a service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:35.736863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59912f3-ed1d-4a0f-84da-b6aced20f55a service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:35.867410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7404f1-6001-4839-a146-b6b21b9bef85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:35.868485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7404f1-6001-4839-a146-b6b21b9bef85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:35.868769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7404f1-6001-4839-a146-b6b21b9bef85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:35.869103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7404f1-6001-4839-a146-b6b21b9bef85 admin admin] PATH_INFO: `/v3/projects/207319ff497340ffa48acb201a00e922` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:35.870659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7404f1-6001-4839-a146-b6b21b9bef85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=207319ff497340ffa48acb201a00e922)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:35.873117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7404f1-6001-4839-a146-b6b21b9bef85 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:35.957198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dc7404f1-6001-4839-a146-b6b21b9bef85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '207319ff497340ffa48acb201a00e922', 'request_id': 'req-dc7404f1-6001-4839-a146-b6b21b9bef85'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:35.971863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dc7404f1-6001-4839-a146-b6b21b9bef85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '207319ff497340ffa48acb201a00e922', 'request_id': 'req-dc7404f1-6001-4839-a146-b6b21b9bef85'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:35.986049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dc7404f1-6001-4839-a146-b6b21b9bef85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '207319ff497340ffa48acb201a00e922', 'request_id': 'req-dc7404f1-6001-4839-a146-b6b21b9bef85'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:36.005420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dc7404f1-6001-4839-a146-b6b21b9bef85 admin admin] The token cache is being invalidate because project 207319ff497340ffa48acb201a00e922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:05:36.005974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dc7404f1-6001-4839-a146-b6b21b9bef85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:36.006845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dc7404f1-6001-4839-a146-b6b21b9bef85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:36.010593 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1446/2885] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:35 2022] DELETE /identity/v3/projects/207319ff497340ffa48acb201a00e922 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:36.016013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de608fa3-e1a2-4a6a-a5ad-79e74e812085 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:36.016589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de608fa3-e1a2-4a6a-a5ad-79e74e812085 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:36.016589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de608fa3-e1a2-4a6a-a5ad-79e74e812085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:36.088241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-de608fa3-e1a2-4a6a-a5ad-79e74e812085 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:36.090815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-de608fa3-e1a2-4a6a-a5ad-79e74e812085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:36.121161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:36.148681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0437-3dc3-4e2d-8b1e-abeb95cdac5e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:36.149214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0437-3dc3-4e2d-8b1e-abeb95cdac5e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:36.149894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0437-3dc3-4e2d-8b1e-abeb95cdac5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:36.207844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-307c0437-3dc3-4e2d-8b1e-abeb95cdac5e None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:36.208045 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1440/2886] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:36.208180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-307c0437-3dc3-4e2d-8b1e-abeb95cdac5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:36.280951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17d8cf-5030-43e8-8108-1bc0c2b92f32 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:36.281442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17d8cf-5030-43e8-8108-1bc0c2b92f32 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:36.281923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17d8cf-5030-43e8-8108-1bc0c2b92f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:36.314567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:36.323110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3c17d8cf-5030-43e8-8108-1bc0c2b92f32 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:36.325209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3c17d8cf-5030-43e8-8108-1bc0c2b92f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:36.356000 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1441/2887] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:05:36.357523 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1447/2888] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:05:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:05:36.370086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17d8cf-5030-43e8-8108-1bc0c2b92f32 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:36.390363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c0437-3dc3-4e2d-8b1e-abeb95cdac5e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:36.391873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-307c0437-3dc3-4e2d-8b1e-abeb95cdac5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:36.398688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17d8cf-5030-43e8-8108-1bc0c2b92f32 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:36.406385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907bd14-a9b5-490a-a8c3-b69bd594d646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:36.406918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907bd14-a9b5-490a-a8c3-b69bd594d646 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:36.407213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907bd14-a9b5-490a-a8c3-b69bd594d646 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:36.407539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907bd14-a9b5-490a-a8c3-b69bd594d646 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:36.408252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907bd14-a9b5-490a-a8c3-b69bd594d646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:05:36.408560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907bd14-a9b5-490a-a8c3-b69bd594d646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:36.410429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907bd14-a9b5-490a-a8c3-b69bd594d646 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:36.425511 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1442/2889] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:05:36.430084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907bd14-a9b5-490a-a8c3-b69bd594d646 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:36.444025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907bd14-a9b5-490a-a8c3-b69bd594d646 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:36.450871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711552f-75a0-4f6f-b66d-3a6a782d68e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:36.451944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711552f-75a0-4f6f-b66d-3a6a782d68e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:36.452975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711552f-75a0-4f6f-b66d-3a6a782d68e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:36.453482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711552f-75a0-4f6f-b66d-3a6a782d68e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:36.454504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711552f-75a0-4f6f-b66d-3a6a782d68e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:36.458536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711552f-75a0-4f6f-b66d-3a6a782d68e5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:36.507782 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1443/2890] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:05:36 2022] POST /identity/v3/projects => generated 361 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:05:36.512249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711552f-75a0-4f6f-b66d-3a6a782d68e5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:36.569592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c0437-3dc3-4e2d-8b1e-abeb95cdac5e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:36.627464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711552f-75a0-4f6f-b66d-3a6a782d68e5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:36.640803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffdbfd-48e4-4cc0-b919-204ef8b3526f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:36.642461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffdbfd-48e4-4cc0-b919-204ef8b3526f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:36.643276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffdbfd-48e4-4cc0-b919-204ef8b3526f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:36.644106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffdbfd-48e4-4cc0-b919-204ef8b3526f admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:36.646007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffdbfd-48e4-4cc0-b919-204ef8b3526f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:36.649555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffdbfd-48e4-4cc0-b919-204ef8b3526f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:36.672329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1e389-335c-419d-9e2b-3b0fc74f0b57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:36.673086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1e389-335c-419d-9e2b-3b0fc74f0b57 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:36.673647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1e389-335c-419d-9e2b-3b0fc74f0b57 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:36.674025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1e389-335c-419d-9e2b-3b0fc74f0b57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:36.692058 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1444/2891] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:05:36 2022] POST /identity/v3/users => generated 281 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:05:36.694193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffdbfd-48e4-4cc0-b919-204ef8b3526f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:36.699397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f2ffdbfd-48e4-4cc0-b919-204ef8b3526f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:36.757369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1e389-335c-419d-9e2b-3b0fc74f0b57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:36.760237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1e389-335c-419d-9e2b-3b0fc74f0b57 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:36.772436 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1448/2892] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:05:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:05:36.773324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1e389-335c-419d-9e2b-3b0fc74f0b57 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:36.787489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1e389-335c-419d-9e2b-3b0fc74f0b57 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:36.810546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74af684-df12-4ca9-be6e-a8448c01d625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:36.811829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74af684-df12-4ca9-be6e-a8448c01d625 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:36.813988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74af684-df12-4ca9-be6e-a8448c01d625 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:36.814302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74af684-df12-4ca9-be6e-a8448c01d625 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:36.815106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74af684-df12-4ca9-be6e-a8448c01d625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:36.818120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74af684-df12-4ca9-be6e-a8448c01d625 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:36.831113 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1449/2893] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:05:36.835764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74af684-df12-4ca9-be6e-a8448c01d625 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:36.849517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74af684-df12-4ca9-be6e-a8448c01d625 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:36.856327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffdbfd-48e4-4cc0-b919-204ef8b3526f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:36.865176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afdd46-66cc-4bf1-bd14-059b47057604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:36.866558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afdd46-66cc-4bf1-bd14-059b47057604 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:36.867797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afdd46-66cc-4bf1-bd14-059b47057604 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:36.869106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afdd46-66cc-4bf1-bd14-059b47057604 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:36.869337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f4d98-096c-40a8-9896-8c70cba06df2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:36.871529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afdd46-66cc-4bf1-bd14-059b47057604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:36.872716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f4d98-096c-40a8-9896-8c70cba06df2 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:36.873104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f4d98-096c-40a8-9896-8c70cba06df2 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:36.873810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f4d98-096c-40a8-9896-8c70cba06df2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:36.876041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afdd46-66cc-4bf1-bd14-059b47057604 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:36.880829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b48f4d98-096c-40a8-9896-8c70cba06df2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:36.907493 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1450/2894] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:05:36.911503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afdd46-66cc-4bf1-bd14-059b47057604 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:36.916712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f4d98-096c-40a8-9896-8c70cba06df2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:36.920590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f4d98-096c-40a8-9896-8c70cba06df2 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:36.936397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afdd46-66cc-4bf1-bd14-059b47057604 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:36.939090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:36.953590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5f6fc-5851-4f63-b3da-588a6627f59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:36.954374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5f6fc-5851-4f63-b3da-588a6627f59e admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:36.954733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5f6fc-5851-4f63-b3da-588a6627f59e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:36.955017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5f6fc-5851-4f63-b3da-588a6627f59e admin admin] PATH_INFO: `/v3/projects/9e46acf708204932bed9ea88f40e0a25/users/92bccfadffcd48eb9183a0cfea9c664f/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:36.957619 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1445/2895] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:05:36.962103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:36.978569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5f6fc-5851-4f63-b3da-588a6627f59e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e46acf708204932bed9ea88f40e0a25, user_id=92bccfadffcd48eb9183a0cfea9c664f, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:36.983071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5f6fc-5851-4f63-b3da-588a6627f59e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:37.004882 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1451/2896] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:05:36 2022] PUT /identity/v3/projects/9e46acf708204932bed9ea88f40e0a25/users/92bccfadffcd48eb9183a0cfea9c664f/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:37.015206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4503a33-21c1-47c3-a986-90c83b62c7f4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:37.015591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4503a33-21c1-47c3-a986-90c83b62c7f4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:37.015826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4503a33-21c1-47c3-a986-90c83b62c7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:37.095671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c4503a33-21c1-47c3-a986-90c83b62c7f4 None None] MFA Rules not processed for user `92bccfadffcd48eb9183a0cfea9c664f`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:37.102190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c4503a33-21c1-47c3-a986-90c83b62c7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:37.430561 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1446/2897] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:37.435791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5f6fc-5851-4f63-b3da-588a6627f59e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:37.623475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5f6fc-5851-4f63-b3da-588a6627f59e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:37.640420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194ec5f-61cb-468a-9343-e578ba9e8427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:37.641292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194ec5f-61cb-468a-9343-e578ba9e8427 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:37.641787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194ec5f-61cb-468a-9343-e578ba9e8427 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:37.642218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194ec5f-61cb-468a-9343-e578ba9e8427 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:37.643722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194ec5f-61cb-468a-9343-e578ba9e8427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:37.645892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194ec5f-61cb-468a-9343-e578ba9e8427 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:37.706255 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1452/2898] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:05:37 2022] POST /identity/v3/projects => generated 359 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:05:37.710483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4503a33-21c1-47c3-a986-90c83b62c7f4 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:37.733077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4503a33-21c1-47c3-a986-90c83b62c7f4 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:37.893420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0defb-1c1a-4589-8a00-f8c081471622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:37.894167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0defb-1c1a-4589-8a00-f8c081471622 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:37.894549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0defb-1c1a-4589-8a00-f8c081471622 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:37.895463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0defb-1c1a-4589-8a00-f8c081471622 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:37.896152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0defb-1c1a-4589-8a00-f8c081471622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:37.898902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0defb-1c1a-4589-8a00-f8c081471622 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:37.967441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194ec5f-61cb-468a-9343-e578ba9e8427 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:37.970232 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1447/2899] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:05:37 2022] POST /identity/v3/users => generated 286 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:05:37.982502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194ec5f-61cb-468a-9343-e578ba9e8427 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:38.003825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f7d94-0674-4cee-aab9-5ddbb6b1d015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:38.008679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f7d94-0674-4cee-aab9-5ddbb6b1d015 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:38.009633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f7d94-0674-4cee-aab9-5ddbb6b1d015 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:38.011958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f7d94-0674-4cee-aab9-5ddbb6b1d015 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:38.013695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f7d94-0674-4cee-aab9-5ddbb6b1d015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:38.020649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f7d94-0674-4cee-aab9-5ddbb6b1d015 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:38.064547 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1453/2900] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:05:38.068256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0defb-1c1a-4589-8a00-f8c081471622 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:38.081341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0defb-1c1a-4589-8a00-f8c081471622 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:38.086244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf48d09-26e8-40ee-bb27-d041ebd7bb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:38.086936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf48d09-26e8-40ee-bb27-d041ebd7bb0a admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:38.087981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf48d09-26e8-40ee-bb27-d041ebd7bb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:38.088267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf48d09-26e8-40ee-bb27-d041ebd7bb0a admin admin] PATH_INFO: `/v3/projects/5c550fb908984b8ebd3ee8cb1a8f59c6/users/3a669637ba054664b9e8d912520c02cf/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:38.134607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf48d09-26e8-40ee-bb27-d041ebd7bb0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c550fb908984b8ebd3ee8cb1a8f59c6, user_id=3a669637ba054664b9e8d912520c02cf, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:38.146398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf48d09-26e8-40ee-bb27-d041ebd7bb0a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:38.171585 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1448/2901] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:05:38 2022] PUT /identity/v3/projects/5c550fb908984b8ebd3ee8cb1a8f59c6/users/3a669637ba054664b9e8d912520c02cf/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:38.177477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f7d94-0674-4cee-aab9-5ddbb6b1d015 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:38.191049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f7d94-0674-4cee-aab9-5ddbb6b1d015 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:38.333354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367b0dd-3348-417d-b5de-707940ed27e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:38.341659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367b0dd-3348-417d-b5de-707940ed27e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:38.342051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367b0dd-3348-417d-b5de-707940ed27e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:38.342486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367b0dd-3348-417d-b5de-707940ed27e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:38.344684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367b0dd-3348-417d-b5de-707940ed27e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:38.347761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367b0dd-3348-417d-b5de-707940ed27e6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:38.374614 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1454/2902] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:05:38.377372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf48d09-26e8-40ee-bb27-d041ebd7bb0a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:38.391784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf48d09-26e8-40ee-bb27-d041ebd7bb0a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:38.399767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7d71b-c330-4821-a80b-b2b66abdf9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:38.400745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7d71b-c330-4821-a80b-b2b66abdf9dd admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:38.401882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7d71b-c330-4821-a80b-b2b66abdf9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:38.401882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7d71b-c330-4821-a80b-b2b66abdf9dd admin admin] PATH_INFO: `/v3/projects/5c550fb908984b8ebd3ee8cb1a8f59c6/users/3a669637ba054664b9e8d912520c02cf/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:38.404031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7d71b-c330-4821-a80b-b2b66abdf9dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c550fb908984b8ebd3ee8cb1a8f59c6, user_id=3a669637ba054664b9e8d912520c02cf, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:38.409989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7d71b-c330-4821-a80b-b2b66abdf9dd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:38.425870 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1449/2903] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:05:38 2022] PUT /identity/v3/projects/5c550fb908984b8ebd3ee8cb1a8f59c6/users/3a669637ba054664b9e8d912520c02cf/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:38.439324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0c201-28de-4e79-93ea-0c321d942d46 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:38.439617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0c201-28de-4e79-93ea-0c321d942d46 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:38.439913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0c201-28de-4e79-93ea-0c321d942d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:38.485030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e2f0c201-28de-4e79-93ea-0c321d942d46 None None] MFA Rules not processed for user `3a669637ba054664b9e8d912520c02cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:38.486543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e2f0c201-28de-4e79-93ea-0c321d942d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:38.598699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:38.650748 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1455/2904] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:38 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:39.398975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7d71b-c330-4821-a80b-b2b66abdf9dd admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:39.490523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:39.528658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7d71b-c330-4821-a80b-b2b66abdf9dd admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:39.536556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f19467-bb17-43a9-be35-367f97c4f293 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:39.537476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f19467-bb17-43a9-be35-367f97c4f293 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:39.537989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f19467-bb17-43a9-be35-367f97c4f293 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:39.538473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f19467-bb17-43a9-be35-367f97c4f293 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:39.553466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f19467-bb17-43a9-be35-367f97c4f293 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:39.555602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f19467-bb17-43a9-be35-367f97c4f293 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:39.570322 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1450/2905] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:39 2022] GET /identity/v3/auth/tokens => generated 3293 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:05:41.596710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0c201-28de-4e79-93ea-0c321d942d46 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:41.771729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0c201-28de-4e79-93ea-0c321d942d46 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:41.777611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f803f1-578f-4164-a538-0fad345375b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:41.778557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f803f1-578f-4164-a538-0fad345375b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:41.779052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f803f1-578f-4164-a538-0fad345375b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:41.779661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f803f1-578f-4164-a538-0fad345375b7 admin admin] PATH_INFO: `/v3/users/92bccfadffcd48eb9183a0cfea9c664f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:41.781439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f803f1-578f-4164-a538-0fad345375b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92bccfadffcd48eb9183a0cfea9c664f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:41.784769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f803f1-578f-4164-a538-0fad345375b7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:41.874845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-40f803f1-578f-4164-a538-0fad345375b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92bccfadffcd48eb9183a0cfea9c664f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:41.875648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-40f803f1-578f-4164-a538-0fad345375b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92bccfadffcd48eb9183a0cfea9c664f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:41.891328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-40f803f1-578f-4164-a538-0fad345375b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92bccfadffcd48eb9183a0cfea9c664f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:41.892499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-40f803f1-578f-4164-a538-0fad345375b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92bccfadffcd48eb9183a0cfea9c664f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:41.907201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-40f803f1-578f-4164-a538-0fad345375b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92bccfadffcd48eb9183a0cfea9c664f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:41.924731 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1456/2906] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:05:41 2022] DELETE /identity/v3/users/92bccfadffcd48eb9183a0cfea9c664f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:41.928976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2f97f-db53-46ec-8670-21629de2d4d8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:41.929461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2f97f-db53-46ec-8670-21629de2d4d8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:41.929961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2f97f-db53-46ec-8670-21629de2d4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:41.961272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bcf2f97f-db53-46ec-8670-21629de2d4d8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:41.963001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bcf2f97f-db53-46ec-8670-21629de2d4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:42.068849 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1451/2907] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:05:42.077025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f803f1-578f-4164-a538-0fad345375b7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:42.083957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-40f803f1-578f-4164-a538-0fad345375b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:42.192977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e20178-f0db-4101-bda9-db8d122677c2 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:42.193237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e20178-f0db-4101-bda9-db8d122677c2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:42.193565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e20178-f0db-4101-bda9-db8d122677c2 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:42.196055 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1452/2908] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:05:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 21:05:42.201300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e74751-ef46-4383-9151-c55c1e4d5f08 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:42.201590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e74751-ef46-4383-9151-c55c1e4d5f08 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:42.201856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e74751-ef46-4383-9151-c55c1e4d5f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:42.238460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f803f1-578f-4164-a538-0fad345375b7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:42.247250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d4e74751-ef46-4383-9151-c55c1e4d5f08 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:42.250512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d4e74751-ef46-4383-9151-c55c1e4d5f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:42.255922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905de18-4f68-4a2d-9fd3-f169ef388061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:42.256590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905de18-4f68-4a2d-9fd3-f169ef388061 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:42.256878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905de18-4f68-4a2d-9fd3-f169ef388061 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:42.257160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905de18-4f68-4a2d-9fd3-f169ef388061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:42.271982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905de18-4f68-4a2d-9fd3-f169ef388061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:42.274449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905de18-4f68-4a2d-9fd3-f169ef388061 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:42.300952 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1457/2909] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:05:42.416638 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1453/2910] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:05:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:05:42.453488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905de18-4f68-4a2d-9fd3-f169ef388061 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:42.455042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4905de18-4f68-4a2d-9fd3-f169ef388061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:42.471142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:42.484140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905de18-4f68-4a2d-9fd3-f169ef388061 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:42.507718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaffd88-1e2a-41fd-864c-eba518909049 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:42.515351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaffd88-1e2a-41fd-864c-eba518909049 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:42.515904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaffd88-1e2a-41fd-864c-eba518909049 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:42.518300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaffd88-1e2a-41fd-864c-eba518909049 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:42.546725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaffd88-1e2a-41fd-864c-eba518909049 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:42.548124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf4b74-dfe3-42ea-bfbc-d177b9f5aea8 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:42.548419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf4b74-dfe3-42ea-bfbc-d177b9f5aea8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:42.548706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf4b74-dfe3-42ea-bfbc-d177b9f5aea8 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:42.549377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaffd88-1e2a-41fd-864c-eba518909049 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:42.550251 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1454/2911] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:05:42.556195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec05fad-64ee-4661-bd95-4c84f128e5a9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:42.556393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec05fad-64ee-4661-bd95-4c84f128e5a9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:42.556667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec05fad-64ee-4661-bd95-4c84f128e5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:42.579266 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1458/2912] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:05:42.581513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7ec05fad-64ee-4661-bd95-4c84f128e5a9 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:42.582979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7ec05fad-64ee-4661-bd95-4c84f128e5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:42.603039 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1455/2913] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:05:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:42.660182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaffd88-1e2a-41fd-864c-eba518909049 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:42.662458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bfaffd88-1e2a-41fd-864c-eba518909049 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:42.704436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaffd88-1e2a-41fd-864c-eba518909049 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:42.711510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdfffb-9ad4-408c-97e7-d2b13baa9aae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:42.712282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdfffb-9ad4-408c-97e7-d2b13baa9aae service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:42.712689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdfffb-9ad4-408c-97e7-d2b13baa9aae service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:42.713069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdfffb-9ad4-408c-97e7-d2b13baa9aae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:42.728594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbdfffb-9ad4-408c-97e7-d2b13baa9aae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:42.733498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbdfffb-9ad4-408c-97e7-d2b13baa9aae service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:42.757383 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1459/2914] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:05:42.864245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec05fad-64ee-4661-bd95-4c84f128e5a9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:42.865753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7ec05fad-64ee-4661-bd95-4c84f128e5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:42.889807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec05fad-64ee-4661-bd95-4c84f128e5a9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:42.902087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f2690-3ae8-41f8-8f4d-8f6c29f97af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:42.902087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f2690-3ae8-41f8-8f4d-8f6c29f97af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:42.902087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f2690-3ae8-41f8-8f4d-8f6c29f97af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:42.902087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f2690-3ae8-41f8-8f4d-8f6c29f97af8 admin admin] PATH_INFO: `/v3/projects/9e46acf708204932bed9ea88f40e0a25` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:42.906426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f2690-3ae8-41f8-8f4d-8f6c29f97af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e46acf708204932bed9ea88f40e0a25)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:42.908406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f2690-3ae8-41f8-8f4d-8f6c29f97af8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:43.042756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f52f2690-3ae8-41f8-8f4d-8f6c29f97af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e46acf708204932bed9ea88f40e0a25', 'request_id': 'req-f52f2690-3ae8-41f8-8f4d-8f6c29f97af8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:43.052090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:43.057353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f52f2690-3ae8-41f8-8f4d-8f6c29f97af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e46acf708204932bed9ea88f40e0a25', 'request_id': 'req-f52f2690-3ae8-41f8-8f4d-8f6c29f97af8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:43.070768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f52f2690-3ae8-41f8-8f4d-8f6c29f97af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e46acf708204932bed9ea88f40e0a25', 'request_id': 'req-f52f2690-3ae8-41f8-8f4d-8f6c29f97af8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:43.089192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f52f2690-3ae8-41f8-8f4d-8f6c29f97af8 admin admin] The token cache is being invalidate because project 9e46acf708204932bed9ea88f40e0a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:05:43.089192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f52f2690-3ae8-41f8-8f4d-8f6c29f97af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:43.090755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f52f2690-3ae8-41f8-8f4d-8f6c29f97af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:43.092889 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1456/2915] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:42 2022] DELETE /identity/v3/projects/9e46acf708204932bed9ea88f40e0a25 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:43.096684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdfffb-9ad4-408c-97e7-d2b13baa9aae service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:43.113354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdfffb-9ad4-408c-97e7-d2b13baa9aae service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:43.264171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65c731-a952-47e4-aec2-033dbf337124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:43.264850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65c731-a952-47e4-aec2-033dbf337124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:43.265138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65c731-a952-47e4-aec2-033dbf337124 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:43.265422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65c731-a952-47e4-aec2-033dbf337124 admin admin] PATH_INFO: `/v3/users/3a669637ba054664b9e8d912520c02cf` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:43.276270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65c731-a952-47e4-aec2-033dbf337124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a669637ba054664b9e8d912520c02cf)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:43.278794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65c731-a952-47e4-aec2-033dbf337124 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:43.423043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7f65c731-a952-47e4-aec2-033dbf337124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a669637ba054664b9e8d912520c02cf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:43.423894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7f65c731-a952-47e4-aec2-033dbf337124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a669637ba054664b9e8d912520c02cf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:43.443253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7f65c731-a952-47e4-aec2-033dbf337124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a669637ba054664b9e8d912520c02cf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:43.444681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7f65c731-a952-47e4-aec2-033dbf337124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a669637ba054664b9e8d912520c02cf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:43.468974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7f65c731-a952-47e4-aec2-033dbf337124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a669637ba054664b9e8d912520c02cf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:43.514326 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1460/2916] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:05:43 2022] DELETE /identity/v3/users/3a669637ba054664b9e8d912520c02cf => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:44.436189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f2690-3ae8-41f8-8f4d-8f6c29f97af8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:44.438233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f52f2690-3ae8-41f8-8f4d-8f6c29f97af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:44.506655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f2690-3ae8-41f8-8f4d-8f6c29f97af8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:44.740581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28789f8-9cc9-41c7-8bd5-15ac2175eb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:44.741644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28789f8-9cc9-41c7-8bd5-15ac2175eb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:44.742172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28789f8-9cc9-41c7-8bd5-15ac2175eb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:44.742654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28789f8-9cc9-41c7-8bd5-15ac2175eb59 admin admin] PATH_INFO: `/v3/projects/5c550fb908984b8ebd3ee8cb1a8f59c6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:44.744846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28789f8-9cc9-41c7-8bd5-15ac2175eb59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c550fb908984b8ebd3ee8cb1a8f59c6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:44.748287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28789f8-9cc9-41c7-8bd5-15ac2175eb59 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:44.863745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f28789f8-9cc9-41c7-8bd5-15ac2175eb59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c550fb908984b8ebd3ee8cb1a8f59c6', 'request_id': 'req-f28789f8-9cc9-41c7-8bd5-15ac2175eb59'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:44.875025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f28789f8-9cc9-41c7-8bd5-15ac2175eb59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c550fb908984b8ebd3ee8cb1a8f59c6', 'request_id': 'req-f28789f8-9cc9-41c7-8bd5-15ac2175eb59'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:44.892860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d655d61-3cc2-4c66-8bba-5cecb0f8ae35 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:44.893493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d655d61-3cc2-4c66-8bba-5cecb0f8ae35 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:44.894056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d655d61-3cc2-4c66-8bba-5cecb0f8ae35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:44.898795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f28789f8-9cc9-41c7-8bd5-15ac2175eb59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c550fb908984b8ebd3ee8cb1a8f59c6', 'request_id': 'req-f28789f8-9cc9-41c7-8bd5-15ac2175eb59'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:44.915066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f28789f8-9cc9-41c7-8bd5-15ac2175eb59 admin admin] The token cache is being invalidate because project 5c550fb908984b8ebd3ee8cb1a8f59c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:05:44.917550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f28789f8-9cc9-41c7-8bd5-15ac2175eb59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:44.918886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f28789f8-9cc9-41c7-8bd5-15ac2175eb59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:44.924714 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1457/2917] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:44 2022] DELETE /identity/v3/projects/5c550fb908984b8ebd3ee8cb1a8f59c6 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:44.926645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bc9c2-0703-4508-a313-2296b7185585 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:44.927107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bc9c2-0703-4508-a313-2296b7185585 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:44.927257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bc9c2-0703-4508-a313-2296b7185585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:44.963899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7d655d61-3cc2-4c66-8bba-5cecb0f8ae35 None None] MFA Rules not processed for user `d20ab89ea13c4611904cec244d37ba25`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:44.966142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7d655d61-3cc2-4c66-8bba-5cecb0f8ae35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:44.981061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7b9bc9c2-0703-4508-a313-2296b7185585 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:44.982346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7b9bc9c2-0703-4508-a313-2296b7185585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:45.201448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:45.203387 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1458/2918] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:45.213068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3e28e-ade8-45ef-ab30-14ce95ed520d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:45.213437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3e28e-ade8-45ef-ab30-14ce95ed520d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:45.213762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3e28e-ade8-45ef-ab30-14ce95ed520d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:45.258765 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1461/2919] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:45.281531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c5b3e28e-ade8-45ef-ab30-14ce95ed520d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:45.283115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c5b3e28e-ade8-45ef-ab30-14ce95ed520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:45.300587 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1459/2920] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:05:45.302215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d655d61-3cc2-4c66-8bba-5cecb0f8ae35 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:45.343745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d655d61-3cc2-4c66-8bba-5cecb0f8ae35 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:45.377847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b46485-bbfd-46d2-8b91-b55597911018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:45.378294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b46485-bbfd-46d2-8b91-b55597911018 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:45.378590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b46485-bbfd-46d2-8b91-b55597911018 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:45.378874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b46485-bbfd-46d2-8b91-b55597911018 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:45.379637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b46485-bbfd-46d2-8b91-b55597911018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:05:45.379948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b46485-bbfd-46d2-8b91-b55597911018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:45.381586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b46485-bbfd-46d2-8b91-b55597911018 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:45.426553 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1462/2921] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:05:45.428367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3e28e-ade8-45ef-ab30-14ce95ed520d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:45.434569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:45.446375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3e28e-ade8-45ef-ab30-14ce95ed520d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:45.467112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55482d7b-f406-48b0-9e66-0f768a3074b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:45.467851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55482d7b-f406-48b0-9e66-0f768a3074b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:45.468261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55482d7b-f406-48b0-9e66-0f768a3074b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:45.468398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55482d7b-f406-48b0-9e66-0f768a3074b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:45.469081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55482d7b-f406-48b0-9e66-0f768a3074b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:45.471107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55482d7b-f406-48b0-9e66-0f768a3074b5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:45.562832 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1460/2922] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:05:45 2022] POST /identity/v3/projects => generated 391 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:05:45.567082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b46485-bbfd-46d2-8b91-b55597911018 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:45.583085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b46485-bbfd-46d2-8b91-b55597911018 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:45.800870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617adb0-b1c0-48eb-a014-7402fa5564ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:45.801605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617adb0-b1c0-48eb-a014-7402fa5564ea admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:45.802056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617adb0-b1c0-48eb-a014-7402fa5564ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:45.802354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617adb0-b1c0-48eb-a014-7402fa5564ea admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:45.804217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617adb0-b1c0-48eb-a014-7402fa5564ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:45.806821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617adb0-b1c0-48eb-a014-7402fa5564ea admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:45.858153 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1463/2923] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:05:45 2022] POST /identity/v3/users => generated 296 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:05:45.859572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55482d7b-f406-48b0-9e66-0f768a3074b5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:45.887478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55482d7b-f406-48b0-9e66-0f768a3074b5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:45.895945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0130da-8e64-4bab-bdfd-c33788b03e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:45.897465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0130da-8e64-4bab-bdfd-c33788b03e07 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:45.897759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0130da-8e64-4bab-bdfd-c33788b03e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:45.898041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0130da-8e64-4bab-bdfd-c33788b03e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:45.899434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0130da-8e64-4bab-bdfd-c33788b03e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:45.902726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0130da-8e64-4bab-bdfd-c33788b03e07 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:45.916689 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1461/2924] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:05:45.931550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617adb0-b1c0-48eb-a014-7402fa5564ea admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:45.945946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617adb0-b1c0-48eb-a014-7402fa5564ea admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:45.952089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38aa1f6-118a-439c-a13c-7b400d92c1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:45.953385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38aa1f6-118a-439c-a13c-7b400d92c1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:45.954085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38aa1f6-118a-439c-a13c-7b400d92c1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:45.954581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38aa1f6-118a-439c-a13c-7b400d92c1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:45.959811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38aa1f6-118a-439c-a13c-7b400d92c1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:45.966281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38aa1f6-118a-439c-a13c-7b400d92c1c7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:45.984192 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1464/2925] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:05:45.988433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0130da-8e64-4bab-bdfd-c33788b03e07 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:46.020604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0130da-8e64-4bab-bdfd-c33788b03e07 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:46.026699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93303789-d8bd-4d8a-b050-aff3afafcb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:46.027426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93303789-d8bd-4d8a-b050-aff3afafcb1e admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:46.027721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93303789-d8bd-4d8a-b050-aff3afafcb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:46.028010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93303789-d8bd-4d8a-b050-aff3afafcb1e admin admin] PATH_INFO: `/v3/projects/ebe60ae219554ca1839242aa20d2bda7/users/f820053bb2d942fd968b7129b2faae47/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:46.070612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93303789-d8bd-4d8a-b050-aff3afafcb1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe60ae219554ca1839242aa20d2bda7, user_id=f820053bb2d942fd968b7129b2faae47, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:46.077177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93303789-d8bd-4d8a-b050-aff3afafcb1e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:46.114454 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1462/2926] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:05:45 2022] PUT /identity/v3/projects/ebe60ae219554ca1839242aa20d2bda7/users/f820053bb2d942fd968b7129b2faae47/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:46.127766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb66822-445c-4e6d-a5d0-400f7acf15e6 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:46.128120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb66822-445c-4e6d-a5d0-400f7acf15e6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:46.128411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb66822-445c-4e6d-a5d0-400f7acf15e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:46.190147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6fb66822-445c-4e6d-a5d0-400f7acf15e6 None None] MFA Rules not processed for user `f820053bb2d942fd968b7129b2faae47`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:46.191420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6fb66822-445c-4e6d-a5d0-400f7acf15e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:46.341485 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1465/2927] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:46.346944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93303789-d8bd-4d8a-b050-aff3afafcb1e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:46.441433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93303789-d8bd-4d8a-b050-aff3afafcb1e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:46.446965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0447a3-500f-422b-b34a-54b21ca5b40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:46.448974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0447a3-500f-422b-b34a-54b21ca5b40f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:46.449492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0447a3-500f-422b-b34a-54b21ca5b40f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:46.450312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0447a3-500f-422b-b34a-54b21ca5b40f admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:46.451162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0447a3-500f-422b-b34a-54b21ca5b40f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:46.453476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0447a3-500f-422b-b34a-54b21ca5b40f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:46.499760 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1463/2928] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:05:46 2022] POST /identity/v3/projects => generated 391 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:05:46.501059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb66822-445c-4e6d-a5d0-400f7acf15e6 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:46.521710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb66822-445c-4e6d-a5d0-400f7acf15e6 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:46.610747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:46.625512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68430c71-8d63-461e-9a0f-5e24422cbffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:46.626267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68430c71-8d63-461e-9a0f-5e24422cbffd admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:46.628491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68430c71-8d63-461e-9a0f-5e24422cbffd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:46.631001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68430c71-8d63-461e-9a0f-5e24422cbffd admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:46.633389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68430c71-8d63-461e-9a0f-5e24422cbffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:46.637590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68430c71-8d63-461e-9a0f-5e24422cbffd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:46.673068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0447a3-500f-422b-b34a-54b21ca5b40f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:46.684088 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1466/2929] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:05:46 2022] POST /identity/v3/users => generated 302 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:05:46.685876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0447a3-500f-422b-b34a-54b21ca5b40f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:46.694955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2811aa4-cf9a-4b36-b39e-f4aa6282d3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:46.697406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2811aa4-cf9a-4b36-b39e-f4aa6282d3ef admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:46.698141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2811aa4-cf9a-4b36-b39e-f4aa6282d3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:46.699837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2811aa4-cf9a-4b36-b39e-f4aa6282d3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:46.702312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2811aa4-cf9a-4b36-b39e-f4aa6282d3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:46.705114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2811aa4-cf9a-4b36-b39e-f4aa6282d3ef admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:46.727638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68430c71-8d63-461e-9a0f-5e24422cbffd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:46.739428 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1464/2930] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:05:46.740938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68430c71-8d63-461e-9a0f-5e24422cbffd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:46.762088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8ca98-b8c2-4e21-9b1c-9887442df069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:46.762088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8ca98-b8c2-4e21-9b1c-9887442df069 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:46.762088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8ca98-b8c2-4e21-9b1c-9887442df069 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:46.762088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8ca98-b8c2-4e21-9b1c-9887442df069 admin admin] PATH_INFO: `/v3/projects/d0fa9f6f453a4d9c8383c84368b98970/users/8f71a7b16f8b4e1fa3b08b96c1705327/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:46.791236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8ca98-b8c2-4e21-9b1c-9887442df069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0fa9f6f453a4d9c8383c84368b98970, user_id=8f71a7b16f8b4e1fa3b08b96c1705327, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:46.796857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8ca98-b8c2-4e21-9b1c-9887442df069 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:46.827730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2811aa4-cf9a-4b36-b39e-f4aa6282d3ef admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:46.828397 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1467/2931] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:05:46 2022] PUT /identity/v3/projects/d0fa9f6f453a4d9c8383c84368b98970/users/8f71a7b16f8b4e1fa3b08b96c1705327/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:46.843203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2811aa4-cf9a-4b36-b39e-f4aa6282d3ef admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:47.023642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f26415-30d9-4d08-af44-80f6ab92f1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:47.025118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f26415-30d9-4d08-af44-80f6ab92f1aa admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:47.025662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f26415-30d9-4d08-af44-80f6ab92f1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:47.026169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f26415-30d9-4d08-af44-80f6ab92f1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:47.027552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f26415-30d9-4d08-af44-80f6ab92f1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:47.031013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f26415-30d9-4d08-af44-80f6ab92f1aa admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:47.077001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8ca98-b8c2-4e21-9b1c-9887442df069 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:47.090425 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1465/2932] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:05:47.092750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8ca98-b8c2-4e21-9b1c-9887442df069 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:47.099960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06f373-5aed-4d9b-b5db-1ab52a3f976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:47.101270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06f373-5aed-4d9b-b5db-1ab52a3f976b admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:47.102395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06f373-5aed-4d9b-b5db-1ab52a3f976b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:47.103630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06f373-5aed-4d9b-b5db-1ab52a3f976b admin admin] PATH_INFO: `/v3/projects/d0fa9f6f453a4d9c8383c84368b98970/users/8f71a7b16f8b4e1fa3b08b96c1705327/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:47.106206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06f373-5aed-4d9b-b5db-1ab52a3f976b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0fa9f6f453a4d9c8383c84368b98970, user_id=8f71a7b16f8b4e1fa3b08b96c1705327, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:47.110360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06f373-5aed-4d9b-b5db-1ab52a3f976b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:47.136634 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1468/2933] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:05:47 2022] PUT /identity/v3/projects/d0fa9f6f453a4d9c8383c84368b98970/users/8f71a7b16f8b4e1fa3b08b96c1705327/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:47.139461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a0813-285a-46d1-8d48-5e9617dd16eb None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:47.140027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a0813-285a-46d1-8d48-5e9617dd16eb None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:47.140538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a0813-285a-46d1-8d48-5e9617dd16eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:47.210128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-129a0813-285a-46d1-8d48-5e9617dd16eb None None] MFA Rules not processed for user `8f71a7b16f8b4e1fa3b08b96c1705327`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:47.212698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-129a0813-285a-46d1-8d48-5e9617dd16eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:47.228484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:47.443311 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1466/2934] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:47.460068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe0f17-8d83-466e-8617-8f915edc3b14 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:47.460685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe0f17-8d83-466e-8617-8f915edc3b14 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:47.461185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe0f17-8d83-466e-8617-8f915edc3b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:47.508850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1dfe0f17-8d83-466e-8617-8f915edc3b14 None None] MFA Rules not processed for user `f820053bb2d942fd968b7129b2faae47`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:47.510132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1dfe0f17-8d83-466e-8617-8f915edc3b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:47.678966 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1469/2935] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:47.787435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a0813-285a-46d1-8d48-5e9617dd16eb None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:47.791214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-129a0813-285a-46d1-8d48-5e9617dd16eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:48.155897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a0813-285a-46d1-8d48-5e9617dd16eb None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:48.180085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af8bb8-8b31-40de-9189-ddf644c6c65d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:48.183932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af8bb8-8b31-40de-9189-ddf644c6c65d service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:48.184249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af8bb8-8b31-40de-9189-ddf644c6c65d service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:48.184542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af8bb8-8b31-40de-9189-ddf644c6c65d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:48.203997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af8bb8-8b31-40de-9189-ddf644c6c65d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:48.206411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af8bb8-8b31-40de-9189-ddf644c6c65d service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:48.228143 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1467/2936] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:05:52.792253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe0f17-8d83-466e-8617-8f915edc3b14 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:52.793680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1dfe0f17-8d83-466e-8617-8f915edc3b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:52.828524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe0f17-8d83-466e-8617-8f915edc3b14 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:52.840362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877cb83-7fa5-4c10-909e-ffa6e36c1240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:52.841374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877cb83-7fa5-4c10-909e-ffa6e36c1240 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:52.841990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877cb83-7fa5-4c10-909e-ffa6e36c1240 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:52.842459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877cb83-7fa5-4c10-909e-ffa6e36c1240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:52.848521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8877cb83-7fa5-4c10-909e-ffa6e36c1240 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:52.998576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877cb83-7fa5-4c10-909e-ffa6e36c1240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:53.006587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877cb83-7fa5-4c10-909e-ffa6e36c1240 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:53.061160 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1470/2937] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:05:54.305105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9ff23-b1a7-4e86-8dc2-f530f8e8e5a6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:54.305616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9ff23-b1a7-4e86-8dc2-f530f8e8e5a6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:54.305731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9ff23-b1a7-4e86-8dc2-f530f8e8e5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:54.345686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d1e9ff23-b1a7-4e86-8dc2-f530f8e8e5a6 None None] MFA Rules not processed for user `5b51cd5eda484fad9a901893f75d1b48`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:54.346945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d1e9ff23-b1a7-4e86-8dc2-f530f8e8e5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:54.538295 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1468/2938] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:55.332611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877cb83-7fa5-4c10-909e-ffa6e36c1240 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:55.334816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8877cb83-7fa5-4c10-909e-ffa6e36c1240 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:55.533154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877cb83-7fa5-4c10-909e-ffa6e36c1240 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:55.538513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4649f59-ef73-4bfd-8a87-efe91a59312e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:55.539753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4649f59-ef73-4bfd-8a87-efe91a59312e service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:55.541220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4649f59-ef73-4bfd-8a87-efe91a59312e service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:55.543200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4649f59-ef73-4bfd-8a87-efe91a59312e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:55.547024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a4649f59-ef73-4bfd-8a87-efe91a59312e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:55.580507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:55.587041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9ff23-b1a7-4e86-8dc2-f530f8e8e5a6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:55.588620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d1e9ff23-b1a7-4e86-8dc2-f530f8e8e5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:55.596845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4649f59-ef73-4bfd-8a87-efe91a59312e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:55.602854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4649f59-ef73-4bfd-8a87-efe91a59312e service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:55.621304 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1471/2939] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:05:55.655897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:55.717200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9ff23-b1a7-4e86-8dc2-f530f8e8e5a6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:55.723381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d4e89-c270-4cc6-945f-aa918a5e3913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:55.725112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d4e89-c270-4cc6-945f-aa918a5e3913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:55.725602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d4e89-c270-4cc6-945f-aa918a5e3913 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:55.726072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d4e89-c270-4cc6-945f-aa918a5e3913 admin admin] PATH_INFO: `/v3/users/1906745af3e24906adf16c6c68e12968` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:55.727934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d4e89-c270-4cc6-945f-aa918a5e3913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1906745af3e24906adf16c6c68e12968)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:55.731160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d4e89-c270-4cc6-945f-aa918a5e3913 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:55.836066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-df0d4e89-c270-4cc6-945f-aa918a5e3913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1906745af3e24906adf16c6c68e12968'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:55.862517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-df0d4e89-c270-4cc6-945f-aa918a5e3913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1906745af3e24906adf16c6c68e12968'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:55.867549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-df0d4e89-c270-4cc6-945f-aa918a5e3913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1906745af3e24906adf16c6c68e12968'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:55.895705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-df0d4e89-c270-4cc6-945f-aa918a5e3913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1906745af3e24906adf16c6c68e12968'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:55.897203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-df0d4e89-c270-4cc6-945f-aa918a5e3913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1906745af3e24906adf16c6c68e12968'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:55.928822 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1469/2940] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:05:55 2022] DELETE /identity/v3/users/1906745af3e24906adf16c6c68e12968 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:05:56.166853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4649f59-ef73-4bfd-8a87-efe91a59312e service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:56.200389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4649f59-ef73-4bfd-8a87-efe91a59312e service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:56.370904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085813cc-3cd7-4f84-a848-9b5607323ad6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:56.379510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085813cc-3cd7-4f84-a848-9b5607323ad6 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:56.379910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085813cc-3cd7-4f84-a848-9b5607323ad6 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:56.380199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085813cc-3cd7-4f84-a848-9b5607323ad6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:56.386900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-085813cc-3cd7-4f84-a848-9b5607323ad6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:56.428745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085813cc-3cd7-4f84-a848-9b5607323ad6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:56.430481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085813cc-3cd7-4f84-a848-9b5607323ad6 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:56.456905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d4e89-c270-4cc6-945f-aa918a5e3913 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:56.458425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-df0d4e89-c270-4cc6-945f-aa918a5e3913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:56.473429 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1472/2941] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:05:56.626228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d4e89-c270-4cc6-945f-aa918a5e3913 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:56.634750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5ad8e-f896-420c-8f28-b204b4e2c770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:56.636510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5ad8e-f896-420c-8f28-b204b4e2c770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:56.637019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5ad8e-f896-420c-8f28-b204b4e2c770 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:56.637662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5ad8e-f896-420c-8f28-b204b4e2c770 admin admin] PATH_INFO: `/v3/projects/2f684cc4b6d44b398d3c6cd0e8aac7b0` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:56.639166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5ad8e-f896-420c-8f28-b204b4e2c770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f684cc4b6d44b398d3c6cd0e8aac7b0)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:56.641430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5ad8e-f896-420c-8f28-b204b4e2c770 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:56.755442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bca5ad8e-f896-420c-8f28-b204b4e2c770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f684cc4b6d44b398d3c6cd0e8aac7b0', 'request_id': 'req-bca5ad8e-f896-420c-8f28-b204b4e2c770'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:56.818555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bca5ad8e-f896-420c-8f28-b204b4e2c770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f684cc4b6d44b398d3c6cd0e8aac7b0', 'request_id': 'req-bca5ad8e-f896-420c-8f28-b204b4e2c770'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:56.833898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:56.862314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bca5ad8e-f896-420c-8f28-b204b4e2c770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f684cc4b6d44b398d3c6cd0e8aac7b0', 'request_id': 'req-bca5ad8e-f896-420c-8f28-b204b4e2c770'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:56.897040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bca5ad8e-f896-420c-8f28-b204b4e2c770 admin admin] The token cache is being invalidate because project 2f684cc4b6d44b398d3c6cd0e8aac7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:05:56.898359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bca5ad8e-f896-420c-8f28-b204b4e2c770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:56.900455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bca5ad8e-f896-420c-8f28-b204b4e2c770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:05:56.906951 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1470/2942] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:56 2022] DELETE /identity/v3/projects/2f684cc4b6d44b398d3c6cd0e8aac7b0 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:05:56.913373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70f29a-a1a1-4278-8337-e599c4a37d11 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:56.913657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70f29a-a1a1-4278-8337-e599c4a37d11 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:56.913958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70f29a-a1a1-4278-8337-e599c4a37d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:56.956620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8a70f29a-a1a1-4278-8337-e599c4a37d11 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:56.962011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8a70f29a-a1a1-4278-8337-e599c4a37d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:57.140822 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1473/2943] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:57.149470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c419f6b-5fa5-4b9c-8f5e-bcedfe251942 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:57.150643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c419f6b-5fa5-4b9c-8f5e-bcedfe251942 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:57.151754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c419f6b-5fa5-4b9c-8f5e-bcedfe251942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:57.185003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1c419f6b-5fa5-4b9c-8f5e-bcedfe251942 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:57.187444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1c419f6b-5fa5-4b9c-8f5e-bcedfe251942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:57.224174 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1471/2944] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:57.230671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70f29a-a1a1-4278-8337-e599c4a37d11 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:57.254160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70f29a-a1a1-4278-8337-e599c4a37d11 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:57.259713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bece11-a8d1-48e3-a299-9f568e2796d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:57.260451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bece11-a8d1-48e3-a299-9f568e2796d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:57.260773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bece11-a8d1-48e3-a299-9f568e2796d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:57.261178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bece11-a8d1-48e3-a299-9f568e2796d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:57.261919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bece11-a8d1-48e3-a299-9f568e2796d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:05:57.262288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bece11-a8d1-48e3-a299-9f568e2796d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:57.264124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bece11-a8d1-48e3-a299-9f568e2796d9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:57.299226 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1474/2945] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:05:57.300402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c419f6b-5fa5-4b9c-8f5e-bcedfe251942 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:57.327427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c419f6b-5fa5-4b9c-8f5e-bcedfe251942 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:57.340412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe15f32-7620-46d0-92ab-d43fd35703cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:57.342247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe15f32-7620-46d0-92ab-d43fd35703cb admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:57.342772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe15f32-7620-46d0-92ab-d43fd35703cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:57.343256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe15f32-7620-46d0-92ab-d43fd35703cb admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:57.348350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe15f32-7620-46d0-92ab-d43fd35703cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:57.355884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe15f32-7620-46d0-92ab-d43fd35703cb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:57.398520 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1472/2946] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:05:57 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:05:57.402930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bece11-a8d1-48e3-a299-9f568e2796d9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:57.418635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bece11-a8d1-48e3-a299-9f568e2796d9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:57.559340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6973db1-f1e8-4631-94f7-d99baf1f57e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:57.563508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6973db1-f1e8-4631-94f7-d99baf1f57e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:57.564314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6973db1-f1e8-4631-94f7-d99baf1f57e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:57.565298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6973db1-f1e8-4631-94f7-d99baf1f57e7 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:57.567276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6973db1-f1e8-4631-94f7-d99baf1f57e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:57.573595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6973db1-f1e8-4631-94f7-d99baf1f57e7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:57.602965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:57.632894 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1475/2947] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:05:57 2022] POST /identity/v3/users => generated 294 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:05:57.638010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe15f32-7620-46d0-92ab-d43fd35703cb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:57.653352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe15f32-7620-46d0-92ab-d43fd35703cb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:57.662333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332f3ac-aef4-4db1-b5eb-da19ec258eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:57.663071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332f3ac-aef4-4db1-b5eb-da19ec258eae admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:57.663491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332f3ac-aef4-4db1-b5eb-da19ec258eae admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:57.663854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332f3ac-aef4-4db1-b5eb-da19ec258eae admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:57.665067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332f3ac-aef4-4db1-b5eb-da19ec258eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:57.669419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332f3ac-aef4-4db1-b5eb-da19ec258eae admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:57.682274 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1473/2948] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:05:57.688744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6973db1-f1e8-4631-94f7-d99baf1f57e7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:57.705848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6973db1-f1e8-4631-94f7-d99baf1f57e7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:57.720705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d94f46-a7b6-4a5d-b7d6-49834cf133f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:57.721741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d94f46-a7b6-4a5d-b7d6-49834cf133f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:57.722122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d94f46-a7b6-4a5d-b7d6-49834cf133f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:57.722577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d94f46-a7b6-4a5d-b7d6-49834cf133f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:57.730718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d94f46-a7b6-4a5d-b7d6-49834cf133f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:57.730718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d94f46-a7b6-4a5d-b7d6-49834cf133f5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:57.794910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332f3ac-aef4-4db1-b5eb-da19ec258eae admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:57.803762 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1476/2949] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:05:57.810646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332f3ac-aef4-4db1-b5eb-da19ec258eae admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:57.823852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f9515-f2ff-47bf-916c-43f34d5a4994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:57.824855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f9515-f2ff-47bf-916c-43f34d5a4994 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:57.825797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f9515-f2ff-47bf-916c-43f34d5a4994 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:57.826241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f9515-f2ff-47bf-916c-43f34d5a4994 admin admin] PATH_INFO: `/v3/projects/74dbfdaed0204a21b01511be04d601cb/users/b0eb24ade1494f8a90b6d2ec7973821d/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:57.873340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f9515-f2ff-47bf-916c-43f34d5a4994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74dbfdaed0204a21b01511be04d601cb, user_id=b0eb24ade1494f8a90b6d2ec7973821d, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:57.878707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f9515-f2ff-47bf-916c-43f34d5a4994 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:57.951025 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1474/2950] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:05:57 2022] PUT /identity/v3/projects/74dbfdaed0204a21b01511be04d601cb/users/b0eb24ade1494f8a90b6d2ec7973821d/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:05:57.953430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa4b9d-9843-4fdc-bb74-467ef107990b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:57.954310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa4b9d-9843-4fdc-bb74-467ef107990b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:57.954827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa4b9d-9843-4fdc-bb74-467ef107990b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:57.988938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a7aa4b9d-9843-4fdc-bb74-467ef107990b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:05:57.991118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a7aa4b9d-9843-4fdc-bb74-467ef107990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:58.134971 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1477/2951] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:05:58.143254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f9515-f2ff-47bf-916c-43f34d5a4994 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:05:58.145521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3c7f9515-f2ff-47bf-916c-43f34d5a4994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:05:58.225767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f9515-f2ff-47bf-916c-43f34d5a4994 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:05:58.239363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c63de-c5ab-4e55-afa8-33d333540d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:05:58.240556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c63de-c5ab-4e55-afa8-33d333540d70 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:05:58.240851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c63de-c5ab-4e55-afa8-33d333540d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:05:58.242833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c63de-c5ab-4e55-afa8-33d333540d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:05:58.271552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c63de-c5ab-4e55-afa8-33d333540d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:05:58.275108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c63de-c5ab-4e55-afa8-33d333540d70 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:05:58.300816 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1475/2952] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:06:02.581117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbdf42-7008-4307-88ac-c7bf0be4e434 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:02.582041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbdf42-7008-4307-88ac-c7bf0be4e434 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:02.582384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbdf42-7008-4307-88ac-c7bf0be4e434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:02.606642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c4fbdf42-7008-4307-88ac-c7bf0be4e434 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:06:02.608369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c4fbdf42-7008-4307-88ac-c7bf0be4e434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:02.700993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c63de-c5ab-4e55-afa8-33d333540d70 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:02.702646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1e0c63de-c5ab-4e55-afa8-33d333540d70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:02.703665 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1478/2953] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:06:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:06:02.815113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c63de-c5ab-4e55-afa8-33d333540d70 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:02.822908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe580a30-e5cc-4d36-8242-edd9ab4d7cd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:02.824507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe580a30-e5cc-4d36-8242-edd9ab4d7cd8 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:02.824871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe580a30-e5cc-4d36-8242-edd9ab4d7cd8 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:02.825156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe580a30-e5cc-4d36-8242-edd9ab4d7cd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:02.842384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe580a30-e5cc-4d36-8242-edd9ab4d7cd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:02.844058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe580a30-e5cc-4d36-8242-edd9ab4d7cd8 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:02.869103 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1476/2954] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:06:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:06:06.519584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7859d57-afe7-4a87-bdb3-a9b454f7a290 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:06.520489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7859d57-afe7-4a87-bdb3-a9b454f7a290 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:06.520945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7859d57-afe7-4a87-bdb3-a9b454f7a290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:06.568346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e7859d57-afe7-4a87-bdb3-a9b454f7a290 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:06:06.569608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e7859d57-afe7-4a87-bdb3-a9b454f7a290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:06.589678 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1479/2955] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:06:06.600647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe580a30-e5cc-4d36-8242-edd9ab4d7cd8 service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:06.621421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe580a30-e5cc-4d36-8242-edd9ab4d7cd8 service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:06.645380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42faffb6-ffa9-491c-b0f3-516f6c7e46ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:06.646566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faffb6-ffa9-491c-b0f3-516f6c7e46ca service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:06.647077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faffb6-ffa9-491c-b0f3-516f6c7e46ca service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:06.647653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faffb6-ffa9-491c-b0f3-516f6c7e46ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:06.665053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42faffb6-ffa9-491c-b0f3-516f6c7e46ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:06.669808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42faffb6-ffa9-491c-b0f3-516f6c7e46ca service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:06.679723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:06.695676 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1477/2956] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:06:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:06:07.736085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7859d57-afe7-4a87-bdb3-a9b454f7a290 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:07.741792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e7859d57-afe7-4a87-bdb3-a9b454f7a290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:08.001854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7859d57-afe7-4a87-bdb3-a9b454f7a290 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:08.017226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3efc6-4881-40a8-a7d3-8f341f5f5a25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:08.018789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3efc6-4881-40a8-a7d3-8f341f5f5a25 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:08.019691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3efc6-4881-40a8-a7d3-8f341f5f5a25 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:08.021170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3efc6-4881-40a8-a7d3-8f341f5f5a25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:08.031256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4cd3efc6-4881-40a8-a7d3-8f341f5f5a25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:08.072260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3efc6-4881-40a8-a7d3-8f341f5f5a25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:08.076778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3efc6-4881-40a8-a7d3-8f341f5f5a25 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:08.128118 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1480/2957] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:06:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:06:13.618601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42faffb6-ffa9-491c-b0f3-516f6c7e46ca service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:13.650210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42faffb6-ffa9-491c-b0f3-516f6c7e46ca service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:13.661049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279617a-27c1-4c9d-bfdd-71a36232a8c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:13.664707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279617a-27c1-4c9d-bfdd-71a36232a8c2 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:13.666931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279617a-27c1-4c9d-bfdd-71a36232a8c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:13.667872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279617a-27c1-4c9d-bfdd-71a36232a8c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:13.678293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c279617a-27c1-4c9d-bfdd-71a36232a8c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:13.927916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279617a-27c1-4c9d-bfdd-71a36232a8c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:13.930810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279617a-27c1-4c9d-bfdd-71a36232a8c2 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:13.965939 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1478/2958] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:06:13 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:06:14.984018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45431c77-2c05-4ced-82f7-9657fdc45e16 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:14.984819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45431c77-2c05-4ced-82f7-9657fdc45e16 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:14.985426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45431c77-2c05-4ced-82f7-9657fdc45e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:15.045715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:15.071324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-45431c77-2c05-4ced-82f7-9657fdc45e16 None None] MFA Rules not processed for user `b0eb24ade1494f8a90b6d2ec7973821d`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:06:15.072591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-45431c77-2c05-4ced-82f7-9657fdc45e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:15.356877 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1481/2959] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:06:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:06:21.328452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279617a-27c1-4c9d-bfdd-71a36232a8c2 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:21.330906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c279617a-27c1-4c9d-bfdd-71a36232a8c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:21.357389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279617a-27c1-4c9d-bfdd-71a36232a8c2 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:21.365648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6b81d-c14e-469f-a667-63fa0cec6ca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:21.366742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6b81d-c14e-469f-a667-63fa0cec6ca0 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:21.367198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6b81d-c14e-469f-a667-63fa0cec6ca0 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:21.367880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6b81d-c14e-469f-a667-63fa0cec6ca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:21.370702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-56c6b81d-c14e-469f-a667-63fa0cec6ca0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:21.470658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6b81d-c14e-469f-a667-63fa0cec6ca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:21.475013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6b81d-c14e-469f-a667-63fa0cec6ca0 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:21.490646 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1479/2960] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:06:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:06:22.401496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45431c77-2c05-4ced-82f7-9657fdc45e16 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:22.427511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45431c77-2c05-4ced-82f7-9657fdc45e16 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:22.450423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1be2b-86a5-43be-92c5-85ed780f700b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:22.451262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1be2b-86a5-43be-92c5-85ed780f700b service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:22.451812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1be2b-86a5-43be-92c5-85ed780f700b service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:22.452396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1be2b-86a5-43be-92c5-85ed780f700b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:22.474403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1be2b-86a5-43be-92c5-85ed780f700b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:22.476295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1be2b-86a5-43be-92c5-85ed780f700b service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:22.501639 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1482/2961] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:06:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:06:22.820369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e6e64-2e60-467c-ba10-336ff3881d80 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:22.820897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e6e64-2e60-467c-ba10-336ff3881d80 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:22.821377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e6e64-2e60-467c-ba10-336ff3881d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:22.845707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-dd5e6e64-2e60-467c-ba10-336ff3881d80 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:06:22.847496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-dd5e6e64-2e60-467c-ba10-336ff3881d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:22.867749 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1480/2962] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:06:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:06:22.890280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1be2b-86a5-43be-92c5-85ed780f700b service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:22.926650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1be2b-86a5-43be-92c5-85ed780f700b service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:22.933615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d87d0-e983-4383-be1a-9701557da7dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:22.934235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d87d0-e983-4383-be1a-9701557da7dd service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:22.934619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d87d0-e983-4383-be1a-9701557da7dd service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:22.935212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d87d0-e983-4383-be1a-9701557da7dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:22.952054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d87d0-e983-4383-be1a-9701557da7dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:22.953532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d87d0-e983-4383-be1a-9701557da7dd service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:22.971859 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1483/2963] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:06:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:06:24.624606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b0078-59ca-478e-a213-b73a73990944 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:24.625497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b0078-59ca-478e-a213-b73a73990944 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:24.626037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b0078-59ca-478e-a213-b73a73990944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:24.650030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-fd6b0078-59ca-478e-a213-b73a73990944 None None] MFA Rules not processed for user `8379e04d2b30488387b3eefab6669768`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:06:24.652303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fd6b0078-59ca-478e-a213-b73a73990944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:24.724536 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1481/2964] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:06:24 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:06:25.251242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d87d0-e983-4383-be1a-9701557da7dd service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:25.253255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f73d87d0-e983-4383-be1a-9701557da7dd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:25.267609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d87d0-e983-4383-be1a-9701557da7dd service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:25.275635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59044484-e40a-44de-900a-f43cecb423cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:25.276679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59044484-e40a-44de-900a-f43cecb423cd service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:25.277024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59044484-e40a-44de-900a-f43cecb423cd service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:25.277363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59044484-e40a-44de-900a-f43cecb423cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:25.279448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-59044484-e40a-44de-900a-f43cecb423cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:25.290568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59044484-e40a-44de-900a-f43cecb423cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:25.292213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59044484-e40a-44de-900a-f43cecb423cd service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:25.301097 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1484/2965] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:06:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:06:27.179447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b0078-59ca-478e-a213-b73a73990944 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:27.197895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b0078-59ca-478e-a213-b73a73990944 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:27.206043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce87af-1fab-4014-824c-17b045a6681f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:27.206991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce87af-1fab-4014-824c-17b045a6681f service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:27.207497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce87af-1fab-4014-824c-17b045a6681f service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:27.207907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce87af-1fab-4014-824c-17b045a6681f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:27.209886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e8ce87af-1fab-4014-824c-17b045a6681f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:27.274183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:27.376283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce87af-1fab-4014-824c-17b045a6681f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:27.378146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce87af-1fab-4014-824c-17b045a6681f service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:27.396759 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1482/2966] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:06:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:06:27.446511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d179d54-c19c-4457-997a-700109960eb1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:27.447432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d179d54-c19c-4457-997a-700109960eb1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:27.448011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d179d54-c19c-4457-997a-700109960eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:27.478182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8d179d54-c19c-4457-997a-700109960eb1 None None] MFA Rules not processed for user `f820053bb2d942fd968b7129b2faae47`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:06:27.480066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8d179d54-c19c-4457-997a-700109960eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:27.642465 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1485/2967] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:06:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:06:33.143381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104e599-82b8-44d3-adec-085a74a02b35 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:33.146580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104e599-82b8-44d3-adec-085a74a02b35 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:33.146580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104e599-82b8-44d3-adec-085a74a02b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:33.184796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9104e599-82b8-44d3-adec-085a74a02b35 None None] MFA Rules not processed for user `d20ab89ea13c4611904cec244d37ba25`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:06:33.186570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9104e599-82b8-44d3-adec-085a74a02b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:33.264228 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1483/2968] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:06:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:06:37.616034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=71 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:39.420796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d3616-2360-4297-9363-d70945b1435e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:39.421398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d3616-2360-4297-9363-d70945b1435e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:39.421398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d3616-2360-4297-9363-d70945b1435e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:39.452841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ce4d3616-2360-4297-9363-d70945b1435e None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:06:39.454314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ce4d3616-2360-4297-9363-d70945b1435e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:39.462243 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1486/2969] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:06:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:06:39.488856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104e599-82b8-44d3-adec-085a74a02b35 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:39.501907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104e599-82b8-44d3-adec-085a74a02b35 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:39.506868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c7d03-4eaa-40b2-a9fa-a022bc141b0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:39.507741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c7d03-4eaa-40b2-a9fa-a022bc141b0d service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:39.508029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c7d03-4eaa-40b2-a9fa-a022bc141b0d service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:39.508306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c7d03-4eaa-40b2-a9fa-a022bc141b0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:39.517018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c7d03-4eaa-40b2-a9fa-a022bc141b0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:39.518609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c7d03-4eaa-40b2-a9fa-a022bc141b0d service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:39.527333 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1484/2970] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:06:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 30 21:06:40.566412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af95361-a83d-4d4f-9ef2-34b94b184cb7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:40.567385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af95361-a83d-4d4f-9ef2-34b94b184cb7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:40.567730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af95361-a83d-4d4f-9ef2-34b94b184cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:40.589797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9af95361-a83d-4d4f-9ef2-34b94b184cb7 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:06:40.591702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9af95361-a83d-4d4f-9ef2-34b94b184cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:40.600145 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1487/2971] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:06:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:06:40.614788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c7d03-4eaa-40b2-a9fa-a022bc141b0d service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:40.635925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c7d03-4eaa-40b2-a9fa-a022bc141b0d service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:40.641581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266f704-dcd7-450b-88d4-d9f356f226a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:40.642273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266f704-dcd7-450b-88d4-d9f356f226a0 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:40.642627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266f704-dcd7-450b-88d4-d9f356f226a0 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:40.642974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266f704-dcd7-450b-88d4-d9f356f226a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:40.651856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266f704-dcd7-450b-88d4-d9f356f226a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:40.653820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266f704-dcd7-450b-88d4-d9f356f226a0 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:40.662838 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1485/2972] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:06:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:06:41.211858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb228b-92ec-487a-92e3-3115db8804c4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:41.212449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb228b-92ec-487a-92e3-3115db8804c4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:41.212798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb228b-92ec-487a-92e3-3115db8804c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:41.240309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-aabb228b-92ec-487a-92e3-3115db8804c4 None None] MFA Rules not processed for user `5b51cd5eda484fad9a901893f75d1b48`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:06:41.241726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-aabb228b-92ec-487a-92e3-3115db8804c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:41.327977 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1488/2973] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:06:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:06:41.359677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba86e5-4f6c-43ca-a1ad-ef6291da628b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:41.359975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba86e5-4f6c-43ca-a1ad-ef6291da628b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:41.360441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba86e5-4f6c-43ca-a1ad-ef6291da628b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:41.382837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-68ba86e5-4f6c-43ca-a1ad-ef6291da628b None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:06:41.384396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-68ba86e5-4f6c-43ca-a1ad-ef6291da628b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:41.393468 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1486/2974] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:06:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:06:41.407563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb228b-92ec-487a-92e3-3115db8804c4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:41.422677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb228b-92ec-487a-92e3-3115db8804c4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:41.428646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a5a07-171f-4fad-a3d7-e3ca90c9549b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:41.429284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a5a07-171f-4fad-a3d7-e3ca90c9549b service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:41.429568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a5a07-171f-4fad-a3d7-e3ca90c9549b service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:41.429844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a5a07-171f-4fad-a3d7-e3ca90c9549b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:41.439820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a5a07-171f-4fad-a3d7-e3ca90c9549b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:41.441618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a5a07-171f-4fad-a3d7-e3ca90c9549b service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:41.452058 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1489/2975] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:06:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:06:48.297179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba86e5-4f6c-43ca-a1ad-ef6291da628b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:48.299538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-68ba86e5-4f6c-43ca-a1ad-ef6291da628b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:48.443961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba86e5-4f6c-43ca-a1ad-ef6291da628b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:48.454324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040883f-6eb2-4c87-a8ab-10157773fac0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:48.454972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040883f-6eb2-4c87-a8ab-10157773fac0 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:48.455359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040883f-6eb2-4c87-a8ab-10157773fac0 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:48.455890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040883f-6eb2-4c87-a8ab-10157773fac0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:48.457951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0040883f-6eb2-4c87-a8ab-10157773fac0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:48.466933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a5a07-171f-4fad-a3d7-e3ca90c9549b service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:48.482761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a5a07-171f-4fad-a3d7-e3ca90c9549b service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:48.492573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040883f-6eb2-4c87-a8ab-10157773fac0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:48.496324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208ee2e-c80d-41cb-a4b0-9f39d87e4e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:48.508727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208ee2e-c80d-41cb-a4b0-9f39d87e4e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:48.510671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040883f-6eb2-4c87-a8ab-10157773fac0 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:48.513704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208ee2e-c80d-41cb-a4b0-9f39d87e4e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:48.514107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208ee2e-c80d-41cb-a4b0-9f39d87e4e92 admin admin] PATH_INFO: `/v3/users/b0eb24ade1494f8a90b6d2ec7973821d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:48.516791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208ee2e-c80d-41cb-a4b0-9f39d87e4e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0eb24ade1494f8a90b6d2ec7973821d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:48.525167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208ee2e-c80d-41cb-a4b0-9f39d87e4e92 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:48.539916 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1487/2976] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:06:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:06:48.643376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a208ee2e-c80d-41cb-a4b0-9f39d87e4e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0eb24ade1494f8a90b6d2ec7973821d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:06:48.644873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a208ee2e-c80d-41cb-a4b0-9f39d87e4e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0eb24ade1494f8a90b6d2ec7973821d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:06:48.662405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a208ee2e-c80d-41cb-a4b0-9f39d87e4e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0eb24ade1494f8a90b6d2ec7973821d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:06:48.663478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a208ee2e-c80d-41cb-a4b0-9f39d87e4e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0eb24ade1494f8a90b6d2ec7973821d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:06:48.673786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a208ee2e-c80d-41cb-a4b0-9f39d87e4e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0eb24ade1494f8a90b6d2ec7973821d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:06:48.704914 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1490/2977] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:06:48 2022] DELETE /identity/v3/users/b0eb24ade1494f8a90b6d2ec7973821d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:06:49.069720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040883f-6eb2-4c87-a8ab-10157773fac0 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:49.099163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040883f-6eb2-4c87-a8ab-10157773fac0 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:49.138241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:49.218966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72466707-fc6f-4ecb-a924-278882fa8b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:49.219664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72466707-fc6f-4ecb-a924-278882fa8b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:49.219950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72466707-fc6f-4ecb-a924-278882fa8b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:49.220229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72466707-fc6f-4ecb-a924-278882fa8b8d admin admin] PATH_INFO: `/v3/projects/74dbfdaed0204a21b01511be04d601cb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:49.222124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72466707-fc6f-4ecb-a924-278882fa8b8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=74dbfdaed0204a21b01511be04d601cb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:49.227049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72466707-fc6f-4ecb-a924-278882fa8b8d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:49.297512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72466707-fc6f-4ecb-a924-278882fa8b8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74dbfdaed0204a21b01511be04d601cb', 'request_id': 'req-72466707-fc6f-4ecb-a924-278882fa8b8d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:06:49.305485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72466707-fc6f-4ecb-a924-278882fa8b8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74dbfdaed0204a21b01511be04d601cb', 'request_id': 'req-72466707-fc6f-4ecb-a924-278882fa8b8d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:06:49.316146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72466707-fc6f-4ecb-a924-278882fa8b8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74dbfdaed0204a21b01511be04d601cb', 'request_id': 'req-72466707-fc6f-4ecb-a924-278882fa8b8d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:06:49.331326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72466707-fc6f-4ecb-a924-278882fa8b8d admin admin] The token cache is being invalidate because project 74dbfdaed0204a21b01511be04d601cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:06:49.332758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72466707-fc6f-4ecb-a924-278882fa8b8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:06:49.333484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72466707-fc6f-4ecb-a924-278882fa8b8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:06:49.335318 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1488/2978] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:06:49 2022] DELETE /identity/v3/projects/74dbfdaed0204a21b01511be04d601cb => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:06:49.340945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b7f1a-4d1c-49a7-b3ec-2474c509b864 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:49.341297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b7f1a-4d1c-49a7-b3ec-2474c509b864 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:49.341667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b7f1a-4d1c-49a7-b3ec-2474c509b864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:49.365124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-847b7f1a-4d1c-49a7-b3ec-2474c509b864 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:06:49.366436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-847b7f1a-4d1c-49a7-b3ec-2474c509b864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:49.434688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:49.465118 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1491/2979] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:06:49.474435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc0d34-8ec3-462b-853c-97e15366a117 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:49.475158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc0d34-8ec3-462b-853c-97e15366a117 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:49.475668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc0d34-8ec3-462b-853c-97e15366a117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:49.523912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-dadc0d34-8ec3-462b-853c-97e15366a117 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:06:49.531430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-dadc0d34-8ec3-462b-853c-97e15366a117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:49.547987 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1489/2980] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:06:49.549108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b7f1a-4d1c-49a7-b3ec-2474c509b864 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:49.565424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b7f1a-4d1c-49a7-b3ec-2474c509b864 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:49.573075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249cd07-4c0b-4cdd-8232-30f70bac6717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:49.574169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249cd07-4c0b-4cdd-8232-30f70bac6717 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:49.574530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249cd07-4c0b-4cdd-8232-30f70bac6717 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:49.574916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249cd07-4c0b-4cdd-8232-30f70bac6717 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:49.575826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249cd07-4c0b-4cdd-8232-30f70bac6717 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:06:49.576268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249cd07-4c0b-4cdd-8232-30f70bac6717 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:49.578417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249cd07-4c0b-4cdd-8232-30f70bac6717 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:49.601632 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1492/2981] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:06:49.605888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc0d34-8ec3-462b-853c-97e15366a117 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:49.625110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc0d34-8ec3-462b-853c-97e15366a117 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:49.631956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25a8ec-9ae1-42aa-a190-9ea0287f9361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:49.632886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25a8ec-9ae1-42aa-a190-9ea0287f9361 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:49.633389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25a8ec-9ae1-42aa-a190-9ea0287f9361 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:49.633899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25a8ec-9ae1-42aa-a190-9ea0287f9361 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:49.634875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25a8ec-9ae1-42aa-a190-9ea0287f9361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:49.637889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25a8ec-9ae1-42aa-a190-9ea0287f9361 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:49.684891 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1490/2982] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:06:49 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:06:49.686370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249cd07-4c0b-4cdd-8232-30f70bac6717 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:49.707544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249cd07-4c0b-4cdd-8232-30f70bac6717 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:49.839795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9bda8-2ddf-4c8f-ae66-bc8159fab70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:49.840326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9bda8-2ddf-4c8f-ae66-bc8159fab70d admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:49.840612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9bda8-2ddf-4c8f-ae66-bc8159fab70d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:49.840890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9bda8-2ddf-4c8f-ae66-bc8159fab70d admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:49.841570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9bda8-2ddf-4c8f-ae66-bc8159fab70d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:49.849451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9bda8-2ddf-4c8f-ae66-bc8159fab70d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:49.896567 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1493/2983] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:06:49 2022] POST /identity/v3/users => generated 290 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:06:49.897624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25a8ec-9ae1-42aa-a190-9ea0287f9361 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:49.929034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25a8ec-9ae1-42aa-a190-9ea0287f9361 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:49.935112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef189c5a-d79e-4b2b-8e40-40568fc57fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:49.936220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef189c5a-d79e-4b2b-8e40-40568fc57fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:49.936667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef189c5a-d79e-4b2b-8e40-40568fc57fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:49.937109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef189c5a-d79e-4b2b-8e40-40568fc57fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:49.938279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef189c5a-d79e-4b2b-8e40-40568fc57fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:49.940322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef189c5a-d79e-4b2b-8e40-40568fc57fe3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:49.969854 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1491/2984] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:06:49.973966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9bda8-2ddf-4c8f-ae66-bc8159fab70d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:49.987167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9bda8-2ddf-4c8f-ae66-bc8159fab70d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:49.993912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca3591-603e-4a6b-9dd8-241d55b930f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:49.995309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca3591-603e-4a6b-9dd8-241d55b930f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:49.995679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca3591-603e-4a6b-9dd8-241d55b930f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:49.996027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca3591-603e-4a6b-9dd8-241d55b930f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:49.996803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca3591-603e-4a6b-9dd8-241d55b930f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:49.999632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca3591-603e-4a6b-9dd8-241d55b930f3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:50.015752 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1494/2985] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:06:50.016775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef189c5a-d79e-4b2b-8e40-40568fc57fe3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:50.032664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef189c5a-d79e-4b2b-8e40-40568fc57fe3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:50.056818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a02d96-bf7f-47ba-a618-b07163f1f8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:50.056818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a02d96-bf7f-47ba-a618-b07163f1f8c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:50.056818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a02d96-bf7f-47ba-a618-b07163f1f8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:50.056818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a02d96-bf7f-47ba-a618-b07163f1f8c8 admin admin] PATH_INFO: `/v3/projects/093aa97f9ad442ba9e9b7e7ca3937bb2/users/ebad594b0ff84e0cb36d719320979476/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:50.097174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a02d96-bf7f-47ba-a618-b07163f1f8c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=093aa97f9ad442ba9e9b7e7ca3937bb2, user_id=ebad594b0ff84e0cb36d719320979476, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:50.100156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a02d96-bf7f-47ba-a618-b07163f1f8c8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:50.118812 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1492/2986] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:06:50 2022] PUT /identity/v3/projects/093aa97f9ad442ba9e9b7e7ca3937bb2/users/ebad594b0ff84e0cb36d719320979476/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:06:50.124882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3c08d-801b-493c-9a15-92f282a43a6a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:50.125276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3c08d-801b-493c-9a15-92f282a43a6a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:50.125619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3c08d-801b-493c-9a15-92f282a43a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:50.148754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6aa3c08d-801b-493c-9a15-92f282a43a6a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:06:50.150579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6aa3c08d-801b-493c-9a15-92f282a43a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:50.284267 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1495/2987] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:06:50.301968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a02d96-bf7f-47ba-a618-b07163f1f8c8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:50.304049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d6a02d96-bf7f-47ba-a618-b07163f1f8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:50.405378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a02d96-bf7f-47ba-a618-b07163f1f8c8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:50.409195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c7f45-39ac-4fc2-b283-76279d07c2ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:50.409826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c7f45-39ac-4fc2-b283-76279d07c2ee service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:50.410117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c7f45-39ac-4fc2-b283-76279d07c2ee service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:50.410395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c7f45-39ac-4fc2-b283-76279d07c2ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:50.421152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:50.423801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c7f45-39ac-4fc2-b283-76279d07c2ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:50.425868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c7f45-39ac-4fc2-b283-76279d07c2ee service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:50.445695 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1493/2988] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:06:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:06:51.177499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3c08d-801b-493c-9a15-92f282a43a6a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:51.190383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3c08d-801b-493c-9a15-92f282a43a6a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:51.194177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bee645-dd3c-4afb-b66f-9c0367085075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:51.194934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bee645-dd3c-4afb-b66f-9c0367085075 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:51.195578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bee645-dd3c-4afb-b66f-9c0367085075 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:51.196485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bee645-dd3c-4afb-b66f-9c0367085075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:51.199186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-70bee645-dd3c-4afb-b66f-9c0367085075 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:51.213192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bee645-dd3c-4afb-b66f-9c0367085075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:51.214755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bee645-dd3c-4afb-b66f-9c0367085075 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:51.225335 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1496/2989] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:06:51.431510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec75bf-5048-48a7-9e12-3389917216e0 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:51.433515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec75bf-5048-48a7-9e12-3389917216e0 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:51.433999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec75bf-5048-48a7-9e12-3389917216e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:51.476033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-04ec75bf-5048-48a7-9e12-3389917216e0 None None] MFA Rules not processed for user `d20ab89ea13c4611904cec244d37ba25`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:06:51.477378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-04ec75bf-5048-48a7-9e12-3389917216e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:51.604431 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1494/2990] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:06:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:06:54.988464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bee645-dd3c-4afb-b66f-9c0367085075 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:55.004177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bee645-dd3c-4afb-b66f-9c0367085075 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:55.017695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d2890-f42c-4e6b-a59d-7d45a297a5ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:55.019082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d2890-f42c-4e6b-a59d-7d45a297a5ab service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:55.019410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d2890-f42c-4e6b-a59d-7d45a297a5ab service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:55.019699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d2890-f42c-4e6b-a59d-7d45a297a5ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:55.026234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-945d2890-f42c-4e6b-a59d-7d45a297a5ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:55.055667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d2890-f42c-4e6b-a59d-7d45a297a5ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:55.057299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d2890-f42c-4e6b-a59d-7d45a297a5ab service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:55.074242 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1497/2991] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:06:58.605030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc01dd-986b-4c67-a0a4-2e4db827e7c5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:58.605887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc01dd-986b-4c67-a0a4-2e4db827e7c5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:58.606356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc01dd-986b-4c67-a0a4-2e4db827e7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:58.637281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-23cc01dd-986b-4c67-a0a4-2e4db827e7c5 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:06:58.644883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-23cc01dd-986b-4c67-a0a4-2e4db827e7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:58.800205 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1495/2992] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:06:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:06:58.818152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d2890-f42c-4e6b-a59d-7d45a297a5ab service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:58.819908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-945d2890-f42c-4e6b-a59d-7d45a297a5ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:58.918832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:59.011088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d2890-f42c-4e6b-a59d-7d45a297a5ab service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:59.021220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291f703-487b-4492-8cae-a39d11566a55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:59.022074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291f703-487b-4492-8cae-a39d11566a55 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:59.022517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291f703-487b-4492-8cae-a39d11566a55 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:59.023058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291f703-487b-4492-8cae-a39d11566a55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:59.035981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291f703-487b-4492-8cae-a39d11566a55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:59.037822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291f703-487b-4492-8cae-a39d11566a55 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:59.065849 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1498/2993] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:06:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:06:59.725181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80e46a-a125-4cd6-a765-655c86f23dd2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:59.725181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80e46a-a125-4cd6-a765-655c86f23dd2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:59.725857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80e46a-a125-4cd6-a765-655c86f23dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:59.765361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ff80e46a-a125-4cd6-a765-655c86f23dd2 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:06:59.767172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ff80e46a-a125-4cd6-a765-655c86f23dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:06:59.789281 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1496/2994] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:06:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:06:59.802576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291f703-487b-4492-8cae-a39d11566a55 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:06:59.818982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291f703-487b-4492-8cae-a39d11566a55 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:06:59.830255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71d741-1605-476e-b989-42cb1ee6b580 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:06:59.832072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71d741-1605-476e-b989-42cb1ee6b580 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:06:59.832616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71d741-1605-476e-b989-42cb1ee6b580 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:06:59.833264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71d741-1605-476e-b989-42cb1ee6b580 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:06:59.846865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71d741-1605-476e-b989-42cb1ee6b580 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:06:59.849815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71d741-1605-476e-b989-42cb1ee6b580 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:06:59.860983 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1499/2995] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:06:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:07:00.282756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18eab32-d35e-47bd-a2e3-dc85fad4e977 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:00.283052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18eab32-d35e-47bd-a2e3-dc85fad4e977 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:00.283363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18eab32-d35e-47bd-a2e3-dc85fad4e977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:00.323140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c18eab32-d35e-47bd-a2e3-dc85fad4e977 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:00.324730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c18eab32-d35e-47bd-a2e3-dc85fad4e977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:00.361622 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1497/2996] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:07:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:00.376879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71d741-1605-476e-b989-42cb1ee6b580 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:00.389212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71d741-1605-476e-b989-42cb1ee6b580 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:00.412941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ee3bb-0337-46f6-ba18-13d83b457e78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:00.414088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ee3bb-0337-46f6-ba18-13d83b457e78 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:00.414606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ee3bb-0337-46f6-ba18-13d83b457e78 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:00.415203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ee3bb-0337-46f6-ba18-13d83b457e78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:00.434155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ee3bb-0337-46f6-ba18-13d83b457e78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:00.436191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ee3bb-0337-46f6-ba18-13d83b457e78 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:00.458735 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1500/2997] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:07:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:07:00.676479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18eab32-d35e-47bd-a2e3-dc85fad4e977 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:00.679782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c18eab32-d35e-47bd-a2e3-dc85fad4e977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:00.714908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18eab32-d35e-47bd-a2e3-dc85fad4e977 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:00.723230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea1f06-fd2a-4841-9d2a-238395fc8149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:00.724214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea1f06-fd2a-4841-9d2a-238395fc8149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:00.726250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea1f06-fd2a-4841-9d2a-238395fc8149 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:00.727162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea1f06-fd2a-4841-9d2a-238395fc8149 admin admin] PATH_INFO: `/v3/users/c8c95b7c11b24f13a2a7148a087d590e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:00.736242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea1f06-fd2a-4841-9d2a-238395fc8149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8c95b7c11b24f13a2a7148a087d590e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:00.738584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea1f06-fd2a-4841-9d2a-238395fc8149 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:00.840303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d5ea1f06-fd2a-4841-9d2a-238395fc8149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8c95b7c11b24f13a2a7148a087d590e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:00.861706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d5ea1f06-fd2a-4841-9d2a-238395fc8149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8c95b7c11b24f13a2a7148a087d590e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:00.862758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d5ea1f06-fd2a-4841-9d2a-238395fc8149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8c95b7c11b24f13a2a7148a087d590e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:00.879281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d5ea1f06-fd2a-4841-9d2a-238395fc8149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8c95b7c11b24f13a2a7148a087d590e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:00.880358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d5ea1f06-fd2a-4841-9d2a-238395fc8149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8c95b7c11b24f13a2a7148a087d590e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:00.908454 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1498/2998] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:00 2022] DELETE /identity/v3/users/c8c95b7c11b24f13a2a7148a087d590e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:00.914223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3cd79-6982-48b8-a8bb-d3d28ecb310e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:00.914793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3cd79-6982-48b8-a8bb-d3d28ecb310e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:00.915410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3cd79-6982-48b8-a8bb-d3d28ecb310e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:00.976825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fcd3cd79-6982-48b8-a8bb-d3d28ecb310e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:00.982575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fcd3cd79-6982-48b8-a8bb-d3d28ecb310e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:01.148802 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1501/2999] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:01.211571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea1f06-fd2a-4841-9d2a-238395fc8149 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:01.219942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d5ea1f06-fd2a-4841-9d2a-238395fc8149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:01.226606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:01.354260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea1f06-fd2a-4841-9d2a-238395fc8149 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:01.367360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9543de-1054-433b-92f2-2567d78ba29f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:01.368038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9543de-1054-433b-92f2-2567d78ba29f service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:01.368329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9543de-1054-433b-92f2-2567d78ba29f service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:01.368616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9543de-1054-433b-92f2-2567d78ba29f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:01.383116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9543de-1054-433b-92f2-2567d78ba29f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:01.385205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9543de-1054-433b-92f2-2567d78ba29f service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:01.396938 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1499/3000] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:02.510026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3cd79-6982-48b8-a8bb-d3d28ecb310e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:02.511533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fcd3cd79-6982-48b8-a8bb-d3d28ecb310e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:02.526198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3cd79-6982-48b8-a8bb-d3d28ecb310e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:02.532987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a9e1d-d7ec-4c6e-a1b6-022c51e6cd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:02.542421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a9e1d-d7ec-4c6e-a1b6-022c51e6cd0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:02.542707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a9e1d-d7ec-4c6e-a1b6-022c51e6cd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:02.543299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a9e1d-d7ec-4c6e-a1b6-022c51e6cd0c admin admin] PATH_INFO: `/v3/projects/3b49b328c44040f0b5ae9b929e137b55` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:02.548210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a9e1d-d7ec-4c6e-a1b6-022c51e6cd0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b49b328c44040f0b5ae9b929e137b55)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:02.552331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a9e1d-d7ec-4c6e-a1b6-022c51e6cd0c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:02.647774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cf8a9e1d-d7ec-4c6e-a1b6-022c51e6cd0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b49b328c44040f0b5ae9b929e137b55', 'request_id': 'req-cf8a9e1d-d7ec-4c6e-a1b6-022c51e6cd0c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:02.657464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cf8a9e1d-d7ec-4c6e-a1b6-022c51e6cd0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b49b328c44040f0b5ae9b929e137b55', 'request_id': 'req-cf8a9e1d-d7ec-4c6e-a1b6-022c51e6cd0c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:02.666658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cf8a9e1d-d7ec-4c6e-a1b6-022c51e6cd0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b49b328c44040f0b5ae9b929e137b55', 'request_id': 'req-cf8a9e1d-d7ec-4c6e-a1b6-022c51e6cd0c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:02.683206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cf8a9e1d-d7ec-4c6e-a1b6-022c51e6cd0c admin admin] The token cache is being invalidate because project 3b49b328c44040f0b5ae9b929e137b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:02.683206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cf8a9e1d-d7ec-4c6e-a1b6-022c51e6cd0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:02.689474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cf8a9e1d-d7ec-4c6e-a1b6-022c51e6cd0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:02.695777 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1502/3001] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:02 2022] DELETE /identity/v3/projects/3b49b328c44040f0b5ae9b929e137b55 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:02.701268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566041d-bf59-4b12-93cc-c2d4fff85afc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:02.701796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566041d-bf59-4b12-93cc-c2d4fff85afc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:02.701906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566041d-bf59-4b12-93cc-c2d4fff85afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:02.724616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4566041d-bf59-4b12-93cc-c2d4fff85afc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:02.726320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4566041d-bf59-4b12-93cc-c2d4fff85afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:02.816511 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1500/3002] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:02.832190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed864a7-8533-42d9-a540-4867403aa91d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:02.832637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed864a7-8533-42d9-a540-4867403aa91d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:02.832926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed864a7-8533-42d9-a540-4867403aa91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:02.861691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-eed864a7-8533-42d9-a540-4867403aa91d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:02.868688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-eed864a7-8533-42d9-a540-4867403aa91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:02.888445 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1503/3003] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:02.890160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566041d-bf59-4b12-93cc-c2d4fff85afc None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:02.908981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566041d-bf59-4b12-93cc-c2d4fff85afc None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:02.920632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe96b5f-bf54-4d50-b7aa-3f2694d75c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:02.921665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe96b5f-bf54-4d50-b7aa-3f2694d75c0e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:02.922116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe96b5f-bf54-4d50-b7aa-3f2694d75c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:02.922559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe96b5f-bf54-4d50-b7aa-3f2694d75c0e admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:02.923521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe96b5f-bf54-4d50-b7aa-3f2694d75c0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:07:02.924018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe96b5f-bf54-4d50-b7aa-3f2694d75c0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:02.934252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe96b5f-bf54-4d50-b7aa-3f2694d75c0e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:02.951910 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1501/3004] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:02.956139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed864a7-8533-42d9-a540-4867403aa91d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:02.967833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed864a7-8533-42d9-a540-4867403aa91d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:02.973134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd11199-8a53-4c96-9237-ce243789af3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:02.974195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd11199-8a53-4c96-9237-ce243789af3d admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:02.975229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd11199-8a53-4c96-9237-ce243789af3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:02.977089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd11199-8a53-4c96-9237-ce243789af3d admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:02.978010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd11199-8a53-4c96-9237-ce243789af3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:02.984163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd11199-8a53-4c96-9237-ce243789af3d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:03.001578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:03.046752 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1504/3005] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:07:02 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:03.050865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe96b5f-bf54-4d50-b7aa-3f2694d75c0e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:03.070880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe96b5f-bf54-4d50-b7aa-3f2694d75c0e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:03.236096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d476850-a98c-46b0-8ff5-3b03dc9524ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:03.236755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d476850-a98c-46b0-8ff5-3b03dc9524ef admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:03.237047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d476850-a98c-46b0-8ff5-3b03dc9524ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:03.237326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d476850-a98c-46b0-8ff5-3b03dc9524ef admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:03.240237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d476850-a98c-46b0-8ff5-3b03dc9524ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:03.245661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d476850-a98c-46b0-8ff5-3b03dc9524ef admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:03.299259 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1502/3006] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:07:03 2022] POST /identity/v3/users => generated 286 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:03.306702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd11199-8a53-4c96-9237-ce243789af3d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:03.323200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd11199-8a53-4c96-9237-ce243789af3d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:03.328891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296bf95-a9e5-4141-8477-f7c4477a536f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:03.329534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296bf95-a9e5-4141-8477-f7c4477a536f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:03.329882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296bf95-a9e5-4141-8477-f7c4477a536f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:03.330089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296bf95-a9e5-4141-8477-f7c4477a536f admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:03.346133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296bf95-a9e5-4141-8477-f7c4477a536f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:03.348024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296bf95-a9e5-4141-8477-f7c4477a536f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:03.365148 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1505/3007] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:03.366357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d476850-a98c-46b0-8ff5-3b03dc9524ef admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:03.405591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d476850-a98c-46b0-8ff5-3b03dc9524ef admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:03.414640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86f902-148e-4ad1-af85-909631ffaf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:03.415301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86f902-148e-4ad1-af85-909631ffaf08 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:03.415671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86f902-148e-4ad1-af85-909631ffaf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:03.415960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86f902-148e-4ad1-af85-909631ffaf08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:03.416805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86f902-148e-4ad1-af85-909631ffaf08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:03.418511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86f902-148e-4ad1-af85-909631ffaf08 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:03.467869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296bf95-a9e5-4141-8477-f7c4477a536f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:03.468481 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1503/3008] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:03.489717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296bf95-a9e5-4141-8477-f7c4477a536f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:03.497849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5fa8d-0cc9-4c0c-bdb5-8c8be129d512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:03.498963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5fa8d-0cc9-4c0c-bdb5-8c8be129d512 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:03.500082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5fa8d-0cc9-4c0c-bdb5-8c8be129d512 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:03.500535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5fa8d-0cc9-4c0c-bdb5-8c8be129d512 admin admin] PATH_INFO: `/v3/projects/7b09f316bee54e09aa9c747e347cb71a/users/922b0134ec3644018b1ae5e2d7376639/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:03.554711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5fa8d-0cc9-4c0c-bdb5-8c8be129d512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b09f316bee54e09aa9c747e347cb71a, user_id=922b0134ec3644018b1ae5e2d7376639, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:03.558476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5fa8d-0cc9-4c0c-bdb5-8c8be129d512 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:03.593155 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1506/3009] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:03 2022] PUT /identity/v3/projects/7b09f316bee54e09aa9c747e347cb71a/users/922b0134ec3644018b1ae5e2d7376639/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:07:03.604639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a0a8-2e73-495e-ac7d-6f56456edca6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:03.604944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a0a8-2e73-495e-ac7d-6f56456edca6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:03.605232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a0a8-2e73-495e-ac7d-6f56456edca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:03.643040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:03.666321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2b96a0a8-2e73-495e-ac7d-6f56456edca6 None None] MFA Rules not processed for user `922b0134ec3644018b1ae5e2d7376639`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:03.667799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2b96a0a8-2e73-495e-ac7d-6f56456edca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:03.790406 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1504/3010] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:04.012480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5fa8d-0cc9-4c0c-bdb5-8c8be129d512 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:04.016685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fef5fa8d-0cc9-4c0c-bdb5-8c8be129d512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:04.196575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5fa8d-0cc9-4c0c-bdb5-8c8be129d512 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:04.204643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351ce21-1147-4d31-986b-1f477f01b35e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:04.205629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351ce21-1147-4d31-986b-1f477f01b35e service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:04.206079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351ce21-1147-4d31-986b-1f477f01b35e service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:04.206560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351ce21-1147-4d31-986b-1f477f01b35e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:04.227008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351ce21-1147-4d31-986b-1f477f01b35e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:04.230850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351ce21-1147-4d31-986b-1f477f01b35e service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:04.260011 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1507/3011] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:06.062866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96a0a8-2e73-495e-ac7d-6f56456edca6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:06.202213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96a0a8-2e73-495e-ac7d-6f56456edca6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:06.208950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00da1bf-f674-47fa-86bd-f30363be894b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:06.212169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00da1bf-f674-47fa-86bd-f30363be894b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:06.213283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00da1bf-f674-47fa-86bd-f30363be894b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:06.213985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00da1bf-f674-47fa-86bd-f30363be894b admin admin] PATH_INFO: `/v3/users/922b0134ec3644018b1ae5e2d7376639` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:06.215544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00da1bf-f674-47fa-86bd-f30363be894b admin admin] RBAC: Authorizing `identity:delete_user(user_id=922b0134ec3644018b1ae5e2d7376639)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:06.217979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00da1bf-f674-47fa-86bd-f30363be894b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:06.351875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e00da1bf-f674-47fa-86bd-f30363be894b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '922b0134ec3644018b1ae5e2d7376639'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:06.402136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e00da1bf-f674-47fa-86bd-f30363be894b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '922b0134ec3644018b1ae5e2d7376639'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:06.406826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e00da1bf-f674-47fa-86bd-f30363be894b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '922b0134ec3644018b1ae5e2d7376639'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:06.424043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e00da1bf-f674-47fa-86bd-f30363be894b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '922b0134ec3644018b1ae5e2d7376639'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:06.424808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e00da1bf-f674-47fa-86bd-f30363be894b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '922b0134ec3644018b1ae5e2d7376639'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:06.475095 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1505/3012] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:06 2022] DELETE /identity/v3/users/922b0134ec3644018b1ae5e2d7376639 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:06.480133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d72075-f3f4-4116-b586-5e1278262b10 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:06.480601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d72075-f3f4-4116-b586-5e1278262b10 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:06.480727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d72075-f3f4-4116-b586-5e1278262b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:06.523173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e4d72075-f3f4-4116-b586-5e1278262b10 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:06.527580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e4d72075-f3f4-4116-b586-5e1278262b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:06.666201 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1508/3013] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:07:06.710817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00da1bf-f674-47fa-86bd-f30363be894b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:06.714454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e00da1bf-f674-47fa-86bd-f30363be894b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:06.751576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:06.809567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00da1bf-f674-47fa-86bd-f30363be894b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:06.813335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6d933-f4dc-4240-be3b-ea568dca3609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:06.813966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6d933-f4dc-4240-be3b-ea568dca3609 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:06.814249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6d933-f4dc-4240-be3b-ea568dca3609 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:06.814525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6d933-f4dc-4240-be3b-ea568dca3609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:06.826128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6d933-f4dc-4240-be3b-ea568dca3609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:06.827281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6d933-f4dc-4240-be3b-ea568dca3609 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:06.840883 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1506/3014] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:06.951778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d703ff4-541f-492b-a389-8300c9b1dd98 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:06.951908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d703ff4-541f-492b-a389-8300c9b1dd98 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:06.952148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d703ff4-541f-492b-a389-8300c9b1dd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:07.027789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3d703ff4-541f-492b-a389-8300c9b1dd98 None None] MFA Rules not processed for user `ebad594b0ff84e0cb36d719320979476`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:07.035647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3d703ff4-541f-492b-a389-8300c9b1dd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:07.105693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:07.197149 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1509/3015] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:07.206828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72415619-8634-4cf4-855a-fc14e9cc67a8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:07.207857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72415619-8634-4cf4-855a-fc14e9cc67a8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:07.208303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72415619-8634-4cf4-855a-fc14e9cc67a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:07.231534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-72415619-8634-4cf4-855a-fc14e9cc67a8 None None] MFA Rules not processed for user `ebad594b0ff84e0cb36d719320979476`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:07.233202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-72415619-8634-4cf4-855a-fc14e9cc67a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:07.246698 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1507/3016] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:07.254303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d703ff4-541f-492b-a389-8300c9b1dd98 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:07.255699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3d703ff4-541f-492b-a389-8300c9b1dd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:07.347842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d703ff4-541f-492b-a389-8300c9b1dd98 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:07.354796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29101351-2ce1-424b-a310-eb24c4f97e92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:07.355473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29101351-2ce1-424b-a310-eb24c4f97e92 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:07.355759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29101351-2ce1-424b-a310-eb24c4f97e92 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:07.356035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29101351-2ce1-424b-a310-eb24c4f97e92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:07.366008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29101351-2ce1-424b-a310-eb24c4f97e92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:07.367847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29101351-2ce1-424b-a310-eb24c4f97e92 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:07.422583 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1510/3017] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:09.128727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72415619-8634-4cf4-855a-fc14e9cc67a8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:09.130213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-72415619-8634-4cf4-855a-fc14e9cc67a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:09.168438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72415619-8634-4cf4-855a-fc14e9cc67a8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:09.190575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1344275-7915-4e15-965f-476662eb89c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:09.191619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1344275-7915-4e15-965f-476662eb89c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:09.192104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1344275-7915-4e15-965f-476662eb89c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:09.193014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1344275-7915-4e15-965f-476662eb89c8 admin admin] PATH_INFO: `/v3/users/f820053bb2d942fd968b7129b2faae47` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:09.198112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1344275-7915-4e15-965f-476662eb89c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f820053bb2d942fd968b7129b2faae47)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:09.203671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1344275-7915-4e15-965f-476662eb89c8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:09.320286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f1344275-7915-4e15-965f-476662eb89c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f820053bb2d942fd968b7129b2faae47'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:09.344833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f1344275-7915-4e15-965f-476662eb89c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f820053bb2d942fd968b7129b2faae47'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:09.349186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f1344275-7915-4e15-965f-476662eb89c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f820053bb2d942fd968b7129b2faae47'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:09.381739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f1344275-7915-4e15-965f-476662eb89c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f820053bb2d942fd968b7129b2faae47'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:09.383602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f1344275-7915-4e15-965f-476662eb89c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f820053bb2d942fd968b7129b2faae47'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:09.422562 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1508/3018] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:09 2022] DELETE /identity/v3/users/f820053bb2d942fd968b7129b2faae47 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:09.426962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1e854-5f0e-436d-b8db-b65c2c5b3b8b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:09.429019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1e854-5f0e-436d-b8db-b65c2c5b3b8b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:09.429524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1e854-5f0e-436d-b8db-b65c2c5b3b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:09.482739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b6d1e854-5f0e-436d-b8db-b65c2c5b3b8b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:09.487355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b6d1e854-5f0e-436d-b8db-b65c2c5b3b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:09.680199 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1511/3019] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:09.704055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1344275-7915-4e15-965f-476662eb89c8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:09.705870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f1344275-7915-4e15-965f-476662eb89c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:09.736072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1e854-5f0e-436d-b8db-b65c2c5b3b8b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:09.737870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b6d1e854-5f0e-436d-b8db-b65c2c5b3b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:09.756995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1e854-5f0e-436d-b8db-b65c2c5b3b8b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:09.830583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1487b7e-f0a6-4da6-92d1-9acd9f0b8436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:09.839884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1487b7e-f0a6-4da6-92d1-9acd9f0b8436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:09.840391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1487b7e-f0a6-4da6-92d1-9acd9f0b8436 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:09.844749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1487b7e-f0a6-4da6-92d1-9acd9f0b8436 admin admin] PATH_INFO: `/v3/projects/7b09f316bee54e09aa9c747e347cb71a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:09.848995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1487b7e-f0a6-4da6-92d1-9acd9f0b8436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b09f316bee54e09aa9c747e347cb71a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:09.865695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1487b7e-f0a6-4da6-92d1-9acd9f0b8436 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:09.969407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1344275-7915-4e15-965f-476662eb89c8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:09.989105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b1368-3e12-412c-a2fd-f00cfc598228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:09.990419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b1368-3e12-412c-a2fd-f00cfc598228 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:09.992532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b1368-3e12-412c-a2fd-f00cfc598228 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:09.993036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b1368-3e12-412c-a2fd-f00cfc598228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:10.009215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b1368-3e12-412c-a2fd-f00cfc598228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:10.016832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b1368-3e12-412c-a2fd-f00cfc598228 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:10.046552 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1509/3020] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:10.069697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e1487b7e-f0a6-4da6-92d1-9acd9f0b8436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b09f316bee54e09aa9c747e347cb71a', 'request_id': 'req-e1487b7e-f0a6-4da6-92d1-9acd9f0b8436'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:10.071760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:10.086978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e1487b7e-f0a6-4da6-92d1-9acd9f0b8436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b09f316bee54e09aa9c747e347cb71a', 'request_id': 'req-e1487b7e-f0a6-4da6-92d1-9acd9f0b8436'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:10.121842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e1487b7e-f0a6-4da6-92d1-9acd9f0b8436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b09f316bee54e09aa9c747e347cb71a', 'request_id': 'req-e1487b7e-f0a6-4da6-92d1-9acd9f0b8436'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:10.167278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e1487b7e-f0a6-4da6-92d1-9acd9f0b8436 admin admin] The token cache is being invalidate because project 7b09f316bee54e09aa9c747e347cb71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:10.167633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e1487b7e-f0a6-4da6-92d1-9acd9f0b8436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:10.169025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e1487b7e-f0a6-4da6-92d1-9acd9f0b8436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:10.177444 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1512/3021] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:09 2022] DELETE /identity/v3/projects/7b09f316bee54e09aa9c747e347cb71a => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:07:10.179189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c64244-0776-411c-ab87-b7ed76bdaefe None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:10.179595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c64244-0776-411c-ab87-b7ed76bdaefe None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:10.179595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c64244-0776-411c-ab87-b7ed76bdaefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:10.220681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-65c64244-0776-411c-ab87-b7ed76bdaefe None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:10.222274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-65c64244-0776-411c-ab87-b7ed76bdaefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:10.262529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:10.353329 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1510/3022] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:10.361477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df69e5-54e9-4c46-8e24-41481f524940 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:10.361768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df69e5-54e9-4c46-8e24-41481f524940 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:10.362051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df69e5-54e9-4c46-8e24-41481f524940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:10.411039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-82df69e5-54e9-4c46-8e24-41481f524940 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:10.423105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-82df69e5-54e9-4c46-8e24-41481f524940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:10.476166 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1513/3023] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:10.476902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c64244-0776-411c-ab87-b7ed76bdaefe None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:10.495337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c64244-0776-411c-ab87-b7ed76bdaefe None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:10.513529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d949bec-e5ef-4dfa-91ab-65eec2eaf106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:10.514178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949bec-e5ef-4dfa-91ab-65eec2eaf106 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:10.514469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949bec-e5ef-4dfa-91ab-65eec2eaf106 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:10.514751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949bec-e5ef-4dfa-91ab-65eec2eaf106 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:10.515504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d949bec-e5ef-4dfa-91ab-65eec2eaf106 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:07:10.515815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d949bec-e5ef-4dfa-91ab-65eec2eaf106 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:10.528458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d949bec-e5ef-4dfa-91ab-65eec2eaf106 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:10.567980 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1511/3024] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:07:10.573486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df69e5-54e9-4c46-8e24-41481f524940 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:10.584508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df69e5-54e9-4c46-8e24-41481f524940 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:10.600491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecbbc7-c00c-42f0-8d11-c12bf462f997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:10.601132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecbbc7-c00c-42f0-8d11-c12bf462f997 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:10.601595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecbbc7-c00c-42f0-8d11-c12bf462f997 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:10.602018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecbbc7-c00c-42f0-8d11-c12bf462f997 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:10.602864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecbbc7-c00c-42f0-8d11-c12bf462f997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:10.606571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecbbc7-c00c-42f0-8d11-c12bf462f997 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:10.689910 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1514/3025] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:07:10 2022] POST /identity/v3/projects => generated 361 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:10.694431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d949bec-e5ef-4dfa-91ab-65eec2eaf106 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:10.710112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d949bec-e5ef-4dfa-91ab-65eec2eaf106 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:10.870882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275acf0b-b353-442f-8588-7c09b0cc86fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:10.871820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275acf0b-b353-442f-8588-7c09b0cc86fd admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:10.872174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275acf0b-b353-442f-8588-7c09b0cc86fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:10.872947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275acf0b-b353-442f-8588-7c09b0cc86fd admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:10.873635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275acf0b-b353-442f-8588-7c09b0cc86fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:10.876004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275acf0b-b353-442f-8588-7c09b0cc86fd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:10.918121 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1512/3026] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:07:10 2022] POST /identity/v3/users => generated 281 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:10.922455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecbbc7-c00c-42f0-8d11-c12bf462f997 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:10.937649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecbbc7-c00c-42f0-8d11-c12bf462f997 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:10.958395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a12df2-703b-4a1c-a58d-06be7f575e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:10.959201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a12df2-703b-4a1c-a58d-06be7f575e42 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:10.959713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a12df2-703b-4a1c-a58d-06be7f575e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:10.960181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a12df2-703b-4a1c-a58d-06be7f575e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:10.961063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a12df2-703b-4a1c-a58d-06be7f575e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:10.963551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a12df2-703b-4a1c-a58d-06be7f575e42 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:10.996669 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1515/3027] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:11.000537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275acf0b-b353-442f-8588-7c09b0cc86fd admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:11.022332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275acf0b-b353-442f-8588-7c09b0cc86fd admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:11.043783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff8be7-1f67-4c46-a44e-2b0bf34f6cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:11.044445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff8be7-1f67-4c46-a44e-2b0bf34f6cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:11.044732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff8be7-1f67-4c46-a44e-2b0bf34f6cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:11.045011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff8be7-1f67-4c46-a44e-2b0bf34f6cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:11.045724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff8be7-1f67-4c46-a44e-2b0bf34f6cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:11.054016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff8be7-1f67-4c46-a44e-2b0bf34f6cb1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:11.087241 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1513/3028] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:11.092097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a12df2-703b-4a1c-a58d-06be7f575e42 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:11.124290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a12df2-703b-4a1c-a58d-06be7f575e42 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:11.142272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc228a-50c1-4b5a-b5ec-147973782630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:11.142968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc228a-50c1-4b5a-b5ec-147973782630 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:11.143252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc228a-50c1-4b5a-b5ec-147973782630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:11.143553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc228a-50c1-4b5a-b5ec-147973782630 admin admin] PATH_INFO: `/v3/projects/14de6219ca7b42798547929c6cc778d5/users/5d3419af79754ebe9c256c9ef3ccab2c/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:11.185746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc228a-50c1-4b5a-b5ec-147973782630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14de6219ca7b42798547929c6cc778d5, user_id=5d3419af79754ebe9c256c9ef3ccab2c, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:11.188844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc228a-50c1-4b5a-b5ec-147973782630 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:11.227495 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1516/3029] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:11 2022] PUT /identity/v3/projects/14de6219ca7b42798547929c6cc778d5/users/5d3419af79754ebe9c256c9ef3ccab2c/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:11.238526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330382a-f715-4b5f-a5f5-4585a559a0fe None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:11.239122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330382a-f715-4b5f-a5f5-4585a559a0fe None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:11.239122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330382a-f715-4b5f-a5f5-4585a559a0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:11.327772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4330382a-f715-4b5f-a5f5-4585a559a0fe None None] MFA Rules not processed for user `5d3419af79754ebe9c256c9ef3ccab2c`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:11.329239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4330382a-f715-4b5f-a5f5-4585a559a0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:11.403250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc228a-50c1-4b5a-b5ec-147973782630 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:11.404883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e8fc228a-50c1-4b5a-b5ec-147973782630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:11.469827 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1514/3030] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:11.558532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc228a-50c1-4b5a-b5ec-147973782630 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:11.573237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097f056-81fa-4098-afc2-001e5e89ad45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:11.574214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097f056-81fa-4098-afc2-001e5e89ad45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:11.574717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097f056-81fa-4098-afc2-001e5e89ad45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:11.575198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097f056-81fa-4098-afc2-001e5e89ad45 admin admin] PATH_INFO: `/v3/projects/ebe60ae219554ca1839242aa20d2bda7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:11.582135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097f056-81fa-4098-afc2-001e5e89ad45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebe60ae219554ca1839242aa20d2bda7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:11.584332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097f056-81fa-4098-afc2-001e5e89ad45 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:11.699504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2097f056-81fa-4098-afc2-001e5e89ad45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebe60ae219554ca1839242aa20d2bda7', 'request_id': 'req-2097f056-81fa-4098-afc2-001e5e89ad45'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:11.714109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2097f056-81fa-4098-afc2-001e5e89ad45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebe60ae219554ca1839242aa20d2bda7', 'request_id': 'req-2097f056-81fa-4098-afc2-001e5e89ad45'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:11.723497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2097f056-81fa-4098-afc2-001e5e89ad45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebe60ae219554ca1839242aa20d2bda7', 'request_id': 'req-2097f056-81fa-4098-afc2-001e5e89ad45'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:11.801817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330382a-f715-4b5f-a5f5-4585a559a0fe None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:11.803274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4330382a-f715-4b5f-a5f5-4585a559a0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:11.808726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2097f056-81fa-4098-afc2-001e5e89ad45 admin admin] The token cache is being invalidate because project ebe60ae219554ca1839242aa20d2bda7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:11.808890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2097f056-81fa-4098-afc2-001e5e89ad45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:11.817827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2097f056-81fa-4098-afc2-001e5e89ad45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:11.832694 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1517/3031] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:11 2022] DELETE /identity/v3/projects/ebe60ae219554ca1839242aa20d2bda7 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:07:11.837132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097f056-81fa-4098-afc2-001e5e89ad45 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:11.841477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2097f056-81fa-4098-afc2-001e5e89ad45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:11.852320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:11.904199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:12.040277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330382a-f715-4b5f-a5f5-4585a559a0fe None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:12.043863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097f056-81fa-4098-afc2-001e5e89ad45 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:12.057897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dee9b0-11e7-445a-8ce8-b955793b7528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:12.058713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dee9b0-11e7-445a-8ce8-b955793b7528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:12.059003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dee9b0-11e7-445a-8ce8-b955793b7528 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:12.059277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dee9b0-11e7-445a-8ce8-b955793b7528 admin admin] PATH_INFO: `/v3/users/8f71a7b16f8b4e1fa3b08b96c1705327` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:12.061812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dee9b0-11e7-445a-8ce8-b955793b7528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f71a7b16f8b4e1fa3b08b96c1705327)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:12.064029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dee9b0-11e7-445a-8ce8-b955793b7528 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:12.130913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-41dee9b0-11e7-445a-8ce8-b955793b7528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f71a7b16f8b4e1fa3b08b96c1705327'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:12.132924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-41dee9b0-11e7-445a-8ce8-b955793b7528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f71a7b16f8b4e1fa3b08b96c1705327'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:12.148783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-41dee9b0-11e7-445a-8ce8-b955793b7528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f71a7b16f8b4e1fa3b08b96c1705327'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:12.149593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-41dee9b0-11e7-445a-8ce8-b955793b7528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f71a7b16f8b4e1fa3b08b96c1705327'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:12.151191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c19f20-263f-46df-b4ac-d93a619f8968 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:12.154488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c19f20-263f-46df-b4ac-d93a619f8968 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:12.154994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c19f20-263f-46df-b4ac-d93a619f8968 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:12.155492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c19f20-263f-46df-b4ac-d93a619f8968 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:12.159163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-42c19f20-263f-46df-b4ac-d93a619f8968 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:12.161345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-41dee9b0-11e7-445a-8ce8-b955793b7528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f71a7b16f8b4e1fa3b08b96c1705327'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:12.181919 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1518/3032] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:11 2022] DELETE /identity/v3/users/8f71a7b16f8b4e1fa3b08b96c1705327 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:12.242352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c19f20-263f-46df-b4ac-d93a619f8968 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:12.245047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c19f20-263f-46df-b4ac-d93a619f8968 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:12.271389 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1515/3033] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:12.326649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dee9b0-11e7-445a-8ce8-b955793b7528 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:12.328261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-41dee9b0-11e7-445a-8ce8-b955793b7528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:12.434067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dee9b0-11e7-445a-8ce8-b955793b7528 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:12.440906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1b364-5e3f-4f48-8a7d-0dabe9e38700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:12.441645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1b364-5e3f-4f48-8a7d-0dabe9e38700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:12.442113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1b364-5e3f-4f48-8a7d-0dabe9e38700 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:12.442404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1b364-5e3f-4f48-8a7d-0dabe9e38700 admin admin] PATH_INFO: `/v3/users/5d3419af79754ebe9c256c9ef3ccab2c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:12.444119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1b364-5e3f-4f48-8a7d-0dabe9e38700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d3419af79754ebe9c256c9ef3ccab2c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:12.455497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1b364-5e3f-4f48-8a7d-0dabe9e38700 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:12.511642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:12.550180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-42d1b364-5e3f-4f48-8a7d-0dabe9e38700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d3419af79754ebe9c256c9ef3ccab2c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:12.550774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-42d1b364-5e3f-4f48-8a7d-0dabe9e38700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d3419af79754ebe9c256c9ef3ccab2c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:12.585262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-42d1b364-5e3f-4f48-8a7d-0dabe9e38700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d3419af79754ebe9c256c9ef3ccab2c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:12.586281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-42d1b364-5e3f-4f48-8a7d-0dabe9e38700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d3419af79754ebe9c256c9ef3ccab2c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:12.600427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-42d1b364-5e3f-4f48-8a7d-0dabe9e38700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d3419af79754ebe9c256c9ef3ccab2c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:12.628356 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1519/3034] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:12 2022] DELETE /identity/v3/users/5d3419af79754ebe9c256c9ef3ccab2c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:12.629744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1d894-4148-41dd-ba38-01ce6344f9d0 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:12.630081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1d894-4148-41dd-ba38-01ce6344f9d0 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:12.630363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1d894-4148-41dd-ba38-01ce6344f9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:12.654347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a6d1d894-4148-41dd-ba38-01ce6344f9d0 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:12.656484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a6d1d894-4148-41dd-ba38-01ce6344f9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:12.791559 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1516/3035] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:12.809446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1b364-5e3f-4f48-8a7d-0dabe9e38700 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:12.812363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-42d1b364-5e3f-4f48-8a7d-0dabe9e38700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:12.903541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1d894-4148-41dd-ba38-01ce6344f9d0 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:12.908632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a6d1d894-4148-41dd-ba38-01ce6344f9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:12.911354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:12.932591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1d894-4148-41dd-ba38-01ce6344f9d0 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:12.962287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80d984-4877-43b0-9473-05e36d01219d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:12.966368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80d984-4877-43b0-9473-05e36d01219d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:12.966666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80d984-4877-43b0-9473-05e36d01219d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:12.966959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80d984-4877-43b0-9473-05e36d01219d admin admin] PATH_INFO: `/v3/projects/d0fa9f6f453a4d9c8383c84368b98970` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:12.974398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80d984-4877-43b0-9473-05e36d01219d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0fa9f6f453a4d9c8383c84368b98970)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:12.976414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80d984-4877-43b0-9473-05e36d01219d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:13.067006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1b364-5e3f-4f48-8a7d-0dabe9e38700 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:13.075719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0ceba-bc00-4174-b86f-167ebe4c5c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:13.076339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0ceba-bc00-4174-b86f-167ebe4c5c89 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:13.079549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0ceba-bc00-4174-b86f-167ebe4c5c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:13.079549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0ceba-bc00-4174-b86f-167ebe4c5c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:13.136041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0ceba-bc00-4174-b86f-167ebe4c5c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:13.137411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0ceba-bc00-4174-b86f-167ebe4c5c89 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:13.155279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7e80d984-4877-43b0-9473-05e36d01219d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0fa9f6f453a4d9c8383c84368b98970', 'request_id': 'req-7e80d984-4877-43b0-9473-05e36d01219d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:13.159673 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1520/3036] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:13.163585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0ceba-bc00-4174-b86f-167ebe4c5c89 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:13.165055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7e80d984-4877-43b0-9473-05e36d01219d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0fa9f6f453a4d9c8383c84368b98970', 'request_id': 'req-7e80d984-4877-43b0-9473-05e36d01219d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:13.167545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e0f0ceba-bc00-4174-b86f-167ebe4c5c89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:13.182673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7e80d984-4877-43b0-9473-05e36d01219d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0fa9f6f453a4d9c8383c84368b98970', 'request_id': 'req-7e80d984-4877-43b0-9473-05e36d01219d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:13.196406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7e80d984-4877-43b0-9473-05e36d01219d admin admin] The token cache is being invalidate because project d0fa9f6f453a4d9c8383c84368b98970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:13.196644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7e80d984-4877-43b0-9473-05e36d01219d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:13.199699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7e80d984-4877-43b0-9473-05e36d01219d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:13.202080 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1517/3037] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:12 2022] DELETE /identity/v3/projects/d0fa9f6f453a4d9c8383c84368b98970 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:13.210939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6145b6-1502-4d87-b008-8f8ab6777e10 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:13.211231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6145b6-1502-4d87-b008-8f8ab6777e10 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:13.211568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6145b6-1502-4d87-b008-8f8ab6777e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:13.259271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-6a6145b6-1502-4d87-b008-8f8ab6777e10 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:13.261115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6a6145b6-1502-4d87-b008-8f8ab6777e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:13.325055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0ceba-bc00-4174-b86f-167ebe4c5c89 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:13.377755 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1518/3038] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:13.386758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8fe93-a24b-43ee-b3f7-a3dfc39a2831 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:13.387683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8fe93-a24b-43ee-b3f7-a3dfc39a2831 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:13.388164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8fe93-a24b-43ee-b3f7-a3dfc39a2831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:13.421035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-dfd8fe93-a24b-43ee-b3f7-a3dfc39a2831 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:13.425066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-dfd8fe93-a24b-43ee-b3f7-a3dfc39a2831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:13.430470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:13.459162 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1519/3039] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:07:13.460086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8fe93-a24b-43ee-b3f7-a3dfc39a2831 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:13.469778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-dfd8fe93-a24b-43ee-b3f7-a3dfc39a2831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:13.496225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a1b0e-6d93-4f5f-9d2f-ce78c53c5dc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:13.496876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a1b0e-6d93-4f5f-9d2f-ce78c53c5dc9 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:13.497163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a1b0e-6d93-4f5f-9d2f-ce78c53c5dc9 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:13.497444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a1b0e-6d93-4f5f-9d2f-ce78c53c5dc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:13.510864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8c2a1b0e-6d93-4f5f-9d2f-ce78c53c5dc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:13.518500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8fe93-a24b-43ee-b3f7-a3dfc39a2831 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:13.537900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514302b-fec7-466c-9fd0-0ed2dba52da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:13.538597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514302b-fec7-466c-9fd0-0ed2dba52da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:13.538981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514302b-fec7-466c-9fd0-0ed2dba52da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:13.541764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514302b-fec7-466c-9fd0-0ed2dba52da4 admin admin] PATH_INFO: `/v3/users/46d7264a2f63436bb8519cd8cec6d9f5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:13.544090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514302b-fec7-466c-9fd0-0ed2dba52da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d7264a2f63436bb8519cd8cec6d9f5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:13.550290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514302b-fec7-466c-9fd0-0ed2dba52da4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:13.553504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a1b0e-6d93-4f5f-9d2f-ce78c53c5dc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:13.557439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a1b0e-6d93-4f5f-9d2f-ce78c53c5dc9 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:13.602328 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1521/3040] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:13.611723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a1b0e-6d93-4f5f-9d2f-ce78c53c5dc9 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:13.641514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a1b0e-6d93-4f5f-9d2f-ce78c53c5dc9 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:13.655470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384366f3-68fc-4680-ae19-6aa6976d9064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:13.656116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384366f3-68fc-4680-ae19-6aa6976d9064 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:13.656401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384366f3-68fc-4680-ae19-6aa6976d9064 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:13.656857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384366f3-68fc-4680-ae19-6aa6976d9064 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:13.661781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384366f3-68fc-4680-ae19-6aa6976d9064 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:07:13.662214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384366f3-68fc-4680-ae19-6aa6976d9064 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:13.667113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384366f3-68fc-4680-ae19-6aa6976d9064 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:13.676870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6514302b-fec7-466c-9fd0-0ed2dba52da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d7264a2f63436bb8519cd8cec6d9f5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:13.696216 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1522/3041] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:13.701259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384366f3-68fc-4680-ae19-6aa6976d9064 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:13.712250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384366f3-68fc-4680-ae19-6aa6976d9064 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:13.717947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd783192-e048-4f8b-8c12-a248f50da499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:13.719029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd783192-e048-4f8b-8c12-a248f50da499 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:13.719585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd783192-e048-4f8b-8c12-a248f50da499 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:13.720092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd783192-e048-4f8b-8c12-a248f50da499 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:13.720975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd783192-e048-4f8b-8c12-a248f50da499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:13.723146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd783192-e048-4f8b-8c12-a248f50da499 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:13.740296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6514302b-fec7-466c-9fd0-0ed2dba52da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d7264a2f63436bb8519cd8cec6d9f5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:13.743665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6514302b-fec7-466c-9fd0-0ed2dba52da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d7264a2f63436bb8519cd8cec6d9f5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:13.765928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6514302b-fec7-466c-9fd0-0ed2dba52da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d7264a2f63436bb8519cd8cec6d9f5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:13.767348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6514302b-fec7-466c-9fd0-0ed2dba52da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d7264a2f63436bb8519cd8cec6d9f5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:13.769344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:13.774746 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1523/3042] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:07:13 2022] POST /identity/v3/projects => generated 391 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:13.781116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd783192-e048-4f8b-8c12-a248f50da499 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:13.789736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cd783192-e048-4f8b-8c12-a248f50da499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:13.800089 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1520/3043] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:13 2022] DELETE /identity/v3/users/46d7264a2f63436bb8519cd8cec6d9f5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:13.816094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514302b-fec7-466c-9fd0-0ed2dba52da4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:13.817800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6514302b-fec7-466c-9fd0-0ed2dba52da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:13.962064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd783192-e048-4f8b-8c12-a248f50da499 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:13.972403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514302b-fec7-466c-9fd0-0ed2dba52da4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:13.976296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50fcdd-5d48-484b-9738-f223e6e530a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:13.976954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50fcdd-5d48-484b-9738-f223e6e530a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:13.977324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50fcdd-5d48-484b-9738-f223e6e530a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:13.977518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50fcdd-5d48-484b-9738-f223e6e530a8 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:13.979278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50fcdd-5d48-484b-9738-f223e6e530a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:13.982345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50fcdd-5d48-484b-9738-f223e6e530a8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:13.990962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6c574-2330-4285-9f5f-2991f9f5910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:13.992283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6c574-2330-4285-9f5f-2991f9f5910e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:13.992582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6c574-2330-4285-9f5f-2991f9f5910e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:13.992873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6c574-2330-4285-9f5f-2991f9f5910e admin admin] PATH_INFO: `/v3/users/8379e04d2b30488387b3eefab6669768` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:13.996815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6c574-2330-4285-9f5f-2991f9f5910e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8379e04d2b30488387b3eefab6669768)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:14.002860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6c574-2330-4285-9f5f-2991f9f5910e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:14.039504 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1524/3044] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:07:13 2022] POST /identity/v3/users => generated 296 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:07:14.041376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50fcdd-5d48-484b-9738-f223e6e530a8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:14.066753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50fcdd-5d48-484b-9738-f223e6e530a8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:14.083797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae21ba-40da-433c-b6d3-98264144f9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:14.084784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae21ba-40da-433c-b6d3-98264144f9fc admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:14.085086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae21ba-40da-433c-b6d3-98264144f9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:14.085369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae21ba-40da-433c-b6d3-98264144f9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:14.086094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae21ba-40da-433c-b6d3-98264144f9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:14.090782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae21ba-40da-433c-b6d3-98264144f9fc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:14.119827 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1525/3045] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:07:14.122188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae21ba-40da-433c-b6d3-98264144f9fc admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:14.124840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e4a6c574-2330-4285-9f5f-2991f9f5910e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8379e04d2b30488387b3eefab6669768'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:14.139497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e4a6c574-2330-4285-9f5f-2991f9f5910e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8379e04d2b30488387b3eefab6669768'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:14.140427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e4a6c574-2330-4285-9f5f-2991f9f5910e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8379e04d2b30488387b3eefab6669768'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:14.148391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e4a6c574-2330-4285-9f5f-2991f9f5910e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8379e04d2b30488387b3eefab6669768'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:14.149152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e4a6c574-2330-4285-9f5f-2991f9f5910e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8379e04d2b30488387b3eefab6669768'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:14.149956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae21ba-40da-433c-b6d3-98264144f9fc admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:14.165427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031e0a4-520d-47e0-a727-e065a649a0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:14.166988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031e0a4-520d-47e0-a727-e065a649a0cd admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:14.167506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031e0a4-520d-47e0-a727-e065a649a0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:14.167951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031e0a4-520d-47e0-a727-e065a649a0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:14.169331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031e0a4-520d-47e0-a727-e065a649a0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:14.171188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031e0a4-520d-47e0-a727-e065a649a0cd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:14.173499 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1521/3046] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:13 2022] DELETE /identity/v3/users/8379e04d2b30488387b3eefab6669768 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:07:14.203969 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1526/3047] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:14.208911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6c574-2330-4285-9f5f-2991f9f5910e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:14.210431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e4a6c574-2330-4285-9f5f-2991f9f5910e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:14.343481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6c574-2330-4285-9f5f-2991f9f5910e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:14.351994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21400a40-f95e-464f-abe1-721327890068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:14.356671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21400a40-f95e-464f-abe1-721327890068 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:14.357333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21400a40-f95e-464f-abe1-721327890068 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:14.357844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21400a40-f95e-464f-abe1-721327890068 admin admin] PATH_INFO: `/v3/projects/d7f8aac4d7bc44abb0d86e5a72bdaff1/users/26bab5a783244ca9aa9668dd106e373f/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:14.408071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21400a40-f95e-464f-abe1-721327890068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f8aac4d7bc44abb0d86e5a72bdaff1, user_id=26bab5a783244ca9aa9668dd106e373f, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:14.408071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21400a40-f95e-464f-abe1-721327890068 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:14.420068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:14.457541 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1522/3048] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:14 2022] PUT /identity/v3/projects/d7f8aac4d7bc44abb0d86e5a72bdaff1/users/26bab5a783244ca9aa9668dd106e373f/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:14.459727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff3afe-41cd-4c44-b7ee-a7135665b85c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:14.459727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff3afe-41cd-4c44-b7ee-a7135665b85c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:14.460245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff3afe-41cd-4c44-b7ee-a7135665b85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:14.499963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8aff3afe-41cd-4c44-b7ee-a7135665b85c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:14.501420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8aff3afe-41cd-4c44-b7ee-a7135665b85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:14.587078 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1527/3049] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:14.644347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21400a40-f95e-464f-abe1-721327890068 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:14.647560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-21400a40-f95e-464f-abe1-721327890068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:14.744582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21400a40-f95e-464f-abe1-721327890068 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:14.749449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8067ae7-df63-4108-bdbf-dbeae60cfa92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:14.750113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8067ae7-df63-4108-bdbf-dbeae60cfa92 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:14.750597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8067ae7-df63-4108-bdbf-dbeae60cfa92 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:14.750870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8067ae7-df63-4108-bdbf-dbeae60cfa92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:14.764088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8067ae7-df63-4108-bdbf-dbeae60cfa92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:14.765546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8067ae7-df63-4108-bdbf-dbeae60cfa92 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:14.769515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff3afe-41cd-4c44-b7ee-a7135665b85c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:14.771143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8aff3afe-41cd-4c44-b7ee-a7135665b85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:14.792167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff3afe-41cd-4c44-b7ee-a7135665b85c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:14.799272 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1523/3050] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:14.801496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667dfbb-9bb4-4c5e-91a3-16f5c339928d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:14.802149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667dfbb-9bb4-4c5e-91a3-16f5c339928d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:14.802434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667dfbb-9bb4-4c5e-91a3-16f5c339928d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:14.802715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667dfbb-9bb4-4c5e-91a3-16f5c339928d admin admin] PATH_INFO: `/v3/projects/bfb74be507694713821cb1a68619f9e2` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:14.804034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667dfbb-9bb4-4c5e-91a3-16f5c339928d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb74be507694713821cb1a68619f9e2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:14.806046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667dfbb-9bb4-4c5e-91a3-16f5c339928d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:14.813887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:14.880421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad1dd1-7c53-450d-8883-354b07e6300e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:14.880421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad1dd1-7c53-450d-8883-354b07e6300e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:14.880836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad1dd1-7c53-450d-8883-354b07e6300e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:14.925817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-71ad1dd1-7c53-450d-8883-354b07e6300e None None] MFA Rules not processed for user `d20ab89ea13c4611904cec244d37ba25`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:14.930084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-71ad1dd1-7c53-450d-8883-354b07e6300e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:14.936608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1667dfbb-9bb4-4c5e-91a3-16f5c339928d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb74be507694713821cb1a68619f9e2', 'request_id': 'req-1667dfbb-9bb4-4c5e-91a3-16f5c339928d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:14.948864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1667dfbb-9bb4-4c5e-91a3-16f5c339928d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb74be507694713821cb1a68619f9e2', 'request_id': 'req-1667dfbb-9bb4-4c5e-91a3-16f5c339928d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:14.961459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1667dfbb-9bb4-4c5e-91a3-16f5c339928d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb74be507694713821cb1a68619f9e2', 'request_id': 'req-1667dfbb-9bb4-4c5e-91a3-16f5c339928d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:14.988340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1667dfbb-9bb4-4c5e-91a3-16f5c339928d admin admin] The token cache is being invalidate because project bfb74be507694713821cb1a68619f9e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:14.988340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1667dfbb-9bb4-4c5e-91a3-16f5c339928d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:14.989184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1667dfbb-9bb4-4c5e-91a3-16f5c339928d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:14.991502 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1528/3051] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:14 2022] DELETE /identity/v3/projects/bfb74be507694713821cb1a68619f9e2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:14.996494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667dfbb-9bb4-4c5e-91a3-16f5c339928d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:14.998887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1667dfbb-9bb4-4c5e-91a3-16f5c339928d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:15.106613 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1524/3052] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:07:15.121883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667dfbb-9bb4-4c5e-91a3-16f5c339928d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:15.140270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc8c0b-ec48-47b5-a7ab-eff56c96f859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:15.143658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc8c0b-ec48-47b5-a7ab-eff56c96f859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:15.143957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc8c0b-ec48-47b5-a7ab-eff56c96f859 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:15.144245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc8c0b-ec48-47b5-a7ab-eff56c96f859 admin admin] PATH_INFO: `/v3/users/4ed9345c92b74253ae7c4c15f4457ae0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:15.152274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc8c0b-ec48-47b5-a7ab-eff56c96f859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ed9345c92b74253ae7c4c15f4457ae0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:15.154256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc8c0b-ec48-47b5-a7ab-eff56c96f859 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:15.247517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-edbc8c0b-ec48-47b5-a7ab-eff56c96f859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ed9345c92b74253ae7c4c15f4457ae0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:15.248767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-edbc8c0b-ec48-47b5-a7ab-eff56c96f859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ed9345c92b74253ae7c4c15f4457ae0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:15.266767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-edbc8c0b-ec48-47b5-a7ab-eff56c96f859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ed9345c92b74253ae7c4c15f4457ae0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:15.267684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-edbc8c0b-ec48-47b5-a7ab-eff56c96f859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ed9345c92b74253ae7c4c15f4457ae0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:15.291477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-edbc8c0b-ec48-47b5-a7ab-eff56c96f859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ed9345c92b74253ae7c4c15f4457ae0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:15.318335 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1529/3053] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:14 2022] DELETE /identity/v3/users/4ed9345c92b74253ae7c4c15f4457ae0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:15.333999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad1dd1-7c53-450d-8883-354b07e6300e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:15.335953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-71ad1dd1-7c53-450d-8883-354b07e6300e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:15.357139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad1dd1-7c53-450d-8883-354b07e6300e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:15.391088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc8c0b-ec48-47b5-a7ab-eff56c96f859 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:15.394251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-edbc8c0b-ec48-47b5-a7ab-eff56c96f859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:15.421658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:15.451035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e1c1c-d674-4bc4-a67b-d770546f1345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:15.451749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e1c1c-d674-4bc4-a67b-d770546f1345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:15.452033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e1c1c-d674-4bc4-a67b-d770546f1345 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:15.452313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e1c1c-d674-4bc4-a67b-d770546f1345 admin admin] PATH_INFO: `/v3/projects/14de6219ca7b42798547929c6cc778d5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:15.454174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e1c1c-d674-4bc4-a67b-d770546f1345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14de6219ca7b42798547929c6cc778d5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:15.456195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e1c1c-d674-4bc4-a67b-d770546f1345 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:15.513264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=1,keystone:SELECT=96,keystone:DELETE=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:15.516889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc8c0b-ec48-47b5-a7ab-eff56c96f859 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:15.518493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f08e1c1c-d674-4bc4-a67b-d770546f1345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14de6219ca7b42798547929c6cc778d5', 'request_id': 'req-f08e1c1c-d674-4bc4-a67b-d770546f1345'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:15.527847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f08e1c1c-d674-4bc4-a67b-d770546f1345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14de6219ca7b42798547929c6cc778d5', 'request_id': 'req-f08e1c1c-d674-4bc4-a67b-d770546f1345'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:15.540700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f08e1c1c-d674-4bc4-a67b-d770546f1345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14de6219ca7b42798547929c6cc778d5', 'request_id': 'req-f08e1c1c-d674-4bc4-a67b-d770546f1345'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:15.557040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f08e1c1c-d674-4bc4-a67b-d770546f1345 admin admin] The token cache is being invalidate because project 14de6219ca7b42798547929c6cc778d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:15.557737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f08e1c1c-d674-4bc4-a67b-d770546f1345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:15.558959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f08e1c1c-d674-4bc4-a67b-d770546f1345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:15.561203 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1525/3054] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:15 2022] DELETE /identity/v3/projects/14de6219ca7b42798547929c6cc778d5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:15.566597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deceae-4f90-4b0c-9688-657e9b140a06 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:15.567010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deceae-4f90-4b0c-9688-657e9b140a06 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:15.567606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deceae-4f90-4b0c-9688-657e9b140a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:15.595475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f9deceae-4f90-4b0c-9688-657e9b140a06 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:15.597622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f9deceae-4f90-4b0c-9688-657e9b140a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:15.629798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a43cd-b2e5-4c4c-bff5-bba8099a5396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:15.630808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a43cd-b2e5-4c4c-bff5-bba8099a5396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:15.631252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a43cd-b2e5-4c4c-bff5-bba8099a5396 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:15.631734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a43cd-b2e5-4c4c-bff5-bba8099a5396 admin admin] PATH_INFO: `/v3/projects/afa530811f1f43aeb7957b6cd28d4653` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:15.633377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a43cd-b2e5-4c4c-bff5-bba8099a5396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa530811f1f43aeb7957b6cd28d4653)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:15.636248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a43cd-b2e5-4c4c-bff5-bba8099a5396 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:15.680748 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1526/3055] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:15.682675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a1bfc-da9f-4278-bc3e-823d1fc0212a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:15.683341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a1bfc-da9f-4278-bc3e-823d1fc0212a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:15.684691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a1bfc-da9f-4278-bc3e-823d1fc0212a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:15.721673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e6a43cd-b2e5-4c4c-bff5-bba8099a5396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa530811f1f43aeb7957b6cd28d4653', 'request_id': 'req-4e6a43cd-b2e5-4c4c-bff5-bba8099a5396'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:15.732320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e6a43cd-b2e5-4c4c-bff5-bba8099a5396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa530811f1f43aeb7957b6cd28d4653', 'request_id': 'req-4e6a43cd-b2e5-4c4c-bff5-bba8099a5396'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:15.737879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f42a1bfc-da9f-4278-bc3e-823d1fc0212a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:15.739931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f42a1bfc-da9f-4278-bc3e-823d1fc0212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:15.742063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e6a43cd-b2e5-4c4c-bff5-bba8099a5396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa530811f1f43aeb7957b6cd28d4653', 'request_id': 'req-4e6a43cd-b2e5-4c4c-bff5-bba8099a5396'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:15.761297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e6a43cd-b2e5-4c4c-bff5-bba8099a5396 admin admin] The token cache is being invalidate because project afa530811f1f43aeb7957b6cd28d4653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:15.761835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e6a43cd-b2e5-4c4c-bff5-bba8099a5396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:15.762925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e6a43cd-b2e5-4c4c-bff5-bba8099a5396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:15.765050 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1530/3056] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:15 2022] DELETE /identity/v3/projects/afa530811f1f43aeb7957b6cd28d4653 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:15.772665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bd06b-cb01-44ab-b466-c0341b142bee None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:15.773849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bd06b-cb01-44ab-b466-c0341b142bee None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:15.775718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bd06b-cb01-44ab-b466-c0341b142bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:15.829612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6e5bd06b-cb01-44ab-b466-c0341b142bee None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:15.831074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6e5bd06b-cb01-44ab-b466-c0341b142bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:15.842927 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1527/3057] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:07:15.846379 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1531/3058] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:15.847100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a1bfc-da9f-4278-bc3e-823d1fc0212a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:15.855706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef4a67-2599-4dbf-8276-d2fd889ec9aa None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:15.856234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef4a67-2599-4dbf-8276-d2fd889ec9aa None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:15.856608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef4a67-2599-4dbf-8276-d2fd889ec9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:15.859392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a1bfc-da9f-4278-bc3e-823d1fc0212a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:15.864710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22caadf1-af4b-47a3-8707-8746ff1bd5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:15.866358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22caadf1-af4b-47a3-8707-8746ff1bd5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:15.866358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22caadf1-af4b-47a3-8707-8746ff1bd5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:15.866358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22caadf1-af4b-47a3-8707-8746ff1bd5c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:15.867209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22caadf1-af4b-47a3-8707-8746ff1bd5c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:07:15.867651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22caadf1-af4b-47a3-8707-8746ff1bd5c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:15.870419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22caadf1-af4b-47a3-8707-8746ff1bd5c4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:15.898429 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1528/3059] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:15.902095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22caadf1-af4b-47a3-8707-8746ff1bd5c4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:15.920683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ddef4a67-2599-4dbf-8276-d2fd889ec9aa None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:15.922053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ddef4a67-2599-4dbf-8276-d2fd889ec9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:15.926017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22caadf1-af4b-47a3-8707-8746ff1bd5c4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:15.955165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082c200-77a6-4b7f-a9e8-42cc6a0f5eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:15.956208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082c200-77a6-4b7f-a9e8-42cc6a0f5eaa admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:15.956907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082c200-77a6-4b7f-a9e8-42cc6a0f5eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:15.957316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082c200-77a6-4b7f-a9e8-42cc6a0f5eaa admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:15.958180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082c200-77a6-4b7f-a9e8-42cc6a0f5eaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:15.960800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082c200-77a6-4b7f-a9e8-42cc6a0f5eaa admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:16.001545 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1532/3060] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:07:16.015589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef4a67-2599-4dbf-8276-d2fd889ec9aa None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:16.046073 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1529/3061] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:07:15 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:16.046932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef4a67-2599-4dbf-8276-d2fd889ec9aa None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:16.055344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082c200-77a6-4b7f-a9e8-42cc6a0f5eaa admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:16.136639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:16.177190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db8342-2189-48cc-a2eb-b82ca914e9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:16.178441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db8342-2189-48cc-a2eb-b82ca914e9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:16.178920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db8342-2189-48cc-a2eb-b82ca914e9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:16.179376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db8342-2189-48cc-a2eb-b82ca914e9d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:16.180981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db8342-2189-48cc-a2eb-b82ca914e9d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:07:16.182025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db8342-2189-48cc-a2eb-b82ca914e9d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:16.184842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db8342-2189-48cc-a2eb-b82ca914e9d7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:16.189776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:16.237229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082c200-77a6-4b7f-a9e8-42cc6a0f5eaa admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:16.243054 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1533/3062] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:16.243054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db8342-2189-48cc-a2eb-b82ca914e9d7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:16.243595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-97db8342-2189-48cc-a2eb-b82ca914e9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:16.253455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e9a6d-ae78-4f85-afd8-bd6ca8a6157b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:16.254204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e9a6d-ae78-4f85-afd8-bd6ca8a6157b admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:16.254718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e9a6d-ae78-4f85-afd8-bd6ca8a6157b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:16.255014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e9a6d-ae78-4f85-afd8-bd6ca8a6157b admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:16.255990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e9a6d-ae78-4f85-afd8-bd6ca8a6157b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:16.258081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e9a6d-ae78-4f85-afd8-bd6ca8a6157b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:16.259059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db8342-2189-48cc-a2eb-b82ca914e9d7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:16.278985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433351b-d955-41ec-8f54-55cb50121edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:16.278985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433351b-d955-41ec-8f54-55cb50121edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:16.278985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433351b-d955-41ec-8f54-55cb50121edd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:16.278985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433351b-d955-41ec-8f54-55cb50121edd admin admin] PATH_INFO: `/v3/projects/ea652869c07c47f19dff281474c15054` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:16.279542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433351b-d955-41ec-8f54-55cb50121edd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea652869c07c47f19dff281474c15054)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:16.279542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433351b-d955-41ec-8f54-55cb50121edd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:16.297172 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1530/3063] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:07:16 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:07:16.313831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e9a6d-ae78-4f85-afd8-bd6ca8a6157b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:16.333391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e9a6d-ae78-4f85-afd8-bd6ca8a6157b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:16.339271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd224cdd-3c19-44be-a5ca-a3e77b15a697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:16.340199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd224cdd-3c19-44be-a5ca-a3e77b15a697 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:16.340735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd224cdd-3c19-44be-a5ca-a3e77b15a697 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:16.341252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd224cdd-3c19-44be-a5ca-a3e77b15a697 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:16.342416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd224cdd-3c19-44be-a5ca-a3e77b15a697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:16.346500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd224cdd-3c19-44be-a5ca-a3e77b15a697 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:16.404139 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1531/3064] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:07:16 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:16.405128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd224cdd-3c19-44be-a5ca-a3e77b15a697 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:16.415032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5433351b-d955-41ec-8f54-55cb50121edd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea652869c07c47f19dff281474c15054', 'request_id': 'req-5433351b-d955-41ec-8f54-55cb50121edd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:16.442837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5433351b-d955-41ec-8f54-55cb50121edd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea652869c07c47f19dff281474c15054', 'request_id': 'req-5433351b-d955-41ec-8f54-55cb50121edd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:16.453584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5433351b-d955-41ec-8f54-55cb50121edd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea652869c07c47f19dff281474c15054', 'request_id': 'req-5433351b-d955-41ec-8f54-55cb50121edd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:16.480643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5433351b-d955-41ec-8f54-55cb50121edd admin admin] The token cache is being invalidate because project ea652869c07c47f19dff281474c15054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:16.481649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5433351b-d955-41ec-8f54-55cb50121edd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:16.482776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5433351b-d955-41ec-8f54-55cb50121edd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:16.485620 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1534/3065] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:16 2022] DELETE /identity/v3/projects/ea652869c07c47f19dff281474c15054 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:16.487502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433351b-d955-41ec-8f54-55cb50121edd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:16.489720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5433351b-d955-41ec-8f54-55cb50121edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:16.509206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd224cdd-3c19-44be-a5ca-a3e77b15a697 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:16.517481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a627780-1dec-4504-beac-71f987e6f01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:16.518828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a627780-1dec-4504-beac-71f987e6f01d admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:16.519418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a627780-1dec-4504-beac-71f987e6f01d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:16.519914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a627780-1dec-4504-beac-71f987e6f01d admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:16.521003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a627780-1dec-4504-beac-71f987e6f01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:16.528375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a627780-1dec-4504-beac-71f987e6f01d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:16.555519 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1532/3066] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:16.557101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2b61f-4f90-4f0d-ba3a-2707b8ce0eb9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:16.557513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2b61f-4f90-4f0d-ba3a-2707b8ce0eb9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:16.557911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2b61f-4f90-4f0d-ba3a-2707b8ce0eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:16.583644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-28c2b61f-4f90-4f0d-ba3a-2707b8ce0eb9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:16.585585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-28c2b61f-4f90-4f0d-ba3a-2707b8ce0eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:16.592299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433351b-d955-41ec-8f54-55cb50121edd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:16.605856 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1533/3067] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:16.606192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926ec85-d9a7-43b3-b6be-234418aa23d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:16.606192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926ec85-d9a7-43b3-b6be-234418aa23d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:16.606486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2b61f-4f90-4f0d-ba3a-2707b8ce0eb9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:16.606588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926ec85-d9a7-43b3-b6be-234418aa23d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:16.606588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926ec85-d9a7-43b3-b6be-234418aa23d9 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:16.606803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-28c2b61f-4f90-4f0d-ba3a-2707b8ce0eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:16.606905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926ec85-d9a7-43b3-b6be-234418aa23d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:16.607793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926ec85-d9a7-43b3-b6be-234418aa23d9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:16.616000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2b61f-4f90-4f0d-ba3a-2707b8ce0eb9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:16.623068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386df93-f9af-4211-9eba-48eebad1a977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:16.624489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386df93-f9af-4211-9eba-48eebad1a977 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:16.624850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386df93-f9af-4211-9eba-48eebad1a977 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:16.625212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386df93-f9af-4211-9eba-48eebad1a977 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:16.626057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386df93-f9af-4211-9eba-48eebad1a977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:16.627839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386df93-f9af-4211-9eba-48eebad1a977 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:16.640792 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1534/3068] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:16.642247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc327d-427a-4f70-bfeb-b1715d54875c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:16.642533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc327d-427a-4f70-bfeb-b1715d54875c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:16.642813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc327d-427a-4f70-bfeb-b1715d54875c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:16.647369 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1535/3069] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:07:16 2022] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:16.647369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926ec85-d9a7-43b3-b6be-234418aa23d9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:16.659771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926ec85-d9a7-43b3-b6be-234418aa23d9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:16.666267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad6b93-7df6-417e-a77c-e1b7a1ffc9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:16.667552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad6b93-7df6-417e-a77c-e1b7a1ffc9cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:16.668006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad6b93-7df6-417e-a77c-e1b7a1ffc9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:16.668467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad6b93-7df6-417e-a77c-e1b7a1ffc9cd admin admin] PATH_INFO: `/v3/projects/d9be740494d2497cb1771330a1ba99f1/users/2517a20b0358424480784b0003512d50/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:16.673790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-45bc327d-427a-4f70-bfeb-b1715d54875c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:16.675453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-45bc327d-427a-4f70-bfeb-b1715d54875c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:16.686124 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1535/3070] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:16.687111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc327d-427a-4f70-bfeb-b1715d54875c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:16.696526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad6b93-7df6-417e-a77c-e1b7a1ffc9cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9be740494d2497cb1771330a1ba99f1, user_id=2517a20b0358424480784b0003512d50, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:16.701606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad6b93-7df6-417e-a77c-e1b7a1ffc9cd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:16.708454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc327d-427a-4f70-bfeb-b1715d54875c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:16.724840 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1536/3071] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:16 2022] PUT /identity/v3/projects/d9be740494d2497cb1771330a1ba99f1/users/2517a20b0358424480784b0003512d50/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:16.726074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad6b93-7df6-417e-a77c-e1b7a1ffc9cd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:16.734783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b75f85-0277-4b2a-ba3d-67853df803be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:16.736156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b75f85-0277-4b2a-ba3d-67853df803be admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:16.736156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b75f85-0277-4b2a-ba3d-67853df803be admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:16.736386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b75f85-0277-4b2a-ba3d-67853df803be admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:16.737434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b75f85-0277-4b2a-ba3d-67853df803be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:16.754263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b75f85-0277-4b2a-ba3d-67853df803be admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:16.773242 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1536/3072] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:16.773242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44acbe7-f804-4264-a65c-38ee7b13c736 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:16.773242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44acbe7-f804-4264-a65c-38ee7b13c736 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:16.773242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44acbe7-f804-4264-a65c-38ee7b13c736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:16.800008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:16.806003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d44acbe7-f804-4264-a65c-38ee7b13c736 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:16.807558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d44acbe7-f804-4264-a65c-38ee7b13c736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:16.933724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad6b93-7df6-417e-a77c-e1b7a1ffc9cd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:16.947446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46b0c6-7d07-4a07-9baa-fb5f8dbd88fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:16.948109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46b0c6-7d07-4a07-9baa-fb5f8dbd88fd admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:16.948392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46b0c6-7d07-4a07-9baa-fb5f8dbd88fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:16.948665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46b0c6-7d07-4a07-9baa-fb5f8dbd88fd admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:16.949380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46b0c6-7d07-4a07-9baa-fb5f8dbd88fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:07:16.949684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46b0c6-7d07-4a07-9baa-fb5f8dbd88fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:16.951351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46b0c6-7d07-4a07-9baa-fb5f8dbd88fd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:16.982397 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1537/3073] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:16.987243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44acbe7-f804-4264-a65c-38ee7b13c736 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:16.995966 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1537/3074] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:16.997476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46b0c6-7d07-4a07-9baa-fb5f8dbd88fd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:17.014979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44acbe7-f804-4264-a65c-38ee7b13c736 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:17.021795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46b0c6-7d07-4a07-9baa-fb5f8dbd88fd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:17.024532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41af94b-fc9c-4338-8265-42f28fdfa4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:17.026979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41af94b-fc9c-4338-8265-42f28fdfa4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:17.027445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41af94b-fc9c-4338-8265-42f28fdfa4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:17.027820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41af94b-fc9c-4338-8265-42f28fdfa4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:17.028636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41af94b-fc9c-4338-8265-42f28fdfa4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:17.032329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41af94b-fc9c-4338-8265-42f28fdfa4d0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:17.034352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:17.038252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e49e46-0906-45f0-9fce-2a1d3391f288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:17.039123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e49e46-0906-45f0-9fce-2a1d3391f288 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:17.039721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e49e46-0906-45f0-9fce-2a1d3391f288 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:17.040017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e49e46-0906-45f0-9fce-2a1d3391f288 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:17.041692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e49e46-0906-45f0-9fce-2a1d3391f288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:17.050883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e49e46-0906-45f0-9fce-2a1d3391f288 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:17.061741 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1538/3075] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:17.065537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41af94b-fc9c-4338-8265-42f28fdfa4d0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:17.088665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41af94b-fc9c-4338-8265-42f28fdfa4d0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:17.096102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236267e3-cb3e-42dc-a347-5ca7b388fa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:17.097027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236267e3-cb3e-42dc-a347-5ca7b388fa3e admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:17.097414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236267e3-cb3e-42dc-a347-5ca7b388fa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:17.097791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236267e3-cb3e-42dc-a347-5ca7b388fa3e admin admin] PATH_INFO: `/v3/projects/6193b7fd6d224f328a2b4c561edb89ea/users/eeb3ffbaef3347de8d9ad6b2bdfa19bc/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:17.129926 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1538/3076] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:07:16 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:17.131209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e49e46-0906-45f0-9fce-2a1d3391f288 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:17.133497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c4e49e46-0906-45f0-9fce-2a1d3391f288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:17.137352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236267e3-cb3e-42dc-a347-5ca7b388fa3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6193b7fd6d224f328a2b4c561edb89ea, user_id=eeb3ffbaef3347de8d9ad6b2bdfa19bc, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:17.152966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236267e3-cb3e-42dc-a347-5ca7b388fa3e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:17.198578 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1539/3077] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:17 2022] PUT /identity/v3/projects/6193b7fd6d224f328a2b4c561edb89ea/users/eeb3ffbaef3347de8d9ad6b2bdfa19bc/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:17.199577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236267e3-cb3e-42dc-a347-5ca7b388fa3e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:17.260128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e49e46-0906-45f0-9fce-2a1d3391f288 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:17.332532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236267e3-cb3e-42dc-a347-5ca7b388fa3e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:17.335454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e2ebc-501b-41c3-a9bf-c2cd2772efc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:17.336854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e2ebc-501b-41c3-a9bf-c2cd2772efc0 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:17.337246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e2ebc-501b-41c3-a9bf-c2cd2772efc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:17.337672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e2ebc-501b-41c3-a9bf-c2cd2772efc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:17.344786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97dee4-b191-4a15-b06b-6f5fa847b102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:17.346527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97dee4-b191-4a15-b06b-6f5fa847b102 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:17.347149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97dee4-b191-4a15-b06b-6f5fa847b102 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:17.347796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97dee4-b191-4a15-b06b-6f5fa847b102 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:17.348488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97dee4-b191-4a15-b06b-6f5fa847b102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:17.351571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e2ebc-501b-41c3-a9bf-c2cd2772efc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:17.351830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97dee4-b191-4a15-b06b-6f5fa847b102 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:17.353910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e2ebc-501b-41c3-a9bf-c2cd2772efc0 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:17.368475 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1539/3078] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:17.370958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05dca9-77f7-4534-977c-bad68795649c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:17.371566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05dca9-77f7-4534-977c-bad68795649c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:17.372033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05dca9-77f7-4534-977c-bad68795649c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:17.387240 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1540/3079] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:07:17 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:17.388366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97dee4-b191-4a15-b06b-6f5fa847b102 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:17.402184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97dee4-b191-4a15-b06b-6f5fa847b102 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:17.406984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-eb05dca9-77f7-4534-977c-bad68795649c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:17.409308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-eb05dca9-77f7-4534-977c-bad68795649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:17.410382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f3ebf-3d13-4c48-b9ac-af88c720a18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:17.411379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f3ebf-3d13-4c48-b9ac-af88c720a18c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:17.411677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f3ebf-3d13-4c48-b9ac-af88c720a18c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:17.411960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f3ebf-3d13-4c48-b9ac-af88c720a18c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:17.413501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f3ebf-3d13-4c48-b9ac-af88c720a18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:17.417455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f3ebf-3d13-4c48-b9ac-af88c720a18c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:17.435577 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1541/3080] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:17.435877 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1540/3081] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:17.437599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f3ebf-3d13-4c48-b9ac-af88c720a18c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:17.452120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f3ebf-3d13-4c48-b9ac-af88c720a18c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:17.458623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583b1c6-c8d7-4396-90c3-316da3d05eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:17.459506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583b1c6-c8d7-4396-90c3-316da3d05eeb admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:17.460741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583b1c6-c8d7-4396-90c3-316da3d05eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:17.461188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583b1c6-c8d7-4396-90c3-316da3d05eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:17.462567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4583b1c6-c8d7-4396-90c3-316da3d05eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:17.466101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4583b1c6-c8d7-4396-90c3-316da3d05eeb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:17.485820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05dca9-77f7-4534-977c-bad68795649c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:17.496640 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1542/3082] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:17.501871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05dca9-77f7-4534-977c-bad68795649c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:17.508039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c188b-927a-428e-86e2-f062131b2b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:17.509128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c188b-927a-428e-86e2-f062131b2b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:17.509128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c188b-927a-428e-86e2-f062131b2b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:17.509959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c188b-927a-428e-86e2-f062131b2b93 admin admin] PATH_INFO: `/v3/projects/61ed7d57264748e1907d9c2f3743667a/users/25cff561a2d14c45b71920346aee5d57/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:17.523827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583b1c6-c8d7-4396-90c3-316da3d05eeb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:17.526107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4583b1c6-c8d7-4396-90c3-316da3d05eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:17.532158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c188b-927a-428e-86e2-f062131b2b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ed7d57264748e1907d9c2f3743667a, user_id=25cff561a2d14c45b71920346aee5d57, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:17.535095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c188b-927a-428e-86e2-f062131b2b93 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:17.560740 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1541/3083] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:17 2022] PUT /identity/v3/projects/61ed7d57264748e1907d9c2f3743667a/users/25cff561a2d14c45b71920346aee5d57/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:07:17.571358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac1d1f-eb1b-4292-98bc-588661fe87c1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:17.572460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac1d1f-eb1b-4292-98bc-588661fe87c1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:17.572597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac1d1f-eb1b-4292-98bc-588661fe87c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:17.576795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583b1c6-c8d7-4396-90c3-316da3d05eeb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:17.648030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bfac1d1f-eb1b-4292-98bc-588661fe87c1 None None] MFA Rules not processed for user `25cff561a2d14c45b71920346aee5d57`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:17.651673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bfac1d1f-eb1b-4292-98bc-588661fe87c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:17.670987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:17.751391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a9cfa-64a1-4af3-b60c-8be5f4d693bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:17.752456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a9cfa-64a1-4af3-b60c-8be5f4d693bb service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:17.752972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a9cfa-64a1-4af3-b60c-8be5f4d693bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:17.753518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a9cfa-64a1-4af3-b60c-8be5f4d693bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:17.811068 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1542/3084] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:17.815427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac1d1f-eb1b-4292-98bc-588661fe87c1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:17.841335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:17.854500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a9cfa-64a1-4af3-b60c-8be5f4d693bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:17.856424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a9cfa-64a1-4af3-b60c-8be5f4d693bb service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:17.869741 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1543/3085] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:17.907828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac1d1f-eb1b-4292-98bc-588661fe87c1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:17.913277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43046ba6-11b0-45dc-9480-87cf808baba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:17.914634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43046ba6-11b0-45dc-9480-87cf808baba7 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:17.915048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43046ba6-11b0-45dc-9480-87cf808baba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:17.916163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43046ba6-11b0-45dc-9480-87cf808baba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:17.917356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43046ba6-11b0-45dc-9480-87cf808baba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:17.920293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43046ba6-11b0-45dc-9480-87cf808baba7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:17.972582 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1543/3086] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:07:17 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:07:17.976240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a9cfa-64a1-4af3-b60c-8be5f4d693bb service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:17.988717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a9cfa-64a1-4af3-b60c-8be5f4d693bb service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:18.075185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cbe42-603e-4542-91a8-595a00990bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:18.076155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cbe42-603e-4542-91a8-595a00990bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:18.076550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cbe42-603e-4542-91a8-595a00990bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:18.076958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cbe42-603e-4542-91a8-595a00990bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:18.077801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cbe42-603e-4542-91a8-595a00990bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:18.080070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cbe42-603e-4542-91a8-595a00990bb3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:18.123358 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1544/3087] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:07:17 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:18.126386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43046ba6-11b0-45dc-9480-87cf808baba7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:18.139445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43046ba6-11b0-45dc-9480-87cf808baba7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:18.149812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bbc52-3706-4e5e-b844-ed441d67120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:18.151024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bbc52-3706-4e5e-b844-ed441d67120e admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:18.151342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bbc52-3706-4e5e-b844-ed441d67120e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:18.151622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bbc52-3706-4e5e-b844-ed441d67120e admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:18.152344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bbc52-3706-4e5e-b844-ed441d67120e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:18.154037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bbc52-3706-4e5e-b844-ed441d67120e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:18.165434 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1544/3088] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:18.170446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cbe42-603e-4542-91a8-595a00990bb3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:18.184556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cbe42-603e-4542-91a8-595a00990bb3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:18.190661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab5d8f-39b5-4b54-92ef-93b46ab65d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:18.191395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab5d8f-39b5-4b54-92ef-93b46ab65d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:18.191688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab5d8f-39b5-4b54-92ef-93b46ab65d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:18.191955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab5d8f-39b5-4b54-92ef-93b46ab65d58 admin admin] PATH_INFO: `/v3/projects/43b34535abfb4f5d86e5091998a6823b/users/042c41b5f14d4a87979147530adccda3/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:18.211908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab5d8f-39b5-4b54-92ef-93b46ab65d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b34535abfb4f5d86e5091998a6823b, user_id=042c41b5f14d4a87979147530adccda3, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:18.215764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab5d8f-39b5-4b54-92ef-93b46ab65d58 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:18.241526 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1545/3089] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:18 2022] PUT /identity/v3/projects/43b34535abfb4f5d86e5091998a6823b/users/042c41b5f14d4a87979147530adccda3/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:18.242751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bbc52-3706-4e5e-b844-ed441d67120e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:18.257514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bbc52-3706-4e5e-b844-ed441d67120e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:18.364914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8b2ad-a8dc-49ff-83be-fcea4602b099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:18.366537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b2ad-a8dc-49ff-83be-fcea4602b099 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:18.366977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b2ad-a8dc-49ff-83be-fcea4602b099 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:18.367598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b2ad-a8dc-49ff-83be-fcea4602b099 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:18.378541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8b2ad-a8dc-49ff-83be-fcea4602b099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:18.380572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8b2ad-a8dc-49ff-83be-fcea4602b099 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:18.412221 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1545/3090] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:18.413183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab5d8f-39b5-4b54-92ef-93b46ab65d58 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:18.426676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab5d8f-39b5-4b54-92ef-93b46ab65d58 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:18.433969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46017261-9b46-4e3e-b94c-08847ab4d995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:18.434694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46017261-9b46-4e3e-b94c-08847ab4d995 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:18.434920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46017261-9b46-4e3e-b94c-08847ab4d995 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:18.435176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46017261-9b46-4e3e-b94c-08847ab4d995 admin admin] PATH_INFO: `/v3/projects/43b34535abfb4f5d86e5091998a6823b/users/042c41b5f14d4a87979147530adccda3/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:18.438758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46017261-9b46-4e3e-b94c-08847ab4d995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b34535abfb4f5d86e5091998a6823b, user_id=042c41b5f14d4a87979147530adccda3, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:18.449172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46017261-9b46-4e3e-b94c-08847ab4d995 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:18.477383 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1546/3091] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:18 2022] PUT /identity/v3/projects/43b34535abfb4f5d86e5091998a6823b/users/042c41b5f14d4a87979147530adccda3/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:18.489368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa580e62-6ce2-4cad-9ad7-d2a4f3ce11d8 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:18.489927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa580e62-6ce2-4cad-9ad7-d2a4f3ce11d8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:18.490442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa580e62-6ce2-4cad-9ad7-d2a4f3ce11d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:18.535197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-aa580e62-6ce2-4cad-9ad7-d2a4f3ce11d8 None None] MFA Rules not processed for user `042c41b5f14d4a87979147530adccda3`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:18.538726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-aa580e62-6ce2-4cad-9ad7-d2a4f3ce11d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:18.554056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:18.753039 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1546/3092] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:18.831127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acfbc5-5f43-46bd-8606-9b1e1a17d6d4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:18.831539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acfbc5-5f43-46bd-8606-9b1e1a17d6d4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:18.831825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acfbc5-5f43-46bd-8606-9b1e1a17d6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:18.864518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-25acfbc5-5f43-46bd-8606-9b1e1a17d6d4 None None] MFA Rules not processed for user `25cff561a2d14c45b71920346aee5d57`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:18.866553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-25acfbc5-5f43-46bd-8606-9b1e1a17d6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:18.955084 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1547/3093] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:07:18.961282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa580e62-6ce2-4cad-9ad7-d2a4f3ce11d8 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:18.963558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-aa580e62-6ce2-4cad-9ad7-d2a4f3ce11d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:19.073186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa580e62-6ce2-4cad-9ad7-d2a4f3ce11d8 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:19.088581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dad57-16d1-4161-9f7a-ec868e6c74ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:19.089244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dad57-16d1-4161-9f7a-ec868e6c74ab service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:19.089528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dad57-16d1-4161-9f7a-ec868e6c74ab service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:19.089809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dad57-16d1-4161-9f7a-ec868e6c74ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:19.101187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dad57-16d1-4161-9f7a-ec868e6c74ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:19.103272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dad57-16d1-4161-9f7a-ec868e6c74ab service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:19.123002 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1547/3094] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:07:21.513519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acfbc5-5f43-46bd-8606-9b1e1a17d6d4 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:21.515807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-25acfbc5-5f43-46bd-8606-9b1e1a17d6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:21.602651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:21.644791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acfbc5-5f43-46bd-8606-9b1e1a17d6d4 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:21.656534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24259e46-87d6-41d8-91e0-c1eacb8ce2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:21.660116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24259e46-87d6-41d8-91e0-c1eacb8ce2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:21.660597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24259e46-87d6-41d8-91e0-c1eacb8ce2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:21.662832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24259e46-87d6-41d8-91e0-c1eacb8ce2bf admin admin] PATH_INFO: `/v3/users/96815c6776f1464a8b6350b4a52d4548` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:21.668689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24259e46-87d6-41d8-91e0-c1eacb8ce2bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=96815c6776f1464a8b6350b4a52d4548)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:21.677426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24259e46-87d6-41d8-91e0-c1eacb8ce2bf admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:21.820507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-24259e46-87d6-41d8-91e0-c1eacb8ce2bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96815c6776f1464a8b6350b4a52d4548'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:21.870853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-24259e46-87d6-41d8-91e0-c1eacb8ce2bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96815c6776f1464a8b6350b4a52d4548'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:21.871474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-24259e46-87d6-41d8-91e0-c1eacb8ce2bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96815c6776f1464a8b6350b4a52d4548'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:21.888381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-24259e46-87d6-41d8-91e0-c1eacb8ce2bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96815c6776f1464a8b6350b4a52d4548'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:21.889158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-24259e46-87d6-41d8-91e0-c1eacb8ce2bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96815c6776f1464a8b6350b4a52d4548'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:21.918982 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1548/3095] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:21 2022] DELETE /identity/v3/users/96815c6776f1464a8b6350b4a52d4548 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:23.680176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dad57-16d1-4161-9f7a-ec868e6c74ab service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:23.706409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dad57-16d1-4161-9f7a-ec868e6c74ab service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:23.857421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721312e0-5312-4241-9276-e6aa4d689356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:23.858529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721312e0-5312-4241-9276-e6aa4d689356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:23.858529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721312e0-5312-4241-9276-e6aa4d689356 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:23.858757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721312e0-5312-4241-9276-e6aa4d689356 admin admin] PATH_INFO: `/v3/projects/81fb262c72e0468e92246bf31d93a204` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:23.863771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721312e0-5312-4241-9276-e6aa4d689356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81fb262c72e0468e92246bf31d93a204)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:23.868346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721312e0-5312-4241-9276-e6aa4d689356 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:23.934437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:23.979722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-721312e0-5312-4241-9276-e6aa4d689356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81fb262c72e0468e92246bf31d93a204', 'request_id': 'req-721312e0-5312-4241-9276-e6aa4d689356'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:24.012801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-721312e0-5312-4241-9276-e6aa4d689356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81fb262c72e0468e92246bf31d93a204', 'request_id': 'req-721312e0-5312-4241-9276-e6aa4d689356'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:24.027992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-721312e0-5312-4241-9276-e6aa4d689356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81fb262c72e0468e92246bf31d93a204', 'request_id': 'req-721312e0-5312-4241-9276-e6aa4d689356'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:24.047834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-721312e0-5312-4241-9276-e6aa4d689356 admin admin] The token cache is being invalidate because project 81fb262c72e0468e92246bf31d93a204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:24.048188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-721312e0-5312-4241-9276-e6aa4d689356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:24.049147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-721312e0-5312-4241-9276-e6aa4d689356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:24.052588 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1548/3096] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:23 2022] DELETE /identity/v3/projects/81fb262c72e0468e92246bf31d93a204 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:24.056007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24259e46-87d6-41d8-91e0-c1eacb8ce2bf admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:24.059679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-24259e46-87d6-41d8-91e0-c1eacb8ce2bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:24.085944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24259e46-87d6-41d8-91e0-c1eacb8ce2bf admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:24.222776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af1680-5396-4a57-b535-6d810fb37e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:24.224234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af1680-5396-4a57-b535-6d810fb37e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:24.224651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af1680-5396-4a57-b535-6d810fb37e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:24.224943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af1680-5396-4a57-b535-6d810fb37e2f admin admin] PATH_INFO: `/v3/users/b4237892fec840cf987708cb717d5a3c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:24.228284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af1680-5396-4a57-b535-6d810fb37e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4237892fec840cf987708cb717d5a3c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:24.232863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af1680-5396-4a57-b535-6d810fb37e2f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:24.312441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-74af1680-5396-4a57-b535-6d810fb37e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4237892fec840cf987708cb717d5a3c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:24.331050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-74af1680-5396-4a57-b535-6d810fb37e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4237892fec840cf987708cb717d5a3c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:24.331932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-74af1680-5396-4a57-b535-6d810fb37e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4237892fec840cf987708cb717d5a3c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:24.335391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:24.365326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-74af1680-5396-4a57-b535-6d810fb37e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4237892fec840cf987708cb717d5a3c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:24.366211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-74af1680-5396-4a57-b535-6d810fb37e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4237892fec840cf987708cb717d5a3c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:24.390063 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1549/3097] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:24 2022] DELETE /identity/v3/users/b4237892fec840cf987708cb717d5a3c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:07:25.826758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721312e0-5312-4241-9276-e6aa4d689356 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:25.828949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-721312e0-5312-4241-9276-e6aa4d689356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:25.859499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721312e0-5312-4241-9276-e6aa4d689356 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:26.020669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316fac4-00bf-4e44-88fe-27e948425325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:26.021349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316fac4-00bf-4e44-88fe-27e948425325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:26.021634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316fac4-00bf-4e44-88fe-27e948425325 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:26.021913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316fac4-00bf-4e44-88fe-27e948425325 admin admin] PATH_INFO: `/v3/projects/fb68cb235ba44602a694baa9e3d4b352` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:26.023791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316fac4-00bf-4e44-88fe-27e948425325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb68cb235ba44602a694baa9e3d4b352)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:26.025395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316fac4-00bf-4e44-88fe-27e948425325 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:26.120593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b316fac4-00bf-4e44-88fe-27e948425325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb68cb235ba44602a694baa9e3d4b352', 'request_id': 'req-b316fac4-00bf-4e44-88fe-27e948425325'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:26.138720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b316fac4-00bf-4e44-88fe-27e948425325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb68cb235ba44602a694baa9e3d4b352', 'request_id': 'req-b316fac4-00bf-4e44-88fe-27e948425325'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:26.151498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b316fac4-00bf-4e44-88fe-27e948425325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb68cb235ba44602a694baa9e3d4b352', 'request_id': 'req-b316fac4-00bf-4e44-88fe-27e948425325'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:26.177252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b316fac4-00bf-4e44-88fe-27e948425325 admin admin] The token cache is being invalidate because project fb68cb235ba44602a694baa9e3d4b352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:26.178548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b316fac4-00bf-4e44-88fe-27e948425325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:26.178548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b316fac4-00bf-4e44-88fe-27e948425325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:26.180207 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1549/3098] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:25 2022] DELETE /identity/v3/projects/fb68cb235ba44602a694baa9e3d4b352 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:26.186351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c71c9-a9e4-424b-b141-87d785732231 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:26.186836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c71c9-a9e4-424b-b141-87d785732231 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:26.186955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c71c9-a9e4-424b-b141-87d785732231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:26.250380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-521c71c9-a9e4-424b-b141-87d785732231 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:26.252186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-521c71c9-a9e4-424b-b141-87d785732231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:26.411562 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1550/3099] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:26.414122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eca150-1a32-43b0-8baa-5b548193577f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:26.414607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eca150-1a32-43b0-8baa-5b548193577f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:26.414887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eca150-1a32-43b0-8baa-5b548193577f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:26.483833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-48eca150-1a32-43b0-8baa-5b548193577f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:26.485065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-48eca150-1a32-43b0-8baa-5b548193577f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:26.508745 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1550/3100] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:26.513867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c71c9-a9e4-424b-b141-87d785732231 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:26.542482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c71c9-a9e4-424b-b141-87d785732231 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:26.560463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eca150-1a32-43b0-8baa-5b548193577f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:26.561787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-48eca150-1a32-43b0-8baa-5b548193577f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:26.567451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91126b0a-547b-4580-888e-1ff09e0f190a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:26.568482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91126b0a-547b-4580-888e-1ff09e0f190a admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:26.569008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91126b0a-547b-4580-888e-1ff09e0f190a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:26.569504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91126b0a-547b-4580-888e-1ff09e0f190a admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:26.570526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91126b0a-547b-4580-888e-1ff09e0f190a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:07:26.571052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91126b0a-547b-4580-888e-1ff09e0f190a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:26.577356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91126b0a-547b-4580-888e-1ff09e0f190a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:26.593258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eca150-1a32-43b0-8baa-5b548193577f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:26.606116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60616d7-1740-492c-860c-15d9eabb0b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:26.607347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60616d7-1740-492c-860c-15d9eabb0b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:26.607646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60616d7-1740-492c-860c-15d9eabb0b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:26.608444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60616d7-1740-492c-860c-15d9eabb0b1e admin admin] PATH_INFO: `/v3/users/5b51cd5eda484fad9a901893f75d1b48` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:26.611693 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1551/3101] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:26.612567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60616d7-1740-492c-860c-15d9eabb0b1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b51cd5eda484fad9a901893f75d1b48)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:26.615892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91126b0a-547b-4580-888e-1ff09e0f190a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:26.616616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60616d7-1740-492c-860c-15d9eabb0b1e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:26.662651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91126b0a-547b-4580-888e-1ff09e0f190a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:26.683219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193a019-c076-477b-adf6-c42b764384cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:26.687544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193a019-c076-477b-adf6-c42b764384cc admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:26.687895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193a019-c076-477b-adf6-c42b764384cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:26.688192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193a019-c076-477b-adf6-c42b764384cc admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:26.691804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193a019-c076-477b-adf6-c42b764384cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:26.695924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193a019-c076-477b-adf6-c42b764384cc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:26.736135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:26.752485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c60616d7-1740-492c-860c-15d9eabb0b1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b51cd5eda484fad9a901893f75d1b48'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:26.753354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c60616d7-1740-492c-860c-15d9eabb0b1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b51cd5eda484fad9a901893f75d1b48'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:26.755356 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1552/3102] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:07:26 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:07:26.759703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193a019-c076-477b-adf6-c42b764384cc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:26.762204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a193a019-c076-477b-adf6-c42b764384cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:26.790283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c60616d7-1740-492c-860c-15d9eabb0b1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b51cd5eda484fad9a901893f75d1b48'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:26.793333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c60616d7-1740-492c-860c-15d9eabb0b1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b51cd5eda484fad9a901893f75d1b48'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:26.812716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c60616d7-1740-492c-860c-15d9eabb0b1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b51cd5eda484fad9a901893f75d1b48'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:26.869089 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1551/3103] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:26 2022] DELETE /identity/v3/users/5b51cd5eda484fad9a901893f75d1b48 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:07:26.869767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193a019-c076-477b-adf6-c42b764384cc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:26.977127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:27.014690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98b307-8bc9-46ba-894a-4fea0ed008ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:27.015990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98b307-8bc9-46ba-894a-4fea0ed008ff admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:27.016285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98b307-8bc9-46ba-894a-4fea0ed008ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:27.016565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98b307-8bc9-46ba-894a-4fea0ed008ff admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:27.019806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98b307-8bc9-46ba-894a-4fea0ed008ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:27.026531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98b307-8bc9-46ba-894a-4fea0ed008ff admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:27.090418 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1553/3104] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:07:26 2022] POST /identity/v3/users => generated 293 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:07:27.094684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60616d7-1740-492c-860c-15d9eabb0b1e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:27.173762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60616d7-1740-492c-860c-15d9eabb0b1e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:27.200685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a106ede-b26d-46cb-bd29-a2f8e4065916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:27.201521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a106ede-b26d-46cb-bd29-a2f8e4065916 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:27.201908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a106ede-b26d-46cb-bd29-a2f8e4065916 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:27.202529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a106ede-b26d-46cb-bd29-a2f8e4065916 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:27.203472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a106ede-b26d-46cb-bd29-a2f8e4065916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:27.205275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a106ede-b26d-46cb-bd29-a2f8e4065916 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:27.223983 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1552/3105] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:27.224325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98b307-8bc9-46ba-894a-4fea0ed008ff admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:27.244091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98b307-8bc9-46ba-894a-4fea0ed008ff admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:27.267270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e35a8-8c7f-4d61-96b1-bd5758aef687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:27.272624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e35a8-8c7f-4d61-96b1-bd5758aef687 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:27.272624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e35a8-8c7f-4d61-96b1-bd5758aef687 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:27.272951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e35a8-8c7f-4d61-96b1-bd5758aef687 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:27.279230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e35a8-8c7f-4d61-96b1-bd5758aef687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:27.280935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e35a8-8c7f-4d61-96b1-bd5758aef687 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:27.324869 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1554/3106] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:27.331517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a106ede-b26d-46cb-bd29-a2f8e4065916 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:27.381249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a106ede-b26d-46cb-bd29-a2f8e4065916 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:27.394782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3845d6-eac9-41dd-b0d6-087afe57e0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:27.395762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3845d6-eac9-41dd-b0d6-087afe57e0e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:27.396159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3845d6-eac9-41dd-b0d6-087afe57e0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:27.396609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3845d6-eac9-41dd-b0d6-087afe57e0e6 admin admin] PATH_INFO: `/v3/projects/dc54e6feb6974e74992e151e1cb97ba0/users/442abdff570f432e82775ce92c6b97b4/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:27.433654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3845d6-eac9-41dd-b0d6-087afe57e0e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc54e6feb6974e74992e151e1cb97ba0, user_id=442abdff570f432e82775ce92c6b97b4, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:27.437024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3845d6-eac9-41dd-b0d6-087afe57e0e6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:27.484008 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1553/3107] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:27 2022] PUT /identity/v3/projects/dc54e6feb6974e74992e151e1cb97ba0/users/442abdff570f432e82775ce92c6b97b4/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:27.488970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17966d7a-217a-4312-b739-0cce4fdef93e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:27.489767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17966d7a-217a-4312-b739-0cce4fdef93e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:27.490225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17966d7a-217a-4312-b739-0cce4fdef93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:27.569900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-17966d7a-217a-4312-b739-0cce4fdef93e None None] MFA Rules not processed for user `442abdff570f432e82775ce92c6b97b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:27.571341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-17966d7a-217a-4312-b739-0cce4fdef93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:27.707445 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1555/3108] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:27.709358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3845d6-eac9-41dd-b0d6-087afe57e0e6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:27.823980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3845d6-eac9-41dd-b0d6-087afe57e0e6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:27.836343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb467601-9583-46ef-af86-b0827b83ed66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:27.837370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb467601-9583-46ef-af86-b0827b83ed66 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:27.839737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb467601-9583-46ef-af86-b0827b83ed66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:27.841350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb467601-9583-46ef-af86-b0827b83ed66 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:27.845399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb467601-9583-46ef-af86-b0827b83ed66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:27.848836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb467601-9583-46ef-af86-b0827b83ed66 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:27.894516 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1554/3109] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:07:27 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:27.898387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17966d7a-217a-4312-b739-0cce4fdef93e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:27.914794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17966d7a-217a-4312-b739-0cce4fdef93e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:28.029054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb06dc-ad90-4402-a2f3-eea382138038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:28.030067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb06dc-ad90-4402-a2f3-eea382138038 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:28.030585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb06dc-ad90-4402-a2f3-eea382138038 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:28.031157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb06dc-ad90-4402-a2f3-eea382138038 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:28.033367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb06dc-ad90-4402-a2f3-eea382138038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:28.036004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb06dc-ad90-4402-a2f3-eea382138038 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:28.081181 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1556/3110] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:07:27 2022] POST /identity/v3/users => generated 299 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:28.086346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb467601-9583-46ef-af86-b0827b83ed66 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:28.102747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb467601-9583-46ef-af86-b0827b83ed66 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:28.109980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847dfecc-6aaa-4f24-a598-a7dbe5a2bd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:28.110640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dfecc-6aaa-4f24-a598-a7dbe5a2bd59 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:28.110913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dfecc-6aaa-4f24-a598-a7dbe5a2bd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:28.111196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dfecc-6aaa-4f24-a598-a7dbe5a2bd59 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:28.111941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847dfecc-6aaa-4f24-a598-a7dbe5a2bd59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:28.113657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847dfecc-6aaa-4f24-a598-a7dbe5a2bd59 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:28.144144 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1555/3111] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:28.148785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb06dc-ad90-4402-a2f3-eea382138038 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:28.175421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb06dc-ad90-4402-a2f3-eea382138038 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:28.181962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b052e41-228c-4d66-adeb-26faeca89efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:28.183558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b052e41-228c-4d66-adeb-26faeca89efe admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:28.183912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b052e41-228c-4d66-adeb-26faeca89efe admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:28.184268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b052e41-228c-4d66-adeb-26faeca89efe admin admin] PATH_INFO: `/v3/projects/4c5d0fe393624cdbac1b3bd7ac6832fe/users/347ececef391450da8dd4163980db907/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:28.241771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b052e41-228c-4d66-adeb-26faeca89efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5d0fe393624cdbac1b3bd7ac6832fe, user_id=347ececef391450da8dd4163980db907, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:28.244545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b052e41-228c-4d66-adeb-26faeca89efe admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:28.279919 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1557/3112] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:28 2022] PUT /identity/v3/projects/4c5d0fe393624cdbac1b3bd7ac6832fe/users/347ececef391450da8dd4163980db907/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:28.284204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847dfecc-6aaa-4f24-a598-a7dbe5a2bd59 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:28.299059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847dfecc-6aaa-4f24-a598-a7dbe5a2bd59 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:28.360636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b052e41-228c-4d66-adeb-26faeca89efe admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:28.362820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8b052e41-228c-4d66-adeb-26faeca89efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:28.428665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:28.445750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:28.452856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d887707-b5ce-4ad3-887a-6d71cf2b1d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:28.454313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d887707-b5ce-4ad3-887a-6d71cf2b1d89 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:28.454795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d887707-b5ce-4ad3-887a-6d71cf2b1d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:28.456027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d887707-b5ce-4ad3-887a-6d71cf2b1d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:28.457499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d887707-b5ce-4ad3-887a-6d71cf2b1d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:28.460537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d887707-b5ce-4ad3-887a-6d71cf2b1d89 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:28.479490 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1556/3113] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:28.501193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d887707-b5ce-4ad3-887a-6d71cf2b1d89 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:28.515140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d887707-b5ce-4ad3-887a-6d71cf2b1d89 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:28.519005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b052e41-228c-4d66-adeb-26faeca89efe admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:28.521715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba663c-92a9-460b-a9be-7d4e84d14235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:28.522518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba663c-92a9-460b-a9be-7d4e84d14235 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:28.522908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba663c-92a9-460b-a9be-7d4e84d14235 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:28.523502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba663c-92a9-460b-a9be-7d4e84d14235 admin admin] PATH_INFO: `/v3/projects/4c5d0fe393624cdbac1b3bd7ac6832fe/users/347ececef391450da8dd4163980db907/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:28.526472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba663c-92a9-460b-a9be-7d4e84d14235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5d0fe393624cdbac1b3bd7ac6832fe, user_id=347ececef391450da8dd4163980db907, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:28.529874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba663c-92a9-460b-a9be-7d4e84d14235 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:28.535667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef172f2b-102b-4965-b183-0a9be759e6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:28.536348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef172f2b-102b-4965-b183-0a9be759e6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:28.536633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef172f2b-102b-4965-b183-0a9be759e6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:28.536913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef172f2b-102b-4965-b183-0a9be759e6a9 admin admin] PATH_INFO: `/v3/projects/c4671c42e59f421192dea290a355021d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:28.538137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef172f2b-102b-4965-b183-0a9be759e6a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4671c42e59f421192dea290a355021d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:28.540282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef172f2b-102b-4965-b183-0a9be759e6a9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:28.570128 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1557/3114] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:28 2022] PUT /identity/v3/projects/4c5d0fe393624cdbac1b3bd7ac6832fe/users/347ececef391450da8dd4163980db907/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:28.577295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63273a1-4d31-4839-9b6d-57b917e1c46d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:28.578849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63273a1-4d31-4839-9b6d-57b917e1c46d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:28.579141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63273a1-4d31-4839-9b6d-57b917e1c46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:28.658595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d63273a1-4d31-4839-9b6d-57b917e1c46d None None] MFA Rules not processed for user `347ececef391450da8dd4163980db907`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:28.660289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d63273a1-4d31-4839-9b6d-57b917e1c46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:28.674294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ef172f2b-102b-4965-b183-0a9be759e6a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4671c42e59f421192dea290a355021d', 'request_id': 'req-ef172f2b-102b-4965-b183-0a9be759e6a9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:28.693796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ef172f2b-102b-4965-b183-0a9be759e6a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4671c42e59f421192dea290a355021d', 'request_id': 'req-ef172f2b-102b-4965-b183-0a9be759e6a9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:28.728763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ef172f2b-102b-4965-b183-0a9be759e6a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4671c42e59f421192dea290a355021d', 'request_id': 'req-ef172f2b-102b-4965-b183-0a9be759e6a9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:28.780439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ef172f2b-102b-4965-b183-0a9be759e6a9 admin admin] The token cache is being invalidate because project c4671c42e59f421192dea290a355021d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:28.780756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ef172f2b-102b-4965-b183-0a9be759e6a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:28.785119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ef172f2b-102b-4965-b183-0a9be759e6a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:28.789849 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1558/3115] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:28 2022] DELETE /identity/v3/projects/c4671c42e59f421192dea290a355021d => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:28.794555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380110df-a1a4-4fc2-8e6d-f6a5f1d46b31 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:28.794931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380110df-a1a4-4fc2-8e6d-f6a5f1d46b31 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:28.801310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380110df-a1a4-4fc2-8e6d-f6a5f1d46b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:28.872598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-380110df-a1a4-4fc2-8e6d-f6a5f1d46b31 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:28.875437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-380110df-a1a4-4fc2-8e6d-f6a5f1d46b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:28.887176 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1558/3116] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:29.036101 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1559/3117] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:29.044004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f42f73-f4d4-4cf3-a4f3-e519d1ea08b2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:29.044589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f42f73-f4d4-4cf3-a4f3-e519d1ea08b2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:29.044589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f42f73-f4d4-4cf3-a4f3-e519d1ea08b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:29.084480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-39f42f73-f4d4-4cf3-a4f3-e519d1ea08b2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:29.086706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-39f42f73-f4d4-4cf3-a4f3-e519d1ea08b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:29.115692 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1559/3118] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:29.120012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380110df-a1a4-4fc2-8e6d-f6a5f1d46b31 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:29.139332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380110df-a1a4-4fc2-8e6d-f6a5f1d46b31 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:29.146692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f32098-8eec-4ebc-93ef-8e8d76be489b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:29.148615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f32098-8eec-4ebc-93ef-8e8d76be489b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:29.149260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f32098-8eec-4ebc-93ef-8e8d76be489b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:29.150387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f32098-8eec-4ebc-93ef-8e8d76be489b admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:29.152022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f32098-8eec-4ebc-93ef-8e8d76be489b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:07:29.152728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f32098-8eec-4ebc-93ef-8e8d76be489b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:29.154783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f32098-8eec-4ebc-93ef-8e8d76be489b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:29.179815 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1560/3119] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:29.184961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f42f73-f4d4-4cf3-a4f3-e519d1ea08b2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:29.199621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f42f73-f4d4-4cf3-a4f3-e519d1ea08b2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:29.207324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7279cc-ac53-42e2-8ae6-5c75bfb5fa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:29.209274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7279cc-ac53-42e2-8ae6-5c75bfb5fa50 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:29.209737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7279cc-ac53-42e2-8ae6-5c75bfb5fa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:29.210334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7279cc-ac53-42e2-8ae6-5c75bfb5fa50 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:29.211362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7279cc-ac53-42e2-8ae6-5c75bfb5fa50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:29.230892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7279cc-ac53-42e2-8ae6-5c75bfb5fa50 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:29.268918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f32098-8eec-4ebc-93ef-8e8d76be489b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:29.275656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c0f32098-8eec-4ebc-93ef-8e8d76be489b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:29.321304 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1560/3120] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:07:29 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:07:29.335904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7279cc-ac53-42e2-8ae6-5c75bfb5fa50 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:29.473455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:29.517918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7279cc-ac53-42e2-8ae6-5c75bfb5fa50 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:29.529130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88734a91-b454-4773-938e-becbe4ca2bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:29.529785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88734a91-b454-4773-938e-becbe4ca2bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:29.530070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88734a91-b454-4773-938e-becbe4ca2bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:29.530349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88734a91-b454-4773-938e-becbe4ca2bb2 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:29.531133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f32098-8eec-4ebc-93ef-8e8d76be489b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:29.531268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88734a91-b454-4773-938e-becbe4ca2bb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:29.533252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88734a91-b454-4773-938e-becbe4ca2bb2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:29.581903 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1561/3121] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:07:29 2022] POST /identity/v3/users => generated 287 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:29.586327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88734a91-b454-4773-938e-becbe4ca2bb2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:29.605858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88734a91-b454-4773-938e-becbe4ca2bb2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:29.623988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7334d8-e282-49c0-bd83-e303ffad83cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:29.624539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7334d8-e282-49c0-bd83-e303ffad83cc admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:29.624824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7334d8-e282-49c0-bd83-e303ffad83cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:29.625099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7334d8-e282-49c0-bd83-e303ffad83cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:29.625979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7334d8-e282-49c0-bd83-e303ffad83cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:29.630182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7334d8-e282-49c0-bd83-e303ffad83cc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:29.665436 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1562/3122] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:07:29.667413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7334d8-e282-49c0-bd83-e303ffad83cc admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:29.673894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d9ac7-a9e9-4d50-a62c-dd767b9a39c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:29.674910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d9ac7-a9e9-4d50-a62c-dd767b9a39c6 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:29.675719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d9ac7-a9e9-4d50-a62c-dd767b9a39c6 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:29.676167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d9ac7-a9e9-4d50-a62c-dd767b9a39c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:29.690033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7334d8-e282-49c0-bd83-e303ffad83cc admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:29.701865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb61da2-b1a8-458a-9657-740cc09bfa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:29.702557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb61da2-b1a8-458a-9657-740cc09bfa4d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:29.702793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb61da2-b1a8-458a-9657-740cc09bfa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:29.703075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb61da2-b1a8-458a-9657-740cc09bfa4d admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:29.704160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb61da2-b1a8-458a-9657-740cc09bfa4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:29.705761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb61da2-b1a8-458a-9657-740cc09bfa4d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:29.731220 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1563/3123] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:29.735342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb61da2-b1a8-458a-9657-740cc09bfa4d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:29.740865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:29.752809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb61da2-b1a8-458a-9657-740cc09bfa4d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:29.766259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48a741-e0fa-474c-82c6-9b21dbafb718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:29.766965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48a741-e0fa-474c-82c6-9b21dbafb718 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:29.767248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48a741-e0fa-474c-82c6-9b21dbafb718 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:29.767565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48a741-e0fa-474c-82c6-9b21dbafb718 admin admin] PATH_INFO: `/v3/projects/036560fb7239447ba298591f4b86eed5/users/81c149d9fe404d6797e831cb5cd2f7eb/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:29.792018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d9ac7-a9e9-4d50-a62c-dd767b9a39c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:29.794497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d9ac7-a9e9-4d50-a62c-dd767b9a39c6 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:29.803074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48a741-e0fa-474c-82c6-9b21dbafb718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=036560fb7239447ba298591f4b86eed5, user_id=81c149d9fe404d6797e831cb5cd2f7eb, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:29.805821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48a741-e0fa-474c-82c6-9b21dbafb718 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:29.812920 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1561/3124] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:29.835339 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1564/3125] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:29 2022] PUT /identity/v3/projects/036560fb7239447ba298591f4b86eed5/users/81c149d9fe404d6797e831cb5cd2f7eb/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:07:29.854764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2b2ec-6676-4524-aa90-b0bfdfc11062 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:29.855055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2b2ec-6676-4524-aa90-b0bfdfc11062 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:29.855537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2b2ec-6676-4524-aa90-b0bfdfc11062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:29.904934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c7c2b2ec-6676-4524-aa90-b0bfdfc11062 None None] MFA Rules not processed for user `81c149d9fe404d6797e831cb5cd2f7eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:29.906118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c7c2b2ec-6676-4524-aa90-b0bfdfc11062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:30.042330 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1562/3126] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:30.205559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48a741-e0fa-474c-82c6-9b21dbafb718 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:30.336487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48a741-e0fa-474c-82c6-9b21dbafb718 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:30.353555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cd152-aac9-4c71-aab2-4087f21a3ec3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:30.354038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cd152-aac9-4c71-aab2-4087f21a3ec3 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:30.354331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cd152-aac9-4c71-aab2-4087f21a3ec3 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:30.354614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cd152-aac9-4c71-aab2-4087f21a3ec3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:30.366193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cd152-aac9-4c71-aab2-4087f21a3ec3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:30.367863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cd152-aac9-4c71-aab2-4087f21a3ec3 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:30.381354 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1565/3127] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:30.424592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e82d07-351c-4815-8aab-c6d375809376 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:30.425156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e82d07-351c-4815-8aab-c6d375809376 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:30.425156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e82d07-351c-4815-8aab-c6d375809376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:30.474665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:30.505698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-39e82d07-351c-4815-8aab-c6d375809376 None None] MFA Rules not processed for user `26bab5a783244ca9aa9668dd106e373f`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:30.507104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-39e82d07-351c-4815-8aab-c6d375809376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:30.655684 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1563/3128] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:31.225396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cd152-aac9-4c71-aab2-4087f21a3ec3 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:31.228866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a31cd152-aac9-4c71-aab2-4087f21a3ec3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:31.233219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e82d07-351c-4815-8aab-c6d375809376 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:31.263199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e82d07-351c-4815-8aab-c6d375809376 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:31.295429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55445a06-6f49-43ee-ab5b-c6cc539c7107 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:31.296664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55445a06-6f49-43ee-ab5b-c6cc539c7107 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:31.296664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55445a06-6f49-43ee-ab5b-c6cc539c7107 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:31.296664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55445a06-6f49-43ee-ab5b-c6cc539c7107 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:31.324188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55445a06-6f49-43ee-ab5b-c6cc539c7107 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:31.325804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55445a06-6f49-43ee-ab5b-c6cc539c7107 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:31.368044 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1564/3129] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:07:31.435185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cd152-aac9-4c71-aab2-4087f21a3ec3 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:31.461720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fd263-af2d-464c-8ac5-54cfb328a0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:31.462919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fd263-af2d-464c-8ac5-54cfb328a0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:31.463202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fd263-af2d-464c-8ac5-54cfb328a0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:31.463506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fd263-af2d-464c-8ac5-54cfb328a0e7 admin admin] PATH_INFO: `/v3/users/442abdff570f432e82775ce92c6b97b4` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:31.469523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fd263-af2d-464c-8ac5-54cfb328a0e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=442abdff570f432e82775ce92c6b97b4)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:31.471545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fd263-af2d-464c-8ac5-54cfb328a0e7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:31.525578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55445a06-6f49-43ee-ab5b-c6cc539c7107 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:31.549106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55445a06-6f49-43ee-ab5b-c6cc539c7107 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:31.570976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b03c2a-5c30-4fdc-a3dd-4e049f7f5a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:31.573704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b03c2a-5c30-4fdc-a3dd-4e049f7f5a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:31.574003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b03c2a-5c30-4fdc-a3dd-4e049f7f5a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:31.574288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b03c2a-5c30-4fdc-a3dd-4e049f7f5a33 admin admin] PATH_INFO: `/v3/users/81c149d9fe404d6797e831cb5cd2f7eb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:31.576051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b03c2a-5c30-4fdc-a3dd-4e049f7f5a33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81c149d9fe404d6797e831cb5cd2f7eb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:31.577886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b03c2a-5c30-4fdc-a3dd-4e049f7f5a33 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:31.596086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6a0fd263-af2d-464c-8ac5-54cfb328a0e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '442abdff570f432e82775ce92c6b97b4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:31.597899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6a0fd263-af2d-464c-8ac5-54cfb328a0e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '442abdff570f432e82775ce92c6b97b4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:31.616479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6a0fd263-af2d-464c-8ac5-54cfb328a0e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '442abdff570f432e82775ce92c6b97b4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:31.617694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6a0fd263-af2d-464c-8ac5-54cfb328a0e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '442abdff570f432e82775ce92c6b97b4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:31.619660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:31.639610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6a0fd263-af2d-464c-8ac5-54cfb328a0e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '442abdff570f432e82775ce92c6b97b4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:31.680353 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1566/3130] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:31 2022] DELETE /identity/v3/users/442abdff570f432e82775ce92c6b97b4 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:31.685316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e3e12-3ae8-4c37-b8fd-18f760eb99f9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:31.687512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e3e12-3ae8-4c37-b8fd-18f760eb99f9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:31.687815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e3e12-3ae8-4c37-b8fd-18f760eb99f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:31.724788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-91b03c2a-5c30-4fdc-a3dd-4e049f7f5a33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81c149d9fe404d6797e831cb5cd2f7eb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:31.738642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-390e3e12-3ae8-4c37-b8fd-18f760eb99f9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:31.740647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-390e3e12-3ae8-4c37-b8fd-18f760eb99f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:31.749087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-91b03c2a-5c30-4fdc-a3dd-4e049f7f5a33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81c149d9fe404d6797e831cb5cd2f7eb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:31.750144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-91b03c2a-5c30-4fdc-a3dd-4e049f7f5a33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81c149d9fe404d6797e831cb5cd2f7eb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:31.759739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-91b03c2a-5c30-4fdc-a3dd-4e049f7f5a33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81c149d9fe404d6797e831cb5cd2f7eb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:31.760964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-91b03c2a-5c30-4fdc-a3dd-4e049f7f5a33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81c149d9fe404d6797e831cb5cd2f7eb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:31.801358 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1565/3131] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:31 2022] DELETE /identity/v3/users/81c149d9fe404d6797e831cb5cd2f7eb => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:07:31.803917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4c853-ccef-4fd5-8519-26630700c960 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:31.803917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4c853-ccef-4fd5-8519-26630700c960 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:31.804286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4c853-ccef-4fd5-8519-26630700c960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:31.863390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-69a4c853-ccef-4fd5-8519-26630700c960 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:31.866546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-69a4c853-ccef-4fd5-8519-26630700c960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:31.910706 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1567/3132] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:32.022126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e3e12-3ae8-4c37-b8fd-18f760eb99f9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:32.043124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-390e3e12-3ae8-4c37-b8fd-18f760eb99f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:32.078119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:32.111987 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1566/3133] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:32.163073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4c853-ccef-4fd5-8519-26630700c960 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:32.165102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-69a4c853-ccef-4fd5-8519-26630700c960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:32.203199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e3e12-3ae8-4c37-b8fd-18f760eb99f9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:32.352314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4c853-ccef-4fd5-8519-26630700c960 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:32.357333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5cbf1-3a53-4ca0-b90f-939260635ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:32.358165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5cbf1-3a53-4ca0-b90f-939260635ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:32.358450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5cbf1-3a53-4ca0-b90f-939260635ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:32.358822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5cbf1-3a53-4ca0-b90f-939260635ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:32.370143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeddee1-1aa7-4ec7-bdd2-ed884f359696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:32.370726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeddee1-1aa7-4ec7-bdd2-ed884f359696 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:32.371141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeddee1-1aa7-4ec7-bdd2-ed884f359696 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:32.371553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeddee1-1aa7-4ec7-bdd2-ed884f359696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:32.395396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeddee1-1aa7-4ec7-bdd2-ed884f359696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:32.397572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeddee1-1aa7-4ec7-bdd2-ed884f359696 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:32.410992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5cbf1-3a53-4ca0-b90f-939260635ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:32.415030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5cbf1-3a53-4ca0-b90f-939260635ba1 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:32.422989 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1567/3134] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:32.448112 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1568/3135] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:07:34.313461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeddee1-1aa7-4ec7-bdd2-ed884f359696 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:34.315156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bfeddee1-1aa7-4ec7-bdd2-ed884f359696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:34.346478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeddee1-1aa7-4ec7-bdd2-ed884f359696 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:34.365297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5459a-e4d9-4f91-b507-41fa00462aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:34.366126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5459a-e4d9-4f91-b507-41fa00462aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:34.366424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5459a-e4d9-4f91-b507-41fa00462aac admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:34.366707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5459a-e4d9-4f91-b507-41fa00462aac admin admin] PATH_INFO: `/v3/projects/dc54e6feb6974e74992e151e1cb97ba0` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:34.369036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5459a-e4d9-4f91-b507-41fa00462aac admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc54e6feb6974e74992e151e1cb97ba0)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:34.378157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5459a-e4d9-4f91-b507-41fa00462aac admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:34.482759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93a5459a-e4d9-4f91-b507-41fa00462aac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc54e6feb6974e74992e151e1cb97ba0', 'request_id': 'req-93a5459a-e4d9-4f91-b507-41fa00462aac'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:34.497755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93a5459a-e4d9-4f91-b507-41fa00462aac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc54e6feb6974e74992e151e1cb97ba0', 'request_id': 'req-93a5459a-e4d9-4f91-b507-41fa00462aac'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:34.514639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93a5459a-e4d9-4f91-b507-41fa00462aac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc54e6feb6974e74992e151e1cb97ba0', 'request_id': 'req-93a5459a-e4d9-4f91-b507-41fa00462aac'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:34.531491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93a5459a-e4d9-4f91-b507-41fa00462aac admin admin] The token cache is being invalidate because project dc54e6feb6974e74992e151e1cb97ba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:34.532059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93a5459a-e4d9-4f91-b507-41fa00462aac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:34.533813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93a5459a-e4d9-4f91-b507-41fa00462aac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:34.536668 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1568/3136] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:34 2022] DELETE /identity/v3/projects/dc54e6feb6974e74992e151e1cb97ba0 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:34.540658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5cbf1-3a53-4ca0-b90f-939260635ba1 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:34.550982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5cbf1-3a53-4ca0-b90f-939260635ba1 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:34.631787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:34.687446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99a7c8-b7de-4ecc-a0fe-9a8294f7aec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:34.688455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99a7c8-b7de-4ecc-a0fe-9a8294f7aec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:34.688915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99a7c8-b7de-4ecc-a0fe-9a8294f7aec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:34.689363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99a7c8-b7de-4ecc-a0fe-9a8294f7aec9 admin admin] PATH_INFO: `/v3/users/347ececef391450da8dd4163980db907` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:34.691200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99a7c8-b7de-4ecc-a0fe-9a8294f7aec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=347ececef391450da8dd4163980db907)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:34.693593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99a7c8-b7de-4ecc-a0fe-9a8294f7aec9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:34.793560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb99a7c8-b7de-4ecc-a0fe-9a8294f7aec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '347ececef391450da8dd4163980db907'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:34.798854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb99a7c8-b7de-4ecc-a0fe-9a8294f7aec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '347ececef391450da8dd4163980db907'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:34.856265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb99a7c8-b7de-4ecc-a0fe-9a8294f7aec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '347ececef391450da8dd4163980db907'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:34.858704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb99a7c8-b7de-4ecc-a0fe-9a8294f7aec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '347ececef391450da8dd4163980db907'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:34.879392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb99a7c8-b7de-4ecc-a0fe-9a8294f7aec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '347ececef391450da8dd4163980db907'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:34.927945 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1569/3137] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:34 2022] DELETE /identity/v3/users/347ececef391450da8dd4163980db907 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:07:34.938101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5459a-e4d9-4f91-b507-41fa00462aac admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:34.940272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-93a5459a-e4d9-4f91-b507-41fa00462aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:34.965290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5459a-e4d9-4f91-b507-41fa00462aac admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:35.140372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89599b9-6e70-444d-a4b6-27d3ab8db2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:35.141050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89599b9-6e70-444d-a4b6-27d3ab8db2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:35.141340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89599b9-6e70-444d-a4b6-27d3ab8db2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:35.141627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89599b9-6e70-444d-a4b6-27d3ab8db2b1 admin admin] PATH_INFO: `/v3/projects/036560fb7239447ba298591f4b86eed5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:35.147637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89599b9-6e70-444d-a4b6-27d3ab8db2b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=036560fb7239447ba298591f4b86eed5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:35.153714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89599b9-6e70-444d-a4b6-27d3ab8db2b1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:35.231602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:35.266898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f89599b9-6e70-444d-a4b6-27d3ab8db2b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '036560fb7239447ba298591f4b86eed5', 'request_id': 'req-f89599b9-6e70-444d-a4b6-27d3ab8db2b1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:35.282105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f89599b9-6e70-444d-a4b6-27d3ab8db2b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '036560fb7239447ba298591f4b86eed5', 'request_id': 'req-f89599b9-6e70-444d-a4b6-27d3ab8db2b1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:35.300935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f89599b9-6e70-444d-a4b6-27d3ab8db2b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '036560fb7239447ba298591f4b86eed5', 'request_id': 'req-f89599b9-6e70-444d-a4b6-27d3ab8db2b1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:35.345699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f89599b9-6e70-444d-a4b6-27d3ab8db2b1 admin admin] The token cache is being invalidate because project 036560fb7239447ba298591f4b86eed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:35.347650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f89599b9-6e70-444d-a4b6-27d3ab8db2b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:35.349851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f89599b9-6e70-444d-a4b6-27d3ab8db2b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:35.362917 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1569/3138] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:34 2022] DELETE /identity/v3/projects/036560fb7239447ba298591f4b86eed5 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:35.368102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee45db1-01da-48dd-bc2a-b503288a2a56 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:35.368890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee45db1-01da-48dd-bc2a-b503288a2a56 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:35.369360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee45db1-01da-48dd-bc2a-b503288a2a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:35.416275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bee45db1-01da-48dd-bc2a-b503288a2a56 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:35.417858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bee45db1-01da-48dd-bc2a-b503288a2a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:35.597125 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1570/3139] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:35.605088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cb3d9-228e-4cc6-a976-c5e87ec8c19b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:35.605378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cb3d9-228e-4cc6-a976-c5e87ec8c19b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:35.605664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cb3d9-228e-4cc6-a976-c5e87ec8c19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:35.686318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ee0cb3d9-228e-4cc6-a976-c5e87ec8c19b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:35.687822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ee0cb3d9-228e-4cc6-a976-c5e87ec8c19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:35.725134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee45db1-01da-48dd-bc2a-b503288a2a56 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:35.746266 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1570/3140] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:35.754147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee45db1-01da-48dd-bc2a-b503288a2a56 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:35.769314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f0a09-1ccf-48cc-ac45-48222785bfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:35.771000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f0a09-1ccf-48cc-ac45-48222785bfa6 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:35.772361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f0a09-1ccf-48cc-ac45-48222785bfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:35.786259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f0a09-1ccf-48cc-ac45-48222785bfa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:35.789636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f0a09-1ccf-48cc-ac45-48222785bfa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:07:35.791557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f0a09-1ccf-48cc-ac45-48222785bfa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:35.804102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f0a09-1ccf-48cc-ac45-48222785bfa6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:35.853137 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1571/3141] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:35.857181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cb3d9-228e-4cc6-a976-c5e87ec8c19b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:35.874876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cb3d9-228e-4cc6-a976-c5e87ec8c19b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:35.893802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92033e1-7d93-44ce-b760-545777274bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:35.894493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92033e1-7d93-44ce-b760-545777274bed admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:35.894785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92033e1-7d93-44ce-b760-545777274bed admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:35.895067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92033e1-7d93-44ce-b760-545777274bed admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:35.896037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92033e1-7d93-44ce-b760-545777274bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:35.914020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92033e1-7d93-44ce-b760-545777274bed admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:36.043383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f0a09-1ccf-48cc-ac45-48222785bfa6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:36.043726 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1571/3142] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:07:35 2022] POST /identity/v3/projects => generated 381 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:36.066086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f0a09-1ccf-48cc-ac45-48222785bfa6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:36.186928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:36.216040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd69c3-acc7-4c31-ab14-159855a3453b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:36.217106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd69c3-acc7-4c31-ab14-159855a3453b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:36.218079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd69c3-acc7-4c31-ab14-159855a3453b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:36.218624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd69c3-acc7-4c31-ab14-159855a3453b admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:36.220206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd69c3-acc7-4c31-ab14-159855a3453b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:36.232948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd69c3-acc7-4c31-ab14-159855a3453b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:36.267755 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1572/3143] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:07:36 2022] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:36.271827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92033e1-7d93-44ce-b760-545777274bed admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:36.284849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92033e1-7d93-44ce-b760-545777274bed admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:36.291865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fadf8f-4c19-4946-8d7b-e05f30cf7444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:36.292598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fadf8f-4c19-4946-8d7b-e05f30cf7444 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:36.292966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fadf8f-4c19-4946-8d7b-e05f30cf7444 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:36.293320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fadf8f-4c19-4946-8d7b-e05f30cf7444 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:36.294461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fadf8f-4c19-4946-8d7b-e05f30cf7444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:36.296437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fadf8f-4c19-4946-8d7b-e05f30cf7444 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:36.312976 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1572/3144] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:07:36.316880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd69c3-acc7-4c31-ab14-159855a3453b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:36.334274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd69c3-acc7-4c31-ab14-159855a3453b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:36.339776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d95f40-6044-425c-9e2c-6b00f77aa4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:36.340479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d95f40-6044-425c-9e2c-6b00f77aa4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:36.340836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d95f40-6044-425c-9e2c-6b00f77aa4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:36.341753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d95f40-6044-425c-9e2c-6b00f77aa4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:36.343262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d95f40-6044-425c-9e2c-6b00f77aa4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:36.345153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d95f40-6044-425c-9e2c-6b00f77aa4b7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:36.366561 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1573/3145] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:36.367173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fadf8f-4c19-4946-8d7b-e05f30cf7444 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:36.386171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fadf8f-4c19-4946-8d7b-e05f30cf7444 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:36.397218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4dedd-024c-4f4b-844d-3275e6ebd863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:36.398919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4dedd-024c-4f4b-844d-3275e6ebd863 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:36.399461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4dedd-024c-4f4b-844d-3275e6ebd863 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:36.400920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4dedd-024c-4f4b-844d-3275e6ebd863 admin admin] PATH_INFO: `/v3/projects/176b72696f4c4dc59d3f6dd23d896fe2/users/a3bdc00668764e1e978d72f4607531c6/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:36.439478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76921f72-b960-4a6a-9319-bdb753f1bcdb None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:36.440109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76921f72-b960-4a6a-9319-bdb753f1bcdb None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:36.440745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76921f72-b960-4a6a-9319-bdb753f1bcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:36.465729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4dedd-024c-4f4b-844d-3275e6ebd863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=176b72696f4c4dc59d3f6dd23d896fe2, user_id=a3bdc00668764e1e978d72f4607531c6, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:36.476323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4dedd-024c-4f4b-844d-3275e6ebd863 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:36.517808 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1573/3146] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:36 2022] PUT /identity/v3/projects/176b72696f4c4dc59d3f6dd23d896fe2/users/a3bdc00668764e1e978d72f4607531c6/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:36.520365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f7076-92c0-41d4-9776-e5a6d136299b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:36.521494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f7076-92c0-41d4-9776-e5a6d136299b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:36.521494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f7076-92c0-41d4-9776-e5a6d136299b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:36.526804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-76921f72-b960-4a6a-9319-bdb753f1bcdb None None] MFA Rules not processed for user `2517a20b0358424480784b0003512d50`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:36.528041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-76921f72-b960-4a6a-9319-bdb753f1bcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:36.584158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0e7f7076-92c0-41d4-9776-e5a6d136299b None None] MFA Rules not processed for user `a3bdc00668764e1e978d72f4607531c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:36.585803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0e7f7076-92c0-41d4-9776-e5a6d136299b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:36.673014 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1574/3147] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:36.685662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128f176-8eb1-41d4-a405-f0b78c7c776b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:36.686052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128f176-8eb1-41d4-a405-f0b78c7c776b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:36.686259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128f176-8eb1-41d4-a405-f0b78c7c776b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:36.748346 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1574/3148] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:36.760772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f7076-92c0-41d4-9776-e5a6d136299b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:36.762349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f128f176-8eb1-41d4-a405-f0b78c7c776b None None] MFA Rules not processed for user `2517a20b0358424480784b0003512d50`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:36.762704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0e7f7076-92c0-41d4-9776-e5a6d136299b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:36.767523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f128f176-8eb1-41d4-a405-f0b78c7c776b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:36.789924 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1575/3149] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:36.864903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:36.926292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f7076-92c0-41d4-9776-e5a6d136299b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:36.933335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d59932-41fb-426b-a2b8-929a9a20db3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:36.933644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d59932-41fb-426b-a2b8-929a9a20db3c service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:36.934236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d59932-41fb-426b-a2b8-929a9a20db3c service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:36.934575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d59932-41fb-426b-a2b8-929a9a20db3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:36.944596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d59932-41fb-426b-a2b8-929a9a20db3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:36.948379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d59932-41fb-426b-a2b8-929a9a20db3c service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:36.965820 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1575/3150] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:37.034537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128f176-8eb1-41d4-a405-f0b78c7c776b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:37.042984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d59932-41fb-426b-a2b8-929a9a20db3c service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:37.069957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128f176-8eb1-41d4-a405-f0b78c7c776b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:37.093170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c41021-cfd2-4f2a-af9f-51fcd904429e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:37.094153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c41021-cfd2-4f2a-af9f-51fcd904429e service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:37.094153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c41021-cfd2-4f2a-af9f-51fcd904429e service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:37.095965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c41021-cfd2-4f2a-af9f-51fcd904429e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:37.125937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c41021-cfd2-4f2a-af9f-51fcd904429e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:37.128945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c41021-cfd2-4f2a-af9f-51fcd904429e service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:37.156437 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1576/3151] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:37.213753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d59932-41fb-426b-a2b8-929a9a20db3c service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:37.218945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2429b-f557-4eb6-85b2-03e814a7704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:37.219843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2429b-f557-4eb6-85b2-03e814a7704f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:37.220292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2429b-f557-4eb6-85b2-03e814a7704f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:37.220570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2429b-f557-4eb6-85b2-03e814a7704f admin admin] PATH_INFO: `/v3/users/a3bdc00668764e1e978d72f4607531c6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:37.221835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2429b-f557-4eb6-85b2-03e814a7704f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3bdc00668764e1e978d72f4607531c6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:37.230550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2429b-f557-4eb6-85b2-03e814a7704f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:37.356086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6ae2429b-f557-4eb6-85b2-03e814a7704f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3bdc00668764e1e978d72f4607531c6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:37.395005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6ae2429b-f557-4eb6-85b2-03e814a7704f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3bdc00668764e1e978d72f4607531c6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:37.397914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6ae2429b-f557-4eb6-85b2-03e814a7704f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3bdc00668764e1e978d72f4607531c6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:37.418644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6ae2429b-f557-4eb6-85b2-03e814a7704f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3bdc00668764e1e978d72f4607531c6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:37.423336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6ae2429b-f557-4eb6-85b2-03e814a7704f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3bdc00668764e1e978d72f4607531c6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:37.506275 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1576/3152] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:37 2022] DELETE /identity/v3/users/a3bdc00668764e1e978d72f4607531c6 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:07:37.514293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628b4a9-a46f-4b54-92c4-3bf8ba7e97b9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:37.514815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628b4a9-a46f-4b54-92c4-3bf8ba7e97b9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:37.515663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628b4a9-a46f-4b54-92c4-3bf8ba7e97b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:37.557374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d628b4a9-a46f-4b54-92c4-3bf8ba7e97b9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:37.563823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d628b4a9-a46f-4b54-92c4-3bf8ba7e97b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:37.722665 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1577/3153] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:37.935810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2429b-f557-4eb6-85b2-03e814a7704f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:37.937869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6ae2429b-f557-4eb6-85b2-03e814a7704f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:38.094209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:38.121768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2429b-f557-4eb6-85b2-03e814a7704f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:38.127576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f4d4d-7f94-485d-83c3-7a4d7e5f3956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:38.129133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f4d4d-7f94-485d-83c3-7a4d7e5f3956 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:38.129612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f4d4d-7f94-485d-83c3-7a4d7e5f3956 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:38.130367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f4d4d-7f94-485d-83c3-7a4d7e5f3956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:38.144490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f4d4d-7f94-485d-83c3-7a4d7e5f3956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:38.146524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f4d4d-7f94-485d-83c3-7a4d7e5f3956 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:38.158983 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1577/3154] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:38.261050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628b4a9-a46f-4b54-92c4-3bf8ba7e97b9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:38.262681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d628b4a9-a46f-4b54-92c4-3bf8ba7e97b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:38.285878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628b4a9-a46f-4b54-92c4-3bf8ba7e97b9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:38.301705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ce35c-811d-44e4-9198-d749e9badc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:38.302969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ce35c-811d-44e4-9198-d749e9badc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:38.304798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ce35c-811d-44e4-9198-d749e9badc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:38.305126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ce35c-811d-44e4-9198-d749e9badc48 admin admin] PATH_INFO: `/v3/projects/4c5d0fe393624cdbac1b3bd7ac6832fe` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:38.310677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ce35c-811d-44e4-9198-d749e9badc48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c5d0fe393624cdbac1b3bd7ac6832fe)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:38.317687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ce35c-811d-44e4-9198-d749e9badc48 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:38.439052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:38.480543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-629ce35c-811d-44e4-9198-d749e9badc48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c5d0fe393624cdbac1b3bd7ac6832fe', 'request_id': 'req-629ce35c-811d-44e4-9198-d749e9badc48'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:38.499636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-629ce35c-811d-44e4-9198-d749e9badc48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c5d0fe393624cdbac1b3bd7ac6832fe', 'request_id': 'req-629ce35c-811d-44e4-9198-d749e9badc48'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:38.513003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-629ce35c-811d-44e4-9198-d749e9badc48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c5d0fe393624cdbac1b3bd7ac6832fe', 'request_id': 'req-629ce35c-811d-44e4-9198-d749e9badc48'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:38.563056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-629ce35c-811d-44e4-9198-d749e9badc48 admin admin] The token cache is being invalidate because project 4c5d0fe393624cdbac1b3bd7ac6832fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:38.563503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-629ce35c-811d-44e4-9198-d749e9badc48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:38.571108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-629ce35c-811d-44e4-9198-d749e9badc48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:38.579631 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1578/3155] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:38 2022] DELETE /identity/v3/projects/4c5d0fe393624cdbac1b3bd7ac6832fe => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:38.585060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dcb3d-f19c-4e0e-943d-3119a3cee663 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:38.585940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dcb3d-f19c-4e0e-943d-3119a3cee663 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:38.586134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dcb3d-f19c-4e0e-943d-3119a3cee663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:38.642153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c52dcb3d-f19c-4e0e-943d-3119a3cee663 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:38.647513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c52dcb3d-f19c-4e0e-943d-3119a3cee663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:38.828615 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1578/3156] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:38.839569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d7244-be36-437c-a21c-9b2787469374 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:38.840315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d7244-be36-437c-a21c-9b2787469374 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:38.840460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d7244-be36-437c-a21c-9b2787469374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:38.881553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-884d7244-be36-437c-a21c-9b2787469374 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:38.882818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-884d7244-be36-437c-a21c-9b2787469374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:38.895807 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1579/3157] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:38.898321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52dcb3d-f19c-4e0e-943d-3119a3cee663 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:38.924309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52dcb3d-f19c-4e0e-943d-3119a3cee663 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:38.937747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602ebf0-3efa-45b2-aefc-35cb7afae0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:38.938626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602ebf0-3efa-45b2-aefc-35cb7afae0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:38.939076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602ebf0-3efa-45b2-aefc-35cb7afae0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:38.939615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602ebf0-3efa-45b2-aefc-35cb7afae0a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:38.940536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602ebf0-3efa-45b2-aefc-35cb7afae0a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:07:38.941036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602ebf0-3efa-45b2-aefc-35cb7afae0a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:38.943071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602ebf0-3efa-45b2-aefc-35cb7afae0a7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:38.976718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d7244-be36-437c-a21c-9b2787469374 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:38.996275 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1579/3158] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:39.004186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d7244-be36-437c-a21c-9b2787469374 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:39.014414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6bc51-9e8d-48d0-bf7c-0b4c2cf201a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:39.015496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6bc51-9e8d-48d0-bf7c-0b4c2cf201a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:39.016040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6bc51-9e8d-48d0-bf7c-0b4c2cf201a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:39.016518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6bc51-9e8d-48d0-bf7c-0b4c2cf201a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:39.017844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6bc51-9e8d-48d0-bf7c-0b4c2cf201a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:39.020752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6bc51-9e8d-48d0-bf7c-0b4c2cf201a8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:39.081375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602ebf0-3efa-45b2-aefc-35cb7afae0a7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:39.092317 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1580/3159] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:07:38 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:39.106998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602ebf0-3efa-45b2-aefc-35cb7afae0a7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:39.311405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd93d5-8d72-4226-b738-8181e129d4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:39.312289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd93d5-8d72-4226-b738-8181e129d4ac admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:39.314180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd93d5-8d72-4226-b738-8181e129d4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:39.314180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd93d5-8d72-4226-b738-8181e129d4ac admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:39.317373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd93d5-8d72-4226-b738-8181e129d4ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:39.323058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd93d5-8d72-4226-b738-8181e129d4ac admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:39.377428 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1580/3160] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:07:39 2022] POST /identity/v3/users => generated 293 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:39.381788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6bc51-9e8d-48d0-bf7c-0b4c2cf201a8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:39.396577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6bc51-9e8d-48d0-bf7c-0b4c2cf201a8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:39.407881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b417f-85bb-440e-9dd1-9aecbfd732d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:39.408835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b417f-85bb-440e-9dd1-9aecbfd732d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:39.409298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b417f-85bb-440e-9dd1-9aecbfd732d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:39.410127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b417f-85bb-440e-9dd1-9aecbfd732d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:39.411854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b417f-85bb-440e-9dd1-9aecbfd732d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:39.415180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b417f-85bb-440e-9dd1-9aecbfd732d4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:39.447706 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1581/3161] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:39.451820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd93d5-8d72-4226-b738-8181e129d4ac admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:39.464852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd93d5-8d72-4226-b738-8181e129d4ac admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:39.470412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50ecb4-c38e-4f59-99bf-f82e1061080e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:39.470585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50ecb4-c38e-4f59-99bf-f82e1061080e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:39.470843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50ecb4-c38e-4f59-99bf-f82e1061080e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:39.471124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50ecb4-c38e-4f59-99bf-f82e1061080e admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:39.471963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50ecb4-c38e-4f59-99bf-f82e1061080e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:39.473448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50ecb4-c38e-4f59-99bf-f82e1061080e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:39.485435 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1581/3162] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:39.489846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b417f-85bb-440e-9dd1-9aecbfd732d4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:39.501354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b417f-85bb-440e-9dd1-9aecbfd732d4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:39.508341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633abb6-29f2-4d4c-ac85-e5aed584d197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:39.509328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633abb6-29f2-4d4c-ac85-e5aed584d197 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:39.509992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633abb6-29f2-4d4c-ac85-e5aed584d197 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:39.510439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633abb6-29f2-4d4c-ac85-e5aed584d197 admin admin] PATH_INFO: `/v3/projects/b5d767c7241946c7928e33c6afac22fd/users/bc0c452f4dce4f5d928fa8d1fcf901be/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:39.552999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633abb6-29f2-4d4c-ac85-e5aed584d197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d767c7241946c7928e33c6afac22fd, user_id=bc0c452f4dce4f5d928fa8d1fcf901be, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:39.556303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633abb6-29f2-4d4c-ac85-e5aed584d197 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:39.597251 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1582/3163] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:39 2022] PUT /identity/v3/projects/b5d767c7241946c7928e33c6afac22fd/users/bc0c452f4dce4f5d928fa8d1fcf901be/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:07:39.616126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174edba-e55a-4097-bfeb-1e6e071957bb None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:39.617270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174edba-e55a-4097-bfeb-1e6e071957bb None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:39.617802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174edba-e55a-4097-bfeb-1e6e071957bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:39.691424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-6174edba-e55a-4097-bfeb-1e6e071957bb None None] MFA Rules not processed for user `bc0c452f4dce4f5d928fa8d1fcf901be`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:39.697112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6174edba-e55a-4097-bfeb-1e6e071957bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:39.822198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:39.859781 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1582/3164] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:39.865119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633abb6-29f2-4d4c-ac85-e5aed584d197 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:40.018713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633abb6-29f2-4d4c-ac85-e5aed584d197 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:40.031373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15223032-0c7f-450d-99e8-b8cb80cb5f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:40.033989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15223032-0c7f-450d-99e8-b8cb80cb5f4e admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:40.034384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15223032-0c7f-450d-99e8-b8cb80cb5f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:40.034763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15223032-0c7f-450d-99e8-b8cb80cb5f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:40.040869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15223032-0c7f-450d-99e8-b8cb80cb5f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:40.044137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15223032-0c7f-450d-99e8-b8cb80cb5f4e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:40.101208 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1583/3165] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:07:39 2022] POST /identity/v3/projects => generated 385 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:40.103367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174edba-e55a-4097-bfeb-1e6e071957bb None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:40.119225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174edba-e55a-4097-bfeb-1e6e071957bb None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:40.240321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eaae5-34a1-4fdd-8b97-59619f68a5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:40.241076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eaae5-34a1-4fdd-8b97-59619f68a5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:40.241685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eaae5-34a1-4fdd-8b97-59619f68a5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:40.242089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eaae5-34a1-4fdd-8b97-59619f68a5f4 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:40.242789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eaae5-34a1-4fdd-8b97-59619f68a5f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:40.245306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eaae5-34a1-4fdd-8b97-59619f68a5f4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:40.285203 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1583/3166] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:07:40 2022] POST /identity/v3/users => generated 299 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:40.291055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15223032-0c7f-450d-99e8-b8cb80cb5f4e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:40.307042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15223032-0c7f-450d-99e8-b8cb80cb5f4e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:40.336571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6522f-581a-47c4-afc5-eae01c4e5aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:40.337954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6522f-581a-47c4-afc5-eae01c4e5aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:40.338704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6522f-581a-47c4-afc5-eae01c4e5aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:40.339234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6522f-581a-47c4-afc5-eae01c4e5aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:40.341775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6522f-581a-47c4-afc5-eae01c4e5aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:40.345768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6522f-581a-47c4-afc5-eae01c4e5aa6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:40.369366 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1584/3167] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:40.379999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eaae5-34a1-4fdd-8b97-59619f68a5f4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:40.392507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eaae5-34a1-4fdd-8b97-59619f68a5f4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:40.417566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38798b-1e6f-4cd8-8d62-23077e9b9274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:40.418476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38798b-1e6f-4cd8-8d62-23077e9b9274 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:40.418919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38798b-1e6f-4cd8-8d62-23077e9b9274 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:40.419244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38798b-1e6f-4cd8-8d62-23077e9b9274 admin admin] PATH_INFO: `/v3/projects/dff522848feb4091b8ccdcb7d55974e7/users/5dcd1b23eb0c41979cd32c5ed1ec0532/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:40.456356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38798b-1e6f-4cd8-8d62-23077e9b9274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dff522848feb4091b8ccdcb7d55974e7, user_id=5dcd1b23eb0c41979cd32c5ed1ec0532, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:40.475496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38798b-1e6f-4cd8-8d62-23077e9b9274 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:40.518793 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1584/3168] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:40 2022] PUT /identity/v3/projects/dff522848feb4091b8ccdcb7d55974e7/users/5dcd1b23eb0c41979cd32c5ed1ec0532/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:40.523193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6522f-581a-47c4-afc5-eae01c4e5aa6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:40.548544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6522f-581a-47c4-afc5-eae01c4e5aa6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:40.630893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:40.694703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490891e-76e4-49a6-8949-27c128647d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:40.695351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490891e-76e4-49a6-8949-27c128647d3b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:40.695883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490891e-76e4-49a6-8949-27c128647d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:40.696933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490891e-76e4-49a6-8949-27c128647d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:40.698883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490891e-76e4-49a6-8949-27c128647d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:40.700972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490891e-76e4-49a6-8949-27c128647d3b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:40.714712 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1585/3169] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:40.719677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38798b-1e6f-4cd8-8d62-23077e9b9274 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:40.733957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38798b-1e6f-4cd8-8d62-23077e9b9274 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:40.748633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdf515-0370-43b3-ad4d-7207127a4ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:40.749941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdf515-0370-43b3-ad4d-7207127a4ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:40.750451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdf515-0370-43b3-ad4d-7207127a4ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:40.750946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdf515-0370-43b3-ad4d-7207127a4ffa admin admin] PATH_INFO: `/v3/projects/dff522848feb4091b8ccdcb7d55974e7/users/5dcd1b23eb0c41979cd32c5ed1ec0532/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:40.756113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdf515-0370-43b3-ad4d-7207127a4ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=dff522848feb4091b8ccdcb7d55974e7, user_id=5dcd1b23eb0c41979cd32c5ed1ec0532, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:40.760199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdf515-0370-43b3-ad4d-7207127a4ffa admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:40.778663 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1585/3170] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:40 2022] PUT /identity/v3/projects/dff522848feb4091b8ccdcb7d55974e7/users/5dcd1b23eb0c41979cd32c5ed1ec0532/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:40.793607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbeb34-08de-44f4-b28c-e62596f02dc2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:40.793896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbeb34-08de-44f4-b28c-e62596f02dc2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:40.794182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbeb34-08de-44f4-b28c-e62596f02dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:40.878754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9bbbeb34-08de-44f4-b28c-e62596f02dc2 None None] MFA Rules not processed for user `5dcd1b23eb0c41979cd32c5ed1ec0532`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:40.880277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9bbbeb34-08de-44f4-b28c-e62596f02dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:41.132430 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1586/3171] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:41.146889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdf515-0370-43b3-ad4d-7207127a4ffa admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:41.149002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-34bdf515-0370-43b3-ad4d-7207127a4ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:41.261574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdf515-0370-43b3-ad4d-7207127a4ffa admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:41.268185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25170c0-bbf0-4997-b0bc-a3d6647fe9e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:41.269422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25170c0-bbf0-4997-b0bc-a3d6647fe9e0 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:41.270258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25170c0-bbf0-4997-b0bc-a3d6647fe9e0 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:41.270258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25170c0-bbf0-4997-b0bc-a3d6647fe9e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:41.289950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25170c0-bbf0-4997-b0bc-a3d6647fe9e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:41.292529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25170c0-bbf0-4997-b0bc-a3d6647fe9e0 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:41.307210 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1586/3172] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:41.547330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbeb34-08de-44f4-b28c-e62596f02dc2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:41.548928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9bbbeb34-08de-44f4-b28c-e62596f02dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:41.716353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbeb34-08de-44f4-b28c-e62596f02dc2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:41.724814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636bbea-d122-48e5-84e7-6a313a98ee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:41.725489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636bbea-d122-48e5-84e7-6a313a98ee95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:41.725773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636bbea-d122-48e5-84e7-6a313a98ee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:41.726053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636bbea-d122-48e5-84e7-6a313a98ee95 admin admin] PATH_INFO: `/v3/projects/176b72696f4c4dc59d3f6dd23d896fe2` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:41.727264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636bbea-d122-48e5-84e7-6a313a98ee95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=176b72696f4c4dc59d3f6dd23d896fe2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:41.729861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636bbea-d122-48e5-84e7-6a313a98ee95 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:41.796510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5636bbea-d122-48e5-84e7-6a313a98ee95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176b72696f4c4dc59d3f6dd23d896fe2', 'request_id': 'req-5636bbea-d122-48e5-84e7-6a313a98ee95'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:41.802640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:41.816876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5636bbea-d122-48e5-84e7-6a313a98ee95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176b72696f4c4dc59d3f6dd23d896fe2', 'request_id': 'req-5636bbea-d122-48e5-84e7-6a313a98ee95'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:41.824109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5636bbea-d122-48e5-84e7-6a313a98ee95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176b72696f4c4dc59d3f6dd23d896fe2', 'request_id': 'req-5636bbea-d122-48e5-84e7-6a313a98ee95'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:41.838922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5636bbea-d122-48e5-84e7-6a313a98ee95 admin admin] The token cache is being invalidate because project 176b72696f4c4dc59d3f6dd23d896fe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:41.839201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5636bbea-d122-48e5-84e7-6a313a98ee95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:41.840200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5636bbea-d122-48e5-84e7-6a313a98ee95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:41.845356 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1587/3173] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:41 2022] DELETE /identity/v3/projects/176b72696f4c4dc59d3f6dd23d896fe2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:41.847565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e790d-4e82-47a8-9da8-d15edb2170da None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:41.848082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e790d-4e82-47a8-9da8-d15edb2170da None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:41.848361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e790d-4e82-47a8-9da8-d15edb2170da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:41.874165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a34e790d-4e82-47a8-9da8-d15edb2170da None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:41.875635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a34e790d-4e82-47a8-9da8-d15edb2170da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:41.897506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:41.980186 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1587/3174] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:41.988871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7655c-7e5e-478d-8a54-aaf50ab909da None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:41.989398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7655c-7e5e-478d-8a54-aaf50ab909da None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:41.989594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7655c-7e5e-478d-8a54-aaf50ab909da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:42.042105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6af7655c-7e5e-478d-8a54-aaf50ab909da None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:42.044483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6af7655c-7e5e-478d-8a54-aaf50ab909da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:42.059351 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1588/3175] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:42.059999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e790d-4e82-47a8-9da8-d15edb2170da None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:42.070530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7655c-7e5e-478d-8a54-aaf50ab909da None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:42.074133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e790d-4e82-47a8-9da8-d15edb2170da None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:42.075852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6af7655c-7e5e-478d-8a54-aaf50ab909da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:42.086303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06435ffc-60f2-49e5-b8a4-91a1219a0805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:42.086712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06435ffc-60f2-49e5-b8a4-91a1219a0805 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:42.087119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06435ffc-60f2-49e5-b8a4-91a1219a0805 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:42.087921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06435ffc-60f2-49e5-b8a4-91a1219a0805 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:42.088646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06435ffc-60f2-49e5-b8a4-91a1219a0805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:07:42.090918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06435ffc-60f2-49e5-b8a4-91a1219a0805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:42.094380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06435ffc-60f2-49e5-b8a4-91a1219a0805 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:42.116166 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1588/3176] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:42.120363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06435ffc-60f2-49e5-b8a4-91a1219a0805 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:42.136156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06435ffc-60f2-49e5-b8a4-91a1219a0805 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:42.155495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9322aa6-b1cd-44a4-9970-5bc845a5c5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:42.156451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9322aa6-b1cd-44a4-9970-5bc845a5c5ca admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:42.156840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9322aa6-b1cd-44a4-9970-5bc845a5c5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:42.157218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9322aa6-b1cd-44a4-9970-5bc845a5c5ca admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:42.157994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9322aa6-b1cd-44a4-9970-5bc845a5c5ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:42.160298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9322aa6-b1cd-44a4-9970-5bc845a5c5ca admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:42.230614 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1589/3177] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:07:42 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:42.230789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7655c-7e5e-478d-8a54-aaf50ab909da None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:42.231851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9322aa6-b1cd-44a4-9970-5bc845a5c5ca admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:42.324286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2018b-1fdc-4da2-920a-8d9d19f38b59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:42.324924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2018b-1fdc-4da2-920a-8d9d19f38b59 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:42.325317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2018b-1fdc-4da2-920a-8d9d19f38b59 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:42.325600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2018b-1fdc-4da2-920a-8d9d19f38b59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:42.327649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-31a2018b-1fdc-4da2-920a-8d9d19f38b59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:42.415458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9322aa6-b1cd-44a4-9970-5bc845a5c5ca admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:42.422298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dff08-4852-4226-ae21-ac4c3b5d08a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:42.423611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dff08-4852-4226-ae21-ac4c3b5d08a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:42.424933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dff08-4852-4226-ae21-ac4c3b5d08a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:42.425688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dff08-4852-4226-ae21-ac4c3b5d08a4 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:42.427800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09dff08-4852-4226-ae21-ac4c3b5d08a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:42.434813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09dff08-4852-4226-ae21-ac4c3b5d08a4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:42.475922 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1590/3178] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:07:42 2022] POST /identity/v3/users => generated 287 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:42.479269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dff08-4852-4226-ae21-ac4c3b5d08a4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:42.483864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2018b-1fdc-4da2-920a-8d9d19f38b59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:42.487308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2018b-1fdc-4da2-920a-8d9d19f38b59 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:42.515019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dff08-4852-4226-ae21-ac4c3b5d08a4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:42.543337 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1589/3179] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:42.543972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2018b-1fdc-4da2-920a-8d9d19f38b59 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:42.545965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0d2bd-72c2-428e-b434-fb13050e1d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:42.546603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0d2bd-72c2-428e-b434-fb13050e1d18 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:42.546967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0d2bd-72c2-428e-b434-fb13050e1d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:42.547139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0d2bd-72c2-428e-b434-fb13050e1d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:42.548009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0d2bd-72c2-428e-b434-fb13050e1d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:42.565626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-31a2018b-1fdc-4da2-920a-8d9d19f38b59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:42.577558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0d2bd-72c2-428e-b434-fb13050e1d18 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:42.607719 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1591/3180] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:07:42.607719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbc96a-2ef3-48cf-beec-ab0de711b7dc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:42.607719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbc96a-2ef3-48cf-beec-ab0de711b7dc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:42.608132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbc96a-2ef3-48cf-beec-ab0de711b7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:42.608646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2018b-1fdc-4da2-920a-8d9d19f38b59 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:42.617410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1569b-c2e6-4afb-bf72-39db5551fdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:42.618748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1569b-c2e6-4afb-bf72-39db5551fdec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:42.619039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1569b-c2e6-4afb-bf72-39db5551fdec admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:42.619400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1569b-c2e6-4afb-bf72-39db5551fdec admin admin] PATH_INFO: `/v3/users/bc0c452f4dce4f5d928fa8d1fcf901be` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:42.622417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1569b-c2e6-4afb-bf72-39db5551fdec admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0c452f4dce4f5d928fa8d1fcf901be)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:42.625672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1569b-c2e6-4afb-bf72-39db5551fdec admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:42.627229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:42.665986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ebfbc96a-2ef3-48cf-beec-ab0de711b7dc None None] MFA Rules not processed for user `eeb3ffbaef3347de8d9ad6b2bdfa19bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:42.668938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ebfbc96a-2ef3-48cf-beec-ab0de711b7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:42.727220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5bc1569b-c2e6-4afb-bf72-39db5551fdec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0c452f4dce4f5d928fa8d1fcf901be'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:42.729519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5bc1569b-c2e6-4afb-bf72-39db5551fdec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0c452f4dce4f5d928fa8d1fcf901be'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:42.754426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5bc1569b-c2e6-4afb-bf72-39db5551fdec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0c452f4dce4f5d928fa8d1fcf901be'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:42.755412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5bc1569b-c2e6-4afb-bf72-39db5551fdec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0c452f4dce4f5d928fa8d1fcf901be'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:42.765029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5bc1569b-c2e6-4afb-bf72-39db5551fdec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0c452f4dce4f5d928fa8d1fcf901be'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:42.775838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:42.785630 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1590/3181] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:42 2022] DELETE /identity/v3/users/bc0c452f4dce4f5d928fa8d1fcf901be => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:42.787742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1569b-c2e6-4afb-bf72-39db5551fdec admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:42.790794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5bc1569b-c2e6-4afb-bf72-39db5551fdec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:42.794138 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1592/3182] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:42.795798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521b39e-cc69-4f5c-a9bb-66840ba2296b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:42.796940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521b39e-cc69-4f5c-a9bb-66840ba2296b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:42.797229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521b39e-cc69-4f5c-a9bb-66840ba2296b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:42.834387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a521b39e-cc69-4f5c-a9bb-66840ba2296b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:42.837281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a521b39e-cc69-4f5c-a9bb-66840ba2296b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:42.900051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1569b-c2e6-4afb-bf72-39db5551fdec admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:42.912521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62771f1f-f80d-4f77-846d-f730245c43a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:42.915729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62771f1f-f80d-4f77-846d-f730245c43a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:42.916060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62771f1f-f80d-4f77-846d-f730245c43a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:42.917585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62771f1f-f80d-4f77-846d-f730245c43a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:42.918598 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1593/3183] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:42.919688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62771f1f-f80d-4f77-846d-f730245c43a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:42.920872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521b39e-cc69-4f5c-a9bb-66840ba2296b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:42.923066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62771f1f-f80d-4f77-846d-f730245c43a2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:42.925573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a521b39e-cc69-4f5c-a9bb-66840ba2296b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:42.956000 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1591/3184] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:42.958228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62771f1f-f80d-4f77-846d-f730245c43a2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:42.962752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-62771f1f-f80d-4f77-846d-f730245c43a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:43.077143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521b39e-cc69-4f5c-a9bb-66840ba2296b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:43.096950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ca2ba-d25b-462a-9884-7e743244a843 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:43.097598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ca2ba-d25b-462a-9884-7e743244a843 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:43.097876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ca2ba-d25b-462a-9884-7e743244a843 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:43.098143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ca2ba-d25b-462a-9884-7e743244a843 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:43.106050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62771f1f-f80d-4f77-846d-f730245c43a2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:43.116045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36562e5-f7f8-488a-9b2b-fc58712b389a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:43.119608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36562e5-f7f8-488a-9b2b-fc58712b389a service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:43.119895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36562e5-f7f8-488a-9b2b-fc58712b389a service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:43.121066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36562e5-f7f8-488a-9b2b-fc58712b389a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:43.148175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36562e5-f7f8-488a-9b2b-fc58712b389a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:43.156145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36562e5-f7f8-488a-9b2b-fc58712b389a service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:43.179679 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1592/3185] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:43.182961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36562e5-f7f8-488a-9b2b-fc58712b389a service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:43.206440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36562e5-f7f8-488a-9b2b-fc58712b389a service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:43.219039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296b557-79a4-4efa-88da-59aff640f1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:43.220727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296b557-79a4-4efa-88da-59aff640f1a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:43.221011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296b557-79a4-4efa-88da-59aff640f1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:43.221288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296b557-79a4-4efa-88da-59aff640f1a4 admin admin] PATH_INFO: `/v3/projects/a502ca105b1344babf2e8d590de18198/users/8027664b7857430494e38fa27da60c75/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:43.251679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ca2ba-d25b-462a-9884-7e743244a843 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:43.253317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ca2ba-d25b-462a-9884-7e743244a843 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:43.262617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296b557-79a4-4efa-88da-59aff640f1a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a502ca105b1344babf2e8d590de18198, user_id=8027664b7857430494e38fa27da60c75, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:43.268110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296b557-79a4-4efa-88da-59aff640f1a4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:43.275556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:43.291907 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1594/3186] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:43.302720 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1593/3187] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:43 2022] PUT /identity/v3/projects/a502ca105b1344babf2e8d590de18198/users/8027664b7857430494e38fa27da60c75/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:43.308381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bba05-1849-4089-b88c-bc4906c16cb0 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:43.309001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bba05-1849-4089-b88c-bc4906c16cb0 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:43.309457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bba05-1849-4089-b88c-bc4906c16cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:43.333018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-682bba05-1849-4089-b88c-bc4906c16cb0 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:43.335113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-682bba05-1849-4089-b88c-bc4906c16cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:43.371970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:43.423865 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1595/3188] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:43.469144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296b557-79a4-4efa-88da-59aff640f1a4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:43.471119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e296b557-79a4-4efa-88da-59aff640f1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:43.592999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296b557-79a4-4efa-88da-59aff640f1a4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:43.599559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa065a-930d-4bbe-a0ba-6662bcc49631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:43.600209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa065a-930d-4bbe-a0ba-6662bcc49631 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:43.600540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa065a-930d-4bbe-a0ba-6662bcc49631 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:43.600818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa065a-930d-4bbe-a0ba-6662bcc49631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:43.623493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa065a-930d-4bbe-a0ba-6662bcc49631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:43.624878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa065a-930d-4bbe-a0ba-6662bcc49631 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:43.651957 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1594/3189] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:44.519166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3c128-6c79-49ce-be01-d6e69b7ac0b9 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:44.520115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3c128-6c79-49ce-be01-d6e69b7ac0b9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:44.520560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3c128-6c79-49ce-be01-d6e69b7ac0b9 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:44.522117 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1596/3190] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:07:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:07:44.533646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d085c99-b780-4fbe-a713-d5fedb7e9268 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:44.534695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d085c99-b780-4fbe-a713-d5fedb7e9268 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:44.535167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d085c99-b780-4fbe-a713-d5fedb7e9268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:44.565665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3d085c99-b780-4fbe-a713-d5fedb7e9268 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:44.567713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3d085c99-b780-4fbe-a713-d5fedb7e9268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:44.688056 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1595/3191] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:07:44.714342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3c128-6c79-49ce-be01-d6e69b7ac0b9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:44.717849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ede3c128-6c79-49ce-be01-d6e69b7ac0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:44.764643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3c128-6c79-49ce-be01-d6e69b7ac0b9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:44.782034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa1e43-9abf-488a-9228-1445fba46f72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:44.782725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa1e43-9abf-488a-9228-1445fba46f72 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:44.783033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa1e43-9abf-488a-9228-1445fba46f72 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:44.783313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa1e43-9abf-488a-9228-1445fba46f72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:44.809286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa1e43-9abf-488a-9228-1445fba46f72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:44.811504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa1e43-9abf-488a-9228-1445fba46f72 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:44.835043 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1597/3192] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:45.132316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d085c99-b780-4fbe-a713-d5fedb7e9268 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:45.134155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3d085c99-b780-4fbe-a713-d5fedb7e9268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:45.166718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d085c99-b780-4fbe-a713-d5fedb7e9268 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:45.179704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b00fc7-5ce6-4b93-9f99-3980cdeaedf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:45.183469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b00fc7-5ce6-4b93-9f99-3980cdeaedf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:45.184129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b00fc7-5ce6-4b93-9f99-3980cdeaedf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:45.185945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b00fc7-5ce6-4b93-9f99-3980cdeaedf0 admin admin] PATH_INFO: `/v3/projects/b5d767c7241946c7928e33c6afac22fd` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:45.191545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b00fc7-5ce6-4b93-9f99-3980cdeaedf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d767c7241946c7928e33c6afac22fd)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:45.196068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b00fc7-5ce6-4b93-9f99-3980cdeaedf0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:45.225103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa1e43-9abf-488a-9228-1445fba46f72 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:45.237332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa1e43-9abf-488a-9228-1445fba46f72 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:45.256809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a13fb-dda6-416b-b66b-3d27772e8102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:45.257591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a13fb-dda6-416b-b66b-3d27772e8102 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:45.258531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a13fb-dda6-416b-b66b-3d27772e8102 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:45.260394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a13fb-dda6-416b-b66b-3d27772e8102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:45.266574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2d3a13fb-dda6-416b-b66b-3d27772e8102 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:45.308606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a13fb-dda6-416b-b66b-3d27772e8102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:45.310842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a13fb-dda6-416b-b66b-3d27772e8102 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:45.339065 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1598/3193] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:45.376786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-17b00fc7-5ce6-4b93-9f99-3980cdeaedf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d767c7241946c7928e33c6afac22fd', 'request_id': 'req-17b00fc7-5ce6-4b93-9f99-3980cdeaedf0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:45.396281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-17b00fc7-5ce6-4b93-9f99-3980cdeaedf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d767c7241946c7928e33c6afac22fd', 'request_id': 'req-17b00fc7-5ce6-4b93-9f99-3980cdeaedf0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:45.408649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-17b00fc7-5ce6-4b93-9f99-3980cdeaedf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d767c7241946c7928e33c6afac22fd', 'request_id': 'req-17b00fc7-5ce6-4b93-9f99-3980cdeaedf0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:45.459137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-17b00fc7-5ce6-4b93-9f99-3980cdeaedf0 admin admin] The token cache is being invalidate because project b5d767c7241946c7928e33c6afac22fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:45.459671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-17b00fc7-5ce6-4b93-9f99-3980cdeaedf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:45.460775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-17b00fc7-5ce6-4b93-9f99-3980cdeaedf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:45.463435 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1596/3194] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:45 2022] DELETE /identity/v3/projects/b5d767c7241946c7928e33c6afac22fd => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:45.467159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a13fb-dda6-416b-b66b-3d27772e8102 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:45.482647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a13fb-dda6-416b-b66b-3d27772e8102 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:45.588838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29008aad-e622-44f9-939d-82b4091e7b00 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:45.589466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29008aad-e622-44f9-939d-82b4091e7b00 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:45.590125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29008aad-e622-44f9-939d-82b4091e7b00 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:45.593612 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1597/3195] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:07:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:07:45.601677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55336b-2c18-4266-aa76-baa6e7b6b3e1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:45.601977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55336b-2c18-4266-aa76-baa6e7b6b3e1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:45.602963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55336b-2c18-4266-aa76-baa6e7b6b3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:45.687645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d857873-9b7c-40d4-b5d2-1fc348011178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:45.691203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d857873-9b7c-40d4-b5d2-1fc348011178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:45.694032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d857873-9b7c-40d4-b5d2-1fc348011178 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:45.695564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d857873-9b7c-40d4-b5d2-1fc348011178 admin admin] PATH_INFO: `/v3/users/5dcd1b23eb0c41979cd32c5ed1ec0532` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:45.708788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d857873-9b7c-40d4-b5d2-1fc348011178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dcd1b23eb0c41979cd32c5ed1ec0532)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:45.710841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d857873-9b7c-40d4-b5d2-1fc348011178 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:45.737014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-da55336b-2c18-4266-aa76-baa6e7b6b3e1 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:45.738757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-da55336b-2c18-4266-aa76-baa6e7b6b3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:45.757699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:45.879811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d857873-9b7c-40d4-b5d2-1fc348011178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dcd1b23eb0c41979cd32c5ed1ec0532'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:45.913516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d857873-9b7c-40d4-b5d2-1fc348011178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dcd1b23eb0c41979cd32c5ed1ec0532'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:45.914294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d857873-9b7c-40d4-b5d2-1fc348011178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dcd1b23eb0c41979cd32c5ed1ec0532'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:45.927221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d857873-9b7c-40d4-b5d2-1fc348011178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dcd1b23eb0c41979cd32c5ed1ec0532'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:45.928386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d857873-9b7c-40d4-b5d2-1fc348011178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dcd1b23eb0c41979cd32c5ed1ec0532'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:45.942458 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1598/3196] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:07:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:45.975219 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1599/3197] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:45 2022] DELETE /identity/v3/users/5dcd1b23eb0c41979cd32c5ed1ec0532 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:46.004494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55336b-2c18-4266-aa76-baa6e7b6b3e1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:46.012435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-da55336b-2c18-4266-aa76-baa6e7b6b3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:46.029469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55336b-2c18-4266-aa76-baa6e7b6b3e1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:46.193595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5347b-0ac8-4e4d-bcb0-e7345738cd7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:46.195369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5347b-0ac8-4e4d-bcb0-e7345738cd7c service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:46.195946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5347b-0ac8-4e4d-bcb0-e7345738cd7c service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:46.197574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5347b-0ac8-4e4d-bcb0-e7345738cd7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:46.224927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5347b-0ac8-4e4d-bcb0-e7345738cd7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:46.228854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5347b-0ac8-4e4d-bcb0-e7345738cd7c service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:46.255414 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1599/3198] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:46.407480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957050e-684a-4a82-971c-f646ef2246b5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:46.407978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957050e-684a-4a82-971c-f646ef2246b5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:46.408339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957050e-684a-4a82-971c-f646ef2246b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:46.438112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a957050e-684a-4a82-971c-f646ef2246b5 None None] MFA Rules not processed for user `eeb3ffbaef3347de8d9ad6b2bdfa19bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:46.439547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a957050e-684a-4a82-971c-f646ef2246b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:46.499517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:46.605574 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1600/3199] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:46.705455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c7a49-882f-4a99-8816-cde57d8a28ae None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:46.706011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c7a49-882f-4a99-8816-cde57d8a28ae None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:46.706011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c7a49-882f-4a99-8816-cde57d8a28ae None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:46.708269 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1600/3200] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:07:46.716132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56449f-ae64-4745-816d-b5592068b88c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:46.716667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56449f-ae64-4745-816d-b5592068b88c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:46.716667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56449f-ae64-4745-816d-b5592068b88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:46.791795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1e56449f-ae64-4745-816d-b5592068b88c None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:46.793074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1e56449f-ae64-4745-816d-b5592068b88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:47.016404 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1601/3201] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:07:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:47.045848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c7a49-882f-4a99-8816-cde57d8a28ae None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:47.047948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4d2c7a49-882f-4a99-8816-cde57d8a28ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:47.129272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c7a49-882f-4a99-8816-cde57d8a28ae None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:47.135398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c496ebc-aeb7-462d-b8f6-762509397f09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:47.135947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c496ebc-aeb7-462d-b8f6-762509397f09 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:47.136234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c496ebc-aeb7-462d-b8f6-762509397f09 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:47.136509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c496ebc-aeb7-462d-b8f6-762509397f09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:47.149405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c496ebc-aeb7-462d-b8f6-762509397f09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:47.150968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c496ebc-aeb7-462d-b8f6-762509397f09 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:47.171434 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1601/3202] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:47.424714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56449f-ae64-4745-816d-b5592068b88c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:47.426176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1e56449f-ae64-4745-816d-b5592068b88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:47.638330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56449f-ae64-4745-816d-b5592068b88c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:47.648436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc224f-a930-4e1d-8ab9-5352ac3776a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:47.650187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc224f-a930-4e1d-8ab9-5352ac3776a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:47.650601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc224f-a930-4e1d-8ab9-5352ac3776a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:47.650961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc224f-a930-4e1d-8ab9-5352ac3776a8 admin admin] PATH_INFO: `/v3/projects/dff522848feb4091b8ccdcb7d55974e7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:47.652354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc224f-a930-4e1d-8ab9-5352ac3776a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dff522848feb4091b8ccdcb7d55974e7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:47.655852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc224f-a930-4e1d-8ab9-5352ac3776a8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:47.780384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-07fc224f-a930-4e1d-8ab9-5352ac3776a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dff522848feb4091b8ccdcb7d55974e7', 'request_id': 'req-07fc224f-a930-4e1d-8ab9-5352ac3776a8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:47.796319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-07fc224f-a930-4e1d-8ab9-5352ac3776a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dff522848feb4091b8ccdcb7d55974e7', 'request_id': 'req-07fc224f-a930-4e1d-8ab9-5352ac3776a8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:47.823556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-07fc224f-a930-4e1d-8ab9-5352ac3776a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dff522848feb4091b8ccdcb7d55974e7', 'request_id': 'req-07fc224f-a930-4e1d-8ab9-5352ac3776a8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:47.826361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:47.843950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-07fc224f-a930-4e1d-8ab9-5352ac3776a8 admin admin] The token cache is being invalidate because project dff522848feb4091b8ccdcb7d55974e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:47.844310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-07fc224f-a930-4e1d-8ab9-5352ac3776a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:47.851827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-07fc224f-a930-4e1d-8ab9-5352ac3776a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:47.854552 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1602/3203] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:47 2022] DELETE /identity/v3/projects/dff522848feb4091b8ccdcb7d55974e7 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:47.859431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8fafc-894a-4a33-85ca-043acac8032a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:47.860000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8fafc-894a-4a33-85ca-043acac8032a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:47.860000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8fafc-894a-4a33-85ca-043acac8032a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:47.892513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-44d8fafc-894a-4a33-85ca-043acac8032a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:47.893700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-44d8fafc-894a-4a33-85ca-043acac8032a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:47.996421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:48.001547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc224f-a930-4e1d-8ab9-5352ac3776a8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:48.003423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-07fc224f-a930-4e1d-8ab9-5352ac3776a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:48.038872 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1602/3204] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:48.043737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc6526-905a-4a75-b1d7-137b3b1315b9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:48.044088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc6526-905a-4a75-b1d7-137b3b1315b9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:48.051914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc6526-905a-4a75-b1d7-137b3b1315b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:48.088074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e5bc6526-905a-4a75-b1d7-137b3b1315b9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:48.090004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e5bc6526-905a-4a75-b1d7-137b3b1315b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:48.106188 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1603/3205] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:07:48.107577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc6526-905a-4a75-b1d7-137b3b1315b9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:48.130143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc6526-905a-4a75-b1d7-137b3b1315b9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:48.140715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58926179-de6a-4488-9d81-5947bd4142a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:48.143775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58926179-de6a-4488-9d81-5947bd4142a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:48.144227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58926179-de6a-4488-9d81-5947bd4142a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:48.144696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58926179-de6a-4488-9d81-5947bd4142a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:48.145792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58926179-de6a-4488-9d81-5947bd4142a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:07:48.146184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58926179-de6a-4488-9d81-5947bd4142a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:48.150660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58926179-de6a-4488-9d81-5947bd4142a0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:48.190561 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1604/3206] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:48.195007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58926179-de6a-4488-9d81-5947bd4142a0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:48.214592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58926179-de6a-4488-9d81-5947bd4142a0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:48.233358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74732713-763f-4d06-bf24-f24e8bd677e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:48.233848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74732713-763f-4d06-bf24-f24e8bd677e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:48.235136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74732713-763f-4d06-bf24-f24e8bd677e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:48.235311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74732713-763f-4d06-bf24-f24e8bd677e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:48.236764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74732713-763f-4d06-bf24-f24e8bd677e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:48.243320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74732713-763f-4d06-bf24-f24e8bd677e9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:48.262331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc224f-a930-4e1d-8ab9-5352ac3776a8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:48.284577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4708f22-5bdd-46d8-bc37-7ff7eb1c214d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:48.288122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4708f22-5bdd-46d8-bc37-7ff7eb1c214d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:48.288417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4708f22-5bdd-46d8-bc37-7ff7eb1c214d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:48.291132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4708f22-5bdd-46d8-bc37-7ff7eb1c214d admin admin] PATH_INFO: `/v3/users/26bab5a783244ca9aa9668dd106e373f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:48.298775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4708f22-5bdd-46d8-bc37-7ff7eb1c214d admin admin] RBAC: Authorizing `identity:delete_user(user_id=26bab5a783244ca9aa9668dd106e373f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:48.310692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4708f22-5bdd-46d8-bc37-7ff7eb1c214d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:48.397919 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1605/3207] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:07:48 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:07:48.404812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74732713-763f-4d06-bf24-f24e8bd677e9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:48.480992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b4708f22-5bdd-46d8-bc37-7ff7eb1c214d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26bab5a783244ca9aa9668dd106e373f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:48.518828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b4708f22-5bdd-46d8-bc37-7ff7eb1c214d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26bab5a783244ca9aa9668dd106e373f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:48.520955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b4708f22-5bdd-46d8-bc37-7ff7eb1c214d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26bab5a783244ca9aa9668dd106e373f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:48.544008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b4708f22-5bdd-46d8-bc37-7ff7eb1c214d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26bab5a783244ca9aa9668dd106e373f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:48.547149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b4708f22-5bdd-46d8-bc37-7ff7eb1c214d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26bab5a783244ca9aa9668dd106e373f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:48.598205 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1603/3208] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:48 2022] DELETE /identity/v3/users/26bab5a783244ca9aa9668dd106e373f => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:07:48.645957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74732713-763f-4d06-bf24-f24e8bd677e9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:48.767492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb62bb3-5171-4c1d-8a79-67d402458716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:48.768510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb62bb3-5171-4c1d-8a79-67d402458716 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:48.768899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb62bb3-5171-4c1d-8a79-67d402458716 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:48.769277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb62bb3-5171-4c1d-8a79-67d402458716 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:48.771024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb62bb3-5171-4c1d-8a79-67d402458716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:48.774110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb62bb3-5171-4c1d-8a79-67d402458716 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:48.828413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4708f22-5bdd-46d8-bc37-7ff7eb1c214d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:48.832427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b4708f22-5bdd-46d8-bc37-7ff7eb1c214d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:48.848951 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1606/3209] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:07:48 2022] POST /identity/v3/users => generated 288 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:07:48.861308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4708f22-5bdd-46d8-bc37-7ff7eb1c214d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:48.867471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130da2a0-eb2c-4762-b546-3e65358e3c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:48.869156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130da2a0-eb2c-4762-b546-3e65358e3c51 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:48.869497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130da2a0-eb2c-4762-b546-3e65358e3c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:48.869831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130da2a0-eb2c-4762-b546-3e65358e3c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:48.870920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130da2a0-eb2c-4762-b546-3e65358e3c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:48.872883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130da2a0-eb2c-4762-b546-3e65358e3c51 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:48.892097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb62bb3-5171-4c1d-8a79-67d402458716 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:48.905350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb62bb3-5171-4c1d-8a79-67d402458716 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:48.906353 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1604/3210] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:48.910835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fba93-ac8b-44b5-940c-ac4c01e91370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:48.911866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fba93-ac8b-44b5-940c-ac4c01e91370 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:48.912187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fba93-ac8b-44b5-940c-ac4c01e91370 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:48.912434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fba93-ac8b-44b5-940c-ac4c01e91370 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:48.913284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fba93-ac8b-44b5-940c-ac4c01e91370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:48.915941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fba93-ac8b-44b5-940c-ac4c01e91370 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:48.940401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130da2a0-eb2c-4762-b546-3e65358e3c51 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:48.950295 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1607/3211] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:48.955606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130da2a0-eb2c-4762-b546-3e65358e3c51 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:48.962525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea13291-2700-49f8-9a9a-97e06f356e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:48.963282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea13291-2700-49f8-9a9a-97e06f356e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:48.963570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea13291-2700-49f8-9a9a-97e06f356e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:48.963858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea13291-2700-49f8-9a9a-97e06f356e1c admin admin] PATH_INFO: `/v3/projects/3b999bc8557447fc9a95c1105fbfab16/users/0c77cdec4284469ca7be0955efedda22/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:48.984444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea13291-2700-49f8-9a9a-97e06f356e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b999bc8557447fc9a95c1105fbfab16, user_id=0c77cdec4284469ca7be0955efedda22, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:48.987739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea13291-2700-49f8-9a9a-97e06f356e1c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:49.027901 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1605/3212] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:48 2022] PUT /identity/v3/projects/3b999bc8557447fc9a95c1105fbfab16/users/0c77cdec4284469ca7be0955efedda22/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:49.033947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a220e7-feb8-4bec-9cd5-d194efdbd214 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:49.034242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a220e7-feb8-4bec-9cd5-d194efdbd214 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:49.034523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a220e7-feb8-4bec-9cd5-d194efdbd214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:49.069636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-37a220e7-feb8-4bec-9cd5-d194efdbd214 None None] MFA Rules not processed for user `0c77cdec4284469ca7be0955efedda22`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:49.072448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-37a220e7-feb8-4bec-9cd5-d194efdbd214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:49.100992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:49.185883 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1608/3213] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:49.186680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea13291-2700-49f8-9a9a-97e06f356e1c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:49.321070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:49.379866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea13291-2700-49f8-9a9a-97e06f356e1c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:49.393715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324cb91-f462-497c-bbd9-fc983e564ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:49.394363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324cb91-f462-497c-bbd9-fc983e564ebb admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:49.394646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324cb91-f462-497c-bbd9-fc983e564ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:49.394924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324cb91-f462-497c-bbd9-fc983e564ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:49.395765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324cb91-f462-497c-bbd9-fc983e564ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:49.397842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324cb91-f462-497c-bbd9-fc983e564ebb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:49.460087 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1606/3214] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:07:49 2022] POST /identity/v3/projects => generated 375 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:07:49.464722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a220e7-feb8-4bec-9cd5-d194efdbd214 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:49.480734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a220e7-feb8-4bec-9cd5-d194efdbd214 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:49.590826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41d0fb-eaa1-409c-a383-3e5bf509b8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:49.594444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41d0fb-eaa1-409c-a383-3e5bf509b8da admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:49.594444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41d0fb-eaa1-409c-a383-3e5bf509b8da admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:49.594900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41d0fb-eaa1-409c-a383-3e5bf509b8da admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:49.595774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41d0fb-eaa1-409c-a383-3e5bf509b8da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:49.598778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41d0fb-eaa1-409c-a383-3e5bf509b8da admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:49.648441 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1609/3215] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:07:49 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:49.649373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324cb91-f462-497c-bbd9-fc983e564ebb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:49.677194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324cb91-f462-497c-bbd9-fc983e564ebb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:49.686697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d3983-e0a0-4dd5-a57e-52d4784c47fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:49.687914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d3983-e0a0-4dd5-a57e-52d4784c47fa admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:49.688421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d3983-e0a0-4dd5-a57e-52d4784c47fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:49.689283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d3983-e0a0-4dd5-a57e-52d4784c47fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:49.692428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d3983-e0a0-4dd5-a57e-52d4784c47fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:49.694619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d3983-e0a0-4dd5-a57e-52d4784c47fa admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:49.722553 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1607/3216] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:49.722785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41d0fb-eaa1-409c-a383-3e5bf509b8da admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:49.734657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41d0fb-eaa1-409c-a383-3e5bf509b8da admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:49.740376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4a2b1-259d-4f40-8a0e-3fd259e64a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:49.741061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a2b1-259d-4f40-8a0e-3fd259e64a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:49.741346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a2b1-259d-4f40-8a0e-3fd259e64a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:49.741644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a2b1-259d-4f40-8a0e-3fd259e64a94 admin admin] PATH_INFO: `/v3/projects/82b3039358bc4c47bcb4726672d34ada/users/4c935aa0b2cf4c40b7faab5d8325b730/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:49.760988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4a2b1-259d-4f40-8a0e-3fd259e64a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b3039358bc4c47bcb4726672d34ada, user_id=4c935aa0b2cf4c40b7faab5d8325b730, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:49.764094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4a2b1-259d-4f40-8a0e-3fd259e64a94 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:49.797184 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1610/3217] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:49 2022] PUT /identity/v3/projects/82b3039358bc4c47bcb4726672d34ada/users/4c935aa0b2cf4c40b7faab5d8325b730/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:49.799610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d3983-e0a0-4dd5-a57e-52d4784c47fa admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:49.826523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d3983-e0a0-4dd5-a57e-52d4784c47fa admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:49.878369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4a2b1-259d-4f40-8a0e-3fd259e64a94 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:49.881285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b9c4a2b1-259d-4f40-8a0e-3fd259e64a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:49.959846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32f49d-eb36-4343-bfdf-de19ec81b3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:49.961981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32f49d-eb36-4343-bfdf-de19ec81b3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:49.964686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32f49d-eb36-4343-bfdf-de19ec81b3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:49.965283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32f49d-eb36-4343-bfdf-de19ec81b3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:49.966473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32f49d-eb36-4343-bfdf-de19ec81b3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:49.970191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32f49d-eb36-4343-bfdf-de19ec81b3b2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:50.005550 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1608/3218] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:50.009848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32f49d-eb36-4343-bfdf-de19ec81b3b2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:50.023624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32f49d-eb36-4343-bfdf-de19ec81b3b2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:50.031173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b1890-9ad8-494e-8ea4-10917b92b905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:50.031902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b1890-9ad8-494e-8ea4-10917b92b905 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:50.032194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b1890-9ad8-494e-8ea4-10917b92b905 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:50.032454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b1890-9ad8-494e-8ea4-10917b92b905 admin admin] PATH_INFO: `/v3/projects/82b3039358bc4c47bcb4726672d34ada/users/4c935aa0b2cf4c40b7faab5d8325b730/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:50.041003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b1890-9ad8-494e-8ea4-10917b92b905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b3039358bc4c47bcb4726672d34ada, user_id=4c935aa0b2cf4c40b7faab5d8325b730, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:50.045032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b1890-9ad8-494e-8ea4-10917b92b905 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:50.063396 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1609/3219] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:50 2022] PUT /identity/v3/projects/82b3039358bc4c47bcb4726672d34ada/users/4c935aa0b2cf4c40b7faab5d8325b730/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:50.063844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4a2b1-259d-4f40-8a0e-3fd259e64a94 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:50.169138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ef1c-5fc6-4340-bc87-6337ac3a4b81 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:50.169376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ef1c-5fc6-4340-bc87-6337ac3a4b81 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:50.169622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ef1c-5fc6-4340-bc87-6337ac3a4b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:50.234510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ce62ef1c-5fc6-4340-bc87-6337ac3a4b81 None None] MFA Rules not processed for user `4c935aa0b2cf4c40b7faab5d8325b730`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:50.236605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:50.239026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ce62ef1c-5fc6-4340-bc87-6337ac3a4b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:50.327889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e446b7-e251-42bb-aed5-bccc58029890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:50.328954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e446b7-e251-42bb-aed5-bccc58029890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:50.329238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e446b7-e251-42bb-aed5-bccc58029890 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:50.329509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e446b7-e251-42bb-aed5-bccc58029890 admin admin] PATH_INFO: `/v3/projects/d7f8aac4d7bc44abb0d86e5a72bdaff1` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:50.331910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e446b7-e251-42bb-aed5-bccc58029890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7f8aac4d7bc44abb0d86e5a72bdaff1)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:50.334645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e446b7-e251-42bb-aed5-bccc58029890 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:50.430737 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1610/3220] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:50.432574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62ef1c-5fc6-4340-bc87-6337ac3a4b81 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:50.448277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62ef1c-5fc6-4340-bc87-6337ac3a4b81 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:50.477064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f5e446b7-e251-42bb-aed5-bccc58029890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7f8aac4d7bc44abb0d86e5a72bdaff1', 'request_id': 'req-f5e446b7-e251-42bb-aed5-bccc58029890'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:50.485998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:50.496399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f5e446b7-e251-42bb-aed5-bccc58029890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7f8aac4d7bc44abb0d86e5a72bdaff1', 'request_id': 'req-f5e446b7-e251-42bb-aed5-bccc58029890'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:50.513570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f5e446b7-e251-42bb-aed5-bccc58029890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7f8aac4d7bc44abb0d86e5a72bdaff1', 'request_id': 'req-f5e446b7-e251-42bb-aed5-bccc58029890'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:50.541219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f5e446b7-e251-42bb-aed5-bccc58029890 admin admin] The token cache is being invalidate because project d7f8aac4d7bc44abb0d86e5a72bdaff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:50.541483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f5e446b7-e251-42bb-aed5-bccc58029890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:50.543047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f5e446b7-e251-42bb-aed5-bccc58029890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:50.545789 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1611/3221] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:49 2022] DELETE /identity/v3/projects/d7f8aac4d7bc44abb0d86e5a72bdaff1 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:50.550993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24d166-31b4-4b90-9144-fcb5f1a763d9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:50.551304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24d166-31b4-4b90-9144-fcb5f1a763d9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:50.551588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24d166-31b4-4b90-9144-fcb5f1a763d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:50.565682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a061a2a-dd8c-4ce2-b075-26b787f9270e tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c935aa0b2cf4c40b7faab5d8325b730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b3039358bc4c47bcb4726672d34ada', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:50.566994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a061a2a-dd8c-4ce2-b075-26b787f9270e tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:50.569615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a061a2a-dd8c-4ce2-b075-26b787f9270e tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:50.570262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a061a2a-dd8c-4ce2-b075-26b787f9270e tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:50.571263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a061a2a-dd8c-4ce2-b075-26b787f9270e tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:07:50.572262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a061a2a-dd8c-4ce2-b075-26b787f9270e tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:50.574276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a061a2a-dd8c-4ce2-b075-26b787f9270e tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:50.615352 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1611/3222] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:50.619798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a061a2a-dd8c-4ce2-b075-26b787f9270e tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:50.624100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6a061a2a-dd8c-4ce2-b075-26b787f9270e tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:50.646044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fb24d166-31b4-4b90-9144-fcb5f1a763d9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:50.647422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fb24d166-31b4-4b90-9144-fcb5f1a763d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:50.680880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a061a2a-dd8c-4ce2-b075-26b787f9270e tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:50.704454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ca974-cd49-4c18-bb0a-b5a32347a936 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c935aa0b2cf4c40b7faab5d8325b730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b3039358bc4c47bcb4726672d34ada', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:50.710870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ca974-cd49-4c18-bb0a-b5a32347a936 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:50.715557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ca974-cd49-4c18-bb0a-b5a32347a936 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:50.715965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ca974-cd49-4c18-bb0a-b5a32347a936 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:50.718652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ca974-cd49-4c18-bb0a-b5a32347a936 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:50.723368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ca974-cd49-4c18-bb0a-b5a32347a936 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:50.810660 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1612/3223] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:07:50 2022] POST /identity/v3/projects => generated 369 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:07:50.812555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ca974-cd49-4c18-bb0a-b5a32347a936 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:50.871240 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1612/3224] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:07:50.879388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d1644-c2c5-4fb2-aea2-50b4c3c3f7eb None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:50.879933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d1644-c2c5-4fb2-aea2-50b4c3c3f7eb None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:50.880379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d1644-c2c5-4fb2-aea2-50b4c3c3f7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:50.923281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-af1d1644-c2c5-4fb2-aea2-50b4c3c3f7eb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:50.924829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-af1d1644-c2c5-4fb2-aea2-50b4c3c3f7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:50.999800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ca974-cd49-4c18-bb0a-b5a32347a936 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:51.015837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b867f2-1036-46ed-8985-19895d1a678f tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c935aa0b2cf4c40b7faab5d8325b730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b3039358bc4c47bcb4726672d34ada', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:51.016824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b867f2-1036-46ed-8985-19895d1a678f tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:51.017120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b867f2-1036-46ed-8985-19895d1a678f tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:51.017413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b867f2-1036-46ed-8985-19895d1a678f tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:51.018290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b867f2-1036-46ed-8985-19895d1a678f tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:07:51.018792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b867f2-1036-46ed-8985-19895d1a678f tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:51.020786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b867f2-1036-46ed-8985-19895d1a678f tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:51.062731 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1613/3225] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:51.078760 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1613/3226] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:51.080567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b867f2-1036-46ed-8985-19895d1a678f tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:51.094023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b867f2-1036-46ed-8985-19895d1a678f tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:51.100556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1525fc4-ce1f-40ca-8be0-b111dd2dad48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:51.101538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1525fc4-ce1f-40ca-8be0-b111dd2dad48 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:51.102004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1525fc4-ce1f-40ca-8be0-b111dd2dad48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:51.102383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1525fc4-ce1f-40ca-8be0-b111dd2dad48 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:51.103468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1525fc4-ce1f-40ca-8be0-b111dd2dad48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:07:51.103895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1525fc4-ce1f-40ca-8be0-b111dd2dad48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:51.105607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1525fc4-ce1f-40ca-8be0-b111dd2dad48 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:51.135032 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1614/3227] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:51.138361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d1644-c2c5-4fb2-aea2-50b4c3c3f7eb None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:51.144414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:51.153199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d1644-c2c5-4fb2-aea2-50b4c3c3f7eb None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:51.162917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24326b-fba6-4eab-9c80-45d2ec0ce998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:51.163740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24326b-fba6-4eab-9c80-45d2ec0ce998 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:51.164119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24326b-fba6-4eab-9c80-45d2ec0ce998 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:51.164453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24326b-fba6-4eab-9c80-45d2ec0ce998 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:51.165391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24326b-fba6-4eab-9c80-45d2ec0ce998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:51.167919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24326b-fba6-4eab-9c80-45d2ec0ce998 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:51.219844 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1614/3228] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:07:51 2022] POST /identity/v3/projects => generated 397 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:51.224046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1525fc4-ce1f-40ca-8be0-b111dd2dad48 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:51.237355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1525fc4-ce1f-40ca-8be0-b111dd2dad48 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:51.395345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35242f-ad1e-41bb-b328-54c603ebaa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:51.397401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35242f-ad1e-41bb-b328-54c603ebaa81 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:51.397932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35242f-ad1e-41bb-b328-54c603ebaa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:51.398805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35242f-ad1e-41bb-b328-54c603ebaa81 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:51.399852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35242f-ad1e-41bb-b328-54c603ebaa81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:51.404742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35242f-ad1e-41bb-b328-54c603ebaa81 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:51.429965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:51.439344 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1615/3229] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:07:51 2022] POST /identity/v3/users => generated 299 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:07:51.443331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24326b-fba6-4eab-9c80-45d2ec0ce998 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:51.457282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24326b-fba6-4eab-9c80-45d2ec0ce998 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:51.470269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e84d48-312f-4628-af80-073b4e7f5a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:51.471019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e84d48-312f-4628-af80-073b4e7f5a73 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:51.471389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e84d48-312f-4628-af80-073b4e7f5a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:51.471636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e84d48-312f-4628-af80-073b4e7f5a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:51.472346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e84d48-312f-4628-af80-073b4e7f5a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:51.473966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e84d48-312f-4628-af80-073b4e7f5a73 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:51.504082 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1615/3230] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:51.505944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35242f-ad1e-41bb-b328-54c603ebaa81 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:51.533367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35242f-ad1e-41bb-b328-54c603ebaa81 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:51.538738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf387c-ba20-4a97-9896-1bbffab828fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:51.539601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf387c-ba20-4a97-9896-1bbffab828fa admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:51.539890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf387c-ba20-4a97-9896-1bbffab828fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:51.540222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf387c-ba20-4a97-9896-1bbffab828fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:51.540991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf387c-ba20-4a97-9896-1bbffab828fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:51.542864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf387c-ba20-4a97-9896-1bbffab828fa admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:51.545309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e84d48-312f-4628-af80-073b4e7f5a73 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:51.547012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f7e84d48-312f-4628-af80-073b4e7f5a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:51.589743 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1616/3231] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:51.594675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf387c-ba20-4a97-9896-1bbffab828fa admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:51.631738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf387c-ba20-4a97-9896-1bbffab828fa admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:51.643363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44b127-ab45-4acc-88cf-02a27f26bb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:51.643884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44b127-ab45-4acc-88cf-02a27f26bb3e admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:51.644165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44b127-ab45-4acc-88cf-02a27f26bb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:51.644437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44b127-ab45-4acc-88cf-02a27f26bb3e admin admin] PATH_INFO: `/v3/projects/b89b4ac33c224340841a65250343d643/users/d7c534dcb896486ab003d91ab6623449/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:51.685102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44b127-ab45-4acc-88cf-02a27f26bb3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b89b4ac33c224340841a65250343d643, user_id=d7c534dcb896486ab003d91ab6623449, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:51.692767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44b127-ab45-4acc-88cf-02a27f26bb3e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:51.725486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e84d48-312f-4628-af80-073b4e7f5a73 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:51.743335 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1617/3232] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:51 2022] PUT /identity/v3/projects/b89b4ac33c224340841a65250343d643/users/d7c534dcb896486ab003d91ab6623449/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:51.755909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3b6b0-3697-48db-a326-a576f399e45a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:51.756113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3b6b0-3697-48db-a326-a576f399e45a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:51.756378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3b6b0-3697-48db-a326-a576f399e45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:51.762264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cec62-9f3f-422b-9ad5-bb957530c6d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:51.762907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cec62-9f3f-422b-9ad5-bb957530c6d3 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:51.763187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cec62-9f3f-422b-9ad5-bb957530c6d3 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:51.763496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cec62-9f3f-422b-9ad5-bb957530c6d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:51.824556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-15d3b6b0-3697-48db-a326-a576f399e45a None None] MFA Rules not processed for user `d7c534dcb896486ab003d91ab6623449`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:51.825960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-15d3b6b0-3697-48db-a326-a576f399e45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:51.894221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cec62-9f3f-422b-9ad5-bb957530c6d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:51.896318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cec62-9f3f-422b-9ad5-bb957530c6d3 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:51.914578 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1618/3233] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:51.922900 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1616/3234] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:07:51.978084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6575c-8e5a-4711-b4cf-25fc4b7423ce None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:51.978084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6575c-8e5a-4711-b4cf-25fc4b7423ce None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:51.978378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6575c-8e5a-4711-b4cf-25fc4b7423ce None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:51.979671 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1619/3235] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:07:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:07:51.991372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cec62-9f3f-422b-9ad5-bb957530c6d3 service nova] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:07:52.016166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cec62-9f3f-422b-9ad5-bb957530c6d3 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:52.037833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cec62-9f3f-422b-9ad5-bb957530c6d3 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:52.162154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:52.171564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8738fca-171f-41ec-881f-f39225386f2a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c935aa0b2cf4c40b7faab5d8325b730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b3039358bc4c47bcb4726672d34ada', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:52.172872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8738fca-171f-41ec-881f-f39225386f2a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:52.173606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8738fca-171f-41ec-881f-f39225386f2a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:52.174221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8738fca-171f-41ec-881f-f39225386f2a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] PATH_INFO: `/v3/projects/27f025408e2d4f4e855f02d2be5cc7c2` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:52.178256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8738fca-171f-41ec-881f-f39225386f2a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorizing `identity:get_project(project_id=27f025408e2d4f4e855f02d2be5cc7c2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:52.182415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8738fca-171f-41ec-881f-f39225386f2a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:52.184972 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1617/3236] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:07:51 2022] GET /identity/v3/projects/27f025408e2d4f4e855f02d2be5cc7c2 => generated 369 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:52.461400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6575c-8e5a-4711-b4cf-25fc4b7423ce None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:52.547386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377a9d2-9eab-4cdd-814a-75548e75a205 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:52.547612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377a9d2-9eab-4cdd-814a-75548e75a205 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:52.547862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377a9d2-9eab-4cdd-814a-75548e75a205 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:52.550024 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1618/3237] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:07:52.560901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377a9d2-9eab-4cdd-814a-75548e75a205 None None] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:07:52.563518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f377a9d2-9eab-4cdd-814a-75548e75a205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:52.609962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6575c-8e5a-4711-b4cf-25fc4b7423ce None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:52.625239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772a339-118c-4cb4-a049-05fe1c6f015b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:52.625885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772a339-118c-4cb4-a049-05fe1c6f015b service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:52.626171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772a339-118c-4cb4-a049-05fe1c6f015b service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:52.626448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772a339-118c-4cb4-a049-05fe1c6f015b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:52.644908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772a339-118c-4cb4-a049-05fe1c6f015b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:52.646583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772a339-118c-4cb4-a049-05fe1c6f015b service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:52.666636 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1620/3238] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:52.727492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377a9d2-9eab-4cdd-814a-75548e75a205 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:52.740100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377a9d2-9eab-4cdd-814a-75548e75a205 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:52.746425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc27a80-7c26-4b52-91b2-a328a355741a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c935aa0b2cf4c40b7faab5d8325b730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b3039358bc4c47bcb4726672d34ada', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:52.747589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc27a80-7c26-4b52-91b2-a328a355741a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:52.748565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc27a80-7c26-4b52-91b2-a328a355741a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:52.749086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc27a80-7c26-4b52-91b2-a328a355741a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] PATH_INFO: `/v3/projects/27f025408e2d4f4e855f02d2be5cc7c2` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:52.751356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc27a80-7c26-4b52-91b2-a328a355741a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorizing `identity:get_project(project_id=27f025408e2d4f4e855f02d2be5cc7c2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:52.753823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc27a80-7c26-4b52-91b2-a328a355741a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:52.756508 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1619/3239] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:07:52 2022] GET /identity/v3/projects/27f025408e2d4f4e855f02d2be5cc7c2 => generated 369 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:52.877016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772a339-118c-4cb4-a049-05fe1c6f015b service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:52.898770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772a339-118c-4cb4-a049-05fe1c6f015b service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:52.913181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8e4fd-441a-4bf0-8239-c88b015c5926 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c935aa0b2cf4c40b7faab5d8325b730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b3039358bc4c47bcb4726672d34ada', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:52.916371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8e4fd-441a-4bf0-8239-c88b015c5926 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:52.916793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8e4fd-441a-4bf0-8239-c88b015c5926 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:52.919806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8e4fd-441a-4bf0-8239-c88b015c5926 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:52.920539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8e4fd-441a-4bf0-8239-c88b015c5926 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:07:52.920958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8e4fd-441a-4bf0-8239-c88b015c5926 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:52.926157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8e4fd-441a-4bf0-8239-c88b015c5926 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:52.957294 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1621/3240] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:07:52.962762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc27a80-7c26-4b52-91b2-a328a355741a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:52.975241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc27a80-7c26-4b52-91b2-a328a355741a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:52.983105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ed369-7667-41e5-ac84-29e647ceb3cf tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c935aa0b2cf4c40b7faab5d8325b730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b3039358bc4c47bcb4726672d34ada', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:52.985017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ed369-7667-41e5-ac84-29e647ceb3cf tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:52.985417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ed369-7667-41e5-ac84-29e647ceb3cf tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:52.985805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ed369-7667-41e5-ac84-29e647ceb3cf tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:52.986597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ed369-7667-41e5-ac84-29e647ceb3cf tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:52.988902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ed369-7667-41e5-ac84-29e647ceb3cf tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:53.044408 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1620/3241] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:07:52 2022] POST /identity/v3/users => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:53.050863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8e4fd-441a-4bf0-8239-c88b015c5926 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:53.069530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8e4fd-441a-4bf0-8239-c88b015c5926 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:53.106494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c768f0-a6b8-45d0-8350-9dc622a70d76 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c935aa0b2cf4c40b7faab5d8325b730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b3039358bc4c47bcb4726672d34ada', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:53.108508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c768f0-a6b8-45d0-8350-9dc622a70d76 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:53.108880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c768f0-a6b8-45d0-8350-9dc622a70d76 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:53.109220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c768f0-a6b8-45d0-8350-9dc622a70d76 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:53.110084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c768f0-a6b8-45d0-8350-9dc622a70d76 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:07:53.110478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c768f0-a6b8-45d0-8350-9dc622a70d76 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:53.115511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c768f0-a6b8-45d0-8350-9dc622a70d76 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:53.138367 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1622/3242] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:53.544103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594588d3-4089-4d49-8616-a2046543cbcb None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:53.544103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594588d3-4089-4d49-8616-a2046543cbcb None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:53.544103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594588d3-4089-4d49-8616-a2046543cbcb None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:53.545143 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1621/3243] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:07:53.550897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c768f0-a6b8-45d0-8350-9dc622a70d76 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:07:53.576974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c768f0-a6b8-45d0-8350-9dc622a70d76 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:53.597816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c768f0-a6b8-45d0-8350-9dc622a70d76 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:53.612826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5953fa-2e9b-451a-bdb0-ea0d4922de10 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c935aa0b2cf4c40b7faab5d8325b730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b3039358bc4c47bcb4726672d34ada', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:53.613655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5953fa-2e9b-451a-bdb0-ea0d4922de10 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:53.614041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5953fa-2e9b-451a-bdb0-ea0d4922de10 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:53.614453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5953fa-2e9b-451a-bdb0-ea0d4922de10 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] PATH_INFO: `/v3/projects/27f025408e2d4f4e855f02d2be5cc7c2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:53.615842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5953fa-2e9b-451a-bdb0-ea0d4922de10 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorizing `identity:get_project(project_id=27f025408e2d4f4e855f02d2be5cc7c2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:53.618561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5953fa-2e9b-451a-bdb0-ea0d4922de10 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:53.621967 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1623/3244] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:07:53 2022] GET /identity/v3/projects/27f025408e2d4f4e855f02d2be5cc7c2 => generated 369 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:53.962002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146e720-a25b-4583-b121-34acd955adf2 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:53.962567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146e720-a25b-4583-b121-34acd955adf2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:53.962845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146e720-a25b-4583-b121-34acd955adf2 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:53.964806 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1622/3245] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:07:53.971055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5953fa-2e9b-451a-bdb0-ea0d4922de10 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:07:53.986059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:54.020213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5953fa-2e9b-451a-bdb0-ea0d4922de10 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:54.041050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5953fa-2e9b-451a-bdb0-ea0d4922de10 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:54.052616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82926d70-9400-4afa-890c-6117cbf75d1a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c935aa0b2cf4c40b7faab5d8325b730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b3039358bc4c47bcb4726672d34ada', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:54.053755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82926d70-9400-4afa-890c-6117cbf75d1a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:54.054340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82926d70-9400-4afa-890c-6117cbf75d1a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:54.054862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82926d70-9400-4afa-890c-6117cbf75d1a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] PATH_INFO: `/v3/projects/27f025408e2d4f4e855f02d2be5cc7c2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:54.058702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82926d70-9400-4afa-890c-6117cbf75d1a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorizing `identity:get_project(project_id=27f025408e2d4f4e855f02d2be5cc7c2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:54.061125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82926d70-9400-4afa-890c-6117cbf75d1a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:54.072689 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1624/3246] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:07:53 2022] GET /identity/v3/projects/27f025408e2d4f4e855f02d2be5cc7c2 => generated 369 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:54.141970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146e720-a25b-4583-b121-34acd955adf2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:54.178159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146e720-a25b-4583-b121-34acd955adf2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:54.210365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e183d7-b9e9-4609-bb29-9cd6a34fc60b tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c935aa0b2cf4c40b7faab5d8325b730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b3039358bc4c47bcb4726672d34ada', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:54.212513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e183d7-b9e9-4609-bb29-9cd6a34fc60b tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:54.212652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e183d7-b9e9-4609-bb29-9cd6a34fc60b tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:54.217934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e183d7-b9e9-4609-bb29-9cd6a34fc60b tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] PATH_INFO: `/v3/users/0ecb3c0646de417582d3780b478dcf83` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:54.277635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e183d7-b9e9-4609-bb29-9cd6a34fc60b tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0ecb3c0646de417582d3780b478dcf83)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:54.284168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e183d7-b9e9-4609-bb29-9cd6a34fc60b tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:54.433794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d6e183d7-b9e9-4609-bb29-9cd6a34fc60b tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ecb3c0646de417582d3780b478dcf83'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:54.436345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d6e183d7-b9e9-4609-bb29-9cd6a34fc60b tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ecb3c0646de417582d3780b478dcf83'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:54.476712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d6e183d7-b9e9-4609-bb29-9cd6a34fc60b tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ecb3c0646de417582d3780b478dcf83'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:54.480275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d6e183d7-b9e9-4609-bb29-9cd6a34fc60b tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ecb3c0646de417582d3780b478dcf83'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:54.506460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d6e183d7-b9e9-4609-bb29-9cd6a34fc60b tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ecb3c0646de417582d3780b478dcf83'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:54.540864 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1623/3247] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:54 2022] DELETE /identity/v3/users/0ecb3c0646de417582d3780b478dcf83 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:54.544981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82926d70-9400-4afa-890c-6117cbf75d1a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:54.547332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-82926d70-9400-4afa-890c-6117cbf75d1a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:54.589458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82926d70-9400-4afa-890c-6117cbf75d1a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:54.653435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e183d7-b9e9-4609-bb29-9cd6a34fc60b tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:54.656415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d6e183d7-b9e9-4609-bb29-9cd6a34fc60b tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:54.729558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a1bd4-d65a-4213-a4fd-49ab4072ad15 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c935aa0b2cf4c40b7faab5d8325b730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b3039358bc4c47bcb4726672d34ada', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:54.730246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a1bd4-d65a-4213-a4fd-49ab4072ad15 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:54.730516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a1bd4-d65a-4213-a4fd-49ab4072ad15 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:54.730785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a1bd4-d65a-4213-a4fd-49ab4072ad15 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] PATH_INFO: `/v3/projects/27f025408e2d4f4e855f02d2be5cc7c2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:54.733293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a1bd4-d65a-4213-a4fd-49ab4072ad15 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorizing `identity:delete_project(project_id=27f025408e2d4f4e855f02d2be5cc7c2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:54.735469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a1bd4-d65a-4213-a4fd-49ab4072ad15 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:54.744213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:54.809695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e183d7-b9e9-4609-bb29-9cd6a34fc60b tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:54.829798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d6c3f-0636-4a34-b95d-e254e295ca88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:54.830610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d6c3f-0636-4a34-b95d-e254e295ca88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:54.831965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d6c3f-0636-4a34-b95d-e254e295ca88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:54.832702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d6c3f-0636-4a34-b95d-e254e295ca88 admin admin] PATH_INFO: `/v3/users/d7c534dcb896486ab003d91ab6623449` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:54.838732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d6c3f-0636-4a34-b95d-e254e295ca88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c534dcb896486ab003d91ab6623449)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:54.848260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d6c3f-0636-4a34-b95d-e254e295ca88 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:54.851753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-153a1bd4-d65a-4213-a4fd-49ab4072ad15 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f025408e2d4f4e855f02d2be5cc7c2', 'request_id': 'req-153a1bd4-d65a-4213-a4fd-49ab4072ad15'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:54.874720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-153a1bd4-d65a-4213-a4fd-49ab4072ad15 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f025408e2d4f4e855f02d2be5cc7c2', 'request_id': 'req-153a1bd4-d65a-4213-a4fd-49ab4072ad15'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:54.892922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-153a1bd4-d65a-4213-a4fd-49ab4072ad15 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f025408e2d4f4e855f02d2be5cc7c2', 'request_id': 'req-153a1bd4-d65a-4213-a4fd-49ab4072ad15'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:54.911137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-153a1bd4-d65a-4213-a4fd-49ab4072ad15 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] The token cache is being invalidate because project 27f025408e2d4f4e855f02d2be5cc7c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:54.911644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-153a1bd4-d65a-4213-a4fd-49ab4072ad15 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:54.913765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-153a1bd4-d65a-4213-a4fd-49ab4072ad15 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:54.919402 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1625/3248] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:54 2022] DELETE /identity/v3/projects/27f025408e2d4f4e855f02d2be5cc7c2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:54.927478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a1bd4-d65a-4213-a4fd-49ab4072ad15 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:54.929884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-153a1bd4-d65a-4213-a4fd-49ab4072ad15 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:54.983047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe0d6c3f-0636-4a34-b95d-e254e295ca88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c534dcb896486ab003d91ab6623449'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:54.984813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe0d6c3f-0636-4a34-b95d-e254e295ca88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c534dcb896486ab003d91ab6623449'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:55.013459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe0d6c3f-0636-4a34-b95d-e254e295ca88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c534dcb896486ab003d91ab6623449'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:55.014681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe0d6c3f-0636-4a34-b95d-e254e295ca88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c534dcb896486ab003d91ab6623449'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:55.029337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe0d6c3f-0636-4a34-b95d-e254e295ca88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c534dcb896486ab003d91ab6623449'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:55.065241 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1624/3249] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:54 2022] DELETE /identity/v3/users/d7c534dcb896486ab003d91ab6623449 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:55.065836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a1bd4-d65a-4213-a4fd-49ab4072ad15 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:55.068355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85d5d3-e7fe-4d98-ad1e-cf5e34c631d9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:55.068823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85d5d3-e7fe-4d98-ad1e-cf5e34c631d9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:55.069349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85d5d3-e7fe-4d98-ad1e-cf5e34c631d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:55.104614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-da85d5d3-e7fe-4d98-ad1e-cf5e34c631d9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:55.106378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-da85d5d3-e7fe-4d98-ad1e-cf5e34c631d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:55.146420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:55.204195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920b416-350f-478b-8c29-b17b14b9d20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:55.204865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920b416-350f-478b-8c29-b17b14b9d20c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:55.205151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920b416-350f-478b-8c29-b17b14b9d20c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:55.205431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920b416-350f-478b-8c29-b17b14b9d20c admin admin] PATH_INFO: `/v3/users/0c77cdec4284469ca7be0955efedda22` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:55.212632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920b416-350f-478b-8c29-b17b14b9d20c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c77cdec4284469ca7be0955efedda22)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:55.214654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920b416-350f-478b-8c29-b17b14b9d20c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:55.218313 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1625/3250] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:55.271772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85d5d3-e7fe-4d98-ad1e-cf5e34c631d9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:55.276295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-da85d5d3-e7fe-4d98-ad1e-cf5e34c631d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:55.299692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7920b416-350f-478b-8c29-b17b14b9d20c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c77cdec4284469ca7be0955efedda22'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:55.342334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7920b416-350f-478b-8c29-b17b14b9d20c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c77cdec4284469ca7be0955efedda22'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:55.343748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7920b416-350f-478b-8c29-b17b14b9d20c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c77cdec4284469ca7be0955efedda22'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:55.353527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7920b416-350f-478b-8c29-b17b14b9d20c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c77cdec4284469ca7be0955efedda22'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:55.354316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7920b416-350f-478b-8c29-b17b14b9d20c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c77cdec4284469ca7be0955efedda22'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:55.386652 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1626/3251] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:54 2022] DELETE /identity/v3/users/0c77cdec4284469ca7be0955efedda22 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:55.386652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28907f68-ee0e-451d-954d-9bfd81636784 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:55.388416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28907f68-ee0e-451d-954d-9bfd81636784 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:55.388416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28907f68-ee0e-451d-954d-9bfd81636784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:55.417288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85d5d3-e7fe-4d98-ad1e-cf5e34c631d9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:55.439313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:55.439561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-28907f68-ee0e-451d-954d-9bfd81636784 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:55.440102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-28907f68-ee0e-451d-954d-9bfd81636784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:55.558653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6416229-32f6-4547-977c-772daf5ba706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:55.559324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6416229-32f6-4547-977c-772daf5ba706 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:55.559608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6416229-32f6-4547-977c-772daf5ba706 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:55.559883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6416229-32f6-4547-977c-772daf5ba706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:55.562325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e6416229-32f6-4547-977c-772daf5ba706 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:55.657792 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1627/3252] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:55.659049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28907f68-ee0e-451d-954d-9bfd81636784 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:55.662944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-28907f68-ee0e-451d-954d-9bfd81636784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:55.696038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28907f68-ee0e-451d-954d-9bfd81636784 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:55.721727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb66cf-66f6-4a4b-bcf8-4bd281a4d224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:55.722467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb66cf-66f6-4a4b-bcf8-4bd281a4d224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:55.722755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb66cf-66f6-4a4b-bcf8-4bd281a4d224 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:55.723033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb66cf-66f6-4a4b-bcf8-4bd281a4d224 admin admin] PATH_INFO: `/v3/users/ebad594b0ff84e0cb36d719320979476` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:55.728550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb66cf-66f6-4a4b-bcf8-4bd281a4d224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebad594b0ff84e0cb36d719320979476)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:55.732694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb66cf-66f6-4a4b-bcf8-4bd281a4d224 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:55.784726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6416229-32f6-4547-977c-772daf5ba706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:55.786877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6416229-32f6-4547-977c-772daf5ba706 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:55.823465 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1626/3253] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:55.825566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6416229-32f6-4547-977c-772daf5ba706 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:55.829840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e6416229-32f6-4547-977c-772daf5ba706 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:55.848635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9fbb66cf-66f6-4a4b-bcf8-4bd281a4d224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebad594b0ff84e0cb36d719320979476'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:55.853178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:55.879601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6416229-32f6-4547-977c-772daf5ba706 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:55.902100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2e669-d2bf-47b3-a792-9f849859922e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:55.905721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2e669-d2bf-47b3-a792-9f849859922e service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:55.906029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2e669-d2bf-47b3-a792-9f849859922e service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:55.906319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2e669-d2bf-47b3-a792-9f849859922e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:55.914651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9fbb66cf-66f6-4a4b-bcf8-4bd281a4d224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebad594b0ff84e0cb36d719320979476'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:55.917162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9fbb66cf-66f6-4a4b-bcf8-4bd281a4d224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebad594b0ff84e0cb36d719320979476'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:55.935274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2e669-d2bf-47b3-a792-9f849859922e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:55.939505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2e669-d2bf-47b3-a792-9f849859922e service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:55.943069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9fbb66cf-66f6-4a4b-bcf8-4bd281a4d224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebad594b0ff84e0cb36d719320979476'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:55.944012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9fbb66cf-66f6-4a4b-bcf8-4bd281a4d224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebad594b0ff84e0cb36d719320979476'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:55.969123 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1627/3254] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:55.970689 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1628/3255] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:55 2022] DELETE /identity/v3/users/ebad594b0ff84e0cb36d719320979476 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:57.412254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2e669-d2bf-47b3-a792-9f849859922e service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:57.413850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a8b2e669-d2bf-47b3-a792-9f849859922e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:57.436937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2e669-d2bf-47b3-a792-9f849859922e service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:57.549306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb66cf-66f6-4a4b-bcf8-4bd281a4d224 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:57.550880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9fbb66cf-66f6-4a4b-bcf8-4bd281a4d224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:57.622207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ae631-7e55-44be-8ab6-b4e4ebdf74a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:57.622885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ae631-7e55-44be-8ab6-b4e4ebdf74a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:57.623174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ae631-7e55-44be-8ab6-b4e4ebdf74a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:57.623821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ae631-7e55-44be-8ab6-b4e4ebdf74a2 admin admin] PATH_INFO: `/v3/projects/3b999bc8557447fc9a95c1105fbfab16` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:57.625346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ae631-7e55-44be-8ab6-b4e4ebdf74a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b999bc8557447fc9a95c1105fbfab16)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:57.628465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ae631-7e55-44be-8ab6-b4e4ebdf74a2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:57.684204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb66cf-66f6-4a4b-bcf8-4bd281a4d224 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:57.688033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:57.690223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fb6ae631-7e55-44be-8ab6-b4e4ebdf74a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b999bc8557447fc9a95c1105fbfab16', 'request_id': 'req-fb6ae631-7e55-44be-8ab6-b4e4ebdf74a2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:57.703634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fb6ae631-7e55-44be-8ab6-b4e4ebdf74a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b999bc8557447fc9a95c1105fbfab16', 'request_id': 'req-fb6ae631-7e55-44be-8ab6-b4e4ebdf74a2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:57.713561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fb6ae631-7e55-44be-8ab6-b4e4ebdf74a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b999bc8557447fc9a95c1105fbfab16', 'request_id': 'req-fb6ae631-7e55-44be-8ab6-b4e4ebdf74a2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:57.729761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fb6ae631-7e55-44be-8ab6-b4e4ebdf74a2 admin admin] The token cache is being invalidate because project 3b999bc8557447fc9a95c1105fbfab16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:57.730092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fb6ae631-7e55-44be-8ab6-b4e4ebdf74a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:57.730953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fb6ae631-7e55-44be-8ab6-b4e4ebdf74a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:57.735522 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1628/3256] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:57 2022] DELETE /identity/v3/projects/3b999bc8557447fc9a95c1105fbfab16 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:57.736613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ae631-7e55-44be-8ab6-b4e4ebdf74a2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:57.738936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fb6ae631-7e55-44be-8ab6-b4e4ebdf74a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:57.793379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683b81c-6c5c-42f5-aeb1-b300eb1686de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:57.794044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683b81c-6c5c-42f5-aeb1-b300eb1686de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:57.794324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683b81c-6c5c-42f5-aeb1-b300eb1686de admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:57.794646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683b81c-6c5c-42f5-aeb1-b300eb1686de admin admin] PATH_INFO: `/v3/projects/b89b4ac33c224340841a65250343d643` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:57.795876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683b81c-6c5c-42f5-aeb1-b300eb1686de admin admin] RBAC: Authorizing `identity:delete_project(project_id=b89b4ac33c224340841a65250343d643)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:57.803491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683b81c-6c5c-42f5-aeb1-b300eb1686de admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:57.895172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ae631-7e55-44be-8ab6-b4e4ebdf74a2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:57.913791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f683b81c-6c5c-42f5-aeb1-b300eb1686de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b89b4ac33c224340841a65250343d643', 'request_id': 'req-f683b81c-6c5c-42f5-aeb1-b300eb1686de'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:57.924546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f683b81c-6c5c-42f5-aeb1-b300eb1686de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b89b4ac33c224340841a65250343d643', 'request_id': 'req-f683b81c-6c5c-42f5-aeb1-b300eb1686de'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:57.948151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f683b81c-6c5c-42f5-aeb1-b300eb1686de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b89b4ac33c224340841a65250343d643', 'request_id': 'req-f683b81c-6c5c-42f5-aeb1-b300eb1686de'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:57.966982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f683b81c-6c5c-42f5-aeb1-b300eb1686de admin admin] The token cache is being invalidate because project b89b4ac33c224340841a65250343d643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:57.967282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f683b81c-6c5c-42f5-aeb1-b300eb1686de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:57.968978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f683b81c-6c5c-42f5-aeb1-b300eb1686de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:57.975419 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1629/3257] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:57 2022] DELETE /identity/v3/projects/b89b4ac33c224340841a65250343d643 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:57.976256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683b81c-6c5c-42f5-aeb1-b300eb1686de admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:57.980851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f683b81c-6c5c-42f5-aeb1-b300eb1686de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:58.003090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:58.073127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4f24e-f759-488b-b570-18ace16ee95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:58.073808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4f24e-f759-488b-b570-18ace16ee95a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:58.074100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4f24e-f759-488b-b570-18ace16ee95a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:58.074383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4f24e-f759-488b-b570-18ace16ee95a admin admin] PATH_INFO: `/v3/users/4c935aa0b2cf4c40b7faab5d8325b730` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:58.075737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4f24e-f759-488b-b570-18ace16ee95a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c935aa0b2cf4c40b7faab5d8325b730)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:58.078836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4f24e-f759-488b-b570-18ace16ee95a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:58.197305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-20b4f24e-f759-488b-b570-18ace16ee95a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c935aa0b2cf4c40b7faab5d8325b730'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:58.201194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-20b4f24e-f759-488b-b570-18ace16ee95a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c935aa0b2cf4c40b7faab5d8325b730'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:58.207203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683b81c-6c5c-42f5-aeb1-b300eb1686de admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:58.219633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09f702-c7d9-470b-8389-c1af3b46345d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:58.221147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09f702-c7d9-470b-8389-c1af3b46345d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:58.221513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09f702-c7d9-470b-8389-c1af3b46345d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:58.222644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09f702-c7d9-470b-8389-c1af3b46345d admin admin] PATH_INFO: `/v3/projects/093aa97f9ad442ba9e9b7e7ca3937bb2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:58.226038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09f702-c7d9-470b-8389-c1af3b46345d admin admin] RBAC: Authorizing `identity:delete_project(project_id=093aa97f9ad442ba9e9b7e7ca3937bb2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:58.229094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09f702-c7d9-470b-8389-c1af3b46345d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:58.233551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-20b4f24e-f759-488b-b570-18ace16ee95a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c935aa0b2cf4c40b7faab5d8325b730'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:58.235853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-20b4f24e-f759-488b-b570-18ace16ee95a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c935aa0b2cf4c40b7faab5d8325b730'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:58.252628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-20b4f24e-f759-488b-b570-18ace16ee95a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c935aa0b2cf4c40b7faab5d8325b730'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:58.282734 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1629/3258] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:07:57 2022] DELETE /identity/v3/users/4c935aa0b2cf4c40b7faab5d8325b730 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:58.287196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4577bc-4801-4943-85d7-117fad3bfabb None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:58.288386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4577bc-4801-4943-85d7-117fad3bfabb None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:58.288957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4577bc-4801-4943-85d7-117fad3bfabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:58.304583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:58.349545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6a4577bc-4801-4943-85d7-117fad3bfabb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:58.353088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1a09f702-c7d9-470b-8389-c1af3b46345d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'request_id': 'req-1a09f702-c7d9-470b-8389-c1af3b46345d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:58.353506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6a4577bc-4801-4943-85d7-117fad3bfabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:58.372252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1a09f702-c7d9-470b-8389-c1af3b46345d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'request_id': 'req-1a09f702-c7d9-470b-8389-c1af3b46345d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:58.392643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1a09f702-c7d9-470b-8389-c1af3b46345d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'request_id': 'req-1a09f702-c7d9-470b-8389-c1af3b46345d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:58.424093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1a09f702-c7d9-470b-8389-c1af3b46345d admin admin] The token cache is being invalidate because project 093aa97f9ad442ba9e9b7e7ca3937bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:58.424522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1a09f702-c7d9-470b-8389-c1af3b46345d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:58.426122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1a09f702-c7d9-470b-8389-c1af3b46345d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:58.429384 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1630/3259] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:57 2022] DELETE /identity/v3/projects/093aa97f9ad442ba9e9b7e7ca3937bb2 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:58.434501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd69aa-1ee7-408c-8fa9-03f056c5498a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:58.434936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd69aa-1ee7-408c-8fa9-03f056c5498a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:58.435341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd69aa-1ee7-408c-8fa9-03f056c5498a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:58.491983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-fefd69aa-1ee7-408c-8fa9-03f056c5498a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:58.493304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fefd69aa-1ee7-408c-8fa9-03f056c5498a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:58.529044 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1630/3260] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:58.538232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f7c3a-9333-4fb2-935d-b86e0cdab4b6 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:58.538599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f7c3a-9333-4fb2-935d-b86e0cdab4b6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:58.539405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f7c3a-9333-4fb2-935d-b86e0cdab4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:58.585847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-066f7c3a-9333-4fb2-935d-b86e0cdab4b6 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:58.595237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-066f7c3a-9333-4fb2-935d-b86e0cdab4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:58.614099 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1631/3261] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:58.618950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f7c3a-9333-4fb2-935d-b86e0cdab4b6 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:58.635032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f7c3a-9333-4fb2-935d-b86e0cdab4b6 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:58.647553 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1631/3262] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:07:58.648267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e5ec3-d305-4d1c-a619-51ac070e945f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:58.649185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e5ec3-d305-4d1c-a619-51ac070e945f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:58.650029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e5ec3-d305-4d1c-a619-51ac070e945f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:58.650308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e5ec3-d305-4d1c-a619-51ac070e945f admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:58.651024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e5ec3-d305-4d1c-a619-51ac070e945f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:07:58.651363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e5ec3-d305-4d1c-a619-51ac070e945f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:58.654707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba9819-f542-44fd-b8f0-8915f43918f4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:58.654999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba9819-f542-44fd-b8f0-8915f43918f4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:58.655277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba9819-f542-44fd-b8f0-8915f43918f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:58.658836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e5ec3-d305-4d1c-a619-51ac070e945f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:58.693948 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1632/3263] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:58.695688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e5ec3-d305-4d1c-a619-51ac070e945f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:58.697439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c9ba9819-f542-44fd-b8f0-8915f43918f4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:58.699255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c9ba9819-f542-44fd-b8f0-8915f43918f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:58.716261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e5ec3-d305-4d1c-a619-51ac070e945f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:58.724946 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1632/3264] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:07:58.732160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba9819-f542-44fd-b8f0-8915f43918f4 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:58.734643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc43cca-4239-40ed-a051-571bc65164c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:58.735404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc43cca-4239-40ed-a051-571bc65164c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:58.735612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc43cca-4239-40ed-a051-571bc65164c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:58.735873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc43cca-4239-40ed-a051-571bc65164c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:58.736552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc43cca-4239-40ed-a051-571bc65164c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:58.746846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc43cca-4239-40ed-a051-571bc65164c7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:58.759421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba9819-f542-44fd-b8f0-8915f43918f4 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:58.788113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d79ca-e138-4975-b286-b0c7a8aaf078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:58.788728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d79ca-e138-4975-b286-b0c7a8aaf078 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:58.789021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d79ca-e138-4975-b286-b0c7a8aaf078 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:58.789307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d79ca-e138-4975-b286-b0c7a8aaf078 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:58.790082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d79ca-e138-4975-b286-b0c7a8aaf078 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:07:58.790391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d79ca-e138-4975-b286-b0c7a8aaf078 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:58.795415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d79ca-e138-4975-b286-b0c7a8aaf078 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:58.829548 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1633/3265] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:07:58.834324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d79ca-e138-4975-b286-b0c7a8aaf078 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:58.857641 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1633/3266] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:07:58 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:07:58.861064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d79ca-e138-4975-b286-b0c7a8aaf078 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:58.861680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc43cca-4239-40ed-a051-571bc65164c7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:58.894883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:59.002874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e9d20-44f4-461d-b3e1-9017f2c6b306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:59.003263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e9d20-44f4-461d-b3e1-9017f2c6b306 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:59.003668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e9d20-44f4-461d-b3e1-9017f2c6b306 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:59.003877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e9d20-44f4-461d-b3e1-9017f2c6b306 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:59.004517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e9d20-44f4-461d-b3e1-9017f2c6b306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:59.015579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e9d20-44f4-461d-b3e1-9017f2c6b306 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:59.078891 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1634/3267] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:07:58 2022] POST /identity/v3/projects => generated 375 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:59.078891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e9d20-44f4-461d-b3e1-9017f2c6b306 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:59.079232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc43cca-4239-40ed-a051-571bc65164c7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:59.083551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ce9e9d20-44f4-461d-b3e1-9017f2c6b306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:59.181199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987e655-a47e-4705-a27f-429c2c2012c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:59.182693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987e655-a47e-4705-a27f-429c2c2012c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:59.183331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987e655-a47e-4705-a27f-429c2c2012c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:59.183831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987e655-a47e-4705-a27f-429c2c2012c6 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:59.186136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987e655-a47e-4705-a27f-429c2c2012c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:59.190379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987e655-a47e-4705-a27f-429c2c2012c6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:59.216541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:59.225956 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1634/3268] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:07:58 2022] POST /identity/v3/users => generated 288 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:59.228201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987e655-a47e-4705-a27f-429c2c2012c6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:59.258536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987e655-a47e-4705-a27f-429c2c2012c6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:59.264484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030303e-c56f-4228-aeed-594e156542a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:59.265118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030303e-c56f-4228-aeed-594e156542a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:59.265410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030303e-c56f-4228-aeed-594e156542a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:59.265725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030303e-c56f-4228-aeed-594e156542a0 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:59.266720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030303e-c56f-4228-aeed-594e156542a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:59.268859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030303e-c56f-4228-aeed-594e156542a0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:59.282426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e9d20-44f4-461d-b3e1-9017f2c6b306 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:59.292139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9ebe5-f7b8-4038-a221-f58a432cffd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:59.293208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9ebe5-f7b8-4038-a221-f58a432cffd4 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:59.293608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9ebe5-f7b8-4038-a221-f58a432cffd4 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:59.294027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9ebe5-f7b8-4038-a221-f58a432cffd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:59.297917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-caa9ebe5-f7b8-4038-a221-f58a432cffd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:59.309532 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1635/3269] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:07:59 2022] POST /identity/v3/users => generated 288 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:07:59.310560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030303e-c56f-4228-aeed-594e156542a0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:59.324852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030303e-c56f-4228-aeed-594e156542a0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:59.327694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9ebe5-f7b8-4038-a221-f58a432cffd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:59.329415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9ebe5-f7b8-4038-a221-f58a432cffd4 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:59.333960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e577f8-0df3-4117-9f2e-4a07329bec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:59.334613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e577f8-0df3-4117-9f2e-4a07329bec04 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:59.335076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e577f8-0df3-4117-9f2e-4a07329bec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:59.335433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e577f8-0df3-4117-9f2e-4a07329bec04 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:59.336392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e577f8-0df3-4117-9f2e-4a07329bec04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:59.339349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e577f8-0df3-4117-9f2e-4a07329bec04 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:59.355883 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1635/3270] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:07:59.356875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9ebe5-f7b8-4038-a221-f58a432cffd4 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:59.366708 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1636/3271] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:59.369242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e577f8-0df3-4117-9f2e-4a07329bec04 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:59.382991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9ebe5-f7b8-4038-a221-f58a432cffd4 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:59.388061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e577f8-0df3-4117-9f2e-4a07329bec04 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:59.388706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb6c10-2451-4549-b7d6-9425c79de1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:59.389744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb6c10-2451-4549-b7d6-9425c79de1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:59.390038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb6c10-2451-4549-b7d6-9425c79de1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:59.390321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb6c10-2451-4549-b7d6-9425c79de1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:59.391196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb6c10-2451-4549-b7d6-9425c79de1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:59.392985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb6c10-2451-4549-b7d6-9425c79de1b5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:59.394205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48548e5-f0bc-49cb-86fc-ee5ea35cdda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:59.395224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48548e5-f0bc-49cb-86fc-ee5ea35cdda7 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:59.396052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48548e5-f0bc-49cb-86fc-ee5ea35cdda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:59.396521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48548e5-f0bc-49cb-86fc-ee5ea35cdda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:59.397388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48548e5-f0bc-49cb-86fc-ee5ea35cdda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:59.399979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48548e5-f0bc-49cb-86fc-ee5ea35cdda7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:59.405378 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1636/3272] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:59.409292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb6c10-2451-4549-b7d6-9425c79de1b5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:59.418755 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1637/3273] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:07:59.423758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48548e5-f0bc-49cb-86fc-ee5ea35cdda7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:59.427819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb6c10-2451-4549-b7d6-9425c79de1b5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:59.439020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48548e5-f0bc-49cb-86fc-ee5ea35cdda7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:59.445217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb9fd7-0f48-484d-b35a-d5a29a9790d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:59.445896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb9fd7-0f48-484d-b35a-d5a29a9790d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:59.446224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb9fd7-0f48-484d-b35a-d5a29a9790d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:59.446511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb9fd7-0f48-484d-b35a-d5a29a9790d4 admin admin] PATH_INFO: `/v3/projects/c143a2d2e4b04edba1f2734d4d19d978/users/6399b6f3e2574df8af12786c8755c59a/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:59.449716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8186ab-3d10-4d59-be65-0544a2f42f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:59.451811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8186ab-3d10-4d59-be65-0544a2f42f95 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:59.454667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8186ab-3d10-4d59-be65-0544a2f42f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:59.455026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8186ab-3d10-4d59-be65-0544a2f42f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:59.457422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8186ab-3d10-4d59-be65-0544a2f42f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:59.465168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb9fd7-0f48-484d-b35a-d5a29a9790d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c143a2d2e4b04edba1f2734d4d19d978, user_id=6399b6f3e2574df8af12786c8755c59a, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:59.467237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8186ab-3d10-4d59-be65-0544a2f42f95 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:59.477970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb9fd7-0f48-484d-b35a-d5a29a9790d4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:59.495804 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1637/3274] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:07:59.496981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8186ab-3d10-4d59-be65-0544a2f42f95 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:59.499217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8c8186ab-3d10-4d59-be65-0544a2f42f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:59.515443 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1638/3275] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:59 2022] PUT /identity/v3/projects/c143a2d2e4b04edba1f2734d4d19d978/users/6399b6f3e2574df8af12786c8755c59a/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:59.516023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb9fd7-0f48-484d-b35a-d5a29a9790d4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:59.519986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8186ab-3d10-4d59-be65-0544a2f42f95 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:59.589780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:59.601980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb9fd7-0f48-484d-b35a-d5a29a9790d4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:07:59.610627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80780d3d-8b99-46a8-9f23-d7d015616622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:59.611210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80780d3d-8b99-46a8-9f23-d7d015616622 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:59.612136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80780d3d-8b99-46a8-9f23-d7d015616622 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:59.612136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80780d3d-8b99-46a8-9f23-d7d015616622 admin admin] PATH_INFO: `/v3/projects/41d28fba915445daa4e83bf039331e48/users/759702e0f5de493cb1aa8a79983d5599/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:59.613598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a505a-ff60-439d-9899-c15ecaedd4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:07:59.614464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a505a-ff60-439d-9899-c15ecaedd4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:59.614842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a505a-ff60-439d-9899-c15ecaedd4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:59.615215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a505a-ff60-439d-9899-c15ecaedd4e9 admin admin] PATH_INFO: `/v3/projects/82b3039358bc4c47bcb4726672d34ada` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:59.616611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a505a-ff60-439d-9899-c15ecaedd4e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82b3039358bc4c47bcb4726672d34ada)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:59.619050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a505a-ff60-439d-9899-c15ecaedd4e9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:59.653268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80780d3d-8b99-46a8-9f23-d7d015616622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d28fba915445daa4e83bf039331e48, user_id=759702e0f5de493cb1aa8a79983d5599, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:07:59.656851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80780d3d-8b99-46a8-9f23-d7d015616622 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:07:59.688378 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1639/3276] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:07:59 2022] PUT /identity/v3/projects/41d28fba915445daa4e83bf039331e48/users/759702e0f5de493cb1aa8a79983d5599/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:59.691011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42a3dc-032e-4672-8f15-b9ba3ad26260 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:59.691602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42a3dc-032e-4672-8f15-b9ba3ad26260 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:59.692366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42a3dc-032e-4672-8f15-b9ba3ad26260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:59.702658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bc7a505a-ff60-439d-9899-c15ecaedd4e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82b3039358bc4c47bcb4726672d34ada', 'request_id': 'req-bc7a505a-ff60-439d-9899-c15ecaedd4e9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:59.710220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bc7a505a-ff60-439d-9899-c15ecaedd4e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82b3039358bc4c47bcb4726672d34ada', 'request_id': 'req-bc7a505a-ff60-439d-9899-c15ecaedd4e9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:59.722198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6c42a3dc-032e-4672-8f15-b9ba3ad26260 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:59.723794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6c42a3dc-032e-4672-8f15-b9ba3ad26260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:59.731024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bc7a505a-ff60-439d-9899-c15ecaedd4e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82b3039358bc4c47bcb4726672d34ada', 'request_id': 'req-bc7a505a-ff60-439d-9899-c15ecaedd4e9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:59.751464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bc7a505a-ff60-439d-9899-c15ecaedd4e9 admin admin] The token cache is being invalidate because project 82b3039358bc4c47bcb4726672d34ada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:07:59.751835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bc7a505a-ff60-439d-9899-c15ecaedd4e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:59.752436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bc7a505a-ff60-439d-9899-c15ecaedd4e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:07:59.758730 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1638/3277] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:59 2022] DELETE /identity/v3/projects/82b3039358bc4c47bcb4726672d34ada => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:07:59.758730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288d8b9-c249-4588-890c-7006cdd56877 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:59.758730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288d8b9-c249-4588-890c-7006cdd56877 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:59.758730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288d8b9-c249-4588-890c-7006cdd56877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:59.808896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e288d8b9-c249-4588-890c-7006cdd56877 None None] MFA Rules not processed for user `759702e0f5de493cb1aa8a79983d5599`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:59.810604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e288d8b9-c249-4588-890c-7006cdd56877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:59.839137 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1640/3278] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:59.842590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2344b-1894-4772-9736-826a2304660f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:59.843885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2344b-1894-4772-9736-826a2304660f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:59.844357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2344b-1894-4772-9736-826a2304660f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:07:59.882662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-15b2344b-1894-4772-9736-826a2304660f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:07:59.886158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-15b2344b-1894-4772-9736-826a2304660f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:59.921904 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1639/3279] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:59.921904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288d8b9-c249-4588-890c-7006cdd56877 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:07:59.921904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e288d8b9-c249-4588-890c-7006cdd56877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:07:59.926942 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1641/3280] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:07:59.936032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e6ba7-467e-4bd5-950f-fff4ca1b6b18 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:07:59.938659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e6ba7-467e-4bd5-950f-fff4ca1b6b18 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:07:59.939377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e6ba7-467e-4bd5-950f-fff4ca1b6b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:00.028130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-cc9e6ba7-467e-4bd5-950f-fff4ca1b6b18 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:00.029735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cc9e6ba7-467e-4bd5-950f-fff4ca1b6b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:00.040645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288d8b9-c249-4588-890c-7006cdd56877 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:00.052008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769b1d2-cbd3-48c2-8d73-e0a3af7dc400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:00.053496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769b1d2-cbd3-48c2-8d73-e0a3af7dc400 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:00.054732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769b1d2-cbd3-48c2-8d73-e0a3af7dc400 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:00.055696 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1642/3281] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:00.056194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769b1d2-cbd3-48c2-8d73-e0a3af7dc400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:00.056910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e6ba7-467e-4bd5-950f-fff4ca1b6b18 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:00.058376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cc9e6ba7-467e-4bd5-950f-fff4ca1b6b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:00.066560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:00.082342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769b1d2-cbd3-48c2-8d73-e0a3af7dc400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:00.084100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769b1d2-cbd3-48c2-8d73-e0a3af7dc400 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:00.108617 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1640/3282] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:08:00.112106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769b1d2-cbd3-48c2-8d73-e0a3af7dc400 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:00.132812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769b1d2-cbd3-48c2-8d73-e0a3af7dc400 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:00.156161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b26a89-2be6-407c-840c-fd4b11e0cb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:00.156970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b26a89-2be6-407c-840c-fd4b11e0cb20 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:00.157533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b26a89-2be6-407c-840c-fd4b11e0cb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:00.159552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b26a89-2be6-407c-840c-fd4b11e0cb20 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:00.160451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b26a89-2be6-407c-840c-fd4b11e0cb20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:08:00.160778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b26a89-2be6-407c-840c-fd4b11e0cb20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:00.165063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b26a89-2be6-407c-840c-fd4b11e0cb20 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:00.176382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:00.199082 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1641/3283] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:08:00.200363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b26a89-2be6-407c-840c-fd4b11e0cb20 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:00.208444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-38b26a89-2be6-407c-840c-fd4b11e0cb20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:00.255686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e6ba7-467e-4bd5-950f-fff4ca1b6b18 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:00.275058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f879f21-4635-421b-8751-782436071ebf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:00.279675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f879f21-4635-421b-8751-782436071ebf service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:00.279675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f879f21-4635-421b-8751-782436071ebf service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:00.279675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f879f21-4635-421b-8751-782436071ebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:00.318359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f879f21-4635-421b-8751-782436071ebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:00.324039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f879f21-4635-421b-8751-782436071ebf service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:00.344685 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1643/3284] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:08:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:08:00.345707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f879f21-4635-421b-8751-782436071ebf service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:00.374053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f879f21-4635-421b-8751-782436071ebf service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:00.381538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c214b-e3aa-42ae-98a8-a15fa9ff3964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:00.382475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c214b-e3aa-42ae-98a8-a15fa9ff3964 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:00.382868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c214b-e3aa-42ae-98a8-a15fa9ff3964 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:00.385535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c214b-e3aa-42ae-98a8-a15fa9ff3964 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:00.388663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c214b-e3aa-42ae-98a8-a15fa9ff3964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:00.392969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c214b-e3aa-42ae-98a8-a15fa9ff3964 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:00.416315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b26a89-2be6-407c-840c-fd4b11e0cb20 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:00.431839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8c4f3-c6bd-48e8-8e7c-83f3e0e4cb5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:00.432611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8c4f3-c6bd-48e8-8e7c-83f3e0e4cb5b service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:00.432907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8c4f3-c6bd-48e8-8e7c-83f3e0e4cb5b service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:00.433189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8c4f3-c6bd-48e8-8e7c-83f3e0e4cb5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:00.437666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2af8c4f3-c6bd-48e8-8e7c-83f3e0e4cb5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:00.448248 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1644/3285] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:08:00 2022] POST /identity/v3/projects => generated 395 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:08:00.449970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c214b-e3aa-42ae-98a8-a15fa9ff3964 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:00.466768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8c4f3-c6bd-48e8-8e7c-83f3e0e4cb5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:00.468441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8c4f3-c6bd-48e8-8e7c-83f3e0e4cb5b service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:00.516183 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1642/3286] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:08:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:08:00.604137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c214b-e3aa-42ae-98a8-a15fa9ff3964 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:00.611824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef0633-4073-4e6a-acc6-8d52426fcf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:00.612551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef0633-4073-4e6a-acc6-8d52426fcf50 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:00.612844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef0633-4073-4e6a-acc6-8d52426fcf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:00.613277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef0633-4073-4e6a-acc6-8d52426fcf50 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:00.614042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef0633-4073-4e6a-acc6-8d52426fcf50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:00.616174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef0633-4073-4e6a-acc6-8d52426fcf50 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:00.671692 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1645/3287] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:08:00 2022] POST /identity/v3/users => generated 298 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:08:00.675956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8c4f3-c6bd-48e8-8e7c-83f3e0e4cb5b service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:00.691922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8c4f3-c6bd-48e8-8e7c-83f3e0e4cb5b service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:00.702592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219183e-b705-43a3-b721-d337684a7ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:00.703239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219183e-b705-43a3-b721-d337684a7ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:00.703852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219183e-b705-43a3-b721-d337684a7ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:00.703852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219183e-b705-43a3-b721-d337684a7ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:00.705395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219183e-b705-43a3-b721-d337684a7ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:00.710795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219183e-b705-43a3-b721-d337684a7ff5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:00.735662 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1643/3288] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:08:00.739367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef0633-4073-4e6a-acc6-8d52426fcf50 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:00.753546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef0633-4073-4e6a-acc6-8d52426fcf50 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:00.761124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460e690-b390-4133-ae50-4cab79c4a8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:00.761826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460e690-b390-4133-ae50-4cab79c4a8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:00.762130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460e690-b390-4133-ae50-4cab79c4a8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:00.762552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460e690-b390-4133-ae50-4cab79c4a8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:00.763515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460e690-b390-4133-ae50-4cab79c4a8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:00.765552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460e690-b390-4133-ae50-4cab79c4a8f6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:00.790684 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1646/3289] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:08:00.791666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219183e-b705-43a3-b721-d337684a7ff5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:00.808829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219183e-b705-43a3-b721-d337684a7ff5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:00.817391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1e2bf-c254-4a57-bc19-69f42d823b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:00.818223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1e2bf-c254-4a57-bc19-69f42d823b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:00.818718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1e2bf-c254-4a57-bc19-69f42d823b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:00.819329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1e2bf-c254-4a57-bc19-69f42d823b81 admin admin] PATH_INFO: `/v3/projects/d76392eb8a3a4a95a0d9c4d356802ddf/users/ff63f203723043ee8acaae1b08d0e32b/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:00.836796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1e2bf-c254-4a57-bc19-69f42d823b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76392eb8a3a4a95a0d9c4d356802ddf, user_id=ff63f203723043ee8acaae1b08d0e32b, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:00.840293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1e2bf-c254-4a57-bc19-69f42d823b81 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:00.856994 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1644/3290] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:08:00 2022] PUT /identity/v3/projects/d76392eb8a3a4a95a0d9c4d356802ddf/users/ff63f203723043ee8acaae1b08d0e32b/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:08:00.868567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2f6dc-2b1b-4b2b-8ec6-7283f76c65e8 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:00.868779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2f6dc-2b1b-4b2b-8ec6-7283f76c65e8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:00.869153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2f6dc-2b1b-4b2b-8ec6-7283f76c65e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:00.907511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9de2f6dc-2b1b-4b2b-8ec6-7283f76c65e8 None None] MFA Rules not processed for user `ff63f203723043ee8acaae1b08d0e32b`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:00.908755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9de2f6dc-2b1b-4b2b-8ec6-7283f76c65e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:01.029557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:01.095941 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1647/3291] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:01.100028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1e2bf-c254-4a57-bc19-69f42d823b81 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:01.203053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1e2bf-c254-4a57-bc19-69f42d823b81 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:01.208748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405bb29-7e87-4f15-bb54-d01b088887ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:01.210479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405bb29-7e87-4f15-bb54-d01b088887ac admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:01.210771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405bb29-7e87-4f15-bb54-d01b088887ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:01.211052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405bb29-7e87-4f15-bb54-d01b088887ac admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:01.212298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405bb29-7e87-4f15-bb54-d01b088887ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:01.214846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405bb29-7e87-4f15-bb54-d01b088887ac admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:01.258782 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1645/3292] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:08:01 2022] POST /identity/v3/projects => generated 395 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:08:01.262511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2f6dc-2b1b-4b2b-8ec6-7283f76c65e8 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:01.281032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2f6dc-2b1b-4b2b-8ec6-7283f76c65e8 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:01.339251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4c84b-820e-4e61-9029-63b03fa00335 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:01.339719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4c84b-820e-4e61-9029-63b03fa00335 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:01.340134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4c84b-820e-4e61-9029-63b03fa00335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:01.397452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d5d4c84b-820e-4e61-9029-63b03fa00335 None None] MFA Rules not processed for user `8027664b7857430494e38fa27da60c75`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:01.398821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d5d4c84b-820e-4e61-9029-63b03fa00335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:01.433938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:01.465275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a088e0-609b-45ca-b4a9-05b31ad299db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:01.466126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a088e0-609b-45ca-b4a9-05b31ad299db admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:01.472080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a088e0-609b-45ca-b4a9-05b31ad299db admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:01.472553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a088e0-609b-45ca-b4a9-05b31ad299db admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:01.485056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a088e0-609b-45ca-b4a9-05b31ad299db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:01.487364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a088e0-609b-45ca-b4a9-05b31ad299db admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:01.525542 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1648/3293] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:08:01 2022] POST /identity/v3/users => generated 304 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:08:01.529853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a088e0-609b-45ca-b4a9-05b31ad299db admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:01.551280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a088e0-609b-45ca-b4a9-05b31ad299db admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:01.555030 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1646/3294] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:01.564636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4c84b-820e-4e61-9029-63b03fa00335 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:01.566645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d5d4c84b-820e-4e61-9029-63b03fa00335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:01.569768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe20bf-a2ed-4cc2-85be-d4b3fb8bacdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:01.570635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe20bf-a2ed-4cc2-85be-d4b3fb8bacdc admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:01.571608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe20bf-a2ed-4cc2-85be-d4b3fb8bacdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:01.572125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe20bf-a2ed-4cc2-85be-d4b3fb8bacdc admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:01.579581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe20bf-a2ed-4cc2-85be-d4b3fb8bacdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:01.588111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe20bf-a2ed-4cc2-85be-d4b3fb8bacdc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:01.615590 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1649/3295] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:08:01.617034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe20bf-a2ed-4cc2-85be-d4b3fb8bacdc admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:01.654209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe20bf-a2ed-4cc2-85be-d4b3fb8bacdc admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:01.669220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127ef3f-ad89-4732-b948-89aed7fac084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:01.671016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127ef3f-ad89-4732-b948-89aed7fac084 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:01.672682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127ef3f-ad89-4732-b948-89aed7fac084 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:01.673284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127ef3f-ad89-4732-b948-89aed7fac084 admin admin] PATH_INFO: `/v3/projects/9f75781a0e7e452fb1d05ecd80f3253e/users/dfab02f3ec8e427f8407da1aa70c658e/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:01.749167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127ef3f-ad89-4732-b948-89aed7fac084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f75781a0e7e452fb1d05ecd80f3253e, user_id=dfab02f3ec8e427f8407da1aa70c658e, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:01.751815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4c84b-820e-4e61-9029-63b03fa00335 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:01.754905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127ef3f-ad89-4732-b948-89aed7fac084 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:01.770737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f19b5-9b81-4949-9716-79be5830309d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:01.771426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f19b5-9b81-4949-9716-79be5830309d service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:01.771719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f19b5-9b81-4949-9716-79be5830309d service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:01.771996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f19b5-9b81-4949-9716-79be5830309d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:01.794088 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1650/3296] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:08:01 2022] PUT /identity/v3/projects/9f75781a0e7e452fb1d05ecd80f3253e/users/dfab02f3ec8e427f8407da1aa70c658e/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:08:01.799550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127ef3f-ad89-4732-b948-89aed7fac084 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:01.807016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f19b5-9b81-4949-9716-79be5830309d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:01.808702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f19b5-9b81-4949-9716-79be5830309d service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:01.850618 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1647/3297] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:08:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:08:01.897559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127ef3f-ad89-4732-b948-89aed7fac084 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:01.903915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582530c8-d875-4a00-9199-252069cace1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:01.904635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582530c8-d875-4a00-9199-252069cace1b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:01.904991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582530c8-d875-4a00-9199-252069cace1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:01.905371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582530c8-d875-4a00-9199-252069cace1b admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:01.906157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582530c8-d875-4a00-9199-252069cace1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:01.907923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582530c8-d875-4a00-9199-252069cace1b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:01.969104 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1651/3298] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:08:01.972554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f19b5-9b81-4949-9716-79be5830309d service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:02.004740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f19b5-9b81-4949-9716-79be5830309d service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:02.030716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad09f8f-081a-4112-91d8-1aae6e0d5ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:02.031466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad09f8f-081a-4112-91d8-1aae6e0d5ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:02.031759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad09f8f-081a-4112-91d8-1aae6e0d5ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:02.032096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad09f8f-081a-4112-91d8-1aae6e0d5ffa admin admin] PATH_INFO: `/v3/projects/9f75781a0e7e452fb1d05ecd80f3253e/users/dfab02f3ec8e427f8407da1aa70c658e/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:02.037242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad09f8f-081a-4112-91d8-1aae6e0d5ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f75781a0e7e452fb1d05ecd80f3253e, user_id=dfab02f3ec8e427f8407da1aa70c658e, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:02.042505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad09f8f-081a-4112-91d8-1aae6e0d5ffa admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:02.063971 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1648/3299] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:08:01 2022] PUT /identity/v3/projects/9f75781a0e7e452fb1d05ecd80f3253e/users/dfab02f3ec8e427f8407da1aa70c658e/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:08:02.077259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3e533-abb2-4b77-9b9c-90bbe85cfd81 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:02.078200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3e533-abb2-4b77-9b9c-90bbe85cfd81 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:02.078651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3e533-abb2-4b77-9b9c-90bbe85cfd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:02.156111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7de3e533-abb2-4b77-9b9c-90bbe85cfd81 None None] MFA Rules not processed for user `dfab02f3ec8e427f8407da1aa70c658e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:02.159826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7de3e533-abb2-4b77-9b9c-90bbe85cfd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:02.228597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:02.379330 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1652/3300] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:02.982720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad09f8f-081a-4112-91d8-1aae6e0d5ffa admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:03.251259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad09f8f-081a-4112-91d8-1aae6e0d5ffa admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:03.268989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5d53e-8b13-4923-90ab-561ad4ef42db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:03.269239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5d53e-8b13-4923-90ab-561ad4ef42db service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:03.269527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5d53e-8b13-4923-90ab-561ad4ef42db service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:03.269809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5d53e-8b13-4923-90ab-561ad4ef42db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:03.295586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5d53e-8b13-4923-90ab-561ad4ef42db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:03.297411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5d53e-8b13-4923-90ab-561ad4ef42db service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:03.311330 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1649/3301] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:08:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:08:04.365461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3e533-abb2-4b77-9b9c-90bbe85cfd81 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:04.388810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3e533-abb2-4b77-9b9c-90bbe85cfd81 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:04.395519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a6237-fb43-443b-986f-2de378569b76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:04.396181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a6237-fb43-443b-986f-2de378569b76 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:04.396472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a6237-fb43-443b-986f-2de378569b76 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:04.396754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a6237-fb43-443b-986f-2de378569b76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:04.480434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a6237-fb43-443b-986f-2de378569b76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:04.482329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a6237-fb43-443b-986f-2de378569b76 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:04.515508 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1653/3302] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:08:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:08:04.533824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5d53e-8b13-4923-90ab-561ad4ef42db service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:04.585675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:04.663564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5d53e-8b13-4923-90ab-561ad4ef42db service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:04.669743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed47cd-0638-4433-a0f7-3cc61ddee4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:04.682946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed47cd-0638-4433-a0f7-3cc61ddee4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:04.683784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed47cd-0638-4433-a0f7-3cc61ddee4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:04.684238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed47cd-0638-4433-a0f7-3cc61ddee4c0 admin admin] PATH_INFO: `/v3/users/ff63f203723043ee8acaae1b08d0e32b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:04.687131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed47cd-0638-4433-a0f7-3cc61ddee4c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff63f203723043ee8acaae1b08d0e32b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:04.694403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed47cd-0638-4433-a0f7-3cc61ddee4c0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:04.768573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-00ed47cd-0638-4433-a0f7-3cc61ddee4c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff63f203723043ee8acaae1b08d0e32b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:04.794374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-00ed47cd-0638-4433-a0f7-3cc61ddee4c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff63f203723043ee8acaae1b08d0e32b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:04.795251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-00ed47cd-0638-4433-a0f7-3cc61ddee4c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff63f203723043ee8acaae1b08d0e32b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:04.805433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-00ed47cd-0638-4433-a0f7-3cc61ddee4c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff63f203723043ee8acaae1b08d0e32b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:04.806280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-00ed47cd-0638-4433-a0f7-3cc61ddee4c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff63f203723043ee8acaae1b08d0e32b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:04.830533 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1650/3303] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:08:04 2022] DELETE /identity/v3/users/ff63f203723043ee8acaae1b08d0e32b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:08:04.835411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54451d2-9a64-40bf-85c7-b68daa6dfe93 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:04.835751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54451d2-9a64-40bf-85c7-b68daa6dfe93 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:04.835983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54451d2-9a64-40bf-85c7-b68daa6dfe93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:04.879251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f54451d2-9a64-40bf-85c7-b68daa6dfe93 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:04.880910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f54451d2-9a64-40bf-85c7-b68daa6dfe93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:05.019079 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1654/3304] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:05.051071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed47cd-0638-4433-a0f7-3cc61ddee4c0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:05.052657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-00ed47cd-0638-4433-a0f7-3cc61ddee4c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:05.142021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed47cd-0638-4433-a0f7-3cc61ddee4c0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:05.148592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c6a0e-8a1e-4a59-97b3-e3f89f3fb390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:05.150792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c6a0e-8a1e-4a59-97b3-e3f89f3fb390 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:05.151184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c6a0e-8a1e-4a59-97b3-e3f89f3fb390 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:05.152241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c6a0e-8a1e-4a59-97b3-e3f89f3fb390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:05.166733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c6a0e-8a1e-4a59-97b3-e3f89f3fb390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:05.169672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c6a0e-8a1e-4a59-97b3-e3f89f3fb390 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:05.188667 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1651/3305] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:08:05.798524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54451d2-9a64-40bf-85c7-b68daa6dfe93 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:05.800085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f54451d2-9a64-40bf-85c7-b68daa6dfe93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:05.824296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54451d2-9a64-40bf-85c7-b68daa6dfe93 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:05.840565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5a78d-e58b-4ca6-8bb0-47b4f05b56c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:05.841496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5a78d-e58b-4ca6-8bb0-47b4f05b56c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:05.841882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5a78d-e58b-4ca6-8bb0-47b4f05b56c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:05.842909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5a78d-e58b-4ca6-8bb0-47b4f05b56c0 admin admin] PATH_INFO: `/v3/projects/d76392eb8a3a4a95a0d9c4d356802ddf` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:05.844400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5a78d-e58b-4ca6-8bb0-47b4f05b56c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76392eb8a3a4a95a0d9c4d356802ddf)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:05.846714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5a78d-e58b-4ca6-8bb0-47b4f05b56c0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:05.883833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1cf10-6f7a-4f72-8f5b-8f91f45c3f55 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:05.884911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1cf10-6f7a-4f72-8f5b-8f91f45c3f55 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:05.885358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1cf10-6f7a-4f72-8f5b-8f91f45c3f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:05.918658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-94c1cf10-6f7a-4f72-8f5b-8f91f45c3f55 None None] MFA Rules not processed for user `8027664b7857430494e38fa27da60c75`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:05.920212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-94c1cf10-6f7a-4f72-8f5b-8f91f45c3f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:05.975502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:05.983145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:05.984184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4cc5a78d-e58b-4ca6-8bb0-47b4f05b56c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76392eb8a3a4a95a0d9c4d356802ddf', 'request_id': 'req-4cc5a78d-e58b-4ca6-8bb0-47b4f05b56c0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:06.014782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4cc5a78d-e58b-4ca6-8bb0-47b4f05b56c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76392eb8a3a4a95a0d9c4d356802ddf', 'request_id': 'req-4cc5a78d-e58b-4ca6-8bb0-47b4f05b56c0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:06.034605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4cc5a78d-e58b-4ca6-8bb0-47b4f05b56c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76392eb8a3a4a95a0d9c4d356802ddf', 'request_id': 'req-4cc5a78d-e58b-4ca6-8bb0-47b4f05b56c0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:06.043574 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1652/3306] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 30 21:08:06.044536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1cf10-6f7a-4f72-8f5b-8f91f45c3f55 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:06.052946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-94c1cf10-6f7a-4f72-8f5b-8f91f45c3f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:06.057775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4cc5a78d-e58b-4ca6-8bb0-47b4f05b56c0 admin admin] The token cache is being invalidate because project d76392eb8a3a4a95a0d9c4d356802ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:08:06.058078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4cc5a78d-e58b-4ca6-8bb0-47b4f05b56c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:06.058802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4cc5a78d-e58b-4ca6-8bb0-47b4f05b56c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:06.064673 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1655/3307] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:08:05 2022] DELETE /identity/v3/projects/d76392eb8a3a4a95a0d9c4d356802ddf => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:08:06.065941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5a78d-e58b-4ca6-8bb0-47b4f05b56c0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:06.067572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4cc5a78d-e58b-4ca6-8bb0-47b4f05b56c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:06.128233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1cf10-6f7a-4f72-8f5b-8f91f45c3f55 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:06.285442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5a78d-e58b-4ca6-8bb0-47b4f05b56c0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:06.303894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59646f03-cf3f-44f4-bc44-345e9016ad87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:06.306535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59646f03-cf3f-44f4-bc44-345e9016ad87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:06.307098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59646f03-cf3f-44f4-bc44-345e9016ad87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:06.307411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59646f03-cf3f-44f4-bc44-345e9016ad87 admin admin] PATH_INFO: `/v3/users/dfab02f3ec8e427f8407da1aa70c658e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:06.311874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59646f03-cf3f-44f4-bc44-345e9016ad87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfab02f3ec8e427f8407da1aa70c658e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:06.324732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59646f03-cf3f-44f4-bc44-345e9016ad87 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:06.353861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b3455-6cf5-41ae-8a14-abdf59c35280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:06.354541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b3455-6cf5-41ae-8a14-abdf59c35280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:06.354826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b3455-6cf5-41ae-8a14-abdf59c35280 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:06.355105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b3455-6cf5-41ae-8a14-abdf59c35280 admin admin] PATH_INFO: `/v3/users/759702e0f5de493cb1aa8a79983d5599` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:06.358769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b3455-6cf5-41ae-8a14-abdf59c35280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=759702e0f5de493cb1aa8a79983d5599)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:06.360770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b3455-6cf5-41ae-8a14-abdf59c35280 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:06.452394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59646f03-cf3f-44f4-bc44-345e9016ad87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfab02f3ec8e427f8407da1aa70c658e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:06.453352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59646f03-cf3f-44f4-bc44-345e9016ad87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfab02f3ec8e427f8407da1aa70c658e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:06.490603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59646f03-cf3f-44f4-bc44-345e9016ad87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfab02f3ec8e427f8407da1aa70c658e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:06.491724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59646f03-cf3f-44f4-bc44-345e9016ad87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfab02f3ec8e427f8407da1aa70c658e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:06.504295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-298b3455-6cf5-41ae-8a14-abdf59c35280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '759702e0f5de493cb1aa8a79983d5599'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:06.510904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59646f03-cf3f-44f4-bc44-345e9016ad87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfab02f3ec8e427f8407da1aa70c658e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:06.536297 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1656/3308] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:08:06 2022] DELETE /identity/v3/users/dfab02f3ec8e427f8407da1aa70c658e => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:08:06.539890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-298b3455-6cf5-41ae-8a14-abdf59c35280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '759702e0f5de493cb1aa8a79983d5599'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:06.549575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-298b3455-6cf5-41ae-8a14-abdf59c35280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '759702e0f5de493cb1aa8a79983d5599'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:06.580070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-298b3455-6cf5-41ae-8a14-abdf59c35280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '759702e0f5de493cb1aa8a79983d5599'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:06.588624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-298b3455-6cf5-41ae-8a14-abdf59c35280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '759702e0f5de493cb1aa8a79983d5599'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:06.612536 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1653/3309] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:08:06 2022] DELETE /identity/v3/users/759702e0f5de493cb1aa8a79983d5599 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:08:06.616989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d4d8d-462e-421d-81a3-ae1929ee7ead None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:06.617344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d4d8d-462e-421d-81a3-ae1929ee7ead None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:06.617703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d4d8d-462e-421d-81a3-ae1929ee7ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:06.656851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3c4d4d8d-462e-421d-81a3-ae1929ee7ead None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:06.659216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3c4d4d8d-462e-421d-81a3-ae1929ee7ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:06.763321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:06.784255 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1657/3310] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:06.851751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b3455-6cf5-41ae-8a14-abdf59c35280 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:06.854485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-298b3455-6cf5-41ae-8a14-abdf59c35280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:07.016074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b3455-6cf5-41ae-8a14-abdf59c35280 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:07.028580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65c811-a002-4eb9-bf04-d30fa8dcbd8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:07.029228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65c811-a002-4eb9-bf04-d30fa8dcbd8d service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:07.029513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65c811-a002-4eb9-bf04-d30fa8dcbd8d service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:07.029796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65c811-a002-4eb9-bf04-d30fa8dcbd8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:07.073798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65c811-a002-4eb9-bf04-d30fa8dcbd8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:07.075367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65c811-a002-4eb9-bf04-d30fa8dcbd8d service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:07.110563 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1654/3311] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:08:08.150649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d4d8d-462e-421d-81a3-ae1929ee7ead None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:08.152233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3c4d4d8d-462e-421d-81a3-ae1929ee7ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:08.192748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d4d8d-462e-421d-81a3-ae1929ee7ead None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:08.227643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132eb83f-2095-429f-921d-715ae84a68f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:08.228314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132eb83f-2095-429f-921d-715ae84a68f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:08.229298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132eb83f-2095-429f-921d-715ae84a68f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:08.229589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132eb83f-2095-429f-921d-715ae84a68f3 admin admin] PATH_INFO: `/v3/projects/9f75781a0e7e452fb1d05ecd80f3253e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:08.231891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132eb83f-2095-429f-921d-715ae84a68f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f75781a0e7e452fb1d05ecd80f3253e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:08.237315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132eb83f-2095-429f-921d-715ae84a68f3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:08.419470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-132eb83f-2095-429f-921d-715ae84a68f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f75781a0e7e452fb1d05ecd80f3253e', 'request_id': 'req-132eb83f-2095-429f-921d-715ae84a68f3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:08.441065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-132eb83f-2095-429f-921d-715ae84a68f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f75781a0e7e452fb1d05ecd80f3253e', 'request_id': 'req-132eb83f-2095-429f-921d-715ae84a68f3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:08.456443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-132eb83f-2095-429f-921d-715ae84a68f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f75781a0e7e452fb1d05ecd80f3253e', 'request_id': 'req-132eb83f-2095-429f-921d-715ae84a68f3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:08.473400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-132eb83f-2095-429f-921d-715ae84a68f3 admin admin] The token cache is being invalidate because project 9f75781a0e7e452fb1d05ecd80f3253e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:08:08.473705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-132eb83f-2095-429f-921d-715ae84a68f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:08.474960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-132eb83f-2095-429f-921d-715ae84a68f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:08.483882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a7250-ff05-4ab8-9c02-276720222264 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:08.484420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a7250-ff05-4ab8-9c02-276720222264 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:08.484420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a7250-ff05-4ab8-9c02-276720222264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:08.494052 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1658/3312] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:08:08 2022] DELETE /identity/v3/projects/9f75781a0e7e452fb1d05ecd80f3253e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:08:08.529582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5f1a7250-ff05-4ab8-9c02-276720222264 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:08.531417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5f1a7250-ff05-4ab8-9c02-276720222264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:08.542046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:08.672964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d8864-32ef-4da5-b412-9f8a0f8f4b9f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:08.673217 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1655/3313] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:08.673358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d8864-32ef-4da5-b412-9f8a0f8f4b9f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:08.673558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d8864-32ef-4da5-b412-9f8a0f8f4b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:08.716441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4c0d8864-32ef-4da5-b412-9f8a0f8f4b9f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:08.717724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4c0d8864-32ef-4da5-b412-9f8a0f8f4b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:08.752101 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1659/3314] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:08.753397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a7250-ff05-4ab8-9c02-276720222264 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:08.770671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a7250-ff05-4ab8-9c02-276720222264 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:08.792371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34724e2e-590a-4cb8-8893-80c09aed030e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:08.793768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34724e2e-590a-4cb8-8893-80c09aed030e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:08.796439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34724e2e-590a-4cb8-8893-80c09aed030e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:08.797409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34724e2e-590a-4cb8-8893-80c09aed030e admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:08.798336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34724e2e-590a-4cb8-8893-80c09aed030e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:08:08.798819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34724e2e-590a-4cb8-8893-80c09aed030e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:08.806175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34724e2e-590a-4cb8-8893-80c09aed030e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:08.840124 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1656/3315] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:08:08.845263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d8864-32ef-4da5-b412-9f8a0f8f4b9f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:08.853315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34724e2e-590a-4cb8-8893-80c09aed030e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:08.857765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-34724e2e-590a-4cb8-8893-80c09aed030e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:08.868551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d8864-32ef-4da5-b412-9f8a0f8f4b9f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:08.884085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9ff84-c2b6-4474-b046-a1fb9288d53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:08.884731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9ff84-c2b6-4474-b046-a1fb9288d53b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:08.885013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9ff84-c2b6-4474-b046-a1fb9288d53b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:08.885284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9ff84-c2b6-4474-b046-a1fb9288d53b admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:08.888261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9ff84-c2b6-4474-b046-a1fb9288d53b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:08.890835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34724e2e-590a-4cb8-8893-80c09aed030e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:08.898105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9ff84-c2b6-4474-b046-a1fb9288d53b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:08.908610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f33330-6f44-4858-8855-5a95d2e6fc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:08.909469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f33330-6f44-4858-8855-5a95d2e6fc43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:08.909703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f33330-6f44-4858-8855-5a95d2e6fc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:08.911922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f33330-6f44-4858-8855-5a95d2e6fc43 admin admin] PATH_INFO: `/v3/projects/41d28fba915445daa4e83bf039331e48` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:08.915345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f33330-6f44-4858-8855-5a95d2e6fc43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41d28fba915445daa4e83bf039331e48)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:08.918010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f33330-6f44-4858-8855-5a95d2e6fc43 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:08.974043 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1660/3316] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:08:08 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:08:08.977964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9ff84-c2b6-4474-b046-a1fb9288d53b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:09.042051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-53f33330-6f44-4858-8855-5a95d2e6fc43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41d28fba915445daa4e83bf039331e48', 'request_id': 'req-53f33330-6f44-4858-8855-5a95d2e6fc43'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:09.063005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-53f33330-6f44-4858-8855-5a95d2e6fc43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41d28fba915445daa4e83bf039331e48', 'request_id': 'req-53f33330-6f44-4858-8855-5a95d2e6fc43'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:09.084672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-53f33330-6f44-4858-8855-5a95d2e6fc43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41d28fba915445daa4e83bf039331e48', 'request_id': 'req-53f33330-6f44-4858-8855-5a95d2e6fc43'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:09.115557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-53f33330-6f44-4858-8855-5a95d2e6fc43 admin admin] The token cache is being invalidate because project 41d28fba915445daa4e83bf039331e48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:08:09.116061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-53f33330-6f44-4858-8855-5a95d2e6fc43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:09.118427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-53f33330-6f44-4858-8855-5a95d2e6fc43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:09.127886 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1657/3317] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:08:08 2022] DELETE /identity/v3/projects/41d28fba915445daa4e83bf039331e48 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:08:09.134305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9ff84-c2b6-4474-b046-a1fb9288d53b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:09.134897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004a17f-fea7-4216-8032-668a0f4434a5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:09.135394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004a17f-fea7-4216-8032-668a0f4434a5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:09.135864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004a17f-fea7-4216-8032-668a0f4434a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:09.176643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8004a17f-fea7-4216-8032-668a0f4434a5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:09.182137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8004a17f-fea7-4216-8032-668a0f4434a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:09.209632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:09.283411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d6da0-bca4-4393-9bad-ed17485f1331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:09.287889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d6da0-bca4-4393-9bad-ed17485f1331 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:09.288268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d6da0-bca4-4393-9bad-ed17485f1331 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:09.290811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d6da0-bca4-4393-9bad-ed17485f1331 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:09.292057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d6da0-bca4-4393-9bad-ed17485f1331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:09.294146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d6da0-bca4-4393-9bad-ed17485f1331 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:09.343096 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1658/3318] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:08:09.355404 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1661/3319] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:08:08 2022] POST /identity/v3/users => generated 292 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:08:09.359944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d6da0-bca4-4393-9bad-ed17485f1331 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:09.364191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d701e8-af9d-47a6-8cd1-9841ddceed3b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:09.365016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d701e8-af9d-47a6-8cd1-9841ddceed3b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:09.366353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d701e8-af9d-47a6-8cd1-9841ddceed3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:09.377701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ed0d6da0-bca4-4393-9bad-ed17485f1331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:09.394411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-09d701e8-af9d-47a6-8cd1-9841ddceed3b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:09.396004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-09d701e8-af9d-47a6-8cd1-9841ddceed3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:09.408830 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1659/3320] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:09.413430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d701e8-af9d-47a6-8cd1-9841ddceed3b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:09.413776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d6da0-bca4-4393-9bad-ed17485f1331 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:09.425181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed537c-8597-4c99-bfb9-e4940aa7a89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:09.426451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed537c-8597-4c99-bfb9-e4940aa7a89f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:09.426741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed537c-8597-4c99-bfb9-e4940aa7a89f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:09.427018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed537c-8597-4c99-bfb9-e4940aa7a89f admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:09.427794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed537c-8597-4c99-bfb9-e4940aa7a89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:09.428844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d701e8-af9d-47a6-8cd1-9841ddceed3b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:09.429508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed537c-8597-4c99-bfb9-e4940aa7a89f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:09.438046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c062ac-7cfb-4301-adb9-6d218d66fa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:09.440020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c062ac-7cfb-4301-adb9-6d218d66fa56 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:09.440888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c062ac-7cfb-4301-adb9-6d218d66fa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:09.441375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c062ac-7cfb-4301-adb9-6d218d66fa56 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:09.442607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c062ac-7cfb-4301-adb9-6d218d66fa56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:08:09.443151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c062ac-7cfb-4301-adb9-6d218d66fa56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:09.446169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c062ac-7cfb-4301-adb9-6d218d66fa56 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:09.456221 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1662/3321] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:08:09.457213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed537c-8597-4c99-bfb9-e4940aa7a89f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:09.465740 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1660/3322] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:08:09.471351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c062ac-7cfb-4301-adb9-6d218d66fa56 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:09.474733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed537c-8597-4c99-bfb9-e4940aa7a89f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:09.481378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15f268-5cc3-47ab-a2f8-108aef57fbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:09.482167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15f268-5cc3-47ab-a2f8-108aef57fbfc admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:09.482455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15f268-5cc3-47ab-a2f8-108aef57fbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:09.482732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15f268-5cc3-47ab-a2f8-108aef57fbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:09.484532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15f268-5cc3-47ab-a2f8-108aef57fbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:09.486467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15f268-5cc3-47ab-a2f8-108aef57fbfc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:09.497718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:09.513484 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1663/3323] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:08:09.519315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15f268-5cc3-47ab-a2f8-108aef57fbfc admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:09.523139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c062ac-7cfb-4301-adb9-6d218d66fa56 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:09.535925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5953399-3865-4b15-86a6-3ff27c15a070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:09.536845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5953399-3865-4b15-86a6-3ff27c15a070 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:09.537409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5953399-3865-4b15-86a6-3ff27c15a070 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:09.537892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5953399-3865-4b15-86a6-3ff27c15a070 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:09.538734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5953399-3865-4b15-86a6-3ff27c15a070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:09.541486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5953399-3865-4b15-86a6-3ff27c15a070 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:09.545664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15f268-5cc3-47ab-a2f8-108aef57fbfc admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:09.557447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc820c7-8703-4b20-95d0-8c04210cb68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:09.558148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc820c7-8703-4b20-95d0-8c04210cb68c admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:09.558436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc820c7-8703-4b20-95d0-8c04210cb68c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:09.558725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc820c7-8703-4b20-95d0-8c04210cb68c admin admin] PATH_INFO: `/v3/projects/6dcec3648d3843dd96bfed76e793598a/users/879e94018c474c838b1b989f3d4013a0/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:09.579013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc820c7-8703-4b20-95d0-8c04210cb68c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dcec3648d3843dd96bfed76e793598a, user_id=879e94018c474c838b1b989f3d4013a0, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:09.582272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc820c7-8703-4b20-95d0-8c04210cb68c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:09.612451 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1664/3324] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:08:09 2022] PUT /identity/v3/projects/6dcec3648d3843dd96bfed76e793598a/users/879e94018c474c838b1b989f3d4013a0/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:08:09.614896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb91ca9-0eda-4765-b77b-512969e619a9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:09.615362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb91ca9-0eda-4765-b77b-512969e619a9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:09.615752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb91ca9-0eda-4765-b77b-512969e619a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:09.634356 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1661/3325] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:08:09 2022] POST /identity/v3/projects => generated 395 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:08:09.636786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5953399-3865-4b15-86a6-3ff27c15a070 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:09.662919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5bb91ca9-0eda-4765-b77b-512969e619a9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:09.667389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5bb91ca9-0eda-4765-b77b-512969e619a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:09.786404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5953399-3865-4b15-86a6-3ff27c15a070 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:09.790582 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1665/3326] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:08:09.798824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90419098-3d3b-48b6-a0ae-359ace63427e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:09.799497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90419098-3d3b-48b6-a0ae-359ace63427e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:09.799988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90419098-3d3b-48b6-a0ae-359ace63427e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:09.800427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90419098-3d3b-48b6-a0ae-359ace63427e admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:09.801271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90419098-3d3b-48b6-a0ae-359ace63427e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:09.801412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb91ca9-0eda-4765-b77b-512969e619a9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:09.803549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90419098-3d3b-48b6-a0ae-359ace63427e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:09.804295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5bb91ca9-0eda-4765-b77b-512969e619a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:09.860410 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1662/3327] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:08:09 2022] POST /identity/v3/users => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:08:09.868344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90419098-3d3b-48b6-a0ae-359ace63427e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:09.893770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90419098-3d3b-48b6-a0ae-359ace63427e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:09.922790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739e2f6-7695-47a1-864b-1b1ca9402364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:09.922790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739e2f6-7695-47a1-864b-1b1ca9402364 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:09.923176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739e2f6-7695-47a1-864b-1b1ca9402364 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:09.923176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739e2f6-7695-47a1-864b-1b1ca9402364 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:09.924399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739e2f6-7695-47a1-864b-1b1ca9402364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:09.926441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739e2f6-7695-47a1-864b-1b1ca9402364 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:09.949320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb91ca9-0eda-4765-b77b-512969e619a9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:09.950770 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1663/3328] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:08:09.954425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739e2f6-7695-47a1-864b-1b1ca9402364 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:09.962072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d67c3-8595-4d21-91b5-81eb1c6cdce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:09.965691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d67c3-8595-4d21-91b5-81eb1c6cdce8 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:09.967420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d67c3-8595-4d21-91b5-81eb1c6cdce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:09.967869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d67c3-8595-4d21-91b5-81eb1c6cdce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:09.989983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739e2f6-7695-47a1-864b-1b1ca9402364 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:09.993194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d67c3-8595-4d21-91b5-81eb1c6cdce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:10.006889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d67c3-8595-4d21-91b5-81eb1c6cdce8 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:10.021556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54e196-dc42-4f4a-9045-7f9c69087217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:10.022433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54e196-dc42-4f4a-9045-7f9c69087217 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:10.022678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54e196-dc42-4f4a-9045-7f9c69087217 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:10.024610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54e196-dc42-4f4a-9045-7f9c69087217 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:10.025333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54e196-dc42-4f4a-9045-7f9c69087217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:10.026963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54e196-dc42-4f4a-9045-7f9c69087217 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:10.049852 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1666/3330] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:08:10.050036 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1664/3330] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:08:10.054595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54e196-dc42-4f4a-9045-7f9c69087217 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:10.075486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54e196-dc42-4f4a-9045-7f9c69087217 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:10.085228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20848db-6a1b-4a8f-9282-2fedf1cd23cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:10.085975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20848db-6a1b-4a8f-9282-2fedf1cd23cc admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:10.086435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20848db-6a1b-4a8f-9282-2fedf1cd23cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:10.086617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20848db-6a1b-4a8f-9282-2fedf1cd23cc admin admin] PATH_INFO: `/v3/projects/104c18938daf48a585c72a3072616758/users/21aec407a6e04e4f8a0379061bab8a69/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:10.130904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20848db-6a1b-4a8f-9282-2fedf1cd23cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=104c18938daf48a585c72a3072616758, user_id=21aec407a6e04e4f8a0379061bab8a69, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:10.134424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20848db-6a1b-4a8f-9282-2fedf1cd23cc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:10.177831 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1665/3331] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:08:10 2022] PUT /identity/v3/projects/104c18938daf48a585c72a3072616758/users/21aec407a6e04e4f8a0379061bab8a69/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:08:10.179405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a15f4-5956-433e-b08e-b6c7116fa202 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:10.179970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a15f4-5956-433e-b08e-b6c7116fa202 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:10.180827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a15f4-5956-433e-b08e-b6c7116fa202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:10.272812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-561a15f4-5956-433e-b08e-b6c7116fa202 None None] MFA Rules not processed for user `21aec407a6e04e4f8a0379061bab8a69`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:10.277430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-561a15f4-5956-433e-b08e-b6c7116fa202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:10.323497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:10.411691 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1667/3332] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:10.414402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357494a-52ad-4693-a012-83f65e029144 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:10.414899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357494a-52ad-4693-a012-83f65e029144 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:10.415543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357494a-52ad-4693-a012-83f65e029144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:10.462909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7357494a-52ad-4693-a012-83f65e029144 None None] MFA Rules not processed for user `21aec407a6e04e4f8a0379061bab8a69`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:10.466215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7357494a-52ad-4693-a012-83f65e029144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:10.494237 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1666/3333] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:11.069609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a15f4-5956-433e-b08e-b6c7116fa202 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:11.072939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-561a15f4-5956-433e-b08e-b6c7116fa202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:11.303074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a15f4-5956-433e-b08e-b6c7116fa202 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:11.334713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc7d06-4649-46f0-9009-033c1ce8b69a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:11.335495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc7d06-4649-46f0-9009-033c1ce8b69a service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:11.335932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc7d06-4649-46f0-9009-033c1ce8b69a service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:11.336227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc7d06-4649-46f0-9009-033c1ce8b69a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:11.355007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc7d06-4649-46f0-9009-033c1ce8b69a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:11.358177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc7d06-4649-46f0-9009-033c1ce8b69a service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:11.412567 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1668/3334] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:08:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:08:11.429102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ffcc9-046f-4b09-8205-1d1d5dab9a7b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:11.429634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ffcc9-046f-4b09-8205-1d1d5dab9a7b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:11.429818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ffcc9-046f-4b09-8205-1d1d5dab9a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:11.484833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-743ffcc9-046f-4b09-8205-1d1d5dab9a7b None None] MFA Rules not processed for user `21aec407a6e04e4f8a0379061bab8a69`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:11.491002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-743ffcc9-046f-4b09-8205-1d1d5dab9a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:11.517528 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1667/3335] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:12.036828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa27cf-e7cc-48a5-86e4-102dec13e523 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:12.037169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa27cf-e7cc-48a5-86e4-102dec13e523 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:12.037417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa27cf-e7cc-48a5-86e4-102dec13e523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:12.058882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fdfa27cf-e7cc-48a5-86e4-102dec13e523 None None] MFA Rules not processed for user `21aec407a6e04e4f8a0379061bab8a69`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:12.060868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fdfa27cf-e7cc-48a5-86e4-102dec13e523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:12.072949 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1669/3336] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:12.110852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901415a-b649-40af-ad56-172eee744570 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:12.112227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901415a-b649-40af-ad56-172eee744570 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:12.112520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901415a-b649-40af-ad56-172eee744570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:12.166951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a901415a-b649-40af-ad56-172eee744570 None None] MFA Rules not processed for user `21aec407a6e04e4f8a0379061bab8a69`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:12.185456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a901415a-b649-40af-ad56-172eee744570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:12.205778 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1668/3337] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:12.706336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36b57-963e-48d9-8159-0116005b440c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:12.706890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36b57-963e-48d9-8159-0116005b440c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:12.706999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36b57-963e-48d9-8159-0116005b440c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:12.735323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f7c36b57-963e-48d9-8159-0116005b440c None None] MFA Rules not processed for user `21aec407a6e04e4f8a0379061bab8a69`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:12.736743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f7c36b57-963e-48d9-8159-0116005b440c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:12.760024 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1670/3338] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:12.824892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901415a-b649-40af-ad56-172eee744570 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:12.853470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eab5e-91c8-44d9-a2c1-a8abbcaef95e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:12.854165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eab5e-91c8-44d9-a2c1-a8abbcaef95e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:12.854543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eab5e-91c8-44d9-a2c1-a8abbcaef95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:12.907255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-da9eab5e-91c8-44d9-a2c1-a8abbcaef95e None None] MFA Rules not processed for user `6399b6f3e2574df8af12786c8755c59a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:12.909938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-da9eab5e-91c8-44d9-a2c1-a8abbcaef95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:12.913634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901415a-b649-40af-ad56-172eee744570 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:12.919811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053460bb-0220-489a-af0f-a28f63da2316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:12.920714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053460bb-0220-489a-af0f-a28f63da2316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:12.921121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053460bb-0220-489a-af0f-a28f63da2316 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:12.921489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053460bb-0220-489a-af0f-a28f63da2316 admin admin] PATH_INFO: `/v3/users/21aec407a6e04e4f8a0379061bab8a69` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:12.937471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053460bb-0220-489a-af0f-a28f63da2316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21aec407a6e04e4f8a0379061bab8a69)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:12.944817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053460bb-0220-489a-af0f-a28f63da2316 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:12.961046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:13.023495 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1671/3339] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:13.060921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-053460bb-0220-489a-af0f-a28f63da2316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21aec407a6e04e4f8a0379061bab8a69'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:13.065181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9eab5e-91c8-44d9-a2c1-a8abbcaef95e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:13.082848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-053460bb-0220-489a-af0f-a28f63da2316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21aec407a6e04e4f8a0379061bab8a69'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:13.083647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-053460bb-0220-489a-af0f-a28f63da2316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21aec407a6e04e4f8a0379061bab8a69'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:13.110143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-053460bb-0220-489a-af0f-a28f63da2316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21aec407a6e04e4f8a0379061bab8a69'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:13.111072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-053460bb-0220-489a-af0f-a28f63da2316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21aec407a6e04e4f8a0379061bab8a69'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:13.121430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:13.141340 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1669/3340] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:08:12 2022] DELETE /identity/v3/users/21aec407a6e04e4f8a0379061bab8a69 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:08:13.145795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dcab9-b258-4382-86de-637c0e285abf None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:13.146093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dcab9-b258-4382-86de-637c0e285abf None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:13.146519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dcab9-b258-4382-86de-637c0e285abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:13.159894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9eab5e-91c8-44d9-a2c1-a8abbcaef95e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:13.187615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-945dcab9-b258-4382-86de-637c0e285abf None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:13.189557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-945dcab9-b258-4382-86de-637c0e285abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:13.306084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113e7e8-c1f0-4566-9412-5715d4c24288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:13.308459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113e7e8-c1f0-4566-9412-5715d4c24288 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:13.308751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113e7e8-c1f0-4566-9412-5715d4c24288 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:13.309035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113e7e8-c1f0-4566-9412-5715d4c24288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:13.330362 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1670/3341] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:08:13.331953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945dcab9-b258-4382-86de-637c0e285abf None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:13.333214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9113e7e8-c1f0-4566-9412-5715d4c24288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:13.335758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-945dcab9-b258-4382-86de-637c0e285abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:13.377955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945dcab9-b258-4382-86de-637c0e285abf None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:13.392803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871f3d1-dc26-482b-b20e-20614f4276b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:13.394745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871f3d1-dc26-482b-b20e-20614f4276b8 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:13.395330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871f3d1-dc26-482b-b20e-20614f4276b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:13.395862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871f3d1-dc26-482b-b20e-20614f4276b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:13.411249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871f3d1-dc26-482b-b20e-20614f4276b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:13.415886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871f3d1-dc26-482b-b20e-20614f4276b8 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:13.437896 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1671/3342] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:08:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:08:13.478321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113e7e8-c1f0-4566-9412-5715d4c24288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:13.480824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113e7e8-c1f0-4566-9412-5715d4c24288 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:13.496252 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1672/3343] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:08:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:08:14.613247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871f3d1-dc26-482b-b20e-20614f4276b8 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:14.615058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3871f3d1-dc26-482b-b20e-20614f4276b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:14.646214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871f3d1-dc26-482b-b20e-20614f4276b8 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:14.656619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4670876-4b1e-4adb-8a72-fa52eef2d1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:14.673796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4670876-4b1e-4adb-8a72-fa52eef2d1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:14.675156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4670876-4b1e-4adb-8a72-fa52eef2d1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:14.676873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4670876-4b1e-4adb-8a72-fa52eef2d1f6 admin admin] PATH_INFO: `/v3/projects/104c18938daf48a585c72a3072616758` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:14.682545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4670876-4b1e-4adb-8a72-fa52eef2d1f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=104c18938daf48a585c72a3072616758)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:14.705968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4670876-4b1e-4adb-8a72-fa52eef2d1f6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:14.859392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a4670876-4b1e-4adb-8a72-fa52eef2d1f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104c18938daf48a585c72a3072616758', 'request_id': 'req-a4670876-4b1e-4adb-8a72-fa52eef2d1f6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:14.877310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a4670876-4b1e-4adb-8a72-fa52eef2d1f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104c18938daf48a585c72a3072616758', 'request_id': 'req-a4670876-4b1e-4adb-8a72-fa52eef2d1f6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:14.897939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a4670876-4b1e-4adb-8a72-fa52eef2d1f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104c18938daf48a585c72a3072616758', 'request_id': 'req-a4670876-4b1e-4adb-8a72-fa52eef2d1f6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:14.908359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:14.927158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a4670876-4b1e-4adb-8a72-fa52eef2d1f6 admin admin] The token cache is being invalidate because project 104c18938daf48a585c72a3072616758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:08:14.927818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a4670876-4b1e-4adb-8a72-fa52eef2d1f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:14.928620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a4670876-4b1e-4adb-8a72-fa52eef2d1f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:14.935969 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1672/3344] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:08:14 2022] DELETE /identity/v3/projects/104c18938daf48a585c72a3072616758 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:08:14.937079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f5410-06a3-44eb-bc5d-0e10ba4ac8ad None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:14.937565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f5410-06a3-44eb-bc5d-0e10ba4ac8ad None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:14.937660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f5410-06a3-44eb-bc5d-0e10ba4ac8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:14.978503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ff9f5410-06a3-44eb-bc5d-0e10ba4ac8ad None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:14.981204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ff9f5410-06a3-44eb-bc5d-0e10ba4ac8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:15.097925 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1673/3345] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:08:15.101403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667786a2-e410-46a3-9b12-735456c2fe62 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:15.102542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667786a2-e410-46a3-9b12-735456c2fe62 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:15.103055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667786a2-e410-46a3-9b12-735456c2fe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:15.146884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-667786a2-e410-46a3-9b12-735456c2fe62 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:15.149076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-667786a2-e410-46a3-9b12-735456c2fe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:15.196891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f5410-06a3-44eb-bc5d-0e10ba4ac8ad None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:15.197301 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1673/3346] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:15.208559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f5410-06a3-44eb-bc5d-0e10ba4ac8ad None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:15.216646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c478a-0e43-48db-a608-b4a3476588bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:15.217302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c478a-0e43-48db-a608-b4a3476588bd admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:15.217583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c478a-0e43-48db-a608-b4a3476588bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:15.218037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c478a-0e43-48db-a608-b4a3476588bd admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:15.219541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c478a-0e43-48db-a608-b4a3476588bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:08:15.219899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c478a-0e43-48db-a608-b4a3476588bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:15.222077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c478a-0e43-48db-a608-b4a3476588bd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:15.255055 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1674/3347] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:08:15.256305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667786a2-e410-46a3-9b12-735456c2fe62 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:15.272783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667786a2-e410-46a3-9b12-735456c2fe62 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:15.284587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ad0a2-a4c1-48c9-b1a0-80c9810bba1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:15.285234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ad0a2-a4c1-48c9-b1a0-80c9810bba1b admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:15.285521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ad0a2-a4c1-48c9-b1a0-80c9810bba1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:15.285796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ad0a2-a4c1-48c9-b1a0-80c9810bba1b admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:15.286967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ad0a2-a4c1-48c9-b1a0-80c9810bba1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:15.291890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ad0a2-a4c1-48c9-b1a0-80c9810bba1b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:15.347825 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1674/3348] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:08:15 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:08:15.351857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c478a-0e43-48db-a608-b4a3476588bd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:15.366789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c478a-0e43-48db-a608-b4a3476588bd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:15.443928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:15.496059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf05562-7777-4c39-a19b-caf7cf7956c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:15.497572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf05562-7777-4c39-a19b-caf7cf7956c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:15.498086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf05562-7777-4c39-a19b-caf7cf7956c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:15.498506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf05562-7777-4c39-a19b-caf7cf7956c8 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:15.501376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf05562-7777-4c39-a19b-caf7cf7956c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:15.508918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf05562-7777-4c39-a19b-caf7cf7956c8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:15.621022 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1675/3349] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:08:15 2022] POST /identity/v3/users => generated 291 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:08:15.621440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ad0a2-a4c1-48c9-b1a0-80c9810bba1b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:15.646575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ad0a2-a4c1-48c9-b1a0-80c9810bba1b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:15.659335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0225e-b779-44ca-a208-8f2481b0de2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:15.660384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0225e-b779-44ca-a208-8f2481b0de2a admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:15.660834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0225e-b779-44ca-a208-8f2481b0de2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:15.661297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0225e-b779-44ca-a208-8f2481b0de2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:15.662185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0225e-b779-44ca-a208-8f2481b0de2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:15.664015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0225e-b779-44ca-a208-8f2481b0de2a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:15.682384 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1675/3350] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:08:15.690131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf05562-7777-4c39-a19b-caf7cf7956c8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:15.707660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf05562-7777-4c39-a19b-caf7cf7956c8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:15.722994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de899912-b828-4d9f-b2d6-c6715bf95285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:15.724123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de899912-b828-4d9f-b2d6-c6715bf95285 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:15.724518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de899912-b828-4d9f-b2d6-c6715bf95285 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:15.724929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de899912-b828-4d9f-b2d6-c6715bf95285 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:15.728279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de899912-b828-4d9f-b2d6-c6715bf95285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:15.731910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de899912-b828-4d9f-b2d6-c6715bf95285 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:15.755272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0225e-b779-44ca-a208-8f2481b0de2a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:15.757554 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1676/3351] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:08:15.774733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0225e-b779-44ca-a208-8f2481b0de2a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:15.787852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8ce3e-8acd-4b9c-8fa2-51d2dec25957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:15.789096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8ce3e-8acd-4b9c-8fa2-51d2dec25957 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:15.789599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8ce3e-8acd-4b9c-8fa2-51d2dec25957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:15.790080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8ce3e-8acd-4b9c-8fa2-51d2dec25957 admin admin] PATH_INFO: `/v3/projects/ab77ff72721c4579b8e48346f7d98842/users/e32ef1b0626a4e8ba78cf5d60d5cba07/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:15.820641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8ce3e-8acd-4b9c-8fa2-51d2dec25957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab77ff72721c4579b8e48346f7d98842, user_id=e32ef1b0626a4e8ba78cf5d60d5cba07, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:15.824791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8ce3e-8acd-4b9c-8fa2-51d2dec25957 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:15.851766 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1676/3352] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:08:15 2022] PUT /identity/v3/projects/ab77ff72721c4579b8e48346f7d98842/users/e32ef1b0626a4e8ba78cf5d60d5cba07/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:08:15.858886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db756f-0ff4-4adb-8532-ae4486a208d7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:15.859084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db756f-0ff4-4adb-8532-ae4486a208d7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:15.859499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db756f-0ff4-4adb-8532-ae4486a208d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:15.887512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-10db756f-0ff4-4adb-8532-ae4486a208d7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:15.889088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-10db756f-0ff4-4adb-8532-ae4486a208d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:16.017198 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1677/3353] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:08:16.043528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8ce3e-8acd-4b9c-8fa2-51d2dec25957 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:16.046231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-47d8ce3e-8acd-4b9c-8fa2-51d2dec25957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:16.229615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8ce3e-8acd-4b9c-8fa2-51d2dec25957 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:16.241683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c946f-b92b-4dcb-911b-418b29fce9bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:16.242486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c946f-b92b-4dcb-911b-418b29fce9bb service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:16.243494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c946f-b92b-4dcb-911b-418b29fce9bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:16.243873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c946f-b92b-4dcb-911b-418b29fce9bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:16.265168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c946f-b92b-4dcb-911b-418b29fce9bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:16.267631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c946f-b92b-4dcb-911b-418b29fce9bb service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:16.299377 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1677/3354] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:08:18.421846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db756f-0ff4-4adb-8532-ae4486a208d7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:18.423480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-10db756f-0ff4-4adb-8532-ae4486a208d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:18.438882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db756f-0ff4-4adb-8532-ae4486a208d7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:18.446997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048240c-42ca-4562-a030-627a5b2d6007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:18.447817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048240c-42ca-4562-a030-627a5b2d6007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:18.448205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048240c-42ca-4562-a030-627a5b2d6007 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:18.448587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048240c-42ca-4562-a030-627a5b2d6007 admin admin] PATH_INFO: `/v3/users/d20ab89ea13c4611904cec244d37ba25` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:18.449956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048240c-42ca-4562-a030-627a5b2d6007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d20ab89ea13c4611904cec244d37ba25)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:18.452882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048240c-42ca-4562-a030-627a5b2d6007 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:18.585834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c048240c-42ca-4562-a030-627a5b2d6007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd20ab89ea13c4611904cec244d37ba25'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:18.589779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c048240c-42ca-4562-a030-627a5b2d6007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd20ab89ea13c4611904cec244d37ba25'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:18.609095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c048240c-42ca-4562-a030-627a5b2d6007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd20ab89ea13c4611904cec244d37ba25'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:18.610227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c048240c-42ca-4562-a030-627a5b2d6007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd20ab89ea13c4611904cec244d37ba25'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:18.622118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c048240c-42ca-4562-a030-627a5b2d6007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd20ab89ea13c4611904cec244d37ba25'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:18.639309 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1678/3355] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:08:18 2022] DELETE /identity/v3/users/d20ab89ea13c4611904cec244d37ba25 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:08:18.645157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18402d9-8fa6-497f-ac4a-7d3638d59346 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:18.645717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18402d9-8fa6-497f-ac4a-7d3638d59346 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:18.645717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18402d9-8fa6-497f-ac4a-7d3638d59346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:18.691315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c18402d9-8fa6-497f-ac4a-7d3638d59346 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:18.693465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c18402d9-8fa6-497f-ac4a-7d3638d59346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:18.786754 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1678/3356] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:18.888459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048240c-42ca-4562-a030-627a5b2d6007 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:18.890348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c048240c-42ca-4562-a030-627a5b2d6007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:18.955384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:19.028486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048240c-42ca-4562-a030-627a5b2d6007 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:19.038873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834cb18-15ab-41d1-852a-73815ddb3357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:19.040220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834cb18-15ab-41d1-852a-73815ddb3357 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:19.040617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834cb18-15ab-41d1-852a-73815ddb3357 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:19.041000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834cb18-15ab-41d1-852a-73815ddb3357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:19.074670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834cb18-15ab-41d1-852a-73815ddb3357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:19.080069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834cb18-15ab-41d1-852a-73815ddb3357 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:19.094817 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1679/3357] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:08:21.090149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18402d9-8fa6-497f-ac4a-7d3638d59346 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:21.092198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c18402d9-8fa6-497f-ac4a-7d3638d59346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:21.117018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18402d9-8fa6-497f-ac4a-7d3638d59346 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:21.124511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146fdae-5d73-428b-938c-92b199cf5de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:21.126773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146fdae-5d73-428b-938c-92b199cf5de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:21.127411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146fdae-5d73-428b-938c-92b199cf5de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:21.128030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146fdae-5d73-428b-938c-92b199cf5de0 admin admin] PATH_INFO: `/v3/projects/3a50eb5e4a334562a71d4116fa94fbcf` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:21.129689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146fdae-5d73-428b-938c-92b199cf5de0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a50eb5e4a334562a71d4116fa94fbcf)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:21.166951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146fdae-5d73-428b-938c-92b199cf5de0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:21.186969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a27382-c207-4eba-a568-410d782faf59 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:21.187482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a27382-c207-4eba-a568-410d782faf59 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:21.187721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a27382-c207-4eba-a568-410d782faf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:21.275693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-87a27382-c207-4eba-a568-410d782faf59 None None] MFA Rules not processed for user `6399b6f3e2574df8af12786c8755c59a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:21.284012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-87a27382-c207-4eba-a568-410d782faf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:21.322444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:21.375412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b146fdae-5d73-428b-938c-92b199cf5de0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a50eb5e4a334562a71d4116fa94fbcf', 'request_id': 'req-b146fdae-5d73-428b-938c-92b199cf5de0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:21.394432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b146fdae-5d73-428b-938c-92b199cf5de0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a50eb5e4a334562a71d4116fa94fbcf', 'request_id': 'req-b146fdae-5d73-428b-938c-92b199cf5de0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:21.442784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b146fdae-5d73-428b-938c-92b199cf5de0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a50eb5e4a334562a71d4116fa94fbcf', 'request_id': 'req-b146fdae-5d73-428b-938c-92b199cf5de0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:21.497041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b146fdae-5d73-428b-938c-92b199cf5de0 admin admin] The token cache is being invalidate because project 3a50eb5e4a334562a71d4116fa94fbcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:08:21.497456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b146fdae-5d73-428b-938c-92b199cf5de0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:21.500002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b146fdae-5d73-428b-938c-92b199cf5de0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:21.506245 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1679/3358] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:08:21 2022] DELETE /identity/v3/projects/3a50eb5e4a334562a71d4116fa94fbcf => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:08:21.513308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146fdae-5d73-428b-938c-92b199cf5de0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:21.516666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b146fdae-5d73-428b-938c-92b199cf5de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:21.544426 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1680/3359] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:21.728309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146fdae-5d73-428b-938c-92b199cf5de0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:21.745243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c910b29-95c5-4d28-a552-f499711a1704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:21.745786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c910b29-95c5-4d28-a552-f499711a1704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:21.746359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c910b29-95c5-4d28-a552-f499711a1704 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:21.746643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c910b29-95c5-4d28-a552-f499711a1704 admin admin] PATH_INFO: `/v3/users/29334772c35f4ffeaca8c0533a5e7051` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:21.753091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c910b29-95c5-4d28-a552-f499711a1704 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29334772c35f4ffeaca8c0533a5e7051)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:21.769397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c910b29-95c5-4d28-a552-f499711a1704 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:21.924599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8c910b29-95c5-4d28-a552-f499711a1704 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29334772c35f4ffeaca8c0533a5e7051'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:21.941793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8c910b29-95c5-4d28-a552-f499711a1704 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29334772c35f4ffeaca8c0533a5e7051'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:21.942661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8c910b29-95c5-4d28-a552-f499711a1704 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29334772c35f4ffeaca8c0533a5e7051'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:21.960945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8c910b29-95c5-4d28-a552-f499711a1704 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29334772c35f4ffeaca8c0533a5e7051'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:21.962301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8c910b29-95c5-4d28-a552-f499711a1704 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29334772c35f4ffeaca8c0533a5e7051'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:22.009162 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1680/3360] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:08:21 2022] DELETE /identity/v3/users/29334772c35f4ffeaca8c0533a5e7051 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:08:23.375101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a27382-c207-4eba-a568-410d782faf59 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:23.400339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a27382-c207-4eba-a568-410d782faf59 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:23.547174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a34c4-394b-4023-8901-f1cc0c09340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:23.547836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a34c4-394b-4023-8901-f1cc0c09340d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:23.548035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a34c4-394b-4023-8901-f1cc0c09340d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:23.549192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a34c4-394b-4023-8901-f1cc0c09340d admin admin] PATH_INFO: `/v3/projects/015edf2ee05b47dbbaf477d89e57b47d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:23.562533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a34c4-394b-4023-8901-f1cc0c09340d admin admin] RBAC: Authorizing `identity:delete_project(project_id=015edf2ee05b47dbbaf477d89e57b47d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:23.568579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a34c4-394b-4023-8901-f1cc0c09340d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:23.731672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-788a34c4-394b-4023-8901-f1cc0c09340d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '015edf2ee05b47dbbaf477d89e57b47d', 'request_id': 'req-788a34c4-394b-4023-8901-f1cc0c09340d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:23.759143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-788a34c4-394b-4023-8901-f1cc0c09340d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '015edf2ee05b47dbbaf477d89e57b47d', 'request_id': 'req-788a34c4-394b-4023-8901-f1cc0c09340d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:23.771559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-788a34c4-394b-4023-8901-f1cc0c09340d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '015edf2ee05b47dbbaf477d89e57b47d', 'request_id': 'req-788a34c4-394b-4023-8901-f1cc0c09340d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:23.793766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:23.798968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-788a34c4-394b-4023-8901-f1cc0c09340d admin admin] The token cache is being invalidate because project 015edf2ee05b47dbbaf477d89e57b47d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:08:23.800297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-788a34c4-394b-4023-8901-f1cc0c09340d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:23.802453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-788a34c4-394b-4023-8901-f1cc0c09340d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:23.808126 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1681/3361] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:08:23 2022] DELETE /identity/v3/projects/015edf2ee05b47dbbaf477d89e57b47d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:08:23.813123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c07da1-530d-45e4-ad39-a7c4a99c702b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:23.816588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c07da1-530d-45e4-ad39-a7c4a99c702b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:23.816588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c07da1-530d-45e4-ad39-a7c4a99c702b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:23.854600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-67c07da1-530d-45e4-ad39-a7c4a99c702b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:23.857674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-67c07da1-530d-45e4-ad39-a7c4a99c702b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:23.939102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:24.020957 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1681/3362] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:24.024035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4112985-1106-4963-87b1-f9661eed2b1f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:24.024421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4112985-1106-4963-87b1-f9661eed2b1f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:24.024713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4112985-1106-4963-87b1-f9661eed2b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:24.078501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e4112985-1106-4963-87b1-f9661eed2b1f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:24.079838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e4112985-1106-4963-87b1-f9661eed2b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:24.107267 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1682/3363] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:08:24.111540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c07da1-530d-45e4-ad39-a7c4a99c702b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:24.122426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c07da1-530d-45e4-ad39-a7c4a99c702b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:24.130572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bcf37-c871-440c-877e-f17d4ab984c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:24.131326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bcf37-c871-440c-877e-f17d4ab984c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:24.131562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bcf37-c871-440c-877e-f17d4ab984c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:24.131840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bcf37-c871-440c-877e-f17d4ab984c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:24.132572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bcf37-c871-440c-877e-f17d4ab984c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:08:24.132878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bcf37-c871-440c-877e-f17d4ab984c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:24.134584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bcf37-c871-440c-877e-f17d4ab984c0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:24.166338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4112985-1106-4963-87b1-f9661eed2b1f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:24.177110 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1682/3364] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:08:24.179563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4112985-1106-4963-87b1-f9661eed2b1f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:24.191505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb0d27-f1e5-48a3-923a-ffe07d2dcd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:24.192154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb0d27-f1e5-48a3-923a-ffe07d2dcd9e admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:24.192440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb0d27-f1e5-48a3-923a-ffe07d2dcd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:24.192716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb0d27-f1e5-48a3-923a-ffe07d2dcd9e admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:24.193403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb0d27-f1e5-48a3-923a-ffe07d2dcd9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:24.195438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb0d27-f1e5-48a3-923a-ffe07d2dcd9e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:24.279921 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1683/3365] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:08:24 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:08:24.281450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bcf37-c871-440c-877e-f17d4ab984c0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:24.316251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bcf37-c871-440c-877e-f17d4ab984c0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:24.467800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfce0d5-7581-4916-a8f1-e2046a2d56e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:24.468502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfce0d5-7581-4916-a8f1-e2046a2d56e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:24.468922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfce0d5-7581-4916-a8f1-e2046a2d56e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:24.469360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfce0d5-7581-4916-a8f1-e2046a2d56e8 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:24.470144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfce0d5-7581-4916-a8f1-e2046a2d56e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:24.472291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfce0d5-7581-4916-a8f1-e2046a2d56e8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:24.512338 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1683/3366] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:08:24 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:08:24.516214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb0d27-f1e5-48a3-923a-ffe07d2dcd9e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:24.543371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb0d27-f1e5-48a3-923a-ffe07d2dcd9e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:24.558792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22f879-0efc-4f51-8198-ea8495f9e87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:24.563267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22f879-0efc-4f51-8198-ea8495f9e87f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:24.564466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22f879-0efc-4f51-8198-ea8495f9e87f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:24.565568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22f879-0efc-4f51-8198-ea8495f9e87f admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:24.566778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22f879-0efc-4f51-8198-ea8495f9e87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:24.569561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22f879-0efc-4f51-8198-ea8495f9e87f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:24.612048 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1684/3367] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:08:24.615748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfce0d5-7581-4916-a8f1-e2046a2d56e8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:24.654285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfce0d5-7581-4916-a8f1-e2046a2d56e8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:24.662048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db9904-3782-4ea3-9a10-898d96897edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:24.662698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db9904-3782-4ea3-9a10-898d96897edc admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:24.662982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db9904-3782-4ea3-9a10-898d96897edc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:24.665230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db9904-3782-4ea3-9a10-898d96897edc admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:24.666035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db9904-3782-4ea3-9a10-898d96897edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:24.675942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db9904-3782-4ea3-9a10-898d96897edc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:24.694347 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1684/3368] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:08:24.697301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22f879-0efc-4f51-8198-ea8495f9e87f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:24.726296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22f879-0efc-4f51-8198-ea8495f9e87f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:24.743889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a267f6d-6fd6-46f7-abff-df4c033ad599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:24.745146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a267f6d-6fd6-46f7-abff-df4c033ad599 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:24.750514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a267f6d-6fd6-46f7-abff-df4c033ad599 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:24.751128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a267f6d-6fd6-46f7-abff-df4c033ad599 admin admin] PATH_INFO: `/v3/projects/9ac2076b2db2419db452fab81b425dbf/users/cd9de4db5d7a487fa26b3138d1158f33/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:24.806190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a267f6d-6fd6-46f7-abff-df4c033ad599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac2076b2db2419db452fab81b425dbf, user_id=cd9de4db5d7a487fa26b3138d1158f33, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:24.808927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a267f6d-6fd6-46f7-abff-df4c033ad599 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:24.854285 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1685/3369] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:08:24 2022] PUT /identity/v3/projects/9ac2076b2db2419db452fab81b425dbf/users/cd9de4db5d7a487fa26b3138d1158f33/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:08:24.857677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a89c5f-58ca-4350-b894-7f415896a7b0 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:24.871755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a89c5f-58ca-4350-b894-7f415896a7b0 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:24.872304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a89c5f-58ca-4350-b894-7f415896a7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:24.969588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-33a89c5f-58ca-4350-b894-7f415896a7b0 None None] MFA Rules not processed for user `cd9de4db5d7a487fa26b3138d1158f33`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:24.973476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-33a89c5f-58ca-4350-b894-7f415896a7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:25.126781 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1685/3370] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:25.131711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a267f6d-6fd6-46f7-abff-df4c033ad599 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:25.258909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a267f6d-6fd6-46f7-abff-df4c033ad599 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:25.265303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea69619-ab0d-4e80-904a-4b748ca2a8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:25.265948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea69619-ab0d-4e80-904a-4b748ca2a8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:25.266234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea69619-ab0d-4e80-904a-4b748ca2a8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:25.266519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea69619-ab0d-4e80-904a-4b748ca2a8d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:25.269330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea69619-ab0d-4e80-904a-4b748ca2a8d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:25.271318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea69619-ab0d-4e80-904a-4b748ca2a8d1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:25.315139 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1686/3371] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:08:25 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:08:25.316916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a89c5f-58ca-4350-b894-7f415896a7b0 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:25.330632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a89c5f-58ca-4350-b894-7f415896a7b0 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:25.411391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:25.481697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c860e-755b-406e-bcaf-c84bd5e11d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:25.481697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c860e-755b-406e-bcaf-c84bd5e11d7e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:25.482274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c860e-755b-406e-bcaf-c84bd5e11d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:25.482661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c860e-755b-406e-bcaf-c84bd5e11d7e admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:25.483990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c860e-755b-406e-bcaf-c84bd5e11d7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:25.486074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c860e-755b-406e-bcaf-c84bd5e11d7e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:25.520392 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1686/3372] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:08:25 2022] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:08:25.527975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea69619-ab0d-4e80-904a-4b748ca2a8d1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:25.546661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea69619-ab0d-4e80-904a-4b748ca2a8d1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:25.553797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349c046-f8a2-48a2-b76b-e1f0b90fd92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:25.556473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349c046-f8a2-48a2-b76b-e1f0b90fd92c admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:25.559307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349c046-f8a2-48a2-b76b-e1f0b90fd92c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:25.560027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349c046-f8a2-48a2-b76b-e1f0b90fd92c admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:25.561083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349c046-f8a2-48a2-b76b-e1f0b90fd92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:25.563204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349c046-f8a2-48a2-b76b-e1f0b90fd92c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:25.584200 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1687/3373] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:08:25.588460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c860e-755b-406e-bcaf-c84bd5e11d7e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:25.601482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c860e-755b-406e-bcaf-c84bd5e11d7e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:25.613379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92839a8-778f-40e1-9aa7-30910124485b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:25.614289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92839a8-778f-40e1-9aa7-30910124485b admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:25.615231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92839a8-778f-40e1-9aa7-30910124485b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:25.615231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92839a8-778f-40e1-9aa7-30910124485b admin admin] PATH_INFO: `/v3/projects/e91c37d221dc44b2855aaabd9772590c/users/e44f38e49bc54c3c903cff8827d9aa79/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:25.668972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92839a8-778f-40e1-9aa7-30910124485b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91c37d221dc44b2855aaabd9772590c, user_id=e44f38e49bc54c3c903cff8827d9aa79, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:25.672076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92839a8-778f-40e1-9aa7-30910124485b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:25.705143 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1687/3374] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:08:25 2022] PUT /identity/v3/projects/e91c37d221dc44b2855aaabd9772590c/users/e44f38e49bc54c3c903cff8827d9aa79/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:08:25.706383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349c046-f8a2-48a2-b76b-e1f0b90fd92c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:25.723524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349c046-f8a2-48a2-b76b-e1f0b90fd92c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:25.862227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28411bda-5cf9-43d5-ad9b-58231f0b83d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:25.870862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28411bda-5cf9-43d5-ad9b-58231f0b83d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:25.871582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28411bda-5cf9-43d5-ad9b-58231f0b83d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:25.872553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28411bda-5cf9-43d5-ad9b-58231f0b83d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:25.873592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28411bda-5cf9-43d5-ad9b-58231f0b83d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:25.876319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28411bda-5cf9-43d5-ad9b-58231f0b83d7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:25.896350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92839a8-778f-40e1-9aa7-30910124485b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:25.897826 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1688/3375] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:08:25.912622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92839a8-778f-40e1-9aa7-30910124485b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:25.919563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed8f9f-46f0-4291-9897-8cf75bc1b27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:25.920561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed8f9f-46f0-4291-9897-8cf75bc1b27c admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:25.921080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed8f9f-46f0-4291-9897-8cf75bc1b27c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:25.921718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed8f9f-46f0-4291-9897-8cf75bc1b27c admin admin] PATH_INFO: `/v3/projects/e91c37d221dc44b2855aaabd9772590c/users/e44f38e49bc54c3c903cff8827d9aa79/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:25.924314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed8f9f-46f0-4291-9897-8cf75bc1b27c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91c37d221dc44b2855aaabd9772590c, user_id=e44f38e49bc54c3c903cff8827d9aa79, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:25.927516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed8f9f-46f0-4291-9897-8cf75bc1b27c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:25.963528 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1688/3376] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:08:25 2022] PUT /identity/v3/projects/e91c37d221dc44b2855aaabd9772590c/users/e44f38e49bc54c3c903cff8827d9aa79/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:08:25.964486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61a6cf-0f24-45db-bb41-6f6e70618052 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:25.964486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61a6cf-0f24-45db-bb41-6f6e70618052 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:25.964687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61a6cf-0f24-45db-bb41-6f6e70618052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:25.982933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:26.014974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0d61a6cf-0f24-45db-bb41-6f6e70618052 None None] MFA Rules not processed for user `e44f38e49bc54c3c903cff8827d9aa79`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:26.016709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0d61a6cf-0f24-45db-bb41-6f6e70618052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:26.160387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1b948-37bf-4276-a551-30e9c9a513d7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:26.160387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1b948-37bf-4276-a551-30e9c9a513d7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:26.160387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1b948-37bf-4276-a551-30e9c9a513d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:26.165463 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1689/3377] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:08:26.189148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-14b1b948-37bf-4276-a551-30e9c9a513d7 None None] MFA Rules not processed for user `cd9de4db5d7a487fa26b3138d1158f33`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:26.190671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-14b1b948-37bf-4276-a551-30e9c9a513d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:26.281837 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1689/3378] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:26.386666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ff5a8-13b6-4e97-b911-c3d9e6e5b0b5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:26.387479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ff5a8-13b6-4e97-b911-c3d9e6e5b0b5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:26.387682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ff5a8-13b6-4e97-b911-c3d9e6e5b0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:26.470375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0b7ff5a8-13b6-4e97-b911-c3d9e6e5b0b5 None None] MFA Rules not processed for user `879e94018c474c838b1b989f3d4013a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:26.472011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0b7ff5a8-13b6-4e97-b911-c3d9e6e5b0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:26.604221 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1690/3379] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:26.610005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1b948-37bf-4276-a551-30e9c9a513d7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:26.614430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-14b1b948-37bf-4276-a551-30e9c9a513d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:26.776109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1b948-37bf-4276-a551-30e9c9a513d7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:26.787188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3f0c2-d3be-4e57-b424-5d58afb9acf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:26.789287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3f0c2-d3be-4e57-b424-5d58afb9acf8 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:26.790726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3f0c2-d3be-4e57-b424-5d58afb9acf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:26.793365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3f0c2-d3be-4e57-b424-5d58afb9acf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:26.795561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3f0c2-d3be-4e57-b424-5d58afb9acf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:26.800253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3f0c2-d3be-4e57-b424-5d58afb9acf8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:26.843934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ff5a8-13b6-4e97-b911-c3d9e6e5b0b5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:26.851914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0b7ff5a8-13b6-4e97-b911-c3d9e6e5b0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:26.889648 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1690/3380] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:08:26 2022] POST /identity/v3/projects => generated 385 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:08:26.893249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3f0c2-d3be-4e57-b424-5d58afb9acf8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:26.939967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:27.100906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3f0c2-d3be-4e57-b424-5d58afb9acf8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:27.119036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0ccb7-57d5-452f-8fdd-65dca79dcf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:27.119719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0ccb7-57d5-452f-8fdd-65dca79dcf91 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:27.120006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0ccb7-57d5-452f-8fdd-65dca79dcf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:27.120288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0ccb7-57d5-452f-8fdd-65dca79dcf91 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:27.120977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0ccb7-57d5-452f-8fdd-65dca79dcf91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:27.122948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0ccb7-57d5-452f-8fdd-65dca79dcf91 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:27.168576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ff5a8-13b6-4e97-b911-c3d9e6e5b0b5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:27.196583 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1691/3381] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:08:26 2022] POST /identity/v3/users => generated 299 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:08:27.205476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0ccb7-57d5-452f-8fdd-65dca79dcf91 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:27.235184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:27.235603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0ccb7-57d5-452f-8fdd-65dca79dcf91 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:27.251650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527e51c-f35d-4cda-82ec-62939afa89e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:27.252201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527e51c-f35d-4cda-82ec-62939afa89e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:27.252493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527e51c-f35d-4cda-82ec-62939afa89e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:27.252771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527e51c-f35d-4cda-82ec-62939afa89e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:27.253489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527e51c-f35d-4cda-82ec-62939afa89e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:27.265179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527e51c-f35d-4cda-82ec-62939afa89e9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:27.309120 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1692/3382] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:08:27.313138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527e51c-f35d-4cda-82ec-62939afa89e9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:27.339662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527e51c-f35d-4cda-82ec-62939afa89e9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:27.363375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1980f-1da4-435e-8a8f-0c3974e199bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:27.366351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1980f-1da4-435e-8a8f-0c3974e199bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:27.367722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1980f-1da4-435e-8a8f-0c3974e199bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:27.368056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1980f-1da4-435e-8a8f-0c3974e199bc admin admin] PATH_INFO: `/v3/projects/ceab0b2bf0de497b841655c7e3005051/users/3a2370cb4f5f422e940ec81b74bb39b2/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:27.421661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1980f-1da4-435e-8a8f-0c3974e199bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceab0b2bf0de497b841655c7e3005051, user_id=3a2370cb4f5f422e940ec81b74bb39b2, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:27.427075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1980f-1da4-435e-8a8f-0c3974e199bc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:27.431504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3d584-b7ee-477e-ab0c-6f7bbc99258d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:27.432154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3d584-b7ee-477e-ab0c-6f7bbc99258d service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:27.432489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3d584-b7ee-477e-ab0c-6f7bbc99258d service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:27.433028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3d584-b7ee-477e-ab0c-6f7bbc99258d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:27.459816 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1693/3383] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:08:27 2022] PUT /identity/v3/projects/ceab0b2bf0de497b841655c7e3005051/users/3a2370cb4f5f422e940ec81b74bb39b2/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:08:27.490984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1980f-1da4-435e-8a8f-0c3974e199bc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:27.567391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3d584-b7ee-477e-ab0c-6f7bbc99258d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:27.580981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3d584-b7ee-477e-ab0c-6f7bbc99258d service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:27.617363 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1691/3384] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:08:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 774 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:08:27.671978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1980f-1da4-435e-8a8f-0c3974e199bc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:27.690767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126925e5-ac9f-4f46-8d5a-ba2f6e901b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:27.692151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126925e5-ac9f-4f46-8d5a-ba2f6e901b7b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:27.692404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126925e5-ac9f-4f46-8d5a-ba2f6e901b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:27.692676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126925e5-ac9f-4f46-8d5a-ba2f6e901b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:27.693534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126925e5-ac9f-4f46-8d5a-ba2f6e901b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:27.696283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126925e5-ac9f-4f46-8d5a-ba2f6e901b7b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:27.729398 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1694/3385] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:08:27.734304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3d584-b7ee-477e-ab0c-6f7bbc99258d service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:27.753660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3d584-b7ee-477e-ab0c-6f7bbc99258d service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:27.762151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a999efa-5675-4054-a093-d8e48e6ca871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:27.763369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a999efa-5675-4054-a093-d8e48e6ca871 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:27.764492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a999efa-5675-4054-a093-d8e48e6ca871 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:27.766009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a999efa-5675-4054-a093-d8e48e6ca871 admin admin] PATH_INFO: `/v3/projects/ceab0b2bf0de497b841655c7e3005051/users/3a2370cb4f5f422e940ec81b74bb39b2/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:27.768585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a999efa-5675-4054-a093-d8e48e6ca871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceab0b2bf0de497b841655c7e3005051, user_id=3a2370cb4f5f422e940ec81b74bb39b2, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:27.772773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a999efa-5675-4054-a093-d8e48e6ca871 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:27.798422 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1692/3386] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:08:27 2022] PUT /identity/v3/projects/ceab0b2bf0de497b841655c7e3005051/users/3a2370cb4f5f422e940ec81b74bb39b2/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:08:32.608470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e089a3-a598-4787-8908-7b4dd814753d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:32.609368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e089a3-a598-4787-8908-7b4dd814753d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:32.609860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e089a3-a598-4787-8908-7b4dd814753d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:32.668550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-27e089a3-a598-4787-8908-7b4dd814753d None None] MFA Rules not processed for user `e32ef1b0626a4e8ba78cf5d60d5cba07`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:32.670384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-27e089a3-a598-4787-8908-7b4dd814753d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:32.857726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:32.873292 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1695/3387] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:32.887083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0277f-e453-4ae5-a790-b592b532fc08 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:32.888148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0277f-e453-4ae5-a790-b592b532fc08 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:32.890992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0277f-e453-4ae5-a790-b592b532fc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:32.925192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7ca0277f-e453-4ae5-a790-b592b532fc08 None None] MFA Rules not processed for user `e32ef1b0626a4e8ba78cf5d60d5cba07`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:32.926960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7ca0277f-e453-4ae5-a790-b592b532fc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:32.938641 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1693/3388] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:34.037771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e089a3-a598-4787-8908-7b4dd814753d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:34.039466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-27e089a3-a598-4787-8908-7b4dd814753d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:34.256491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e089a3-a598-4787-8908-7b4dd814753d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:34.276868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117d427-0a13-4957-8f4c-731de3349f08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:34.278008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117d427-0a13-4957-8f4c-731de3349f08 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:34.278605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117d427-0a13-4957-8f4c-731de3349f08 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:34.279141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117d427-0a13-4957-8f4c-731de3349f08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:34.310282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117d427-0a13-4957-8f4c-731de3349f08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:34.323661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117d427-0a13-4957-8f4c-731de3349f08 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:34.356690 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1696/3389] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:08:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:08:36.240239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37404c42-d4e0-44e8-973d-3410ceb8533e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:36.240868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37404c42-d4e0-44e8-973d-3410ceb8533e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:36.240868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37404c42-d4e0-44e8-973d-3410ceb8533e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:36.279028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-37404c42-d4e0-44e8-973d-3410ceb8533e None None] MFA Rules not processed for user `25cff561a2d14c45b71920346aee5d57`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:36.280709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-37404c42-d4e0-44e8-973d-3410ceb8533e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:36.363419 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1694/3390] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:43.196606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45265ac2-8e1f-478f-8fac-2d622463e304 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:43.197085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45265ac2-8e1f-478f-8fac-2d622463e304 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:43.197192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45265ac2-8e1f-478f-8fac-2d622463e304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:43.252943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-45265ac2-8e1f-478f-8fac-2d622463e304 None None] MFA Rules not processed for user `eeb3ffbaef3347de8d9ad6b2bdfa19bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:43.254105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-45265ac2-8e1f-478f-8fac-2d622463e304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:43.465882 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1697/3391] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:44.708422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a45c5-974e-479b-85e1-0b676601f223 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:44.708935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a45c5-974e-479b-85e1-0b676601f223 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:44.709031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a45c5-974e-479b-85e1-0b676601f223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:44.777084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-255a45c5-974e-479b-85e1-0b676601f223 None None] MFA Rules not processed for user `3a2370cb4f5f422e940ec81b74bb39b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:44.778351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-255a45c5-974e-479b-85e1-0b676601f223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:44.816643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:44.885540 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1695/3392] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:44.894289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45265ac2-8e1f-478f-8fac-2d622463e304 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:44.896225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-45265ac2-8e1f-478f-8fac-2d622463e304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:44.998478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45265ac2-8e1f-478f-8fac-2d622463e304 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:45.003201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cacdc5-a7ee-4191-9a5c-dcda48e0f809 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:45.004004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cacdc5-a7ee-4191-9a5c-dcda48e0f809 service glance] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:45.015228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cacdc5-a7ee-4191-9a5c-dcda48e0f809 service glance] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:45.015741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cacdc5-a7ee-4191-9a5c-dcda48e0f809 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:45.029527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cacdc5-a7ee-4191-9a5c-dcda48e0f809 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:45.030918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cacdc5-a7ee-4191-9a5c-dcda48e0f809 service glance] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:45.036977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:45.043033 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1698/3393] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:08:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:08:47.185261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8f8f5-7ba1-41e4-b6cf-52f88a43127d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:47.186454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8f8f5-7ba1-41e4-b6cf-52f88a43127d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:47.186985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8f8f5-7ba1-41e4-b6cf-52f88a43127d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:47.255892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fde8f8f5-7ba1-41e4-b6cf-52f88a43127d None None] MFA Rules not processed for user `2517a20b0358424480784b0003512d50`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:47.257624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fde8f8f5-7ba1-41e4-b6cf-52f88a43127d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:47.414279 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1696/3394] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:08:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:08:52.715918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cacdc5-a7ee-4191-9a5c-dcda48e0f809 service glance] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:52.753617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cacdc5-a7ee-4191-9a5c-dcda48e0f809 service glance] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:52.765803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729f43a-633a-4370-b521-8888e69d5b82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:52.769497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729f43a-633a-4370-b521-8888e69d5b82 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:52.769893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729f43a-633a-4370-b521-8888e69d5b82 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:52.771002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729f43a-633a-4370-b521-8888e69d5b82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:52.879028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729f43a-633a-4370-b521-8888e69d5b82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:52.880966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729f43a-633a-4370-b521-8888e69d5b82 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:52.936998 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1699/3395] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:08:52 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:08:57.387214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=40 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:59.315913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8f8f5-7ba1-41e4-b6cf-52f88a43127d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:59.321160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fde8f8f5-7ba1-41e4-b6cf-52f88a43127d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:59.488645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8c09a-c7e3-4070-b9ab-5efee28351a4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:59.489207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8c09a-c7e3-4070-b9ab-5efee28351a4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:59.489207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8c09a-c7e3-4070-b9ab-5efee28351a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:59.511506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8f8f5-7ba1-41e4-b6cf-52f88a43127d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:08:59.528874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb4325-0dfa-4c71-968a-60f2154103a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:08:59.530868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb4325-0dfa-4c71-968a-60f2154103a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:08:59.531481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb4325-0dfa-4c71-968a-60f2154103a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:08:59.531962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb4325-0dfa-4c71-968a-60f2154103a1 admin admin] PATH_INFO: `/v3/users/8027664b7857430494e38fa27da60c75` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:08:59.535613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb4325-0dfa-4c71-968a-60f2154103a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8027664b7857430494e38fa27da60c75)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:08:59.536559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e1b8c09a-c7e3-4070-b9ab-5efee28351a4 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:08:59.537891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e1b8c09a-c7e3-4070-b9ab-5efee28351a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:59.538520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb4325-0dfa-4c71-968a-60f2154103a1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:08:59.663587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-53eb4325-0dfa-4c71-968a-60f2154103a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8027664b7857430494e38fa27da60c75'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:59.666261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-53eb4325-0dfa-4c71-968a-60f2154103a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8027664b7857430494e38fa27da60c75'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:59.673005 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1700/3396] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:08:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:08:59.685113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-53eb4325-0dfa-4c71-968a-60f2154103a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8027664b7857430494e38fa27da60c75'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:59.686370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-53eb4325-0dfa-4c71-968a-60f2154103a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8027664b7857430494e38fa27da60c75'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:59.700523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-53eb4325-0dfa-4c71-968a-60f2154103a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8027664b7857430494e38fa27da60c75'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:08:59.729632 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1697/3397] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:08:59 2022] DELETE /identity/v3/users/8027664b7857430494e38fa27da60c75 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:08:59.748743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8c09a-c7e3-4070-b9ab-5efee28351a4 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:59.751191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e1b8c09a-c7e3-4070-b9ab-5efee28351a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:08:59.964899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb4325-0dfa-4c71-968a-60f2154103a1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:08:59.969742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-53eb4325-0dfa-4c71-968a-60f2154103a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:00.030458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8c09a-c7e3-4070-b9ab-5efee28351a4 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:00.085878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:00.111560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb4325-0dfa-4c71-968a-60f2154103a1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:00.117507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb418b-01d5-4ddd-a3c3-51d2d6747161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:00.118166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71b850-66fb-4a7e-9729-bc10751be96f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:00.118308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb418b-01d5-4ddd-a3c3-51d2d6747161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:00.118577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb418b-01d5-4ddd-a3c3-51d2d6747161 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:00.118858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb418b-01d5-4ddd-a3c3-51d2d6747161 admin admin] PATH_INFO: `/v3/projects/a502ca105b1344babf2e8d590de18198` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:00.119008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71b850-66fb-4a7e-9729-bc10751be96f service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:00.119413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71b850-66fb-4a7e-9729-bc10751be96f service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:00.119773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71b850-66fb-4a7e-9729-bc10751be96f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:00.120212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb418b-01d5-4ddd-a3c3-51d2d6747161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a502ca105b1344babf2e8d590de18198)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:00.121850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2c71b850-66fb-4a7e-9729-bc10751be96f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:00.122499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb418b-01d5-4ddd-a3c3-51d2d6747161 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:00.156934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:00.186368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-87eb418b-01d5-4ddd-a3c3-51d2d6747161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a502ca105b1344babf2e8d590de18198', 'request_id': 'req-87eb418b-01d5-4ddd-a3c3-51d2d6747161'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:00.194673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-87eb418b-01d5-4ddd-a3c3-51d2d6747161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a502ca105b1344babf2e8d590de18198', 'request_id': 'req-87eb418b-01d5-4ddd-a3c3-51d2d6747161'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:00.199551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71b850-66fb-4a7e-9729-bc10751be96f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:00.201377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71b850-66fb-4a7e-9729-bc10751be96f service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:00.203164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-87eb418b-01d5-4ddd-a3c3-51d2d6747161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a502ca105b1344babf2e8d590de18198', 'request_id': 'req-87eb418b-01d5-4ddd-a3c3-51d2d6747161'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:00.211535 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1701/3398] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:08:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:09:00.215604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-87eb418b-01d5-4ddd-a3c3-51d2d6747161 admin admin] The token cache is being invalidate because project a502ca105b1344babf2e8d590de18198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:09:00.215911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-87eb418b-01d5-4ddd-a3c3-51d2d6747161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:00.216701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-87eb418b-01d5-4ddd-a3c3-51d2d6747161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:00.218213 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1698/3399] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:08:59 2022] DELETE /identity/v3/projects/a502ca105b1344babf2e8d590de18198 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:00.224623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a97f3-f7a0-41a6-a882-789124efed77 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:00.224886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a97f3-f7a0-41a6-a882-789124efed77 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:00.225176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a97f3-f7a0-41a6-a882-789124efed77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:00.253733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e29a97f3-f7a0-41a6-a882-789124efed77 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:00.255879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e29a97f3-f7a0-41a6-a882-789124efed77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:00.384059 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1702/3400] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:00.392819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc117d4-9a12-4385-b09e-55ab260c57ee None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:00.393276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc117d4-9a12-4385-b09e-55ab260c57ee None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:00.393357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc117d4-9a12-4385-b09e-55ab260c57ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:00.415458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-dbc117d4-9a12-4385-b09e-55ab260c57ee None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:00.416700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dbc117d4-9a12-4385-b09e-55ab260c57ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:00.430256 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1699/3401] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:00.430638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a97f3-f7a0-41a6-a882-789124efed77 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:00.441531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a97f3-f7a0-41a6-a882-789124efed77 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:00.447308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137e9ce-a9ee-4d90-9df0-8961ed784c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:00.448027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137e9ce-a9ee-4d90-9df0-8961ed784c0d admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:00.448432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137e9ce-a9ee-4d90-9df0-8961ed784c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:00.448807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137e9ce-a9ee-4d90-9df0-8961ed784c0d admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:00.449617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137e9ce-a9ee-4d90-9df0-8961ed784c0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:09:00.450020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137e9ce-a9ee-4d90-9df0-8961ed784c0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:00.451904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137e9ce-a9ee-4d90-9df0-8961ed784c0d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:00.487912 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1703/3402] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:09:00.493254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc117d4-9a12-4385-b09e-55ab260c57ee None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:00.509237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc117d4-9a12-4385-b09e-55ab260c57ee None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:00.516767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9657b0-5fe9-4366-a1ec-cb536261d7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:00.517404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9657b0-5fe9-4366-a1ec-cb536261d7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:00.517681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9657b0-5fe9-4366-a1ec-cb536261d7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:00.517977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9657b0-5fe9-4366-a1ec-cb536261d7f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:00.518638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9657b0-5fe9-4366-a1ec-cb536261d7f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:00.520642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9657b0-5fe9-4366-a1ec-cb536261d7f1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:00.557730 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1700/3403] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:09:00 2022] POST /identity/v3/projects => generated 403 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:09:00.568525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137e9ce-a9ee-4d90-9df0-8961ed784c0d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:00.580875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137e9ce-a9ee-4d90-9df0-8961ed784c0d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:00.688095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2013b0-9c20-4f9a-b07b-0ce3e43c6e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:00.688095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2013b0-9c20-4f9a-b07b-0ce3e43c6e3b admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:00.688095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2013b0-9c20-4f9a-b07b-0ce3e43c6e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:00.688437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2013b0-9c20-4f9a-b07b-0ce3e43c6e3b admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:00.689041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2013b0-9c20-4f9a-b07b-0ce3e43c6e3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:00.690989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2013b0-9c20-4f9a-b07b-0ce3e43c6e3b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:00.716350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:00.737587 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1704/3404] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:09:00 2022] POST /identity/v3/users => generated 302 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:09:00.740422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9657b0-5fe9-4366-a1ec-cb536261d7f1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:00.756681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9657b0-5fe9-4366-a1ec-cb536261d7f1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:00.764945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61387205-deb6-4ab5-a569-41f7e6e8063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:00.765789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61387205-deb6-4ab5-a569-41f7e6e8063a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:00.766138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61387205-deb6-4ab5-a569-41f7e6e8063a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:00.769986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61387205-deb6-4ab5-a569-41f7e6e8063a admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:00.770898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61387205-deb6-4ab5-a569-41f7e6e8063a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:00.774514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61387205-deb6-4ab5-a569-41f7e6e8063a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:00.785623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2013b0-9c20-4f9a-b07b-0ce3e43c6e3b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:00.788323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5c2013b0-9c20-4f9a-b07b-0ce3e43c6e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:00.807549 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1701/3405] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:09:00.812244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61387205-deb6-4ab5-a569-41f7e6e8063a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:00.813659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2013b0-9c20-4f9a-b07b-0ce3e43c6e3b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:00.819478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60ccc5-20b6-4b66-842b-b7038fbc15dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:00.820583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60ccc5-20b6-4b66-842b-b7038fbc15dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:00.821071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60ccc5-20b6-4b66-842b-b7038fbc15dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:00.821687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60ccc5-20b6-4b66-842b-b7038fbc15dc admin admin] PATH_INFO: `/v3/users/cd9de4db5d7a487fa26b3138d1158f33` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:00.823076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60ccc5-20b6-4b66-842b-b7038fbc15dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd9de4db5d7a487fa26b3138d1158f33)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:00.825417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60ccc5-20b6-4b66-842b-b7038fbc15dc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:00.837625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61387205-deb6-4ab5-a569-41f7e6e8063a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:00.843616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e375e-e5de-4c6a-a24b-ac08094d5b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:00.844458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e375e-e5de-4c6a-a24b-ac08094d5b5b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:00.844886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e375e-e5de-4c6a-a24b-ac08094d5b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:00.845605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e375e-e5de-4c6a-a24b-ac08094d5b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:00.846864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e375e-e5de-4c6a-a24b-ac08094d5b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:00.849058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e375e-e5de-4c6a-a24b-ac08094d5b5b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:00.867218 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1702/3406] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:09:00.875155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e375e-e5de-4c6a-a24b-ac08094d5b5b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:00.888863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e375e-e5de-4c6a-a24b-ac08094d5b5b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:00.894754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca65f9-59ab-48cc-9393-20f8e08eb996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:00.895620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca65f9-59ab-48cc-9393-20f8e08eb996 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:00.895954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca65f9-59ab-48cc-9393-20f8e08eb996 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:00.896240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca65f9-59ab-48cc-9393-20f8e08eb996 admin admin] PATH_INFO: `/v3/projects/c1afeb48b7594ff8be03824dac32af73/users/04b96e95d016465f96bf5193644baf2b/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:00.906389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5a60ccc5-20b6-4b66-842b-b7038fbc15dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd9de4db5d7a487fa26b3138d1158f33'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:00.915205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca65f9-59ab-48cc-9393-20f8e08eb996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1afeb48b7594ff8be03824dac32af73, user_id=04b96e95d016465f96bf5193644baf2b, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:00.917883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca65f9-59ab-48cc-9393-20f8e08eb996 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:00.926828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5a60ccc5-20b6-4b66-842b-b7038fbc15dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd9de4db5d7a487fa26b3138d1158f33'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:00.927735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5a60ccc5-20b6-4b66-842b-b7038fbc15dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd9de4db5d7a487fa26b3138d1158f33'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:00.939414 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1703/3407] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:09:00 2022] PUT /identity/v3/projects/c1afeb48b7594ff8be03824dac32af73/users/04b96e95d016465f96bf5193644baf2b/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:00.939997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5a60ccc5-20b6-4b66-842b-b7038fbc15dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd9de4db5d7a487fa26b3138d1158f33'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:00.940758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5a60ccc5-20b6-4b66-842b-b7038fbc15dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd9de4db5d7a487fa26b3138d1158f33'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:00.950328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64072d43-b233-41fb-a79a-b9f6ca5c60fb None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:00.950746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64072d43-b233-41fb-a79a-b9f6ca5c60fb None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:00.951041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64072d43-b233-41fb-a79a-b9f6ca5c60fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:00.956547 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1705/3408] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:09:00 2022] DELETE /identity/v3/users/cd9de4db5d7a487fa26b3138d1158f33 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:09:00.961054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0e194-3672-4431-8d3e-f3cb1bca182a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:00.961342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0e194-3672-4431-8d3e-f3cb1bca182a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:00.961625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0e194-3672-4431-8d3e-f3cb1bca182a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:00.983611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f1c0e194-3672-4431-8d3e-f3cb1bca182a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:00.985227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f1c0e194-3672-4431-8d3e-f3cb1bca182a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:00.987589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-64072d43-b233-41fb-a79a-b9f6ca5c60fb None None] MFA Rules not processed for user `04b96e95d016465f96bf5193644baf2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:00.988783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-64072d43-b233-41fb-a79a-b9f6ca5c60fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:01.072537 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1706/3409] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:01.082964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0e194-3672-4431-8d3e-f3cb1bca182a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:01.086104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f1c0e194-3672-4431-8d3e-f3cb1bca182a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:01.111997 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1704/3410] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:01.130804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64072d43-b233-41fb-a79a-b9f6ca5c60fb None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:01.135071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-64072d43-b233-41fb-a79a-b9f6ca5c60fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:01.160935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64072d43-b233-41fb-a79a-b9f6ca5c60fb None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:01.168128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a94e4-1544-449c-9bf4-72e255dfa652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:01.168962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a94e4-1544-449c-9bf4-72e255dfa652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:01.169447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a94e4-1544-449c-9bf4-72e255dfa652 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:01.171130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a94e4-1544-449c-9bf4-72e255dfa652 admin admin] PATH_INFO: `/v3/users/04b96e95d016465f96bf5193644baf2b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:01.172823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a94e4-1544-449c-9bf4-72e255dfa652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04b96e95d016465f96bf5193644baf2b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:01.175768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a94e4-1544-449c-9bf4-72e255dfa652 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:01.205529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0e194-3672-4431-8d3e-f3cb1bca182a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:01.207392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:01.210962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358baab-ba2b-4d19-a6ce-16817d72d063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:01.212084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358baab-ba2b-4d19-a6ce-16817d72d063 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:01.212641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358baab-ba2b-4d19-a6ce-16817d72d063 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:01.212985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358baab-ba2b-4d19-a6ce-16817d72d063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:01.226602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358baab-ba2b-4d19-a6ce-16817d72d063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:01.228754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358baab-ba2b-4d19-a6ce-16817d72d063 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:01.259650 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1707/3411] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:09:01.283145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-386a94e4-1544-449c-9bf4-72e255dfa652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04b96e95d016465f96bf5193644baf2b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:01.283974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-386a94e4-1544-449c-9bf4-72e255dfa652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04b96e95d016465f96bf5193644baf2b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:01.304013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-386a94e4-1544-449c-9bf4-72e255dfa652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04b96e95d016465f96bf5193644baf2b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:01.304865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-386a94e4-1544-449c-9bf4-72e255dfa652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04b96e95d016465f96bf5193644baf2b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:01.314825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-386a94e4-1544-449c-9bf4-72e255dfa652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04b96e95d016465f96bf5193644baf2b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:01.331049 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1705/3412] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:09:01 2022] DELETE /identity/v3/users/04b96e95d016465f96bf5193644baf2b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:01.336777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33432cd-1492-47ae-8552-58b0c243da47 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:01.337075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33432cd-1492-47ae-8552-58b0c243da47 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:01.337350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33432cd-1492-47ae-8552-58b0c243da47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:01.377929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f33432cd-1492-47ae-8552-58b0c243da47 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:01.379670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f33432cd-1492-47ae-8552-58b0c243da47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:01.407357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:01.504293 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1708/3413] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:01.516105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a94e4-1544-449c-9bf4-72e255dfa652 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:01.517601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-386a94e4-1544-449c-9bf4-72e255dfa652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:01.589529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a94e4-1544-449c-9bf4-72e255dfa652 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:01.593312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa48595-788e-4362-abf1-abc4514e7c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:01.593929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa48595-788e-4362-abf1-abc4514e7c81 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:01.594213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa48595-788e-4362-abf1-abc4514e7c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:01.594486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa48595-788e-4362-abf1-abc4514e7c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:01.608497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa48595-788e-4362-abf1-abc4514e7c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:01.610296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa48595-788e-4362-abf1-abc4514e7c81 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:01.645105 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1706/3414] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:09:02.223380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33432cd-1492-47ae-8552-58b0c243da47 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:02.225151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f33432cd-1492-47ae-8552-58b0c243da47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:02.247801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33432cd-1492-47ae-8552-58b0c243da47 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:02.259874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd1ead-df13-4dd1-a742-9421287c335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:02.261614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd1ead-df13-4dd1-a742-9421287c335c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:02.261966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd1ead-df13-4dd1-a742-9421287c335c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:02.262352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd1ead-df13-4dd1-a742-9421287c335c admin admin] PATH_INFO: `/v3/projects/9ac2076b2db2419db452fab81b425dbf` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:02.264731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd1ead-df13-4dd1-a742-9421287c335c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac2076b2db2419db452fab81b425dbf)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:02.269111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd1ead-df13-4dd1-a742-9421287c335c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:02.386828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6dbd1ead-df13-4dd1-a742-9421287c335c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac2076b2db2419db452fab81b425dbf', 'request_id': 'req-6dbd1ead-df13-4dd1-a742-9421287c335c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:02.395454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6dbd1ead-df13-4dd1-a742-9421287c335c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac2076b2db2419db452fab81b425dbf', 'request_id': 'req-6dbd1ead-df13-4dd1-a742-9421287c335c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:02.422695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6dbd1ead-df13-4dd1-a742-9421287c335c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac2076b2db2419db452fab81b425dbf', 'request_id': 'req-6dbd1ead-df13-4dd1-a742-9421287c335c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:02.465693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6dbd1ead-df13-4dd1-a742-9421287c335c admin admin] The token cache is being invalidate because project 9ac2076b2db2419db452fab81b425dbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:09:02.466594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6dbd1ead-df13-4dd1-a742-9421287c335c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:02.467645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6dbd1ead-df13-4dd1-a742-9421287c335c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:02.475085 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1709/3415] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:09:02 2022] DELETE /identity/v3/projects/9ac2076b2db2419db452fab81b425dbf => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:02.479225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa48595-788e-4362-abf1-abc4514e7c81 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:02.503048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa48595-788e-4362-abf1-abc4514e7c81 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:02.636625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd1ead-df13-4dd1-a742-9421287c335c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:02.646557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6dbd1ead-df13-4dd1-a742-9421287c335c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:02.686849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0bcde-4272-4f08-8e61-ea13d4ffc79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:02.688408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0bcde-4272-4f08-8e61-ea13d4ffc79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:02.689080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0bcde-4272-4f08-8e61-ea13d4ffc79e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:02.689557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0bcde-4272-4f08-8e61-ea13d4ffc79e admin admin] PATH_INFO: `/v3/users/e44f38e49bc54c3c903cff8827d9aa79` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:02.691234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0bcde-4272-4f08-8e61-ea13d4ffc79e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44f38e49bc54c3c903cff8827d9aa79)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:02.694143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0bcde-4272-4f08-8e61-ea13d4ffc79e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:02.821015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:02.829204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-36e0bcde-4272-4f08-8e61-ea13d4ffc79e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44f38e49bc54c3c903cff8827d9aa79'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:02.830789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-36e0bcde-4272-4f08-8e61-ea13d4ffc79e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44f38e49bc54c3c903cff8827d9aa79'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:02.870502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-36e0bcde-4272-4f08-8e61-ea13d4ffc79e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44f38e49bc54c3c903cff8827d9aa79'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:02.872257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-36e0bcde-4272-4f08-8e61-ea13d4ffc79e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44f38e49bc54c3c903cff8827d9aa79'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:02.883455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd1ead-df13-4dd1-a742-9421287c335c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:02.889130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39894ec5-5961-4ea1-b119-9b9bf1864312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:02.889824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39894ec5-5961-4ea1-b119-9b9bf1864312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:02.890141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39894ec5-5961-4ea1-b119-9b9bf1864312 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:02.890435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39894ec5-5961-4ea1-b119-9b9bf1864312 admin admin] PATH_INFO: `/v3/projects/c1afeb48b7594ff8be03824dac32af73` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:02.891905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39894ec5-5961-4ea1-b119-9b9bf1864312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1afeb48b7594ff8be03824dac32af73)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:02.893517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-36e0bcde-4272-4f08-8e61-ea13d4ffc79e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44f38e49bc54c3c903cff8827d9aa79'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:02.894798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39894ec5-5961-4ea1-b119-9b9bf1864312 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:02.933153 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1707/3416] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:09:02 2022] DELETE /identity/v3/users/e44f38e49bc54c3c903cff8827d9aa79 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:02.983829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:03.002794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-39894ec5-5961-4ea1-b119-9b9bf1864312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1afeb48b7594ff8be03824dac32af73', 'request_id': 'req-39894ec5-5961-4ea1-b119-9b9bf1864312'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:03.014386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-39894ec5-5961-4ea1-b119-9b9bf1864312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1afeb48b7594ff8be03824dac32af73', 'request_id': 'req-39894ec5-5961-4ea1-b119-9b9bf1864312'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:03.037226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-39894ec5-5961-4ea1-b119-9b9bf1864312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1afeb48b7594ff8be03824dac32af73', 'request_id': 'req-39894ec5-5961-4ea1-b119-9b9bf1864312'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:03.056271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-39894ec5-5961-4ea1-b119-9b9bf1864312 admin admin] The token cache is being invalidate because project c1afeb48b7594ff8be03824dac32af73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:09:03.056593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-39894ec5-5961-4ea1-b119-9b9bf1864312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:03.058446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-39894ec5-5961-4ea1-b119-9b9bf1864312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:03.063032 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1710/3417] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:09:02 2022] DELETE /identity/v3/projects/c1afeb48b7594ff8be03824dac32af73 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:03.071631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c6c2a-5a77-4917-94f1-326e7b52fa78 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:03.071631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c6c2a-5a77-4917-94f1-326e7b52fa78 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:03.071631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c6c2a-5a77-4917-94f1-326e7b52fa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:03.117868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f34c6c2a-5a77-4917-94f1-326e7b52fa78 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:03.121815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f34c6c2a-5a77-4917-94f1-326e7b52fa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:03.309694 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1708/3418] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:09:03.316853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc209b35-aec5-47d7-a59c-1730ac5b7efa None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:03.317297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc209b35-aec5-47d7-a59c-1730ac5b7efa None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:03.317567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc209b35-aec5-47d7-a59c-1730ac5b7efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:03.363549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bc209b35-aec5-47d7-a59c-1730ac5b7efa None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:03.365710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bc209b35-aec5-47d7-a59c-1730ac5b7efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:03.390508 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1711/3419] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:03.391882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c6c2a-5a77-4917-94f1-326e7b52fa78 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:03.415562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c6c2a-5a77-4917-94f1-326e7b52fa78 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:03.425708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b021c8-d9bd-4ce7-b4ab-a6bc402a6b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:03.426778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b021c8-d9bd-4ce7-b4ab-a6bc402a6b3b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:03.427064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b021c8-d9bd-4ce7-b4ab-a6bc402a6b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:03.427369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b021c8-d9bd-4ce7-b4ab-a6bc402a6b3b admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:03.429625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b021c8-d9bd-4ce7-b4ab-a6bc402a6b3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:09:03.434376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b021c8-d9bd-4ce7-b4ab-a6bc402a6b3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:03.436511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b021c8-d9bd-4ce7-b4ab-a6bc402a6b3b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:03.451452 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1709/3420] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:09:03.456360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc209b35-aec5-47d7-a59c-1730ac5b7efa None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:03.484274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc209b35-aec5-47d7-a59c-1730ac5b7efa None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:03.506142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cc2fd-6eb6-4029-be4e-c0e8b25c7070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:03.509064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cc2fd-6eb6-4029-be4e-c0e8b25c7070 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:03.509500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cc2fd-6eb6-4029-be4e-c0e8b25c7070 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:03.510246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cc2fd-6eb6-4029-be4e-c0e8b25c7070 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:03.512405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cc2fd-6eb6-4029-be4e-c0e8b25c7070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:03.514705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cc2fd-6eb6-4029-be4e-c0e8b25c7070 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:03.570736 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1712/3421] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:09:03 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:09:03.575523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b021c8-d9bd-4ce7-b4ab-a6bc402a6b3b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:03.588377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b021c8-d9bd-4ce7-b4ab-a6bc402a6b3b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:03.683916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4919f2-1e1b-4444-afcf-c41e9a65bbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:03.684844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4919f2-1e1b-4444-afcf-c41e9a65bbd7 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:03.685580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4919f2-1e1b-4444-afcf-c41e9a65bbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:03.686165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4919f2-1e1b-4444-afcf-c41e9a65bbd7 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:03.686960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4919f2-1e1b-4444-afcf-c41e9a65bbd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:03.689178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4919f2-1e1b-4444-afcf-c41e9a65bbd7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:03.728122 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1710/3422] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:09:03 2022] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:09:03.737291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cc2fd-6eb6-4029-be4e-c0e8b25c7070 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:03.753492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cc2fd-6eb6-4029-be4e-c0e8b25c7070 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:03.769204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ca3ab-b859-4e0c-850e-e474883ce926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:03.770094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ca3ab-b859-4e0c-850e-e474883ce926 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:03.770496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ca3ab-b859-4e0c-850e-e474883ce926 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:03.770866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ca3ab-b859-4e0c-850e-e474883ce926 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:03.771864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ca3ab-b859-4e0c-850e-e474883ce926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:03.773674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ca3ab-b859-4e0c-850e-e474883ce926 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:03.787068 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1713/3423] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:09:03.791674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4919f2-1e1b-4444-afcf-c41e9a65bbd7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:03.804402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4919f2-1e1b-4444-afcf-c41e9a65bbd7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:03.810086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4dfedc-9956-462c-b6c4-1165438f4574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:03.812292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4dfedc-9956-462c-b6c4-1165438f4574 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:03.812578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4dfedc-9956-462c-b6c4-1165438f4574 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:03.812851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4dfedc-9956-462c-b6c4-1165438f4574 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:03.813566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4dfedc-9956-462c-b6c4-1165438f4574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:03.815379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4dfedc-9956-462c-b6c4-1165438f4574 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:03.836561 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1711/3424] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:09:03.838593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ca3ab-b859-4e0c-850e-e474883ce926 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:03.859872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ca3ab-b859-4e0c-850e-e474883ce926 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:03.871873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86135dd2-2fb0-44de-a07e-f3bc721f246a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:03.872586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86135dd2-2fb0-44de-a07e-f3bc721f246a admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:03.873107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86135dd2-2fb0-44de-a07e-f3bc721f246a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:03.873422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86135dd2-2fb0-44de-a07e-f3bc721f246a admin admin] PATH_INFO: `/v3/projects/01e07746fe614f5ca3dcf9cafa96e7bf/users/f4cd985d3acd49198bcf8b3356acc9ad/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:03.912058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86135dd2-2fb0-44de-a07e-f3bc721f246a admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e07746fe614f5ca3dcf9cafa96e7bf, user_id=f4cd985d3acd49198bcf8b3356acc9ad, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:03.914704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86135dd2-2fb0-44de-a07e-f3bc721f246a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:03.953613 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1714/3425] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:09:03 2022] PUT /identity/v3/projects/01e07746fe614f5ca3dcf9cafa96e7bf/users/f4cd985d3acd49198bcf8b3356acc9ad/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:03.958296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4dfedc-9956-462c-b6c4-1165438f4574 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:03.965200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227555-32f8-46c5-9b9e-dd78e20affcc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:03.965893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227555-32f8-46c5-9b9e-dd78e20affcc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:03.966381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227555-32f8-46c5-9b9e-dd78e20affcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:03.968689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-db4dfedc-9956-462c-b6c4-1165438f4574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:04.013751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4dfedc-9956-462c-b6c4-1165438f4574 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:04.043605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-da227555-32f8-46c5-9b9e-dd78e20affcc None None] MFA Rules not processed for user `f4cd985d3acd49198bcf8b3356acc9ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:04.044901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-da227555-32f8-46c5-9b9e-dd78e20affcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:04.072311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:04.161178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec222579-dd60-4073-9f91-34f4884e2f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:04.162887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec222579-dd60-4073-9f91-34f4884e2f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:04.163187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec222579-dd60-4073-9f91-34f4884e2f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:04.164478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec222579-dd60-4073-9f91-34f4884e2f80 admin admin] PATH_INFO: `/v3/projects/e91c37d221dc44b2855aaabd9772590c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:04.167239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec222579-dd60-4073-9f91-34f4884e2f80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e91c37d221dc44b2855aaabd9772590c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:04.172526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec222579-dd60-4073-9f91-34f4884e2f80 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:04.223322 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1715/3426] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:09:04.247517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da227555-32f8-46c5-9b9e-dd78e20affcc None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:04.249938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-da227555-32f8-46c5-9b9e-dd78e20affcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:04.324538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ec222579-dd60-4073-9f91-34f4884e2f80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e91c37d221dc44b2855aaabd9772590c', 'request_id': 'req-ec222579-dd60-4073-9f91-34f4884e2f80'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:04.350971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ec222579-dd60-4073-9f91-34f4884e2f80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e91c37d221dc44b2855aaabd9772590c', 'request_id': 'req-ec222579-dd60-4073-9f91-34f4884e2f80'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:04.363531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ec222579-dd60-4073-9f91-34f4884e2f80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e91c37d221dc44b2855aaabd9772590c', 'request_id': 'req-ec222579-dd60-4073-9f91-34f4884e2f80'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:04.385668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:04.414929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ec222579-dd60-4073-9f91-34f4884e2f80 admin admin] The token cache is being invalidate because project e91c37d221dc44b2855aaabd9772590c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:09:04.415232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ec222579-dd60-4073-9f91-34f4884e2f80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:04.418614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ec222579-dd60-4073-9f91-34f4884e2f80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:04.423040 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1712/3427] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:09:03 2022] DELETE /identity/v3/projects/e91c37d221dc44b2855aaabd9772590c => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:04.426311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da227555-32f8-46c5-9b9e-dd78e20affcc None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:04.438557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1ec06-a7c2-4e70-b591-893f37602a7c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:04.438848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1ec06-a7c2-4e70-b591-893f37602a7c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:04.439569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1ec06-a7c2-4e70-b591-893f37602a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:04.487581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-aea1ec06-a7c2-4e70-b591-893f37602a7c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:04.488822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-aea1ec06-a7c2-4e70-b591-893f37602a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:04.579007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e7979-072f-462e-9ad2-09e12b3d348e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:04.579690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e7979-072f-462e-9ad2-09e12b3d348e service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:04.580042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e7979-072f-462e-9ad2-09e12b3d348e service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:04.580382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e7979-072f-462e-9ad2-09e12b3d348e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:04.582587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c50e7979-072f-462e-9ad2-09e12b3d348e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:04.611630 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1713/3428] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:04.613355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25e99a-e070-4a2c-a33e-032e78b4395c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:04.613728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25e99a-e070-4a2c-a33e-032e78b4395c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:04.614169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25e99a-e070-4a2c-a33e-032e78b4395c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:04.639105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4e25e99a-e070-4a2c-a33e-032e78b4395c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:04.640999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4e25e99a-e070-4a2c-a33e-032e78b4395c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:04.655158 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1714/3429] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:04.656144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25e99a-e070-4a2c-a33e-032e78b4395c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:04.669416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25e99a-e070-4a2c-a33e-032e78b4395c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:04.675157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badcb2a-ad05-4d4d-b719-e30885260a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:04.678421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badcb2a-ad05-4d4d-b719-e30885260a65 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:04.678715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badcb2a-ad05-4d4d-b719-e30885260a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:04.679021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badcb2a-ad05-4d4d-b719-e30885260a65 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:04.680305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badcb2a-ad05-4d4d-b719-e30885260a65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:09:04.680610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badcb2a-ad05-4d4d-b719-e30885260a65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:04.682902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badcb2a-ad05-4d4d-b719-e30885260a65 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:04.702933 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1715/3430] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:09:04.703966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badcb2a-ad05-4d4d-b719-e30885260a65 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:04.716175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badcb2a-ad05-4d4d-b719-e30885260a65 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:04.721655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50401b25-4455-4db8-8509-d6c02f251343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:04.722304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50401b25-4455-4db8-8509-d6c02f251343 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:04.723201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50401b25-4455-4db8-8509-d6c02f251343 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:04.723517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50401b25-4455-4db8-8509-d6c02f251343 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:04.725010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50401b25-4455-4db8-8509-d6c02f251343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:04.728347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50401b25-4455-4db8-8509-d6c02f251343 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:04.737620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e7979-072f-462e-9ad2-09e12b3d348e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:04.739323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e7979-072f-462e-9ad2-09e12b3d348e service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:04.772357 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1716/3431] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:09:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:09:04.793075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063381bd-2105-4402-8804-5995c72784e8 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:04.793742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063381bd-2105-4402-8804-5995c72784e8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:04.794027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063381bd-2105-4402-8804-5995c72784e8 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:04.796291 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1717/3432] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:09:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:09:04.803058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063381bd-2105-4402-8804-5995c72784e8 None None] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:09:04.805648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-063381bd-2105-4402-8804-5995c72784e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:04.809820 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1716/3433] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:09:04 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:09:04.811555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce500f66-e0c3-48db-bb5a-c3c9f514a439 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:04.812164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce500f66-e0c3-48db-bb5a-c3c9f514a439 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:04.812643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce500f66-e0c3-48db-bb5a-c3c9f514a439 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:04.814517 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1717/3434] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:09:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:09:04.815573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce500f66-e0c3-48db-bb5a-c3c9f514a439 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:04.831756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:04.951966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce500f66-e0c3-48db-bb5a-c3c9f514a439 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:04.958441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063381bd-2105-4402-8804-5995c72784e8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:04.959333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb198b7e-d60e-4ddd-99f2-91767325b6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:04.960046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb198b7e-d60e-4ddd-99f2-91767325b6ad admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:04.960975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb198b7e-d60e-4ddd-99f2-91767325b6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:04.961338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb198b7e-d60e-4ddd-99f2-91767325b6ad admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:04.962112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb198b7e-d60e-4ddd-99f2-91767325b6ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:04.964181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb198b7e-d60e-4ddd-99f2-91767325b6ad admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:04.995381 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1718/3435] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:09:04 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:09:04.995381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841901ca-27de-4d8e-a05f-8487b8611f33 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:04.997335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841901ca-27de-4d8e-a05f-8487b8611f33 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:04.997987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841901ca-27de-4d8e-a05f-8487b8611f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:05.047057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-841901ca-27de-4d8e-a05f-8487b8611f33 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:05.048209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-841901ca-27de-4d8e-a05f-8487b8611f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:05.058776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:05.129838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063381bd-2105-4402-8804-5995c72784e8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:05.133254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a27601-d6bc-4219-87d1-250189086a79 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4cd985d3acd49198bcf8b3356acc9ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e07746fe614f5ca3dcf9cafa96e7bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:05.134287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a27601-d6bc-4219-87d1-250189086a79 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:05.134752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a27601-d6bc-4219-87d1-250189086a79 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:05.135045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a27601-d6bc-4219-87d1-250189086a79 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] PATH_INFO: `/v3/projects/01e07746fe614f5ca3dcf9cafa96e7bf` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:05.136698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a27601-d6bc-4219-87d1-250189086a79 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] RBAC: Authorizing `identity:get_project(project_id=01e07746fe614f5ca3dcf9cafa96e7bf)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:05.138874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a27601-d6bc-4219-87d1-250189086a79 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:05.141250 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1718/3436] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:09:04 2022] GET /identity/v3/projects/01e07746fe614f5ca3dcf9cafa96e7bf => generated 365 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:09:05.147501 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1719/3437] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:09:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:05.149605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841901ca-27de-4d8e-a05f-8487b8611f33 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:05.179430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a27601-d6bc-4219-87d1-250189086a79 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:05.183051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841901ca-27de-4d8e-a05f-8487b8611f33 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:05.189795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-64a27601-d6bc-4219-87d1-250189086a79 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:05.198135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da613b19-57a4-438e-8a9e-d585e4d5ba69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:05.198929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da613b19-57a4-438e-8a9e-d585e4d5ba69 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:05.199131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da613b19-57a4-438e-8a9e-d585e4d5ba69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:05.199629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da613b19-57a4-438e-8a9e-d585e4d5ba69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:05.200354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da613b19-57a4-438e-8a9e-d585e4d5ba69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:05.201999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da613b19-57a4-438e-8a9e-d585e4d5ba69 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:05.223130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a27601-d6bc-4219-87d1-250189086a79 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:05.224303 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1720/3438] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:09:05.225552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da613b19-57a4-438e-8a9e-d585e4d5ba69 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:05.248116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02513fa8-71b5-4509-a53d-a3fc059ad86a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:05.250465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02513fa8-71b5-4509-a53d-a3fc059ad86a service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:05.250465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02513fa8-71b5-4509-a53d-a3fc059ad86a service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:05.250465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02513fa8-71b5-4509-a53d-a3fc059ad86a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:05.260061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da613b19-57a4-438e-8a9e-d585e4d5ba69 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:05.269802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3db556-e73e-4ce9-abff-21313f2a3b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:05.270450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3db556-e73e-4ce9-abff-21313f2a3b56 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:05.270773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02513fa8-71b5-4509-a53d-a3fc059ad86a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:05.270966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3db556-e73e-4ce9-abff-21313f2a3b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:05.271559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3db556-e73e-4ce9-abff-21313f2a3b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:05.272358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3db556-e73e-4ce9-abff-21313f2a3b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:05.273311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02513fa8-71b5-4509-a53d-a3fc059ad86a service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:05.289729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3db556-e73e-4ce9-abff-21313f2a3b56 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:05.307469 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1719/3439] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:09:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:09:05.354003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02513fa8-71b5-4509-a53d-a3fc059ad86a service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:05.355318 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1721/3440] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:09:05.383577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02513fa8-71b5-4509-a53d-a3fc059ad86a service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:05.406539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe23df-0b73-4811-b984-a675d7680517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:05.407227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe23df-0b73-4811-b984-a675d7680517 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:05.407684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe23df-0b73-4811-b984-a675d7680517 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:05.407963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe23df-0b73-4811-b984-a675d7680517 admin admin] PATH_INFO: `/v3/projects/f1483d62924a45fb8861eba403c6dd19/users/538cf63f2e4c46a6969b3e7ed54c475d/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:05.433504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe23df-0b73-4811-b984-a675d7680517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1483d62924a45fb8861eba403c6dd19, user_id=538cf63f2e4c46a6969b3e7ed54c475d, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:05.436648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe23df-0b73-4811-b984-a675d7680517 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:05.463547 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1720/3441] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:09:05 2022] PUT /identity/v3/projects/f1483d62924a45fb8861eba403c6dd19/users/538cf63f2e4c46a6969b3e7ed54c475d/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:05.473916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed60f48-20a7-46be-a375-210be8470c9e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:05.474207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed60f48-20a7-46be-a375-210be8470c9e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:05.474485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed60f48-20a7-46be-a375-210be8470c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:05.577100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0ed60f48-20a7-46be-a375-210be8470c9e None None] MFA Rules not processed for user `538cf63f2e4c46a6969b3e7ed54c475d`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:05.577919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0ed60f48-20a7-46be-a375-210be8470c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:05.589209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a31a61-1c9d-47fb-a61b-cd206e55c847 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:05.589743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a31a61-1c9d-47fb-a61b-cd206e55c847 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:05.590165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a31a61-1c9d-47fb-a61b-cd206e55c847 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:05.592593 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1721/3442] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:09:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 21:09:05.605646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66be784-7de8-4475-b736-85e10c7eedf8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:05.606367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66be784-7de8-4475-b736-85e10c7eedf8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:05.606848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66be784-7de8-4475-b736-85e10c7eedf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:05.635275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e66be784-7de8-4475-b736-85e10c7eedf8 None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:05.640051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e66be784-7de8-4475-b736-85e10c7eedf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:05.737187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:05.787448 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1722/3443] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:05.798280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed60f48-20a7-46be-a375-210be8470c9e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:05.800897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0ed60f48-20a7-46be-a375-210be8470c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:05.834084 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1722/3444] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:09:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:09:05.836621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e73db7-7a48-4520-a087-d70353d08627 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:05.836984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e73db7-7a48-4520-a087-d70353d08627 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:05.837530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e73db7-7a48-4520-a087-d70353d08627 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:05.839492 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1723/3445] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:09:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:09:05.847126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e73db7-7a48-4520-a087-d70353d08627 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:05.849174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a5e73db7-7a48-4520-a087-d70353d08627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:05.944368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed60f48-20a7-46be-a375-210be8470c9e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:05.954146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbca0f-d6b1-4c57-a3b5-d89ef2e23b46 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:05.955697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbca0f-d6b1-4c57-a3b5-d89ef2e23b46 service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:05.956177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbca0f-d6b1-4c57-a3b5-d89ef2e23b46 service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:05.957687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbca0f-d6b1-4c57-a3b5-d89ef2e23b46 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:05.965352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e73db7-7a48-4520-a087-d70353d08627 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:05.970641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46598f-1e57-4386-851b-be1e8e0bfbe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:05.971878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbca0f-d6b1-4c57-a3b5-d89ef2e23b46 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:05.971993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46598f-1e57-4386-851b-be1e8e0bfbe9 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:05.972947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46598f-1e57-4386-851b-be1e8e0bfbe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:05.973403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46598f-1e57-4386-851b-be1e8e0bfbe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:05.975646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbca0f-d6b1-4c57-a3b5-d89ef2e23b46 service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:05.987085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46598f-1e57-4386-851b-be1e8e0bfbe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:05.988447 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1723/3446] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:09:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:09:05.989533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbca0f-d6b1-4c57-a3b5-d89ef2e23b46 service glance] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:09:05.991560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d1cbca0f-d6b1-4c57-a3b5-d89ef2e23b46 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:06.001433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46598f-1e57-4386-851b-be1e8e0bfbe9 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:06.027462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbca0f-d6b1-4c57-a3b5-d89ef2e23b46 service glance] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:06.029585 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1724/3447] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:09:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:09:06.110361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbca0f-d6b1-4c57-a3b5-d89ef2e23b46 service glance] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:06.116371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3889c84-e8cf-44b8-8fbe-de2fefa4a35f tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4cd985d3acd49198bcf8b3356acc9ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e07746fe614f5ca3dcf9cafa96e7bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:06.117219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3889c84-e8cf-44b8-8fbe-de2fefa4a35f tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:06.117510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3889c84-e8cf-44b8-8fbe-de2fefa4a35f tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:06.117791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3889c84-e8cf-44b8-8fbe-de2fefa4a35f tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] PATH_INFO: `/v3/projects/01e07746fe614f5ca3dcf9cafa96e7bf` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:06.119967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3889c84-e8cf-44b8-8fbe-de2fefa4a35f tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] RBAC: Authorizing `identity:get_project(project_id=01e07746fe614f5ca3dcf9cafa96e7bf)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:06.122028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3889c84-e8cf-44b8-8fbe-de2fefa4a35f tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:06.125069 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1724/3448] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:09:05 2022] GET /identity/v3/projects/01e07746fe614f5ca3dcf9cafa96e7bf => generated 365 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:09:06.287083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b6fdd-3dec-4e6a-bf1f-08092ba535e8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:06.287417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b6fdd-3dec-4e6a-bf1f-08092ba535e8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:06.287686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b6fdd-3dec-4e6a-bf1f-08092ba535e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:06.338296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b29b6fdd-3dec-4e6a-bf1f-08092ba535e8 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:06.339908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b29b6fdd-3dec-4e6a-bf1f-08092ba535e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:06.384427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:06.438221 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1725/3449] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:06.454077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3889c84-e8cf-44b8-8fbe-de2fefa4a35f tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:06.455992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c3889c84-e8cf-44b8-8fbe-de2fefa4a35f tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:06.639187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e77b0-aa95-4db2-9588-31a42e19fe26 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:06.639772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e77b0-aa95-4db2-9588-31a42e19fe26 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:06.640350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e77b0-aa95-4db2-9588-31a42e19fe26 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:06.642213 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1726/3450] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:09:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:09:06.647498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e77b0-aa95-4db2-9588-31a42e19fe26 None None] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:09:06.665799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3889c84-e8cf-44b8-8fbe-de2fefa4a35f tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:06.670497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e77b0-aa95-4db2-9588-31a42e19fe26 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:06.681129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e77b0-aa95-4db2-9588-31a42e19fe26 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:06.685140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5be6a4-ddc1-4974-b0e8-9f6df7e3ba07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:06.685967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5be6a4-ddc1-4974-b0e8-9f6df7e3ba07 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:06.686390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5be6a4-ddc1-4974-b0e8-9f6df7e3ba07 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:06.686802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5be6a4-ddc1-4974-b0e8-9f6df7e3ba07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:06.687343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d24f7e-0a45-4516-9563-48cd80d82ca8 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4cd985d3acd49198bcf8b3356acc9ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e07746fe614f5ca3dcf9cafa96e7bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:06.688237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d24f7e-0a45-4516-9563-48cd80d82ca8 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:06.688620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d24f7e-0a45-4516-9563-48cd80d82ca8 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:06.689006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d24f7e-0a45-4516-9563-48cd80d82ca8 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] PATH_INFO: `/v3/projects/01e07746fe614f5ca3dcf9cafa96e7bf` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:06.690393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d24f7e-0a45-4516-9563-48cd80d82ca8 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] RBAC: Authorizing `identity:get_project(project_id=01e07746fe614f5ca3dcf9cafa96e7bf)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:06.693553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d24f7e-0a45-4516-9563-48cd80d82ca8 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:06.696458 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1727/3451] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:09:06 2022] GET /identity/v3/projects/01e07746fe614f5ca3dcf9cafa96e7bf => generated 365 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:09:06.713795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5be6a4-ddc1-4974-b0e8-9f6df7e3ba07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:06.728741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5be6a4-ddc1-4974-b0e8-9f6df7e3ba07 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:06.743047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e413a3f-e6b1-47eb-a0ce-e354eb2c5e41 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:06.743520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e413a3f-e6b1-47eb-a0ce-e354eb2c5e41 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:06.743948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e413a3f-e6b1-47eb-a0ce-e354eb2c5e41 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:06.745913 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1728/3452] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:09:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:09:06.751319 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1725/3453] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:09:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:09:06.752090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e413a3f-e6b1-47eb-a0ce-e354eb2c5e41 None None] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:09:06.779358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e413a3f-e6b1-47eb-a0ce-e354eb2c5e41 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:06.810101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e413a3f-e6b1-47eb-a0ce-e354eb2c5e41 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:06.823147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1577ec5-566f-4db3-8611-20e126d4858f tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4cd985d3acd49198bcf8b3356acc9ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e07746fe614f5ca3dcf9cafa96e7bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:06.824346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1577ec5-566f-4db3-8611-20e126d4858f tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:06.824632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1577ec5-566f-4db3-8611-20e126d4858f tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:06.824913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1577ec5-566f-4db3-8611-20e126d4858f tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] PATH_INFO: `/v3/projects/01e07746fe614f5ca3dcf9cafa96e7bf` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:06.827255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1577ec5-566f-4db3-8611-20e126d4858f tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] RBAC: Authorizing `identity:get_project(project_id=01e07746fe614f5ca3dcf9cafa96e7bf)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:06.832366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1577ec5-566f-4db3-8611-20e126d4858f tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:06.840367 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1729/3454] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:09:06 2022] GET /identity/v3/projects/01e07746fe614f5ca3dcf9cafa96e7bf => generated 365 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:09:08.724937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595f75f-a8bc-4823-ade5-96c49008ffd8 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:08.725398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595f75f-a8bc-4823-ade5-96c49008ffd8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:08.725578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595f75f-a8bc-4823-ade5-96c49008ffd8 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:08.727847 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1726/3455] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:09:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:09:08.737011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1577ec5-566f-4db3-8611-20e126d4858f tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:09:08.764177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1577ec5-566f-4db3-8611-20e126d4858f tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:08.789227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1577ec5-566f-4db3-8611-20e126d4858f tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:08.799978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8781f5d-2751-4606-9f86-8ffc08e836c6 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4cd985d3acd49198bcf8b3356acc9ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e07746fe614f5ca3dcf9cafa96e7bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:08.800750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8781f5d-2751-4606-9f86-8ffc08e836c6 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:08.801134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8781f5d-2751-4606-9f86-8ffc08e836c6 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:08.801514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8781f5d-2751-4606-9f86-8ffc08e836c6 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] PATH_INFO: `/v3/projects/01e07746fe614f5ca3dcf9cafa96e7bf` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:08.805717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8781f5d-2751-4606-9f86-8ffc08e836c6 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] RBAC: Authorizing `identity:get_project(project_id=01e07746fe614f5ca3dcf9cafa96e7bf)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:08.810665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8781f5d-2751-4606-9f86-8ffc08e836c6 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:08.815501 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1730/3456] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:09:08 2022] GET /identity/v3/projects/01e07746fe614f5ca3dcf9cafa96e7bf => generated 365 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:09:08.920868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595f75f-a8bc-4823-ade5-96c49008ffd8 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:08.923259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f595f75f-a8bc-4823-ade5-96c49008ffd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:08.989096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:09.087173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595f75f-a8bc-4823-ade5-96c49008ffd8 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:09.092342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c0d8d-ca60-4c87-bae9-4a022820a54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:09.093122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c0d8d-ca60-4c87-bae9-4a022820a54f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:09.093476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c0d8d-ca60-4c87-bae9-4a022820a54f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:09.093828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c0d8d-ca60-4c87-bae9-4a022820a54f admin admin] PATH_INFO: `/v3/users/f4cd985d3acd49198bcf8b3356acc9ad` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:09.095241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c0d8d-ca60-4c87-bae9-4a022820a54f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4cd985d3acd49198bcf8b3356acc9ad)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:09.098941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c0d8d-ca60-4c87-bae9-4a022820a54f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:09.240047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a63c0d8d-ca60-4c87-bae9-4a022820a54f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4cd985d3acd49198bcf8b3356acc9ad'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:09.240818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a63c0d8d-ca60-4c87-bae9-4a022820a54f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4cd985d3acd49198bcf8b3356acc9ad'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:09.264687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a63c0d8d-ca60-4c87-bae9-4a022820a54f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4cd985d3acd49198bcf8b3356acc9ad'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:09.265817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a63c0d8d-ca60-4c87-bae9-4a022820a54f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4cd985d3acd49198bcf8b3356acc9ad'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:09.288205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a63c0d8d-ca60-4c87-bae9-4a022820a54f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4cd985d3acd49198bcf8b3356acc9ad'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:09.329780 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1727/3457] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:09:08 2022] DELETE /identity/v3/users/f4cd985d3acd49198bcf8b3356acc9ad => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:09.332890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdae30d-cbcc-405f-b343-f6ea8b77b621 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:09.332890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdae30d-cbcc-405f-b343-f6ea8b77b621 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:09.332890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdae30d-cbcc-405f-b343-f6ea8b77b621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:09.367884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0cdae30d-cbcc-405f-b343-f6ea8b77b621 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:09.370384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0cdae30d-cbcc-405f-b343-f6ea8b77b621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:09.521916 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1731/3458] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:09.555869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c0d8d-ca60-4c87-bae9-4a022820a54f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:09.557434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a63c0d8d-ca60-4c87-bae9-4a022820a54f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:09.693171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c0d8d-ca60-4c87-bae9-4a022820a54f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:09.705761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d0ae0-c357-4c61-b2bb-9ecb0f3e91e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:09.706409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d0ae0-c357-4c61-b2bb-9ecb0f3e91e5 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:09.706682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d0ae0-c357-4c61-b2bb-9ecb0f3e91e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:09.706968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d0ae0-c357-4c61-b2bb-9ecb0f3e91e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:09.721865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d0ae0-c357-4c61-b2bb-9ecb0f3e91e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:09.724424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d0ae0-c357-4c61-b2bb-9ecb0f3e91e5 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:09.751314 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1728/3459] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:09:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:09:10.888862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdae30d-cbcc-405f-b343-f6ea8b77b621 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:10.893691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0cdae30d-cbcc-405f-b343-f6ea8b77b621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:10.954813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdae30d-cbcc-405f-b343-f6ea8b77b621 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:10.984006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70696435-41f3-4d11-96b4-a57198205df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:10.984853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70696435-41f3-4d11-96b4-a57198205df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:10.986174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70696435-41f3-4d11-96b4-a57198205df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:10.986623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70696435-41f3-4d11-96b4-a57198205df9 admin admin] PATH_INFO: `/v3/projects/01e07746fe614f5ca3dcf9cafa96e7bf` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:10.987993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70696435-41f3-4d11-96b4-a57198205df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e07746fe614f5ca3dcf9cafa96e7bf)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:10.990027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70696435-41f3-4d11-96b4-a57198205df9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:11.096491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-70696435-41f3-4d11-96b4-a57198205df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e07746fe614f5ca3dcf9cafa96e7bf', 'request_id': 'req-70696435-41f3-4d11-96b4-a57198205df9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:11.114299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-70696435-41f3-4d11-96b4-a57198205df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e07746fe614f5ca3dcf9cafa96e7bf', 'request_id': 'req-70696435-41f3-4d11-96b4-a57198205df9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:11.135914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-70696435-41f3-4d11-96b4-a57198205df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e07746fe614f5ca3dcf9cafa96e7bf', 'request_id': 'req-70696435-41f3-4d11-96b4-a57198205df9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:11.154069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-70696435-41f3-4d11-96b4-a57198205df9 admin admin] The token cache is being invalidate because project 01e07746fe614f5ca3dcf9cafa96e7bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:09:11.154551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-70696435-41f3-4d11-96b4-a57198205df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:11.158841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-70696435-41f3-4d11-96b4-a57198205df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:11.170329 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1732/3460] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:09:10 2022] DELETE /identity/v3/projects/01e07746fe614f5ca3dcf9cafa96e7bf => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:11.172892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf68c5a-cff5-4387-9f2b-dd85bd9378e4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:11.174398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf68c5a-cff5-4387-9f2b-dd85bd9378e4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:11.174829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf68c5a-cff5-4387-9f2b-dd85bd9378e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:11.245776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9bf68c5a-cff5-4387-9f2b-dd85bd9378e4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:11.247336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9bf68c5a-cff5-4387-9f2b-dd85bd9378e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:11.318305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:11.353939 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1729/3461] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:11.361883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa4eda-4ee8-4429-878e-278b9aaa1e39 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:11.362459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa4eda-4ee8-4429-878e-278b9aaa1e39 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:11.362989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa4eda-4ee8-4429-878e-278b9aaa1e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:11.417024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-afaa4eda-4ee8-4429-878e-278b9aaa1e39 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:11.419328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-afaa4eda-4ee8-4429-878e-278b9aaa1e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:11.439732 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1733/3462] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:11.444236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf68c5a-cff5-4387-9f2b-dd85bd9378e4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:11.484410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf68c5a-cff5-4387-9f2b-dd85bd9378e4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:11.498298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee2d12-a2e9-48e6-a0ab-0ec86d412f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:11.501855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee2d12-a2e9-48e6-a0ab-0ec86d412f04 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:11.503534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee2d12-a2e9-48e6-a0ab-0ec86d412f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:11.504107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee2d12-a2e9-48e6-a0ab-0ec86d412f04 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:11.506509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee2d12-a2e9-48e6-a0ab-0ec86d412f04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:09:11.507613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee2d12-a2e9-48e6-a0ab-0ec86d412f04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:11.510984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee2d12-a2e9-48e6-a0ab-0ec86d412f04 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:11.544876 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1730/3463] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:09:11.549184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa4eda-4ee8-4429-878e-278b9aaa1e39 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:11.571800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa4eda-4ee8-4429-878e-278b9aaa1e39 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:11.608920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93675dc-c809-4075-a4ef-c14a28953584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:11.610392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93675dc-c809-4075-a4ef-c14a28953584 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:11.610778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93675dc-c809-4075-a4ef-c14a28953584 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:11.611242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93675dc-c809-4075-a4ef-c14a28953584 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:11.613799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93675dc-c809-4075-a4ef-c14a28953584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:11.621524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93675dc-c809-4075-a4ef-c14a28953584 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:11.694102 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1734/3464] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:09:11 2022] POST /identity/v3/projects => generated 389 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:09:11.698843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee2d12-a2e9-48e6-a0ab-0ec86d412f04 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:11.715733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee2d12-a2e9-48e6-a0ab-0ec86d412f04 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:12.026441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0710c-01b0-44b4-81d1-39fb5ab6ab84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:12.028210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0710c-01b0-44b4-81d1-39fb5ab6ab84 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:12.028714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0710c-01b0-44b4-81d1-39fb5ab6ab84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:12.029212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0710c-01b0-44b4-81d1-39fb5ab6ab84 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:12.030090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0710c-01b0-44b4-81d1-39fb5ab6ab84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:12.039385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0710c-01b0-44b4-81d1-39fb5ab6ab84 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:12.144475 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1731/3465] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:09:11 2022] POST /identity/v3/users => generated 295 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:09:12.165494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93675dc-c809-4075-a4ef-c14a28953584 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:12.177804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:12.197560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93675dc-c809-4075-a4ef-c14a28953584 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:12.205528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861ecda-5624-45da-9321-73b3b10e5986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:12.206276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861ecda-5624-45da-9321-73b3b10e5986 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:12.207045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861ecda-5624-45da-9321-73b3b10e5986 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:12.207646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861ecda-5624-45da-9321-73b3b10e5986 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:12.208625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861ecda-5624-45da-9321-73b3b10e5986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:12.210506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861ecda-5624-45da-9321-73b3b10e5986 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:12.223116 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1735/3466] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:09:12.227456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0710c-01b0-44b4-81d1-39fb5ab6ab84 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:12.238518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0710c-01b0-44b4-81d1-39fb5ab6ab84 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:12.244350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11486e05-4640-4899-9392-d2bc2cb1e844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:12.245375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486e05-4640-4899-9392-d2bc2cb1e844 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:12.245662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486e05-4640-4899-9392-d2bc2cb1e844 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:12.245941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486e05-4640-4899-9392-d2bc2cb1e844 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:12.246882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11486e05-4640-4899-9392-d2bc2cb1e844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:12.250256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11486e05-4640-4899-9392-d2bc2cb1e844 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:12.266186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861ecda-5624-45da-9321-73b3b10e5986 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:12.266266 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1732/3467] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:09:12.276358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861ecda-5624-45da-9321-73b3b10e5986 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:12.285109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e991e95-0950-4e38-9318-07e85ab6e40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:12.286081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e991e95-0950-4e38-9318-07e85ab6e40f admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:12.286364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e991e95-0950-4e38-9318-07e85ab6e40f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:12.286637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e991e95-0950-4e38-9318-07e85ab6e40f admin admin] PATH_INFO: `/v3/projects/2b4c650076ad4077874a72f6e64461f3/users/f00d46cd63d94b49abfa65d6106c7d88/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:12.309818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e991e95-0950-4e38-9318-07e85ab6e40f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4c650076ad4077874a72f6e64461f3, user_id=f00d46cd63d94b49abfa65d6106c7d88, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:12.315599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e991e95-0950-4e38-9318-07e85ab6e40f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:12.337364 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1736/3468] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:09:12 2022] PUT /identity/v3/projects/2b4c650076ad4077874a72f6e64461f3/users/f00d46cd63d94b49abfa65d6106c7d88/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:12.342379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aebc15-5106-4846-b9e1-7b4ae1945706 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:12.342840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aebc15-5106-4846-b9e1-7b4ae1945706 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:12.343269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aebc15-5106-4846-b9e1-7b4ae1945706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:12.577803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-03aebc15-5106-4846-b9e1-7b4ae1945706 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:12.579554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-03aebc15-5106-4846-b9e1-7b4ae1945706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:12.744800 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1733/3469] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:12.763603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e991e95-0950-4e38-9318-07e85ab6e40f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:12.765577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9e991e95-0950-4e38-9318-07e85ab6e40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:12.970580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e991e95-0950-4e38-9318-07e85ab6e40f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:12.986500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9155d90-eaa9-4046-9c1b-75e30e38e15d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:12.991077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9155d90-eaa9-4046-9c1b-75e30e38e15d service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:12.993403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9155d90-eaa9-4046-9c1b-75e30e38e15d service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:12.993720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9155d90-eaa9-4046-9c1b-75e30e38e15d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:13.021470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9155d90-eaa9-4046-9c1b-75e30e38e15d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:13.025327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9155d90-eaa9-4046-9c1b-75e30e38e15d service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:13.055431 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1737/3470] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:09:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:09:16.470900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aebc15-5106-4846-b9e1-7b4ae1945706 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:16.475539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-03aebc15-5106-4846-b9e1-7b4ae1945706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:16.504188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aebc15-5106-4846-b9e1-7b4ae1945706 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:16.515030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8423007-f9c1-4238-8f7a-b2e668b18997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:16.516935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8423007-f9c1-4238-8f7a-b2e668b18997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:16.517427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8423007-f9c1-4238-8f7a-b2e668b18997 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:16.518118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8423007-f9c1-4238-8f7a-b2e668b18997 admin admin] PATH_INFO: `/v3/users/e32ef1b0626a4e8ba78cf5d60d5cba07` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:16.519856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8423007-f9c1-4238-8f7a-b2e668b18997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32ef1b0626a4e8ba78cf5d60d5cba07)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:16.522021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8423007-f9c1-4238-8f7a-b2e668b18997 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:16.676581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d8423007-f9c1-4238-8f7a-b2e668b18997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32ef1b0626a4e8ba78cf5d60d5cba07'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:16.681459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d8423007-f9c1-4238-8f7a-b2e668b18997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32ef1b0626a4e8ba78cf5d60d5cba07'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:16.693595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:16.724168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d8423007-f9c1-4238-8f7a-b2e668b18997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32ef1b0626a4e8ba78cf5d60d5cba07'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:16.728842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d8423007-f9c1-4238-8f7a-b2e668b18997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32ef1b0626a4e8ba78cf5d60d5cba07'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:16.769607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d8423007-f9c1-4238-8f7a-b2e668b18997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32ef1b0626a4e8ba78cf5d60d5cba07'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:16.819362 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1734/3471] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:09:16 2022] DELETE /identity/v3/users/e32ef1b0626a4e8ba78cf5d60d5cba07 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:17.396802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9155d90-eaa9-4046-9c1b-75e30e38e15d service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:17.411335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9155d90-eaa9-4046-9c1b-75e30e38e15d service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:17.556227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08684a8a-6b06-4c3c-ae92-1baf5c1ba1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:17.556897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08684a8a-6b06-4c3c-ae92-1baf5c1ba1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:17.557177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08684a8a-6b06-4c3c-ae92-1baf5c1ba1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:17.557448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08684a8a-6b06-4c3c-ae92-1baf5c1ba1ba admin admin] PATH_INFO: `/v3/projects/ab77ff72721c4579b8e48346f7d98842` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:17.561280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08684a8a-6b06-4c3c-ae92-1baf5c1ba1ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab77ff72721c4579b8e48346f7d98842)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:17.563899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08684a8a-6b06-4c3c-ae92-1baf5c1ba1ba admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:17.755522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-08684a8a-6b06-4c3c-ae92-1baf5c1ba1ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab77ff72721c4579b8e48346f7d98842', 'request_id': 'req-08684a8a-6b06-4c3c-ae92-1baf5c1ba1ba'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:17.785233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-08684a8a-6b06-4c3c-ae92-1baf5c1ba1ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab77ff72721c4579b8e48346f7d98842', 'request_id': 'req-08684a8a-6b06-4c3c-ae92-1baf5c1ba1ba'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:17.804919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-08684a8a-6b06-4c3c-ae92-1baf5c1ba1ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab77ff72721c4579b8e48346f7d98842', 'request_id': 'req-08684a8a-6b06-4c3c-ae92-1baf5c1ba1ba'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:17.823928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:17.830725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-08684a8a-6b06-4c3c-ae92-1baf5c1ba1ba admin admin] The token cache is being invalidate because project ab77ff72721c4579b8e48346f7d98842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:09:17.831654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-08684a8a-6b06-4c3c-ae92-1baf5c1ba1ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:17.834912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-08684a8a-6b06-4c3c-ae92-1baf5c1ba1ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:17.843949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762e958-da73-457e-9586-a72be00a5276 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:17.844474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762e958-da73-457e-9586-a72be00a5276 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:17.844744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762e958-da73-457e-9586-a72be00a5276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:17.848661 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1738/3472] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:09:17 2022] DELETE /identity/v3/projects/ab77ff72721c4579b8e48346f7d98842 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:17.885371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4762e958-da73-457e-9586-a72be00a5276 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:17.888180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4762e958-da73-457e-9586-a72be00a5276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:18.015927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54510cf-1353-496f-9a0a-d547f7141d1c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:18.016222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54510cf-1353-496f-9a0a-d547f7141d1c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:18.016503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54510cf-1353-496f-9a0a-d547f7141d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:18.020279 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1735/3473] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:18.072489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c54510cf-1353-496f-9a0a-d547f7141d1c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:18.073762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c54510cf-1353-496f-9a0a-d547f7141d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:18.098868 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1739/3474] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:09:18.099146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762e958-da73-457e-9586-a72be00a5276 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:18.136001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762e958-da73-457e-9586-a72be00a5276 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:18.145085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ab16b-2611-4b37-9f1a-62ca92ab81be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:18.146613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ab16b-2611-4b37-9f1a-62ca92ab81be admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:18.147111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ab16b-2611-4b37-9f1a-62ca92ab81be admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:18.147661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ab16b-2611-4b37-9f1a-62ca92ab81be admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:18.148564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ab16b-2611-4b37-9f1a-62ca92ab81be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:09:18.160541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ab16b-2611-4b37-9f1a-62ca92ab81be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:18.164578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ab16b-2611-4b37-9f1a-62ca92ab81be admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:18.192168 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1736/3475] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:09:18.194472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54510cf-1353-496f-9a0a-d547f7141d1c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:18.207227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54510cf-1353-496f-9a0a-d547f7141d1c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:18.221359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec531c5b-2171-4b9a-af18-bff72d4e8232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:18.222297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec531c5b-2171-4b9a-af18-bff72d4e8232 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:18.222297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec531c5b-2171-4b9a-af18-bff72d4e8232 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:18.222557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec531c5b-2171-4b9a-af18-bff72d4e8232 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:18.223230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec531c5b-2171-4b9a-af18-bff72d4e8232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:18.227724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec531c5b-2171-4b9a-af18-bff72d4e8232 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:18.298842 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1740/3476] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:09:18 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:09:18.300054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ab16b-2611-4b37-9f1a-62ca92ab81be admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:18.314465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ab16b-2611-4b37-9f1a-62ca92ab81be admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:18.491804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2e8e2-5bad-4608-9f8f-8843c4745e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:18.492457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2e8e2-5bad-4608-9f8f-8843c4745e67 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:18.492745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2e8e2-5bad-4608-9f8f-8843c4745e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:18.493024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2e8e2-5bad-4608-9f8f-8843c4745e67 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:18.493698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2e8e2-5bad-4608-9f8f-8843c4745e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:18.495762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2e8e2-5bad-4608-9f8f-8843c4745e67 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:18.550311 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1737/3477] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:09:18 2022] POST /identity/v3/users => generated 291 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:09:18.554203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec531c5b-2171-4b9a-af18-bff72d4e8232 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:18.573068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec531c5b-2171-4b9a-af18-bff72d4e8232 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:18.582354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45673861-a44d-438a-80f1-1b700ad5682e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:18.582975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45673861-a44d-438a-80f1-1b700ad5682e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:18.583260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45673861-a44d-438a-80f1-1b700ad5682e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:18.583714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45673861-a44d-438a-80f1-1b700ad5682e admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:18.588880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45673861-a44d-438a-80f1-1b700ad5682e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:18.590737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45673861-a44d-438a-80f1-1b700ad5682e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:18.634457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2e8e2-5bad-4608-9f8f-8843c4745e67 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:18.639859 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1741/3478] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:09:18.649813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2e8e2-5bad-4608-9f8f-8843c4745e67 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:18.667873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90130930-600a-4ad3-b0f0-c4ca85dd0849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:18.668868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90130930-600a-4ad3-b0f0-c4ca85dd0849 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:18.669630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90130930-600a-4ad3-b0f0-c4ca85dd0849 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:18.670194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90130930-600a-4ad3-b0f0-c4ca85dd0849 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:18.670935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90130930-600a-4ad3-b0f0-c4ca85dd0849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:18.672657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90130930-600a-4ad3-b0f0-c4ca85dd0849 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:18.701371 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1738/3479] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:09:18.702549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45673861-a44d-438a-80f1-1b700ad5682e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:18.719133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45673861-a44d-438a-80f1-1b700ad5682e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:18.744748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4620b6-6c15-4f60-91e0-0cb682903e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:18.745587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4620b6-6c15-4f60-91e0-0cb682903e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:18.745756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4620b6-6c15-4f60-91e0-0cb682903e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:18.746041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4620b6-6c15-4f60-91e0-0cb682903e2f admin admin] PATH_INFO: `/v3/projects/cc4eb46593544ff78b641193ec88a7c3/users/70a0d6cf4a484ad4900293ad97249a5d/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:18.797796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4620b6-6c15-4f60-91e0-0cb682903e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc4eb46593544ff78b641193ec88a7c3, user_id=70a0d6cf4a484ad4900293ad97249a5d, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:18.805259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4620b6-6c15-4f60-91e0-0cb682903e2f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:18.861090 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1742/3480] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:09:18 2022] PUT /identity/v3/projects/cc4eb46593544ff78b641193ec88a7c3/users/70a0d6cf4a484ad4900293ad97249a5d/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:18.866564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96e710-968f-453e-9274-7fe55ac37e6e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:18.867051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96e710-968f-453e-9274-7fe55ac37e6e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:18.867051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96e710-968f-453e-9274-7fe55ac37e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:18.910889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3f96e710-968f-453e-9274-7fe55ac37e6e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:18.922884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3f96e710-968f-453e-9274-7fe55ac37e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:19.035561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:19.145473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4620b6-6c15-4f60-91e0-0cb682903e2f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:19.145664 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1739/3481] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:19.148043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-af4620b6-6c15-4f60-91e0-0cb682903e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:19.327069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4620b6-6c15-4f60-91e0-0cb682903e2f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:19.337995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46321248-aa6e-46d0-91c4-9c080b2d9a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:19.338755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46321248-aa6e-46d0-91c4-9c080b2d9a95 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:19.339151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46321248-aa6e-46d0-91c4-9c080b2d9a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:19.339558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46321248-aa6e-46d0-91c4-9c080b2d9a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:19.379472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46321248-aa6e-46d0-91c4-9c080b2d9a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:19.386039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46321248-aa6e-46d0-91c4-9c080b2d9a95 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:19.427354 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1743/3482] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:09:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:09:20.324799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb3510-f640-4704-a059-16c49948320e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:20.324799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb3510-f640-4704-a059-16c49948320e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:20.324799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb3510-f640-4704-a059-16c49948320e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:20.362573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-57eb3510-f640-4704-a059-16c49948320e None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:20.366857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-57eb3510-f640-4704-a059-16c49948320e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:20.607331 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1740/3483] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:09:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:20.624529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46321248-aa6e-46d0-91c4-9c080b2d9a95 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:20.627747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-46321248-aa6e-46d0-91c4-9c080b2d9a95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:20.866037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46321248-aa6e-46d0-91c4-9c080b2d9a95 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:20.879396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17da9d-382f-452a-b712-72f6aadecb2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:20.880198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17da9d-382f-452a-b712-72f6aadecb2b service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:20.880582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17da9d-382f-452a-b712-72f6aadecb2b service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:20.880957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17da9d-382f-452a-b712-72f6aadecb2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:20.901928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17da9d-382f-452a-b712-72f6aadecb2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:20.906862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17da9d-382f-452a-b712-72f6aadecb2b service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:20.929329 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1744/3484] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:09:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:09:21.224576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb3510-f640-4704-a059-16c49948320e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:21.227258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-57eb3510-f640-4704-a059-16c49948320e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:21.281349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb3510-f640-4704-a059-16c49948320e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:21.302333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bda25-becd-4874-b775-25ac1297454c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:21.304965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bda25-becd-4874-b775-25ac1297454c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:21.306629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bda25-becd-4874-b775-25ac1297454c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:21.308024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bda25-becd-4874-b775-25ac1297454c admin admin] PATH_INFO: `/v3/users/538cf63f2e4c46a6969b3e7ed54c475d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:21.315251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bda25-becd-4874-b775-25ac1297454c admin admin] RBAC: Authorizing `identity:delete_user(user_id=538cf63f2e4c46a6969b3e7ed54c475d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:21.318164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bda25-becd-4874-b775-25ac1297454c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:21.442351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-690bda25-becd-4874-b775-25ac1297454c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '538cf63f2e4c46a6969b3e7ed54c475d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:21.445034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-690bda25-becd-4874-b775-25ac1297454c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '538cf63f2e4c46a6969b3e7ed54c475d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:21.486204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-690bda25-becd-4874-b775-25ac1297454c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '538cf63f2e4c46a6969b3e7ed54c475d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:21.488945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-690bda25-becd-4874-b775-25ac1297454c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '538cf63f2e4c46a6969b3e7ed54c475d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:21.513883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-690bda25-becd-4874-b775-25ac1297454c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '538cf63f2e4c46a6969b3e7ed54c475d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:21.554328 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1741/3485] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:09:21 2022] DELETE /identity/v3/users/538cf63f2e4c46a6969b3e7ed54c475d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:21.557953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75545a1-6c60-4121-bb8c-8eaec57ccbcf None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:21.558534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75545a1-6c60-4121-bb8c-8eaec57ccbcf None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:21.559052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75545a1-6c60-4121-bb8c-8eaec57ccbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:21.618485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a75545a1-6c60-4121-bb8c-8eaec57ccbcf None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:21.619779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a75545a1-6c60-4121-bb8c-8eaec57ccbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:21.717234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:21.837960 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1745/3486] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:21.884260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bda25-becd-4874-b775-25ac1297454c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:21.885952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-690bda25-becd-4874-b775-25ac1297454c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:22.068486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bda25-becd-4874-b775-25ac1297454c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:22.072982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc6a4c-75ca-46a2-aa0b-557bc4b870d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:22.074022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc6a4c-75ca-46a2-aa0b-557bc4b870d3 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:22.074449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc6a4c-75ca-46a2-aa0b-557bc4b870d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:22.074818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc6a4c-75ca-46a2-aa0b-557bc4b870d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:22.089239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:22.093180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc6a4c-75ca-46a2-aa0b-557bc4b870d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:22.094881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc6a4c-75ca-46a2-aa0b-557bc4b870d3 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:22.117135 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1742/3487] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:09:22.556089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75545a1-6c60-4121-bb8c-8eaec57ccbcf None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:22.558173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a75545a1-6c60-4121-bb8c-8eaec57ccbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:22.688705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75545a1-6c60-4121-bb8c-8eaec57ccbcf None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:22.698270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7d905-4d7a-4c36-ae56-1290784504ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:22.701526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7d905-4d7a-4c36-ae56-1290784504ad service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:22.702237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7d905-4d7a-4c36-ae56-1290784504ad service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:22.702652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7d905-4d7a-4c36-ae56-1290784504ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:22.708199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-82d7d905-4d7a-4c36-ae56-1290784504ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:22.812185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7d905-4d7a-4c36-ae56-1290784504ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:22.815076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7d905-4d7a-4c36-ae56-1290784504ad service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:22.871064 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1746/3488] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:09:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:09:24.242482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc6a4c-75ca-46a2-aa0b-557bc4b870d3 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:24.244742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a7dc6a4c-75ca-46a2-aa0b-557bc4b870d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:24.281208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc6a4c-75ca-46a2-aa0b-557bc4b870d3 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:24.293611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5022e64-9126-496b-b7b5-1a2eb0e0f5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:24.296073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5022e64-9126-496b-b7b5-1a2eb0e0f5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:24.296532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5022e64-9126-496b-b7b5-1a2eb0e0f5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:24.299561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5022e64-9126-496b-b7b5-1a2eb0e0f5e3 admin admin] PATH_INFO: `/v3/projects/f1483d62924a45fb8861eba403c6dd19` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:24.301526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5022e64-9126-496b-b7b5-1a2eb0e0f5e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1483d62924a45fb8861eba403c6dd19)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:24.309294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5022e64-9126-496b-b7b5-1a2eb0e0f5e3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:24.465639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b5022e64-9126-496b-b7b5-1a2eb0e0f5e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1483d62924a45fb8861eba403c6dd19', 'request_id': 'req-b5022e64-9126-496b-b7b5-1a2eb0e0f5e3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:24.489731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b5022e64-9126-496b-b7b5-1a2eb0e0f5e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1483d62924a45fb8861eba403c6dd19', 'request_id': 'req-b5022e64-9126-496b-b7b5-1a2eb0e0f5e3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:24.498400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b5022e64-9126-496b-b7b5-1a2eb0e0f5e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1483d62924a45fb8861eba403c6dd19', 'request_id': 'req-b5022e64-9126-496b-b7b5-1a2eb0e0f5e3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:24.535399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b5022e64-9126-496b-b7b5-1a2eb0e0f5e3 admin admin] The token cache is being invalidate because project f1483d62924a45fb8861eba403c6dd19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:09:24.535882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b5022e64-9126-496b-b7b5-1a2eb0e0f5e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:24.539881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b5022e64-9126-496b-b7b5-1a2eb0e0f5e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:24.545175 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1743/3489] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:09:24 2022] DELETE /identity/v3/projects/f1483d62924a45fb8861eba403c6dd19 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:24.554493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec663d4-6bc4-4782-9ade-c352e5b8b63a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:24.555103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec663d4-6bc4-4782-9ade-c352e5b8b63a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:24.555516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec663d4-6bc4-4782-9ade-c352e5b8b63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:24.621727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-6ec663d4-6bc4-4782-9ade-c352e5b8b63a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:24.628954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6ec663d4-6bc4-4782-9ade-c352e5b8b63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:24.985885 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1747/3490] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:24.994641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12128d95-7921-4201-952f-1885c9516adb None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:24.995153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12128d95-7921-4201-952f-1885c9516adb None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:24.995785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12128d95-7921-4201-952f-1885c9516adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:25.075702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-12128d95-7921-4201-952f-1885c9516adb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:25.077168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-12128d95-7921-4201-952f-1885c9516adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:25.098935 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1744/3491] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:25.100252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec663d4-6bc4-4782-9ade-c352e5b8b63a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:25.115611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec663d4-6bc4-4782-9ade-c352e5b8b63a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:25.130985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f32332-c1d6-463c-ad44-2ca0ca6361cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:25.132852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f32332-c1d6-463c-ad44-2ca0ca6361cb admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:25.133289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f32332-c1d6-463c-ad44-2ca0ca6361cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:25.133729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f32332-c1d6-463c-ad44-2ca0ca6361cb admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:25.136832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f32332-c1d6-463c-ad44-2ca0ca6361cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:09:25.136832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f32332-c1d6-463c-ad44-2ca0ca6361cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:25.149870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f32332-c1d6-463c-ad44-2ca0ca6361cb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:25.151826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:25.174675 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1748/3492] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:09:25.177065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12128d95-7921-4201-952f-1885c9516adb None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:25.195881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12128d95-7921-4201-952f-1885c9516adb None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:25.207351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203a3fb-462e-4b64-952d-c5d0e46c14d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:25.208487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203a3fb-462e-4b64-952d-c5d0e46c14d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:25.208618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203a3fb-462e-4b64-952d-c5d0e46c14d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:25.212771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203a3fb-462e-4b64-952d-c5d0e46c14d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:25.213904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203a3fb-462e-4b64-952d-c5d0e46c14d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:25.222049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203a3fb-462e-4b64-952d-c5d0e46c14d9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:25.318418 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1745/3493] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:09:25 2022] POST /identity/v3/projects => generated 395 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:09:25.320414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f32332-c1d6-463c-ad44-2ca0ca6361cb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:25.335160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f32332-c1d6-463c-ad44-2ca0ca6361cb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:25.507782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c433def-492d-4060-90b5-242b856dfb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:25.508821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c433def-492d-4060-90b5-242b856dfb2d admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:25.510186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c433def-492d-4060-90b5-242b856dfb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:25.510694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c433def-492d-4060-90b5-242b856dfb2d admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:25.512872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c433def-492d-4060-90b5-242b856dfb2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:25.516911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c433def-492d-4060-90b5-242b856dfb2d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:25.552227 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1749/3494] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:09:25 2022] POST /identity/v3/users => generated 298 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:09:25.557637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203a3fb-462e-4b64-952d-c5d0e46c14d9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:25.592321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203a3fb-462e-4b64-952d-c5d0e46c14d9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:25.620002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403e9e0-bb05-4e2c-9e7e-0d9d0f8d4771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:25.621098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403e9e0-bb05-4e2c-9e7e-0d9d0f8d4771 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:25.622215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403e9e0-bb05-4e2c-9e7e-0d9d0f8d4771 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:25.623839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403e9e0-bb05-4e2c-9e7e-0d9d0f8d4771 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:25.627354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403e9e0-bb05-4e2c-9e7e-0d9d0f8d4771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:25.632452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403e9e0-bb05-4e2c-9e7e-0d9d0f8d4771 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:25.656012 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1746/3495] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:09:25.656390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c433def-492d-4060-90b5-242b856dfb2d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:25.677566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c433def-492d-4060-90b5-242b856dfb2d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:25.683508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df773e20-ae84-4806-a0f3-4af1efd71ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:25.685808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df773e20-ae84-4806-a0f3-4af1efd71ffc admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:25.686894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df773e20-ae84-4806-a0f3-4af1efd71ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:25.687300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df773e20-ae84-4806-a0f3-4af1efd71ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:25.688731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df773e20-ae84-4806-a0f3-4af1efd71ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:25.690685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df773e20-ae84-4806-a0f3-4af1efd71ffc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:25.715486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403e9e0-bb05-4e2c-9e7e-0d9d0f8d4771 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:25.717027 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1750/3496] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:09:25.728239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403e9e0-bb05-4e2c-9e7e-0d9d0f8d4771 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:25.743014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021e281-867d-4752-b9d8-175f2be39296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:25.745990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021e281-867d-4752-b9d8-175f2be39296 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:25.746529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021e281-867d-4752-b9d8-175f2be39296 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:25.746947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021e281-867d-4752-b9d8-175f2be39296 admin admin] PATH_INFO: `/v3/projects/33e26e21a05e4ecd87fd72361a5cbfbe/users/c56c6e988ce2451b9426e412284605fb/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:25.778726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021e281-867d-4752-b9d8-175f2be39296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e26e21a05e4ecd87fd72361a5cbfbe, user_id=c56c6e988ce2451b9426e412284605fb, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:25.782341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021e281-867d-4752-b9d8-175f2be39296 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:25.815752 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1747/3497] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:09:25 2022] PUT /identity/v3/projects/33e26e21a05e4ecd87fd72361a5cbfbe/users/c56c6e988ce2451b9426e412284605fb/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:25.818087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d70d5-6cca-40a9-bd48-b8999a322572 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:25.818715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d70d5-6cca-40a9-bd48-b8999a322572 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:25.820020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d70d5-6cca-40a9-bd48-b8999a322572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:25.880728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b80d70d5-6cca-40a9-bd48-b8999a322572 None None] MFA Rules not processed for user `c56c6e988ce2451b9426e412284605fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:25.883522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b80d70d5-6cca-40a9-bd48-b8999a322572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:26.032027 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1751/3498] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:26.035662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021e281-867d-4752-b9d8-175f2be39296 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:26.038123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0021e281-867d-4752-b9d8-175f2be39296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:26.195944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021e281-867d-4752-b9d8-175f2be39296 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:26.203263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145be22b-6df8-45c4-a5f7-627593a15218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:26.205406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145be22b-6df8-45c4-a5f7-627593a15218 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:26.205918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145be22b-6df8-45c4-a5f7-627593a15218 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:26.206404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145be22b-6df8-45c4-a5f7-627593a15218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:26.218763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145be22b-6df8-45c4-a5f7-627593a15218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:26.221613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145be22b-6df8-45c4-a5f7-627593a15218 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:26.229557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:26.252896 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1748/3499] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:09:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:09:26.480530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25611fd-ba86-4873-95e5-5490a273be94 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:26.480843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25611fd-ba86-4873-95e5-5490a273be94 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:26.481112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25611fd-ba86-4873-95e5-5490a273be94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:26.508700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e25611fd-ba86-4873-95e5-5490a273be94 None None] MFA Rules not processed for user `c56c6e988ce2451b9426e412284605fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:26.510632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e25611fd-ba86-4873-95e5-5490a273be94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:26.537749 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1752/3500] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:26.574776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c9709-e8aa-442b-a663-1d3abd498e4f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:26.575365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c9709-e8aa-442b-a663-1d3abd498e4f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:26.576969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c9709-e8aa-442b-a663-1d3abd498e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:26.613379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0d2c9709-e8aa-442b-a663-1d3abd498e4f None None] MFA Rules not processed for user `6399b6f3e2574df8af12786c8755c59a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:26.615029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0d2c9709-e8aa-442b-a663-1d3abd498e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:26.737407 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1749/3501] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:27.326729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4b01b-9d9c-45e6-a1ff-26fb2304eba8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:27.327227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4b01b-9d9c-45e6-a1ff-26fb2304eba8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:27.327413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4b01b-9d9c-45e6-a1ff-26fb2304eba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:27.375133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-77b4b01b-9d9c-45e6-a1ff-26fb2304eba8 None None] MFA Rules not processed for user `f00d46cd63d94b49abfa65d6106c7d88`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:27.377091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-77b4b01b-9d9c-45e6-a1ff-26fb2304eba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:27.442621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:27.476708 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1753/3502] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:27.897106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c9709-e8aa-442b-a663-1d3abd498e4f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:28.081347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c9709-e8aa-442b-a663-1d3abd498e4f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:28.088324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b32ff-ef77-46f1-8cd1-fc6b9e8f74be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:28.089053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b32ff-ef77-46f1-8cd1-fc6b9e8f74be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:28.089339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b32ff-ef77-46f1-8cd1-fc6b9e8f74be admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:28.089616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b32ff-ef77-46f1-8cd1-fc6b9e8f74be admin admin] PATH_INFO: `/v3/users/c56c6e988ce2451b9426e412284605fb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:28.090821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b32ff-ef77-46f1-8cd1-fc6b9e8f74be admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56c6e988ce2451b9426e412284605fb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:28.092794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b32ff-ef77-46f1-8cd1-fc6b9e8f74be admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:28.171168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-144b32ff-ef77-46f1-8cd1-fc6b9e8f74be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56c6e988ce2451b9426e412284605fb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:28.177754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-144b32ff-ef77-46f1-8cd1-fc6b9e8f74be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56c6e988ce2451b9426e412284605fb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:28.194392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-144b32ff-ef77-46f1-8cd1-fc6b9e8f74be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56c6e988ce2451b9426e412284605fb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:28.195449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-144b32ff-ef77-46f1-8cd1-fc6b9e8f74be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56c6e988ce2451b9426e412284605fb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:28.207644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-144b32ff-ef77-46f1-8cd1-fc6b9e8f74be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56c6e988ce2451b9426e412284605fb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:28.235915 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1750/3503] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:09:27 2022] DELETE /identity/v3/users/c56c6e988ce2451b9426e412284605fb => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:28.238786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded91b2-e2d4-4c08-8fc8-cf76a83f6154 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:28.239135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded91b2-e2d4-4c08-8fc8-cf76a83f6154 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:28.239457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded91b2-e2d4-4c08-8fc8-cf76a83f6154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:28.265129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8ded91b2-e2d4-4c08-8fc8-cf76a83f6154 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:28.266890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8ded91b2-e2d4-4c08-8fc8-cf76a83f6154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:28.389587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b32ff-ef77-46f1-8cd1-fc6b9e8f74be admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:28.392266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-144b32ff-ef77-46f1-8cd1-fc6b9e8f74be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:28.395734 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1754/3504] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:09:28.426641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded91b2-e2d4-4c08-8fc8-cf76a83f6154 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:28.434638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8ded91b2-e2d4-4c08-8fc8-cf76a83f6154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:28.469365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:28.599950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b32ff-ef77-46f1-8cd1-fc6b9e8f74be admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:28.632597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c26d9-01cd-4137-bc06-7e6a37a64a45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:28.633430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c26d9-01cd-4137-bc06-7e6a37a64a45 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:28.633727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c26d9-01cd-4137-bc06-7e6a37a64a45 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:28.633994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c26d9-01cd-4137-bc06-7e6a37a64a45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:28.636956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fd7c26d9-01cd-4137-bc06-7e6a37a64a45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:28.643785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded91b2-e2d4-4c08-8fc8-cf76a83f6154 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:28.654386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae5144-a6bf-4f36-9c02-0a7feccbd49e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:28.654778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae5144-a6bf-4f36-9c02-0a7feccbd49e service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:28.655629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae5144-a6bf-4f36-9c02-0a7feccbd49e service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:28.655629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae5144-a6bf-4f36-9c02-0a7feccbd49e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:28.680101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae5144-a6bf-4f36-9c02-0a7feccbd49e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:28.681598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae5144-a6bf-4f36-9c02-0a7feccbd49e service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:28.715660 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1755/3505] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:09:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:09:28.720181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39604bbb-9f0d-4846-b717-dc113b0a662e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:28.720304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39604bbb-9f0d-4846-b717-dc113b0a662e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:28.720574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39604bbb-9f0d-4846-b717-dc113b0a662e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:28.753092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-39604bbb-9f0d-4846-b717-dc113b0a662e None None] MFA Rules not processed for user `879e94018c474c838b1b989f3d4013a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:28.754373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-39604bbb-9f0d-4846-b717-dc113b0a662e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:28.813195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c26d9-01cd-4137-bc06-7e6a37a64a45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:28.817113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c26d9-01cd-4137-bc06-7e6a37a64a45 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:28.853233 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1751/3506] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:09:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:09:28.874144 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1756/3507] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:29.578213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c26d9-01cd-4137-bc06-7e6a37a64a45 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:29.579887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fd7c26d9-01cd-4137-bc06-7e6a37a64a45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:29.597918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c26d9-01cd-4137-bc06-7e6a37a64a45 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:29.604792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697b3d2-0258-436f-8779-62e48eb6914a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:29.605748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697b3d2-0258-436f-8779-62e48eb6914a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:29.606237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697b3d2-0258-436f-8779-62e48eb6914a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:29.606719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697b3d2-0258-436f-8779-62e48eb6914a admin admin] PATH_INFO: `/v3/projects/33e26e21a05e4ecd87fd72361a5cbfbe` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:29.608256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697b3d2-0258-436f-8779-62e48eb6914a admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e26e21a05e4ecd87fd72361a5cbfbe)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:29.610411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697b3d2-0258-436f-8779-62e48eb6914a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:29.760614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1697b3d2-0258-436f-8779-62e48eb6914a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e26e21a05e4ecd87fd72361a5cbfbe', 'request_id': 'req-1697b3d2-0258-436f-8779-62e48eb6914a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:29.792337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1697b3d2-0258-436f-8779-62e48eb6914a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e26e21a05e4ecd87fd72361a5cbfbe', 'request_id': 'req-1697b3d2-0258-436f-8779-62e48eb6914a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:29.799878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1697b3d2-0258-436f-8779-62e48eb6914a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e26e21a05e4ecd87fd72361a5cbfbe', 'request_id': 'req-1697b3d2-0258-436f-8779-62e48eb6914a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:29.826426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1697b3d2-0258-436f-8779-62e48eb6914a admin admin] The token cache is being invalidate because project 33e26e21a05e4ecd87fd72361a5cbfbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:09:29.827713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1697b3d2-0258-436f-8779-62e48eb6914a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:29.829344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1697b3d2-0258-436f-8779-62e48eb6914a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:09:29.832689 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1752/3508] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:09:29 2022] DELETE /identity/v3/projects/33e26e21a05e4ecd87fd72361a5cbfbe => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:29.840877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a3081-8b82-4f64-be3f-44ba32b3cc3c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:29.841445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a3081-8b82-4f64-be3f-44ba32b3cc3c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:29.841721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a3081-8b82-4f64-be3f-44ba32b3cc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:29.879872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9d0a3081-8b82-4f64-be3f-44ba32b3cc3c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:29.882346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9d0a3081-8b82-4f64-be3f-44ba32b3cc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:29.977324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:30.042408 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1757/3509] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:09:30.052325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8085d4d-3c26-46c0-a17f-6e3cdd948640 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:30.052657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8085d4d-3c26-46c0-a17f-6e3cdd948640 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:30.053292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8085d4d-3c26-46c0-a17f-6e3cdd948640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:30.094478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c8085d4d-3c26-46c0-a17f-6e3cdd948640 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:30.096468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c8085d4d-3c26-46c0-a17f-6e3cdd948640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:30.117124 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1753/3510] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:30.117589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a3081-8b82-4f64-be3f-44ba32b3cc3c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:30.134062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a3081-8b82-4f64-be3f-44ba32b3cc3c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:30.145621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45617e32-235d-4fe7-be25-8a39f547b6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:30.146528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45617e32-235d-4fe7-be25-8a39f547b6cb admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:30.146737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45617e32-235d-4fe7-be25-8a39f547b6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:30.147183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45617e32-235d-4fe7-be25-8a39f547b6cb admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:30.148546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45617e32-235d-4fe7-be25-8a39f547b6cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:09:30.148852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45617e32-235d-4fe7-be25-8a39f547b6cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:30.150447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45617e32-235d-4fe7-be25-8a39f547b6cb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:30.177272 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1758/3511] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:09:30.182272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8085d4d-3c26-46c0-a17f-6e3cdd948640 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:30.201380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8085d4d-3c26-46c0-a17f-6e3cdd948640 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:30.208287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b9a6c-ed55-4a2e-bd03-026964b52c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:30.209183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b9a6c-ed55-4a2e-bd03-026964b52c4c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:30.209602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b9a6c-ed55-4a2e-bd03-026964b52c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:30.210777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b9a6c-ed55-4a2e-bd03-026964b52c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:30.212344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b9a6c-ed55-4a2e-bd03-026964b52c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:30.214901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b9a6c-ed55-4a2e-bd03-026964b52c4c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:30.281516 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1754/3512] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:09:30 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:09:30.286443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45617e32-235d-4fe7-be25-8a39f547b6cb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:30.302217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45617e32-235d-4fe7-be25-8a39f547b6cb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:30.438378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d11eb2-a7bc-4b6c-b11d-823a8016f8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:30.439767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d11eb2-a7bc-4b6c-b11d-823a8016f8fa admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:30.440173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d11eb2-a7bc-4b6c-b11d-823a8016f8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:30.440326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d11eb2-a7bc-4b6c-b11d-823a8016f8fa admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:30.441025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d11eb2-a7bc-4b6c-b11d-823a8016f8fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:30.443093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d11eb2-a7bc-4b6c-b11d-823a8016f8fa admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:30.491600 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1759/3513] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:09:30 2022] POST /identity/v3/users => generated 296 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:09:30.497786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b9a6c-ed55-4a2e-bd03-026964b52c4c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:30.527348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b9a6c-ed55-4a2e-bd03-026964b52c4c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:30.557548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43222fac-cc71-45b3-be6a-1d3f709cc0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:30.561810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43222fac-cc71-45b3-be6a-1d3f709cc0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:30.563572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43222fac-cc71-45b3-be6a-1d3f709cc0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:30.575161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43222fac-cc71-45b3-be6a-1d3f709cc0f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:30.576792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43222fac-cc71-45b3-be6a-1d3f709cc0f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:30.578689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43222fac-cc71-45b3-be6a-1d3f709cc0f9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:30.618739 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1755/3514] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:09:30.623419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d11eb2-a7bc-4b6c-b11d-823a8016f8fa admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:30.652123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d11eb2-a7bc-4b6c-b11d-823a8016f8fa admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:30.667788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b197dde-661f-4b1a-a419-f3c2fc3c6184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:30.668605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b197dde-661f-4b1a-a419-f3c2fc3c6184 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:30.669426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b197dde-661f-4b1a-a419-f3c2fc3c6184 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:30.669426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b197dde-661f-4b1a-a419-f3c2fc3c6184 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:30.670185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b197dde-661f-4b1a-a419-f3c2fc3c6184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:30.671980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b197dde-661f-4b1a-a419-f3c2fc3c6184 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:30.706047 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1760/3515] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:09:30.709948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43222fac-cc71-45b3-be6a-1d3f709cc0f9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:30.722334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:30.752907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43222fac-cc71-45b3-be6a-1d3f709cc0f9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:30.766478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777c9b1-06b0-4c98-8498-4c5071f505f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:30.767532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777c9b1-06b0-4c98-8498-4c5071f505f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:30.767959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777c9b1-06b0-4c98-8498-4c5071f505f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:30.768625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777c9b1-06b0-4c98-8498-4c5071f505f3 admin admin] PATH_INFO: `/v3/projects/aef0a07428164b708be97eebe5547697/users/8b930b074300497fa17ae36dc074c586/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:30.794333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777c9b1-06b0-4c98-8498-4c5071f505f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef0a07428164b708be97eebe5547697, user_id=8b930b074300497fa17ae36dc074c586, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:30.798602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777c9b1-06b0-4c98-8498-4c5071f505f3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:30.826912 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1756/3516] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:09:30 2022] PUT /identity/v3/projects/aef0a07428164b708be97eebe5547697/users/8b930b074300497fa17ae36dc074c586/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:09:30.832071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b6414-807f-44a7-84fe-5bd98585f1bd None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:30.832418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b6414-807f-44a7-84fe-5bd98585f1bd None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:30.832712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b6414-807f-44a7-84fe-5bd98585f1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:30.876487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-971b6414-807f-44a7-84fe-5bd98585f1bd None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:30.881030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-971b6414-807f-44a7-84fe-5bd98585f1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:31.095278 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1761/3517] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:31.175180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777c9b1-06b0-4c98-8498-4c5071f505f3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:31.177795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1777c9b1-06b0-4c98-8498-4c5071f505f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:31.304465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777c9b1-06b0-4c98-8498-4c5071f505f3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:31.309382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00054578-b7f2-468a-b20f-779d5085f404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:31.310306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00054578-b7f2-468a-b20f-779d5085f404 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:31.310807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00054578-b7f2-468a-b20f-779d5085f404 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:31.311498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00054578-b7f2-468a-b20f-779d5085f404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:31.324971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00054578-b7f2-468a-b20f-779d5085f404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:31.326737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00054578-b7f2-468a-b20f-779d5085f404 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:31.348093 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1757/3518] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:09:35.467225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1e54b-b2ea-4c49-8d91-a6a2d9923a2f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:35.468132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1e54b-b2ea-4c49-8d91-a6a2d9923a2f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:35.468573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1e54b-b2ea-4c49-8d91-a6a2d9923a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:35.495435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-aac1e54b-b2ea-4c49-8d91-a6a2d9923a2f None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:35.496670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-aac1e54b-b2ea-4c49-8d91-a6a2d9923a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:35.537615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:35.593584 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1762/3519] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:09:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:35.594413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00054578-b7f2-468a-b20f-779d5085f404 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:35.596153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-00054578-b7f2-468a-b20f-779d5085f404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:35.729807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00054578-b7f2-468a-b20f-779d5085f404 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:35.738020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4a1d3-d57a-4853-af4f-d621e1ae8253 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:35.739123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4a1d3-d57a-4853-af4f-d621e1ae8253 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:35.739613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4a1d3-d57a-4853-af4f-d621e1ae8253 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:35.740041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4a1d3-d57a-4853-af4f-d621e1ae8253 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:35.755106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4a1d3-d57a-4853-af4f-d621e1ae8253 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:35.759660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4a1d3-d57a-4853-af4f-d621e1ae8253 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:35.776766 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1758/3520] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:09:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 30 21:09:36.796001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0c8a5-3cf4-49bb-8f45-d3d6e60934c1 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:36.796458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0c8a5-3cf4-49bb-8f45-d3d6e60934c1 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:36.796549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0c8a5-3cf4-49bb-8f45-d3d6e60934c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:36.827176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-36e0c8a5-3cf4-49bb-8f45-d3d6e60934c1 None None] MFA Rules not processed for user `f00d46cd63d94b49abfa65d6106c7d88`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:36.828470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-36e0c8a5-3cf4-49bb-8f45-d3d6e60934c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:36.955962 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1763/3521] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:38.987272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abae34f-c12a-463c-87b2-35cfa0615531 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:38.987760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abae34f-c12a-463c-87b2-35cfa0615531 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:38.987900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abae34f-c12a-463c-87b2-35cfa0615531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:39.056598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0abae34f-c12a-463c-87b2-35cfa0615531 None None] MFA Rules not processed for user `70a0d6cf4a484ad4900293ad97249a5d`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:39.057835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0abae34f-c12a-463c-87b2-35cfa0615531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:39.230115 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1759/3522] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:39.245510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56c5c-7dbf-4353-b82b-068889e9cf43 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:39.251831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56c5c-7dbf-4353-b82b-068889e9cf43 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:39.252419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56c5c-7dbf-4353-b82b-068889e9cf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:39.305066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-17b56c5c-7dbf-4353-b82b-068889e9cf43 None None] MFA Rules not processed for user `70a0d6cf4a484ad4900293ad97249a5d`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:39.309339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-17b56c5c-7dbf-4353-b82b-068889e9cf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:39.331821 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1764/3523] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:41.314378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abae34f-c12a-463c-87b2-35cfa0615531 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:41.318562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0abae34f-c12a-463c-87b2-35cfa0615531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:41.332770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:41.544682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abae34f-c12a-463c-87b2-35cfa0615531 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:41.572884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c70b07-f10f-41ef-99f7-730fac0a4c46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:41.573540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c70b07-f10f-41ef-99f7-730fac0a4c46 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:41.573820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c70b07-f10f-41ef-99f7-730fac0a4c46 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:41.579280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c70b07-f10f-41ef-99f7-730fac0a4c46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:41.609047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c70b07-f10f-41ef-99f7-730fac0a4c46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:41.618973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c70b07-f10f-41ef-99f7-730fac0a4c46 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:41.668661 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1760/3524] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:09:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:09:49.285227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=35 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:51.472183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0e498-59cc-41cc-9218-669ffbcf939e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:51.472807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0e498-59cc-41cc-9218-669ffbcf939e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:51.472807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0e498-59cc-41cc-9218-669ffbcf939e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:51.530573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-20d0e498-59cc-41cc-9218-669ffbcf939e None None] MFA Rules not processed for user `8b930b074300497fa17ae36dc074c586`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:51.534288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-20d0e498-59cc-41cc-9218-669ffbcf939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:51.642521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=33 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:51.689265 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1765/3525] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:51.691984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0494a-f9ec-44fe-8844-588d2bdf8a3e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:51.692385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0494a-f9ec-44fe-8844-588d2bdf8a3e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:51.692673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0494a-f9ec-44fe-8844-588d2bdf8a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:51.731110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e4f0494a-f9ec-44fe-8844-588d2bdf8a3e None None] MFA Rules not processed for user `8b930b074300497fa17ae36dc074c586`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:51.732686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e4f0494a-f9ec-44fe-8844-588d2bdf8a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:51.753779 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1761/3526] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:52.242125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0e498-59cc-41cc-9218-669ffbcf939e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:09:52.273067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0e498-59cc-41cc-9218-669ffbcf939e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:09:52.279921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be9e6b-9df8-4454-b3fa-1188a2f24330 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:09:52.281408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be9e6b-9df8-4454-b3fa-1188a2f24330 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:52.281408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be9e6b-9df8-4454-b3fa-1188a2f24330 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:52.281408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be9e6b-9df8-4454-b3fa-1188a2f24330 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:52.290786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be9e6b-9df8-4454-b3fa-1188a2f24330 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:09:52.292462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be9e6b-9df8-4454-b3fa-1188a2f24330 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:09:52.327953 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1766/3527] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:09:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:09:54.436542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b36bec-984e-486e-b1fc-2cfd0fb8444e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:54.437549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b36bec-984e-486e-b1fc-2cfd0fb8444e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:54.437983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b36bec-984e-486e-b1fc-2cfd0fb8444e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:54.470226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-98b36bec-984e-486e-b1fc-2cfd0fb8444e None None] MFA Rules not processed for user `8b930b074300497fa17ae36dc074c586`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:54.472767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-98b36bec-984e-486e-b1fc-2cfd0fb8444e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:54.497393 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1762/3528] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:09:58.467929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded907e-170a-4046-b387-4804b52c63fa None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:58.468431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded907e-170a-4046-b387-4804b52c63fa None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:58.468613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded907e-170a-4046-b387-4804b52c63fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:58.504056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9ded907e-170a-4046-b387-4804b52c63fa None None] MFA Rules not processed for user `2517a20b0358424480784b0003512d50`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:58.506459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9ded907e-170a-4046-b387-4804b52c63fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:58.626671 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1767/3529] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:09:59.208130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2450c-f0b8-4e0d-aa20-39b6f35c720c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:09:59.212608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2450c-f0b8-4e0d-aa20-39b6f35c720c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:09:59.213157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2450c-f0b8-4e0d-aa20-39b6f35c720c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:09:59.259743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7dc2450c-f0b8-4e0d-aa20-39b6f35c720c None None] MFA Rules not processed for user `25cff561a2d14c45b71920346aee5d57`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:09:59.261274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7dc2450c-f0b8-4e0d-aa20-39b6f35c720c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:09:59.376828 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1763/3530] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:09:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:02.279172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded907e-170a-4046-b387-4804b52c63fa None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:02.280704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9ded907e-170a-4046-b387-4804b52c63fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:02.320933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded907e-170a-4046-b387-4804b52c63fa None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:02.356522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6331602-2236-4ca7-9e73-72ed5a3d4dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:02.357499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6331602-2236-4ca7-9e73-72ed5a3d4dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:02.358345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6331602-2236-4ca7-9e73-72ed5a3d4dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:02.358876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6331602-2236-4ca7-9e73-72ed5a3d4dbc admin admin] PATH_INFO: `/v3/users/eeb3ffbaef3347de8d9ad6b2bdfa19bc` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:02.362274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6331602-2236-4ca7-9e73-72ed5a3d4dbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb3ffbaef3347de8d9ad6b2bdfa19bc)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:02.364668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6331602-2236-4ca7-9e73-72ed5a3d4dbc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:02.477709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a6331602-2236-4ca7-9e73-72ed5a3d4dbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:02.518854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a6331602-2236-4ca7-9e73-72ed5a3d4dbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:02.533581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a6331602-2236-4ca7-9e73-72ed5a3d4dbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:02.549985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a6331602-2236-4ca7-9e73-72ed5a3d4dbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:02.551041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a6331602-2236-4ca7-9e73-72ed5a3d4dbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:02.557266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:02.600480 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1768/3531] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:10:02 2022] DELETE /identity/v3/users/eeb3ffbaef3347de8d9ad6b2bdfa19bc => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:10:03.122834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2450c-f0b8-4e0d-aa20-39b6f35c720c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:03.160004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2450c-f0b8-4e0d-aa20-39b6f35c720c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:03.279577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2efc5b-74fe-4600-b8dc-965e7d01c136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:03.280246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2efc5b-74fe-4600-b8dc-965e7d01c136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:03.280571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2efc5b-74fe-4600-b8dc-965e7d01c136 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:03.280854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2efc5b-74fe-4600-b8dc-965e7d01c136 admin admin] PATH_INFO: `/v3/projects/6193b7fd6d224f328a2b4c561edb89ea` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:03.282213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2efc5b-74fe-4600-b8dc-965e7d01c136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6193b7fd6d224f328a2b4c561edb89ea)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:03.285616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2efc5b-74fe-4600-b8dc-965e7d01c136 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:03.353023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9c2efc5b-74fe-4600-b8dc-965e7d01c136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6193b7fd6d224f328a2b4c561edb89ea', 'request_id': 'req-9c2efc5b-74fe-4600-b8dc-965e7d01c136'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:03.364342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9c2efc5b-74fe-4600-b8dc-965e7d01c136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6193b7fd6d224f328a2b4c561edb89ea', 'request_id': 'req-9c2efc5b-74fe-4600-b8dc-965e7d01c136'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:03.379522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9c2efc5b-74fe-4600-b8dc-965e7d01c136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6193b7fd6d224f328a2b4c561edb89ea', 'request_id': 'req-9c2efc5b-74fe-4600-b8dc-965e7d01c136'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:03.415653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9c2efc5b-74fe-4600-b8dc-965e7d01c136 admin admin] The token cache is being invalidate because project 6193b7fd6d224f328a2b4c561edb89ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:10:03.416267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9c2efc5b-74fe-4600-b8dc-965e7d01c136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:03.417855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9c2efc5b-74fe-4600-b8dc-965e7d01c136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:03.425602 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1764/3532] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:10:03 2022] DELETE /identity/v3/projects/6193b7fd6d224f328a2b4c561edb89ea => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:10:03.427892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9f223-93fe-491a-bd74-c2d9a054c2dd None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:03.427892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9f223-93fe-491a-bd74-c2d9a054c2dd None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:03.428509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9f223-93fe-491a-bd74-c2d9a054c2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:03.453057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a0e9f223-93fe-491a-bd74-c2d9a054c2dd None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:03.454873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a0e9f223-93fe-491a-bd74-c2d9a054c2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:03.550621 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1769/3533] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:03.558596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a4d51-f4d9-4dd5-bd3c-84cedd63d468 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:03.558899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a4d51-f4d9-4dd5-bd3c-84cedd63d468 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:03.559185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a4d51-f4d9-4dd5-bd3c-84cedd63d468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:03.585787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-698a4d51-f4d9-4dd5-bd3c-84cedd63d468 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:03.587034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-698a4d51-f4d9-4dd5-bd3c-84cedd63d468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:03.596609 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1765/3534] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:03.602344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9f223-93fe-491a-bd74-c2d9a054c2dd None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:03.614330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9f223-93fe-491a-bd74-c2d9a054c2dd None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:03.622104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdc9ea-13ee-4a6b-9acb-f69fadab1e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:03.623218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdc9ea-13ee-4a6b-9acb-f69fadab1e13 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:03.623934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdc9ea-13ee-4a6b-9acb-f69fadab1e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:03.624419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdc9ea-13ee-4a6b-9acb-f69fadab1e13 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:03.626305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdc9ea-13ee-4a6b-9acb-f69fadab1e13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:10:03.626858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdc9ea-13ee-4a6b-9acb-f69fadab1e13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:03.628898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdc9ea-13ee-4a6b-9acb-f69fadab1e13 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:03.649785 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1770/3535] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:10:03.654883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a4d51-f4d9-4dd5-bd3c-84cedd63d468 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:03.665397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a4d51-f4d9-4dd5-bd3c-84cedd63d468 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:03.670856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff6de3-4955-4e72-b45a-0936e1a90a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:03.671725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff6de3-4955-4e72-b45a-0936e1a90a23 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:03.672179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff6de3-4955-4e72-b45a-0936e1a90a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:03.672604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff6de3-4955-4e72-b45a-0936e1a90a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:03.673488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff6de3-4955-4e72-b45a-0936e1a90a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:03.675678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff6de3-4955-4e72-b45a-0936e1a90a23 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:03.693465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:03.716693 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1766/3536] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:10:03 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:10:03.721517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdc9ea-13ee-4a6b-9acb-f69fadab1e13 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:03.735080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdc9ea-13ee-4a6b-9acb-f69fadab1e13 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:03.813877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b252f-ffcd-4f84-ab52-9874c7289678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:03.814804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b252f-ffcd-4f84-ab52-9874c7289678 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:03.815321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b252f-ffcd-4f84-ab52-9874c7289678 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:03.815514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b252f-ffcd-4f84-ab52-9874c7289678 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:03.817602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b252f-ffcd-4f84-ab52-9874c7289678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:03.820515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b252f-ffcd-4f84-ab52-9874c7289678 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:03.852672 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1771/3537] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:10:03 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:10:03.854905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff6de3-4955-4e72-b45a-0936e1a90a23 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:03.882141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff6de3-4955-4e72-b45a-0936e1a90a23 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:03.895920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684495f-9176-42ab-91ae-1a0898aa9235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:03.897312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684495f-9176-42ab-91ae-1a0898aa9235 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:03.897852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684495f-9176-42ab-91ae-1a0898aa9235 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:03.897965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684495f-9176-42ab-91ae-1a0898aa9235 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:03.903827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684495f-9176-42ab-91ae-1a0898aa9235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:03.905665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684495f-9176-42ab-91ae-1a0898aa9235 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:03.922694 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1767/3538] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:10:03.927071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b252f-ffcd-4f84-ab52-9874c7289678 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:03.973141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b252f-ffcd-4f84-ab52-9874c7289678 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:03.988077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f1d26-2bba-43c7-b34e-41d898a3eb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:03.989093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f1d26-2bba-43c7-b34e-41d898a3eb54 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:03.989401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f1d26-2bba-43c7-b34e-41d898a3eb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:03.989717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f1d26-2bba-43c7-b34e-41d898a3eb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:03.991415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f1d26-2bba-43c7-b34e-41d898a3eb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:03.993835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f1d26-2bba-43c7-b34e-41d898a3eb54 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:04.014249 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1772/3539] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:10:04.015910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684495f-9176-42ab-91ae-1a0898aa9235 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:04.028065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684495f-9176-42ab-91ae-1a0898aa9235 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:04.035608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349f54e-e38d-4d9b-a78c-0b268f703ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:04.036726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349f54e-e38d-4d9b-a78c-0b268f703ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:04.036880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349f54e-e38d-4d9b-a78c-0b268f703ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:04.037236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349f54e-e38d-4d9b-a78c-0b268f703ae4 admin admin] PATH_INFO: `/v3/projects/7174018ac671484ab204d0ad1559d683/users/eb637624ed0f48c9b4ad60e2cda88eb8/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:04.056859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349f54e-e38d-4d9b-a78c-0b268f703ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7174018ac671484ab204d0ad1559d683, user_id=eb637624ed0f48c9b4ad60e2cda88eb8, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:04.061150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349f54e-e38d-4d9b-a78c-0b268f703ae4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:04.090750 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1768/3540] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:10:04 2022] PUT /identity/v3/projects/7174018ac671484ab204d0ad1559d683/users/eb637624ed0f48c9b4ad60e2cda88eb8/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:10:04.092463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d57779-3f95-4567-befd-a7c3e3a80f7f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:04.092853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d57779-3f95-4567-befd-a7c3e3a80f7f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:04.093217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d57779-3f95-4567-befd-a7c3e3a80f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:04.119955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e6d57779-3f95-4567-befd-a7c3e3a80f7f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:04.121466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e6d57779-3f95-4567-befd-a7c3e3a80f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:04.241955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:04.278014 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1773/3541] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:04.284257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349f54e-e38d-4d9b-a78c-0b268f703ae4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:04.287363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6349f54e-e38d-4d9b-a78c-0b268f703ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:04.369398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349f54e-e38d-4d9b-a78c-0b268f703ae4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:04.373922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d155f-64b8-4619-ad3b-bc1214ad6490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:04.374629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d155f-64b8-4619-ad3b-bc1214ad6490 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:04.374989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d155f-64b8-4619-ad3b-bc1214ad6490 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:04.375619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d155f-64b8-4619-ad3b-bc1214ad6490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:04.386068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d155f-64b8-4619-ad3b-bc1214ad6490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:04.387598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d155f-64b8-4619-ad3b-bc1214ad6490 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:04.399084 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1769/3542] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:10:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:10:13.716803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844bead-3fd5-495d-94a6-6ab215f9f43c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:13.716803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844bead-3fd5-495d-94a6-6ab215f9f43c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:13.716803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844bead-3fd5-495d-94a6-6ab215f9f43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:13.750648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9844bead-3fd5-495d-94a6-6ab215f9f43c None None] MFA Rules not processed for user `eb637624ed0f48c9b4ad60e2cda88eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:13.751934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9844bead-3fd5-495d-94a6-6ab215f9f43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:13.864174 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1774/3543] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:13.900091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d155f-64b8-4619-ad3b-bc1214ad6490 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:13.901629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f47d155f-64b8-4619-ad3b-bc1214ad6490 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:13.983776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d155f-64b8-4619-ad3b-bc1214ad6490 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:13.989267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca76f37-3c66-47ba-a54a-cf3c15d4a57d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:13.990495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca76f37-3c66-47ba-a54a-cf3c15d4a57d service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:13.990834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca76f37-3c66-47ba-a54a-cf3c15d4a57d service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:13.991279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca76f37-3c66-47ba-a54a-cf3c15d4a57d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:14.031114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca76f37-3c66-47ba-a54a-cf3c15d4a57d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:14.035067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca76f37-3c66-47ba-a54a-cf3c15d4a57d service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:14.060957 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1770/3544] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:10:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:10:17.881170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951dc11-cd81-44f7-8f72-655e4d6edcb1 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:17.882048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951dc11-cd81-44f7-8f72-655e4d6edcb1 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:17.882511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951dc11-cd81-44f7-8f72-655e4d6edcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:17.908174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d951dc11-cd81-44f7-8f72-655e4d6edcb1 None None] MFA Rules not processed for user `eb637624ed0f48c9b4ad60e2cda88eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:17.909883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d951dc11-cd81-44f7-8f72-655e4d6edcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:17.924829 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1775/3545] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:24.051700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=2,keystone:SELECT=77 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:25.992088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca76f37-3c66-47ba-a54a-cf3c15d4a57d service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:25.993758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4ca76f37-3c66-47ba-a54a-cf3c15d4a57d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:26.024426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca76f37-3c66-47ba-a54a-cf3c15d4a57d service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:26.040673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc5137-bfb1-4465-a2b9-a7531cf6ec09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:26.041718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc5137-bfb1-4465-a2b9-a7531cf6ec09 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:26.042163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc5137-bfb1-4465-a2b9-a7531cf6ec09 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:26.042601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc5137-bfb1-4465-a2b9-a7531cf6ec09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:26.044898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7ccc5137-bfb1-4465-a2b9-a7531cf6ec09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:26.068896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc5137-bfb1-4465-a2b9-a7531cf6ec09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:26.070514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc5137-bfb1-4465-a2b9-a7531cf6ec09 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:26.093301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951dc11-cd81-44f7-8f72-655e4d6edcb1 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:26.095556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d951dc11-cd81-44f7-8f72-655e4d6edcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:26.105453 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1771/3546] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:10:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:10:26.112678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951dc11-cd81-44f7-8f72-655e4d6edcb1 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:26.118743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ea377-ea6b-4e2e-ad4c-9cf90331ad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:26.119639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ea377-ea6b-4e2e-ad4c-9cf90331ad27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:26.120069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ea377-ea6b-4e2e-ad4c-9cf90331ad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:26.120515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ea377-ea6b-4e2e-ad4c-9cf90331ad27 admin admin] PATH_INFO: `/v3/users/70a0d6cf4a484ad4900293ad97249a5d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:26.121908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ea377-ea6b-4e2e-ad4c-9cf90331ad27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70a0d6cf4a484ad4900293ad97249a5d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:26.125417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ea377-ea6b-4e2e-ad4c-9cf90331ad27 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:26.229581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7c5ea377-ea6b-4e2e-ad4c-9cf90331ad27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70a0d6cf4a484ad4900293ad97249a5d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:26.266144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7c5ea377-ea6b-4e2e-ad4c-9cf90331ad27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70a0d6cf4a484ad4900293ad97249a5d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:26.267124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7c5ea377-ea6b-4e2e-ad4c-9cf90331ad27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70a0d6cf4a484ad4900293ad97249a5d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:26.279221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc5137-bfb1-4465-a2b9-a7531cf6ec09 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:26.290988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc5137-bfb1-4465-a2b9-a7531cf6ec09 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:26.296454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7c5ea377-ea6b-4e2e-ad4c-9cf90331ad27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70a0d6cf4a484ad4900293ad97249a5d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:26.297484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7c5ea377-ea6b-4e2e-ad4c-9cf90331ad27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70a0d6cf4a484ad4900293ad97249a5d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:26.300623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2821ce-6a83-4fa8-ac5b-a38fb0af0684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:26.301259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2821ce-6a83-4fa8-ac5b-a38fb0af0684 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:26.301539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2821ce-6a83-4fa8-ac5b-a38fb0af0684 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:26.301812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2821ce-6a83-4fa8-ac5b-a38fb0af0684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:26.313877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3e2821ce-6a83-4fa8-ac5b-a38fb0af0684 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:26.343235 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1776/3547] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:10:26 2022] DELETE /identity/v3/users/70a0d6cf4a484ad4900293ad97249a5d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:10:26.346277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2821ce-6a83-4fa8-ac5b-a38fb0af0684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:26.358185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2821ce-6a83-4fa8-ac5b-a38fb0af0684 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:26.368970 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1772/3548] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:10:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:10:26.615145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1f9e5-1887-42e9-b0ff-f872f0a9aec9 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:26.615479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1f9e5-1887-42e9-b0ff-f872f0a9aec9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:26.615763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1f9e5-1887-42e9-b0ff-f872f0a9aec9 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:26.617130 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1777/3549] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:10:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:10:26.624653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c37fd5-39c9-4213-8a81-b35b8732c9ea None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:26.625101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c37fd5-39c9-4213-8a81-b35b8732c9ea None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:26.625791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c37fd5-39c9-4213-8a81-b35b8732c9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:26.663350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-07c37fd5-39c9-4213-8a81-b35b8732c9ea None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:26.666561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-07c37fd5-39c9-4213-8a81-b35b8732c9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:26.790320 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1773/3550] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:10:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:10:26.814836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1f9e5-1887-42e9-b0ff-f872f0a9aec9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:26.816792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3ed1f9e5-1887-42e9-b0ff-f872f0a9aec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:26.847792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1f9e5-1887-42e9-b0ff-f872f0a9aec9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:26.854101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7087c6-021d-413a-b699-699884fba9ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:26.854931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7087c6-021d-413a-b699-699884fba9ae service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:26.855350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7087c6-021d-413a-b699-699884fba9ae service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:26.855733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7087c6-021d-413a-b699-699884fba9ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:26.877791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7087c6-021d-413a-b699-699884fba9ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:26.879936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7087c6-021d-413a-b699-699884fba9ae service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:26.909744 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1778/3551] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:10:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:10:27.111900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c37fd5-39c9-4213-8a81-b35b8732c9ea None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:27.115012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-07c37fd5-39c9-4213-8a81-b35b8732c9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:27.352580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c37fd5-39c9-4213-8a81-b35b8732c9ea None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:27.375361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0160e0-0939-4f13-9eea-0ba2723dbaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:27.376671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0160e0-0939-4f13-9eea-0ba2723dbaba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:27.377241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0160e0-0939-4f13-9eea-0ba2723dbaba admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:27.378999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0160e0-0939-4f13-9eea-0ba2723dbaba admin admin] PATH_INFO: `/v3/projects/cc4eb46593544ff78b641193ec88a7c3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:27.383043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0160e0-0939-4f13-9eea-0ba2723dbaba admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc4eb46593544ff78b641193ec88a7c3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:27.387327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0160e0-0939-4f13-9eea-0ba2723dbaba admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:27.492701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6b0160e0-0939-4f13-9eea-0ba2723dbaba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc4eb46593544ff78b641193ec88a7c3', 'request_id': 'req-6b0160e0-0939-4f13-9eea-0ba2723dbaba'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:27.508256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6b0160e0-0939-4f13-9eea-0ba2723dbaba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc4eb46593544ff78b641193ec88a7c3', 'request_id': 'req-6b0160e0-0939-4f13-9eea-0ba2723dbaba'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:27.521602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6b0160e0-0939-4f13-9eea-0ba2723dbaba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc4eb46593544ff78b641193ec88a7c3', 'request_id': 'req-6b0160e0-0939-4f13-9eea-0ba2723dbaba'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:27.532945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:27.538062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6b0160e0-0939-4f13-9eea-0ba2723dbaba admin admin] The token cache is being invalidate because project cc4eb46593544ff78b641193ec88a7c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:10:27.538576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6b0160e0-0939-4f13-9eea-0ba2723dbaba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:27.540990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6b0160e0-0939-4f13-9eea-0ba2723dbaba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:27.545232 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1774/3552] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:10:27 2022] DELETE /identity/v3/projects/cc4eb46593544ff78b641193ec88a7c3 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:10:27.550846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55e3ad-82d8-4729-b8eb-358520053b7d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:27.551353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55e3ad-82d8-4729-b8eb-358520053b7d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:27.551493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55e3ad-82d8-4729-b8eb-358520053b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:27.585758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ad55e3ad-82d8-4729-b8eb-358520053b7d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:27.589053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ad55e3ad-82d8-4729-b8eb-358520053b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:27.623432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0160e0-0939-4f13-9eea-0ba2723dbaba admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:27.625323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6b0160e0-0939-4f13-9eea-0ba2723dbaba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:27.675009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:27.770204 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1779/3553] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:27.773063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088b922-facd-41a3-abc7-9bd39ac96772 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:27.773555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088b922-facd-41a3-abc7-9bd39ac96772 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:27.774202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088b922-facd-41a3-abc7-9bd39ac96772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:27.865231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0160e0-0939-4f13-9eea-0ba2723dbaba admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:27.868921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3088b922-facd-41a3-abc7-9bd39ac96772 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:27.871022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8cff9-077b-4458-9629-8daabdd43b80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:27.871891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8cff9-077b-4458-9629-8daabdd43b80 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:27.872183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8cff9-077b-4458-9629-8daabdd43b80 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:27.872465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8cff9-077b-4458-9629-8daabdd43b80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:27.874168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3088b922-facd-41a3-abc7-9bd39ac96772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:27.874728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7fe8cff9-077b-4458-9629-8daabdd43b80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:27.888036 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1780/3554] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:27.889161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088b922-facd-41a3-abc7-9bd39ac96772 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:27.906376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3088b922-facd-41a3-abc7-9bd39ac96772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:27.922318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088b922-facd-41a3-abc7-9bd39ac96772 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:27.926713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82d381-17ad-4131-a071-ac016206f29b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:27.928094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82d381-17ad-4131-a071-ac016206f29b service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:27.928461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82d381-17ad-4131-a071-ac016206f29b service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:27.928650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82d381-17ad-4131-a071-ac016206f29b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:27.930550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4b82d381-17ad-4131-a071-ac016206f29b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:28.048165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8cff9-077b-4458-9629-8daabdd43b80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:28.049620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8cff9-077b-4458-9629-8daabdd43b80 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:28.067137 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1775/3555] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:10:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:10:28.070568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8cff9-077b-4458-9629-8daabdd43b80 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:28.081325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82d381-17ad-4131-a071-ac016206f29b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:28.084164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82d381-17ad-4131-a071-ac016206f29b service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:28.105344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8cff9-077b-4458-9629-8daabdd43b80 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:28.115875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63f5b2-e8de-476b-a37b-25d51b90b49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:28.116695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63f5b2-e8de-476b-a37b-25d51b90b49c admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:28.117104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63f5b2-e8de-476b-a37b-25d51b90b49c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:28.117454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63f5b2-e8de-476b-a37b-25d51b90b49c admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:28.118326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63f5b2-e8de-476b-a37b-25d51b90b49c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:10:28.118736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63f5b2-e8de-476b-a37b-25d51b90b49c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:28.119675 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1781/3556] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:10:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:10:28.121813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63f5b2-e8de-476b-a37b-25d51b90b49c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:28.139752 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1776/3557] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:10:28.143891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82d381-17ad-4131-a071-ac016206f29b service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:28.158245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82d381-17ad-4131-a071-ac016206f29b service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:28.164839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85551d-8e79-401c-9d1b-53a8371cb4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:28.165784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85551d-8e79-401c-9d1b-53a8371cb4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:28.166224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85551d-8e79-401c-9d1b-53a8371cb4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:28.166757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85551d-8e79-401c-9d1b-53a8371cb4b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:28.167927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85551d-8e79-401c-9d1b-53a8371cb4b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:28.170088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85551d-8e79-401c-9d1b-53a8371cb4b8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:28.203505 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1782/3558] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:10:28 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:10:28.207672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63f5b2-e8de-476b-a37b-25d51b90b49c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:28.219865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63f5b2-e8de-476b-a37b-25d51b90b49c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:28.303381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ca572-b909-494e-8179-2df452bd57c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:28.304132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ca572-b909-494e-8179-2df452bd57c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:28.304847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ca572-b909-494e-8179-2df452bd57c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:28.305199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ca572-b909-494e-8179-2df452bd57c9 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:28.305991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ca572-b909-494e-8179-2df452bd57c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:28.309529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ca572-b909-494e-8179-2df452bd57c9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:28.355965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85551d-8e79-401c-9d1b-53a8371cb4b8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:28.356149 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1777/3559] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:10:28 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:10:28.379105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85551d-8e79-401c-9d1b-53a8371cb4b8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:28.387435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0e887-8dec-45eb-81ed-be977f668a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:28.388339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0e887-8dec-45eb-81ed-be977f668a8c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:28.388722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0e887-8dec-45eb-81ed-be977f668a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:28.389077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0e887-8dec-45eb-81ed-be977f668a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:28.390114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0e887-8dec-45eb-81ed-be977f668a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:28.392460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0e887-8dec-45eb-81ed-be977f668a8c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:28.416715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ca572-b909-494e-8179-2df452bd57c9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:28.425333 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1783/3560] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:10:28.430497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ca572-b909-494e-8179-2df452bd57c9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:28.436377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d99c94-7f4e-4ba5-9d1a-7b50363c26f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:28.437611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d99c94-7f4e-4ba5-9d1a-7b50363c26f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:28.437718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d99c94-7f4e-4ba5-9d1a-7b50363c26f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:28.438068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d99c94-7f4e-4ba5-9d1a-7b50363c26f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:28.439755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d99c94-7f4e-4ba5-9d1a-7b50363c26f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:28.442188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d99c94-7f4e-4ba5-9d1a-7b50363c26f4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:28.472346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0e887-8dec-45eb-81ed-be977f668a8c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:28.480098 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1778/3561] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:10:28.489895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0e887-8dec-45eb-81ed-be977f668a8c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:28.495546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533825c7-275f-4331-ba1d-c47c1001184d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:28.496445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533825c7-275f-4331-ba1d-c47c1001184d admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:28.496887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533825c7-275f-4331-ba1d-c47c1001184d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:28.497429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533825c7-275f-4331-ba1d-c47c1001184d admin admin] PATH_INFO: `/v3/projects/7e9653a81a694ec29d1fcfe2da97eaa3/users/36fe4dfa0f564eedb8deb3491a5068a5/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:28.522301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533825c7-275f-4331-ba1d-c47c1001184d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e9653a81a694ec29d1fcfe2da97eaa3, user_id=36fe4dfa0f564eedb8deb3491a5068a5, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:28.525157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533825c7-275f-4331-ba1d-c47c1001184d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:28.555665 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1784/3562] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:10:28 2022] PUT /identity/v3/projects/7e9653a81a694ec29d1fcfe2da97eaa3/users/36fe4dfa0f564eedb8deb3491a5068a5/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:10:28.556698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9b60a-6752-4137-af40-1125cd6f9c80 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:28.557138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9b60a-6752-4137-af40-1125cd6f9c80 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:28.557400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9b60a-6752-4137-af40-1125cd6f9c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:28.576353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:28.582758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-12b9b60a-6752-4137-af40-1125cd6f9c80 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:28.584746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-12b9b60a-6752-4137-af40-1125cd6f9c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:28.670656 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1779/3563] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:28.686283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533825c7-275f-4331-ba1d-c47c1001184d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:28.786859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533825c7-275f-4331-ba1d-c47c1001184d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:28.791230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0d89a-e1f4-46e3-882d-9adf3bd2386b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:28.792052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0d89a-e1f4-46e3-882d-9adf3bd2386b service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:28.792473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0d89a-e1f4-46e3-882d-9adf3bd2386b service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:28.792865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0d89a-e1f4-46e3-882d-9adf3bd2386b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:28.804273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0d89a-e1f4-46e3-882d-9adf3bd2386b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:28.806337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0d89a-e1f4-46e3-882d-9adf3bd2386b service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:28.821351 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1785/3564] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:10:29.655183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9b60a-6752-4137-af40-1125cd6f9c80 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:29.666435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9b60a-6752-4137-af40-1125cd6f9c80 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:29.670155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64163c-ad74-4660-84a7-2cb928a9ed74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:29.670713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64163c-ad74-4660-84a7-2cb928a9ed74 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:29.670996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64163c-ad74-4660-84a7-2cb928a9ed74 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:29.671274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64163c-ad74-4660-84a7-2cb928a9ed74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:29.673079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ea64163c-ad74-4660-84a7-2cb928a9ed74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:29.684782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64163c-ad74-4660-84a7-2cb928a9ed74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:29.686584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64163c-ad74-4660-84a7-2cb928a9ed74 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:29.697239 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1780/3565] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:10:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:10:29.769882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0d89a-e1f4-46e3-882d-9adf3bd2386b service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:29.772044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-44d0d89a-e1f4-46e3-882d-9adf3bd2386b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:29.787739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0d89a-e1f4-46e3-882d-9adf3bd2386b service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:29.795031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac5dac-6df9-497e-aad3-5073a27cd088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:29.795943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac5dac-6df9-497e-aad3-5073a27cd088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:29.796259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac5dac-6df9-497e-aad3-5073a27cd088 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:29.796662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac5dac-6df9-497e-aad3-5073a27cd088 admin admin] PATH_INFO: `/v3/users/6399b6f3e2574df8af12786c8755c59a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:29.797990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac5dac-6df9-497e-aad3-5073a27cd088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6399b6f3e2574df8af12786c8755c59a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:29.800077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac5dac-6df9-497e-aad3-5073a27cd088 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:29.802177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:29.860925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-68ac5dac-6df9-497e-aad3-5073a27cd088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6399b6f3e2574df8af12786c8755c59a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:29.878395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-68ac5dac-6df9-497e-aad3-5073a27cd088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6399b6f3e2574df8af12786c8755c59a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:29.879179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-68ac5dac-6df9-497e-aad3-5073a27cd088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6399b6f3e2574df8af12786c8755c59a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:29.889052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-68ac5dac-6df9-497e-aad3-5073a27cd088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6399b6f3e2574df8af12786c8755c59a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:29.889913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-68ac5dac-6df9-497e-aad3-5073a27cd088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6399b6f3e2574df8af12786c8755c59a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:29.908865 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1786/3566] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:10:29 2022] DELETE /identity/v3/users/6399b6f3e2574df8af12786c8755c59a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:10:30.324025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64163c-ad74-4660-84a7-2cb928a9ed74 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:30.348052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64163c-ad74-4660-84a7-2cb928a9ed74 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:30.457748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b22bc8-155b-4f8c-8e24-cf08a1a0e220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:30.459804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b22bc8-155b-4f8c-8e24-cf08a1a0e220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:30.459804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b22bc8-155b-4f8c-8e24-cf08a1a0e220 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:30.460107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b22bc8-155b-4f8c-8e24-cf08a1a0e220 admin admin] PATH_INFO: `/v3/projects/c143a2d2e4b04edba1f2734d4d19d978` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:30.461818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b22bc8-155b-4f8c-8e24-cf08a1a0e220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c143a2d2e4b04edba1f2734d4d19d978)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:30.464376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b22bc8-155b-4f8c-8e24-cf08a1a0e220 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:30.525000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-47b22bc8-155b-4f8c-8e24-cf08a1a0e220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c143a2d2e4b04edba1f2734d4d19d978', 'request_id': 'req-47b22bc8-155b-4f8c-8e24-cf08a1a0e220'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:30.546985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-47b22bc8-155b-4f8c-8e24-cf08a1a0e220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c143a2d2e4b04edba1f2734d4d19d978', 'request_id': 'req-47b22bc8-155b-4f8c-8e24-cf08a1a0e220'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:30.563726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-47b22bc8-155b-4f8c-8e24-cf08a1a0e220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c143a2d2e4b04edba1f2734d4d19d978', 'request_id': 'req-47b22bc8-155b-4f8c-8e24-cf08a1a0e220'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:30.578833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-47b22bc8-155b-4f8c-8e24-cf08a1a0e220 admin admin] The token cache is being invalidate because project c143a2d2e4b04edba1f2734d4d19d978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:10:30.579134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-47b22bc8-155b-4f8c-8e24-cf08a1a0e220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:30.579798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-47b22bc8-155b-4f8c-8e24-cf08a1a0e220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:30.585123 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1781/3567] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:10:30 2022] DELETE /identity/v3/projects/c143a2d2e4b04edba1f2734d4d19d978 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:10:30.586835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63516e9-0377-4090-8ef9-4c71804fcd45 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:30.587132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63516e9-0377-4090-8ef9-4c71804fcd45 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:30.587436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63516e9-0377-4090-8ef9-4c71804fcd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:30.614052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a63516e9-0377-4090-8ef9-4c71804fcd45 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:30.615359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a63516e9-0377-4090-8ef9-4c71804fcd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:30.720009 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1787/3568] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:30.721718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66655ec-91e8-4315-b640-6839b8a6ff6b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:30.722234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66655ec-91e8-4315-b640-6839b8a6ff6b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:30.722328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66655ec-91e8-4315-b640-6839b8a6ff6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:30.761128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b66655ec-91e8-4315-b640-6839b8a6ff6b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:30.762703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b66655ec-91e8-4315-b640-6839b8a6ff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:30.778476 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1782/3569] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:30.780588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63516e9-0377-4090-8ef9-4c71804fcd45 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:30.796393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63516e9-0377-4090-8ef9-4c71804fcd45 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:30.806133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b824df8-55c7-40c2-9bb4-f5c1091b7710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:30.808985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b824df8-55c7-40c2-9bb4-f5c1091b7710 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:30.808985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b824df8-55c7-40c2-9bb4-f5c1091b7710 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:30.808985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b824df8-55c7-40c2-9bb4-f5c1091b7710 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:30.808985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b824df8-55c7-40c2-9bb4-f5c1091b7710 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:10:30.808985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b824df8-55c7-40c2-9bb4-f5c1091b7710 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:30.810826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b824df8-55c7-40c2-9bb4-f5c1091b7710 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:30.830545 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1788/3570] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:10:30.832967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66655ec-91e8-4315-b640-6839b8a6ff6b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:30.845794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66655ec-91e8-4315-b640-6839b8a6ff6b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:30.866866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822a6fe-8d4d-4118-abc8-0bceaa168f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:30.868885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822a6fe-8d4d-4118-abc8-0bceaa168f5e admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:30.869862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822a6fe-8d4d-4118-abc8-0bceaa168f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:30.870772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822a6fe-8d4d-4118-abc8-0bceaa168f5e admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:30.871826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822a6fe-8d4d-4118-abc8-0bceaa168f5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:30.874567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822a6fe-8d4d-4118-abc8-0bceaa168f5e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:30.919104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:30.971117 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1783/3571] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:10:30 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:10:30.974483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b824df8-55c7-40c2-9bb4-f5c1091b7710 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:31.002112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b824df8-55c7-40c2-9bb4-f5c1091b7710 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:31.159394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc87220-c0fb-4d0c-b21d-7f3b8dbe5c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:31.163627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc87220-c0fb-4d0c-b21d-7f3b8dbe5c1e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:31.164007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc87220-c0fb-4d0c-b21d-7f3b8dbe5c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:31.164686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc87220-c0fb-4d0c-b21d-7f3b8dbe5c1e admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:31.165790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc87220-c0fb-4d0c-b21d-7f3b8dbe5c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:31.168290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc87220-c0fb-4d0c-b21d-7f3b8dbe5c1e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:31.182101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:31.221155 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1789/3572] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:10:30 2022] POST /identity/v3/users => generated 290 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:10:31.225135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822a6fe-8d4d-4118-abc8-0bceaa168f5e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:31.241986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822a6fe-8d4d-4118-abc8-0bceaa168f5e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:31.255726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6c223-4729-4c1e-84a3-d1377f7e4fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:31.256368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6c223-4729-4c1e-84a3-d1377f7e4fab admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:31.256660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6c223-4729-4c1e-84a3-d1377f7e4fab admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:31.256942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6c223-4729-4c1e-84a3-d1377f7e4fab admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:31.257652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6c223-4729-4c1e-84a3-d1377f7e4fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:31.259271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6c223-4729-4c1e-84a3-d1377f7e4fab admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:31.280349 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1784/3573] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:10:31.284558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc87220-c0fb-4d0c-b21d-7f3b8dbe5c1e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:31.306010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc87220-c0fb-4d0c-b21d-7f3b8dbe5c1e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:31.321735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1a2cb-97df-4bfa-825d-58e21caad842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:31.323132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1a2cb-97df-4bfa-825d-58e21caad842 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:31.326687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1a2cb-97df-4bfa-825d-58e21caad842 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:31.327138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1a2cb-97df-4bfa-825d-58e21caad842 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:31.328055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1a2cb-97df-4bfa-825d-58e21caad842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:31.329877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1a2cb-97df-4bfa-825d-58e21caad842 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:31.348113 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1790/3574] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:10:31.353026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6c223-4729-4c1e-84a3-d1377f7e4fab admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:31.366620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6c223-4729-4c1e-84a3-d1377f7e4fab admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:31.378726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decc348-c5db-4b1d-9205-b965cca5772d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:31.379454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decc348-c5db-4b1d-9205-b965cca5772d admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:31.379746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decc348-c5db-4b1d-9205-b965cca5772d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:31.380064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decc348-c5db-4b1d-9205-b965cca5772d admin admin] PATH_INFO: `/v3/projects/0743c6764e9d487a9a3efa52e8e2b611/users/b839893e78134428a3cf451901129edc/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:31.425501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decc348-c5db-4b1d-9205-b965cca5772d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0743c6764e9d487a9a3efa52e8e2b611, user_id=b839893e78134428a3cf451901129edc, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:31.428622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decc348-c5db-4b1d-9205-b965cca5772d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:31.448269 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1785/3575] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:10:31 2022] PUT /identity/v3/projects/0743c6764e9d487a9a3efa52e8e2b611/users/b839893e78134428a3cf451901129edc/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:10:31.453018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc21808-edd9-4668-a7b1-252154697308 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:31.453520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc21808-edd9-4668-a7b1-252154697308 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:31.453877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc21808-edd9-4668-a7b1-252154697308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:31.476307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-cfc21808-edd9-4668-a7b1-252154697308 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:31.477533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cfc21808-edd9-4668-a7b1-252154697308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:31.551415 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1791/3576] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:31.564740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decc348-c5db-4b1d-9205-b965cca5772d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:31.567395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0decc348-c5db-4b1d-9205-b965cca5772d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:31.642553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decc348-c5db-4b1d-9205-b965cca5772d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:31.647355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc2a9e-7108-47ed-ad72-dc467aa08f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:31.648237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc2a9e-7108-47ed-ad72-dc467aa08f47 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:31.648893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc2a9e-7108-47ed-ad72-dc467aa08f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:31.648893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc2a9e-7108-47ed-ad72-dc467aa08f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:31.660231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc2a9e-7108-47ed-ad72-dc467aa08f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:31.662120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc2a9e-7108-47ed-ad72-dc467aa08f47 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:31.674061 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1786/3577] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:10:37.205694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc21808-edd9-4668-a7b1-252154697308 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:37.207393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cfc21808-edd9-4668-a7b1-252154697308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:37.229983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc21808-edd9-4668-a7b1-252154697308 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:37.246868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62b62d-b4e3-46fa-8aa4-32daf45b0411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:37.248953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62b62d-b4e3-46fa-8aa4-32daf45b0411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:37.249257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62b62d-b4e3-46fa-8aa4-32daf45b0411 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:37.249536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62b62d-b4e3-46fa-8aa4-32daf45b0411 admin admin] PATH_INFO: `/v3/users/2517a20b0358424480784b0003512d50` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:37.254340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62b62d-b4e3-46fa-8aa4-32daf45b0411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2517a20b0358424480784b0003512d50)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:37.257083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62b62d-b4e3-46fa-8aa4-32daf45b0411 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:37.454905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd62b62d-b4e3-46fa-8aa4-32daf45b0411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2517a20b0358424480784b0003512d50'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:37.487747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd62b62d-b4e3-46fa-8aa4-32daf45b0411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2517a20b0358424480784b0003512d50'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:37.488670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd62b62d-b4e3-46fa-8aa4-32daf45b0411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2517a20b0358424480784b0003512d50'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:37.503189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd62b62d-b4e3-46fa-8aa4-32daf45b0411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2517a20b0358424480784b0003512d50'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:37.504193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd62b62d-b4e3-46fa-8aa4-32daf45b0411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2517a20b0358424480784b0003512d50'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:37.528752 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1792/3578] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:10:37 2022] DELETE /identity/v3/users/2517a20b0358424480784b0003512d50 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:10:38.247750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc2a9e-7108-47ed-ad72-dc467aa08f47 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:38.264917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc2a9e-7108-47ed-ad72-dc467aa08f47 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:38.378576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bf2f3-b380-4683-bde1-10c439da8a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:38.380489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bf2f3-b380-4683-bde1-10c439da8a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:38.381719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bf2f3-b380-4683-bde1-10c439da8a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:38.382010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bf2f3-b380-4683-bde1-10c439da8a03 admin admin] PATH_INFO: `/v3/projects/d9be740494d2497cb1771330a1ba99f1` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:38.384019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bf2f3-b380-4683-bde1-10c439da8a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9be740494d2497cb1771330a1ba99f1)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:38.386295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bf2f3-b380-4683-bde1-10c439da8a03 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:38.486019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6f2bf2f3-b380-4683-bde1-10c439da8a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9be740494d2497cb1771330a1ba99f1', 'request_id': 'req-6f2bf2f3-b380-4683-bde1-10c439da8a03'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:38.532948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6f2bf2f3-b380-4683-bde1-10c439da8a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9be740494d2497cb1771330a1ba99f1', 'request_id': 'req-6f2bf2f3-b380-4683-bde1-10c439da8a03'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:38.555926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6f2bf2f3-b380-4683-bde1-10c439da8a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9be740494d2497cb1771330a1ba99f1', 'request_id': 'req-6f2bf2f3-b380-4683-bde1-10c439da8a03'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:38.558517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:38.623005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6f2bf2f3-b380-4683-bde1-10c439da8a03 admin admin] The token cache is being invalidate because project d9be740494d2497cb1771330a1ba99f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:10:38.623365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6f2bf2f3-b380-4683-bde1-10c439da8a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:38.625136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6f2bf2f3-b380-4683-bde1-10c439da8a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:10:38.630490 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1787/3579] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:10:38 2022] DELETE /identity/v3/projects/d9be740494d2497cb1771330a1ba99f1 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:10:38.636173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bd530-025c-41d4-b68d-c80d9918e0c3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:38.638160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bd530-025c-41d4-b68d-c80d9918e0c3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:38.638160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bd530-025c-41d4-b68d-c80d9918e0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:38.721923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-979bd530-025c-41d4-b68d-c80d9918e0c3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:38.723968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-979bd530-025c-41d4-b68d-c80d9918e0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:38.895054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:38.918733 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1793/3580] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:38.927505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87814353-49b4-45c2-9324-7b5120c5f1b9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:38.928083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87814353-49b4-45c2-9324-7b5120c5f1b9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:38.928659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87814353-49b4-45c2-9324-7b5120c5f1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:38.970443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-87814353-49b4-45c2-9324-7b5120c5f1b9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:38.972475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-87814353-49b4-45c2-9324-7b5120c5f1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:38.989082 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1788/3581] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:38.999717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bd530-025c-41d4-b68d-c80d9918e0c3 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:39.022772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bd530-025c-41d4-b68d-c80d9918e0c3 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:39.037424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8813a42-a2d7-4bd8-8e8c-358cf4f333bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:39.039903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8813a42-a2d7-4bd8-8e8c-358cf4f333bc admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:39.040419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8813a42-a2d7-4bd8-8e8c-358cf4f333bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:39.041636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8813a42-a2d7-4bd8-8e8c-358cf4f333bc admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:39.042581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8813a42-a2d7-4bd8-8e8c-358cf4f333bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:10:39.044975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8813a42-a2d7-4bd8-8e8c-358cf4f333bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:39.047466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8813a42-a2d7-4bd8-8e8c-358cf4f333bc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:39.097944 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1794/3582] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:10:39.102781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87814353-49b4-45c2-9324-7b5120c5f1b9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:39.113769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87814353-49b4-45c2-9324-7b5120c5f1b9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:39.125329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adf221-001b-4384-ae1e-4093a7ec221e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:39.126267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adf221-001b-4384-ae1e-4093a7ec221e admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:39.126592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adf221-001b-4384-ae1e-4093a7ec221e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:39.126948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adf221-001b-4384-ae1e-4093a7ec221e admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:39.127701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adf221-001b-4384-ae1e-4093a7ec221e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:39.132667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adf221-001b-4384-ae1e-4093a7ec221e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:39.222386 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1789/3583] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:10:39 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:10:39.222923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8813a42-a2d7-4bd8-8e8c-358cf4f333bc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:39.240636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8813a42-a2d7-4bd8-8e8c-358cf4f333bc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:39.433825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d43a14-027c-4f8c-afdd-91dfb9dca092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:39.434480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d43a14-027c-4f8c-afdd-91dfb9dca092 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:39.434758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d43a14-027c-4f8c-afdd-91dfb9dca092 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:39.435032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d43a14-027c-4f8c-afdd-91dfb9dca092 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:39.435747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d43a14-027c-4f8c-afdd-91dfb9dca092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:39.441735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d43a14-027c-4f8c-afdd-91dfb9dca092 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:39.490386 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1795/3584] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:10:39 2022] POST /identity/v3/users => generated 294 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:10:39.494926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adf221-001b-4384-ae1e-4093a7ec221e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:39.519194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adf221-001b-4384-ae1e-4093a7ec221e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:39.538118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc75e2-c088-47ca-9538-0e2e0cc392c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:39.540453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc75e2-c088-47ca-9538-0e2e0cc392c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:39.541997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc75e2-c088-47ca-9538-0e2e0cc392c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:39.545540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc75e2-c088-47ca-9538-0e2e0cc392c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:39.546364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc75e2-c088-47ca-9538-0e2e0cc392c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:39.553950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc75e2-c088-47ca-9538-0e2e0cc392c1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:39.571673 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1790/3585] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:10:39.575753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d43a14-027c-4f8c-afdd-91dfb9dca092 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:39.590488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d43a14-027c-4f8c-afdd-91dfb9dca092 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:39.596438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8e7e8-5bdd-4e49-868e-9f21b17eb4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:39.596879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8e7e8-5bdd-4e49-868e-9f21b17eb4cf admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:39.597164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8e7e8-5bdd-4e49-868e-9f21b17eb4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:39.597444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8e7e8-5bdd-4e49-868e-9f21b17eb4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:39.598220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8e7e8-5bdd-4e49-868e-9f21b17eb4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:39.600728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8e7e8-5bdd-4e49-868e-9f21b17eb4cf admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:39.618004 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1796/3586] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:10:39.626972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6a3b3-92b1-481a-bf2f-7622fa5f38e1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:39.627525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6a3b3-92b1-481a-bf2f-7622fa5f38e1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:39.628122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6a3b3-92b1-481a-bf2f-7622fa5f38e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:39.633488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8e7e8-5bdd-4e49-868e-9f21b17eb4cf admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:39.667934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8e7e8-5bdd-4e49-868e-9f21b17eb4cf admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:39.683895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccfb65-9cb0-4d27-9303-7fc89d13cf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:39.685068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccfb65-9cb0-4d27-9303-7fc89d13cf23 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:39.685359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccfb65-9cb0-4d27-9303-7fc89d13cf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:39.685643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccfb65-9cb0-4d27-9303-7fc89d13cf23 admin admin] PATH_INFO: `/v3/projects/07faa65e8ff5420a92cab2a17cd2cc74/users/f5f8f28630a3430f81fa884985963a9b/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:39.699439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c6a6a3b3-92b1-481a-bf2f-7622fa5f38e1 None None] MFA Rules not processed for user `36fe4dfa0f564eedb8deb3491a5068a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:39.707018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c6a6a3b3-92b1-481a-bf2f-7622fa5f38e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:39.727863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccfb65-9cb0-4d27-9303-7fc89d13cf23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07faa65e8ff5420a92cab2a17cd2cc74, user_id=f5f8f28630a3430f81fa884985963a9b, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:39.738160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccfb65-9cb0-4d27-9303-7fc89d13cf23 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:39.778068 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1797/3587] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:10:39 2022] PUT /identity/v3/projects/07faa65e8ff5420a92cab2a17cd2cc74/users/f5f8f28630a3430f81fa884985963a9b/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:10:39.783964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f13331-8b8d-49c4-b054-c7d907cbe222 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:39.784259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f13331-8b8d-49c4-b054-c7d907cbe222 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:39.789012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f13331-8b8d-49c4-b054-c7d907cbe222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:39.835427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-83f13331-8b8d-49c4-b054-c7d907cbe222 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:39.837009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-83f13331-8b8d-49c4-b054-c7d907cbe222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:39.882065 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1791/3588] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:39.892260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ac167-5126-4c59-9e81-cb7b92111f3c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:39.892630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ac167-5126-4c59-9e81-cb7b92111f3c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:39.892985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ac167-5126-4c59-9e81-cb7b92111f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:39.935272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e71ac167-5126-4c59-9e81-cb7b92111f3c None None] MFA Rules not processed for user `36fe4dfa0f564eedb8deb3491a5068a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:39.940318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e71ac167-5126-4c59-9e81-cb7b92111f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:39.989576 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1798/3589] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:39.997264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f13331-8b8d-49c4-b054-c7d907cbe222 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:39.998386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-83f13331-8b8d-49c4-b054-c7d907cbe222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:40.073966 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1792/3590] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:10:40.087865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ac167-5126-4c59-9e81-cb7b92111f3c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:40.090900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e71ac167-5126-4c59-9e81-cb7b92111f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:40.118170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:40.162963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f13331-8b8d-49c4-b054-c7d907cbe222 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:40.171393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca09249-2931-486c-bfc8-f2cf379bdb7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:40.172024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca09249-2931-486c-bfc8-f2cf379bdb7a service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:40.172315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca09249-2931-486c-bfc8-f2cf379bdb7a service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:40.172590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca09249-2931-486c-bfc8-f2cf379bdb7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:40.192414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca09249-2931-486c-bfc8-f2cf379bdb7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:40.193945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca09249-2931-486c-bfc8-f2cf379bdb7a service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:40.198581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:40.210572 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1799/3591] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:10:40.247863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ac167-5126-4c59-9e81-cb7b92111f3c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:40.256413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d98f3d-0fc0-4333-b6d9-954701ecd473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:40.263249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d98f3d-0fc0-4333-b6d9-954701ecd473 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:40.263991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d98f3d-0fc0-4333-b6d9-954701ecd473 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:40.264469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d98f3d-0fc0-4333-b6d9-954701ecd473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:40.277571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d98f3d-0fc0-4333-b6d9-954701ecd473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:40.280970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d98f3d-0fc0-4333-b6d9-954701ecd473 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:40.304574 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1793/3592] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:10:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:10:40.519825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c80f08-2f0c-4cf1-a1f4-c4d542fb61e0 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:40.520127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c80f08-2f0c-4cf1-a1f4-c4d542fb61e0 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:40.520534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c80f08-2f0c-4cf1-a1f4-c4d542fb61e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:40.600229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-36c80f08-2f0c-4cf1-a1f4-c4d542fb61e0 None None] MFA Rules not processed for user `b839893e78134428a3cf451901129edc`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:40.601497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-36c80f08-2f0c-4cf1-a1f4-c4d542fb61e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:40.757585 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1800/3593] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:40.769339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa23c5-0a74-4e76-958e-418ac0049703 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:40.771231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa23c5-0a74-4e76-958e-418ac0049703 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:40.772199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa23c5-0a74-4e76-958e-418ac0049703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:40.815633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-37fa23c5-0a74-4e76-958e-418ac0049703 None None] MFA Rules not processed for user `b839893e78134428a3cf451901129edc`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:40.816895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-37fa23c5-0a74-4e76-958e-418ac0049703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:40.843253 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1794/3594] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:41.060823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c80f08-2f0c-4cf1-a1f4-c4d542fb61e0 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:41.062256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-36c80f08-2f0c-4cf1-a1f4-c4d542fb61e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:41.123647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c80f08-2f0c-4cf1-a1f4-c4d542fb61e0 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:41.130814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffecd2-363d-4e11-858f-55cc541821d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:41.131737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffecd2-363d-4e11-858f-55cc541821d2 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:41.132091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffecd2-363d-4e11-858f-55cc541821d2 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:41.132443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffecd2-363d-4e11-858f-55cc541821d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:41.146288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffecd2-363d-4e11-858f-55cc541821d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:41.153624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffecd2-363d-4e11-858f-55cc541821d2 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:41.181184 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1801/3595] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:10:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:10:41.613963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa23c5-0a74-4e76-958e-418ac0049703 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:41.616275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-37fa23c5-0a74-4e76-958e-418ac0049703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:41.738905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa23c5-0a74-4e76-958e-418ac0049703 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:41.751470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba79370-3ea7-4dcb-9f5d-a4bf6ae5af52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:41.752538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba79370-3ea7-4dcb-9f5d-a4bf6ae5af52 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:41.753059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba79370-3ea7-4dcb-9f5d-a4bf6ae5af52 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:41.753781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba79370-3ea7-4dcb-9f5d-a4bf6ae5af52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:41.757038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dba79370-3ea7-4dcb-9f5d-a4bf6ae5af52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:41.774516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba79370-3ea7-4dcb-9f5d-a4bf6ae5af52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:41.776398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba79370-3ea7-4dcb-9f5d-a4bf6ae5af52 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:41.796806 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1795/3596] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:10:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:10:41.894671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5d4b6-7d16-47db-94ef-3172531aeed2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:41.895176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5d4b6-7d16-47db-94ef-3172531aeed2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:41.895255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5d4b6-7d16-47db-94ef-3172531aeed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:42.017627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-dab5d4b6-7d16-47db-94ef-3172531aeed2 None None] MFA Rules not processed for user `f5f8f28630a3430f81fa884985963a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:42.018872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-dab5d4b6-7d16-47db-94ef-3172531aeed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:42.297661 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1802/3597] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:42.307820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bfa69-160a-4e71-9594-998aaf8d0a24 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:42.308108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bfa69-160a-4e71-9594-998aaf8d0a24 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:42.308597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bfa69-160a-4e71-9594-998aaf8d0a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:42.360337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-725bfa69-160a-4e71-9594-998aaf8d0a24 None None] MFA Rules not processed for user `f5f8f28630a3430f81fa884985963a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:42.361962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-725bfa69-160a-4e71-9594-998aaf8d0a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:42.397222 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1796/3598] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:42.397595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecd238-417b-453f-8fbe-a1c532c70f25 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:42.397996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecd238-417b-453f-8fbe-a1c532c70f25 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:42.398384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecd238-417b-453f-8fbe-a1c532c70f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:42.477517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-39ecd238-417b-453f-8fbe-a1c532c70f25 None None] MFA Rules not processed for user `f5f8f28630a3430f81fa884985963a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:42.480948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-39ecd238-417b-453f-8fbe-a1c532c70f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:42.504024 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1803/3599] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:43.118020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bfa69-160a-4e71-9594-998aaf8d0a24 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:43.135539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bfa69-160a-4e71-9594-998aaf8d0a24 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:43.148533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3e27a-5667-4311-9ced-720773f66d08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:43.150046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3e27a-5667-4311-9ced-720773f66d08 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:43.150534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3e27a-5667-4311-9ced-720773f66d08 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:43.154191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3e27a-5667-4311-9ced-720773f66d08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:43.173188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3e27a-5667-4311-9ced-720773f66d08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:43.183473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3e27a-5667-4311-9ced-720773f66d08 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:43.230416 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1797/3600] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:10:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:10:44.227036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc62455-d3d0-4b69-b41a-4a6c953b0ef7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:44.227589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc62455-d3d0-4b69-b41a-4a6c953b0ef7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:44.227683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc62455-d3d0-4b69-b41a-4a6c953b0ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:44.304188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8bc62455-d3d0-4b69-b41a-4a6c953b0ef7 None None] MFA Rules not processed for user `f5f8f28630a3430f81fa884985963a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:44.311791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8bc62455-d3d0-4b69-b41a-4a6c953b0ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:44.341853 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1804/3601] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:45.913428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1045bb-9196-425b-a1ca-31323b3036ba None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:45.913997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1045bb-9196-425b-a1ca-31323b3036ba None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:45.914847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1045bb-9196-425b-a1ca-31323b3036ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:45.970744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1c1045bb-9196-425b-a1ca-31323b3036ba None None] MFA Rules not processed for user `f5f8f28630a3430f81fa884985963a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:45.972336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1c1045bb-9196-425b-a1ca-31323b3036ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:45.989124 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1798/3602] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:10:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:50.873243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc62455-d3d0-4b69-b41a-4a6c953b0ef7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:50.902075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc62455-d3d0-4b69-b41a-4a6c953b0ef7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:50.912655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fef9e-7b6f-4c0f-aa11-8977ec73c1c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:50.913502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fef9e-7b6f-4c0f-aa11-8977ec73c1c9 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:50.913944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fef9e-7b6f-4c0f-aa11-8977ec73c1c9 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:50.914385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fef9e-7b6f-4c0f-aa11-8977ec73c1c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:50.919706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d92fef9e-7b6f-4c0f-aa11-8977ec73c1c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:50.940722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fef9e-7b6f-4c0f-aa11-8977ec73c1c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:50.943630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fef9e-7b6f-4c0f-aa11-8977ec73c1c9 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:50.971562 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1805/3603] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:10:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:10:55.947140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=59 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:59.376204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba4529-005d-45ae-90b7-86827fa61998 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:59.377392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba4529-005d-45ae-90b7-86827fa61998 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:59.378055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba4529-005d-45ae-90b7-86827fa61998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:59.484024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9aba4529-005d-45ae-90b7-86827fa61998 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:10:59.485814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9aba4529-005d-45ae-90b7-86827fa61998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:59.631339 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1799/3604] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:10:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:10:59.709029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fef9e-7b6f-4c0f-aa11-8977ec73c1c9 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:10:59.711006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d92fef9e-7b6f-4c0f-aa11-8977ec73c1c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:10:59.762985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:59.845761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fef9e-7b6f-4c0f-aa11-8977ec73c1c9 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:10:59.851617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0b68f-417f-49e2-8b68-0cdc46b3fc90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:10:59.852510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0b68f-417f-49e2-8b68-0cdc46b3fc90 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:10:59.852961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0b68f-417f-49e2-8b68-0cdc46b3fc90 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:10:59.853395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0b68f-417f-49e2-8b68-0cdc46b3fc90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:10:59.863499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0b68f-417f-49e2-8b68-0cdc46b3fc90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:10:59.865966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0b68f-417f-49e2-8b68-0cdc46b3fc90 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:10:59.877025 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1806/3605] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:10:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:11:01.828434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba4529-005d-45ae-90b7-86827fa61998 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:01.852158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba4529-005d-45ae-90b7-86827fa61998 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:01.876467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b6ede-9c89-4fda-9d97-877c6fe60c44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:01.877386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b6ede-9c89-4fda-9d97-877c6fe60c44 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:01.877877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b6ede-9c89-4fda-9d97-877c6fe60c44 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:01.878300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b6ede-9c89-4fda-9d97-877c6fe60c44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:01.885641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a96b6ede-9c89-4fda-9d97-877c6fe60c44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:01.929072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b6ede-9c89-4fda-9d97-877c6fe60c44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:01.930980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b6ede-9c89-4fda-9d97-877c6fe60c44 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:01.964122 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1800/3606] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:11:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:11:07.810041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444c6f3-9f3c-4286-be5d-7e28f3b48ce4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:07.811601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444c6f3-9f3c-4286-be5d-7e28f3b48ce4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:07.812375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444c6f3-9f3c-4286-be5d-7e28f3b48ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:07.867121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d444c6f3-9f3c-4286-be5d-7e28f3b48ce4 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:11:07.868444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d444c6f3-9f3c-4286-be5d-7e28f3b48ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:07.885019 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1807/3607] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:11:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:11:07.988215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b6ede-9c89-4fda-9d97-877c6fe60c44 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:08.015663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b6ede-9c89-4fda-9d97-877c6fe60c44 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:08.023153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbf324-affa-410a-97ed-8c2d645f23f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:08.024083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbf324-affa-410a-97ed-8c2d645f23f2 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:08.024525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbf324-affa-410a-97ed-8c2d645f23f2 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:08.025759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbf324-affa-410a-97ed-8c2d645f23f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:08.040940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbf324-affa-410a-97ed-8c2d645f23f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:08.043985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbf324-affa-410a-97ed-8c2d645f23f2 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:08.059022 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1801/3608] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:11:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:11:13.041362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de288910-ba06-412b-8128-99d1df91e74b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:13.041833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de288910-ba06-412b-8128-99d1df91e74b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:13.041927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de288910-ba06-412b-8128-99d1df91e74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:13.098162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-de288910-ba06-412b-8128-99d1df91e74b None None] MFA Rules not processed for user `25cff561a2d14c45b71920346aee5d57`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:11:13.103844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-de288910-ba06-412b-8128-99d1df91e74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:13.289305 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1808/3609] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:11:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:11:13.962421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbf324-affa-410a-97ed-8c2d645f23f2 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:13.979633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbf324-affa-410a-97ed-8c2d645f23f2 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:13.986879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adf7b6-a7a9-4552-bb30-46b68e616a53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:13.987770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adf7b6-a7a9-4552-bb30-46b68e616a53 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:13.988273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adf7b6-a7a9-4552-bb30-46b68e616a53 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:13.988701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adf7b6-a7a9-4552-bb30-46b68e616a53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:13.991894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c4adf7b6-a7a9-4552-bb30-46b68e616a53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:14.009174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adf7b6-a7a9-4552-bb30-46b68e616a53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:14.025068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adf7b6-a7a9-4552-bb30-46b68e616a53 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:14.071847 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1802/3610] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:11:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:11:14.791858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed5fd2-4a1c-45dd-98a0-89127000a03c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:14.792435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed5fd2-4a1c-45dd-98a0-89127000a03c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:14.792435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed5fd2-4a1c-45dd-98a0-89127000a03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:14.849821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4eed5fd2-4a1c-45dd-98a0-89127000a03c None None] MFA Rules not processed for user `b839893e78134428a3cf451901129edc`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:11:14.851581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4eed5fd2-4a1c-45dd-98a0-89127000a03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:14.887217 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1809/3611] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:11:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:11:15.849088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adf7b6-a7a9-4552-bb30-46b68e616a53 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:15.851360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c4adf7b6-a7a9-4552-bb30-46b68e616a53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:15.876460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adf7b6-a7a9-4552-bb30-46b68e616a53 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:15.883721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24752025-f09d-4af8-9b4c-19c4d9cc0169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:15.885543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24752025-f09d-4af8-9b4c-19c4d9cc0169 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:15.886511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24752025-f09d-4af8-9b4c-19c4d9cc0169 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:15.887114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24752025-f09d-4af8-9b4c-19c4d9cc0169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:15.889769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-24752025-f09d-4af8-9b4c-19c4d9cc0169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:15.910686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24752025-f09d-4af8-9b4c-19c4d9cc0169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:15.913754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24752025-f09d-4af8-9b4c-19c4d9cc0169 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:15.927932 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1803/3612] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:11:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:11:24.820111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=62 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:25.921772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=64 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:25.946762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed5fd2-4a1c-45dd-98a0-89127000a03c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:25.957344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed5fd2-4a1c-45dd-98a0-89127000a03c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:25.961872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af99dd-6190-49a8-b310-0648ee2d6162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:25.962501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af99dd-6190-49a8-b310-0648ee2d6162 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:25.962779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af99dd-6190-49a8-b310-0648ee2d6162 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:25.963615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af99dd-6190-49a8-b310-0648ee2d6162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:25.965670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-04af99dd-6190-49a8-b310-0648ee2d6162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:25.977964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af99dd-6190-49a8-b310-0648ee2d6162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:25.979641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af99dd-6190-49a8-b310-0648ee2d6162 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:25.990111 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1810/3613] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:11:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:11:26.180748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24752025-f09d-4af8-9b4c-19c4d9cc0169 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:26.183425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-24752025-f09d-4af8-9b4c-19c4d9cc0169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:26.304450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24752025-f09d-4af8-9b4c-19c4d9cc0169 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:26.309101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42dc730-a211-4fb0-adb7-23724dbffff0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:26.309843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dc730-a211-4fb0-adb7-23724dbffff0 service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:26.310179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dc730-a211-4fb0-adb7-23724dbffff0 service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:26.310505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dc730-a211-4fb0-adb7-23724dbffff0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:26.313505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e42dc730-a211-4fb0-adb7-23724dbffff0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:26.331527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42dc730-a211-4fb0-adb7-23724dbffff0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:26.336068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42dc730-a211-4fb0-adb7-23724dbffff0 service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:26.349349 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1804/3614] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:11:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:11:28.120019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af99dd-6190-49a8-b310-0648ee2d6162 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:28.123879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-04af99dd-6190-49a8-b310-0648ee2d6162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:28.148372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af99dd-6190-49a8-b310-0648ee2d6162 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:28.155853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f776c-32bb-4aa4-a20c-850486cb037f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:28.156831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f776c-32bb-4aa4-a20c-850486cb037f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:28.157547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f776c-32bb-4aa4-a20c-850486cb037f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:28.157989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f776c-32bb-4aa4-a20c-850486cb037f admin admin] PATH_INFO: `/v3/users/879e94018c474c838b1b989f3d4013a0` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:28.159587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f776c-32bb-4aa4-a20c-850486cb037f admin admin] RBAC: Authorizing `identity:delete_user(user_id=879e94018c474c838b1b989f3d4013a0)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:28.162307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f776c-32bb-4aa4-a20c-850486cb037f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:28.242371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5e0f776c-32bb-4aa4-a20c-850486cb037f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879e94018c474c838b1b989f3d4013a0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:11:28.257557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5e0f776c-32bb-4aa4-a20c-850486cb037f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879e94018c474c838b1b989f3d4013a0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:11:28.258387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5e0f776c-32bb-4aa4-a20c-850486cb037f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879e94018c474c838b1b989f3d4013a0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:11:28.266513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5e0f776c-32bb-4aa4-a20c-850486cb037f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879e94018c474c838b1b989f3d4013a0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:11:28.267535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5e0f776c-32bb-4aa4-a20c-850486cb037f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879e94018c474c838b1b989f3d4013a0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:11:28.282746 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1811/3615] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:11:28 2022] DELETE /identity/v3/users/879e94018c474c838b1b989f3d4013a0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:11:28.493255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42dc730-a211-4fb0-adb7-23724dbffff0 service glance] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:28.506270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42dc730-a211-4fb0-adb7-23724dbffff0 service glance] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:28.581528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5ed58-7483-436f-b13e-c887480f060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:28.582404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5ed58-7483-436f-b13e-c887480f060f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:28.582707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5ed58-7483-436f-b13e-c887480f060f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:28.582981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5ed58-7483-436f-b13e-c887480f060f admin admin] PATH_INFO: `/v3/projects/6dcec3648d3843dd96bfed76e793598a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:28.584311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5ed58-7483-436f-b13e-c887480f060f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dcec3648d3843dd96bfed76e793598a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:28.586403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5ed58-7483-436f-b13e-c887480f060f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:28.685367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-35e5ed58-7483-436f-b13e-c887480f060f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dcec3648d3843dd96bfed76e793598a', 'request_id': 'req-35e5ed58-7483-436f-b13e-c887480f060f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:11:28.697842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-35e5ed58-7483-436f-b13e-c887480f060f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dcec3648d3843dd96bfed76e793598a', 'request_id': 'req-35e5ed58-7483-436f-b13e-c887480f060f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:11:28.709136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-35e5ed58-7483-436f-b13e-c887480f060f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dcec3648d3843dd96bfed76e793598a', 'request_id': 'req-35e5ed58-7483-436f-b13e-c887480f060f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:11:28.727411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-35e5ed58-7483-436f-b13e-c887480f060f admin admin] The token cache is being invalidate because project 6dcec3648d3843dd96bfed76e793598a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:11:28.727804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-35e5ed58-7483-436f-b13e-c887480f060f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:11:28.728909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-35e5ed58-7483-436f-b13e-c887480f060f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:11:28.736903 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1805/3616] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:11:28 2022] DELETE /identity/v3/projects/6dcec3648d3843dd96bfed76e793598a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:11:28.741428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f776c-32bb-4aa4-a20c-850486cb037f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:28.743690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5e0f776c-32bb-4aa4-a20c-850486cb037f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:28.777201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f776c-32bb-4aa4-a20c-850486cb037f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:28.890000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea7b54-bf69-480c-859b-aed9f6c17415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:28.890888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea7b54-bf69-480c-859b-aed9f6c17415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:28.891374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea7b54-bf69-480c-859b-aed9f6c17415 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:28.891758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea7b54-bf69-480c-859b-aed9f6c17415 admin admin] PATH_INFO: `/v3/users/3a2370cb4f5f422e940ec81b74bb39b2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:28.893198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea7b54-bf69-480c-859b-aed9f6c17415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a2370cb4f5f422e940ec81b74bb39b2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:28.895960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea7b54-bf69-480c-859b-aed9f6c17415 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:29.006139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1cea7b54-bf69-480c-859b-aed9f6c17415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a2370cb4f5f422e940ec81b74bb39b2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:11:29.036234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:29.041153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1cea7b54-bf69-480c-859b-aed9f6c17415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a2370cb4f5f422e940ec81b74bb39b2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:11:29.042611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1cea7b54-bf69-480c-859b-aed9f6c17415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a2370cb4f5f422e940ec81b74bb39b2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:11:29.060536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1cea7b54-bf69-480c-859b-aed9f6c17415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a2370cb4f5f422e940ec81b74bb39b2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:11:29.061614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1cea7b54-bf69-480c-859b-aed9f6c17415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a2370cb4f5f422e940ec81b74bb39b2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:11:29.090957 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1812/3617] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:11:28 2022] DELETE /identity/v3/users/3a2370cb4f5f422e940ec81b74bb39b2 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:11:29.514751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5ed58-7483-436f-b13e-c887480f060f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:29.516353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-35e5ed58-7483-436f-b13e-c887480f060f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:29.544825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5ed58-7483-436f-b13e-c887480f060f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:29.576923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:29.644933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebca8f-16b9-40aa-b394-8a475840a265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:29.645874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebca8f-16b9-40aa-b394-8a475840a265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:29.646315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebca8f-16b9-40aa-b394-8a475840a265 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:29.646837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebca8f-16b9-40aa-b394-8a475840a265 admin admin] PATH_INFO: `/v3/projects/ceab0b2bf0de497b841655c7e3005051` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:29.648305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebca8f-16b9-40aa-b394-8a475840a265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceab0b2bf0de497b841655c7e3005051)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:29.650745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebca8f-16b9-40aa-b394-8a475840a265 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:29.721849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-43ebca8f-16b9-40aa-b394-8a475840a265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceab0b2bf0de497b841655c7e3005051', 'request_id': 'req-43ebca8f-16b9-40aa-b394-8a475840a265'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:11:29.734485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-43ebca8f-16b9-40aa-b394-8a475840a265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceab0b2bf0de497b841655c7e3005051', 'request_id': 'req-43ebca8f-16b9-40aa-b394-8a475840a265'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:11:29.757213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-43ebca8f-16b9-40aa-b394-8a475840a265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceab0b2bf0de497b841655c7e3005051', 'request_id': 'req-43ebca8f-16b9-40aa-b394-8a475840a265'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:11:29.770491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-43ebca8f-16b9-40aa-b394-8a475840a265 admin admin] The token cache is being invalidate because project ceab0b2bf0de497b841655c7e3005051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:11:29.770779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-43ebca8f-16b9-40aa-b394-8a475840a265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:11:29.771776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-43ebca8f-16b9-40aa-b394-8a475840a265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:11:29.773694 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1806/3618] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:11:29 2022] DELETE /identity/v3/projects/ceab0b2bf0de497b841655c7e3005051 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:11:29.787583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef01df-269e-49f0-98f6-723ca2067a1a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:29.788108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef01df-269e-49f0-98f6-723ca2067a1a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:29.788272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef01df-269e-49f0-98f6-723ca2067a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:29.809192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-05ef01df-269e-49f0-98f6-723ca2067a1a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:11:29.810572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-05ef01df-269e-49f0-98f6-723ca2067a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:29.885482 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1813/3619] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:11:29.893930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74061132-3659-4750-b99c-813d3872b7b5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:29.894232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74061132-3659-4750-b99c-813d3872b7b5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:29.894587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74061132-3659-4750-b99c-813d3872b7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:29.918156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-74061132-3659-4750-b99c-813d3872b7b5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:11:29.919637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-74061132-3659-4750-b99c-813d3872b7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:29.930981 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1807/3620] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:11:29.936470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef01df-269e-49f0-98f6-723ca2067a1a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:29.955279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef01df-269e-49f0-98f6-723ca2067a1a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:29.962690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c1dd8-3bd1-4e84-94d6-1e08d84a4bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:29.964150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c1dd8-3bd1-4e84-94d6-1e08d84a4bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:29.964508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c1dd8-3bd1-4e84-94d6-1e08d84a4bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:29.964799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c1dd8-3bd1-4e84-94d6-1e08d84a4bc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:29.965731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c1dd8-3bd1-4e84-94d6-1e08d84a4bc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:11:29.965889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c1dd8-3bd1-4e84-94d6-1e08d84a4bc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:29.967761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c1dd8-3bd1-4e84-94d6-1e08d84a4bc5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:29.991132 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1814/3621] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:11:29.993669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74061132-3659-4750-b99c-813d3872b7b5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:30.022870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74061132-3659-4750-b99c-813d3872b7b5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:30.031187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce5fe7-7227-4b8d-8b34-74e7ead744f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:30.033495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce5fe7-7227-4b8d-8b34-74e7ead744f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:30.033795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce5fe7-7227-4b8d-8b34-74e7ead744f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:30.034199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce5fe7-7227-4b8d-8b34-74e7ead744f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:30.034888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce5fe7-7227-4b8d-8b34-74e7ead744f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:30.046993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce5fe7-7227-4b8d-8b34-74e7ead744f9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:30.111372 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1808/3622] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:11:29 2022] POST /identity/v3/projects => generated 397 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:11:30.116094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c1dd8-3bd1-4e84-94d6-1e08d84a4bc5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:30.134237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c1dd8-3bd1-4e84-94d6-1e08d84a4bc5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:30.234831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a9836-d1ff-4bc6-a0fe-07d53c058953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:30.235729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a9836-d1ff-4bc6-a0fe-07d53c058953 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:30.236045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a9836-d1ff-4bc6-a0fe-07d53c058953 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:30.236429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a9836-d1ff-4bc6-a0fe-07d53c058953 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:30.237588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a9836-d1ff-4bc6-a0fe-07d53c058953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:30.240830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a9836-d1ff-4bc6-a0fe-07d53c058953 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:30.285341 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1815/3623] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:11:30 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:11:30.290733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce5fe7-7227-4b8d-8b34-74e7ead744f9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:30.305860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce5fe7-7227-4b8d-8b34-74e7ead744f9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:30.312575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b8ff3-d407-450a-a6c1-2c15ddfb98f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:30.313389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b8ff3-d407-450a-a6c1-2c15ddfb98f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:30.313846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b8ff3-d407-450a-a6c1-2c15ddfb98f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:30.314447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b8ff3-d407-450a-a6c1-2c15ddfb98f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:30.315120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b8ff3-d407-450a-a6c1-2c15ddfb98f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:30.317460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b8ff3-d407-450a-a6c1-2c15ddfb98f1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:30.333873 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1809/3624] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:11:30.338693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a9836-d1ff-4bc6-a0fe-07d53c058953 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:30.352273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a9836-d1ff-4bc6-a0fe-07d53c058953 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:30.359276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a8f06-390c-40c7-a4d7-b965ef8b1733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:30.360167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a8f06-390c-40c7-a4d7-b965ef8b1733 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:30.360536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a8f06-390c-40c7-a4d7-b965ef8b1733 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:30.360885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a8f06-390c-40c7-a4d7-b965ef8b1733 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:30.361729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a8f06-390c-40c7-a4d7-b965ef8b1733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:30.363399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a8f06-390c-40c7-a4d7-b965ef8b1733 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:30.375588 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1816/3625] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:11:30.380708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b8ff3-d407-450a-a6c1-2c15ddfb98f1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:30.392037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b8ff3-d407-450a-a6c1-2c15ddfb98f1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:30.398463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a47012-460e-4d4a-855b-8478b2301909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:30.399201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a47012-460e-4d4a-855b-8478b2301909 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:30.399647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a47012-460e-4d4a-855b-8478b2301909 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:30.400074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a47012-460e-4d4a-855b-8478b2301909 admin admin] PATH_INFO: `/v3/projects/b6c50d273347476986fe5cff264295c0/users/d9d75013f5714db097bb2975b57d5328/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:30.423922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a47012-460e-4d4a-855b-8478b2301909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c50d273347476986fe5cff264295c0, user_id=d9d75013f5714db097bb2975b57d5328, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:30.426662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a47012-460e-4d4a-855b-8478b2301909 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:30.449278 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1810/3626] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:11:30 2022] PUT /identity/v3/projects/b6c50d273347476986fe5cff264295c0/users/d9d75013f5714db097bb2975b57d5328/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:11:30.455237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabaaa8-9269-435a-9d61-f38d49be4267 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:30.455745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabaaa8-9269-435a-9d61-f38d49be4267 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:30.456238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabaaa8-9269-435a-9d61-f38d49be4267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:30.484570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-afabaaa8-9269-435a-9d61-f38d49be4267 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:11:30.486038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-afabaaa8-9269-435a-9d61-f38d49be4267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:30.546109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:30.587630 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1817/3627] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:11:30.599664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a47012-460e-4d4a-855b-8478b2301909 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:30.601439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-52a47012-460e-4d4a-855b-8478b2301909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:30.732772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:30.758486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a47012-460e-4d4a-855b-8478b2301909 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:30.763131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0efc22-0147-439f-a40b-b83b5ae5f88d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:30.764079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0efc22-0147-439f-a40b-b83b5ae5f88d service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:30.764371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0efc22-0147-439f-a40b-b83b5ae5f88d service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:30.764646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0efc22-0147-439f-a40b-b83b5ae5f88d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:30.775493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0efc22-0147-439f-a40b-b83b5ae5f88d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:30.777001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0efc22-0147-439f-a40b-b83b5ae5f88d service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:30.791567 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1811/3628] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:11:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:11:33.734112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a125138-522a-48fb-b14b-5bb0cfe5a266 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:33.734647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a125138-522a-48fb-b14b-5bb0cfe5a266 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:33.734647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a125138-522a-48fb-b14b-5bb0cfe5a266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:33.766256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5a125138-522a-48fb-b14b-5bb0cfe5a266 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:11:33.767100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5a125138-522a-48fb-b14b-5bb0cfe5a266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:33.895508 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1818/3629] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:11:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:11:33.908963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0efc22-0147-439f-a40b-b83b5ae5f88d service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:33.911211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ea0efc22-0147-439f-a40b-b83b5ae5f88d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:34.068507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0efc22-0147-439f-a40b-b83b5ae5f88d service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:34.078556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9c840-69de-4f6b-b0fc-7fabd23ad9df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:34.079563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9c840-69de-4f6b-b0fc-7fabd23ad9df service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:34.080014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9c840-69de-4f6b-b0fc-7fabd23ad9df service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:34.080495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9c840-69de-4f6b-b0fc-7fabd23ad9df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:34.093485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9c840-69de-4f6b-b0fc-7fabd23ad9df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:34.096150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9c840-69de-4f6b-b0fc-7fabd23ad9df service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:34.106247 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1812/3630] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:11:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:11:36.298156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849429b-5704-4624-874a-d246fb999374 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:36.298750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849429b-5704-4624-874a-d246fb999374 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:36.298989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849429b-5704-4624-874a-d246fb999374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:36.362267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c849429b-5704-4624-874a-d246fb999374 None None] MFA Rules not processed for user `8b930b074300497fa17ae36dc074c586`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:11:36.365450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c849429b-5704-4624-874a-d246fb999374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:36.519540 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1819/3631] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:11:36.684555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2e4be-06ea-460a-bf0c-690ab283300b None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:36.685397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2e4be-06ea-460a-bf0c-690ab283300b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:36.685817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2e4be-06ea-460a-bf0c-690ab283300b None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:36.687866 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1813/3632] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:11:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:11:36.698718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd54bb-2cce-4346-a33a-a9980a47d1c1 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:36.699215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd54bb-2cce-4346-a33a-a9980a47d1c1 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:36.699690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd54bb-2cce-4346-a33a-a9980a47d1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:36.760110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1bbd54bb-2cce-4346-a33a-a9980a47d1c1 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:11:36.762094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1bbd54bb-2cce-4346-a33a-a9980a47d1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:36.854940 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1820/3633] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:11:36.906985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2e4be-06ea-460a-bf0c-690ab283300b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:36.909048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-37d2e4be-06ea-460a-bf0c-690ab283300b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:36.965375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2e4be-06ea-460a-bf0c-690ab283300b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:36.977332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7d3b0-4ec8-4298-8995-4f9e10c226a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:36.978261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7d3b0-4ec8-4298-8995-4f9e10c226a6 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:36.978774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7d3b0-4ec8-4298-8995-4f9e10c226a6 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:36.979276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7d3b0-4ec8-4298-8995-4f9e10c226a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:37.016693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7d3b0-4ec8-4298-8995-4f9e10c226a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:37.018560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7d3b0-4ec8-4298-8995-4f9e10c226a6 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:37.052340 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1814/3634] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:11:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:11:37.817419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bd49a-5641-462a-a063-7d0a529c10b5 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:37.818561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bd49a-5641-462a-a063-7d0a529c10b5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:37.818561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bd49a-5641-462a-a063-7d0a529c10b5 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:37.820998 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1821/3635] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:11:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:11:37.826437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aaeb6d-72a5-4e36-b975-87b5b8e1d43c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:37.826923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aaeb6d-72a5-4e36-b975-87b5b8e1d43c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:37.827020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aaeb6d-72a5-4e36-b975-87b5b8e1d43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:37.877846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c5aaeb6d-72a5-4e36-b975-87b5b8e1d43c None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:11:37.879238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c5aaeb6d-72a5-4e36-b975-87b5b8e1d43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:37.929003 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1815/3636] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:11:37.962026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bd49a-5641-462a-a063-7d0a529c10b5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:38.010816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bd49a-5641-462a-a063-7d0a529c10b5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:38.044876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad0583-d2f1-4b9c-acff-89ee159907de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:38.045691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad0583-d2f1-4b9c-acff-89ee159907de service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:38.045985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad0583-d2f1-4b9c-acff-89ee159907de service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:38.046386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad0583-d2f1-4b9c-acff-89ee159907de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:38.082941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad0583-d2f1-4b9c-acff-89ee159907de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:38.085173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad0583-d2f1-4b9c-acff-89ee159907de service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:38.117931 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1822/3637] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:11:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:11:42.293815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c99738-fbfc-4b44-9eb0-1a2096dc7543 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:42.294486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c99738-fbfc-4b44-9eb0-1a2096dc7543 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:42.294486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c99738-fbfc-4b44-9eb0-1a2096dc7543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:42.350788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b6c99738-fbfc-4b44-9eb0-1a2096dc7543 None None] MFA Rules not processed for user `d9d75013f5714db097bb2975b57d5328`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:11:42.354559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b6c99738-fbfc-4b44-9eb0-1a2096dc7543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:42.515048 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1816/3638] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:11:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:11:42.516225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d847d1c-9b45-474e-aa7c-f896336a9c11 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:42.516694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d847d1c-9b45-474e-aa7c-f896336a9c11 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:42.516946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d847d1c-9b45-474e-aa7c-f896336a9c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:42.583112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4d847d1c-9b45-474e-aa7c-f896336a9c11 None None] MFA Rules not processed for user `d9d75013f5714db097bb2975b57d5328`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:11:42.585389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4d847d1c-9b45-474e-aa7c-f896336a9c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:42.594953 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1823/3639] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:11:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:11:42.608676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c99738-fbfc-4b44-9eb0-1a2096dc7543 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:42.610127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b6c99738-fbfc-4b44-9eb0-1a2096dc7543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:42.760396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:42.830745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c99738-fbfc-4b44-9eb0-1a2096dc7543 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:42.839339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e212dcd-0e6e-4a77-9ff9-4c663e10dd03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:42.841758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e212dcd-0e6e-4a77-9ff9-4c663e10dd03 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:42.843250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e212dcd-0e6e-4a77-9ff9-4c663e10dd03 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:42.843983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e212dcd-0e6e-4a77-9ff9-4c663e10dd03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:42.857398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e212dcd-0e6e-4a77-9ff9-4c663e10dd03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:42.859421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e212dcd-0e6e-4a77-9ff9-4c663e10dd03 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:42.873014 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1817/3640] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:11:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:11:46.143591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4f63f-b26f-43fd-9cdd-f714037d344a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:46.145926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4f63f-b26f-43fd-9cdd-f714037d344a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:46.148334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4f63f-b26f-43fd-9cdd-f714037d344a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:46.219635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0cc4f63f-b26f-43fd-9cdd-f714037d344a None None] MFA Rules not processed for user `b839893e78134428a3cf451901129edc`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:11:46.226781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0cc4f63f-b26f-43fd-9cdd-f714037d344a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:46.239637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:46.402045 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1824/3641] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:11:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:11:48.637379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5a7f-944d-4342-ba30-480750fdb3d0 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:48.637873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5a7f-944d-4342-ba30-480750fdb3d0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:48.638241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5a7f-944d-4342-ba30-480750fdb3d0 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:48.640840 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1818/3642] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:11:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:11:48.647919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d4ae9-d7b7-459a-8ec1-a8ca36d8f8d5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:48.648774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d4ae9-d7b7-459a-8ec1-a8ca36d8f8d5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:48.649184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d4ae9-d7b7-459a-8ec1-a8ca36d8f8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:48.689604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1e6d4ae9-d7b7-459a-8ec1-a8ca36d8f8d5 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:11:48.690851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1e6d4ae9-d7b7-459a-8ec1-a8ca36d8f8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:48.710387 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1825/3643] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:11:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:11:48.759955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a5a7f-944d-4342-ba30-480750fdb3d0 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:48.786398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a5a7f-944d-4342-ba30-480750fdb3d0 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:48.798135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe82553-477f-4234-ac26-6e685c89e0e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:48.799906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe82553-477f-4234-ac26-6e685c89e0e6 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:48.800362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe82553-477f-4234-ac26-6e685c89e0e6 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:48.800845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe82553-477f-4234-ac26-6e685c89e0e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:48.813314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe82553-477f-4234-ac26-6e685c89e0e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:48.815125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe82553-477f-4234-ac26-6e685c89e0e6 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:48.826828 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1819/3644] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:11:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:11:49.075400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5769ee8-a0d7-4b1d-a7fd-c9a5418b56cc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:49.075969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5769ee8-a0d7-4b1d-a7fd-c9a5418b56cc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:49.076718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5769ee8-a0d7-4b1d-a7fd-c9a5418b56cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:49.108818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c5769ee8-a0d7-4b1d-a7fd-c9a5418b56cc None None] MFA Rules not processed for user `b839893e78134428a3cf451901129edc`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:11:49.110329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c5769ee8-a0d7-4b1d-a7fd-c9a5418b56cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:49.119243 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1826/3645] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:11:50.425226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f3c08-954f-4876-84e0-213e70590752 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:50.425777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f3c08-954f-4876-84e0-213e70590752 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:50.425894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f3c08-954f-4876-84e0-213e70590752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:50.467377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9c5f3c08-954f-4876-84e0-213e70590752 None None] MFA Rules not processed for user `36fe4dfa0f564eedb8deb3491a5068a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:11:50.468884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9c5f3c08-954f-4876-84e0-213e70590752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:50.546605 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1820/3646] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:11:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:11:59.102071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=26 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:59.176280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39283c7f-f841-48d2-b206-847faa70bcdf None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:59.176761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39283c7f-f841-48d2-b206-847faa70bcdf None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:59.177205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39283c7f-f841-48d2-b206-847faa70bcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:59.203440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-39283c7f-f841-48d2-b206-847faa70bcdf None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:11:59.205050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-39283c7f-f841-48d2-b206-847faa70bcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:11:59.214951 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1827/3647] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:11:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:11:59.244274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f3c08-954f-4876-84e0-213e70590752 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:11:59.260207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f3c08-954f-4876-84e0-213e70590752 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:11:59.267694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1f5a9-ecc5-425b-9b90-b6194aa36e5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:11:59.268535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1f5a9-ecc5-425b-9b90-b6194aa36e5e service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:11:59.268993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1f5a9-ecc5-425b-9b90-b6194aa36e5e service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:11:59.269836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1f5a9-ecc5-425b-9b90-b6194aa36e5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:11:59.291604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1f5a9-ecc5-425b-9b90-b6194aa36e5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:11:59.293676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1f5a9-ecc5-425b-9b90-b6194aa36e5e service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:11:59.310613 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1821/3648] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:11:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:12:02.989082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8ef7b-608a-41a1-af51-cb50890eefcd None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:02.990261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8ef7b-608a-41a1-af51-cb50890eefcd None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:02.996125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8ef7b-608a-41a1-af51-cb50890eefcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:03.023865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0ac8ef7b-608a-41a1-af51-cb50890eefcd None None] MFA Rules not processed for user `d9d75013f5714db097bb2975b57d5328`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:12:03.025566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0ac8ef7b-608a-41a1-af51-cb50890eefcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:03.034571 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1828/3649] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:12:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:12:09.306661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=52 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:13.016924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:15.036349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae97a0-f5fe-428d-a2e9-6334adc049ad None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:15.037253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae97a0-f5fe-428d-a2e9-6334adc049ad None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:15.037609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae97a0-f5fe-428d-a2e9-6334adc049ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:15.073888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-59ae97a0-f5fe-428d-a2e9-6334adc049ad None None] MFA Rules not processed for user `b839893e78134428a3cf451901129edc`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:12:15.076086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-59ae97a0-f5fe-428d-a2e9-6334adc049ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:15.096760 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1822/3650] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:12:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:12:16.121535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8ef7b-608a-41a1-af51-cb50890eefcd None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:16.123597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0ac8ef7b-608a-41a1-af51-cb50890eefcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:16.145558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8ef7b-608a-41a1-af51-cb50890eefcd None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:16.152335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99dbd6-5c99-4560-a2c6-641afdd0f891 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:16.153234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99dbd6-5c99-4560-a2c6-641afdd0f891 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:16.153761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99dbd6-5c99-4560-a2c6-641afdd0f891 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:16.154269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99dbd6-5c99-4560-a2c6-641afdd0f891 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:16.165851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ee99dbd6-5c99-4560-a2c6-641afdd0f891 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:16.182837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99dbd6-5c99-4560-a2c6-641afdd0f891 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:16.184473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99dbd6-5c99-4560-a2c6-641afdd0f891 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:16.196227 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1829/3651] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:12:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:12:16.569126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae97a0-f5fe-428d-a2e9-6334adc049ad None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:16.571401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-59ae97a0-f5fe-428d-a2e9-6334adc049ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:16.597391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae97a0-f5fe-428d-a2e9-6334adc049ad None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:16.610525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59094072-6d1f-474e-b5c8-0ab3dba8b302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:16.611263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59094072-6d1f-474e-b5c8-0ab3dba8b302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:16.611644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59094072-6d1f-474e-b5c8-0ab3dba8b302 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:16.612009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59094072-6d1f-474e-b5c8-0ab3dba8b302 admin admin] PATH_INFO: `/v3/users/f5f8f28630a3430f81fa884985963a9b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:16.616254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59094072-6d1f-474e-b5c8-0ab3dba8b302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f8f28630a3430f81fa884985963a9b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:16.618269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59094072-6d1f-474e-b5c8-0ab3dba8b302 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:16.719789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59094072-6d1f-474e-b5c8-0ab3dba8b302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f8f28630a3430f81fa884985963a9b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:16.720505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59094072-6d1f-474e-b5c8-0ab3dba8b302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f8f28630a3430f81fa884985963a9b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:16.744137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59094072-6d1f-474e-b5c8-0ab3dba8b302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f8f28630a3430f81fa884985963a9b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:16.749334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59094072-6d1f-474e-b5c8-0ab3dba8b302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f8f28630a3430f81fa884985963a9b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:16.760502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59094072-6d1f-474e-b5c8-0ab3dba8b302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f8f28630a3430f81fa884985963a9b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:16.779205 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1823/3652] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:12:16 2022] DELETE /identity/v3/users/f5f8f28630a3430f81fa884985963a9b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:12:17.045235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99dbd6-5c99-4560-a2c6-641afdd0f891 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:17.062391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99dbd6-5c99-4560-a2c6-641afdd0f891 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:17.205493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245c6ff-071f-46bc-9955-65c66ae50af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:17.208364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245c6ff-071f-46bc-9955-65c66ae50af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:17.208656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245c6ff-071f-46bc-9955-65c66ae50af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:17.208939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245c6ff-071f-46bc-9955-65c66ae50af0 admin admin] PATH_INFO: `/v3/projects/07faa65e8ff5420a92cab2a17cd2cc74` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:17.211008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245c6ff-071f-46bc-9955-65c66ae50af0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07faa65e8ff5420a92cab2a17cd2cc74)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:17.216295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245c6ff-071f-46bc-9955-65c66ae50af0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:17.328829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f245c6ff-071f-46bc-9955-65c66ae50af0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07faa65e8ff5420a92cab2a17cd2cc74', 'request_id': 'req-f245c6ff-071f-46bc-9955-65c66ae50af0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:17.351168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f245c6ff-071f-46bc-9955-65c66ae50af0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07faa65e8ff5420a92cab2a17cd2cc74', 'request_id': 'req-f245c6ff-071f-46bc-9955-65c66ae50af0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:17.368378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f245c6ff-071f-46bc-9955-65c66ae50af0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07faa65e8ff5420a92cab2a17cd2cc74', 'request_id': 'req-f245c6ff-071f-46bc-9955-65c66ae50af0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:17.398955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f245c6ff-071f-46bc-9955-65c66ae50af0 admin admin] The token cache is being invalidate because project 07faa65e8ff5420a92cab2a17cd2cc74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:12:17.399721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f245c6ff-071f-46bc-9955-65c66ae50af0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:17.400624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f245c6ff-071f-46bc-9955-65c66ae50af0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:17.403830 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1830/3653] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:12:17 2022] DELETE /identity/v3/projects/07faa65e8ff5420a92cab2a17cd2cc74 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:12:17.411007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509da683-c57e-4143-95e2-3f76e716c9fc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:17.411327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509da683-c57e-4143-95e2-3f76e716c9fc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:17.411604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509da683-c57e-4143-95e2-3f76e716c9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:17.446772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-509da683-c57e-4143-95e2-3f76e716c9fc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:12:17.448072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-509da683-c57e-4143-95e2-3f76e716c9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:17.536565 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1824/3654] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:12:17.538284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30228b-078c-477d-b700-ba11488eb5c7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:17.538517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30228b-078c-477d-b700-ba11488eb5c7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:17.538800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30228b-078c-477d-b700-ba11488eb5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:17.560051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5b30228b-078c-477d-b700-ba11488eb5c7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:12:17.561282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5b30228b-078c-477d-b700-ba11488eb5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:17.573425 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1831/3655] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:12:17.574616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509da683-c57e-4143-95e2-3f76e716c9fc None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:17.586253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509da683-c57e-4143-95e2-3f76e716c9fc None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:17.601041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d7c2e-27be-413b-b5a0-41078f5b6cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:17.601801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d7c2e-27be-413b-b5a0-41078f5b6cac admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:17.602242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d7c2e-27be-413b-b5a0-41078f5b6cac admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:17.602619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d7c2e-27be-413b-b5a0-41078f5b6cac admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:17.603560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d7c2e-27be-413b-b5a0-41078f5b6cac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:12:17.603901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d7c2e-27be-413b-b5a0-41078f5b6cac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:17.606517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d7c2e-27be-413b-b5a0-41078f5b6cac admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:17.618992 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1825/3656] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:12:17.623584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30228b-078c-477d-b700-ba11488eb5c7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:17.633743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30228b-078c-477d-b700-ba11488eb5c7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:17.639735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76d8df-bfd9-45c7-b0c6-acf9bd79ec16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:17.640519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76d8df-bfd9-45c7-b0c6-acf9bd79ec16 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:17.640919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76d8df-bfd9-45c7-b0c6-acf9bd79ec16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:17.641181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76d8df-bfd9-45c7-b0c6-acf9bd79ec16 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:17.642708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76d8df-bfd9-45c7-b0c6-acf9bd79ec16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:17.645281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76d8df-bfd9-45c7-b0c6-acf9bd79ec16 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:17.683243 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1832/3657] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:12:17 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:12:17.691867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d7c2e-27be-413b-b5a0-41078f5b6cac admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:17.703196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d7c2e-27be-413b-b5a0-41078f5b6cac admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:17.763390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:17.779114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e5930-7818-4903-a18d-c446ef674dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:17.780160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e5930-7818-4903-a18d-c446ef674dac admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:17.780911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e5930-7818-4903-a18d-c446ef674dac admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:17.781469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e5930-7818-4903-a18d-c446ef674dac admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:17.782326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e5930-7818-4903-a18d-c446ef674dac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:17.784572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e5930-7818-4903-a18d-c446ef674dac admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:17.812408 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1826/3658] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:12:17 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:12:17.816702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76d8df-bfd9-45c7-b0c6-acf9bd79ec16 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:17.829211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76d8df-bfd9-45c7-b0c6-acf9bd79ec16 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:17.835593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d9f08-710d-4f7a-89fd-52c947bf736c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:17.836405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d9f08-710d-4f7a-89fd-52c947bf736c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:17.837019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d9f08-710d-4f7a-89fd-52c947bf736c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:17.837415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d9f08-710d-4f7a-89fd-52c947bf736c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:17.838991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d9f08-710d-4f7a-89fd-52c947bf736c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:17.840834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d9f08-710d-4f7a-89fd-52c947bf736c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:17.856517 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1833/3659] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:12:17.859799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e5930-7818-4903-a18d-c446ef674dac admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:17.871169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e5930-7818-4903-a18d-c446ef674dac admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:17.876863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cf6a9-7375-47b9-b045-afa1b8c4c2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:17.877494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cf6a9-7375-47b9-b045-afa1b8c4c2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:17.877776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cf6a9-7375-47b9-b045-afa1b8c4c2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:17.878748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cf6a9-7375-47b9-b045-afa1b8c4c2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:17.879510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cf6a9-7375-47b9-b045-afa1b8c4c2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:17.881334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cf6a9-7375-47b9-b045-afa1b8c4c2e5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:17.896389 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1827/3660] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:12:17.902313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d9f08-710d-4f7a-89fd-52c947bf736c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:17.920689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d9f08-710d-4f7a-89fd-52c947bf736c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:17.941321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46828cb-f141-4663-8ba1-c3961492401b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:17.942296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46828cb-f141-4663-8ba1-c3961492401b admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:17.942685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46828cb-f141-4663-8ba1-c3961492401b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:17.943077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46828cb-f141-4663-8ba1-c3961492401b admin admin] PATH_INFO: `/v3/projects/afa70c1fb55148909a98d8628111983e/users/8f4da0578588431db5da2d58455e8364/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:17.976193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46828cb-f141-4663-8ba1-c3961492401b admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa70c1fb55148909a98d8628111983e, user_id=8f4da0578588431db5da2d58455e8364, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:17.981329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46828cb-f141-4663-8ba1-c3961492401b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:18.017332 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1834/3661] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:12:17 2022] PUT /identity/v3/projects/afa70c1fb55148909a98d8628111983e/users/8f4da0578588431db5da2d58455e8364/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:12:18.028034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2e69f-2230-4ad3-b573-e18ed702f336 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:18.028320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2e69f-2230-4ad3-b573-e18ed702f336 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:18.028764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2e69f-2230-4ad3-b573-e18ed702f336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:18.066642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e1b2e69f-2230-4ad3-b573-e18ed702f336 None None] MFA Rules not processed for user `8f4da0578588431db5da2d58455e8364`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:12:18.067848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e1b2e69f-2230-4ad3-b573-e18ed702f336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:18.203451 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1828/3662] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:12:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:12:18.301016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9dba2-fefe-464e-b8ec-d91dc38d5c78 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:18.301578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9dba2-fefe-464e-b8ec-d91dc38d5c78 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:18.301578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9dba2-fefe-464e-b8ec-d91dc38d5c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:18.337991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bfb9dba2-fefe-464e-b8ec-d91dc38d5c78 None None] MFA Rules not processed for user `8f4da0578588431db5da2d58455e8364`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:12:18.339242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bfb9dba2-fefe-464e-b8ec-d91dc38d5c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:18.364240 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1835/3663] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:12:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:12:18.371134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2e69f-2230-4ad3-b573-e18ed702f336 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:18.372861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e1b2e69f-2230-4ad3-b573-e18ed702f336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:18.517946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2e69f-2230-4ad3-b573-e18ed702f336 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:18.525159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d96950-4e88-4b2d-bf0f-119890f7cf1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:18.525801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d96950-4e88-4b2d-bf0f-119890f7cf1d service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:18.526100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d96950-4e88-4b2d-bf0f-119890f7cf1d service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:18.526385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d96950-4e88-4b2d-bf0f-119890f7cf1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:18.536823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d96950-4e88-4b2d-bf0f-119890f7cf1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:18.538522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d96950-4e88-4b2d-bf0f-119890f7cf1d service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:18.549072 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1829/3664] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:12:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:12:19.092103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9dba2-fefe-464e-b8ec-d91dc38d5c78 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:19.093585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bfb9dba2-fefe-464e-b8ec-d91dc38d5c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:19.116734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:19.232258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9dba2-fefe-464e-b8ec-d91dc38d5c78 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:19.248027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922ef67-f40e-487c-a87d-e128c1017b08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:19.248907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922ef67-f40e-487c-a87d-e128c1017b08 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:19.249376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922ef67-f40e-487c-a87d-e128c1017b08 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:19.250107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922ef67-f40e-487c-a87d-e128c1017b08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:19.252839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f922ef67-f40e-487c-a87d-e128c1017b08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:19.445473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922ef67-f40e-487c-a87d-e128c1017b08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:19.449265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922ef67-f40e-487c-a87d-e128c1017b08 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:19.477417 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1836/3665] 10.222.0.17 () {60 vars in 1396 bytes} [Sat Jul 30 21:12:19 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:12:21.433831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d96950-4e88-4b2d-bf0f-119890f7cf1d service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:21.435337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e7d96950-4e88-4b2d-bf0f-119890f7cf1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:21.547244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:21.580520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922ef67-f40e-487c-a87d-e128c1017b08 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:21.581445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f922ef67-f40e-487c-a87d-e128c1017b08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:21.592643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d96950-4e88-4b2d-bf0f-119890f7cf1d service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:21.607827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57756a-5134-4c8d-a637-53f1ecb80bad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:21.610838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57756a-5134-4c8d-a637-53f1ecb80bad service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:21.611131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57756a-5134-4c8d-a637-53f1ecb80bad service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:21.611443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57756a-5134-4c8d-a637-53f1ecb80bad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:21.623053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3a57756a-5134-4c8d-a637-53f1ecb80bad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:21.647455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57756a-5134-4c8d-a637-53f1ecb80bad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:21.651762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57756a-5134-4c8d-a637-53f1ecb80bad service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:21.700523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922ef67-f40e-487c-a87d-e128c1017b08 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:21.704740 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1830/3666] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:12:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:12:21.713276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c0349-eec7-44fb-a864-ef7e98228a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:21.715012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c0349-eec7-44fb-a864-ef7e98228a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:21.715563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c0349-eec7-44fb-a864-ef7e98228a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:21.716389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c0349-eec7-44fb-a864-ef7e98228a0a admin admin] PATH_INFO: `/v3/users/eb637624ed0f48c9b4ad60e2cda88eb8` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:21.718570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c0349-eec7-44fb-a864-ef7e98228a0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb637624ed0f48c9b4ad60e2cda88eb8)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:21.721453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c0349-eec7-44fb-a864-ef7e98228a0a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:21.808498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-954c0349-eec7-44fb-a864-ef7e98228a0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb637624ed0f48c9b4ad60e2cda88eb8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:21.835123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:21.836700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-954c0349-eec7-44fb-a864-ef7e98228a0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb637624ed0f48c9b4ad60e2cda88eb8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:21.837564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-954c0349-eec7-44fb-a864-ef7e98228a0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb637624ed0f48c9b4ad60e2cda88eb8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:21.846164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-954c0349-eec7-44fb-a864-ef7e98228a0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb637624ed0f48c9b4ad60e2cda88eb8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:21.847189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-954c0349-eec7-44fb-a864-ef7e98228a0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb637624ed0f48c9b4ad60e2cda88eb8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:21.879842 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1837/3667] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:12:21 2022] DELETE /identity/v3/users/eb637624ed0f48c9b4ad60e2cda88eb8 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:12:22.279680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57756a-5134-4c8d-a637-53f1ecb80bad service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:22.319145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57756a-5134-4c8d-a637-53f1ecb80bad service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:22.405907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59923bbf-9a8f-46ef-b735-15549ce7d0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:22.406564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59923bbf-9a8f-46ef-b735-15549ce7d0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:22.406856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59923bbf-9a8f-46ef-b735-15549ce7d0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:22.407468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59923bbf-9a8f-46ef-b735-15549ce7d0c3 admin admin] PATH_INFO: `/v3/projects/7174018ac671484ab204d0ad1559d683` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:22.409408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59923bbf-9a8f-46ef-b735-15549ce7d0c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7174018ac671484ab204d0ad1559d683)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:22.411976 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59923bbf-9a8f-46ef-b735-15549ce7d0c3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:22.487054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59923bbf-9a8f-46ef-b735-15549ce7d0c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7174018ac671484ab204d0ad1559d683', 'request_id': 'req-59923bbf-9a8f-46ef-b735-15549ce7d0c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:22.502607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59923bbf-9a8f-46ef-b735-15549ce7d0c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7174018ac671484ab204d0ad1559d683', 'request_id': 'req-59923bbf-9a8f-46ef-b735-15549ce7d0c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:22.515148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59923bbf-9a8f-46ef-b735-15549ce7d0c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7174018ac671484ab204d0ad1559d683', 'request_id': 'req-59923bbf-9a8f-46ef-b735-15549ce7d0c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:22.546204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59923bbf-9a8f-46ef-b735-15549ce7d0c3 admin admin] The token cache is being invalidate because project 7174018ac671484ab204d0ad1559d683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:12:22.546692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59923bbf-9a8f-46ef-b735-15549ce7d0c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:22.547631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-59923bbf-9a8f-46ef-b735-15549ce7d0c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:22.552104 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1831/3668] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:12:22 2022] DELETE /identity/v3/projects/7174018ac671484ab204d0ad1559d683 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:12:22.557484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc35001-e9a2-4154-98b3-2fdbe7b1b399 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:22.557774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc35001-e9a2-4154-98b3-2fdbe7b1b399 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:22.558053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc35001-e9a2-4154-98b3-2fdbe7b1b399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:22.594558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3fc35001-e9a2-4154-98b3-2fdbe7b1b399 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:12:22.597934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3fc35001-e9a2-4154-98b3-2fdbe7b1b399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:22.697840 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1838/3669] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:12:22.701321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c48493-f1e7-4ed7-abea-3cc67ec04439 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:22.701859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c48493-f1e7-4ed7-abea-3cc67ec04439 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:22.702383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c48493-f1e7-4ed7-abea-3cc67ec04439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:22.744032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e7c48493-f1e7-4ed7-abea-3cc67ec04439 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:12:22.748523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e7c48493-f1e7-4ed7-abea-3cc67ec04439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:22.761740 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1832/3670] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:12:22.765801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc35001-e9a2-4154-98b3-2fdbe7b1b399 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:22.775800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc35001-e9a2-4154-98b3-2fdbe7b1b399 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:22.780586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b37a1-d96b-4425-b074-67a400b4ceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:22.781225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b37a1-d96b-4425-b074-67a400b4ceb4 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:22.781510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b37a1-d96b-4425-b074-67a400b4ceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:22.781792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b37a1-d96b-4425-b074-67a400b4ceb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:22.782567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b37a1-d96b-4425-b074-67a400b4ceb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:12:22.782915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b37a1-d96b-4425-b074-67a400b4ceb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:22.786864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b37a1-d96b-4425-b074-67a400b4ceb4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:22.802171 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1839/3671] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:12:22.806354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c48493-f1e7-4ed7-abea-3cc67ec04439 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:22.816301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c48493-f1e7-4ed7-abea-3cc67ec04439 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:22.821246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d29de8-629c-440c-acec-2a92bad4bece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:22.821874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d29de8-629c-440c-acec-2a92bad4bece admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:22.822158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d29de8-629c-440c-acec-2a92bad4bece admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:22.822437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d29de8-629c-440c-acec-2a92bad4bece admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:22.823113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d29de8-629c-440c-acec-2a92bad4bece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:22.825283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d29de8-629c-440c-acec-2a92bad4bece admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:22.868259 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1833/3672] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:12:22 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:12:22.872331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b37a1-d96b-4425-b074-67a400b4ceb4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:22.888102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b37a1-d96b-4425-b074-67a400b4ceb4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:22.985058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4ebb5-3187-428c-abc3-91cd5365e90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:22.985757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4ebb5-3187-428c-abc3-91cd5365e90e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:22.986045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4ebb5-3187-428c-abc3-91cd5365e90e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:22.986318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4ebb5-3187-428c-abc3-91cd5365e90e admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:22.987062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4ebb5-3187-428c-abc3-91cd5365e90e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:22.990190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4ebb5-3187-428c-abc3-91cd5365e90e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:23.029080 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1840/3673] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:12:22 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:12:23.032864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d29de8-629c-440c-acec-2a92bad4bece admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:23.048131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d29de8-629c-440c-acec-2a92bad4bece admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:23.059431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec41a3-e545-4df5-a0e4-4a90ecf43501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:23.061565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec41a3-e545-4df5-a0e4-4a90ecf43501 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:23.061994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec41a3-e545-4df5-a0e4-4a90ecf43501 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:23.062625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec41a3-e545-4df5-a0e4-4a90ecf43501 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:23.063914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec41a3-e545-4df5-a0e4-4a90ecf43501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:23.068613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec41a3-e545-4df5-a0e4-4a90ecf43501 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:23.091952 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1834/3674] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:12:23.096370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4ebb5-3187-428c-abc3-91cd5365e90e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:23.122650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4ebb5-3187-428c-abc3-91cd5365e90e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:23.129126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a796a-518a-4845-a8f9-55a09a0d54bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:23.130280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a796a-518a-4845-a8f9-55a09a0d54bf admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:23.131377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a796a-518a-4845-a8f9-55a09a0d54bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:23.132067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a796a-518a-4845-a8f9-55a09a0d54bf admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:23.133187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a796a-518a-4845-a8f9-55a09a0d54bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:23.135625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a796a-518a-4845-a8f9-55a09a0d54bf admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:23.153704 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1841/3675] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:12:23.157480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec41a3-e545-4df5-a0e4-4a90ecf43501 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:23.182979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec41a3-e545-4df5-a0e4-4a90ecf43501 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:23.191061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc9358-bb49-4c2e-a65e-7c8039d98736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:23.191921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc9358-bb49-4c2e-a65e-7c8039d98736 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:23.192306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc9358-bb49-4c2e-a65e-7c8039d98736 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:23.193309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc9358-bb49-4c2e-a65e-7c8039d98736 admin admin] PATH_INFO: `/v3/projects/a2471207e4614f369934b1723545d1f3/users/c4fc3f756d034b339878ee04f0469df0/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:23.259548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc9358-bb49-4c2e-a65e-7c8039d98736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2471207e4614f369934b1723545d1f3, user_id=c4fc3f756d034b339878ee04f0469df0, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:23.262748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc9358-bb49-4c2e-a65e-7c8039d98736 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:23.301096 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1835/3676] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:12:23 2022] PUT /identity/v3/projects/a2471207e4614f369934b1723545d1f3/users/c4fc3f756d034b339878ee04f0469df0/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:12:23.307076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63754804-a37b-4f24-b7a9-6c1f35c6e608 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:23.307421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63754804-a37b-4f24-b7a9-6c1f35c6e608 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:23.308036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63754804-a37b-4f24-b7a9-6c1f35c6e608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:23.344103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-63754804-a37b-4f24-b7a9-6c1f35c6e608 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:12:23.348011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-63754804-a37b-4f24-b7a9-6c1f35c6e608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:23.433781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:23.468448 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1842/3677] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:12:23.528797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc9358-bb49-4c2e-a65e-7c8039d98736 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:23.530944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3bfc9358-bb49-4c2e-a65e-7c8039d98736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:23.537247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:23.627489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc9358-bb49-4c2e-a65e-7c8039d98736 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:23.637225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a6c22-33ca-46ff-ae74-c94b272df882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:23.638676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a6c22-33ca-46ff-ae74-c94b272df882 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:23.640174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a6c22-33ca-46ff-ae74-c94b272df882 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:23.640467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a6c22-33ca-46ff-ae74-c94b272df882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:23.652389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a6c22-33ca-46ff-ae74-c94b272df882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:23.653856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a6c22-33ca-46ff-ae74-c94b272df882 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:23.667760 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1836/3678] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:12:30.541602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63754804-a37b-4f24-b7a9-6c1f35c6e608 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:30.546852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-63754804-a37b-4f24-b7a9-6c1f35c6e608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:30.564609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63754804-a37b-4f24-b7a9-6c1f35c6e608 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:30.575613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aaa084-d24b-461e-9754-94b091a89063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:30.584831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aaa084-d24b-461e-9754-94b091a89063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:30.585126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aaa084-d24b-461e-9754-94b091a89063 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:30.585404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aaa084-d24b-461e-9754-94b091a89063 admin admin] PATH_INFO: `/v3/users/8f4da0578588431db5da2d58455e8364` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:30.587684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aaa084-d24b-461e-9754-94b091a89063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f4da0578588431db5da2d58455e8364)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:30.589953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aaa084-d24b-461e-9754-94b091a89063 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:30.708098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b7aaa084-d24b-461e-9754-94b091a89063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f4da0578588431db5da2d58455e8364'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:30.734115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b7aaa084-d24b-461e-9754-94b091a89063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f4da0578588431db5da2d58455e8364'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:30.735051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b7aaa084-d24b-461e-9754-94b091a89063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f4da0578588431db5da2d58455e8364'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:30.749949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b7aaa084-d24b-461e-9754-94b091a89063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f4da0578588431db5da2d58455e8364'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:30.754779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b7aaa084-d24b-461e-9754-94b091a89063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f4da0578588431db5da2d58455e8364'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:30.797754 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1843/3679] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:12:30 2022] DELETE /identity/v3/users/8f4da0578588431db5da2d58455e8364 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:12:30.803830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f88757-7f69-4122-9800-28c49d4de6af None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:30.804887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f88757-7f69-4122-9800-28c49d4de6af None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:30.805315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f88757-7f69-4122-9800-28c49d4de6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:30.828636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e6f88757-7f69-4122-9800-28c49d4de6af None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:12:30.830174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e6f88757-7f69-4122-9800-28c49d4de6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:30.929894 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1837/3680] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:12:31.044276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aaa084-d24b-461e-9754-94b091a89063 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:31.045780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b7aaa084-d24b-461e-9754-94b091a89063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:31.153384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aaa084-d24b-461e-9754-94b091a89063 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:31.160238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9da56-e391-44ec-9830-5adfcbc5b75b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:31.161252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9da56-e391-44ec-9830-5adfcbc5b75b service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:31.161746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9da56-e391-44ec-9830-5adfcbc5b75b service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:31.162224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9da56-e391-44ec-9830-5adfcbc5b75b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:31.176256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9da56-e391-44ec-9830-5adfcbc5b75b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:31.178125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9da56-e391-44ec-9830-5adfcbc5b75b service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:31.190139 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1844/3681] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:12:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:12:32.332905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f88757-7f69-4122-9800-28c49d4de6af None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:32.334685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e6f88757-7f69-4122-9800-28c49d4de6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:32.366232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f88757-7f69-4122-9800-28c49d4de6af None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:32.377001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48719d88-675b-4aec-bcba-af98153d93db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:32.377711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48719d88-675b-4aec-bcba-af98153d93db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:32.378019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48719d88-675b-4aec-bcba-af98153d93db admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:32.379777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48719d88-675b-4aec-bcba-af98153d93db admin admin] PATH_INFO: `/v3/projects/afa70c1fb55148909a98d8628111983e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:32.384609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48719d88-675b-4aec-bcba-af98153d93db admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa70c1fb55148909a98d8628111983e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:32.389185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48719d88-675b-4aec-bcba-af98153d93db admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:32.487670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-48719d88-675b-4aec-bcba-af98153d93db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa70c1fb55148909a98d8628111983e', 'request_id': 'req-48719d88-675b-4aec-bcba-af98153d93db'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:32.502398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-48719d88-675b-4aec-bcba-af98153d93db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa70c1fb55148909a98d8628111983e', 'request_id': 'req-48719d88-675b-4aec-bcba-af98153d93db'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:32.512284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-48719d88-675b-4aec-bcba-af98153d93db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa70c1fb55148909a98d8628111983e', 'request_id': 'req-48719d88-675b-4aec-bcba-af98153d93db'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:32.525988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-48719d88-675b-4aec-bcba-af98153d93db admin admin] The token cache is being invalidate because project afa70c1fb55148909a98d8628111983e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:12:32.526642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-48719d88-675b-4aec-bcba-af98153d93db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:32.528168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-48719d88-675b-4aec-bcba-af98153d93db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:12:32.534746 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1838/3682] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:12:32 2022] DELETE /identity/v3/projects/afa70c1fb55148909a98d8628111983e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:12:32.536825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988219ee-43b3-4533-82fa-ef296d2cd6e3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:32.537316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988219ee-43b3-4533-82fa-ef296d2cd6e3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:32.537509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988219ee-43b3-4533-82fa-ef296d2cd6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:32.563227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-988219ee-43b3-4533-82fa-ef296d2cd6e3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:12:32.564612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-988219ee-43b3-4533-82fa-ef296d2cd6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:32.715574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4202802-c6b4-4971-8902-a5b63a80f042 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:32.716135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4202802-c6b4-4971-8902-a5b63a80f042 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:32.716536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4202802-c6b4-4971-8902-a5b63a80f042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:32.719052 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1845/3683] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:12:32.746709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e4202802-c6b4-4971-8902-a5b63a80f042 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:12:32.748474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e4202802-c6b4-4971-8902-a5b63a80f042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:32.758647 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1839/3684] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:12:32.763144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988219ee-43b3-4533-82fa-ef296d2cd6e3 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:32.769145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:32.781573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988219ee-43b3-4533-82fa-ef296d2cd6e3 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:32.790097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c8a1b-79d2-433e-9c0d-051875a30cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:32.793599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c8a1b-79d2-433e-9c0d-051875a30cce admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:32.793902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c8a1b-79d2-433e-9c0d-051875a30cce admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:32.794180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c8a1b-79d2-433e-9c0d-051875a30cce admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:32.794920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c8a1b-79d2-433e-9c0d-051875a30cce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:12:32.795226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c8a1b-79d2-433e-9c0d-051875a30cce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:32.797261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c8a1b-79d2-433e-9c0d-051875a30cce admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:32.822737 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1846/3685] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:12:32.824030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4202802-c6b4-4971-8902-a5b63a80f042 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:32.838238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4202802-c6b4-4971-8902-a5b63a80f042 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:32.851210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0109cc4-6b58-41a1-a086-5625cc6b3aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:32.853100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0109cc4-6b58-41a1-a086-5625cc6b3aab admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:32.853756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0109cc4-6b58-41a1-a086-5625cc6b3aab admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:32.854904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0109cc4-6b58-41a1-a086-5625cc6b3aab admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:32.856141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0109cc4-6b58-41a1-a086-5625cc6b3aab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:32.859408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0109cc4-6b58-41a1-a086-5625cc6b3aab admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:32.899761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:32.915665 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1840/3686] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:12:32 2022] POST /identity/v3/projects => generated 399 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:12:32.916487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c8a1b-79d2-433e-9c0d-051875a30cce admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:32.935104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c8a1b-79d2-433e-9c0d-051875a30cce admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:33.087652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2a909-2c2b-4c77-8577-eb4bb67217b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:33.088640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2a909-2c2b-4c77-8577-eb4bb67217b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:33.088993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2a909-2c2b-4c77-8577-eb4bb67217b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:33.089403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2a909-2c2b-4c77-8577-eb4bb67217b7 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:33.090199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2a909-2c2b-4c77-8577-eb4bb67217b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:33.092253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2a909-2c2b-4c77-8577-eb4bb67217b7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:33.128478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0109cc4-6b58-41a1-a086-5625cc6b3aab admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:33.139511 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1847/3687] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:12:32 2022] POST /identity/v3/users => generated 300 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:12:33.144762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0109cc4-6b58-41a1-a086-5625cc6b3aab admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:33.157101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622f041-178d-47cf-b3db-944118b78e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:33.158176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622f041-178d-47cf-b3db-944118b78e33 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:33.158601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622f041-178d-47cf-b3db-944118b78e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:33.159568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622f041-178d-47cf-b3db-944118b78e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:33.160494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622f041-178d-47cf-b3db-944118b78e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:33.162268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622f041-178d-47cf-b3db-944118b78e33 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:33.180500 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1841/3688] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:12:33.184912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2a909-2c2b-4c77-8577-eb4bb67217b7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:33.229238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2a909-2c2b-4c77-8577-eb4bb67217b7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:33.243655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772a94a-6073-4d68-89a8-3a574b59f5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:33.244218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772a94a-6073-4d68-89a8-3a574b59f5fb admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:33.244497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772a94a-6073-4d68-89a8-3a574b59f5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:33.247577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772a94a-6073-4d68-89a8-3a574b59f5fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:33.248321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772a94a-6073-4d68-89a8-3a574b59f5fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:33.253045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772a94a-6073-4d68-89a8-3a574b59f5fb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:33.293261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e936d-f2b0-4dd7-89d2-e21dac8e6f01 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:33.293740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e936d-f2b0-4dd7-89d2-e21dac8e6f01 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:33.294118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e936d-f2b0-4dd7-89d2-e21dac8e6f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:33.304725 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1848/3689] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:12:33.310098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772a94a-6073-4d68-89a8-3a574b59f5fb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:33.324069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772a94a-6073-4d68-89a8-3a574b59f5fb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:33.331419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbf479-457a-45bf-8fb3-2d0efb316170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:33.332243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbf479-457a-45bf-8fb3-2d0efb316170 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:33.332508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbf479-457a-45bf-8fb3-2d0efb316170 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:33.332789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbf479-457a-45bf-8fb3-2d0efb316170 admin admin] PATH_INFO: `/v3/projects/af6c6b5ced854c3ca03b65cb69903ef5/users/f89692ad732b4d9f8429659ee6a03a0b/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:33.346994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-af9e936d-f2b0-4dd7-89d2-e21dac8e6f01 None None] MFA Rules not processed for user `c4fc3f756d034b339878ee04f0469df0`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:12:33.349031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-af9e936d-f2b0-4dd7-89d2-e21dac8e6f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:33.351349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbf479-457a-45bf-8fb3-2d0efb316170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af6c6b5ced854c3ca03b65cb69903ef5, user_id=f89692ad732b4d9f8429659ee6a03a0b, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:33.354392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbf479-457a-45bf-8fb3-2d0efb316170 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:33.393519 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1849/3690] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:12:33 2022] PUT /identity/v3/projects/af6c6b5ced854c3ca03b65cb69903ef5/users/f89692ad732b4d9f8429659ee6a03a0b/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:12:33.394433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c40997-5a0d-480c-8c96-44dc7858ac70 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:33.394721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c40997-5a0d-480c-8c96-44dc7858ac70 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:33.395050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c40997-5a0d-480c-8c96-44dc7858ac70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:33.442918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-66c40997-5a0d-480c-8c96-44dc7858ac70 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:12:33.445200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-66c40997-5a0d-480c-8c96-44dc7858ac70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:33.495358 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1842/3691] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:12:33.496691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e936d-f2b0-4dd7-89d2-e21dac8e6f01 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:33.501115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-af9e936d-f2b0-4dd7-89d2-e21dac8e6f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:33.523432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e936d-f2b0-4dd7-89d2-e21dac8e6f01 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:33.528626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2c578-0b59-4b13-8f39-0f3922589039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:33.529263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2c578-0b59-4b13-8f39-0f3922589039 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:33.529553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2c578-0b59-4b13-8f39-0f3922589039 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:33.529832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2c578-0b59-4b13-8f39-0f3922589039 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:33.530512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2c578-0b59-4b13-8f39-0f3922589039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:33.532484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2c578-0b59-4b13-8f39-0f3922589039 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:33.533029 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1850/3692] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:12:33.540807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c40997-5a0d-480c-8c96-44dc7858ac70 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:33.542915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-66c40997-5a0d-480c-8c96-44dc7858ac70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:33.572003 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1843/3693] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:12:33 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:12:33.576470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2c578-0b59-4b13-8f39-0f3922589039 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:33.617981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:33.634739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c40997-5a0d-480c-8c96-44dc7858ac70 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:33.676657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2c578-0b59-4b13-8f39-0f3922589039 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:33.683706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec01ef-5278-4734-a952-d4ea0f8daeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:33.685379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec01ef-5278-4734-a952-d4ea0f8daeb7 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:33.685913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec01ef-5278-4734-a952-d4ea0f8daeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:33.686429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec01ef-5278-4734-a952-d4ea0f8daeb7 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:33.687531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec01ef-5278-4734-a952-d4ea0f8daeb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:33.691209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec01ef-5278-4734-a952-d4ea0f8daeb7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:33.711441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b118da1-2435-49ce-8814-d1fe9573a3df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:33.712545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b118da1-2435-49ce-8814-d1fe9573a3df service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:33.712937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b118da1-2435-49ce-8814-d1fe9573a3df service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:33.713220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b118da1-2435-49ce-8814-d1fe9573a3df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:33.725437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b118da1-2435-49ce-8814-d1fe9573a3df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:33.727140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b118da1-2435-49ce-8814-d1fe9573a3df service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:33.737224 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1844/3694] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:12:33 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:12:33.741160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec01ef-5278-4734-a952-d4ea0f8daeb7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:33.749447 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1851/3695] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:12:33.768821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec01ef-5278-4734-a952-d4ea0f8daeb7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:33.774948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdb32e-0f72-4d0a-9657-1e8cd244ba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:33.776355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdb32e-0f72-4d0a-9657-1e8cd244ba98 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:33.776884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdb32e-0f72-4d0a-9657-1e8cd244ba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:33.777536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdb32e-0f72-4d0a-9657-1e8cd244ba98 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:33.778967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdb32e-0f72-4d0a-9657-1e8cd244ba98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:33.781319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdb32e-0f72-4d0a-9657-1e8cd244ba98 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:33.800652 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1845/3696] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:12:33.804481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b118da1-2435-49ce-8814-d1fe9573a3df service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:33.816227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b118da1-2435-49ce-8814-d1fe9573a3df service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:33.821314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a9df-abfe-4f9c-b1a9-725d373fa81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:33.822154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a9df-abfe-4f9c-b1a9-725d373fa81b admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:33.822438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a9df-abfe-4f9c-b1a9-725d373fa81b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:33.822717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a9df-abfe-4f9c-b1a9-725d373fa81b admin admin] PATH_INFO: `/v3/projects/02630ca446a44e888f364be7e0668001/users/bc511889bc8746918744f88856db87fe/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:33.840609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5a9df-abfe-4f9c-b1a9-725d373fa81b admin admin] RBAC: Authorizing `identity:create_grant(project_id=02630ca446a44e888f364be7e0668001, user_id=bc511889bc8746918744f88856db87fe, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:33.843563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5a9df-abfe-4f9c-b1a9-725d373fa81b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:33.862753 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1852/3697] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:12:33 2022] PUT /identity/v3/projects/02630ca446a44e888f364be7e0668001/users/bc511889bc8746918744f88856db87fe/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:12:33.864059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdb32e-0f72-4d0a-9657-1e8cd244ba98 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:33.888824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdb32e-0f72-4d0a-9657-1e8cd244ba98 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:33.941925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:33.981942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcdfaf-0858-4e75-b924-0779d345ecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:33.982999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcdfaf-0858-4e75-b924-0779d345ecc6 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:33.983431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcdfaf-0858-4e75-b924-0779d345ecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:33.983811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcdfaf-0858-4e75-b924-0779d345ecc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:33.984625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcdfaf-0858-4e75-b924-0779d345ecc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:33.989858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcdfaf-0858-4e75-b924-0779d345ecc6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:34.007662 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1846/3698] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:12:34.012032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a9df-abfe-4f9c-b1a9-725d373fa81b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:34.032195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a9df-abfe-4f9c-b1a9-725d373fa81b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:34.038275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a2e8e-f363-49e0-9a63-ae4387e3b63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:34.039063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a2e8e-f363-49e0-9a63-ae4387e3b63e admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:34.039464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a2e8e-f363-49e0-9a63-ae4387e3b63e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:34.039820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a2e8e-f363-49e0-9a63-ae4387e3b63e admin admin] PATH_INFO: `/v3/projects/02630ca446a44e888f364be7e0668001/users/bc511889bc8746918744f88856db87fe/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:34.041964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a2e8e-f363-49e0-9a63-ae4387e3b63e admin admin] RBAC: Authorizing `identity:create_grant(project_id=02630ca446a44e888f364be7e0668001, user_id=bc511889bc8746918744f88856db87fe, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:34.047180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a2e8e-f363-49e0-9a63-ae4387e3b63e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:34.060287 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1853/3699] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:12:34 2022] PUT /identity/v3/projects/02630ca446a44e888f364be7e0668001/users/bc511889bc8746918744f88856db87fe/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:12:43.998372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=13 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:44.055480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=41,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:47.818630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717cab0-9726-4e13-8e39-bb754bcbdb39 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:47.819095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717cab0-9726-4e13-8e39-bb754bcbdb39 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:47.819590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717cab0-9726-4e13-8e39-bb754bcbdb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:47.864509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e717cab0-9726-4e13-8e39-bb754bcbdb39 None None] MFA Rules not processed for user `bc511889bc8746918744f88856db87fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:12:47.866068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e717cab0-9726-4e13-8e39-bb754bcbdb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:48.076990 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1847/3700] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:12:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:12:48.089303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a2e8e-f363-49e0-9a63-ae4387e3b63e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:48.091243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1d7a2e8e-f363-49e0-9a63-ae4387e3b63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:48.286563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a2e8e-f363-49e0-9a63-ae4387e3b63e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:48.291921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269ae84-0814-4797-80b1-1f628c645813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:48.292786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269ae84-0814-4797-80b1-1f628c645813 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:48.293171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269ae84-0814-4797-80b1-1f628c645813 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:48.293545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269ae84-0814-4797-80b1-1f628c645813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:48.404502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269ae84-0814-4797-80b1-1f628c645813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:48.408524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269ae84-0814-4797-80b1-1f628c645813 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:48.445677 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1854/3701] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:12:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:12:48.919192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a624eb-9e2e-46c3-b757-bd9ec4d40770 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:48.919731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a624eb-9e2e-46c3-b757-bd9ec4d40770 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:48.919953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a624eb-9e2e-46c3-b757-bd9ec4d40770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:49.013550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-80a624eb-9e2e-46c3-b757-bd9ec4d40770 None None] MFA Rules not processed for user `f89692ad732b4d9f8429659ee6a03a0b`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:12:49.020713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-80a624eb-9e2e-46c3-b757-bd9ec4d40770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:49.253853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708a429-fed3-4cd6-aa40-5e9e332662c6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:49.255112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708a429-fed3-4cd6-aa40-5e9e332662c6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:49.256617 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1848/3702] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:12:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:12:49.256906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708a429-fed3-4cd6-aa40-5e9e332662c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:49.338508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4708a429-fed3-4cd6-aa40-5e9e332662c6 None None] MFA Rules not processed for user `f89692ad732b4d9f8429659ee6a03a0b`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:12:49.340223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4708a429-fed3-4cd6-aa40-5e9e332662c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:49.368182 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1855/3703] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:12:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:12:50.137197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a624eb-9e2e-46c3-b757-bd9ec4d40770 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:12:50.142136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-80a624eb-9e2e-46c3-b757-bd9ec4d40770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:12:50.355827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a624eb-9e2e-46c3-b757-bd9ec4d40770 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:12:50.370011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe53045-0bbc-4baf-baf3-9dfc06d3cc96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:12:50.370668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe53045-0bbc-4baf-baf3-9dfc06d3cc96 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:12:50.370958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe53045-0bbc-4baf-baf3-9dfc06d3cc96 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:12:50.371240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe53045-0bbc-4baf-baf3-9dfc06d3cc96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:12:50.390666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe53045-0bbc-4baf-baf3-9dfc06d3cc96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:12:50.392354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe53045-0bbc-4baf-baf3-9dfc06d3cc96 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:12:50.400881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:50.424895 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1849/3704] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:12:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:12:59.276015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=60 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:01.104396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708a429-fed3-4cd6-aa40-5e9e332662c6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:01.106892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4708a429-fed3-4cd6-aa40-5e9e332662c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:01.323803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708a429-fed3-4cd6-aa40-5e9e332662c6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:01.330932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61097343-f10c-4c04-b102-f999dd575d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:01.331962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61097343-f10c-4c04-b102-f999dd575d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:01.332713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61097343-f10c-4c04-b102-f999dd575d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:01.333558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61097343-f10c-4c04-b102-f999dd575d5f admin admin] PATH_INFO: `/v3/users/d9d75013f5714db097bb2975b57d5328` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:01.335030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61097343-f10c-4c04-b102-f999dd575d5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d75013f5714db097bb2975b57d5328)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:01.337622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61097343-f10c-4c04-b102-f999dd575d5f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:01.424121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe53045-0bbc-4baf-baf3-9dfc06d3cc96 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:01.425678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cfe53045-0bbc-4baf-baf3-9dfc06d3cc96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:01.452094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-61097343-f10c-4c04-b102-f999dd575d5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d75013f5714db097bb2975b57d5328'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:01.472452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-61097343-f10c-4c04-b102-f999dd575d5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d75013f5714db097bb2975b57d5328'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:01.474218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-61097343-f10c-4c04-b102-f999dd575d5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d75013f5714db097bb2975b57d5328'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:01.485204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-61097343-f10c-4c04-b102-f999dd575d5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d75013f5714db097bb2975b57d5328'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:01.486947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-61097343-f10c-4c04-b102-f999dd575d5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d75013f5714db097bb2975b57d5328'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:01.508019 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1856/3705] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:13:01 2022] DELETE /identity/v3/users/d9d75013f5714db097bb2975b57d5328 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:01.607428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe53045-0bbc-4baf-baf3-9dfc06d3cc96 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:01.722860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd0bbd-dd03-4443-90d5-05523888faa7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:01.723937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd0bbd-dd03-4443-90d5-05523888faa7 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:01.724235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd0bbd-dd03-4443-90d5-05523888faa7 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:01.724512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd0bbd-dd03-4443-90d5-05523888faa7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:01.728692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0cdd0bbd-dd03-4443-90d5-05523888faa7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:01.766914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd0bbd-dd03-4443-90d5-05523888faa7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:01.769359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd0bbd-dd03-4443-90d5-05523888faa7 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:01.815550 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1850/3706] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:13:02.749800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61097343-f10c-4c04-b102-f999dd575d5f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:02.755742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-61097343-f10c-4c04-b102-f999dd575d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:02.875223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61097343-f10c-4c04-b102-f999dd575d5f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:02.887408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed26d13-f416-4592-9863-a88261c74abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:02.887408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed26d13-f416-4592-9863-a88261c74abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:02.887408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed26d13-f416-4592-9863-a88261c74abb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:02.887408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed26d13-f416-4592-9863-a88261c74abb admin admin] PATH_INFO: `/v3/projects/b6c50d273347476986fe5cff264295c0` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:02.887947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed26d13-f416-4592-9863-a88261c74abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c50d273347476986fe5cff264295c0)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:02.888908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed26d13-f416-4592-9863-a88261c74abb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:02.923088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:03.020390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9ed26d13-f416-4592-9863-a88261c74abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c50d273347476986fe5cff264295c0', 'request_id': 'req-9ed26d13-f416-4592-9863-a88261c74abb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:03.043030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9ed26d13-f416-4592-9863-a88261c74abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c50d273347476986fe5cff264295c0', 'request_id': 'req-9ed26d13-f416-4592-9863-a88261c74abb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:03.067594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9ed26d13-f416-4592-9863-a88261c74abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c50d273347476986fe5cff264295c0', 'request_id': 'req-9ed26d13-f416-4592-9863-a88261c74abb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:03.090460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9ed26d13-f416-4592-9863-a88261c74abb admin admin] The token cache is being invalidate because project b6c50d273347476986fe5cff264295c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:13:03.090761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9ed26d13-f416-4592-9863-a88261c74abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:03.092051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9ed26d13-f416-4592-9863-a88261c74abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:03.095954 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1857/3707] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:13:02 2022] DELETE /identity/v3/projects/b6c50d273347476986fe5cff264295c0 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:03.101190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3243c0-4cc2-431e-b691-bf5c31c9728b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:03.101985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3243c0-4cc2-431e-b691-bf5c31c9728b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:03.102422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3243c0-4cc2-431e-b691-bf5c31c9728b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:03.140534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1c3243c0-4cc2-431e-b691-bf5c31c9728b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:03.141779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1c3243c0-4cc2-431e-b691-bf5c31c9728b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:03.317146 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1851/3708] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:03.326188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7cb3a-dec6-4846-be6b-a02e355754a1 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:03.326560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7cb3a-dec6-4846-be6b-a02e355754a1 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:03.326753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7cb3a-dec6-4846-be6b-a02e355754a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:03.371375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-76c7cb3a-dec6-4846-be6b-a02e355754a1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:03.375072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-76c7cb3a-dec6-4846-be6b-a02e355754a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:03.391193 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1858/3709] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:03.393547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3243c0-4cc2-431e-b691-bf5c31c9728b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:03.417250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3243c0-4cc2-431e-b691-bf5c31c9728b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:03.430593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464978a4-18db-43c7-9c2f-1ba689e2baa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:03.432048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464978a4-18db-43c7-9c2f-1ba689e2baa5 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:03.432688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464978a4-18db-43c7-9c2f-1ba689e2baa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:03.433147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464978a4-18db-43c7-9c2f-1ba689e2baa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:03.434143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464978a4-18db-43c7-9c2f-1ba689e2baa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:13:03.440519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464978a4-18db-43c7-9c2f-1ba689e2baa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:03.445128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464978a4-18db-43c7-9c2f-1ba689e2baa5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:03.484089 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1852/3710] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:13:03.489514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7cb3a-dec6-4846-be6b-a02e355754a1 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:03.505563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7cb3a-dec6-4846-be6b-a02e355754a1 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:03.522363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464978a4-18db-43c7-9c2f-1ba689e2baa5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:03.522772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3915b-586f-405f-abac-fd897ee7b78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:03.523586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3915b-586f-405f-abac-fd897ee7b78b admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:03.523878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3915b-586f-405f-abac-fd897ee7b78b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:03.524417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3915b-586f-405f-abac-fd897ee7b78b admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:03.526599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3915b-586f-405f-abac-fd897ee7b78b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:03.526848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-464978a4-18db-43c7-9c2f-1ba689e2baa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:03.529036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3915b-586f-405f-abac-fd897ee7b78b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:03.583222 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1859/3711] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:13:03 2022] POST /identity/v3/projects => generated 391 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:13:03.585077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:03.588289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3915b-586f-405f-abac-fd897ee7b78b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:03.647196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464978a4-18db-43c7-9c2f-1ba689e2baa5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:03.729903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b68a9-29ff-4e9d-bae3-d65aa38a36eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:03.730624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b68a9-29ff-4e9d-bae3-d65aa38a36eb service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:03.730910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b68a9-29ff-4e9d-bae3-d65aa38a36eb service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:03.731492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b68a9-29ff-4e9d-bae3-d65aa38a36eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:03.733739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-082b68a9-29ff-4e9d-bae3-d65aa38a36eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:03.748187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b68a9-29ff-4e9d-bae3-d65aa38a36eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:03.749951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b68a9-29ff-4e9d-bae3-d65aa38a36eb service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:03.768905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3915b-586f-405f-abac-fd897ee7b78b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:03.774721 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1853/3712] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:13:03.777232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a8915-d9ec-46fb-8e99-6fe9968b5192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:03.777873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a8915-d9ec-46fb-8e99-6fe9968b5192 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:03.778169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a8915-d9ec-46fb-8e99-6fe9968b5192 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:03.778430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a8915-d9ec-46fb-8e99-6fe9968b5192 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:03.779095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a8915-d9ec-46fb-8e99-6fe9968b5192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:03.781311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a8915-d9ec-46fb-8e99-6fe9968b5192 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:03.821505 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1860/3713] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:13:03 2022] POST /identity/v3/users => generated 296 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:13:03.826125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b68a9-29ff-4e9d-bae3-d65aa38a36eb service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:03.843772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b68a9-29ff-4e9d-bae3-d65aa38a36eb service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:03.857211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36899f-ae63-470f-8feb-af1f3e459969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:03.857845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36899f-ae63-470f-8feb-af1f3e459969 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:03.858130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36899f-ae63-470f-8feb-af1f3e459969 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:03.858406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36899f-ae63-470f-8feb-af1f3e459969 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:03.859105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36899f-ae63-470f-8feb-af1f3e459969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:03.860751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36899f-ae63-470f-8feb-af1f3e459969 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:03.890664 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1854/3714] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:13:03.890843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a8915-d9ec-46fb-8e99-6fe9968b5192 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:03.915376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a8915-d9ec-46fb-8e99-6fe9968b5192 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:03.925806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a5381-7008-4933-9e43-cec4acea4af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:03.926461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a5381-7008-4933-9e43-cec4acea4af6 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:03.926751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a5381-7008-4933-9e43-cec4acea4af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:03.927033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a5381-7008-4933-9e43-cec4acea4af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:03.927794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a5381-7008-4933-9e43-cec4acea4af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:03.929570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a5381-7008-4933-9e43-cec4acea4af6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:03.952683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36899f-ae63-470f-8feb-af1f3e459969 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:03.956125 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1861/3715] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:13:03.968370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36899f-ae63-470f-8feb-af1f3e459969 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:03.982913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ea18c-0bed-4ee5-8c10-d1746df4d8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:03.983833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ea18c-0bed-4ee5-8c10-d1746df4d8ea admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:03.984762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ea18c-0bed-4ee5-8c10-d1746df4d8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:03.985143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ea18c-0bed-4ee5-8c10-d1746df4d8ea admin admin] PATH_INFO: `/v3/projects/006af94f365f4f6a90a0ff8b1d36e9f8/users/a81f365477344b77a90b286c6b80d169/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:04.059702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ea18c-0bed-4ee5-8c10-d1746df4d8ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=006af94f365f4f6a90a0ff8b1d36e9f8, user_id=a81f365477344b77a90b286c6b80d169, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:04.064541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ea18c-0bed-4ee5-8c10-d1746df4d8ea admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:04.100974 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1855/3716] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:13:03 2022] PUT /identity/v3/projects/006af94f365f4f6a90a0ff8b1d36e9f8/users/a81f365477344b77a90b286c6b80d169/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:13:04.102961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac75c9-13c5-4bab-9394-2d0f73620cd0 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:04.103540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac75c9-13c5-4bab-9394-2d0f73620cd0 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:04.104035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac75c9-13c5-4bab-9394-2d0f73620cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:04.148188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e9ac75c9-13c5-4bab-9394-2d0f73620cd0 None None] MFA Rules not processed for user `a81f365477344b77a90b286c6b80d169`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:04.150447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e9ac75c9-13c5-4bab-9394-2d0f73620cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:04.212746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:04.240975 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1862/3717] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:04.307309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ea18c-0bed-4ee5-8c10-d1746df4d8ea admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:04.309160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-619ea18c-0bed-4ee5-8c10-d1746df4d8ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:04.492204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fc2b9-dbbe-4715-8a5d-f522c13b7ded None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:04.492506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fc2b9-dbbe-4715-8a5d-f522c13b7ded None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:04.492835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fc2b9-dbbe-4715-8a5d-f522c13b7ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:04.536529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-157fc2b9-dbbe-4715-8a5d-f522c13b7ded None None] MFA Rules not processed for user `f00d46cd63d94b49abfa65d6106c7d88`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:04.537811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-157fc2b9-dbbe-4715-8a5d-f522c13b7ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:04.552359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ea18c-0bed-4ee5-8c10-d1746df4d8ea admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:04.574042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6098dfb-2901-4f46-8b80-ae4ae7fc7dc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:04.575428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6098dfb-2901-4f46-8b80-ae4ae7fc7dc0 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:04.575723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6098dfb-2901-4f46-8b80-ae4ae7fc7dc0 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:04.576001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6098dfb-2901-4f46-8b80-ae4ae7fc7dc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:04.600322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6098dfb-2901-4f46-8b80-ae4ae7fc7dc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:04.600983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6098dfb-2901-4f46-8b80-ae4ae7fc7dc0 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:04.640371 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1856/3718] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:13:04.671423 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1863/3719] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:13:06.337208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6098dfb-2901-4f46-8b80-ae4ae7fc7dc0 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:06.350727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:06.522906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6098dfb-2901-4f46-8b80-ae4ae7fc7dc0 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:06.536938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221b3e2-702e-4797-902d-bbaa7c92ca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:06.537888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221b3e2-702e-4797-902d-bbaa7c92ca61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:06.538324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221b3e2-702e-4797-902d-bbaa7c92ca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:06.538870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221b3e2-702e-4797-902d-bbaa7c92ca61 admin admin] PATH_INFO: `/v3/users/a81f365477344b77a90b286c6b80d169` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:06.544935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221b3e2-702e-4797-902d-bbaa7c92ca61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a81f365477344b77a90b286c6b80d169)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:06.547376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221b3e2-702e-4797-902d-bbaa7c92ca61 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:06.650701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6221b3e2-702e-4797-902d-bbaa7c92ca61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a81f365477344b77a90b286c6b80d169'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:06.651735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6221b3e2-702e-4797-902d-bbaa7c92ca61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a81f365477344b77a90b286c6b80d169'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:06.676838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6221b3e2-702e-4797-902d-bbaa7c92ca61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a81f365477344b77a90b286c6b80d169'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:06.678106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6221b3e2-702e-4797-902d-bbaa7c92ca61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a81f365477344b77a90b286c6b80d169'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:06.694193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6221b3e2-702e-4797-902d-bbaa7c92ca61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a81f365477344b77a90b286c6b80d169'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:06.713477 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1857/3720] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:13:06 2022] DELETE /identity/v3/users/a81f365477344b77a90b286c6b80d169 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:06.718170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856339a-5823-44da-925d-11a6a5ce02d0 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:06.718655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856339a-5823-44da-925d-11a6a5ce02d0 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:06.719105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856339a-5823-44da-925d-11a6a5ce02d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:06.756834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d856339a-5823-44da-925d-11a6a5ce02d0 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:06.758374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d856339a-5823-44da-925d-11a6a5ce02d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:06.896533 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1864/3721] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:13:06.913413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221b3e2-702e-4797-902d-bbaa7c92ca61 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:06.915192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6221b3e2-702e-4797-902d-bbaa7c92ca61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:07.002935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221b3e2-702e-4797-902d-bbaa7c92ca61 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:07.018554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a72648-7c19-49b9-86d1-7ca12a2b6fe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:07.036833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a72648-7c19-49b9-86d1-7ca12a2b6fe5 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:07.037407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a72648-7c19-49b9-86d1-7ca12a2b6fe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:07.040101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a72648-7c19-49b9-86d1-7ca12a2b6fe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:07.073410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a72648-7c19-49b9-86d1-7ca12a2b6fe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:07.075171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a72648-7c19-49b9-86d1-7ca12a2b6fe5 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:07.105651 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1858/3722] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:13:07.468472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856339a-5823-44da-925d-11a6a5ce02d0 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:07.471532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d856339a-5823-44da-925d-11a6a5ce02d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:07.495614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856339a-5823-44da-925d-11a6a5ce02d0 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:07.508919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911b6a6-89bf-4d5a-9941-2ac01f9ef4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:07.509689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911b6a6-89bf-4d5a-9941-2ac01f9ef4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:07.510077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911b6a6-89bf-4d5a-9941-2ac01f9ef4be admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:07.510444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911b6a6-89bf-4d5a-9941-2ac01f9ef4be admin admin] PATH_INFO: `/v3/users/25cff561a2d14c45b71920346aee5d57` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:07.512003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911b6a6-89bf-4d5a-9941-2ac01f9ef4be admin admin] RBAC: Authorizing `identity:delete_user(user_id=25cff561a2d14c45b71920346aee5d57)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:07.517758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911b6a6-89bf-4d5a-9941-2ac01f9ef4be admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:07.636617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2911b6a6-89bf-4d5a-9941-2ac01f9ef4be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25cff561a2d14c45b71920346aee5d57'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:07.666445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2911b6a6-89bf-4d5a-9941-2ac01f9ef4be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25cff561a2d14c45b71920346aee5d57'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:07.667201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2911b6a6-89bf-4d5a-9941-2ac01f9ef4be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25cff561a2d14c45b71920346aee5d57'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:07.678561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2911b6a6-89bf-4d5a-9941-2ac01f9ef4be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25cff561a2d14c45b71920346aee5d57'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:07.679428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2911b6a6-89bf-4d5a-9941-2ac01f9ef4be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25cff561a2d14c45b71920346aee5d57'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:07.706141 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1865/3723] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:13:07 2022] DELETE /identity/v3/users/25cff561a2d14c45b71920346aee5d57 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:07.710947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15724bbd-c11d-4f70-9aef-ddaf3ddc9ae4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:07.711459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15724bbd-c11d-4f70-9aef-ddaf3ddc9ae4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:07.711668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15724bbd-c11d-4f70-9aef-ddaf3ddc9ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:07.740487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-15724bbd-c11d-4f70-9aef-ddaf3ddc9ae4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:07.742276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-15724bbd-c11d-4f70-9aef-ddaf3ddc9ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:07.787813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:07.915198 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1859/3724] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:07.926014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911b6a6-89bf-4d5a-9941-2ac01f9ef4be admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:07.928130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2911b6a6-89bf-4d5a-9941-2ac01f9ef4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:07.962880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15724bbd-c11d-4f70-9aef-ddaf3ddc9ae4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:07.966384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-15724bbd-c11d-4f70-9aef-ddaf3ddc9ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:07.980448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911b6a6-89bf-4d5a-9941-2ac01f9ef4be admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:07.992824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365231e-bebd-4839-837f-59b3158b94b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:07.994021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365231e-bebd-4839-837f-59b3158b94b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:07.994447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365231e-bebd-4839-837f-59b3158b94b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:07.995028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365231e-bebd-4839-837f-59b3158b94b2 admin admin] PATH_INFO: `/v3/projects/006af94f365f4f6a90a0ff8b1d36e9f8` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:07.996715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365231e-bebd-4839-837f-59b3158b94b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=006af94f365f4f6a90a0ff8b1d36e9f8)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:07.999597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365231e-bebd-4839-837f-59b3158b94b2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:08.005794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:08.068055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15724bbd-c11d-4f70-9aef-ddaf3ddc9ae4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:08.073780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cade029-98f7-45d2-9625-24adb8bdac52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:08.075416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cade029-98f7-45d2-9625-24adb8bdac52 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:08.075735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cade029-98f7-45d2-9625-24adb8bdac52 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:08.076049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cade029-98f7-45d2-9625-24adb8bdac52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:08.092664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cade029-98f7-45d2-9625-24adb8bdac52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:08.094725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cade029-98f7-45d2-9625-24adb8bdac52 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:08.108407 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1860/3725] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:13:08.121005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d365231e-bebd-4839-837f-59b3158b94b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '006af94f365f4f6a90a0ff8b1d36e9f8', 'request_id': 'req-d365231e-bebd-4839-837f-59b3158b94b2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:08.129581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d365231e-bebd-4839-837f-59b3158b94b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '006af94f365f4f6a90a0ff8b1d36e9f8', 'request_id': 'req-d365231e-bebd-4839-837f-59b3158b94b2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:08.138918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d365231e-bebd-4839-837f-59b3158b94b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '006af94f365f4f6a90a0ff8b1d36e9f8', 'request_id': 'req-d365231e-bebd-4839-837f-59b3158b94b2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:08.172083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d365231e-bebd-4839-837f-59b3158b94b2 admin admin] The token cache is being invalidate because project 006af94f365f4f6a90a0ff8b1d36e9f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:13:08.172487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d365231e-bebd-4839-837f-59b3158b94b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:08.174096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d365231e-bebd-4839-837f-59b3158b94b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:08.182579 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1866/3726] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:13:07 2022] DELETE /identity/v3/projects/006af94f365f4f6a90a0ff8b1d36e9f8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:08.185576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c58842-bdcc-423f-9d5e-7a8f82fc9f14 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:08.186134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c58842-bdcc-423f-9d5e-7a8f82fc9f14 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:08.187175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c58842-bdcc-423f-9d5e-7a8f82fc9f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:08.217297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d3c58842-bdcc-423f-9d5e-7a8f82fc9f14 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:08.219491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d3c58842-bdcc-423f-9d5e-7a8f82fc9f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:08.314508 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1861/3727] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:08.324392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af80c3-1207-49d5-8ad2-71116532ad46 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:08.324392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af80c3-1207-49d5-8ad2-71116532ad46 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:08.324548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af80c3-1207-49d5-8ad2-71116532ad46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:08.359348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-87af80c3-1207-49d5-8ad2-71116532ad46 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:08.360455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-87af80c3-1207-49d5-8ad2-71116532ad46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:08.371363 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1867/3728] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:08.375986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c58842-bdcc-423f-9d5e-7a8f82fc9f14 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:08.391564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c58842-bdcc-423f-9d5e-7a8f82fc9f14 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:08.399091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235ee14-f7ff-4c71-869a-756b4774f487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:08.399982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235ee14-f7ff-4c71-869a-756b4774f487 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:08.400468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235ee14-f7ff-4c71-869a-756b4774f487 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:08.401186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235ee14-f7ff-4c71-869a-756b4774f487 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:08.402081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235ee14-f7ff-4c71-869a-756b4774f487 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:13:08.402707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235ee14-f7ff-4c71-869a-756b4774f487 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:08.405288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235ee14-f7ff-4c71-869a-756b4774f487 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:08.425250 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1862/3729] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:13:08.430117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af80c3-1207-49d5-8ad2-71116532ad46 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:08.444235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af80c3-1207-49d5-8ad2-71116532ad46 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:08.464181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c715d28-5286-4698-8400-10c3711436c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:08.466302 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c715d28-5286-4698-8400-10c3711436c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:08.466893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c715d28-5286-4698-8400-10c3711436c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:08.467354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c715d28-5286-4698-8400-10c3711436c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:08.468428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c715d28-5286-4698-8400-10c3711436c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:08.471341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c715d28-5286-4698-8400-10c3711436c5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:08.519065 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1868/3730] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:13:08 2022] POST /identity/v3/projects => generated 399 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:13:08.522944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235ee14-f7ff-4c71-869a-756b4774f487 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:08.534282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235ee14-f7ff-4c71-869a-756b4774f487 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:08.639501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:08.656448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1982c-6246-467a-94f6-9f47ceb28972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:08.657095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1982c-6246-467a-94f6-9f47ceb28972 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:08.657379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1982c-6246-467a-94f6-9f47ceb28972 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:08.657654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1982c-6246-467a-94f6-9f47ceb28972 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:08.659102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1982c-6246-467a-94f6-9f47ceb28972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:08.667174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b4ff7-b13a-4319-a222-858563edacfa None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:08.667502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b4ff7-b13a-4319-a222-858563edacfa None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:08.667779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1982c-6246-467a-94f6-9f47ceb28972 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:08.667903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b4ff7-b13a-4319-a222-858563edacfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:08.710741 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1863/3731] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:13:08 2022] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:13:08.714496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1982c-6246-467a-94f6-9f47ceb28972 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:08.717837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-6c0b4ff7-b13a-4319-a222-858563edacfa None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:08.728140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1982c-6246-467a-94f6-9f47ceb28972 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:08.730153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6c0b4ff7-b13a-4319-a222-858563edacfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:08.740188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e1612-742f-4728-9566-83fea8bccad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:08.740833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e1612-742f-4728-9566-83fea8bccad6 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:08.741115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e1612-742f-4728-9566-83fea8bccad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:08.741385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e1612-742f-4728-9566-83fea8bccad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:08.742082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e1612-742f-4728-9566-83fea8bccad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:08.743735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e1612-742f-4728-9566-83fea8bccad6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:08.768799 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1864/3732] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:13:08.773870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e1612-742f-4728-9566-83fea8bccad6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:08.797769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e1612-742f-4728-9566-83fea8bccad6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:08.811173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff99b1-3ab9-4ba4-8b12-fb0cad34ccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:08.814266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff99b1-3ab9-4ba4-8b12-fb0cad34ccd1 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:08.814568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff99b1-3ab9-4ba4-8b12-fb0cad34ccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:08.815019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff99b1-3ab9-4ba4-8b12-fb0cad34ccd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:08.815984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff99b1-3ab9-4ba4-8b12-fb0cad34ccd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:08.817813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff99b1-3ab9-4ba4-8b12-fb0cad34ccd1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:08.830230 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1865/3733] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:13:08.834048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff99b1-3ab9-4ba4-8b12-fb0cad34ccd1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:08.848408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff99b1-3ab9-4ba4-8b12-fb0cad34ccd1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:08.856051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8ae0e-157e-4176-90c7-3534692f7d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:08.856753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8ae0e-157e-4176-90c7-3534692f7d4d admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:08.857646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8ae0e-157e-4176-90c7-3534692f7d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:08.857945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8ae0e-157e-4176-90c7-3534692f7d4d admin admin] PATH_INFO: `/v3/projects/e9d604456790434ca636b569e916f53a/users/5f030fb471ff43f196e204901a4dce82/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:08.866627 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1869/3734] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:13:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:13:08.885790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8ae0e-157e-4176-90c7-3534692f7d4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d604456790434ca636b569e916f53a, user_id=5f030fb471ff43f196e204901a4dce82, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:08.889464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8ae0e-157e-4176-90c7-3534692f7d4d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:08.912171 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1866/3735] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:13:08 2022] PUT /identity/v3/projects/e9d604456790434ca636b569e916f53a/users/5f030fb471ff43f196e204901a4dce82/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:13:08.924680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad2a39-dfd3-4ec9-9309-f849ef05afcd None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:08.925108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad2a39-dfd3-4ec9-9309-f849ef05afcd None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:08.925950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad2a39-dfd3-4ec9-9309-f849ef05afcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:08.941119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8ae0e-157e-4176-90c7-3534692f7d4d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:08.943000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-eaf8ae0e-157e-4176-90c7-3534692f7d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:08.970205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d5ad2a39-dfd3-4ec9-9309-f849ef05afcd None None] MFA Rules not processed for user `5f030fb471ff43f196e204901a4dce82`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:08.972962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d5ad2a39-dfd3-4ec9-9309-f849ef05afcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:09.087486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8ae0e-157e-4176-90c7-3534692f7d4d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:09.092435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:09.104772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96882b3e-f362-4387-a0ea-7e8c83435dbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:09.105408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96882b3e-f362-4387-a0ea-7e8c83435dbb service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:09.105700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96882b3e-f362-4387-a0ea-7e8c83435dbb service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:09.106007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96882b3e-f362-4387-a0ea-7e8c83435dbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:09.112255 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1870/3736] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:09.181074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96882b3e-f362-4387-a0ea-7e8c83435dbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:09.182825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96882b3e-f362-4387-a0ea-7e8c83435dbb service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:09.192567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad2a39-dfd3-4ec9-9309-f849ef05afcd None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:09.194627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d5ad2a39-dfd3-4ec9-9309-f849ef05afcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:09.196359 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1867/3737] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:13:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:13:09.354206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96882b3e-f362-4387-a0ea-7e8c83435dbb service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:09.356098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-96882b3e-f362-4387-a0ea-7e8c83435dbb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:09.376519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad2a39-dfd3-4ec9-9309-f849ef05afcd None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:09.391268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7553a-9ef7-4d5b-9fec-7b3219e57dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:09.391979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7553a-9ef7-4d5b-9fec-7b3219e57dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:09.392309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7553a-9ef7-4d5b-9fec-7b3219e57dac admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:09.393030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7553a-9ef7-4d5b-9fec-7b3219e57dac admin admin] PATH_INFO: `/v3/projects/61ed7d57264748e1907d9c2f3743667a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:09.396622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7553a-9ef7-4d5b-9fec-7b3219e57dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=61ed7d57264748e1907d9c2f3743667a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:09.398640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7553a-9ef7-4d5b-9fec-7b3219e57dac admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:09.479787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:09.509157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-18c7553a-9ef7-4d5b-9fec-7b3219e57dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61ed7d57264748e1907d9c2f3743667a', 'request_id': 'req-18c7553a-9ef7-4d5b-9fec-7b3219e57dac'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:09.524326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-18c7553a-9ef7-4d5b-9fec-7b3219e57dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61ed7d57264748e1907d9c2f3743667a', 'request_id': 'req-18c7553a-9ef7-4d5b-9fec-7b3219e57dac'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:09.544419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-18c7553a-9ef7-4d5b-9fec-7b3219e57dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61ed7d57264748e1907d9c2f3743667a', 'request_id': 'req-18c7553a-9ef7-4d5b-9fec-7b3219e57dac'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:09.568789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-18c7553a-9ef7-4d5b-9fec-7b3219e57dac admin admin] The token cache is being invalidate because project 61ed7d57264748e1907d9c2f3743667a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:13:09.569147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-18c7553a-9ef7-4d5b-9fec-7b3219e57dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:09.569752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-18c7553a-9ef7-4d5b-9fec-7b3219e57dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:09.574121 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1871/3738] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:13:09 2022] DELETE /identity/v3/projects/61ed7d57264748e1907d9c2f3743667a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:09.575742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7553a-9ef7-4d5b-9fec-7b3219e57dac admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:09.576939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-18c7553a-9ef7-4d5b-9fec-7b3219e57dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:09.631311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96882b3e-f362-4387-a0ea-7e8c83435dbb service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:09.751746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7553a-9ef7-4d5b-9fec-7b3219e57dac admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:09.762777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bd32e-2c35-4a62-a5d4-0c45cc2a5f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:09.764021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bd32e-2c35-4a62-a5d4-0c45cc2a5f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:09.764021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bd32e-2c35-4a62-a5d4-0c45cc2a5f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:09.764256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bd32e-2c35-4a62-a5d4-0c45cc2a5f5b admin admin] PATH_INFO: `/v3/users/042c41b5f14d4a87979147530adccda3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:09.765527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bd32e-2c35-4a62-a5d4-0c45cc2a5f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=042c41b5f14d4a87979147530adccda3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:09.767665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bd32e-2c35-4a62-a5d4-0c45cc2a5f5b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:09.809910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d6a7b-1a7f-471a-8e87-22e37a9543d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:09.810567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d6a7b-1a7f-471a-8e87-22e37a9543d1 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:09.810877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d6a7b-1a7f-471a-8e87-22e37a9543d1 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:09.811157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d6a7b-1a7f-471a-8e87-22e37a9543d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:09.813381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5c6d6a7b-1a7f-471a-8e87-22e37a9543d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:09.885486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:09.944426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d6a7b-1a7f-471a-8e87-22e37a9543d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:09.948527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-282bd32e-2c35-4a62-a5d4-0c45cc2a5f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042c41b5f14d4a87979147530adccda3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:09.948849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d6a7b-1a7f-471a-8e87-22e37a9543d1 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:09.984303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-282bd32e-2c35-4a62-a5d4-0c45cc2a5f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042c41b5f14d4a87979147530adccda3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:09.987340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-282bd32e-2c35-4a62-a5d4-0c45cc2a5f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042c41b5f14d4a87979147530adccda3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:09.988804 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1868/3739] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:13:10.010649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-282bd32e-2c35-4a62-a5d4-0c45cc2a5f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042c41b5f14d4a87979147530adccda3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:10.011800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-282bd32e-2c35-4a62-a5d4-0c45cc2a5f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042c41b5f14d4a87979147530adccda3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:10.042610 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1872/3740] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:13:09 2022] DELETE /identity/v3/users/042c41b5f14d4a87979147530adccda3 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:10.056724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d6a7b-1a7f-471a-8e87-22e37a9543d1 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:10.058292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5c6d6a7b-1a7f-471a-8e87-22e37a9543d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:10.086491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d6a7b-1a7f-471a-8e87-22e37a9543d1 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:10.283321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608ce49-498b-4d82-9686-8dbd371f3e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:10.284024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608ce49-498b-4d82-9686-8dbd371f3e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:10.284315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608ce49-498b-4d82-9686-8dbd371f3e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:10.284596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608ce49-498b-4d82-9686-8dbd371f3e2e admin admin] PATH_INFO: `/v3/users/5f030fb471ff43f196e204901a4dce82` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:10.285940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608ce49-498b-4d82-9686-8dbd371f3e2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f030fb471ff43f196e204901a4dce82)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:10.287907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608ce49-498b-4d82-9686-8dbd371f3e2e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:10.309491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:10.405449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5608ce49-498b-4d82-9686-8dbd371f3e2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f030fb471ff43f196e204901a4dce82'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:10.406392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5608ce49-498b-4d82-9686-8dbd371f3e2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f030fb471ff43f196e204901a4dce82'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:10.423826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5608ce49-498b-4d82-9686-8dbd371f3e2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f030fb471ff43f196e204901a4dce82'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:10.424832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5608ce49-498b-4d82-9686-8dbd371f3e2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f030fb471ff43f196e204901a4dce82'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:10.435585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5608ce49-498b-4d82-9686-8dbd371f3e2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f030fb471ff43f196e204901a4dce82'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:10.469663 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1869/3741] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:13:10 2022] DELETE /identity/v3/users/5f030fb471ff43f196e204901a4dce82 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:10.474867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e3a0e-22c7-4f72-9d61-972363af5220 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:10.475392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e3a0e-22c7-4f72-9d61-972363af5220 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:10.475851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e3a0e-22c7-4f72-9d61-972363af5220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:10.501114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e63e3a0e-22c7-4f72-9d61-972363af5220 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:10.504556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e63e3a0e-22c7-4f72-9d61-972363af5220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:10.618458 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1873/3742] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:10.634085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608ce49-498b-4d82-9686-8dbd371f3e2e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:10.636274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5608ce49-498b-4d82-9686-8dbd371f3e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:10.721971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608ce49-498b-4d82-9686-8dbd371f3e2e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:10.728708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af6ab3-aaa6-418e-ae7f-0516d5a857d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:10.729441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af6ab3-aaa6-418e-ae7f-0516d5a857d0 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:10.729823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af6ab3-aaa6-418e-ae7f-0516d5a857d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:10.730179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af6ab3-aaa6-418e-ae7f-0516d5a857d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:10.770016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af6ab3-aaa6-418e-ae7f-0516d5a857d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:10.774972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af6ab3-aaa6-418e-ae7f-0516d5a857d0 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:10.791664 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1870/3743] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:13:11.611237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e3a0e-22c7-4f72-9d61-972363af5220 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:11.616950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e63e3a0e-22c7-4f72-9d61-972363af5220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:11.707317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e3a0e-22c7-4f72-9d61-972363af5220 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:11.735323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c080b4-5b0b-42e4-a985-307ee862644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:11.740508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c080b4-5b0b-42e4-a985-307ee862644c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:11.743270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c080b4-5b0b-42e4-a985-307ee862644c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:11.743804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c080b4-5b0b-42e4-a985-307ee862644c admin admin] PATH_INFO: `/v3/projects/43b34535abfb4f5d86e5091998a6823b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:11.748708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c080b4-5b0b-42e4-a985-307ee862644c admin admin] RBAC: Authorizing `identity:delete_project(project_id=43b34535abfb4f5d86e5091998a6823b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:11.750766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c080b4-5b0b-42e4-a985-307ee862644c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:11.811139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dad5b6-68fd-480f-9bcb-997400f6efe9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:11.811729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dad5b6-68fd-480f-9bcb-997400f6efe9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:11.811935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dad5b6-68fd-480f-9bcb-997400f6efe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:11.840157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93c080b4-5b0b-42e4-a985-307ee862644c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43b34535abfb4f5d86e5091998a6823b', 'request_id': 'req-93c080b4-5b0b-42e4-a985-307ee862644c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:11.848872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93c080b4-5b0b-42e4-a985-307ee862644c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43b34535abfb4f5d86e5091998a6823b', 'request_id': 'req-93c080b4-5b0b-42e4-a985-307ee862644c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:11.856583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-79dad5b6-68fd-480f-9bcb-997400f6efe9 None None] MFA Rules not processed for user `c4fc3f756d034b339878ee04f0469df0`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:11.859585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-79dad5b6-68fd-480f-9bcb-997400f6efe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:11.869918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93c080b4-5b0b-42e4-a985-307ee862644c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43b34535abfb4f5d86e5091998a6823b', 'request_id': 'req-93c080b4-5b0b-42e4-a985-307ee862644c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:11.885515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93c080b4-5b0b-42e4-a985-307ee862644c admin admin] The token cache is being invalidate because project 43b34535abfb4f5d86e5091998a6823b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:13:11.885808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93c080b4-5b0b-42e4-a985-307ee862644c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:11.886485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93c080b4-5b0b-42e4-a985-307ee862644c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:11.889004 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1874/3744] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:13:11 2022] DELETE /identity/v3/projects/43b34535abfb4f5d86e5091998a6823b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:11.894839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea13975-e583-4879-b065-636981dc55af None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:11.895134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea13975-e583-4879-b065-636981dc55af None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:11.895575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea13975-e583-4879-b065-636981dc55af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:11.920551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1ea13975-e583-4879-b065-636981dc55af None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:11.922248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1ea13975-e583-4879-b065-636981dc55af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:11.976477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:12.030898 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1871/3745] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:13:12.041302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ce6c0-7e24-447b-b18e-5ca9bf7ff1b0 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:12.043807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ce6c0-7e24-447b-b18e-5ca9bf7ff1b0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:12.044809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ce6c0-7e24-447b-b18e-5ca9bf7ff1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:12.077584 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1875/3746] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:13:12.084442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d78ce6c0-7e24-447b-b18e-5ca9bf7ff1b0 None None] MFA Rules not processed for user `c4fc3f756d034b339878ee04f0469df0`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:12.086139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d78ce6c0-7e24-447b-b18e-5ca9bf7ff1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:12.086633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a29447-d2e8-490d-8540-146c96bf3e14 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:12.086926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a29447-d2e8-490d-8540-146c96bf3e14 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:12.087206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a29447-d2e8-490d-8540-146c96bf3e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:12.095183 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1872/3747] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:12.136220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ce6c0-7e24-447b-b18e-5ca9bf7ff1b0 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:12.136639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f3a29447-d2e8-490d-8540-146c96bf3e14 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:12.137915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f3a29447-d2e8-490d-8540-146c96bf3e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:12.140107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d78ce6c0-7e24-447b-b18e-5ca9bf7ff1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:12.157793 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1876/3748] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:12.159084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a29447-d2e8-490d-8540-146c96bf3e14 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:12.186888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a29447-d2e8-490d-8540-146c96bf3e14 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:12.190529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ce6c0-7e24-447b-b18e-5ca9bf7ff1b0 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:12.200307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdcbc1-68d3-4d6c-a268-98c7d0910073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:12.202786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166331b-83fc-46d5-af94-c517187cc12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:12.203698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdcbc1-68d3-4d6c-a268-98c7d0910073 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:12.205196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166331b-83fc-46d5-af94-c517187cc12d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:12.205667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdcbc1-68d3-4d6c-a268-98c7d0910073 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:12.206197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdcbc1-68d3-4d6c-a268-98c7d0910073 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:12.207084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdcbc1-68d3-4d6c-a268-98c7d0910073 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:13:12.207563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166331b-83fc-46d5-af94-c517187cc12d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:12.208025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdcbc1-68d3-4d6c-a268-98c7d0910073 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:12.208455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166331b-83fc-46d5-af94-c517187cc12d admin admin] PATH_INFO: `/v3/projects/e9d604456790434ca636b569e916f53a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:12.212153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdcbc1-68d3-4d6c-a268-98c7d0910073 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:12.212797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166331b-83fc-46d5-af94-c517187cc12d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d604456790434ca636b569e916f53a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:12.216243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166331b-83fc-46d5-af94-c517187cc12d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:12.250029 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1877/3749] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:13:12.254790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdcbc1-68d3-4d6c-a268-98c7d0910073 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:12.281572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdcbc1-68d3-4d6c-a268-98c7d0910073 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:12.293944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa5739-58ce-4770-98a7-c836657e4bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:12.296823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa5739-58ce-4770-98a7-c836657e4bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:12.297483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa5739-58ce-4770-98a7-c836657e4bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:12.297926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa5739-58ce-4770-98a7-c836657e4bb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:12.299320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa5739-58ce-4770-98a7-c836657e4bb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:12.302014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa5739-58ce-4770-98a7-c836657e4bb7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:12.323484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:12.374490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6166331b-83fc-46d5-af94-c517187cc12d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d604456790434ca636b569e916f53a', 'request_id': 'req-6166331b-83fc-46d5-af94-c517187cc12d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:12.386170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6166331b-83fc-46d5-af94-c517187cc12d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d604456790434ca636b569e916f53a', 'request_id': 'req-6166331b-83fc-46d5-af94-c517187cc12d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:12.398754 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1878/3750] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:13:12 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:13:12.404018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa5739-58ce-4770-98a7-c836657e4bb7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:12.413780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6166331b-83fc-46d5-af94-c517187cc12d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d604456790434ca636b569e916f53a', 'request_id': 'req-6166331b-83fc-46d5-af94-c517187cc12d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:12.431397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6166331b-83fc-46d5-af94-c517187cc12d admin admin] The token cache is being invalidate because project e9d604456790434ca636b569e916f53a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:13:12.431727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6166331b-83fc-46d5-af94-c517187cc12d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:12.432442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6166331b-83fc-46d5-af94-c517187cc12d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:12.434404 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1873/3751] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:13:12 2022] DELETE /identity/v3/projects/e9d604456790434ca636b569e916f53a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:12.440427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284498a-68a3-4941-8b09-6f313582d4fc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:12.440858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284498a-68a3-4941-8b09-6f313582d4fc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:12.441243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284498a-68a3-4941-8b09-6f313582d4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:12.484090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2284498a-68a3-4941-8b09-6f313582d4fc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:12.485439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2284498a-68a3-4941-8b09-6f313582d4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:12.570237 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1874/3752] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:12.581218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe6a43-4e55-4733-86a4-53258e99d32f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:12.587889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe6a43-4e55-4733-86a4-53258e99d32f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:12.588404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe6a43-4e55-4733-86a4-53258e99d32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:12.646653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-82fe6a43-4e55-4733-86a4-53258e99d32f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:12.649742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-82fe6a43-4e55-4733-86a4-53258e99d32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:12.656837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa5739-58ce-4770-98a7-c836657e4bb7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:12.672393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06e98c-183d-4f6f-9f46-05de381940d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:12.672950 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1875/3753] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:12.674164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06e98c-183d-4f6f-9f46-05de381940d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:12.674601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06e98c-183d-4f6f-9f46-05de381940d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:12.675658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe6a43-4e55-4733-86a4-53258e99d32f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:12.677103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06e98c-183d-4f6f-9f46-05de381940d6 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:12.678711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06e98c-183d-4f6f-9f46-05de381940d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:12.685738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06e98c-183d-4f6f-9f46-05de381940d6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:12.734097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe6a43-4e55-4733-86a4-53258e99d32f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:12.749082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f0db2-0850-4a32-ace8-aef32d0fed4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:12.750250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0db2-0850-4a32-ace8-aef32d0fed4e admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:12.752193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0db2-0850-4a32-ace8-aef32d0fed4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:12.752691 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1879/3754] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:13:12 2022] POST /identity/v3/users => generated 290 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:13:12.753870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0db2-0850-4a32-ace8-aef32d0fed4e admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:12.756388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06e98c-183d-4f6f-9f46-05de381940d6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:12.756673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f0db2-0850-4a32-ace8-aef32d0fed4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:13:12.757210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f0db2-0850-4a32-ace8-aef32d0fed4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:12.759108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f0db2-0850-4a32-ace8-aef32d0fed4e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:12.761334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-df06e98c-183d-4f6f-9f46-05de381940d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:12.784818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06e98c-183d-4f6f-9f46-05de381940d6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:12.790184 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1876/3755] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:13:12.801998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ffb5d-3a3a-4d74-af18-1522ed3f2933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:12.802648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ffb5d-3a3a-4d74-af18-1522ed3f2933 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:12.802952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ffb5d-3a3a-4d74-af18-1522ed3f2933 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:12.803222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ffb5d-3a3a-4d74-af18-1522ed3f2933 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:12.804082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ffb5d-3a3a-4d74-af18-1522ed3f2933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:12.805708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ffb5d-3a3a-4d74-af18-1522ed3f2933 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:12.820875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f0db2-0850-4a32-ace8-aef32d0fed4e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:12.824964 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1880/3756] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:13:12.831337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ffb5d-3a3a-4d74-af18-1522ed3f2933 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:12.854098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ffb5d-3a3a-4d74-af18-1522ed3f2933 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:12.856085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f0db2-0850-4a32-ace8-aef32d0fed4e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:12.864497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b533dbe-7faa-46e6-82a3-3e8988d476a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:12.865641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b533dbe-7faa-46e6-82a3-3e8988d476a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:12.866167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b533dbe-7faa-46e6-82a3-3e8988d476a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:12.866657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b533dbe-7faa-46e6-82a3-3e8988d476a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:12.867659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b533dbe-7faa-46e6-82a3-3e8988d476a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:12.868069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36927053-b69e-48d4-a6fc-c27982f68abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:12.868718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36927053-b69e-48d4-a6fc-c27982f68abe admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:12.869004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36927053-b69e-48d4-a6fc-c27982f68abe admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:12.869286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36927053-b69e-48d4-a6fc-c27982f68abe admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:12.869995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36927053-b69e-48d4-a6fc-c27982f68abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:12.871261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b533dbe-7faa-46e6-82a3-3e8988d476a3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:12.871611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36927053-b69e-48d4-a6fc-c27982f68abe admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:12.889813 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1881/3757] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:13:12.897705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36927053-b69e-48d4-a6fc-c27982f68abe admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:12.924934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36927053-b69e-48d4-a6fc-c27982f68abe admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:12.940321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bfe4b-03c5-4748-af01-dcb0aff5abaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:12.941016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bfe4b-03c5-4748-af01-dcb0aff5abaa admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:12.941303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bfe4b-03c5-4748-af01-dcb0aff5abaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:12.941612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bfe4b-03c5-4748-af01-dcb0aff5abaa admin admin] PATH_INFO: `/v3/projects/ee919a6a30cb4a3292cbdb6888a69da8/users/d0e3cb3ffeb0490ab082907ce6673e65/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:12.965005 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1877/3758] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:13:12 2022] POST /identity/v3/projects => generated 395 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:13:12.972629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b533dbe-7faa-46e6-82a3-3e8988d476a3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:12.975571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bfe4b-03c5-4748-af01-dcb0aff5abaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee919a6a30cb4a3292cbdb6888a69da8, user_id=d0e3cb3ffeb0490ab082907ce6673e65, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:12.978452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bfe4b-03c5-4748-af01-dcb0aff5abaa admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:13.017429 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1882/3759] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:13:12 2022] PUT /identity/v3/projects/ee919a6a30cb4a3292cbdb6888a69da8/users/d0e3cb3ffeb0490ab082907ce6673e65/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:13.027640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5b548-f66c-4677-aa8e-cdc132757735 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:13.027990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5b548-f66c-4677-aa8e-cdc132757735 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:13.028195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5b548-f66c-4677-aa8e-cdc132757735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:13.097641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d3e5b548-f66c-4677-aa8e-cdc132757735 None None] MFA Rules not processed for user `d0e3cb3ffeb0490ab082907ce6673e65`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:13.098898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d3e5b548-f66c-4677-aa8e-cdc132757735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:13.119076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b533dbe-7faa-46e6-82a3-3e8988d476a3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:13.155574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:13.167452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:13.252961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62765061-970b-4a53-a407-6e79d929ceca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:13.256695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62765061-970b-4a53-a407-6e79d929ceca admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:13.259724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62765061-970b-4a53-a407-6e79d929ceca admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:13.260247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62765061-970b-4a53-a407-6e79d929ceca admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:13.271051 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1883/3760] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:13.275207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62765061-970b-4a53-a407-6e79d929ceca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:13.275407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5b548-f66c-4677-aa8e-cdc132757735 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:13.290945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62765061-970b-4a53-a407-6e79d929ceca admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:13.297190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5b548-f66c-4677-aa8e-cdc132757735 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:13.308211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53085cb-59e5-4f05-8277-17059ead89e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:13.308211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53085cb-59e5-4f05-8277-17059ead89e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:13.308211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53085cb-59e5-4f05-8277-17059ead89e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:13.308566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53085cb-59e5-4f05-8277-17059ead89e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:13.309086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53085cb-59e5-4f05-8277-17059ead89e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:13.320967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53085cb-59e5-4f05-8277-17059ead89e0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:13.377543 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1884/3761] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:13:13 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:13:13.379404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53085cb-59e5-4f05-8277-17059ead89e0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:13.382181 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1878/3762] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:13:12 2022] POST /identity/v3/users => generated 298 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:13:13.387016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62765061-970b-4a53-a407-6e79d929ceca admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:13.423033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62765061-970b-4a53-a407-6e79d929ceca admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:13.488986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53085cb-59e5-4f05-8277-17059ead89e0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:13.496079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6741f-9a1f-400b-af1f-57a7e83adab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:13.496770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6741f-9a1f-400b-af1f-57a7e83adab2 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:13.497060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6741f-9a1f-400b-af1f-57a7e83adab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:13.497339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6741f-9a1f-400b-af1f-57a7e83adab2 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:13.498075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6741f-9a1f-400b-af1f-57a7e83adab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:13.500042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6741f-9a1f-400b-af1f-57a7e83adab2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:13.546845 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1885/3763] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:13:13 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:13:13.548751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6741f-9a1f-400b-af1f-57a7e83adab2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:13.562175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6741f-9a1f-400b-af1f-57a7e83adab2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:13.576535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e097dd-d816-493d-9fb7-80d1c0f95cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:13.578854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e097dd-d816-493d-9fb7-80d1c0f95cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:13.579274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e097dd-d816-493d-9fb7-80d1c0f95cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:13.580429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e097dd-d816-493d-9fb7-80d1c0f95cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:13.581272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e097dd-d816-493d-9fb7-80d1c0f95cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:13.583990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e097dd-d816-493d-9fb7-80d1c0f95cf8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:13.601599 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1886/3764] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:13:13.604658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f553cd-eec4-4371-8af1-edaf9d93a6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:13.605427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f553cd-eec4-4371-8af1-edaf9d93a6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:13.605743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e097dd-d816-493d-9fb7-80d1c0f95cf8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:13.606602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f553cd-eec4-4371-8af1-edaf9d93a6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:13.607116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f553cd-eec4-4371-8af1-edaf9d93a6b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:13.608546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f553cd-eec4-4371-8af1-edaf9d93a6b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:13.612618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f553cd-eec4-4371-8af1-edaf9d93a6b0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:13.636469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e097dd-d816-493d-9fb7-80d1c0f95cf8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:13.649370 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1879/3765] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:13:13.650987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f553cd-eec4-4371-8af1-edaf9d93a6b0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:13.653798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd39b52-a282-40f4-ad20-9e5a0bf38cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:13.654669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd39b52-a282-40f4-ad20-9e5a0bf38cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:13.655479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd39b52-a282-40f4-ad20-9e5a0bf38cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:13.657017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd39b52-a282-40f4-ad20-9e5a0bf38cfa admin admin] PATH_INFO: `/v3/projects/66ac2f70e5404fb484bce2857196a9a1/users/95dd01dc41ad41e3ac32851745e268bc/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:13.680621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f553cd-eec4-4371-8af1-edaf9d93a6b0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:13.691801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42977d3-0d4a-43f1-be19-cc8010db4544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:13.692700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42977d3-0d4a-43f1-be19-cc8010db4544 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:13.693659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42977d3-0d4a-43f1-be19-cc8010db4544 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:13.694647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd39b52-a282-40f4-ad20-9e5a0bf38cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ac2f70e5404fb484bce2857196a9a1, user_id=95dd01dc41ad41e3ac32851745e268bc, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:13.695059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42977d3-0d4a-43f1-be19-cc8010db4544 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:13.695917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42977d3-0d4a-43f1-be19-cc8010db4544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:13.701329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42977d3-0d4a-43f1-be19-cc8010db4544 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:13.702791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd39b52-a282-40f4-ad20-9e5a0bf38cfa admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:13.735762 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1880/3766] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:13:13.737470 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1887/3767] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:13:13 2022] PUT /identity/v3/projects/66ac2f70e5404fb484bce2857196a9a1/users/95dd01dc41ad41e3ac32851745e268bc/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:13.741943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42977d3-0d4a-43f1-be19-cc8010db4544 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:13.743868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd39b52-a282-40f4-ad20-9e5a0bf38cfa admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:13.768774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42977d3-0d4a-43f1-be19-cc8010db4544 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:13.874509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:13.889990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d00076-7169-48c7-bfc1-8ba6eee8af13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:13.891704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d00076-7169-48c7-bfc1-8ba6eee8af13 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:13.892251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d00076-7169-48c7-bfc1-8ba6eee8af13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:13.892708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d00076-7169-48c7-bfc1-8ba6eee8af13 admin admin] PATH_INFO: `/v3/projects/8062527ac2b2406bbb3856d37f7af540/users/7c6e44ff30dc435b8fd6d9d76e02287f/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:13.898394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd39b52-a282-40f4-ad20-9e5a0bf38cfa admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:13.911541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964ce83-35da-4ee8-b025-916325052723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:13.912233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964ce83-35da-4ee8-b025-916325052723 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:13.912516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964ce83-35da-4ee8-b025-916325052723 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:13.912837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964ce83-35da-4ee8-b025-916325052723 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:13.913541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964ce83-35da-4ee8-b025-916325052723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:13.916116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964ce83-35da-4ee8-b025-916325052723 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:13.930990 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1888/3768] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:13:13.935215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964ce83-35da-4ee8-b025-916325052723 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:13.941425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d00076-7169-48c7-bfc1-8ba6eee8af13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8062527ac2b2406bbb3856d37f7af540, user_id=7c6e44ff30dc435b8fd6d9d76e02287f, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:13.945793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d00076-7169-48c7-bfc1-8ba6eee8af13 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:13.958747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964ce83-35da-4ee8-b025-916325052723 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:13.974042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d8071-d716-42c1-9833-60be40595bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:13.974851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d8071-d716-42c1-9833-60be40595bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:13.975138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d8071-d716-42c1-9833-60be40595bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:13.975448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d8071-d716-42c1-9833-60be40595bdb admin admin] PATH_INFO: `/v3/projects/66ac2f70e5404fb484bce2857196a9a1/users/95dd01dc41ad41e3ac32851745e268bc/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:13.985253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d8071-d716-42c1-9833-60be40595bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ac2f70e5404fb484bce2857196a9a1, user_id=95dd01dc41ad41e3ac32851745e268bc, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:13.989057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d8071-d716-42c1-9833-60be40595bdb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:14.031893 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1889/3769] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:13:13 2022] PUT /identity/v3/projects/66ac2f70e5404fb484bce2857196a9a1/users/95dd01dc41ad41e3ac32851745e268bc/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:14.034087 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1881/3770] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:13:13 2022] PUT /identity/v3/projects/8062527ac2b2406bbb3856d37f7af540/users/7c6e44ff30dc435b8fd6d9d76e02287f/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:14.036864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8bc76-7296-47e0-a3dc-9a353cf69475 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:14.037165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8bc76-7296-47e0-a3dc-9a353cf69475 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:14.037456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8bc76-7296-47e0-a3dc-9a353cf69475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:14.039486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ea61e-61ed-43a9-a7c0-f38b67988ce7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:14.039832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ea61e-61ed-43a9-a7c0-f38b67988ce7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:14.040175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ea61e-61ed-43a9-a7c0-f38b67988ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:14.100773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bd2ea61e-61ed-43a9-a7c0-f38b67988ce7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:14.123785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bd2ea61e-61ed-43a9-a7c0-f38b67988ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:14.124474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-cba8bc76-7296-47e0-a3dc-9a353cf69475 None None] MFA Rules not processed for user `95dd01dc41ad41e3ac32851745e268bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:14.125736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cba8bc76-7296-47e0-a3dc-9a353cf69475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:14.201167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:14.295775 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1890/3771] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:14.341106 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1882/3772] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:14.360245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8bc76-7296-47e0-a3dc-9a353cf69475 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:14.362702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cba8bc76-7296-47e0-a3dc-9a353cf69475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:14.424168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ea61e-61ed-43a9-a7c0-f38b67988ce7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:14.426541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bd2ea61e-61ed-43a9-a7c0-f38b67988ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:14.455310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8bc76-7296-47e0-a3dc-9a353cf69475 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:14.459536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d5c33-b158-4a44-9b77-bb47cc38eeed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:14.460242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d5c33-b158-4a44-9b77-bb47cc38eeed service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:14.460593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d5c33-b158-4a44-9b77-bb47cc38eeed service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:14.460963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d5c33-b158-4a44-9b77-bb47cc38eeed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:14.471738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d5c33-b158-4a44-9b77-bb47cc38eeed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:14.473553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d5c33-b158-4a44-9b77-bb47cc38eeed service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:14.485088 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1891/3773] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:13:14.543895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ea61e-61ed-43a9-a7c0-f38b67988ce7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:14.557894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2620e-2a45-4f06-9809-3b6ca68bf59a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:14.558597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2620e-2a45-4f06-9809-3b6ca68bf59a service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:14.558862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2620e-2a45-4f06-9809-3b6ca68bf59a service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:14.559571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2620e-2a45-4f06-9809-3b6ca68bf59a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:14.570856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2620e-2a45-4f06-9809-3b6ca68bf59a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:14.572627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2620e-2a45-4f06-9809-3b6ca68bf59a service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:14.587653 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1883/3774] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:13:16.763961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d5c33-b158-4a44-9b77-bb47cc38eeed service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:16.782893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d5c33-b158-4a44-9b77-bb47cc38eeed service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:16.797549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e11fb-632b-4695-9eb2-01cbe5192f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:16.798055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e11fb-632b-4695-9eb2-01cbe5192f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:16.805688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e11fb-632b-4695-9eb2-01cbe5192f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:16.806027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e11fb-632b-4695-9eb2-01cbe5192f9c admin admin] PATH_INFO: `/v3/users/d0e3cb3ffeb0490ab082907ce6673e65` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:16.810494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e11fb-632b-4695-9eb2-01cbe5192f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e3cb3ffeb0490ab082907ce6673e65)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:16.812499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e11fb-632b-4695-9eb2-01cbe5192f9c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:16.951311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cd3e11fb-632b-4695-9eb2-01cbe5192f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e3cb3ffeb0490ab082907ce6673e65'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:16.968343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:16.987059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cd3e11fb-632b-4695-9eb2-01cbe5192f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e3cb3ffeb0490ab082907ce6673e65'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:16.987886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cd3e11fb-632b-4695-9eb2-01cbe5192f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e3cb3ffeb0490ab082907ce6673e65'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:17.004447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cd3e11fb-632b-4695-9eb2-01cbe5192f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e3cb3ffeb0490ab082907ce6673e65'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:17.005431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cd3e11fb-632b-4695-9eb2-01cbe5192f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e3cb3ffeb0490ab082907ce6673e65'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:17.040280 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1892/3775] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:13:16 2022] DELETE /identity/v3/users/d0e3cb3ffeb0490ab082907ce6673e65 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:17.041647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ed54f-0c02-461d-a082-84f2c638a6ed None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:17.042136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ed54f-0c02-461d-a082-84f2c638a6ed None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:17.042225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ed54f-0c02-461d-a082-84f2c638a6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:17.069093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-220ed54f-0c02-461d-a082-84f2c638a6ed None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:17.074418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-220ed54f-0c02-461d-a082-84f2c638a6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:17.228994 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1884/3776] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:17.261234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e11fb-632b-4695-9eb2-01cbe5192f9c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:17.264161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cd3e11fb-632b-4695-9eb2-01cbe5192f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:17.414519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e11fb-632b-4695-9eb2-01cbe5192f9c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:17.427504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34b8c3-81f5-4aed-a66a-fa66bfdb2404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:17.428159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34b8c3-81f5-4aed-a66a-fa66bfdb2404 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:17.428446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34b8c3-81f5-4aed-a66a-fa66bfdb2404 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:17.428726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34b8c3-81f5-4aed-a66a-fa66bfdb2404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:17.480160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34b8c3-81f5-4aed-a66a-fa66bfdb2404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:17.481639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34b8c3-81f5-4aed-a66a-fa66bfdb2404 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:17.513213 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1893/3777] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:13:19.290941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ed54f-0c02-461d-a082-84f2c638a6ed None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:19.293668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-220ed54f-0c02-461d-a082-84f2c638a6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:19.327856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ed54f-0c02-461d-a082-84f2c638a6ed None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:19.337979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7f97b-af25-4fee-9823-918381f69d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:19.338906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7f97b-af25-4fee-9823-918381f69d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:19.339433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7f97b-af25-4fee-9823-918381f69d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:19.339879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7f97b-af25-4fee-9823-918381f69d34 admin admin] PATH_INFO: `/v3/projects/ee919a6a30cb4a3292cbdb6888a69da8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:19.341309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7f97b-af25-4fee-9823-918381f69d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee919a6a30cb4a3292cbdb6888a69da8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:19.343418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7f97b-af25-4fee-9823-918381f69d34 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:19.465414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:19.475939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-aec7f97b-af25-4fee-9823-918381f69d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee919a6a30cb4a3292cbdb6888a69da8', 'request_id': 'req-aec7f97b-af25-4fee-9823-918381f69d34'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:19.496693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-aec7f97b-af25-4fee-9823-918381f69d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee919a6a30cb4a3292cbdb6888a69da8', 'request_id': 'req-aec7f97b-af25-4fee-9823-918381f69d34'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:19.508681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-aec7f97b-af25-4fee-9823-918381f69d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee919a6a30cb4a3292cbdb6888a69da8', 'request_id': 'req-aec7f97b-af25-4fee-9823-918381f69d34'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:19.541210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-aec7f97b-af25-4fee-9823-918381f69d34 admin admin] The token cache is being invalidate because project ee919a6a30cb4a3292cbdb6888a69da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:13:19.541517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-aec7f97b-af25-4fee-9823-918381f69d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:19.550468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-aec7f97b-af25-4fee-9823-918381f69d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:19.552589 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1885/3778] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:13:19 2022] DELETE /identity/v3/projects/ee919a6a30cb4a3292cbdb6888a69da8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:19.556371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34b8c3-81f5-4aed-a66a-fa66bfdb2404 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:19.567234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34b8c3-81f5-4aed-a66a-fa66bfdb2404 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:19.728803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91d603-f6b8-4dce-9fc8-e61c44da5759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:19.730837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91d603-f6b8-4dce-9fc8-e61c44da5759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:19.732839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91d603-f6b8-4dce-9fc8-e61c44da5759 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:19.734150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91d603-f6b8-4dce-9fc8-e61c44da5759 admin admin] PATH_INFO: `/v3/users/95dd01dc41ad41e3ac32851745e268bc` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:19.738096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91d603-f6b8-4dce-9fc8-e61c44da5759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95dd01dc41ad41e3ac32851745e268bc)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:19.744279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91d603-f6b8-4dce-9fc8-e61c44da5759 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:19.880235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ac91d603-f6b8-4dce-9fc8-e61c44da5759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95dd01dc41ad41e3ac32851745e268bc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:19.917194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ac91d603-f6b8-4dce-9fc8-e61c44da5759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95dd01dc41ad41e3ac32851745e268bc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:19.919174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ac91d603-f6b8-4dce-9fc8-e61c44da5759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95dd01dc41ad41e3ac32851745e268bc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:19.935256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ac91d603-f6b8-4dce-9fc8-e61c44da5759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95dd01dc41ad41e3ac32851745e268bc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:19.937151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ac91d603-f6b8-4dce-9fc8-e61c44da5759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95dd01dc41ad41e3ac32851745e268bc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:19.961475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:19.967748 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1894/3779] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:13:19 2022] DELETE /identity/v3/users/95dd01dc41ad41e3ac32851745e268bc => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:21.379562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7f97b-af25-4fee-9823-918381f69d34 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:21.381961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-aec7f97b-af25-4fee-9823-918381f69d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:21.411377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7f97b-af25-4fee-9823-918381f69d34 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:21.568057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe342e2a-9696-4414-b742-d6cc9fe34276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:21.568722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe342e2a-9696-4414-b742-d6cc9fe34276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:21.571303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe342e2a-9696-4414-b742-d6cc9fe34276 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:21.571682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe342e2a-9696-4414-b742-d6cc9fe34276 admin admin] PATH_INFO: `/v3/projects/66ac2f70e5404fb484bce2857196a9a1` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:21.574228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe342e2a-9696-4414-b742-d6cc9fe34276 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ac2f70e5404fb484bce2857196a9a1)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:21.580763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe342e2a-9696-4414-b742-d6cc9fe34276 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:21.729185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe342e2a-9696-4414-b742-d6cc9fe34276 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ac2f70e5404fb484bce2857196a9a1', 'request_id': 'req-fe342e2a-9696-4414-b742-d6cc9fe34276'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:21.740576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe342e2a-9696-4414-b742-d6cc9fe34276 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ac2f70e5404fb484bce2857196a9a1', 'request_id': 'req-fe342e2a-9696-4414-b742-d6cc9fe34276'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:21.758916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe342e2a-9696-4414-b742-d6cc9fe34276 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ac2f70e5404fb484bce2857196a9a1', 'request_id': 'req-fe342e2a-9696-4414-b742-d6cc9fe34276'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:21.790591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe342e2a-9696-4414-b742-d6cc9fe34276 admin admin] The token cache is being invalidate because project 66ac2f70e5404fb484bce2857196a9a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:13:21.792644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe342e2a-9696-4414-b742-d6cc9fe34276 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:21.793613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe342e2a-9696-4414-b742-d6cc9fe34276 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:21.796013 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1886/3780] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:13:21 2022] DELETE /identity/v3/projects/66ac2f70e5404fb484bce2857196a9a1 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:21.800960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5827a4b-df5e-4983-8bdf-a5a53269ab82 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:21.802288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5827a4b-df5e-4983-8bdf-a5a53269ab82 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:21.802887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5827a4b-df5e-4983-8bdf-a5a53269ab82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:21.848461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e5827a4b-df5e-4983-8bdf-a5a53269ab82 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:21.850712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e5827a4b-df5e-4983-8bdf-a5a53269ab82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:21.993663 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1895/3781] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:22.002420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff31d5-b52e-49fe-91fe-9ff1eb2864dc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:22.003186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff31d5-b52e-49fe-91fe-9ff1eb2864dc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:22.003742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff31d5-b52e-49fe-91fe-9ff1eb2864dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:22.069475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-19ff31d5-b52e-49fe-91fe-9ff1eb2864dc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:22.070980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-19ff31d5-b52e-49fe-91fe-9ff1eb2864dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:22.101445 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1887/3782] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:22.105960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5827a4b-df5e-4983-8bdf-a5a53269ab82 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:22.120763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5827a4b-df5e-4983-8bdf-a5a53269ab82 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:22.135078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a895d8d-9bef-4333-9a91-3a87eda4a6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:22.136794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a895d8d-9bef-4333-9a91-3a87eda4a6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:22.138376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a895d8d-9bef-4333-9a91-3a87eda4a6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:22.140643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a895d8d-9bef-4333-9a91-3a87eda4a6d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:22.141571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a895d8d-9bef-4333-9a91-3a87eda4a6d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:13:22.143923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a895d8d-9bef-4333-9a91-3a87eda4a6d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:22.147368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a895d8d-9bef-4333-9a91-3a87eda4a6d7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:22.198947 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1896/3783] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:13:22.202042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff31d5-b52e-49fe-91fe-9ff1eb2864dc None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:22.214813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a895d8d-9bef-4333-9a91-3a87eda4a6d7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:22.216697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff31d5-b52e-49fe-91fe-9ff1eb2864dc None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:22.218879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0a895d8d-9bef-4333-9a91-3a87eda4a6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:22.226990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45e463-6570-4cac-8d7d-645afb7654e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:22.229655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45e463-6570-4cac-8d7d-645afb7654e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:22.234204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45e463-6570-4cac-8d7d-645afb7654e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:22.234506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45e463-6570-4cac-8d7d-645afb7654e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:22.235976 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45e463-6570-4cac-8d7d-645afb7654e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:22.238215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45e463-6570-4cac-8d7d-645afb7654e0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:22.252362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a895d8d-9bef-4333-9a91-3a87eda4a6d7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:22.269528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4c781-dd95-419e-b2eb-9ef274e7a66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:22.273003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4c781-dd95-419e-b2eb-9ef274e7a66c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:22.273555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4c781-dd95-419e-b2eb-9ef274e7a66c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:22.273847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4c781-dd95-419e-b2eb-9ef274e7a66c admin admin] PATH_INFO: `/v3/users/36fe4dfa0f564eedb8deb3491a5068a5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:22.279272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4c781-dd95-419e-b2eb-9ef274e7a66c admin admin] RBAC: Authorizing `identity:delete_user(user_id=36fe4dfa0f564eedb8deb3491a5068a5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:22.283786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4c781-dd95-419e-b2eb-9ef274e7a66c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:22.327520 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1888/3784] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:13:22 2022] POST /identity/v3/projects => generated 369 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:13:22.329696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45e463-6570-4cac-8d7d-645afb7654e0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:22.453724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-26a4c781-dd95-419e-b2eb-9ef274e7a66c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36fe4dfa0f564eedb8deb3491a5068a5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:22.489635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-26a4c781-dd95-419e-b2eb-9ef274e7a66c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36fe4dfa0f564eedb8deb3491a5068a5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:22.491580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-26a4c781-dd95-419e-b2eb-9ef274e7a66c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36fe4dfa0f564eedb8deb3491a5068a5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:22.508388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-26a4c781-dd95-419e-b2eb-9ef274e7a66c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36fe4dfa0f564eedb8deb3491a5068a5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:22.509974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-26a4c781-dd95-419e-b2eb-9ef274e7a66c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36fe4dfa0f564eedb8deb3491a5068a5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:22.528680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:22.554816 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1897/3785] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:13:22 2022] DELETE /identity/v3/users/36fe4dfa0f564eedb8deb3491a5068a5 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:22.556569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b13ac6-cdc8-4b89-9e4f-f509635f8684 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:22.560444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b13ac6-cdc8-4b89-9e4f-f509635f8684 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:22.561046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b13ac6-cdc8-4b89-9e4f-f509635f8684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:22.611663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-31b13ac6-cdc8-4b89-9e4f-f509635f8684 None None] MFA Rules not processed for user `8b930b074300497fa17ae36dc074c586`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:22.613789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-31b13ac6-cdc8-4b89-9e4f-f509635f8684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:22.641248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45e463-6570-4cac-8d7d-645afb7654e0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:22.779155 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1898/3786] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:22.793213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c50db-862f-4517-a961-889fa0deba8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:22.794262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c50db-862f-4517-a961-889fa0deba8e admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:22.794758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c50db-862f-4517-a961-889fa0deba8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:22.795261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c50db-862f-4517-a961-889fa0deba8e admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:22.796163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c50db-862f-4517-a961-889fa0deba8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:22.799547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c50db-862f-4517-a961-889fa0deba8e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:22.858723 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1889/3787] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:13:22 2022] POST /identity/v3/users => generated 285 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:13:22.859883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b13ac6-cdc8-4b89-9e4f-f509635f8684 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:22.862248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-31b13ac6-cdc8-4b89-9e4f-f509635f8684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:22.874757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:22.899547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b13ac6-cdc8-4b89-9e4f-f509635f8684 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:22.906992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957427a-5b2a-4c0d-ae3c-f41a0c10b646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:22.922336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957427a-5b2a-4c0d-ae3c-f41a0c10b646 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:22.922924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957427a-5b2a-4c0d-ae3c-f41a0c10b646 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:22.923391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957427a-5b2a-4c0d-ae3c-f41a0c10b646 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:22.924473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957427a-5b2a-4c0d-ae3c-f41a0c10b646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:22.932504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957427a-5b2a-4c0d-ae3c-f41a0c10b646 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:22.982834 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1899/3788] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:13:22.987198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c50db-862f-4517-a961-889fa0deba8e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:23.022566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c50db-862f-4517-a961-889fa0deba8e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:23.038947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdee81-f0ec-4db4-9a0a-e78df8e98c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:23.039715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdee81-f0ec-4db4-9a0a-e78df8e98c74 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:23.040001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdee81-f0ec-4db4-9a0a-e78df8e98c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:23.040284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdee81-f0ec-4db4-9a0a-e78df8e98c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:23.040984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdee81-f0ec-4db4-9a0a-e78df8e98c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:23.043481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdee81-f0ec-4db4-9a0a-e78df8e98c74 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:23.074346 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1890/3789] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:13:23.078938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957427a-5b2a-4c0d-ae3c-f41a0c10b646 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:23.102360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957427a-5b2a-4c0d-ae3c-f41a0c10b646 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:23.112629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9f27e-c3ef-490a-86de-f3a07fe68f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:23.113463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9f27e-c3ef-490a-86de-f3a07fe68f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:23.113915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9f27e-c3ef-490a-86de-f3a07fe68f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:23.114201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9f27e-c3ef-490a-86de-f3a07fe68f62 admin admin] PATH_INFO: `/v3/projects/9476d2b50a404e7ba2ef4815d057347c/users/e2b4d333a61642909bc022c729bfe075/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:23.159519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9f27e-c3ef-490a-86de-f3a07fe68f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9476d2b50a404e7ba2ef4815d057347c, user_id=e2b4d333a61642909bc022c729bfe075, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:23.167126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9f27e-c3ef-490a-86de-f3a07fe68f62 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:23.228551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31862ea-5b14-424f-971b-9f046b497279 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:23.228920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31862ea-5b14-424f-971b-9f046b497279 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:23.229121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31862ea-5b14-424f-971b-9f046b497279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:23.232838 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1900/3790] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:13:23 2022] PUT /identity/v3/projects/9476d2b50a404e7ba2ef4815d057347c/users/e2b4d333a61642909bc022c729bfe075/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:23.423210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d31862ea-5b14-424f-971b-9f046b497279 None None] MFA Rules not processed for user `e2b4d333a61642909bc022c729bfe075`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:23.425959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d31862ea-5b14-424f-971b-9f046b497279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:23.691806 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1891/3791] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:23.989069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9f27e-c3ef-490a-86de-f3a07fe68f62 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:23.992271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-dff9f27e-c3ef-490a-86de-f3a07fe68f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:24.147487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9f27e-c3ef-490a-86de-f3a07fe68f62 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:24.162468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018220d-9df1-4e81-bc4e-a25af5edf9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:24.165550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018220d-9df1-4e81-bc4e-a25af5edf9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:24.166771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018220d-9df1-4e81-bc4e-a25af5edf9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:24.167255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018220d-9df1-4e81-bc4e-a25af5edf9f8 admin admin] PATH_INFO: `/v3/projects/7e9653a81a694ec29d1fcfe2da97eaa3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:24.171735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018220d-9df1-4e81-bc4e-a25af5edf9f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e9653a81a694ec29d1fcfe2da97eaa3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:24.177917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018220d-9df1-4e81-bc4e-a25af5edf9f8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:24.224738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31862ea-5b14-424f-971b-9f046b497279 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:24.226394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d31862ea-5b14-424f-971b-9f046b497279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:24.323740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b018220d-9df1-4e81-bc4e-a25af5edf9f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e9653a81a694ec29d1fcfe2da97eaa3', 'request_id': 'req-b018220d-9df1-4e81-bc4e-a25af5edf9f8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:24.356918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b018220d-9df1-4e81-bc4e-a25af5edf9f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e9653a81a694ec29d1fcfe2da97eaa3', 'request_id': 'req-b018220d-9df1-4e81-bc4e-a25af5edf9f8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:24.364187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:24.394868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b018220d-9df1-4e81-bc4e-a25af5edf9f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e9653a81a694ec29d1fcfe2da97eaa3', 'request_id': 'req-b018220d-9df1-4e81-bc4e-a25af5edf9f8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:24.419487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b018220d-9df1-4e81-bc4e-a25af5edf9f8 admin admin] The token cache is being invalidate because project 7e9653a81a694ec29d1fcfe2da97eaa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:13:24.419683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31862ea-5b14-424f-971b-9f046b497279 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:24.423915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b018220d-9df1-4e81-bc4e-a25af5edf9f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:24.426600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b018220d-9df1-4e81-bc4e-a25af5edf9f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:24.429251 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1901/3792] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:13:23 2022] DELETE /identity/v3/projects/7e9653a81a694ec29d1fcfe2da97eaa3 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:24.434288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33f357-83b8-411e-bdb6-360ea1a406f7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:24.434784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33f357-83b8-411e-bdb6-360ea1a406f7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:24.435222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33f357-83b8-411e-bdb6-360ea1a406f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:24.483449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3a33f357-83b8-411e-bdb6-360ea1a406f7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:24.485181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3a33f357-83b8-411e-bdb6-360ea1a406f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:24.617055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:24.635623 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1902/3793] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:13:24.643554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8a67e-67fd-49bd-aaea-d54000214c53 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:24.643851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8a67e-67fd-49bd-aaea-d54000214c53 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:24.644670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9781ab0-25c1-40ee-ae6a-857b2c688bfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:24.645456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8a67e-67fd-49bd-aaea-d54000214c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:24.648674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9781ab0-25c1-40ee-ae6a-857b2c688bfc service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:24.649112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9781ab0-25c1-40ee-ae6a-857b2c688bfc service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:24.649400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9781ab0-25c1-40ee-ae6a-857b2c688bfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:24.655128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c9781ab0-25c1-40ee-ae6a-857b2c688bfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:24.684285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-51c8a67e-67fd-49bd-aaea-d54000214c53 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:24.685710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-51c8a67e-67fd-49bd-aaea-d54000214c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:24.715820 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1903/3794] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:24.717068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8a67e-67fd-49bd-aaea-d54000214c53 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:24.735578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8a67e-67fd-49bd-aaea-d54000214c53 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:24.755005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db90b54-e548-4ff5-8563-37ec146bfd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:24.755680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db90b54-e548-4ff5-8563-37ec146bfd0b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:24.755968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db90b54-e548-4ff5-8563-37ec146bfd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:24.756251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db90b54-e548-4ff5-8563-37ec146bfd0b admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:24.759025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db90b54-e548-4ff5-8563-37ec146bfd0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:13:24.759025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db90b54-e548-4ff5-8563-37ec146bfd0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:24.760351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db90b54-e548-4ff5-8563-37ec146bfd0b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:24.804430 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1904/3795] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:13:24.808567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db90b54-e548-4ff5-8563-37ec146bfd0b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:24.820080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9781ab0-25c1-40ee-ae6a-857b2c688bfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:24.825878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9781ab0-25c1-40ee-ae6a-857b2c688bfc service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:24.839707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db90b54-e548-4ff5-8563-37ec146bfd0b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:24.849806 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1892/3796] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:24 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:13:24.869420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a18420-7883-440b-87c3-39500cd88543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:24.870956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a18420-7883-440b-87c3-39500cd88543 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:24.871747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a18420-7883-440b-87c3-39500cd88543 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:24.872219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a18420-7883-440b-87c3-39500cd88543 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:24.873123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a18420-7883-440b-87c3-39500cd88543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:24.875599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a18420-7883-440b-87c3-39500cd88543 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:24.932887 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1905/3797] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:13:24 2022] POST /identity/v3/projects => generated 369 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:13:24.936771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9781ab0-25c1-40ee-ae6a-857b2c688bfc service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:24.969570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9781ab0-25c1-40ee-ae6a-857b2c688bfc service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:25.149871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd1da6-4e53-4251-8b9a-1d88a3f1697b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:25.150833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd1da6-4e53-4251-8b9a-1d88a3f1697b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:25.151384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd1da6-4e53-4251-8b9a-1d88a3f1697b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:25.151898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd1da6-4e53-4251-8b9a-1d88a3f1697b admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:25.152802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd1da6-4e53-4251-8b9a-1d88a3f1697b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:25.160179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd1da6-4e53-4251-8b9a-1d88a3f1697b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:25.202881 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1893/3798] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:13:24 2022] POST /identity/v3/users => generated 285 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:13:25.206677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a18420-7883-440b-87c3-39500cd88543 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:25.229498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a18420-7883-440b-87c3-39500cd88543 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:25.238404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b2816-a42e-45df-9e7b-fa32f9a0b656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:25.239281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b2816-a42e-45df-9e7b-fa32f9a0b656 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:25.239737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b2816-a42e-45df-9e7b-fa32f9a0b656 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:25.240191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b2816-a42e-45df-9e7b-fa32f9a0b656 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:25.241812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b2816-a42e-45df-9e7b-fa32f9a0b656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:25.243791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b2816-a42e-45df-9e7b-fa32f9a0b656 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:25.263543 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1906/3799] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:13:25.267629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd1da6-4e53-4251-8b9a-1d88a3f1697b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:25.295857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd1da6-4e53-4251-8b9a-1d88a3f1697b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:25.303459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2e6c2-7a9d-48eb-a22b-78e6dccaa8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:25.304462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2e6c2-7a9d-48eb-a22b-78e6dccaa8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:25.304892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2e6c2-7a9d-48eb-a22b-78e6dccaa8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:25.305454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2e6c2-7a9d-48eb-a22b-78e6dccaa8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:25.307314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2e6c2-7a9d-48eb-a22b-78e6dccaa8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:25.311893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2e6c2-7a9d-48eb-a22b-78e6dccaa8d9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:25.339948 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1894/3800] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:13:25.345024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b2816-a42e-45df-9e7b-fa32f9a0b656 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:25.374145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b2816-a42e-45df-9e7b-fa32f9a0b656 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:25.402659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b9e66-4128-491b-84eb-b2656e4a44d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:25.404960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b9e66-4128-491b-84eb-b2656e4a44d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:25.409706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b9e66-4128-491b-84eb-b2656e4a44d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:25.410222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b9e66-4128-491b-84eb-b2656e4a44d8 admin admin] PATH_INFO: `/v3/projects/93838542feaa41ff9c8cac14d04fc99a/users/6e84c9c580a24203a9b37732bda4e135/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:25.454922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b9e66-4128-491b-84eb-b2656e4a44d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93838542feaa41ff9c8cac14d04fc99a, user_id=6e84c9c580a24203a9b37732bda4e135, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:25.459662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b9e66-4128-491b-84eb-b2656e4a44d8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:25.516829 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1907/3801] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:13:25 2022] PUT /identity/v3/projects/93838542feaa41ff9c8cac14d04fc99a/users/6e84c9c580a24203a9b37732bda4e135/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:25.602498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dca4c4-8ac9-41fd-85c2-ffccbfdac3ff None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:25.602797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dca4c4-8ac9-41fd-85c2-ffccbfdac3ff None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:25.603050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dca4c4-8ac9-41fd-85c2-ffccbfdac3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:25.611241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:25.642956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-83dca4c4-8ac9-41fd-85c2-ffccbfdac3ff None None] MFA Rules not processed for user `6e84c9c580a24203a9b37732bda4e135`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:25.644257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-83dca4c4-8ac9-41fd-85c2-ffccbfdac3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:25.754485 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1895/3802] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:25.759471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232fd8b-fae8-4539-8423-7b7a19adef53 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:25.759761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232fd8b-fae8-4539-8423-7b7a19adef53 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:25.760037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232fd8b-fae8-4539-8423-7b7a19adef53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:25.786063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d232fd8b-fae8-4539-8423-7b7a19adef53 None None] MFA Rules not processed for user `6e84c9c580a24203a9b37732bda4e135`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:25.787322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d232fd8b-fae8-4539-8423-7b7a19adef53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:25.805155 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1908/3803] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:26.222246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dca4c4-8ac9-41fd-85c2-ffccbfdac3ff None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:26.224560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-83dca4c4-8ac9-41fd-85c2-ffccbfdac3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:26.466277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dca4c4-8ac9-41fd-85c2-ffccbfdac3ff None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:26.483492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580e596-69d4-4279-bc41-96ab1e5f0cd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:26.484156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580e596-69d4-4279-bc41-96ab1e5f0cd3 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:26.484448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580e596-69d4-4279-bc41-96ab1e5f0cd3 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:26.484727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580e596-69d4-4279-bc41-96ab1e5f0cd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:26.507548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580e596-69d4-4279-bc41-96ab1e5f0cd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:26.509921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580e596-69d4-4279-bc41-96ab1e5f0cd3 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:26.529484 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1896/3804] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:13:29.683332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232fd8b-fae8-4539-8423-7b7a19adef53 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:29.685192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d232fd8b-fae8-4539-8423-7b7a19adef53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:29.814398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232fd8b-fae8-4539-8423-7b7a19adef53 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:29.819322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81647c0-b96e-4ff9-8e0f-95de5493bfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:29.820070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81647c0-b96e-4ff9-8e0f-95de5493bfc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:29.820354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81647c0-b96e-4ff9-8e0f-95de5493bfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:29.820630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81647c0-b96e-4ff9-8e0f-95de5493bfc3 admin admin] PATH_INFO: `/v3/users/f89692ad732b4d9f8429659ee6a03a0b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:29.821834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81647c0-b96e-4ff9-8e0f-95de5493bfc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f89692ad732b4d9f8429659ee6a03a0b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:29.823789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81647c0-b96e-4ff9-8e0f-95de5493bfc3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:29.898454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b81647c0-b96e-4ff9-8e0f-95de5493bfc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f89692ad732b4d9f8429659ee6a03a0b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:29.916851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b81647c0-b96e-4ff9-8e0f-95de5493bfc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f89692ad732b4d9f8429659ee6a03a0b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:29.917669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b81647c0-b96e-4ff9-8e0f-95de5493bfc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f89692ad732b4d9f8429659ee6a03a0b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:29.926903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b81647c0-b96e-4ff9-8e0f-95de5493bfc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f89692ad732b4d9f8429659ee6a03a0b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:29.927616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b81647c0-b96e-4ff9-8e0f-95de5493bfc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f89692ad732b4d9f8429659ee6a03a0b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:29.934330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:29.975761 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1909/3805] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:13:29 2022] DELETE /identity/v3/users/f89692ad732b4d9f8429659ee6a03a0b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:30.426165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580e596-69d4-4279-bc41-96ab1e5f0cd3 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:30.428330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b580e596-69d4-4279-bc41-96ab1e5f0cd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:30.463490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580e596-69d4-4279-bc41-96ab1e5f0cd3 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:30.673041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823cc91-f908-47ec-889c-2260b5d660d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:30.673903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823cc91-f908-47ec-889c-2260b5d660d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:30.674190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823cc91-f908-47ec-889c-2260b5d660d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:30.674464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823cc91-f908-47ec-889c-2260b5d660d1 admin admin] PATH_INFO: `/v3/users/e2b4d333a61642909bc022c729bfe075` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:30.675689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823cc91-f908-47ec-889c-2260b5d660d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b4d333a61642909bc022c729bfe075)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:30.677609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823cc91-f908-47ec-889c-2260b5d660d1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:30.739709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:30.767608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0db387-460f-493f-8bf1-7d32f356209e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:30.769019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0db387-460f-493f-8bf1-7d32f356209e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:30.769523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0db387-460f-493f-8bf1-7d32f356209e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:30.800174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d823cc91-f908-47ec-889c-2260b5d660d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b4d333a61642909bc022c729bfe075'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:30.807030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d823cc91-f908-47ec-889c-2260b5d660d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b4d333a61642909bc022c729bfe075'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:30.861125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8d0db387-460f-493f-8bf1-7d32f356209e None None] MFA Rules not processed for user `7c6e44ff30dc435b8fd6d9d76e02287f`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:30.862730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8d0db387-460f-493f-8bf1-7d32f356209e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:30.865523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d823cc91-f908-47ec-889c-2260b5d660d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b4d333a61642909bc022c729bfe075'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:30.866286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d823cc91-f908-47ec-889c-2260b5d660d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b4d333a61642909bc022c729bfe075'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:30.887229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d823cc91-f908-47ec-889c-2260b5d660d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b4d333a61642909bc022c729bfe075'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:30.934280 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1897/3806] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:13:30 2022] DELETE /identity/v3/users/e2b4d333a61642909bc022c729bfe075 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:30.942245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1f4c-eae4-48b6-8af2-5c4fccd921cd None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:30.942546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1f4c-eae4-48b6-8af2-5c4fccd921cd None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:30.943442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1f4c-eae4-48b6-8af2-5c4fccd921cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:31.027382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-991b1f4c-eae4-48b6-8af2-5c4fccd921cd None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:31.030725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-991b1f4c-eae4-48b6-8af2-5c4fccd921cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:31.085315 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1910/3807] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:31.095971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0db387-460f-493f-8bf1-7d32f356209e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:31.099766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8d0db387-460f-493f-8bf1-7d32f356209e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:31.343244 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1898/3808] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:31.369010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0db387-460f-493f-8bf1-7d32f356209e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:31.533810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b0254-24d0-434d-b539-d490a7dba2c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:31.535210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b0254-24d0-434d-b539-d490a7dba2c7 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:31.535737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b0254-24d0-434d-b539-d490a7dba2c7 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:31.536245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b0254-24d0-434d-b539-d490a7dba2c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:31.570069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:31.623764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b1f4c-eae4-48b6-8af2-5c4fccd921cd None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:31.625803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-991b1f4c-eae4-48b6-8af2-5c4fccd921cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:31.679969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b0254-24d0-434d-b539-d490a7dba2c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:31.682401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b0254-24d0-434d-b539-d490a7dba2c7 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:31.706103 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1911/3809] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:13:31.864728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b1f4c-eae4-48b6-8af2-5c4fccd921cd None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:31.881425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b6168-9e16-4337-9edd-a9e4ee3077ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:31.882457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b6168-9e16-4337-9edd-a9e4ee3077ff service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:31.891989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b6168-9e16-4337-9edd-a9e4ee3077ff service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:31.892430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b6168-9e16-4337-9edd-a9e4ee3077ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:31.930507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b6168-9e16-4337-9edd-a9e4ee3077ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:31.936625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b6168-9e16-4337-9edd-a9e4ee3077ff service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:31.989460 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1899/3810] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:13:33.435224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b0254-24d0-434d-b539-d490a7dba2c7 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:33.437156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-494b0254-24d0-434d-b539-d490a7dba2c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:33.481638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b0254-24d0-434d-b539-d490a7dba2c7 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:33.500521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41ac80-c962-4092-8836-0109f9cde4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:33.503380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41ac80-c962-4092-8836-0109f9cde4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:33.504693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41ac80-c962-4092-8836-0109f9cde4db admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:33.507386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41ac80-c962-4092-8836-0109f9cde4db admin admin] PATH_INFO: `/v3/projects/af6c6b5ced854c3ca03b65cb69903ef5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:33.513361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41ac80-c962-4092-8836-0109f9cde4db admin admin] RBAC: Authorizing `identity:delete_project(project_id=af6c6b5ced854c3ca03b65cb69903ef5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:33.521131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41ac80-c962-4092-8836-0109f9cde4db admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:33.683938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-af41ac80-c962-4092-8836-0109f9cde4db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af6c6b5ced854c3ca03b65cb69903ef5', 'request_id': 'req-af41ac80-c962-4092-8836-0109f9cde4db'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:33.699467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-af41ac80-c962-4092-8836-0109f9cde4db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af6c6b5ced854c3ca03b65cb69903ef5', 'request_id': 'req-af41ac80-c962-4092-8836-0109f9cde4db'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:33.725275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-af41ac80-c962-4092-8836-0109f9cde4db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af6c6b5ced854c3ca03b65cb69903ef5', 'request_id': 'req-af41ac80-c962-4092-8836-0109f9cde4db'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:33.755172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-af41ac80-c962-4092-8836-0109f9cde4db admin admin] The token cache is being invalidate because project af6c6b5ced854c3ca03b65cb69903ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:13:33.755172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-af41ac80-c962-4092-8836-0109f9cde4db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:33.756656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-af41ac80-c962-4092-8836-0109f9cde4db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:33.758943 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1912/3811] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:13:33 2022] DELETE /identity/v3/projects/af6c6b5ced854c3ca03b65cb69903ef5 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:33.763601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc4304-11e3-4fb6-8110-3851447d6a1b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:33.764439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc4304-11e3-4fb6-8110-3851447d6a1b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:33.764909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc4304-11e3-4fb6-8110-3851447d6a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:33.850607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3edc4304-11e3-4fb6-8110-3851447d6a1b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:33.852412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3edc4304-11e3-4fb6-8110-3851447d6a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:33.971950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:34.050703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48d7cf-50b5-4129-803a-13070041399e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:34.051039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48d7cf-50b5-4129-803a-13070041399e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:34.051273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48d7cf-50b5-4129-803a-13070041399e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:34.053303 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1900/3812] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:34.097718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2b48d7cf-50b5-4129-803a-13070041399e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:34.101056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2b48d7cf-50b5-4129-803a-13070041399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:34.135908 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1913/3813] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:13:34.137709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc4304-11e3-4fb6-8110-3851447d6a1b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:34.154595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc4304-11e3-4fb6-8110-3851447d6a1b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:34.166343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ec2ac-1f8e-4fec-8175-02da7d6403ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:34.169604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ec2ac-1f8e-4fec-8175-02da7d6403ec admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:34.169923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ec2ac-1f8e-4fec-8175-02da7d6403ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:34.170202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ec2ac-1f8e-4fec-8175-02da7d6403ec admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:34.170922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ec2ac-1f8e-4fec-8175-02da7d6403ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:13:34.171233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ec2ac-1f8e-4fec-8175-02da7d6403ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:34.173442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ec2ac-1f8e-4fec-8175-02da7d6403ec admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:34.237385 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1901/3814] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:13:34.237713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48d7cf-50b5-4129-803a-13070041399e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:34.248713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48d7cf-50b5-4129-803a-13070041399e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:34.282264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c2625-5402-432a-aeb4-6a6d93c1f600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:34.282953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c2625-5402-432a-aeb4-6a6d93c1f600 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:34.283245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c2625-5402-432a-aeb4-6a6d93c1f600 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:34.283565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c2625-5402-432a-aeb4-6a6d93c1f600 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:34.284273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c2625-5402-432a-aeb4-6a6d93c1f600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:34.296239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c2625-5402-432a-aeb4-6a6d93c1f600 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:34.393300 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1914/3815] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:13:34 2022] POST /identity/v3/projects => generated 395 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:13:34.397059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ec2ac-1f8e-4fec-8175-02da7d6403ec admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:34.412243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ec2ac-1f8e-4fec-8175-02da7d6403ec admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:34.617063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a127780-d504-4a14-91fd-afe1220b7162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:34.617754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a127780-d504-4a14-91fd-afe1220b7162 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:34.619513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a127780-d504-4a14-91fd-afe1220b7162 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:34.619809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a127780-d504-4a14-91fd-afe1220b7162 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:34.620501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a127780-d504-4a14-91fd-afe1220b7162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:34.622456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a127780-d504-4a14-91fd-afe1220b7162 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:34.686712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c2625-5402-432a-aeb4-6a6d93c1f600 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:34.693959 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1902/3816] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:13:34 2022] POST /identity/v3/users => generated 298 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:13:34.704058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c2625-5402-432a-aeb4-6a6d93c1f600 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:34.719367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891f7c1-4188-48b6-b699-6ab9be9b99c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:34.720559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891f7c1-4188-48b6-b699-6ab9be9b99c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:34.720847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891f7c1-4188-48b6-b699-6ab9be9b99c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:34.721962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891f7c1-4188-48b6-b699-6ab9be9b99c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:34.722680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891f7c1-4188-48b6-b699-6ab9be9b99c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:34.724319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891f7c1-4188-48b6-b699-6ab9be9b99c8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:34.797419 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1915/3817] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:13:34.802140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a127780-d504-4a14-91fd-afe1220b7162 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:34.818035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a127780-d504-4a14-91fd-afe1220b7162 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:34.852530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc2cae-3df2-40dc-9372-654914d23230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:34.854672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc2cae-3df2-40dc-9372-654914d23230 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:34.855410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc2cae-3df2-40dc-9372-654914d23230 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:34.857335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc2cae-3df2-40dc-9372-654914d23230 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:34.858160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc2cae-3df2-40dc-9372-654914d23230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:34.875176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc2cae-3df2-40dc-9372-654914d23230 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:34.915383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891f7c1-4188-48b6-b699-6ab9be9b99c8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:34.929636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891f7c1-4188-48b6-b699-6ab9be9b99c8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:34.930490 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1903/3818] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:13:34.949495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d80d0f-f79a-43d1-81c2-558fb9a260d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:34.955786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d80d0f-f79a-43d1-81c2-558fb9a260d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:34.956155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d80d0f-f79a-43d1-81c2-558fb9a260d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:34.957632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d80d0f-f79a-43d1-81c2-558fb9a260d6 admin admin] PATH_INFO: `/v3/projects/e118fcd176734b698c4b7a48dc715d4d/users/76afad1e6b734e858fdf1306c79d7fbd/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:35.036657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d80d0f-f79a-43d1-81c2-558fb9a260d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e118fcd176734b698c4b7a48dc715d4d, user_id=76afad1e6b734e858fdf1306c79d7fbd, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:35.039702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d80d0f-f79a-43d1-81c2-558fb9a260d6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:35.081712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1aca4-843b-4112-b24c-b8c8ec276909 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:35.082347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1aca4-843b-4112-b24c-b8c8ec276909 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:35.082832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1aca4-843b-4112-b24c-b8c8ec276909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:35.087667 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1916/3819] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:13:34 2022] PUT /identity/v3/projects/e118fcd176734b698c4b7a48dc715d4d/users/76afad1e6b734e858fdf1306c79d7fbd/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:13:35.105239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d80d0f-f79a-43d1-81c2-558fb9a260d6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:35.107799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a7d80d0f-f79a-43d1-81c2-558fb9a260d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:35.121801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6ea1aca4-843b-4112-b24c-b8c8ec276909 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:35.123371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6ea1aca4-843b-4112-b24c-b8c8ec276909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:35.239666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:35.324560 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1904/3820] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:35.355156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d80d0f-f79a-43d1-81c2-558fb9a260d6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:35.370659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebdf38-9335-4611-a609-774a08386b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:35.371736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebdf38-9335-4611-a609-774a08386b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:35.373035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebdf38-9335-4611-a609-774a08386b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:35.373395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebdf38-9335-4611-a609-774a08386b4a admin admin] PATH_INFO: `/v3/projects/9476d2b50a404e7ba2ef4815d057347c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:35.381524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebdf38-9335-4611-a609-774a08386b4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9476d2b50a404e7ba2ef4815d057347c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:35.384270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebdf38-9335-4611-a609-774a08386b4a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:35.403570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1aca4-843b-4112-b24c-b8c8ec276909 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:35.405256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6ea1aca4-843b-4112-b24c-b8c8ec276909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:35.478413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fcebdf38-9335-4611-a609-774a08386b4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9476d2b50a404e7ba2ef4815d057347c', 'request_id': 'req-fcebdf38-9335-4611-a609-774a08386b4a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:35.495309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fcebdf38-9335-4611-a609-774a08386b4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9476d2b50a404e7ba2ef4815d057347c', 'request_id': 'req-fcebdf38-9335-4611-a609-774a08386b4a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:35.519601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fcebdf38-9335-4611-a609-774a08386b4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9476d2b50a404e7ba2ef4815d057347c', 'request_id': 'req-fcebdf38-9335-4611-a609-774a08386b4a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:35.538538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fcebdf38-9335-4611-a609-774a08386b4a admin admin] The token cache is being invalidate because project 9476d2b50a404e7ba2ef4815d057347c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:13:35.539067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fcebdf38-9335-4611-a609-774a08386b4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:35.540928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fcebdf38-9335-4611-a609-774a08386b4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:35.548401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:35.551333 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1917/3821] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:13:35 2022] DELETE /identity/v3/projects/9476d2b50a404e7ba2ef4815d057347c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:13:35.553319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a553eb4-921a-4e1d-af23-339a58135ccb None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:35.553766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a553eb4-921a-4e1d-af23-339a58135ccb None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:35.554124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a553eb4-921a-4e1d-af23-339a58135ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:35.560573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1aca4-843b-4112-b24c-b8c8ec276909 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:35.614331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2a553eb4-921a-4e1d-af23-339a58135ccb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:35.618614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2a553eb4-921a-4e1d-af23-339a58135ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:35.689469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b95199-36f0-41f5-bd02-c1d122a05046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:35.690313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b95199-36f0-41f5-bd02-c1d122a05046 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:35.690770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b95199-36f0-41f5-bd02-c1d122a05046 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:35.691034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b95199-36f0-41f5-bd02-c1d122a05046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:35.694251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-37b95199-36f0-41f5-bd02-c1d122a05046 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:35.800671 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1918/3822] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:35.809840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885072c8-d92a-4a60-8acb-0b3651dbbdc5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:35.810186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885072c8-d92a-4a60-8acb-0b3651dbbdc5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:35.810492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885072c8-d92a-4a60-8acb-0b3651dbbdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:35.828109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b95199-36f0-41f5-bd02-c1d122a05046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:35.829411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b95199-36f0-41f5-bd02-c1d122a05046 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:35.870165 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1905/3823] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:13:35.871620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-885072c8-d92a-4a60-8acb-0b3651dbbdc5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:35.872878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-885072c8-d92a-4a60-8acb-0b3651dbbdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:35.896322 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1919/3824] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:35.900905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b95199-36f0-41f5-bd02-c1d122a05046 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:35.915207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b95199-36f0-41f5-bd02-c1d122a05046 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:35.929243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d97b0-90af-4077-bbae-b1615bfe3efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:35.930092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d97b0-90af-4077-bbae-b1615bfe3efc admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:35.930219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d97b0-90af-4077-bbae-b1615bfe3efc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:35.930475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d97b0-90af-4077-bbae-b1615bfe3efc admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:35.931195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d97b0-90af-4077-bbae-b1615bfe3efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:13:35.931470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d97b0-90af-4077-bbae-b1615bfe3efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:35.935703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d97b0-90af-4077-bbae-b1615bfe3efc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:35.981599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885072c8-d92a-4a60-8acb-0b3651dbbdc5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:35.982519 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1906/3825] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:13:36.006379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885072c8-d92a-4a60-8acb-0b3651dbbdc5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:36.018298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6389d0-b5aa-43c3-aa2d-6ae6675811de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:36.018945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6389d0-b5aa-43c3-aa2d-6ae6675811de admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:36.019231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6389d0-b5aa-43c3-aa2d-6ae6675811de admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:36.019943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6389d0-b5aa-43c3-aa2d-6ae6675811de admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:36.020262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6389d0-b5aa-43c3-aa2d-6ae6675811de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:36.022302 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6389d0-b5aa-43c3-aa2d-6ae6675811de admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:36.136103 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1920/3826] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:13:35 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:13:36.141048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d97b0-90af-4077-bbae-b1615bfe3efc admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:36.153740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d97b0-90af-4077-bbae-b1615bfe3efc admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:36.338437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4965979-89ae-4fdf-a693-33092b08fac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:36.339168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4965979-89ae-4fdf-a693-33092b08fac3 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:36.339406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4965979-89ae-4fdf-a693-33092b08fac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:36.339690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4965979-89ae-4fdf-a693-33092b08fac3 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:36.340371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4965979-89ae-4fdf-a693-33092b08fac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:36.342328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4965979-89ae-4fdf-a693-33092b08fac3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:36.401131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6389d0-b5aa-43c3-aa2d-6ae6675811de admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:36.402260 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1907/3827] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:13:36 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:13:36.426545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6389d0-b5aa-43c3-aa2d-6ae6675811de admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:36.454176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb01d2-7e15-4858-8f92-cbb64b205f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:36.455419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb01d2-7e15-4858-8f92-cbb64b205f9f admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:36.456179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb01d2-7e15-4858-8f92-cbb64b205f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:36.456648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb01d2-7e15-4858-8f92-cbb64b205f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:36.457573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb01d2-7e15-4858-8f92-cbb64b205f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:36.459433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb01d2-7e15-4858-8f92-cbb64b205f9f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:36.473046 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1921/3828] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:13:36.476485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4965979-89ae-4fdf-a693-33092b08fac3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:36.507657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4965979-89ae-4fdf-a693-33092b08fac3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:36.520705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e579fc2-b90b-4bad-8bc8-71411ce88f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:36.521523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579fc2-b90b-4bad-8bc8-71411ce88f0a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:36.521960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579fc2-b90b-4bad-8bc8-71411ce88f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:36.522340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579fc2-b90b-4bad-8bc8-71411ce88f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:36.523148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e579fc2-b90b-4bad-8bc8-71411ce88f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:36.527104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e579fc2-b90b-4bad-8bc8-71411ce88f0a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:36.548721 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1908/3829] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:13:36.550260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb01d2-7e15-4858-8f92-cbb64b205f9f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:36.562857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb01d2-7e15-4858-8f92-cbb64b205f9f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:36.568256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a186e-3814-4b2b-bbb2-100b78033bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:36.568882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a186e-3814-4b2b-bbb2-100b78033bff admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:36.569170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a186e-3814-4b2b-bbb2-100b78033bff admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:36.569451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a186e-3814-4b2b-bbb2-100b78033bff admin admin] PATH_INFO: `/v3/projects/28a564c725354058930b750a9520e40d/users/846000d9e9734695b08c6a29efb84377/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:36.593498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a186e-3814-4b2b-bbb2-100b78033bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a564c725354058930b750a9520e40d, user_id=846000d9e9734695b08c6a29efb84377, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:36.597430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a186e-3814-4b2b-bbb2-100b78033bff admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:36.631984 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1922/3830] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:13:36 2022] PUT /identity/v3/projects/28a564c725354058930b750a9520e40d/users/846000d9e9734695b08c6a29efb84377/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:36.634084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b6640-3bb4-4a52-b327-4d566c99a424 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:36.634475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b6640-3bb4-4a52-b327-4d566c99a424 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:36.634861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b6640-3bb4-4a52-b327-4d566c99a424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:36.703745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d17b6640-3bb4-4a52-b327-4d566c99a424 None None] MFA Rules not processed for user `846000d9e9734695b08c6a29efb84377`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:36.705022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d17b6640-3bb4-4a52-b327-4d566c99a424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:36.716026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:36.851457 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1909/3831] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:36.861977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a186e-3814-4b2b-bbb2-100b78033bff admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:36.864348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b65a186e-3814-4b2b-bbb2-100b78033bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:36.874106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:36.966112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a186e-3814-4b2b-bbb2-100b78033bff admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:36.974278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc44b22-f8b6-4b40-b55b-2b8e173b1b42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:36.975077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc44b22-f8b6-4b40-b55b-2b8e173b1b42 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:36.975501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc44b22-f8b6-4b40-b55b-2b8e173b1b42 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:36.976031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc44b22-f8b6-4b40-b55b-2b8e173b1b42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:36.987625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc44b22-f8b6-4b40-b55b-2b8e173b1b42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:36.990446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc44b22-f8b6-4b40-b55b-2b8e173b1b42 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:37.015704 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1923/3832] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:13:38.057520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b6640-3bb4-4a52-b327-4d566c99a424 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:38.182802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b6640-3bb4-4a52-b327-4d566c99a424 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:38.198173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92eb4be-2d32-484f-8524-d515fc96a7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:38.199210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eb4be-2d32-484f-8524-d515fc96a7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:38.200614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eb4be-2d32-484f-8524-d515fc96a7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:38.201085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eb4be-2d32-484f-8524-d515fc96a7f8 admin admin] PATH_INFO: `/v3/users/846000d9e9734695b08c6a29efb84377` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:38.202633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92eb4be-2d32-484f-8524-d515fc96a7f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=846000d9e9734695b08c6a29efb84377)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:38.215440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92eb4be-2d32-484f-8524-d515fc96a7f8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:38.310997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d92eb4be-2d32-484f-8524-d515fc96a7f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '846000d9e9734695b08c6a29efb84377'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:38.311820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d92eb4be-2d32-484f-8524-d515fc96a7f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '846000d9e9734695b08c6a29efb84377'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:38.328153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d92eb4be-2d32-484f-8524-d515fc96a7f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '846000d9e9734695b08c6a29efb84377'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:38.330570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d92eb4be-2d32-484f-8524-d515fc96a7f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '846000d9e9734695b08c6a29efb84377'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:38.345123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d92eb4be-2d32-484f-8524-d515fc96a7f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '846000d9e9734695b08c6a29efb84377'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:38.361698 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1910/3833] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:13:38 2022] DELETE /identity/v3/users/846000d9e9734695b08c6a29efb84377 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:38.365991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb0231-241f-4c1d-b268-62f8b10f8e1d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:38.366515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb0231-241f-4c1d-b268-62f8b10f8e1d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:38.366623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb0231-241f-4c1d-b268-62f8b10f8e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:38.389920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4fbb0231-241f-4c1d-b268-62f8b10f8e1d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:38.392077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4fbb0231-241f-4c1d-b268-62f8b10f8e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:38.466796 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1924/3834] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:38.479547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92eb4be-2d32-484f-8524-d515fc96a7f8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:38.481701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d92eb4be-2d32-484f-8524-d515fc96a7f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:38.523771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:38.568225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92eb4be-2d32-484f-8524-d515fc96a7f8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:38.574097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6323a15-682f-4bc6-9d02-4a389ae11cf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:38.574760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6323a15-682f-4bc6-9d02-4a389ae11cf4 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:38.575041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6323a15-682f-4bc6-9d02-4a389ae11cf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:38.575398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6323a15-682f-4bc6-9d02-4a389ae11cf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:38.590005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6323a15-682f-4bc6-9d02-4a389ae11cf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:38.592066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6323a15-682f-4bc6-9d02-4a389ae11cf4 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:38.619542 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1911/3835] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:13:39.085562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb0231-241f-4c1d-b268-62f8b10f8e1d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:39.091582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4fbb0231-241f-4c1d-b268-62f8b10f8e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:39.129140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb0231-241f-4c1d-b268-62f8b10f8e1d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:39.138303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871298d-c6fb-4789-a136-7e749ba8024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:39.139210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871298d-c6fb-4789-a136-7e749ba8024d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:39.139608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871298d-c6fb-4789-a136-7e749ba8024d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:39.139882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871298d-c6fb-4789-a136-7e749ba8024d admin admin] PATH_INFO: `/v3/projects/28a564c725354058930b750a9520e40d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:39.141085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871298d-c6fb-4789-a136-7e749ba8024d admin admin] RBAC: Authorizing `identity:delete_project(project_id=28a564c725354058930b750a9520e40d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:39.143815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871298d-c6fb-4789-a136-7e749ba8024d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:39.278399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d871298d-c6fb-4789-a136-7e749ba8024d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28a564c725354058930b750a9520e40d', 'request_id': 'req-d871298d-c6fb-4789-a136-7e749ba8024d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:39.289508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d871298d-c6fb-4789-a136-7e749ba8024d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28a564c725354058930b750a9520e40d', 'request_id': 'req-d871298d-c6fb-4789-a136-7e749ba8024d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:39.319946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d871298d-c6fb-4789-a136-7e749ba8024d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28a564c725354058930b750a9520e40d', 'request_id': 'req-d871298d-c6fb-4789-a136-7e749ba8024d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:39.337292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d871298d-c6fb-4789-a136-7e749ba8024d admin admin] The token cache is being invalidate because project 28a564c725354058930b750a9520e40d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:13:39.337664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d871298d-c6fb-4789-a136-7e749ba8024d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:39.338346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d871298d-c6fb-4789-a136-7e749ba8024d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:39.341004 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1925/3836] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:13:39 2022] DELETE /identity/v3/projects/28a564c725354058930b750a9520e40d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:39.345503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04ec22-a2e1-40f4-932e-de3596644540 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:39.346134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04ec22-a2e1-40f4-932e-de3596644540 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:39.346337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04ec22-a2e1-40f4-932e-de3596644540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:39.397235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1d04ec22-a2e1-40f4-932e-de3596644540 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:39.398872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1d04ec22-a2e1-40f4-932e-de3596644540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:39.483476 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1912/3837] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:39.490099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec56dc-f9d1-41c2-9ed1-9447e14c0fc7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:39.491722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec56dc-f9d1-41c2-9ed1-9447e14c0fc7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:39.492012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec56dc-f9d1-41c2-9ed1-9447e14c0fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:39.516941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-67ec56dc-f9d1-41c2-9ed1-9447e14c0fc7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:39.518199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-67ec56dc-f9d1-41c2-9ed1-9447e14c0fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:39.532888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04ec22-a2e1-40f4-932e-de3596644540 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:39.539482 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1926/3838] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:39.543918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04ec22-a2e1-40f4-932e-de3596644540 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:39.549374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6da2b0-5507-4071-bfbc-17f7dc6d78ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:39.550004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6da2b0-5507-4071-bfbc-17f7dc6d78ee admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:39.550287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6da2b0-5507-4071-bfbc-17f7dc6d78ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:39.550561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6da2b0-5507-4071-bfbc-17f7dc6d78ee admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:39.551319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6da2b0-5507-4071-bfbc-17f7dc6d78ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:13:39.552590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6da2b0-5507-4071-bfbc-17f7dc6d78ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:39.554479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6da2b0-5507-4071-bfbc-17f7dc6d78ee admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:39.580886 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1913/3839] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:13:39.585631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec56dc-f9d1-41c2-9ed1-9447e14c0fc7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:39.601707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec56dc-f9d1-41c2-9ed1-9447e14c0fc7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:39.608099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d081e45-8fc0-4e31-bc83-ca3c752761d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:39.608840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d081e45-8fc0-4e31-bc83-ca3c752761d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:39.609122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d081e45-8fc0-4e31-bc83-ca3c752761d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:39.609455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d081e45-8fc0-4e31-bc83-ca3c752761d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:39.610931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d081e45-8fc0-4e31-bc83-ca3c752761d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:39.613546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d081e45-8fc0-4e31-bc83-ca3c752761d4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:39.621207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:39.658221 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1927/3840] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:13:39 2022] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:13:39.662461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6da2b0-5507-4071-bfbc-17f7dc6d78ee admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:39.676135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6da2b0-5507-4071-bfbc-17f7dc6d78ee admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:39.753998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6093717-5cfc-4970-a8ac-fb3351ef0da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:39.755016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6093717-5cfc-4970-a8ac-fb3351ef0da7 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:39.755422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6093717-5cfc-4970-a8ac-fb3351ef0da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:39.755808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6093717-5cfc-4970-a8ac-fb3351ef0da7 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:39.756684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6093717-5cfc-4970-a8ac-fb3351ef0da7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:39.763068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6093717-5cfc-4970-a8ac-fb3351ef0da7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:39.792960 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1914/3841] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:13:39 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:13:39.797115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d081e45-8fc0-4e31-bc83-ca3c752761d4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:39.814115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d081e45-8fc0-4e31-bc83-ca3c752761d4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:39.821161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4f428-0c02-4a72-9c8b-20f18cfdd988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:39.821901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4f428-0c02-4a72-9c8b-20f18cfdd988 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:39.822258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4f428-0c02-4a72-9c8b-20f18cfdd988 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:39.822608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4f428-0c02-4a72-9c8b-20f18cfdd988 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:39.823421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4f428-0c02-4a72-9c8b-20f18cfdd988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:39.825190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4f428-0c02-4a72-9c8b-20f18cfdd988 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:39.845452 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1928/3842] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:13:39.846414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6093717-5cfc-4970-a8ac-fb3351ef0da7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:39.859081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6093717-5cfc-4970-a8ac-fb3351ef0da7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:39.869370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047b575-efe3-4cec-89cb-604ad441ae95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:39.870187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047b575-efe3-4cec-89cb-604ad441ae95 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:39.870439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047b575-efe3-4cec-89cb-604ad441ae95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:39.870730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047b575-efe3-4cec-89cb-604ad441ae95 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:39.872940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047b575-efe3-4cec-89cb-604ad441ae95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:39.874675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047b575-efe3-4cec-89cb-604ad441ae95 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:39.887486 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1915/3843] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:13:39.891495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4f428-0c02-4a72-9c8b-20f18cfdd988 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:39.904962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4f428-0c02-4a72-9c8b-20f18cfdd988 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:39.910412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b49e48-e03d-4e72-a224-507b39e0327f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:39.911110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b49e48-e03d-4e72-a224-507b39e0327f admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:39.911437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b49e48-e03d-4e72-a224-507b39e0327f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:39.911722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b49e48-e03d-4e72-a224-507b39e0327f admin admin] PATH_INFO: `/v3/projects/86b1c41454614861afe325f6cc859ba9/users/ea502b7c80394310a36cc826e1795461/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:39.932059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b49e48-e03d-4e72-a224-507b39e0327f admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b1c41454614861afe325f6cc859ba9, user_id=ea502b7c80394310a36cc826e1795461, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:39.936528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b49e48-e03d-4e72-a224-507b39e0327f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:39.960649 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1929/3844] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:13:39 2022] PUT /identity/v3/projects/86b1c41454614861afe325f6cc859ba9/users/ea502b7c80394310a36cc826e1795461/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:39.968058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c3d55-d818-4a11-aea0-34f091ca87ca None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:39.968366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c3d55-d818-4a11-aea0-34f091ca87ca None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:39.969019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c3d55-d818-4a11-aea0-34f091ca87ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:39.995539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d03c3d55-d818-4a11-aea0-34f091ca87ca None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:39.999721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d03c3d55-d818-4a11-aea0-34f091ca87ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:40.039397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:40.092889 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1916/3845] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:40.102391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b49e48-e03d-4e72-a224-507b39e0327f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:40.104384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-39b49e48-e03d-4e72-a224-507b39e0327f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:40.214933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b49e48-e03d-4e72-a224-507b39e0327f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:40.221041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cfc56-97ce-4919-9f2a-b04f3002fd4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:40.221840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cfc56-97ce-4919-9f2a-b04f3002fd4d service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:40.222235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cfc56-97ce-4919-9f2a-b04f3002fd4d service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:40.222616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cfc56-97ce-4919-9f2a-b04f3002fd4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:40.244857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5cfc56-97ce-4919-9f2a-b04f3002fd4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:40.246532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5cfc56-97ce-4919-9f2a-b04f3002fd4d service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:40.258608 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1930/3846] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:13:41.163976 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df84d9c-8a9d-4b00-bd79-948c3536a2f8 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:41.164855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df84d9c-8a9d-4b00-bd79-948c3536a2f8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:41.165573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df84d9c-8a9d-4b00-bd79-948c3536a2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:41.193622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7df84d9c-8a9d-4b00-bd79-948c3536a2f8 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:41.195324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7df84d9c-8a9d-4b00-bd79-948c3536a2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:41.273556 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1917/3847] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:13:41.293056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cfc56-97ce-4919-9f2a-b04f3002fd4d service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:41.295194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8a5cfc56-97ce-4919-9f2a-b04f3002fd4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:41.433654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cfc56-97ce-4919-9f2a-b04f3002fd4d service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:41.441257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c01dd-6992-410d-9c37-bebd799bdf32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:41.441985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c01dd-6992-410d-9c37-bebd799bdf32 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:41.442338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c01dd-6992-410d-9c37-bebd799bdf32 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:41.442673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c01dd-6992-410d-9c37-bebd799bdf32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:41.458641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c01dd-6992-410d-9c37-bebd799bdf32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:41.462343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c01dd-6992-410d-9c37-bebd799bdf32 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:41.481802 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1931/3848] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:13:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:13:44.742693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33657f-9caa-45cc-8976-799da5276a18 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:44.743173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33657f-9caa-45cc-8976-799da5276a18 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:44.743887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33657f-9caa-45cc-8976-799da5276a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:44.803771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4c33657f-9caa-45cc-8976-799da5276a18 None None] MFA Rules not processed for user `b839893e78134428a3cf451901129edc`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:44.810199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4c33657f-9caa-45cc-8976-799da5276a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:45.013089 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1918/3849] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:48.098719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c01dd-6992-410d-9c37-bebd799bdf32 service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:48.100816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-602c01dd-6992-410d-9c37-bebd799bdf32 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:48.126443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c01dd-6992-410d-9c37-bebd799bdf32 service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:48.148765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b292bd-c8fa-4dd9-924d-f95b5e7666cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:48.151133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b292bd-c8fa-4dd9-924d-f95b5e7666cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:48.151823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b292bd-c8fa-4dd9-924d-f95b5e7666cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:48.152249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b292bd-c8fa-4dd9-924d-f95b5e7666cb admin admin] PATH_INFO: `/v3/users/7c6e44ff30dc435b8fd6d9d76e02287f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:48.153940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b292bd-c8fa-4dd9-924d-f95b5e7666cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c6e44ff30dc435b8fd6d9d76e02287f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:48.157375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b292bd-c8fa-4dd9-924d-f95b5e7666cb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:48.232086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:48.257799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-53b292bd-c8fa-4dd9-924d-f95b5e7666cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c6e44ff30dc435b8fd6d9d76e02287f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:48.289848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-53b292bd-c8fa-4dd9-924d-f95b5e7666cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c6e44ff30dc435b8fd6d9d76e02287f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:48.293427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-53b292bd-c8fa-4dd9-924d-f95b5e7666cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c6e44ff30dc435b8fd6d9d76e02287f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:48.315886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-53b292bd-c8fa-4dd9-924d-f95b5e7666cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c6e44ff30dc435b8fd6d9d76e02287f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:48.316744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-53b292bd-c8fa-4dd9-924d-f95b5e7666cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c6e44ff30dc435b8fd6d9d76e02287f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:48.348734 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1932/3850] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:13:48 2022] DELETE /identity/v3/users/7c6e44ff30dc435b8fd6d9d76e02287f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:49.236032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33657f-9caa-45cc-8976-799da5276a18 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:49.256501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33657f-9caa-45cc-8976-799da5276a18 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:49.394143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603b472-8a5e-427d-95e5-023881218e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:49.397298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603b472-8a5e-427d-95e5-023881218e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:49.398096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603b472-8a5e-427d-95e5-023881218e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:49.398794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603b472-8a5e-427d-95e5-023881218e48 admin admin] PATH_INFO: `/v3/projects/8062527ac2b2406bbb3856d37f7af540` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:49.401549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603b472-8a5e-427d-95e5-023881218e48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8062527ac2b2406bbb3856d37f7af540)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:49.409055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603b472-8a5e-427d-95e5-023881218e48 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:49.464093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f29f6-5193-4fcf-911f-847615813bae None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:49.464956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f29f6-5193-4fcf-911f-847615813bae None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:49.465425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f29f6-5193-4fcf-911f-847615813bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:49.492792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:49.541929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3603b472-8a5e-427d-95e5-023881218e48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8062527ac2b2406bbb3856d37f7af540', 'request_id': 'req-3603b472-8a5e-427d-95e5-023881218e48'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:49.553987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-982f29f6-5193-4fcf-911f-847615813bae None None] MFA Rules not processed for user `ea502b7c80394310a36cc826e1795461`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:49.556344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-982f29f6-5193-4fcf-911f-847615813bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:49.557622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3603b472-8a5e-427d-95e5-023881218e48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8062527ac2b2406bbb3856d37f7af540', 'request_id': 'req-3603b472-8a5e-427d-95e5-023881218e48'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:49.568801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3603b472-8a5e-427d-95e5-023881218e48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8062527ac2b2406bbb3856d37f7af540', 'request_id': 'req-3603b472-8a5e-427d-95e5-023881218e48'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:49.599895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3603b472-8a5e-427d-95e5-023881218e48 admin admin] The token cache is being invalidate because project 8062527ac2b2406bbb3856d37f7af540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:13:49.600988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3603b472-8a5e-427d-95e5-023881218e48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:49.601883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3603b472-8a5e-427d-95e5-023881218e48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:13:49.609374 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1919/3851] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:13:49 2022] DELETE /identity/v3/projects/8062527ac2b2406bbb3856d37f7af540 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:49.612073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a822a-6ca2-45c6-abe8-07fdb905e1ac None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:49.612763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a822a-6ca2-45c6-abe8-07fdb905e1ac None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:49.613233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a822a-6ca2-45c6-abe8-07fdb905e1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:49.641557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-191a822a-6ca2-45c6-abe8-07fdb905e1ac None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:49.643180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-191a822a-6ca2-45c6-abe8-07fdb905e1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:49.782473 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1933/3852] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:49.796329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f29f6-5193-4fcf-911f-847615813bae None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:49.798776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-982f29f6-5193-4fcf-911f-847615813bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:49.837415 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1920/3853] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:49.847282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30085bc-86d9-4d6e-a072-f9df2eeafdfc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:49.847604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30085bc-86d9-4d6e-a072-f9df2eeafdfc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:49.847883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30085bc-86d9-4d6e-a072-f9df2eeafdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:49.876666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b30085bc-86d9-4d6e-a072-f9df2eeafdfc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:49.878176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b30085bc-86d9-4d6e-a072-f9df2eeafdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:49.911980 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1921/3854] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:49.912950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30085bc-86d9-4d6e-a072-f9df2eeafdfc None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:49.923506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30085bc-86d9-4d6e-a072-f9df2eeafdfc None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:49.933168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf208f90-f2e7-48b0-8540-8adce4e3cbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:49.933726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf208f90-f2e7-48b0-8540-8adce4e3cbef admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:49.934204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf208f90-f2e7-48b0-8540-8adce4e3cbef admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:49.934565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf208f90-f2e7-48b0-8540-8adce4e3cbef admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:49.935411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf208f90-f2e7-48b0-8540-8adce4e3cbef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:13:49.935800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf208f90-f2e7-48b0-8540-8adce4e3cbef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:49.937708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf208f90-f2e7-48b0-8540-8adce4e3cbef admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:49.958403 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1922/3855] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:13:49.971048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf208f90-f2e7-48b0-8540-8adce4e3cbef admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:49.983857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf208f90-f2e7-48b0-8540-8adce4e3cbef admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:49.991474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89816c-6446-4351-9297-acd81b35145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:49.992434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89816c-6446-4351-9297-acd81b35145b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:49.992702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89816c-6446-4351-9297-acd81b35145b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:49.993098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89816c-6446-4351-9297-acd81b35145b admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:49.994248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89816c-6446-4351-9297-acd81b35145b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:49.997354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89816c-6446-4351-9297-acd81b35145b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:50.029163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f29f6-5193-4fcf-911f-847615813bae None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:50.042809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0cacf-d2ad-4c20-b3dc-2e2eac7c109b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:50.043494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0cacf-d2ad-4c20-b3dc-2e2eac7c109b service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:50.043783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0cacf-d2ad-4c20-b3dc-2e2eac7c109b service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:50.044123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0cacf-d2ad-4c20-b3dc-2e2eac7c109b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:50.051604 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1923/3856] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:13:49 2022] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:13:50.055431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89816c-6446-4351-9297-acd81b35145b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:50.063535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0cacf-d2ad-4c20-b3dc-2e2eac7c109b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:50.065482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0cacf-d2ad-4c20-b3dc-2e2eac7c109b service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:50.086552 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1934/3857] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:13:50.197244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89816c-6446-4351-9297-acd81b35145b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:50.217141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77efed-32f2-4a8b-b075-3b27a4944172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:50.217925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77efed-32f2-4a8b-b075-3b27a4944172 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:50.218482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77efed-32f2-4a8b-b075-3b27a4944172 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:50.218875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77efed-32f2-4a8b-b075-3b27a4944172 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:50.227625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77efed-32f2-4a8b-b075-3b27a4944172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:50.240985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77efed-32f2-4a8b-b075-3b27a4944172 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:50.289525 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1924/3858] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:13:50 2022] POST /identity/v3/users => generated 283 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:13:50.293973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0cacf-d2ad-4c20-b3dc-2e2eac7c109b service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:50.325499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0cacf-d2ad-4c20-b3dc-2e2eac7c109b service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:50.343709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d04f3c-fc8b-4d34-b6b5-dbefbcb2d029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:50.344602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d04f3c-fc8b-4d34-b6b5-dbefbcb2d029 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:50.344885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d04f3c-fc8b-4d34-b6b5-dbefbcb2d029 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:50.345195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d04f3c-fc8b-4d34-b6b5-dbefbcb2d029 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:50.348015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d04f3c-fc8b-4d34-b6b5-dbefbcb2d029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:50.349731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d04f3c-fc8b-4d34-b6b5-dbefbcb2d029 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:50.392430 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1935/3859] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:13:50.394540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77efed-32f2-4a8b-b075-3b27a4944172 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:50.403249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:50.414859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77efed-32f2-4a8b-b075-3b27a4944172 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:50.430371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8fa51-0d71-4be1-a8ea-dce9af6fc795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:50.431185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8fa51-0d71-4be1-a8ea-dce9af6fc795 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:50.431697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8fa51-0d71-4be1-a8ea-dce9af6fc795 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:50.436335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8fa51-0d71-4be1-a8ea-dce9af6fc795 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:50.438518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8fa51-0d71-4be1-a8ea-dce9af6fc795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:50.446049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8fa51-0d71-4be1-a8ea-dce9af6fc795 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:50.464585 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1925/3860] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:13:50.468123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d04f3c-fc8b-4d34-b6b5-dbefbcb2d029 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:50.481094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d04f3c-fc8b-4d34-b6b5-dbefbcb2d029 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:50.489827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3c419-30ad-4774-8102-7b4eef938bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:50.490872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3c419-30ad-4774-8102-7b4eef938bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:50.491435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3c419-30ad-4774-8102-7b4eef938bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:50.492013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3c419-30ad-4774-8102-7b4eef938bd3 admin admin] PATH_INFO: `/v3/projects/3a35c62a04494e1f89562e4aca3a3da6/users/7f6e06e9270a48b7bc6cecf4b2d73509/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:50.515280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3c419-30ad-4774-8102-7b4eef938bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a35c62a04494e1f89562e4aca3a3da6, user_id=7f6e06e9270a48b7bc6cecf4b2d73509, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:50.519862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3c419-30ad-4774-8102-7b4eef938bd3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:50.524067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:50.547564 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1936/3861] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:13:50 2022] PUT /identity/v3/projects/3a35c62a04494e1f89562e4aca3a3da6/users/7f6e06e9270a48b7bc6cecf4b2d73509/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:13:50.550459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a749d-d971-4a74-81ac-42c641cbcd46 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:50.551021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a749d-d971-4a74-81ac-42c641cbcd46 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:50.551408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a749d-d971-4a74-81ac-42c641cbcd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:50.578387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2a5a749d-d971-4a74-81ac-42c641cbcd46 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:50.579437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2a5a749d-d971-4a74-81ac-42c641cbcd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:50.699507 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1926/3862] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:50.724718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3c419-30ad-4774-8102-7b4eef938bd3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:50.727590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-02c3c419-30ad-4774-8102-7b4eef938bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:50.915582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3c419-30ad-4774-8102-7b4eef938bd3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:50.932224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e00f1b-53a8-4901-af83-bb6e67b00c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:50.935028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e00f1b-53a8-4901-af83-bb6e67b00c2f service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:50.935634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e00f1b-53a8-4901-af83-bb6e67b00c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:50.937461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e00f1b-53a8-4901-af83-bb6e67b00c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:50.972211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e00f1b-53a8-4901-af83-bb6e67b00c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:50.975378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e00f1b-53a8-4901-af83-bb6e67b00c2f service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:50.992607 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1937/3863] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:13:52.342624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224dea0-d577-4728-a251-34fb6c71fd38 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:52.343058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224dea0-d577-4728-a251-34fb6c71fd38 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:52.343493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224dea0-d577-4728-a251-34fb6c71fd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:52.413402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7224dea0-d577-4728-a251-34fb6c71fd38 None None] MFA Rules not processed for user `76afad1e6b734e858fdf1306c79d7fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:52.424688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7224dea0-d577-4728-a251-34fb6c71fd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:52.575734 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1927/3864] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:52.586820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de2adb-cd34-44a3-8312-5ce0cfec5363 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:52.588470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de2adb-cd34-44a3-8312-5ce0cfec5363 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:52.588973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de2adb-cd34-44a3-8312-5ce0cfec5363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:52.644800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b7de2adb-cd34-44a3-8312-5ce0cfec5363 None None] MFA Rules not processed for user `76afad1e6b734e858fdf1306c79d7fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:13:52.648573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b7de2adb-cd34-44a3-8312-5ce0cfec5363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:52.674904 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1938/3865] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:13:53.388544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224dea0-d577-4728-a251-34fb6c71fd38 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:13:53.390128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7224dea0-d577-4728-a251-34fb6c71fd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:13:53.608873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224dea0-d577-4728-a251-34fb6c71fd38 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:13:53.626138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fca2f6-8bf1-4f8e-b867-525aa14b8b86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:13:53.627582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fca2f6-8bf1-4f8e-b867-525aa14b8b86 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:13:53.628099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fca2f6-8bf1-4f8e-b867-525aa14b8b86 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:13:53.628754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fca2f6-8bf1-4f8e-b867-525aa14b8b86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:13:53.641584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fca2f6-8bf1-4f8e-b867-525aa14b8b86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:13:53.649789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fca2f6-8bf1-4f8e-b867-525aa14b8b86 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:13:53.663235 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1928/3866] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:13:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:14:02.619473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=1,keystone:SELECT=31 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:02.961857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592c6ff-f449-4e18-b5d9-b2387b7d0efa None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:02.962154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592c6ff-f449-4e18-b5d9-b2387b7d0efa None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:02.962437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592c6ff-f449-4e18-b5d9-b2387b7d0efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:03.009329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7592c6ff-f449-4e18-b5d9-b2387b7d0efa None None] MFA Rules not processed for user `7f6e06e9270a48b7bc6cecf4b2d73509`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:03.010743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7592c6ff-f449-4e18-b5d9-b2387b7d0efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:03.209661 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1939/3867] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:03.363564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fca2f6-8bf1-4f8e-b867-525aa14b8b86 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:03.382643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fca2f6-8bf1-4f8e-b867-525aa14b8b86 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:03.390952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d091a37-1da5-4dc8-99c5-e386ba27e4fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:03.392172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d091a37-1da5-4dc8-99c5-e386ba27e4fc service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:03.392782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d091a37-1da5-4dc8-99c5-e386ba27e4fc service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:03.393253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d091a37-1da5-4dc8-99c5-e386ba27e4fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:03.401764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:03.407934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d091a37-1da5-4dc8-99c5-e386ba27e4fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:03.409816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d091a37-1da5-4dc8-99c5-e386ba27e4fc service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:03.435393 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1929/3868] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:14:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:14:07.213825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ab93d-f1a5-43e1-8d2b-8d03c7610569 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:07.214387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ab93d-f1a5-43e1-8d2b-8d03c7610569 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:07.214387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ab93d-f1a5-43e1-8d2b-8d03c7610569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:07.254631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0f8ab93d-f1a5-43e1-8d2b-8d03c7610569 None None] MFA Rules not processed for user `7f6e06e9270a48b7bc6cecf4b2d73509`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:07.256695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0f8ab93d-f1a5-43e1-8d2b-8d03c7610569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:07.306808 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1940/3869] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:13.416692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:14.236525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480b935-ed32-45e6-be5b-be5dc5adbe03 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:14.236952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480b935-ed32-45e6-be5b-be5dc5adbe03 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:14.237366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480b935-ed32-45e6-be5b-be5dc5adbe03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:14.263668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4480b935-ed32-45e6-be5b-be5dc5adbe03 None None] MFA Rules not processed for user `76afad1e6b734e858fdf1306c79d7fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:14.265799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4480b935-ed32-45e6-be5b-be5dc5adbe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:14.298972 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1930/3870] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:14.314517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ab93d-f1a5-43e1-8d2b-8d03c7610569 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:14.316317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0f8ab93d-f1a5-43e1-8d2b-8d03c7610569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:14.349718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ab93d-f1a5-43e1-8d2b-8d03c7610569 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:14.364975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a38656-aa65-4e50-8a20-b852674dac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:14.365692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a38656-aa65-4e50-8a20-b852674dac41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:14.366147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a38656-aa65-4e50-8a20-b852674dac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:14.366574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a38656-aa65-4e50-8a20-b852674dac41 admin admin] PATH_INFO: `/v3/users/6e84c9c580a24203a9b37732bda4e135` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:14.368625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a38656-aa65-4e50-8a20-b852674dac41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e84c9c580a24203a9b37732bda4e135)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:14.371846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a38656-aa65-4e50-8a20-b852674dac41 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:14.410982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadf773-57e1-4130-94c3-55074972eb4b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:14.412180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadf773-57e1-4130-94c3-55074972eb4b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:14.412800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadf773-57e1-4130-94c3-55074972eb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:14.474128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bfadf773-57e1-4130-94c3-55074972eb4b None None] MFA Rules not processed for user `76afad1e6b734e858fdf1306c79d7fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:14.475715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bfadf773-57e1-4130-94c3-55074972eb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:14.490301 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1931/3871] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:14.501349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5a38656-aa65-4e50-8a20-b852674dac41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e84c9c580a24203a9b37732bda4e135'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:14.536702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b071aa-fbe7-4a5c-843d-cf2e6e85b774 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:14.536992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b071aa-fbe7-4a5c-843d-cf2e6e85b774 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:14.537281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b071aa-fbe7-4a5c-843d-cf2e6e85b774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:14.547747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5a38656-aa65-4e50-8a20-b852674dac41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e84c9c580a24203a9b37732bda4e135'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:14.548642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5a38656-aa65-4e50-8a20-b852674dac41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e84c9c580a24203a9b37732bda4e135'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:14.561530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5a38656-aa65-4e50-8a20-b852674dac41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e84c9c580a24203a9b37732bda4e135'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:14.562834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5a38656-aa65-4e50-8a20-b852674dac41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e84c9c580a24203a9b37732bda4e135'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:14.592309 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1941/3872] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:14:14 2022] DELETE /identity/v3/users/6e84c9c580a24203a9b37732bda4e135 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:14.608241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c03a4f-9f5b-4dfb-a75a-1d3aed0ac49d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:14.611017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c03a4f-9f5b-4dfb-a75a-1d3aed0ac49d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:14.611625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c03a4f-9f5b-4dfb-a75a-1d3aed0ac49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:14.611945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d2b071aa-fbe7-4a5c-843d-cf2e6e85b774 None None] MFA Rules not processed for user `76afad1e6b734e858fdf1306c79d7fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:14.613160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d2b071aa-fbe7-4a5c-843d-cf2e6e85b774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:14.661821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b9c03a4f-9f5b-4dfb-a75a-1d3aed0ac49d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:14.663427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b9c03a4f-9f5b-4dfb-a75a-1d3aed0ac49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:14.722143 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1932/3873] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:14.783015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:14.823023 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1942/3874] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:14.850553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b071aa-fbe7-4a5c-843d-cf2e6e85b774 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:14.852950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d2b071aa-fbe7-4a5c-843d-cf2e6e85b774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:14.995174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b071aa-fbe7-4a5c-843d-cf2e6e85b774 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:15.000301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd979a-2d29-4583-b5c6-a81ff5691d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:15.001114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd979a-2d29-4583-b5c6-a81ff5691d06 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:15.001585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd979a-2d29-4583-b5c6-a81ff5691d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:15.002069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd979a-2d29-4583-b5c6-a81ff5691d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:15.010020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c03a4f-9f5b-4dfb-a75a-1d3aed0ac49d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:15.012051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b9c03a4f-9f5b-4dfb-a75a-1d3aed0ac49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:15.019273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd979a-2d29-4583-b5c6-a81ff5691d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:15.020858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd979a-2d29-4583-b5c6-a81ff5691d06 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:15.034854 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1933/3875] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:14:15.036647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c03a4f-9f5b-4dfb-a75a-1d3aed0ac49d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:15.044112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09b15e-b4ef-4860-9f56-1dd8fdb57dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:15.044865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b15e-b4ef-4860-9f56-1dd8fdb57dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:15.050377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b15e-b4ef-4860-9f56-1dd8fdb57dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:15.050755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b15e-b4ef-4860-9f56-1dd8fdb57dd6 admin admin] PATH_INFO: `/v3/users/ea502b7c80394310a36cc826e1795461` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:15.054452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09b15e-b4ef-4860-9f56-1dd8fdb57dd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea502b7c80394310a36cc826e1795461)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:15.056744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09b15e-b4ef-4860-9f56-1dd8fdb57dd6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:15.142995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47145cd-d9c1-43ac-bf94-5578de5af4e9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:15.143819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47145cd-d9c1-43ac-bf94-5578de5af4e9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:15.144112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47145cd-d9c1-43ac-bf94-5578de5af4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:15.181065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9d09b15e-b4ef-4860-9f56-1dd8fdb57dd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea502b7c80394310a36cc826e1795461'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:15.182008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d47145cd-d9c1-43ac-bf94-5578de5af4e9 None None] MFA Rules not processed for user `76afad1e6b734e858fdf1306c79d7fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:15.183373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d47145cd-d9c1-43ac-bf94-5578de5af4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:15.201988 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1934/3876] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:15.217996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9d09b15e-b4ef-4860-9f56-1dd8fdb57dd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea502b7c80394310a36cc826e1795461'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:15.217996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9d09b15e-b4ef-4860-9f56-1dd8fdb57dd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea502b7c80394310a36cc826e1795461'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:15.233485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73855c0d-7f5e-4b42-a846-d8dd7a91cf79 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:15.233701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73855c0d-7f5e-4b42-a846-d8dd7a91cf79 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:15.234938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73855c0d-7f5e-4b42-a846-d8dd7a91cf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:15.236237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9d09b15e-b4ef-4860-9f56-1dd8fdb57dd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea502b7c80394310a36cc826e1795461'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:15.237483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9d09b15e-b4ef-4860-9f56-1dd8fdb57dd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea502b7c80394310a36cc826e1795461'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:15.267754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-73855c0d-7f5e-4b42-a846-d8dd7a91cf79 None None] MFA Rules not processed for user `76afad1e6b734e858fdf1306c79d7fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:15.269060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-73855c0d-7f5e-4b42-a846-d8dd7a91cf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:15.274717 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1943/3877] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:14:15 2022] DELETE /identity/v3/users/ea502b7c80394310a36cc826e1795461 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:15.282071 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1935/3878] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:15.729669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09b15e-b4ef-4860-9f56-1dd8fdb57dd6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:15.731453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9d09b15e-b4ef-4860-9f56-1dd8fdb57dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:15.736931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73855c0d-7f5e-4b42-a846-d8dd7a91cf79 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:15.738529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-73855c0d-7f5e-4b42-a846-d8dd7a91cf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:15.763936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73855c0d-7f5e-4b42-a846-d8dd7a91cf79 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:15.826530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042eab1f-6a5d-4066-bd94-3d07804a150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:15.828403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042eab1f-6a5d-4066-bd94-3d07804a150a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:15.829224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042eab1f-6a5d-4066-bd94-3d07804a150a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:15.829696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042eab1f-6a5d-4066-bd94-3d07804a150a admin admin] PATH_INFO: `/v3/projects/86b1c41454614861afe325f6cc859ba9` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:15.831149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042eab1f-6a5d-4066-bd94-3d07804a150a admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b1c41454614861afe325f6cc859ba9)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:15.836837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042eab1f-6a5d-4066-bd94-3d07804a150a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:15.842580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09b15e-b4ef-4860-9f56-1dd8fdb57dd6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:15.848761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf81965-3825-40cb-b985-03235480e001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:15.849929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf81965-3825-40cb-b985-03235480e001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:15.850354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf81965-3825-40cb-b985-03235480e001 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:15.850641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf81965-3825-40cb-b985-03235480e001 admin admin] PATH_INFO: `/v3/projects/93838542feaa41ff9c8cac14d04fc99a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:15.851871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf81965-3825-40cb-b985-03235480e001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93838542feaa41ff9c8cac14d04fc99a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:15.854399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf81965-3825-40cb-b985-03235480e001 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:15.874964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:15.913076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-042eab1f-6a5d-4066-bd94-3d07804a150a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b1c41454614861afe325f6cc859ba9', 'request_id': 'req-042eab1f-6a5d-4066-bd94-3d07804a150a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:15.916639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cdf81965-3825-40cb-b985-03235480e001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93838542feaa41ff9c8cac14d04fc99a', 'request_id': 'req-cdf81965-3825-40cb-b985-03235480e001'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:15.925016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-042eab1f-6a5d-4066-bd94-3d07804a150a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b1c41454614861afe325f6cc859ba9', 'request_id': 'req-042eab1f-6a5d-4066-bd94-3d07804a150a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:15.925416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cdf81965-3825-40cb-b985-03235480e001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93838542feaa41ff9c8cac14d04fc99a', 'request_id': 'req-cdf81965-3825-40cb-b985-03235480e001'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:15.933269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-042eab1f-6a5d-4066-bd94-3d07804a150a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b1c41454614861afe325f6cc859ba9', 'request_id': 'req-042eab1f-6a5d-4066-bd94-3d07804a150a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:15.938394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cdf81965-3825-40cb-b985-03235480e001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93838542feaa41ff9c8cac14d04fc99a', 'request_id': 'req-cdf81965-3825-40cb-b985-03235480e001'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:15.950873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:15.969360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cdf81965-3825-40cb-b985-03235480e001 admin admin] The token cache is being invalidate because project 93838542feaa41ff9c8cac14d04fc99a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:14:15.969837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cdf81965-3825-40cb-b985-03235480e001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:15.970966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cdf81965-3825-40cb-b985-03235480e001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:15.971485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-042eab1f-6a5d-4066-bd94-3d07804a150a admin admin] The token cache is being invalidate because project 86b1c41454614861afe325f6cc859ba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:14:15.971971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-042eab1f-6a5d-4066-bd94-3d07804a150a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:15.972727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-042eab1f-6a5d-4066-bd94-3d07804a150a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:15.973536 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1944/3879] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:14:15 2022] DELETE /identity/v3/projects/93838542feaa41ff9c8cac14d04fc99a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:15.974599 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1936/3880] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:14:15 2022] DELETE /identity/v3/projects/86b1c41454614861afe325f6cc859ba9 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:14:15.979179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe743a22-9147-4a39-98de-a80c90bc78ca None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:15.979524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe743a22-9147-4a39-98de-a80c90bc78ca None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:15.979811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe743a22-9147-4a39-98de-a80c90bc78ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:15.983579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e27815-444d-45fc-b43c-5cfff389ba2e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:15.984139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e27815-444d-45fc-b43c-5cfff389ba2e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:15.984512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e27815-444d-45fc-b43c-5cfff389ba2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:16.005013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-fe743a22-9147-4a39-98de-a80c90bc78ca None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:16.006684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fe743a22-9147-4a39-98de-a80c90bc78ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:16.023075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-54e27815-444d-45fc-b43c-5cfff389ba2e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:16.024417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-54e27815-444d-45fc-b43c-5cfff389ba2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:16.085363 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1945/3881] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:14:16.100763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16993b1-7854-4806-be76-4f757f61ea30 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:16.100763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16993b1-7854-4806-be76-4f757f61ea30 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:16.100763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16993b1-7854-4806-be76-4f757f61ea30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:16.111393 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1937/3882] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:16.113043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ccd08-a058-428d-bc47-f1c9fbd00119 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:16.113335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ccd08-a058-428d-bc47-f1c9fbd00119 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:16.113608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ccd08-a058-428d-bc47-f1c9fbd00119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:16.132578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f16993b1-7854-4806-be76-4f757f61ea30 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:16.133789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f16993b1-7854-4806-be76-4f757f61ea30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:16.135190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0d7ccd08-a058-428d-bc47-f1c9fbd00119 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:16.136510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0d7ccd08-a058-428d-bc47-f1c9fbd00119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:16.144673 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1946/3883] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:16.148877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16993b1-7854-4806-be76-4f757f61ea30 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:16.151762 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1938/3884] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:16.155466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ccd08-a058-428d-bc47-f1c9fbd00119 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:16.162039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16993b1-7854-4806-be76-4f757f61ea30 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:16.168949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ccd08-a058-428d-bc47-f1c9fbd00119 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:16.169911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7a6c6-cf57-4060-a93e-b6a64292c832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:16.172045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7a6c6-cf57-4060-a93e-b6a64292c832 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:16.172648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7a6c6-cf57-4060-a93e-b6a64292c832 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:16.173255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7a6c6-cf57-4060-a93e-b6a64292c832 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:16.174731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7a6c6-cf57-4060-a93e-b6a64292c832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:14:16.175411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7a6c6-cf57-4060-a93e-b6a64292c832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:16.175596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89840ced-b8b8-4091-a18a-7124a648775a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:16.177806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89840ced-b8b8-4091-a18a-7124a648775a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:16.177806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89840ced-b8b8-4091-a18a-7124a648775a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:16.178069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89840ced-b8b8-4091-a18a-7124a648775a admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:16.178750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89840ced-b8b8-4091-a18a-7124a648775a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:14:16.178882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7a6c6-cf57-4060-a93e-b6a64292c832 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:16.179050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89840ced-b8b8-4091-a18a-7124a648775a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:16.181247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89840ced-b8b8-4091-a18a-7124a648775a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:16.198963 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1947/3885] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:14:16.200618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7a6c6-cf57-4060-a93e-b6a64292c832 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:16.222126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7a6c6-cf57-4060-a93e-b6a64292c832 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:16.225851 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1939/3886] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:14:16.229920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89840ced-b8b8-4091-a18a-7124a648775a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:16.231403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef79ea-d0aa-45ba-b0ee-d47108976a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:16.232568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef79ea-d0aa-45ba-b0ee-d47108976a84 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:16.233097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef79ea-d0aa-45ba-b0ee-d47108976a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:16.233584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef79ea-d0aa-45ba-b0ee-d47108976a84 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:16.235630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef79ea-d0aa-45ba-b0ee-d47108976a84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:16.240478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef79ea-d0aa-45ba-b0ee-d47108976a84 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:16.250151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89840ced-b8b8-4091-a18a-7124a648775a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:16.269142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61619050-cd51-4a4c-9aa6-af0057d1d905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:16.270038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61619050-cd51-4a4c-9aa6-af0057d1d905 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:16.271081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61619050-cd51-4a4c-9aa6-af0057d1d905 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:16.271562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61619050-cd51-4a4c-9aa6-af0057d1d905 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:16.272913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61619050-cd51-4a4c-9aa6-af0057d1d905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:16.275228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61619050-cd51-4a4c-9aa6-af0057d1d905 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:16.292507 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1948/3887] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:14:16 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:16.297455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef79ea-d0aa-45ba-b0ee-d47108976a84 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:16.316210 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1940/3888] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:14:16 2022] POST /identity/v3/projects => generated 405 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:14:16.322748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61619050-cd51-4a4c-9aa6-af0057d1d905 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:16.400874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef79ea-d0aa-45ba-b0ee-d47108976a84 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:16.452936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61619050-cd51-4a4c-9aa6-af0057d1d905 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:16.459057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de913f6-01e0-4553-bddc-96650cdab3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:16.459780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de913f6-01e0-4553-bddc-96650cdab3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:16.460125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de913f6-01e0-4553-bddc-96650cdab3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:16.460408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de913f6-01e0-4553-bddc-96650cdab3d8 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:16.461081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de913f6-01e0-4553-bddc-96650cdab3d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:16.463092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de913f6-01e0-4553-bddc-96650cdab3d8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:16.483384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:16.494371 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1941/3889] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:14:16 2022] POST /identity/v3/users => generated 303 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:16.498718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de913f6-01e0-4553-bddc-96650cdab3d8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:16.507833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2315733-a936-4410-a8ba-b701119a5508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:16.509118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2315733-a936-4410-a8ba-b701119a5508 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:16.509118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2315733-a936-4410-a8ba-b701119a5508 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:16.509344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2315733-a936-4410-a8ba-b701119a5508 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:16.510104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2315733-a936-4410-a8ba-b701119a5508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:16.511400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de913f6-01e0-4553-bddc-96650cdab3d8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:16.512267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2315733-a936-4410-a8ba-b701119a5508 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:16.516793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80582de-963a-4ed4-9ba7-48cad17c0584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:16.517891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80582de-963a-4ed4-9ba7-48cad17c0584 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:16.517891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80582de-963a-4ed4-9ba7-48cad17c0584 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:16.518118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80582de-963a-4ed4-9ba7-48cad17c0584 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:16.518939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80582de-963a-4ed4-9ba7-48cad17c0584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:16.520543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80582de-963a-4ed4-9ba7-48cad17c0584 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:16.535735 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1942/3890] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:16.538308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80582de-963a-4ed4-9ba7-48cad17c0584 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:16.538454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:16.549867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80582de-963a-4ed4-9ba7-48cad17c0584 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:16.557591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abf988-9f26-47c8-9ccb-929d2f89fec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:16.558217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abf988-9f26-47c8-9ccb-929d2f89fec9 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:16.558502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abf988-9f26-47c8-9ccb-929d2f89fec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:16.558901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abf988-9f26-47c8-9ccb-929d2f89fec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:16.559672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abf988-9f26-47c8-9ccb-929d2f89fec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:16.560278 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1949/3891] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:14:16 2022] POST /identity/v3/users => generated 292 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:16.561741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abf988-9f26-47c8-9ccb-929d2f89fec9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:16.564664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2315733-a936-4410-a8ba-b701119a5508 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:16.577621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2315733-a936-4410-a8ba-b701119a5508 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:16.577955 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1943/3892] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:16.579713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abf988-9f26-47c8-9ccb-929d2f89fec9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:16.584472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3226751-386c-4781-bb9b-e25a2197cf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:16.585295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3226751-386c-4781-bb9b-e25a2197cf24 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:16.585649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3226751-386c-4781-bb9b-e25a2197cf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:16.586153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3226751-386c-4781-bb9b-e25a2197cf24 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:16.587073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3226751-386c-4781-bb9b-e25a2197cf24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:16.588897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3226751-386c-4781-bb9b-e25a2197cf24 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:16.598350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abf988-9f26-47c8-9ccb-929d2f89fec9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:16.607194 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1950/3893] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:16.610124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3226751-386c-4781-bb9b-e25a2197cf24 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:16.619078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3b2e4-500e-4352-8cd7-616dbc58a41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:16.619796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3b2e4-500e-4352-8cd7-616dbc58a41b admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:16.620088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3b2e4-500e-4352-8cd7-616dbc58a41b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:16.620367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3b2e4-500e-4352-8cd7-616dbc58a41b admin admin] PATH_INFO: `/v3/projects/2ae42a10d54a4ab6aa4ab30fee3e1e69/users/cf1514e67acc4c15a04f5ce04957f937/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:16.622596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3226751-386c-4781-bb9b-e25a2197cf24 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:16.632741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7dff2b-6a00-4a37-9bda-c60814a2696e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:16.634480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dff2b-6a00-4a37-9bda-c60814a2696e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:16.634993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dff2b-6a00-4a37-9bda-c60814a2696e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:16.635595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dff2b-6a00-4a37-9bda-c60814a2696e admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:16.636717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7dff2b-6a00-4a37-9bda-c60814a2696e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:16.639024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3b2e4-500e-4352-8cd7-616dbc58a41b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae42a10d54a4ab6aa4ab30fee3e1e69, user_id=cf1514e67acc4c15a04f5ce04957f937, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:16.641774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3b2e4-500e-4352-8cd7-616dbc58a41b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:16.646583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7dff2b-6a00-4a37-9bda-c60814a2696e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:16.660376 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1951/3894] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:16.664423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7dff2b-6a00-4a37-9bda-c60814a2696e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:16.672239 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1944/3895] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:14:16 2022] PUT /identity/v3/projects/2ae42a10d54a4ab6aa4ab30fee3e1e69/users/cf1514e67acc4c15a04f5ce04957f937/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:16.674540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064a0e7-8626-4b4f-a6e6-01eb407793c7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:16.674757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064a0e7-8626-4b4f-a6e6-01eb407793c7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:16.675014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064a0e7-8626-4b4f-a6e6-01eb407793c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:16.677082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7dff2b-6a00-4a37-9bda-c60814a2696e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:16.698494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d064a0e7-8626-4b4f-a6e6-01eb407793c7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:16.700040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d064a0e7-8626-4b4f-a6e6-01eb407793c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:16.756475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323ecb1-8d6e-4fab-a728-b2e3069715d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:16.757114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323ecb1-8d6e-4fab-a728-b2e3069715d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:16.757114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323ecb1-8d6e-4fab-a728-b2e3069715d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:16.757296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323ecb1-8d6e-4fab-a728-b2e3069715d9 admin admin] PATH_INFO: `/v3/projects/8bddb6ea5e6b470592072376351e7ac4/users/046af69274664f7abac7cd594988a66c/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:16.780003 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1945/3896] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:14:16.786912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323ecb1-8d6e-4fab-a728-b2e3069715d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bddb6ea5e6b470592072376351e7ac4, user_id=046af69274664f7abac7cd594988a66c, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:16.787850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064a0e7-8626-4b4f-a6e6-01eb407793c7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:16.789275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d064a0e7-8626-4b4f-a6e6-01eb407793c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:16.790179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323ecb1-8d6e-4fab-a728-b2e3069715d9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:16.811047 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1952/3897] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:14:16 2022] PUT /identity/v3/projects/8bddb6ea5e6b470592072376351e7ac4/users/046af69274664f7abac7cd594988a66c/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:16.821223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e257bb-a8b8-4e78-b31c-10e43075a503 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:16.821545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e257bb-a8b8-4e78-b31c-10e43075a503 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:16.821874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e257bb-a8b8-4e78-b31c-10e43075a503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:16.859775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-33e257bb-a8b8-4e78-b31c-10e43075a503 None None] MFA Rules not processed for user `046af69274664f7abac7cd594988a66c`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:16.861438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-33e257bb-a8b8-4e78-b31c-10e43075a503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:16.872796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064a0e7-8626-4b4f-a6e6-01eb407793c7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:16.934180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2bcc7-74fb-4ea1-998b-0f27046d22b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:16.934815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2bcc7-74fb-4ea1-998b-0f27046d22b7 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:16.935096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2bcc7-74fb-4ea1-998b-0f27046d22b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:16.935403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2bcc7-74fb-4ea1-998b-0f27046d22b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:16.951390 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1953/3898] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:14:16.964856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e257bb-a8b8-4e78-b31c-10e43075a503 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:16.966297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-33e257bb-a8b8-4e78-b31c-10e43075a503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:16.983146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:17.060511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2bcc7-74fb-4ea1-998b-0f27046d22b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:17.062470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2bcc7-74fb-4ea1-998b-0f27046d22b7 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:17.073910 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1946/3899] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:14:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:14:17.078461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:17.115965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e257bb-a8b8-4e78-b31c-10e43075a503 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:17.128945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d122ca3-1030-426a-9e3d-b1a4d49867af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:17.130632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d122ca3-1030-426a-9e3d-b1a4d49867af service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:17.131840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d122ca3-1030-426a-9e3d-b1a4d49867af service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:17.132141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d122ca3-1030-426a-9e3d-b1a4d49867af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:17.150823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d122ca3-1030-426a-9e3d-b1a4d49867af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:17.158078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d122ca3-1030-426a-9e3d-b1a4d49867af service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:17.194334 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1954/3900] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:14:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:14:22.374879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2bcc7-74fb-4ea1-998b-0f27046d22b7 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:22.392872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2bcc7-74fb-4ea1-998b-0f27046d22b7 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:22.401073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1a33d-a458-40a9-bbda-b31f237b32a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:22.401731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1a33d-a458-40a9-bbda-b31f237b32a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:22.402011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1a33d-a458-40a9-bbda-b31f237b32a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:22.402285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1a33d-a458-40a9-bbda-b31f237b32a4 admin admin] PATH_INFO: `/v3/users/046af69274664f7abac7cd594988a66c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:22.405097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1a33d-a458-40a9-bbda-b31f237b32a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=046af69274664f7abac7cd594988a66c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:22.411874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1a33d-a458-40a9-bbda-b31f237b32a4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:22.529140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-31b1a33d-a458-40a9-bbda-b31f237b32a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '046af69274664f7abac7cd594988a66c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:22.531791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-31b1a33d-a458-40a9-bbda-b31f237b32a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '046af69274664f7abac7cd594988a66c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:22.570193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-31b1a33d-a458-40a9-bbda-b31f237b32a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '046af69274664f7abac7cd594988a66c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:22.570939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-31b1a33d-a458-40a9-bbda-b31f237b32a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '046af69274664f7abac7cd594988a66c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:22.581105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-31b1a33d-a458-40a9-bbda-b31f237b32a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '046af69274664f7abac7cd594988a66c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:22.605903 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1947/3901] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:14:22 2022] DELETE /identity/v3/users/046af69274664f7abac7cd594988a66c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:22.611114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a2c14-6c36-4dad-a115-e7915565cd10 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:22.611676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a2c14-6c36-4dad-a115-e7915565cd10 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:22.611921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a2c14-6c36-4dad-a115-e7915565cd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:22.656108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5f6a2c14-6c36-4dad-a115-e7915565cd10 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:22.657771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5f6a2c14-6c36-4dad-a115-e7915565cd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:22.766951 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1955/3902] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:22.777596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1a33d-a458-40a9-bbda-b31f237b32a4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:22.780036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-31b1a33d-a458-40a9-bbda-b31f237b32a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:22.868078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1a33d-a458-40a9-bbda-b31f237b32a4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:22.873578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd60a3-7cd2-4a35-8505-e0acba8290bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:22.874560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd60a3-7cd2-4a35-8505-e0acba8290bf service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:22.875232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd60a3-7cd2-4a35-8505-e0acba8290bf service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:22.875782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd60a3-7cd2-4a35-8505-e0acba8290bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:22.887419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd60a3-7cd2-4a35-8505-e0acba8290bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:22.889329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd60a3-7cd2-4a35-8505-e0acba8290bf service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:22.914692 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1948/3903] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:14:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:14:23.533829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a2c14-6c36-4dad-a115-e7915565cd10 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:23.535490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5f6a2c14-6c36-4dad-a115-e7915565cd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:23.558307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a2c14-6c36-4dad-a115-e7915565cd10 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:23.572447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45923b-83e5-4b58-a588-031630b0c43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:23.573248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45923b-83e5-4b58-a588-031630b0c43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:23.573590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45923b-83e5-4b58-a588-031630b0c43d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:23.573876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45923b-83e5-4b58-a588-031630b0c43d admin admin] PATH_INFO: `/v3/projects/8bddb6ea5e6b470592072376351e7ac4` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:23.579955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45923b-83e5-4b58-a588-031630b0c43d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bddb6ea5e6b470592072376351e7ac4)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:23.581930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45923b-83e5-4b58-a588-031630b0c43d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:23.709887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e45923b-83e5-4b58-a588-031630b0c43d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bddb6ea5e6b470592072376351e7ac4', 'request_id': 'req-1e45923b-83e5-4b58-a588-031630b0c43d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:23.719945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e45923b-83e5-4b58-a588-031630b0c43d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bddb6ea5e6b470592072376351e7ac4', 'request_id': 'req-1e45923b-83e5-4b58-a588-031630b0c43d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:23.736423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e45923b-83e5-4b58-a588-031630b0c43d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bddb6ea5e6b470592072376351e7ac4', 'request_id': 'req-1e45923b-83e5-4b58-a588-031630b0c43d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:23.764322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e45923b-83e5-4b58-a588-031630b0c43d admin admin] The token cache is being invalidate because project 8bddb6ea5e6b470592072376351e7ac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:14:23.764618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e45923b-83e5-4b58-a588-031630b0c43d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:23.766911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e45923b-83e5-4b58-a588-031630b0c43d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:23.769697 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1956/3904] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:14:23 2022] DELETE /identity/v3/projects/8bddb6ea5e6b470592072376351e7ac4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:23.775581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1d8b5-8fd6-4386-87d7-fe3b8fe1c80c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:23.776116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1d8b5-8fd6-4386-87d7-fe3b8fe1c80c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:23.776116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1d8b5-8fd6-4386-87d7-fe3b8fe1c80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:23.797377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-64e1d8b5-8fd6-4386-87d7-fe3b8fe1c80c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:23.798716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-64e1d8b5-8fd6-4386-87d7-fe3b8fe1c80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:23.838893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:23.897103 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1949/3905] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:23.907768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b973-9d7c-46dc-8312-2d2920218825 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:23.908380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b973-9d7c-46dc-8312-2d2920218825 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:23.908716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b973-9d7c-46dc-8312-2d2920218825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:23.935214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-07c8b973-9d7c-46dc-8312-2d2920218825 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:23.937808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-07c8b973-9d7c-46dc-8312-2d2920218825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:23.948107 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1957/3906] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:23.961391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1d8b5-8fd6-4386-87d7-fe3b8fe1c80c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:23.976913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1d8b5-8fd6-4386-87d7-fe3b8fe1c80c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:24.011651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03961c17-5698-4e5c-9b19-9f5886fcde1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:24.012514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03961c17-5698-4e5c-9b19-9f5886fcde1e admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:24.012895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03961c17-5698-4e5c-9b19-9f5886fcde1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:24.013258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03961c17-5698-4e5c-9b19-9f5886fcde1e admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:24.014036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03961c17-5698-4e5c-9b19-9f5886fcde1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:14:24.014534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03961c17-5698-4e5c-9b19-9f5886fcde1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:24.017399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03961c17-5698-4e5c-9b19-9f5886fcde1e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:24.042075 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1950/3907] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:14:24.043745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8b973-9d7c-46dc-8312-2d2920218825 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:24.057094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8b973-9d7c-46dc-8312-2d2920218825 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:24.069836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be630093-2370-415f-92be-ca24bfd67491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:24.070720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be630093-2370-415f-92be-ca24bfd67491 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:24.071524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be630093-2370-415f-92be-ca24bfd67491 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:24.072548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be630093-2370-415f-92be-ca24bfd67491 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:24.073260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be630093-2370-415f-92be-ca24bfd67491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:24.075634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be630093-2370-415f-92be-ca24bfd67491 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:24.128490 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1958/3908] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:14:24 2022] POST /identity/v3/projects => generated 403 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:14:24.130114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03961c17-5698-4e5c-9b19-9f5886fcde1e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:24.145270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03961c17-5698-4e5c-9b19-9f5886fcde1e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:24.256992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b6bed-5708-476b-bc9d-20a1441731c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:24.257639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b6bed-5708-476b-bc9d-20a1441731c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:24.257928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b6bed-5708-476b-bc9d-20a1441731c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:24.258201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b6bed-5708-476b-bc9d-20a1441731c2 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:24.258885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b6bed-5708-476b-bc9d-20a1441731c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:24.262394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b6bed-5708-476b-bc9d-20a1441731c2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:24.306214 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1951/3909] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:14:24 2022] POST /identity/v3/users => generated 302 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:24.309203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be630093-2370-415f-92be-ca24bfd67491 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:24.329905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be630093-2370-415f-92be-ca24bfd67491 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:24.348511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59dfdf-f505-471e-a43b-408c2fe41177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:24.349174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59dfdf-f505-471e-a43b-408c2fe41177 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:24.349456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59dfdf-f505-471e-a43b-408c2fe41177 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:24.349864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59dfdf-f505-471e-a43b-408c2fe41177 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:24.350444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59dfdf-f505-471e-a43b-408c2fe41177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:24.352094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59dfdf-f505-471e-a43b-408c2fe41177 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:24.381799 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1959/3910] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:24.383041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b6bed-5708-476b-bc9d-20a1441731c2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:24.397596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b6bed-5708-476b-bc9d-20a1441731c2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:24.410307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a33ad-80d3-4e64-83bc-37668ad5afb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:24.411031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a33ad-80d3-4e64-83bc-37668ad5afb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:24.411389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a33ad-80d3-4e64-83bc-37668ad5afb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:24.412440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a33ad-80d3-4e64-83bc-37668ad5afb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:24.412561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a33ad-80d3-4e64-83bc-37668ad5afb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:24.416919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a33ad-80d3-4e64-83bc-37668ad5afb3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:24.443472 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1952/3911] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:24.444089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59dfdf-f505-471e-a43b-408c2fe41177 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:24.454947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59dfdf-f505-471e-a43b-408c2fe41177 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:24.460801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc0534-9058-4032-a3e6-55ffb6f8a9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:24.461495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc0534-9058-4032-a3e6-55ffb6f8a9cc admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:24.461842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc0534-9058-4032-a3e6-55ffb6f8a9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:24.462172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc0534-9058-4032-a3e6-55ffb6f8a9cc admin admin] PATH_INFO: `/v3/projects/3640514cfd2e42129217e50ff2df9f58/users/8633373bdc9a499781e9ea1f62bb17cd/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:24.477408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:24.485469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc0534-9058-4032-a3e6-55ffb6f8a9cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3640514cfd2e42129217e50ff2df9f58, user_id=8633373bdc9a499781e9ea1f62bb17cd, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:24.488647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc0534-9058-4032-a3e6-55ffb6f8a9cc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:24.517435 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1960/3912] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:14:24 2022] PUT /identity/v3/projects/3640514cfd2e42129217e50ff2df9f58/users/8633373bdc9a499781e9ea1f62bb17cd/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:14:24.528001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d4881-9016-47a3-9a8d-26bf479f7bc5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:24.529365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d4881-9016-47a3-9a8d-26bf479f7bc5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:24.529770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d4881-9016-47a3-9a8d-26bf479f7bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:24.575612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-866d4881-9016-47a3-9a8d-26bf479f7bc5 None None] MFA Rules not processed for user `8633373bdc9a499781e9ea1f62bb17cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:24.578071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-866d4881-9016-47a3-9a8d-26bf479f7bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:24.706730 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1953/3913] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:24.710902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc0534-9058-4032-a3e6-55ffb6f8a9cc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:24.818245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc0534-9058-4032-a3e6-55ffb6f8a9cc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:24.823894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bf716-eada-4225-a980-17dbaaf8ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:24.825708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bf716-eada-4225-a980-17dbaaf8ba7a admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:24.826143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bf716-eada-4225-a980-17dbaaf8ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:24.826484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bf716-eada-4225-a980-17dbaaf8ba7a admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:24.828584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bf716-eada-4225-a980-17dbaaf8ba7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:24.832746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bf716-eada-4225-a980-17dbaaf8ba7a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:24.876746 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1961/3914] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:14:24 2022] POST /identity/v3/projects => generated 403 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:24.881463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d4881-9016-47a3-9a8d-26bf479f7bc5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:24.894299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d4881-9016-47a3-9a8d-26bf479f7bc5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:24.933393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:24.997013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0873a3e-4f15-4404-a11e-4332f638ac5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:24.997013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0873a3e-4f15-4404-a11e-4332f638ac5b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:24.997013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0873a3e-4f15-4404-a11e-4332f638ac5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:25.000312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0873a3e-4f15-4404-a11e-4332f638ac5b admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:25.001797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0873a3e-4f15-4404-a11e-4332f638ac5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:25.006961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0873a3e-4f15-4404-a11e-4332f638ac5b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:25.063934 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1954/3915] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:14:24 2022] POST /identity/v3/users => generated 308 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:25.064793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bf716-eada-4225-a980-17dbaaf8ba7a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:25.087879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bf716-eada-4225-a980-17dbaaf8ba7a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:25.105421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f98f8-47f7-4963-8789-4803d79986ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:25.106317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f98f8-47f7-4963-8789-4803d79986ea admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:25.106760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f98f8-47f7-4963-8789-4803d79986ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:25.107193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f98f8-47f7-4963-8789-4803d79986ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:25.108200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f98f8-47f7-4963-8789-4803d79986ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:25.110498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f98f8-47f7-4963-8789-4803d79986ea admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:25.139485 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1962/3916] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:14:25.143810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0873a3e-4f15-4404-a11e-4332f638ac5b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:25.160813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0873a3e-4f15-4404-a11e-4332f638ac5b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:25.177655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7c6f7-0500-4ed3-81d6-f09544337f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:25.178424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7c6f7-0500-4ed3-81d6-f09544337f3f admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:25.178716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7c6f7-0500-4ed3-81d6-f09544337f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:25.179056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7c6f7-0500-4ed3-81d6-f09544337f3f admin admin] PATH_INFO: `/v3/projects/de92556f0d2e4e3da8e6cfc068b62eb6/users/5ec9141840e04504b2f2d08544fbe4fa/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:25.198256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7c6f7-0500-4ed3-81d6-f09544337f3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=de92556f0d2e4e3da8e6cfc068b62eb6, user_id=5ec9141840e04504b2f2d08544fbe4fa, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:25.201598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7c6f7-0500-4ed3-81d6-f09544337f3f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:25.229353 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1955/3917] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:14:25 2022] PUT /identity/v3/projects/de92556f0d2e4e3da8e6cfc068b62eb6/users/5ec9141840e04504b2f2d08544fbe4fa/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:25.230148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f98f8-47f7-4963-8789-4803d79986ea admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:25.256751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f98f8-47f7-4963-8789-4803d79986ea admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:25.428939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b214a4-5a47-4b34-b371-87b4914acad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:25.429585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b214a4-5a47-4b34-b371-87b4914acad4 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:25.429867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b214a4-5a47-4b34-b371-87b4914acad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:25.430143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b214a4-5a47-4b34-b371-87b4914acad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:25.430841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b214a4-5a47-4b34-b371-87b4914acad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:25.442395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b214a4-5a47-4b34-b371-87b4914acad4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:25.495857 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1963/3918] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:14:25.500334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7c6f7-0500-4ed3-81d6-f09544337f3f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:25.519942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7c6f7-0500-4ed3-81d6-f09544337f3f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:25.536836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f04a88-e821-4298-9338-270d4019b6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:25.537703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f04a88-e821-4298-9338-270d4019b6b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:25.537993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f04a88-e821-4298-9338-270d4019b6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:25.538270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f04a88-e821-4298-9338-270d4019b6b2 admin admin] PATH_INFO: `/v3/projects/de92556f0d2e4e3da8e6cfc068b62eb6/users/5ec9141840e04504b2f2d08544fbe4fa/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:25.540943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f04a88-e821-4298-9338-270d4019b6b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de92556f0d2e4e3da8e6cfc068b62eb6, user_id=5ec9141840e04504b2f2d08544fbe4fa, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:25.544872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f04a88-e821-4298-9338-270d4019b6b2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:25.599174 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1956/3919] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:14:25 2022] PUT /identity/v3/projects/de92556f0d2e4e3da8e6cfc068b62eb6/users/5ec9141840e04504b2f2d08544fbe4fa/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:25.612324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4408379-d188-4741-8fa6-ee0f0f7a86ef None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:25.613483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4408379-d188-4741-8fa6-ee0f0f7a86ef None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:25.614109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4408379-d188-4741-8fa6-ee0f0f7a86ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:25.674992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b4408379-d188-4741-8fa6-ee0f0f7a86ef None None] MFA Rules not processed for user `5ec9141840e04504b2f2d08544fbe4fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:25.680275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b4408379-d188-4741-8fa6-ee0f0f7a86ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:25.790331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:25.864894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f04a88-e821-4298-9338-270d4019b6b2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:25.865158 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1964/3920] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:25 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:25.879616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f04a88-e821-4298-9338-270d4019b6b2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:25.899693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9483bfa-1543-46bc-87ac-7414b943b2bc tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec9141840e04504b2f2d08544fbe4fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de92556f0d2e4e3da8e6cfc068b62eb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:25.900343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9483bfa-1543-46bc-87ac-7414b943b2bc tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:25.900575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9483bfa-1543-46bc-87ac-7414b943b2bc tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:25.900858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9483bfa-1543-46bc-87ac-7414b943b2bc tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:25.901590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9483bfa-1543-46bc-87ac-7414b943b2bc tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:25.902709 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-f9483bfa-1543-46bc-87ac-7414b943b2bc tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:14:25.902709 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:14:25.902709 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:14:25.906700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9483bfa-1543-46bc-87ac-7414b943b2bc tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:25.953667 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1957/3921] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:14:25 2022] POST /identity/v3/roles => generated 240 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:25.957800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4408379-d188-4741-8fa6-ee0f0f7a86ef None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:25.974317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4408379-d188-4741-8fa6-ee0f0f7a86ef None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:25.985528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042066e-bb61-44cf-9ae8-582c720abfa9 tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec9141840e04504b2f2d08544fbe4fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de92556f0d2e4e3da8e6cfc068b62eb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:25.987190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042066e-bb61-44cf-9ae8-582c720abfa9 tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:25.989464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042066e-bb61-44cf-9ae8-582c720abfa9 tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:25.989924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042066e-bb61-44cf-9ae8-582c720abfa9 tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] PATH_INFO: `/v3/projects/3640514cfd2e42129217e50ff2df9f58/users/8633373bdc9a499781e9ea1f62bb17cd/roles/4b37a3796f8c49ec89782283143d3d7e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:25.996861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042066e-bb61-44cf-9ae8-582c720abfa9 tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3640514cfd2e42129217e50ff2df9f58, user_id=8633373bdc9a499781e9ea1f62bb17cd, role_id=4b37a3796f8c49ec89782283143d3d7e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:26.003724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042066e-bb61-44cf-9ae8-582c720abfa9 tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:26.046311 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1965/3922] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:14:25 2022] PUT /identity/v3/projects/3640514cfd2e42129217e50ff2df9f58/users/8633373bdc9a499781e9ea1f62bb17cd/roles/4b37a3796f8c49ec89782283143d3d7e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:26.047030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9483bfa-1543-46bc-87ac-7414b943b2bc tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:26.218034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9483bfa-1543-46bc-87ac-7414b943b2bc tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:26.361562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26b7d4-c845-429b-ba6a-e50510a15bee tempest-ApplicationCredentialsV3AdminTest-1422924237 tempest-ApplicationCredentialsV3AdminTest-1422924237-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8633373bdc9a499781e9ea1f62bb17cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3640514cfd2e42129217e50ff2df9f58', 'project_domain_id': 'default', 'roles': ['tempest-test_role-1781318951', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:26.362247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26b7d4-c845-429b-ba6a-e50510a15bee tempest-ApplicationCredentialsV3AdminTest-1422924237 tempest-ApplicationCredentialsV3AdminTest-1422924237-project] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:26.362614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26b7d4-c845-429b-ba6a-e50510a15bee tempest-ApplicationCredentialsV3AdminTest-1422924237 tempest-ApplicationCredentialsV3AdminTest-1422924237-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:26.362803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26b7d4-c845-429b-ba6a-e50510a15bee tempest-ApplicationCredentialsV3AdminTest-1422924237 tempest-ApplicationCredentialsV3AdminTest-1422924237-project] PATH_INFO: `/v3/users/8633373bdc9a499781e9ea1f62bb17cd/application_credentials` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:26.363711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26b7d4-c845-429b-ba6a-e50510a15bee tempest-ApplicationCredentialsV3AdminTest-1422924237 tempest-ApplicationCredentialsV3AdminTest-1422924237-project] RBAC: Authorizing `identity:create_application_credential(user_id=8633373bdc9a499781e9ea1f62bb17cd)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:26.364846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26b7d4-c845-429b-ba6a-e50510a15bee tempest-ApplicationCredentialsV3AdminTest-1422924237 tempest-ApplicationCredentialsV3AdminTest-1422924237-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:26.406931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:26.565328 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1958/3923] 10.222.0.17 () {60 vars in 1315 bytes} [Sat Jul 30 21:14:26 2022] POST /identity/v3/users/8633373bdc9a499781e9ea1f62bb17cd/application_credentials => generated 660 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:26.567556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6d022-bc73-470d-833b-daf8b2874d1a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:26.568036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6d022-bc73-470d-833b-daf8b2874d1a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:26.568466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6d022-bc73-470d-833b-daf8b2874d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:26.633447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c6a6d022-bc73-470d-833b-daf8b2874d1a None None] MFA Rules not processed for user `8633373bdc9a499781e9ea1f62bb17cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:26.640761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c6a6d022-bc73-470d-833b-daf8b2874d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:26.985413 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1966/3924] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:26 2022] POST /identity/v3/auth/tokens => generated 3387 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 30 21:14:26.991131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26b7d4-c845-429b-ba6a-e50510a15bee tempest-ApplicationCredentialsV3AdminTest-1422924237 tempest-ApplicationCredentialsV3AdminTest-1422924237-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:27.022423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26b7d4-c845-429b-ba6a-e50510a15bee tempest-ApplicationCredentialsV3AdminTest-1422924237 tempest-ApplicationCredentialsV3AdminTest-1422924237-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:27.034167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493b2d1-fcb4-47df-af32-2448d792812a tempest-ApplicationCredentialsV3AdminTest-1422924237 tempest-ApplicationCredentialsV3AdminTest-1422924237-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8633373bdc9a499781e9ea1f62bb17cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3640514cfd2e42129217e50ff2df9f58', 'project_domain_id': 'default', 'roles': ['tempest-test_role-1781318951', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:27.034789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493b2d1-fcb4-47df-af32-2448d792812a tempest-ApplicationCredentialsV3AdminTest-1422924237 tempest-ApplicationCredentialsV3AdminTest-1422924237-project] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:27.035077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493b2d1-fcb4-47df-af32-2448d792812a tempest-ApplicationCredentialsV3AdminTest-1422924237 tempest-ApplicationCredentialsV3AdminTest-1422924237-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:27.035386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493b2d1-fcb4-47df-af32-2448d792812a tempest-ApplicationCredentialsV3AdminTest-1422924237 tempest-ApplicationCredentialsV3AdminTest-1422924237-project] PATH_INFO: `/v3/users/8633373bdc9a499781e9ea1f62bb17cd/application_credentials/036e1db7664f402e929d89a92a20155a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:27.039669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493b2d1-fcb4-47df-af32-2448d792812a tempest-ApplicationCredentialsV3AdminTest-1422924237 tempest-ApplicationCredentialsV3AdminTest-1422924237-project] RBAC: Authorizing `identity:delete_application_credential(user_id=8633373bdc9a499781e9ea1f62bb17cd, application_credential_id=036e1db7664f402e929d89a92a20155a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:27.041679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493b2d1-fcb4-47df-af32-2448d792812a tempest-ApplicationCredentialsV3AdminTest-1422924237 tempest-ApplicationCredentialsV3AdminTest-1422924237-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:27.153354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6d022-bc73-470d-833b-daf8b2874d1a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:27.156369 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1959/3925] 10.222.0.17 () {58 vars in 1395 bytes} [Sat Jul 30 21:14:26 2022] DELETE /identity/v3/users/8633373bdc9a499781e9ea1f62bb17cd/application_credentials/036e1db7664f402e929d89a92a20155a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:27.291217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000b15c-3334-48d8-be3d-d18d9e5898e8 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:27.291592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000b15c-3334-48d8-be3d-d18d9e5898e8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:27.291873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000b15c-3334-48d8-be3d-d18d9e5898e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:27.364535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6000b15c-3334-48d8-be3d-d18d9e5898e8 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:27.367120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6000b15c-3334-48d8-be3d-d18d9e5898e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:27.423374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6d022-bc73-470d-833b-daf8b2874d1a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:27.433522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd352a-1ca4-48c4-9d0e-b41904c01b75 tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec9141840e04504b2f2d08544fbe4fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de92556f0d2e4e3da8e6cfc068b62eb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:27.434204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd352a-1ca4-48c4-9d0e-b41904c01b75 tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:27.434795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd352a-1ca4-48c4-9d0e-b41904c01b75 tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:27.435092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd352a-1ca4-48c4-9d0e-b41904c01b75 tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] PATH_INFO: `/v3/roles/4b37a3796f8c49ec89782283143d3d7e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:27.440764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd352a-1ca4-48c4-9d0e-b41904c01b75 tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4b37a3796f8c49ec89782283143d3d7e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:27.444958 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-08fd352a-1ca4-48c4-9d0e-b41904c01b75 tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:14:27.444958 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:14:27.444958 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:14:27.445897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd352a-1ca4-48c4-9d0e-b41904c01b75 tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:27.475000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:27.562923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-08fd352a-1ca4-48c4-9d0e-b41904c01b75 tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] Invalidating the token cache because role 4b37a3796f8c49ec89782283143d3d7e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:14:27.563404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-08fd352a-1ca4-48c4-9d0e-b41904c01b75 tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:27.564439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-08fd352a-1ca4-48c4-9d0e-b41904c01b75 tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:27.571176 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1967/3926] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:14:27 2022] DELETE /identity/v3/roles/4b37a3796f8c49ec89782283143d3d7e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:27.573593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd352a-1ca4-48c4-9d0e-b41904c01b75 tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:27.575426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-08fd352a-1ca4-48c4-9d0e-b41904c01b75 tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:27.576708 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1960/3927] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:14:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:14:27.604189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000b15c-3334-48d8-be3d-d18d9e5898e8 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:27.605948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6000b15c-3334-48d8-be3d-d18d9e5898e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:27.703862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd352a-1ca4-48c4-9d0e-b41904c01b75 tempest-ApplicationCredentialsV3AdminTest-1242696030 tempest-ApplicationCredentialsV3AdminTest-1242696030-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:27.712798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef36f75-5696-498b-98b2-41b2deaa83cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:27.713777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef36f75-5696-498b-98b2-41b2deaa83cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:27.714117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef36f75-5696-498b-98b2-41b2deaa83cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:27.715661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef36f75-5696-498b-98b2-41b2deaa83cb admin admin] PATH_INFO: `/v3/users/8633373bdc9a499781e9ea1f62bb17cd` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:27.718659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef36f75-5696-498b-98b2-41b2deaa83cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8633373bdc9a499781e9ea1f62bb17cd)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:27.722244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef36f75-5696-498b-98b2-41b2deaa83cb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:27.790202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000b15c-3334-48d8-be3d-d18d9e5898e8 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:27.822448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-aef36f75-5696-498b-98b2-41b2deaa83cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8633373bdc9a499781e9ea1f62bb17cd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:27.848139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-aef36f75-5696-498b-98b2-41b2deaa83cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8633373bdc9a499781e9ea1f62bb17cd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:27.848920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-aef36f75-5696-498b-98b2-41b2deaa83cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8633373bdc9a499781e9ea1f62bb17cd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:27.860451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-aef36f75-5696-498b-98b2-41b2deaa83cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8633373bdc9a499781e9ea1f62bb17cd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:27.864293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-aef36f75-5696-498b-98b2-41b2deaa83cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8633373bdc9a499781e9ea1f62bb17cd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:27.908389 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1968/3928] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:14:27 2022] DELETE /identity/v3/users/8633373bdc9a499781e9ea1f62bb17cd => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:27.908389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef36f75-5696-498b-98b2-41b2deaa83cb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:27.908805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-aef36f75-5696-498b-98b2-41b2deaa83cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:27.987189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:28.055428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25916b70-1bfc-494a-8250-ebfcb1671b3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:28.057547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25916b70-1bfc-494a-8250-ebfcb1671b3e service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:28.058060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25916b70-1bfc-494a-8250-ebfcb1671b3e service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:28.058877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25916b70-1bfc-494a-8250-ebfcb1671b3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:28.066177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-25916b70-1bfc-494a-8250-ebfcb1671b3e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:28.143505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef36f75-5696-498b-98b2-41b2deaa83cb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:28.158643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35dcb7b-5d95-4b6e-b741-666c29c2ae7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:28.159677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dcb7b-5d95-4b6e-b741-666c29c2ae7c service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:28.161554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dcb7b-5d95-4b6e-b741-666c29c2ae7c service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:28.163225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dcb7b-5d95-4b6e-b741-666c29c2ae7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:28.168588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a35dcb7b-5d95-4b6e-b741-666c29c2ae7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:28.206436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25916b70-1bfc-494a-8250-ebfcb1671b3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:28.208426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25916b70-1bfc-494a-8250-ebfcb1671b3e service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:28.210977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:28.232025 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1961/3929] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:14:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:14:28.234584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121c77d-8296-463d-9bb6-3d0a416cade5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:28.235961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121c77d-8296-463d-9bb6-3d0a416cade5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:28.237434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121c77d-8296-463d-9bb6-3d0a416cade5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:28.305756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e121c77d-8296-463d-9bb6-3d0a416cade5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:28.305756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e121c77d-8296-463d-9bb6-3d0a416cade5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:28.457305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35dcb7b-5d95-4b6e-b741-666c29c2ae7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:28.458803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35dcb7b-5d95-4b6e-b741-666c29c2ae7c service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:28.488501 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1969/3930] 10.222.0.17 () {60 vars in 1396 bytes} [Sat Jul 30 21:14:27 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:14:28.495625 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1962/3931] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:28.891872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35dcb7b-5d95-4b6e-b741-666c29c2ae7c service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:28.894724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a35dcb7b-5d95-4b6e-b741-666c29c2ae7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:28.916300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35dcb7b-5d95-4b6e-b741-666c29c2ae7c service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:28.930772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c77c7-2625-4c4a-8683-b568a4aab498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:28.932762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c77c7-2625-4c4a-8683-b568a4aab498 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:28.937688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c77c7-2625-4c4a-8683-b568a4aab498 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:28.938168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c77c7-2625-4c4a-8683-b568a4aab498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:28.992501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c77c7-2625-4c4a-8683-b568a4aab498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:28.993997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c77c7-2625-4c4a-8683-b568a4aab498 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:29.015877 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1970/3932] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:14:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:14:29.809199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121c77d-8296-463d-9bb6-3d0a416cade5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:29.812929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e121c77d-8296-463d-9bb6-3d0a416cade5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:29.856734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121c77d-8296-463d-9bb6-3d0a416cade5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:29.872737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d90ee-2310-4894-85e8-4089b38597c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:29.879468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d90ee-2310-4894-85e8-4089b38597c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:29.880943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d90ee-2310-4894-85e8-4089b38597c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:29.882050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d90ee-2310-4894-85e8-4089b38597c1 admin admin] PATH_INFO: `/v3/users/76afad1e6b734e858fdf1306c79d7fbd` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:29.883999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d90ee-2310-4894-85e8-4089b38597c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76afad1e6b734e858fdf1306c79d7fbd)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:29.887926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d90ee-2310-4894-85e8-4089b38597c1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:30.000457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b43d90ee-2310-4894-85e8-4089b38597c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76afad1e6b734e858fdf1306c79d7fbd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:30.002092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b43d90ee-2310-4894-85e8-4089b38597c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76afad1e6b734e858fdf1306c79d7fbd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:30.035806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b43d90ee-2310-4894-85e8-4089b38597c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76afad1e6b734e858fdf1306c79d7fbd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:30.036914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b43d90ee-2310-4894-85e8-4089b38597c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76afad1e6b734e858fdf1306c79d7fbd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:30.050279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b43d90ee-2310-4894-85e8-4089b38597c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76afad1e6b734e858fdf1306c79d7fbd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:30.062083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:30.079603 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1963/3933] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:14:29 2022] DELETE /identity/v3/users/76afad1e6b734e858fdf1306c79d7fbd => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:30.377770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310d3a2-a464-4ab0-839f-86448ee1c856 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:30.378799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310d3a2-a464-4ab0-839f-86448ee1c856 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:30.379540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310d3a2-a464-4ab0-839f-86448ee1c856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:30.449326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7310d3a2-a464-4ab0-839f-86448ee1c856 None None] MFA Rules not processed for user `cf1514e67acc4c15a04f5ce04957f937`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:30.451339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7310d3a2-a464-4ab0-839f-86448ee1c856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:30.459198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d90ee-2310-4894-85e8-4089b38597c1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:30.461171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b43d90ee-2310-4894-85e8-4089b38597c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:30.613936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d90ee-2310-4894-85e8-4089b38597c1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:30.627118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7b3ea-081c-4eb0-8077-71250c45375b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:30.628427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7b3ea-081c-4eb0-8077-71250c45375b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:30.628939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7b3ea-081c-4eb0-8077-71250c45375b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:30.629701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7b3ea-081c-4eb0-8077-71250c45375b admin admin] PATH_INFO: `/v3/projects/e118fcd176734b698c4b7a48dc715d4d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:30.633012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7b3ea-081c-4eb0-8077-71250c45375b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e118fcd176734b698c4b7a48dc715d4d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:30.635261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7b3ea-081c-4eb0-8077-71250c45375b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:30.648150 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1971/3934] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:30 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:30.648150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310d3a2-a464-4ab0-839f-86448ee1c856 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:30.654266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7310d3a2-a464-4ab0-839f-86448ee1c856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:30.687939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310d3a2-a464-4ab0-839f-86448ee1c856 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:30.700998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5495ef-9d23-4403-9635-4180ffdeaa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:30.701856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5495ef-9d23-4403-9635-4180ffdeaa7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:30.702941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5495ef-9d23-4403-9635-4180ffdeaa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:30.703343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5495ef-9d23-4403-9635-4180ffdeaa7c admin admin] PATH_INFO: `/v3/projects/3640514cfd2e42129217e50ff2df9f58` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:30.706578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5495ef-9d23-4403-9635-4180ffdeaa7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3640514cfd2e42129217e50ff2df9f58)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:30.711797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5495ef-9d23-4403-9635-4180ffdeaa7c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:30.767882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0cb7b3ea-081c-4eb0-8077-71250c45375b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e118fcd176734b698c4b7a48dc715d4d', 'request_id': 'req-0cb7b3ea-081c-4eb0-8077-71250c45375b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:30.785232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0cb7b3ea-081c-4eb0-8077-71250c45375b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e118fcd176734b698c4b7a48dc715d4d', 'request_id': 'req-0cb7b3ea-081c-4eb0-8077-71250c45375b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:30.792305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0cb7b3ea-081c-4eb0-8077-71250c45375b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e118fcd176734b698c4b7a48dc715d4d', 'request_id': 'req-0cb7b3ea-081c-4eb0-8077-71250c45375b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:30.821892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0cb7b3ea-081c-4eb0-8077-71250c45375b admin admin] The token cache is being invalidate because project e118fcd176734b698c4b7a48dc715d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:14:30.822568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0cb7b3ea-081c-4eb0-8077-71250c45375b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:30.824733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0cb7b3ea-081c-4eb0-8077-71250c45375b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:30.830843 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1964/3935] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:14:30 2022] DELETE /identity/v3/projects/e118fcd176734b698c4b7a48dc715d4d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:14:30.831719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7b3ea-081c-4eb0-8077-71250c45375b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:30.834910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0cb7b3ea-081c-4eb0-8077-71250c45375b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:30.835667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da5495ef-9d23-4403-9635-4180ffdeaa7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3640514cfd2e42129217e50ff2df9f58', 'request_id': 'req-da5495ef-9d23-4403-9635-4180ffdeaa7c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:30.852321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da5495ef-9d23-4403-9635-4180ffdeaa7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3640514cfd2e42129217e50ff2df9f58', 'request_id': 'req-da5495ef-9d23-4403-9635-4180ffdeaa7c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:30.871390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da5495ef-9d23-4403-9635-4180ffdeaa7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3640514cfd2e42129217e50ff2df9f58', 'request_id': 'req-da5495ef-9d23-4403-9635-4180ffdeaa7c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:30.898267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da5495ef-9d23-4403-9635-4180ffdeaa7c admin admin] The token cache is being invalidate because project 3640514cfd2e42129217e50ff2df9f58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:14:30.898634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da5495ef-9d23-4403-9635-4180ffdeaa7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:30.900573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da5495ef-9d23-4403-9635-4180ffdeaa7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:30.904914 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1972/3936] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:14:30 2022] DELETE /identity/v3/projects/3640514cfd2e42129217e50ff2df9f58 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:30.909039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5495ef-9d23-4403-9635-4180ffdeaa7c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:30.913103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-da5495ef-9d23-4403-9635-4180ffdeaa7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:30.939842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:31.066235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7b3ea-081c-4eb0-8077-71250c45375b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:31.102906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5495ef-9d23-4403-9635-4180ffdeaa7c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:31.112901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21de65-28d8-405a-9032-bd2b1479f3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:31.113626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21de65-28d8-405a-9032-bd2b1479f3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:31.115763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21de65-28d8-405a-9032-bd2b1479f3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:31.117829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:31.117990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21de65-28d8-405a-9032-bd2b1479f3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:31.121345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cf21de65-28d8-405a-9032-bd2b1479f3c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:31.241823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fda500-375b-46ae-aceb-86248dcfb2b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:31.243588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fda500-375b-46ae-aceb-86248dcfb2b7 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:31.243886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fda500-375b-46ae-aceb-86248dcfb2b7 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:31.244165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fda500-375b-46ae-aceb-86248dcfb2b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:31.250981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-55fda500-375b-46ae-aceb-86248dcfb2b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:31.267834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21de65-28d8-405a-9032-bd2b1479f3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:31.269302 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21de65-28d8-405a-9032-bd2b1479f3c6 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:31.302318 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1973/3937] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:14:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:14:31.305054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cf265-b7be-4508-8624-280549e9a6c3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:31.307629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cf265-b7be-4508-8624-280549e9a6c3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:31.307972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cf265-b7be-4508-8624-280549e9a6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:31.396003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fda500-375b-46ae-aceb-86248dcfb2b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:31.399947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3d0cf265-b7be-4508-8624-280549e9a6c3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:31.400984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fda500-375b-46ae-aceb-86248dcfb2b7 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:31.406311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3d0cf265-b7be-4508-8624-280549e9a6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:31.426084 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1965/3938] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:14:30 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:14:31.428281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fda500-375b-46ae-aceb-86248dcfb2b7 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:31.433691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-55fda500-375b-46ae-aceb-86248dcfb2b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:31.453333 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1974/3939] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:31.461796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b48c4-9b17-4d76-a50d-9572ec3d1858 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:31.462086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b48c4-9b17-4d76-a50d-9572ec3d1858 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:31.462357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b48c4-9b17-4d76-a50d-9572ec3d1858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:31.465981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fda500-375b-46ae-aceb-86248dcfb2b7 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:31.481082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba1acd-dae1-46cc-a1bf-450ac0adca5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:31.481755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba1acd-dae1-46cc-a1bf-450ac0adca5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:31.482033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba1acd-dae1-46cc-a1bf-450ac0adca5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:31.482308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba1acd-dae1-46cc-a1bf-450ac0adca5a admin admin] PATH_INFO: `/v3/users/5ec9141840e04504b2f2d08544fbe4fa` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:31.485974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba1acd-dae1-46cc-a1bf-450ac0adca5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec9141840e04504b2f2d08544fbe4fa)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:31.488116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba1acd-dae1-46cc-a1bf-450ac0adca5a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:31.568495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8e4b48c4-9b17-4d76-a50d-9572ec3d1858 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:31.569765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8e4b48c4-9b17-4d76-a50d-9572ec3d1858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:31.585107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-85ba1acd-dae1-46cc-a1bf-450ac0adca5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec9141840e04504b2f2d08544fbe4fa'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:31.586049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-85ba1acd-dae1-46cc-a1bf-450ac0adca5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec9141840e04504b2f2d08544fbe4fa'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:31.590313 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1975/3940] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:31.591420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b48c4-9b17-4d76-a50d-9572ec3d1858 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:31.606625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b48c4-9b17-4d76-a50d-9572ec3d1858 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:31.614265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-85ba1acd-dae1-46cc-a1bf-450ac0adca5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec9141840e04504b2f2d08544fbe4fa'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:31.615507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-85ba1acd-dae1-46cc-a1bf-450ac0adca5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec9141840e04504b2f2d08544fbe4fa'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:31.617242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051ec55-ff45-4e3a-8c02-0137439c032d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:31.617885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051ec55-ff45-4e3a-8c02-0137439c032d admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:31.618253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051ec55-ff45-4e3a-8c02-0137439c032d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:31.618457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051ec55-ff45-4e3a-8c02-0137439c032d admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:31.619235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051ec55-ff45-4e3a-8c02-0137439c032d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:14:31.619605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051ec55-ff45-4e3a-8c02-0137439c032d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:31.621870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051ec55-ff45-4e3a-8c02-0137439c032d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:31.647052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-85ba1acd-dae1-46cc-a1bf-450ac0adca5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec9141840e04504b2f2d08544fbe4fa'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:31.657687 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1976/3941] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:14:31.658719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051ec55-ff45-4e3a-8c02-0137439c032d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:31.666955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5051ec55-ff45-4e3a-8c02-0137439c032d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:31.684898 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1966/3942] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:14:31 2022] DELETE /identity/v3/users/5ec9141840e04504b2f2d08544fbe4fa => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:31.690942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051ec55-ff45-4e3a-8c02-0137439c032d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:31.832230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03fa4e-9bc6-43d9-99e2-425fa6fbf909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:31.832893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03fa4e-9bc6-43d9-99e2-425fa6fbf909 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:31.833181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03fa4e-9bc6-43d9-99e2-425fa6fbf909 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:31.833465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03fa4e-9bc6-43d9-99e2-425fa6fbf909 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:31.834272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03fa4e-9bc6-43d9-99e2-425fa6fbf909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:31.838211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03fa4e-9bc6-43d9-99e2-425fa6fbf909 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:31.926495 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1977/3943] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:14:31 2022] POST /identity/v3/projects => generated 371 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:14:31.927690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba1acd-dae1-46cc-a1bf-450ac0adca5a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:31.945739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba1acd-dae1-46cc-a1bf-450ac0adca5a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:31.996397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:32.049332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e41a4-9602-4ec0-b5e8-1aba7f7ef91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:32.051307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e41a4-9602-4ec0-b5e8-1aba7f7ef91a admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:32.051836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e41a4-9602-4ec0-b5e8-1aba7f7ef91a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:32.053280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e41a4-9602-4ec0-b5e8-1aba7f7ef91a admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:32.054270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e41a4-9602-4ec0-b5e8-1aba7f7ef91a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:32.057206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e41a4-9602-4ec0-b5e8-1aba7f7ef91a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:32.108892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03fa4e-9bc6-43d9-99e2-425fa6fbf909 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:32.109923 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1967/3944] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:14:31 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:32.127014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03fa4e-9bc6-43d9-99e2-425fa6fbf909 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:32.143608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c160d-d3ff-4cdc-ab93-fafa76d48d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:32.144382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c160d-d3ff-4cdc-ab93-fafa76d48d32 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:32.145220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c160d-d3ff-4cdc-ab93-fafa76d48d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:32.145220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c160d-d3ff-4cdc-ab93-fafa76d48d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:32.145796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c160d-d3ff-4cdc-ab93-fafa76d48d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:32.147582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c160d-d3ff-4cdc-ab93-fafa76d48d32 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:32.176462 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1978/3945] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:32.178549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e41a4-9602-4ec0-b5e8-1aba7f7ef91a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:32.234646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e41a4-9602-4ec0-b5e8-1aba7f7ef91a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:32.246488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f20447-7426-4140-86f6-18b9cb339fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:32.247164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f20447-7426-4140-86f6-18b9cb339fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:32.247427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f20447-7426-4140-86f6-18b9cb339fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:32.247734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f20447-7426-4140-86f6-18b9cb339fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:32.248508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f20447-7426-4140-86f6-18b9cb339fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:32.250083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f20447-7426-4140-86f6-18b9cb339fa8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:32.289371 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1968/3946] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:32.290904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c160d-d3ff-4cdc-ab93-fafa76d48d32 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:32.304678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:32.308800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c160d-d3ff-4cdc-ab93-fafa76d48d32 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:32.327634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef376209-d5e6-4279-97e7-be5a00bb0c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:32.328591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef376209-d5e6-4279-97e7-be5a00bb0c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:32.329099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef376209-d5e6-4279-97e7-be5a00bb0c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:32.329607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef376209-d5e6-4279-97e7-be5a00bb0c98 admin admin] PATH_INFO: `/v3/projects/ec9cf72add9f4d0d8fa2652095636289/users/682921a9a9374c90be43ebe98669fb95/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:32.388287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef376209-d5e6-4279-97e7-be5a00bb0c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9cf72add9f4d0d8fa2652095636289, user_id=682921a9a9374c90be43ebe98669fb95, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:32.392941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef376209-d5e6-4279-97e7-be5a00bb0c98 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:32.435058 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1979/3947] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:14:32 2022] PUT /identity/v3/projects/ec9cf72add9f4d0d8fa2652095636289/users/682921a9a9374c90be43ebe98669fb95/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:32.441873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55874453-24e8-4422-b4be-efe15257251b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:32.442312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55874453-24e8-4422-b4be-efe15257251b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:32.442690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55874453-24e8-4422-b4be-efe15257251b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:32.525841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-55874453-24e8-4422-b4be-efe15257251b None None] MFA Rules not processed for user `682921a9a9374c90be43ebe98669fb95`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:32.527911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-55874453-24e8-4422-b4be-efe15257251b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:32.689188 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1969/3948] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:32.701543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c320a-6b31-4e28-8ebd-7f09621047ee None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:32.702423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c320a-6b31-4e28-8ebd-7f09621047ee None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:32.702729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c320a-6b31-4e28-8ebd-7f09621047ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:32.761888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a52c320a-6b31-4e28-8ebd-7f09621047ee None None] MFA Rules not processed for user `682921a9a9374c90be43ebe98669fb95`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:32.763174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a52c320a-6b31-4e28-8ebd-7f09621047ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:32.803147 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1980/3949] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:33.134179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55874453-24e8-4422-b4be-efe15257251b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:33.136718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-55874453-24e8-4422-b4be-efe15257251b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:33.210421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c320a-6b31-4e28-8ebd-7f09621047ee None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:33.224043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a52c320a-6b31-4e28-8ebd-7f09621047ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:33.406065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55874453-24e8-4422-b4be-efe15257251b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:33.416666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4dc92b-890f-4c20-a453-f23f72903589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:33.420057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dc92b-890f-4c20-a453-f23f72903589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:33.420057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dc92b-890f-4c20-a453-f23f72903589 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:33.421520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dc92b-890f-4c20-a453-f23f72903589 admin admin] PATH_INFO: `/v3/projects/de92556f0d2e4e3da8e6cfc068b62eb6` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:33.429166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4dc92b-890f-4c20-a453-f23f72903589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de92556f0d2e4e3da8e6cfc068b62eb6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:33.432629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4dc92b-890f-4c20-a453-f23f72903589 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:33.434593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c320a-6b31-4e28-8ebd-7f09621047ee None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:33.451841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a96141-899d-4b03-a1f0-783ddf98f828 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:33.452679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a96141-899d-4b03-a1f0-783ddf98f828 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:33.452942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a96141-899d-4b03-a1f0-783ddf98f828 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:33.453205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a96141-899d-4b03-a1f0-783ddf98f828 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:33.473595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a96141-899d-4b03-a1f0-783ddf98f828 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:33.473595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a96141-899d-4b03-a1f0-783ddf98f828 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:33.499762 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1981/3950] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:14:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:14:33.529589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:33.535009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1b4dc92b-890f-4c20-a453-f23f72903589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de92556f0d2e4e3da8e6cfc068b62eb6', 'request_id': 'req-1b4dc92b-890f-4c20-a453-f23f72903589'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:33.556747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1b4dc92b-890f-4c20-a453-f23f72903589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de92556f0d2e4e3da8e6cfc068b62eb6', 'request_id': 'req-1b4dc92b-890f-4c20-a453-f23f72903589'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:33.569173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1b4dc92b-890f-4c20-a453-f23f72903589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de92556f0d2e4e3da8e6cfc068b62eb6', 'request_id': 'req-1b4dc92b-890f-4c20-a453-f23f72903589'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:33.599971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1b4dc92b-890f-4c20-a453-f23f72903589 admin admin] The token cache is being invalidate because project de92556f0d2e4e3da8e6cfc068b62eb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:14:33.600367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1b4dc92b-890f-4c20-a453-f23f72903589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:33.601182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1b4dc92b-890f-4c20-a453-f23f72903589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:33.609592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8654d-39d5-4c90-a5ef-e6310658548c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:33.610172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8654d-39d5-4c90-a5ef-e6310658548c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:33.610647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8654d-39d5-4c90-a5ef-e6310658548c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:33.614528 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1970/3951] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:14:33 2022] DELETE /identity/v3/projects/de92556f0d2e4e3da8e6cfc068b62eb6 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:33.652859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-87a8654d-39d5-4c90-a5ef-e6310658548c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:33.666311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-87a8654d-39d5-4c90-a5ef-e6310658548c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:33.821347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd5e13-b8ee-4bee-b0ff-8e4a74544c6f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:33.822333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd5e13-b8ee-4bee-b0ff-8e4a74544c6f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:33.822731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd5e13-b8ee-4bee-b0ff-8e4a74544c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:33.833515 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1982/3952] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:33.869420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-78fd5e13-b8ee-4bee-b0ff-8e4a74544c6f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:33.874413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-78fd5e13-b8ee-4bee-b0ff-8e4a74544c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:33.916484 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1971/3953] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:33.921239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8654d-39d5-4c90-a5ef-e6310658548c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:33.937971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8654d-39d5-4c90-a5ef-e6310658548c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:33.954839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ae4f1-afe4-4be1-ac95-ce691d87aa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:33.955850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ae4f1-afe4-4be1-ac95-ce691d87aa26 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:33.956376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ae4f1-afe4-4be1-ac95-ce691d87aa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:33.957057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ae4f1-afe4-4be1-ac95-ce691d87aa26 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:33.958269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ae4f1-afe4-4be1-ac95-ce691d87aa26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:14:33.958790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ae4f1-afe4-4be1-ac95-ce691d87aa26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:33.961144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ae4f1-afe4-4be1-ac95-ce691d87aa26 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:34.018980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd5e13-b8ee-4bee-b0ff-8e4a74544c6f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:34.027379 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1983/3954] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:14:34.035179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd5e13-b8ee-4bee-b0ff-8e4a74544c6f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:34.050746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629c695-846f-4b54-aa1a-c67d8d4ee2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:34.052041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629c695-846f-4b54-aa1a-c67d8d4ee2db admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:34.052361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629c695-846f-4b54-aa1a-c67d8d4ee2db admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:34.052644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629c695-846f-4b54-aa1a-c67d8d4ee2db admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:34.053335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629c695-846f-4b54-aa1a-c67d8d4ee2db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:34.055273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629c695-846f-4b54-aa1a-c67d8d4ee2db admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:34.106756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ae4f1-afe4-4be1-ac95-ce691d87aa26 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:34.117793 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1972/3955] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:14:34 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:14:34.129741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ae4f1-afe4-4be1-ac95-ce691d87aa26 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:34.315894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:34.343776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659234e5-582e-4946-8948-82cdd201daa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:34.344589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659234e5-582e-4946-8948-82cdd201daa6 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:34.345672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659234e5-582e-4946-8948-82cdd201daa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:34.345955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659234e5-582e-4946-8948-82cdd201daa6 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:34.346638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659234e5-582e-4946-8948-82cdd201daa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:34.349404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659234e5-582e-4946-8948-82cdd201daa6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:34.403494 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1984/3956] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:14:34 2022] POST /identity/v3/users => generated 289 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:34.407015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629c695-846f-4b54-aa1a-c67d8d4ee2db admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:34.430582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629c695-846f-4b54-aa1a-c67d8d4ee2db admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:34.448791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dbab2-1b0c-454f-8c89-92911d6419fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:34.449458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dbab2-1b0c-454f-8c89-92911d6419fc admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:34.449812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dbab2-1b0c-454f-8c89-92911d6419fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:34.450093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dbab2-1b0c-454f-8c89-92911d6419fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:34.450831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9dbab2-1b0c-454f-8c89-92911d6419fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:34.453125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9dbab2-1b0c-454f-8c89-92911d6419fc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:34.480463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659234e5-582e-4946-8948-82cdd201daa6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:34.482293 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1973/3957] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:34.509939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659234e5-582e-4946-8948-82cdd201daa6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:34.528283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267483af-a920-4e70-b2c6-e635bfe23dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:34.529240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267483af-a920-4e70-b2c6-e635bfe23dac admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:34.529777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267483af-a920-4e70-b2c6-e635bfe23dac admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:34.530902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267483af-a920-4e70-b2c6-e635bfe23dac admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:34.531776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267483af-a920-4e70-b2c6-e635bfe23dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:34.534884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267483af-a920-4e70-b2c6-e635bfe23dac admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:34.549932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e15d7-9750-4e47-9241-a925c2614619 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:34.550396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e15d7-9750-4e47-9241-a925c2614619 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:34.550786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e15d7-9750-4e47-9241-a925c2614619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:34.561788 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1985/3958] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:34.567052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267483af-a920-4e70-b2c6-e635bfe23dac admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:34.589131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267483af-a920-4e70-b2c6-e635bfe23dac admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:34.598972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4c6e15d7-9750-4e47-9241-a925c2614619 None None] MFA Rules not processed for user `682921a9a9374c90be43ebe98669fb95`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:34.600674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4c6e15d7-9750-4e47-9241-a925c2614619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:34.605563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08733e70-5262-4fb8-ac8c-a4bca5624a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:34.606435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08733e70-5262-4fb8-ac8c-a4bca5624a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:34.606820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08733e70-5262-4fb8-ac8c-a4bca5624a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:34.607201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08733e70-5262-4fb8-ac8c-a4bca5624a3d admin admin] PATH_INFO: `/v3/projects/f24d6093793e4533b46965099d2c031c/users/de15d213132648dcba912457e67c1c7f/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:34.644568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08733e70-5262-4fb8-ac8c-a4bca5624a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f24d6093793e4533b46965099d2c031c, user_id=de15d213132648dcba912457e67c1c7f, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:34.650169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08733e70-5262-4fb8-ac8c-a4bca5624a3d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:34.692652 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1986/3959] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:14:34 2022] PUT /identity/v3/projects/f24d6093793e4533b46965099d2c031c/users/de15d213132648dcba912457e67c1c7f/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:34.693665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7067d5-1278-4d94-bff0-39863f76d28d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:34.694095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7067d5-1278-4d94-bff0-39863f76d28d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:34.694478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7067d5-1278-4d94-bff0-39863f76d28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:34.764119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9f7067d5-1278-4d94-bff0-39863f76d28d None None] MFA Rules not processed for user `de15d213132648dcba912457e67c1c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:34.767510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9f7067d5-1278-4d94-bff0-39863f76d28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:34.789589 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1974/3960] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:14:34.978270 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1987/3961] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:34.979272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e15d7-9750-4e47-9241-a925c2614619 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:35.018551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e15d7-9750-4e47-9241-a925c2614619 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:35.236079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343bd72-18b0-4259-acfe-a95e336e94de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:35.239194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343bd72-18b0-4259-acfe-a95e336e94de admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:35.243033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343bd72-18b0-4259-acfe-a95e336e94de admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:35.243625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343bd72-18b0-4259-acfe-a95e336e94de admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:35.244980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343bd72-18b0-4259-acfe-a95e336e94de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:35.257098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343bd72-18b0-4259-acfe-a95e336e94de admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:35.335623 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1975/3962] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:14:34 2022] POST /identity/v3/projects => generated 377 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:35.339522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7067d5-1278-4d94-bff0-39863f76d28d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:35.384983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7067d5-1278-4d94-bff0-39863f76d28d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:35.629861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ac9fe-984a-4a89-8c73-b72d20dd32f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:35.629861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ac9fe-984a-4a89-8c73-b72d20dd32f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:35.629861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ac9fe-984a-4a89-8c73-b72d20dd32f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:35.630768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ac9fe-984a-4a89-8c73-b72d20dd32f9 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:35.637380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ac9fe-984a-4a89-8c73-b72d20dd32f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:35.640127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ac9fe-984a-4a89-8c73-b72d20dd32f9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:35.692667 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1988/3963] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:14:35 2022] POST /identity/v3/users => generated 295 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:35.694041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343bd72-18b0-4259-acfe-a95e336e94de admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:35.712979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343bd72-18b0-4259-acfe-a95e336e94de admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:35.728319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddce5f0-79d6-4787-aeb2-d7dcdc4037c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:35.734252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddce5f0-79d6-4787-aeb2-d7dcdc4037c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:35.734484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddce5f0-79d6-4787-aeb2-d7dcdc4037c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:35.734761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddce5f0-79d6-4787-aeb2-d7dcdc4037c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:35.741479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddce5f0-79d6-4787-aeb2-d7dcdc4037c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:35.746098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddce5f0-79d6-4787-aeb2-d7dcdc4037c2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:35.801094 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1976/3964] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:35.802654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ac9fe-984a-4a89-8c73-b72d20dd32f9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:35.818918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ac9fe-984a-4a89-8c73-b72d20dd32f9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:35.832130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582c574-4686-4225-b717-c552a6a5f4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:35.834051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582c574-4686-4225-b717-c552a6a5f4c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:35.834477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582c574-4686-4225-b717-c552a6a5f4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:35.834820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582c574-4686-4225-b717-c552a6a5f4c4 admin admin] PATH_INFO: `/v3/projects/c1da0c46681f469abd74778a814c13fa/users/4e38931b44a7479fbe9e17dce2269e73/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:35.871973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582c574-4686-4225-b717-c552a6a5f4c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1da0c46681f469abd74778a814c13fa, user_id=4e38931b44a7479fbe9e17dce2269e73, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:35.875778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582c574-4686-4225-b717-c552a6a5f4c4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:35.880043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:35.915680 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1989/3965] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:14:35 2022] PUT /identity/v3/projects/c1da0c46681f469abd74778a814c13fa/users/4e38931b44a7479fbe9e17dce2269e73/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:35.920310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddce5f0-79d6-4787-aeb2-d7dcdc4037c2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:35.947449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddce5f0-79d6-4787-aeb2-d7dcdc4037c2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:35.977714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:36.177715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa668d6-7b40-4daf-bbbd-8e01599f60b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:36.178644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa668d6-7b40-4daf-bbbd-8e01599f60b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:36.179126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa668d6-7b40-4daf-bbbd-8e01599f60b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:36.179642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa668d6-7b40-4daf-bbbd-8e01599f60b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:36.180535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa668d6-7b40-4daf-bbbd-8e01599f60b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:36.183668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa668d6-7b40-4daf-bbbd-8e01599f60b5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:36.206417 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1977/3966] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:36.211006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582c574-4686-4225-b717-c552a6a5f4c4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:36.230108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582c574-4686-4225-b717-c552a6a5f4c4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:36.245852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3a4d4-ff6c-4ea4-adb9-cb677677bce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:36.246559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3a4d4-ff6c-4ea4-adb9-cb677677bce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:36.246979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3a4d4-ff6c-4ea4-adb9-cb677677bce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:36.247267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3a4d4-ff6c-4ea4-adb9-cb677677bce5 admin admin] PATH_INFO: `/v3/projects/c1da0c46681f469abd74778a814c13fa/users/4e38931b44a7479fbe9e17dce2269e73/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:36.254468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3a4d4-ff6c-4ea4-adb9-cb677677bce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1da0c46681f469abd74778a814c13fa, user_id=4e38931b44a7479fbe9e17dce2269e73, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:36.259663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3a4d4-ff6c-4ea4-adb9-cb677677bce5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:36.292142 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1990/3967] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:14:36 2022] PUT /identity/v3/projects/c1da0c46681f469abd74778a814c13fa/users/4e38931b44a7479fbe9e17dce2269e73/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:36.302869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ae606-80bf-471f-aa55-107184768eb4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:36.303461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ae606-80bf-471f-aa55-107184768eb4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:36.303901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ae606-80bf-471f-aa55-107184768eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:36.385250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ee2ae606-80bf-471f-aa55-107184768eb4 None None] MFA Rules not processed for user `4e38931b44a7479fbe9e17dce2269e73`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:36.398808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ee2ae606-80bf-471f-aa55-107184768eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:36.637495 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1978/3968] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:36.642606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3a4d4-ff6c-4ea4-adb9-cb677677bce5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:36.660234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3a4d4-ff6c-4ea4-adb9-cb677677bce5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:36.692082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47013c00-f183-438a-a321-dda1a10d5891 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38931b44a7479fbe9e17dce2269e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1da0c46681f469abd74778a814c13fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:36.693029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47013c00-f183-438a-a321-dda1a10d5891 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:36.693516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47013c00-f183-438a-a321-dda1a10d5891 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:36.693979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47013c00-f183-438a-a321-dda1a10d5891 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:36.694968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47013c00-f183-438a-a321-dda1a10d5891 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:36.697036 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-47013c00-f183-438a-a321-dda1a10d5891 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:14:36.697036 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:14:36.697036 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:14:36.698389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47013c00-f183-438a-a321-dda1a10d5891 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:36.742223 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1991/3969] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:14:36 2022] POST /identity/v3/domains => generated 246 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:36.746506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ae606-80bf-471f-aa55-107184768eb4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:36.762196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ae606-80bf-471f-aa55-107184768eb4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:36.946033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ab0de-7b33-439d-9cf1-52dbf6e8128b tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38931b44a7479fbe9e17dce2269e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1da0c46681f469abd74778a814c13fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:36.946851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ab0de-7b33-439d-9cf1-52dbf6e8128b tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:36.947395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ab0de-7b33-439d-9cf1-52dbf6e8128b tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:36.949022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ab0de-7b33-439d-9cf1-52dbf6e8128b tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:36.950859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ab0de-7b33-439d-9cf1-52dbf6e8128b tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:36.954215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ab0de-7b33-439d-9cf1-52dbf6e8128b tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:37.047093 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1979/3970] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:14:36 2022] POST /identity/v3/projects => generated 410 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:37.050964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47013c00-f183-438a-a321-dda1a10d5891 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:37.067368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47013c00-f183-438a-a321-dda1a10d5891 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:37.207742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ab13c-b47b-40da-bc3a-71b3ada8102a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38931b44a7479fbe9e17dce2269e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1da0c46681f469abd74778a814c13fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:37.208666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ab13c-b47b-40da-bc3a-71b3ada8102a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:37.208990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ab13c-b47b-40da-bc3a-71b3ada8102a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:37.209285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ab13c-b47b-40da-bc3a-71b3ada8102a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:37.210208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ab13c-b47b-40da-bc3a-71b3ada8102a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:37.212175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ab13c-b47b-40da-bc3a-71b3ada8102a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:37.308070 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1992/3971] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:14:37 2022] POST /identity/v3/users => generated 347 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:37.309098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ab0de-7b33-439d-9cf1-52dbf6e8128b tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:37.331124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ab0de-7b33-439d-9cf1-52dbf6e8128b tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:37.359149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408a70a-3e8a-4621-a59a-b63a07f3a77c tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38931b44a7479fbe9e17dce2269e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1da0c46681f469abd74778a814c13fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:37.359149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408a70a-3e8a-4621-a59a-b63a07f3a77c tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:37.359149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408a70a-3e8a-4621-a59a-b63a07f3a77c tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:37.359654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408a70a-3e8a-4621-a59a-b63a07f3a77c tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:37.359654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408a70a-3e8a-4621-a59a-b63a07f3a77c tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:37.360841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408a70a-3e8a-4621-a59a-b63a07f3a77c tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:37.379061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:37.402592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ab13c-b47b-40da-bc3a-71b3ada8102a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:37.407633 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1980/3972] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:37.426363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ab13c-b47b-40da-bc3a-71b3ada8102a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:37.447364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910bfa8-f6fe-4b68-b1d1-6ae1f8607a5e tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38931b44a7479fbe9e17dce2269e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1da0c46681f469abd74778a814c13fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:37.452664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910bfa8-f6fe-4b68-b1d1-6ae1f8607a5e tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:37.453082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910bfa8-f6fe-4b68-b1d1-6ae1f8607a5e tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:37.453475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910bfa8-f6fe-4b68-b1d1-6ae1f8607a5e tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] PATH_INFO: `/v3/projects/175df2a319554821a4a06d48f148e8a4/users/d2e1aa3395d94334844d7b2035e10c89/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:37.545348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910bfa8-f6fe-4b68-b1d1-6ae1f8607a5e tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: Authorizing `identity:create_grant(project_id=175df2a319554821a4a06d48f148e8a4, user_id=d2e1aa3395d94334844d7b2035e10c89, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:37.550942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910bfa8-f6fe-4b68-b1d1-6ae1f8607a5e tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:37.587108 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1993/3973] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:14:37 2022] PUT /identity/v3/projects/175df2a319554821a4a06d48f148e8a4/users/d2e1aa3395d94334844d7b2035e10c89/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:14:37.594409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc605ba-d8ee-4320-b6a8-a47564130de9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:37.594698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc605ba-d8ee-4320-b6a8-a47564130de9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:37.594987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc605ba-d8ee-4320-b6a8-a47564130de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:37.861236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1fc605ba-d8ee-4320-b6a8-a47564130de9 None None] MFA Rules not processed for user `d2e1aa3395d94334844d7b2035e10c89`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:37.863262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1fc605ba-d8ee-4320-b6a8-a47564130de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:37.906379 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1981/3974] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:37 2022] POST /identity/v3/auth/tokens => generated 3352 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:37.920106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b1d1a-74ff-4be0-be68-76e4ee45bbce None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:37.921718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b1d1a-74ff-4be0-be68-76e4ee45bbce None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:37.922299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b1d1a-74ff-4be0-be68-76e4ee45bbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:38.005480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c42b1d1a-74ff-4be0-be68-76e4ee45bbce None None] MFA Rules not processed for user `d2e1aa3395d94334844d7b2035e10c89`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:38.007308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c42b1d1a-74ff-4be0-be68-76e4ee45bbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:38.030271 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1994/3975] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:37 2022] POST /identity/v3/auth/tokens => generated 3352 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:38.034855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc605ba-d8ee-4320-b6a8-a47564130de9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:38.046063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc605ba-d8ee-4320-b6a8-a47564130de9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:38.076505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba668a-35e8-43d7-8779-d174dced94c9 tempest-test_project-1118825894 tempest-user-131708803] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2e1aa3395d94334844d7b2035e10c89', 'user_domain_id': '6849980357cb4534b8231990c34344b7', 'system_scope': None, 'project_id': '175df2a319554821a4a06d48f148e8a4', 'project_domain_id': '6849980357cb4534b8231990c34344b7', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:38.077252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba668a-35e8-43d7-8779-d174dced94c9 tempest-test_project-1118825894 tempest-user-131708803] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:38.077544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba668a-35e8-43d7-8779-d174dced94c9 tempest-test_project-1118825894 tempest-user-131708803] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:38.077831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba668a-35e8-43d7-8779-d174dced94c9 tempest-test_project-1118825894 tempest-user-131708803] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:38.101062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba668a-35e8-43d7-8779-d174dced94c9 tempest-test_project-1118825894 tempest-user-131708803] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:38.102262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba668a-35e8-43d7-8779-d174dced94c9 tempest-test_project-1118825894 tempest-user-131708803] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:38.137651 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1982/3976] 10.222.0.17 () {56 vars in 1284 bytes} [Sat Jul 30 21:14:38 2022] GET /identity/v3/auth/tokens => generated 3352 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:14:38.139325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b1d1a-74ff-4be0-be68-76e4ee45bbce None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:38.307767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b1d1a-74ff-4be0-be68-76e4ee45bbce None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:38.314127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c65e40-9e7d-4edf-9ff2-66371ddaf4df tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38931b44a7479fbe9e17dce2269e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1da0c46681f469abd74778a814c13fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:38.315172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c65e40-9e7d-4edf-9ff2-66371ddaf4df tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:38.316098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c65e40-9e7d-4edf-9ff2-66371ddaf4df tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:38.316598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c65e40-9e7d-4edf-9ff2-66371ddaf4df tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] PATH_INFO: `/v3/users/d2e1aa3395d94334844d7b2035e10c89` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:38.318265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c65e40-9e7d-4edf-9ff2-66371ddaf4df tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d2e1aa3395d94334844d7b2035e10c89)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:38.321343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c65e40-9e7d-4edf-9ff2-66371ddaf4df tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:38.409793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:38.446626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a5c65e40-9e7d-4edf-9ff2-66371ddaf4df tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2e1aa3395d94334844d7b2035e10c89'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:38.475871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a5c65e40-9e7d-4edf-9ff2-66371ddaf4df tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2e1aa3395d94334844d7b2035e10c89'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:38.476999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a5c65e40-9e7d-4edf-9ff2-66371ddaf4df tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2e1aa3395d94334844d7b2035e10c89'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:38.487131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a5c65e40-9e7d-4edf-9ff2-66371ddaf4df tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2e1aa3395d94334844d7b2035e10c89'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:38.488071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a5c65e40-9e7d-4edf-9ff2-66371ddaf4df tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2e1aa3395d94334844d7b2035e10c89'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:38.533480 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1995/3977] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:14:38 2022] DELETE /identity/v3/users/d2e1aa3395d94334844d7b2035e10c89 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:38.533804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba668a-35e8-43d7-8779-d174dced94c9 tempest-test_project-1118825894 tempest-user-131708803] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:38.551848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba668a-35e8-43d7-8779-d174dced94c9 tempest-test_project-1118825894 tempest-user-131708803] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:38.687010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159f0a4-c79b-40be-842a-e9479d4f8a28 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38931b44a7479fbe9e17dce2269e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1da0c46681f469abd74778a814c13fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:38.687762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159f0a4-c79b-40be-842a-e9479d4f8a28 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:38.688048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159f0a4-c79b-40be-842a-e9479d4f8a28 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:38.688327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159f0a4-c79b-40be-842a-e9479d4f8a28 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] PATH_INFO: `/v3/projects/175df2a319554821a4a06d48f148e8a4` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:38.689740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159f0a4-c79b-40be-842a-e9479d4f8a28 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: Authorizing `identity:delete_project(project_id=175df2a319554821a4a06d48f148e8a4)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:38.693416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159f0a4-c79b-40be-842a-e9479d4f8a28 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:38.783822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2159f0a4-c79b-40be-842a-e9479d4f8a28 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '175df2a319554821a4a06d48f148e8a4', 'request_id': 'req-2159f0a4-c79b-40be-842a-e9479d4f8a28'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:38.815766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2159f0a4-c79b-40be-842a-e9479d4f8a28 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '175df2a319554821a4a06d48f148e8a4', 'request_id': 'req-2159f0a4-c79b-40be-842a-e9479d4f8a28'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:38.820231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:38.828139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2159f0a4-c79b-40be-842a-e9479d4f8a28 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '175df2a319554821a4a06d48f148e8a4', 'request_id': 'req-2159f0a4-c79b-40be-842a-e9479d4f8a28'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:38.848607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2159f0a4-c79b-40be-842a-e9479d4f8a28 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] The token cache is being invalidate because project 175df2a319554821a4a06d48f148e8a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:14:38.849159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2159f0a4-c79b-40be-842a-e9479d4f8a28 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:38.850167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2159f0a4-c79b-40be-842a-e9479d4f8a28 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:38.856998 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1983/3978] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:14:38 2022] DELETE /identity/v3/projects/175df2a319554821a4a06d48f148e8a4 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:38.863133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c65e40-9e7d-4edf-9ff2-66371ddaf4df tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:38.866425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a5c65e40-9e7d-4edf-9ff2-66371ddaf4df tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:38.890406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c65e40-9e7d-4edf-9ff2-66371ddaf4df tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:39.060467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7dbbad-23fc-4646-971e-5e99560dfb9a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38931b44a7479fbe9e17dce2269e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1da0c46681f469abd74778a814c13fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:39.061719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dbbad-23fc-4646-971e-5e99560dfb9a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:39.062078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dbbad-23fc-4646-971e-5e99560dfb9a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:39.062500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dbbad-23fc-4646-971e-5e99560dfb9a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] PATH_INFO: `/v3/domains/6849980357cb4534b8231990c34344b7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:39.066686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7dbbad-23fc-4646-971e-5e99560dfb9a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6849980357cb4534b8231990c34344b7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:39.067797 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-8e7dbbad-23fc-4646-971e-5e99560dfb9a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:14:39.067797 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:14:39.067797 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:14:39.068718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7dbbad-23fc-4646-971e-5e99560dfb9a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:39.100408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8e7dbbad-23fc-4646-971e-5e99560dfb9a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6849980357cb4534b8231990c34344b7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:39.101251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8e7dbbad-23fc-4646-971e-5e99560dfb9a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6849980357cb4534b8231990c34344b7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:39.181786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8e7dbbad-23fc-4646-971e-5e99560dfb9a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6849980357cb4534b8231990c34344b7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:39.186704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8e7dbbad-23fc-4646-971e-5e99560dfb9a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6849980357cb4534b8231990c34344b7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:39.197418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159f0a4-c79b-40be-842a-e9479d4f8a28 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:39.199019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2159f0a4-c79b-40be-842a-e9479d4f8a28 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:39.199687 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1996/3979] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:14:38 2022] PATCH /identity/v3/domains/6849980357cb4534b8231990c34344b7 => generated 247 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:14:39.233663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159f0a4-c79b-40be-842a-e9479d4f8a28 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:39.416254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47649e-95ba-4783-95a7-89ca16512fc8 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38931b44a7479fbe9e17dce2269e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1da0c46681f469abd74778a814c13fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:39.416976 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47649e-95ba-4783-95a7-89ca16512fc8 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:39.417267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47649e-95ba-4783-95a7-89ca16512fc8 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:39.417563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47649e-95ba-4783-95a7-89ca16512fc8 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] PATH_INFO: `/v3/domains/6849980357cb4534b8231990c34344b7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:39.476626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47649e-95ba-4783-95a7-89ca16512fc8 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6849980357cb4534b8231990c34344b7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:39.479208 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-0c47649e-95ba-4783-95a7-89ca16512fc8 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:14:39.479208 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:14:39.479208 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:14:39.480694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47649e-95ba-4783-95a7-89ca16512fc8 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:39.520445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0c47649e-95ba-4783-95a7-89ca16512fc8 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6849980357cb4534b8231990c34344b7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:39.526966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0c47649e-95ba-4783-95a7-89ca16512fc8 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6849980357cb4534b8231990c34344b7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:39.631737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0c47649e-95ba-4783-95a7-89ca16512fc8 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6849980357cb4534b8231990c34344b7', 'request_id': 'req-0c47649e-95ba-4783-95a7-89ca16512fc8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:39.648616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0c47649e-95ba-4783-95a7-89ca16512fc8 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6849980357cb4534b8231990c34344b7', 'request_id': 'req-0c47649e-95ba-4783-95a7-89ca16512fc8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:39.663118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0c47649e-95ba-4783-95a7-89ca16512fc8 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6849980357cb4534b8231990c34344b7', 'request_id': 'req-0c47649e-95ba-4783-95a7-89ca16512fc8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:39.702702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0c47649e-95ba-4783-95a7-89ca16512fc8 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] The token cache is being invalidate because project 6849980357cb4534b8231990c34344b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:14:39.703023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0c47649e-95ba-4783-95a7-89ca16512fc8 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:39.706557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0c47649e-95ba-4783-95a7-89ca16512fc8 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:39.732308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0c47649e-95ba-4783-95a7-89ca16512fc8 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6849980357cb4534b8231990c34344b7', 'request_id': 'req-0c47649e-95ba-4783-95a7-89ca16512fc8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:39.749076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0c47649e-95ba-4783-95a7-89ca16512fc8 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6849980357cb4534b8231990c34344b7', 'request_id': 'req-0c47649e-95ba-4783-95a7-89ca16512fc8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:39.749906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0c47649e-95ba-4783-95a7-89ca16512fc8 tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6849980357cb4534b8231990c34344b7', 'request_id': 'req-0c47649e-95ba-4783-95a7-89ca16512fc8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:39.760264 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1984/3980] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:14:39 2022] DELETE /identity/v3/domains/6849980357cb4534b8231990c34344b7 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:39.766441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7dbbad-23fc-4646-971e-5e99560dfb9a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:39.767983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8e7dbbad-23fc-4646-971e-5e99560dfb9a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:39.869384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7dbbad-23fc-4646-971e-5e99560dfb9a tempest-TestDefaultProjectId-1371627586 tempest-TestDefaultProjectId-1371627586-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:39.894264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:39.954366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9662d11-c106-4eb4-bf64-5b0e9ff0cae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:39.955619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9662d11-c106-4eb4-bf64-5b0e9ff0cae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:39.956067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9662d11-c106-4eb4-bf64-5b0e9ff0cae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:39.957786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9662d11-c106-4eb4-bf64-5b0e9ff0cae9 admin admin] PATH_INFO: `/v3/users/de15d213132648dcba912457e67c1c7f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:39.960366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9662d11-c106-4eb4-bf64-5b0e9ff0cae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de15d213132648dcba912457e67c1c7f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:39.962693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9662d11-c106-4eb4-bf64-5b0e9ff0cae9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:40.044392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e9662d11-c106-4eb4-bf64-5b0e9ff0cae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de15d213132648dcba912457e67c1c7f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:40.059368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e9662d11-c106-4eb4-bf64-5b0e9ff0cae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de15d213132648dcba912457e67c1c7f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:40.060179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e9662d11-c106-4eb4-bf64-5b0e9ff0cae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de15d213132648dcba912457e67c1c7f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:40.079083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e9662d11-c106-4eb4-bf64-5b0e9ff0cae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de15d213132648dcba912457e67c1c7f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:40.079083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e9662d11-c106-4eb4-bf64-5b0e9ff0cae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de15d213132648dcba912457e67c1c7f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:40.101403 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1997/3981] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:14:39 2022] DELETE /identity/v3/users/de15d213132648dcba912457e67c1c7f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:40.104028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3354c65-c687-40d2-909a-c0449ef6dcf6 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:40.104809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3354c65-c687-40d2-909a-c0449ef6dcf6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:40.105345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3354c65-c687-40d2-909a-c0449ef6dcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:40.137093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e3354c65-c687-40d2-909a-c0449ef6dcf6 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:40.140749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e3354c65-c687-40d2-909a-c0449ef6dcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:40.167615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:40.253144 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1985/3982] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:40.291565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9662d11-c106-4eb4-bf64-5b0e9ff0cae9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:40.293673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e9662d11-c106-4eb4-bf64-5b0e9ff0cae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:40.374749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9662d11-c106-4eb4-bf64-5b0e9ff0cae9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:40.379746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73729b9-b74a-4e76-a2e3-277d756c78f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:40.380627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73729b9-b74a-4e76-a2e3-277d756c78f8 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:40.381129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73729b9-b74a-4e76-a2e3-277d756c78f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:40.381654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73729b9-b74a-4e76-a2e3-277d756c78f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:40.428680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73729b9-b74a-4e76-a2e3-277d756c78f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:40.437495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73729b9-b74a-4e76-a2e3-277d756c78f8 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:40.500490 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1998/3983] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:14:41.646498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84ce2-4437-4f8a-9044-b908c47e7c3e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:41.646974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84ce2-4437-4f8a-9044-b908c47e7c3e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:41.647070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84ce2-4437-4f8a-9044-b908c47e7c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:41.687714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a0f84ce2-4437-4f8a-9044-b908c47e7c3e None None] MFA Rules not processed for user `b839893e78134428a3cf451901129edc`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:41.689229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a0f84ce2-4437-4f8a-9044-b908c47e7c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:41.803968 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1986/3984] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:42.316802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73729b9-b74a-4e76-a2e3-277d756c78f8 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:42.319685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b73729b9-b74a-4e76-a2e3-277d756c78f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:42.349366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73729b9-b74a-4e76-a2e3-277d756c78f8 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:42.354517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dec71c-df4e-4d3e-94a2-1dbcc3b830f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:42.355455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec71c-df4e-4d3e-94a2-1dbcc3b830f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:42.355949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec71c-df4e-4d3e-94a2-1dbcc3b830f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:42.356429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec71c-df4e-4d3e-94a2-1dbcc3b830f7 admin admin] PATH_INFO: `/v3/projects/f24d6093793e4533b46965099d2c031c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:42.357819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dec71c-df4e-4d3e-94a2-1dbcc3b830f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f24d6093793e4533b46965099d2c031c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:42.360148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dec71c-df4e-4d3e-94a2-1dbcc3b830f7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:42.454608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:42.474377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a2dec71c-df4e-4d3e-94a2-1dbcc3b830f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f24d6093793e4533b46965099d2c031c', 'request_id': 'req-a2dec71c-df4e-4d3e-94a2-1dbcc3b830f7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:42.485386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a2dec71c-df4e-4d3e-94a2-1dbcc3b830f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f24d6093793e4533b46965099d2c031c', 'request_id': 'req-a2dec71c-df4e-4d3e-94a2-1dbcc3b830f7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:42.496557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a2dec71c-df4e-4d3e-94a2-1dbcc3b830f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f24d6093793e4533b46965099d2c031c', 'request_id': 'req-a2dec71c-df4e-4d3e-94a2-1dbcc3b830f7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:42.514775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a2dec71c-df4e-4d3e-94a2-1dbcc3b830f7 admin admin] The token cache is being invalidate because project f24d6093793e4533b46965099d2c031c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:14:42.527851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a2dec71c-df4e-4d3e-94a2-1dbcc3b830f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:42.533044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a2dec71c-df4e-4d3e-94a2-1dbcc3b830f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:42.539579 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 1999/3985] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:14:42 2022] DELETE /identity/v3/projects/f24d6093793e4533b46965099d2c031c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:42.540906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f84ce2-4437-4f8a-9044-b908c47e7c3e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:42.558007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f84ce2-4437-4f8a-9044-b908c47e7c3e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:42.702780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dec71c-df4e-4d3e-94a2-1dbcc3b830f7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:42.704711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a2dec71c-df4e-4d3e-94a2-1dbcc3b830f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:42.729926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ec686-77b3-4257-9048-d6b2d107397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:42.733358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ec686-77b3-4257-9048-d6b2d107397c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:42.734660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ec686-77b3-4257-9048-d6b2d107397c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:42.735048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ec686-77b3-4257-9048-d6b2d107397c admin admin] PATH_INFO: `/v3/users/4e38931b44a7479fbe9e17dce2269e73` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:42.738946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ec686-77b3-4257-9048-d6b2d107397c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e38931b44a7479fbe9e17dce2269e73)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:42.745753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ec686-77b3-4257-9048-d6b2d107397c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:42.832654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dec71c-df4e-4d3e-94a2-1dbcc3b830f7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:42.841552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a81ee-354d-4c98-a54c-1b15aa51a0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:42.842429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a81ee-354d-4c98-a54c-1b15aa51a0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:42.842723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a81ee-354d-4c98-a54c-1b15aa51a0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:42.843009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a81ee-354d-4c98-a54c-1b15aa51a0a6 admin admin] PATH_INFO: `/v3/users/8b930b074300497fa17ae36dc074c586` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:42.844304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a81ee-354d-4c98-a54c-1b15aa51a0a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b930b074300497fa17ae36dc074c586)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:42.848331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a81ee-354d-4c98-a54c-1b15aa51a0a6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:42.856047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ba7ec686-77b3-4257-9048-d6b2d107397c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e38931b44a7479fbe9e17dce2269e73'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:42.862103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ba7ec686-77b3-4257-9048-d6b2d107397c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e38931b44a7479fbe9e17dce2269e73'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:42.897931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ba7ec686-77b3-4257-9048-d6b2d107397c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e38931b44a7479fbe9e17dce2269e73'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:42.899641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ba7ec686-77b3-4257-9048-d6b2d107397c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e38931b44a7479fbe9e17dce2269e73'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:42.906944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:42.919477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ba7ec686-77b3-4257-9048-d6b2d107397c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e38931b44a7479fbe9e17dce2269e73'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:42.977745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bb3a81ee-354d-4c98-a54c-1b15aa51a0a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b930b074300497fa17ae36dc074c586'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:42.996306 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1987/3986] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:14:42 2022] DELETE /identity/v3/users/4e38931b44a7479fbe9e17dce2269e73 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:43.030787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bb3a81ee-354d-4c98-a54c-1b15aa51a0a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b930b074300497fa17ae36dc074c586'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:43.033834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bb3a81ee-354d-4c98-a54c-1b15aa51a0a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b930b074300497fa17ae36dc074c586'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:43.084044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bb3a81ee-354d-4c98-a54c-1b15aa51a0a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b930b074300497fa17ae36dc074c586'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:43.086837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bb3a81ee-354d-4c98-a54c-1b15aa51a0a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b930b074300497fa17ae36dc074c586'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:43.126466 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2000/3987] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:14:42 2022] DELETE /identity/v3/users/8b930b074300497fa17ae36dc074c586 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:43.801449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ec686-77b3-4257-9048-d6b2d107397c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:43.803682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ba7ec686-77b3-4257-9048-d6b2d107397c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:43.986558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ec686-77b3-4257-9048-d6b2d107397c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:44.121084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7d877-faac-4fac-843c-c25d9cac1a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:44.121893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7d877-faac-4fac-843c-c25d9cac1a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:44.122424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7d877-faac-4fac-843c-c25d9cac1a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:44.122807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7d877-faac-4fac-843c-c25d9cac1a72 admin admin] PATH_INFO: `/v3/projects/aef0a07428164b708be97eebe5547697` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:44.124827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7d877-faac-4fac-843c-c25d9cac1a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aef0a07428164b708be97eebe5547697)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:44.127009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7d877-faac-4fac-843c-c25d9cac1a72 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:44.239039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2d7d877-faac-4fac-843c-c25d9cac1a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aef0a07428164b708be97eebe5547697', 'request_id': 'req-c2d7d877-faac-4fac-843c-c25d9cac1a72'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:44.258348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2d7d877-faac-4fac-843c-c25d9cac1a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aef0a07428164b708be97eebe5547697', 'request_id': 'req-c2d7d877-faac-4fac-843c-c25d9cac1a72'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:44.269479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2d7d877-faac-4fac-843c-c25d9cac1a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aef0a07428164b708be97eebe5547697', 'request_id': 'req-c2d7d877-faac-4fac-843c-c25d9cac1a72'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:44.278622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a81ee-354d-4c98-a54c-1b15aa51a0a6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:44.280712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bb3a81ee-354d-4c98-a54c-1b15aa51a0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:44.298163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2d7d877-faac-4fac-843c-c25d9cac1a72 admin admin] The token cache is being invalidate because project aef0a07428164b708be97eebe5547697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:14:44.299416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2d7d877-faac-4fac-843c-c25d9cac1a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:44.302586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2d7d877-faac-4fac-843c-c25d9cac1a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:44.309779 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1988/3988] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:14:43 2022] DELETE /identity/v3/projects/aef0a07428164b708be97eebe5547697 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:44.313938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec8b37-7d46-48e3-bcf1-8876a8c05625 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:44.314247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec8b37-7d46-48e3-bcf1-8876a8c05625 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:44.314492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec8b37-7d46-48e3-bcf1-8876a8c05625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:44.326660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a81ee-354d-4c98-a54c-1b15aa51a0a6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:44.378534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-73ec8b37-7d46-48e3-bcf1-8876a8c05625 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:44.379901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-73ec8b37-7d46-48e3-bcf1-8876a8c05625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:44.409398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:44.445876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:44.478730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d655a-e7fa-4a93-af8e-36e6314e1c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:44.479587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d655a-e7fa-4a93-af8e-36e6314e1c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:44.480033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d655a-e7fa-4a93-af8e-36e6314e1c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:44.480412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d655a-e7fa-4a93-af8e-36e6314e1c13 admin admin] PATH_INFO: `/v3/projects/c1da0c46681f469abd74778a814c13fa` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:44.488918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d655a-e7fa-4a93-af8e-36e6314e1c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1da0c46681f469abd74778a814c13fa)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:44.497549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d655a-e7fa-4a93-af8e-36e6314e1c13 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:44.584699 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1989/3989] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:44.586363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7c4b8-e7de-406d-ae80-01ff82bd7f04 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:44.586692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7c4b8-e7de-406d-ae80-01ff82bd7f04 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:44.587329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7c4b8-e7de-406d-ae80-01ff82bd7f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:44.645867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cd8d655a-e7fa-4a93-af8e-36e6314e1c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1da0c46681f469abd74778a814c13fa', 'request_id': 'req-cd8d655a-e7fa-4a93-af8e-36e6314e1c13'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:44.659123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c1c7c4b8-e7de-406d-ae80-01ff82bd7f04 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:44.660292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c1c7c4b8-e7de-406d-ae80-01ff82bd7f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:44.662381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cd8d655a-e7fa-4a93-af8e-36e6314e1c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1da0c46681f469abd74778a814c13fa', 'request_id': 'req-cd8d655a-e7fa-4a93-af8e-36e6314e1c13'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:44.688953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cd8d655a-e7fa-4a93-af8e-36e6314e1c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1da0c46681f469abd74778a814c13fa', 'request_id': 'req-cd8d655a-e7fa-4a93-af8e-36e6314e1c13'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:44.729259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cd8d655a-e7fa-4a93-af8e-36e6314e1c13 admin admin] The token cache is being invalidate because project c1da0c46681f469abd74778a814c13fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:14:44.729569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cd8d655a-e7fa-4a93-af8e-36e6314e1c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:44.733863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cd8d655a-e7fa-4a93-af8e-36e6314e1c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:44.743747 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2001/3990] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:14:44 2022] DELETE /identity/v3/projects/c1da0c46681f469abd74778a814c13fa => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:44.748203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f8a41-4e3c-4acd-bef0-83f86d7bc2b3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:44.748555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f8a41-4e3c-4acd-bef0-83f86d7bc2b3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:44.748835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f8a41-4e3c-4acd-bef0-83f86d7bc2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:44.773292 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1990/3991] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:44.779753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7c4b8-e7de-406d-ae80-01ff82bd7f04 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:44.791143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7c4b8-e7de-406d-ae80-01ff82bd7f04 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:44.791386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0e9f8a41-4e3c-4acd-bef0-83f86d7bc2b3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:44.792577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0e9f8a41-4e3c-4acd-bef0-83f86d7bc2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:44.795858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6fa34-501e-45ba-8ac3-4e5a1c25e682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:44.796437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6fa34-501e-45ba-8ac3-4e5a1c25e682 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:44.796717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6fa34-501e-45ba-8ac3-4e5a1c25e682 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:44.796982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6fa34-501e-45ba-8ac3-4e5a1c25e682 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:44.798202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6fa34-501e-45ba-8ac3-4e5a1c25e682 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:14:44.798516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6fa34-501e-45ba-8ac3-4e5a1c25e682 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:44.803267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6fa34-501e-45ba-8ac3-4e5a1c25e682 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:44.820750 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2002/3992] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:14:44.853346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1974d0-f46b-4b1c-8ef6-857c7be5ea71 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:44.853748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1974d0-f46b-4b1c-8ef6-857c7be5ea71 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:44.854642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1974d0-f46b-4b1c-8ef6-857c7be5ea71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:44.880988 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1991/3993] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:14:44.887147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6fa34-501e-45ba-8ac3-4e5a1c25e682 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:44.891278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3a1974d0-f46b-4b1c-8ef6-857c7be5ea71 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:44.894429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3a1974d0-f46b-4b1c-8ef6-857c7be5ea71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:44.908867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6fa34-501e-45ba-8ac3-4e5a1c25e682 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:44.914601 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2003/3994] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:14:44.917402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ff1c1-73be-4e5d-8201-e784adf04303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:44.917951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ff1c1-73be-4e5d-8201-e784adf04303 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:44.919241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1974d0-f46b-4b1c-8ef6-857c7be5ea71 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:44.921662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ff1c1-73be-4e5d-8201-e784adf04303 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:44.923600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ff1c1-73be-4e5d-8201-e784adf04303 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:44.924370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ff1c1-73be-4e5d-8201-e784adf04303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:44.926308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ff1c1-73be-4e5d-8201-e784adf04303 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:44.941337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1974d0-f46b-4b1c-8ef6-857c7be5ea71 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:44.949140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120230d-d51a-4ecf-a4c7-1f80b58f2523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:44.949929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120230d-d51a-4ecf-a4c7-1f80b58f2523 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:44.950432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120230d-d51a-4ecf-a4c7-1f80b58f2523 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:44.950962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120230d-d51a-4ecf-a4c7-1f80b58f2523 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:44.953511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120230d-d51a-4ecf-a4c7-1f80b58f2523 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:14:44.953927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120230d-d51a-4ecf-a4c7-1f80b58f2523 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:44.957321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120230d-d51a-4ecf-a4c7-1f80b58f2523 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:44.970461 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1992/3995] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:14:44 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:44.974719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ff1c1-73be-4e5d-8201-e784adf04303 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:44.984574 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2004/3996] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:14:44.989206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120230d-d51a-4ecf-a4c7-1f80b58f2523 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:45.013467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120230d-d51a-4ecf-a4c7-1f80b58f2523 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:45.111112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ff1c1-73be-4e5d-8201-e784adf04303 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:45.116874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd30b8-1e17-4c65-91d5-057740ab2616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:45.117500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd30b8-1e17-4c65-91d5-057740ab2616 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:45.117799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd30b8-1e17-4c65-91d5-057740ab2616 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:45.118064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd30b8-1e17-4c65-91d5-057740ab2616 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:45.118882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd30b8-1e17-4c65-91d5-057740ab2616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:45.122231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd30b8-1e17-4c65-91d5-057740ab2616 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:45.142174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a35489-bcce-4dd4-b558-84c0a1d212cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:45.143709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a35489-bcce-4dd4-b558-84c0a1d212cd admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:45.143709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a35489-bcce-4dd4-b558-84c0a1d212cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:45.143958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a35489-bcce-4dd4-b558-84c0a1d212cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:45.144770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a35489-bcce-4dd4-b558-84c0a1d212cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:45.146959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a35489-bcce-4dd4-b558-84c0a1d212cd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:45.155202 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1993/3997] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:14:44 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:45.156009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd30b8-1e17-4c65-91d5-057740ab2616 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:45.172037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd30b8-1e17-4c65-91d5-057740ab2616 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:45.181185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14246026-9ad6-4ca9-9c9c-76636088468b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:45.182208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14246026-9ad6-4ca9-9c9c-76636088468b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:45.182208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14246026-9ad6-4ca9-9c9c-76636088468b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:45.182411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14246026-9ad6-4ca9-9c9c-76636088468b admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:45.183040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14246026-9ad6-4ca9-9c9c-76636088468b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:45.185529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14246026-9ad6-4ca9-9c9c-76636088468b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:45.214751 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2005/3998] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:14:44 2022] POST /identity/v3/projects => generated 385 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:45.216831 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1994/3999] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:45.221375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a35489-bcce-4dd4-b558-84c0a1d212cd admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:45.222743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14246026-9ad6-4ca9-9c9c-76636088468b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:45.241526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14246026-9ad6-4ca9-9c9c-76636088468b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:45.254117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:45.300089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:45.350307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a35489-bcce-4dd4-b558-84c0a1d212cd admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:45.363099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a865af-df32-45cc-b988-9e5f0d2ae152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:45.364975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a865af-df32-45cc-b988-9e5f0d2ae152 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:45.364975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a865af-df32-45cc-b988-9e5f0d2ae152 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:45.364975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a865af-df32-45cc-b988-9e5f0d2ae152 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:45.366433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a865af-df32-45cc-b988-9e5f0d2ae152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:45.368065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a865af-df32-45cc-b988-9e5f0d2ae152 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:45.370331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124f897-6853-4350-8735-3237fae03a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:45.371001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124f897-6853-4350-8735-3237fae03a84 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:45.371122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124f897-6853-4350-8735-3237fae03a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:45.371823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124f897-6853-4350-8735-3237fae03a84 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:45.372641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124f897-6853-4350-8735-3237fae03a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:45.375142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124f897-6853-4350-8735-3237fae03a84 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:45.406536 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2006/4000] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:45.419315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a865af-df32-45cc-b988-9e5f0d2ae152 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:45.425522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a865af-df32-45cc-b988-9e5f0d2ae152 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:45.433617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b069d-fb6e-4ff5-8912-917dce492907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:45.434455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b069d-fb6e-4ff5-8912-917dce492907 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:45.435247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b069d-fb6e-4ff5-8912-917dce492907 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:45.435676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b069d-fb6e-4ff5-8912-917dce492907 admin admin] PATH_INFO: `/v3/projects/89f89748dd014b50ba710e4a2e82381d/users/28f39af9487e4dee8e84bbbf58a85124/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:45.446035 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1995/4001] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:14:45 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:45.450911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124f897-6853-4350-8735-3237fae03a84 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:45.461468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b069d-fb6e-4ff5-8912-917dce492907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f89748dd014b50ba710e4a2e82381d, user_id=28f39af9487e4dee8e84bbbf58a85124, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:45.464927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b069d-fb6e-4ff5-8912-917dce492907 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:45.475224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124f897-6853-4350-8735-3237fae03a84 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:45.488349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d223b-e170-46ae-be56-8d883d2e6714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:45.489100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d223b-e170-46ae-be56-8d883d2e6714 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:45.489393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d223b-e170-46ae-be56-8d883d2e6714 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:45.489691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d223b-e170-46ae-be56-8d883d2e6714 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:45.490424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d223b-e170-46ae-be56-8d883d2e6714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:45.491597 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2007/4002] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:14:45 2022] PUT /identity/v3/projects/89f89748dd014b50ba710e4a2e82381d/users/28f39af9487e4dee8e84bbbf58a85124/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:45.492673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d223b-e170-46ae-be56-8d883d2e6714 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:45.504892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc449c08-05db-43ef-b8d9-050c7cb25b9a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:45.505312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc449c08-05db-43ef-b8d9-050c7cb25b9a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:45.505510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc449c08-05db-43ef-b8d9-050c7cb25b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:45.525875 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1996/4003] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:45.528349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d223b-e170-46ae-be56-8d883d2e6714 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:45.542977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d223b-e170-46ae-be56-8d883d2e6714 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:45.587734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bc449c08-05db-43ef-b8d9-050c7cb25b9a None None] MFA Rules not processed for user `28f39af9487e4dee8e84bbbf58a85124`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:45.593181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bc449c08-05db-43ef-b8d9-050c7cb25b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:45.627960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b266f-87d7-4910-81dd-6341069165d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:45.628592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b266f-87d7-4910-81dd-6341069165d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:45.629037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b266f-87d7-4910-81dd-6341069165d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:45.629281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b266f-87d7-4910-81dd-6341069165d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:45.630267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b266f-87d7-4910-81dd-6341069165d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:45.631901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b266f-87d7-4910-81dd-6341069165d0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:45.654142 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1997/4004] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:45.656424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b266f-87d7-4910-81dd-6341069165d0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:45.671675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b266f-87d7-4910-81dd-6341069165d0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:45.677829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d3a5f-d6d0-4007-8b32-76d168fda20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:45.678949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d3a5f-d6d0-4007-8b32-76d168fda20d admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:45.679233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d3a5f-d6d0-4007-8b32-76d168fda20d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:45.679545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d3a5f-d6d0-4007-8b32-76d168fda20d admin admin] PATH_INFO: `/v3/projects/a967dc0190fd4e0ba738f6a195881d2a/users/d7821c595c1743a8b51720d9d60eb810/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:45.733765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d3a5f-d6d0-4007-8b32-76d168fda20d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a967dc0190fd4e0ba738f6a195881d2a, user_id=d7821c595c1743a8b51720d9d60eb810, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:45.737600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d3a5f-d6d0-4007-8b32-76d168fda20d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:45.779667 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1998/4005] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:14:45 2022] PUT /identity/v3/projects/a967dc0190fd4e0ba738f6a195881d2a/users/d7821c595c1743a8b51720d9d60eb810/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:45.791183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462ccc6-75fe-40a3-aa9c-89450e10e3f4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:45.791598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462ccc6-75fe-40a3-aa9c-89450e10e3f4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:45.791855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462ccc6-75fe-40a3-aa9c-89450e10e3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:45.823829 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2008/4006] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:45.837172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea524c70-8db1-4668-bd90-a9a40639b72f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:45.837813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea524c70-8db1-4668-bd90-a9a40639b72f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:45.838348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea524c70-8db1-4668-bd90-a9a40639b72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:45.842207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c462ccc6-75fe-40a3-aa9c-89450e10e3f4 None None] MFA Rules not processed for user `d7821c595c1743a8b51720d9d60eb810`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:45.843716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c462ccc6-75fe-40a3-aa9c-89450e10e3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:45.913402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ea524c70-8db1-4668-bd90-a9a40639b72f None None] MFA Rules not processed for user `28f39af9487e4dee8e84bbbf58a85124`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:45.914842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ea524c70-8db1-4668-bd90-a9a40639b72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:45.948399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:45.987967 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 1999/4007] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:45.992347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462ccc6-75fe-40a3-aa9c-89450e10e3f4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:46.039229 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2009/4008] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:46.051036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea524c70-8db1-4668-bd90-a9a40639b72f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:46.057679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ea524c70-8db1-4668-bd90-a9a40639b72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:46.116089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462ccc6-75fe-40a3-aa9c-89450e10e3f4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:46.125053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2edc8c-b935-4929-9379-ee710cc0e1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:46.126056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2edc8c-b935-4929-9379-ee710cc0e1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:46.127852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2edc8c-b935-4929-9379-ee710cc0e1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:46.128351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2edc8c-b935-4929-9379-ee710cc0e1b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:46.130333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2edc8c-b935-4929-9379-ee710cc0e1b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:46.135428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2edc8c-b935-4929-9379-ee710cc0e1b3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:46.170727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:46.193181 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2000/4009] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:14:45 2022] POST /identity/v3/projects => generated 381 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:14:46.195716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2edc8c-b935-4929-9379-ee710cc0e1b3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:46.250063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea524c70-8db1-4668-bd90-a9a40639b72f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:46.300293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2edc8c-b935-4929-9379-ee710cc0e1b3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:46.307183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf6b61-52f4-41b9-b1d0-b9ffdb4c1f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:46.307984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf6b61-52f4-41b9-b1d0-b9ffdb4c1f16 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:46.308938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf6b61-52f4-41b9-b1d0-b9ffdb4c1f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:46.309374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf6b61-52f4-41b9-b1d0-b9ffdb4c1f16 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:46.310178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf6b61-52f4-41b9-b1d0-b9ffdb4c1f16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:46.313613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf6b61-52f4-41b9-b1d0-b9ffdb4c1f16 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:46.348291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aac41d-cfb8-499e-ada0-5eb95daccb22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:46.349350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac41d-cfb8-499e-ada0-5eb95daccb22 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:46.349720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac41d-cfb8-499e-ada0-5eb95daccb22 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:46.350006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac41d-cfb8-499e-ada0-5eb95daccb22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:46.372440 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2001/4010] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:14:46 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:46.377794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf6b61-52f4-41b9-b1d0-b9ffdb4c1f16 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:46.401808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf6b61-52f4-41b9-b1d0-b9ffdb4c1f16 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:46.410621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188e300-5928-4e06-acb6-c41ec3376048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:46.411366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188e300-5928-4e06-acb6-c41ec3376048 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:46.411857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188e300-5928-4e06-acb6-c41ec3376048 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:46.412148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188e300-5928-4e06-acb6-c41ec3376048 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:46.413025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188e300-5928-4e06-acb6-c41ec3376048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:46.414932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188e300-5928-4e06-acb6-c41ec3376048 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:46.431790 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2002/4011] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:46.433006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188e300-5928-4e06-acb6-c41ec3376048 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:46.448837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aac41d-cfb8-499e-ada0-5eb95daccb22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:46.449648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188e300-5928-4e06-acb6-c41ec3376048 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:46.453862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aac41d-cfb8-499e-ada0-5eb95daccb22 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:46.456894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3944a17-00f4-4e18-b379-57a42ec47f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:46.458169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3944a17-00f4-4e18-b379-57a42ec47f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:46.458520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3944a17-00f4-4e18-b379-57a42ec47f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:46.458893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3944a17-00f4-4e18-b379-57a42ec47f8f admin admin] PATH_INFO: `/v3/projects/a5fc8459269f4ce8a8e93606a9a3ebfd/users/c8f237dc1fe445828eec39b31a295a1a/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:46.481342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3944a17-00f4-4e18-b379-57a42ec47f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5fc8459269f4ce8a8e93606a9a3ebfd, user_id=c8f237dc1fe445828eec39b31a295a1a, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:46.485730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3944a17-00f4-4e18-b379-57a42ec47f8f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:46.495493 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2010/4012] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:14:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:14:46.515586 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2003/4013] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:14:46 2022] PUT /identity/v3/projects/a5fc8459269f4ce8a8e93606a9a3ebfd/users/c8f237dc1fe445828eec39b31a295a1a/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:46.519376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aac41d-cfb8-499e-ada0-5eb95daccb22 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:46.535786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aac41d-cfb8-499e-ada0-5eb95daccb22 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:46.630170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4da64-4408-49b7-a56e-f7ed10bbeb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:46.631359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4da64-4408-49b7-a56e-f7ed10bbeb59 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:46.631658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4da64-4408-49b7-a56e-f7ed10bbeb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:46.631949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4da64-4408-49b7-a56e-f7ed10bbeb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:46.632799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4da64-4408-49b7-a56e-f7ed10bbeb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:46.634851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4da64-4408-49b7-a56e-f7ed10bbeb59 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:46.651347 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2011/4014] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:14:46.652511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3944a17-00f4-4e18-b379-57a42ec47f8f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:46.668230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3944a17-00f4-4e18-b379-57a42ec47f8f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:46.679951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7635e-5f1d-455f-868d-128c751ade48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:46.681645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7635e-5f1d-455f-868d-128c751ade48 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:46.682093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7635e-5f1d-455f-868d-128c751ade48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:46.682895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7635e-5f1d-455f-868d-128c751ade48 admin admin] PATH_INFO: `/v3/projects/a5fc8459269f4ce8a8e93606a9a3ebfd/users/c8f237dc1fe445828eec39b31a295a1a/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:46.687636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7635e-5f1d-455f-868d-128c751ade48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5fc8459269f4ce8a8e93606a9a3ebfd, user_id=c8f237dc1fe445828eec39b31a295a1a, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:46.690946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7635e-5f1d-455f-868d-128c751ade48 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:46.719095 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2004/4015] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:14:46 2022] PUT /identity/v3/projects/a5fc8459269f4ce8a8e93606a9a3ebfd/users/c8f237dc1fe445828eec39b31a295a1a/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:46.720028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34ca95-9980-4c1c-9cd7-486ce61f29f6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:46.720329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34ca95-9980-4c1c-9cd7-486ce61f29f6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:46.720643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34ca95-9980-4c1c-9cd7-486ce61f29f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:46.778874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:46.796168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-be34ca95-9980-4c1c-9cd7-486ce61f29f6 None None] MFA Rules not processed for user `c8f237dc1fe445828eec39b31a295a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:46.797585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-be34ca95-9980-4c1c-9cd7-486ce61f29f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:46.960436 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2012/4016] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:46.964576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7635e-5f1d-455f-868d-128c751ade48 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:46.987517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7635e-5f1d-455f-868d-128c751ade48 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:47.027998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315234c0-0374-4ed0-af1b-67d590b002f8 tempest-ProjectsNegativeTestJSON-50194819 tempest-ProjectsNegativeTestJSON-50194819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f237dc1fe445828eec39b31a295a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5fc8459269f4ce8a8e93606a9a3ebfd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:47.028829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315234c0-0374-4ed0-af1b-67d590b002f8 tempest-ProjectsNegativeTestJSON-50194819 tempest-ProjectsNegativeTestJSON-50194819-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:47.029210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315234c0-0374-4ed0-af1b-67d590b002f8 tempest-ProjectsNegativeTestJSON-50194819 tempest-ProjectsNegativeTestJSON-50194819-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:47.029626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315234c0-0374-4ed0-af1b-67d590b002f8 tempest-ProjectsNegativeTestJSON-50194819 tempest-ProjectsNegativeTestJSON-50194819-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:47.030509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315234c0-0374-4ed0-af1b-67d590b002f8 tempest-ProjectsNegativeTestJSON-50194819 tempest-ProjectsNegativeTestJSON-50194819-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:47.035044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315234c0-0374-4ed0-af1b-67d590b002f8 tempest-ProjectsNegativeTestJSON-50194819 tempest-ProjectsNegativeTestJSON-50194819-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:47.080168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:47.118260 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2005/4017] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:14:46 2022] POST /identity/v3/projects => generated 359 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:14:47.123996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34ca95-9980-4c1c-9cd7-486ce61f29f6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:47.309302 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34ca95-9980-4c1c-9cd7-486ce61f29f6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:47.428524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dbc28-5639-4f76-a1e9-7e528e0f9a63 tempest-ProjectsNegativeTestJSON-2140427954 tempest-ProjectsNegativeTestJSON-2140427954-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7821c595c1743a8b51720d9d60eb810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a967dc0190fd4e0ba738f6a195881d2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:47.430272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dbc28-5639-4f76-a1e9-7e528e0f9a63 tempest-ProjectsNegativeTestJSON-2140427954 tempest-ProjectsNegativeTestJSON-2140427954-project] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:47.431030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dbc28-5639-4f76-a1e9-7e528e0f9a63 tempest-ProjectsNegativeTestJSON-2140427954 tempest-ProjectsNegativeTestJSON-2140427954-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:47.433018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dbc28-5639-4f76-a1e9-7e528e0f9a63 tempest-ProjectsNegativeTestJSON-2140427954 tempest-ProjectsNegativeTestJSON-2140427954-project] PATH_INFO: `/v3/projects/abc30cfec44047399158c9aa6ba86ae7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:47.435191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205dbc28-5639-4f76-a1e9-7e528e0f9a63 tempest-ProjectsNegativeTestJSON-2140427954 tempest-ProjectsNegativeTestJSON-2140427954-project] RBAC: Authorizing `identity:delete_project(project_id=abc30cfec44047399158c9aa6ba86ae7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:47.470654 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-205dbc28-5639-4f76-a1e9-7e528e0f9a63 tempest-ProjectsNegativeTestJSON-2140427954 tempest-ProjectsNegativeTestJSON-2140427954-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jul 30 21:14:47.470654 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:14:47.470654 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:14:47.470654 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:14:47.470654 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:14:47.470654 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:14:47.470654 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:14:47.470654 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:14:47.470654 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:14:47.470654 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:14:47.470654 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:14:47.470654 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:14:47.470654 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Jul 30 21:14:47.470654 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 30 21:14:47.471903 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 30 21:14:47.471903 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 30 21:14:47.471903 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 30 21:14:47.471903 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 30 21:14:47.471903 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:14:47.471903 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 30 21:14:47.471903 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jul 30 21:14:47.471903 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:14:47.472462 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2013/4018] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:14:47 2022] DELETE /identity/v3/projects/abc30cfec44047399158c9aa6ba86ae7 => generated 136 bytes in 350 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:14:47.478054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315234c0-0374-4ed0-af1b-67d590b002f8 tempest-ProjectsNegativeTestJSON-50194819 tempest-ProjectsNegativeTestJSON-50194819-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:47.608494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315234c0-0374-4ed0-af1b-67d590b002f8 tempest-ProjectsNegativeTestJSON-50194819 tempest-ProjectsNegativeTestJSON-50194819-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:47.614421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927910d5-34e0-4f8f-83c8-b997e2d64be1 tempest-ProjectsNegativeTestJSON-50194819 tempest-ProjectsNegativeTestJSON-50194819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f237dc1fe445828eec39b31a295a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5fc8459269f4ce8a8e93606a9a3ebfd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:47.615620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927910d5-34e0-4f8f-83c8-b997e2d64be1 tempest-ProjectsNegativeTestJSON-50194819 tempest-ProjectsNegativeTestJSON-50194819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:47.616045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927910d5-34e0-4f8f-83c8-b997e2d64be1 tempest-ProjectsNegativeTestJSON-50194819 tempest-ProjectsNegativeTestJSON-50194819-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:47.616443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927910d5-34e0-4f8f-83c8-b997e2d64be1 tempest-ProjectsNegativeTestJSON-50194819 tempest-ProjectsNegativeTestJSON-50194819-project-admin] PATH_INFO: `/v3/projects/abc30cfec44047399158c9aa6ba86ae7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:47.620239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927910d5-34e0-4f8f-83c8-b997e2d64be1 tempest-ProjectsNegativeTestJSON-50194819 tempest-ProjectsNegativeTestJSON-50194819-project-admin] RBAC: Authorizing `identity:delete_project(project_id=abc30cfec44047399158c9aa6ba86ae7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:47.624209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927910d5-34e0-4f8f-83c8-b997e2d64be1 tempest-ProjectsNegativeTestJSON-50194819 tempest-ProjectsNegativeTestJSON-50194819-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:47.750071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-927910d5-34e0-4f8f-83c8-b997e2d64be1 tempest-ProjectsNegativeTestJSON-50194819 tempest-ProjectsNegativeTestJSON-50194819-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc30cfec44047399158c9aa6ba86ae7', 'request_id': 'req-927910d5-34e0-4f8f-83c8-b997e2d64be1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:47.764765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-927910d5-34e0-4f8f-83c8-b997e2d64be1 tempest-ProjectsNegativeTestJSON-50194819 tempest-ProjectsNegativeTestJSON-50194819-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc30cfec44047399158c9aa6ba86ae7', 'request_id': 'req-927910d5-34e0-4f8f-83c8-b997e2d64be1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:47.778391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-927910d5-34e0-4f8f-83c8-b997e2d64be1 tempest-ProjectsNegativeTestJSON-50194819 tempest-ProjectsNegativeTestJSON-50194819-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc30cfec44047399158c9aa6ba86ae7', 'request_id': 'req-927910d5-34e0-4f8f-83c8-b997e2d64be1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:47.800043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-927910d5-34e0-4f8f-83c8-b997e2d64be1 tempest-ProjectsNegativeTestJSON-50194819 tempest-ProjectsNegativeTestJSON-50194819-project-admin] The token cache is being invalidate because project abc30cfec44047399158c9aa6ba86ae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:14:47.800684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-927910d5-34e0-4f8f-83c8-b997e2d64be1 tempest-ProjectsNegativeTestJSON-50194819 tempest-ProjectsNegativeTestJSON-50194819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:47.801635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-927910d5-34e0-4f8f-83c8-b997e2d64be1 tempest-ProjectsNegativeTestJSON-50194819 tempest-ProjectsNegativeTestJSON-50194819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:47.803986 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2006/4019] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:14:47 2022] DELETE /identity/v3/projects/abc30cfec44047399158c9aa6ba86ae7 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:47.812445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dbc28-5639-4f76-a1e9-7e528e0f9a63 tempest-ProjectsNegativeTestJSON-2140427954 tempest-ProjectsNegativeTestJSON-2140427954-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:47.816017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-205dbc28-5639-4f76-a1e9-7e528e0f9a63 tempest-ProjectsNegativeTestJSON-2140427954 tempest-ProjectsNegativeTestJSON-2140427954-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:47.961224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:48.070393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dbc28-5639-4f76-a1e9-7e528e0f9a63 tempest-ProjectsNegativeTestJSON-2140427954 tempest-ProjectsNegativeTestJSON-2140427954-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:48.221904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166c33d-e91b-4ffd-b485-88d14fcdc9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:48.222740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166c33d-e91b-4ffd-b485-88d14fcdc9c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:48.223041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166c33d-e91b-4ffd-b485-88d14fcdc9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:48.223366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166c33d-e91b-4ffd-b485-88d14fcdc9c6 admin admin] PATH_INFO: `/v3/users/d7821c595c1743a8b51720d9d60eb810` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:48.225871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166c33d-e91b-4ffd-b485-88d14fcdc9c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7821c595c1743a8b51720d9d60eb810)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:48.241576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166c33d-e91b-4ffd-b485-88d14fcdc9c6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:48.387519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0166c33d-e91b-4ffd-b485-88d14fcdc9c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7821c595c1743a8b51720d9d60eb810'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:48.415380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0166c33d-e91b-4ffd-b485-88d14fcdc9c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7821c595c1743a8b51720d9d60eb810'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:48.416302 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0166c33d-e91b-4ffd-b485-88d14fcdc9c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7821c595c1743a8b51720d9d60eb810'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:48.441258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0166c33d-e91b-4ffd-b485-88d14fcdc9c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7821c595c1743a8b51720d9d60eb810'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:48.442197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0166c33d-e91b-4ffd-b485-88d14fcdc9c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7821c595c1743a8b51720d9d60eb810'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:48.478944 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2014/4020] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:14:47 2022] DELETE /identity/v3/users/d7821c595c1743a8b51720d9d60eb810 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:48.484168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd66d8-1424-4d65-885d-891ef2023ce7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:48.484672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd66d8-1424-4d65-885d-891ef2023ce7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:48.484772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd66d8-1424-4d65-885d-891ef2023ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:48.583723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8dbd66d8-1424-4d65-885d-891ef2023ce7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:48.585224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8dbd66d8-1424-4d65-885d-891ef2023ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:48.728182 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2007/4021] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:48.745952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166c33d-e91b-4ffd-b485-88d14fcdc9c6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:48.747459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0166c33d-e91b-4ffd-b485-88d14fcdc9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:48.878309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166c33d-e91b-4ffd-b485-88d14fcdc9c6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:48.882432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6898e97-00a4-410c-a27d-60b25a2c364c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:48.883215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6898e97-00a4-410c-a27d-60b25a2c364c service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:48.883554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6898e97-00a4-410c-a27d-60b25a2c364c service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:48.883861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6898e97-00a4-410c-a27d-60b25a2c364c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:48.895219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:48.923516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6898e97-00a4-410c-a27d-60b25a2c364c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:48.925047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6898e97-00a4-410c-a27d-60b25a2c364c service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:48.937122 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2015/4022] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:14:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:14:49.897361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd66d8-1424-4d65-885d-891ef2023ce7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:49.899740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8dbd66d8-1424-4d65-885d-891ef2023ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:49.910141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:50.019716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd66d8-1424-4d65-885d-891ef2023ce7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:50.026441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036841c-5c87-4ea6-9f2c-ca5b63c96951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:50.027599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036841c-5c87-4ea6-9f2c-ca5b63c96951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:50.028043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036841c-5c87-4ea6-9f2c-ca5b63c96951 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:50.028629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036841c-5c87-4ea6-9f2c-ca5b63c96951 admin admin] PATH_INFO: `/v3/projects/a967dc0190fd4e0ba738f6a195881d2a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:50.033478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036841c-5c87-4ea6-9f2c-ca5b63c96951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a967dc0190fd4e0ba738f6a195881d2a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:50.036583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036841c-5c87-4ea6-9f2c-ca5b63c96951 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:50.165390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9036841c-5c87-4ea6-9f2c-ca5b63c96951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a967dc0190fd4e0ba738f6a195881d2a', 'request_id': 'req-9036841c-5c87-4ea6-9f2c-ca5b63c96951'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:50.178599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9036841c-5c87-4ea6-9f2c-ca5b63c96951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a967dc0190fd4e0ba738f6a195881d2a', 'request_id': 'req-9036841c-5c87-4ea6-9f2c-ca5b63c96951'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:50.193435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9036841c-5c87-4ea6-9f2c-ca5b63c96951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a967dc0190fd4e0ba738f6a195881d2a', 'request_id': 'req-9036841c-5c87-4ea6-9f2c-ca5b63c96951'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:50.216166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9036841c-5c87-4ea6-9f2c-ca5b63c96951 admin admin] The token cache is being invalidate because project a967dc0190fd4e0ba738f6a195881d2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:14:50.218530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9036841c-5c87-4ea6-9f2c-ca5b63c96951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:50.219512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9036841c-5c87-4ea6-9f2c-ca5b63c96951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:50.222058 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2008/4023] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:14:49 2022] DELETE /identity/v3/projects/a967dc0190fd4e0ba738f6a195881d2a => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:50.225562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6898e97-00a4-410c-a27d-60b25a2c364c service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:50.241770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6898e97-00a4-410c-a27d-60b25a2c364c service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:50.446643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c90529-3c77-416c-966f-dd075148d84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:50.447353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c90529-3c77-416c-966f-dd075148d84f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:50.447645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c90529-3c77-416c-966f-dd075148d84f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:50.447928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c90529-3c77-416c-966f-dd075148d84f admin admin] PATH_INFO: `/v3/users/c8f237dc1fe445828eec39b31a295a1a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:50.449284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c90529-3c77-416c-966f-dd075148d84f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8f237dc1fe445828eec39b31a295a1a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:50.452102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c90529-3c77-416c-966f-dd075148d84f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:50.577437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-15c90529-3c77-416c-966f-dd075148d84f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8f237dc1fe445828eec39b31a295a1a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:50.659444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-15c90529-3c77-416c-966f-dd075148d84f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8f237dc1fe445828eec39b31a295a1a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:50.663132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-15c90529-3c77-416c-966f-dd075148d84f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8f237dc1fe445828eec39b31a295a1a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:50.696403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-15c90529-3c77-416c-966f-dd075148d84f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8f237dc1fe445828eec39b31a295a1a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:50.698136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-15c90529-3c77-416c-966f-dd075148d84f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8f237dc1fe445828eec39b31a295a1a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:50.737914 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2016/4024] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:14:50 2022] DELETE /identity/v3/users/c8f237dc1fe445828eec39b31a295a1a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:51.311448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036841c-5c87-4ea6-9f2c-ca5b63c96951 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:51.315472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9036841c-5c87-4ea6-9f2c-ca5b63c96951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:51.363828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036841c-5c87-4ea6-9f2c-ca5b63c96951 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:51.477734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf8618-d273-410c-9dfc-b5dd51955e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:51.478558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf8618-d273-410c-9dfc-b5dd51955e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:51.478990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf8618-d273-410c-9dfc-b5dd51955e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:51.479422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf8618-d273-410c-9dfc-b5dd51955e43 admin admin] PATH_INFO: `/v3/projects/a5fc8459269f4ce8a8e93606a9a3ebfd` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:51.480912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf8618-d273-410c-9dfc-b5dd51955e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5fc8459269f4ce8a8e93606a9a3ebfd)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:51.484527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf8618-d273-410c-9dfc-b5dd51955e43 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:51.561567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d8bf8618-d273-410c-9dfc-b5dd51955e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5fc8459269f4ce8a8e93606a9a3ebfd', 'request_id': 'req-d8bf8618-d273-410c-9dfc-b5dd51955e43'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:51.585134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d8bf8618-d273-410c-9dfc-b5dd51955e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5fc8459269f4ce8a8e93606a9a3ebfd', 'request_id': 'req-d8bf8618-d273-410c-9dfc-b5dd51955e43'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:51.596272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d8bf8618-d273-410c-9dfc-b5dd51955e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5fc8459269f4ce8a8e93606a9a3ebfd', 'request_id': 'req-d8bf8618-d273-410c-9dfc-b5dd51955e43'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:51.608508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:51.618379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d8bf8618-d273-410c-9dfc-b5dd51955e43 admin admin] The token cache is being invalidate because project a5fc8459269f4ce8a8e93606a9a3ebfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:14:51.619355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d8bf8618-d273-410c-9dfc-b5dd51955e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:51.628407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d8bf8618-d273-410c-9dfc-b5dd51955e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:51.644861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba2697-15cf-4b86-99cf-fafdec728fe3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:51.645407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba2697-15cf-4b86-99cf-fafdec728fe3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:51.645407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba2697-15cf-4b86-99cf-fafdec728fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:51.645747 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2009/4025] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:14:51 2022] DELETE /identity/v3/projects/a5fc8459269f4ce8a8e93606a9a3ebfd => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:51.763406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-58ba2697-15cf-4b86-99cf-fafdec728fe3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:51.770545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-58ba2697-15cf-4b86-99cf-fafdec728fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:51.843920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:51.896547 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2017/4026] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:14:51.905552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3c2e1-4a7d-4a5e-ad4d-673762ac85ec None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:51.905897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3c2e1-4a7d-4a5e-ad4d-673762ac85ec None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:51.906118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3c2e1-4a7d-4a5e-ad4d-673762ac85ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:51.928221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-90b3c2e1-4a7d-4a5e-ad4d-673762ac85ec None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:51.929849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-90b3c2e1-4a7d-4a5e-ad4d-673762ac85ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:51.939727 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2010/4027] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:51.944337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba2697-15cf-4b86-99cf-fafdec728fe3 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:51.956629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba2697-15cf-4b86-99cf-fafdec728fe3 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:51.961988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e65def-d030-49b4-8184-4b06119f7c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:51.962698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e65def-d030-49b4-8184-4b06119f7c50 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:51.963232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e65def-d030-49b4-8184-4b06119f7c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:51.963615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e65def-d030-49b4-8184-4b06119f7c50 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:51.964432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e65def-d030-49b4-8184-4b06119f7c50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:14:51.964804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e65def-d030-49b4-8184-4b06119f7c50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:51.966509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e65def-d030-49b4-8184-4b06119f7c50 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:51.985073 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2018/4028] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:14:51.989549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3c2e1-4a7d-4a5e-ad4d-673762ac85ec None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:52.005972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3c2e1-4a7d-4a5e-ad4d-673762ac85ec None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:52.018180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e230f-5257-4a1a-8fca-7c036314d732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:52.018821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e230f-5257-4a1a-8fca-7c036314d732 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:52.019101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e230f-5257-4a1a-8fca-7c036314d732 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:52.019420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e230f-5257-4a1a-8fca-7c036314d732 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:52.020226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e230f-5257-4a1a-8fca-7c036314d732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:52.023183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e230f-5257-4a1a-8fca-7c036314d732 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:52.080888 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2011/4029] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:14:51 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:52.084964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e65def-d030-49b4-8184-4b06119f7c50 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:52.097583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e65def-d030-49b4-8184-4b06119f7c50 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:52.182408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5e3a6-6bdf-4dfd-aab1-c8efd5822d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:52.183041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5e3a6-6bdf-4dfd-aab1-c8efd5822d40 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:52.183374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5e3a6-6bdf-4dfd-aab1-c8efd5822d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:52.183629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5e3a6-6bdf-4dfd-aab1-c8efd5822d40 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:52.184333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5e3a6-6bdf-4dfd-aab1-c8efd5822d40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:52.186458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5e3a6-6bdf-4dfd-aab1-c8efd5822d40 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:52.224354 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2019/4030] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:14:52 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:52.228951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e230f-5257-4a1a-8fca-7c036314d732 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:52.267321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e230f-5257-4a1a-8fca-7c036314d732 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:52.284220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d6a2e-fb23-485a-be2e-43c5b8e946be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:52.284866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d6a2e-fb23-485a-be2e-43c5b8e946be admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:52.285160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d6a2e-fb23-485a-be2e-43c5b8e946be admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:52.285600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d6a2e-fb23-485a-be2e-43c5b8e946be admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:52.286320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d6a2e-fb23-485a-be2e-43c5b8e946be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:52.287989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d6a2e-fb23-485a-be2e-43c5b8e946be admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:52.313349 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2012/4031] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:52.314580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5e3a6-6bdf-4dfd-aab1-c8efd5822d40 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:52.331945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5e3a6-6bdf-4dfd-aab1-c8efd5822d40 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:52.338156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bfb05-16d6-4377-b41d-ed1f3a64f52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:52.338882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bfb05-16d6-4377-b41d-ed1f3a64f52d admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:52.339715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bfb05-16d6-4377-b41d-ed1f3a64f52d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:52.342043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bfb05-16d6-4377-b41d-ed1f3a64f52d admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:52.343600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bfb05-16d6-4377-b41d-ed1f3a64f52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:52.345783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bfb05-16d6-4377-b41d-ed1f3a64f52d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:52.366918 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2020/4032] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:52.371481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d6a2e-fb23-485a-be2e-43c5b8e946be admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:52.382694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d6a2e-fb23-485a-be2e-43c5b8e946be admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:52.400677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f914e81-ac8f-48de-9f24-441afa1cb9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:52.401371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f914e81-ac8f-48de-9f24-441afa1cb9bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:52.401654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f914e81-ac8f-48de-9f24-441afa1cb9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:52.401927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f914e81-ac8f-48de-9f24-441afa1cb9bb admin admin] PATH_INFO: `/v3/projects/b5ae42c93174441dae4283560c8f0131/users/39518446ffae4a3e849bc393ee64bd52/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:52.443256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f914e81-ac8f-48de-9f24-441afa1cb9bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ae42c93174441dae4283560c8f0131, user_id=39518446ffae4a3e849bc393ee64bd52, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:52.447446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f914e81-ac8f-48de-9f24-441afa1cb9bb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:52.469871 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2013/4033] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:14:52 2022] PUT /identity/v3/projects/b5ae42c93174441dae4283560c8f0131/users/39518446ffae4a3e849bc393ee64bd52/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:52.481639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcfeab-41dd-4d82-ac68-14bb6d828ebe None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:52.481952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcfeab-41dd-4d82-ac68-14bb6d828ebe None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:52.482134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcfeab-41dd-4d82-ac68-14bb6d828ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:52.519132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9bdcfeab-41dd-4d82-ac68-14bb6d828ebe None None] MFA Rules not processed for user `39518446ffae4a3e849bc393ee64bd52`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:52.520858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9bdcfeab-41dd-4d82-ac68-14bb6d828ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:52.599558 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2021/4034] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:52.604230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f914e81-ac8f-48de-9f24-441afa1cb9bb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:52.615566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f914e81-ac8f-48de-9f24-441afa1cb9bb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:52.624390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8fb15-a441-49b0-aeaf-273016cab852 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39518446ffae4a3e849bc393ee64bd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5ae42c93174441dae4283560c8f0131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:52.624799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8fb15-a441-49b0-aeaf-273016cab852 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:52.625162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8fb15-a441-49b0-aeaf-273016cab852 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:52.625515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8fb15-a441-49b0-aeaf-273016cab852 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] PATH_INFO: `/v3/users/39518446ffae4a3e849bc393ee64bd52/application_credentials` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:52.626294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8fb15-a441-49b0-aeaf-273016cab852 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: Authorizing `identity:create_application_credential(user_id=39518446ffae4a3e849bc393ee64bd52)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:52.627795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8fb15-a441-49b0-aeaf-273016cab852 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:52.735083 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2014/4035] 10.222.0.17 () {60 vars in 1315 bytes} [Sat Jul 30 21:14:52 2022] POST /identity/v3/users/39518446ffae4a3e849bc393ee64bd52/application_credentials => generated 920 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:52.736358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcfeab-41dd-4d82-ac68-14bb6d828ebe None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:52.746529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcfeab-41dd-4d82-ac68-14bb6d828ebe None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:52.751735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5b0ec-c747-4527-98e8-8393120a9aa4 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39518446ffae4a3e849bc393ee64bd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5ae42c93174441dae4283560c8f0131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:52.752753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5b0ec-c747-4527-98e8-8393120a9aa4 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:52.753076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5b0ec-c747-4527-98e8-8393120a9aa4 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:52.753389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5b0ec-c747-4527-98e8-8393120a9aa4 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] PATH_INFO: `/v3/users/39518446ffae4a3e849bc393ee64bd52/access_rules/739e45ef24c643548988758bca0c78e9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:52.754601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5b0ec-c747-4527-98e8-8393120a9aa4 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: Authorizing `identity:delete_access_rule(user_id=39518446ffae4a3e849bc393ee64bd52, access_rule_id=739e45ef24c643548988758bca0c78e9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:52.756015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5b0ec-c747-4527-98e8-8393120a9aa4 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:52.826524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-fde5b0ec-c747-4527-98e8-8393120a9aa4 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jul 30 21:14:52.826524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:14:52.826524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Jul 30 21:14:52.826524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application session.delete(ref) Jul 30 21:14:52.826524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 30 21:14:52.826524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application next(self.gen) Jul 30 21:14:52.826524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 30 21:14:52.826524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application yield resource Jul 30 21:14:52.826524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 30 21:14:52.826524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application next(self.gen) Jul 30 21:14:52.826524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 30 21:14:52.826524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.session.rollback() Jul 30 21:14:52.826524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:14:52.826524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.force_reraise() Jul 30 21:14:52.826524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:14:52.826524 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise self.value Jul 30 21:14:52.827904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 30 21:14:52.827904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 30 21:14:52.827904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 30 21:14:52.827904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application session.commit() Jul 30 21:14:52.827904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 30 21:14:52.827904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 30 21:14:52.827904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 30 21:14:52.827904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._prepare_impl() Jul 30 21:14:52.827904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 30 21:14:52.827904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.session.flush() Jul 30 21:14:52.827904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 30 21:14:52.827904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._flush(objects) Jul 30 21:14:52.827904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 30 21:14:52.827904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 30 21:14:52.827904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 30 21:14:52.827904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application compat.raise_( Jul 30 21:14:52.829087 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 30 21:14:52.829087 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception Jul 30 21:14:52.829087 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 30 21:14:52.829087 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application flush_context.execute() Jul 30 21:14:52.829087 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 30 21:14:52.829087 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rec.execute(self) Jul 30 21:14:52.829087 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Jul 30 21:14:52.829087 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Jul 30 21:14:52.829087 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Jul 30 21:14:52.829087 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._synchronize( Jul 30 21:14:52.829087 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Jul 30 21:14:52.829087 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Jul 30 21:14:52.829087 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Jul 30 21:14:52.829087 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise AssertionError( Jul 30 21:14:52.829087 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Jul 30 21:14:52.829087 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:14:52.830109 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:14:52.830109 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:14:52.830109 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:14:52.830109 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:14:52.830109 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:14:52.830109 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:14:52.830109 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:14:52.830109 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:14:52.830109 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:14:52.830109 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:14:52.830109 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:14:52.830109 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:14:52.830109 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:14:52.830109 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Jul 30 21:14:52.830109 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Jul 30 21:14:52.830109 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:14:52.830109 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:14:52.831481 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Jul 30 21:14:52.831481 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Jul 30 21:14:52.831481 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Jul 30 21:14:52.831481 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jul 30 21:14:52.831481 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jul 30 21:14:52.831481 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:14:52.836135 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2022/4036] 10.222.0.17 () {58 vars in 1362 bytes} [Sat Jul 30 21:14:52 2022] DELETE /identity/v3/users/39518446ffae4a3e849bc393ee64bd52/access_rules/739e45ef24c643548988758bca0c78e9 => generated 89 bytes in 97 msecs (HTTP/1.1 403) 5 headers in 183 bytes (2 switches on core 0) Jul 30 21:14:52.836771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8fb15-a441-49b0-aeaf-273016cab852 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:52.847714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8fb15-a441-49b0-aeaf-273016cab852 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:52.852054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7259c-07c2-48ee-8e60-4d1624b30025 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39518446ffae4a3e849bc393ee64bd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5ae42c93174441dae4283560c8f0131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:52.852795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7259c-07c2-48ee-8e60-4d1624b30025 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:52.853172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7259c-07c2-48ee-8e60-4d1624b30025 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:52.853522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7259c-07c2-48ee-8e60-4d1624b30025 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] PATH_INFO: `/v3/users/39518446ffae4a3e849bc393ee64bd52/application_credentials/cda5efc229d54a5fb7fca99f1336e4fc` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:52.870460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7259c-07c2-48ee-8e60-4d1624b30025 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: Authorizing `identity:delete_application_credential(user_id=39518446ffae4a3e849bc393ee64bd52, application_credential_id=cda5efc229d54a5fb7fca99f1336e4fc)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:52.872097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7259c-07c2-48ee-8e60-4d1624b30025 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:52.896597 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2015/4037] 10.222.0.17 () {58 vars in 1395 bytes} [Sat Jul 30 21:14:52 2022] DELETE /identity/v3/users/39518446ffae4a3e849bc393ee64bd52/application_credentials/cda5efc229d54a5fb7fca99f1336e4fc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:52.900921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5b0ec-c747-4527-98e8-8393120a9aa4 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:52.911341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5b0ec-c747-4527-98e8-8393120a9aa4 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:52.916184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a0206-986a-4b10-b184-c5c9c47a8b77 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39518446ffae4a3e849bc393ee64bd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5ae42c93174441dae4283560c8f0131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:52.916840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a0206-986a-4b10-b184-c5c9c47a8b77 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:52.917215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a0206-986a-4b10-b184-c5c9c47a8b77 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:52.917419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a0206-986a-4b10-b184-c5c9c47a8b77 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] PATH_INFO: `/v3/users/39518446ffae4a3e849bc393ee64bd52/access_rules` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:52.918845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a0206-986a-4b10-b184-c5c9c47a8b77 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: Authorizing `identity:list_access_rules(user_id=39518446ffae4a3e849bc393ee64bd52)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:52.920934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a0206-986a-4b10-b184-c5c9c47a8b77 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:52.927626 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2023/4038] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Jul 30 21:14:52 2022] GET /identity/v3/users/39518446ffae4a3e849bc393ee64bd52/access_rules => generated 369 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:14:52.931736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7259c-07c2-48ee-8e60-4d1624b30025 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:52.941831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7259c-07c2-48ee-8e60-4d1624b30025 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:52.951643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7b658-e39f-4d17-82c7-23fce312e234 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39518446ffae4a3e849bc393ee64bd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5ae42c93174441dae4283560c8f0131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:52.952698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7b658-e39f-4d17-82c7-23fce312e234 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:52.952993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7b658-e39f-4d17-82c7-23fce312e234 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:52.953277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7b658-e39f-4d17-82c7-23fce312e234 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] PATH_INFO: `/v3/users/39518446ffae4a3e849bc393ee64bd52/access_rules/739e45ef24c643548988758bca0c78e9` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:52.954617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7b658-e39f-4d17-82c7-23fce312e234 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: Authorizing `identity:delete_access_rule(user_id=39518446ffae4a3e849bc393ee64bd52, access_rule_id=739e45ef24c643548988758bca0c78e9)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:52.956109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7b658-e39f-4d17-82c7-23fce312e234 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:52.976484 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2016/4039] 10.222.0.17 () {58 vars in 1362 bytes} [Sat Jul 30 21:14:52 2022] DELETE /identity/v3/users/39518446ffae4a3e849bc393ee64bd52/access_rules/739e45ef24c643548988758bca0c78e9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:14:52.980679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a0206-986a-4b10-b184-c5c9c47a8b77 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:52.998002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a0206-986a-4b10-b184-c5c9c47a8b77 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:53.003148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5341f19-0ffc-4e03-ba14-1602f5ec2527 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39518446ffae4a3e849bc393ee64bd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5ae42c93174441dae4283560c8f0131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:53.003905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5341f19-0ffc-4e03-ba14-1602f5ec2527 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:53.004196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5341f19-0ffc-4e03-ba14-1602f5ec2527 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:53.004478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5341f19-0ffc-4e03-ba14-1602f5ec2527 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] PATH_INFO: `/v3/users/39518446ffae4a3e849bc393ee64bd52/access_rules` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:53.005781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5341f19-0ffc-4e03-ba14-1602f5ec2527 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: Authorizing `identity:list_access_rules(user_id=39518446ffae4a3e849bc393ee64bd52)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:53.007379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5341f19-0ffc-4e03-ba14-1602f5ec2527 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:53.010386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:53.015210 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2024/4040] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Jul 30 21:14:52 2022] GET /identity/v3/users/39518446ffae4a3e849bc393ee64bd52/access_rules => generated 158 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:14:53.019261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7b658-e39f-4d17-82c7-23fce312e234 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:53.029090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7b658-e39f-4d17-82c7-23fce312e234 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:53.033415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9051aec-fcf0-4469-ace9-2348563e01e2 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39518446ffae4a3e849bc393ee64bd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5ae42c93174441dae4283560c8f0131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:53.034098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9051aec-fcf0-4469-ace9-2348563e01e2 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:53.034446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9051aec-fcf0-4469-ace9-2348563e01e2 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:53.034731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9051aec-fcf0-4469-ace9-2348563e01e2 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] PATH_INFO: `/v3/users/39518446ffae4a3e849bc393ee64bd52/application_credentials` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:53.035731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9051aec-fcf0-4469-ace9-2348563e01e2 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: Authorizing `identity:create_application_credential(user_id=39518446ffae4a3e849bc393ee64bd52)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:53.036635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9051aec-fcf0-4469-ace9-2348563e01e2 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:53.060011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:53.180463 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2017/4041] 10.222.0.17 () {60 vars in 1315 bytes} [Sat Jul 30 21:14:53 2022] POST /identity/v3/users/39518446ffae4a3e849bc393ee64bd52/application_credentials => generated 920 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:53.181247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5341f19-0ffc-4e03-ba14-1602f5ec2527 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:53.199032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5341f19-0ffc-4e03-ba14-1602f5ec2527 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:53.206518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c83381-e197-4930-9afe-8b01793e37c1 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39518446ffae4a3e849bc393ee64bd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5ae42c93174441dae4283560c8f0131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:53.207268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c83381-e197-4930-9afe-8b01793e37c1 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:53.207657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c83381-e197-4930-9afe-8b01793e37c1 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:53.208008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c83381-e197-4930-9afe-8b01793e37c1 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] PATH_INFO: `/v3/users/39518446ffae4a3e849bc393ee64bd52/access_rules` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:53.209334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c83381-e197-4930-9afe-8b01793e37c1 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: Authorizing `identity:list_access_rules(user_id=39518446ffae4a3e849bc393ee64bd52)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:53.211232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c83381-e197-4930-9afe-8b01793e37c1 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:53.224038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9051aec-fcf0-4469-ace9-2348563e01e2 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:53.231702 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2025/4042] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Jul 30 21:14:53 2022] GET /identity/v3/users/39518446ffae4a3e849bc393ee64bd52/access_rules => generated 369 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:14:53.238265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9051aec-fcf0-4469-ace9-2348563e01e2 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:53.247761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ab02b-90b9-4a2b-a38c-028c3a5ec014 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39518446ffae4a3e849bc393ee64bd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5ae42c93174441dae4283560c8f0131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:53.249232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ab02b-90b9-4a2b-a38c-028c3a5ec014 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:53.249511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ab02b-90b9-4a2b-a38c-028c3a5ec014 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:53.249791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ab02b-90b9-4a2b-a38c-028c3a5ec014 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] PATH_INFO: `/v3/users/39518446ffae4a3e849bc393ee64bd52/application_credentials` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:53.250649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ab02b-90b9-4a2b-a38c-028c3a5ec014 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: Authorizing `identity:create_application_credential(user_id=39518446ffae4a3e849bc393ee64bd52)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:53.252366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ab02b-90b9-4a2b-a38c-028c3a5ec014 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:53.377272 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2018/4043] 10.222.0.17 () {60 vars in 1315 bytes} [Sat Jul 30 21:14:53 2022] POST /identity/v3/users/39518446ffae4a3e849bc393ee64bd52/application_credentials => generated 920 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:53.381521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c83381-e197-4930-9afe-8b01793e37c1 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:53.394130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c83381-e197-4930-9afe-8b01793e37c1 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:53.399895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4c44a-a45d-4d53-bc56-8a2eaf0f1895 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39518446ffae4a3e849bc393ee64bd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5ae42c93174441dae4283560c8f0131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:53.402365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4c44a-a45d-4d53-bc56-8a2eaf0f1895 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:53.402365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4c44a-a45d-4d53-bc56-8a2eaf0f1895 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:53.402365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4c44a-a45d-4d53-bc56-8a2eaf0f1895 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] PATH_INFO: `/v3/users/39518446ffae4a3e849bc393ee64bd52/access_rules/3d2b1050fc554cb6bd0e5ec10b5d4cf3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:53.404041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4c44a-a45d-4d53-bc56-8a2eaf0f1895 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: Authorizing `identity:get_access_rule(user_id=39518446ffae4a3e849bc393ee64bd52, access_rule_id=3d2b1050fc554cb6bd0e5ec10b5d4cf3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:53.407465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4c44a-a45d-4d53-bc56-8a2eaf0f1895 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:53.415808 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2026/4044] 10.222.0.17 () {58 vars in 1359 bytes} [Sat Jul 30 21:14:53 2022] GET /identity/v3/users/39518446ffae4a3e849bc393ee64bd52/access_rules/3d2b1050fc554cb6bd0e5ec10b5d4cf3 => generated 229 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:14:53.420675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ab02b-90b9-4a2b-a38c-028c3a5ec014 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:53.585446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ab02b-90b9-4a2b-a38c-028c3a5ec014 tempest-AccessRulesV3Test-1226047869 tempest-AccessRulesV3Test-1226047869-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:53.605903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ea020-2612-4f71-a5d8-1cc1d3bff22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:53.606828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ea020-2612-4f71-a5d8-1cc1d3bff22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:53.607007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ea020-2612-4f71-a5d8-1cc1d3bff22d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:53.607690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ea020-2612-4f71-a5d8-1cc1d3bff22d admin admin] PATH_INFO: `/v3/users/39518446ffae4a3e849bc393ee64bd52` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:53.612626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ea020-2612-4f71-a5d8-1cc1d3bff22d admin admin] RBAC: Authorizing `identity:delete_user(user_id=39518446ffae4a3e849bc393ee64bd52)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:53.615676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ea020-2612-4f71-a5d8-1cc1d3bff22d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:53.676973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:INSERT=7,keystone:DELETE=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:53.714988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8d3ea020-2612-4f71-a5d8-1cc1d3bff22d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39518446ffae4a3e849bc393ee64bd52'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:53.716056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8d3ea020-2612-4f71-a5d8-1cc1d3bff22d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39518446ffae4a3e849bc393ee64bd52'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:53.783200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8d3ea020-2612-4f71-a5d8-1cc1d3bff22d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39518446ffae4a3e849bc393ee64bd52'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:53.784591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8d3ea020-2612-4f71-a5d8-1cc1d3bff22d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39518446ffae4a3e849bc393ee64bd52'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:53.795409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8d3ea020-2612-4f71-a5d8-1cc1d3bff22d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39518446ffae4a3e849bc393ee64bd52'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:53.817773 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2019/4045] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:14:53 2022] DELETE /identity/v3/users/39518446ffae4a3e849bc393ee64bd52 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:53.817895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88615c2e-64cb-4b06-bcc9-7528e79eef38 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:53.817895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88615c2e-64cb-4b06-bcc9-7528e79eef38 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:53.817895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88615c2e-64cb-4b06-bcc9-7528e79eef38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:53.838776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-88615c2e-64cb-4b06-bcc9-7528e79eef38 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:53.840150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-88615c2e-64cb-4b06-bcc9-7528e79eef38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:53.912803 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2027/4046] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:53.931361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ea020-2612-4f71-a5d8-1cc1d3bff22d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:53.932970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8d3ea020-2612-4f71-a5d8-1cc1d3bff22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:54.025695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ea020-2612-4f71-a5d8-1cc1d3bff22d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:54.029391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942d0bd-b63f-4ed4-97dc-71f39c96a57f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:54.030018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942d0bd-b63f-4ed4-97dc-71f39c96a57f service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:54.030298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942d0bd-b63f-4ed4-97dc-71f39c96a57f service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:54.030575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942d0bd-b63f-4ed4-97dc-71f39c96a57f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:54.041896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942d0bd-b63f-4ed4-97dc-71f39c96a57f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:54.043371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942d0bd-b63f-4ed4-97dc-71f39c96a57f service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:54.051196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88615c2e-64cb-4b06-bcc9-7528e79eef38 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:54.052726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-88615c2e-64cb-4b06-bcc9-7528e79eef38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:54.058853 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2020/4047] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:14:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:14:54.067639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88615c2e-64cb-4b06-bcc9-7528e79eef38 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:54.073011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e88721-97b0-405f-be96-2ed0b5b1efa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:54.073846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e88721-97b0-405f-be96-2ed0b5b1efa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:54.074358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e88721-97b0-405f-be96-2ed0b5b1efa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:54.074806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e88721-97b0-405f-be96-2ed0b5b1efa1 admin admin] PATH_INFO: `/v3/users/cf1514e67acc4c15a04f5ce04957f937` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:54.077458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e88721-97b0-405f-be96-2ed0b5b1efa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1514e67acc4c15a04f5ce04957f937)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:54.079466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e88721-97b0-405f-be96-2ed0b5b1efa1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:54.137828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-01e88721-97b0-405f-be96-2ed0b5b1efa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1514e67acc4c15a04f5ce04957f937'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:54.152015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-01e88721-97b0-405f-be96-2ed0b5b1efa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1514e67acc4c15a04f5ce04957f937'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:54.152764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-01e88721-97b0-405f-be96-2ed0b5b1efa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1514e67acc4c15a04f5ce04957f937'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:54.160746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-01e88721-97b0-405f-be96-2ed0b5b1efa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1514e67acc4c15a04f5ce04957f937'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:54.161514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-01e88721-97b0-405f-be96-2ed0b5b1efa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1514e67acc4c15a04f5ce04957f937'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:54.178428 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2028/4048] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:14:54 2022] DELETE /identity/v3/users/cf1514e67acc4c15a04f5ce04957f937 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:14:54.462736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942d0bd-b63f-4ed4-97dc-71f39c96a57f service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:54.464422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e942d0bd-b63f-4ed4-97dc-71f39c96a57f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:54.468791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e88721-97b0-405f-be96-2ed0b5b1efa1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:54.470250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-01e88721-97b0-405f-be96-2ed0b5b1efa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:54.477813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942d0bd-b63f-4ed4-97dc-71f39c96a57f service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:54.552554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:54.565583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e88721-97b0-405f-be96-2ed0b5b1efa1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:54.573100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c381e40-1ea5-4094-a1dc-abadeb1d05f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:54.574583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c381e40-1ea5-4094-a1dc-abadeb1d05f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:54.576047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c381e40-1ea5-4094-a1dc-abadeb1d05f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:54.576388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c381e40-1ea5-4094-a1dc-abadeb1d05f6 admin admin] PATH_INFO: `/v3/projects/2ae42a10d54a4ab6aa4ab30fee3e1e69` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:54.578040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c381e40-1ea5-4094-a1dc-abadeb1d05f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae42a10d54a4ab6aa4ab30fee3e1e69)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:54.580669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c381e40-1ea5-4094-a1dc-abadeb1d05f6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:54.589258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e96cc0-e8ba-449b-a9bf-464ea68cf39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:54.590591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e96cc0-e8ba-449b-a9bf-464ea68cf39c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:54.591242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e96cc0-e8ba-449b-a9bf-464ea68cf39c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:54.592404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e96cc0-e8ba-449b-a9bf-464ea68cf39c admin admin] PATH_INFO: `/v3/projects/b5ae42c93174441dae4283560c8f0131` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:54.593861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e96cc0-e8ba-449b-a9bf-464ea68cf39c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5ae42c93174441dae4283560c8f0131)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:54.597666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e96cc0-e8ba-449b-a9bf-464ea68cf39c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:54.621596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:54.645159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4c381e40-1ea5-4094-a1dc-abadeb1d05f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae42a10d54a4ab6aa4ab30fee3e1e69', 'request_id': 'req-4c381e40-1ea5-4094-a1dc-abadeb1d05f6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:54.652477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4c381e40-1ea5-4094-a1dc-abadeb1d05f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae42a10d54a4ab6aa4ab30fee3e1e69', 'request_id': 'req-4c381e40-1ea5-4094-a1dc-abadeb1d05f6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:54.661132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4c381e40-1ea5-4094-a1dc-abadeb1d05f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae42a10d54a4ab6aa4ab30fee3e1e69', 'request_id': 'req-4c381e40-1ea5-4094-a1dc-abadeb1d05f6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:54.666759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-34e96cc0-e8ba-449b-a9bf-464ea68cf39c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5ae42c93174441dae4283560c8f0131', 'request_id': 'req-34e96cc0-e8ba-449b-a9bf-464ea68cf39c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:54.674639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4c381e40-1ea5-4094-a1dc-abadeb1d05f6 admin admin] The token cache is being invalidate because project 2ae42a10d54a4ab6aa4ab30fee3e1e69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:14:54.674999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4c381e40-1ea5-4094-a1dc-abadeb1d05f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:54.675673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4c381e40-1ea5-4094-a1dc-abadeb1d05f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:54.676458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-34e96cc0-e8ba-449b-a9bf-464ea68cf39c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5ae42c93174441dae4283560c8f0131', 'request_id': 'req-34e96cc0-e8ba-449b-a9bf-464ea68cf39c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:54.677444 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2029/4049] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:14:54 2022] DELETE /identity/v3/projects/2ae42a10d54a4ab6aa4ab30fee3e1e69 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:14:54.682315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae7f58-d0fd-4206-83c1-0d37a4c748ff None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:54.682609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae7f58-d0fd-4206-83c1-0d37a4c748ff None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:54.682908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae7f58-d0fd-4206-83c1-0d37a4c748ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:54.684332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-34e96cc0-e8ba-449b-a9bf-464ea68cf39c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5ae42c93174441dae4283560c8f0131', 'request_id': 'req-34e96cc0-e8ba-449b-a9bf-464ea68cf39c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:54.697257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-34e96cc0-e8ba-449b-a9bf-464ea68cf39c admin admin] The token cache is being invalidate because project b5ae42c93174441dae4283560c8f0131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:14:54.697639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-34e96cc0-e8ba-449b-a9bf-464ea68cf39c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:54.698303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-34e96cc0-e8ba-449b-a9bf-464ea68cf39c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:54.699896 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2021/4050] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:14:54 2022] DELETE /identity/v3/projects/b5ae42c93174441dae4283560c8f0131 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:54.704875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3916cde-1aac-4b66-85f6-7f670c563eba None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:54.705249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3916cde-1aac-4b66-85f6-7f670c563eba None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:54.705535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3916cde-1aac-4b66-85f6-7f670c563eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:54.707944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-49ae7f58-d0fd-4206-83c1-0d37a4c748ff None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:54.709224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-49ae7f58-d0fd-4206-83c1-0d37a4c748ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:54.726887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f3916cde-1aac-4b66-85f6-7f670c563eba None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:54.728132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f3916cde-1aac-4b66-85f6-7f670c563eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:54.798434 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2030/4051] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:54.800007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091fae4-2bab-44c1-97b8-357c80d7e9e9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:54.800296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091fae4-2bab-44c1-97b8-357c80d7e9e9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:54.800573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091fae4-2bab-44c1-97b8-357c80d7e9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:54.804246 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2022/4052] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:14:54.812354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cf6df-cbac-4d1c-9ebb-20a1551a1e26 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:54.812718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cf6df-cbac-4d1c-9ebb-20a1551a1e26 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:54.813064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cf6df-cbac-4d1c-9ebb-20a1551a1e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:54.821954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5091fae4-2bab-44c1-97b8-357c80d7e9e9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:54.823256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5091fae4-2bab-44c1-97b8-357c80d7e9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:54.832922 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2031/4053] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:54.840174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091fae4-2bab-44c1-97b8-357c80d7e9e9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:54.846226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-173cf6df-cbac-4d1c-9ebb-20a1551a1e26 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:54.847599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-173cf6df-cbac-4d1c-9ebb-20a1551a1e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:54.856594 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2023/4054] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:54.858547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091fae4-2bab-44c1-97b8-357c80d7e9e9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:54.861664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cf6df-cbac-4d1c-9ebb-20a1551a1e26 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:54.864842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1998c-f4a9-48e8-97f9-2aa65ad972c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:54.865721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1998c-f4a9-48e8-97f9-2aa65ad972c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:54.866285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1998c-f4a9-48e8-97f9-2aa65ad972c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:54.866573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1998c-f4a9-48e8-97f9-2aa65ad972c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:54.867303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1998c-f4a9-48e8-97f9-2aa65ad972c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:14:54.867624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1998c-f4a9-48e8-97f9-2aa65ad972c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:54.869547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1998c-f4a9-48e8-97f9-2aa65ad972c0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:54.875077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cf6df-cbac-4d1c-9ebb-20a1551a1e26 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:54.880866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608f4f7-814d-43cb-b2ac-346e0d69295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:54.881713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608f4f7-814d-43cb-b2ac-346e0d69295f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:54.882074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608f4f7-814d-43cb-b2ac-346e0d69295f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:54.882427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608f4f7-814d-43cb-b2ac-346e0d69295f admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:54.883239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608f4f7-814d-43cb-b2ac-346e0d69295f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:14:54.883607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608f4f7-814d-43cb-b2ac-346e0d69295f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:54.885413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608f4f7-814d-43cb-b2ac-346e0d69295f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:54.886839 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2032/4055] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:14:54.887758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1998c-f4a9-48e8-97f9-2aa65ad972c0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:54.898409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1998c-f4a9-48e8-97f9-2aa65ad972c0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:54.901396 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2024/4056] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:14:54.906059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608f4f7-814d-43cb-b2ac-346e0d69295f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:54.907492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45343087-ca90-46ed-88bc-5f3ef7071041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:54.908129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45343087-ca90-46ed-88bc-5f3ef7071041 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:54.908417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45343087-ca90-46ed-88bc-5f3ef7071041 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:54.908697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45343087-ca90-46ed-88bc-5f3ef7071041 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:54.909366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45343087-ca90-46ed-88bc-5f3ef7071041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:54.911411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45343087-ca90-46ed-88bc-5f3ef7071041 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:54.916341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608f4f7-814d-43cb-b2ac-346e0d69295f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:54.921726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e7fa9-89d4-4577-adfe-b402147f70bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:54.922406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e7fa9-89d4-4577-adfe-b402147f70bf admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:54.922640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e7fa9-89d4-4577-adfe-b402147f70bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:54.922910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e7fa9-89d4-4577-adfe-b402147f70bf admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:54.923609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e7fa9-89d4-4577-adfe-b402147f70bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:54.925516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e7fa9-89d4-4577-adfe-b402147f70bf admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:54.943466 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2033/4057] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:14:54 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:54.945326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45343087-ca90-46ed-88bc-5f3ef7071041 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:54.955340 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2025/4058] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:14:54 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:14:54.959800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e7fa9-89d4-4577-adfe-b402147f70bf admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:55.000524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:55.031097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45343087-ca90-46ed-88bc-5f3ef7071041 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:55.035069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e7fa9-89d4-4577-adfe-b402147f70bf admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:55.038159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2b77e-9263-4a35-a386-d58744b36475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:55.038928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2b77e-9263-4a35-a386-d58744b36475 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:55.039263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2b77e-9263-4a35-a386-d58744b36475 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:55.039687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2b77e-9263-4a35-a386-d58744b36475 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:55.040433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2b77e-9263-4a35-a386-d58744b36475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:55.040548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330de4d-5fed-423f-b9f0-464f23d4961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:55.041188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330de4d-5fed-423f-b9f0-464f23d4961c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:55.041651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330de4d-5fed-423f-b9f0-464f23d4961c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:55.042004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330de4d-5fed-423f-b9f0-464f23d4961c admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:55.042694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2b77e-9263-4a35-a386-d58744b36475 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:55.043047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330de4d-5fed-423f-b9f0-464f23d4961c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:55.045639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330de4d-5fed-423f-b9f0-464f23d4961c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:55.056936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:55.082376 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2026/4059] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:14:54 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:55.084710 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2034/4060] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:14:54 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:55.088538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2b77e-9263-4a35-a386-d58744b36475 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:55.088861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330de4d-5fed-423f-b9f0-464f23d4961c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:55.103888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2b77e-9263-4a35-a386-d58744b36475 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:55.110127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330de4d-5fed-423f-b9f0-464f23d4961c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:55.111034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bbf7e-7e59-4dc7-a954-2109ad51f687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:55.111813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bbf7e-7e59-4dc7-a954-2109ad51f687 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:55.112137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bbf7e-7e59-4dc7-a954-2109ad51f687 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:55.112487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bbf7e-7e59-4dc7-a954-2109ad51f687 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:55.113267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127bbf7e-7e59-4dc7-a954-2109ad51f687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:55.115074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127bbf7e-7e59-4dc7-a954-2109ad51f687 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:55.115207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11baf5-9447-4fd5-8b1d-a622f482e82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:55.115821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11baf5-9447-4fd5-8b1d-a622f482e82d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:55.116108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11baf5-9447-4fd5-8b1d-a622f482e82d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:55.116386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11baf5-9447-4fd5-8b1d-a622f482e82d admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:55.117086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11baf5-9447-4fd5-8b1d-a622f482e82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:55.118686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11baf5-9447-4fd5-8b1d-a622f482e82d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:55.126579 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2035/4061] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:14:55.130581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bbf7e-7e59-4dc7-a954-2109ad51f687 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:55.131513 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2027/4062] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:55.135048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11baf5-9447-4fd5-8b1d-a622f482e82d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:55.145196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bbf7e-7e59-4dc7-a954-2109ad51f687 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:55.149083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11baf5-9447-4fd5-8b1d-a622f482e82d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:55.155457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1468eeb-6dd4-4f7f-a95c-93288ea152a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:55.156384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7ac6a-78b2-4551-bf7d-ed33703db0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:55.156726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1468eeb-6dd4-4f7f-a95c-93288ea152a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:55.157012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1468eeb-6dd4-4f7f-a95c-93288ea152a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:55.157194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7ac6a-78b2-4551-bf7d-ed33703db0bd admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:55.157319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1468eeb-6dd4-4f7f-a95c-93288ea152a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:55.157483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7ac6a-78b2-4551-bf7d-ed33703db0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:55.157894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7ac6a-78b2-4551-bf7d-ed33703db0bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:55.158009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1468eeb-6dd4-4f7f-a95c-93288ea152a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:55.158601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7ac6a-78b2-4551-bf7d-ed33703db0bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:55.159999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1468eeb-6dd4-4f7f-a95c-93288ea152a7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:55.160324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7ac6a-78b2-4551-bf7d-ed33703db0bd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:55.175645 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2036/4063] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:14:55.176796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7ac6a-78b2-4551-bf7d-ed33703db0bd admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:55.180248 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2028/4064] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:14:55.183933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1468eeb-6dd4-4f7f-a95c-93288ea152a7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:55.189687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7ac6a-78b2-4551-bf7d-ed33703db0bd admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:55.198378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d766d1-cfbb-47f7-99df-bca28be90a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:55.198684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1468eeb-6dd4-4f7f-a95c-93288ea152a7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:55.199818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d766d1-cfbb-47f7-99df-bca28be90a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:55.200213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d766d1-cfbb-47f7-99df-bca28be90a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:55.200599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d766d1-cfbb-47f7-99df-bca28be90a74 admin admin] PATH_INFO: `/v3/projects/e33adbba42e242c394fc4e395ecbdca7/users/4b4290dc9e8042b58ae1965c00dfe78b/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:55.204241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15507ea7-4125-4642-bcc8-eb787879a2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:55.205736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15507ea7-4125-4642-bcc8-eb787879a2a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:55.206018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15507ea7-4125-4642-bcc8-eb787879a2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:55.206305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15507ea7-4125-4642-bcc8-eb787879a2a3 admin admin] PATH_INFO: `/v3/projects/b7f58a1378f74a3d8b440f05a2770595/users/89e4e9166be8450fb26004936a60de67/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:55.217491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d766d1-cfbb-47f7-99df-bca28be90a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33adbba42e242c394fc4e395ecbdca7, user_id=4b4290dc9e8042b58ae1965c00dfe78b, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:55.220343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d766d1-cfbb-47f7-99df-bca28be90a74 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:55.223142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15507ea7-4125-4642-bcc8-eb787879a2a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f58a1378f74a3d8b440f05a2770595, user_id=89e4e9166be8450fb26004936a60de67, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:55.226381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15507ea7-4125-4642-bcc8-eb787879a2a3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:55.240362 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2029/4065] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:14:55 2022] PUT /identity/v3/projects/b7f58a1378f74a3d8b440f05a2770595/users/89e4e9166be8450fb26004936a60de67/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:55.240810 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2037/4066] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:14:55 2022] PUT /identity/v3/projects/e33adbba42e242c394fc4e395ecbdca7/users/4b4290dc9e8042b58ae1965c00dfe78b/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:55.256751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299feaca-5f46-4f66-bab3-72185b9b2835 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:55.257040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299feaca-5f46-4f66-bab3-72185b9b2835 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:55.257221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ac722-7230-42c5-a937-8e33b8a3a7de None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:55.257343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299feaca-5f46-4f66-bab3-72185b9b2835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:55.257791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ac722-7230-42c5-a937-8e33b8a3a7de None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:55.258171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ac722-7230-42c5-a937-8e33b8a3a7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:55.276811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-299feaca-5f46-4f66-bab3-72185b9b2835 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:55.278037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-299feaca-5f46-4f66-bab3-72185b9b2835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:55.287434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-494ac722-7230-42c5-a937-8e33b8a3a7de None None] MFA Rules not processed for user `89e4e9166be8450fb26004936a60de67`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:55.288787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-494ac722-7230-42c5-a937-8e33b8a3a7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:55.337224 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2030/4067] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:55.347772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299feaca-5f46-4f66-bab3-72185b9b2835 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:55.349121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-299feaca-5f46-4f66-bab3-72185b9b2835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:55.354743 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2038/4068] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:14:55.359524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ac722-7230-42c5-a937-8e33b8a3a7de None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:55.368004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ac722-7230-42c5-a937-8e33b8a3a7de None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:55.372324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299f8e2-1b8e-4b3e-9da0-da58bdfe66cc tempest-DefaultDomainTestJSON-185435072 tempest-DefaultDomainTestJSON-185435072-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e4e9166be8450fb26004936a60de67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f58a1378f74a3d8b440f05a2770595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:55.372957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299f8e2-1b8e-4b3e-9da0-da58bdfe66cc tempest-DefaultDomainTestJSON-185435072 tempest-DefaultDomainTestJSON-185435072-project] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:55.373315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299f8e2-1b8e-4b3e-9da0-da58bdfe66cc tempest-DefaultDomainTestJSON-185435072 tempest-DefaultDomainTestJSON-185435072-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:55.373602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299f8e2-1b8e-4b3e-9da0-da58bdfe66cc tempest-DefaultDomainTestJSON-185435072 tempest-DefaultDomainTestJSON-185435072-project] PATH_INFO: `/v3/domains/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:55.374771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299f8e2-1b8e-4b3e-9da0-da58bdfe66cc tempest-DefaultDomainTestJSON-185435072 tempest-DefaultDomainTestJSON-185435072-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:55.376502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299f8e2-1b8e-4b3e-9da0-da58bdfe66cc tempest-DefaultDomainTestJSON-185435072 tempest-DefaultDomainTestJSON-185435072-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:55.378344 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2039/4069] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:14:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:14:55.384117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299f8e2-1b8e-4b3e-9da0-da58bdfe66cc tempest-DefaultDomainTestJSON-185435072 tempest-DefaultDomainTestJSON-185435072-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:55.398415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299f8e2-1b8e-4b3e-9da0-da58bdfe66cc tempest-DefaultDomainTestJSON-185435072 tempest-DefaultDomainTestJSON-185435072-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:55.403400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9304c8a-ffbe-4c43-926e-fd87108bac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:55.404042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9304c8a-ffbe-4c43-926e-fd87108bac08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:55.404345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9304c8a-ffbe-4c43-926e-fd87108bac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:55.405154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9304c8a-ffbe-4c43-926e-fd87108bac08 admin admin] PATH_INFO: `/v3/users/89e4e9166be8450fb26004936a60de67` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:55.406380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9304c8a-ffbe-4c43-926e-fd87108bac08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89e4e9166be8450fb26004936a60de67)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:55.408333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9304c8a-ffbe-4c43-926e-fd87108bac08 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:55.419061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299feaca-5f46-4f66-bab3-72185b9b2835 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:55.423631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108dabe-37ed-48a3-9763-8c78f5bdcb27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:55.424099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108dabe-37ed-48a3-9763-8c78f5bdcb27 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:55.424398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108dabe-37ed-48a3-9763-8c78f5bdcb27 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:55.424698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108dabe-37ed-48a3-9763-8c78f5bdcb27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:55.436878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108dabe-37ed-48a3-9763-8c78f5bdcb27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:55.438362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108dabe-37ed-48a3-9763-8c78f5bdcb27 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:55.448810 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2031/4070] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:14:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:14:55.475352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a9304c8a-ffbe-4c43-926e-fd87108bac08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89e4e9166be8450fb26004936a60de67'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:55.492347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a9304c8a-ffbe-4c43-926e-fd87108bac08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89e4e9166be8450fb26004936a60de67'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:55.493252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a9304c8a-ffbe-4c43-926e-fd87108bac08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89e4e9166be8450fb26004936a60de67'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:55.495582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:55.503009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a9304c8a-ffbe-4c43-926e-fd87108bac08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89e4e9166be8450fb26004936a60de67'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:55.503800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a9304c8a-ffbe-4c43-926e-fd87108bac08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89e4e9166be8450fb26004936a60de67'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:55.532586 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2040/4071] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:14:55 2022] DELETE /identity/v3/users/89e4e9166be8450fb26004936a60de67 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:55.537233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fd5a7-8156-4794-aa32-8a166372190d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:55.538171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fd5a7-8156-4794-aa32-8a166372190d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:55.538703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fd5a7-8156-4794-aa32-8a166372190d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:55.559979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-544fd5a7-8156-4794-aa32-8a166372190d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:55.561828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-544fd5a7-8156-4794-aa32-8a166372190d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:55.615623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:55.644527 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2032/4072] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:14:55.655170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9304c8a-ffbe-4c43-926e-fd87108bac08 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:55.656854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a9304c8a-ffbe-4c43-926e-fd87108bac08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:55.742578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9304c8a-ffbe-4c43-926e-fd87108bac08 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:55.746556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251a9df-1a43-4915-833f-ab4931277ccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:55.747174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251a9df-1a43-4915-833f-ab4931277ccc service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:55.747512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251a9df-1a43-4915-833f-ab4931277ccc service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:55.747791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251a9df-1a43-4915-833f-ab4931277ccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:55.757839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251a9df-1a43-4915-833f-ab4931277ccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:55.759267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251a9df-1a43-4915-833f-ab4931277ccc service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:55.771313 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2041/4073] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:14:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:14:56.273486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fd5a7-8156-4794-aa32-8a166372190d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:56.275753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-544fd5a7-8156-4794-aa32-8a166372190d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:56.298726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fd5a7-8156-4794-aa32-8a166372190d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:56.306381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324d9a0-9730-4ad9-aa41-502d08994846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:56.307097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d9a0-9730-4ad9-aa41-502d08994846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:56.307802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d9a0-9730-4ad9-aa41-502d08994846 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:56.307802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d9a0-9730-4ad9-aa41-502d08994846 admin admin] PATH_INFO: `/v3/projects/b7f58a1378f74a3d8b440f05a2770595` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:56.317336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324d9a0-9730-4ad9-aa41-502d08994846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7f58a1378f74a3d8b440f05a2770595)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:56.319461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324d9a0-9730-4ad9-aa41-502d08994846 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:56.379672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5324d9a0-9730-4ad9-aa41-502d08994846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7f58a1378f74a3d8b440f05a2770595', 'request_id': 'req-5324d9a0-9730-4ad9-aa41-502d08994846'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:56.389925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5324d9a0-9730-4ad9-aa41-502d08994846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7f58a1378f74a3d8b440f05a2770595', 'request_id': 'req-5324d9a0-9730-4ad9-aa41-502d08994846'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:56.400142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5324d9a0-9730-4ad9-aa41-502d08994846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7f58a1378f74a3d8b440f05a2770595', 'request_id': 'req-5324d9a0-9730-4ad9-aa41-502d08994846'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:56.428163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5324d9a0-9730-4ad9-aa41-502d08994846 admin admin] The token cache is being invalidate because project b7f58a1378f74a3d8b440f05a2770595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:14:56.428460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5324d9a0-9730-4ad9-aa41-502d08994846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:56.429122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5324d9a0-9730-4ad9-aa41-502d08994846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:56.431107 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2033/4074] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:14:56 2022] DELETE /identity/v3/projects/b7f58a1378f74a3d8b440f05a2770595 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:56.439015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154816fa-4392-4d32-bde1-4988a0c932b4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:56.439578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154816fa-4392-4d32-bde1-4988a0c932b4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:56.439682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154816fa-4392-4d32-bde1-4988a0c932b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:56.468618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-154816fa-4392-4d32-bde1-4988a0c932b4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:56.469869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-154816fa-4392-4d32-bde1-4988a0c932b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:56.545827 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2042/4075] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:56.554757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc2899-9a79-4502-866a-2a3f5c26c947 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:56.555356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc2899-9a79-4502-866a-2a3f5c26c947 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:56.555356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc2899-9a79-4502-866a-2a3f5c26c947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:56.575605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-62cc2899-9a79-4502-866a-2a3f5c26c947 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:56.577365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-62cc2899-9a79-4502-866a-2a3f5c26c947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:56.589754 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2034/4076] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:56.590739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154816fa-4392-4d32-bde1-4988a0c932b4 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:56.602345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154816fa-4392-4d32-bde1-4988a0c932b4 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:56.608236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3c906-0855-4e53-a78a-5dedaacde698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:56.608949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3c906-0855-4e53-a78a-5dedaacde698 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:56.609311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3c906-0855-4e53-a78a-5dedaacde698 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:56.609787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3c906-0855-4e53-a78a-5dedaacde698 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:56.610571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3c906-0855-4e53-a78a-5dedaacde698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:14:56.610950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3c906-0855-4e53-a78a-5dedaacde698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:56.612663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3c906-0855-4e53-a78a-5dedaacde698 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:56.629574 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2043/4077] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:14:56.630783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc2899-9a79-4502-866a-2a3f5c26c947 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:56.641803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc2899-9a79-4502-866a-2a3f5c26c947 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:56.647379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e660cc-1491-4f1e-b513-9b12d0b66d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:56.647861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e660cc-1491-4f1e-b513-9b12d0b66d7a admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:56.648220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e660cc-1491-4f1e-b513-9b12d0b66d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:56.648568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e660cc-1491-4f1e-b513-9b12d0b66d7a admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:56.649432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e660cc-1491-4f1e-b513-9b12d0b66d7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:56.651567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e660cc-1491-4f1e-b513-9b12d0b66d7a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:56.708172 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2035/4078] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:14:56 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:14:56.708569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3c906-0855-4e53-a78a-5dedaacde698 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:56.722221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3c906-0855-4e53-a78a-5dedaacde698 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:56.882491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e7c2c-4982-4bbe-a128-99c78312d74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:56.883580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e7c2c-4982-4bbe-a128-99c78312d74a admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:56.884868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e7c2c-4982-4bbe-a128-99c78312d74a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:56.885990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e7c2c-4982-4bbe-a128-99c78312d74a admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:56.886786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e7c2c-4982-4bbe-a128-99c78312d74a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:56.891704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e7c2c-4982-4bbe-a128-99c78312d74a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:56.930296 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2044/4079] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:14:56 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:14:56.933573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e660cc-1491-4f1e-b513-9b12d0b66d7a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:56.945636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e660cc-1491-4f1e-b513-9b12d0b66d7a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:56.956328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f7448-594f-41d4-8347-459fcbf8fe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:56.957183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f7448-594f-41d4-8347-459fcbf8fe50 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:56.957633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f7448-594f-41d4-8347-459fcbf8fe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:56.958377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f7448-594f-41d4-8347-459fcbf8fe50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:56.959246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f7448-594f-41d4-8347-459fcbf8fe50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:56.962083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f7448-594f-41d4-8347-459fcbf8fe50 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:56.976632 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2036/4080] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:56.980497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e7c2c-4982-4bbe-a128-99c78312d74a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:56.993543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:57.019183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e7c2c-4982-4bbe-a128-99c78312d74a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:57.036831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf33d21-9a81-435f-9825-05c080aeefc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:57.037968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf33d21-9a81-435f-9825-05c080aeefc6 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:57.038426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf33d21-9a81-435f-9825-05c080aeefc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:57.038867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf33d21-9a81-435f-9825-05c080aeefc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:57.048342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf33d21-9a81-435f-9825-05c080aeefc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:57.066924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf33d21-9a81-435f-9825-05c080aeefc6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:57.089907 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2045/4081] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:14:57.094914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f7448-594f-41d4-8347-459fcbf8fe50 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:57.109104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f7448-594f-41d4-8347-459fcbf8fe50 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:57.115386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20a587-cbed-4447-bbde-b4890c3a3313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:57.116469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20a587-cbed-4447-bbde-b4890c3a3313 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:57.116915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20a587-cbed-4447-bbde-b4890c3a3313 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:57.117522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20a587-cbed-4447-bbde-b4890c3a3313 admin admin] PATH_INFO: `/v3/projects/d4b5b5b0a7c74a16bb6d738e53219bb9/users/5c517165a4f644cc9f5e5d2fdc9e46e5/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:57.142778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20a587-cbed-4447-bbde-b4890c3a3313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b5b5b0a7c74a16bb6d738e53219bb9, user_id=5c517165a4f644cc9f5e5d2fdc9e46e5, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:57.146730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20a587-cbed-4447-bbde-b4890c3a3313 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:57.177930 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2037/4082] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:14:57 2022] PUT /identity/v3/projects/d4b5b5b0a7c74a16bb6d738e53219bb9/users/5c517165a4f644cc9f5e5d2fdc9e46e5/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:14:57.189333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9014a33-6d07-4ee5-8c82-80f1485a5040 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:57.189743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9014a33-6d07-4ee5-8c82-80f1485a5040 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:57.190955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9014a33-6d07-4ee5-8c82-80f1485a5040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:57.240263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f9014a33-6d07-4ee5-8c82-80f1485a5040 None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:57.242961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f9014a33-6d07-4ee5-8c82-80f1485a5040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:57.392182 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2046/4083] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:57.397775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20a587-cbed-4447-bbde-b4890c3a3313 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:57.417222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20a587-cbed-4447-bbde-b4890c3a3313 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:57.422768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa4f6b-b885-452a-9f25-b5183418fab9 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c517165a4f644cc9f5e5d2fdc9e46e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b5b5b0a7c74a16bb6d738e53219bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:57.423516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa4f6b-b885-452a-9f25-b5183418fab9 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:57.424369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa4f6b-b885-452a-9f25-b5183418fab9 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:57.425010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa4f6b-b885-452a-9f25-b5183418fab9 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] PATH_INFO: `/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:57.509291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-92aa4f6b-b885-452a-9f25-b5183418fab9 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5c517165a4f644cc9f5e5d2fdc9e46e5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:57.523180 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2038/4084] 10.222.0.17 () {60 vars in 1269 bytes} [Sat Jul 30 21:14:57 2022] POST /identity/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:14:58.313869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9014a33-6d07-4ee5-8c82-80f1485a5040 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:58.315966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f9014a33-6d07-4ee5-8c82-80f1485a5040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:58.409297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9014a33-6d07-4ee5-8c82-80f1485a5040 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:58.413256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462f678-52a0-42a2-b8af-31045ea6fae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:58.413860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462f678-52a0-42a2-b8af-31045ea6fae8 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:58.414149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462f678-52a0-42a2-b8af-31045ea6fae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:58.414431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462f678-52a0-42a2-b8af-31045ea6fae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:58.416335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4462f678-52a0-42a2-b8af-31045ea6fae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:58.508214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462f678-52a0-42a2-b8af-31045ea6fae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:14:58.509783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462f678-52a0-42a2-b8af-31045ea6fae8 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:14:58.524451 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2047/4085] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:14:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:14:58.526577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52720184-1039-4ffa-8912-19123a2dc064 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:58.527055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52720184-1039-4ffa-8912-19123a2dc064 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:58.527273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52720184-1039-4ffa-8912-19123a2dc064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:58.550804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-52720184-1039-4ffa-8912-19123a2dc064 None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:58.552265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-52720184-1039-4ffa-8912-19123a2dc064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:58.557271 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2039/4086] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:58 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 21:14:58.564102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7c25e-6997-453a-9fd6-9ef1391ac910 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:58.564657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7c25e-6997-453a-9fd6-9ef1391ac910 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:58.564937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7c25e-6997-453a-9fd6-9ef1391ac910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:58.575220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:58.590781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-04c7c25e-6997-453a-9fd6-9ef1391ac910 None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:14:58.592257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-04c7c25e-6997-453a-9fd6-9ef1391ac910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:14:58.601080 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2048/4087] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:14:58.604499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52720184-1039-4ffa-8912-19123a2dc064 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:58.618968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52720184-1039-4ffa-8912-19123a2dc064 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:58.627934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2e6f7-093a-45a7-bdb0-b57b78007768 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c517165a4f644cc9f5e5d2fdc9e46e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b5b5b0a7c74a16bb6d738e53219bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:58.628658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2e6f7-093a-45a7-bdb0-b57b78007768 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:58.629072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2e6f7-093a-45a7-bdb0-b57b78007768 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:58.629357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2e6f7-093a-45a7-bdb0-b57b78007768 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] PATH_INFO: `/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:58.719771 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-41c2e6f7-093a-45a7-bdb0-b57b78007768 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 30 21:14:58.719771 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:14:58.719771 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:14:58.719771 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:14:58.719771 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:14:58.719771 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:14:58.719771 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:14:58.719771 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:14:58.719771 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:14:58.719771 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:14:58.719771 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:14:58.719771 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:14:58.719771 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 30 21:14:58.720948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 30 21:14:58.720948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jul 30 21:14:58.720948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jul 30 21:14:58.720948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:14:58.720948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:14:58.720948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 21:14:58.720948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 21:14:58.720948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jul 30 21:14:58.720948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jul 30 21:14:58.720948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jul 30 21:14:58.720948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jul 30 21:14:58.720948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jul 30 21:14:58.720948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jul 30 21:14:58.720948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 30 21:14:58.720948 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:14:58.727764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7c25e-6997-453a-9fd6-9ef1391ac910 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:58.728050 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2040/4088] 10.222.0.17 () {60 vars in 1269 bytes} [Sat Jul 30 21:14:58 2022] POST /identity/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password => generated 188 bytes in 124 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 30 21:14:58.755742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7c25e-6997-453a-9fd6-9ef1391ac910 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:58.768188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d8928-23ce-4699-b003-83e065386ac7 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c517165a4f644cc9f5e5d2fdc9e46e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b5b5b0a7c74a16bb6d738e53219bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:58.769021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d8928-23ce-4699-b003-83e065386ac7 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:58.769674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d8928-23ce-4699-b003-83e065386ac7 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:58.770386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d8928-23ce-4699-b003-83e065386ac7 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] PATH_INFO: `/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:58.843899 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-b36d8928-23ce-4699-b003-83e065386ac7 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 30 21:14:58.843899 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:14:58.843899 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:14:58.843899 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:14:58.843899 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:14:58.843899 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:14:58.843899 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:14:58.843899 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:14:58.843899 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:14:58.843899 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:14:58.843899 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:14:58.843899 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:14:58.843899 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 30 21:14:58.844997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 30 21:14:58.844997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jul 30 21:14:58.844997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jul 30 21:14:58.844997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:14:58.844997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:14:58.844997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 21:14:58.844997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 21:14:58.844997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jul 30 21:14:58.844997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jul 30 21:14:58.844997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jul 30 21:14:58.844997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jul 30 21:14:58.844997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jul 30 21:14:58.844997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jul 30 21:14:58.844997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 30 21:14:58.844997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:14:58.848462 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2049/4089] 10.222.0.17 () {60 vars in 1269 bytes} [Sat Jul 30 21:14:58 2022] POST /identity/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password => generated 188 bytes in 121 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 30 21:14:58.852163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2e6f7-093a-45a7-bdb0-b57b78007768 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:14:58.870547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2e6f7-093a-45a7-bdb0-b57b78007768 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:14:58.876598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1a319-412f-475f-9cbe-b00bbcd06772 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c517165a4f644cc9f5e5d2fdc9e46e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b5b5b0a7c74a16bb6d738e53219bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:14:58.877220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1a319-412f-475f-9cbe-b00bbcd06772 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:58.877818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1a319-412f-475f-9cbe-b00bbcd06772 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:58.878187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1a319-412f-475f-9cbe-b00bbcd06772 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] PATH_INFO: `/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:14:58.886274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:DELETE=8,keystone:INSERT=5,keystone:UPDATE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:58.959636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dfc1a319-412f-475f-9cbe-b00bbcd06772 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5c517165a4f644cc9f5e5d2fdc9e46e5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:14:58.971619 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2041/4090] 10.222.0.17 () {60 vars in 1269 bytes} [Sat Jul 30 21:14:58 2022] POST /identity/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:14:59.980285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7fb75-4b09-497a-a2d1-a15db8ccdf03 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:14:59.981755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7fb75-4b09-497a-a2d1-a15db8ccdf03 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:14:59.982011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7fb75-4b09-497a-a2d1-a15db8ccdf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:00.021341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-63c7fb75-4b09-497a-a2d1-a15db8ccdf03 None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:00.024357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-63c7fb75-4b09-497a-a2d1-a15db8ccdf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:00.028581 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2050/4091] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:14:59 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 21:15:00.033854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0a8e6-424c-46bf-a6ad-fe4f071cc718 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:00.034511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0a8e6-424c-46bf-a6ad-fe4f071cc718 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:00.034511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0a8e6-424c-46bf-a6ad-fe4f071cc718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:00.082593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a3e0a8e6-424c-46bf-a6ad-fe4f071cc718 None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:00.086603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a3e0a8e6-424c-46bf-a6ad-fe4f071cc718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:00.113759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7fb75-4b09-497a-a2d1-a15db8ccdf03 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:00.116404 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2042/4092] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:00.133898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7fb75-4b09-497a-a2d1-a15db8ccdf03 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:00.140387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfd701-6a9a-49f2-aa04-a8feabcc5c1c tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c517165a4f644cc9f5e5d2fdc9e46e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b5b5b0a7c74a16bb6d738e53219bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:00.141063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfd701-6a9a-49f2-aa04-a8feabcc5c1c tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:00.141980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfd701-6a9a-49f2-aa04-a8feabcc5c1c tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:00.141980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfd701-6a9a-49f2-aa04-a8feabcc5c1c tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] PATH_INFO: `/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:00.211243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dcdfd701-6a9a-49f2-aa04-a8feabcc5c1c tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5c517165a4f644cc9f5e5d2fdc9e46e5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:00.225885 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2051/4093] 10.222.0.17 () {60 vars in 1269 bytes} [Sat Jul 30 21:15:00 2022] POST /identity/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:01.232996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1af60-2b15-47c9-a530-6e998d2c0b42 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:01.233975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1af60-2b15-47c9-a530-6e998d2c0b42 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:01.234408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1af60-2b15-47c9-a530-6e998d2c0b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:01.285215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c4a1af60-2b15-47c9-a530-6e998d2c0b42 None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:01.287336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c4a1af60-2b15-47c9-a530-6e998d2c0b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:01.291335 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2043/4094] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:01 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 21:15:01.295743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834f076-7c19-475b-81af-7ec1c6503ddc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:01.296244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834f076-7c19-475b-81af-7ec1c6503ddc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:01.296344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834f076-7c19-475b-81af-7ec1c6503ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:01.319686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-6834f076-7c19-475b-81af-7ec1c6503ddc None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:01.321181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6834f076-7c19-475b-81af-7ec1c6503ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:01.336964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1af60-2b15-47c9-a530-6e998d2c0b42 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:01.339429 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2052/4095] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:01.366832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1af60-2b15-47c9-a530-6e998d2c0b42 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:01.378481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1cf62-60a3-4337-a899-a6999aff8017 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c517165a4f644cc9f5e5d2fdc9e46e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b5b5b0a7c74a16bb6d738e53219bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:01.384096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1cf62-60a3-4337-a899-a6999aff8017 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:01.384658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1cf62-60a3-4337-a899-a6999aff8017 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:01.385115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1cf62-60a3-4337-a899-a6999aff8017 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] PATH_INFO: `/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:01.459544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8c936-c488-4c7c-8fb8-25d87de96eeb None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:01.459918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8c936-c488-4c7c-8fb8-25d87de96eeb None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:01.460122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8c936-c488-4c7c-8fb8-25d87de96eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:01.501726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3ba1cf62-60a3-4337-a899-a6999aff8017 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5c517165a4f644cc9f5e5d2fdc9e46e5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:01.533447 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2044/4096] 10.222.0.17 () {60 vars in 1269 bytes} [Sat Jul 30 21:15:01 2022] POST /identity/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:01.549796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-6ac8c936-c488-4c7c-8fb8-25d87de96eeb None None] MFA Rules not processed for user `4b4290dc9e8042b58ae1965c00dfe78b`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:01.551039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6ac8c936-c488-4c7c-8fb8-25d87de96eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:01.757976 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2053/4097] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:01.791369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1cf62-60a3-4337-a899-a6999aff8017 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:01.794146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3ba1cf62-60a3-4337-a899-a6999aff8017 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:01.822650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1cf62-60a3-4337-a899-a6999aff8017 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:01.837704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef77582-4eb3-41c2-a585-bd47dbf4d032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:01.840377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef77582-4eb3-41c2-a585-bd47dbf4d032 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:01.840851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef77582-4eb3-41c2-a585-bd47dbf4d032 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:01.841907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef77582-4eb3-41c2-a585-bd47dbf4d032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:01.852671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef77582-4eb3-41c2-a585-bd47dbf4d032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:01.854431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef77582-4eb3-41c2-a585-bd47dbf4d032 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:01.866487 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2045/4098] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:02.537532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04fba3-7a61-46dc-984f-44c276d34dd7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:02.538460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04fba3-7a61-46dc-984f-44c276d34dd7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:02.538750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04fba3-7a61-46dc-984f-44c276d34dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:02.562123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1b04fba3-7a61-46dc-984f-44c276d34dd7 None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:02.563878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1b04fba3-7a61-46dc-984f-44c276d34dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:02.567938 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2054/4099] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:02 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 21:15:02.573128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f9dc0-2790-4823-b213-03bc11491771 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:02.574399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f9dc0-2790-4823-b213-03bc11491771 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:02.574869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f9dc0-2790-4823-b213-03bc11491771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:02.603179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-558f9dc0-2790-4823-b213-03bc11491771 None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:02.604775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-558f9dc0-2790-4823-b213-03bc11491771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:02.618399 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2046/4100] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:15:02.622886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04fba3-7a61-46dc-984f-44c276d34dd7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:02.636405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04fba3-7a61-46dc-984f-44c276d34dd7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:02.642574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428465f6-23e3-40a5-9a89-a4dab91a8b73 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c517165a4f644cc9f5e5d2fdc9e46e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b5b5b0a7c74a16bb6d738e53219bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:02.643373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428465f6-23e3-40a5-9a89-a4dab91a8b73 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:02.644754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428465f6-23e3-40a5-9a89-a4dab91a8b73 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:02.645150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428465f6-23e3-40a5-9a89-a4dab91a8b73 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] PATH_INFO: `/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:02.710787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-428465f6-23e3-40a5-9a89-a4dab91a8b73 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5c517165a4f644cc9f5e5d2fdc9e46e5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:02.726512 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2055/4101] 10.222.0.17 () {60 vars in 1269 bytes} [Sat Jul 30 21:15:02 2022] POST /identity/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:02.914934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbdddb-1fc5-40fe-a930-c96fdf5b3c04 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:02.915577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbdddb-1fc5-40fe-a930-c96fdf5b3c04 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:02.916030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbdddb-1fc5-40fe-a930-c96fdf5b3c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:02.950683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ccbbdddb-1fc5-40fe-a930-c96fdf5b3c04 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:02.953961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ccbbdddb-1fc5-40fe-a930-c96fdf5b3c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:03.025891 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2047/4102] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:03.042445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428465f6-23e3-40a5-9a89-a4dab91a8b73 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:03.044811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-428465f6-23e3-40a5-9a89-a4dab91a8b73 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:03.168819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:INSERT=4,keystone:DELETE=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:03.246929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428465f6-23e3-40a5-9a89-a4dab91a8b73 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:03.255360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989a8c5-80ec-44d1-8772-b1438267faa6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:03.257258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989a8c5-80ec-44d1-8772-b1438267faa6 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:03.257553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989a8c5-80ec-44d1-8772-b1438267faa6 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:03.257882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989a8c5-80ec-44d1-8772-b1438267faa6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:03.293934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989a8c5-80ec-44d1-8772-b1438267faa6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:03.298737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989a8c5-80ec-44d1-8772-b1438267faa6 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:03.317523 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2056/4103] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:15:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:15:03.732247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2e03f-dab4-408c-871e-9e14cc79d12e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:03.732835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2e03f-dab4-408c-871e-9e14cc79d12e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:03.732835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2e03f-dab4-408c-871e-9e14cc79d12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:03.772831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-51c2e03f-dab4-408c-871e-9e14cc79d12e None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:03.774114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-51c2e03f-dab4-408c-871e-9e14cc79d12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:03.781184 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2048/4104] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:03 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 21:15:04.787429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee488f-c18c-4860-bb63-00728ccd372a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:04.787979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee488f-c18c-4860-bb63-00728ccd372a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:04.788383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee488f-c18c-4860-bb63-00728ccd372a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:04.819762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2aee488f-c18c-4860-bb63-00728ccd372a None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:04.821534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2aee488f-c18c-4860-bb63-00728ccd372a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:04.831893 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2057/4105] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:04.839350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724b0af-c354-44c3-a5b6-4cb2ae82c822 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:04.840141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724b0af-c354-44c3-a5b6-4cb2ae82c822 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:04.840438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724b0af-c354-44c3-a5b6-4cb2ae82c822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:04.870008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9724b0af-c354-44c3-a5b6-4cb2ae82c822 None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:04.871568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9724b0af-c354-44c3-a5b6-4cb2ae82c822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:04.878780 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2049/4106] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:04 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 21:15:04.887527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1260a4-f9a6-43d5-ba7e-9494efdb6041 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:04.887896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bf137-aa83-4ddc-a477-10eeaf140038 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:04.889072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bf137-aa83-4ddc-a477-10eeaf140038 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:04.889528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1260a4-f9a6-43d5-ba7e-9494efdb6041 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:04.889853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1260a4-f9a6-43d5-ba7e-9494efdb6041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:04.891545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bf137-aa83-4ddc-a477-10eeaf140038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:04.919753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8f1bf137-aa83-4ddc-a477-10eeaf140038 None None] MFA Rules not processed for user `4b4290dc9e8042b58ae1965c00dfe78b`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:04.921173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8f1bf137-aa83-4ddc-a477-10eeaf140038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:04.936465 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2050/4107] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:05.003848 ncdv-master-1 devstack@keystone.service[91085]: WARNING keystone.server.flask.application [None req-0d1260a4-f9a6-43d5-ba7e-9494efdb6041 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.17: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 30 21:15:05.006867 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2058/4108] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:04 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 122 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 30 21:15:05.015341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e53190-848b-40a2-8a39-991de301ef8b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:05.017413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e53190-848b-40a2-8a39-991de301ef8b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:05.017711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e53190-848b-40a2-8a39-991de301ef8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:05.101137 ncdv-master-1 devstack@keystone.service[91086]: WARNING keystone.server.flask.application [None req-a0e53190-848b-40a2-8a39-991de301ef8b None None] Authorization failed. The request you have made requires authentication. from 10.222.0.17: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 30 21:15:05.109913 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2051/4109] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:05 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 94 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 30 21:15:05.112141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436eb2-d9dc-4d90-a496-072453930117 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:05.112457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436eb2-d9dc-4d90-a496-072453930117 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:05.112833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436eb2-d9dc-4d90-a496-072453930117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:05.152693 ncdv-master-1 devstack@keystone.service[91085]: WARNING keystone.server.flask.application [None req-5c436eb2-d9dc-4d90-a496-072453930117 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.17: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 30 21:15:05.158270 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2059/4110] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:05 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 48 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 30 21:15:15.088824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=79,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:15.148935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=32,keystone:UPDATE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:16.172667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b78c12-5458-4a8a-99a2-2ea548e3de8f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:16.174385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b78c12-5458-4a8a-99a2-2ea548e3de8f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:16.174896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b78c12-5458-4a8a-99a2-2ea548e3de8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:16.249884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-63b78c12-5458-4a8a-99a2-2ea548e3de8f None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:16.252337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-63b78c12-5458-4a8a-99a2-2ea548e3de8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:16.265345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c436eb2-d9dc-4d90-a496-072453930117 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:16.269030 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2052/4111] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:16 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 21:15:16.281032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c436eb2-d9dc-4d90-a496-072453930117 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:16.287199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf7911-8187-4f77-b5d0-c731735f9ae1 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c517165a4f644cc9f5e5d2fdc9e46e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b5b5b0a7c74a16bb6d738e53219bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:16.287602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf7911-8187-4f77-b5d0-c731735f9ae1 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:16.287955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf7911-8187-4f77-b5d0-c731735f9ae1 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:16.288158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf7911-8187-4f77-b5d0-c731735f9ae1 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] PATH_INFO: `/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:16.361618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e7bf7911-8187-4f77-b5d0-c731735f9ae1 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5c517165a4f644cc9f5e5d2fdc9e46e5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:16.380466 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2060/4112] 10.222.0.17 () {60 vars in 1269 bytes} [Sat Jul 30 21:15:16 2022] POST /identity/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:15:17.389350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4734641-e05b-404a-8d70-659383a798e9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:17.389889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4734641-e05b-404a-8d70-659383a798e9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:17.389889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4734641-e05b-404a-8d70-659383a798e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:17.424905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a4734641-e05b-404a-8d70-659383a798e9 None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:17.426309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a4734641-e05b-404a-8d70-659383a798e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:17.437479 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2053/4113] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:17 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 21:15:17.439978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b8639-97df-4445-9d1d-97f184c5f814 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:17.440467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b8639-97df-4445-9d1d-97f184c5f814 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:17.440978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b8639-97df-4445-9d1d-97f184c5f814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:17.506709 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-ca0b8639-97df-4445-9d1d-97f184c5f814 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 30 21:15:17.506709 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:15:17.506709 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:15:17.506709 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:15:17.506709 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:15:17.506709 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:15:17.506709 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:15:17.506709 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:15:17.506709 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:15:17.506709 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:15:17.506709 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:15:17.506709 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:15:17.506709 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 30 21:15:17.506709 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 30 21:15:17.506709 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Jul 30 21:15:17.506709 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Jul 30 21:15:17.508220 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Jul 30 21:15:17.508220 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Jul 30 21:15:17.508220 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Jul 30 21:15:17.508220 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Jul 30 21:15:17.508220 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Jul 30 21:15:17.508220 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Jul 30 21:15:17.508220 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Jul 30 21:15:17.508220 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Jul 30 21:15:17.508220 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:15:17.508220 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:15:17.508220 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 30 21:15:17.508220 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 30 21:15:17.508220 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 30 21:15:17.508220 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 30 21:15:17.508220 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:15:17.508220 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:15:17.509478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 30 21:15:17.509478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 30 21:15:17.509478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:15:17.509478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:15:17.509478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 30 21:15:17.509478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 30 21:15:17.509478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:15:17.509478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:15:17.509478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 30 21:15:17.509478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 30 21:15:17.509478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 30 21:15:17.509478 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:15:17.512217 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2061/4114] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:17 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 21:15:17.514502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b4774-4ae9-4b5a-843c-9760511cebd7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:17.516071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b4774-4ae9-4b5a-843c-9760511cebd7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:17.516608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b4774-4ae9-4b5a-843c-9760511cebd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:17.604329 ncdv-master-1 devstack@keystone.service[91086]: WARNING keystone.server.flask.application [None req-b88b4774-4ae9-4b5a-843c-9760511cebd7 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.17: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 30 21:15:17.605828 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2054/4115] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:17 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 94 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 30 21:15:17.610750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad6811-23c0-454f-a5f4-4f5d497d5a5e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:17.611046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad6811-23c0-454f-a5f4-4f5d497d5a5e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:17.611350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad6811-23c0-454f-a5f4-4f5d497d5a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:17.656077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-78ad6811-23c0-454f-a5f4-4f5d497d5a5e None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:17.657732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-78ad6811-23c0-454f-a5f4-4f5d497d5a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:17.669866 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2062/4116] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:15:17.674150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b4774-4ae9-4b5a-843c-9760511cebd7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:17.688490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b4774-4ae9-4b5a-843c-9760511cebd7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:17.693566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182428c6-d8f5-48e2-8130-899c749c66bc tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c517165a4f644cc9f5e5d2fdc9e46e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b5b5b0a7c74a16bb6d738e53219bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:17.694411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182428c6-d8f5-48e2-8130-899c749c66bc tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:17.694902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182428c6-d8f5-48e2-8130-899c749c66bc tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:17.695383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182428c6-d8f5-48e2-8130-899c749c66bc tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] PATH_INFO: `/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:17.748586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-182428c6-d8f5-48e2-8130-899c749c66bc tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5c517165a4f644cc9f5e5d2fdc9e46e5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:17.758831 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2055/4117] 10.222.0.17 () {60 vars in 1269 bytes} [Sat Jul 30 21:15:17 2022] POST /identity/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:15:18.766360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc765d47-07da-4b97-a13d-b9d63d5d6804 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:18.768311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc765d47-07da-4b97-a13d-b9d63d5d6804 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:18.768849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc765d47-07da-4b97-a13d-b9d63d5d6804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:18.802226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-fc765d47-07da-4b97-a13d-b9d63d5d6804 None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:18.804215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fc765d47-07da-4b97-a13d-b9d63d5d6804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:18.809472 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2063/4118] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:18 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 21:15:18.815225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e59a6-4bf5-4619-9c95-b19861b328e5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:18.818422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e59a6-4bf5-4619-9c95-b19861b328e5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:18.819082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e59a6-4bf5-4619-9c95-b19861b328e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:18.852512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ba9e59a6-4bf5-4619-9c95-b19861b328e5 None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:18.854137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ba9e59a6-4bf5-4619-9c95-b19861b328e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:18.863076 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2056/4119] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:15:18.867548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc765d47-07da-4b97-a13d-b9d63d5d6804 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:18.883845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc765d47-07da-4b97-a13d-b9d63d5d6804 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:18.892520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a2891-3ec9-4283-bff7-8e7dce6e387c tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c517165a4f644cc9f5e5d2fdc9e46e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b5b5b0a7c74a16bb6d738e53219bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:18.893329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a2891-3ec9-4283-bff7-8e7dce6e387c tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:18.893723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a2891-3ec9-4283-bff7-8e7dce6e387c tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:18.894101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a2891-3ec9-4283-bff7-8e7dce6e387c tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] PATH_INFO: `/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:18.959006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-087a2891-3ec9-4283-bff7-8e7dce6e387c tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5c517165a4f644cc9f5e5d2fdc9e46e5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:18.975226 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2064/4120] 10.222.0.17 () {60 vars in 1269 bytes} [Sat Jul 30 21:15:18 2022] POST /identity/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:19.256087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e59a6-4bf5-4619-9c95-b19861b328e5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:19.257642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ba9e59a6-4bf5-4619-9c95-b19861b328e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:19.412078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e59a6-4bf5-4619-9c95-b19861b328e5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:19.423846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe389079-abd1-44af-8fc9-983ede6c8e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:19.425293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe389079-abd1-44af-8fc9-983ede6c8e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:19.425771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe389079-abd1-44af-8fc9-983ede6c8e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:19.426257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe389079-abd1-44af-8fc9-983ede6c8e04 admin admin] PATH_INFO: `/v3/users/7f6e06e9270a48b7bc6cecf4b2d73509` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:19.427876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe389079-abd1-44af-8fc9-983ede6c8e04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f6e06e9270a48b7bc6cecf4b2d73509)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:19.430075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe389079-abd1-44af-8fc9-983ede6c8e04 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:19.521532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe389079-abd1-44af-8fc9-983ede6c8e04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f6e06e9270a48b7bc6cecf4b2d73509'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:19.523783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe389079-abd1-44af-8fc9-983ede6c8e04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f6e06e9270a48b7bc6cecf4b2d73509'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:19.541247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe389079-abd1-44af-8fc9-983ede6c8e04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f6e06e9270a48b7bc6cecf4b2d73509'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:19.542127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe389079-abd1-44af-8fc9-983ede6c8e04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f6e06e9270a48b7bc6cecf4b2d73509'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:19.553468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe389079-abd1-44af-8fc9-983ede6c8e04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f6e06e9270a48b7bc6cecf4b2d73509'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:19.555105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=82,keystone:UPDATE=3,keystone:INSERT=3,keystone:DELETE=12 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:19.576522 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2057/4121] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:15:19 2022] DELETE /identity/v3/users/7f6e06e9270a48b7bc6cecf4b2d73509 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:19.800641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a2891-3ec9-4283-bff7-8e7dce6e387c tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:19.803173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-087a2891-3ec9-4283-bff7-8e7dce6e387c tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:19.819004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a2891-3ec9-4283-bff7-8e7dce6e387c tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:19.899569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113101ee-aa1b-4f20-b800-c055198a129b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:19.900275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113101ee-aa1b-4f20-b800-c055198a129b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:19.900652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113101ee-aa1b-4f20-b800-c055198a129b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:19.901025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113101ee-aa1b-4f20-b800-c055198a129b admin admin] PATH_INFO: `/v3/projects/3a35c62a04494e1f89562e4aca3a3da6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:19.902504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113101ee-aa1b-4f20-b800-c055198a129b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a35c62a04494e1f89562e4aca3a3da6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:19.905168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113101ee-aa1b-4f20-b800-c055198a129b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:19.965011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-113101ee-aa1b-4f20-b800-c055198a129b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a35c62a04494e1f89562e4aca3a3da6', 'request_id': 'req-113101ee-aa1b-4f20-b800-c055198a129b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:19.972531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-113101ee-aa1b-4f20-b800-c055198a129b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a35c62a04494e1f89562e4aca3a3da6', 'request_id': 'req-113101ee-aa1b-4f20-b800-c055198a129b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:19.978524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7db20-49c0-42c6-b357-d30652f282dc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:19.982079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7db20-49c0-42c6-b357-d30652f282dc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:19.982376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7db20-49c0-42c6-b357-d30652f282dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:19.986782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-113101ee-aa1b-4f20-b800-c055198a129b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a35c62a04494e1f89562e4aca3a3da6', 'request_id': 'req-113101ee-aa1b-4f20-b800-c055198a129b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:19.996125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=82,keystone:UPDATE=3,keystone:INSERT=5,keystone:DELETE=10 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:20.003116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-113101ee-aa1b-4f20-b800-c055198a129b admin admin] The token cache is being invalidate because project 3a35c62a04494e1f89562e4aca3a3da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:15:20.003802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-113101ee-aa1b-4f20-b800-c055198a129b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:20.005242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-113101ee-aa1b-4f20-b800-c055198a129b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:20.007579 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2065/4122] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:15:19 2022] DELETE /identity/v3/projects/3a35c62a04494e1f89562e4aca3a3da6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:20.015388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736911d-3603-4887-9053-5293db72219f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:20.015975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736911d-3603-4887-9053-5293db72219f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:20.016635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736911d-3603-4887-9053-5293db72219f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:20.024864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-beb7db20-49c0-42c6-b357-d30652f282dc None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:20.026477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-beb7db20-49c0-42c6-b357-d30652f282dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:20.034659 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2058/4123] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:19 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 21:15:20.036666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc2235-0bd4-4620-bfc7-b937be1f112a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:20.037121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc2235-0bd4-4620-bfc7-b937be1f112a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:20.037582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc2235-0bd4-4620-bfc7-b937be1f112a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:20.052463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f736911d-3603-4887-9053-5293db72219f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:20.054127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f736911d-3603-4887-9053-5293db72219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:20.062005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5cbc2235-0bd4-4620-bfc7-b937be1f112a None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:20.063232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5cbc2235-0bd4-4620-bfc7-b937be1f112a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:20.147739 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2066/4124] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:20.147892 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2059/4125] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:20.149050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc2235-0bd4-4620-bfc7-b937be1f112a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:20.149286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57557d3-d47d-4834-8078-6864827efc49 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:20.149587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57557d3-d47d-4834-8078-6864827efc49 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:20.150009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57557d3-d47d-4834-8078-6864827efc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:20.161346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc2235-0bd4-4620-bfc7-b937be1f112a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:20.166037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b89e0-9822-48e7-9c05-97364985a6e7 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c517165a4f644cc9f5e5d2fdc9e46e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b5b5b0a7c74a16bb6d738e53219bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:20.166759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b89e0-9822-48e7-9c05-97364985a6e7 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:20.167480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b89e0-9822-48e7-9c05-97364985a6e7 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:20.167836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b89e0-9822-48e7-9c05-97364985a6e7 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] PATH_INFO: `/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:20.176465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e57557d3-d47d-4834-8078-6864827efc49 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:20.177699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e57557d3-d47d-4834-8078-6864827efc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:20.191251 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2067/4126] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:20.192799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57557d3-d47d-4834-8078-6864827efc49 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:20.212093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57557d3-d47d-4834-8078-6864827efc49 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:20.220526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a52c8-4ac3-480e-92c2-64d791014a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:20.222506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a52c8-4ac3-480e-92c2-64d791014a57 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:20.223166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a52c8-4ac3-480e-92c2-64d791014a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:20.223783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a52c8-4ac3-480e-92c2-64d791014a57 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:20.225655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a52c8-4ac3-480e-92c2-64d791014a57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:15:20.226305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a52c8-4ac3-480e-92c2-64d791014a57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:20.228675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a52c8-4ac3-480e-92c2-64d791014a57 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:20.230304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-496b89e0-9822-48e7-9c05-97364985a6e7 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5c517165a4f644cc9f5e5d2fdc9e46e5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:20.248029 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2060/4127] 10.222.0.17 () {60 vars in 1269 bytes} [Sat Jul 30 21:15:20 2022] POST /identity/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5/password => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:20.265176 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2068/4128] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:15:20.267214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b89e0-9822-48e7-9c05-97364985a6e7 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:20.291809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b89e0-9822-48e7-9c05-97364985a6e7 tempest-IdentityV3UsersTest-1776373933 tempest-IdentityV3UsersTest-1776373933-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:20.298110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bde118-a2cf-4037-8346-8f3a766eeddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:20.298799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bde118-a2cf-4037-8346-8f3a766eeddd admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:20.299199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bde118-a2cf-4037-8346-8f3a766eeddd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:20.299692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bde118-a2cf-4037-8346-8f3a766eeddd admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:20.305133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bde118-a2cf-4037-8346-8f3a766eeddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:20.308177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bde118-a2cf-4037-8346-8f3a766eeddd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:20.360473 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2061/4129] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:15:20 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:15:20.364543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a52c8-4ac3-480e-92c2-64d791014a57 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:20.378027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a52c8-4ac3-480e-92c2-64d791014a57 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:20.498851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fb10c-1a0d-4882-84db-2bec9b90eed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:20.499737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fb10c-1a0d-4882-84db-2bec9b90eed8 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:20.500059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fb10c-1a0d-4882-84db-2bec9b90eed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:20.500810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fb10c-1a0d-4882-84db-2bec9b90eed8 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:20.501825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fb10c-1a0d-4882-84db-2bec9b90eed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:20.505508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fb10c-1a0d-4882-84db-2bec9b90eed8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:20.593088 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2069/4130] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:15:20 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:15:20.594906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bde118-a2cf-4037-8346-8f3a766eeddd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:20.612628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bde118-a2cf-4037-8346-8f3a766eeddd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:20.628012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2af581-8c4b-47ae-8f77-c247e4904db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:20.629012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2af581-8c4b-47ae-8f77-c247e4904db1 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:20.629507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2af581-8c4b-47ae-8f77-c247e4904db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:20.630265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2af581-8c4b-47ae-8f77-c247e4904db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:20.632827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2af581-8c4b-47ae-8f77-c247e4904db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:20.634694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2af581-8c4b-47ae-8f77-c247e4904db1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:20.668174 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2062/4131] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:15:20.672460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fb10c-1a0d-4882-84db-2bec9b90eed8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:20.688293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fb10c-1a0d-4882-84db-2bec9b90eed8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:20.695276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24087bf9-c0f8-4bb7-a3af-ef4585da3dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:20.696877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24087bf9-c0f8-4bb7-a3af-ef4585da3dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:20.697418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24087bf9-c0f8-4bb7-a3af-ef4585da3dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:20.697938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24087bf9-c0f8-4bb7-a3af-ef4585da3dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:20.698927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24087bf9-c0f8-4bb7-a3af-ef4585da3dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:20.703964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24087bf9-c0f8-4bb7-a3af-ef4585da3dc2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:20.722963 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2070/4132] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:15:20.728154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2af581-8c4b-47ae-8f77-c247e4904db1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:20.756964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2af581-8c4b-47ae-8f77-c247e4904db1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:20.766450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c5b24-9937-41f6-b83d-ce1f82dd8224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:20.766450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c5b24-9937-41f6-b83d-ce1f82dd8224 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:20.766450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c5b24-9937-41f6-b83d-ce1f82dd8224 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:20.766450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c5b24-9937-41f6-b83d-ce1f82dd8224 admin admin] PATH_INFO: `/v3/projects/e153111da8d54ad598f44e7bbc83661d/users/fed2e7125f98476c8083cab9b20aa1c3/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:20.786686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c5b24-9937-41f6-b83d-ce1f82dd8224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e153111da8d54ad598f44e7bbc83661d, user_id=fed2e7125f98476c8083cab9b20aa1c3, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:20.791391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c5b24-9937-41f6-b83d-ce1f82dd8224 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:20.822032 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2063/4133] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:15:20 2022] PUT /identity/v3/projects/e153111da8d54ad598f44e7bbc83661d/users/fed2e7125f98476c8083cab9b20aa1c3/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:20.827690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd7e9b-f018-4433-9ecb-92fc4288a19a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:20.828618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd7e9b-f018-4433-9ecb-92fc4288a19a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:20.829109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd7e9b-f018-4433-9ecb-92fc4288a19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:20.862883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-20cd7e9b-f018-4433-9ecb-92fc4288a19a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:20.863871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-20cd7e9b-f018-4433-9ecb-92fc4288a19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:20.925947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:20.953008 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2071/4134] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:20.964933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c5b24-9937-41f6-b83d-ce1f82dd8224 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:20.968123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7e1c5b24-9937-41f6-b83d-ce1f82dd8224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:21.073673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c5b24-9937-41f6-b83d-ce1f82dd8224 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:21.078073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5b705-9526-4185-a13b-f3c081a7e038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:21.078867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5b705-9526-4185-a13b-f3c081a7e038 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:21.079223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5b705-9526-4185-a13b-f3c081a7e038 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:21.079545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5b705-9526-4185-a13b-f3c081a7e038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:21.098171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5b705-9526-4185-a13b-f3c081a7e038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:21.099688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5b705-9526-4185-a13b-f3c081a7e038 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:21.105062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:21.121079 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2064/4135] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:21.252087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48e2a2-0e0c-4ed0-9cc3-9047f9fb0ee3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:21.253643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48e2a2-0e0c-4ed0-9cc3-9047f9fb0ee3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:21.254089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48e2a2-0e0c-4ed0-9cc3-9047f9fb0ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:21.287282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-aa48e2a2-0e0c-4ed0-9cc3-9047f9fb0ee3 None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:21.289602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-aa48e2a2-0e0c-4ed0-9cc3-9047f9fb0ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:21.297356 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2072/4136] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:21 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 21:15:22.089152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38ae32-1c0a-445b-9272-2278d01f1169 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:22.089988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38ae32-1c0a-445b-9272-2278d01f1169 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:22.089988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38ae32-1c0a-445b-9272-2278d01f1169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:22.150525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9a38ae32-1c0a-445b-9272-2278d01f1169 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:22.151957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9a38ae32-1c0a-445b-9272-2278d01f1169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:22.295755 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2065/4137] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:15:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:22.301665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16f6ea-380d-45bd-a102-7b246e6580f4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:22.302585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16f6ea-380d-45bd-a102-7b246e6580f4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:22.303100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16f6ea-380d-45bd-a102-7b246e6580f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:22.318094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38ae32-1c0a-445b-9272-2278d01f1169 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:22.321852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9a38ae32-1c0a-445b-9272-2278d01f1169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:22.357419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2d16f6ea-380d-45bd-a102-7b246e6580f4 None None] MFA Rules not processed for user `5c517165a4f644cc9f5e5d2fdc9e46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:22.362811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2d16f6ea-380d-45bd-a102-7b246e6580f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:22.444303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38ae32-1c0a-445b-9272-2278d01f1169 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:22.451072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bb0ca-c5ab-4a8c-a174-d49223faf160 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:22.459991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bb0ca-c5ab-4a8c-a174-d49223faf160 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:22.459991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bb0ca-c5ab-4a8c-a174-d49223faf160 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:22.460310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bb0ca-c5ab-4a8c-a174-d49223faf160 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:22.475751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bb0ca-c5ab-4a8c-a174-d49223faf160 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:22.478446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bb0ca-c5ab-4a8c-a174-d49223faf160 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:22.495672 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2066/4138] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:15:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:15:22.498577 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2073/4139] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:15:22.508388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bb0ca-c5ab-4a8c-a174-d49223faf160 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:22.512086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-517bb0ca-c5ab-4a8c-a174-d49223faf160 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:22.546617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bb0ca-c5ab-4a8c-a174-d49223faf160 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:22.553448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e6854-aba0-47ba-8778-af3b3bdf1bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:22.554494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e6854-aba0-47ba-8778-af3b3bdf1bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:22.555045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e6854-aba0-47ba-8778-af3b3bdf1bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:22.555473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e6854-aba0-47ba-8778-af3b3bdf1bb3 admin admin] PATH_INFO: `/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:22.556811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e6854-aba0-47ba-8778-af3b3bdf1bb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c517165a4f644cc9f5e5d2fdc9e46e5)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:22.559258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e6854-aba0-47ba-8778-af3b3bdf1bb3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:22.698408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-946e6854-aba0-47ba-8778-af3b3bdf1bb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c517165a4f644cc9f5e5d2fdc9e46e5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:22.699107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-946e6854-aba0-47ba-8778-af3b3bdf1bb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c517165a4f644cc9f5e5d2fdc9e46e5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:22.728631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-946e6854-aba0-47ba-8778-af3b3bdf1bb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c517165a4f644cc9f5e5d2fdc9e46e5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:22.729582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-946e6854-aba0-47ba-8778-af3b3bdf1bb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c517165a4f644cc9f5e5d2fdc9e46e5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:22.755063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-946e6854-aba0-47ba-8778-af3b3bdf1bb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c517165a4f644cc9f5e5d2fdc9e46e5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:22.794793 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2067/4140] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:15:22 2022] DELETE /identity/v3/users/5c517165a4f644cc9f5e5d2fdc9e46e5 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:22.795434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f18ff7-1ed8-4bcc-8c2b-799fa10a3d37 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:22.795736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f18ff7-1ed8-4bcc-8c2b-799fa10a3d37 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:22.796028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f18ff7-1ed8-4bcc-8c2b-799fa10a3d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:22.837226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-48f18ff7-1ed8-4bcc-8c2b-799fa10a3d37 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:22.838497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-48f18ff7-1ed8-4bcc-8c2b-799fa10a3d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:23.120370 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2074/4141] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:15:23.161104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e6854-aba0-47ba-8778-af3b3bdf1bb3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:23.162816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-946e6854-aba0-47ba-8778-af3b3bdf1bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:23.175626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:23.269937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e6854-aba0-47ba-8778-af3b3bdf1bb3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:23.274528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa39a6d-197e-45d4-aab2-06aeab63ba59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:23.275266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa39a6d-197e-45d4-aab2-06aeab63ba59 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:23.276280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa39a6d-197e-45d4-aab2-06aeab63ba59 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:23.276418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa39a6d-197e-45d4-aab2-06aeab63ba59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:23.295798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa39a6d-197e-45d4-aab2-06aeab63ba59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:23.304679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa39a6d-197e-45d4-aab2-06aeab63ba59 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:23.330273 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2068/4142] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:24.051283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f18ff7-1ed8-4bcc-8c2b-799fa10a3d37 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:24.053454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-48f18ff7-1ed8-4bcc-8c2b-799fa10a3d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:24.081211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f18ff7-1ed8-4bcc-8c2b-799fa10a3d37 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:24.090265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9eb816-b2d3-4f66-9d97-066084a95162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:24.091815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9eb816-b2d3-4f66-9d97-066084a95162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:24.092315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9eb816-b2d3-4f66-9d97-066084a95162 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:24.093569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9eb816-b2d3-4f66-9d97-066084a95162 admin admin] PATH_INFO: `/v3/users/b839893e78134428a3cf451901129edc` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:24.095134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9eb816-b2d3-4f66-9d97-066084a95162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b839893e78134428a3cf451901129edc)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:24.097293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9eb816-b2d3-4f66-9d97-066084a95162 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:24.167533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3b9eb816-b2d3-4f66-9d97-066084a95162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b839893e78134428a3cf451901129edc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:24.181609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3b9eb816-b2d3-4f66-9d97-066084a95162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b839893e78134428a3cf451901129edc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:24.182655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3b9eb816-b2d3-4f66-9d97-066084a95162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b839893e78134428a3cf451901129edc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:24.190580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3b9eb816-b2d3-4f66-9d97-066084a95162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b839893e78134428a3cf451901129edc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:24.191638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3b9eb816-b2d3-4f66-9d97-066084a95162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b839893e78134428a3cf451901129edc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:24.224921 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2075/4143] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:15:24 2022] DELETE /identity/v3/users/b839893e78134428a3cf451901129edc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:24.472428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa39a6d-197e-45d4-aab2-06aeab63ba59 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:24.474773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5fa39a6d-197e-45d4-aab2-06aeab63ba59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:24.508285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa39a6d-197e-45d4-aab2-06aeab63ba59 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:24.608903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe61666-25d1-4455-a348-f58288651fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:24.609882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe61666-25d1-4455-a348-f58288651fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:24.610370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe61666-25d1-4455-a348-f58288651fca admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:24.610883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe61666-25d1-4455-a348-f58288651fca admin admin] PATH_INFO: `/v3/projects/d4b5b5b0a7c74a16bb6d738e53219bb9` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:24.612529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe61666-25d1-4455-a348-f58288651fca admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b5b5b0a7c74a16bb6d738e53219bb9)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:24.614987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe61666-25d1-4455-a348-f58288651fca admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:24.640362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9eb816-b2d3-4f66-9d97-066084a95162 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:24.642409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3b9eb816-b2d3-4f66-9d97-066084a95162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:24.667894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:24.676363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9eb816-b2d3-4f66-9d97-066084a95162 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:24.687435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428ece8-8bbb-454f-a362-621b6a0363b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:24.692842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428ece8-8bbb-454f-a362-621b6a0363b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:24.693547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428ece8-8bbb-454f-a362-621b6a0363b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:24.696268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428ece8-8bbb-454f-a362-621b6a0363b7 admin admin] PATH_INFO: `/v3/projects/0743c6764e9d487a9a3efa52e8e2b611` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:24.702447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428ece8-8bbb-454f-a362-621b6a0363b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0743c6764e9d487a9a3efa52e8e2b611)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:24.707281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428ece8-8bbb-454f-a362-621b6a0363b7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:24.734805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2fe61666-25d1-4455-a348-f58288651fca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b5b5b0a7c74a16bb6d738e53219bb9', 'request_id': 'req-2fe61666-25d1-4455-a348-f58288651fca'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:24.755994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2fe61666-25d1-4455-a348-f58288651fca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b5b5b0a7c74a16bb6d738e53219bb9', 'request_id': 'req-2fe61666-25d1-4455-a348-f58288651fca'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:24.767578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2fe61666-25d1-4455-a348-f58288651fca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b5b5b0a7c74a16bb6d738e53219bb9', 'request_id': 'req-2fe61666-25d1-4455-a348-f58288651fca'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:24.790443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8428ece8-8bbb-454f-a362-621b6a0363b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0743c6764e9d487a9a3efa52e8e2b611', 'request_id': 'req-8428ece8-8bbb-454f-a362-621b6a0363b7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:24.797506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2fe61666-25d1-4455-a348-f58288651fca admin admin] The token cache is being invalidate because project d4b5b5b0a7c74a16bb6d738e53219bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:15:24.799709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8428ece8-8bbb-454f-a362-621b6a0363b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0743c6764e9d487a9a3efa52e8e2b611', 'request_id': 'req-8428ece8-8bbb-454f-a362-621b6a0363b7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:24.800263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2fe61666-25d1-4455-a348-f58288651fca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:24.801839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2fe61666-25d1-4455-a348-f58288651fca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:24.807985 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2069/4144] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:15:24 2022] DELETE /identity/v3/projects/d4b5b5b0a7c74a16bb6d738e53219bb9 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:24.814217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8428ece8-8bbb-454f-a362-621b6a0363b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0743c6764e9d487a9a3efa52e8e2b611', 'request_id': 'req-8428ece8-8bbb-454f-a362-621b6a0363b7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:24.816156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa935d6b-8620-4c5f-ad9a-f22beb16ace6 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:24.816627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa935d6b-8620-4c5f-ad9a-f22beb16ace6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:24.816911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa935d6b-8620-4c5f-ad9a-f22beb16ace6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:24.851066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8428ece8-8bbb-454f-a362-621b6a0363b7 admin admin] The token cache is being invalidate because project 0743c6764e9d487a9a3efa52e8e2b611 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:15:24.851476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8428ece8-8bbb-454f-a362-621b6a0363b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:24.853514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8428ece8-8bbb-454f-a362-621b6a0363b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:24.857128 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2076/4145] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:15:24 2022] DELETE /identity/v3/projects/0743c6764e9d487a9a3efa52e8e2b611 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:24.862266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c06a5c-49d4-4915-9887-c7700d6ade6f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:24.862706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c06a5c-49d4-4915-9887-c7700d6ade6f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:24.862997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c06a5c-49d4-4915-9887-c7700d6ade6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:24.863616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-aa935d6b-8620-4c5f-ad9a-f22beb16ace6 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:24.864773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-aa935d6b-8620-4c5f-ad9a-f22beb16ace6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:24.917294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-00c06a5c-49d4-4915-9887-c7700d6ade6f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:24.920042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-00c06a5c-49d4-4915-9887-c7700d6ade6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:24.922489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:24.997261 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2070/4146] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:15:25.015037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8b64b-efa6-4b73-9e9a-4fd1b3536f64 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:25.015394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8b64b-efa6-4b73-9e9a-4fd1b3536f64 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:25.015758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8b64b-efa6-4b73-9e9a-4fd1b3536f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:25.041428 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2077/4147] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:25.047243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ddd8b64b-efa6-4b73-9e9a-4fd1b3536f64 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:25.053884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ddd8b64b-efa6-4b73-9e9a-4fd1b3536f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:25.073661 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2071/4148] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:25.079862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c06a5c-49d4-4915-9887-c7700d6ade6f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:25.116708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c06a5c-49d4-4915-9887-c7700d6ade6f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:25.128570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d13776-b3a7-440b-9dd0-8698269b04ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:25.130457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d13776-b3a7-440b-9dd0-8698269b04ea admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:25.130457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d13776-b3a7-440b-9dd0-8698269b04ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:25.133502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d13776-b3a7-440b-9dd0-8698269b04ea admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:25.135441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d13776-b3a7-440b-9dd0-8698269b04ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:15:25.136089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d13776-b3a7-440b-9dd0-8698269b04ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:25.143214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb679d-82b6-4b0a-8e61-8d1f89076d4a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:25.143683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb679d-82b6-4b0a-8e61-8d1f89076d4a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:25.143801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d13776-b3a7-440b-9dd0-8698269b04ea admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:25.144109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb679d-82b6-4b0a-8e61-8d1f89076d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:25.183062 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2078/4149] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:15:25.187231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d13776-b3a7-440b-9dd0-8698269b04ea admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:25.197081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e8eb679d-82b6-4b0a-8e61-8d1f89076d4a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:25.198618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e8eb679d-82b6-4b0a-8e61-8d1f89076d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:25.206346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d13776-b3a7-440b-9dd0-8698269b04ea admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:25.208412 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2072/4150] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:25.212513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb679d-82b6-4b0a-8e61-8d1f89076d4a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:25.223612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb679d-82b6-4b0a-8e61-8d1f89076d4a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:25.225093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7c5e8-8b12-4abc-a3e9-79929eb81876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:25.225265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7c5e8-8b12-4abc-a3e9-79929eb81876 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:25.225561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7c5e8-8b12-4abc-a3e9-79929eb81876 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:25.225912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7c5e8-8b12-4abc-a3e9-79929eb81876 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:25.226654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7c5e8-8b12-4abc-a3e9-79929eb81876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:25.228737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7c5e8-8b12-4abc-a3e9-79929eb81876 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:25.229960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42852b6e-fd71-4508-bb13-7b9733958d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:25.230736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42852b6e-fd71-4508-bb13-7b9733958d88 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:25.231024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42852b6e-fd71-4508-bb13-7b9733958d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:25.231321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42852b6e-fd71-4508-bb13-7b9733958d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:25.232221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42852b6e-fd71-4508-bb13-7b9733958d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:15:25.232540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42852b6e-fd71-4508-bb13-7b9733958d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:25.234169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42852b6e-fd71-4508-bb13-7b9733958d88 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:25.253970 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2073/4151] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:15:25.254520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42852b6e-fd71-4508-bb13-7b9733958d88 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:25.267551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42852b6e-fd71-4508-bb13-7b9733958d88 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:25.272976 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2532a-03f6-4a33-9c58-dbe9f2d0b745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:25.274208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2532a-03f6-4a33-9c58-dbe9f2d0b745 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:25.274732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2532a-03f6-4a33-9c58-dbe9f2d0b745 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:25.275138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2532a-03f6-4a33-9c58-dbe9f2d0b745 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:25.277565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2532a-03f6-4a33-9c58-dbe9f2d0b745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:25.280380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2532a-03f6-4a33-9c58-dbe9f2d0b745 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:25.293433 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2079/4152] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:15:25 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:15:25.295089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7c5e8-8b12-4abc-a3e9-79929eb81876 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:25.324135 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2074/4153] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:15:25 2022] POST /identity/v3/projects => generated 399 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:15:25.324728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2532a-03f6-4a33-9c58-dbe9f2d0b745 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:25.398326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:25.439078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7c5e8-8b12-4abc-a3e9-79929eb81876 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:25.443670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2532a-03f6-4a33-9c58-dbe9f2d0b745 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:25.447851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53ee2c-ef72-4aa2-bab1-762d09b6709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:25.448717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53ee2c-ef72-4aa2-bab1-762d09b6709a admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:25.450091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53ee2c-ef72-4aa2-bab1-762d09b6709a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:25.450321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022d74f-8e4c-4a88-ae0f-79436a061574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:25.451671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53ee2c-ef72-4aa2-bab1-762d09b6709a admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:25.452107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022d74f-8e4c-4a88-ae0f-79436a061574 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:25.452568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022d74f-8e4c-4a88-ae0f-79436a061574 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:25.452963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53ee2c-ef72-4aa2-bab1-762d09b6709a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:25.453196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022d74f-8e4c-4a88-ae0f-79436a061574 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:25.454546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022d74f-8e4c-4a88-ae0f-79436a061574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:25.456741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022d74f-8e4c-4a88-ae0f-79436a061574 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:25.457514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53ee2c-ef72-4aa2-bab1-762d09b6709a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:25.487259 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2075/4154] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:15:25 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:15:25.489602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022d74f-8e4c-4a88-ae0f-79436a061574 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:25.491405 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2080/4155] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:15:25 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:15:25.495014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53ee2c-ef72-4aa2-bab1-762d09b6709a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:25.505642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022d74f-8e4c-4a88-ae0f-79436a061574 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:25.509072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53ee2c-ef72-4aa2-bab1-762d09b6709a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:25.511668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c398e3-42f7-4c65-ba1d-b90eeb9ec3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:25.512517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c398e3-42f7-4c65-ba1d-b90eeb9ec3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:25.513627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c398e3-42f7-4c65-ba1d-b90eeb9ec3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:25.514627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c398e3-42f7-4c65-ba1d-b90eeb9ec3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:25.515533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c398e3-42f7-4c65-ba1d-b90eeb9ec3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:25.516422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc9399-d84d-41f9-b071-fa2c861f4dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:25.517243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc9399-d84d-41f9-b071-fa2c861f4dcb admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:25.517626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc9399-d84d-41f9-b071-fa2c861f4dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:25.518001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc9399-d84d-41f9-b071-fa2c861f4dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:25.518385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c398e3-42f7-4c65-ba1d-b90eeb9ec3f5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:25.519199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc9399-d84d-41f9-b071-fa2c861f4dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:25.521178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc9399-d84d-41f9-b071-fa2c861f4dcb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:25.533190 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2076/4156] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:15:25.534452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c398e3-42f7-4c65-ba1d-b90eeb9ec3f5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:25.536497 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2081/4157] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:15:25.540148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc9399-d84d-41f9-b071-fa2c861f4dcb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:25.550178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c398e3-42f7-4c65-ba1d-b90eeb9ec3f5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:25.555149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc9399-d84d-41f9-b071-fa2c861f4dcb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:25.556889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d11ce3-b642-40ed-81ee-8576e4a9da20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:25.558445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d11ce3-b642-40ed-81ee-8576e4a9da20 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:25.558914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d11ce3-b642-40ed-81ee-8576e4a9da20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:25.559407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d11ce3-b642-40ed-81ee-8576e4a9da20 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:25.560835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d11ce3-b642-40ed-81ee-8576e4a9da20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:25.562008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb52990-5f42-4c08-be20-6a0e7f92351f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:25.562773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb52990-5f42-4c08-be20-6a0e7f92351f admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:25.563072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d11ce3-b642-40ed-81ee-8576e4a9da20 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:25.563629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb52990-5f42-4c08-be20-6a0e7f92351f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:25.564011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb52990-5f42-4c08-be20-6a0e7f92351f admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:25.564923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb52990-5f42-4c08-be20-6a0e7f92351f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:25.567535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb52990-5f42-4c08-be20-6a0e7f92351f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:25.581593 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2077/4158] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:15:25.582505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d11ce3-b642-40ed-81ee-8576e4a9da20 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:25.587668 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2082/4159] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:15:25.590150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb52990-5f42-4c08-be20-6a0e7f92351f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:25.597840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d11ce3-b642-40ed-81ee-8576e4a9da20 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:25.608953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb52990-5f42-4c08-be20-6a0e7f92351f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:25.611025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021e27e-20e8-45e9-88b5-50839c171b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:25.611893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021e27e-20e8-45e9-88b5-50839c171b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:25.612985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021e27e-20e8-45e9-88b5-50839c171b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:25.613281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021e27e-20e8-45e9-88b5-50839c171b0e admin admin] PATH_INFO: `/v3/projects/874222f573704f10bff5cb7cdce08465/users/4ef2420cd50d4006b7ba4e651fdaaaaa/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:25.627206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3fab1-26d9-437c-9347-d900402eb85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:25.628184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3fab1-26d9-437c-9347-d900402eb85d admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:25.628474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3fab1-26d9-437c-9347-d900402eb85d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:25.628756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3fab1-26d9-437c-9347-d900402eb85d admin admin] PATH_INFO: `/v3/projects/4e771262d4714517b6f35ada669fa8ee/users/6f036b84b2724f53882852e1133223d1/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:25.650327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021e27e-20e8-45e9-88b5-50839c171b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=874222f573704f10bff5cb7cdce08465, user_id=4ef2420cd50d4006b7ba4e651fdaaaaa, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:25.653874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021e27e-20e8-45e9-88b5-50839c171b0e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:25.664613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3fab1-26d9-437c-9347-d900402eb85d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e771262d4714517b6f35ada669fa8ee, user_id=6f036b84b2724f53882852e1133223d1, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:25.667681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3fab1-26d9-437c-9347-d900402eb85d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:25.678328 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2078/4160] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:15:25 2022] PUT /identity/v3/projects/874222f573704f10bff5cb7cdce08465/users/4ef2420cd50d4006b7ba4e651fdaaaaa/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:25.685675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba5fbe-400f-4a3f-8a1b-498e5a42395f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:25.686083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba5fbe-400f-4a3f-8a1b-498e5a42395f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:25.687082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba5fbe-400f-4a3f-8a1b-498e5a42395f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:25.699566 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2083/4161] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:15:25 2022] PUT /identity/v3/projects/4e771262d4714517b6f35ada669fa8ee/users/6f036b84b2724f53882852e1133223d1/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:25.711658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec5b54-63f5-4ab4-8bc0-28cc4d5d78aa None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:25.711870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec5b54-63f5-4ab4-8bc0-28cc4d5d78aa None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:25.712165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec5b54-63f5-4ab4-8bc0-28cc4d5d78aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:25.729159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9aba5fbe-400f-4a3f-8a1b-498e5a42395f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:25.736245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9aba5fbe-400f-4a3f-8a1b-498e5a42395f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:25.769564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b7ec5b54-63f5-4ab4-8bc0-28cc4d5d78aa None None] MFA Rules not processed for user `6f036b84b2724f53882852e1133223d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:25.770806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b7ec5b54-63f5-4ab4-8bc0-28cc4d5d78aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:25.832623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:25.886109 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2079/4162] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:25.907138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba5fbe-400f-4a3f-8a1b-498e5a42395f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:25.940505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9aba5fbe-400f-4a3f-8a1b-498e5a42395f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:25.952316 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2084/4163] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:25.965145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec5b54-63f5-4ab4-8bc0-28cc4d5d78aa None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:25.967401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b7ec5b54-63f5-4ab4-8bc0-28cc4d5d78aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:26.079637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba5fbe-400f-4a3f-8a1b-498e5a42395f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:26.084081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b2025-c81c-4e03-a77c-7481791c59f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:26.084730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b2025-c81c-4e03-a77c-7481791c59f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:26.085012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b2025-c81c-4e03-a77c-7481791c59f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:26.085287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b2025-c81c-4e03-a77c-7481791c59f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:26.092399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec5b54-63f5-4ab4-8bc0-28cc4d5d78aa None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:26.096640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbeb03d-b402-4e37-bea7-0b392b2c3dca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:26.097484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbeb03d-b402-4e37-bea7-0b392b2c3dca service glance] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:26.097874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbeb03d-b402-4e37-bea7-0b392b2c3dca service glance] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:26.098307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbeb03d-b402-4e37-bea7-0b392b2c3dca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:26.109796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b2025-c81c-4e03-a77c-7481791c59f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:26.111910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b2025-c81c-4e03-a77c-7481791c59f5 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:26.119082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbeb03d-b402-4e37-bea7-0b392b2c3dca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:26.120779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbeb03d-b402-4e37-bea7-0b392b2c3dca service glance] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:26.139518 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2080/4164] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:26.139518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b2025-c81c-4e03-a77c-7481791c59f5 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:26.139518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-770b2025-c81c-4e03-a77c-7481791c59f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:26.146561 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2085/4165] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:26.176612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b2025-c81c-4e03-a77c-7481791c59f5 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:26.180242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbeb03d-b402-4e37-bea7-0b392b2c3dca service glance] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:26.186978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a13588-061f-4d74-aa5d-39cf5ae80162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:26.187779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a13588-061f-4d74-aa5d-39cf5ae80162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:26.188197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a13588-061f-4d74-aa5d-39cf5ae80162 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:26.188751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a13588-061f-4d74-aa5d-39cf5ae80162 admin admin] PATH_INFO: `/v3/users/682921a9a9374c90be43ebe98669fb95` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:26.190364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a13588-061f-4d74-aa5d-39cf5ae80162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=682921a9a9374c90be43ebe98669fb95)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:26.192695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a13588-061f-4d74-aa5d-39cf5ae80162 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:26.194727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbeb03d-b402-4e37-bea7-0b392b2c3dca service glance] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:26.204272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41668fa-d948-4ef6-ab4e-305200319d3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:26.206353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41668fa-d948-4ef6-ab4e-305200319d3e service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:26.206646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41668fa-d948-4ef6-ab4e-305200319d3e service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:26.207938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41668fa-d948-4ef6-ab4e-305200319d3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:26.213218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d41668fa-d948-4ef6-ab4e-305200319d3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:26.240476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41668fa-d948-4ef6-ab4e-305200319d3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:26.242241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41668fa-d948-4ef6-ab4e-305200319d3e service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:26.268566 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2086/4166] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:26.298137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89a13588-061f-4d74-aa5d-39cf5ae80162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '682921a9a9374c90be43ebe98669fb95'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:26.303263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89a13588-061f-4d74-aa5d-39cf5ae80162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '682921a9a9374c90be43ebe98669fb95'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:26.354720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89a13588-061f-4d74-aa5d-39cf5ae80162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '682921a9a9374c90be43ebe98669fb95'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:26.355681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89a13588-061f-4d74-aa5d-39cf5ae80162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '682921a9a9374c90be43ebe98669fb95'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:26.376191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89a13588-061f-4d74-aa5d-39cf5ae80162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '682921a9a9374c90be43ebe98669fb95'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:26.398106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e965811-465e-4ce4-bb21-12f4b6caf605 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:26.398444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e965811-465e-4ce4-bb21-12f4b6caf605 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:26.398699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e965811-465e-4ce4-bb21-12f4b6caf605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:26.402016 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2081/4167] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:15:26 2022] DELETE /identity/v3/users/682921a9a9374c90be43ebe98669fb95 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:26.422705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1e965811-465e-4ce4-bb21-12f4b6caf605 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:26.424551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1e965811-465e-4ce4-bb21-12f4b6caf605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:26.436224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:26.511987 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2087/4168] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:26.548010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a13588-061f-4d74-aa5d-39cf5ae80162 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:26.550260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-89a13588-061f-4d74-aa5d-39cf5ae80162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:26.672877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:26.678409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a13588-061f-4d74-aa5d-39cf5ae80162 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:26.685437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e743a-59a2-48be-8eb3-1f29affc6b45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:26.686637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e743a-59a2-48be-8eb3-1f29affc6b45 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:26.691332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e743a-59a2-48be-8eb3-1f29affc6b45 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:26.691654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e743a-59a2-48be-8eb3-1f29affc6b45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:26.717921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e743a-59a2-48be-8eb3-1f29affc6b45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:26.719931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e743a-59a2-48be-8eb3-1f29affc6b45 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:26.742980 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2082/4169] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:27.698380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e965811-465e-4ce4-bb21-12f4b6caf605 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:27.706237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1e965811-465e-4ce4-bb21-12f4b6caf605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:27.730862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e743a-59a2-48be-8eb3-1f29affc6b45 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:27.733430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e965811-465e-4ce4-bb21-12f4b6caf605 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:27.733601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b04e743a-59a2-48be-8eb3-1f29affc6b45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:27.757009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b947157-71bc-45b1-81ce-4220a9425031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:27.758474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b947157-71bc-45b1-81ce-4220a9425031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:27.758474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b947157-71bc-45b1-81ce-4220a9425031 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:27.758668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e743a-59a2-48be-8eb3-1f29affc6b45 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:27.758777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b947157-71bc-45b1-81ce-4220a9425031 admin admin] PATH_INFO: `/v3/projects/ec9cf72add9f4d0d8fa2652095636289` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:27.759748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b947157-71bc-45b1-81ce-4220a9425031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec9cf72add9f4d0d8fa2652095636289)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:27.764409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b947157-71bc-45b1-81ce-4220a9425031 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:27.774258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def3c17-9915-4dbd-99cf-40ec636fe605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:27.774967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def3c17-9915-4dbd-99cf-40ec636fe605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:27.775346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def3c17-9915-4dbd-99cf-40ec636fe605 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:27.775633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def3c17-9915-4dbd-99cf-40ec636fe605 admin admin] PATH_INFO: `/v3/users/6f036b84b2724f53882852e1133223d1` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:27.777062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def3c17-9915-4dbd-99cf-40ec636fe605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f036b84b2724f53882852e1133223d1)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:27.781184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def3c17-9915-4dbd-99cf-40ec636fe605 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:27.859899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2b947157-71bc-45b1-81ce-4220a9425031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec9cf72add9f4d0d8fa2652095636289', 'request_id': 'req-2b947157-71bc-45b1-81ce-4220a9425031'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:27.877331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2b947157-71bc-45b1-81ce-4220a9425031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec9cf72add9f4d0d8fa2652095636289', 'request_id': 'req-2b947157-71bc-45b1-81ce-4220a9425031'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:27.904385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2b947157-71bc-45b1-81ce-4220a9425031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec9cf72add9f4d0d8fa2652095636289', 'request_id': 'req-2b947157-71bc-45b1-81ce-4220a9425031'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:27.909822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3def3c17-9915-4dbd-99cf-40ec636fe605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f036b84b2724f53882852e1133223d1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:27.911941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3def3c17-9915-4dbd-99cf-40ec636fe605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f036b84b2724f53882852e1133223d1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:27.923102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2b947157-71bc-45b1-81ce-4220a9425031 admin admin] The token cache is being invalidate because project ec9cf72add9f4d0d8fa2652095636289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:15:27.923787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2b947157-71bc-45b1-81ce-4220a9425031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:27.924710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2b947157-71bc-45b1-81ce-4220a9425031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:27.927227 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2088/4170] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:15:27 2022] DELETE /identity/v3/projects/ec9cf72add9f4d0d8fa2652095636289 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:27.932210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d46df-b44e-412e-bb6f-07b00cb9c30f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:27.933004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d46df-b44e-412e-bb6f-07b00cb9c30f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:27.933355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d46df-b44e-412e-bb6f-07b00cb9c30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:27.942627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3def3c17-9915-4dbd-99cf-40ec636fe605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f036b84b2724f53882852e1133223d1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:27.947868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3def3c17-9915-4dbd-99cf-40ec636fe605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f036b84b2724f53882852e1133223d1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:27.962969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3def3c17-9915-4dbd-99cf-40ec636fe605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f036b84b2724f53882852e1133223d1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:27.965064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4c9d46df-b44e-412e-bb6f-07b00cb9c30f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:27.967117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4c9d46df-b44e-412e-bb6f-07b00cb9c30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:27.996802 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2083/4171] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:15:27 2022] DELETE /identity/v3/users/6f036b84b2724f53882852e1133223d1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:15:28.001439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c5b4a-d0cb-4b04-87b8-71abf60dbd68 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:28.002096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c5b4a-d0cb-4b04-87b8-71abf60dbd68 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:28.008235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c5b4a-d0cb-4b04-87b8-71abf60dbd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:28.046858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f28c5b4a-d0cb-4b04-87b8-71abf60dbd68 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:28.051336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f28c5b4a-d0cb-4b04-87b8-71abf60dbd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:28.113433 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2089/4172] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:28.122225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0290c-a393-471d-9314-2557cc99cea3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:28.122783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0290c-a393-471d-9314-2557cc99cea3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:28.123322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0290c-a393-471d-9314-2557cc99cea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:28.173896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-37c0290c-a393-471d-9314-2557cc99cea3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:28.177229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-37c0290c-a393-471d-9314-2557cc99cea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:28.212508 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2084/4173] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:28.287195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:28.307807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c5b4a-d0cb-4b04-87b8-71abf60dbd68 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:28.311010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f28c5b4a-d0cb-4b04-87b8-71abf60dbd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:28.326246 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2090/4174] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:28.331071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0290c-a393-471d-9314-2557cc99cea3 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:28.344403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0290c-a393-471d-9314-2557cc99cea3 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:28.350824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486f851-4a09-40eb-844c-5720e59efb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:28.351804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486f851-4a09-40eb-844c-5720e59efb31 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:28.352205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486f851-4a09-40eb-844c-5720e59efb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:28.352623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486f851-4a09-40eb-844c-5720e59efb31 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:28.353443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486f851-4a09-40eb-844c-5720e59efb31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:15:28.354380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486f851-4a09-40eb-844c-5720e59efb31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:28.357122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486f851-4a09-40eb-844c-5720e59efb31 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:28.381502 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2091/4175] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:15:28.387007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486f851-4a09-40eb-844c-5720e59efb31 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:28.399573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486f851-4a09-40eb-844c-5720e59efb31 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:28.406081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4afdc9-0c61-440c-8935-2db602b94724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:28.407212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4afdc9-0c61-440c-8935-2db602b94724 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:28.407802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4afdc9-0c61-440c-8935-2db602b94724 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:28.408187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4afdc9-0c61-440c-8935-2db602b94724 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:28.409244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4afdc9-0c61-440c-8935-2db602b94724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:28.411529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4afdc9-0c61-440c-8935-2db602b94724 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:28.449181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c5b4a-d0cb-4b04-87b8-71abf60dbd68 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:28.457508 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2092/4176] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:15:28 2022] POST /identity/v3/projects => generated 365 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:15:28.458389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216fbeb-af3c-44fa-ba42-07a1b23ead9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:28.459040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216fbeb-af3c-44fa-ba42-07a1b23ead9d service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:28.462589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216fbeb-af3c-44fa-ba42-07a1b23ead9d service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:28.463585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216fbeb-af3c-44fa-ba42-07a1b23ead9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:28.463973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4afdc9-0c61-440c-8935-2db602b94724 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:28.466860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3b4afdc9-0c61-440c-8935-2db602b94724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:28.488181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216fbeb-af3c-44fa-ba42-07a1b23ead9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:28.489824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216fbeb-af3c-44fa-ba42-07a1b23ead9d service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:28.523564 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2085/4177] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:28.524618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216fbeb-af3c-44fa-ba42-07a1b23ead9d service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:28.549404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216fbeb-af3c-44fa-ba42-07a1b23ead9d service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:28.560250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:28.571345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4afdc9-0c61-440c-8935-2db602b94724 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:28.580608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e68819-f683-4115-a31c-729297719e3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:28.582169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e68819-f683-4115-a31c-729297719e3c service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:28.583880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e68819-f683-4115-a31c-729297719e3c service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:28.584678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e68819-f683-4115-a31c-729297719e3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:28.591351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a5e68819-f683-4115-a31c-729297719e3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:28.669874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58f924-0062-41d7-85df-004fd6a86dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:28.670692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58f924-0062-41d7-85df-004fd6a86dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:28.671119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58f924-0062-41d7-85df-004fd6a86dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:28.671556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58f924-0062-41d7-85df-004fd6a86dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:28.672334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58f924-0062-41d7-85df-004fd6a86dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:28.675198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58f924-0062-41d7-85df-004fd6a86dc4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:28.708147 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2086/4178] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:15:28 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:15:28.713365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58f924-0062-41d7-85df-004fd6a86dc4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:28.736579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58f924-0062-41d7-85df-004fd6a86dc4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:28.744461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb17225-4ba1-4732-8584-83a5ae8adb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:28.746039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb17225-4ba1-4732-8584-83a5ae8adb58 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:28.746572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb17225-4ba1-4732-8584-83a5ae8adb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:28.747646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb17225-4ba1-4732-8584-83a5ae8adb58 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:28.748742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb17225-4ba1-4732-8584-83a5ae8adb58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:28.750631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb17225-4ba1-4732-8584-83a5ae8adb58 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:28.768800 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2087/4179] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:15:28.772982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb17225-4ba1-4732-8584-83a5ae8adb58 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:28.782484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e68819-f683-4115-a31c-729297719e3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:28.784316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e68819-f683-4115-a31c-729297719e3c service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:28.794488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb17225-4ba1-4732-8584-83a5ae8adb58 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:28.801262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016a249-dbd0-444f-9d9e-0d45c9152a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:28.802224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016a249-dbd0-444f-9d9e-0d45c9152a96 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:28.802826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016a249-dbd0-444f-9d9e-0d45c9152a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:28.803421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016a249-dbd0-444f-9d9e-0d45c9152a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:28.804350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016a249-dbd0-444f-9d9e-0d45c9152a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:28.806584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016a249-dbd0-444f-9d9e-0d45c9152a96 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:28.814527 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2093/4180] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:28.825748 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2088/4181] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:15:28.826822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e68819-f683-4115-a31c-729297719e3c service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:28.840172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e68819-f683-4115-a31c-729297719e3c service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:28.849065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5928441-3bf6-4562-a708-b67f34c48ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:28.849947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5928441-3bf6-4562-a708-b67f34c48ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:28.850269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5928441-3bf6-4562-a708-b67f34c48ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:28.850582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5928441-3bf6-4562-a708-b67f34c48ad5 admin admin] PATH_INFO: `/v3/projects/acc6c23a959246638169178d6a5acd4c/users/4a01092bfa5a4118a5fe61a6dc9c5460/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:28.873512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5928441-3bf6-4562-a708-b67f34c48ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc6c23a959246638169178d6a5acd4c, user_id=4a01092bfa5a4118a5fe61a6dc9c5460, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:28.876322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5928441-3bf6-4562-a708-b67f34c48ad5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:28.897651 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2094/4182] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:15:28 2022] PUT /identity/v3/projects/acc6c23a959246638169178d6a5acd4c/users/4a01092bfa5a4118a5fe61a6dc9c5460/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:15:28.905717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d8d60-3071-4a31-a418-8ed6c4373255 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:28.906513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d8d60-3071-4a31-a418-8ed6c4373255 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:28.907050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d8d60-3071-4a31-a418-8ed6c4373255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:28.995253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fc8d8d60-3071-4a31-a418-8ed6c4373255 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:28.996421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fc8d8d60-3071-4a31-a418-8ed6c4373255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:29.304409 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2089/4183] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:29.420107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5928441-3bf6-4562-a708-b67f34c48ad5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:29.473423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:29.529817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d8d60-3071-4a31-a418-8ed6c4373255 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:29.534412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5928441-3bf6-4562-a708-b67f34c48ad5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:29.546282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d8d60-3071-4a31-a418-8ed6c4373255 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:29.546529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2195a8-efd1-422f-8fad-860d2dc19bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:29.548934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2195a8-efd1-422f-8fad-860d2dc19bcc service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:29.553001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2195a8-efd1-422f-8fad-860d2dc19bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:29.553753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2195a8-efd1-422f-8fad-860d2dc19bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:29.555996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f24dd0-ccfb-411c-a35c-fd3e69f9aecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:29.560721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24dd0-ccfb-411c-a35c-fd3e69f9aecd service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:29.561426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24dd0-ccfb-411c-a35c-fd3e69f9aecd service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:29.561996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24dd0-ccfb-411c-a35c-fd3e69f9aecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:29.570538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-39f24dd0-ccfb-411c-a35c-fd3e69f9aecd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:29.582991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2195a8-efd1-422f-8fad-860d2dc19bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:29.585675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2195a8-efd1-422f-8fad-860d2dc19bcc service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:29.613718 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2095/4184] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:29.703717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f24dd0-ccfb-411c-a35c-fd3e69f9aecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:29.706801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f24dd0-ccfb-411c-a35c-fd3e69f9aecd service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:29.715523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:29.722194 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2090/4185] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:30.415809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2195a8-efd1-422f-8fad-860d2dc19bcc service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:30.418868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6d2195a8-efd1-422f-8fad-860d2dc19bcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:30.476459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2195a8-efd1-422f-8fad-860d2dc19bcc service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:30.506405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e333c0-5ae2-4917-ba41-0939b1c13695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:30.507974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e333c0-5ae2-4917-ba41-0939b1c13695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:30.525383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e333c0-5ae2-4917-ba41-0939b1c13695 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:30.526019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e333c0-5ae2-4917-ba41-0939b1c13695 admin admin] PATH_INFO: `/v3/projects/4e771262d4714517b6f35ada669fa8ee` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:30.528041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e333c0-5ae2-4917-ba41-0939b1c13695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e771262d4714517b6f35ada669fa8ee)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:30.530948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e333c0-5ae2-4917-ba41-0939b1c13695 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:30.633465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-49e333c0-5ae2-4917-ba41-0939b1c13695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e771262d4714517b6f35ada669fa8ee', 'request_id': 'req-49e333c0-5ae2-4917-ba41-0939b1c13695'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:30.641844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-49e333c0-5ae2-4917-ba41-0939b1c13695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e771262d4714517b6f35ada669fa8ee', 'request_id': 'req-49e333c0-5ae2-4917-ba41-0939b1c13695'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:30.650903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-49e333c0-5ae2-4917-ba41-0939b1c13695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e771262d4714517b6f35ada669fa8ee', 'request_id': 'req-49e333c0-5ae2-4917-ba41-0939b1c13695'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:30.667390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-49e333c0-5ae2-4917-ba41-0939b1c13695 admin admin] The token cache is being invalidate because project 4e771262d4714517b6f35ada669fa8ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:15:30.667728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-49e333c0-5ae2-4917-ba41-0939b1c13695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:30.668468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-49e333c0-5ae2-4917-ba41-0939b1c13695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:30.670445 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2096/4186] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:15:30 2022] DELETE /identity/v3/projects/4e771262d4714517b6f35ada669fa8ee => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:30.676226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3581f2-cafb-4215-851e-885cfd9f5794 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:30.676720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3581f2-cafb-4215-851e-885cfd9f5794 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:30.677514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3581f2-cafb-4215-851e-885cfd9f5794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:30.702616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2c3581f2-cafb-4215-851e-885cfd9f5794 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:30.703962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2c3581f2-cafb-4215-851e-885cfd9f5794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:30.794952 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2091/4187] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:30.803220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58925f27-3d40-4ced-b8d1-ac6a6f91e9ec None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:30.804238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58925f27-3d40-4ced-b8d1-ac6a6f91e9ec None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:30.804735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58925f27-3d40-4ced-b8d1-ac6a6f91e9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:30.829092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-58925f27-3d40-4ced-b8d1-ac6a6f91e9ec None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:30.830267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-58925f27-3d40-4ced-b8d1-ac6a6f91e9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:30.843900 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2097/4188] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:15:30.848935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3581f2-cafb-4215-851e-885cfd9f5794 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:30.864836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3581f2-cafb-4215-851e-885cfd9f5794 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:30.871079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d2919-01b5-4b5a-be44-e312deec16ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:30.872653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d2919-01b5-4b5a-be44-e312deec16ce admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:30.872653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d2919-01b5-4b5a-be44-e312deec16ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:30.873045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d2919-01b5-4b5a-be44-e312deec16ce admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:30.873982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d2919-01b5-4b5a-be44-e312deec16ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:15:30.874300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d2919-01b5-4b5a-be44-e312deec16ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:30.878146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d2919-01b5-4b5a-be44-e312deec16ce admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:30.898555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36030ce-5804-4e98-9145-39a8ee61be45 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:30.900314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36030ce-5804-4e98-9145-39a8ee61be45 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:30.901165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36030ce-5804-4e98-9145-39a8ee61be45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:30.909381 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2092/4189] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:15:30.910860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d2919-01b5-4b5a-be44-e312deec16ce admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:30.935464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d2919-01b5-4b5a-be44-e312deec16ce admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:30.938193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce938c-97e0-40d9-a7c9-5e0d254330e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:30.939577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce938c-97e0-40d9-a7c9-5e0d254330e3 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:30.940170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce938c-97e0-40d9-a7c9-5e0d254330e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:30.940525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce938c-97e0-40d9-a7c9-5e0d254330e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:30.941277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce938c-97e0-40d9-a7c9-5e0d254330e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:30.943989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce938c-97e0-40d9-a7c9-5e0d254330e3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:30.996488 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2093/4190] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:15:30 2022] POST /identity/v3/projects => generated 379 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:15:30.998614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce938c-97e0-40d9-a7c9-5e0d254330e3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:31.017128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c36030ce-5804-4e98-9145-39a8ee61be45 None None] MFA Rules not processed for user `fed2e7125f98476c8083cab9b20aa1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:31.021127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c36030ce-5804-4e98-9145-39a8ee61be45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:31.189365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce938c-97e0-40d9-a7c9-5e0d254330e3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:31.209770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce893a64-5c30-455e-9cc2-3f82bd715075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:31.209989 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2098/4191] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:31.210097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce893a64-5c30-455e-9cc2-3f82bd715075 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:31.210097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce893a64-5c30-455e-9cc2-3f82bd715075 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:31.210097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce893a64-5c30-455e-9cc2-3f82bd715075 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:31.210097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce893a64-5c30-455e-9cc2-3f82bd715075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:31.210097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce893a64-5c30-455e-9cc2-3f82bd715075 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:31.234429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36030ce-5804-4e98-9145-39a8ee61be45 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:31.237944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c36030ce-5804-4e98-9145-39a8ee61be45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:31.270472 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2094/4192] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:15:30 2022] POST /identity/v3/users => generated 290 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:15:31.276320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce893a64-5c30-455e-9cc2-3f82bd715075 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:31.300260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce893a64-5c30-455e-9cc2-3f82bd715075 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:31.318013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f885d21-c9ee-4036-a039-4dcf9d92f540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:31.318531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f885d21-c9ee-4036-a039-4dcf9d92f540 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:31.318810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f885d21-c9ee-4036-a039-4dcf9d92f540 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:31.319154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f885d21-c9ee-4036-a039-4dcf9d92f540 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:31.319997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f885d21-c9ee-4036-a039-4dcf9d92f540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:31.321801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f885d21-c9ee-4036-a039-4dcf9d92f540 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:31.326643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:31.347143 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2095/4193] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:15:31.350876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f885d21-c9ee-4036-a039-4dcf9d92f540 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:31.385380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f885d21-c9ee-4036-a039-4dcf9d92f540 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:31.397081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e52fd2-42a2-422e-8481-2830b10ec4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:31.397081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e52fd2-42a2-422e-8481-2830b10ec4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:31.397431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e52fd2-42a2-422e-8481-2830b10ec4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:31.397548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e52fd2-42a2-422e-8481-2830b10ec4a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:31.398276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e52fd2-42a2-422e-8481-2830b10ec4a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:31.400111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e52fd2-42a2-422e-8481-2830b10ec4a6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:31.417425 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2096/4194] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:15:31.424184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e52fd2-42a2-422e-8481-2830b10ec4a6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:31.426617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36030ce-5804-4e98-9145-39a8ee61be45 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:31.453295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ecffc-c28a-43a6-9523-1be3ab4950da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:31.453953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ecffc-c28a-43a6-9523-1be3ab4950da service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:31.454244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ecffc-c28a-43a6-9523-1be3ab4950da service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:31.454521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ecffc-c28a-43a6-9523-1be3ab4950da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:31.457973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e52fd2-42a2-422e-8481-2830b10ec4a6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:31.472051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51472d-305d-4f9f-8fca-51e2c7856634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:31.477384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51472d-305d-4f9f-8fca-51e2c7856634 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:31.477684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51472d-305d-4f9f-8fca-51e2c7856634 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:31.477984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51472d-305d-4f9f-8fca-51e2c7856634 admin admin] PATH_INFO: `/v3/projects/c378ab8f7d65496aa3e51d7079408fca/users/6d34b989ff9741ad93810b6ea47cd998/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:31.479561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ecffc-c28a-43a6-9523-1be3ab4950da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:31.483467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ecffc-c28a-43a6-9523-1be3ab4950da service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:31.509015 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2099/4195] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:31.514356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51472d-305d-4f9f-8fca-51e2c7856634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c378ab8f7d65496aa3e51d7079408fca, user_id=6d34b989ff9741ad93810b6ea47cd998, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:31.517242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51472d-305d-4f9f-8fca-51e2c7856634 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:31.537439 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2097/4196] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:15:31 2022] PUT /identity/v3/projects/c378ab8f7d65496aa3e51d7079408fca/users/6d34b989ff9741ad93810b6ea47cd998/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:31.549025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c1085-6e29-4e9e-abdb-1e1aad722de8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:31.550799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c1085-6e29-4e9e-abdb-1e1aad722de8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:31.551365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c1085-6e29-4e9e-abdb-1e1aad722de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:31.596820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-975c1085-6e29-4e9e-abdb-1e1aad722de8 None None] MFA Rules not processed for user `6d34b989ff9741ad93810b6ea47cd998`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:31.598835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-975c1085-6e29-4e9e-abdb-1e1aad722de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:31.752230 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2100/4197] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:31.766894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51472d-305d-4f9f-8fca-51e2c7856634 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:31.768679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2e51472d-305d-4f9f-8fca-51e2c7856634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:31.791348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:31.937830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51472d-305d-4f9f-8fca-51e2c7856634 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:31.945164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f248a9-0820-484d-85c4-8d25411e0764 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:31.946065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f248a9-0820-484d-85c4-8d25411e0764 service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:31.946616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f248a9-0820-484d-85c4-8d25411e0764 service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:31.947169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f248a9-0820-484d-85c4-8d25411e0764 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:31.971389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f248a9-0820-484d-85c4-8d25411e0764 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:31.973423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f248a9-0820-484d-85c4-8d25411e0764 service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:31.989812 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2098/4198] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:32.630077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c1085-6e29-4e9e-abdb-1e1aad722de8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:32.773921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c1085-6e29-4e9e-abdb-1e1aad722de8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:32.817252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5c02a-9aeb-40fa-8403-1c79ff233032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:32.818416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5c02a-9aeb-40fa-8403-1c79ff233032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:32.818708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5c02a-9aeb-40fa-8403-1c79ff233032 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:32.818998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5c02a-9aeb-40fa-8403-1c79ff233032 admin admin] PATH_INFO: `/v3/users/6d34b989ff9741ad93810b6ea47cd998` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:32.822452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5c02a-9aeb-40fa-8403-1c79ff233032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d34b989ff9741ad93810b6ea47cd998)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:32.827236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5c02a-9aeb-40fa-8403-1c79ff233032 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:32.947450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fff5c02a-9aeb-40fa-8403-1c79ff233032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d34b989ff9741ad93810b6ea47cd998'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:32.954637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:33.038523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fff5c02a-9aeb-40fa-8403-1c79ff233032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d34b989ff9741ad93810b6ea47cd998'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:33.041633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fff5c02a-9aeb-40fa-8403-1c79ff233032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d34b989ff9741ad93810b6ea47cd998'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:33.056019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fff5c02a-9aeb-40fa-8403-1c79ff233032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d34b989ff9741ad93810b6ea47cd998'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:33.058198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fff5c02a-9aeb-40fa-8403-1c79ff233032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d34b989ff9741ad93810b6ea47cd998'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:33.094586 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2101/4199] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:15:32 2022] DELETE /identity/v3/users/6d34b989ff9741ad93810b6ea47cd998 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:33.099185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1240d2-db1a-4878-9821-7e467d81917f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:33.099864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1240d2-db1a-4878-9821-7e467d81917f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:33.099864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1240d2-db1a-4878-9821-7e467d81917f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:33.136999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4a1240d2-db1a-4878-9821-7e467d81917f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:33.138682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4a1240d2-db1a-4878-9821-7e467d81917f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:33.281194 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2099/4200] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:33.318165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5c02a-9aeb-40fa-8403-1c79ff233032 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:33.321274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fff5c02a-9aeb-40fa-8403-1c79ff233032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:33.496017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5c02a-9aeb-40fa-8403-1c79ff233032 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:33.507032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011275e-52bf-4841-ba09-193a63eab7dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:33.509482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011275e-52bf-4841-ba09-193a63eab7dc service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:33.510049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011275e-52bf-4841-ba09-193a63eab7dc service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:33.510497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011275e-52bf-4841-ba09-193a63eab7dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:33.541335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011275e-52bf-4841-ba09-193a63eab7dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:33.543266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011275e-52bf-4841-ba09-193a63eab7dc service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:33.595270 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2102/4201] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:33.888383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1240d2-db1a-4878-9821-7e467d81917f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:33.891519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4a1240d2-db1a-4878-9821-7e467d81917f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:33.928941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1240d2-db1a-4878-9821-7e467d81917f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:33.946131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06004250-3095-4b6d-acd5-38596fec8b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:33.948511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06004250-3095-4b6d-acd5-38596fec8b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:33.950580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06004250-3095-4b6d-acd5-38596fec8b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:33.950870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06004250-3095-4b6d-acd5-38596fec8b99 admin admin] PATH_INFO: `/v3/users/28f39af9487e4dee8e84bbbf58a85124` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:33.960931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06004250-3095-4b6d-acd5-38596fec8b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28f39af9487e4dee8e84bbbf58a85124)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:33.963223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06004250-3095-4b6d-acd5-38596fec8b99 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:34.069068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-06004250-3095-4b6d-acd5-38596fec8b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28f39af9487e4dee8e84bbbf58a85124'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:34.069929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-06004250-3095-4b6d-acd5-38596fec8b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28f39af9487e4dee8e84bbbf58a85124'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:34.096685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-06004250-3095-4b6d-acd5-38596fec8b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28f39af9487e4dee8e84bbbf58a85124'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:34.099889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-06004250-3095-4b6d-acd5-38596fec8b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28f39af9487e4dee8e84bbbf58a85124'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:34.115789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-06004250-3095-4b6d-acd5-38596fec8b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28f39af9487e4dee8e84bbbf58a85124'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:34.138479 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2100/4202] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:15:33 2022] DELETE /identity/v3/users/28f39af9487e4dee8e84bbbf58a85124 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:34.143597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc990-5bc9-4ae3-ab9a-c4b0b9da9ef8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:34.144037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc990-5bc9-4ae3-ab9a-c4b0b9da9ef8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:34.144037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc990-5bc9-4ae3-ab9a-c4b0b9da9ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:34.166455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-53edc990-5bc9-4ae3-ab9a-c4b0b9da9ef8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:34.167806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-53edc990-5bc9-4ae3-ab9a-c4b0b9da9ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:34.251315 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2103/4203] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:34.305950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06004250-3095-4b6d-acd5-38596fec8b99 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:34.307591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-06004250-3095-4b6d-acd5-38596fec8b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:34.363954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:34.447174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06004250-3095-4b6d-acd5-38596fec8b99 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:34.452512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155bcec-f0be-4355-92a8-d43c3f3af4a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:34.453144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155bcec-f0be-4355-92a8-d43c3f3af4a7 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:34.453828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155bcec-f0be-4355-92a8-d43c3f3af4a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:34.454117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155bcec-f0be-4355-92a8-d43c3f3af4a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:34.469106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155bcec-f0be-4355-92a8-d43c3f3af4a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:34.472011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155bcec-f0be-4355-92a8-d43c3f3af4a7 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:34.490781 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2101/4204] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:35.097478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edc990-5bc9-4ae3-ab9a-c4b0b9da9ef8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:35.099174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-53edc990-5bc9-4ae3-ab9a-c4b0b9da9ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:35.123150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edc990-5bc9-4ae3-ab9a-c4b0b9da9ef8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:35.136748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f04b4d-4fac-4455-9331-304c83ad61b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:35.138356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f04b4d-4fac-4455-9331-304c83ad61b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:35.138865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f04b4d-4fac-4455-9331-304c83ad61b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:35.139595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f04b4d-4fac-4455-9331-304c83ad61b2 admin admin] PATH_INFO: `/v3/projects/c378ab8f7d65496aa3e51d7079408fca` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:35.141382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f04b4d-4fac-4455-9331-304c83ad61b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c378ab8f7d65496aa3e51d7079408fca)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:35.143559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f04b4d-4fac-4455-9331-304c83ad61b2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:35.266574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a1f04b4d-4fac-4455-9331-304c83ad61b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c378ab8f7d65496aa3e51d7079408fca', 'request_id': 'req-a1f04b4d-4fac-4455-9331-304c83ad61b2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:35.276996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a1f04b4d-4fac-4455-9331-304c83ad61b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c378ab8f7d65496aa3e51d7079408fca', 'request_id': 'req-a1f04b4d-4fac-4455-9331-304c83ad61b2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:35.290040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a1f04b4d-4fac-4455-9331-304c83ad61b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c378ab8f7d65496aa3e51d7079408fca', 'request_id': 'req-a1f04b4d-4fac-4455-9331-304c83ad61b2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:35.293201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:35.311151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a1f04b4d-4fac-4455-9331-304c83ad61b2 admin admin] The token cache is being invalidate because project c378ab8f7d65496aa3e51d7079408fca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:15:35.311516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a1f04b4d-4fac-4455-9331-304c83ad61b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:35.312748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a1f04b4d-4fac-4455-9331-304c83ad61b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:35.316276 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2104/4205] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:15:35 2022] DELETE /identity/v3/projects/c378ab8f7d65496aa3e51d7079408fca => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:35.321900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e7605-93ad-4799-936f-6b04ece31165 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:35.323662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e7605-93ad-4799-936f-6b04ece31165 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:35.324160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e7605-93ad-4799-936f-6b04ece31165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:35.381181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e19e7605-93ad-4799-936f-6b04ece31165 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:35.383268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e19e7605-93ad-4799-936f-6b04ece31165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:35.442603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f04b4d-4fac-4455-9331-304c83ad61b2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:35.445841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a1f04b4d-4fac-4455-9331-304c83ad61b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:35.536384 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2102/4206] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:35.544593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4792c6-f134-45fb-ad67-aebf8dbb5d6b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:35.544937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4792c6-f134-45fb-ad67-aebf8dbb5d6b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:35.545227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4792c6-f134-45fb-ad67-aebf8dbb5d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:35.594145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f04b4d-4fac-4455-9331-304c83ad61b2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:35.595531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ec4792c6-f134-45fb-ad67-aebf8dbb5d6b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:35.596821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ec4792c6-f134-45fb-ad67-aebf8dbb5d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:35.603609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271c604-683a-42ef-9d4d-a5bfb1cae26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:35.604996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271c604-683a-42ef-9d4d-a5bfb1cae26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:35.605628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271c604-683a-42ef-9d4d-a5bfb1cae26b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:35.606756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271c604-683a-42ef-9d4d-a5bfb1cae26b admin admin] PATH_INFO: `/v3/projects/89f89748dd014b50ba710e4a2e82381d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:35.609351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271c604-683a-42ef-9d4d-a5bfb1cae26b admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f89748dd014b50ba710e4a2e82381d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:35.611788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271c604-683a-42ef-9d4d-a5bfb1cae26b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:35.621570 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2103/4207] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:35.626322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4792c6-f134-45fb-ad67-aebf8dbb5d6b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:35.652614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4792c6-f134-45fb-ad67-aebf8dbb5d6b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:35.673164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392c383-637e-476a-b648-e736bc9396e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:35.673820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392c383-637e-476a-b648-e736bc9396e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:35.674104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392c383-637e-476a-b648-e736bc9396e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:35.674384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392c383-637e-476a-b648-e736bc9396e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:35.675104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392c383-637e-476a-b648-e736bc9396e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:15:35.675492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392c383-637e-476a-b648-e736bc9396e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:35.677130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392c383-637e-476a-b648-e736bc9396e2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:35.712719 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2104/4208] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:15:35.713858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392c383-637e-476a-b648-e736bc9396e2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:35.738090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392c383-637e-476a-b648-e736bc9396e2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:35.764000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a271c604-683a-42ef-9d4d-a5bfb1cae26b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f89748dd014b50ba710e4a2e82381d', 'request_id': 'req-a271c604-683a-42ef-9d4d-a5bfb1cae26b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:35.775139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a271c604-683a-42ef-9d4d-a5bfb1cae26b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f89748dd014b50ba710e4a2e82381d', 'request_id': 'req-a271c604-683a-42ef-9d4d-a5bfb1cae26b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:35.799664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a271c604-683a-42ef-9d4d-a5bfb1cae26b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f89748dd014b50ba710e4a2e82381d', 'request_id': 'req-a271c604-683a-42ef-9d4d-a5bfb1cae26b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:35.851344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a271c604-683a-42ef-9d4d-a5bfb1cae26b admin admin] The token cache is being invalidate because project 89f89748dd014b50ba710e4a2e82381d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:15:35.851939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a271c604-683a-42ef-9d4d-a5bfb1cae26b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:35.854399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a271c604-683a-42ef-9d4d-a5bfb1cae26b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:35.858610 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2105/4209] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:15:35 2022] DELETE /identity/v3/projects/89f89748dd014b50ba710e4a2e82381d => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:35.868122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be207da-0e53-49e5-a314-5afe90e02f52 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:35.868710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be207da-0e53-49e5-a314-5afe90e02f52 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:35.869182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be207da-0e53-49e5-a314-5afe90e02f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:35.908041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1be207da-0e53-49e5-a314-5afe90e02f52 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:35.920832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1be207da-0e53-49e5-a314-5afe90e02f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:35.948470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f992e-d85f-435c-bbc0-ffc9a1830be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:35.949926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f992e-d85f-435c-bbc0-ffc9a1830be2 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:35.949926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f992e-d85f-435c-bbc0-ffc9a1830be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:35.949926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f992e-d85f-435c-bbc0-ffc9a1830be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:35.950950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f992e-d85f-435c-bbc0-ffc9a1830be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:35.956779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f992e-d85f-435c-bbc0-ffc9a1830be2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:36.032592 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2106/4210] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:36.041630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c6a5e-e73e-4e28-81c8-d74892a370fb None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:36.042132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c6a5e-e73e-4e28-81c8-d74892a370fb None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:36.043054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c6a5e-e73e-4e28-81c8-d74892a370fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:36.052641 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2105/4211] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:15:35 2022] POST /identity/v3/projects => generated 367 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:15:36.053813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f992e-d85f-435c-bbc0-ffc9a1830be2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:36.057628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-967f992e-d85f-435c-bbc0-ffc9a1830be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:36.071547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-6a8c6a5e-e73e-4e28-81c8-d74892a370fb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:36.073018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6a8c6a5e-e73e-4e28-81c8-d74892a370fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:36.122929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:36.135242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:36.213796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f992e-d85f-435c-bbc0-ffc9a1830be2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:36.227084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4dc1a-52cd-4f75-b145-953ff9d494fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:36.228725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4dc1a-52cd-4f75-b145-953ff9d494fd admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:36.229415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4dc1a-52cd-4f75-b145-953ff9d494fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:36.230473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4dc1a-52cd-4f75-b145-953ff9d494fd admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:36.232428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4dc1a-52cd-4f75-b145-953ff9d494fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:36.235663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4dc1a-52cd-4f75-b145-953ff9d494fd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:36.249983 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2107/4212] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:36.254113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1785e-b576-4296-a3ce-33fb140f5bc7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:36.254669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1785e-b576-4296-a3ce-33fb140f5bc7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:36.255484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1785e-b576-4296-a3ce-33fb140f5bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:36.280601 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2106/4213] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:15:36 2022] POST /identity/v3/users => generated 284 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:15:36.280818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0df1785e-b576-4296-a3ce-33fb140f5bc7 None None] MFA Rules not processed for user `fed2e7125f98476c8083cab9b20aa1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:36.282180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0df1785e-b576-4296-a3ce-33fb140f5bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:36.283368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4dc1a-52cd-4f75-b145-953ff9d494fd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:36.298731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4dc1a-52cd-4f75-b145-953ff9d494fd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:36.307989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf5b00-4544-4b92-9c4b-b6e2e32557c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:36.308864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf5b00-4544-4b92-9c4b-b6e2e32557c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:36.309487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf5b00-4544-4b92-9c4b-b6e2e32557c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:36.310007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf5b00-4544-4b92-9c4b-b6e2e32557c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:36.310983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf5b00-4544-4b92-9c4b-b6e2e32557c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:15:36.312204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf5b00-4544-4b92-9c4b-b6e2e32557c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:36.314271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf5b00-4544-4b92-9c4b-b6e2e32557c1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:36.342356 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2107/4214] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:15:36.344286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf5b00-4544-4b92-9c4b-b6e2e32557c1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:36.361817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf5b00-4544-4b92-9c4b-b6e2e32557c1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:36.370541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d55b3-abac-4079-a23c-58bd6296ffd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:36.371396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d55b3-abac-4079-a23c-58bd6296ffd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:36.371770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d55b3-abac-4079-a23c-58bd6296ffd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:36.372125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d55b3-abac-4079-a23c-58bd6296ffd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:36.372932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d55b3-abac-4079-a23c-58bd6296ffd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:36.374858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d55b3-abac-4079-a23c-58bd6296ffd0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:36.393109 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2108/4215] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:15:36.397691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d55b3-abac-4079-a23c-58bd6296ffd0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:36.412501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d55b3-abac-4079-a23c-58bd6296ffd0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:36.415312 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2108/4216] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:36.416353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1785e-b576-4296-a3ce-33fb140f5bc7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:36.433997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df141e-2652-4798-9460-2c5308fe1536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:36.435171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df141e-2652-4798-9460-2c5308fe1536 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:36.436721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df141e-2652-4798-9460-2c5308fe1536 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:36.438379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df141e-2652-4798-9460-2c5308fe1536 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:36.439257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df141e-2652-4798-9460-2c5308fe1536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:36.446224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1785e-b576-4296-a3ce-33fb140f5bc7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:36.446725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df141e-2652-4798-9460-2c5308fe1536 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:36.456754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892244f-65da-4749-ad36-38f8c7e8b6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:36.457396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892244f-65da-4749-ad36-38f8c7e8b6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:36.457682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892244f-65da-4749-ad36-38f8c7e8b6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:36.457957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892244f-65da-4749-ad36-38f8c7e8b6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:36.458767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892244f-65da-4749-ad36-38f8c7e8b6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:36.461447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892244f-65da-4749-ad36-38f8c7e8b6f8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:36.490634 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2109/4217] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:15:36.494519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892244f-65da-4749-ad36-38f8c7e8b6f8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:36.536707 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2109/4218] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:15:36 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:15:36.539634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df141e-2652-4798-9460-2c5308fe1536 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:36.555002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892244f-65da-4749-ad36-38f8c7e8b6f8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:36.642045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df141e-2652-4798-9460-2c5308fe1536 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:36.648934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850f807-1b1d-4bed-a467-c5d9739c156c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:36.649967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850f807-1b1d-4bed-a467-c5d9739c156c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:36.650610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850f807-1b1d-4bed-a467-c5d9739c156c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:36.650783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850f807-1b1d-4bed-a467-c5d9739c156c admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:36.651631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850f807-1b1d-4bed-a467-c5d9739c156c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:36.654557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850f807-1b1d-4bed-a467-c5d9739c156c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:36.696675 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2110/4219] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:15:36 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:15:36.701974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850f807-1b1d-4bed-a467-c5d9739c156c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:36.718920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850f807-1b1d-4bed-a467-c5d9739c156c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:36.733843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd95b6a-3073-46de-8820-359cf2896591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:36.734965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd95b6a-3073-46de-8820-359cf2896591 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:36.735694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd95b6a-3073-46de-8820-359cf2896591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:36.736234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd95b6a-3073-46de-8820-359cf2896591 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:36.737818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd95b6a-3073-46de-8820-359cf2896591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:36.739794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd95b6a-3073-46de-8820-359cf2896591 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:36.756618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0779f95-dd3d-4758-bfa4-be0a9a017591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:36.756618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0779f95-dd3d-4758-bfa4-be0a9a017591 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:36.756618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0779f95-dd3d-4758-bfa4-be0a9a017591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:36.757019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0779f95-dd3d-4758-bfa4-be0a9a017591 admin admin] PATH_INFO: `/v3/projects/890ecd5a6f4941dca5a54ddf380e4fdf/users/ef1e17e0670648d8ac6e93568ff4aa7a/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:36.758985 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2111/4220] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:15:36.765782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd95b6a-3073-46de-8820-359cf2896591 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:36.781468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd95b6a-3073-46de-8820-359cf2896591 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:36.790450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6745d8-ff12-4741-a63a-7746b3bcebf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:36.792026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6745d8-ff12-4741-a63a-7746b3bcebf6 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:36.792604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6745d8-ff12-4741-a63a-7746b3bcebf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:36.793842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6745d8-ff12-4741-a63a-7746b3bcebf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:36.795201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6745d8-ff12-4741-a63a-7746b3bcebf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:36.797374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6745d8-ff12-4741-a63a-7746b3bcebf6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:36.811929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0779f95-dd3d-4758-bfa4-be0a9a017591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=890ecd5a6f4941dca5a54ddf380e4fdf, user_id=ef1e17e0670648d8ac6e93568ff4aa7a, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:36.815027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0779f95-dd3d-4758-bfa4-be0a9a017591 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:36.818332 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2112/4221] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:15:36.822689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6745d8-ff12-4741-a63a-7746b3bcebf6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:36.844507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6745d8-ff12-4741-a63a-7746b3bcebf6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:36.849721 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2110/4222] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:15:36 2022] PUT /identity/v3/projects/890ecd5a6f4941dca5a54ddf380e4fdf/users/ef1e17e0670648d8ac6e93568ff4aa7a/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:36.860936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94860d24-030a-488b-bf0b-e66347eded93 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:36.861253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94860d24-030a-488b-bf0b-e66347eded93 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:36.861616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94860d24-030a-488b-bf0b-e66347eded93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:36.938249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:36.942447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-94860d24-030a-488b-bf0b-e66347eded93 None None] MFA Rules not processed for user `ef1e17e0670648d8ac6e93568ff4aa7a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:36.943779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-94860d24-030a-488b-bf0b-e66347eded93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:36.962468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210163f-7a31-4731-8184-ea29ffa651e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:36.963229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210163f-7a31-4731-8184-ea29ffa651e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:36.963606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210163f-7a31-4731-8184-ea29ffa651e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:36.964281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210163f-7a31-4731-8184-ea29ffa651e8 admin admin] PATH_INFO: `/v3/projects/73245fdcb10c4144a60fa8ca6b6a7ab8/users/23ba5ddf22424eff840602440872f86e/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:36.997510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210163f-7a31-4731-8184-ea29ffa651e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73245fdcb10c4144a60fa8ca6b6a7ab8, user_id=23ba5ddf22424eff840602440872f86e, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:37.001383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210163f-7a31-4731-8184-ea29ffa651e8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:37.026463 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2113/4223] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:15:36 2022] PUT /identity/v3/projects/73245fdcb10c4144a60fa8ca6b6a7ab8/users/23ba5ddf22424eff840602440872f86e/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:37.032863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae4a3e-478d-47c7-b3d7-294cf142b974 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:37.035508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae4a3e-478d-47c7-b3d7-294cf142b974 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:37.035975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae4a3e-478d-47c7-b3d7-294cf142b974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:37.043346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:37.072019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-daae4a3e-478d-47c7-b3d7-294cf142b974 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:37.076422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-daae4a3e-478d-47c7-b3d7-294cf142b974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:37.175595 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2111/4224] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:37.179929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94860d24-030a-488b-bf0b-e66347eded93 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:37.214046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94860d24-030a-488b-bf0b-e66347eded93 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:37.237657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8250a-2f62-4b51-b7b1-b2bafaafb87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:37.238319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8250a-2f62-4b51-b7b1-b2bafaafb87b admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:37.238608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8250a-2f62-4b51-b7b1-b2bafaafb87b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:37.238907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8250a-2f62-4b51-b7b1-b2bafaafb87b admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:37.239815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8250a-2f62-4b51-b7b1-b2bafaafb87b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:37.242372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8250a-2f62-4b51-b7b1-b2bafaafb87b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:37.255279 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2114/4225] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:37.308828 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2112/4226] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:15:37 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:15:37.310832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae4a3e-478d-47c7-b3d7-294cf142b974 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:37.325550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae4a3e-478d-47c7-b3d7-294cf142b974 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:37.421616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8250a-2f62-4b51-b7b1-b2bafaafb87b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:37.425454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-95e8250a-2f62-4b51-b7b1-b2bafaafb87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:37.532235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098caa3-8853-4a9c-aea6-e9ffaf941735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:37.535329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098caa3-8853-4a9c-aea6-e9ffaf941735 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:37.538905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098caa3-8853-4a9c-aea6-e9ffaf941735 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:37.539422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098caa3-8853-4a9c-aea6-e9ffaf941735 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:37.540335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098caa3-8853-4a9c-aea6-e9ffaf941735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:37.548166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098caa3-8853-4a9c-aea6-e9ffaf941735 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:37.576433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8250a-2f62-4b51-b7b1-b2bafaafb87b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:37.593599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e7f97-3dcc-45e0-b785-d57e0a043673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:37.594718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e7f97-3dcc-45e0-b785-d57e0a043673 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:37.595168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e7f97-3dcc-45e0-b785-d57e0a043673 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:37.595834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e7f97-3dcc-45e0-b785-d57e0a043673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:37.619275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e7f97-3dcc-45e0-b785-d57e0a043673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:37.622137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e7f97-3dcc-45e0-b785-d57e0a043673 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:37.638559 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2115/4227] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:15:37 2022] POST /identity/v3/users => generated 291 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:15:37.644061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098caa3-8853-4a9c-aea6-e9ffaf941735 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:37.655828 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2113/4228] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:37.678880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098caa3-8853-4a9c-aea6-e9ffaf941735 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:37.698798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90f78a-cbe6-46b7-8b3d-3a0c42b7e12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:37.703925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90f78a-cbe6-46b7-8b3d-3a0c42b7e12e admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:37.704380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90f78a-cbe6-46b7-8b3d-3a0c42b7e12e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:37.704678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90f78a-cbe6-46b7-8b3d-3a0c42b7e12e admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:37.705525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90f78a-cbe6-46b7-8b3d-3a0c42b7e12e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:37.711244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90f78a-cbe6-46b7-8b3d-3a0c42b7e12e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:37.744641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e7f97-3dcc-45e0-b785-d57e0a043673 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:37.745034 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2116/4229] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:15:37.767453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e7f97-3dcc-45e0-b785-d57e0a043673 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:37.789208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bd272-4852-475b-add8-32b66f82250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:37.790153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bd272-4852-475b-add8-32b66f82250f admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:37.790567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bd272-4852-475b-add8-32b66f82250f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:37.790924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bd272-4852-475b-add8-32b66f82250f admin admin] PATH_INFO: `/v3/projects/c9285ce2616a47f9afefd202323865e0/users/cca36e5df85a4980a8716ce1b17c1a42/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:37.833158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bd272-4852-475b-add8-32b66f82250f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9285ce2616a47f9afefd202323865e0, user_id=cca36e5df85a4980a8716ce1b17c1a42, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:37.836815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bd272-4852-475b-add8-32b66f82250f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:37.870311 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2114/4230] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:15:37 2022] PUT /identity/v3/projects/c9285ce2616a47f9afefd202323865e0/users/cca36e5df85a4980a8716ce1b17c1a42/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:15:37.874657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90f78a-cbe6-46b7-8b3d-3a0c42b7e12e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:37.892500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90f78a-cbe6-46b7-8b3d-3a0c42b7e12e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:37.997636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:38.037377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc841e8-f2bd-47fd-abd7-d8c84a753acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:38.038506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc841e8-f2bd-47fd-abd7-d8c84a753acc admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:38.039018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc841e8-f2bd-47fd-abd7-d8c84a753acc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:38.039543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc841e8-f2bd-47fd-abd7-d8c84a753acc admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:38.040503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc841e8-f2bd-47fd-abd7-d8c84a753acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:38.047273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc841e8-f2bd-47fd-abd7-d8c84a753acc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:38.083097 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2117/4231] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:15:38.087270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bd272-4852-475b-add8-32b66f82250f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:38.106903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bd272-4852-475b-add8-32b66f82250f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:38.119605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746da03-90e1-4729-b019-bd3e444c7372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:38.120477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746da03-90e1-4729-b019-bd3e444c7372 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:38.120767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746da03-90e1-4729-b019-bd3e444c7372 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:38.121080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746da03-90e1-4729-b019-bd3e444c7372 admin admin] PATH_INFO: `/v3/projects/c9285ce2616a47f9afefd202323865e0/users/cca36e5df85a4980a8716ce1b17c1a42/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:38.124504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746da03-90e1-4729-b019-bd3e444c7372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9285ce2616a47f9afefd202323865e0, user_id=cca36e5df85a4980a8716ce1b17c1a42, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:38.127401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746da03-90e1-4729-b019-bd3e444c7372 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:38.160769 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2115/4232] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:15:38 2022] PUT /identity/v3/projects/c9285ce2616a47f9afefd202323865e0/users/cca36e5df85a4980a8716ce1b17c1a42/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:38.174155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72c682-1401-490a-9724-eb2469d8d87c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:38.174533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72c682-1401-490a-9724-eb2469d8d87c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:38.174824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72c682-1401-490a-9724-eb2469d8d87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:38.248882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-de72c682-1401-490a-9724-eb2469d8d87c None None] MFA Rules not processed for user `cca36e5df85a4980a8716ce1b17c1a42`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:38.250218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-de72c682-1401-490a-9724-eb2469d8d87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:38.414853 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2118/4233] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:38 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:15:38.435396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746da03-90e1-4729-b019-bd3e444c7372 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:38.438429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1746da03-90e1-4729-b019-bd3e444c7372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:38.592962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746da03-90e1-4729-b019-bd3e444c7372 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:38.617837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d0862-38ce-4d66-95f2-c3f656548bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:38.619970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d0862-38ce-4d66-95f2-c3f656548bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:38.621249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d0862-38ce-4d66-95f2-c3f656548bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:38.622994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d0862-38ce-4d66-95f2-c3f656548bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:38.646094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d0862-38ce-4d66-95f2-c3f656548bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:38.647869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d0862-38ce-4d66-95f2-c3f656548bb7 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:38.661153 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2116/4234] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:38 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:40.852359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0218544-96db-42c9-8c53-4f444947800f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:40.853616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0218544-96db-42c9-8c53-4f444947800f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:40.853616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0218544-96db-42c9-8c53-4f444947800f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:40.943427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a0218544-96db-42c9-8c53-4f444947800f None None] MFA Rules not processed for user `4ef2420cd50d4006b7ba4e651fdaaaaa`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:40.948815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a0218544-96db-42c9-8c53-4f444947800f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:41.278779 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2119/4235] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:41.288656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac3d3c-f962-4148-9bb8-d12e3c65ec2c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:41.290259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac3d3c-f962-4148-9bb8-d12e3c65ec2c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:41.290719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac3d3c-f962-4148-9bb8-d12e3c65ec2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:41.347927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c3ac3d3c-f962-4148-9bb8-d12e3c65ec2c None None] MFA Rules not processed for user `4ef2420cd50d4006b7ba4e651fdaaaaa`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:41.349886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c3ac3d3c-f962-4148-9bb8-d12e3c65ec2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:41.370024 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2117/4236] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:41.385578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0218544-96db-42c9-8c53-4f444947800f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:41.392256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a0218544-96db-42c9-8c53-4f444947800f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:41.495184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:41.511829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0218544-96db-42c9-8c53-4f444947800f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:41.525682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d3ef9-f6ee-49bd-98e4-ab665f24683a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:41.526737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d3ef9-f6ee-49bd-98e4-ab665f24683a service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:41.527688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d3ef9-f6ee-49bd-98e4-ab665f24683a service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:41.528819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d3ef9-f6ee-49bd-98e4-ab665f24683a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:41.541897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d3ef9-f6ee-49bd-98e4-ab665f24683a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:41.545129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d3ef9-f6ee-49bd-98e4-ab665f24683a service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:41.561770 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2120/4237] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:43.704314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d3ef9-f6ee-49bd-98e4-ab665f24683a service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:43.714801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac3d3c-f962-4148-9bb8-d12e3c65ec2c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:43.721520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c3ac3d3c-f962-4148-9bb8-d12e3c65ec2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:43.766662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:43.970901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d3ef9-f6ee-49bd-98e4-ab665f24683a service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:43.985133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b9496-570c-4995-8516-97d2a4fd83bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:43.988760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b9496-570c-4995-8516-97d2a4fd83bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:43.989601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b9496-570c-4995-8516-97d2a4fd83bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:43.991025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b9496-570c-4995-8516-97d2a4fd83bb admin admin] PATH_INFO: `/v3/users/ef1e17e0670648d8ac6e93568ff4aa7a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:43.992674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac3d3c-f962-4148-9bb8-d12e3c65ec2c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:43.995022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b9496-570c-4995-8516-97d2a4fd83bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef1e17e0670648d8ac6e93568ff4aa7a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:44.003131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b9496-570c-4995-8516-97d2a4fd83bb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:44.008426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77613a47-6196-414b-a35d-ba990ecb7b54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:44.009082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77613a47-6196-414b-a35d-ba990ecb7b54 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:44.009366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77613a47-6196-414b-a35d-ba990ecb7b54 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:44.009642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77613a47-6196-414b-a35d-ba990ecb7b54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:44.016601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-77613a47-6196-414b-a35d-ba990ecb7b54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:44.061709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77613a47-6196-414b-a35d-ba990ecb7b54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:44.065266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77613a47-6196-414b-a35d-ba990ecb7b54 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:44.108690 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2118/4238] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:44.110366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad30405-3e41-4631-9200-e2afe00c6a11 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:44.112069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad30405-3e41-4631-9200-e2afe00c6a11 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:44.118025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad30405-3e41-4631-9200-e2afe00c6a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:44.160176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-032b9496-570c-4995-8516-97d2a4fd83bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef1e17e0670648d8ac6e93568ff4aa7a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:44.164972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-032b9496-570c-4995-8516-97d2a4fd83bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef1e17e0670648d8ac6e93568ff4aa7a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:44.247148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-032b9496-570c-4995-8516-97d2a4fd83bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef1e17e0670648d8ac6e93568ff4aa7a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:44.248668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-032b9496-570c-4995-8516-97d2a4fd83bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef1e17e0670648d8ac6e93568ff4aa7a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:44.265670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7ad30405-3e41-4631-9200-e2afe00c6a11 None None] MFA Rules not processed for user `4a01092bfa5a4118a5fe61a6dc9c5460`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:44.271576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7ad30405-3e41-4631-9200-e2afe00c6a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:44.277274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-032b9496-570c-4995-8516-97d2a4fd83bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef1e17e0670648d8ac6e93568ff4aa7a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:44.344462 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2121/4239] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:15:43 2022] DELETE /identity/v3/users/ef1e17e0670648d8ac6e93568ff4aa7a => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:44.348402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b9496-570c-4995-8516-97d2a4fd83bb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:44.358302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-032b9496-570c-4995-8516-97d2a4fd83bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:44.549959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b9496-570c-4995-8516-97d2a4fd83bb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:44.572306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d58cf0-13f1-40f1-b083-e4ab45306ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:44.572984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d58cf0-13f1-40f1-b083-e4ab45306ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:44.573320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d58cf0-13f1-40f1-b083-e4ab45306ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:44.573536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d58cf0-13f1-40f1-b083-e4ab45306ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:44.583044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f4d58cf0-13f1-40f1-b083-e4ab45306ea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:44.599465 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2119/4240] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:44.611139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3a91b-c8fe-4579-913c-c70b6486cce0 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:44.611475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3a91b-c8fe-4579-913c-c70b6486cce0 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:44.612149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3a91b-c8fe-4579-913c-c70b6486cce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:44.630491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d58cf0-13f1-40f1-b083-e4ab45306ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:44.632020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d58cf0-13f1-40f1-b083-e4ab45306ea1 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:44.666739 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2122/4241] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:44.674697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0a461-a75b-4444-9970-d6111ec8dfa9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:44.676960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0a461-a75b-4444-9970-d6111ec8dfa9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:44.677765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0a461-a75b-4444-9970-d6111ec8dfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:44.690413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-05c3a91b-c8fe-4579-913c-c70b6486cce0 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:44.701627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-05c3a91b-c8fe-4579-913c-c70b6486cce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:44.712767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:44.773062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3df0a461-a75b-4444-9970-d6111ec8dfa9 None None] MFA Rules not processed for user `4a01092bfa5a4118a5fe61a6dc9c5460`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:44.774863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3df0a461-a75b-4444-9970-d6111ec8dfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:44.925621 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2123/4242] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:44.937892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0a461-a75b-4444-9970-d6111ec8dfa9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:44.940127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3df0a461-a75b-4444-9970-d6111ec8dfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:44.945896 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2120/4243] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:44.962771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3a91b-c8fe-4579-913c-c70b6486cce0 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:44.985912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3a91b-c8fe-4579-913c-c70b6486cce0 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:45.003663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe792c-499b-43bb-9e09-e5dcbb4e630c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:45.004317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe792c-499b-43bb-9e09-e5dcbb4e630c service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:45.017446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe792c-499b-43bb-9e09-e5dcbb4e630c service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:45.017818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe792c-499b-43bb-9e09-e5dcbb4e630c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:45.060936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe792c-499b-43bb-9e09-e5dcbb4e630c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:45.062528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe792c-499b-43bb-9e09-e5dcbb4e630c service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:45.080810 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2121/4244] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:15:45.214328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0a461-a75b-4444-9970-d6111ec8dfa9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:45.239864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942cbba-9dec-4dc2-8f47-6d753f04e5b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:45.241510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942cbba-9dec-4dc2-8f47-6d753f04e5b7 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:45.241801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942cbba-9dec-4dc2-8f47-6d753f04e5b7 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:45.242116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942cbba-9dec-4dc2-8f47-6d753f04e5b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:45.264707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942cbba-9dec-4dc2-8f47-6d753f04e5b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:45.273037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942cbba-9dec-4dc2-8f47-6d753f04e5b7 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:45.302933 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2124/4245] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:15:47.166141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe792c-499b-43bb-9e09-e5dcbb4e630c service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:47.167779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0ffe792c-499b-43bb-9e09-e5dcbb4e630c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:47.198376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe792c-499b-43bb-9e09-e5dcbb4e630c service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:47.203830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf59206-df98-44af-b785-5d2e249f2717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:47.204506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf59206-df98-44af-b785-5d2e249f2717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:47.204800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf59206-df98-44af-b785-5d2e249f2717 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:47.205083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf59206-df98-44af-b785-5d2e249f2717 admin admin] PATH_INFO: `/v3/projects/890ecd5a6f4941dca5a54ddf380e4fdf` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:47.208123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf59206-df98-44af-b785-5d2e249f2717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=890ecd5a6f4941dca5a54ddf380e4fdf)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:47.210042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf59206-df98-44af-b785-5d2e249f2717 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:47.240883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:47.324923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6bf59206-df98-44af-b785-5d2e249f2717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '890ecd5a6f4941dca5a54ddf380e4fdf', 'request_id': 'req-6bf59206-df98-44af-b785-5d2e249f2717'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:47.332130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6bf59206-df98-44af-b785-5d2e249f2717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '890ecd5a6f4941dca5a54ddf380e4fdf', 'request_id': 'req-6bf59206-df98-44af-b785-5d2e249f2717'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:47.352046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6bf59206-df98-44af-b785-5d2e249f2717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '890ecd5a6f4941dca5a54ddf380e4fdf', 'request_id': 'req-6bf59206-df98-44af-b785-5d2e249f2717'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:47.374054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6bf59206-df98-44af-b785-5d2e249f2717 admin admin] The token cache is being invalidate because project 890ecd5a6f4941dca5a54ddf380e4fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:15:47.374347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6bf59206-df98-44af-b785-5d2e249f2717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:47.375219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6bf59206-df98-44af-b785-5d2e249f2717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:47.384676 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2122/4246] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:15:47 2022] DELETE /identity/v3/projects/890ecd5a6f4941dca5a54ddf380e4fdf => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:47.388918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942cbba-9dec-4dc2-8f47-6d753f04e5b7 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:47.407138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942cbba-9dec-4dc2-8f47-6d753f04e5b7 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:47.550207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ad91f-78dd-4313-9b7f-52b06809fa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:47.550876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ad91f-78dd-4313-9b7f-52b06809fa49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:47.551167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ad91f-78dd-4313-9b7f-52b06809fa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:47.551489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ad91f-78dd-4313-9b7f-52b06809fa49 admin admin] PATH_INFO: `/v3/users/cca36e5df85a4980a8716ce1b17c1a42` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:47.556081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ad91f-78dd-4313-9b7f-52b06809fa49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cca36e5df85a4980a8716ce1b17c1a42)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:47.558027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ad91f-78dd-4313-9b7f-52b06809fa49 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:47.674277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:47.716201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f28ad91f-78dd-4313-9b7f-52b06809fa49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cca36e5df85a4980a8716ce1b17c1a42'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:47.721047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f28ad91f-78dd-4313-9b7f-52b06809fa49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cca36e5df85a4980a8716ce1b17c1a42'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:47.744189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f28ad91f-78dd-4313-9b7f-52b06809fa49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cca36e5df85a4980a8716ce1b17c1a42'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:47.747685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f28ad91f-78dd-4313-9b7f-52b06809fa49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cca36e5df85a4980a8716ce1b17c1a42'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:47.771375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f28ad91f-78dd-4313-9b7f-52b06809fa49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cca36e5df85a4980a8716ce1b17c1a42'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:47.801181 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2125/4247] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:15:47 2022] DELETE /identity/v3/users/cca36e5df85a4980a8716ce1b17c1a42 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:49.308532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf59206-df98-44af-b785-5d2e249f2717 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:49.311411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6bf59206-df98-44af-b785-5d2e249f2717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:49.353776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf59206-df98-44af-b785-5d2e249f2717 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:49.440479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a14d2-6d46-405c-98a7-ce260e6474b3 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:49.441573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a14d2-6d46-405c-98a7-ce260e6474b3 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:49.442083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a14d2-6d46-405c-98a7-ce260e6474b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:49.541723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-df8a14d2-6d46-405c-98a7-ce260e6474b3 None None] MFA Rules not processed for user `23ba5ddf22424eff840602440872f86e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:49.544904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-df8a14d2-6d46-405c-98a7-ce260e6474b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:49.545359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036bbba-ab1d-4cbb-8c38-b1d5309891a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:49.546346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036bbba-ab1d-4cbb-8c38-b1d5309891a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:49.546637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036bbba-ab1d-4cbb-8c38-b1d5309891a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:49.547056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036bbba-ab1d-4cbb-8c38-b1d5309891a0 admin admin] PATH_INFO: `/v3/projects/c9285ce2616a47f9afefd202323865e0` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:49.548540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036bbba-ab1d-4cbb-8c38-b1d5309891a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9285ce2616a47f9afefd202323865e0)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:49.550881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036bbba-ab1d-4cbb-8c38-b1d5309891a0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:49.700235 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2126/4248] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:15:49.713509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946205b2-2625-4f8c-80bc-fd51b1822504 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:49.714342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946205b2-2625-4f8c-80bc-fd51b1822504 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:49.716867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946205b2-2625-4f8c-80bc-fd51b1822504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:49.732293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9036bbba-ab1d-4cbb-8c38-b1d5309891a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9285ce2616a47f9afefd202323865e0', 'request_id': 'req-9036bbba-ab1d-4cbb-8c38-b1d5309891a0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:49.743146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9036bbba-ab1d-4cbb-8c38-b1d5309891a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9285ce2616a47f9afefd202323865e0', 'request_id': 'req-9036bbba-ab1d-4cbb-8c38-b1d5309891a0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:49.763369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-946205b2-2625-4f8c-80bc-fd51b1822504 None None] MFA Rules not processed for user `23ba5ddf22424eff840602440872f86e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:49.764127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9036bbba-ab1d-4cbb-8c38-b1d5309891a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9285ce2616a47f9afefd202323865e0', 'request_id': 'req-9036bbba-ab1d-4cbb-8c38-b1d5309891a0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:49.767847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-946205b2-2625-4f8c-80bc-fd51b1822504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:49.792764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9036bbba-ab1d-4cbb-8c38-b1d5309891a0 admin admin] The token cache is being invalidate because project c9285ce2616a47f9afefd202323865e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:15:49.793744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9036bbba-ab1d-4cbb-8c38-b1d5309891a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:49.796063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9036bbba-ab1d-4cbb-8c38-b1d5309891a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:49.800973 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2123/4249] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:15:49 2022] DELETE /identity/v3/projects/c9285ce2616a47f9afefd202323865e0 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:15:49.805718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae7fab-d34a-4c38-9b4f-75cf21c208c2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:49.806028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae7fab-d34a-4c38-9b4f-75cf21c208c2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:49.806373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae7fab-d34a-4c38-9b4f-75cf21c208c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:49.865017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-aaae7fab-d34a-4c38-9b4f-75cf21c208c2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:49.869050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-aaae7fab-d34a-4c38-9b4f-75cf21c208c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:49.935682 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2127/4250] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:49.939929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:49.959516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946205b2-2625-4f8c-80bc-fd51b1822504 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:49.963547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-946205b2-2625-4f8c-80bc-fd51b1822504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:50.003343 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2124/4251] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:50.006646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05974ad5-e8ff-425c-be23-af0272984481 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:50.006948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05974ad5-e8ff-425c-be23-af0272984481 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:50.007334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05974ad5-e8ff-425c-be23-af0272984481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:50.051731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-05974ad5-e8ff-425c-be23-af0272984481 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:50.053392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-05974ad5-e8ff-425c-be23-af0272984481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:50.056036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:50.073067 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2125/4252] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:50.076056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05974ad5-e8ff-425c-be23-af0272984481 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:50.089270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05974ad5-e8ff-425c-be23-af0272984481 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:50.095742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d409e-22dc-4904-b1cf-935c95fcae19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:50.096685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d409e-22dc-4904-b1cf-935c95fcae19 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:50.096977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d409e-22dc-4904-b1cf-935c95fcae19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:50.097324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d409e-22dc-4904-b1cf-935c95fcae19 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:50.098036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d409e-22dc-4904-b1cf-935c95fcae19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:15:50.098383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d409e-22dc-4904-b1cf-935c95fcae19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:50.100369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d409e-22dc-4904-b1cf-935c95fcae19 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:50.124435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946205b2-2625-4f8c-80bc-fd51b1822504 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:50.133451 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2126/4253] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:15:50.134920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d409e-22dc-4904-b1cf-935c95fcae19 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:50.152948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d409e-22dc-4904-b1cf-935c95fcae19 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:50.157306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9709c-0b0d-4a22-81c2-05f551ec43ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:50.162377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9709c-0b0d-4a22-81c2-05f551ec43ab service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:50.162808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9709c-0b0d-4a22-81c2-05f551ec43ab service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:50.164006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9709c-0b0d-4a22-81c2-05f551ec43ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:50.165088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0af0c-b628-43cb-a1d7-7942d863e77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:50.165245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0af0c-b628-43cb-a1d7-7942d863e77e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:50.166061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0af0c-b628-43cb-a1d7-7942d863e77e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:50.166061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0af0c-b628-43cb-a1d7-7942d863e77e admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:50.166538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0af0c-b628-43cb-a1d7-7942d863e77e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:50.168027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8db9709c-0b0d-4a22-81c2-05f551ec43ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:50.169804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0af0c-b628-43cb-a1d7-7942d863e77e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:50.199815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9709c-0b0d-4a22-81c2-05f551ec43ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:50.207282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9709c-0b0d-4a22-81c2-05f551ec43ab service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:50.233088 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2127/4254] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:15:50 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:15:50.237795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0af0c-b628-43cb-a1d7-7942d863e77e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:50.251862 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2128/4255] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:50.418934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0af0c-b628-43cb-a1d7-7942d863e77e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:50.432476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9348a-4f0b-46f4-89c5-f5a59acaf7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:50.433773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9348a-4f0b-46f4-89c5-f5a59acaf7bb admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:50.436433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9348a-4f0b-46f4-89c5-f5a59acaf7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:50.437293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9348a-4f0b-46f4-89c5-f5a59acaf7bb admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:50.438209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9348a-4f0b-46f4-89c5-f5a59acaf7bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:50.441445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9348a-4f0b-46f4-89c5-f5a59acaf7bb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:50.498192 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2128/4256] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:15:50 2022] POST /identity/v3/users => generated 287 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:15:50.503744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9709c-0b0d-4a22-81c2-05f551ec43ab service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:50.523645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9709c-0b0d-4a22-81c2-05f551ec43ab service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:50.530582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82c70a-22a9-4b2b-8397-3bae2d2b7d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:50.531231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82c70a-22a9-4b2b-8397-3bae2d2b7d1a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:50.531573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82c70a-22a9-4b2b-8397-3bae2d2b7d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:50.531871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82c70a-22a9-4b2b-8397-3bae2d2b7d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:50.532649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82c70a-22a9-4b2b-8397-3bae2d2b7d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:50.534941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82c70a-22a9-4b2b-8397-3bae2d2b7d1a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:50.552788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9348a-4f0b-46f4-89c5-f5a59acaf7bb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:50.554458 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2129/4257] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:15:50.570369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9348a-4f0b-46f4-89c5-f5a59acaf7bb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:50.578902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae4500-669f-440a-91bf-3044f523c3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:50.579996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae4500-669f-440a-91bf-3044f523c3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:50.580523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae4500-669f-440a-91bf-3044f523c3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:50.580978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae4500-669f-440a-91bf-3044f523c3c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:50.582502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae4500-669f-440a-91bf-3044f523c3c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:50.584332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae4500-669f-440a-91bf-3044f523c3c6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:50.600882 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2129/4258] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:15:50.606005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82c70a-22a9-4b2b-8397-3bae2d2b7d1a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:50.618446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82c70a-22a9-4b2b-8397-3bae2d2b7d1a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:50.629708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5947f-326d-44ff-8ef1-8187e91a8ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:50.630793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5947f-326d-44ff-8ef1-8187e91a8ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:50.633530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5947f-326d-44ff-8ef1-8187e91a8ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:50.634436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5947f-326d-44ff-8ef1-8187e91a8ad3 admin admin] PATH_INFO: `/v3/projects/cd82af2c13894450b5efd4752f271cab/users/b8c55588a43e4b67b99500751bb550fb/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:50.695137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5947f-326d-44ff-8ef1-8187e91a8ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd82af2c13894450b5efd4752f271cab, user_id=b8c55588a43e4b67b99500751bb550fb, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:50.698078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5947f-326d-44ff-8ef1-8187e91a8ad3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:50.722748 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2130/4259] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:15:50 2022] PUT /identity/v3/projects/cd82af2c13894450b5efd4752f271cab/users/b8c55588a43e4b67b99500751bb550fb/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:50.730667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38f435-8266-43cd-a260-47eee6a5d7e8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:50.732076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38f435-8266-43cd-a260-47eee6a5d7e8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:50.732076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38f435-8266-43cd-a260-47eee6a5d7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:50.787236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0b38f435-8266-43cd-a260-47eee6a5d7e8 None None] MFA Rules not processed for user `b8c55588a43e4b67b99500751bb550fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:50.788852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0b38f435-8266-43cd-a260-47eee6a5d7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:50.881877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:50.907491 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2130/4260] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:50.909660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5947f-326d-44ff-8ef1-8187e91a8ad3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:50.998503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5947f-326d-44ff-8ef1-8187e91a8ad3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:51.022709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f81aeb-2ac5-40e7-bf63-093c2bd35244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:51.023859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f81aeb-2ac5-40e7-bf63-093c2bd35244 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:51.024329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f81aeb-2ac5-40e7-bf63-093c2bd35244 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:51.024984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f81aeb-2ac5-40e7-bf63-093c2bd35244 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:51.025849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f81aeb-2ac5-40e7-bf63-093c2bd35244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:51.029296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f81aeb-2ac5-40e7-bf63-093c2bd35244 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:51.104789 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2131/4261] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:15:50 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:15:51.109012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38f435-8266-43cd-a260-47eee6a5d7e8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:51.133287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38f435-8266-43cd-a260-47eee6a5d7e8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:51.218731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13e160-20b3-4815-a1ea-8e1fc39a9476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:51.219843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13e160-20b3-4815-a1ea-8e1fc39a9476 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:51.220384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13e160-20b3-4815-a1ea-8e1fc39a9476 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:51.220844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13e160-20b3-4815-a1ea-8e1fc39a9476 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:51.221681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13e160-20b3-4815-a1ea-8e1fc39a9476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:51.224406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13e160-20b3-4815-a1ea-8e1fc39a9476 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:51.282714 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2131/4262] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:15:51 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:15:51.287053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f81aeb-2ac5-40e7-bf63-093c2bd35244 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:51.311699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f81aeb-2ac5-40e7-bf63-093c2bd35244 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:51.323003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e35ea-00de-47be-bff3-2eab10cd1e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:51.325727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e35ea-00de-47be-bff3-2eab10cd1e71 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:51.326021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e35ea-00de-47be-bff3-2eab10cd1e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:51.327252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e35ea-00de-47be-bff3-2eab10cd1e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:51.328496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e35ea-00de-47be-bff3-2eab10cd1e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:51.331846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e35ea-00de-47be-bff3-2eab10cd1e71 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:51.362099 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2132/4263] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:15:51.363641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13e160-20b3-4815-a1ea-8e1fc39a9476 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:51.392826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13e160-20b3-4815-a1ea-8e1fc39a9476 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:51.411627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a376b6-a25e-4ba9-9422-844219bedf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:51.412498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a376b6-a25e-4ba9-9422-844219bedf3a admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:51.419604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a376b6-a25e-4ba9-9422-844219bedf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:51.423472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a376b6-a25e-4ba9-9422-844219bedf3a admin admin] PATH_INFO: `/v3/projects/4a98478083b940cf87189a715cc9e955/users/b0092299618945ed8361f9351966e67e/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:51.473015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a376b6-a25e-4ba9-9422-844219bedf3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a98478083b940cf87189a715cc9e955, user_id=b0092299618945ed8361f9351966e67e, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:51.478618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a376b6-a25e-4ba9-9422-844219bedf3a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:51.545236 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2132/4264] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:15:51 2022] PUT /identity/v3/projects/4a98478083b940cf87189a715cc9e955/users/b0092299618945ed8361f9351966e67e/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:51.549428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e35ea-00de-47be-bff3-2eab10cd1e71 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:51.566062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e35ea-00de-47be-bff3-2eab10cd1e71 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:51.653282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ed43c-f760-4ac7-ba6b-a15d23f1e544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:51.653925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ed43c-f760-4ac7-ba6b-a15d23f1e544 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:51.654522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ed43c-f760-4ac7-ba6b-a15d23f1e544 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:51.654797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ed43c-f760-4ac7-ba6b-a15d23f1e544 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:51.655527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ed43c-f760-4ac7-ba6b-a15d23f1e544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:51.657114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ed43c-f760-4ac7-ba6b-a15d23f1e544 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:51.671807 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2133/4265] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:15:51.675953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a376b6-a25e-4ba9-9422-844219bedf3a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:51.689933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a376b6-a25e-4ba9-9422-844219bedf3a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:51.695428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256e24d-b8b1-4bd4-a776-18512106445c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:51.696257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256e24d-b8b1-4bd4-a776-18512106445c admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:51.696615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256e24d-b8b1-4bd4-a776-18512106445c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:51.697025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256e24d-b8b1-4bd4-a776-18512106445c admin admin] PATH_INFO: `/v3/projects/4a98478083b940cf87189a715cc9e955/users/b0092299618945ed8361f9351966e67e/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:51.700132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256e24d-b8b1-4bd4-a776-18512106445c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a98478083b940cf87189a715cc9e955, user_id=b0092299618945ed8361f9351966e67e, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:51.704044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256e24d-b8b1-4bd4-a776-18512106445c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:51.716467 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2133/4266] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:15:51 2022] PUT /identity/v3/projects/4a98478083b940cf87189a715cc9e955/users/b0092299618945ed8361f9351966e67e/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:15:51.813956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05593c89-954d-45fd-85da-b68c7ceb9948 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:51.814519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05593c89-954d-45fd-85da-b68c7ceb9948 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:51.815000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05593c89-954d-45fd-85da-b68c7ceb9948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:51.840725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:51.855710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-05593c89-954d-45fd-85da-b68c7ceb9948 None None] MFA Rules not processed for user `b0092299618945ed8361f9351966e67e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:51.857362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-05593c89-954d-45fd-85da-b68c7ceb9948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:51.942153 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2134/4267] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:51.947252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256e24d-b8b1-4bd4-a776-18512106445c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:51.959712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256e24d-b8b1-4bd4-a776-18512106445c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:51.964527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3795331-3427-467f-a425-69f081da23c5 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0092299618945ed8361f9351966e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a98478083b940cf87189a715cc9e955', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:51.965453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3795331-3427-467f-a425-69f081da23c5 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:51.965745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3795331-3427-467f-a425-69f081da23c5 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:51.966040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3795331-3427-467f-a425-69f081da23c5 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:51.966755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3795331-3427-467f-a425-69f081da23c5 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:15:51.967069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3795331-3427-467f-a425-69f081da23c5 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:51.968917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3795331-3427-467f-a425-69f081da23c5 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:51.985522 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2134/4268] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:15:51.990227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05593c89-954d-45fd-85da-b68c7ceb9948 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:52.002148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05593c89-954d-45fd-85da-b68c7ceb9948 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:52.015317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e973872-01c9-46b5-abdd-e4e62e483eed tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0092299618945ed8361f9351966e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a98478083b940cf87189a715cc9e955', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:52.016105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e973872-01c9-46b5-abdd-e4e62e483eed tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:52.016423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e973872-01c9-46b5-abdd-e4e62e483eed tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:52.016706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e973872-01c9-46b5-abdd-e4e62e483eed tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:52.018534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e973872-01c9-46b5-abdd-e4e62e483eed tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:52.019845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e973872-01c9-46b5-abdd-e4e62e483eed tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:52.056185 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2135/4269] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:15:51 2022] POST /identity/v3/projects => generated 349 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:15:52.064997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3795331-3427-467f-a425-69f081da23c5 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:52.078231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3795331-3427-467f-a425-69f081da23c5 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:52.163444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088e0c8-6a62-45a2-87e9-d217741de4ce tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0092299618945ed8361f9351966e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a98478083b940cf87189a715cc9e955', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:52.164076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088e0c8-6a62-45a2-87e9-d217741de4ce tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:52.164355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088e0c8-6a62-45a2-87e9-d217741de4ce tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:52.164628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088e0c8-6a62-45a2-87e9-d217741de4ce tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:52.169139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088e0c8-6a62-45a2-87e9-d217741de4ce tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:15:52.169441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088e0c8-6a62-45a2-87e9-d217741de4ce tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:52.171089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088e0c8-6a62-45a2-87e9-d217741de4ce tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:52.214034 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2135/4270] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:15:52.226374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e973872-01c9-46b5-abdd-e4e62e483eed tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:52.228391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5e973872-01c9-46b5-abdd-e4e62e483eed tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:52.396672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e973872-01c9-46b5-abdd-e4e62e483eed tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:52.411669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615bae6-2418-434e-9a64-be5bacc17d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:52.411669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615bae6-2418-434e-9a64-be5bacc17d23 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:52.411669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615bae6-2418-434e-9a64-be5bacc17d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:52.411669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615bae6-2418-434e-9a64-be5bacc17d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:52.418945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615bae6-2418-434e-9a64-be5bacc17d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:52.421788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615bae6-2418-434e-9a64-be5bacc17d23 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:52.441740 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2136/4271] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:53.801271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088e0c8-6a62-45a2-87e9-d217741de4ce tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:53.886902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:54.034314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088e0c8-6a62-45a2-87e9-d217741de4ce tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:54.072340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140be62-5d7d-4d2f-a079-fedb32f87260 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:54.073381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140be62-5d7d-4d2f-a079-fedb32f87260 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:54.073903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140be62-5d7d-4d2f-a079-fedb32f87260 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:54.074433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140be62-5d7d-4d2f-a079-fedb32f87260 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:54.081560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3140be62-5d7d-4d2f-a079-fedb32f87260 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:54.145275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140be62-5d7d-4d2f-a079-fedb32f87260 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:54.147155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140be62-5d7d-4d2f-a079-fedb32f87260 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:54.183073 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2136/4272] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:56.109005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615bae6-2418-434e-9a64-be5bacc17d23 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:56.124551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615bae6-2418-434e-9a64-be5bacc17d23 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:56.139412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccffef-ef6d-4899-b21f-3f4c04934610 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0092299618945ed8361f9351966e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a98478083b940cf87189a715cc9e955', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:56.140304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccffef-ef6d-4899-b21f-3f4c04934610 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:56.140840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccffef-ef6d-4899-b21f-3f4c04934610 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:56.141347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccffef-ef6d-4899-b21f-3f4c04934610 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] PATH_INFO: `/v3/projects/2bbdf38bf93542ad9b992214e6a02884` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:56.142916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccffef-ef6d-4899-b21f-3f4c04934610 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2bbdf38bf93542ad9b992214e6a02884)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:56.146111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccffef-ef6d-4899-b21f-3f4c04934610 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:56.313339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75ccffef-ef6d-4899-b21f-3f4c04934610 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bbdf38bf93542ad9b992214e6a02884', 'request_id': 'req-75ccffef-ef6d-4899-b21f-3f4c04934610'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:56.327639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75ccffef-ef6d-4899-b21f-3f4c04934610 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bbdf38bf93542ad9b992214e6a02884', 'request_id': 'req-75ccffef-ef6d-4899-b21f-3f4c04934610'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:56.342444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75ccffef-ef6d-4899-b21f-3f4c04934610 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bbdf38bf93542ad9b992214e6a02884', 'request_id': 'req-75ccffef-ef6d-4899-b21f-3f4c04934610'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:56.353448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:56.366045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75ccffef-ef6d-4899-b21f-3f4c04934610 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] The token cache is being invalidate because project 2bbdf38bf93542ad9b992214e6a02884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:15:56.366397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75ccffef-ef6d-4899-b21f-3f4c04934610 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:56.367987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75ccffef-ef6d-4899-b21f-3f4c04934610 tempest-QuotasNegativeTest-1385426729 tempest-QuotasNegativeTest-1385426729-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:56.370035 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2137/4273] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:15:56 2022] DELETE /identity/v3/projects/2bbdf38bf93542ad9b992214e6a02884 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:56.375658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140be62-5d7d-4d2f-a079-fedb32f87260 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:56.499239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140be62-5d7d-4d2f-a079-fedb32f87260 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:56.637834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904ffbf-3941-42cc-b3a4-5d84d72ea9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:56.639230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904ffbf-3941-42cc-b3a4-5d84d72ea9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:56.639952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904ffbf-3941-42cc-b3a4-5d84d72ea9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:56.640392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904ffbf-3941-42cc-b3a4-5d84d72ea9b5 admin admin] PATH_INFO: `/v3/users/b8c55588a43e4b67b99500751bb550fb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:56.642196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904ffbf-3941-42cc-b3a4-5d84d72ea9b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8c55588a43e4b67b99500751bb550fb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:56.645482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904ffbf-3941-42cc-b3a4-5d84d72ea9b5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:56.753772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6904ffbf-3941-42cc-b3a4-5d84d72ea9b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8c55588a43e4b67b99500751bb550fb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:56.769861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:56.772415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6904ffbf-3941-42cc-b3a4-5d84d72ea9b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8c55588a43e4b67b99500751bb550fb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:56.773451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6904ffbf-3941-42cc-b3a4-5d84d72ea9b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8c55588a43e4b67b99500751bb550fb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:56.788076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6904ffbf-3941-42cc-b3a4-5d84d72ea9b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8c55588a43e4b67b99500751bb550fb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:56.789260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6904ffbf-3941-42cc-b3a4-5d84d72ea9b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8c55588a43e4b67b99500751bb550fb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:56.826384 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2137/4274] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:15:56 2022] DELETE /identity/v3/users/b8c55588a43e4b67b99500751bb550fb => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:56.828143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de598034-49a7-4a20-a16b-51f0ba786d14 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:56.828581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de598034-49a7-4a20-a16b-51f0ba786d14 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:56.829134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de598034-49a7-4a20-a16b-51f0ba786d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:56.875319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-de598034-49a7-4a20-a16b-51f0ba786d14 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:56.882222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-de598034-49a7-4a20-a16b-51f0ba786d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:57.035232 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2138/4275] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:57.054615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904ffbf-3941-42cc-b3a4-5d84d72ea9b5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:57.056325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6904ffbf-3941-42cc-b3a4-5d84d72ea9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:57.235873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904ffbf-3941-42cc-b3a4-5d84d72ea9b5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:57.250010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31fa0e-af15-4c55-86e7-cf0bbad973ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:57.252677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31fa0e-af15-4c55-86e7-cf0bbad973ed service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:57.253297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31fa0e-af15-4c55-86e7-cf0bbad973ed service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:57.253575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31fa0e-af15-4c55-86e7-cf0bbad973ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:57.277427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31fa0e-af15-4c55-86e7-cf0bbad973ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:57.279802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31fa0e-af15-4c55-86e7-cf0bbad973ed service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:57.305418 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2138/4276] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:15:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:15:57.830985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de598034-49a7-4a20-a16b-51f0ba786d14 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:57.833895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-de598034-49a7-4a20-a16b-51f0ba786d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:57.851543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de598034-49a7-4a20-a16b-51f0ba786d14 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:57.860749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3929a4c-2923-40e6-b998-92d6a07ebb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:57.862698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3929a4c-2923-40e6-b998-92d6a07ebb48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:57.863673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3929a4c-2923-40e6-b998-92d6a07ebb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:57.864177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3929a4c-2923-40e6-b998-92d6a07ebb48 admin admin] PATH_INFO: `/v3/projects/cd82af2c13894450b5efd4752f271cab` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:57.866468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3929a4c-2923-40e6-b998-92d6a07ebb48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd82af2c13894450b5efd4752f271cab)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:57.869794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3929a4c-2923-40e6-b998-92d6a07ebb48 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:57.937852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e3929a4c-2923-40e6-b998-92d6a07ebb48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd82af2c13894450b5efd4752f271cab', 'request_id': 'req-e3929a4c-2923-40e6-b998-92d6a07ebb48'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:57.946395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e3929a4c-2923-40e6-b998-92d6a07ebb48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd82af2c13894450b5efd4752f271cab', 'request_id': 'req-e3929a4c-2923-40e6-b998-92d6a07ebb48'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:57.955779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e3929a4c-2923-40e6-b998-92d6a07ebb48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd82af2c13894450b5efd4752f271cab', 'request_id': 'req-e3929a4c-2923-40e6-b998-92d6a07ebb48'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:57.976014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e3929a4c-2923-40e6-b998-92d6a07ebb48 admin admin] The token cache is being invalidate because project cd82af2c13894450b5efd4752f271cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:15:57.976478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e3929a4c-2923-40e6-b998-92d6a07ebb48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:57.977536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e3929a4c-2923-40e6-b998-92d6a07ebb48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:57.979657 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2139/4277] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:15:57 2022] DELETE /identity/v3/projects/cd82af2c13894450b5efd4752f271cab => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:57.984233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31fa0e-af15-4c55-86e7-cf0bbad973ed service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:58.003702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31fa0e-af15-4c55-86e7-cf0bbad973ed service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:58.097888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9338ae6-725a-4f0a-9058-1320171a55cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:58.098563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9338ae6-725a-4f0a-9058-1320171a55cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:58.098849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9338ae6-725a-4f0a-9058-1320171a55cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:58.099186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9338ae6-725a-4f0a-9058-1320171a55cd admin admin] PATH_INFO: `/v3/users/b0092299618945ed8361f9351966e67e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:58.100724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9338ae6-725a-4f0a-9058-1320171a55cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0092299618945ed8361f9351966e67e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:58.102996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9338ae6-725a-4f0a-9058-1320171a55cd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:58.245097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f9338ae6-725a-4f0a-9058-1320171a55cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0092299618945ed8361f9351966e67e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:58.290291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f9338ae6-725a-4f0a-9058-1320171a55cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0092299618945ed8361f9351966e67e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:58.291409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f9338ae6-725a-4f0a-9058-1320171a55cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0092299618945ed8361f9351966e67e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:58.312489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f9338ae6-725a-4f0a-9058-1320171a55cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0092299618945ed8361f9351966e67e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:58.315897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f9338ae6-725a-4f0a-9058-1320171a55cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0092299618945ed8361f9351966e67e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:58.345419 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2139/4278] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:15:57 2022] DELETE /identity/v3/users/b0092299618945ed8361f9351966e67e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:15:58.733894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3929a4c-2923-40e6-b998-92d6a07ebb48 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:58.736349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e3929a4c-2923-40e6-b998-92d6a07ebb48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:58.757989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3929a4c-2923-40e6-b998-92d6a07ebb48 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:58.838229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b69a8-067a-4663-8521-4797901ba966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:58.839012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b69a8-067a-4663-8521-4797901ba966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:58.839458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b69a8-067a-4663-8521-4797901ba966 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:58.841654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b69a8-067a-4663-8521-4797901ba966 admin admin] PATH_INFO: `/v3/projects/4a98478083b940cf87189a715cc9e955` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:58.844122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b69a8-067a-4663-8521-4797901ba966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a98478083b940cf87189a715cc9e955)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:58.846859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b69a8-067a-4663-8521-4797901ba966 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:58.883573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:58.935326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f05b69a8-067a-4663-8521-4797901ba966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a98478083b940cf87189a715cc9e955', 'request_id': 'req-f05b69a8-067a-4663-8521-4797901ba966'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:58.952380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f05b69a8-067a-4663-8521-4797901ba966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a98478083b940cf87189a715cc9e955', 'request_id': 'req-f05b69a8-067a-4663-8521-4797901ba966'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:58.961170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f05b69a8-067a-4663-8521-4797901ba966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a98478083b940cf87189a715cc9e955', 'request_id': 'req-f05b69a8-067a-4663-8521-4797901ba966'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:58.981145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f05b69a8-067a-4663-8521-4797901ba966 admin admin] The token cache is being invalidate because project 4a98478083b940cf87189a715cc9e955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:15:58.981890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f05b69a8-067a-4663-8521-4797901ba966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:58.982779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f05b69a8-067a-4663-8521-4797901ba966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:15:58.984902 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2140/4279] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:15:58 2022] DELETE /identity/v3/projects/4a98478083b940cf87189a715cc9e955 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:15:58.989569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94818b-c177-4af4-b2eb-909596cd5690 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:58.990201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94818b-c177-4af4-b2eb-909596cd5690 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:58.990201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94818b-c177-4af4-b2eb-909596cd5690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:59.004336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:59.026786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bb94818b-c177-4af4-b2eb-909596cd5690 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:59.029536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bb94818b-c177-4af4-b2eb-909596cd5690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:59.103329 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2140/4280] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:59.113599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25730c73-2728-4c99-aa95-3944ce1eab51 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:59.113933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25730c73-2728-4c99-aa95-3944ce1eab51 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:59.114248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25730c73-2728-4c99-aa95-3944ce1eab51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:59.141821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-25730c73-2728-4c99-aa95-3944ce1eab51 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:59.141821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-25730c73-2728-4c99-aa95-3944ce1eab51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:59.150383 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2141/4281] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:59.151776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94818b-c177-4af4-b2eb-909596cd5690 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:59.164801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94818b-c177-4af4-b2eb-909596cd5690 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:59.170804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7beaf09-2f8f-4a5b-8162-99c1ca1415c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:59.171577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7beaf09-2f8f-4a5b-8162-99c1ca1415c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:59.171935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7beaf09-2f8f-4a5b-8162-99c1ca1415c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:59.172281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7beaf09-2f8f-4a5b-8162-99c1ca1415c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:59.173057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7beaf09-2f8f-4a5b-8162-99c1ca1415c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:15:59.173689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7beaf09-2f8f-4a5b-8162-99c1ca1415c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:59.175950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7beaf09-2f8f-4a5b-8162-99c1ca1415c7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:59.194986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25730c73-2728-4c99-aa95-3944ce1eab51 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:59.195371 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2141/4282] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:15:59.208270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25730c73-2728-4c99-aa95-3944ce1eab51 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:59.214826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43931d-4035-496d-9654-c5a27d20d5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:59.215505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43931d-4035-496d-9654-c5a27d20d5dd admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:59.215793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43931d-4035-496d-9654-c5a27d20d5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:59.216073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43931d-4035-496d-9654-c5a27d20d5dd admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:59.216755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43931d-4035-496d-9654-c5a27d20d5dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:59.218859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43931d-4035-496d-9654-c5a27d20d5dd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:59.299733 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2142/4283] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:15:59 2022] POST /identity/v3/projects => generated 397 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:15:59.305184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7beaf09-2f8f-4a5b-8162-99c1ca1415c7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:59.333009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7beaf09-2f8f-4a5b-8162-99c1ca1415c7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:59.484772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa83591-46a4-462a-a9d5-424cb1b629cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:59.485413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa83591-46a4-462a-a9d5-424cb1b629cb admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:59.485699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa83591-46a4-462a-a9d5-424cb1b629cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:59.485974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa83591-46a4-462a-a9d5-424cb1b629cb admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:59.486652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa83591-46a4-462a-a9d5-424cb1b629cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:59.488641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa83591-46a4-462a-a9d5-424cb1b629cb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:59.525957 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2142/4284] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:15:59 2022] POST /identity/v3/users => generated 299 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:15:59.526541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43931d-4035-496d-9654-c5a27d20d5dd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:59.541450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43931d-4035-496d-9654-c5a27d20d5dd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:59.557641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e427fd-99f0-43d9-93b5-eb9f2a32402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:59.558287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e427fd-99f0-43d9-93b5-eb9f2a32402b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:59.559180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e427fd-99f0-43d9-93b5-eb9f2a32402b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:59.559495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e427fd-99f0-43d9-93b5-eb9f2a32402b admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:59.560890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e427fd-99f0-43d9-93b5-eb9f2a32402b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:59.561948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e427fd-99f0-43d9-93b5-eb9f2a32402b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:59.597445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa83591-46a4-462a-a9d5-424cb1b629cb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:59.615905 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2143/4285] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:15:59.618736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa83591-46a4-462a-a9d5-424cb1b629cb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:59.624672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2a1fc-a9ae-4f08-9214-bf429689c30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:59.625410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2a1fc-a9ae-4f08-9214-bf429689c30f admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:59.625766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2a1fc-a9ae-4f08-9214-bf429689c30f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:59.626128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2a1fc-a9ae-4f08-9214-bf429689c30f admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:59.627011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2a1fc-a9ae-4f08-9214-bf429689c30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:59.629247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2a1fc-a9ae-4f08-9214-bf429689c30f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:59.643503 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2143/4286] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:15:59.647507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e427fd-99f0-43d9-93b5-eb9f2a32402b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:15:59.664603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e427fd-99f0-43d9-93b5-eb9f2a32402b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:15:59.688986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a5b35-a3de-4d29-9ffa-d8039dbd4b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:15:59.689795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a5b35-a3de-4d29-9ffa-d8039dbd4b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:59.690151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a5b35-a3de-4d29-9ffa-d8039dbd4b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:59.690501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a5b35-a3de-4d29-9ffa-d8039dbd4b6c admin admin] PATH_INFO: `/v3/projects/db516cd255ac4bf4a6b18bbfb7edf8c3/users/accf44159b6e4f63ba9b55896b9e8fe9/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:59.719324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a5b35-a3de-4d29-9ffa-d8039dbd4b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db516cd255ac4bf4a6b18bbfb7edf8c3, user_id=accf44159b6e4f63ba9b55896b9e8fe9, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:15:59.722130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a5b35-a3de-4d29-9ffa-d8039dbd4b6c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:15:59.751625 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2144/4287] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:15:59 2022] PUT /identity/v3/projects/db516cd255ac4bf4a6b18bbfb7edf8c3/users/accf44159b6e4f63ba9b55896b9e8fe9/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:15:59.762545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e68ba-4fa5-441c-b092-4e22512916bc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:15:59.762868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e68ba-4fa5-441c-b092-4e22512916bc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:15:59.763155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e68ba-4fa5-441c-b092-4e22512916bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:15:59.797307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a08e68ba-4fa5-441c-b092-4e22512916bc None None] MFA Rules not processed for user `accf44159b6e4f63ba9b55896b9e8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:15:59.798509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a08e68ba-4fa5-441c-b092-4e22512916bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:15:59.881175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:59.890239 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2144/4288] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:15:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:15:59.892110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a5b35-a3de-4d29-9ffa-d8039dbd4b6c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:00.059571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a5b35-a3de-4d29-9ffa-d8039dbd4b6c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:00.065740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9fabd-2fc2-4b7a-8604-c5e1dd583c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:00.066959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9fabd-2fc2-4b7a-8604-c5e1dd583c0b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:00.067494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9fabd-2fc2-4b7a-8604-c5e1dd583c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:00.067980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9fabd-2fc2-4b7a-8604-c5e1dd583c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:00.068961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9fabd-2fc2-4b7a-8604-c5e1dd583c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:00.071446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9fabd-2fc2-4b7a-8604-c5e1dd583c0b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:00.105646 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2145/4289] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:15:59 2022] POST /identity/v3/projects => generated 397 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:00.109730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e68ba-4fa5-441c-b092-4e22512916bc None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:00.123330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e68ba-4fa5-441c-b092-4e22512916bc None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:00.191900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014b5fd-1864-4436-86b7-4d9077c8fde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:00.193031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014b5fd-1864-4436-86b7-4d9077c8fde4 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:00.193222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014b5fd-1864-4436-86b7-4d9077c8fde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:00.193427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014b5fd-1864-4436-86b7-4d9077c8fde4 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:00.194123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014b5fd-1864-4436-86b7-4d9077c8fde4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:00.196260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014b5fd-1864-4436-86b7-4d9077c8fde4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:00.227589 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2145/4290] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:16:00 2022] POST /identity/v3/users => generated 305 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:00.228891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9fabd-2fc2-4b7a-8604-c5e1dd583c0b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:00.240480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9fabd-2fc2-4b7a-8604-c5e1dd583c0b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:00.247224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65a151-92c5-447c-9ad4-83e95b5c60ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:00.247939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65a151-92c5-447c-9ad4-83e95b5c60ac admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:00.248349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65a151-92c5-447c-9ad4-83e95b5c60ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:00.248638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65a151-92c5-447c-9ad4-83e95b5c60ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:00.249572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65a151-92c5-447c-9ad4-83e95b5c60ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:00.251217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65a151-92c5-447c-9ad4-83e95b5c60ac admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:00.267951 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2146/4291] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:00.271246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014b5fd-1864-4436-86b7-4d9077c8fde4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:00.285625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014b5fd-1864-4436-86b7-4d9077c8fde4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:00.292424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772fe36-c869-4cbe-8749-91528db7f42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:00.293754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772fe36-c869-4cbe-8749-91528db7f42d admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:00.294023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772fe36-c869-4cbe-8749-91528db7f42d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:00.294375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772fe36-c869-4cbe-8749-91528db7f42d admin admin] PATH_INFO: `/v3/projects/ed97307eead04aaabf8c45432ecd2c97/users/a5b0079477c94d0397e68c5c875a547e/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:00.315105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772fe36-c869-4cbe-8749-91528db7f42d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed97307eead04aaabf8c45432ecd2c97, user_id=a5b0079477c94d0397e68c5c875a547e, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:00.317994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772fe36-c869-4cbe-8749-91528db7f42d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:00.358571 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2146/4292] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:00 2022] PUT /identity/v3/projects/ed97307eead04aaabf8c45432ecd2c97/users/a5b0079477c94d0397e68c5c875a547e/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:00.360231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65a151-92c5-447c-9ad4-83e95b5c60ac admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:00.374817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65a151-92c5-447c-9ad4-83e95b5c60ac admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:00.403482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:00.474243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc7443-4b4e-4bf8-bbc5-79247469d76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:00.475199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc7443-4b4e-4bf8-bbc5-79247469d76f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:00.475600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc7443-4b4e-4bf8-bbc5-79247469d76f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:00.475979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc7443-4b4e-4bf8-bbc5-79247469d76f admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:00.476926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc7443-4b4e-4bf8-bbc5-79247469d76f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:00.478717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc7443-4b4e-4bf8-bbc5-79247469d76f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:00.495543 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2147/4293] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:00.497421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772fe36-c869-4cbe-8749-91528db7f42d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:00.511745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772fe36-c869-4cbe-8749-91528db7f42d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:00.517468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61962a85-5e20-45f7-ae14-2622c80d594b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:00.518161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61962a85-5e20-45f7-ae14-2622c80d594b admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:00.519060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61962a85-5e20-45f7-ae14-2622c80d594b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:00.519060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61962a85-5e20-45f7-ae14-2622c80d594b admin admin] PATH_INFO: `/v3/projects/ed97307eead04aaabf8c45432ecd2c97/users/a5b0079477c94d0397e68c5c875a547e/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:00.521321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61962a85-5e20-45f7-ae14-2622c80d594b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed97307eead04aaabf8c45432ecd2c97, user_id=a5b0079477c94d0397e68c5c875a547e, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:00.524061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61962a85-5e20-45f7-ae14-2622c80d594b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:00.535628 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2147/4294] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:00 2022] PUT /identity/v3/projects/ed97307eead04aaabf8c45432ecd2c97/users/a5b0079477c94d0397e68c5c875a547e/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:16:00.548283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf862c1-14d2-43af-a612-0c02d435fcaa None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:00.548578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf862c1-14d2-43af-a612-0c02d435fcaa None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:00.548890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf862c1-14d2-43af-a612-0c02d435fcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:00.586432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-baf862c1-14d2-43af-a612-0c02d435fcaa None None] MFA Rules not processed for user `a5b0079477c94d0397e68c5c875a547e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:00.587727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-baf862c1-14d2-43af-a612-0c02d435fcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:00.722153 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2148/4295] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:00.772028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61962a85-5e20-45f7-ae14-2622c80d594b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:00.773849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-61962a85-5e20-45f7-ae14-2622c80d594b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:00.855165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61962a85-5e20-45f7-ae14-2622c80d594b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:00.862226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377e55a-d196-4c45-95f6-ca1bb48217a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:00.862539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377e55a-d196-4c45-95f6-ca1bb48217a2 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:00.862789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377e55a-d196-4c45-95f6-ca1bb48217a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:00.863070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377e55a-d196-4c45-95f6-ca1bb48217a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:00.938457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377e55a-d196-4c45-95f6-ca1bb48217a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:00.940135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377e55a-d196-4c45-95f6-ca1bb48217a2 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:00.956245 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2148/4296] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:16:02.853992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf862c1-14d2-43af-a612-0c02d435fcaa None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:02.856083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-baf862c1-14d2-43af-a612-0c02d435fcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:02.974519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf862c1-14d2-43af-a612-0c02d435fcaa None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:02.980789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6321c3-e43d-485f-8300-2401eae2bdab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:02.981675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6321c3-e43d-485f-8300-2401eae2bdab service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:02.982275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6321c3-e43d-485f-8300-2401eae2bdab service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:02.982728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6321c3-e43d-485f-8300-2401eae2bdab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:03.007480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6321c3-e43d-485f-8300-2401eae2bdab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:03.016498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6321c3-e43d-485f-8300-2401eae2bdab service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:03.046027 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2149/4297] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:16:08.231760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dd937-057c-4616-a6e7-ef8cb10e77c4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:08.232346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dd937-057c-4616-a6e7-ef8cb10e77c4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:08.232346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dd937-057c-4616-a6e7-ef8cb10e77c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:08.242465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:08.271245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b54dd937-057c-4616-a6e7-ef8cb10e77c4 None None] MFA Rules not processed for user `4a01092bfa5a4118a5fe61a6dc9c5460`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:08.274145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b54dd937-057c-4616-a6e7-ef8cb10e77c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:08.296562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6321c3-e43d-485f-8300-2401eae2bdab service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:08.348798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6321c3-e43d-485f-8300-2401eae2bdab service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:08.366765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbc1be-84c5-4ddd-8108-4f5aeb1c3284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:08.369184 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2149/4298] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:08.371393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbc1be-84c5-4ddd-8108-4f5aeb1c3284 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:08.373332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbc1be-84c5-4ddd-8108-4f5aeb1c3284 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:08.373867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbc1be-84c5-4ddd-8108-4f5aeb1c3284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:08.384830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4ecbc1be-84c5-4ddd-8108-4f5aeb1c3284 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:08.477950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:08.583177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbc1be-84c5-4ddd-8108-4f5aeb1c3284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:08.584608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbc1be-84c5-4ddd-8108-4f5aeb1c3284 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:08.607735 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2150/4299] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:16:09.117495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54dd937-057c-4616-a6e7-ef8cb10e77c4 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:09.118942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b54dd937-057c-4616-a6e7-ef8cb10e77c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:09.142150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54dd937-057c-4616-a6e7-ef8cb10e77c4 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:09.151210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f63a4f-ef75-40c8-9c3c-d28576981cf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:09.153112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f63a4f-ef75-40c8-9c3c-d28576981cf0 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:09.153939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f63a4f-ef75-40c8-9c3c-d28576981cf0 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:09.154872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f63a4f-ef75-40c8-9c3c-d28576981cf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:09.157779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-79f63a4f-ef75-40c8-9c3c-d28576981cf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:09.177998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f63a4f-ef75-40c8-9c3c-d28576981cf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:09.181247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f63a4f-ef75-40c8-9c3c-d28576981cf0 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:09.195810 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2150/4300] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:16:10.428187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69b61e-fc1b-4740-8f91-9df8be0d9138 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:10.429315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69b61e-fc1b-4740-8f91-9df8be0d9138 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:10.430343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69b61e-fc1b-4740-8f91-9df8be0d9138 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:10.432006 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2151/4301] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:16:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:16:10.459387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbe776-36b6-4e83-8159-f5d5a2fe2535 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:10.461015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbe776-36b6-4e83-8159-f5d5a2fe2535 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:10.461329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbe776-36b6-4e83-8159-f5d5a2fe2535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:10.497136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-04bbe776-36b6-4e83-8159-f5d5a2fe2535 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:10.499148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-04bbe776-36b6-4e83-8159-f5d5a2fe2535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:10.696143 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2151/4302] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:16:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:10.753286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69b61e-fc1b-4740-8f91-9df8be0d9138 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:10.756039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3f69b61e-fc1b-4740-8f91-9df8be0d9138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:10.782885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69b61e-fc1b-4740-8f91-9df8be0d9138 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:10.791004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084d120-a16d-479a-8c86-8650cca786cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:10.793500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084d120-a16d-479a-8c86-8650cca786cf service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:10.794540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084d120-a16d-479a-8c86-8650cca786cf service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:10.794998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084d120-a16d-479a-8c86-8650cca786cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:10.809023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084d120-a16d-479a-8c86-8650cca786cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:10.811510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084d120-a16d-479a-8c86-8650cca786cf service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:10.822754 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2152/4303] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:16:10.824481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbe776-36b6-4e83-8159-f5d5a2fe2535 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:10.827410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-04bbe776-36b6-4e83-8159-f5d5a2fe2535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:10.866789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbe776-36b6-4e83-8159-f5d5a2fe2535 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:10.882173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d461c-c867-4f0d-84e9-d7365121d83f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:10.883085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d461c-c867-4f0d-84e9-d7365121d83f service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:10.883653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d461c-c867-4f0d-84e9-d7365121d83f service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:10.884233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d461c-c867-4f0d-84e9-d7365121d83f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:10.892421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-599d461c-c867-4f0d-84e9-d7365121d83f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:10.923758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d461c-c867-4f0d-84e9-d7365121d83f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:10.928093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d461c-c867-4f0d-84e9-d7365121d83f service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:10.959085 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2152/4304] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:16:11.070564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ce32d-2462-4798-a073-2ade27f14b54 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:11.071229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ce32d-2462-4798-a073-2ade27f14b54 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:11.071713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ce32d-2462-4798-a073-2ade27f14b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:11.105461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5f9ce32d-2462-4798-a073-2ade27f14b54 None None] MFA Rules not processed for user `4a01092bfa5a4118a5fe61a6dc9c5460`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:11.108435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5f9ce32d-2462-4798-a073-2ade27f14b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:11.123530 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2153/4305] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:11.434738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d1124-dc20-4e4f-aaea-ec2367d681df None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:11.437244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d1124-dc20-4e4f-aaea-ec2367d681df None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:11.437244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d1124-dc20-4e4f-aaea-ec2367d681df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:11.486104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c07d1124-dc20-4e4f-aaea-ec2367d681df None None] MFA Rules not processed for user `23ba5ddf22424eff840602440872f86e`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:11.487719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c07d1124-dc20-4e4f-aaea-ec2367d681df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:11.614004 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2153/4306] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:13.371960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfab36-af65-4c90-9a6d-b3106a1dad73 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:13.372431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfab36-af65-4c90-9a6d-b3106a1dad73 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:13.372799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfab36-af65-4c90-9a6d-b3106a1dad73 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:13.375898 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2154/4307] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:16:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:16:13.384185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398a521-b4ea-4976-8011-863096c7ac5a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:13.384734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398a521-b4ea-4976-8011-863096c7ac5a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:13.384916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398a521-b4ea-4976-8011-863096c7ac5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:13.469459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3398a521-b4ea-4976-8011-863096c7ac5a None None] MFA Rules not processed for user `4a886ccf9590432caf209526410a7b53`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:13.470788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3398a521-b4ea-4976-8011-863096c7ac5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:13.479889 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2154/4308] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:16:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:13.519940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfab36-af65-4c90-9a6d-b3106a1dad73 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:13.557294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfab36-af65-4c90-9a6d-b3106a1dad73 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:13.569872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d6566-6349-43f4-86db-9a616eb2b73f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:13.571841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d6566-6349-43f4-86db-9a616eb2b73f service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:13.573482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d6566-6349-43f4-86db-9a616eb2b73f service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:13.577111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d6566-6349-43f4-86db-9a616eb2b73f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:13.603317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d6566-6349-43f4-86db-9a616eb2b73f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:13.605054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d6566-6349-43f4-86db-9a616eb2b73f service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:13.629214 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2155/4309] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:16:19.250491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398a521-b4ea-4976-8011-863096c7ac5a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:19.262070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:19.268206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398a521-b4ea-4976-8011-863096c7ac5a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:19.274570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dea73-37a2-4e68-929b-8cf2095ddf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:19.275642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dea73-37a2-4e68-929b-8cf2095ddf5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:19.276152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dea73-37a2-4e68-929b-8cf2095ddf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:19.278800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dea73-37a2-4e68-929b-8cf2095ddf5a admin admin] PATH_INFO: `/v3/users/accf44159b6e4f63ba9b55896b9e8fe9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:19.280363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dea73-37a2-4e68-929b-8cf2095ddf5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=accf44159b6e4f63ba9b55896b9e8fe9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:19.282508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dea73-37a2-4e68-929b-8cf2095ddf5a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:19.369785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bb0dea73-37a2-4e68-929b-8cf2095ddf5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'accf44159b6e4f63ba9b55896b9e8fe9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:19.388166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bb0dea73-37a2-4e68-929b-8cf2095ddf5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'accf44159b6e4f63ba9b55896b9e8fe9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:19.390634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bb0dea73-37a2-4e68-929b-8cf2095ddf5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'accf44159b6e4f63ba9b55896b9e8fe9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:19.401026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bb0dea73-37a2-4e68-929b-8cf2095ddf5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'accf44159b6e4f63ba9b55896b9e8fe9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:19.403038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bb0dea73-37a2-4e68-929b-8cf2095ddf5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'accf44159b6e4f63ba9b55896b9e8fe9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:19.429194 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2155/4310] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:16:19 2022] DELETE /identity/v3/users/accf44159b6e4f63ba9b55896b9e8fe9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:19.434166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5001f2c-eb8c-4165-b6e0-46fa51f93ead None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:19.435153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5001f2c-eb8c-4165-b6e0-46fa51f93ead None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:19.435825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5001f2c-eb8c-4165-b6e0-46fa51f93ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:19.463700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d5001f2c-eb8c-4165-b6e0-46fa51f93ead None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:19.465726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d5001f2c-eb8c-4165-b6e0-46fa51f93ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:19.559343 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2156/4311] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:19.613311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dea73-37a2-4e68-929b-8cf2095ddf5a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:19.616083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bb0dea73-37a2-4e68-929b-8cf2095ddf5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:19.804745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dea73-37a2-4e68-929b-8cf2095ddf5a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:19.814500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b2279-aa5d-4910-bccc-cf1ffe5a36fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:19.815580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b2279-aa5d-4910-bccc-cf1ffe5a36fa service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:19.816209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b2279-aa5d-4910-bccc-cf1ffe5a36fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:19.816662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b2279-aa5d-4910-bccc-cf1ffe5a36fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:19.834243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b2279-aa5d-4910-bccc-cf1ffe5a36fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:19.837055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b2279-aa5d-4910-bccc-cf1ffe5a36fa service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:19.850745 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2156/4312] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:16:21.001379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5001f2c-eb8c-4165-b6e0-46fa51f93ead None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:21.002325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d5001f2c-eb8c-4165-b6e0-46fa51f93ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:21.027020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5001f2c-eb8c-4165-b6e0-46fa51f93ead None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:21.035625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07ff3d-78ea-4a1a-9efc-f0850839196e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:21.036338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07ff3d-78ea-4a1a-9efc-f0850839196e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:21.036628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07ff3d-78ea-4a1a-9efc-f0850839196e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:21.036960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07ff3d-78ea-4a1a-9efc-f0850839196e admin admin] PATH_INFO: `/v3/projects/db516cd255ac4bf4a6b18bbfb7edf8c3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:21.038849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07ff3d-78ea-4a1a-9efc-f0850839196e admin admin] RBAC: Authorizing `identity:delete_project(project_id=db516cd255ac4bf4a6b18bbfb7edf8c3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:21.040949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07ff3d-78ea-4a1a-9efc-f0850839196e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:21.162495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5f07ff3d-78ea-4a1a-9efc-f0850839196e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db516cd255ac4bf4a6b18bbfb7edf8c3', 'request_id': 'req-5f07ff3d-78ea-4a1a-9efc-f0850839196e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:21.171785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5f07ff3d-78ea-4a1a-9efc-f0850839196e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db516cd255ac4bf4a6b18bbfb7edf8c3', 'request_id': 'req-5f07ff3d-78ea-4a1a-9efc-f0850839196e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:21.179227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5f07ff3d-78ea-4a1a-9efc-f0850839196e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db516cd255ac4bf4a6b18bbfb7edf8c3', 'request_id': 'req-5f07ff3d-78ea-4a1a-9efc-f0850839196e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:21.196668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5f07ff3d-78ea-4a1a-9efc-f0850839196e admin admin] The token cache is being invalidate because project db516cd255ac4bf4a6b18bbfb7edf8c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:16:21.197179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5f07ff3d-78ea-4a1a-9efc-f0850839196e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:21.198235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5f07ff3d-78ea-4a1a-9efc-f0850839196e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:21.203516 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2157/4313] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:20 2022] DELETE /identity/v3/projects/db516cd255ac4bf4a6b18bbfb7edf8c3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:21.204994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b2279-aa5d-4910-bccc-cf1ffe5a36fa service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:21.241675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b2279-aa5d-4910-bccc-cf1ffe5a36fa service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:21.298252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07ff3d-78ea-4a1a-9efc-f0850839196e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:21.300921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5f07ff3d-78ea-4a1a-9efc-f0850839196e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:21.333268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:21.358431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfd059-0322-481f-8f0b-bdca74c858cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:21.359766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfd059-0322-481f-8f0b-bdca74c858cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:21.360258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfd059-0322-481f-8f0b-bdca74c858cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:21.360716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfd059-0322-481f-8f0b-bdca74c858cc admin admin] PATH_INFO: `/v3/users/a5b0079477c94d0397e68c5c875a547e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:21.364893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfd059-0322-481f-8f0b-bdca74c858cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5b0079477c94d0397e68c5c875a547e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:21.367975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfd059-0322-481f-8f0b-bdca74c858cc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:21.414931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:21.447017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07ff3d-78ea-4a1a-9efc-f0850839196e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:21.454229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3501c-4df3-4547-8915-0f3eedbc4008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:21.455145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3501c-4df3-4547-8915-0f3eedbc4008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:21.455479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3501c-4df3-4547-8915-0f3eedbc4008 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:21.459982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3501c-4df3-4547-8915-0f3eedbc4008 admin admin] PATH_INFO: `/v3/users/f00d46cd63d94b49abfa65d6106c7d88` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:21.461556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3501c-4df3-4547-8915-0f3eedbc4008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00d46cd63d94b49abfa65d6106c7d88)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:21.467668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3501c-4df3-4547-8915-0f3eedbc4008 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:21.476916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93bfd059-0322-481f-8f0b-bdca74c858cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5b0079477c94d0397e68c5c875a547e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:21.522686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93bfd059-0322-481f-8f0b-bdca74c858cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5b0079477c94d0397e68c5c875a547e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:21.523633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93bfd059-0322-481f-8f0b-bdca74c858cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5b0079477c94d0397e68c5c875a547e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:21.538252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93bfd059-0322-481f-8f0b-bdca74c858cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5b0079477c94d0397e68c5c875a547e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:21.539087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-93bfd059-0322-481f-8f0b-bdca74c858cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5b0079477c94d0397e68c5c875a547e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:21.546645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7c3501c-4df3-4547-8915-0f3eedbc4008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00d46cd63d94b49abfa65d6106c7d88'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:21.547411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7c3501c-4df3-4547-8915-0f3eedbc4008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00d46cd63d94b49abfa65d6106c7d88'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:21.562839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7c3501c-4df3-4547-8915-0f3eedbc4008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00d46cd63d94b49abfa65d6106c7d88'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:21.563770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7c3501c-4df3-4547-8915-0f3eedbc4008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00d46cd63d94b49abfa65d6106c7d88'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:21.566034 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2157/4314] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:16:21 2022] DELETE /identity/v3/users/a5b0079477c94d0397e68c5c875a547e => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:21.573152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfd059-0322-481f-8f0b-bdca74c858cc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:21.575541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-93bfd059-0322-481f-8f0b-bdca74c858cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:21.579740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7c3501c-4df3-4547-8915-0f3eedbc4008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00d46cd63d94b49abfa65d6106c7d88'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:21.603693 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2158/4315] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:16:21 2022] DELETE /identity/v3/users/f00d46cd63d94b49abfa65d6106c7d88 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:21.674589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfd059-0322-481f-8f0b-bdca74c858cc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:21.754725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189647c-442d-47fc-8d6b-005ceacad69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:21.756026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189647c-442d-47fc-8d6b-005ceacad69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:21.756390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189647c-442d-47fc-8d6b-005ceacad69e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:21.756799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189647c-442d-47fc-8d6b-005ceacad69e admin admin] PATH_INFO: `/v3/users/4ef2420cd50d4006b7ba4e651fdaaaaa` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:21.758134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189647c-442d-47fc-8d6b-005ceacad69e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ef2420cd50d4006b7ba4e651fdaaaaa)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:21.760270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189647c-442d-47fc-8d6b-005ceacad69e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:21.841104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1189647c-442d-47fc-8d6b-005ceacad69e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ef2420cd50d4006b7ba4e651fdaaaaa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:21.842774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:21.876869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3501c-4df3-4547-8915-0f3eedbc4008 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:21.880918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a7c3501c-4df3-4547-8915-0f3eedbc4008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:21.881140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1189647c-442d-47fc-8d6b-005ceacad69e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ef2420cd50d4006b7ba4e651fdaaaaa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:21.883625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1189647c-442d-47fc-8d6b-005ceacad69e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ef2420cd50d4006b7ba4e651fdaaaaa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:21.900571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1189647c-442d-47fc-8d6b-005ceacad69e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ef2420cd50d4006b7ba4e651fdaaaaa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:21.901347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1189647c-442d-47fc-8d6b-005ceacad69e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ef2420cd50d4006b7ba4e651fdaaaaa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:21.918406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3501c-4df3-4547-8915-0f3eedbc4008 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:21.931679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21811fb-5303-4fde-a20f-a4c81d0bfa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:21.932406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21811fb-5303-4fde-a20f-a4c81d0bfa93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:21.933614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21811fb-5303-4fde-a20f-a4c81d0bfa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:21.933614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21811fb-5303-4fde-a20f-a4c81d0bfa93 admin admin] PATH_INFO: `/v3/projects/2b4c650076ad4077874a72f6e64461f3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:21.934866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21811fb-5303-4fde-a20f-a4c81d0bfa93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4c650076ad4077874a72f6e64461f3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:21.936961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21811fb-5303-4fde-a20f-a4c81d0bfa93 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:21.943229 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2158/4316] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:16:21 2022] DELETE /identity/v3/users/4ef2420cd50d4006b7ba4e651fdaaaaa => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:21.945961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189647c-442d-47fc-8d6b-005ceacad69e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:21.947662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1189647c-442d-47fc-8d6b-005ceacad69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:22.015261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d21811fb-5303-4fde-a20f-a4c81d0bfa93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4c650076ad4077874a72f6e64461f3', 'request_id': 'req-d21811fb-5303-4fde-a20f-a4c81d0bfa93'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:22.027838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d21811fb-5303-4fde-a20f-a4c81d0bfa93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4c650076ad4077874a72f6e64461f3', 'request_id': 'req-d21811fb-5303-4fde-a20f-a4c81d0bfa93'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:22.035713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d21811fb-5303-4fde-a20f-a4c81d0bfa93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4c650076ad4077874a72f6e64461f3', 'request_id': 'req-d21811fb-5303-4fde-a20f-a4c81d0bfa93'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:22.052525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189647c-442d-47fc-8d6b-005ceacad69e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:22.058808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d21811fb-5303-4fde-a20f-a4c81d0bfa93 admin admin] The token cache is being invalidate because project 2b4c650076ad4077874a72f6e64461f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:16:22.059112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d21811fb-5303-4fde-a20f-a4c81d0bfa93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:22.060216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d21811fb-5303-4fde-a20f-a4c81d0bfa93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:22.066212 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2159/4317] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:21 2022] DELETE /identity/v3/projects/2b4c650076ad4077874a72f6e64461f3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:22.068856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c26b24-c534-46d2-8862-9bb4b0b43bb7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:22.069154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c26b24-c534-46d2-8862-9bb4b0b43bb7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:22.069441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c26b24-c534-46d2-8862-9bb4b0b43bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:22.105559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-53c26b24-c534-46d2-8862-9bb4b0b43bb7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:22.107054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-53c26b24-c534-46d2-8862-9bb4b0b43bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:22.136618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:22.166417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac98289-7ee3-4681-af7a-d6c074fb2305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:22.168650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac98289-7ee3-4681-af7a-d6c074fb2305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:22.170926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac98289-7ee3-4681-af7a-d6c074fb2305 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:22.171366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac98289-7ee3-4681-af7a-d6c074fb2305 admin admin] PATH_INFO: `/v3/projects/ed97307eead04aaabf8c45432ecd2c97` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:22.173943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac98289-7ee3-4681-af7a-d6c074fb2305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed97307eead04aaabf8c45432ecd2c97)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:22.179374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac98289-7ee3-4681-af7a-d6c074fb2305 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:22.282673 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2160/4318] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:22.295251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78db1d-f82e-4b43-805f-934fb02dcc89 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:22.295710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78db1d-f82e-4b43-805f-934fb02dcc89 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:22.296236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78db1d-f82e-4b43-805f-934fb02dcc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:22.296485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cac98289-7ee3-4681-af7a-d6c074fb2305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed97307eead04aaabf8c45432ecd2c97', 'request_id': 'req-cac98289-7ee3-4681-af7a-d6c074fb2305'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:22.315809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cac98289-7ee3-4681-af7a-d6c074fb2305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed97307eead04aaabf8c45432ecd2c97', 'request_id': 'req-cac98289-7ee3-4681-af7a-d6c074fb2305'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:22.328662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cac98289-7ee3-4681-af7a-d6c074fb2305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed97307eead04aaabf8c45432ecd2c97', 'request_id': 'req-cac98289-7ee3-4681-af7a-d6c074fb2305'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:22.330848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ac78db1d-f82e-4b43-805f-934fb02dcc89 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:22.333386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ac78db1d-f82e-4b43-805f-934fb02dcc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:22.388827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cac98289-7ee3-4681-af7a-d6c074fb2305 admin admin] The token cache is being invalidate because project ed97307eead04aaabf8c45432ecd2c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:16:22.390932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cac98289-7ee3-4681-af7a-d6c074fb2305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:22.392375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cac98289-7ee3-4681-af7a-d6c074fb2305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:22.395720 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2159/4319] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:21 2022] DELETE /identity/v3/projects/ed97307eead04aaabf8c45432ecd2c97 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:22.398177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac98289-7ee3-4681-af7a-d6c074fb2305 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:22.402200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cac98289-7ee3-4681-af7a-d6c074fb2305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:22.409100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:22.470528 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2161/4320] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:22.476783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc22945-c870-4452-913f-c33a5bce0aff None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:22.477286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc22945-c870-4452-913f-c33a5bce0aff None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:22.478596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc22945-c870-4452-913f-c33a5bce0aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:22.523539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac98289-7ee3-4681-af7a-d6c074fb2305 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:22.530238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3cdda-e334-489f-aa39-eb92ffc0c7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:22.531052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3cdda-e334-489f-aa39-eb92ffc0c7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:22.531475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3cdda-e334-489f-aa39-eb92ffc0c7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:22.531862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3cdda-e334-489f-aa39-eb92ffc0c7ec admin admin] PATH_INFO: `/v3/projects/874222f573704f10bff5cb7cdce08465` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:22.533181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3cdda-e334-489f-aa39-eb92ffc0c7ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=874222f573704f10bff5cb7cdce08465)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:22.535976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3cdda-e334-489f-aa39-eb92ffc0c7ec admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:22.536476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-cbc22945-c870-4452-913f-c33a5bce0aff None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:22.537754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cbc22945-c870-4452-913f-c33a5bce0aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:22.550673 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2162/4321] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:22.569015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc22945-c870-4452-913f-c33a5bce0aff None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:22.587569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc22945-c870-4452-913f-c33a5bce0aff None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:22.595824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79234521-5366-4a80-938a-331bc7057433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:22.596518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79234521-5366-4a80-938a-331bc7057433 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:22.596875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79234521-5366-4a80-938a-331bc7057433 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:22.597160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79234521-5366-4a80-938a-331bc7057433 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:22.598747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79234521-5366-4a80-938a-331bc7057433 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:16:22.599113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79234521-5366-4a80-938a-331bc7057433 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:22.602234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79234521-5366-4a80-938a-331bc7057433 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:22.620152 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2163/4322] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:16:22.621855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d7aa3-a083-4701-b3b0-3424bcd5d9ec None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:22.622153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d7aa3-a083-4701-b3b0-3424bcd5d9ec None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:22.622432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d7aa3-a083-4701-b3b0-3424bcd5d9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:22.636957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-79e3cdda-e334-489f-aa39-eb92ffc0c7ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '874222f573704f10bff5cb7cdce08465', 'request_id': 'req-79e3cdda-e334-489f-aa39-eb92ffc0c7ec'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:22.650211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-79e3cdda-e334-489f-aa39-eb92ffc0c7ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '874222f573704f10bff5cb7cdce08465', 'request_id': 'req-79e3cdda-e334-489f-aa39-eb92ffc0c7ec'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:22.654238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2e0d7aa3-a083-4701-b3b0-3424bcd5d9ec None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:22.656062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2e0d7aa3-a083-4701-b3b0-3424bcd5d9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:22.673755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-79e3cdda-e334-489f-aa39-eb92ffc0c7ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '874222f573704f10bff5cb7cdce08465', 'request_id': 'req-79e3cdda-e334-489f-aa39-eb92ffc0c7ec'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:22.706222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-79e3cdda-e334-489f-aa39-eb92ffc0c7ec admin admin] The token cache is being invalidate because project 874222f573704f10bff5cb7cdce08465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:16:22.706677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-79e3cdda-e334-489f-aa39-eb92ffc0c7ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:22.708186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-79e3cdda-e334-489f-aa39-eb92ffc0c7ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:22.710414 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2160/4323] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:22 2022] DELETE /identity/v3/projects/874222f573704f10bff5cb7cdce08465 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:22.710782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3cdda-e334-489f-aa39-eb92ffc0c7ec admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:22.716694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-79e3cdda-e334-489f-aa39-eb92ffc0c7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:22.741167 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2164/4324] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:22.742452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fc404-e6f0-46bd-a316-d3ba6ad72fb1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:22.742739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fc404-e6f0-46bd-a316-d3ba6ad72fb1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:22.743015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fc404-e6f0-46bd-a316-d3ba6ad72fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:22.782049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ce9fc404-e6f0-46bd-a316-d3ba6ad72fb1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:22.783553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ce9fc404-e6f0-46bd-a316-d3ba6ad72fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:22.797479 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2165/4325] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:22.798923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fc404-e6f0-46bd-a316-d3ba6ad72fb1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:22.824380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fc404-e6f0-46bd-a316-d3ba6ad72fb1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:22.833570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f7543-84a6-4e37-a38c-6632986b519d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:22.834479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f7543-84a6-4e37-a38c-6632986b519d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:22.835006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f7543-84a6-4e37-a38c-6632986b519d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:22.835625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f7543-84a6-4e37-a38c-6632986b519d admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:22.836704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f7543-84a6-4e37-a38c-6632986b519d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:16:22.837255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f7543-84a6-4e37-a38c-6632986b519d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:22.841743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f7543-84a6-4e37-a38c-6632986b519d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:22.855101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3cdda-e334-489f-aa39-eb92ffc0c7ec admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:22.863272 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2166/4326] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:16:22.863272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95936a1-2c8f-4dde-a7d6-7121f8b81ecb None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:22.863845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95936a1-2c8f-4dde-a7d6-7121f8b81ecb None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:22.864226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95936a1-2c8f-4dde-a7d6-7121f8b81ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:22.864747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf94d2-703d-4890-9cdb-ef61d8089605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:22.865401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf94d2-703d-4890-9cdb-ef61d8089605 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:22.865691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf94d2-703d-4890-9cdb-ef61d8089605 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:22.865978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf94d2-703d-4890-9cdb-ef61d8089605 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:22.866656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf94d2-703d-4890-9cdb-ef61d8089605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:22.870536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf94d2-703d-4890-9cdb-ef61d8089605 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:22.914805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f95936a1-2c8f-4dde-a7d6-7121f8b81ecb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:22.916466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f95936a1-2c8f-4dde-a7d6-7121f8b81ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:22.934894 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2167/4327] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:22.936107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95936a1-2c8f-4dde-a7d6-7121f8b81ecb None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:22.942878 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2161/4328] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:22 2022] POST /identity/v3/projects => generated 375 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:22.942878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf94d2-703d-4890-9cdb-ef61d8089605 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:22.968078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:22.970620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95936a1-2c8f-4dde-a7d6-7121f8b81ecb None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:22.986067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:23.045922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca253af5-61ec-4b3e-ad24-4402bdf411b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:23.046631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca253af5-61ec-4b3e-ad24-4402bdf411b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:23.047264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca253af5-61ec-4b3e-ad24-4402bdf411b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:23.047264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca253af5-61ec-4b3e-ad24-4402bdf411b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:23.047789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca253af5-61ec-4b3e-ad24-4402bdf411b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:23.049686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca253af5-61ec-4b3e-ad24-4402bdf411b7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:23.051110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf94d2-703d-4890-9cdb-ef61d8089605 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:23.060580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaa81a-f8f7-44ba-b6b5-24af4c807c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:23.061323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaa81a-f8f7-44ba-b6b5-24af4c807c45 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:23.061691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaa81a-f8f7-44ba-b6b5-24af4c807c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:23.062048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaa81a-f8f7-44ba-b6b5-24af4c807c45 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:23.063282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaa81a-f8f7-44ba-b6b5-24af4c807c45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:16:23.063700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaa81a-f8f7-44ba-b6b5-24af4c807c45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:23.066182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaa81a-f8f7-44ba-b6b5-24af4c807c45 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:23.081977 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2162/4329] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:16:23.083486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaa81a-f8f7-44ba-b6b5-24af4c807c45 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:23.085607 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2168/4330] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:22 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:23.086468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca253af5-61ec-4b3e-ad24-4402bdf411b7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:23.096741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaa81a-f8f7-44ba-b6b5-24af4c807c45 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:23.159417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca253af5-61ec-4b3e-ad24-4402bdf411b7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:23.166751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1437d2-3956-4a05-8361-8776c11a98a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:23.167526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1437d2-3956-4a05-8361-8776c11a98a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:23.167818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1437d2-3956-4a05-8361-8776c11a98a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:23.168122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1437d2-3956-4a05-8361-8776c11a98a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:23.168837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1437d2-3956-4a05-8361-8776c11a98a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:23.170690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1437d2-3956-4a05-8361-8776c11a98a5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:23.171902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3cae8b-d766-41c2-be1d-909cece63206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:23.172673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cae8b-d766-41c2-be1d-909cece63206 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:23.173061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cae8b-d766-41c2-be1d-909cece63206 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:23.173525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cae8b-d766-41c2-be1d-909cece63206 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:23.174287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3cae8b-d766-41c2-be1d-909cece63206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:23.176662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3cae8b-d766-41c2-be1d-909cece63206 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:23.204012 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2169/4331] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:23 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:23.204734 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2163/4332] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:16:23 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:23.208370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1437d2-3956-4a05-8361-8776c11a98a5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:23.208840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3cae8b-d766-41c2-be1d-909cece63206 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:23.223041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3cae8b-d766-41c2-be1d-909cece63206 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:23.300042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1437d2-3956-4a05-8361-8776c11a98a5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:23.300663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad6ada-e83c-463c-b1a0-a992c24e3e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:23.301334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad6ada-e83c-463c-b1a0-a992c24e3e78 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:23.301622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad6ada-e83c-463c-b1a0-a992c24e3e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:23.301897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad6ada-e83c-463c-b1a0-a992c24e3e78 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:23.302569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad6ada-e83c-463c-b1a0-a992c24e3e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:23.304520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad6ada-e83c-463c-b1a0-a992c24e3e78 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:23.307404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827ec54-1f98-4ec3-be70-f65c824d1266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:23.308930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827ec54-1f98-4ec3-be70-f65c824d1266 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:23.309436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827ec54-1f98-4ec3-be70-f65c824d1266 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:23.309957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827ec54-1f98-4ec3-be70-f65c824d1266 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:23.311051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827ec54-1f98-4ec3-be70-f65c824d1266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:23.313456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827ec54-1f98-4ec3-be70-f65c824d1266 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:23.331261 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2164/4333] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:16:23 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:23.332124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad6ada-e83c-463c-b1a0-a992c24e3e78 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:23.336002 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2170/4334] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:16:23 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:23.336810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827ec54-1f98-4ec3-be70-f65c824d1266 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:23.338470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5827ec54-1f98-4ec3-be70-f65c824d1266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:23.343033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad6ada-e83c-463c-b1a0-a992c24e3e78 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:23.351018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ad1e5-3b1b-45ca-9b4e-8fd72abb26f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:23.351707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ad1e5-3b1b-45ca-9b4e-8fd72abb26f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:23.351996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ad1e5-3b1b-45ca-9b4e-8fd72abb26f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:23.352388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ad1e5-3b1b-45ca-9b4e-8fd72abb26f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:23.353095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ad1e5-3b1b-45ca-9b4e-8fd72abb26f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:23.353301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827ec54-1f98-4ec3-be70-f65c824d1266 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:23.354963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ad1e5-3b1b-45ca-9b4e-8fd72abb26f0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:23.358958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c096fc0-adc8-4918-b562-462745814783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:23.359722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c096fc0-adc8-4918-b562-462745814783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:23.360012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c096fc0-adc8-4918-b562-462745814783 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:23.360290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c096fc0-adc8-4918-b562-462745814783 admin admin] PATH_INFO: `/v3/users/4b4290dc9e8042b58ae1965c00dfe78b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:23.361532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c096fc0-adc8-4918-b562-462745814783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b4290dc9e8042b58ae1965c00dfe78b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:23.363482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c096fc0-adc8-4918-b562-462745814783 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:23.367188 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2165/4335] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:23.368080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ad1e5-3b1b-45ca-9b4e-8fd72abb26f0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:23.371131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:23.379496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ad1e5-3b1b-45ca-9b4e-8fd72abb26f0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:23.384455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e611ab-feac-46c8-9d8c-a6f746286eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:23.385048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e611ab-feac-46c8-9d8c-a6f746286eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:23.385330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e611ab-feac-46c8-9d8c-a6f746286eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:23.385632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e611ab-feac-46c8-9d8c-a6f746286eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:23.387040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e611ab-feac-46c8-9d8c-a6f746286eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:23.388813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e611ab-feac-46c8-9d8c-a6f746286eb8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:23.400536 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2166/4336] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:23.401800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e611ab-feac-46c8-9d8c-a6f746286eb8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:23.411855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e611ab-feac-46c8-9d8c-a6f746286eb8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:23.416836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1c096fc0-adc8-4918-b562-462745814783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b4290dc9e8042b58ae1965c00dfe78b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:23.417007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2059bc4-bfb1-4f78-9d22-ec27f83d6800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:23.417547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1c096fc0-adc8-4918-b562-462745814783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b4290dc9e8042b58ae1965c00dfe78b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:23.417694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2059bc4-bfb1-4f78-9d22-ec27f83d6800 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:23.417877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2059bc4-bfb1-4f78-9d22-ec27f83d6800 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:23.418152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2059bc4-bfb1-4f78-9d22-ec27f83d6800 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:23.418831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2059bc4-bfb1-4f78-9d22-ec27f83d6800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:23.420509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2059bc4-bfb1-4f78-9d22-ec27f83d6800 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:23.422642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:23.433685 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2167/4337] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:23.434535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2059bc4-bfb1-4f78-9d22-ec27f83d6800 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:23.436507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c2059bc4-bfb1-4f78-9d22-ec27f83d6800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:23.437795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1c096fc0-adc8-4918-b562-462745814783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b4290dc9e8042b58ae1965c00dfe78b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:23.438653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1c096fc0-adc8-4918-b562-462745814783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b4290dc9e8042b58ae1965c00dfe78b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:23.447043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1c096fc0-adc8-4918-b562-462745814783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b4290dc9e8042b58ae1965c00dfe78b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:23.451166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2059bc4-bfb1-4f78-9d22-ec27f83d6800 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:23.456103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bba63-bc32-4fa2-8e5a-e7efad88e549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:23.456717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bba63-bc32-4fa2-8e5a-e7efad88e549 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:23.457004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bba63-bc32-4fa2-8e5a-e7efad88e549 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:23.457320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bba63-bc32-4fa2-8e5a-e7efad88e549 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:23.458023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bba63-bc32-4fa2-8e5a-e7efad88e549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:23.459702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bba63-bc32-4fa2-8e5a-e7efad88e549 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:23.460370 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2171/4338] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:16:23 2022] DELETE /identity/v3/users/4b4290dc9e8042b58ae1965c00dfe78b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:23.461162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c096fc0-adc8-4918-b562-462745814783 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:23.462504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1c096fc0-adc8-4918-b562-462745814783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:23.471659 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2168/4339] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:23.472504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bba63-bc32-4fa2-8e5a-e7efad88e549 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:23.474358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-418bba63-bc32-4fa2-8e5a-e7efad88e549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:23.490967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bba63-bc32-4fa2-8e5a-e7efad88e549 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:23.556089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c096fc0-adc8-4918-b562-462745814783 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:23.563704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4747a-7ac0-4287-97a2-df7caeebeefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:23.565672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4747a-7ac0-4287-97a2-df7caeebeefd admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:23.566163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4747a-7ac0-4287-97a2-df7caeebeefd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:23.566670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4747a-7ac0-4287-97a2-df7caeebeefd admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:23.567609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4747a-7ac0-4287-97a2-df7caeebeefd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:23.569654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4747a-7ac0-4287-97a2-df7caeebeefd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:23.572166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be915476-e35d-42a4-b673-e6624db66538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:23.572942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be915476-e35d-42a4-b673-e6624db66538 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:23.573479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be915476-e35d-42a4-b673-e6624db66538 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:23.573861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be915476-e35d-42a4-b673-e6624db66538 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:23.574786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be915476-e35d-42a4-b673-e6624db66538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:23.576559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be915476-e35d-42a4-b673-e6624db66538 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:23.585815 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2172/4340] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:23.586977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4747a-7ac0-4287-97a2-df7caeebeefd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:23.590845 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2169/4341] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:23.591815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be915476-e35d-42a4-b673-e6624db66538 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:23.604168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be915476-e35d-42a4-b673-e6624db66538 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:23.606237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4747a-7ac0-4287-97a2-df7caeebeefd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:23.612625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea45da-e1b2-41d2-9c63-91acbb0a8464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:23.613533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d4e5e-9a0a-4bf5-84ae-529546e9e40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:23.614149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea45da-e1b2-41d2-9c63-91acbb0a8464 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:23.614278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d4e5e-9a0a-4bf5-84ae-529546e9e40d admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:23.614645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d4e5e-9a0a-4bf5-84ae-529546e9e40d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:23.615137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea45da-e1b2-41d2-9c63-91acbb0a8464 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:23.615335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d4e5e-9a0a-4bf5-84ae-529546e9e40d admin admin] PATH_INFO: `/v3/projects/90a8a347af0e497dbd65c1b79f4cde22/users/5f6545058c3d465992b5761677dc5261/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:23.616006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea45da-e1b2-41d2-9c63-91acbb0a8464 admin admin] PATH_INFO: `/v3/projects/667f980c89e44761854a092ff2addee9/users/cd36f0a48bf3474984d257a447cc826c/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:23.635600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d4e5e-9a0a-4bf5-84ae-529546e9e40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a8a347af0e497dbd65c1b79f4cde22, user_id=5f6545058c3d465992b5761677dc5261, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:23.638843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d4e5e-9a0a-4bf5-84ae-529546e9e40d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:23.645339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea45da-e1b2-41d2-9c63-91acbb0a8464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=667f980c89e44761854a092ff2addee9, user_id=cd36f0a48bf3474984d257a447cc826c, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:23.649284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea45da-e1b2-41d2-9c63-91acbb0a8464 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:23.661304 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2170/4342] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:23 2022] PUT /identity/v3/projects/90a8a347af0e497dbd65c1b79f4cde22/users/5f6545058c3d465992b5761677dc5261/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:23.662527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d4e5e-9a0a-4bf5-84ae-529546e9e40d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:23.675617 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2173/4343] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:23 2022] PUT /identity/v3/projects/667f980c89e44761854a092ff2addee9/users/cd36f0a48bf3474984d257a447cc826c/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:23.677468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92f24a-6301-46d6-ac34-1fa405dad5dc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:23.678154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92f24a-6301-46d6-ac34-1fa405dad5dc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:23.678706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92f24a-6301-46d6-ac34-1fa405dad5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:23.704402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1c92f24a-6301-46d6-ac34-1fa405dad5dc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:23.706024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1c92f24a-6301-46d6-ac34-1fa405dad5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:23.745902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d4e5e-9a0a-4bf5-84ae-529546e9e40d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:23.788191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:23.818508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68374dc3-0d2d-4029-a83e-c8a3bd133e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:23.823478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68374dc3-0d2d-4029-a83e-c8a3bd133e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:23.823996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68374dc3-0d2d-4029-a83e-c8a3bd133e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:23.824600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68374dc3-0d2d-4029-a83e-c8a3bd133e28 admin admin] PATH_INFO: `/v3/projects/563728adf42b4406a340fc8ac17e8421/users/6f3dedfa378e41d0b0fdb0a685d4e1fb/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:23.831641 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2174/4344] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:23.832975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc47d3-18cc-4930-ad1f-65d72485984b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:23.833271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc47d3-18cc-4930-ad1f-65d72485984b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:23.835346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc47d3-18cc-4930-ad1f-65d72485984b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:23.843936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:23.852410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68374dc3-0d2d-4029-a83e-c8a3bd133e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=563728adf42b4406a340fc8ac17e8421, user_id=6f3dedfa378e41d0b0fdb0a685d4e1fb, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:23.856089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68374dc3-0d2d-4029-a83e-c8a3bd133e28 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:23.877175 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2171/4345] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:23 2022] PUT /identity/v3/projects/563728adf42b4406a340fc8ac17e8421/users/6f3dedfa378e41d0b0fdb0a685d4e1fb/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:23.878273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68374dc3-0d2d-4029-a83e-c8a3bd133e28 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:23.879878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-68374dc3-0d2d-4029-a83e-c8a3bd133e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:23.885149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c8cc47d3-18cc-4930-ad1f-65d72485984b None None] MFA Rules not processed for user `cd36f0a48bf3474984d257a447cc826c`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:23.888205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c8cc47d3-18cc-4930-ad1f-65d72485984b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:23.967846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68374dc3-0d2d-4029-a83e-c8a3bd133e28 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:23.973686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22417304-67cf-4aee-b101-62bc833c9181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:23.974754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22417304-67cf-4aee-b101-62bc833c9181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:23.974754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22417304-67cf-4aee-b101-62bc833c9181 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:23.975097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22417304-67cf-4aee-b101-62bc833c9181 admin admin] PATH_INFO: `/v3/projects/e33adbba42e242c394fc4e395ecbdca7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:23.976421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22417304-67cf-4aee-b101-62bc833c9181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e33adbba42e242c394fc4e395ecbdca7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:23.978492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22417304-67cf-4aee-b101-62bc833c9181 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:24.019590 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2175/4346] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:24.021328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc47d3-18cc-4930-ad1f-65d72485984b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:24.024839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c8cc47d3-18cc-4930-ad1f-65d72485984b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:24.078900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-22417304-67cf-4aee-b101-62bc833c9181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e33adbba42e242c394fc4e395ecbdca7', 'request_id': 'req-22417304-67cf-4aee-b101-62bc833c9181'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:24.087327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-22417304-67cf-4aee-b101-62bc833c9181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e33adbba42e242c394fc4e395ecbdca7', 'request_id': 'req-22417304-67cf-4aee-b101-62bc833c9181'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:24.096224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc47d3-18cc-4930-ad1f-65d72485984b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:24.100363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-22417304-67cf-4aee-b101-62bc833c9181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e33adbba42e242c394fc4e395ecbdca7', 'request_id': 'req-22417304-67cf-4aee-b101-62bc833c9181'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:24.115435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-22417304-67cf-4aee-b101-62bc833c9181 admin admin] The token cache is being invalidate because project e33adbba42e242c394fc4e395ecbdca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:16:24.115879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-22417304-67cf-4aee-b101-62bc833c9181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:24.116668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-22417304-67cf-4aee-b101-62bc833c9181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:24.118678 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2172/4347] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:23 2022] DELETE /identity/v3/projects/e33adbba42e242c394fc4e395ecbdca7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:24.120448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585665c0-0acf-49a6-9df5-b1e0cf6d9953 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:24.120848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585665c0-0acf-49a6-9df5-b1e0cf6d9953 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:24.121292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585665c0-0acf-49a6-9df5-b1e0cf6d9953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:24.156940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-585665c0-0acf-49a6-9df5-b1e0cf6d9953 None None] MFA Rules not processed for user `6f3dedfa378e41d0b0fdb0a685d4e1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:24.158571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-585665c0-0acf-49a6-9df5-b1e0cf6d9953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:24.182059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c03252-521e-4c92-9d50-28670986229c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:24.183578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c03252-521e-4c92-9d50-28670986229c service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:24.183909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c03252-521e-4c92-9d50-28670986229c service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:24.184311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c03252-521e-4c92-9d50-28670986229c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:24.187512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b4c03252-521e-4c92-9d50-28670986229c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:24.257838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:24.270366 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2173/4348] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:24.272123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb293d65-26e7-4380-8349-3c774a9b5910 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:24.272798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb293d65-26e7-4380-8349-3c774a9b5910 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:24.273442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb293d65-26e7-4380-8349-3c774a9b5910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:24.273580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c03252-521e-4c92-9d50-28670986229c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:24.275420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c03252-521e-4c92-9d50-28670986229c service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:24.286235 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2176/4349] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:16:24.288296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c03252-521e-4c92-9d50-28670986229c service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:24.289765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b4c03252-521e-4c92-9d50-28670986229c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:24.297278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-fb293d65-26e7-4380-8349-3c774a9b5910 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:24.299093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fb293d65-26e7-4380-8349-3c774a9b5910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:24.312073 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2174/4350] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:24.313937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb293d65-26e7-4380-8349-3c774a9b5910 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:24.315763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fb293d65-26e7-4380-8349-3c774a9b5910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:24.324018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:24.330608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb293d65-26e7-4380-8349-3c774a9b5910 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:24.336151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6761e8-938e-46c7-9293-908d4b22a2dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:24.337119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6761e8-938e-46c7-9293-908d4b22a2dc service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:24.337713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6761e8-938e-46c7-9293-908d4b22a2dc service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:24.338552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6761e8-938e-46c7-9293-908d4b22a2dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:24.352854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6761e8-938e-46c7-9293-908d4b22a2dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:24.355326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6761e8-938e-46c7-9293-908d4b22a2dc service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:24.368749 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2175/4351] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:16:24.370691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66f41b-e4a1-4df2-bbdf-13773bd8c7e6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:24.370997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66f41b-e4a1-4df2-bbdf-13773bd8c7e6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:24.371808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66f41b-e4a1-4df2-bbdf-13773bd8c7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:24.391852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c03252-521e-4c92-9d50-28670986229c service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:24.399454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06df41-e2a6-49e7-b797-31bc033058a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:24.400340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06df41-e2a6-49e7-b797-31bc033058a3 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:24.400733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ae66f41b-e4a1-4df2-bbdf-13773bd8c7e6 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:24.402136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06df41-e2a6-49e7-b797-31bc033058a3 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:24.402383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ae66f41b-e4a1-4df2-bbdf-13773bd8c7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:24.403086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06df41-e2a6-49e7-b797-31bc033058a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:24.406126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ba06df41-e2a6-49e7-b797-31bc033058a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:24.413881 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2176/4352] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:24.419898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66f41b-e4a1-4df2-bbdf-13773bd8c7e6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:24.433387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66f41b-e4a1-4df2-bbdf-13773bd8c7e6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:24.445001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff0a63-9eeb-44f3-8c7b-de9c9f945ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:24.445954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff0a63-9eeb-44f3-8c7b-de9c9f945ddc admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:24.446583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff0a63-9eeb-44f3-8c7b-de9c9f945ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:24.447045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff0a63-9eeb-44f3-8c7b-de9c9f945ddc admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:24.449057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff0a63-9eeb-44f3-8c7b-de9c9f945ddc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:16:24.449567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff0a63-9eeb-44f3-8c7b-de9c9f945ddc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:24.452779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff0a63-9eeb-44f3-8c7b-de9c9f945ddc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:24.467014 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2177/4353] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:16:24.471618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff0a63-9eeb-44f3-8c7b-de9c9f945ddc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:24.486002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff0a63-9eeb-44f3-8c7b-de9c9f945ddc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:24.492223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2c003-322d-4db7-a739-0d90b0ca1748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:24.493034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2c003-322d-4db7-a739-0d90b0ca1748 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:24.493427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2c003-322d-4db7-a739-0d90b0ca1748 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:24.493777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2c003-322d-4db7-a739-0d90b0ca1748 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:24.493986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06df41-e2a6-49e7-b797-31bc033058a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:24.494635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2c003-322d-4db7-a739-0d90b0ca1748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:24.496877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06df41-e2a6-49e7-b797-31bc033058a3 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:24.497943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2c003-322d-4db7-a739-0d90b0ca1748 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:24.528331 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2177/4354] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:16:24.544432 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2178/4355] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:24 2022] POST /identity/v3/projects => generated 389 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:16:24.546608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06df41-e2a6-49e7-b797-31bc033058a3 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:24.562229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06df41-e2a6-49e7-b797-31bc033058a3 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:24.696195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af429f72-2483-4295-8282-1b63b9fb998c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:24.697109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af429f72-2483-4295-8282-1b63b9fb998c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:24.697983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af429f72-2483-4295-8282-1b63b9fb998c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:24.699206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af429f72-2483-4295-8282-1b63b9fb998c admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:24.699567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af429f72-2483-4295-8282-1b63b9fb998c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:24.701743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af429f72-2483-4295-8282-1b63b9fb998c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:24.735917 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2178/4356] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:16:24 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:24.739781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2c003-322d-4db7-a739-0d90b0ca1748 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:24.761540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2c003-322d-4db7-a739-0d90b0ca1748 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:24.770849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8948b4-80d9-4923-9850-783be14378e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:24.772188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8948b4-80d9-4923-9850-783be14378e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:24.772188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8948b4-80d9-4923-9850-783be14378e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:24.772188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8948b4-80d9-4923-9850-783be14378e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:24.773582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8948b4-80d9-4923-9850-783be14378e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:24.774410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8948b4-80d9-4923-9850-783be14378e6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:24.786983 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2179/4357] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:24.791452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af429f72-2483-4295-8282-1b63b9fb998c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:24.804695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af429f72-2483-4295-8282-1b63b9fb998c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:24.810232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea0c3c-1b34-4f41-a38e-da3ae38646d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:24.810924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea0c3c-1b34-4f41-a38e-da3ae38646d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:24.811273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea0c3c-1b34-4f41-a38e-da3ae38646d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:24.811797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea0c3c-1b34-4f41-a38e-da3ae38646d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:24.812431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea0c3c-1b34-4f41-a38e-da3ae38646d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:24.823942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea0c3c-1b34-4f41-a38e-da3ae38646d7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:24.825254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8948b4-80d9-4923-9850-783be14378e6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:24.826872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5b8948b4-80d9-4923-9850-783be14378e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:24.843326 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2179/4358] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:24.844396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea0c3c-1b34-4f41-a38e-da3ae38646d7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:24.850045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8948b4-80d9-4923-9850-783be14378e6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:24.857480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea0c3c-1b34-4f41-a38e-da3ae38646d7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:24.860163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc6ba7-43a8-4c7f-ada4-de51361a2632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:24.863253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc6ba7-43a8-4c7f-ada4-de51361a2632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:24.863606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc6ba7-43a8-4c7f-ada4-de51361a2632 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:24.863860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b2022-b0fa-403f-ae1d-e7baa71ce024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:24.864006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc6ba7-43a8-4c7f-ada4-de51361a2632 admin admin] PATH_INFO: `/v3/users/cd36f0a48bf3474984d257a447cc826c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:24.864750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b2022-b0fa-403f-ae1d-e7baa71ce024 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:24.865131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b2022-b0fa-403f-ae1d-e7baa71ce024 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:24.865536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b2022-b0fa-403f-ae1d-e7baa71ce024 admin admin] PATH_INFO: `/v3/projects/8696e08b027f4d259759dff57403f900/users/7369e2a4c5b24e85b94816e6404b300f/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:24.866132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc6ba7-43a8-4c7f-ada4-de51361a2632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd36f0a48bf3474984d257a447cc826c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:24.868307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:24.869401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc6ba7-43a8-4c7f-ada4-de51361a2632 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:24.885094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b2022-b0fa-403f-ae1d-e7baa71ce024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8696e08b027f4d259759dff57403f900, user_id=7369e2a4c5b24e85b94816e6404b300f, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:24.888067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b2022-b0fa-403f-ae1d-e7baa71ce024 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:24.906561 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2180/4359] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:24 2022] PUT /identity/v3/projects/8696e08b027f4d259759dff57403f900/users/7369e2a4c5b24e85b94816e6404b300f/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:24.912110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1e2d9-7527-405f-9cce-182bbb7040e3 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:24.912407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1e2d9-7527-405f-9cce-182bbb7040e3 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:24.912800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1e2d9-7527-405f-9cce-182bbb7040e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:24.953773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-12bc6ba7-43a8-4c7f-ada4-de51361a2632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd36f0a48bf3474984d257a447cc826c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:24.954342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-40f1e2d9-7527-405f-9cce-182bbb7040e3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:24.958020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-40f1e2d9-7527-405f-9cce-182bbb7040e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:24.977804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-12bc6ba7-43a8-4c7f-ada4-de51361a2632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd36f0a48bf3474984d257a447cc826c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:24.979328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-12bc6ba7-43a8-4c7f-ada4-de51361a2632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd36f0a48bf3474984d257a447cc826c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:25.000984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-12bc6ba7-43a8-4c7f-ada4-de51361a2632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd36f0a48bf3474984d257a447cc826c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:25.002306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-12bc6ba7-43a8-4c7f-ada4-de51361a2632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd36f0a48bf3474984d257a447cc826c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:25.031347 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2180/4360] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:16:24 2022] DELETE /identity/v3/users/cd36f0a48bf3474984d257a447cc826c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:16:25.032980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cddae7-9d4b-40d2-977c-d57dc5ab5f2e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:25.033400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cddae7-9d4b-40d2-977c-d57dc5ab5f2e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:25.033971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cddae7-9d4b-40d2-977c-d57dc5ab5f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:25.053720 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2181/4361] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:16:25.062574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b4cddae7-9d4b-40d2-977c-d57dc5ab5f2e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:25.064310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b4cddae7-9d4b-40d2-977c-d57dc5ab5f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:25.075446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1e2d9-7527-405f-9cce-182bbb7040e3 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:25.076756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-40f1e2d9-7527-405f-9cce-182bbb7040e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:25.146867 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2181/4362] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:16:25.165747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cddae7-9d4b-40d2-977c-d57dc5ab5f2e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:25.167406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b4cddae7-9d4b-40d2-977c-d57dc5ab5f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:25.179887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:25.201594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1e2d9-7527-405f-9cce-182bbb7040e3 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:25.313884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc47b5-b273-4d19-9c7a-cee7a775649c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:25.315899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc47b5-b273-4d19-9c7a-cee7a775649c service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:25.317809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc47b5-b273-4d19-9c7a-cee7a775649c service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:25.318294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc47b5-b273-4d19-9c7a-cee7a775649c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:25.337637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cddae7-9d4b-40d2-977c-d57dc5ab5f2e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:25.344753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc47b5-b273-4d19-9c7a-cee7a775649c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:25.347997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc47b5-b273-4d19-9c7a-cee7a775649c service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:25.349470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e1820-0951-415c-accc-8b71551f4aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:25.351541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e1820-0951-415c-accc-8b71551f4aea service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:25.352044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e1820-0951-415c-accc-8b71551f4aea service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:25.352517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e1820-0951-415c-accc-8b71551f4aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:25.375274 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2182/4363] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:16:25.380934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e1820-0951-415c-accc-8b71551f4aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:25.386137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e1820-0951-415c-accc-8b71551f4aea service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:25.407011 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2182/4364] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:16:26.413197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc47b5-b273-4d19-9c7a-cee7a775649c service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:26.416953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a5fc47b5-b273-4d19-9c7a-cee7a775649c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:26.452982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc47b5-b273-4d19-9c7a-cee7a775649c service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:26.461673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fcfcc-e582-4c2e-a41f-290c0ce0b9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:26.462986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fcfcc-e582-4c2e-a41f-290c0ce0b9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:26.463411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fcfcc-e582-4c2e-a41f-290c0ce0b9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:26.464356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fcfcc-e582-4c2e-a41f-290c0ce0b9f6 admin admin] PATH_INFO: `/v3/projects/667f980c89e44761854a092ff2addee9` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:26.467418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473fcfcc-e582-4c2e-a41f-290c0ce0b9f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=667f980c89e44761854a092ff2addee9)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:26.469880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473fcfcc-e582-4c2e-a41f-290c0ce0b9f6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:26.557391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:26.569525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-473fcfcc-e582-4c2e-a41f-290c0ce0b9f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '667f980c89e44761854a092ff2addee9', 'request_id': 'req-473fcfcc-e582-4c2e-a41f-290c0ce0b9f6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:26.579316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-473fcfcc-e582-4c2e-a41f-290c0ce0b9f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '667f980c89e44761854a092ff2addee9', 'request_id': 'req-473fcfcc-e582-4c2e-a41f-290c0ce0b9f6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:26.610237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-473fcfcc-e582-4c2e-a41f-290c0ce0b9f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '667f980c89e44761854a092ff2addee9', 'request_id': 'req-473fcfcc-e582-4c2e-a41f-290c0ce0b9f6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:26.634932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-473fcfcc-e582-4c2e-a41f-290c0ce0b9f6 admin admin] The token cache is being invalidate because project 667f980c89e44761854a092ff2addee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:16:26.635388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-473fcfcc-e582-4c2e-a41f-290c0ce0b9f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:26.641597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-473fcfcc-e582-4c2e-a41f-290c0ce0b9f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:26.645991 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2183/4365] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:26 2022] DELETE /identity/v3/projects/667f980c89e44761854a092ff2addee9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:26.651961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f4045-49d4-47f5-b5b4-96cfed49af8e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:26.652467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f4045-49d4-47f5-b5b4-96cfed49af8e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:26.652580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f4045-49d4-47f5-b5b4-96cfed49af8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:26.694164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9b5f4045-49d4-47f5-b5b4-96cfed49af8e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:26.699816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9b5f4045-49d4-47f5-b5b4-96cfed49af8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:26.793628 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2183/4366] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:26.796678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4d1e-fcdf-4cbf-ba47-fe8d9d249b7d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:26.796678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4d1e-fcdf-4cbf-ba47-fe8d9d249b7d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:26.796931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4d1e-fcdf-4cbf-ba47-fe8d9d249b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:26.825182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-466d4d1e-fcdf-4cbf-ba47-fe8d9d249b7d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:26.826322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-466d4d1e-fcdf-4cbf-ba47-fe8d9d249b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:26.848695 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2184/4367] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:26.851022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f4045-49d4-47f5-b5b4-96cfed49af8e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:26.862534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f4045-49d4-47f5-b5b4-96cfed49af8e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:26.868342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63075407-3cfb-4d10-8957-6ac2ebd7f030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:26.869146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63075407-3cfb-4d10-8957-6ac2ebd7f030 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:26.869741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63075407-3cfb-4d10-8957-6ac2ebd7f030 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:26.869741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63075407-3cfb-4d10-8957-6ac2ebd7f030 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:26.870490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63075407-3cfb-4d10-8957-6ac2ebd7f030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:16:26.870851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63075407-3cfb-4d10-8957-6ac2ebd7f030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:26.873183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63075407-3cfb-4d10-8957-6ac2ebd7f030 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:26.892156 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2184/4368] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:16:26.893516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d4d1e-fcdf-4cbf-ba47-fe8d9d249b7d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:26.904265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d4d1e-fcdf-4cbf-ba47-fe8d9d249b7d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:26.910286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0650e-8955-4ff0-920f-6a3c8e8d41dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:26.911487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0650e-8955-4ff0-920f-6a3c8e8d41dc admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:26.911779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0650e-8955-4ff0-920f-6a3c8e8d41dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:26.912063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0650e-8955-4ff0-920f-6a3c8e8d41dc admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:26.912754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0650e-8955-4ff0-920f-6a3c8e8d41dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:26.914954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0650e-8955-4ff0-920f-6a3c8e8d41dc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:26.939099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63075407-3cfb-4d10-8957-6ac2ebd7f030 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:26.941305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-63075407-3cfb-4d10-8957-6ac2ebd7f030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:26.992411 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2185/4369] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:26 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:16:26.994902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0650e-8955-4ff0-920f-6a3c8e8d41dc admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:27.136781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0650e-8955-4ff0-920f-6a3c8e8d41dc admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:27.145339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38cfc9-ddf1-4243-a4ca-21bd7a43361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:27.146002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38cfc9-ddf1-4243-a4ca-21bd7a43361d admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:27.146395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38cfc9-ddf1-4243-a4ca-21bd7a43361d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:27.146702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38cfc9-ddf1-4243-a4ca-21bd7a43361d admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:27.147720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38cfc9-ddf1-4243-a4ca-21bd7a43361d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:27.149930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38cfc9-ddf1-4243-a4ca-21bd7a43361d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:27.159255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63075407-3cfb-4d10-8957-6ac2ebd7f030 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:27.221808 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2186/4370] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:16:26 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:27.231422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38cfc9-ddf1-4243-a4ca-21bd7a43361d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:27.266343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38cfc9-ddf1-4243-a4ca-21bd7a43361d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:27.274027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda0de1-dc5d-4de0-9cb4-3391ce21b51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:27.275207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:27.279567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda0de1-dc5d-4de0-9cb4-3391ce21b51a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:27.280141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda0de1-dc5d-4de0-9cb4-3391ce21b51a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:27.280650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda0de1-dc5d-4de0-9cb4-3391ce21b51a admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:27.281880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda0de1-dc5d-4de0-9cb4-3391ce21b51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:27.283874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda0de1-dc5d-4de0-9cb4-3391ce21b51a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:27.302227 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2187/4371] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:27.307595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda0de1-dc5d-4de0-9cb4-3391ce21b51a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:27.330794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3607495-6c12-4407-a026-e2b2b066ca2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:27.331967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3607495-6c12-4407-a026-e2b2b066ca2b service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:27.331967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3607495-6c12-4407-a026-e2b2b066ca2b service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:27.332308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3607495-6c12-4407-a026-e2b2b066ca2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:27.333985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda0de1-dc5d-4de0-9cb4-3391ce21b51a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:27.335865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b3607495-6c12-4407-a026-e2b2b066ca2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:27.343308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb4526-cc47-4cf0-b049-a2ea5f03710d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:27.344037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4526-cc47-4cf0-b049-a2ea5f03710d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:27.344341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4526-cc47-4cf0-b049-a2ea5f03710d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:27.344622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4526-cc47-4cf0-b049-a2ea5f03710d admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:27.345375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb4526-cc47-4cf0-b049-a2ea5f03710d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:27.347121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb4526-cc47-4cf0-b049-a2ea5f03710d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:27.357104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3607495-6c12-4407-a026-e2b2b066ca2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:27.362262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3607495-6c12-4407-a026-e2b2b066ca2b service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:27.370409 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2188/4372] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:27.374626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb4526-cc47-4cf0-b049-a2ea5f03710d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:27.392492 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2185/4373] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:16:27.394307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb4526-cc47-4cf0-b049-a2ea5f03710d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:27.399710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3408f-6a4a-4e78-b00f-b1d1f7003528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:27.400595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3408f-6a4a-4e78-b00f-b1d1f7003528 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:27.400734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3408f-6a4a-4e78-b00f-b1d1f7003528 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:27.400938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3408f-6a4a-4e78-b00f-b1d1f7003528 admin admin] PATH_INFO: `/v3/projects/5b2a81385c344fd1b33401470fabf82b/users/d3dce6e324c84c1581029aa9b8f24b69/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:27.434210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3408f-6a4a-4e78-b00f-b1d1f7003528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2a81385c344fd1b33401470fabf82b, user_id=d3dce6e324c84c1581029aa9b8f24b69, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:27.438411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3408f-6a4a-4e78-b00f-b1d1f7003528 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:27.475239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891a96d-fdb3-434e-937c-9c8a6e523213 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:27.475559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891a96d-fdb3-434e-937c-9c8a6e523213 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:27.475699 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2189/4374] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:27 2022] PUT /identity/v3/projects/5b2a81385c344fd1b33401470fabf82b/users/d3dce6e324c84c1581029aa9b8f24b69/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:27.475859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891a96d-fdb3-434e-937c-9c8a6e523213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:27.604733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b891a96d-fdb3-434e-937c-9c8a6e523213 None None] MFA Rules not processed for user `d3dce6e324c84c1581029aa9b8f24b69`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:27.605974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b891a96d-fdb3-434e-937c-9c8a6e523213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:27.770492 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2186/4375] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:27.775984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3408f-6a4a-4e78-b00f-b1d1f7003528 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:27.865748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:27.905056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3408f-6a4a-4e78-b00f-b1d1f7003528 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:27.913054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6eb141-d334-4cf3-967f-f76fd58d7f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:27.914101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6eb141-d334-4cf3-967f-f76fd58d7f00 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:27.914567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6eb141-d334-4cf3-967f-f76fd58d7f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:27.915048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6eb141-d334-4cf3-967f-f76fd58d7f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:27.916096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6eb141-d334-4cf3-967f-f76fd58d7f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:27.919099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6eb141-d334-4cf3-967f-f76fd58d7f00 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:27.970178 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2190/4376] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:27 2022] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:27.973935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891a96d-fdb3-434e-937c-9c8a6e523213 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:27.986303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891a96d-fdb3-434e-937c-9c8a6e523213 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:28.100201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e66850-5ca2-48ae-a5cd-82c51dd7f9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:28.100956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e66850-5ca2-48ae-a5cd-82c51dd7f9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:28.101319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e66850-5ca2-48ae-a5cd-82c51dd7f9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:28.101670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e66850-5ca2-48ae-a5cd-82c51dd7f9f6 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:28.102431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e66850-5ca2-48ae-a5cd-82c51dd7f9f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:28.105556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e66850-5ca2-48ae-a5cd-82c51dd7f9f6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:28.142371 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2187/4377] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:16:27 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:28.143557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6eb141-d334-4cf3-967f-f76fd58d7f00 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:28.159222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6eb141-d334-4cf3-967f-f76fd58d7f00 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:28.165712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1d7d0-1f55-4867-9f94-84848f82f340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:28.166637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1d7d0-1f55-4867-9f94-84848f82f340 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:28.167780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1d7d0-1f55-4867-9f94-84848f82f340 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:28.168255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1d7d0-1f55-4867-9f94-84848f82f340 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:28.169176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1d7d0-1f55-4867-9f94-84848f82f340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:28.171068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1d7d0-1f55-4867-9f94-84848f82f340 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:28.192171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e66850-5ca2-48ae-a5cd-82c51dd7f9f6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:28.193928 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2191/4378] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:16:28.211133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e66850-5ca2-48ae-a5cd-82c51dd7f9f6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:28.218807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedafc92-846b-49c6-897c-059d1cb3d66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:28.219759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedafc92-846b-49c6-897c-059d1cb3d66c admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:28.220181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedafc92-846b-49c6-897c-059d1cb3d66c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:28.220570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedafc92-846b-49c6-897c-059d1cb3d66c admin admin] PATH_INFO: `/v3/projects/c78ee704d98246cda0982d6cee4a472a/users/7100db1afc404f3baece07c51d7a0c34/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:28.242828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedafc92-846b-49c6-897c-059d1cb3d66c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78ee704d98246cda0982d6cee4a472a, user_id=7100db1afc404f3baece07c51d7a0c34, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:28.249018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedafc92-846b-49c6-897c-059d1cb3d66c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:28.269162 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2188/4379] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:28 2022] PUT /identity/v3/projects/c78ee704d98246cda0982d6cee4a472a/users/7100db1afc404f3baece07c51d7a0c34/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:28.274524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1d7d0-1f55-4867-9f94-84848f82f340 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:28.288234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1d7d0-1f55-4867-9f94-84848f82f340 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:28.410996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495e708-f473-4aca-8c67-fd3055d6e095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:28.411846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495e708-f473-4aca-8c67-fd3055d6e095 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:28.412206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495e708-f473-4aca-8c67-fd3055d6e095 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:28.412552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495e708-f473-4aca-8c67-fd3055d6e095 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:28.413635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495e708-f473-4aca-8c67-fd3055d6e095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:28.415651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495e708-f473-4aca-8c67-fd3055d6e095 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:28.459735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedafc92-846b-49c6-897c-059d1cb3d66c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:28.471849 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2192/4380] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:28.474962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedafc92-846b-49c6-897c-059d1cb3d66c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:28.482268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc93c65-b012-417b-b0fa-9d873280c45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:28.484631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc93c65-b012-417b-b0fa-9d873280c45b admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:28.485001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc93c65-b012-417b-b0fa-9d873280c45b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:28.485424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc93c65-b012-417b-b0fa-9d873280c45b admin admin] PATH_INFO: `/v3/projects/c78ee704d98246cda0982d6cee4a472a/users/7100db1afc404f3baece07c51d7a0c34/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:28.495867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc93c65-b012-417b-b0fa-9d873280c45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78ee704d98246cda0982d6cee4a472a, user_id=7100db1afc404f3baece07c51d7a0c34, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:28.499938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc93c65-b012-417b-b0fa-9d873280c45b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:28.527564 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2189/4381] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:28 2022] PUT /identity/v3/projects/c78ee704d98246cda0982d6cee4a472a/users/7100db1afc404f3baece07c51d7a0c34/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:28.531782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ff5eb-d9ab-4cb2-beb5-adfd3d2dda2d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:28.532231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ff5eb-d9ab-4cb2-beb5-adfd3d2dda2d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:28.532644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ff5eb-d9ab-4cb2-beb5-adfd3d2dda2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:28.576137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b99ff5eb-d9ab-4cb2-beb5-adfd3d2dda2d None None] MFA Rules not processed for user `7100db1afc404f3baece07c51d7a0c34`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:28.579343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b99ff5eb-d9ab-4cb2-beb5-adfd3d2dda2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:28.689377 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2193/4382] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:16:28.691647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc93c65-b012-417b-b0fa-9d873280c45b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:28.707240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:28.724680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc93c65-b012-417b-b0fa-9d873280c45b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:28.740432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761f9b8-ca22-4530-a758-75c2bcbdfae9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7100db1afc404f3baece07c51d7a0c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c78ee704d98246cda0982d6cee4a472a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:28.743714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761f9b8-ca22-4530-a758-75c2bcbdfae9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:28.744119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761f9b8-ca22-4530-a758-75c2bcbdfae9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:28.744609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761f9b8-ca22-4530-a758-75c2bcbdfae9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:28.746527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761f9b8-ca22-4530-a758-75c2bcbdfae9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:28.758452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761f9b8-ca22-4530-a758-75c2bcbdfae9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:28.820664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ff5eb-d9ab-4cb2-beb5-adfd3d2dda2d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:28.834991 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2190/4383] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 30 21:16:28 2022] POST /identity/v3/projects => generated 348 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:16:28.836595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ff5eb-d9ab-4cb2-beb5-adfd3d2dda2d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:28.907998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:28.949900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00dc41-e003-425f-bb4a-faf1b96fb3b6 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7100db1afc404f3baece07c51d7a0c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c78ee704d98246cda0982d6cee4a472a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:28.952483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00dc41-e003-425f-bb4a-faf1b96fb3b6 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:28.952962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00dc41-e003-425f-bb4a-faf1b96fb3b6 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:28.953411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00dc41-e003-425f-bb4a-faf1b96fb3b6 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:28.954369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00dc41-e003-425f-bb4a-faf1b96fb3b6 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:28.973148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00dc41-e003-425f-bb4a-faf1b96fb3b6 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:29.046664 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2194/4384] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:28 2022] POST /identity/v3/projects => generated 350 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:29.051460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761f9b8-ca22-4530-a758-75c2bcbdfae9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:29.067496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761f9b8-ca22-4530-a758-75c2bcbdfae9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:29.244025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9082c-f598-4654-9677-5de841d95ec4 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7100db1afc404f3baece07c51d7a0c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c78ee704d98246cda0982d6cee4a472a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:29.245816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9082c-f598-4654-9677-5de841d95ec4 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:29.247120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9082c-f598-4654-9677-5de841d95ec4 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:29.247755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9082c-f598-4654-9677-5de841d95ec4 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] PATH_INFO: `/v3/users/d3dce6e324c84c1581029aa9b8f24b69` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:29.249232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9082c-f598-4654-9677-5de841d95ec4 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorizing `identity:get_user(user_id=d3dce6e324c84c1581029aa9b8f24b69)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:29.252756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9082c-f598-4654-9677-5de841d95ec4 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:29.255927 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2191/4385] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:16:29 2022] GET /identity/v3/users/d3dce6e324c84c1581029aa9b8f24b69 => generated 287 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:16:29.261422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00dc41-e003-425f-bb4a-faf1b96fb3b6 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:29.282499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00dc41-e003-425f-bb4a-faf1b96fb3b6 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:29.304042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38948f3-907a-466d-961e-50a7e76fe202 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7100db1afc404f3baece07c51d7a0c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c78ee704d98246cda0982d6cee4a472a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:29.304715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38948f3-907a-466d-961e-50a7e76fe202 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:29.305012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38948f3-907a-466d-961e-50a7e76fe202 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:29.305298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38948f3-907a-466d-961e-50a7e76fe202 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:29.305997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38948f3-907a-466d-961e-50a7e76fe202 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:29.308637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38948f3-907a-466d-961e-50a7e76fe202 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:29.363093 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2195/4386] 10.222.0.17 () {60 vars in 1162 bytes} [Sat Jul 30 21:16:29 2022] POST /identity/v3/credentials => generated 431 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:29.367559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9082c-f598-4654-9677-5de841d95ec4 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:29.380508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9082c-f598-4654-9677-5de841d95ec4 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:29.388551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b1a41-efbe-44d4-aee9-54c025c8689d tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7100db1afc404f3baece07c51d7a0c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c78ee704d98246cda0982d6cee4a472a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:29.389279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b1a41-efbe-44d4-aee9-54c025c8689d tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:29.389572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b1a41-efbe-44d4-aee9-54c025c8689d tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:29.389851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b1a41-efbe-44d4-aee9-54c025c8689d tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] PATH_INFO: `/v3/credentials/58c6bf314f00bcb6334d51e0d3a98a0438107b1d110022e25d2e60102507c002` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:29.392518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b1a41-efbe-44d4-aee9-54c025c8689d tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=58c6bf314f00bcb6334d51e0d3a98a0438107b1d110022e25d2e60102507c002)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:29.397899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b1a41-efbe-44d4-aee9-54c025c8689d tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:29.401960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b1a41-efbe-44d4-aee9-54c025c8689d tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=58c6bf314f00bcb6334d51e0d3a98a0438107b1d110022e25d2e60102507c002)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:29.404173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b1a41-efbe-44d4-aee9-54c025c8689d tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:29.425627 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2192/4387] 10.222.0.17 () {60 vars in 1358 bytes} [Sat Jul 30 21:16:29 2022] PATCH /identity/v3/credentials/58c6bf314f00bcb6334d51e0d3a98a0438107b1d110022e25d2e60102507c002 => generated 437 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:16:29.427269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38948f3-907a-466d-961e-50a7e76fe202 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:29.439895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38948f3-907a-466d-961e-50a7e76fe202 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:29.447011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01d6e3-f88b-47ee-86cd-00582baff4fe tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7100db1afc404f3baece07c51d7a0c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c78ee704d98246cda0982d6cee4a472a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:29.447757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01d6e3-f88b-47ee-86cd-00582baff4fe tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:29.448747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01d6e3-f88b-47ee-86cd-00582baff4fe tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:29.449473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01d6e3-f88b-47ee-86cd-00582baff4fe tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] PATH_INFO: `/v3/credentials/58c6bf314f00bcb6334d51e0d3a98a0438107b1d110022e25d2e60102507c002` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:29.451852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01d6e3-f88b-47ee-86cd-00582baff4fe tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=58c6bf314f00bcb6334d51e0d3a98a0438107b1d110022e25d2e60102507c002)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:29.453792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01d6e3-f88b-47ee-86cd-00582baff4fe tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:29.465984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b1a41-efbe-44d4-aee9-54c025c8689d tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:29.466516 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2196/4388] 10.222.0.17 () {58 vars in 1335 bytes} [Sat Jul 30 21:16:29 2022] GET /identity/v3/credentials/58c6bf314f00bcb6334d51e0d3a98a0438107b1d110022e25d2e60102507c002 => generated 437 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:16:29.485265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b1a41-efbe-44d4-aee9-54c025c8689d tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:29.492119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f63cc2-5936-4aca-b7d3-f259ecf7e9c0 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7100db1afc404f3baece07c51d7a0c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c78ee704d98246cda0982d6cee4a472a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:29.493461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f63cc2-5936-4aca-b7d3-f259ecf7e9c0 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:29.493905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f63cc2-5936-4aca-b7d3-f259ecf7e9c0 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:29.494351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f63cc2-5936-4aca-b7d3-f259ecf7e9c0 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] PATH_INFO: `/v3/credentials/58c6bf314f00bcb6334d51e0d3a98a0438107b1d110022e25d2e60102507c002` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:29.497546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f63cc2-5936-4aca-b7d3-f259ecf7e9c0 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=58c6bf314f00bcb6334d51e0d3a98a0438107b1d110022e25d2e60102507c002)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:29.499545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f63cc2-5936-4aca-b7d3-f259ecf7e9c0 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:29.528433 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2193/4389] 10.222.0.17 () {58 vars in 1338 bytes} [Sat Jul 30 21:16:29 2022] DELETE /identity/v3/credentials/58c6bf314f00bcb6334d51e0d3a98a0438107b1d110022e25d2e60102507c002 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:29.529957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01d6e3-f88b-47ee-86cd-00582baff4fe tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:29.545668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01d6e3-f88b-47ee-86cd-00582baff4fe tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:29.558831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed3f64-3489-42d4-9244-157d0045754f tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7100db1afc404f3baece07c51d7a0c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c78ee704d98246cda0982d6cee4a472a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:29.559961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed3f64-3489-42d4-9244-157d0045754f tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:29.560625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed3f64-3489-42d4-9244-157d0045754f tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:29.561377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed3f64-3489-42d4-9244-157d0045754f tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:29.562779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed3f64-3489-42d4-9244-157d0045754f tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:29.567068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed3f64-3489-42d4-9244-157d0045754f tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:29.616232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f63cc2-5936-4aca-b7d3-f259ecf7e9c0 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:29.619327 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2197/4390] 10.222.0.17 () {60 vars in 1162 bytes} [Sat Jul 30 21:16:29 2022] POST /identity/v3/credentials => generated 429 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:29.639837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f63cc2-5936-4aca-b7d3-f259ecf7e9c0 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:29.651130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1012e2-8380-470b-a454-ab4afb7995f6 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7100db1afc404f3baece07c51d7a0c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c78ee704d98246cda0982d6cee4a472a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:29.653778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1012e2-8380-470b-a454-ab4afb7995f6 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:29.654316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1012e2-8380-470b-a454-ab4afb7995f6 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:29.654864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1012e2-8380-470b-a454-ab4afb7995f6 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:29.657150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1012e2-8380-470b-a454-ab4afb7995f6 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:29.661885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1012e2-8380-470b-a454-ab4afb7995f6 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:29.712000 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2194/4391] 10.222.0.17 () {60 vars in 1162 bytes} [Sat Jul 30 21:16:29 2022] POST /identity/v3/credentials => generated 430 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:29.713522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed3f64-3489-42d4-9244-157d0045754f tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:29.727588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed3f64-3489-42d4-9244-157d0045754f tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:29.734408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855df448-89e4-4544-b7ca-a9c54cbc6f65 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7100db1afc404f3baece07c51d7a0c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c78ee704d98246cda0982d6cee4a472a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:29.735252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855df448-89e4-4544-b7ca-a9c54cbc6f65 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:29.735711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855df448-89e4-4544-b7ca-a9c54cbc6f65 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:29.736476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855df448-89e4-4544-b7ca-a9c54cbc6f65 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:29.736878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855df448-89e4-4544-b7ca-a9c54cbc6f65 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:29.738678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855df448-89e4-4544-b7ca-a9c54cbc6f65 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:29.748609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855df448-89e4-4544-b7ca-a9c54cbc6f65 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:29.751955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855df448-89e4-4544-b7ca-a9c54cbc6f65 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:29.754889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855df448-89e4-4544-b7ca-a9c54cbc6f65 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:29.756875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855df448-89e4-4544-b7ca-a9c54cbc6f65 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:29.763964 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2198/4392] 10.222.0.17 () {58 vars in 1140 bytes} [Sat Jul 30 21:16:29 2022] GET /identity/v3/credentials => generated 944 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:16:29.765410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1012e2-8380-470b-a454-ab4afb7995f6 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:29.790778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1012e2-8380-470b-a454-ab4afb7995f6 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:29.802893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36809f29-cecc-4cc1-ada5-0fe0f6522bd5 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7100db1afc404f3baece07c51d7a0c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c78ee704d98246cda0982d6cee4a472a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:29.804439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36809f29-cecc-4cc1-ada5-0fe0f6522bd5 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:29.804736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36809f29-cecc-4cc1-ada5-0fe0f6522bd5 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:29.805024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36809f29-cecc-4cc1-ada5-0fe0f6522bd5 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] PATH_INFO: `/v3/credentials/50ba145b9577a0cd47b7301180878b85065fce7c0a062f0bd3988550bb020818` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:29.811518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36809f29-cecc-4cc1-ada5-0fe0f6522bd5 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=50ba145b9577a0cd47b7301180878b85065fce7c0a062f0bd3988550bb020818)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:29.814567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36809f29-cecc-4cc1-ada5-0fe0f6522bd5 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:29.849493 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2195/4393] 10.222.0.17 () {58 vars in 1338 bytes} [Sat Jul 30 21:16:29 2022] DELETE /identity/v3/credentials/50ba145b9577a0cd47b7301180878b85065fce7c0a062f0bd3988550bb020818 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:29.850906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855df448-89e4-4544-b7ca-a9c54cbc6f65 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:29.862505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855df448-89e4-4544-b7ca-a9c54cbc6f65 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:29.876534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e867d9-c699-4eaf-933b-29dc14d8a175 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7100db1afc404f3baece07c51d7a0c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c78ee704d98246cda0982d6cee4a472a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:29.885975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e867d9-c699-4eaf-933b-29dc14d8a175 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:29.888063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e867d9-c699-4eaf-933b-29dc14d8a175 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:29.888357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e867d9-c699-4eaf-933b-29dc14d8a175 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] PATH_INFO: `/v3/credentials/3ec698c87af4b3ef0fd90115f2b6db3de55c8e574c4c2cc359a5d426b02ec0f3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:29.890648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e867d9-c699-4eaf-933b-29dc14d8a175 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=3ec698c87af4b3ef0fd90115f2b6db3de55c8e574c4c2cc359a5d426b02ec0f3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:29.892482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e867d9-c699-4eaf-933b-29dc14d8a175 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:29.928313 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2199/4394] 10.222.0.17 () {58 vars in 1338 bytes} [Sat Jul 30 21:16:29 2022] DELETE /identity/v3/credentials/3ec698c87af4b3ef0fd90115f2b6db3de55c8e574c4c2cc359a5d426b02ec0f3 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:29.934803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36809f29-cecc-4cc1-ada5-0fe0f6522bd5 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:29.948263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36809f29-cecc-4cc1-ada5-0fe0f6522bd5 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:29.957386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f176664-efc2-42d7-a729-b3ee6a955fb9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7100db1afc404f3baece07c51d7a0c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c78ee704d98246cda0982d6cee4a472a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:29.958499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f176664-efc2-42d7-a729-b3ee6a955fb9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:29.959416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f176664-efc2-42d7-a729-b3ee6a955fb9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:29.959929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f176664-efc2-42d7-a729-b3ee6a955fb9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] PATH_INFO: `/v3/projects/4e1a833fe00e49f9befb02d546e461c2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:29.961776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f176664-efc2-42d7-a729-b3ee6a955fb9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4e1a833fe00e49f9befb02d546e461c2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:29.964551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f176664-efc2-42d7-a729-b3ee6a955fb9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:30.082953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5f176664-efc2-42d7-a729-b3ee6a955fb9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1a833fe00e49f9befb02d546e461c2', 'request_id': 'req-5f176664-efc2-42d7-a729-b3ee6a955fb9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:30.092051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5f176664-efc2-42d7-a729-b3ee6a955fb9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1a833fe00e49f9befb02d546e461c2', 'request_id': 'req-5f176664-efc2-42d7-a729-b3ee6a955fb9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:30.106367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5f176664-efc2-42d7-a729-b3ee6a955fb9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1a833fe00e49f9befb02d546e461c2', 'request_id': 'req-5f176664-efc2-42d7-a729-b3ee6a955fb9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:30.122827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5f176664-efc2-42d7-a729-b3ee6a955fb9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] The token cache is being invalidate because project 4e1a833fe00e49f9befb02d546e461c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:16:30.123132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5f176664-efc2-42d7-a729-b3ee6a955fb9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:30.125778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5f176664-efc2-42d7-a729-b3ee6a955fb9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:30.129387 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2196/4395] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:29 2022] DELETE /identity/v3/projects/4e1a833fe00e49f9befb02d546e461c2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:30.133137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e867d9-c699-4eaf-933b-29dc14d8a175 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:30.135729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-24e867d9-c699-4eaf-933b-29dc14d8a175 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:30.153018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e867d9-c699-4eaf-933b-29dc14d8a175 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:30.259169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee31fe2-a6c9-4f27-973d-7039e67f2a7f tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7100db1afc404f3baece07c51d7a0c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c78ee704d98246cda0982d6cee4a472a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:30.260190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee31fe2-a6c9-4f27-973d-7039e67f2a7f tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:30.260632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee31fe2-a6c9-4f27-973d-7039e67f2a7f tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:30.261247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee31fe2-a6c9-4f27-973d-7039e67f2a7f tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] PATH_INFO: `/v3/projects/d1b7ff924a164a7884262b211c06251d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:30.262161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee31fe2-a6c9-4f27-973d-7039e67f2a7f tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d1b7ff924a164a7884262b211c06251d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:30.264892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee31fe2-a6c9-4f27-973d-7039e67f2a7f tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:30.330640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3ee31fe2-a6c9-4f27-973d-7039e67f2a7f tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b7ff924a164a7884262b211c06251d', 'request_id': 'req-3ee31fe2-a6c9-4f27-973d-7039e67f2a7f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:30.343694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3ee31fe2-a6c9-4f27-973d-7039e67f2a7f tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b7ff924a164a7884262b211c06251d', 'request_id': 'req-3ee31fe2-a6c9-4f27-973d-7039e67f2a7f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:30.352044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3ee31fe2-a6c9-4f27-973d-7039e67f2a7f tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b7ff924a164a7884262b211c06251d', 'request_id': 'req-3ee31fe2-a6c9-4f27-973d-7039e67f2a7f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:30.355981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:30.367883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3ee31fe2-a6c9-4f27-973d-7039e67f2a7f tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] The token cache is being invalidate because project d1b7ff924a164a7884262b211c06251d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:16:30.368592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3ee31fe2-a6c9-4f27-973d-7039e67f2a7f tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:30.370177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3ee31fe2-a6c9-4f27-973d-7039e67f2a7f tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:30.376210 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2200/4396] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:30 2022] DELETE /identity/v3/projects/d1b7ff924a164a7884262b211c06251d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:30.377430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f176664-efc2-42d7-a729-b3ee6a955fb9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:30.381755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5f176664-efc2-42d7-a729-b3ee6a955fb9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:30.410344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=9 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:30.499426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f176664-efc2-42d7-a729-b3ee6a955fb9 tempest-CredentialsTestJSON-294558192 tempest-CredentialsTestJSON-294558192-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:30.588470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d808f-ebb6-411f-a765-40f56564b546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:30.590488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d808f-ebb6-411f-a765-40f56564b546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:30.591041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d808f-ebb6-411f-a765-40f56564b546 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:30.591453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d808f-ebb6-411f-a765-40f56564b546 admin admin] PATH_INFO: `/v3/users/d3dce6e324c84c1581029aa9b8f24b69` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:30.593329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d808f-ebb6-411f-a765-40f56564b546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3dce6e324c84c1581029aa9b8f24b69)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:30.596778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d808f-ebb6-411f-a765-40f56564b546 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:30.688789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-077d808f-ebb6-411f-a765-40f56564b546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3dce6e324c84c1581029aa9b8f24b69'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:30.722539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-077d808f-ebb6-411f-a765-40f56564b546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3dce6e324c84c1581029aa9b8f24b69'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:30.723701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-077d808f-ebb6-411f-a765-40f56564b546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3dce6e324c84c1581029aa9b8f24b69'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:30.747874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-077d808f-ebb6-411f-a765-40f56564b546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3dce6e324c84c1581029aa9b8f24b69'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:30.750070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-077d808f-ebb6-411f-a765-40f56564b546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3dce6e324c84c1581029aa9b8f24b69'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:30.798469 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2197/4397] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:16:30 2022] DELETE /identity/v3/users/d3dce6e324c84c1581029aa9b8f24b69 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:16:30.803011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97b1ab-6612-45aa-ac83-c446a4d76ca6 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:30.803532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97b1ab-6612-45aa-ac83-c446a4d76ca6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:30.803624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97b1ab-6612-45aa-ac83-c446a4d76ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:30.862421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bf97b1ab-6612-45aa-ac83-c446a4d76ca6 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:30.864468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bf97b1ab-6612-45aa-ac83-c446a4d76ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:31.000046 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2201/4398] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:31.072546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d808f-ebb6-411f-a765-40f56564b546 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:31.075110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-077d808f-ebb6-411f-a765-40f56564b546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:31.217398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:31.254950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d808f-ebb6-411f-a765-40f56564b546 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:31.263843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d92e3-6ebb-4c8b-bb02-fe225a4d30c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:31.264501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d92e3-6ebb-4c8b-bb02-fe225a4d30c0 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:31.264787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d92e3-6ebb-4c8b-bb02-fe225a4d30c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:31.265065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d92e3-6ebb-4c8b-bb02-fe225a4d30c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:31.292688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d92e3-6ebb-4c8b-bb02-fe225a4d30c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:31.294161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d92e3-6ebb-4c8b-bb02-fe225a4d30c0 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:31.327503 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2198/4399] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:16:31.869884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97b1ab-6612-45aa-ac83-c446a4d76ca6 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:31.871811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bf97b1ab-6612-45aa-ac83-c446a4d76ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:31.889556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97b1ab-6612-45aa-ac83-c446a4d76ca6 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:31.898024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb5da4-6c0b-49e7-bcfe-cf9170a3a0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:31.899200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb5da4-6c0b-49e7-bcfe-cf9170a3a0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:31.899532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb5da4-6c0b-49e7-bcfe-cf9170a3a0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:31.899815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb5da4-6c0b-49e7-bcfe-cf9170a3a0f3 admin admin] PATH_INFO: `/v3/projects/5b2a81385c344fd1b33401470fabf82b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:31.901974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb5da4-6c0b-49e7-bcfe-cf9170a3a0f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2a81385c344fd1b33401470fabf82b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:31.904142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb5da4-6c0b-49e7-bcfe-cf9170a3a0f3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:31.973088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9fb5da4-6c0b-49e7-bcfe-cf9170a3a0f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2a81385c344fd1b33401470fabf82b', 'request_id': 'req-f9fb5da4-6c0b-49e7-bcfe-cf9170a3a0f3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:31.993883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9fb5da4-6c0b-49e7-bcfe-cf9170a3a0f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2a81385c344fd1b33401470fabf82b', 'request_id': 'req-f9fb5da4-6c0b-49e7-bcfe-cf9170a3a0f3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:32.029802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9fb5da4-6c0b-49e7-bcfe-cf9170a3a0f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2a81385c344fd1b33401470fabf82b', 'request_id': 'req-f9fb5da4-6c0b-49e7-bcfe-cf9170a3a0f3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:32.051900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9fb5da4-6c0b-49e7-bcfe-cf9170a3a0f3 admin admin] The token cache is being invalidate because project 5b2a81385c344fd1b33401470fabf82b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:16:32.052477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9fb5da4-6c0b-49e7-bcfe-cf9170a3a0f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:32.053565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9fb5da4-6c0b-49e7-bcfe-cf9170a3a0f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:32.057986 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2202/4400] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:31 2022] DELETE /identity/v3/projects/5b2a81385c344fd1b33401470fabf82b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:32.061422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d92e3-6ebb-4c8b-bb02-fe225a4d30c0 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:32.077069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d92e3-6ebb-4c8b-bb02-fe225a4d30c0 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:32.156981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c27c43-d478-4734-be68-7e156f7ca7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:32.157679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c27c43-d478-4734-be68-7e156f7ca7da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:32.158183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c27c43-d478-4734-be68-7e156f7ca7da admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:32.159156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c27c43-d478-4734-be68-7e156f7ca7da admin admin] PATH_INFO: `/v3/users/7100db1afc404f3baece07c51d7a0c34` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:32.161052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c27c43-d478-4734-be68-7e156f7ca7da admin admin] RBAC: Authorizing `identity:delete_user(user_id=7100db1afc404f3baece07c51d7a0c34)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:32.163053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c27c43-d478-4734-be68-7e156f7ca7da admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:32.243364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-08c27c43-d478-4734-be68-7e156f7ca7da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7100db1afc404f3baece07c51d7a0c34'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:32.267281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-08c27c43-d478-4734-be68-7e156f7ca7da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7100db1afc404f3baece07c51d7a0c34'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:32.268334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-08c27c43-d478-4734-be68-7e156f7ca7da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7100db1afc404f3baece07c51d7a0c34'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:32.280840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-08c27c43-d478-4734-be68-7e156f7ca7da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7100db1afc404f3baece07c51d7a0c34'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:32.281697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-08c27c43-d478-4734-be68-7e156f7ca7da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7100db1afc404f3baece07c51d7a0c34'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:32.306893 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2199/4401] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:16:32 2022] DELETE /identity/v3/users/7100db1afc404f3baece07c51d7a0c34 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:34.165770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb5da4-6c0b-49e7-bcfe-cf9170a3a0f3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:34.166252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f9fb5da4-6c0b-49e7-bcfe-cf9170a3a0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:34.193398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb5da4-6c0b-49e7-bcfe-cf9170a3a0f3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:34.355250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd697a4-baff-469a-a1af-bb23fe989250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:34.356218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd697a4-baff-469a-a1af-bb23fe989250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:34.356681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd697a4-baff-469a-a1af-bb23fe989250 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:34.357118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd697a4-baff-469a-a1af-bb23fe989250 admin admin] PATH_INFO: `/v3/projects/c78ee704d98246cda0982d6cee4a472a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:34.364921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd697a4-baff-469a-a1af-bb23fe989250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c78ee704d98246cda0982d6cee4a472a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:34.367162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd697a4-baff-469a-a1af-bb23fe989250 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:34.425697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:34.526302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-efd697a4-baff-469a-a1af-bb23fe989250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c78ee704d98246cda0982d6cee4a472a', 'request_id': 'req-efd697a4-baff-469a-a1af-bb23fe989250'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:34.576854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-efd697a4-baff-469a-a1af-bb23fe989250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c78ee704d98246cda0982d6cee4a472a', 'request_id': 'req-efd697a4-baff-469a-a1af-bb23fe989250'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:34.598137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-efd697a4-baff-469a-a1af-bb23fe989250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c78ee704d98246cda0982d6cee4a472a', 'request_id': 'req-efd697a4-baff-469a-a1af-bb23fe989250'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:34.634680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-efd697a4-baff-469a-a1af-bb23fe989250 admin admin] The token cache is being invalidate because project c78ee704d98246cda0982d6cee4a472a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:16:34.634983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-efd697a4-baff-469a-a1af-bb23fe989250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:34.636482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-efd697a4-baff-469a-a1af-bb23fe989250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:34.641769 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2203/4402] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:34 2022] DELETE /identity/v3/projects/c78ee704d98246cda0982d6cee4a472a => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:34.646222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c00e3-7f87-4a23-8efe-ec8fd3ec9c92 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:34.646723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c00e3-7f87-4a23-8efe-ec8fd3ec9c92 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:34.646835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c00e3-7f87-4a23-8efe-ec8fd3ec9c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:34.707972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2c6c00e3-7f87-4a23-8efe-ec8fd3ec9c92 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:34.709083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2c6c00e3-7f87-4a23-8efe-ec8fd3ec9c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:34.922454 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2200/4403] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:34.930606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32afd4-0aab-47f0-90a0-af81ec6b0089 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:34.931224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32afd4-0aab-47f0-90a0-af81ec6b0089 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:34.931981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32afd4-0aab-47f0-90a0-af81ec6b0089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:35.000315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-cb32afd4-0aab-47f0-90a0-af81ec6b0089 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:35.001996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cb32afd4-0aab-47f0-90a0-af81ec6b0089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:35.021990 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2204/4404] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:35.025171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c00e3-7f87-4a23-8efe-ec8fd3ec9c92 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:35.030926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:35.056856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c00e3-7f87-4a23-8efe-ec8fd3ec9c92 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:35.076683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e645a2-255d-4534-874c-fa8cb1707fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:35.077353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e645a2-255d-4534-874c-fa8cb1707fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:35.077640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e645a2-255d-4534-874c-fa8cb1707fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:35.077919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e645a2-255d-4534-874c-fa8cb1707fb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:35.078647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e645a2-255d-4534-874c-fa8cb1707fb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:16:35.078956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e645a2-255d-4534-874c-fa8cb1707fb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:35.090741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e645a2-255d-4534-874c-fa8cb1707fb8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:35.127744 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2201/4405] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:16:35.132043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32afd4-0aab-47f0-90a0-af81ec6b0089 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:35.146314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32afd4-0aab-47f0-90a0-af81ec6b0089 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:35.158054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff220d4-854b-4d1f-9747-3dbdd2e7b849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:35.158737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff220d4-854b-4d1f-9747-3dbdd2e7b849 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:35.159020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff220d4-854b-4d1f-9747-3dbdd2e7b849 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:35.159313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff220d4-854b-4d1f-9747-3dbdd2e7b849 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:35.159989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff220d4-854b-4d1f-9747-3dbdd2e7b849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:35.162058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff220d4-854b-4d1f-9747-3dbdd2e7b849 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:35.236022 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2205/4406] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:35 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:35.240205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e645a2-255d-4534-874c-fa8cb1707fb8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:35.258360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e645a2-255d-4534-874c-fa8cb1707fb8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:35.376666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd9a8c-8e55-45e7-91d1-7f3a378be7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:35.377321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd9a8c-8e55-45e7-91d1-7f3a378be7f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:35.377645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd9a8c-8e55-45e7-91d1-7f3a378be7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:35.378171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd9a8c-8e55-45e7-91d1-7f3a378be7f0 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:35.378858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd9a8c-8e55-45e7-91d1-7f3a378be7f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:35.380836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd9a8c-8e55-45e7-91d1-7f3a378be7f0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:35.423341 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2202/4407] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:16:35 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:35.426036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff220d4-854b-4d1f-9747-3dbdd2e7b849 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:35.448127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff220d4-854b-4d1f-9747-3dbdd2e7b849 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:35.455972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e23de-f517-4294-8c42-279e7a211816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:35.457714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e23de-f517-4294-8c42-279e7a211816 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:35.458020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e23de-f517-4294-8c42-279e7a211816 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:35.458444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e23de-f517-4294-8c42-279e7a211816 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:35.459330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e23de-f517-4294-8c42-279e7a211816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:35.461332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e23de-f517-4294-8c42-279e7a211816 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:35.494882 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2206/4408] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:35.496608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd9a8c-8e55-45e7-91d1-7f3a378be7f0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:35.515340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd9a8c-8e55-45e7-91d1-7f3a378be7f0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:35.529882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb7ba4-2ef3-47c7-8f79-e1dccdec0dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:35.533459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb7ba4-2ef3-47c7-8f79-e1dccdec0dda admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:35.533749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb7ba4-2ef3-47c7-8f79-e1dccdec0dda admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:35.534108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb7ba4-2ef3-47c7-8f79-e1dccdec0dda admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:35.534905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb7ba4-2ef3-47c7-8f79-e1dccdec0dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:35.541430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb7ba4-2ef3-47c7-8f79-e1dccdec0dda admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:35.584445 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2203/4409] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:35.589992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e23de-f517-4294-8c42-279e7a211816 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:35.607644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e23de-f517-4294-8c42-279e7a211816 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:35.621777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c6f33-6a78-42ce-95ef-f4ce3be4ffef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:35.622577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c6f33-6a78-42ce-95ef-f4ce3be4ffef admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:35.622972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c6f33-6a78-42ce-95ef-f4ce3be4ffef admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:35.623379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c6f33-6a78-42ce-95ef-f4ce3be4ffef admin admin] PATH_INFO: `/v3/projects/e02b2aa18e2c4c6aa2d8189c834395a7/users/b58900af2769478cbda55b4a5205b4ad/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:35.657246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c6f33-6a78-42ce-95ef-f4ce3be4ffef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02b2aa18e2c4c6aa2d8189c834395a7, user_id=b58900af2769478cbda55b4a5205b4ad, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:35.668554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c6f33-6a78-42ce-95ef-f4ce3be4ffef admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:35.701270 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2207/4410] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:35 2022] PUT /identity/v3/projects/e02b2aa18e2c4c6aa2d8189c834395a7/users/b58900af2769478cbda55b4a5205b4ad/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:35.718041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9e1ce-fd38-4847-aa90-615f608082dc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:35.718510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9e1ce-fd38-4847-aa90-615f608082dc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:35.718510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9e1ce-fd38-4847-aa90-615f608082dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:35.758228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ebb9e1ce-fd38-4847-aa90-615f608082dc None None] MFA Rules not processed for user `b58900af2769478cbda55b4a5205b4ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:35.760926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ebb9e1ce-fd38-4847-aa90-615f608082dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:35.900023 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2204/4411] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:35.906391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c6f33-6a78-42ce-95ef-f4ce3be4ffef admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:36.074163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c6f33-6a78-42ce-95ef-f4ce3be4ffef admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:36.081446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853b4ed-9d39-46f8-a43f-e1894221df91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:36.082382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853b4ed-9d39-46f8-a43f-e1894221df91 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:36.082843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853b4ed-9d39-46f8-a43f-e1894221df91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:36.083836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853b4ed-9d39-46f8-a43f-e1894221df91 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:36.084838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853b4ed-9d39-46f8-a43f-e1894221df91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:36.087728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853b4ed-9d39-46f8-a43f-e1894221df91 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:36.131476 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2208/4412] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:35 2022] POST /identity/v3/projects => generated 371 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:36.133094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9e1ce-fd38-4847-aa90-615f608082dc None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:36.146730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9e1ce-fd38-4847-aa90-615f608082dc None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:36.205588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:36.215091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cb3d5-2a8f-493a-8292-026b773d9821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:36.215337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cb3d5-2a8f-493a-8292-026b773d9821 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:36.216015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cb3d5-2a8f-493a-8292-026b773d9821 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:36.216591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cb3d5-2a8f-493a-8292-026b773d9821 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:36.218215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cb3d5-2a8f-493a-8292-026b773d9821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:36.220299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cb3d5-2a8f-493a-8292-026b773d9821 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:36.246795 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2205/4413] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:16:36 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:36.248119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853b4ed-9d39-46f8-a43f-e1894221df91 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:36.259820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853b4ed-9d39-46f8-a43f-e1894221df91 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:36.265437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1564191-4f27-44f7-b2b8-a95114624e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:36.266132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1564191-4f27-44f7-b2b8-a95114624e3e admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:36.266503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1564191-4f27-44f7-b2b8-a95114624e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:36.266782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1564191-4f27-44f7-b2b8-a95114624e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:36.267547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1564191-4f27-44f7-b2b8-a95114624e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:36.269295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1564191-4f27-44f7-b2b8-a95114624e3e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:36.283450 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2209/4414] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:16:36.286716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cb3d5-2a8f-493a-8292-026b773d9821 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:36.298601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cb3d5-2a8f-493a-8292-026b773d9821 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:36.303463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6daf40-a3d2-4cd3-960b-9738db0ae889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:36.304166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6daf40-a3d2-4cd3-960b-9738db0ae889 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:36.304452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6daf40-a3d2-4cd3-960b-9738db0ae889 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:36.304733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6daf40-a3d2-4cd3-960b-9738db0ae889 admin admin] PATH_INFO: `/v3/projects/a973f891706749ea905a4457ae7ebe88/users/ccad2edd009046ab9fdcf50630067cfc/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:36.323579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6daf40-a3d2-4cd3-960b-9738db0ae889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a973f891706749ea905a4457ae7ebe88, user_id=ccad2edd009046ab9fdcf50630067cfc, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:36.326506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6daf40-a3d2-4cd3-960b-9738db0ae889 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:36.342336 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2206/4415] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:36 2022] PUT /identity/v3/projects/a973f891706749ea905a4457ae7ebe88/users/ccad2edd009046ab9fdcf50630067cfc/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:16:36.346769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1564191-4f27-44f7-b2b8-a95114624e3e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:36.358485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1564191-4f27-44f7-b2b8-a95114624e3e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:36.377570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:36.423966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de7b85-6303-4582-907d-96d508f4c390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:36.424636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de7b85-6303-4582-907d-96d508f4c390 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:36.424917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de7b85-6303-4582-907d-96d508f4c390 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:36.425193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de7b85-6303-4582-907d-96d508f4c390 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:36.425920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de7b85-6303-4582-907d-96d508f4c390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:36.427592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de7b85-6303-4582-907d-96d508f4c390 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:36.439053 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2210/4416] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:36.443459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6daf40-a3d2-4cd3-960b-9738db0ae889 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:36.456277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6daf40-a3d2-4cd3-960b-9738db0ae889 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:36.461175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30a09b-3942-4a78-ac85-2a72989f39a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:36.461929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30a09b-3942-4a78-ac85-2a72989f39a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:36.462233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30a09b-3942-4a78-ac85-2a72989f39a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:36.462510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30a09b-3942-4a78-ac85-2a72989f39a7 admin admin] PATH_INFO: `/v3/projects/a973f891706749ea905a4457ae7ebe88/users/ccad2edd009046ab9fdcf50630067cfc/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:36.464571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30a09b-3942-4a78-ac85-2a72989f39a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a973f891706749ea905a4457ae7ebe88, user_id=ccad2edd009046ab9fdcf50630067cfc, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:36.467479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30a09b-3942-4a78-ac85-2a72989f39a7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:36.478900 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2207/4417] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:36 2022] PUT /identity/v3/projects/a973f891706749ea905a4457ae7ebe88/users/ccad2edd009046ab9fdcf50630067cfc/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:36.562575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f5ace-52c9-47b0-bef3-2ad54caad540 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:36.562868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f5ace-52c9-47b0-bef3-2ad54caad540 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:36.563149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f5ace-52c9-47b0-bef3-2ad54caad540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:36.594940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b99f5ace-52c9-47b0-bef3-2ad54caad540 None None] MFA Rules not processed for user `ccad2edd009046ab9fdcf50630067cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:36.596231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b99f5ace-52c9-47b0-bef3-2ad54caad540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:36.678613 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2211/4418] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:36 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:36.685083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30a09b-3942-4a78-ac85-2a72989f39a7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:36.698336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30a09b-3942-4a78-ac85-2a72989f39a7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:36.705920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a072bb0-26ea-46e4-bb36-1390f9e19dbc tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccad2edd009046ab9fdcf50630067cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a973f891706749ea905a4457ae7ebe88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:36.707784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a072bb0-26ea-46e4-bb36-1390f9e19dbc tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:36.708074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a072bb0-26ea-46e4-bb36-1390f9e19dbc tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:36.710959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a072bb0-26ea-46e4-bb36-1390f9e19dbc tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:36.711098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a072bb0-26ea-46e4-bb36-1390f9e19dbc tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:36.713074 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-0a072bb0-26ea-46e4-bb36-1390f9e19dbc tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:16:36.713074 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:16:36.713074 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:16:36.717019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a072bb0-26ea-46e4-bb36-1390f9e19dbc tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:36.737554 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2208/4419] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:36 2022] POST /identity/v3/services => generated 288 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:16:36.742603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f5ace-52c9-47b0-bef3-2ad54caad540 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:36.753173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f5ace-52c9-47b0-bef3-2ad54caad540 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:36.772304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae5012-43de-4a77-a5f4-0b80df5ba82f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccad2edd009046ab9fdcf50630067cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a973f891706749ea905a4457ae7ebe88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:36.772863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae5012-43de-4a77-a5f4-0b80df5ba82f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:36.773149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae5012-43de-4a77-a5f4-0b80df5ba82f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:36.774269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae5012-43de-4a77-a5f4-0b80df5ba82f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:36.774977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae5012-43de-4a77-a5f4-0b80df5ba82f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:36.776603 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-3aae5012-43de-4a77-a5f4-0b80df5ba82f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:16:36.776603 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:16:36.776603 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:16:36.777458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae5012-43de-4a77-a5f4-0b80df5ba82f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:36.804209 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2212/4420] 10.222.0.17 () {60 vars in 1213 bytes} [Sat Jul 30 21:16:36 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:36.806397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a072bb0-26ea-46e4-bb36-1390f9e19dbc tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:36.833027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a072bb0-26ea-46e4-bb36-1390f9e19dbc tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:36.845296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6968b3-1cb9-4def-b0b4-7c5b5333d40f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccad2edd009046ab9fdcf50630067cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a973f891706749ea905a4457ae7ebe88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:36.846517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6968b3-1cb9-4def-b0b4-7c5b5333d40f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:36.847929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6968b3-1cb9-4def-b0b4-7c5b5333d40f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:36.849015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6968b3-1cb9-4def-b0b4-7c5b5333d40f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:36.851225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6968b3-1cb9-4def-b0b4-7c5b5333d40f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:36.860394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6968b3-1cb9-4def-b0b4-7c5b5333d40f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:36.915888 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2209/4421] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:36 2022] POST /identity/v3/services => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:36.920637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae5012-43de-4a77-a5f4-0b80df5ba82f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:36.935488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae5012-43de-4a77-a5f4-0b80df5ba82f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:36.978134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc04c03-0d27-47b0-a28a-5f57c2e15536 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccad2edd009046ab9fdcf50630067cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a973f891706749ea905a4457ae7ebe88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:36.978776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc04c03-0d27-47b0-a28a-5f57c2e15536 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:36.979657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc04c03-0d27-47b0-a28a-5f57c2e15536 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:36.983657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc04c03-0d27-47b0-a28a-5f57c2e15536 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:36.984626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc04c03-0d27-47b0-a28a-5f57c2e15536 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:36.989032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc04c03-0d27-47b0-a28a-5f57c2e15536 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:37.026350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6968b3-1cb9-4def-b0b4-7c5b5333d40f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:37.027641 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2213/4422] 10.222.0.17 () {60 vars in 1213 bytes} [Sat Jul 30 21:16:36 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:37.042478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ebc82-b94e-4a93-93e0-72f7e74452ab None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:37.043094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ebc82-b94e-4a93-93e0-72f7e74452ab None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:37.048008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ebc82-b94e-4a93-93e0-72f7e74452ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:37.065620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6968b3-1cb9-4def-b0b4-7c5b5333d40f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:37.095160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186a25d-0260-43ed-9a80-300912f0c337 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccad2edd009046ab9fdcf50630067cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a973f891706749ea905a4457ae7ebe88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:37.099543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186a25d-0260-43ed-9a80-300912f0c337 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:37.101099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186a25d-0260-43ed-9a80-300912f0c337 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:37.102824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186a25d-0260-43ed-9a80-300912f0c337 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:37.103744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186a25d-0260-43ed-9a80-300912f0c337 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:37.111833 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-5186a25d-0260-43ed-9a80-300912f0c337 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:16:37.111833 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:16:37.111833 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:16:37.116877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186a25d-0260-43ed-9a80-300912f0c337 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:37.147493 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2210/4423] 10.222.0.17 () {58 vars in 1191 bytes} [Sat Jul 30 21:16:37 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 766 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:16:37.148532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186a25d-0260-43ed-9a80-300912f0c337 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:37.159025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6e9ebc82-b94e-4a93-93e0-72f7e74452ab None None] MFA Rules not processed for user `7369e2a4c5b24e85b94816e6404b300f`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:37.161546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6e9ebc82-b94e-4a93-93e0-72f7e74452ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:37.172575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186a25d-0260-43ed-9a80-300912f0c337 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:37.191960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a3100-58be-4c05-9631-c04a737ef051 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccad2edd009046ab9fdcf50630067cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a973f891706749ea905a4457ae7ebe88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:37.194011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a3100-58be-4c05-9631-c04a737ef051 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:37.194580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a3100-58be-4c05-9631-c04a737ef051 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:37.195865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a3100-58be-4c05-9631-c04a737ef051 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/0e8e778e676e4e589d8a430141ef320f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:37.196678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a3100-58be-4c05-9631-c04a737ef051 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=0e8e778e676e4e589d8a430141ef320f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:37.200375 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-8f2a3100-58be-4c05-9631-c04a737ef051 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:16:37.200375 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:16:37.200375 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:16:37.201960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a3100-58be-4c05-9631-c04a737ef051 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:37.219729 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2211/4424] 10.222.0.17 () {58 vars in 1290 bytes} [Sat Jul 30 21:16:37 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/0e8e778e676e4e589d8a430141ef320f => generated 334 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:16:37.220814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a3100-58be-4c05-9631-c04a737ef051 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:37.250344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a3100-58be-4c05-9631-c04a737ef051 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:37.261018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e0d0f-9780-485e-ab0b-a2cedbe7fd30 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccad2edd009046ab9fdcf50630067cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a973f891706749ea905a4457ae7ebe88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:37.261910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e0d0f-9780-485e-ab0b-a2cedbe7fd30 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:37.262564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e0d0f-9780-485e-ab0b-a2cedbe7fd30 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:37.262939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e0d0f-9780-485e-ab0b-a2cedbe7fd30 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/0e8e778e676e4e589d8a430141ef320f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:37.263755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e0d0f-9780-485e-ab0b-a2cedbe7fd30 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=0e8e778e676e4e589d8a430141ef320f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:37.279921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e0d0f-9780-485e-ab0b-a2cedbe7fd30 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:37.308132 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2212/4425] 10.222.0.17 () {58 vars in 1291 bytes} [Sat Jul 30 21:16:37 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/0e8e778e676e4e589d8a430141ef320f => generated 0 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 30 21:16:37.312265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e0d0f-9780-485e-ab0b-a2cedbe7fd30 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:37.326894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e0d0f-9780-485e-ab0b-a2cedbe7fd30 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:37.333079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db0309-4a3d-41b5-b6f4-f7a55a034c2c tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccad2edd009046ab9fdcf50630067cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a973f891706749ea905a4457ae7ebe88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:37.333863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db0309-4a3d-41b5-b6f4-f7a55a034c2c tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:37.334228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db0309-4a3d-41b5-b6f4-f7a55a034c2c tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:37.334637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db0309-4a3d-41b5-b6f4-f7a55a034c2c tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/0e8e778e676e4e589d8a430141ef320f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:37.335410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db0309-4a3d-41b5-b6f4-f7a55a034c2c tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=0e8e778e676e4e589d8a430141ef320f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:37.336504 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-59db0309-4a3d-41b5-b6f4-f7a55a034c2c tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:16:37.336504 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:16:37.336504 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:16:37.337580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db0309-4a3d-41b5-b6f4-f7a55a034c2c tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:37.348945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:37.356793 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2213/4426] 10.222.0.17 () {58 vars in 1293 bytes} [Sat Jul 30 21:16:37 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/0e8e778e676e4e589d8a430141ef320f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:37.356793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc862657-3c9d-430f-807d-664d6e1a54f6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:37.358376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc862657-3c9d-430f-807d-664d6e1a54f6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:37.358376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc862657-3c9d-430f-807d-664d6e1a54f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:37.371415 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2214/4427] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:37 2022] POST /identity/v3/auth/tokens => generated 3520 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:37.372776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ebc82-b94e-4a93-93e0-72f7e74452ab None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:37.389036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bc862657-3c9d-430f-807d-664d6e1a54f6 None None] MFA Rules not processed for user `23ba5ddf22424eff840602440872f86e`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:37.391759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bc862657-3c9d-430f-807d-664d6e1a54f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:37.398656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ebc82-b94e-4a93-93e0-72f7e74452ab None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:37.405354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48597fd-a08f-46fb-8f82-246021570a85 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccad2edd009046ab9fdcf50630067cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a973f891706749ea905a4457ae7ebe88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:37.406294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48597fd-a08f-46fb-8f82-246021570a85 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:37.406783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48597fd-a08f-46fb-8f82-246021570a85 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:37.407419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48597fd-a08f-46fb-8f82-246021570a85 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:37.408270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48597fd-a08f-46fb-8f82-246021570a85 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:37.409536 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-e48597fd-a08f-46fb-8f82-246021570a85 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:16:37.409536 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:16:37.409536 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:16:37.411130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48597fd-a08f-46fb-8f82-246021570a85 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:37.418829 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2215/4428] 10.222.0.17 () {58 vars in 1191 bytes} [Sat Jul 30 21:16:37 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 451 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:16:37.423404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48597fd-a08f-46fb-8f82-246021570a85 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:37.425610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e48597fd-a08f-46fb-8f82-246021570a85 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:37.484308 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2214/4429] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:37 2022] POST /identity/v3/auth/tokens => generated 3514 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:37.484308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc862657-3c9d-430f-807d-664d6e1a54f6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:37.511424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc862657-3c9d-430f-807d-664d6e1a54f6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:37.522244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf528c-0976-4b5e-b28b-536c8bbba08a tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccad2edd009046ab9fdcf50630067cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a973f891706749ea905a4457ae7ebe88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:37.522754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf528c-0976-4b5e-b28b-536c8bbba08a tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:37.523096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf528c-0976-4b5e-b28b-536c8bbba08a tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:37.523371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf528c-0976-4b5e-b28b-536c8bbba08a tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/0e8e778e676e4e589d8a430141ef320f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:37.524201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf528c-0976-4b5e-b28b-536c8bbba08a tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=0e8e778e676e4e589d8a430141ef320f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:37.526033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf528c-0976-4b5e-b28b-536c8bbba08a tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:37.555456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48597fd-a08f-46fb-8f82-246021570a85 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:37.560888 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-b8cf528c-0976-4b5e-b28b-536c8bbba08a tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Could not find Endpoint Group: 0e8e778e676e4e589d8a430141ef320f.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 0e8e778e676e4e589d8a430141ef320f. Jul 30 21:16:37.560888 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:16:37.560888 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:16:37.560888 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:16:37.560888 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:16:37.560888 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:16:37.560888 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:16:37.560888 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:16:37.560888 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:16:37.560888 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:16:37.560888 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:16:37.560888 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:16:37.560888 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Jul 30 21:16:37.560888 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Jul 30 21:16:37.562251 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Jul 30 21:16:37.562251 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Jul 30 21:16:37.562251 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Jul 30 21:16:37.562251 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Jul 30 21:16:37.562251 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 0e8e778e676e4e589d8a430141ef320f. Jul 30 21:16:37.562251 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:16:37.565698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5a283-ca34-430c-91a6-28975add00ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:37.565698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5a283-ca34-430c-91a6-28975add00ac admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:37.565698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5a283-ca34-430c-91a6-28975add00ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:37.565698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5a283-ca34-430c-91a6-28975add00ac admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:37.566078 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2215/4430] 10.222.0.17 () {58 vars in 1293 bytes} [Sat Jul 30 21:16:37 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/0e8e778e676e4e589d8a430141ef320f => generated 120 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:16:37.566485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5a283-ca34-430c-91a6-28975add00ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:37.568641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5a283-ca34-430c-91a6-28975add00ac admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:37.569753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf528c-0976-4b5e-b28b-536c8bbba08a tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:37.603360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf528c-0976-4b5e-b28b-536c8bbba08a tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:37.610311 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2216/4431] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:37 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:37.614241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5a283-ca34-430c-91a6-28975add00ac admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:37.619321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671b4ec-f0cb-409c-bce4-70357f9381f0 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccad2edd009046ab9fdcf50630067cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a973f891706749ea905a4457ae7ebe88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:37.620595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671b4ec-f0cb-409c-bce4-70357f9381f0 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:37.620889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671b4ec-f0cb-409c-bce4-70357f9381f0 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:37.621164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671b4ec-f0cb-409c-bce4-70357f9381f0 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] PATH_INFO: `/v3/services/1f6668374f084275b6eeaf928957d0bc` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:37.630193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671b4ec-f0cb-409c-bce4-70357f9381f0 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1f6668374f084275b6eeaf928957d0bc)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:37.633793 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-9671b4ec-f0cb-409c-bce4-70357f9381f0 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:16:37.633793 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:16:37.633793 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:16:37.640271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671b4ec-f0cb-409c-bce4-70357f9381f0 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:37.706777 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2216/4432] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:37 2022] DELETE /identity/v3/services/1f6668374f084275b6eeaf928957d0bc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:37.714367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671b4ec-f0cb-409c-bce4-70357f9381f0 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:37.756366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5a283-ca34-430c-91a6-28975add00ac admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:37.757927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:INSERT=7,keystone:DELETE=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:37.787629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671b4ec-f0cb-409c-bce4-70357f9381f0 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:37.792672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d67dd-708a-4345-b224-06048f9dbf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:37.793458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d67dd-708a-4345-b224-06048f9dbf8f admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:37.794024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d67dd-708a-4345-b224-06048f9dbf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:37.794317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d67dd-708a-4345-b224-06048f9dbf8f admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:37.795267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d67dd-708a-4345-b224-06048f9dbf8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:37.797768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d67dd-708a-4345-b224-06048f9dbf8f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:37.848238 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2217/4433] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:16:37 2022] POST /identity/v3/users => generated 299 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:37.852810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d67dd-708a-4345-b224-06048f9dbf8f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:37.866825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d67dd-708a-4345-b224-06048f9dbf8f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:37.876324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79844f25-bb43-4707-b454-8609d83c7c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:37.879698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79844f25-bb43-4707-b454-8609d83c7c22 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:37.881136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79844f25-bb43-4707-b454-8609d83c7c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:37.881436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79844f25-bb43-4707-b454-8609d83c7c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:37.883364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79844f25-bb43-4707-b454-8609d83c7c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:37.886579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79844f25-bb43-4707-b454-8609d83c7c22 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:37.920032 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2218/4434] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:16:37.924030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79844f25-bb43-4707-b454-8609d83c7c22 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:37.952299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79844f25-bb43-4707-b454-8609d83c7c22 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:37.968178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e17332-50c7-45fa-8d73-119ad1e47e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:37.970198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e17332-50c7-45fa-8d73-119ad1e47e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:37.970495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e17332-50c7-45fa-8d73-119ad1e47e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:37.972694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e17332-50c7-45fa-8d73-119ad1e47e09 admin admin] PATH_INFO: `/v3/projects/d330455f767649039170509c8e3ad25d/users/9ee43250738b4dcc91b2e09e0c060cb0/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:37.993531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ddbf6-b784-4f3d-a06f-f38323ffbaa5 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccad2edd009046ab9fdcf50630067cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a973f891706749ea905a4457ae7ebe88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:37.995549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ddbf6-b784-4f3d-a06f-f38323ffbaa5 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:37.995854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ddbf6-b784-4f3d-a06f-f38323ffbaa5 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:37.996093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ddbf6-b784-4f3d-a06f-f38323ffbaa5 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:37.996900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ddbf6-b784-4f3d-a06f-f38323ffbaa5 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:38.006560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ddbf6-b784-4f3d-a06f-f38323ffbaa5 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:38.025759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e17332-50c7-45fa-8d73-119ad1e47e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d330455f767649039170509c8e3ad25d, user_id=9ee43250738b4dcc91b2e09e0c060cb0, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:38.033808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e17332-50c7-45fa-8d73-119ad1e47e09 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:38.081884 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2219/4435] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:37 2022] PUT /identity/v3/projects/d330455f767649039170509c8e3ad25d/users/9ee43250738b4dcc91b2e09e0c060cb0/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:38.085900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e17332-50c7-45fa-8d73-119ad1e47e09 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:38.091823 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2217/4436] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:37 2022] POST /identity/v3/services => generated 289 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:38.095892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ddbf6-b784-4f3d-a06f-f38323ffbaa5 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:38.120541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:38.156987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ddbf6-b784-4f3d-a06f-f38323ffbaa5 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:38.310123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae38e67-0bfb-40cb-acbc-8352c4f5ab1f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccad2edd009046ab9fdcf50630067cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a973f891706749ea905a4457ae7ebe88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:38.312134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae38e67-0bfb-40cb-acbc-8352c4f5ab1f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:38.312446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae38e67-0bfb-40cb-acbc-8352c4f5ab1f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:38.313597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae38e67-0bfb-40cb-acbc-8352c4f5ab1f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:38.314878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae38e67-0bfb-40cb-acbc-8352c4f5ab1f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:38.316121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e17332-50c7-45fa-8d73-119ad1e47e09 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:38.316288 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-9ae38e67-0bfb-40cb-acbc-8352c4f5ab1f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:16:38.316288 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:16:38.316288 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:16:38.317080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae38e67-0bfb-40cb-acbc-8352c4f5ab1f tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:38.331606 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2218/4437] 10.222.0.17 () {60 vars in 1213 bytes} [Sat Jul 30 21:16:38 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:16:38.333817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f72bac-ac71-49f3-b0c5-b65ec18f4629 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:38.334412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f72bac-ac71-49f3-b0c5-b65ec18f4629 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:38.334542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f72bac-ac71-49f3-b0c5-b65ec18f4629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:38.351530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae39d4-bb22-4782-979b-c5962d10b693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:38.352313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae39d4-bb22-4782-979b-c5962d10b693 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:38.352732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae39d4-bb22-4782-979b-c5962d10b693 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:38.353171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae39d4-bb22-4782-979b-c5962d10b693 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:38.354989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae39d4-bb22-4782-979b-c5962d10b693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:38.356912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae39d4-bb22-4782-979b-c5962d10b693 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:38.378160 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2220/4438] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:38.379206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae39d4-bb22-4782-979b-c5962d10b693 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:38.382872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-17ae39d4-bb22-4782-979b-c5962d10b693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:38.392941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e5f72bac-ac71-49f3-b0c5-b65ec18f4629 None None] MFA Rules not processed for user `5f6545058c3d465992b5761677dc5261`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:38.397133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae39d4-bb22-4782-979b-c5962d10b693 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:38.397326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e5f72bac-ac71-49f3-b0c5-b65ec18f4629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:38.409528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a7842-6e96-46c0-9884-a265f77778ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:38.411456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a7842-6e96-46c0-9884-a265f77778ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:38.411924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a7842-6e96-46c0-9884-a265f77778ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:38.412401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a7842-6e96-46c0-9884-a265f77778ee admin admin] PATH_INFO: `/v3/users/6f3dedfa378e41d0b0fdb0a685d4e1fb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:38.414803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a7842-6e96-46c0-9884-a265f77778ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f3dedfa378e41d0b0fdb0a685d4e1fb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:38.421535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a7842-6e96-46c0-9884-a265f77778ee admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:38.547330 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2219/4439] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:38 2022] POST /identity/v3/auth/tokens => generated 3513 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:38.547330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f72bac-ac71-49f3-b0c5-b65ec18f4629 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:38.554907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-377a7842-6e96-46c0-9884-a265f77778ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f3dedfa378e41d0b0fdb0a685d4e1fb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:38.556008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-377a7842-6e96-46c0-9884-a265f77778ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f3dedfa378e41d0b0fdb0a685d4e1fb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:38.566877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f72bac-ac71-49f3-b0c5-b65ec18f4629 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:38.575206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-377a7842-6e96-46c0-9884-a265f77778ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f3dedfa378e41d0b0fdb0a685d4e1fb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:38.576349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-377a7842-6e96-46c0-9884-a265f77778ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f3dedfa378e41d0b0fdb0a685d4e1fb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:38.584727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7825f7-b7a4-4b78-98b8-57b240564cc7 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccad2edd009046ab9fdcf50630067cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a973f891706749ea905a4457ae7ebe88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:38.586452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7825f7-b7a4-4b78-98b8-57b240564cc7 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:38.586452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7825f7-b7a4-4b78-98b8-57b240564cc7 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:38.586705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7825f7-b7a4-4b78-98b8-57b240564cc7 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:38.588993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7825f7-b7a4-4b78-98b8-57b240564cc7 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:38.591930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-377a7842-6e96-46c0-9884-a265f77778ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f3dedfa378e41d0b0fdb0a685d4e1fb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:38.592845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7825f7-b7a4-4b78-98b8-57b240564cc7 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:38.621523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:38.643356 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2221/4440] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:16:38 2022] DELETE /identity/v3/users/6f3dedfa378e41d0b0fdb0a685d4e1fb => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:38.644225 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2220/4441] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:38 2022] POST /identity/v3/services => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:38.645349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a7842-6e96-46c0-9884-a265f77778ee admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:38.648887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-377a7842-6e96-46c0-9884-a265f77778ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:38.658924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d58bc-3996-4c72-9218-246351396504 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:38.674844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d58bc-3996-4c72-9218-246351396504 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:38.675130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d58bc-3996-4c72-9218-246351396504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:38.743043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-847d58bc-3996-4c72-9218-246351396504 None None] MFA Rules not processed for user `5f6545058c3d465992b5761677dc5261`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:38.744622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-847d58bc-3996-4c72-9218-246351396504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:38.806444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a7842-6e96-46c0-9884-a265f77778ee admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:38.862664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606ed99-f858-4023-a7e2-e3d615b4c086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:38.864635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606ed99-f858-4023-a7e2-e3d615b4c086 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:38.865127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606ed99-f858-4023-a7e2-e3d615b4c086 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:38.865411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606ed99-f858-4023-a7e2-e3d615b4c086 admin admin] PATH_INFO: `/v3/projects/d330455f767649039170509c8e3ad25d/users/9ee43250738b4dcc91b2e09e0c060cb0/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:38.867613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606ed99-f858-4023-a7e2-e3d615b4c086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d330455f767649039170509c8e3ad25d, user_id=9ee43250738b4dcc91b2e09e0c060cb0, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:38.870904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606ed99-f858-4023-a7e2-e3d615b4c086 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:38.874261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:38.909574 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2222/4442] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:38 2022] PUT /identity/v3/projects/d330455f767649039170509c8e3ad25d/users/9ee43250738b4dcc91b2e09e0c060cb0/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:38.910915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606ed99-f858-4023-a7e2-e3d615b4c086 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:38.915752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f606ed99-f858-4023-a7e2-e3d615b4c086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:38.949658 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2221/4443] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:38 2022] POST /identity/v3/auth/tokens => generated 3643 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:38.951835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909e787-980b-41fa-8671-94e11491fc3a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:38.952235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909e787-980b-41fa-8671-94e11491fc3a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:38.952613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909e787-980b-41fa-8671-94e11491fc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:38.979902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9909e787-980b-41fa-8671-94e11491fc3a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:38.982248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9909e787-980b-41fa-8671-94e11491fc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:39.139481 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2222/4444] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:38 2022] POST /identity/v3/auth/tokens => generated 3626 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:39.141396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909e787-980b-41fa-8671-94e11491fc3a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:39.144475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9909e787-980b-41fa-8671-94e11491fc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:39.176560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606ed99-f858-4023-a7e2-e3d615b4c086 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:39.197148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f470a-4436-4b10-8fda-bd390ead20b5 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccad2edd009046ab9fdcf50630067cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a973f891706749ea905a4457ae7ebe88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:39.197891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f470a-4436-4b10-8fda-bd390ead20b5 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:39.198181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f470a-4436-4b10-8fda-bd390ead20b5 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:39.198460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f470a-4436-4b10-8fda-bd390ead20b5 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/0044afd4641d4f3ab63ffe65a9d3dcdd` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:39.199189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f470a-4436-4b10-8fda-bd390ead20b5 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=0044afd4641d4f3ab63ffe65a9d3dcdd)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:39.200252 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-6b1f470a-4436-4b10-8fda-bd390ead20b5 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:16:39.200252 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:16:39.200252 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:16:39.201174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f470a-4436-4b10-8fda-bd390ead20b5 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:39.248473 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2223/4445] 10.222.0.17 () {60 vars in 1313 bytes} [Sat Jul 30 21:16:38 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/0044afd4641d4f3ab63ffe65a9d3dcdd => generated 335 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:16:39.248473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f470a-4436-4b10-8fda-bd390ead20b5 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:39.250544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6b1f470a-4436-4b10-8fda-bd390ead20b5 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:39.400598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909e787-980b-41fa-8671-94e11491fc3a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:39.415185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93560647-49fe-4273-b455-53c5a1f0b1e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:39.417087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93560647-49fe-4273-b455-53c5a1f0b1e0 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:39.417648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93560647-49fe-4273-b455-53c5a1f0b1e0 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:39.417648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93560647-49fe-4273-b455-53c5a1f0b1e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:39.422070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-93560647-49fe-4273-b455-53c5a1f0b1e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:39.424213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f470a-4436-4b10-8fda-bd390ead20b5 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:39.435971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b55f4-9663-4a6a-b7f7-032d022b6c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:39.436959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b55f4-9663-4a6a-b7f7-032d022b6c68 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:39.437425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b55f4-9663-4a6a-b7f7-032d022b6c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:39.437989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b55f4-9663-4a6a-b7f7-032d022b6c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:39.472940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b55f4-9663-4a6a-b7f7-032d022b6c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:39.477017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b55f4-9663-4a6a-b7f7-032d022b6c68 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:39.488272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:39.515874 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2224/4446] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:39 2022] GET /identity/v3/auth/tokens => generated 3626 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:16:39.516995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b55f4-9663-4a6a-b7f7-032d022b6c68 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:39.553022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b55f4-9663-4a6a-b7f7-032d022b6c68 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:39.558581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c36ca-4d27-4b34-a097-be074a9fe8ab tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccad2edd009046ab9fdcf50630067cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a973f891706749ea905a4457ae7ebe88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:39.559509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c36ca-4d27-4b34-a097-be074a9fe8ab tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:39.560031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c36ca-4d27-4b34-a097-be074a9fe8ab tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:39.560487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c36ca-4d27-4b34-a097-be074a9fe8ab tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] PATH_INFO: `/v3/services/f38fafc7e5d648cbb02c7ba1cd0b6dde` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:39.561409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c36ca-4d27-4b34-a097-be074a9fe8ab tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f38fafc7e5d648cbb02c7ba1cd0b6dde)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:39.562594 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-eb8c36ca-4d27-4b34-a097-be074a9fe8ab tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:16:39.562594 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:16:39.562594 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:16:39.563887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c36ca-4d27-4b34-a097-be074a9fe8ab tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:39.583625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93560647-49fe-4273-b455-53c5a1f0b1e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:39.585379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93560647-49fe-4273-b455-53c5a1f0b1e0 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:39.608885 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2223/4447] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:39 2022] GET /identity/v3/auth/tokens => generated 3643 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:16:39.639492 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2225/4448] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:39 2022] DELETE /identity/v3/services/f38fafc7e5d648cbb02c7ba1cd0b6dde => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:39.643617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93560647-49fe-4273-b455-53c5a1f0b1e0 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:39.658925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93560647-49fe-4273-b455-53c5a1f0b1e0 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:39.684191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505a450-b166-4e31-a76a-669e9555e019 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccad2edd009046ab9fdcf50630067cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a973f891706749ea905a4457ae7ebe88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:39.685436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505a450-b166-4e31-a76a-669e9555e019 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:39.685919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505a450-b166-4e31-a76a-669e9555e019 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:39.686531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505a450-b166-4e31-a76a-669e9555e019 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/0044afd4641d4f3ab63ffe65a9d3dcdd` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:39.687545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505a450-b166-4e31-a76a-669e9555e019 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=0044afd4641d4f3ab63ffe65a9d3dcdd)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:39.689545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505a450-b166-4e31-a76a-669e9555e019 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:39.719983 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2224/4449] 10.222.0.17 () {58 vars in 1293 bytes} [Sat Jul 30 21:16:39 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/0044afd4641d4f3ab63ffe65a9d3dcdd => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:39.721536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c36ca-4d27-4b34-a097-be074a9fe8ab tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:39.741183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c36ca-4d27-4b34-a097-be074a9fe8ab tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:39.748232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baf871-916d-4546-8b2a-e6a1e585ab33 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccad2edd009046ab9fdcf50630067cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a973f891706749ea905a4457ae7ebe88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:39.749123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baf871-916d-4546-8b2a-e6a1e585ab33 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:39.749270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baf871-916d-4546-8b2a-e6a1e585ab33 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:39.749484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baf871-916d-4546-8b2a-e6a1e585ab33 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] PATH_INFO: `/v3/services/ca842fe71a4e49c6a8e7823c6cdbe0e8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:39.750063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3baf871-916d-4546-8b2a-e6a1e585ab33 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ca842fe71a4e49c6a8e7823c6cdbe0e8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:39.752106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3baf871-916d-4546-8b2a-e6a1e585ab33 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:39.793318 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2226/4450] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:39 2022] DELETE /identity/v3/services/ca842fe71a4e49c6a8e7823c6cdbe0e8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:39.798347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505a450-b166-4e31-a76a-669e9555e019 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:39.813731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505a450-b166-4e31-a76a-669e9555e019 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:39.837854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d554c87-c3e8-406e-9be5-6a57fc9d6a20 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccad2edd009046ab9fdcf50630067cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a973f891706749ea905a4457ae7ebe88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:39.838907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d554c87-c3e8-406e-9be5-6a57fc9d6a20 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:39.839256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d554c87-c3e8-406e-9be5-6a57fc9d6a20 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:39.840764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d554c87-c3e8-406e-9be5-6a57fc9d6a20 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/a20f706196dd4f76b611aecada9edc0a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:39.841487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d554c87-c3e8-406e-9be5-6a57fc9d6a20 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=a20f706196dd4f76b611aecada9edc0a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:39.843453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d554c87-c3e8-406e-9be5-6a57fc9d6a20 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:39.866216 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2225/4451] 10.222.0.17 () {58 vars in 1293 bytes} [Sat Jul 30 21:16:39 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/a20f706196dd4f76b611aecada9edc0a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:39.872645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baf871-916d-4546-8b2a-e6a1e585ab33 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:39.888118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baf871-916d-4546-8b2a-e6a1e585ab33 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:39.894728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb19d76-3427-46a4-b266-30e97aaf5412 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccad2edd009046ab9fdcf50630067cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a973f891706749ea905a4457ae7ebe88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:39.895641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb19d76-3427-46a4-b266-30e97aaf5412 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:39.896123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb19d76-3427-46a4-b266-30e97aaf5412 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:39.896531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb19d76-3427-46a4-b266-30e97aaf5412 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] PATH_INFO: `/v3/services/40c29ab323014364b6754c7337751d5c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:39.897271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb19d76-3427-46a4-b266-30e97aaf5412 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorizing `identity:delete_service(service_id=40c29ab323014364b6754c7337751d5c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:39.899804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb19d76-3427-46a4-b266-30e97aaf5412 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:39.938780 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2227/4452] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:39 2022] DELETE /identity/v3/services/40c29ab323014364b6754c7337751d5c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:39.943758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d554c87-c3e8-406e-9be5-6a57fc9d6a20 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:39.949827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2d554c87-c3e8-406e-9be5-6a57fc9d6a20 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:39.994131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0dd11-f288-4f38-af83-e92fe7e03f66 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:39.994427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0dd11-f288-4f38-af83-e92fe7e03f66 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:39.995171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d554c87-c3e8-406e-9be5-6a57fc9d6a20 tempest-EndPointGroupsTest-239582667 tempest-EndPointGroupsTest-239582667-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:39.995339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0dd11-f288-4f38-af83-e92fe7e03f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:40.008419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=1,keystone:SELECT=92,keystone:UPDATE=1,keystone:DELETE=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:40.027815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bde0dd11-f288-4f38-af83-e92fe7e03f66 None None] MFA Rules not processed for user `4a01092bfa5a4118a5fe61a6dc9c5460`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:40.028460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816fd41-c17d-4040-bb62-b8426a299b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:40.029428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816fd41-c17d-4040-bb62-b8426a299b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:40.031723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816fd41-c17d-4040-bb62-b8426a299b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:40.031955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bde0dd11-f288-4f38-af83-e92fe7e03f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:40.032076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816fd41-c17d-4040-bb62-b8426a299b82 admin admin] PATH_INFO: `/v3/users/b58900af2769478cbda55b4a5205b4ad` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:40.033322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816fd41-c17d-4040-bb62-b8426a299b82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58900af2769478cbda55b4a5205b4ad)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:40.036607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816fd41-c17d-4040-bb62-b8426a299b82 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:40.149608 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2228/4453] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:40.162829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4816fd41-c17d-4040-bb62-b8426a299b82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58900af2769478cbda55b4a5205b4ad'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:40.191237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4816fd41-c17d-4040-bb62-b8426a299b82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58900af2769478cbda55b4a5205b4ad'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:40.192080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4816fd41-c17d-4040-bb62-b8426a299b82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58900af2769478cbda55b4a5205b4ad'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:40.206875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4816fd41-c17d-4040-bb62-b8426a299b82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58900af2769478cbda55b4a5205b4ad'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:40.207843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4816fd41-c17d-4040-bb62-b8426a299b82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58900af2769478cbda55b4a5205b4ad'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:40.242137 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2226/4454] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:16:39 2022] DELETE /identity/v3/users/b58900af2769478cbda55b4a5205b4ad => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:16:40.254210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefbe2e-bed8-492a-83dd-35591327d02c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:40.255673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefbe2e-bed8-492a-83dd-35591327d02c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:40.256160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefbe2e-bed8-492a-83dd-35591327d02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:40.299501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-dfefbe2e-bed8-492a-83dd-35591327d02c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:40.301701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dfefbe2e-bed8-492a-83dd-35591327d02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:40.428294 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2229/4455] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:40.444066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816fd41-c17d-4040-bb62-b8426a299b82 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:40.445623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4816fd41-c17d-4040-bb62-b8426a299b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:40.479780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefbe2e-bed8-492a-83dd-35591327d02c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:40.481650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dfefbe2e-bed8-492a-83dd-35591327d02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:40.591946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:40.691555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefbe2e-bed8-492a-83dd-35591327d02c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:40.699265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc65600-4099-411c-a171-e949081aebb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:40.700523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc65600-4099-411c-a171-e949081aebb5 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:40.701174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc65600-4099-411c-a171-e949081aebb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:40.701582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc65600-4099-411c-a171-e949081aebb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:40.704119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816fd41-c17d-4040-bb62-b8426a299b82 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:40.704360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6bc65600-4099-411c-a171-e949081aebb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:40.717305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff11b25-d929-471e-92a8-6fb75178f087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:40.718573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff11b25-d929-471e-92a8-6fb75178f087 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:40.719049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff11b25-d929-471e-92a8-6fb75178f087 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:40.719552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff11b25-d929-471e-92a8-6fb75178f087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:40.738887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc65600-4099-411c-a171-e949081aebb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:40.740597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc65600-4099-411c-a171-e949081aebb5 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:40.742294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff11b25-d929-471e-92a8-6fb75178f087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:40.752782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff11b25-d929-471e-92a8-6fb75178f087 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:40.771738 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2227/4456] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:16:40.772611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff11b25-d929-471e-92a8-6fb75178f087 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:40.774073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8ff11b25-d929-471e-92a8-6fb75178f087 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:40.775807 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2230/4457] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:16:40.782139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b8b77-f8e9-4074-b5ad-421f53da731e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:40.782377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b8b77-f8e9-4074-b5ad-421f53da731e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:40.782594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b8b77-f8e9-4074-b5ad-421f53da731e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:40.812142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff11b25-d929-471e-92a8-6fb75178f087 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:40.822469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64d989-2f6f-495d-a411-819bc6f5c429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:40.823510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64d989-2f6f-495d-a411-819bc6f5c429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:40.824613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64d989-2f6f-495d-a411-819bc6f5c429 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:40.824908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64d989-2f6f-495d-a411-819bc6f5c429 admin admin] PATH_INFO: `/v3/projects/563728adf42b4406a340fc8ac17e8421` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:40.826372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64d989-2f6f-495d-a411-819bc6f5c429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=563728adf42b4406a340fc8ac17e8421)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:40.833957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64d989-2f6f-495d-a411-819bc6f5c429 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:40.852185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-216b8b77-f8e9-4074-b5ad-421f53da731e None None] MFA Rules not processed for user `23ba5ddf22424eff840602440872f86e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:40.859140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-216b8b77-f8e9-4074-b5ad-421f53da731e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:40.904702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3a64d989-2f6f-495d-a411-819bc6f5c429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '563728adf42b4406a340fc8ac17e8421', 'request_id': 'req-3a64d989-2f6f-495d-a411-819bc6f5c429'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:40.911490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3a64d989-2f6f-495d-a411-819bc6f5c429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '563728adf42b4406a340fc8ac17e8421', 'request_id': 'req-3a64d989-2f6f-495d-a411-819bc6f5c429'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:40.924036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3a64d989-2f6f-495d-a411-819bc6f5c429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '563728adf42b4406a340fc8ac17e8421', 'request_id': 'req-3a64d989-2f6f-495d-a411-819bc6f5c429'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:40.937564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3a64d989-2f6f-495d-a411-819bc6f5c429 admin admin] The token cache is being invalidate because project 563728adf42b4406a340fc8ac17e8421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:16:40.937919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3a64d989-2f6f-495d-a411-819bc6f5c429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:40.939754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3a64d989-2f6f-495d-a411-819bc6f5c429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:40.941755 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2228/4458] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:40 2022] DELETE /identity/v3/projects/563728adf42b4406a340fc8ac17e8421 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:40.947714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37810b35-4cc1-4805-b18f-7ce1e4539ffe None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:40.948009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37810b35-4cc1-4805-b18f-7ce1e4539ffe None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:40.948401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37810b35-4cc1-4805-b18f-7ce1e4539ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:40.969993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:41.011600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-37810b35-4cc1-4805-b18f-7ce1e4539ffe None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:41.020404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-37810b35-4cc1-4805-b18f-7ce1e4539ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:41.068995 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2231/4459] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:41.110599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b8b77-f8e9-4074-b5ad-421f53da731e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:41.112276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-216b8b77-f8e9-4074-b5ad-421f53da731e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:41.129058 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2229/4460] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:41.133084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9274172-97d7-44da-b620-5cb527217342 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:41.133375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9274172-97d7-44da-b620-5cb527217342 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:41.133653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9274172-97d7-44da-b620-5cb527217342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:41.148236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b8b77-f8e9-4074-b5ad-421f53da731e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:41.218204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e9274172-97d7-44da-b620-5cb527217342 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:41.219502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e9274172-97d7-44da-b620-5cb527217342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:41.247663 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2230/4461] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:41.254317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9274172-97d7-44da-b620-5cb527217342 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:41.288371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9274172-97d7-44da-b620-5cb527217342 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:41.298561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3fd0f-83cb-4ae1-a439-3175fe3bf54a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:41.299816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3fd0f-83cb-4ae1-a439-3175fe3bf54a service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:41.300318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3fd0f-83cb-4ae1-a439-3175fe3bf54a service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:41.300847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3fd0f-83cb-4ae1-a439-3175fe3bf54a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:41.302163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56119837-a01a-4261-a95f-7ee8b95f6e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:41.302796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56119837-a01a-4261-a95f-7ee8b95f6e21 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:41.303082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56119837-a01a-4261-a95f-7ee8b95f6e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:41.303384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56119837-a01a-4261-a95f-7ee8b95f6e21 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:41.304099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56119837-a01a-4261-a95f-7ee8b95f6e21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:16:41.304400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56119837-a01a-4261-a95f-7ee8b95f6e21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:41.306015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56119837-a01a-4261-a95f-7ee8b95f6e21 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:41.308329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-49c3fd0f-83cb-4ae1-a439-3175fe3bf54a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:41.325139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3fd0f-83cb-4ae1-a439-3175fe3bf54a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:41.326613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3fd0f-83cb-4ae1-a439-3175fe3bf54a service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:41.334599 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2231/4462] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:16:41.340951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56119837-a01a-4261-a95f-7ee8b95f6e21 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:41.352994 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2232/4463] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:16:41.367494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56119837-a01a-4261-a95f-7ee8b95f6e21 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:41.380120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ba907-9abc-42fc-8f59-afa26b7bd9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:41.381521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ba907-9abc-42fc-8f59-afa26b7bd9ec admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:41.382555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ba907-9abc-42fc-8f59-afa26b7bd9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:41.383107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ba907-9abc-42fc-8f59-afa26b7bd9ec admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:41.384214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ba907-9abc-42fc-8f59-afa26b7bd9ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:41.388068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ba907-9abc-42fc-8f59-afa26b7bd9ec admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:41.492922 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2232/4464] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:41 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:16:41.494118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3fd0f-83cb-4ae1-a439-3175fe3bf54a service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:41.516071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3fd0f-83cb-4ae1-a439-3175fe3bf54a service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:41.664979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e784d98-4b6f-4fff-94fc-f613e45ae2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:41.665660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e784d98-4b6f-4fff-94fc-f613e45ae2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:41.665909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e784d98-4b6f-4fff-94fc-f613e45ae2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:41.666183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e784d98-4b6f-4fff-94fc-f613e45ae2e6 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:41.666938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e784d98-4b6f-4fff-94fc-f613e45ae2e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:41.669836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e784d98-4b6f-4fff-94fc-f613e45ae2e6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:41.710641 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2233/4465] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:16:41 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:16:41.715585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ba907-9abc-42fc-8f59-afa26b7bd9ec admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:41.729934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ba907-9abc-42fc-8f59-afa26b7bd9ec admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:41.738177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546430cb-8001-4710-a13b-d5907e412fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:41.739055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546430cb-8001-4710-a13b-d5907e412fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:41.751497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546430cb-8001-4710-a13b-d5907e412fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:41.754261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546430cb-8001-4710-a13b-d5907e412fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:41.755313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546430cb-8001-4710-a13b-d5907e412fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:41.763448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546430cb-8001-4710-a13b-d5907e412fa4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:41.774569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:41.823550 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2233/4466] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:41.828237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e784d98-4b6f-4fff-94fc-f613e45ae2e6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:41.843185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e784d98-4b6f-4fff-94fc-f613e45ae2e6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:41.864679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02ba0f-1870-4ad8-92e8-0785bf139d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:41.865357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02ba0f-1870-4ad8-92e8-0785bf139d8f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:41.865648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02ba0f-1870-4ad8-92e8-0785bf139d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:41.865926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02ba0f-1870-4ad8-92e8-0785bf139d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:41.866703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02ba0f-1870-4ad8-92e8-0785bf139d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:41.868459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02ba0f-1870-4ad8-92e8-0785bf139d8f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:41.896865 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2234/4467] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:41.901615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546430cb-8001-4710-a13b-d5907e412fa4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:41.928183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546430cb-8001-4710-a13b-d5907e412fa4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:41.944488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe882be-4c3e-4404-bbd8-03d04b487637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:41.945199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe882be-4c3e-4404-bbd8-03d04b487637 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:41.945488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe882be-4c3e-4404-bbd8-03d04b487637 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:41.945772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe882be-4c3e-4404-bbd8-03d04b487637 admin admin] PATH_INFO: `/v3/projects/2af384c0e6d44b53a12811dfbb3dd2f1/users/2292736a93ca4a548ae1ff004b07c070/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:42.028257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe882be-4c3e-4404-bbd8-03d04b487637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af384c0e6d44b53a12811dfbb3dd2f1, user_id=2292736a93ca4a548ae1ff004b07c070, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:42.041098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe882be-4c3e-4404-bbd8-03d04b487637 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:42.057501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02ba0f-1870-4ad8-92e8-0785bf139d8f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:42.061621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1e02ba0f-1870-4ad8-92e8-0785bf139d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:42.087092 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2234/4468] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:41 2022] PUT /identity/v3/projects/2af384c0e6d44b53a12811dfbb3dd2f1/users/2292736a93ca4a548ae1ff004b07c070/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:42.090340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02ba0f-1870-4ad8-92e8-0785bf139d8f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:42.098714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c66d25-0c89-41cb-be9f-66553dcd3bdf None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:42.099008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c66d25-0c89-41cb-be9f-66553dcd3bdf None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:42.099280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c66d25-0c89-41cb-be9f-66553dcd3bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:42.220454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:42.221693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a9c66d25-0c89-41cb-be9f-66553dcd3bdf None None] MFA Rules not processed for user `2292736a93ca4a548ae1ff004b07c070`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:42.225513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a9c66d25-0c89-41cb-be9f-66553dcd3bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:42.242956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69a3a2-49a6-407d-bb1a-4343652cfe5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:42.243733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69a3a2-49a6-407d-bb1a-4343652cfe5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:42.244084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69a3a2-49a6-407d-bb1a-4343652cfe5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:42.244363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69a3a2-49a6-407d-bb1a-4343652cfe5d admin admin] PATH_INFO: `/v3/projects/e02b2aa18e2c4c6aa2d8189c834395a7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:42.249327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69a3a2-49a6-407d-bb1a-4343652cfe5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e02b2aa18e2c4c6aa2d8189c834395a7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:42.259586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69a3a2-49a6-407d-bb1a-4343652cfe5d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:42.414435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dd69a3a2-49a6-407d-bb1a-4343652cfe5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e02b2aa18e2c4c6aa2d8189c834395a7', 'request_id': 'req-dd69a3a2-49a6-407d-bb1a-4343652cfe5d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:42.441211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dd69a3a2-49a6-407d-bb1a-4343652cfe5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e02b2aa18e2c4c6aa2d8189c834395a7', 'request_id': 'req-dd69a3a2-49a6-407d-bb1a-4343652cfe5d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:42.441629 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2235/4469] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:42.452138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dd69a3a2-49a6-407d-bb1a-4343652cfe5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e02b2aa18e2c4c6aa2d8189c834395a7', 'request_id': 'req-dd69a3a2-49a6-407d-bb1a-4343652cfe5d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:42.478347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dd69a3a2-49a6-407d-bb1a-4343652cfe5d admin admin] The token cache is being invalidate because project e02b2aa18e2c4c6aa2d8189c834395a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:16:42.479461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dd69a3a2-49a6-407d-bb1a-4343652cfe5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:42.483459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dd69a3a2-49a6-407d-bb1a-4343652cfe5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:42.485536 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2235/4470] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:42 2022] DELETE /identity/v3/projects/e02b2aa18e2c4c6aa2d8189c834395a7 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:16:42.489394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c66d25-0c89-41cb-be9f-66553dcd3bdf None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:42.509432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c66d25-0c89-41cb-be9f-66553dcd3bdf None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:42.572589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69a3a2-49a6-407d-bb1a-4343652cfe5d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:42.574284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dd69a3a2-49a6-407d-bb1a-4343652cfe5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:42.703953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6410d-8250-40a4-9047-55c0e66c6237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:42.709752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6410d-8250-40a4-9047-55c0e66c6237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:42.709752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6410d-8250-40a4-9047-55c0e66c6237 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:42.709752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6410d-8250-40a4-9047-55c0e66c6237 admin admin] PATH_INFO: `/v3/users/ccad2edd009046ab9fdcf50630067cfc` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:42.712098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6410d-8250-40a4-9047-55c0e66c6237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccad2edd009046ab9fdcf50630067cfc)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:42.729860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6410d-8250-40a4-9047-55c0e66c6237 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:42.772929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69a3a2-49a6-407d-bb1a-4343652cfe5d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:42.785145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5faf9af-a6b3-4830-a5fc-fd6ef0f5e67f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:42.786838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5faf9af-a6b3-4830-a5fc-fd6ef0f5e67f service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:42.789075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5faf9af-a6b3-4830-a5fc-fd6ef0f5e67f service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:42.790861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5faf9af-a6b3-4830-a5fc-fd6ef0f5e67f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:42.798886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c5faf9af-a6b3-4830-a5fc-fd6ef0f5e67f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:42.881696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-51f6410d-8250-40a4-9047-55c0e66c6237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccad2edd009046ab9fdcf50630067cfc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:42.943917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-51f6410d-8250-40a4-9047-55c0e66c6237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccad2edd009046ab9fdcf50630067cfc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:42.947257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-51f6410d-8250-40a4-9047-55c0e66c6237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccad2edd009046ab9fdcf50630067cfc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:42.948996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:42.978056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-51f6410d-8250-40a4-9047-55c0e66c6237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccad2edd009046ab9fdcf50630067cfc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:42.979784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-51f6410d-8250-40a4-9047-55c0e66c6237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccad2edd009046ab9fdcf50630067cfc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:43.033769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5faf9af-a6b3-4830-a5fc-fd6ef0f5e67f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:43.035845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5faf9af-a6b3-4830-a5fc-fd6ef0f5e67f service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:43.036629 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2236/4471] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:16:42 2022] DELETE /identity/v3/users/ccad2edd009046ab9fdcf50630067cfc => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:43.100945 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2236/4472] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:16:44.632582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6410d-8250-40a4-9047-55c0e66c6237 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:44.636107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-51f6410d-8250-40a4-9047-55c0e66c6237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:44.850742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6410d-8250-40a4-9047-55c0e66c6237 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:44.864393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c911c-2110-4dc4-949c-8a339561d265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:44.865895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c911c-2110-4dc4-949c-8a339561d265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:44.866298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c911c-2110-4dc4-949c-8a339561d265 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:44.866724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c911c-2110-4dc4-949c-8a339561d265 admin admin] PATH_INFO: `/v3/projects/a973f891706749ea905a4457ae7ebe88` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:44.868279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c911c-2110-4dc4-949c-8a339561d265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a973f891706749ea905a4457ae7ebe88)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:44.871494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c911c-2110-4dc4-949c-8a339561d265 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:45.035099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-955c911c-2110-4dc4-949c-8a339561d265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a973f891706749ea905a4457ae7ebe88', 'request_id': 'req-955c911c-2110-4dc4-949c-8a339561d265'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:45.065777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-955c911c-2110-4dc4-949c-8a339561d265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a973f891706749ea905a4457ae7ebe88', 'request_id': 'req-955c911c-2110-4dc4-949c-8a339561d265'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:45.086061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-955c911c-2110-4dc4-949c-8a339561d265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a973f891706749ea905a4457ae7ebe88', 'request_id': 'req-955c911c-2110-4dc4-949c-8a339561d265'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:45.105976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-955c911c-2110-4dc4-949c-8a339561d265 admin admin] The token cache is being invalidate because project a973f891706749ea905a4457ae7ebe88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:16:45.106337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-955c911c-2110-4dc4-949c-8a339561d265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:45.112729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-955c911c-2110-4dc4-949c-8a339561d265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:45.129337 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2237/4473] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:44 2022] DELETE /identity/v3/projects/a973f891706749ea905a4457ae7ebe88 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:45.130495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c1eef-e66a-4836-b9d6-ffb9474917ed None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:45.130982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c1eef-e66a-4836-b9d6-ffb9474917ed None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:45.131310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c1eef-e66a-4836-b9d6-ffb9474917ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:45.195705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-168c1eef-e66a-4836-b9d6-ffb9474917ed None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:45.197082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-168c1eef-e66a-4836-b9d6-ffb9474917ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:45.318039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:45.458578 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2237/4474] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:45.468014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4a43-7567-4926-acfb-fc62b2b5b7c2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:45.468490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4a43-7567-4926-acfb-fc62b2b5b7c2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:45.468601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4a43-7567-4926-acfb-fc62b2b5b7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:45.528918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c5fd4a43-7567-4926-acfb-fc62b2b5b7c2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:45.532514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c5fd4a43-7567-4926-acfb-fc62b2b5b7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:45.562785 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2238/4475] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:45.565952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c1eef-e66a-4836-b9d6-ffb9474917ed None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:45.590904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c1eef-e66a-4836-b9d6-ffb9474917ed None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:45.612782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f536b-f598-4bdb-89e4-4acbf9dec5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:45.613824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f536b-f598-4bdb-89e4-4acbf9dec5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:45.614930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f536b-f598-4bdb-89e4-4acbf9dec5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:45.615496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f536b-f598-4bdb-89e4-4acbf9dec5c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:45.616443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f536b-f598-4bdb-89e4-4acbf9dec5c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:16:45.620201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f536b-f598-4bdb-89e4-4acbf9dec5c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:45.622286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f536b-f598-4bdb-89e4-4acbf9dec5c2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:45.677629 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2238/4476] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:16:45.684564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd4a43-7567-4926-acfb-fc62b2b5b7c2 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:45.704087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd4a43-7567-4926-acfb-fc62b2b5b7c2 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:45.720014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19930584-432d-454d-9037-26b6a3bc5859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:45.720869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930584-432d-454d-9037-26b6a3bc5859 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:45.721163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930584-432d-454d-9037-26b6a3bc5859 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:45.723453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930584-432d-454d-9037-26b6a3bc5859 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:45.725548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19930584-432d-454d-9037-26b6a3bc5859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:45.737658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19930584-432d-454d-9037-26b6a3bc5859 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:45.840659 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2239/4477] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:45 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:45.841711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f536b-f598-4bdb-89e4-4acbf9dec5c2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:45.858776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f536b-f598-4bdb-89e4-4acbf9dec5c2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:46.068693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58a662-be72-4723-8794-f1c433d31c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:46.069445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58a662-be72-4723-8794-f1c433d31c87 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:46.069804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58a662-be72-4723-8794-f1c433d31c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:46.070179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58a662-be72-4723-8794-f1c433d31c87 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:46.070942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58a662-be72-4723-8794-f1c433d31c87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:46.079058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58a662-be72-4723-8794-f1c433d31c87 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:46.135782 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2239/4478] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:16:45 2022] POST /identity/v3/users => generated 294 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:46.139888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19930584-432d-454d-9037-26b6a3bc5859 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:46.182468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19930584-432d-454d-9037-26b6a3bc5859 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:46.197263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a425a8-fb90-4d41-96c9-b96f6e1e4edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:46.203545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a425a8-fb90-4d41-96c9-b96f6e1e4edf admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:46.203953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a425a8-fb90-4d41-96c9-b96f6e1e4edf admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:46.204248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a425a8-fb90-4d41-96c9-b96f6e1e4edf admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:46.205019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a425a8-fb90-4d41-96c9-b96f6e1e4edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:46.212018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a425a8-fb90-4d41-96c9-b96f6e1e4edf admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:46.249560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58a662-be72-4723-8794-f1c433d31c87 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:46.249803 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2240/4479] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:16:46.266610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58a662-be72-4723-8794-f1c433d31c87 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:46.285079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28061b5-172e-40de-974d-1b8f2eb33bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:46.288484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28061b5-172e-40de-974d-1b8f2eb33bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:46.293298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28061b5-172e-40de-974d-1b8f2eb33bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:46.294914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28061b5-172e-40de-974d-1b8f2eb33bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:46.295806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28061b5-172e-40de-974d-1b8f2eb33bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:46.305315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28061b5-172e-40de-974d-1b8f2eb33bf9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:46.340835 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2240/4480] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:46.346321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a425a8-fb90-4d41-96c9-b96f6e1e4edf admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:46.372764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a425a8-fb90-4d41-96c9-b96f6e1e4edf admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:46.384061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33deab-e5dd-4c7c-af5b-8a44249ee10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:46.386431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33deab-e5dd-4c7c-af5b-8a44249ee10c admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:46.387895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33deab-e5dd-4c7c-af5b-8a44249ee10c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:46.388191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33deab-e5dd-4c7c-af5b-8a44249ee10c admin admin] PATH_INFO: `/v3/projects/aa15d3bef2394faa8ede7001e6dc9a76/users/3ae534da2138476ab38b0e16d0810fa8/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:46.428043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33deab-e5dd-4c7c-af5b-8a44249ee10c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa15d3bef2394faa8ede7001e6dc9a76, user_id=3ae534da2138476ab38b0e16d0810fa8, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:46.432466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33deab-e5dd-4c7c-af5b-8a44249ee10c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:46.476225 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2241/4481] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:46 2022] PUT /identity/v3/projects/aa15d3bef2394faa8ede7001e6dc9a76/users/3ae534da2138476ab38b0e16d0810fa8/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:46.476946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07d9fc-52e8-4646-b70c-a8517b6347ac None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:46.477234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07d9fc-52e8-4646-b70c-a8517b6347ac None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:46.477512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07d9fc-52e8-4646-b70c-a8517b6347ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:46.543660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5f07d9fc-52e8-4646-b70c-a8517b6347ac None None] MFA Rules not processed for user `3ae534da2138476ab38b0e16d0810fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:46.544922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5f07d9fc-52e8-4646-b70c-a8517b6347ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:46.624775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd8757-e2c6-4148-9a9b-730dc5d35a0d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:46.625094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd8757-e2c6-4148-9a9b-730dc5d35a0d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:46.625337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd8757-e2c6-4148-9a9b-730dc5d35a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:46.668517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3edd8757-e2c6-4148-9a9b-730dc5d35a0d None None] MFA Rules not processed for user `23ba5ddf22424eff840602440872f86e`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:46.670064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3edd8757-e2c6-4148-9a9b-730dc5d35a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:46.675991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:46.695466 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2241/4482] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:16:46.699849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07d9fc-52e8-4646-b70c-a8517b6347ac None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:46.780526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:46.781186 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2242/4483] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:46.842138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07d9fc-52e8-4646-b70c-a8517b6347ac None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:46.859656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59ddc2-832b-4d36-b5d1-509cc7ccdce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:46.860381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59ddc2-832b-4d36-b5d1-509cc7ccdce4 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:46.860727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59ddc2-832b-4d36-b5d1-509cc7ccdce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:46.861005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59ddc2-832b-4d36-b5d1-509cc7ccdce4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:46.861712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59ddc2-832b-4d36-b5d1-509cc7ccdce4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:46.864350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59ddc2-832b-4d36-b5d1-509cc7ccdce4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:46.950334 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2242/4484] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:46 2022] POST /identity/v3/projects => generated 387 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:16:46.951201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd8757-e2c6-4148-9a9b-730dc5d35a0d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:46.966784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd8757-e2c6-4148-9a9b-730dc5d35a0d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:47.125598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069eeab-ecb4-439e-8f92-54bd9cd24a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:47.126245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069eeab-ecb4-439e-8f92-54bd9cd24a62 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:47.126541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069eeab-ecb4-439e-8f92-54bd9cd24a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:47.126835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069eeab-ecb4-439e-8f92-54bd9cd24a62 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:47.127643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069eeab-ecb4-439e-8f92-54bd9cd24a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:47.134172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069eeab-ecb4-439e-8f92-54bd9cd24a62 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:47.207069 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2243/4485] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:16:46 2022] POST /identity/v3/users => generated 300 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:16:47.211464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59ddc2-832b-4d36-b5d1-509cc7ccdce4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:47.231640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59ddc2-832b-4d36-b5d1-509cc7ccdce4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:47.252697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8743f-a7ad-4139-8a69-05a1619e083b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:47.253584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8743f-a7ad-4139-8a69-05a1619e083b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:47.254080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8743f-a7ad-4139-8a69-05a1619e083b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:47.254535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8743f-a7ad-4139-8a69-05a1619e083b admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:47.255872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8743f-a7ad-4139-8a69-05a1619e083b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:47.264982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8743f-a7ad-4139-8a69-05a1619e083b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:47.292707 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2243/4486] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:47.297162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069eeab-ecb4-439e-8f92-54bd9cd24a62 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:47.313607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069eeab-ecb4-439e-8f92-54bd9cd24a62 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:47.320682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258c1b4-f2c9-4cd9-8ea0-edb14444ebd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:47.321442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258c1b4-f2c9-4cd9-8ea0-edb14444ebd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:47.321938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258c1b4-f2c9-4cd9-8ea0-edb14444ebd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:47.322228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258c1b4-f2c9-4cd9-8ea0-edb14444ebd4 admin admin] PATH_INFO: `/v3/projects/b627da1cba0a4b298f7bcde84ade0c10/users/3eaa18a896f54c91ae4a8429d69ccb3c/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:47.347016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258c1b4-f2c9-4cd9-8ea0-edb14444ebd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b627da1cba0a4b298f7bcde84ade0c10, user_id=3eaa18a896f54c91ae4a8429d69ccb3c, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:47.352581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258c1b4-f2c9-4cd9-8ea0-edb14444ebd4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:47.379388 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2244/4487] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:47 2022] PUT /identity/v3/projects/b627da1cba0a4b298f7bcde84ade0c10/users/3eaa18a896f54c91ae4a8429d69ccb3c/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:16:47.383976 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8743f-a7ad-4139-8a69-05a1619e083b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:47.401497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8743f-a7ad-4139-8a69-05a1619e083b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:47.566250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ee072-54bf-4858-b409-54e5ea68381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:47.569411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ee072-54bf-4858-b409-54e5ea68381b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:47.569818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ee072-54bf-4858-b409-54e5ea68381b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:47.570907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ee072-54bf-4858-b409-54e5ea68381b admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:47.572191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ee072-54bf-4858-b409-54e5ea68381b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:47.591013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ee072-54bf-4858-b409-54e5ea68381b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:47.625782 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2244/4488] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:47.626073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258c1b4-f2c9-4cd9-8ea0-edb14444ebd4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:47.649974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258c1b4-f2c9-4cd9-8ea0-edb14444ebd4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:47.655647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c510f14-9625-45c7-905b-57f3f707039d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:47.656455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c510f14-9625-45c7-905b-57f3f707039d admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:47.656748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c510f14-9625-45c7-905b-57f3f707039d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:47.657086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c510f14-9625-45c7-905b-57f3f707039d admin admin] PATH_INFO: `/v3/projects/b627da1cba0a4b298f7bcde84ade0c10/users/3eaa18a896f54c91ae4a8429d69ccb3c/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:47.659359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c510f14-9625-45c7-905b-57f3f707039d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b627da1cba0a4b298f7bcde84ade0c10, user_id=3eaa18a896f54c91ae4a8429d69ccb3c, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:47.662582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c510f14-9625-45c7-905b-57f3f707039d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:47.679348 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2245/4489] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:47 2022] PUT /identity/v3/projects/b627da1cba0a4b298f7bcde84ade0c10/users/3eaa18a896f54c91ae4a8429d69ccb3c/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:47.690060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dc292-51bd-441e-8f5e-273f33bd1148 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:47.694191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dc292-51bd-441e-8f5e-273f33bd1148 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:47.695282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dc292-51bd-441e-8f5e-273f33bd1148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:47.734118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9b3dc292-51bd-441e-8f5e-273f33bd1148 None None] MFA Rules not processed for user `3eaa18a896f54c91ae4a8429d69ccb3c`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:47.735723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9b3dc292-51bd-441e-8f5e-273f33bd1148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:47.840248 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2245/4490] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:47.842345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c510f14-9625-45c7-905b-57f3f707039d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:47.855669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c510f14-9625-45c7-905b-57f3f707039d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:47.861099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11410c28-a2ba-486a-a322-725a55ee9028 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eaa18a896f54c91ae4a8429d69ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b627da1cba0a4b298f7bcde84ade0c10', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:47.861099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11410c28-a2ba-486a-a322-725a55ee9028 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:47.861426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11410c28-a2ba-486a-a322-725a55ee9028 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:47.861934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11410c28-a2ba-486a-a322-725a55ee9028 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:47.862497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11410c28-a2ba-486a-a322-725a55ee9028 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:47.865578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11410c28-a2ba-486a-a322-725a55ee9028 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:47.898508 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2246/4491] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:47 2022] POST /identity/v3/services => generated 289 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:47.901288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3dc292-51bd-441e-8f5e-273f33bd1148 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:47.911823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3dc292-51bd-441e-8f5e-273f33bd1148 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:47.952217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b06f6-855f-4d52-864d-b1cb278edf5c tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eaa18a896f54c91ae4a8429d69ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b627da1cba0a4b298f7bcde84ade0c10', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:47.953359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b06f6-855f-4d52-864d-b1cb278edf5c tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:47.954042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b06f6-855f-4d52-864d-b1cb278edf5c tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:47.954532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b06f6-855f-4d52-864d-b1cb278edf5c tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:47.955656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b06f6-855f-4d52-864d-b1cb278edf5c tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:47.957383 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-294b06f6-855f-4d52-864d-b1cb278edf5c tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:16:47.957383 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:16:47.957383 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:16:47.958755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b06f6-855f-4d52-864d-b1cb278edf5c tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-294b06f6-855f-4d52-864d-b1cb278edf5c tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: Failed validating 'type' in schema['properties']['enabled']: Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: {'enum': [True, False, None], 'type': 'boolean'} Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: On instance['enabled']: Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: Failed validating 'type' in schema['properties']['enabled']: Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: {'enum': [True, False, None], 'type': 'boolean'} Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: On instance['enabled']: Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: 'False' Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise error Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application On instance['enabled']: Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application 'False' Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:47.993496 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:16:48.001174 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:48.001174 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:16:48.001174 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:16:48.001174 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:16:48.001174 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:16:48.001174 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:16:48.001174 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:16:48.001174 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:16:48.001174 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:16:48.001174 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:16:48.001174 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:16:48.001174 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:16:48.001174 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jul 30 21:16:48.001174 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jul 30 21:16:48.001174 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 30 21:16:48.001174 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 30 21:16:48.001174 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 30 21:16:48.002451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 30 21:16:48.002451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 30 21:16:48.002451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:48.002451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 30 21:16:48.002451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 30 21:16:48.002451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:48.002451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application On instance['enabled']: Jul 30 21:16:48.002451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application 'False' Jul 30 21:16:48.002451 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:48.002451 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2246/4492] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Jul 30 21:16:47 2022] POST /identity/v3/endpoints => generated 283 bytes in 94 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 30 21:16:48.008889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11410c28-a2ba-486a-a322-725a55ee9028 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:48.027273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11410c28-a2ba-486a-a322-725a55ee9028 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:48.054393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bf2af-2cfd-438c-adda-74767300e39e tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eaa18a896f54c91ae4a8429d69ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b627da1cba0a4b298f7bcde84ade0c10', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:48.055648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bf2af-2cfd-438c-adda-74767300e39e tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:48.056155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bf2af-2cfd-438c-adda-74767300e39e tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:48.056602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bf2af-2cfd-438c-adda-74767300e39e tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:48.057615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9bf2af-2cfd-438c-adda-74767300e39e tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:48.059258 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-6f9bf2af-2cfd-438c-adda-74767300e39e tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:16:48.059258 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:16:48.059258 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:16:48.061052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9bf2af-2cfd-438c-adda-74767300e39e tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-6f9bf2af-2cfd-438c-adda-74767300e39e tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: Failed validating 'type' in schema['properties']['enabled']: Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: {'enum': [True, False, None], 'type': 'boolean'} Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: On instance['enabled']: Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: Failed validating 'type' in schema['properties']['enabled']: Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: {'enum': [True, False, None], 'type': 'boolean'} Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: On instance['enabled']: Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: 'True' Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise error Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application On instance['enabled']: Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application 'True' Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:16:48.072625 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:16:48.074705 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:16:48.074705 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:16:48.074705 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:16:48.074705 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:16:48.074705 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:16:48.074705 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:16:48.074705 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:16:48.074705 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:16:48.074705 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:16:48.074705 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:16:48.074705 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:16:48.074705 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:16:48.074705 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jul 30 21:16:48.074705 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jul 30 21:16:48.074705 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 30 21:16:48.074705 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 30 21:16:48.074705 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 30 21:16:48.076132 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 30 21:16:48.076132 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 30 21:16:48.076132 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:16:48.076132 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 30 21:16:48.076132 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 30 21:16:48.076132 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:16:48.076132 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application On instance['enabled']: Jul 30 21:16:48.076132 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application 'True' Jul 30 21:16:48.076132 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:16:48.084299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b06f6-855f-4d52-864d-b1cb278edf5c tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:48.109807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b06f6-855f-4d52-864d-b1cb278edf5c tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:48.112725 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2247/4493] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Jul 30 21:16:47 2022] POST /identity/v3/endpoints => generated 281 bytes in 112 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 30 21:16:48.133838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd30ac8-cc80-4d02-8a77-d6c0e1f885b7 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eaa18a896f54c91ae4a8429d69ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b627da1cba0a4b298f7bcde84ade0c10', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:48.134589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd30ac8-cc80-4d02-8a77-d6c0e1f885b7 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:48.134930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd30ac8-cc80-4d02-8a77-d6c0e1f885b7 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:48.135314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd30ac8-cc80-4d02-8a77-d6c0e1f885b7 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:48.136376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd30ac8-cc80-4d02-8a77-d6c0e1f885b7 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:48.139771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd30ac8-cc80-4d02-8a77-d6c0e1f885b7 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:48.159127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:48.187054 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-cbd30ac8-cc80-4d02-8a77-d6c0e1f885b7 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2028105868. To ensure interoperability, identifiers should be a valid uuid. Jul 30 21:16:48.187054 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 30 21:16:48.187054 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:16:48.231611 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2247/4494] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Jul 30 21:16:48 2022] POST /identity/v3/endpoints => generated 360 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:16:48.233419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bf2af-2cfd-438c-adda-74767300e39e tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:48.247946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bf2af-2cfd-438c-adda-74767300e39e tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:48.275713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb441f-11c6-4ce9-8959-5fd70b13736e tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eaa18a896f54c91ae4a8429d69ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b627da1cba0a4b298f7bcde84ade0c10', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:48.276930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb441f-11c6-4ce9-8959-5fd70b13736e tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:48.277450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb441f-11c6-4ce9-8959-5fd70b13736e tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:48.278045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb441f-11c6-4ce9-8959-5fd70b13736e tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] PATH_INFO: `/v3/regions/tempest-region-2028105868` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:48.279387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb441f-11c6-4ce9-8959-5fd70b13736e tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2028105868)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:48.281008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb441f-11c6-4ce9-8959-5fd70b13736e tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:48.287926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd30ac8-cc80-4d02-8a77-d6c0e1f885b7 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:48.289679 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2248/4495] 10.222.0.17 () {58 vars in 1206 bytes} [Sat Jul 30 21:16:48 2022] GET /identity/v3/regions/tempest-region-2028105868 => generated 180 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:16:48.305048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd30ac8-cc80-4d02-8a77-d6c0e1f885b7 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:48.312787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ae49e-e50d-4454-9ebf-43bdabe59bd3 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eaa18a896f54c91ae4a8429d69ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b627da1cba0a4b298f7bcde84ade0c10', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:48.314725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ae49e-e50d-4454-9ebf-43bdabe59bd3 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:48.315180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ae49e-e50d-4454-9ebf-43bdabe59bd3 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:48.315746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ae49e-e50d-4454-9ebf-43bdabe59bd3 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] PATH_INFO: `/v3/endpoints/0ee07ae30c4644b0909b0c2b284f8704` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:48.325474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ae49e-e50d-4454-9ebf-43bdabe59bd3 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=0ee07ae30c4644b0909b0c2b284f8704)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:48.327143 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-c88ae49e-e50d-4454-9ebf-43bdabe59bd3 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:16:48.327143 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:16:48.327143 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:16:48.328501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ae49e-e50d-4454-9ebf-43bdabe59bd3 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-c88ae49e-e50d-4454-9ebf-43bdabe59bd3 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: Failed validating 'type' in schema['properties']['enabled']: Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: {'enum': [True, False, None], 'type': 'boolean'} Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: On instance['enabled']: Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: Failed validating 'type' in schema['properties']['enabled']: Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: {'enum': [True, False, None], 'type': 'boolean'} Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: On instance['enabled']: Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: 'False' Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise error Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application On instance['enabled']: Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application 'False' Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:48.336853 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:16:48.338611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:48.338611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:16:48.338611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:16:48.338611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:16:48.338611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:16:48.338611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:16:48.338611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:16:48.338611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:16:48.338611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:16:48.338611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:16:48.338611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:16:48.338611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:16:48.338611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jul 30 21:16:48.338611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jul 30 21:16:48.338611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 30 21:16:48.338611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 30 21:16:48.338611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 30 21:16:48.340331 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 30 21:16:48.340331 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 30 21:16:48.340331 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:48.340331 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 30 21:16:48.340331 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 30 21:16:48.340331 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:48.340331 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application On instance['enabled']: Jul 30 21:16:48.340331 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application 'False' Jul 30 21:16:48.340331 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:48.350877 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2248/4496] 10.222.0.17 () {60 vars in 1255 bytes} [Sat Jul 30 21:16:48 2022] PATCH /identity/v3/endpoints/0ee07ae30c4644b0909b0c2b284f8704 => generated 283 bytes in 64 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jul 30 21:16:48.357391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb441f-11c6-4ce9-8959-5fd70b13736e tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:48.374534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb441f-11c6-4ce9-8959-5fd70b13736e tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:48.385501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2dcc0-ce0e-40d7-b4da-4e2946a75125 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eaa18a896f54c91ae4a8429d69ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b627da1cba0a4b298f7bcde84ade0c10', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:48.387166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2dcc0-ce0e-40d7-b4da-4e2946a75125 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:48.388602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2dcc0-ce0e-40d7-b4da-4e2946a75125 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:48.389166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2dcc0-ce0e-40d7-b4da-4e2946a75125 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] PATH_INFO: `/v3/endpoints/0ee07ae30c4644b0909b0c2b284f8704` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:48.391407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2dcc0-ce0e-40d7-b4da-4e2946a75125 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=0ee07ae30c4644b0909b0c2b284f8704)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:48.392949 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-77d2dcc0-ce0e-40d7-b4da-4e2946a75125 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:16:48.392949 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:16:48.392949 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:16:48.394880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2dcc0-ce0e-40d7-b4da-4e2946a75125 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:48.412443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-77d2dcc0-ce0e-40d7-b4da-4e2946a75125 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '0ee07ae30c4644b0909b0c2b284f8704', 'request_id': 'req-77d2dcc0-ce0e-40d7-b4da-4e2946a75125'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:48.440814 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2249/4497] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:48 2022] DELETE /identity/v3/endpoints/0ee07ae30c4644b0909b0c2b284f8704 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:48.441306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ae49e-e50d-4454-9ebf-43bdabe59bd3 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:48.456165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ae49e-e50d-4454-9ebf-43bdabe59bd3 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:48.479320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc081c-9e53-4b92-924a-d73cfe00689f tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eaa18a896f54c91ae4a8429d69ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b627da1cba0a4b298f7bcde84ade0c10', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:48.479988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc081c-9e53-4b92-924a-d73cfe00689f tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:48.480276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc081c-9e53-4b92-924a-d73cfe00689f tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:48.481679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc081c-9e53-4b92-924a-d73cfe00689f tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] PATH_INFO: `/v3/regions/tempest-region-2028105868` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:48.482629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc081c-9e53-4b92-924a-d73cfe00689f tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2028105868)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:48.483870 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-eecc081c-9e53-4b92-924a-d73cfe00689f tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:16:48.483870 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:16:48.483870 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:16:48.485110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc081c-9e53-4b92-924a-d73cfe00689f tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:48.537156 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2249/4498] 10.222.0.17 () {58 vars in 1209 bytes} [Sat Jul 30 21:16:48 2022] DELETE /identity/v3/regions/tempest-region-2028105868 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:16:48.538710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596b7a6-f40f-4497-90c6-c8b81a41e60f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:48.539016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596b7a6-f40f-4497-90c6-c8b81a41e60f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:48.540368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596b7a6-f40f-4497-90c6-c8b81a41e60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:48.548093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc081c-9e53-4b92-924a-d73cfe00689f tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:48.568528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a596b7a6-f40f-4497-90c6-c8b81a41e60f None None] MFA Rules not processed for user `23ba5ddf22424eff840602440872f86e`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:48.571063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a596b7a6-f40f-4497-90c6-c8b81a41e60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:48.583619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:48.591058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc081c-9e53-4b92-924a-d73cfe00689f tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:48.623881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bb7f9-cadb-4bc5-8813-991555a9f33f tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eaa18a896f54c91ae4a8429d69ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b627da1cba0a4b298f7bcde84ade0c10', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:48.625614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bb7f9-cadb-4bc5-8813-991555a9f33f tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:48.627356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bb7f9-cadb-4bc5-8813-991555a9f33f tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:48.628122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bb7f9-cadb-4bc5-8813-991555a9f33f tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:48.632884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bb7f9-cadb-4bc5-8813-991555a9f33f tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:48.638835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bb7f9-cadb-4bc5-8813-991555a9f33f tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:48.679004 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-cf7bb7f9-cadb-4bc5-8813-991555a9f33f tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1823948508. To ensure interoperability, identifiers should be a valid uuid. Jul 30 21:16:48.679004 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 30 21:16:48.679004 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:16:48.748690 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2250/4499] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:48 2022] POST /identity/v3/auth/tokens => generated 3383 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:48.768115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596b7a6-f40f-4497-90c6-c8b81a41e60f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:48.769043 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2250/4500] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Jul 30 21:16:48 2022] POST /identity/v3/endpoints => generated 360 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:16:48.830202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596b7a6-f40f-4497-90c6-c8b81a41e60f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:48.865014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d0eca-193d-4abb-b590-b73c9a7cad07 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eaa18a896f54c91ae4a8429d69ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b627da1cba0a4b298f7bcde84ade0c10', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:48.865689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d0eca-193d-4abb-b590-b73c9a7cad07 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:48.865935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d0eca-193d-4abb-b590-b73c9a7cad07 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:48.866205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d0eca-193d-4abb-b590-b73c9a7cad07 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] PATH_INFO: `/v3/regions/tempest-region-1823948508` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:48.866836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d0eca-193d-4abb-b590-b73c9a7cad07 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1823948508)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:48.868153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d0eca-193d-4abb-b590-b73c9a7cad07 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:48.876310 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2251/4501] 10.222.0.17 () {58 vars in 1206 bytes} [Sat Jul 30 21:16:48 2022] GET /identity/v3/regions/tempest-region-1823948508 => generated 180 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:16:48.881058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bb7f9-cadb-4bc5-8813-991555a9f33f tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:48.901283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bb7f9-cadb-4bc5-8813-991555a9f33f tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:48.910664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243e858-5f64-4d93-841c-6495b1e51301 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eaa18a896f54c91ae4a8429d69ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b627da1cba0a4b298f7bcde84ade0c10', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:48.911362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243e858-5f64-4d93-841c-6495b1e51301 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:48.911655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243e858-5f64-4d93-841c-6495b1e51301 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:48.911937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243e858-5f64-4d93-841c-6495b1e51301 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] PATH_INFO: `/v3/endpoints/fe2f884420ca49409848be5fd3e9e2f2` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:48.920895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243e858-5f64-4d93-841c-6495b1e51301 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=fe2f884420ca49409848be5fd3e9e2f2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:48.922685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243e858-5f64-4d93-841c-6495b1e51301 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-d243e858-5f64-4d93-841c-6495b1e51301 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: Failed validating 'type' in schema['properties']['enabled']: Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: {'enum': [True, False, None], 'type': 'boolean'} Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: On instance['enabled']: Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: Failed validating 'type' in schema['properties']['enabled']: Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: {'enum': [True, False, None], 'type': 'boolean'} Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: On instance['enabled']: Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: 'True' Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise error Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application On instance['enabled']: Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application 'True' Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:48.932711 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:16:48.934474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:48.934474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:16:48.934474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:16:48.934474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:16:48.934474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:16:48.934474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:16:48.934474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:16:48.934474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:16:48.934474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:16:48.934474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:16:48.934474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:16:48.934474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:16:48.934474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jul 30 21:16:48.934474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jul 30 21:16:48.934474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 30 21:16:48.934474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 30 21:16:48.934474 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 30 21:16:48.935922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 30 21:16:48.935922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 30 21:16:48.935922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:48.935922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 30 21:16:48.935922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 30 21:16:48.935922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:48.935922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application On instance['enabled']: Jul 30 21:16:48.935922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application 'True' Jul 30 21:16:48.935922 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:16:48.935922 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2251/4502] 10.222.0.17 () {60 vars in 1255 bytes} [Sat Jul 30 21:16:48 2022] PATCH /identity/v3/endpoints/fe2f884420ca49409848be5fd3e9e2f2 => generated 281 bytes in 54 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 30 21:16:48.938666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d0eca-193d-4abb-b590-b73c9a7cad07 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:48.949479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d0eca-193d-4abb-b590-b73c9a7cad07 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:48.974857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996abb2a-700c-4339-8439-382caa937db1 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eaa18a896f54c91ae4a8429d69ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b627da1cba0a4b298f7bcde84ade0c10', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:48.975802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996abb2a-700c-4339-8439-382caa937db1 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:48.976297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996abb2a-700c-4339-8439-382caa937db1 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:48.979483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996abb2a-700c-4339-8439-382caa937db1 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] PATH_INFO: `/v3/endpoints/fe2f884420ca49409848be5fd3e9e2f2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:48.982889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996abb2a-700c-4339-8439-382caa937db1 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=fe2f884420ca49409848be5fd3e9e2f2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:48.984576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996abb2a-700c-4339-8439-382caa937db1 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:49.014287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-996abb2a-700c-4339-8439-382caa937db1 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'fe2f884420ca49409848be5fd3e9e2f2', 'request_id': 'req-996abb2a-700c-4339-8439-382caa937db1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:49.052622 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2252/4503] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:48 2022] DELETE /identity/v3/endpoints/fe2f884420ca49409848be5fd3e9e2f2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:49.057369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243e858-5f64-4d93-841c-6495b1e51301 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:49.074531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243e858-5f64-4d93-841c-6495b1e51301 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:49.099357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357406fa-b969-431e-9afa-5de05099dac8 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eaa18a896f54c91ae4a8429d69ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b627da1cba0a4b298f7bcde84ade0c10', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:49.100191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357406fa-b969-431e-9afa-5de05099dac8 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:49.100962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357406fa-b969-431e-9afa-5de05099dac8 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:49.100962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357406fa-b969-431e-9afa-5de05099dac8 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] PATH_INFO: `/v3/regions/tempest-region-1823948508` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:49.101565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357406fa-b969-431e-9afa-5de05099dac8 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1823948508)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:49.103261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357406fa-b969-431e-9afa-5de05099dac8 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:49.135561 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2252/4504] 10.222.0.17 () {58 vars in 1209 bytes} [Sat Jul 30 21:16:49 2022] DELETE /identity/v3/regions/tempest-region-1823948508 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:49.141075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996abb2a-700c-4339-8439-382caa937db1 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:49.156735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996abb2a-700c-4339-8439-382caa937db1 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:49.176572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e2860-22cb-4510-9f61-676331a40b62 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eaa18a896f54c91ae4a8429d69ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b627da1cba0a4b298f7bcde84ade0c10', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:49.177344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e2860-22cb-4510-9f61-676331a40b62 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:49.178286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e2860-22cb-4510-9f61-676331a40b62 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:49.178647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e2860-22cb-4510-9f61-676331a40b62 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] PATH_INFO: `/v3/services/20a01feb3c014a2e8a51341123f718fe` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:49.179534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e2860-22cb-4510-9f61-676331a40b62 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorizing `identity:delete_service(service_id=20a01feb3c014a2e8a51341123f718fe)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:49.181438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e2860-22cb-4510-9f61-676331a40b62 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:49.221878 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2253/4505] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:49 2022] DELETE /identity/v3/services/20a01feb3c014a2e8a51341123f718fe => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:49.222606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357406fa-b969-431e-9afa-5de05099dac8 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:49.330958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357406fa-b969-431e-9afa-5de05099dac8 tempest-EndpointsNegativeTestJSON-1912083849 tempest-EndpointsNegativeTestJSON-1912083849-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:49.339826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:49.352396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda8716-5469-46ae-8412-0b996f0e4ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:49.353903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda8716-5469-46ae-8412-0b996f0e4ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:49.354432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda8716-5469-46ae-8412-0b996f0e4ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:49.355434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda8716-5469-46ae-8412-0b996f0e4ba8 admin admin] PATH_INFO: `/v3/users/3ae534da2138476ab38b0e16d0810fa8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:49.366277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda8716-5469-46ae-8412-0b996f0e4ba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ae534da2138476ab38b0e16d0810fa8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:49.376854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda8716-5469-46ae-8412-0b996f0e4ba8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:49.491597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1dda8716-5469-46ae-8412-0b996f0e4ba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ae534da2138476ab38b0e16d0810fa8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:49.492900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1dda8716-5469-46ae-8412-0b996f0e4ba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ae534da2138476ab38b0e16d0810fa8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:49.511569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1dda8716-5469-46ae-8412-0b996f0e4ba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ae534da2138476ab38b0e16d0810fa8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:49.512681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1dda8716-5469-46ae-8412-0b996f0e4ba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ae534da2138476ab38b0e16d0810fa8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:49.529201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1dda8716-5469-46ae-8412-0b996f0e4ba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ae534da2138476ab38b0e16d0810fa8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:49.544855 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2253/4506] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:16:49 2022] DELETE /identity/v3/users/3ae534da2138476ab38b0e16d0810fa8 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:16:49.549112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01304fe-79ea-45f2-8dac-17a1fac15f9a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:49.549614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01304fe-79ea-45f2-8dac-17a1fac15f9a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:49.550083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01304fe-79ea-45f2-8dac-17a1fac15f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:49.583060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b01304fe-79ea-45f2-8dac-17a1fac15f9a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:49.584304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b01304fe-79ea-45f2-8dac-17a1fac15f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:49.659806 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2254/4507] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:16:49.702165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda8716-5469-46ae-8412-0b996f0e4ba8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:49.705512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1dda8716-5469-46ae-8412-0b996f0e4ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:49.833331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda8716-5469-46ae-8412-0b996f0e4ba8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:49.837933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf0f2c-39a9-40c8-b10f-c74188efa821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:49.838732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0f2c-39a9-40c8-b10f-c74188efa821 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:49.839019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0f2c-39a9-40c8-b10f-c74188efa821 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:49.839489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0f2c-39a9-40c8-b10f-c74188efa821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:49.850573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf0f2c-39a9-40c8-b10f-c74188efa821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:49.852323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf0f2c-39a9-40c8-b10f-c74188efa821 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:49.864928 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2254/4508] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:16:50.202927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b58d18-174e-4892-b440-4a51ca1bd1dc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:50.204272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b58d18-174e-4892-b440-4a51ca1bd1dc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:50.204740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b58d18-174e-4892-b440-4a51ca1bd1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:50.227355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c1b58d18-174e-4892-b440-4a51ca1bd1dc None None] MFA Rules not processed for user `23ba5ddf22424eff840602440872f86e`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:50.229562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c1b58d18-174e-4892-b440-4a51ca1bd1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:50.278147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:50.333176 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2255/4509] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:51.671813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f2608-52a7-4def-948a-c2ea6d913d4b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:51.672866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f2608-52a7-4def-948a-c2ea6d913d4b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:51.673749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f2608-52a7-4def-948a-c2ea6d913d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:51.698442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0d3f2608-52a7-4def-948a-c2ea6d913d4b None None] MFA Rules not processed for user `23ba5ddf22424eff840602440872f86e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:51.700394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0d3f2608-52a7-4def-948a-c2ea6d913d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:51.711972 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2255/4510] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:51.899174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b58d18-174e-4892-b440-4a51ca1bd1dc None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:51.901401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c1b58d18-174e-4892-b440-4a51ca1bd1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:51.926916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b58d18-174e-4892-b440-4a51ca1bd1dc None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:51.945760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727e14f-b636-4cec-92ee-8bf8ce77cffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:51.946458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727e14f-b636-4cec-92ee-8bf8ce77cffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:51.946739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727e14f-b636-4cec-92ee-8bf8ce77cffb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:51.947009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727e14f-b636-4cec-92ee-8bf8ce77cffb admin admin] PATH_INFO: `/v3/projects/aa15d3bef2394faa8ede7001e6dc9a76` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:51.948285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727e14f-b636-4cec-92ee-8bf8ce77cffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa15d3bef2394faa8ede7001e6dc9a76)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:51.950295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727e14f-b636-4cec-92ee-8bf8ce77cffb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:52.090776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0727e14f-b636-4cec-92ee-8bf8ce77cffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa15d3bef2394faa8ede7001e6dc9a76', 'request_id': 'req-0727e14f-b636-4cec-92ee-8bf8ce77cffb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:52.098477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0727e14f-b636-4cec-92ee-8bf8ce77cffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa15d3bef2394faa8ede7001e6dc9a76', 'request_id': 'req-0727e14f-b636-4cec-92ee-8bf8ce77cffb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:52.115003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0727e14f-b636-4cec-92ee-8bf8ce77cffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa15d3bef2394faa8ede7001e6dc9a76', 'request_id': 'req-0727e14f-b636-4cec-92ee-8bf8ce77cffb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:52.136123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0727e14f-b636-4cec-92ee-8bf8ce77cffb admin admin] The token cache is being invalidate because project aa15d3bef2394faa8ede7001e6dc9a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:16:52.136725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0727e14f-b636-4cec-92ee-8bf8ce77cffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:52.137869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0727e14f-b636-4cec-92ee-8bf8ce77cffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:52.143074 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2256/4511] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:51 2022] DELETE /identity/v3/projects/aa15d3bef2394faa8ede7001e6dc9a76 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:52.147219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f2608-52a7-4def-948a-c2ea6d913d4b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:52.164816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f2608-52a7-4def-948a-c2ea6d913d4b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:52.282504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e3270-3adc-4fb3-83c7-0de29f06a5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:52.283617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e3270-3adc-4fb3-83c7-0de29f06a5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:52.284411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e3270-3adc-4fb3-83c7-0de29f06a5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:52.284868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e3270-3adc-4fb3-83c7-0de29f06a5a0 admin admin] PATH_INFO: `/v3/users/3eaa18a896f54c91ae4a8429d69ccb3c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:52.286748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e3270-3adc-4fb3-83c7-0de29f06a5a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eaa18a896f54c91ae4a8429d69ccb3c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:52.289693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e3270-3adc-4fb3-83c7-0de29f06a5a0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:52.292395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:52.390038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-130e3270-3adc-4fb3-83c7-0de29f06a5a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eaa18a896f54c91ae4a8429d69ccb3c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:52.392790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-130e3270-3adc-4fb3-83c7-0de29f06a5a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eaa18a896f54c91ae4a8429d69ccb3c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:52.416312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-130e3270-3adc-4fb3-83c7-0de29f06a5a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eaa18a896f54c91ae4a8429d69ccb3c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:52.417120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-130e3270-3adc-4fb3-83c7-0de29f06a5a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eaa18a896f54c91ae4a8429d69ccb3c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:52.433692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-130e3270-3adc-4fb3-83c7-0de29f06a5a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eaa18a896f54c91ae4a8429d69ccb3c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:52.468204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b5557-21c8-4082-a1f8-8e6ff07fc43e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:52.468829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b5557-21c8-4082-a1f8-8e6ff07fc43e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:52.469339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b5557-21c8-4082-a1f8-8e6ff07fc43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:52.473532 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2256/4512] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:16:52 2022] DELETE /identity/v3/users/3eaa18a896f54c91ae4a8429d69ccb3c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:52.494711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-fc7b5557-21c8-4082-a1f8-8e6ff07fc43e None None] MFA Rules not processed for user `23ba5ddf22424eff840602440872f86e`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:52.495995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fc7b5557-21c8-4082-a1f8-8e6ff07fc43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:52.582636 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2257/4513] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:53.991280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e3270-3adc-4fb3-83c7-0de29f06a5a0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:53.994937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-130e3270-3adc-4fb3-83c7-0de29f06a5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:54.093999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4b17f-6388-46c0-8624-4cb8b638a61a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:54.094874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4b17f-6388-46c0-8624-4cb8b638a61a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:54.095368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4b17f-6388-46c0-8624-4cb8b638a61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:54.123162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a6a4b17f-6388-46c0-8624-4cb8b638a61a None None] MFA Rules not processed for user `23ba5ddf22424eff840602440872f86e`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:54.124666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a6a4b17f-6388-46c0-8624-4cb8b638a61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:54.148005 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2258/4514] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:16:54.185938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e3270-3adc-4fb3-83c7-0de29f06a5a0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:54.232669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd349829-3488-447d-9530-ac1df18f7aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:54.234775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd349829-3488-447d-9530-ac1df18f7aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:54.236546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd349829-3488-447d-9530-ac1df18f7aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:54.238141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd349829-3488-447d-9530-ac1df18f7aa1 admin admin] PATH_INFO: `/v3/projects/b627da1cba0a4b298f7bcde84ade0c10` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:54.242689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd349829-3488-447d-9530-ac1df18f7aa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b627da1cba0a4b298f7bcde84ade0c10)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:54.246171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd349829-3488-447d-9530-ac1df18f7aa1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:54.351083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bd349829-3488-447d-9530-ac1df18f7aa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b627da1cba0a4b298f7bcde84ade0c10', 'request_id': 'req-bd349829-3488-447d-9530-ac1df18f7aa1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:54.368005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bd349829-3488-447d-9530-ac1df18f7aa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b627da1cba0a4b298f7bcde84ade0c10', 'request_id': 'req-bd349829-3488-447d-9530-ac1df18f7aa1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:54.378975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bd349829-3488-447d-9530-ac1df18f7aa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b627da1cba0a4b298f7bcde84ade0c10', 'request_id': 'req-bd349829-3488-447d-9530-ac1df18f7aa1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:54.402408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bd349829-3488-447d-9530-ac1df18f7aa1 admin admin] The token cache is being invalidate because project b627da1cba0a4b298f7bcde84ade0c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:16:54.402718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bd349829-3488-447d-9530-ac1df18f7aa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:54.403755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bd349829-3488-447d-9530-ac1df18f7aa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:54.408493 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2257/4515] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:53 2022] DELETE /identity/v3/projects/b627da1cba0a4b298f7bcde84ade0c10 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:54.414155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bc9c4-8033-4c05-b0f3-b9443873c7d5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:54.415178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bc9c4-8033-4c05-b0f3-b9443873c7d5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:54.415731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bc9c4-8033-4c05-b0f3-b9443873c7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:54.443776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d26bc9c4-8033-4c05-b0f3-b9443873c7d5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:54.451874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d26bc9c4-8033-4c05-b0f3-b9443873c7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:54.560354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:54.622566 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2259/4516] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:54.631096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0a80d-f54b-490a-8448-16b86353e269 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:54.631737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0a80d-f54b-490a-8448-16b86353e269 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:54.632321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0a80d-f54b-490a-8448-16b86353e269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:54.674136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-10f0a80d-f54b-490a-8448-16b86353e269 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:54.677008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-10f0a80d-f54b-490a-8448-16b86353e269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:54.699382 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2258/4517] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:54.704346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26bc9c4-8033-4c05-b0f3-b9443873c7d5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:54.718978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26bc9c4-8033-4c05-b0f3-b9443873c7d5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:54.725174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cd4e7-24b0-41c7-90f9-f3715ee14017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:54.726154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cd4e7-24b0-41c7-90f9-f3715ee14017 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:54.726740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cd4e7-24b0-41c7-90f9-f3715ee14017 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:54.726990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cd4e7-24b0-41c7-90f9-f3715ee14017 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:54.727987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cd4e7-24b0-41c7-90f9-f3715ee14017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:16:54.729060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cd4e7-24b0-41c7-90f9-f3715ee14017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:54.731713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cd4e7-24b0-41c7-90f9-f3715ee14017 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:54.760172 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2260/4518] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:16:54.762800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0a80d-f54b-490a-8448-16b86353e269 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:54.767753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:54.776865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0a80d-f54b-490a-8448-16b86353e269 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:54.797840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc187b5-9dcd-4302-acf4-d902bd85cc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:54.797840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc187b5-9dcd-4302-acf4-d902bd85cc22 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:54.797840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc187b5-9dcd-4302-acf4-d902bd85cc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:54.797840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc187b5-9dcd-4302-acf4-d902bd85cc22 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:54.798333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc187b5-9dcd-4302-acf4-d902bd85cc22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:54.800369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc187b5-9dcd-4302-acf4-d902bd85cc22 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:54.854326 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2259/4519] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:54 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:54.858521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cd4e7-24b0-41c7-90f9-f3715ee14017 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:54.872847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cd4e7-24b0-41c7-90f9-f3715ee14017 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:54.959616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf0fea-a34a-42b2-9583-3ec86da72a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:54.960372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf0fea-a34a-42b2-9583-3ec86da72a77 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:54.960663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf0fea-a34a-42b2-9583-3ec86da72a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:54.960944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf0fea-a34a-42b2-9583-3ec86da72a77 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:54.961633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf0fea-a34a-42b2-9583-3ec86da72a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:54.964491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf0fea-a34a-42b2-9583-3ec86da72a77 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:55.001912 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2261/4520] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:16:54 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:55.003837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc187b5-9dcd-4302-acf4-d902bd85cc22 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:55.026922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc187b5-9dcd-4302-acf4-d902bd85cc22 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:55.033740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eda646-291b-4207-804a-8a3bc88940a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:55.034530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eda646-291b-4207-804a-8a3bc88940a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:55.034965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eda646-291b-4207-804a-8a3bc88940a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:55.035488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eda646-291b-4207-804a-8a3bc88940a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:55.036259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eda646-291b-4207-804a-8a3bc88940a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:55.038088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eda646-291b-4207-804a-8a3bc88940a9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:55.058040 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2260/4521] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:55.059375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf0fea-a34a-42b2-9583-3ec86da72a77 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:55.093351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf0fea-a34a-42b2-9583-3ec86da72a77 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:55.101406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b20cc9-b5c5-4717-a60c-1a0d0c362c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:55.104792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b20cc9-b5c5-4717-a60c-1a0d0c362c43 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:55.105268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b20cc9-b5c5-4717-a60c-1a0d0c362c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:55.105740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b20cc9-b5c5-4717-a60c-1a0d0c362c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:55.107556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b20cc9-b5c5-4717-a60c-1a0d0c362c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:55.110222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b20cc9-b5c5-4717-a60c-1a0d0c362c43 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:55.139132 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2262/4522] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:55.143956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eda646-291b-4207-804a-8a3bc88940a9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:55.181850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eda646-291b-4207-804a-8a3bc88940a9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:55.196860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed6126-c6cf-4d4a-bcc0-aa28eb98c68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:55.198824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed6126-c6cf-4d4a-bcc0-aa28eb98c68a admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:55.199210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed6126-c6cf-4d4a-bcc0-aa28eb98c68a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:55.199593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed6126-c6cf-4d4a-bcc0-aa28eb98c68a admin admin] PATH_INFO: `/v3/projects/2da85f5f5ed240258f0f6f7d45d19ba7/users/c6f1a482d0a34160bfbd0a66387079b0/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:55.241874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed6126-c6cf-4d4a-bcc0-aa28eb98c68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da85f5f5ed240258f0f6f7d45d19ba7, user_id=c6f1a482d0a34160bfbd0a66387079b0, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:55.244771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed6126-c6cf-4d4a-bcc0-aa28eb98c68a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:55.277848 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2261/4523] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:55 2022] PUT /identity/v3/projects/2da85f5f5ed240258f0f6f7d45d19ba7/users/c6f1a482d0a34160bfbd0a66387079b0/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:55.279659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a05386-fb59-47a4-9cea-fae9f811792b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:55.279958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a05386-fb59-47a4-9cea-fae9f811792b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:55.280889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a05386-fb59-47a4-9cea-fae9f811792b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:55.342272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-09a05386-fb59-47a4-9cea-fae9f811792b None None] MFA Rules not processed for user `c6f1a482d0a34160bfbd0a66387079b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:55.343569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-09a05386-fb59-47a4-9cea-fae9f811792b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:55.432539 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2263/4524] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:16:55.436911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed6126-c6cf-4d4a-bcc0-aa28eb98c68a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:55.527042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcbe0d-cc35-46c9-a59a-1e8d38725130 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:55.527770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcbe0d-cc35-46c9-a59a-1e8d38725130 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:55.528268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcbe0d-cc35-46c9-a59a-1e8d38725130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:55.550023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d2fcbe0d-cc35-46c9-a59a-1e8d38725130 None None] MFA Rules not processed for user `23ba5ddf22424eff840602440872f86e`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:55.551854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d2fcbe0d-cc35-46c9-a59a-1e8d38725130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:55.576115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed6126-c6cf-4d4a-bcc0-aa28eb98c68a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:55.585681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c5104-e521-4fee-8c15-23f74dc6bb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:55.586354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c5104-e521-4fee-8c15-23f74dc6bb89 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:55.586754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c5104-e521-4fee-8c15-23f74dc6bb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:55.587035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c5104-e521-4fee-8c15-23f74dc6bb89 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:55.592675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c5104-e521-4fee-8c15-23f74dc6bb89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:55.594826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c5104-e521-4fee-8c15-23f74dc6bb89 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:55.612264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:55.636403 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2264/4525] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:16:55.665386 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2262/4526] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:55 2022] POST /identity/v3/projects => generated 375 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:55.666558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcbe0d-cc35-46c9-a59a-1e8d38725130 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:55.686603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcbe0d-cc35-46c9-a59a-1e8d38725130 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:55.767561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0664b9d-4754-45c3-9b6a-985f9553338c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:55.767856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0664b9d-4754-45c3-9b6a-985f9553338c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:55.768137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0664b9d-4754-45c3-9b6a-985f9553338c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:55.813941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a0664b9d-4754-45c3-9b6a-985f9553338c None None] MFA Rules not processed for user `9ee43250738b4dcc91b2e09e0c060cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:55.815191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a0664b9d-4754-45c3-9b6a-985f9553338c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:55.822761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a669c99-fd37-4077-b793-45c78f705880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:55.823927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a669c99-fd37-4077-b793-45c78f705880 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:55.823927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a669c99-fd37-4077-b793-45c78f705880 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:55.824191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a669c99-fd37-4077-b793-45c78f705880 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:55.824800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a669c99-fd37-4077-b793-45c78f705880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:55.826730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a669c99-fd37-4077-b793-45c78f705880 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:55.867181 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2265/4527] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:16:55 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:16:55.871931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a669c99-fd37-4077-b793-45c78f705880 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:55.888533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a669c99-fd37-4077-b793-45c78f705880 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:55.895975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c378d-3191-4621-8186-06750c4fbc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:55.896609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c378d-3191-4621-8186-06750c4fbc85 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:55.896889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c378d-3191-4621-8186-06750c4fbc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:55.897163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c378d-3191-4621-8186-06750c4fbc85 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:55.898990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c378d-3191-4621-8186-06750c4fbc85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:55.900299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c378d-3191-4621-8186-06750c4fbc85 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:55.922807 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2266/4528] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:55.927126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c378d-3191-4621-8186-06750c4fbc85 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:55.941364 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2263/4529] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:16:55.941595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c378d-3191-4621-8186-06750c4fbc85 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:55.945898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885b85b-2c81-421d-a3f8-b837af8aa240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:55.946655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885b85b-2c81-421d-a3f8-b837af8aa240 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:55.947002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885b85b-2c81-421d-a3f8-b837af8aa240 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:55.947943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885b85b-2c81-421d-a3f8-b837af8aa240 admin admin] PATH_INFO: `/v3/projects/83cc1138e9aa4df09b78472e7c2afd21/users/88eda0d48a954b0a89f458793f07e98b/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:55.951463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0664b9d-4754-45c3-9b6a-985f9553338c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:55.953412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a0664b9d-4754-45c3-9b6a-985f9553338c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:55.969990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885b85b-2c81-421d-a3f8-b837af8aa240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cc1138e9aa4df09b78472e7c2afd21, user_id=88eda0d48a954b0a89f458793f07e98b, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:55.975940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885b85b-2c81-421d-a3f8-b837af8aa240 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:55.979074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:56.002632 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2267/4530] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:55 2022] PUT /identity/v3/projects/83cc1138e9aa4df09b78472e7c2afd21/users/88eda0d48a954b0a89f458793f07e98b/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:16:56.016450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885b85b-2c81-421d-a3f8-b837af8aa240 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:56.064351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0664b9d-4754-45c3-9b6a-985f9553338c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:56.104425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885b85b-2c81-421d-a3f8-b837af8aa240 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:56.110777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086d5cb-7413-4159-9062-795970fcc596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:56.111904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086d5cb-7413-4159-9062-795970fcc596 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:56.112294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086d5cb-7413-4159-9062-795970fcc596 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:56.112670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086d5cb-7413-4159-9062-795970fcc596 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:56.113479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086d5cb-7413-4159-9062-795970fcc596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:56.115228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086d5cb-7413-4159-9062-795970fcc596 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:56.131659 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2268/4531] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:56.132947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086d5cb-7413-4159-9062-795970fcc596 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:56.144995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f786ab-cc69-489e-a679-5c6434efc3a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:56.145521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086d5cb-7413-4159-9062-795970fcc596 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:56.146628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f786ab-cc69-489e-a679-5c6434efc3a1 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:56.147232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f786ab-cc69-489e-a679-5c6434efc3a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:56.147870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f786ab-cc69-489e-a679-5c6434efc3a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:56.151132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-97f786ab-cc69-489e-a679-5c6434efc3a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:56.152453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d75768-59bc-4c52-a302-b66b3859109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:56.153268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d75768-59bc-4c52-a302-b66b3859109b admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:56.153654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d75768-59bc-4c52-a302-b66b3859109b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:56.154032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d75768-59bc-4c52-a302-b66b3859109b admin admin] PATH_INFO: `/v3/projects/83cc1138e9aa4df09b78472e7c2afd21/users/88eda0d48a954b0a89f458793f07e98b/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:56.157121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d75768-59bc-4c52-a302-b66b3859109b admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cc1138e9aa4df09b78472e7c2afd21, user_id=88eda0d48a954b0a89f458793f07e98b, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:56.160021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d75768-59bc-4c52-a302-b66b3859109b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:56.176803 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2269/4532] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:16:56 2022] PUT /identity/v3/projects/83cc1138e9aa4df09b78472e7c2afd21/users/88eda0d48a954b0a89f458793f07e98b/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:56.188771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472400f8-ddee-4759-af1a-fbdd1b4ee289 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:56.189079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472400f8-ddee-4759-af1a-fbdd1b4ee289 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:56.189366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472400f8-ddee-4759-af1a-fbdd1b4ee289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:56.225322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-472400f8-ddee-4759-af1a-fbdd1b4ee289 None None] MFA Rules not processed for user `88eda0d48a954b0a89f458793f07e98b`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:56.227144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-472400f8-ddee-4759-af1a-fbdd1b4ee289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:56.256375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:56.263894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f786ab-cc69-489e-a679-5c6434efc3a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:56.268182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f786ab-cc69-489e-a679-5c6434efc3a1 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:56.297713 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2264/4533] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:16:56.335759 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2270/4534] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:56.340292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f786ab-cc69-489e-a679-5c6434efc3a1 service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:56.477266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f786ab-cc69-489e-a679-5c6434efc3a1 service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:56.482809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c215f30-2e72-4e9d-b298-cf88fe93878b tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88eda0d48a954b0a89f458793f07e98b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83cc1138e9aa4df09b78472e7c2afd21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:56.483601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c215f30-2e72-4e9d-b298-cf88fe93878b tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:56.483895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c215f30-2e72-4e9d-b298-cf88fe93878b tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:56.484176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c215f30-2e72-4e9d-b298-cf88fe93878b tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:56.484902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c215f30-2e72-4e9d-b298-cf88fe93878b tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:56.486908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c215f30-2e72-4e9d-b298-cf88fe93878b tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:56.504989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:56.527505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472400f8-ddee-4759-af1a-fbdd1b4ee289 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:56.540397 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2265/4535] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:56 2022] POST /identity/v3/projects => generated 333 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:56.542296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472400f8-ddee-4759-af1a-fbdd1b4ee289 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:56.699272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133c1cd-48b3-47c5-b591-257f70c3a54d tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88eda0d48a954b0a89f458793f07e98b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83cc1138e9aa4df09b78472e7c2afd21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:56.700091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133c1cd-48b3-47c5-b591-257f70c3a54d tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:56.700378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133c1cd-48b3-47c5-b591-257f70c3a54d tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:56.700675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133c1cd-48b3-47c5-b591-257f70c3a54d tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:56.701744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133c1cd-48b3-47c5-b591-257f70c3a54d tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:56.704357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133c1cd-48b3-47c5-b591-257f70c3a54d tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:56.795484 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2271/4536] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 30 21:16:56 2022] POST /identity/v3/projects => generated 331 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:56.799334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c215f30-2e72-4e9d-b298-cf88fe93878b tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:56.813050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c215f30-2e72-4e9d-b298-cf88fe93878b tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:56.960450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab40f7-ac47-45b0-9ce4-d1edcb57cfef tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88eda0d48a954b0a89f458793f07e98b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83cc1138e9aa4df09b78472e7c2afd21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:56.961852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab40f7-ac47-45b0-9ce4-d1edcb57cfef tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:56.963886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab40f7-ac47-45b0-9ce4-d1edcb57cfef tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:56.964522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab40f7-ac47-45b0-9ce4-d1edcb57cfef tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:56.965509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab40f7-ac47-45b0-9ce4-d1edcb57cfef tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:56.968032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab40f7-ac47-45b0-9ce4-d1edcb57cfef tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:57.111522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133c1cd-48b3-47c5-b591-257f70c3a54d tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:57.113008 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2266/4537] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:16:56 2022] POST /identity/v3/projects => generated 358 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:16:57.130305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133c1cd-48b3-47c5-b591-257f70c3a54d tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:57.252120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded4a50-8197-4f99-9b42-375d12bdaf9b tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88eda0d48a954b0a89f458793f07e98b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83cc1138e9aa4df09b78472e7c2afd21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:57.253591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded4a50-8197-4f99-9b42-375d12bdaf9b tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:57.254137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded4a50-8197-4f99-9b42-375d12bdaf9b tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:57.254794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded4a50-8197-4f99-9b42-375d12bdaf9b tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:57.255922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded4a50-8197-4f99-9b42-375d12bdaf9b tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:57.259986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded4a50-8197-4f99-9b42-375d12bdaf9b tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:57.298754 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2272/4538] 10.222.0.17 () {58 vars in 1131 bytes} [Sat Jul 30 21:16:57 2022] GET /identity/v3/projects => generated 7572 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:16:57.303601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab40f7-ac47-45b0-9ce4-d1edcb57cfef tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:57.315311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab40f7-ac47-45b0-9ce4-d1edcb57cfef tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:57.322991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06f78d-1a16-48f8-9b84-d53545cce107 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88eda0d48a954b0a89f458793f07e98b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83cc1138e9aa4df09b78472e7c2afd21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:57.323707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06f78d-1a16-48f8-9b84-d53545cce107 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:57.323992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06f78d-1a16-48f8-9b84-d53545cce107 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:57.324267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06f78d-1a16-48f8-9b84-d53545cce107 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:57.325182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06f78d-1a16-48f8-9b84-d53545cce107 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:16:57.325498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06f78d-1a16-48f8-9b84-d53545cce107 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:57.326834 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-1d06f78d-1a16-48f8-9b84-d53545cce107 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:16:57.326834 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:16:57.326834 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:16:57.328037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06f78d-1a16-48f8-9b84-d53545cce107 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:57.370279 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2267/4539] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Jul 30 21:16:57 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:16:57.370971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded4a50-8197-4f99-9b42-375d12bdaf9b tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:57.398378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded4a50-8197-4f99-9b42-375d12bdaf9b tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:57.412572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d67e88-3016-4326-ac1a-8afd8ee91408 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88eda0d48a954b0a89f458793f07e98b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83cc1138e9aa4df09b78472e7c2afd21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:57.414344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d67e88-3016-4326-ac1a-8afd8ee91408 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:57.416179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d67e88-3016-4326-ac1a-8afd8ee91408 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:57.417322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d67e88-3016-4326-ac1a-8afd8ee91408 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:57.418813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d67e88-3016-4326-ac1a-8afd8ee91408 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: Adding query filter params (parent_id=e64d924bc55944ea875c6be8199879a9) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:16:57.419387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d67e88-3016-4326-ac1a-8afd8ee91408 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:57.424680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d67e88-3016-4326-ac1a-8afd8ee91408 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:57.483570 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2273/4540] 10.222.0.17 () {58 vars in 1216 bytes} [Sat Jul 30 21:16:57 2022] GET /identity/v3/projects?parent_id=e64d924bc55944ea875c6be8199879a9 => generated 498 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:16:57.488194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06f78d-1a16-48f8-9b84-d53545cce107 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:57.501999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06f78d-1a16-48f8-9b84-d53545cce107 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:57.509036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bf98d-5237-4f13-a70a-e5b4d5650f57 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88eda0d48a954b0a89f458793f07e98b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83cc1138e9aa4df09b78472e7c2afd21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:57.510425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bf98d-5237-4f13-a70a-e5b4d5650f57 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:57.511126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bf98d-5237-4f13-a70a-e5b4d5650f57 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:57.511441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bf98d-5237-4f13-a70a-e5b4d5650f57 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] PATH_INFO: `/v3/projects/e8126d1113c44255aa1de71566befa24` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:57.513066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bf98d-5237-4f13-a70a-e5b4d5650f57 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e8126d1113c44255aa1de71566befa24)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:57.515234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bf98d-5237-4f13-a70a-e5b4d5650f57 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:57.624922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-947bf98d-5237-4f13-a70a-e5b4d5650f57 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8126d1113c44255aa1de71566befa24', 'request_id': 'req-947bf98d-5237-4f13-a70a-e5b4d5650f57'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:57.647468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-947bf98d-5237-4f13-a70a-e5b4d5650f57 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8126d1113c44255aa1de71566befa24', 'request_id': 'req-947bf98d-5237-4f13-a70a-e5b4d5650f57'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:57.657375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-947bf98d-5237-4f13-a70a-e5b4d5650f57 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8126d1113c44255aa1de71566befa24', 'request_id': 'req-947bf98d-5237-4f13-a70a-e5b4d5650f57'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:57.677722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-947bf98d-5237-4f13-a70a-e5b4d5650f57 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] The token cache is being invalidate because project e8126d1113c44255aa1de71566befa24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:16:57.679225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-947bf98d-5237-4f13-a70a-e5b4d5650f57 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:57.683865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-947bf98d-5237-4f13-a70a-e5b4d5650f57 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:57.686559 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2268/4541] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:57 2022] DELETE /identity/v3/projects/e8126d1113c44255aa1de71566befa24 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:57.691437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d67e88-3016-4326-ac1a-8afd8ee91408 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:57.694895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-37d67e88-3016-4326-ac1a-8afd8ee91408 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:57.729867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d67e88-3016-4326-ac1a-8afd8ee91408 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:57.782735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:57.890152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac32d4a-0bdf-468c-af1e-108aa46399ea tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88eda0d48a954b0a89f458793f07e98b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83cc1138e9aa4df09b78472e7c2afd21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:57.890873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac32d4a-0bdf-468c-af1e-108aa46399ea tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:57.891169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac32d4a-0bdf-468c-af1e-108aa46399ea tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:57.891492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac32d4a-0bdf-468c-af1e-108aa46399ea tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] PATH_INFO: `/v3/projects/e64d924bc55944ea875c6be8199879a9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:57.893418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac32d4a-0bdf-468c-af1e-108aa46399ea tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e64d924bc55944ea875c6be8199879a9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:57.896452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac32d4a-0bdf-468c-af1e-108aa46399ea tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:57.982728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6ac32d4a-0bdf-468c-af1e-108aa46399ea tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e64d924bc55944ea875c6be8199879a9', 'request_id': 'req-6ac32d4a-0bdf-468c-af1e-108aa46399ea'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:57.992866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6ac32d4a-0bdf-468c-af1e-108aa46399ea tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e64d924bc55944ea875c6be8199879a9', 'request_id': 'req-6ac32d4a-0bdf-468c-af1e-108aa46399ea'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:58.008854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6ac32d4a-0bdf-468c-af1e-108aa46399ea tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e64d924bc55944ea875c6be8199879a9', 'request_id': 'req-6ac32d4a-0bdf-468c-af1e-108aa46399ea'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:58.050278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6ac32d4a-0bdf-468c-af1e-108aa46399ea tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] The token cache is being invalidate because project e64d924bc55944ea875c6be8199879a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:16:58.051024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6ac32d4a-0bdf-468c-af1e-108aa46399ea tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:58.053908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6ac32d4a-0bdf-468c-af1e-108aa46399ea tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:58.060801 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2274/4542] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:57 2022] DELETE /identity/v3/projects/e64d924bc55944ea875c6be8199879a9 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:58.066417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bf98d-5237-4f13-a70a-e5b4d5650f57 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:58.083316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bf98d-5237-4f13-a70a-e5b4d5650f57 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:58.183871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e8596-daa7-47aa-8fa2-6ba7e8bd2cde None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:58.184377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e8596-daa7-47aa-8fa2-6ba7e8bd2cde None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:58.184567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e8596-daa7-47aa-8fa2-6ba7e8bd2cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:58.258989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:58.260361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4b1e8596-daa7-47aa-8fa2-6ba7e8bd2cde None None] MFA Rules not processed for user `23ba5ddf22424eff840602440872f86e`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:58.266146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4b1e8596-daa7-47aa-8fa2-6ba7e8bd2cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:58.300661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2e441-4e0b-4f53-a30b-ac53b04c0844 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88eda0d48a954b0a89f458793f07e98b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83cc1138e9aa4df09b78472e7c2afd21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:58.301599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2e441-4e0b-4f53-a30b-ac53b04c0844 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:58.301895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2e441-4e0b-4f53-a30b-ac53b04c0844 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:58.302330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2e441-4e0b-4f53-a30b-ac53b04c0844 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] PATH_INFO: `/v3/projects/65e8154cb0594321bd534ef7d29ea67e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:58.303915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2e441-4e0b-4f53-a30b-ac53b04c0844 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: Authorizing `identity:delete_project(project_id=65e8154cb0594321bd534ef7d29ea67e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:58.307316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2e441-4e0b-4f53-a30b-ac53b04c0844 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:58.439104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dfb2e441-4e0b-4f53-a30b-ac53b04c0844 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e8154cb0594321bd534ef7d29ea67e', 'request_id': 'req-dfb2e441-4e0b-4f53-a30b-ac53b04c0844'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:58.450639 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2275/4543] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:58.458455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dfb2e441-4e0b-4f53-a30b-ac53b04c0844 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e8154cb0594321bd534ef7d29ea67e', 'request_id': 'req-dfb2e441-4e0b-4f53-a30b-ac53b04c0844'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:58.472583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dfb2e441-4e0b-4f53-a30b-ac53b04c0844 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e8154cb0594321bd534ef7d29ea67e', 'request_id': 'req-dfb2e441-4e0b-4f53-a30b-ac53b04c0844'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:58.495746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dfb2e441-4e0b-4f53-a30b-ac53b04c0844 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] The token cache is being invalidate because project 65e8154cb0594321bd534ef7d29ea67e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:16:58.496134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dfb2e441-4e0b-4f53-a30b-ac53b04c0844 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:58.497790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dfb2e441-4e0b-4f53-a30b-ac53b04c0844 tempest-ListProjectsTestJSON-936262825 tempest-ListProjectsTestJSON-936262825-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:58.498991 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2269/4544] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:16:58 2022] DELETE /identity/v3/projects/65e8154cb0594321bd534ef7d29ea67e => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:58.503323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e8596-daa7-47aa-8fa2-6ba7e8bd2cde None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:58.508442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4b1e8596-daa7-47aa-8fa2-6ba7e8bd2cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:58.609068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e8596-daa7-47aa-8fa2-6ba7e8bd2cde None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:58.631458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:58.793189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9629d-267d-456a-81fa-cc594eb70f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:58.794074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9629d-267d-456a-81fa-cc594eb70f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:58.794398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9629d-267d-456a-81fa-cc594eb70f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:58.794751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9629d-267d-456a-81fa-cc594eb70f89 admin admin] PATH_INFO: `/v3/users/c6f1a482d0a34160bfbd0a66387079b0` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:58.796653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9629d-267d-456a-81fa-cc594eb70f89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6f1a482d0a34160bfbd0a66387079b0)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:58.798913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9629d-267d-456a-81fa-cc594eb70f89 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:58.890431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-70b9629d-267d-456a-81fa-cc594eb70f89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6f1a482d0a34160bfbd0a66387079b0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:58.929085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-70b9629d-267d-456a-81fa-cc594eb70f89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6f1a482d0a34160bfbd0a66387079b0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:58.930661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-70b9629d-267d-456a-81fa-cc594eb70f89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6f1a482d0a34160bfbd0a66387079b0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:58.947904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-70b9629d-267d-456a-81fa-cc594eb70f89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6f1a482d0a34160bfbd0a66387079b0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:58.949497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-70b9629d-267d-456a-81fa-cc594eb70f89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6f1a482d0a34160bfbd0a66387079b0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:16:58.984645 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2276/4545] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:16:58 2022] DELETE /identity/v3/users/c6f1a482d0a34160bfbd0a66387079b0 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:16:58.987654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b808b-eca2-476c-880e-e161a31394d5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:58.988231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b808b-eca2-476c-880e-e161a31394d5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:58.988666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b808b-eca2-476c-880e-e161a31394d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:59.073698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-651b808b-eca2-476c-880e-e161a31394d5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:16:59.075675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-651b808b-eca2-476c-880e-e161a31394d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:59.298844 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2270/4546] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:16:59.377619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9629d-267d-456a-81fa-cc594eb70f89 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:16:59.381437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-70b9629d-267d-456a-81fa-cc594eb70f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:16:59.472575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9629d-267d-456a-81fa-cc594eb70f89 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:16:59.481034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b37fb5-a68a-46b3-8521-eea13d104fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:16:59.481897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b37fb5-a68a-46b3-8521-eea13d104fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:16:59.482398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b37fb5-a68a-46b3-8521-eea13d104fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:16:59.482850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b37fb5-a68a-46b3-8521-eea13d104fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:16:59.500429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b37fb5-a68a-46b3-8521-eea13d104fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:16:59.502764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b37fb5-a68a-46b3-8521-eea13d104fa7 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:16:59.521683 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2277/4547] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:17:00.409040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b808b-eca2-476c-880e-e161a31394d5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:00.410573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-651b808b-eca2-476c-880e-e161a31394d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:00.434395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b808b-eca2-476c-880e-e161a31394d5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:00.457969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f4536-d488-4bed-8fd1-e43bb3b9c2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:00.459979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f4536-d488-4bed-8fd1-e43bb3b9c2b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:00.460339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f4536-d488-4bed-8fd1-e43bb3b9c2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:00.460925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f4536-d488-4bed-8fd1-e43bb3b9c2b8 admin admin] PATH_INFO: `/v3/projects/2da85f5f5ed240258f0f6f7d45d19ba7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:00.464324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f4536-d488-4bed-8fd1-e43bb3b9c2b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da85f5f5ed240258f0f6f7d45d19ba7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:00.466907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f4536-d488-4bed-8fd1-e43bb3b9c2b8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:00.588515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c91f4536-d488-4bed-8fd1-e43bb3b9c2b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da85f5f5ed240258f0f6f7d45d19ba7', 'request_id': 'req-c91f4536-d488-4bed-8fd1-e43bb3b9c2b8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:00.632998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c91f4536-d488-4bed-8fd1-e43bb3b9c2b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da85f5f5ed240258f0f6f7d45d19ba7', 'request_id': 'req-c91f4536-d488-4bed-8fd1-e43bb3b9c2b8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:00.646243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c91f4536-d488-4bed-8fd1-e43bb3b9c2b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da85f5f5ed240258f0f6f7d45d19ba7', 'request_id': 'req-c91f4536-d488-4bed-8fd1-e43bb3b9c2b8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:00.649808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:00.701410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c91f4536-d488-4bed-8fd1-e43bb3b9c2b8 admin admin] The token cache is being invalidate because project 2da85f5f5ed240258f0f6f7d45d19ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:00.701849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c91f4536-d488-4bed-8fd1-e43bb3b9c2b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:00.704219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c91f4536-d488-4bed-8fd1-e43bb3b9c2b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:00.712805 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2271/4548] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:00 2022] DELETE /identity/v3/projects/2da85f5f5ed240258f0f6f7d45d19ba7 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:00.713504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b37fb5-a68a-46b3-8521-eea13d104fa7 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:00.728423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b37fb5-a68a-46b3-8521-eea13d104fa7 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:00.786386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:00.857765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac789f-00bc-42d3-9a5f-7070a7423f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:00.858914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac789f-00bc-42d3-9a5f-7070a7423f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:00.859555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac789f-00bc-42d3-9a5f-7070a7423f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:00.860020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac789f-00bc-42d3-9a5f-7070a7423f00 admin admin] PATH_INFO: `/v3/users/88eda0d48a954b0a89f458793f07e98b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:00.862167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac789f-00bc-42d3-9a5f-7070a7423f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88eda0d48a954b0a89f458793f07e98b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:00.869780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac789f-00bc-42d3-9a5f-7070a7423f00 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:00.980626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5fac789f-00bc-42d3-9a5f-7070a7423f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88eda0d48a954b0a89f458793f07e98b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:01.023589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5fac789f-00bc-42d3-9a5f-7070a7423f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88eda0d48a954b0a89f458793f07e98b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:01.024739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5fac789f-00bc-42d3-9a5f-7070a7423f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88eda0d48a954b0a89f458793f07e98b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:01.048253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5fac789f-00bc-42d3-9a5f-7070a7423f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88eda0d48a954b0a89f458793f07e98b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:01.051016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5fac789f-00bc-42d3-9a5f-7070a7423f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88eda0d48a954b0a89f458793f07e98b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:01.097999 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2278/4549] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:00 2022] DELETE /identity/v3/users/88eda0d48a954b0a89f458793f07e98b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:17:01.600306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f4536-d488-4bed-8fd1-e43bb3b9c2b8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:01.603988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c91f4536-d488-4bed-8fd1-e43bb3b9c2b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:01.636042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f4536-d488-4bed-8fd1-e43bb3b9c2b8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:01.807322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fc44f-aafc-44f6-bf53-7f5d32fe646e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:01.808683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fc44f-aafc-44f6-bf53-7f5d32fe646e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:01.810681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fc44f-aafc-44f6-bf53-7f5d32fe646e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:01.811260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fc44f-aafc-44f6-bf53-7f5d32fe646e admin admin] PATH_INFO: `/v3/users/fed2e7125f98476c8083cab9b20aa1c3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:01.816495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fc44f-aafc-44f6-bf53-7f5d32fe646e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fed2e7125f98476c8083cab9b20aa1c3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:01.820902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fc44f-aafc-44f6-bf53-7f5d32fe646e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:01.932782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0e6fc44f-aafc-44f6-bf53-7f5d32fe646e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fed2e7125f98476c8083cab9b20aa1c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:01.933891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0e6fc44f-aafc-44f6-bf53-7f5d32fe646e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fed2e7125f98476c8083cab9b20aa1c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:01.957853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0e6fc44f-aafc-44f6-bf53-7f5d32fe646e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fed2e7125f98476c8083cab9b20aa1c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:01.959139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0e6fc44f-aafc-44f6-bf53-7f5d32fe646e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fed2e7125f98476c8083cab9b20aa1c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:01.974049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0e6fc44f-aafc-44f6-bf53-7f5d32fe646e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fed2e7125f98476c8083cab9b20aa1c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:02.044132 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2272/4550] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:01 2022] DELETE /identity/v3/users/fed2e7125f98476c8083cab9b20aa1c3 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:02.397034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac789f-00bc-42d3-9a5f-7070a7423f00 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:02.400293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5fac789f-00bc-42d3-9a5f-7070a7423f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:02.418553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac789f-00bc-42d3-9a5f-7070a7423f00 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:02.492925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53014e15-0dd2-4be5-bbce-aa8951bfed29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:02.494270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53014e15-0dd2-4be5-bbce-aa8951bfed29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:02.494842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53014e15-0dd2-4be5-bbce-aa8951bfed29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:02.495214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53014e15-0dd2-4be5-bbce-aa8951bfed29 admin admin] PATH_INFO: `/v3/projects/83cc1138e9aa4df09b78472e7c2afd21` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:02.496629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53014e15-0dd2-4be5-bbce-aa8951bfed29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83cc1138e9aa4df09b78472e7c2afd21)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:02.498566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53014e15-0dd2-4be5-bbce-aa8951bfed29 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:02.561156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-53014e15-0dd2-4be5-bbce-aa8951bfed29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83cc1138e9aa4df09b78472e7c2afd21', 'request_id': 'req-53014e15-0dd2-4be5-bbce-aa8951bfed29'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:02.562512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:02.570194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-53014e15-0dd2-4be5-bbce-aa8951bfed29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83cc1138e9aa4df09b78472e7c2afd21', 'request_id': 'req-53014e15-0dd2-4be5-bbce-aa8951bfed29'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:02.581865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-53014e15-0dd2-4be5-bbce-aa8951bfed29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83cc1138e9aa4df09b78472e7c2afd21', 'request_id': 'req-53014e15-0dd2-4be5-bbce-aa8951bfed29'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:02.598845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-53014e15-0dd2-4be5-bbce-aa8951bfed29 admin admin] The token cache is being invalidate because project 83cc1138e9aa4df09b78472e7c2afd21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:02.601263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-53014e15-0dd2-4be5-bbce-aa8951bfed29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:02.602551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-53014e15-0dd2-4be5-bbce-aa8951bfed29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:02.610093 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2279/4551] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:02 2022] DELETE /identity/v3/projects/83cc1138e9aa4df09b78472e7c2afd21 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:02.611689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32128257-c978-41fd-949d-13849bc2c9a9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:02.612165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32128257-c978-41fd-949d-13849bc2c9a9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:02.612702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32128257-c978-41fd-949d-13849bc2c9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:02.642382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-32128257-c978-41fd-949d-13849bc2c9a9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:02.644381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-32128257-c978-41fd-949d-13849bc2c9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:02.730435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53014e15-0dd2-4be5-bbce-aa8951bfed29 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:02.732148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-53014e15-0dd2-4be5-bbce-aa8951bfed29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:02.813598 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2273/4552] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:17:02.813598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32128257-c978-41fd-949d-13849bc2c9a9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:02.813598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-32128257-c978-41fd-949d-13849bc2c9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:02.831998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32128257-c978-41fd-949d-13849bc2c9a9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:02.838364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50adc1e-4462-447d-b22b-a68d51969149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:02.838748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50adc1e-4462-447d-b22b-a68d51969149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:02.839036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50adc1e-4462-447d-b22b-a68d51969149 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:02.839490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50adc1e-4462-447d-b22b-a68d51969149 admin admin] PATH_INFO: `/v3/users/2292736a93ca4a548ae1ff004b07c070` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:02.840724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50adc1e-4462-447d-b22b-a68d51969149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2292736a93ca4a548ae1ff004b07c070)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:02.843330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50adc1e-4462-447d-b22b-a68d51969149 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:02.856156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:02.858034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53014e15-0dd2-4be5-bbce-aa8951bfed29 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:02.865346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee5b52-e00f-4b09-bf1d-f1ebaf56a9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:02.866177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee5b52-e00f-4b09-bf1d-f1ebaf56a9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:02.866427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee5b52-e00f-4b09-bf1d-f1ebaf56a9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:02.866641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee5b52-e00f-4b09-bf1d-f1ebaf56a9d5 admin admin] PATH_INFO: `/v3/projects/e153111da8d54ad598f44e7bbc83661d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:02.867924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee5b52-e00f-4b09-bf1d-f1ebaf56a9d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e153111da8d54ad598f44e7bbc83661d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:02.870778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee5b52-e00f-4b09-bf1d-f1ebaf56a9d5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:02.938176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a50adc1e-4462-447d-b22b-a68d51969149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2292736a93ca4a548ae1ff004b07c070'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:02.939651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a50adc1e-4462-447d-b22b-a68d51969149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2292736a93ca4a548ae1ff004b07c070'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:02.952723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6eee5b52-e00f-4b09-bf1d-f1ebaf56a9d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e153111da8d54ad598f44e7bbc83661d', 'request_id': 'req-6eee5b52-e00f-4b09-bf1d-f1ebaf56a9d5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:02.960771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6eee5b52-e00f-4b09-bf1d-f1ebaf56a9d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e153111da8d54ad598f44e7bbc83661d', 'request_id': 'req-6eee5b52-e00f-4b09-bf1d-f1ebaf56a9d5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:02.969332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a50adc1e-4462-447d-b22b-a68d51969149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2292736a93ca4a548ae1ff004b07c070'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:02.970430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a50adc1e-4462-447d-b22b-a68d51969149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2292736a93ca4a548ae1ff004b07c070'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:02.984219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a50adc1e-4462-447d-b22b-a68d51969149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2292736a93ca4a548ae1ff004b07c070'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:02.987379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6eee5b52-e00f-4b09-bf1d-f1ebaf56a9d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e153111da8d54ad598f44e7bbc83661d', 'request_id': 'req-6eee5b52-e00f-4b09-bf1d-f1ebaf56a9d5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:03.013942 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2274/4553] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:02 2022] DELETE /identity/v3/users/2292736a93ca4a548ae1ff004b07c070 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:03.015384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd783d5-8ce8-4b98-9153-8796a38671ed None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:03.015762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd783d5-8ce8-4b98-9153-8796a38671ed None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:03.016036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd783d5-8ce8-4b98-9153-8796a38671ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:03.045336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6eee5b52-e00f-4b09-bf1d-f1ebaf56a9d5 admin admin] The token cache is being invalidate because project e153111da8d54ad598f44e7bbc83661d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:03.045631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6eee5b52-e00f-4b09-bf1d-f1ebaf56a9d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:03.049631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6eee5b52-e00f-4b09-bf1d-f1ebaf56a9d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:03.054565 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2280/4554] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:02 2022] DELETE /identity/v3/projects/e153111da8d54ad598f44e7bbc83661d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:03.056312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddcc15-edad-4e3f-b682-207c9b59d4e4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:03.056589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddcc15-edad-4e3f-b682-207c9b59d4e4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:03.056868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddcc15-edad-4e3f-b682-207c9b59d4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:03.110058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7dd783d5-8ce8-4b98-9153-8796a38671ed None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:03.111564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7dd783d5-8ce8-4b98-9153-8796a38671ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:03.120654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d0ddcc15-edad-4e3f-b682-207c9b59d4e4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:03.123612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d0ddcc15-edad-4e3f-b682-207c9b59d4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:03.233996 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2275/4555] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:03.233996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a634ad-d614-494e-8bd1-833a328498c4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:03.233996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a634ad-d614-494e-8bd1-833a328498c4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:03.233996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a634ad-d614-494e-8bd1-833a328498c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:03.254037 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2281/4556] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:03.254884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddcc15-edad-4e3f-b682-207c9b59d4e4 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:03.265947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-44a634ad-d614-494e-8bd1-833a328498c4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:03.268690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-44a634ad-d614-494e-8bd1-833a328498c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:03.274683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddcc15-edad-4e3f-b682-207c9b59d4e4 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:03.285605 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2276/4557] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:03.287628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a634ad-d614-494e-8bd1-833a328498c4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:03.289087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-44a634ad-d614-494e-8bd1-833a328498c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:03.294540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484bf44-de7d-4a0e-ae16-13b6a2ae2906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:03.295413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484bf44-de7d-4a0e-ae16-13b6a2ae2906 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:03.295819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484bf44-de7d-4a0e-ae16-13b6a2ae2906 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:03.296551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484bf44-de7d-4a0e-ae16-13b6a2ae2906 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:03.297947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484bf44-de7d-4a0e-ae16-13b6a2ae2906 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:17:03.298355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484bf44-de7d-4a0e-ae16-13b6a2ae2906 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:03.300264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484bf44-de7d-4a0e-ae16-13b6a2ae2906 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:03.303814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:03.327185 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2282/4558] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:17:03.330230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67791f63-8398-49b9-ba31-17d23d728f94 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:03.330607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67791f63-8398-49b9-ba31-17d23d728f94 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:03.330983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67791f63-8398-49b9-ba31-17d23d728f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:03.377281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-67791f63-8398-49b9-ba31-17d23d728f94 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:03.378776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-67791f63-8398-49b9-ba31-17d23d728f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:03.391765 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2283/4559] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:03.391765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67791f63-8398-49b9-ba31-17d23d728f94 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:03.401944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67791f63-8398-49b9-ba31-17d23d728f94 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:03.407613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec61bfa-d0b9-4b3a-b578-e73ee1f00575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:03.408460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec61bfa-d0b9-4b3a-b578-e73ee1f00575 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:03.408936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec61bfa-d0b9-4b3a-b578-e73ee1f00575 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:03.409390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec61bfa-d0b9-4b3a-b578-e73ee1f00575 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:03.410224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec61bfa-d0b9-4b3a-b578-e73ee1f00575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:03.412536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec61bfa-d0b9-4b3a-b578-e73ee1f00575 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:03.412778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a634ad-d614-494e-8bd1-833a328498c4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:03.417843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba9873-f1d6-4c65-953b-b3da56fd3c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:03.418663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba9873-f1d6-4c65-953b-b3da56fd3c9f service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:03.418821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba9873-f1d6-4c65-953b-b3da56fd3c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:03.419027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba9873-f1d6-4c65-953b-b3da56fd3c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:03.432307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba9873-f1d6-4c65-953b-b3da56fd3c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:03.434271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba9873-f1d6-4c65-953b-b3da56fd3c9f service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:03.448667 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2277/4560] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:17:03.450782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba9873-f1d6-4c65-953b-b3da56fd3c9f service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:03.454821 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2284/4561] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:03 2022] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:03.459592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec61bfa-d0b9-4b3a-b578-e73ee1f00575 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:03.462061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba9873-f1d6-4c65-953b-b3da56fd3c9f service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:03.510322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:03.545161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec61bfa-d0b9-4b3a-b578-e73ee1f00575 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:03.554783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50f3ae-f8a4-4e4d-b310-0ca88cb0854e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:03.556493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50f3ae-f8a4-4e4d-b310-0ca88cb0854e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:03.557676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50f3ae-f8a4-4e4d-b310-0ca88cb0854e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:03.558057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50f3ae-f8a4-4e4d-b310-0ca88cb0854e admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:03.560569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50f3ae-f8a4-4e4d-b310-0ca88cb0854e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:03.566411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50f3ae-f8a4-4e4d-b310-0ca88cb0854e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:03.580457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1bd53-02a8-4cde-aabb-0ab8b382ad9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:03.581239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1bd53-02a8-4cde-aabb-0ab8b382ad9c admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:03.581619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1bd53-02a8-4cde-aabb-0ab8b382ad9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:03.581994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1bd53-02a8-4cde-aabb-0ab8b382ad9c admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:03.583512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1bd53-02a8-4cde-aabb-0ab8b382ad9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:17:03.583871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1bd53-02a8-4cde-aabb-0ab8b382ad9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:03.585514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1bd53-02a8-4cde-aabb-0ab8b382ad9c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:03.612195 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2285/4562] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:17:03 2022] POST /identity/v3/users => generated 284 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:17:03.624892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50f3ae-f8a4-4e4d-b310-0ca88cb0854e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:03.642676 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2278/4563] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:17:03.644361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1bd53-02a8-4cde-aabb-0ab8b382ad9c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:03.647757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50f3ae-f8a4-4e4d-b310-0ca88cb0854e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:03.661468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ba8ab-075a-450d-8586-fd0c7f361a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:03.662601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ba8ab-075a-450d-8586-fd0c7f361a22 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:03.662890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ba8ab-075a-450d-8586-fd0c7f361a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:03.663171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ba8ab-075a-450d-8586-fd0c7f361a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:03.663908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ba8ab-075a-450d-8586-fd0c7f361a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:03.664999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1bd53-02a8-4cde-aabb-0ab8b382ad9c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:03.666907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ba8ab-075a-450d-8586-fd0c7f361a22 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:03.682851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b88869-4fb4-4c2a-a5eb-7c643d315596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:03.683535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b88869-4fb4-4c2a-a5eb-7c643d315596 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:03.683824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b88869-4fb4-4c2a-a5eb-7c643d315596 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:03.684107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b88869-4fb4-4c2a-a5eb-7c643d315596 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:03.684785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b88869-4fb4-4c2a-a5eb-7c643d315596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:03.690476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b88869-4fb4-4c2a-a5eb-7c643d315596 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:03.694472 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2286/4564] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:03.698838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ba8ab-075a-450d-8586-fd0c7f361a22 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:03.716296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ba8ab-075a-450d-8586-fd0c7f361a22 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:03.732336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db7444-e301-43ec-b296-33f6487ce3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:03.733459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db7444-e301-43ec-b296-33f6487ce3eb admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:03.736029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db7444-e301-43ec-b296-33f6487ce3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:03.736496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db7444-e301-43ec-b296-33f6487ce3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:03.738289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db7444-e301-43ec-b296-33f6487ce3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:03.741744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db7444-e301-43ec-b296-33f6487ce3eb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:03.742201 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2279/4565] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:03 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:03.749554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b88869-4fb4-4c2a-a5eb-7c643d315596 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:03.771675 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2287/4566] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:17:03.773012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db7444-e301-43ec-b296-33f6487ce3eb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:03.775769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f8db7444-e301-43ec-b296-33f6487ce3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:03.823442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db7444-e301-43ec-b296-33f6487ce3eb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:03.896835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b88869-4fb4-4c2a-a5eb-7c643d315596 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:03.910351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82424eb9-2519-4193-90bf-cdb8b27eba96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:03.911232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82424eb9-2519-4193-90bf-cdb8b27eba96 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:03.911744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82424eb9-2519-4193-90bf-cdb8b27eba96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:03.912210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82424eb9-2519-4193-90bf-cdb8b27eba96 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:03.913053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82424eb9-2519-4193-90bf-cdb8b27eba96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:03.915418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82424eb9-2519-4193-90bf-cdb8b27eba96 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:03.924747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ba7fa-b0a6-42c8-9689-0650019fc45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:03.925433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ba7fa-b0a6-42c8-9689-0650019fc45a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:03.925719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ba7fa-b0a6-42c8-9689-0650019fc45a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:03.925999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ba7fa-b0a6-42c8-9689-0650019fc45a admin admin] PATH_INFO: `/v3/projects/2af384c0e6d44b53a12811dfbb3dd2f1` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:03.927379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ba7fa-b0a6-42c8-9689-0650019fc45a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af384c0e6d44b53a12811dfbb3dd2f1)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:03.929715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ba7fa-b0a6-42c8-9689-0650019fc45a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:03.965583 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2280/4567] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:17:03 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:03.966395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82424eb9-2519-4193-90bf-cdb8b27eba96 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:03.981414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82424eb9-2519-4193-90bf-cdb8b27eba96 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:03.989895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d16b67-08b8-4e72-b6f7-82323bbe7d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:03.990521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d16b67-08b8-4e72-b6f7-82323bbe7d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:03.997989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d16b67-08b8-4e72-b6f7-82323bbe7d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:03.998353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d16b67-08b8-4e72-b6f7-82323bbe7d8c admin admin] PATH_INFO: `/v3/projects/818eed3e1a5148dfa032c63907f1c9ec/users/2457f9b70fa448b4818ab503e58160a2/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:04.017276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:04.022371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d16b67-08b8-4e72-b6f7-82323bbe7d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=818eed3e1a5148dfa032c63907f1c9ec, user_id=2457f9b70fa448b4818ab503e58160a2, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:04.025977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d16b67-08b8-4e72-b6f7-82323bbe7d8c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:04.032731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e46ba7fa-b0a6-42c8-9689-0650019fc45a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af384c0e6d44b53a12811dfbb3dd2f1', 'request_id': 'req-e46ba7fa-b0a6-42c8-9689-0650019fc45a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:04.043697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e46ba7fa-b0a6-42c8-9689-0650019fc45a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af384c0e6d44b53a12811dfbb3dd2f1', 'request_id': 'req-e46ba7fa-b0a6-42c8-9689-0650019fc45a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:04.046303 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2281/4568] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:03 2022] PUT /identity/v3/projects/818eed3e1a5148dfa032c63907f1c9ec/users/2457f9b70fa448b4818ab503e58160a2/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:04.047971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d16b67-08b8-4e72-b6f7-82323bbe7d8c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:04.054838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e46ba7fa-b0a6-42c8-9689-0650019fc45a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af384c0e6d44b53a12811dfbb3dd2f1', 'request_id': 'req-e46ba7fa-b0a6-42c8-9689-0650019fc45a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:04.075150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e46ba7fa-b0a6-42c8-9689-0650019fc45a admin admin] The token cache is being invalidate because project 2af384c0e6d44b53a12811dfbb3dd2f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:04.075472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e46ba7fa-b0a6-42c8-9689-0650019fc45a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:04.076247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e46ba7fa-b0a6-42c8-9689-0650019fc45a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:04.079788 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2288/4569] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:03 2022] DELETE /identity/v3/projects/2af384c0e6d44b53a12811dfbb3dd2f1 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:04.082952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ee443-0385-4a7e-8532-cfe4a85ee28a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:04.083620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ee443-0385-4a7e-8532-cfe4a85ee28a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:04.083620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ee443-0385-4a7e-8532-cfe4a85ee28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:04.135232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-929ee443-0385-4a7e-8532-cfe4a85ee28a None None] MFA Rules not processed for user `2457f9b70fa448b4818ab503e58160a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:04.138418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-929ee443-0385-4a7e-8532-cfe4a85ee28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:04.146693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d16b67-08b8-4e72-b6f7-82323bbe7d8c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:04.151971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c14194-1d45-43e3-a623-fd86e1e5bcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:04.152778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c14194-1d45-43e3-a623-fd86e1e5bcab admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:04.153417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c14194-1d45-43e3-a623-fd86e1e5bcab admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:04.153709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c14194-1d45-43e3-a623-fd86e1e5bcab admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:04.154488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c14194-1d45-43e3-a623-fd86e1e5bcab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:04.156385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c14194-1d45-43e3-a623-fd86e1e5bcab admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:04.160122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:04.178389 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2282/4570] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:04.182284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd8040-6e61-4430-ac58-dc4f70d8160b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:04.183634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd8040-6e61-4430-ac58-dc4f70d8160b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:04.184321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd8040-6e61-4430-ac58-dc4f70d8160b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:04.214925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-36dd8040-6e61-4430-ac58-dc4f70d8160b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:04.216329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-36dd8040-6e61-4430-ac58-dc4f70d8160b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:04.235710 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2283/4571] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:04.235710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd8040-6e61-4430-ac58-dc4f70d8160b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:04.237953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-36dd8040-6e61-4430-ac58-dc4f70d8160b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:04.241342 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2289/4572] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:04.242974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b774a2f-1dcc-405a-b776-0f7c79aab03f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:04.243520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b774a2f-1dcc-405a-b776-0f7c79aab03f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:04.244578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b774a2f-1dcc-405a-b776-0f7c79aab03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:04.258003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd8040-6e61-4430-ac58-dc4f70d8160b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:04.278172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-6b774a2f-1dcc-405a-b776-0f7c79aab03f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:04.279935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6b774a2f-1dcc-405a-b776-0f7c79aab03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:04.282489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4966f2-13a0-4034-9ae7-3803e5d31e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:04.283260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4966f2-13a0-4034-9ae7-3803e5d31e10 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:04.283613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4966f2-13a0-4034-9ae7-3803e5d31e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:04.283956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4966f2-13a0-4034-9ae7-3803e5d31e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:04.284730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4966f2-13a0-4034-9ae7-3803e5d31e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:04.291232 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2290/4573] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:04.291696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4966f2-13a0-4034-9ae7-3803e5d31e10 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:04.295219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b774a2f-1dcc-405a-b776-0f7c79aab03f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:04.296664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6b774a2f-1dcc-405a-b776-0f7c79aab03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:04.307936 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2284/4574] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:04.309073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4966f2-13a0-4034-9ae7-3803e5d31e10 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:04.315882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b774a2f-1dcc-405a-b776-0f7c79aab03f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:04.321812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4966f2-13a0-4034-9ae7-3803e5d31e10 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:04.323269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff56a7-b76f-4358-a748-26f7989e06d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:04.324095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff56a7-b76f-4358-a748-26f7989e06d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:04.324479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff56a7-b76f-4358-a748-26f7989e06d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:04.324789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff56a7-b76f-4358-a748-26f7989e06d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:04.325795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff56a7-b76f-4358-a748-26f7989e06d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:04.328434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff56a7-b76f-4358-a748-26f7989e06d0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:04.334283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7028502-c685-446e-871f-a2ab98d2ded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:04.335712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7028502-c685-446e-871f-a2ab98d2ded6 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:04.336115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7028502-c685-446e-871f-a2ab98d2ded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:04.336499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7028502-c685-446e-871f-a2ab98d2ded6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:04.337516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7028502-c685-446e-871f-a2ab98d2ded6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:17:04.337987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7028502-c685-446e-871f-a2ab98d2ded6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:04.339883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7028502-c685-446e-871f-a2ab98d2ded6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:04.370240 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2291/4575] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:04 2022] POST /identity/v3/projects => generated 367 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:04.372283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff56a7-b76f-4358-a748-26f7989e06d0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:04.378759 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2285/4576] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:17:04.384910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7028502-c685-446e-871f-a2ab98d2ded6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:04.414150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7028502-c685-446e-871f-a2ab98d2ded6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:04.475462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff56a7-b76f-4358-a748-26f7989e06d0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:04.482130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcbaae-dc75-438f-a75c-72dff6e6f289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:04.483005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcbaae-dc75-438f-a75c-72dff6e6f289 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:04.483486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcbaae-dc75-438f-a75c-72dff6e6f289 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:04.484137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcbaae-dc75-438f-a75c-72dff6e6f289 admin admin] PATH_INFO: `/v3/projects/995094f55a1a4d51bba197347e510968/users/86e4e88cd2154fa09d15bffe4e644a8b/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:04.517185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcbaae-dc75-438f-a75c-72dff6e6f289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=995094f55a1a4d51bba197347e510968, user_id=86e4e88cd2154fa09d15bffe4e644a8b, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:04.520488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcbaae-dc75-438f-a75c-72dff6e6f289 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:04.554453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9714755-88f6-4468-a061-d4668f274332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:04.557115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9714755-88f6-4468-a061-d4668f274332 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:04.557402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9714755-88f6-4468-a061-d4668f274332 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:04.557678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9714755-88f6-4468-a061-d4668f274332 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:04.561246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9714755-88f6-4468-a061-d4668f274332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:04.563531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9714755-88f6-4468-a061-d4668f274332 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:04.567786 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2292/4577] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:04 2022] PUT /identity/v3/projects/995094f55a1a4d51bba197347e510968/users/86e4e88cd2154fa09d15bffe4e644a8b/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:04.569548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcbaae-dc75-438f-a75c-72dff6e6f289 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:04.594922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:04.618973 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2286/4578] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:17:04 2022] POST /identity/v3/users => generated 290 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:04.620971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d8386-0ced-41c2-ab72-01c871090ed7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:04.621487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d8386-0ced-41c2-ab72-01c871090ed7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:04.621972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d8386-0ced-41c2-ab72-01c871090ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:04.652450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-026d8386-0ced-41c2-ab72-01c871090ed7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:04.655469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-026d8386-0ced-41c2-ab72-01c871090ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:04.674938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcbaae-dc75-438f-a75c-72dff6e6f289 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:04.680410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534f9e7-5730-499e-a28f-0acbd0fd79f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:04.681185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534f9e7-5730-499e-a28f-0acbd0fd79f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:04.681537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534f9e7-5730-499e-a28f-0acbd0fd79f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:04.681975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534f9e7-5730-499e-a28f-0acbd0fd79f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:04.682860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534f9e7-5730-499e-a28f-0acbd0fd79f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:04.685687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534f9e7-5730-499e-a28f-0acbd0fd79f3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:04.734066 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2293/4579] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:04 2022] POST /identity/v3/projects => generated 363 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:04.734066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534f9e7-5730-499e-a28f-0acbd0fd79f3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:04.767725 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2287/4580] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:04.767725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d8386-0ced-41c2-ab72-01c871090ed7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:04.791525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d8386-0ced-41c2-ab72-01c871090ed7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:04.816319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534f9e7-5730-499e-a28f-0acbd0fd79f3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:04.827470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653fd00-8df1-4bbc-ac66-9c8851e588b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:04.828463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653fd00-8df1-4bbc-ac66-9c8851e588b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:04.828755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653fd00-8df1-4bbc-ac66-9c8851e588b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:04.829182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653fd00-8df1-4bbc-ac66-9c8851e588b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:04.830282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653fd00-8df1-4bbc-ac66-9c8851e588b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:04.833400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653fd00-8df1-4bbc-ac66-9c8851e588b3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:04.850058 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2294/4581] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:04.850058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653fd00-8df1-4bbc-ac66-9c8851e588b3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:04.850058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f653fd00-8df1-4bbc-ac66-9c8851e588b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:04.901711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:04.911028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d1d28-0470-49b7-880f-9bce1e7fce34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:04.912430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d1d28-0470-49b7-880f-9bce1e7fce34 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:04.912914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d1d28-0470-49b7-880f-9bce1e7fce34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:04.913463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d1d28-0470-49b7-880f-9bce1e7fce34 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:04.915318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d1d28-0470-49b7-880f-9bce1e7fce34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:04.919425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d1d28-0470-49b7-880f-9bce1e7fce34 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:04.948363 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2288/4582] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:17:04 2022] POST /identity/v3/users => generated 282 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:04.949682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d1d28-0470-49b7-880f-9bce1e7fce34 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:04.976766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d1d28-0470-49b7-880f-9bce1e7fce34 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:04.978554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653fd00-8df1-4bbc-ac66-9c8851e588b3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:04.982083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb4414-6882-4a64-bb21-e7ac5b118448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:04.982863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb4414-6882-4a64-bb21-e7ac5b118448 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:04.983151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb4414-6882-4a64-bb21-e7ac5b118448 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:04.983478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb4414-6882-4a64-bb21-e7ac5b118448 admin admin] PATH_INFO: `/v3/projects/fa30c3e53c86400ab3c8d0d24048a429/users/70c88881793f437d8b7b000085857ccb/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:04.983993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad285c95-91da-4c68-a67a-8ff80eeca0bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:04.984833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad285c95-91da-4c68-a67a-8ff80eeca0bf service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:04.985542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad285c95-91da-4c68-a67a-8ff80eeca0bf service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:04.985991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad285c95-91da-4c68-a67a-8ff80eeca0bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:05.010038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb4414-6882-4a64-bb21-e7ac5b118448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa30c3e53c86400ab3c8d0d24048a429, user_id=70c88881793f437d8b7b000085857ccb, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:05.014676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb4414-6882-4a64-bb21-e7ac5b118448 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:05.017139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad285c95-91da-4c68-a67a-8ff80eeca0bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:05.019666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad285c95-91da-4c68-a67a-8ff80eeca0bf service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:05.042526 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2289/4583] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:04 2022] PUT /identity/v3/projects/fa30c3e53c86400ab3c8d0d24048a429/users/70c88881793f437d8b7b000085857ccb/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:05.043782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb4414-6882-4a64-bb21-e7ac5b118448 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:05.044210 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2295/4584] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:17:05.048415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad285c95-91da-4c68-a67a-8ff80eeca0bf service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:05.069053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad285c95-91da-4c68-a67a-8ff80eeca0bf service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:05.124246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb4414-6882-4a64-bb21-e7ac5b118448 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:05.130509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7284b3-7492-47a0-be73-f74297fa46e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:05.131017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7284b3-7492-47a0-be73-f74297fa46e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:05.132024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7284b3-7492-47a0-be73-f74297fa46e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:05.132024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7284b3-7492-47a0-be73-f74297fa46e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:05.132321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7284b3-7492-47a0-be73-f74297fa46e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:05.133933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7284b3-7492-47a0-be73-f74297fa46e0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:05.146970 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2290/4585] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:05.152459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7284b3-7492-47a0-be73-f74297fa46e0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:05.159344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:05.167381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7284b3-7492-47a0-be73-f74297fa46e0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:05.173034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90aa6d-634e-48ad-a342-7dda21c1181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:05.173934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90aa6d-634e-48ad-a342-7dda21c1181f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:05.174419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90aa6d-634e-48ad-a342-7dda21c1181f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:05.174898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90aa6d-634e-48ad-a342-7dda21c1181f admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:05.176025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90aa6d-634e-48ad-a342-7dda21c1181f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:05.178394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90aa6d-634e-48ad-a342-7dda21c1181f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:05.193995 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2291/4586] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:05.201031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e717b-14d3-4254-8f4e-39b89f960907 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:05.201611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e717b-14d3-4254-8f4e-39b89f960907 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:05.202162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e717b-14d3-4254-8f4e-39b89f960907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:05.233192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-057e717b-14d3-4254-8f4e-39b89f960907 None None] MFA Rules not processed for user `23ba5ddf22424eff840602440872f86e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:05.235073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-057e717b-14d3-4254-8f4e-39b89f960907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:05.237077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82f87c-cba7-4023-82ce-adeed00d5836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:05.237983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82f87c-cba7-4023-82ce-adeed00d5836 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:05.238402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82f87c-cba7-4023-82ce-adeed00d5836 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:05.238756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82f87c-cba7-4023-82ce-adeed00d5836 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:05.239645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82f87c-cba7-4023-82ce-adeed00d5836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:05.241783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82f87c-cba7-4023-82ce-adeed00d5836 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:05.258779 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2296/4587] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:05.261334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82f87c-cba7-4023-82ce-adeed00d5836 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:05.275028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82f87c-cba7-4023-82ce-adeed00d5836 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:05.282676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c26683-0228-4a50-b4f7-cc71acd3befb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:05.283791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c26683-0228-4a50-b4f7-cc71acd3befb admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:05.284290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c26683-0228-4a50-b4f7-cc71acd3befb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:05.284821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c26683-0228-4a50-b4f7-cc71acd3befb admin admin] PATH_INFO: `/v3/projects/23b429fc7d3342838aed3027a8af4d54/users/d8fb4677785a43d4bd09cc4aa76f2a9f/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:05.305472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c26683-0228-4a50-b4f7-cc71acd3befb admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b429fc7d3342838aed3027a8af4d54, user_id=d8fb4677785a43d4bd09cc4aa76f2a9f, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:05.310079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c26683-0228-4a50-b4f7-cc71acd3befb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:05.340150 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2297/4588] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:05 2022] PUT /identity/v3/projects/23b429fc7d3342838aed3027a8af4d54/users/d8fb4677785a43d4bd09cc4aa76f2a9f/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:05.345567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c26683-0228-4a50-b4f7-cc71acd3befb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:05.357992 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2292/4589] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:05.359266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcf0c0-2ac5-47c0-b679-524aed5587e7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:05.359893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcf0c0-2ac5-47c0-b679-524aed5587e7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:05.360166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcf0c0-2ac5-47c0-b679-524aed5587e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:05.396555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-effcf0c0-2ac5-47c0-b679-524aed5587e7 None None] MFA Rules not processed for user `d8fb4677785a43d4bd09cc4aa76f2a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:05.396555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-effcf0c0-2ac5-47c0-b679-524aed5587e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:05.451769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:05.505114 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2293/4590] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:05.506172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcf0c0-2ac5-47c0-b679-524aed5587e7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:05.585721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcf0c0-2ac5-47c0-b679-524aed5587e7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:05.588318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c26683-0228-4a50-b4f7-cc71acd3befb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:05.592230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f58dcd-36b2-4806-9f62-a55c94fb534b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:05.592936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f58dcd-36b2-4806-9f62-a55c94fb534b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:05.593224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f58dcd-36b2-4806-9f62-a55c94fb534b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:05.593502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f58dcd-36b2-4806-9f62-a55c94fb534b admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:05.594187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f58dcd-36b2-4806-9f62-a55c94fb534b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:05.596217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f58dcd-36b2-4806-9f62-a55c94fb534b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:05.601895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a6ec7-60cb-48a2-8422-dbabd8ac9308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:05.604817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a6ec7-60cb-48a2-8422-dbabd8ac9308 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:05.605654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a6ec7-60cb-48a2-8422-dbabd8ac9308 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:05.606917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a6ec7-60cb-48a2-8422-dbabd8ac9308 admin admin] PATH_INFO: `/v3/projects/fa30c3e53c86400ab3c8d0d24048a429/users/70c88881793f437d8b7b000085857ccb/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:05.611126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a6ec7-60cb-48a2-8422-dbabd8ac9308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa30c3e53c86400ab3c8d0d24048a429, user_id=70c88881793f437d8b7b000085857ccb, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:05.618155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a6ec7-60cb-48a2-8422-dbabd8ac9308 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:05.638595 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2294/4591] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:05 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:05.639555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f58dcd-36b2-4806-9f62-a55c94fb534b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:05.646624 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2298/4592] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:05 2022] PUT /identity/v3/projects/fa30c3e53c86400ab3c8d0d24048a429/users/70c88881793f437d8b7b000085857ccb/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:05.657556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b6d98-6e64-4490-bdcf-931a5b58c04d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:05.657839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b6d98-6e64-4490-bdcf-931a5b58c04d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:05.658163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b6d98-6e64-4490-bdcf-931a5b58c04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:05.711577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9d6b6d98-6e64-4490-bdcf-931a5b58c04d None None] MFA Rules not processed for user `70c88881793f437d8b7b000085857ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:05.713091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9d6b6d98-6e64-4490-bdcf-931a5b58c04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:05.777283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f58dcd-36b2-4806-9f62-a55c94fb534b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:05.881051 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2299/4593] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:05 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:17:05.886267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b6d98-6e64-4490-bdcf-931a5b58c04d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:05.919251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fd053-2026-48cc-99a5-4185c3e914d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:05.920061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fd053-2026-48cc-99a5-4185c3e914d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:05.920391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fd053-2026-48cc-99a5-4185c3e914d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:05.920624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fd053-2026-48cc-99a5-4185c3e914d1 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:05.923502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fd053-2026-48cc-99a5-4185c3e914d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:05.928025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fd053-2026-48cc-99a5-4185c3e914d1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:05.944661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:05.972926 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2295/4594] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:17:05 2022] POST /identity/v3/users => generated 289 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:05.977335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fd053-2026-48cc-99a5-4185c3e914d1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:05.996114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:06.003922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fd053-2026-48cc-99a5-4185c3e914d1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:06.023665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037a45f-a03f-458e-a063-5c30e6e530b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:06.024602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037a45f-a03f-458e-a063-5c30e6e530b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:06.025572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037a45f-a03f-458e-a063-5c30e6e530b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:06.025909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037a45f-a03f-458e-a063-5c30e6e530b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:06.030055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037a45f-a03f-458e-a063-5c30e6e530b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:06.032173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037a45f-a03f-458e-a063-5c30e6e530b2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:06.048151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b6d98-6e64-4490-bdcf-931a5b58c04d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:06.053935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea91342-cd92-40f6-8211-1f12ac9c5775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:06.055164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea91342-cd92-40f6-8211-1f12ac9c5775 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:06.055493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea91342-cd92-40f6-8211-1f12ac9c5775 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:06.055993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea91342-cd92-40f6-8211-1f12ac9c5775 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:06.056703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea91342-cd92-40f6-8211-1f12ac9c5775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:06.058658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea91342-cd92-40f6-8211-1f12ac9c5775 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:06.061762 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2296/4595] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:17:06.062699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037a45f-a03f-458e-a063-5c30e6e530b2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:06.092958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037a45f-a03f-458e-a063-5c30e6e530b2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:06.101454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac988a1-8c53-4d55-9f9e-d20b9015ef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:06.102146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac988a1-8c53-4d55-9f9e-d20b9015ef6e admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:06.102429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac988a1-8c53-4d55-9f9e-d20b9015ef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:06.102707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac988a1-8c53-4d55-9f9e-d20b9015ef6e admin admin] PATH_INFO: `/v3/projects/2c38e89043a04558ab6cdfd272899dbc/users/1c7a568679114fb8b98fbe6fb4c26068/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:06.131283 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2300/4596] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:05 2022] POST /identity/v3/projects => generated 369 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:06.131873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea91342-cd92-40f6-8211-1f12ac9c5775 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:06.151127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac988a1-8c53-4d55-9f9e-d20b9015ef6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c38e89043a04558ab6cdfd272899dbc, user_id=1c7a568679114fb8b98fbe6fb4c26068, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:06.154006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac988a1-8c53-4d55-9f9e-d20b9015ef6e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:06.201941 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2297/4597] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:06 2022] PUT /identity/v3/projects/2c38e89043a04558ab6cdfd272899dbc/users/1c7a568679114fb8b98fbe6fb4c26068/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:06.203654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555fa58-5217-4da1-820b-1807c265b62b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:06.203985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555fa58-5217-4da1-820b-1807c265b62b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:06.204398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555fa58-5217-4da1-820b-1807c265b62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:06.241015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea91342-cd92-40f6-8211-1f12ac9c5775 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:06.257576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1555fa58-5217-4da1-820b-1807c265b62b None None] MFA Rules not processed for user `23ba5ddf22424eff840602440872f86e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:06.262745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1555fa58-5217-4da1-820b-1807c265b62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:06.341698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abdfd7-f74e-4e87-82d1-bb72fac46a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:06.342376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abdfd7-f74e-4e87-82d1-bb72fac46a6d admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:06.342655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abdfd7-f74e-4e87-82d1-bb72fac46a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:06.342995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abdfd7-f74e-4e87-82d1-bb72fac46a6d admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:06.343672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abdfd7-f74e-4e87-82d1-bb72fac46a6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:06.345683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abdfd7-f74e-4e87-82d1-bb72fac46a6d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:06.372071 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2298/4598] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:06.386824 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2301/4599] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:17:06 2022] POST /identity/v3/users => generated 285 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:17:06.390390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555fa58-5217-4da1-820b-1807c265b62b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:06.400582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abdfd7-f74e-4e87-82d1-bb72fac46a6d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:06.412297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abdfd7-f74e-4e87-82d1-bb72fac46a6d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:06.425002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555fa58-5217-4da1-820b-1807c265b62b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:06.425918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62503c9-1aa3-4c3f-a8a7-69baac4203dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:06.427214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62503c9-1aa3-4c3f-a8a7-69baac4203dd admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:06.428112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62503c9-1aa3-4c3f-a8a7-69baac4203dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:06.429348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62503c9-1aa3-4c3f-a8a7-69baac4203dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:06.431940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62503c9-1aa3-4c3f-a8a7-69baac4203dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:06.435083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62503c9-1aa3-4c3f-a8a7-69baac4203dd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:06.438187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1a23c-5c44-4bf9-86a5-7a039a9555db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:06.439266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1a23c-5c44-4bf9-86a5-7a039a9555db admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:06.439990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1a23c-5c44-4bf9-86a5-7a039a9555db admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:06.440827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1a23c-5c44-4bf9-86a5-7a039a9555db admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:06.445500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1a23c-5c44-4bf9-86a5-7a039a9555db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:06.454152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1a23c-5c44-4bf9-86a5-7a039a9555db admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:06.470997 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2302/4600] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:06.472743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62503c9-1aa3-4c3f-a8a7-69baac4203dd admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:06.490046 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2299/4601] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:06.493503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1a23c-5c44-4bf9-86a5-7a039a9555db admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:06.505647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62503c9-1aa3-4c3f-a8a7-69baac4203dd admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:06.513058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1a23c-5c44-4bf9-86a5-7a039a9555db admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:06.515409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16342c22-3cad-47c6-a2c0-727995c9f7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:06.516562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16342c22-3cad-47c6-a2c0-727995c9f7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:06.516933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16342c22-3cad-47c6-a2c0-727995c9f7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:06.517436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16342c22-3cad-47c6-a2c0-727995c9f7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:06.518912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16342c22-3cad-47c6-a2c0-727995c9f7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:06.520357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453f423-96ec-42eb-8da9-4f6bd56060fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:06.520959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16342c22-3cad-47c6-a2c0-727995c9f7b7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:06.521153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453f423-96ec-42eb-8da9-4f6bd56060fa admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:06.521542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453f423-96ec-42eb-8da9-4f6bd56060fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:06.521895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453f423-96ec-42eb-8da9-4f6bd56060fa admin admin] PATH_INFO: `/v3/projects/2c38e89043a04558ab6cdfd272899dbc/users/1c7a568679114fb8b98fbe6fb4c26068/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:06.524549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453f423-96ec-42eb-8da9-4f6bd56060fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c38e89043a04558ab6cdfd272899dbc, user_id=1c7a568679114fb8b98fbe6fb4c26068, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:06.528361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453f423-96ec-42eb-8da9-4f6bd56060fa admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:06.543028 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2303/4602] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:06.544423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16342c22-3cad-47c6-a2c0-727995c9f7b7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:06.550798 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2300/4603] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:06 2022] PUT /identity/v3/projects/2c38e89043a04558ab6cdfd272899dbc/users/1c7a568679114fb8b98fbe6fb4c26068/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:06.563871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16342c22-3cad-47c6-a2c0-727995c9f7b7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:06.564095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090d61f-4ce8-477f-a309-34d4014b454b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:06.564336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090d61f-4ce8-477f-a309-34d4014b454b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:06.564685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090d61f-4ce8-477f-a309-34d4014b454b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:06.594144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:06.600528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9090d61f-4ce8-477f-a309-34d4014b454b None None] MFA Rules not processed for user `1c7a568679114fb8b98fbe6fb4c26068`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:06.606007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9090d61f-4ce8-477f-a309-34d4014b454b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:06.679205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572ab5e-830d-4686-94cc-e892212f1d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:06.680110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572ab5e-830d-4686-94cc-e892212f1d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:06.680461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572ab5e-830d-4686-94cc-e892212f1d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:06.680807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572ab5e-830d-4686-94cc-e892212f1d4f admin admin] PATH_INFO: `/v3/projects/ccc7a3b0d2e8441ba879ddc51378d941/users/c96d0b373d2348d9bdf4a1585fb3ae44/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:06.714077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572ab5e-830d-4686-94cc-e892212f1d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc7a3b0d2e8441ba879ddc51378d941, user_id=c96d0b373d2348d9bdf4a1585fb3ae44, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:06.722031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572ab5e-830d-4686-94cc-e892212f1d4f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:06.749865 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2301/4604] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:06.767329 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2304/4605] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:06 2022] PUT /identity/v3/projects/ccc7a3b0d2e8441ba879ddc51378d941/users/c96d0b373d2348d9bdf4a1585fb3ae44/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:06.768749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090d61f-4ce8-477f-a309-34d4014b454b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:06.770723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ed85c-5d0f-4b6c-9e85-38688f9888dc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:06.771060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ed85c-5d0f-4b6c-9e85-38688f9888dc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:06.771338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ed85c-5d0f-4b6c-9e85-38688f9888dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:06.775429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9090d61f-4ce8-477f-a309-34d4014b454b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:06.826622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a60ed85c-5d0f-4b6c-9e85-38688f9888dc None None] MFA Rules not processed for user `c96d0b373d2348d9bdf4a1585fb3ae44`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:06.827880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a60ed85c-5d0f-4b6c-9e85-38688f9888dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:06.870652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:06.921527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090d61f-4ce8-477f-a309-34d4014b454b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:06.983956 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2305/4606] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:06.984930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ed85c-5d0f-4b6c-9e85-38688f9888dc None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:07.053858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca26d7-6a63-473d-9bf3-63aedb058c99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:07.054610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca26d7-6a63-473d-9bf3-63aedb058c99 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:07.054999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca26d7-6a63-473d-9bf3-63aedb058c99 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:07.055402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca26d7-6a63-473d-9bf3-63aedb058c99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:07.098396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ed85c-5d0f-4b6c-9e85-38688f9888dc None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:07.112485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bac50-a579-4000-a22d-8d22a1c0350a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:07.113849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bac50-a579-4000-a22d-8d22a1c0350a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:07.115399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bac50-a579-4000-a22d-8d22a1c0350a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:07.116987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bac50-a579-4000-a22d-8d22a1c0350a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:07.119851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6bac50-a579-4000-a22d-8d22a1c0350a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:07.124123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6bac50-a579-4000-a22d-8d22a1c0350a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:07.147814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca26d7-6a63-473d-9bf3-63aedb058c99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:07.151480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca26d7-6a63-473d-9bf3-63aedb058c99 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:07.182112 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2306/4607] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:17:06 2022] POST /identity/v3/domains => generated 275 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:07.184292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bac50-a579-4000-a22d-8d22a1c0350a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:07.208611 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2302/4608] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:17:07.311094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:07.378970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bac50-a579-4000-a22d-8d22a1c0350a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:07.399062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eae404-3b45-4246-a0e3-a0a98376f84c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:07.399062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eae404-3b45-4246-a0e3-a0a98376f84c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:07.399062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eae404-3b45-4246-a0e3-a0a98376f84c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:07.399423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eae404-3b45-4246-a0e3-a0a98376f84c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:07.400915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eae404-3b45-4246-a0e3-a0a98376f84c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:07.402249 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-43eae404-3b45-4246-a0e3-a0a98376f84c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:17:07.402249 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:17:07.402249 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:17:07.405604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eae404-3b45-4246-a0e3-a0a98376f84c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:07.446742 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2307/4609] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:17:07 2022] POST /identity/v3/roles => generated 240 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:17:07.448600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca26d7-6a63-473d-9bf3-63aedb058c99 service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:07.485126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca26d7-6a63-473d-9bf3-63aedb058c99 service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:07.493266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca81ee-9db7-42aa-a96b-d2fcc452c1a6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:07.496010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca81ee-9db7-42aa-a96b-d2fcc452c1a6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:07.496498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca81ee-9db7-42aa-a96b-d2fcc452c1a6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:07.506456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca81ee-9db7-42aa-a96b-d2fcc452c1a6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains/b969bf544da14fc5919dbc3edb143584/users/c96d0b373d2348d9bdf4a1585fb3ae44/roles/ecfb260f9b064e3ea8dfb03f6849064a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:07.532821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca81ee-9db7-42aa-a96b-d2fcc452c1a6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=b969bf544da14fc5919dbc3edb143584, user_id=c96d0b373d2348d9bdf4a1585fb3ae44, role_id=ecfb260f9b064e3ea8dfb03f6849064a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:07.538532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca81ee-9db7-42aa-a96b-d2fcc452c1a6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:07.582492 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2303/4610] 10.222.0.17 () {60 vars in 1480 bytes} [Sat Jul 30 21:17:07 2022] PUT /identity/v3/domains/b969bf544da14fc5919dbc3edb143584/users/c96d0b373d2348d9bdf4a1585fb3ae44/roles/ecfb260f9b064e3ea8dfb03f6849064a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:07.586593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eae404-3b45-4246-a0e3-a0a98376f84c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:07.600917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eae404-3b45-4246-a0e3-a0a98376f84c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:07.799929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807aea1-5b5f-4b03-b5d8-02d9b2c40323 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:07.800859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807aea1-5b5f-4b03-b5d8-02d9b2c40323 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:07.801355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807aea1-5b5f-4b03-b5d8-02d9b2c40323 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:07.801839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807aea1-5b5f-4b03-b5d8-02d9b2c40323 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:07.803931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807aea1-5b5f-4b03-b5d8-02d9b2c40323 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:07.808012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807aea1-5b5f-4b03-b5d8-02d9b2c40323 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:07.860819 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2308/4611] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:17:07 2022] POST /identity/v3/domains => generated 277 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:17:07.872933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca81ee-9db7-42aa-a96b-d2fcc452c1a6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:07.890907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e21c7-e390-4edd-a72d-5c82c46b7a9f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:07.891280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e21c7-e390-4edd-a72d-5c82c46b7a9f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:07.891661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e21c7-e390-4edd-a72d-5c82c46b7a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:07.907839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca81ee-9db7-42aa-a96b-d2fcc452c1a6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:07.945598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b67e21c7-e390-4edd-a72d-5c82c46b7a9f None None] MFA Rules not processed for user `5f6545058c3d465992b5761677dc5261`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:07.951184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b67e21c7-e390-4edd-a72d-5c82c46b7a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:08.120672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730cdf9-daaa-4f5e-9959-9f1f0e54e193 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:08.121330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730cdf9-daaa-4f5e-9959-9f1f0e54e193 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:08.121614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730cdf9-daaa-4f5e-9959-9f1f0e54e193 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:08.121898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730cdf9-daaa-4f5e-9959-9f1f0e54e193 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:08.122621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730cdf9-daaa-4f5e-9959-9f1f0e54e193 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:08.125284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730cdf9-daaa-4f5e-9959-9f1f0e54e193 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:08.138998 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2309/4612] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:08.166352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e21c7-e390-4edd-a72d-5c82c46b7a9f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:08.170369 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2304/4613] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:17:07 2022] POST /identity/v3/roles => generated 239 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:08.180412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730cdf9-daaa-4f5e-9959-9f1f0e54e193 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:08.184925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e21c7-e390-4edd-a72d-5c82c46b7a9f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:08.202061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b24ad-bdf8-468c-bba9-e093761225ff tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:08.203141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b24ad-bdf8-468c-bba9-e093761225ff tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:08.203691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b24ad-bdf8-468c-bba9-e093761225ff tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:08.204143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b24ad-bdf8-468c-bba9-e093761225ff tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/groups` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:08.206610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b24ad-bdf8-468c-bba9-e093761225ff tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:08.207884 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-ed5b24ad-bdf8-468c-bba9-e093761225ff tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:17:08.207884 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:17:08.207884 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:17:08.209499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b24ad-bdf8-468c-bba9-e093761225ff tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:08.215118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:08.281563 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2310/4614] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:17:08 2022] POST /identity/v3/groups => generated 325 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:08.282660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b24ad-bdf8-468c-bba9-e093761225ff tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:08.299122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b24ad-bdf8-468c-bba9-e093761225ff tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:08.312076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b94155-cbd3-47fa-a9c8-e3340b6f0a63 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:08.313062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b94155-cbd3-47fa-a9c8-e3340b6f0a63 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:08.313547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b94155-cbd3-47fa-a9c8-e3340b6f0a63 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:08.314902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b94155-cbd3-47fa-a9c8-e3340b6f0a63 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/groups/2a4acb11aecc4bec92d74fb9ad57f643/users/c96d0b373d2348d9bdf4a1585fb3ae44` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:08.326147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b94155-cbd3-47fa-a9c8-e3340b6f0a63 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2a4acb11aecc4bec92d74fb9ad57f643, user_id=c96d0b373d2348d9bdf4a1585fb3ae44)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:08.326767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730cdf9-daaa-4f5e-9959-9f1f0e54e193 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:08.330506 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-43b94155-cbd3-47fa-a9c8-e3340b6f0a63 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:17:08.330506 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:17:08.330506 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:17:08.333642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b94155-cbd3-47fa-a9c8-e3340b6f0a63 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:08.336562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b0e65-c145-49f7-930b-981b0d3f8bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:08.337027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b0e65-c145-49f7-930b-981b0d3f8bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:08.337294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b0e65-c145-49f7-930b-981b0d3f8bee admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:08.337592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b0e65-c145-49f7-930b-981b0d3f8bee admin admin] PATH_INFO: `/v3/users/d8fb4677785a43d4bd09cc4aa76f2a9f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:08.339065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b0e65-c145-49f7-930b-981b0d3f8bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8fb4677785a43d4bd09cc4aa76f2a9f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:08.340810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b0e65-c145-49f7-930b-981b0d3f8bee admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:08.438906 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2311/4615] 10.222.0.17 () {60 vars in 1360 bytes} [Sat Jul 30 21:17:08 2022] PUT /identity/v3/groups/2a4acb11aecc4bec92d74fb9ad57f643/users/c96d0b373d2348d9bdf4a1585fb3ae44 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:08.440362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b94155-cbd3-47fa-a9c8-e3340b6f0a63 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:08.454809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:08.461044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-285b0e65-c145-49f7-930b-981b0d3f8bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8fb4677785a43d4bd09cc4aa76f2a9f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:08.463901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-285b0e65-c145-49f7-930b-981b0d3f8bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8fb4677785a43d4bd09cc4aa76f2a9f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:08.507600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-285b0e65-c145-49f7-930b-981b0d3f8bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8fb4677785a43d4bd09cc4aa76f2a9f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:08.508623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-285b0e65-c145-49f7-930b-981b0d3f8bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8fb4677785a43d4bd09cc4aa76f2a9f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:08.527647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-285b0e65-c145-49f7-930b-981b0d3f8bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8fb4677785a43d4bd09cc4aa76f2a9f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:08.549383 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2305/4616] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:08 2022] DELETE /identity/v3/users/d8fb4677785a43d4bd09cc4aa76f2a9f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:08.558589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251756a-5253-4109-a100-2815610d27ff None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:08.558985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251756a-5253-4109-a100-2815610d27ff None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:08.559529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251756a-5253-4109-a100-2815610d27ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:08.605377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b94155-cbd3-47fa-a9c8-e3340b6f0a63 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:08.607196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2251756a-5253-4109-a100-2815610d27ff None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:08.611125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2251756a-5253-4109-a100-2815610d27ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:08.780574 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2306/4617] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:08.792734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399a508-dbf2-472b-9db4-00b5d374c205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:08.794624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399a508-dbf2-472b-9db4-00b5d374c205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:08.795021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399a508-dbf2-472b-9db4-00b5d374c205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:08.795594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399a508-dbf2-472b-9db4-00b5d374c205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains/cd272a901746486ca368a951090b95c1/groups/2a4acb11aecc4bec92d74fb9ad57f643/roles/d332b75933174a20bfa358a2facdf2e9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:08.798854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399a508-dbf2-472b-9db4-00b5d374c205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=cd272a901746486ca368a951090b95c1, group_id=2a4acb11aecc4bec92d74fb9ad57f643, role_id=d332b75933174a20bfa358a2facdf2e9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:08.802233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399a508-dbf2-472b-9db4-00b5d374c205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:08.833245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251756a-5253-4109-a100-2815610d27ff None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:08.836680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2251756a-5253-4109-a100-2815610d27ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:08.853571 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2312/4618] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:08 2022] PUT /identity/v3/domains/cd272a901746486ca368a951090b95c1/groups/2a4acb11aecc4bec92d74fb9ad57f643/roles/d332b75933174a20bfa358a2facdf2e9 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:08.858237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399a508-dbf2-472b-9db4-00b5d374c205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:08.860830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a399a508-dbf2-472b-9db4-00b5d374c205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:08.907246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:09.016515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251756a-5253-4109-a100-2815610d27ff None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:09.120053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399a508-dbf2-472b-9db4-00b5d374c205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:09.133073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a3280-6526-4f8b-91e2-44232a079d2d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:09.133739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a3280-6526-4f8b-91e2-44232a079d2d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:09.134034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a3280-6526-4f8b-91e2-44232a079d2d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:09.134886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a3280-6526-4f8b-91e2-44232a079d2d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:09.135668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a3280-6526-4f8b-91e2-44232a079d2d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:09.137346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a3280-6526-4f8b-91e2-44232a079d2d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:09.160445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f369f-0433-4162-9097-1d35d87d322a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:09.161580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f369f-0433-4162-9097-1d35d87d322a service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:09.161868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f369f-0433-4162-9097-1d35d87d322a service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:09.162150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f369f-0433-4162-9097-1d35d87d322a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:09.187164 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2313/4619] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:17:08 2022] POST /identity/v3/domains => generated 276 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:09.188364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a3280-6526-4f8b-91e2-44232a079d2d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:09.325051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:09.341106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f369f-0433-4162-9097-1d35d87d322a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:09.343230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f369f-0433-4162-9097-1d35d87d322a service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:09.368424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a3280-6526-4f8b-91e2-44232a079d2d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:09.369527 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2307/4620] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:17:09.388742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2558b5a-1628-4d19-839d-47b681f2e6dc tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:09.389548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2558b5a-1628-4d19-839d-47b681f2e6dc tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:09.389919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2558b5a-1628-4d19-839d-47b681f2e6dc tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:09.390278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2558b5a-1628-4d19-839d-47b681f2e6dc tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:09.391085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2558b5a-1628-4d19-839d-47b681f2e6dc tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:09.392869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2558b5a-1628-4d19-839d-47b681f2e6dc tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:09.436177 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2314/4621] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:17:09 2022] POST /identity/v3/roles => generated 240 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:09.442162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f369f-0433-4162-9097-1d35d87d322a service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:09.475779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f369f-0433-4162-9097-1d35d87d322a service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:09.491862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5ad9f-d10c-4ae4-9f4a-b3179a99e239 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:09.492844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5ad9f-d10c-4ae4-9f4a-b3179a99e239 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:09.493301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5ad9f-d10c-4ae4-9f4a-b3179a99e239 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:09.494348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5ad9f-d10c-4ae4-9f4a-b3179a99e239 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains/8ee6290ce038431ca988e2c5734bf6fb/users/c96d0b373d2348d9bdf4a1585fb3ae44/roles/3326b2d2640e433d84a8604287b7b8bf` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:09.527051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5ad9f-d10c-4ae4-9f4a-b3179a99e239 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8ee6290ce038431ca988e2c5734bf6fb, user_id=c96d0b373d2348d9bdf4a1585fb3ae44, role_id=3326b2d2640e433d84a8604287b7b8bf)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:09.531481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5ad9f-d10c-4ae4-9f4a-b3179a99e239 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:09.587024 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2308/4622] 10.222.0.17 () {60 vars in 1480 bytes} [Sat Jul 30 21:17:09 2022] PUT /identity/v3/domains/8ee6290ce038431ca988e2c5734bf6fb/users/c96d0b373d2348d9bdf4a1585fb3ae44/roles/3326b2d2640e433d84a8604287b7b8bf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:09.590977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2558b5a-1628-4d19-839d-47b681f2e6dc tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:09.602432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2558b5a-1628-4d19-839d-47b681f2e6dc tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:09.756091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0549f23-a5f5-4466-abaf-4e9ad2fa68cd tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:09.757871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0549f23-a5f5-4466-abaf-4e9ad2fa68cd tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:09.760676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0549f23-a5f5-4466-abaf-4e9ad2fa68cd tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:09.760676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0549f23-a5f5-4466-abaf-4e9ad2fa68cd tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:09.762065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0549f23-a5f5-4466-abaf-4e9ad2fa68cd tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:09.765593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0549f23-a5f5-4466-abaf-4e9ad2fa68cd tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:09.814292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5ad9f-d10c-4ae4-9f4a-b3179a99e239 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:09.814818 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2315/4623] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:17:09 2022] POST /identity/v3/domains => generated 275 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:09.830361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5ad9f-d10c-4ae4-9f4a-b3179a99e239 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:10.034298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aeb5b9-b3a8-4328-a6f3-c2778ac088a8 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:10.035061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aeb5b9-b3a8-4328-a6f3-c2778ac088a8 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:10.035061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aeb5b9-b3a8-4328-a6f3-c2778ac088a8 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:10.035061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aeb5b9-b3a8-4328-a6f3-c2778ac088a8 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:10.036201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aeb5b9-b3a8-4328-a6f3-c2778ac088a8 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:10.038863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aeb5b9-b3a8-4328-a6f3-c2778ac088a8 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:10.083239 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2309/4624] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:17:09 2022] POST /identity/v3/roles => generated 239 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:10.084483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0549f23-a5f5-4466-abaf-4e9ad2fa68cd tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:10.101797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0549f23-a5f5-4466-abaf-4e9ad2fa68cd tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:10.114948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9beac4f-86a2-4e86-bca7-d1bcc2994a8a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:10.117827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beac4f-86a2-4e86-bca7-d1bcc2994a8a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:10.117827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beac4f-86a2-4e86-bca7-d1bcc2994a8a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:10.121520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beac4f-86a2-4e86-bca7-d1bcc2994a8a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/groups` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:10.131049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9beac4f-86a2-4e86-bca7-d1bcc2994a8a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:10.136843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9beac4f-86a2-4e86-bca7-d1bcc2994a8a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:10.204169 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2316/4625] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:17:10 2022] POST /identity/v3/groups => generated 325 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:10.208058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aeb5b9-b3a8-4328-a6f3-c2778ac088a8 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:10.226510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aeb5b9-b3a8-4328-a6f3-c2778ac088a8 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:10.238008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1e574-b6f1-465a-b953-2c662711262a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:10.239273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1e574-b6f1-465a-b953-2c662711262a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:10.239782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1e574-b6f1-465a-b953-2c662711262a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:10.240240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1e574-b6f1-465a-b953-2c662711262a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/groups/02c9783199784873be23c1d41528f2a7/users/c96d0b373d2348d9bdf4a1585fb3ae44` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:10.261093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1e574-b6f1-465a-b953-2c662711262a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=02c9783199784873be23c1d41528f2a7, user_id=c96d0b373d2348d9bdf4a1585fb3ae44)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:10.261897 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-6eb1e574-b6f1-465a-b953-2c662711262a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:17:10.261897 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:17:10.261897 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:17:10.263994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1e574-b6f1-465a-b953-2c662711262a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:10.268913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:10.322130 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2310/4626] 10.222.0.17 () {60 vars in 1360 bytes} [Sat Jul 30 21:17:10 2022] PUT /identity/v3/groups/02c9783199784873be23c1d41528f2a7/users/c96d0b373d2348d9bdf4a1585fb3ae44 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:10.323508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9beac4f-86a2-4e86-bca7-d1bcc2994a8a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:10.341177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9beac4f-86a2-4e86-bca7-d1bcc2994a8a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:10.510031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480664a-3eea-4549-a13d-a6075475dc13 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:10.511280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480664a-3eea-4549-a13d-a6075475dc13 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:10.511779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480664a-3eea-4549-a13d-a6075475dc13 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:10.513669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480664a-3eea-4549-a13d-a6075475dc13 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains/35ea8b2ffbca446c9ceca8365e98c1c2/groups/02c9783199784873be23c1d41528f2a7/roles/cf4cac3dbc6d4dfe98a4081d08cfc608` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:10.517364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480664a-3eea-4549-a13d-a6075475dc13 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=35ea8b2ffbca446c9ceca8365e98c1c2, group_id=02c9783199784873be23c1d41528f2a7, role_id=cf4cac3dbc6d4dfe98a4081d08cfc608)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:10.544603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480664a-3eea-4549-a13d-a6075475dc13 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:10.583361 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2317/4627] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:10 2022] PUT /identity/v3/domains/35ea8b2ffbca446c9ceca8365e98c1c2/groups/02c9783199784873be23c1d41528f2a7/roles/cf4cac3dbc6d4dfe98a4081d08cfc608 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:10.587101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1e574-b6f1-465a-b953-2c662711262a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:10.589425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6eb1e574-b6f1-465a-b953-2c662711262a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:10.909506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1e574-b6f1-465a-b953-2c662711262a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:11.193563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b236e5f-e24b-4b55-95a3-fbb1587e1d54 tempest-TokensV3TestJSON-1195247432 tempest-TokensV3TestJSON-1195247432-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c96d0b373d2348d9bdf4a1585fb3ae44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccc7a3b0d2e8441ba879ddc51378d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:11.195077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b236e5f-e24b-4b55-95a3-fbb1587e1d54 tempest-TokensV3TestJSON-1195247432 tempest-TokensV3TestJSON-1195247432-project] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:11.195624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b236e5f-e24b-4b55-95a3-fbb1587e1d54 tempest-TokensV3TestJSON-1195247432 tempest-TokensV3TestJSON-1195247432-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:11.196067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b236e5f-e24b-4b55-95a3-fbb1587e1d54 tempest-TokensV3TestJSON-1195247432 tempest-TokensV3TestJSON-1195247432-project] PATH_INFO: `/v3/auth/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:11.197301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b236e5f-e24b-4b55-95a3-fbb1587e1d54 tempest-TokensV3TestJSON-1195247432 tempest-TokensV3TestJSON-1195247432-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:11.198625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b236e5f-e24b-4b55-95a3-fbb1587e1d54 tempest-TokensV3TestJSON-1195247432 tempest-TokensV3TestJSON-1195247432-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:11.307667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:11.424534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480664a-3eea-4549-a13d-a6075475dc13 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:11.425125 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2311/4628] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Jul 30 21:17:10 2022] GET /identity/v3/auth/domains => generated 1171 bytes in 837 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:11.528991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:11.598627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480664a-3eea-4549-a13d-a6075475dc13 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:11.610128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c471f-f1e4-463d-b6d1-af5a1e8bb7e4 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:11.612616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c471f-f1e4-463d-b6d1-af5a1e8bb7e4 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:11.613185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c471f-f1e4-463d-b6d1-af5a1e8bb7e4 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:11.616897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c471f-f1e4-463d-b6d1-af5a1e8bb7e4 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains/35ea8b2ffbca446c9ceca8365e98c1c2/groups/02c9783199784873be23c1d41528f2a7/roles/cf4cac3dbc6d4dfe98a4081d08cfc608` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:11.622126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c471f-f1e4-463d-b6d1-af5a1e8bb7e4 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=35ea8b2ffbca446c9ceca8365e98c1c2, group_id=02c9783199784873be23c1d41528f2a7, role_id=cf4cac3dbc6d4dfe98a4081d08cfc608)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:11.630265 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-941c471f-f1e4-463d-b6d1-af5a1e8bb7e4 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:17:11.630265 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:17:11.630265 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:17:11.643960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c471f-f1e4-463d-b6d1-af5a1e8bb7e4 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:11.656019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-941c471f-f1e4-463d-b6d1-af5a1e8bb7e4 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invalidating the token cache because role cf4cac3dbc6d4dfe98a4081d08cfc608 was removed from group 02c9783199784873be23c1d41528f2a7 on domain 35ea8b2ffbca446c9ceca8365e98c1c2. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:11.657930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-941c471f-f1e4-463d-b6d1-af5a1e8bb7e4 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:11.659061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-941c471f-f1e4-463d-b6d1-af5a1e8bb7e4 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:11.704343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b236e5f-e24b-4b55-95a3-fbb1587e1d54 tempest-TokensV3TestJSON-1195247432 tempest-TokensV3TestJSON-1195247432-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:11.707135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8b236e5f-e24b-4b55-95a3-fbb1587e1d54 tempest-TokensV3TestJSON-1195247432 tempest-TokensV3TestJSON-1195247432-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:11.715895 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2318/4629] 10.222.0.17 () {58 vars in 1467 bytes} [Sat Jul 30 21:17:11 2022] DELETE /identity/v3/domains/35ea8b2ffbca446c9ceca8365e98c1c2/groups/02c9783199784873be23c1d41528f2a7/roles/cf4cac3dbc6d4dfe98a4081d08cfc608 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:11.730998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b236e5f-e24b-4b55-95a3-fbb1587e1d54 tempest-TokensV3TestJSON-1195247432 tempest-TokensV3TestJSON-1195247432-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:11.749145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c340ea0-becb-411d-acda-ba0b18dcea09 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:11.751460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c340ea0-becb-411d-acda-ba0b18dcea09 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:11.751757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c340ea0-becb-411d-acda-ba0b18dcea09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:11.810262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4c340ea0-becb-411d-acda-ba0b18dcea09 None None] MFA Rules not processed for user `4a01092bfa5a4118a5fe61a6dc9c5460`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:11.813036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4c340ea0-becb-411d-acda-ba0b18dcea09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:11.956608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab288c-f712-4b9c-afd6-cb12b8c5c77d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:11.957554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab288c-f712-4b9c-afd6-cb12b8c5c77d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:11.959437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab288c-f712-4b9c-afd6-cb12b8c5c77d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:11.960065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab288c-f712-4b9c-afd6-cb12b8c5c77d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/groups/02c9783199784873be23c1d41528f2a7/users/c96d0b373d2348d9bdf4a1585fb3ae44` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:11.969138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab288c-f712-4b9c-afd6-cb12b8c5c77d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=02c9783199784873be23c1d41528f2a7, user_id=c96d0b373d2348d9bdf4a1585fb3ae44)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:11.973607 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-37ab288c-f712-4b9c-afd6-cb12b8c5c77d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:17:11.973607 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:17:11.973607 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:17:11.979832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab288c-f712-4b9c-afd6-cb12b8c5c77d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:12.017789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-37ab288c-f712-4b9c-afd6-cb12b8c5c77d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c96d0b373d2348d9bdf4a1585fb3ae44'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:12.062624 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2319/4630] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:12.075894 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2312/4631] 10.222.0.17 () {58 vars in 1344 bytes} [Sat Jul 30 21:17:11 2022] DELETE /identity/v3/groups/02c9783199784873be23c1d41528f2a7/users/c96d0b373d2348d9bdf4a1585fb3ae44 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:12.080200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c340ea0-becb-411d-acda-ba0b18dcea09 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:12.099046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c340ea0-becb-411d-acda-ba0b18dcea09 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:12.256554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded41cd-5d69-45e3-afff-081df4ad25a2 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:12.258410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded41cd-5d69-45e3-afff-081df4ad25a2 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:12.259916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded41cd-5d69-45e3-afff-081df4ad25a2 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:12.260309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded41cd-5d69-45e3-afff-081df4ad25a2 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/groups/02c9783199784873be23c1d41528f2a7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:12.264309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded41cd-5d69-45e3-afff-081df4ad25a2 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:delete_group(group_id=02c9783199784873be23c1d41528f2a7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:12.267585 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-1ded41cd-5d69-45e3-afff-081df4ad25a2 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:17:12.267585 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:17:12.267585 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:17:12.272101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded41cd-5d69-45e3-afff-081df4ad25a2 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:12.374168 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2320/4632] 10.222.0.17 () {58 vars in 1227 bytes} [Sat Jul 30 21:17:12 2022] DELETE /identity/v3/groups/02c9783199784873be23c1d41528f2a7 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:12.377273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab288c-f712-4b9c-afd6-cb12b8c5c77d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:12.390691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab288c-f712-4b9c-afd6-cb12b8c5c77d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:12.547203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c86868-4a92-44e5-8953-cb404eeeba14 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:12.547921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c86868-4a92-44e5-8953-cb404eeeba14 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:12.548210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c86868-4a92-44e5-8953-cb404eeeba14 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:12.548487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c86868-4a92-44e5-8953-cb404eeeba14 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/roles/cf4cac3dbc6d4dfe98a4081d08cfc608` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:12.549976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded41cd-5d69-45e3-afff-081df4ad25a2 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:12.552046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1ded41cd-5d69-45e3-afff-081df4ad25a2 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:12.559067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c86868-4a92-44e5-8953-cb404eeeba14 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cf4cac3dbc6d4dfe98a4081d08cfc608)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:12.560171 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-a6c86868-4a92-44e5-8953-cb404eeeba14 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:17:12.560171 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:17:12.560171 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:17:12.561165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c86868-4a92-44e5-8953-cb404eeeba14 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:12.686028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:12.755616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a6c86868-4a92-44e5-8953-cb404eeeba14 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invalidating the token cache because role cf4cac3dbc6d4dfe98a4081d08cfc608 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:12.763955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a6c86868-4a92-44e5-8953-cb404eeeba14 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:12.765111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a6c86868-4a92-44e5-8953-cb404eeeba14 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:12.767922 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2313/4633] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:12 2022] DELETE /identity/v3/roles/cf4cac3dbc6d4dfe98a4081d08cfc608 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:12.772297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c86868-4a92-44e5-8953-cb404eeeba14 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:12.774405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a6c86868-4a92-44e5-8953-cb404eeeba14 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:12.780460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded41cd-5d69-45e3-afff-081df4ad25a2 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:12.876699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:12.962739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c86868-4a92-44e5-8953-cb404eeeba14 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:12.981512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474ec10-c76e-4b11-a7e5-929b056b7d92 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:12.982202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474ec10-c76e-4b11-a7e5-929b056b7d92 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:12.982490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474ec10-c76e-4b11-a7e5-929b056b7d92 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:12.982780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474ec10-c76e-4b11-a7e5-929b056b7d92 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains/35ea8b2ffbca446c9ceca8365e98c1c2` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:12.988955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474ec10-c76e-4b11-a7e5-929b056b7d92 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=35ea8b2ffbca446c9ceca8365e98c1c2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:12.990072 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-d474ec10-c76e-4b11-a7e5-929b056b7d92 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:17:12.990072 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:17:12.990072 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:17:12.994903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a71a06-2dbf-4bfb-bfe0-70f35ebbef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:12.994903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a71a06-2dbf-4bfb-bfe0-70f35ebbef82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:12.994903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a71a06-2dbf-4bfb-bfe0-70f35ebbef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:12.994903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a71a06-2dbf-4bfb-bfe0-70f35ebbef82 admin admin] PATH_INFO: `/v3/projects/23b429fc7d3342838aed3027a8af4d54` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:12.996009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474ec10-c76e-4b11-a7e5-929b056b7d92 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:12.999330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a71a06-2dbf-4bfb-bfe0-70f35ebbef82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23b429fc7d3342838aed3027a8af4d54)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:12.999330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a71a06-2dbf-4bfb-bfe0-70f35ebbef82 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:13.079546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d474ec10-c76e-4b11-a7e5-929b056b7d92 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '35ea8b2ffbca446c9ceca8365e98c1c2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.081930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d474ec10-c76e-4b11-a7e5-929b056b7d92 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '35ea8b2ffbca446c9ceca8365e98c1c2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.149144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-62a71a06-2dbf-4bfb-bfe0-70f35ebbef82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b429fc7d3342838aed3027a8af4d54', 'request_id': 'req-62a71a06-2dbf-4bfb-bfe0-70f35ebbef82'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.150569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d474ec10-c76e-4b11-a7e5-929b056b7d92 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '35ea8b2ffbca446c9ceca8365e98c1c2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.155620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d474ec10-c76e-4b11-a7e5-929b056b7d92 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '35ea8b2ffbca446c9ceca8365e98c1c2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.158733 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2314/4634] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:17:12 2022] PATCH /identity/v3/domains/35ea8b2ffbca446c9ceca8365e98c1c2 => generated 276 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:17:13.162438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474ec10-c76e-4b11-a7e5-929b056b7d92 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:13.162875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-62a71a06-2dbf-4bfb-bfe0-70f35ebbef82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b429fc7d3342838aed3027a8af4d54', 'request_id': 'req-62a71a06-2dbf-4bfb-bfe0-70f35ebbef82'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.164077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d474ec10-c76e-4b11-a7e5-929b056b7d92 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:13.184846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-62a71a06-2dbf-4bfb-bfe0-70f35ebbef82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b429fc7d3342838aed3027a8af4d54', 'request_id': 'req-62a71a06-2dbf-4bfb-bfe0-70f35ebbef82'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.200760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-62a71a06-2dbf-4bfb-bfe0-70f35ebbef82 admin admin] The token cache is being invalidate because project 23b429fc7d3342838aed3027a8af4d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:13.201415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-62a71a06-2dbf-4bfb-bfe0-70f35ebbef82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.206963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-62a71a06-2dbf-4bfb-bfe0-70f35ebbef82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.210062 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2321/4635] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:12 2022] DELETE /identity/v3/projects/23b429fc7d3342838aed3027a8af4d54 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:13.214369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a71a06-2dbf-4bfb-bfe0-70f35ebbef82 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:13.216091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-62a71a06-2dbf-4bfb-bfe0-70f35ebbef82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:13.366217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474ec10-c76e-4b11-a7e5-929b056b7d92 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:13.406126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a71a06-2dbf-4bfb-bfe0-70f35ebbef82 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:13.419305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5985fe-d60d-41c1-8d8d-c7ca0cd10179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:13.420405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5985fe-d60d-41c1-8d8d-c7ca0cd10179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:13.420945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5985fe-d60d-41c1-8d8d-c7ca0cd10179 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:13.421450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5985fe-d60d-41c1-8d8d-c7ca0cd10179 admin admin] PATH_INFO: `/v3/users/1c7a568679114fb8b98fbe6fb4c26068` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:13.423163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5985fe-d60d-41c1-8d8d-c7ca0cd10179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c7a568679114fb8b98fbe6fb4c26068)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:13.428631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5985fe-d60d-41c1-8d8d-c7ca0cd10179 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:13.451614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:13.539666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4c0fb-a701-47ef-b5de-890516cd2abe tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:13.540269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4c0fb-a701-47ef-b5de-890516cd2abe tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:13.540385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4c0fb-a701-47ef-b5de-890516cd2abe tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:13.540602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4c0fb-a701-47ef-b5de-890516cd2abe tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains/35ea8b2ffbca446c9ceca8365e98c1c2` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:13.572339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cf5985fe-d60d-41c1-8d8d-c7ca0cd10179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c7a568679114fb8b98fbe6fb4c26068'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.581905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4c0fb-a701-47ef-b5de-890516cd2abe tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=35ea8b2ffbca446c9ceca8365e98c1c2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:13.584368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4c0fb-a701-47ef-b5de-890516cd2abe tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:13.601890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cf5985fe-d60d-41c1-8d8d-c7ca0cd10179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c7a568679114fb8b98fbe6fb4c26068'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.602731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cf5985fe-d60d-41c1-8d8d-c7ca0cd10179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c7a568679114fb8b98fbe6fb4c26068'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.617094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9d4c0fb-a701-47ef-b5de-890516cd2abe tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '35ea8b2ffbca446c9ceca8365e98c1c2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.620692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cf5985fe-d60d-41c1-8d8d-c7ca0cd10179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c7a568679114fb8b98fbe6fb4c26068'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.622880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9d4c0fb-a701-47ef-b5de-890516cd2abe tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '35ea8b2ffbca446c9ceca8365e98c1c2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.623513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cf5985fe-d60d-41c1-8d8d-c7ca0cd10179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c7a568679114fb8b98fbe6fb4c26068'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.647940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:13.660188 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2322/4636] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:13 2022] DELETE /identity/v3/users/1c7a568679114fb8b98fbe6fb4c26068 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:17:13.706057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9d4c0fb-a701-47ef-b5de-890516cd2abe tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35ea8b2ffbca446c9ceca8365e98c1c2', 'request_id': 'req-f9d4c0fb-a701-47ef-b5de-890516cd2abe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.729195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9d4c0fb-a701-47ef-b5de-890516cd2abe tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35ea8b2ffbca446c9ceca8365e98c1c2', 'request_id': 'req-f9d4c0fb-a701-47ef-b5de-890516cd2abe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.773503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9d4c0fb-a701-47ef-b5de-890516cd2abe tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35ea8b2ffbca446c9ceca8365e98c1c2', 'request_id': 'req-f9d4c0fb-a701-47ef-b5de-890516cd2abe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.799993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9d4c0fb-a701-47ef-b5de-890516cd2abe tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] The token cache is being invalidate because project 35ea8b2ffbca446c9ceca8365e98c1c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:13.801885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9d4c0fb-a701-47ef-b5de-890516cd2abe tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.804607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9d4c0fb-a701-47ef-b5de-890516cd2abe tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.825214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9d4c0fb-a701-47ef-b5de-890516cd2abe tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '35ea8b2ffbca446c9ceca8365e98c1c2', 'request_id': 'req-f9d4c0fb-a701-47ef-b5de-890516cd2abe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.829736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9d4c0fb-a701-47ef-b5de-890516cd2abe tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '35ea8b2ffbca446c9ceca8365e98c1c2', 'request_id': 'req-f9d4c0fb-a701-47ef-b5de-890516cd2abe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.831047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9d4c0fb-a701-47ef-b5de-890516cd2abe tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '35ea8b2ffbca446c9ceca8365e98c1c2', 'request_id': 'req-f9d4c0fb-a701-47ef-b5de-890516cd2abe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:13.841523 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2315/4637] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:17:13 2022] DELETE /identity/v3/domains/35ea8b2ffbca446c9ceca8365e98c1c2 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:17:13.844805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5985fe-d60d-41c1-8d8d-c7ca0cd10179 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:13.846591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cf5985fe-d60d-41c1-8d8d-c7ca0cd10179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:14.034902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5985fe-d60d-41c1-8d8d-c7ca0cd10179 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:14.117418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb99038-a962-4500-b1a5-1152f0328205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:14.118117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb99038-a962-4500-b1a5-1152f0328205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:14.119536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb99038-a962-4500-b1a5-1152f0328205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:14.119876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb99038-a962-4500-b1a5-1152f0328205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains/8ee6290ce038431ca988e2c5734bf6fb/users/c96d0b373d2348d9bdf4a1585fb3ae44/roles/3326b2d2640e433d84a8604287b7b8bf` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:14.123827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb99038-a962-4500-b1a5-1152f0328205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8ee6290ce038431ca988e2c5734bf6fb, user_id=c96d0b373d2348d9bdf4a1585fb3ae44, role_id=3326b2d2640e433d84a8604287b7b8bf)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:14.127317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb99038-a962-4500-b1a5-1152f0328205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:14.134716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dfb99038-a962-4500-b1a5-1152f0328205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invalidating the token cache because role 3326b2d2640e433d84a8604287b7b8bf was removed from user c96d0b373d2348d9bdf4a1585fb3ae44 on domain 8ee6290ce038431ca988e2c5734bf6fb. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:14.135155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dfb99038-a962-4500-b1a5-1152f0328205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:14.136011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dfb99038-a962-4500-b1a5-1152f0328205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:14.160050 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2323/4638] 10.222.0.17 () {58 vars in 1464 bytes} [Sat Jul 30 21:17:13 2022] DELETE /identity/v3/domains/8ee6290ce038431ca988e2c5734bf6fb/users/c96d0b373d2348d9bdf4a1585fb3ae44/roles/3326b2d2640e433d84a8604287b7b8bf => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:14.161101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4c0fb-a701-47ef-b5de-890516cd2abe tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:14.162897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f9d4c0fb-a701-47ef-b5de-890516cd2abe tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:14.183593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4c0fb-a701-47ef-b5de-890516cd2abe tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:14.295203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ffb7d-dd80-4222-acf2-747f10bb0cbc tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:14.297332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ffb7d-dd80-4222-acf2-747f10bb0cbc tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:14.297764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ffb7d-dd80-4222-acf2-747f10bb0cbc tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:14.298160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ffb7d-dd80-4222-acf2-747f10bb0cbc tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/roles/3326b2d2640e433d84a8604287b7b8bf` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:14.300902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ffb7d-dd80-4222-acf2-747f10bb0cbc tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3326b2d2640e433d84a8604287b7b8bf)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:14.302843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ffb7d-dd80-4222-acf2-747f10bb0cbc tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:14.386572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-638ffb7d-dd80-4222-acf2-747f10bb0cbc tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invalidating the token cache because role 3326b2d2640e433d84a8604287b7b8bf has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:14.386572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-638ffb7d-dd80-4222-acf2-747f10bb0cbc tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:14.387473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-638ffb7d-dd80-4222-acf2-747f10bb0cbc tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:14.389764 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2316/4639] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:14 2022] DELETE /identity/v3/roles/3326b2d2640e433d84a8604287b7b8bf => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:14.394979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb99038-a962-4500-b1a5-1152f0328205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:14.396901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-dfb99038-a962-4500-b1a5-1152f0328205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:14.422448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb99038-a962-4500-b1a5-1152f0328205 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:14.467154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:14.588189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b718f6-55f9-4e16-bd2b-6e3e4415e23e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:14.588861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b718f6-55f9-4e16-bd2b-6e3e4415e23e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:14.589156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b718f6-55f9-4e16-bd2b-6e3e4415e23e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:14.589444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b718f6-55f9-4e16-bd2b-6e3e4415e23e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains/8ee6290ce038431ca988e2c5734bf6fb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:14.592507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b718f6-55f9-4e16-bd2b-6e3e4415e23e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8ee6290ce038431ca988e2c5734bf6fb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:14.594987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b718f6-55f9-4e16-bd2b-6e3e4415e23e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:14.626205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-58b718f6-55f9-4e16-bd2b-6e3e4415e23e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8ee6290ce038431ca988e2c5734bf6fb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:14.626771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-58b718f6-55f9-4e16-bd2b-6e3e4415e23e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8ee6290ce038431ca988e2c5734bf6fb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:14.670445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-58b718f6-55f9-4e16-bd2b-6e3e4415e23e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8ee6290ce038431ca988e2c5734bf6fb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:14.678015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-58b718f6-55f9-4e16-bd2b-6e3e4415e23e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8ee6290ce038431ca988e2c5734bf6fb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:14.685034 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2324/4640] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:17:14 2022] PATCH /identity/v3/domains/8ee6290ce038431ca988e2c5734bf6fb => generated 277 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:17:14.692302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ffb7d-dd80-4222-acf2-747f10bb0cbc tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:14.693853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-638ffb7d-dd80-4222-acf2-747f10bb0cbc tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:14.716914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ffb7d-dd80-4222-acf2-747f10bb0cbc tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:14.860935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:14.899066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0efbf-4321-46e8-8062-3ad4c672450a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:14.902929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0efbf-4321-46e8-8062-3ad4c672450a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:14.903524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0efbf-4321-46e8-8062-3ad4c672450a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:14.903675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0efbf-4321-46e8-8062-3ad4c672450a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains/8ee6290ce038431ca988e2c5734bf6fb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:14.933710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0efbf-4321-46e8-8062-3ad4c672450a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8ee6290ce038431ca988e2c5734bf6fb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:14.936132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0efbf-4321-46e8-8062-3ad4c672450a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:15.054611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-57e0efbf-4321-46e8-8062-3ad4c672450a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8ee6290ce038431ca988e2c5734bf6fb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:15.065396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-57e0efbf-4321-46e8-8062-3ad4c672450a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8ee6290ce038431ca988e2c5734bf6fb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:15.173810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-57e0efbf-4321-46e8-8062-3ad4c672450a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee6290ce038431ca988e2c5734bf6fb', 'request_id': 'req-57e0efbf-4321-46e8-8062-3ad4c672450a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:15.217354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-57e0efbf-4321-46e8-8062-3ad4c672450a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee6290ce038431ca988e2c5734bf6fb', 'request_id': 'req-57e0efbf-4321-46e8-8062-3ad4c672450a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:15.226534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-57e0efbf-4321-46e8-8062-3ad4c672450a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee6290ce038431ca988e2c5734bf6fb', 'request_id': 'req-57e0efbf-4321-46e8-8062-3ad4c672450a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:15.252799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-57e0efbf-4321-46e8-8062-3ad4c672450a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] The token cache is being invalidate because project 8ee6290ce038431ca988e2c5734bf6fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:15.256532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-57e0efbf-4321-46e8-8062-3ad4c672450a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:15.261927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-57e0efbf-4321-46e8-8062-3ad4c672450a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:15.283199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-57e0efbf-4321-46e8-8062-3ad4c672450a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8ee6290ce038431ca988e2c5734bf6fb', 'request_id': 'req-57e0efbf-4321-46e8-8062-3ad4c672450a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:15.289983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-57e0efbf-4321-46e8-8062-3ad4c672450a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8ee6290ce038431ca988e2c5734bf6fb', 'request_id': 'req-57e0efbf-4321-46e8-8062-3ad4c672450a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:15.291967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-57e0efbf-4321-46e8-8062-3ad4c672450a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8ee6290ce038431ca988e2c5734bf6fb', 'request_id': 'req-57e0efbf-4321-46e8-8062-3ad4c672450a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:15.312529 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2317/4641] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:17:14 2022] DELETE /identity/v3/domains/8ee6290ce038431ca988e2c5734bf6fb => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:15.316604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b718f6-55f9-4e16-bd2b-6e3e4415e23e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:15.318109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-58b718f6-55f9-4e16-bd2b-6e3e4415e23e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:15.359987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b718f6-55f9-4e16-bd2b-6e3e4415e23e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:15.528290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bd0fc-afbc-4ff4-b34d-2f1760a182f7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:15.529856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bd0fc-afbc-4ff4-b34d-2f1760a182f7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:15.530517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bd0fc-afbc-4ff4-b34d-2f1760a182f7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:15.530627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bd0fc-afbc-4ff4-b34d-2f1760a182f7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains/cd272a901746486ca368a951090b95c1/groups/2a4acb11aecc4bec92d74fb9ad57f643/roles/d332b75933174a20bfa358a2facdf2e9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:15.533933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bd0fc-afbc-4ff4-b34d-2f1760a182f7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=cd272a901746486ca368a951090b95c1, group_id=2a4acb11aecc4bec92d74fb9ad57f643, role_id=d332b75933174a20bfa358a2facdf2e9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:15.537717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bd0fc-afbc-4ff4-b34d-2f1760a182f7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:15.559121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-df1bd0fc-afbc-4ff4-b34d-2f1760a182f7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invalidating the token cache because role d332b75933174a20bfa358a2facdf2e9 was removed from group 2a4acb11aecc4bec92d74fb9ad57f643 on domain cd272a901746486ca368a951090b95c1. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:15.559669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-df1bd0fc-afbc-4ff4-b34d-2f1760a182f7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:15.560404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-df1bd0fc-afbc-4ff4-b34d-2f1760a182f7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:15.579332 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2325/4642] 10.222.0.17 () {58 vars in 1467 bytes} [Sat Jul 30 21:17:15 2022] DELETE /identity/v3/domains/cd272a901746486ca368a951090b95c1/groups/2a4acb11aecc4bec92d74fb9ad57f643/roles/d332b75933174a20bfa358a2facdf2e9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:15.584127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0efbf-4321-46e8-8062-3ad4c672450a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:15.587279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-57e0efbf-4321-46e8-8062-3ad4c672450a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:15.610614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0efbf-4321-46e8-8062-3ad4c672450a tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:15.784407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e94b2-7547-4b65-a0d4-bfbc8e3b87a2 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:15.785488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e94b2-7547-4b65-a0d4-bfbc8e3b87a2 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:15.785873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e94b2-7547-4b65-a0d4-bfbc8e3b87a2 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:15.786342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e94b2-7547-4b65-a0d4-bfbc8e3b87a2 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/groups/2a4acb11aecc4bec92d74fb9ad57f643/users/c96d0b373d2348d9bdf4a1585fb3ae44` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:15.788837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e94b2-7547-4b65-a0d4-bfbc8e3b87a2 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=2a4acb11aecc4bec92d74fb9ad57f643, user_id=c96d0b373d2348d9bdf4a1585fb3ae44)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:15.792230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e94b2-7547-4b65-a0d4-bfbc8e3b87a2 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:15.818178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5b5e94b2-7547-4b65-a0d4-bfbc8e3b87a2 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c96d0b373d2348d9bdf4a1585fb3ae44'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:15.853579 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2318/4643] 10.222.0.17 () {58 vars in 1344 bytes} [Sat Jul 30 21:17:15 2022] DELETE /identity/v3/groups/2a4acb11aecc4bec92d74fb9ad57f643/users/c96d0b373d2348d9bdf4a1585fb3ae44 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:17:15.855325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bd0fc-afbc-4ff4-b34d-2f1760a182f7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:15.857035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-df1bd0fc-afbc-4ff4-b34d-2f1760a182f7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:15.877243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bd0fc-afbc-4ff4-b34d-2f1760a182f7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:16.020045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec704ba-7e36-4da1-b03c-3d54c9d91a4e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:16.020781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec704ba-7e36-4da1-b03c-3d54c9d91a4e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:16.021168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec704ba-7e36-4da1-b03c-3d54c9d91a4e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:16.021993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec704ba-7e36-4da1-b03c-3d54c9d91a4e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/groups/2a4acb11aecc4bec92d74fb9ad57f643` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:16.024125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec704ba-7e36-4da1-b03c-3d54c9d91a4e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2a4acb11aecc4bec92d74fb9ad57f643)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:16.032968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec704ba-7e36-4da1-b03c-3d54c9d91a4e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:16.062802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:16.147464 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2326/4644] 10.222.0.17 () {58 vars in 1227 bytes} [Sat Jul 30 21:17:15 2022] DELETE /identity/v3/groups/2a4acb11aecc4bec92d74fb9ad57f643 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:16.152800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e94b2-7547-4b65-a0d4-bfbc8e3b87a2 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:16.170270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e94b2-7547-4b65-a0d4-bfbc8e3b87a2 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:16.184617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:16.305022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f8d97-a23e-445a-b0e3-420d9afd02b1 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:16.305452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f8d97-a23e-445a-b0e3-420d9afd02b1 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:16.305854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f8d97-a23e-445a-b0e3-420d9afd02b1 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:16.306212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f8d97-a23e-445a-b0e3-420d9afd02b1 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/roles/d332b75933174a20bfa358a2facdf2e9` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:16.307948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f8d97-a23e-445a-b0e3-420d9afd02b1 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d332b75933174a20bfa358a2facdf2e9)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:16.309752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f8d97-a23e-445a-b0e3-420d9afd02b1 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:16.376583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9d8f8d97-a23e-445a-b0e3-420d9afd02b1 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invalidating the token cache because role d332b75933174a20bfa358a2facdf2e9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:16.376951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9d8f8d97-a23e-445a-b0e3-420d9afd02b1 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:16.378496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9d8f8d97-a23e-445a-b0e3-420d9afd02b1 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:16.385878 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2319/4645] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:16 2022] DELETE /identity/v3/roles/d332b75933174a20bfa358a2facdf2e9 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:16.390839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec704ba-7e36-4da1-b03c-3d54c9d91a4e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:16.394174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6ec704ba-7e36-4da1-b03c-3d54c9d91a4e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:16.433175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec704ba-7e36-4da1-b03c-3d54c9d91a4e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:16.594283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e953b-66b3-476b-817c-ae69c68dbe8f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:16.596045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e953b-66b3-476b-817c-ae69c68dbe8f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:16.600168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e953b-66b3-476b-817c-ae69c68dbe8f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:16.600752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e953b-66b3-476b-817c-ae69c68dbe8f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains/cd272a901746486ca368a951090b95c1` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:16.607229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e953b-66b3-476b-817c-ae69c68dbe8f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=cd272a901746486ca368a951090b95c1)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:16.609380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e953b-66b3-476b-817c-ae69c68dbe8f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:16.672393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-305e953b-66b3-476b-817c-ae69c68dbe8f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'cd272a901746486ca368a951090b95c1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:16.673434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-305e953b-66b3-476b-817c-ae69c68dbe8f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'cd272a901746486ca368a951090b95c1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:16.718109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-305e953b-66b3-476b-817c-ae69c68dbe8f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'cd272a901746486ca368a951090b95c1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:16.718918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-305e953b-66b3-476b-817c-ae69c68dbe8f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'cd272a901746486ca368a951090b95c1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:16.724615 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2327/4646] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:17:16 2022] PATCH /identity/v3/domains/cd272a901746486ca368a951090b95c1 => generated 278 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:17:16.726308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f8d97-a23e-445a-b0e3-420d9afd02b1 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:16.741740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f8d97-a23e-445a-b0e3-420d9afd02b1 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:16.743737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e953b-66b3-476b-817c-ae69c68dbe8f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:16.745509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-305e953b-66b3-476b-817c-ae69c68dbe8f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:16.823091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb3121-aa71-4e9c-b122-dbbf515593c6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:16.824762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb3121-aa71-4e9c-b122-dbbf515593c6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:16.825050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb3121-aa71-4e9c-b122-dbbf515593c6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:16.825418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb3121-aa71-4e9c-b122-dbbf515593c6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains/cd272a901746486ca368a951090b95c1` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:16.842984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb3121-aa71-4e9c-b122-dbbf515593c6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=cd272a901746486ca368a951090b95c1)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:16.844870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb3121-aa71-4e9c-b122-dbbf515593c6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:16.854301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e953b-66b3-476b-817c-ae69c68dbe8f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:16.861632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38019265-3a21-4622-a179-e32d22032968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:16.861632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38019265-3a21-4622-a179-e32d22032968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:16.862320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38019265-3a21-4622-a179-e32d22032968 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:16.862320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38019265-3a21-4622-a179-e32d22032968 admin admin] PATH_INFO: `/v3/projects/2c38e89043a04558ab6cdfd272899dbc` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:16.864128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38019265-3a21-4622-a179-e32d22032968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c38e89043a04558ab6cdfd272899dbc)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:16.866373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38019265-3a21-4622-a179-e32d22032968 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:16.907310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cebb3121-aa71-4e9c-b122-dbbf515593c6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'cd272a901746486ca368a951090b95c1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:16.917053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cebb3121-aa71-4e9c-b122-dbbf515593c6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'cd272a901746486ca368a951090b95c1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:16.929617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:UPDATE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:16.943952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-38019265-3a21-4622-a179-e32d22032968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c38e89043a04558ab6cdfd272899dbc', 'request_id': 'req-38019265-3a21-4622-a179-e32d22032968'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:16.952292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-38019265-3a21-4622-a179-e32d22032968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c38e89043a04558ab6cdfd272899dbc', 'request_id': 'req-38019265-3a21-4622-a179-e32d22032968'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:16.962170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-38019265-3a21-4622-a179-e32d22032968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c38e89043a04558ab6cdfd272899dbc', 'request_id': 'req-38019265-3a21-4622-a179-e32d22032968'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:16.976514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-38019265-3a21-4622-a179-e32d22032968 admin admin] The token cache is being invalidate because project 2c38e89043a04558ab6cdfd272899dbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:16.976781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-38019265-3a21-4622-a179-e32d22032968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:16.977544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-38019265-3a21-4622-a179-e32d22032968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:16.984161 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2328/4647] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:16 2022] DELETE /identity/v3/projects/2c38e89043a04558ab6cdfd272899dbc => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:16.985834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d36d1-f918-4552-82a7-aba7442497bc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:16.986289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:16.987394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d36d1-f918-4552-82a7-aba7442497bc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:16.987888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d36d1-f918-4552-82a7-aba7442497bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:16.995347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cebb3121-aa71-4e9c-b122-dbbf515593c6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd272a901746486ca368a951090b95c1', 'request_id': 'req-cebb3121-aa71-4e9c-b122-dbbf515593c6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:17.017841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cebb3121-aa71-4e9c-b122-dbbf515593c6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd272a901746486ca368a951090b95c1', 'request_id': 'req-cebb3121-aa71-4e9c-b122-dbbf515593c6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:17.032203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cebb3121-aa71-4e9c-b122-dbbf515593c6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd272a901746486ca368a951090b95c1', 'request_id': 'req-cebb3121-aa71-4e9c-b122-dbbf515593c6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:17.037889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c55d36d1-f918-4552-82a7-aba7442497bc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:17.039178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c55d36d1-f918-4552-82a7-aba7442497bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:17.047910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cebb3121-aa71-4e9c-b122-dbbf515593c6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] The token cache is being invalidate because project cd272a901746486ca368a951090b95c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:17.048309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cebb3121-aa71-4e9c-b122-dbbf515593c6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:17.049298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cebb3121-aa71-4e9c-b122-dbbf515593c6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:17.061977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cebb3121-aa71-4e9c-b122-dbbf515593c6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'cd272a901746486ca368a951090b95c1', 'request_id': 'req-cebb3121-aa71-4e9c-b122-dbbf515593c6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:17.067871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cebb3121-aa71-4e9c-b122-dbbf515593c6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'cd272a901746486ca368a951090b95c1', 'request_id': 'req-cebb3121-aa71-4e9c-b122-dbbf515593c6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:17.068625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cebb3121-aa71-4e9c-b122-dbbf515593c6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'cd272a901746486ca368a951090b95c1', 'request_id': 'req-cebb3121-aa71-4e9c-b122-dbbf515593c6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:17.079107 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2320/4648] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:17:16 2022] DELETE /identity/v3/domains/cd272a901746486ca368a951090b95c1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:17.081146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb3121-aa71-4e9c-b122-dbbf515593c6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:17.083105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cebb3121-aa71-4e9c-b122-dbbf515593c6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:17.138982 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2329/4649] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:17.146984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aed30-b1f1-4a4f-ad35-addcc741a798 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:17.148602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aed30-b1f1-4a4f-ad35-addcc741a798 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:17.149671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aed30-b1f1-4a4f-ad35-addcc741a798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:17.185878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb3121-aa71-4e9c-b122-dbbf515593c6 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:17.194226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e91eea-803a-4e40-ab59-9a40179d4f77 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:17.194879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e91eea-803a-4e40-ab59-9a40179d4f77 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:17.195170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e91eea-803a-4e40-ab59-9a40179d4f77 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:17.195680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e91eea-803a-4e40-ab59-9a40179d4f77 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains/b969bf544da14fc5919dbc3edb143584/users/c96d0b373d2348d9bdf4a1585fb3ae44/roles/ecfb260f9b064e3ea8dfb03f6849064a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:17.199049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e91eea-803a-4e40-ab59-9a40179d4f77 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=b969bf544da14fc5919dbc3edb143584, user_id=c96d0b373d2348d9bdf4a1585fb3ae44, role_id=ecfb260f9b064e3ea8dfb03f6849064a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:17.199802 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-87e91eea-803a-4e40-ab59-9a40179d4f77 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:17:17.199802 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:17:17.199802 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:17:17.201766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e91eea-803a-4e40-ab59-9a40179d4f77 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:17.208503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d52aed30-b1f1-4a4f-ad35-addcc741a798 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:17.210324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d52aed30-b1f1-4a4f-ad35-addcc741a798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:17.210950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-87e91eea-803a-4e40-ab59-9a40179d4f77 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invalidating the token cache because role ecfb260f9b064e3ea8dfb03f6849064a was removed from user c96d0b373d2348d9bdf4a1585fb3ae44 on domain b969bf544da14fc5919dbc3edb143584. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:17.211257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-87e91eea-803a-4e40-ab59-9a40179d4f77 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:17.212533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-87e91eea-803a-4e40-ab59-9a40179d4f77 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:17.224696 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2330/4650] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:17.229678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aed30-b1f1-4a4f-ad35-addcc741a798 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:17.241392 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2321/4651] 10.222.0.17 () {58 vars in 1464 bytes} [Sat Jul 30 21:17:17 2022] DELETE /identity/v3/domains/b969bf544da14fc5919dbc3edb143584/users/c96d0b373d2348d9bdf4a1585fb3ae44/roles/ecfb260f9b064e3ea8dfb03f6849064a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:17.246294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e91eea-803a-4e40-ab59-9a40179d4f77 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:17.247031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aed30-b1f1-4a4f-ad35-addcc741a798 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:17.248487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-87e91eea-803a-4e40-ab59-9a40179d4f77 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:17.321735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef390f7-8f69-4984-bbf8-6afff08776a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:17.322534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef390f7-8f69-4984-bbf8-6afff08776a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:17.322920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef390f7-8f69-4984-bbf8-6afff08776a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:17.323321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef390f7-8f69-4984-bbf8-6afff08776a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:17.324187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef390f7-8f69-4984-bbf8-6afff08776a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:17:17.324924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef390f7-8f69-4984-bbf8-6afff08776a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:17.326665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef390f7-8f69-4984-bbf8-6afff08776a9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:17.342958 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2331/4652] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:17:17.348429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef390f7-8f69-4984-bbf8-6afff08776a9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:17.364671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef390f7-8f69-4984-bbf8-6afff08776a9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:17.372670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7666fd-6a10-467c-84cc-43aeb0195972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:17.373411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7666fd-6a10-467c-84cc-43aeb0195972 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:17.373948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7666fd-6a10-467c-84cc-43aeb0195972 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:17.374341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7666fd-6a10-467c-84cc-43aeb0195972 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:17.376890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7666fd-6a10-467c-84cc-43aeb0195972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:17.380811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7666fd-6a10-467c-84cc-43aeb0195972 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:17.405482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e91eea-803a-4e40-ab59-9a40179d4f77 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:17.421344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fc2a9-96f2-44ec-a016-3dc0c80c33e5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:17.422415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fc2a9-96f2-44ec-a016-3dc0c80c33e5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:17.423034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fc2a9-96f2-44ec-a016-3dc0c80c33e5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:17.423989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fc2a9-96f2-44ec-a016-3dc0c80c33e5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/roles/ecfb260f9b064e3ea8dfb03f6849064a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:17.429942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490fc2a9-96f2-44ec-a016-3dc0c80c33e5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ecfb260f9b064e3ea8dfb03f6849064a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:17.432053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490fc2a9-96f2-44ec-a016-3dc0c80c33e5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:17.437196 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2332/4653] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:17 2022] POST /identity/v3/projects => generated 393 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:17.438647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7666fd-6a10-467c-84cc-43aeb0195972 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:17.507882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-490fc2a9-96f2-44ec-a016-3dc0c80c33e5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invalidating the token cache because role ecfb260f9b064e3ea8dfb03f6849064a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:17.508294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-490fc2a9-96f2-44ec-a016-3dc0c80c33e5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:17.509562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-490fc2a9-96f2-44ec-a016-3dc0c80c33e5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:17.512148 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2322/4654] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:17 2022] DELETE /identity/v3/roles/ecfb260f9b064e3ea8dfb03f6849064a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:17.517106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:17.518584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fc2a9-96f2-44ec-a016-3dc0c80c33e5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:17.522513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-490fc2a9-96f2-44ec-a016-3dc0c80c33e5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:17.546738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:17.590579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7666fd-6a10-467c-84cc-43aeb0195972 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:17.666607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fc2a9-96f2-44ec-a016-3dc0c80c33e5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:17.680449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b91fc1-213f-4d68-8378-51b36f59d39b tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:17.681585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b91fc1-213f-4d68-8378-51b36f59d39b tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:17.681881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b91fc1-213f-4d68-8378-51b36f59d39b tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:17.682168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b91fc1-213f-4d68-8378-51b36f59d39b tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains/b969bf544da14fc5919dbc3edb143584` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:17.688566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b91fc1-213f-4d68-8378-51b36f59d39b tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b969bf544da14fc5919dbc3edb143584)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:17.690385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b91fc1-213f-4d68-8378-51b36f59d39b tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:17.738918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb90077-f20a-4f73-8f36-041470154be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:17.740738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb90077-f20a-4f73-8f36-041470154be4 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:17.743881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb90077-f20a-4f73-8f36-041470154be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:17.744208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb90077-f20a-4f73-8f36-041470154be4 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:17.744986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb90077-f20a-4f73-8f36-041470154be4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:17.749225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb90077-f20a-4f73-8f36-041470154be4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:17.755697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-33b91fc1-213f-4d68-8378-51b36f59d39b tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b969bf544da14fc5919dbc3edb143584'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:17.757644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-33b91fc1-213f-4d68-8378-51b36f59d39b tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b969bf544da14fc5919dbc3edb143584'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:17.808452 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2333/4655] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:17:17 2022] POST /identity/v3/users => generated 297 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:17.811328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb90077-f20a-4f73-8f36-041470154be4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:17.816036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2fb90077-f20a-4f73-8f36-041470154be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:17.831185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-33b91fc1-213f-4d68-8378-51b36f59d39b tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b969bf544da14fc5919dbc3edb143584'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:17.836291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-33b91fc1-213f-4d68-8378-51b36f59d39b tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b969bf544da14fc5919dbc3edb143584'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:17.842491 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2323/4656] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:17:17 2022] PATCH /identity/v3/domains/b969bf544da14fc5919dbc3edb143584 => generated 276 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:17:17.847408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb90077-f20a-4f73-8f36-041470154be4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:17.848946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b91fc1-213f-4d68-8378-51b36f59d39b tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:17.851473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-33b91fc1-213f-4d68-8378-51b36f59d39b tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:18.038384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b91fc1-213f-4d68-8378-51b36f59d39b tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:18.053097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641423cf-34bf-4e0d-ac18-5df41ffb5cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:18.053826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641423cf-34bf-4e0d-ac18-5df41ffb5cee admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:18.054040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641423cf-34bf-4e0d-ac18-5df41ffb5cee admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:18.054322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641423cf-34bf-4e0d-ac18-5df41ffb5cee admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:18.055028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641423cf-34bf-4e0d-ac18-5df41ffb5cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:18.056645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef7119-781a-42f3-bcb3-34a656af7869 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:18.057266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641423cf-34bf-4e0d-ac18-5df41ffb5cee admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:18.058025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef7119-781a-42f3-bcb3-34a656af7869 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:18.058387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef7119-781a-42f3-bcb3-34a656af7869 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:18.058805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef7119-781a-42f3-bcb3-34a656af7869 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains/b969bf544da14fc5919dbc3edb143584` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:18.104899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef7119-781a-42f3-bcb3-34a656af7869 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b969bf544da14fc5919dbc3edb143584)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:18.104899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef7119-781a-42f3-bcb3-34a656af7869 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:18.106869 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2334/4657] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:18.120190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641423cf-34bf-4e0d-ac18-5df41ffb5cee admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:18.123171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-641423cf-34bf-4e0d-ac18-5df41ffb5cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:18.142496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641423cf-34bf-4e0d-ac18-5df41ffb5cee admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:18.152916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914d96d-d856-44df-90ea-e49e2d323ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:18.154156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914d96d-d856-44df-90ea-e49e2d323ecc admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:18.154665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914d96d-d856-44df-90ea-e49e2d323ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:18.155460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914d96d-d856-44df-90ea-e49e2d323ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:18.157041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914d96d-d856-44df-90ea-e49e2d323ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:18.161346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914d96d-d856-44df-90ea-e49e2d323ecc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:18.190120 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2335/4658] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:18.190371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-faef7119-781a-42f3-bcb3-34a656af7869 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b969bf544da14fc5919dbc3edb143584'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:18.193236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914d96d-d856-44df-90ea-e49e2d323ecc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:18.200317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-faef7119-781a-42f3-bcb3-34a656af7869 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b969bf544da14fc5919dbc3edb143584'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:18.213669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914d96d-d856-44df-90ea-e49e2d323ecc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:18.223408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81230a14-1e86-4472-b746-da0eea7f1145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:18.226895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81230a14-1e86-4472-b746-da0eea7f1145 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:18.227615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81230a14-1e86-4472-b746-da0eea7f1145 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:18.228120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81230a14-1e86-4472-b746-da0eea7f1145 admin admin] PATH_INFO: `/v3/projects/337bb83600d7464bad03a15d3bbe7d6f/users/20bea5c4d7ee4dec90aeda50c35f68e6/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:18.264406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81230a14-1e86-4472-b746-da0eea7f1145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=337bb83600d7464bad03a15d3bbe7d6f, user_id=20bea5c4d7ee4dec90aeda50c35f68e6, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:18.269835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81230a14-1e86-4472-b746-da0eea7f1145 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:18.309947 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2336/4659] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:18 2022] PUT /identity/v3/projects/337bb83600d7464bad03a15d3bbe7d6f/users/20bea5c4d7ee4dec90aeda50c35f68e6/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:18.316748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:18.316748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-faef7119-781a-42f3-bcb3-34a656af7869 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b969bf544da14fc5919dbc3edb143584', 'request_id': 'req-faef7119-781a-42f3-bcb3-34a656af7869'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:18.322735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49d45c-3db3-4a5a-8c1e-fea9671e9fb6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:18.323350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49d45c-3db3-4a5a-8c1e-fea9671e9fb6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:18.323691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49d45c-3db3-4a5a-8c1e-fea9671e9fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:18.335606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-faef7119-781a-42f3-bcb3-34a656af7869 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b969bf544da14fc5919dbc3edb143584', 'request_id': 'req-faef7119-781a-42f3-bcb3-34a656af7869'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:18.344734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-faef7119-781a-42f3-bcb3-34a656af7869 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b969bf544da14fc5919dbc3edb143584', 'request_id': 'req-faef7119-781a-42f3-bcb3-34a656af7869'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:18.375832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-faef7119-781a-42f3-bcb3-34a656af7869 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] The token cache is being invalidate because project b969bf544da14fc5919dbc3edb143584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:18.376113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-faef7119-781a-42f3-bcb3-34a656af7869 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:18.377100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-faef7119-781a-42f3-bcb3-34a656af7869 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:18.391504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-faef7119-781a-42f3-bcb3-34a656af7869 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b969bf544da14fc5919dbc3edb143584', 'request_id': 'req-faef7119-781a-42f3-bcb3-34a656af7869'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:18.397635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-cc49d45c-3db3-4a5a-8c1e-fea9671e9fb6 None None] MFA Rules not processed for user `20bea5c4d7ee4dec90aeda50c35f68e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:18.399041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-faef7119-781a-42f3-bcb3-34a656af7869 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b969bf544da14fc5919dbc3edb143584', 'request_id': 'req-faef7119-781a-42f3-bcb3-34a656af7869'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:18.400975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cc49d45c-3db3-4a5a-8c1e-fea9671e9fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:18.401136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-faef7119-781a-42f3-bcb3-34a656af7869 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b969bf544da14fc5919dbc3edb143584', 'request_id': 'req-faef7119-781a-42f3-bcb3-34a656af7869'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:18.421818 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2324/4660] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:17:17 2022] DELETE /identity/v3/domains/b969bf544da14fc5919dbc3edb143584 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:18.424619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef7119-781a-42f3-bcb3-34a656af7869 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:18.426101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-faef7119-781a-42f3-bcb3-34a656af7869 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:18.440870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:18.544928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef7119-781a-42f3-bcb3-34a656af7869 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:18.576771 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2337/4661] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:18.579026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49d45c-3db3-4a5a-8c1e-fea9671e9fb6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:18.583161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cc49d45c-3db3-4a5a-8c1e-fea9671e9fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:18.662229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fd67a-0411-484a-9471-f9db05d25b26 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:18.664900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fd67a-0411-484a-9471-f9db05d25b26 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:18.666645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fd67a-0411-484a-9471-f9db05d25b26 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:18.668257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fd67a-0411-484a-9471-f9db05d25b26 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:18.670949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fd67a-0411-484a-9471-f9db05d25b26 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:18.676086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fd67a-0411-484a-9471-f9db05d25b26 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:18.706561 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2325/4662] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:17:18.710593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fd67a-0411-484a-9471-f9db05d25b26 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:18.733454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49d45c-3db3-4a5a-8c1e-fea9671e9fb6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:18.736583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fd67a-0411-484a-9471-f9db05d25b26 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:18.745464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337ec13-2d42-4892-8bcc-508e8c9b34c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:18.746393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337ec13-2d42-4892-8bcc-508e8c9b34c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:18.746736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337ec13-2d42-4892-8bcc-508e8c9b34c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:18.747033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337ec13-2d42-4892-8bcc-508e8c9b34c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:18.748409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337ec13-2d42-4892-8bcc-508e8c9b34c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:18.749932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d327d-31bf-4ea3-a50f-16a95ab5dd54 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:18.752225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d327d-31bf-4ea3-a50f-16a95ab5dd54 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:18.752520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d327d-31bf-4ea3-a50f-16a95ab5dd54 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:18.753707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337ec13-2d42-4892-8bcc-508e8c9b34c9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:18.754290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d327d-31bf-4ea3-a50f-16a95ab5dd54 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/projects/818eed3e1a5148dfa032c63907f1c9ec/users/70c88881793f437d8b7b000085857ccb/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:18.758270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d327d-31bf-4ea3-a50f-16a95ab5dd54 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_grant(project_id=818eed3e1a5148dfa032c63907f1c9ec, user_id=70c88881793f437d8b7b000085857ccb, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:18.766595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d327d-31bf-4ea3-a50f-16a95ab5dd54 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:18.805446 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2326/4663] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:18 2022] PUT /identity/v3/projects/818eed3e1a5148dfa032c63907f1c9ec/users/70c88881793f437d8b7b000085857ccb/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:18.810051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d327d-31bf-4ea3-a50f-16a95ab5dd54 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:18.818901 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2338/4664] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:18 2022] POST /identity/v3/projects => generated 391 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:18.824940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337ec13-2d42-4892-8bcc-508e8c9b34c9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:18.926104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:18.938447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337ec13-2d42-4892-8bcc-508e8c9b34c9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:18.947685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e523b-1051-49a4-a86e-f689be6e63b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:18.949533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e523b-1051-49a4-a86e-f689be6e63b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:18.949914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e523b-1051-49a4-a86e-f689be6e63b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:18.950510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e523b-1051-49a4-a86e-f689be6e63b1 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:18.951334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e523b-1051-49a4-a86e-f689be6e63b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:18.954250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e523b-1051-49a4-a86e-f689be6e63b1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:18.960874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d327d-31bf-4ea3-a50f-16a95ab5dd54 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:19.032434 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2339/4665] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:17:18 2022] POST /identity/v3/users => generated 302 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:19.034485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e523b-1051-49a4-a86e-f689be6e63b1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:19.049524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e523b-1051-49a4-a86e-f689be6e63b1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:19.065926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcafbe-fc67-4234-8558-ced0318522c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:19.069136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcafbe-fc67-4234-8558-ced0318522c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:19.069672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcafbe-fc67-4234-8558-ced0318522c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:19.070182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcafbe-fc67-4234-8558-ced0318522c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:19.071346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcafbe-fc67-4234-8558-ced0318522c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:19.076219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcafbe-fc67-4234-8558-ced0318522c0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:19.107876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281f54a-965f-419e-977f-a39d3fbeedaa tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:19.108624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281f54a-965f-419e-977f-a39d3fbeedaa tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:19.108917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281f54a-965f-419e-977f-a39d3fbeedaa tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:19.109204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281f54a-965f-419e-977f-a39d3fbeedaa tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:19.110540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281f54a-965f-419e-977f-a39d3fbeedaa tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:19.111952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281f54a-965f-419e-977f-a39d3fbeedaa tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:19.136954 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2340/4666] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:19.141280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcafbe-fc67-4234-8558-ced0318522c0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:19.168040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcafbe-fc67-4234-8558-ced0318522c0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:19.177750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacb91f-c6c4-4448-be90-9bf4ece66936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:19.177750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacb91f-c6c4-4448-be90-9bf4ece66936 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:19.178380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacb91f-c6c4-4448-be90-9bf4ece66936 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:19.178812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacb91f-c6c4-4448-be90-9bf4ece66936 admin admin] PATH_INFO: `/v3/projects/72205a9d5b204c1381410e9c3ba0d6be/users/20078c39c8c9465d853138c72693dac8/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:19.202460 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2327/4667] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:17:18 2022] GET /identity/v3/auth/projects => generated 824 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:17:19.207009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eacb91f-c6c4-4448-be90-9bf4ece66936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72205a9d5b204c1381410e9c3ba0d6be, user_id=20078c39c8c9465d853138c72693dac8, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:19.207250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281f54a-965f-419e-977f-a39d3fbeedaa tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:19.210661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eacb91f-c6c4-4448-be90-9bf4ece66936 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:19.231479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281f54a-965f-419e-977f-a39d3fbeedaa tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:19.244697 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2341/4668] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:19 2022] PUT /identity/v3/projects/72205a9d5b204c1381410e9c3ba0d6be/users/20078c39c8c9465d853138c72693dac8/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:19.249216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacb91f-c6c4-4448-be90-9bf4ece66936 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:19.259053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:19.321862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b07ddf-dd78-4b5d-855d-92d82f6da65c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:19.322569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b07ddf-dd78-4b5d-855d-92d82f6da65c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:19.322859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b07ddf-dd78-4b5d-855d-92d82f6da65c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:19.323145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b07ddf-dd78-4b5d-855d-92d82f6da65c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/projects/818eed3e1a5148dfa032c63907f1c9ec/users/70c88881793f437d8b7b000085857ccb/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:19.330659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b07ddf-dd78-4b5d-855d-92d82f6da65c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=818eed3e1a5148dfa032c63907f1c9ec, user_id=70c88881793f437d8b7b000085857ccb, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:19.337070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b07ddf-dd78-4b5d-855d-92d82f6da65c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:19.340848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacb91f-c6c4-4448-be90-9bf4ece66936 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:19.348631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae545a2a-3546-4555-88ef-ccc9c904e0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:19.349409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae545a2a-3546-4555-88ef-ccc9c904e0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:19.349826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae545a2a-3546-4555-88ef-ccc9c904e0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:19.350203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae545a2a-3546-4555-88ef-ccc9c904e0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:19.350851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-33b07ddf-dd78-4b5d-855d-92d82f6da65c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invalidating the token cache because role 3b89b89da98d4ec08a0587aa13832636 was removed from user 70c88881793f437d8b7b000085857ccb on project 818eed3e1a5148dfa032c63907f1c9ec. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:19.351181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-33b07ddf-dd78-4b5d-855d-92d82f6da65c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:19.351462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae545a2a-3546-4555-88ef-ccc9c904e0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:19.354862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae545a2a-3546-4555-88ef-ccc9c904e0d5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:19.355041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-33b07ddf-dd78-4b5d-855d-92d82f6da65c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:19.369733 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2342/4669] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:19.374530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae545a2a-3546-4555-88ef-ccc9c904e0d5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:19.379106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ae545a2a-3546-4555-88ef-ccc9c904e0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:19.382822 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2328/4670] 10.222.0.17 () {58 vars in 1467 bytes} [Sat Jul 30 21:17:19 2022] DELETE /identity/v3/projects/818eed3e1a5148dfa032c63907f1c9ec/users/70c88881793f437d8b7b000085857ccb/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:19.389098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b07ddf-dd78-4b5d-855d-92d82f6da65c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:19.392298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-33b07ddf-dd78-4b5d-855d-92d82f6da65c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:19.422885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae545a2a-3546-4555-88ef-ccc9c904e0d5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:19.465746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:19.516897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b07ddf-dd78-4b5d-855d-92d82f6da65c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:19.563907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299893fe-2308-448e-8b68-7e8af9433cce tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:19.564669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299893fe-2308-448e-8b68-7e8af9433cce tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:19.564964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299893fe-2308-448e-8b68-7e8af9433cce tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:19.565276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299893fe-2308-448e-8b68-7e8af9433cce tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:19.573718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299893fe-2308-448e-8b68-7e8af9433cce tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:19.578045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299893fe-2308-448e-8b68-7e8af9433cce tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:19.585685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f139cfc-1fe3-406d-a06e-3377b9443b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:19.588901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f139cfc-1fe3-406d-a06e-3377b9443b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:19.589553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f139cfc-1fe3-406d-a06e-3377b9443b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:19.590053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f139cfc-1fe3-406d-a06e-3377b9443b97 admin admin] PATH_INFO: `/v3/projects/72205a9d5b204c1381410e9c3ba0d6be/users/20078c39c8c9465d853138c72693dac8/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:19.592865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f139cfc-1fe3-406d-a06e-3377b9443b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72205a9d5b204c1381410e9c3ba0d6be, user_id=20078c39c8c9465d853138c72693dac8, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:19.595960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f139cfc-1fe3-406d-a06e-3377b9443b97 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:19.621462 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2343/4671] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:19 2022] PUT /identity/v3/projects/72205a9d5b204c1381410e9c3ba0d6be/users/20078c39c8c9465d853138c72693dac8/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:19.632249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aa18e-02e5-459d-9195-1e61975cd922 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:19.632249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aa18e-02e5-459d-9195-1e61975cd922 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:19.633237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aa18e-02e5-459d-9195-1e61975cd922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:19.651250 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2329/4672] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:17:19 2022] POST /identity/v3/users => generated 323 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:17:19.655080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299893fe-2308-448e-8b68-7e8af9433cce tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:19.679097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299893fe-2308-448e-8b68-7e8af9433cce tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:19.720593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-fe4aa18e-02e5-459d-9195-1e61975cd922 None None] MFA Rules not processed for user `20078c39c8c9465d853138c72693dac8`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:19.725238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fe4aa18e-02e5-459d-9195-1e61975cd922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:19.835648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4f6fe-55b3-4f9d-af56-11001ad8496f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:19.837925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4f6fe-55b3-4f9d-af56-11001ad8496f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:19.838414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4f6fe-55b3-4f9d-af56-11001ad8496f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:19.839037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4f6fe-55b3-4f9d-af56-11001ad8496f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:19.840295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4f6fe-55b3-4f9d-af56-11001ad8496f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:19.844768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4f6fe-55b3-4f9d-af56-11001ad8496f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:19.891138 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2330/4673] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:19 2022] POST /identity/v3/projects => generated 362 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:19.896456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4f6fe-55b3-4f9d-af56-11001ad8496f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:19.936114 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2344/4674] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:19.945567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4aa18e-02e5-459d-9195-1e61975cd922 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:19.947576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fe4aa18e-02e5-459d-9195-1e61975cd922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:20.004857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:20.054409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4f6fe-55b3-4f9d-af56-11001ad8496f tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:20.065044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae34770-b0ce-4c47-8542-f59953f8c0d7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:20.065837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae34770-b0ce-4c47-8542-f59953f8c0d7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:20.066727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae34770-b0ce-4c47-8542-f59953f8c0d7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:20.067833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae34770-b0ce-4c47-8542-f59953f8c0d7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:20.068600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae34770-b0ce-4c47-8542-f59953f8c0d7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:20.072276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae34770-b0ce-4c47-8542-f59953f8c0d7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:20.087788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4aa18e-02e5-459d-9195-1e61975cd922 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:20.125007 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2331/4675] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:19 2022] POST /identity/v3/projects => generated 363 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:20.129576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae34770-b0ce-4c47-8542-f59953f8c0d7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:20.193580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bc6a9-2694-490b-b282-49a963275b01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:20.194239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bc6a9-2694-490b-b282-49a963275b01 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:20.194627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bc6a9-2694-490b-b282-49a963275b01 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:20.194995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bc6a9-2694-490b-b282-49a963275b01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:20.249031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:20.307088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae34770-b0ce-4c47-8542-f59953f8c0d7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:20.313452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04bc6a9-2694-490b-b282-49a963275b01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:20.315487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04bc6a9-2694-490b-b282-49a963275b01 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:20.326435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523c49a-b92a-4be9-a853-a07ca9ecc9cf tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:20.327444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523c49a-b92a-4be9-a853-a07ca9ecc9cf tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:20.327745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523c49a-b92a-4be9-a853-a07ca9ecc9cf tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:20.328036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523c49a-b92a-4be9-a853-a07ca9ecc9cf tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:20.328812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523c49a-b92a-4be9-a853-a07ca9ecc9cf tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:20.330567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523c49a-b92a-4be9-a853-a07ca9ecc9cf tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:20.335598 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2345/4676] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:17:20.360795 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2332/4677] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:17:20 2022] POST /identity/v3/roles => generated 240 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:20.365893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bc6a9-2694-490b-b282-49a963275b01 service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:20.388148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bc6a9-2694-490b-b282-49a963275b01 service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:20.411158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e0254-8639-45d3-af9a-84231e76b843 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:20.412313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e0254-8639-45d3-af9a-84231e76b843 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:20.412731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e0254-8639-45d3-af9a-84231e76b843 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:20.412939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e0254-8639-45d3-af9a-84231e76b843 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/projects/a1606cd07d124fa08a8dc1b771cecf58/users/e0676ca73fef4b4b8de3f2cd99a9cf07/roles/8ecf6b8155134459a26f6765a14fc163` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:20.430482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523c49a-b92a-4be9-a853-a07ca9ecc9cf tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:20.433492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3523c49a-b92a-4be9-a853-a07ca9ecc9cf tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:20.479152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e0254-8639-45d3-af9a-84231e76b843 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a1606cd07d124fa08a8dc1b771cecf58, user_id=e0676ca73fef4b4b8de3f2cd99a9cf07, role_id=8ecf6b8155134459a26f6765a14fc163)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:20.501650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e0254-8639-45d3-af9a-84231e76b843 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:20.534522 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2346/4678] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:20 2022] PUT /identity/v3/projects/a1606cd07d124fa08a8dc1b771cecf58/users/e0676ca73fef4b4b8de3f2cd99a9cf07/roles/8ecf6b8155134459a26f6765a14fc163 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:17:20.536460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51051999-e166-4909-b615-56643f649856 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:20.537148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51051999-e166-4909-b615-56643f649856 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:20.537884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51051999-e166-4909-b615-56643f649856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:20.563862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-51051999-e166-4909-b615-56643f649856 None None] MFA Rules not processed for user `7369e2a4c5b24e85b94816e6404b300f`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:20.565718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-51051999-e166-4909-b615-56643f649856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:20.638320 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2347/4679] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:20.640150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51051999-e166-4909-b615-56643f649856 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:20.655206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:20.708162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523c49a-b92a-4be9-a853-a07ca9ecc9cf tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:20.749612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51051999-e166-4909-b615-56643f649856 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:20.780254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a87ec-1f89-40ef-aa27-c0d06f5e7a9c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:20.781123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a87ec-1f89-40ef-aa27-c0d06f5e7a9c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:20.781524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a87ec-1f89-40ef-aa27-c0d06f5e7a9c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:20.782102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a87ec-1f89-40ef-aa27-c0d06f5e7a9c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/projects/c651c27e0f934eba8ecdb870555346a2/users/e0676ca73fef4b4b8de3f2cd99a9cf07/roles/8ecf6b8155134459a26f6765a14fc163` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:20.785284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a87ec-1f89-40ef-aa27-c0d06f5e7a9c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c651c27e0f934eba8ecdb870555346a2, user_id=e0676ca73fef4b4b8de3f2cd99a9cf07, role_id=8ecf6b8155134459a26f6765a14fc163)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:20.790329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a87ec-1f89-40ef-aa27-c0d06f5e7a9c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:20.811560 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2348/4680] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:20 2022] PUT /identity/v3/projects/c651c27e0f934eba8ecdb870555346a2/users/e0676ca73fef4b4b8de3f2cd99a9cf07/roles/8ecf6b8155134459a26f6765a14fc163 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:20.813316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3f6b7-121d-4768-9d0a-885cf224c118 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:20.814663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3f6b7-121d-4768-9d0a-885cf224c118 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:20.815159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3f6b7-121d-4768-9d0a-885cf224c118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:20.842714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bec3f6b7-121d-4768-9d0a-885cf224c118 None None] MFA Rules not processed for user `7369e2a4c5b24e85b94816e6404b300f`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:20.844318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bec3f6b7-121d-4768-9d0a-885cf224c118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:20.872903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636acf15-ec39-47ca-87ca-6704b8a96bb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:20.873683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636acf15-ec39-47ca-87ca-6704b8a96bb3 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:20.873998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636acf15-ec39-47ca-87ca-6704b8a96bb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:20.874309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636acf15-ec39-47ca-87ca-6704b8a96bb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:20.880076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-636acf15-ec39-47ca-87ca-6704b8a96bb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:20.941244 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2349/4681] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:20.943409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cabcc0-46ae-4f49-a309-d9efa610e9b7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:20.944612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cabcc0-46ae-4f49-a309-d9efa610e9b7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:20.944612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cabcc0-46ae-4f49-a309-d9efa610e9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:20.985448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-53cabcc0-46ae-4f49-a309-d9efa610e9b7 None None] MFA Rules not processed for user `e0676ca73fef4b4b8de3f2cd99a9cf07`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:20.990073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-53cabcc0-46ae-4f49-a309-d9efa610e9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:21.001771 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2350/4682] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:20 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 21:17:21.006134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636acf15-ec39-47ca-87ca-6704b8a96bb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:21.008216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636acf15-ec39-47ca-87ca-6704b8a96bb3 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:21.011450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b745de-0d1a-4a64-9bdb-24dde58d3273 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:21.011920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b745de-0d1a-4a64-9bdb-24dde58d3273 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:21.012297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b745de-0d1a-4a64-9bdb-24dde58d3273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:21.036725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-28b745de-0d1a-4a64-9bdb-24dde58d3273 None None] MFA Rules not processed for user `e0676ca73fef4b4b8de3f2cd99a9cf07`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:21.038543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-28b745de-0d1a-4a64-9bdb-24dde58d3273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:21.041199 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2333/4683] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:17:21.164963 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2351/4684] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:21 2022] POST /identity/v3/auth/tokens => generated 3216 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 30 21:17:21.170584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636acf15-ec39-47ca-87ca-6704b8a96bb3 service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:21.186154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636acf15-ec39-47ca-87ca-6704b8a96bb3 service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:21.245660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:21.270372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec52501-1acc-4fa1-944b-fd6c75fbe964 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:21.271895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec52501-1acc-4fa1-944b-fd6c75fbe964 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:21.272483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec52501-1acc-4fa1-944b-fd6c75fbe964 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:21.273008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec52501-1acc-4fa1-944b-fd6c75fbe964 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:21.286179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec52501-1acc-4fa1-944b-fd6c75fbe964 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:21.288812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec52501-1acc-4fa1-944b-fd6c75fbe964 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:21.319625 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2334/4685] 10.222.0.17 () {56 vars in 1308 bytes} [Sat Jul 30 21:17:21 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:21.325293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70395413-2c1b-4bc5-a655-1ea0184a40c4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:21.325805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70395413-2c1b-4bc5-a655-1ea0184a40c4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:21.325966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70395413-2c1b-4bc5-a655-1ea0184a40c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:21.343190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-70395413-2c1b-4bc5-a655-1ea0184a40c4 None None] MFA Rules not processed for user `e0676ca73fef4b4b8de3f2cd99a9cf07`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:21.345436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-70395413-2c1b-4bc5-a655-1ea0184a40c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:21.394578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:21.462200 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2352/4686] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:21 2022] POST /identity/v3/auth/tokens => generated 3216 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 30 21:17:21.467618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec52501-1acc-4fa1-944b-fd6c75fbe964 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:21.481815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec52501-1acc-4fa1-944b-fd6c75fbe964 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:21.494505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e517e2b-506d-434e-b437-2cab4df3314e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:21.495363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e517e2b-506d-434e-b437-2cab4df3314e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:21.495779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e517e2b-506d-434e-b437-2cab4df3314e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:21.496379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e517e2b-506d-434e-b437-2cab4df3314e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/roles/8ecf6b8155134459a26f6765a14fc163` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:21.500126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e517e2b-506d-434e-b437-2cab4df3314e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8ecf6b8155134459a26f6765a14fc163)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:21.502034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e517e2b-506d-434e-b437-2cab4df3314e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:21.590973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0e517e2b-506d-434e-b437-2cab4df3314e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invalidating the token cache because role 8ecf6b8155134459a26f6765a14fc163 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:21.591362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0e517e2b-506d-434e-b437-2cab4df3314e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:21.593244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0e517e2b-506d-434e-b437-2cab4df3314e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:21.606940 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2335/4687] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:21 2022] DELETE /identity/v3/roles/8ecf6b8155134459a26f6765a14fc163 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:21.608256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70395413-2c1b-4bc5-a655-1ea0184a40c4 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:21.646102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70395413-2c1b-4bc5-a655-1ea0184a40c4 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:21.820223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b1920-f614-47ce-bd17-911a465dab3c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:21.820958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b1920-f614-47ce-bd17-911a465dab3c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:21.821303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b1920-f614-47ce-bd17-911a465dab3c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:21.822674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b1920-f614-47ce-bd17-911a465dab3c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/projects/c651c27e0f934eba8ecdb870555346a2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:21.824524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b1920-f614-47ce-bd17-911a465dab3c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c651c27e0f934eba8ecdb870555346a2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:21.826702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b1920-f614-47ce-bd17-911a465dab3c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:21.952300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da7b1920-f614-47ce-bd17-911a465dab3c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c651c27e0f934eba8ecdb870555346a2', 'request_id': 'req-da7b1920-f614-47ce-bd17-911a465dab3c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:21.959701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da7b1920-f614-47ce-bd17-911a465dab3c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c651c27e0f934eba8ecdb870555346a2', 'request_id': 'req-da7b1920-f614-47ce-bd17-911a465dab3c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:21.976714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da7b1920-f614-47ce-bd17-911a465dab3c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c651c27e0f934eba8ecdb870555346a2', 'request_id': 'req-da7b1920-f614-47ce-bd17-911a465dab3c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:21.999166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da7b1920-f614-47ce-bd17-911a465dab3c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] The token cache is being invalidate because project c651c27e0f934eba8ecdb870555346a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:21.999682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da7b1920-f614-47ce-bd17-911a465dab3c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:22.000570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-da7b1920-f614-47ce-bd17-911a465dab3c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:22.002703 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2353/4688] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:21 2022] DELETE /identity/v3/projects/c651c27e0f934eba8ecdb870555346a2 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:22.008133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e517e2b-506d-434e-b437-2cab4df3314e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:22.010109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0e517e2b-506d-434e-b437-2cab4df3314e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:22.030491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e517e2b-506d-434e-b437-2cab4df3314e tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:22.122386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615b0f8-7b27-4d86-8090-a3263ec8a1db tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:22.123855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615b0f8-7b27-4d86-8090-a3263ec8a1db tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:22.124412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615b0f8-7b27-4d86-8090-a3263ec8a1db tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:22.124956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615b0f8-7b27-4d86-8090-a3263ec8a1db tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/projects/c651c27e0f934eba8ecdb870555346a2` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:22.147237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615b0f8-7b27-4d86-8090-a3263ec8a1db tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c651c27e0f934eba8ecdb870555346a2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:22.150619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615b0f8-7b27-4d86-8090-a3263ec8a1db tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:22.172544 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-e615b0f8-7b27-4d86-8090-a3263ec8a1db tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Could not find project: c651c27e0f934eba8ecdb870555346a2.: keystone.exception.ProjectNotFound: Could not find project: c651c27e0f934eba8ecdb870555346a2. Jul 30 21:17:22.172544 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:17:22.172544 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:17:22.172544 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:17:22.172544 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:17:22.172544 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:17:22.172544 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:17:22.172544 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:17:22.172544 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:17:22.172544 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:17:22.172544 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:17:22.172544 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:17:22.172544 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 30 21:17:22.172544 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 30 21:17:22.174083 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:17:22.174083 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:17:22.174083 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 30 21:17:22.174083 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 30 21:17:22.174083 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 21:17:22.174083 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 21:17:22.174083 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 21:17:22.174083 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 21:17:22.174083 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c651c27e0f934eba8ecdb870555346a2. Jul 30 21:17:22.174083 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:17:22.174957 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2336/4689] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:22 2022] DELETE /identity/v3/projects/c651c27e0f934eba8ecdb870555346a2 => generated 113 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 30 21:17:22.179543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b1920-f614-47ce-bd17-911a465dab3c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:22.182230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-da7b1920-f614-47ce-bd17-911a465dab3c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:22.206492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b1920-f614-47ce-bd17-911a465dab3c tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:22.220260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20a06b-2c86-4e88-bc61-931693183d5d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:22.220942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20a06b-2c86-4e88-bc61-931693183d5d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:22.221263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20a06b-2c86-4e88-bc61-931693183d5d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:22.221491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20a06b-2c86-4e88-bc61-931693183d5d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/projects/a1606cd07d124fa08a8dc1b771cecf58` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:22.224844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20a06b-2c86-4e88-bc61-931693183d5d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a1606cd07d124fa08a8dc1b771cecf58)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:22.226904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20a06b-2c86-4e88-bc61-931693183d5d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:22.348879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4f20a06b-2c86-4e88-bc61-931693183d5d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1606cd07d124fa08a8dc1b771cecf58', 'request_id': 'req-4f20a06b-2c86-4e88-bc61-931693183d5d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:22.362212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4f20a06b-2c86-4e88-bc61-931693183d5d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1606cd07d124fa08a8dc1b771cecf58', 'request_id': 'req-4f20a06b-2c86-4e88-bc61-931693183d5d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:22.375538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4f20a06b-2c86-4e88-bc61-931693183d5d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1606cd07d124fa08a8dc1b771cecf58', 'request_id': 'req-4f20a06b-2c86-4e88-bc61-931693183d5d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:22.379869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:22.397600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4f20a06b-2c86-4e88-bc61-931693183d5d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] The token cache is being invalidate because project a1606cd07d124fa08a8dc1b771cecf58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:22.399017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4f20a06b-2c86-4e88-bc61-931693183d5d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:22.400386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4f20a06b-2c86-4e88-bc61-931693183d5d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:22.406312 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2354/4690] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:22 2022] DELETE /identity/v3/projects/a1606cd07d124fa08a8dc1b771cecf58 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:22.407134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615b0f8-7b27-4d86-8090-a3263ec8a1db tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:22.409260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e615b0f8-7b27-4d86-8090-a3263ec8a1db tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:22.428255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615b0f8-7b27-4d86-8090-a3263ec8a1db tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:22.530019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7170a16-5f5b-4145-94f8-cfa566b039c5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:22.531422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7170a16-5f5b-4145-94f8-cfa566b039c5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:22.531422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7170a16-5f5b-4145-94f8-cfa566b039c5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:22.531422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7170a16-5f5b-4145-94f8-cfa566b039c5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/users/e0676ca73fef4b4b8de3f2cd99a9cf07` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:22.533000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7170a16-5f5b-4145-94f8-cfa566b039c5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e0676ca73fef4b4b8de3f2cd99a9cf07)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:22.535158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7170a16-5f5b-4145-94f8-cfa566b039c5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:22.575137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:22.614625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7170a16-5f5b-4145-94f8-cfa566b039c5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0676ca73fef4b4b8de3f2cd99a9cf07'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:22.615363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7170a16-5f5b-4145-94f8-cfa566b039c5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0676ca73fef4b4b8de3f2cd99a9cf07'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:22.630434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7170a16-5f5b-4145-94f8-cfa566b039c5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0676ca73fef4b4b8de3f2cd99a9cf07'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:22.631268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7170a16-5f5b-4145-94f8-cfa566b039c5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0676ca73fef4b4b8de3f2cd99a9cf07'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:22.680948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7170a16-5f5b-4145-94f8-cfa566b039c5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0676ca73fef4b4b8de3f2cd99a9cf07'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:22.721779 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2337/4691] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:22 2022] DELETE /identity/v3/users/e0676ca73fef4b4b8de3f2cd99a9cf07 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:22.726474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20a06b-2c86-4e88-bc61-931693183d5d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:22.739006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20a06b-2c86-4e88-bc61-931693183d5d tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:22.819162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09399abb-c63c-4116-81d0-c4e978cb16c7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:22.819921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09399abb-c63c-4116-81d0-c4e978cb16c7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:22.820213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09399abb-c63c-4116-81d0-c4e978cb16c7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:22.820542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09399abb-c63c-4116-81d0-c4e978cb16c7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains/35ea8b2ffbca446c9ceca8365e98c1c2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:22.844900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09399abb-c63c-4116-81d0-c4e978cb16c7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 21:17:22.869642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-09399abb-c63c-4116-81d0-c4e978cb16c7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Could not find domain: 35ea8b2ffbca446c9ceca8365e98c1c2.: keystone.exception.DomainNotFound: Could not find domain: 35ea8b2ffbca446c9ceca8365e98c1c2. Jul 30 21:17:22.869642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:17:22.869642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 30 21:17:22.869642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 30 21:17:22.869642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 21:17:22.869642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 21:17:22.869642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 21:17:22.869642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 21:17:22.869642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 35ea8b2ffbca446c9ceca8365e98c1c2. Jul 30 21:17:22.869642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:17:22.869642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:17:22.869642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:17:22.869642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:17:22.869642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:17:22.869642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:17:22.869642 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:17:22.871183 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:17:22.871183 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:17:22.871183 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:17:22.871183 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:17:22.871183 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:17:22.871183 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:17:22.871183 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:17:22.871183 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 30 21:17:22.871183 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 30 21:17:22.871183 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 21:17:22.871183 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 21:17:22.871183 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 21:17:22.871183 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 21:17:22.871183 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:17:22.871183 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:17:22.871183 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:17:22.872347 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:17:22.872347 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:17:22.872347 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:17:22.872347 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:17:22.872347 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 21:17:22.872347 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:17:22.872347 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:17:22.872347 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:17:22.872347 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:17:22.872347 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:17:22.872347 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:17:22.872347 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:17:22.872347 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:17:22.872347 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 30 21:17:22.872347 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 21:17:22.872347 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 35ea8b2ffbca446c9ceca8365e98c1c2. Jul 30 21:17:22.872347 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:17:22.873641 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2355/4692] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:17:22 2022] PATCH /identity/v3/domains/35ea8b2ffbca446c9ceca8365e98c1c2 => generated 112 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 30 21:17:22.875450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7170a16-5f5b-4145-94f8-cfa566b039c5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:22.877241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a7170a16-5f5b-4145-94f8-cfa566b039c5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:22.894021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7170a16-5f5b-4145-94f8-cfa566b039c5 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:22.900688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bc48a-09e9-4914-adad-ed716e7fcf06 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:22.901354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bc48a-09e9-4914-adad-ed716e7fcf06 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:22.901641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bc48a-09e9-4914-adad-ed716e7fcf06 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:22.902064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bc48a-09e9-4914-adad-ed716e7fcf06 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains/8ee6290ce038431ca988e2c5734bf6fb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:22.910844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bc48a-09e9-4914-adad-ed716e7fcf06 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 21:17:22.916549 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-d23bc48a-09e9-4914-adad-ed716e7fcf06 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Could not find domain: 8ee6290ce038431ca988e2c5734bf6fb.: keystone.exception.DomainNotFound: Could not find domain: 8ee6290ce038431ca988e2c5734bf6fb. Jul 30 21:17:22.916549 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:17:22.916549 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 30 21:17:22.916549 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 30 21:17:22.916549 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 21:17:22.916549 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 21:17:22.916549 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 21:17:22.916549 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 21:17:22.916549 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8ee6290ce038431ca988e2c5734bf6fb. Jul 30 21:17:22.916549 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:17:22.916549 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:17:22.916549 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:17:22.916549 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:17:22.916549 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:17:22.916549 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:17:22.916549 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:17:22.917897 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:17:22.917897 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:17:22.917897 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:17:22.917897 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:17:22.917897 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:17:22.917897 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:17:22.917897 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:17:22.917897 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 30 21:17:22.917897 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 30 21:17:22.917897 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 21:17:22.917897 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 21:17:22.917897 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 21:17:22.917897 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 21:17:22.917897 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:17:22.917897 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:17:22.917897 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:17:22.919864 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:17:22.919864 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:17:22.919864 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:17:22.919864 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:17:22.919864 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 21:17:22.919864 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:17:22.919864 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:17:22.919864 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:17:22.919864 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:17:22.919864 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:17:22.919864 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:17:22.919864 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:17:22.919864 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:17:22.919864 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 30 21:17:22.919864 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 21:17:22.919864 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8ee6290ce038431ca988e2c5734bf6fb. Jul 30 21:17:22.919864 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:17:22.921606 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2338/4693] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:17:22 2022] PATCH /identity/v3/domains/8ee6290ce038431ca988e2c5734bf6fb => generated 112 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:17:22.924829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09399abb-c63c-4116-81d0-c4e978cb16c7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:22.939555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09399abb-c63c-4116-81d0-c4e978cb16c7 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:22.947972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748402b3-dead-42b7-8a59-3e187ee23763 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:22.948900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748402b3-dead-42b7-8a59-3e187ee23763 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:22.949259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748402b3-dead-42b7-8a59-3e187ee23763 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:22.949685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748402b3-dead-42b7-8a59-3e187ee23763 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains/cd272a901746486ca368a951090b95c1` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:22.961612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748402b3-dead-42b7-8a59-3e187ee23763 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 21:17:22.968837 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-748402b3-dead-42b7-8a59-3e187ee23763 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Could not find domain: cd272a901746486ca368a951090b95c1.: keystone.exception.DomainNotFound: Could not find domain: cd272a901746486ca368a951090b95c1. Jul 30 21:17:22.968837 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:17:22.968837 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 30 21:17:22.968837 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 30 21:17:22.968837 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 21:17:22.968837 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 21:17:22.968837 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 21:17:22.968837 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 21:17:22.968837 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: cd272a901746486ca368a951090b95c1. Jul 30 21:17:22.968837 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:17:22.968837 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:17:22.968837 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:17:22.968837 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:17:22.968837 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:17:22.968837 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:17:22.968837 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:17:22.970873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:17:22.970873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:17:22.970873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:17:22.970873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:17:22.970873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:17:22.970873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:17:22.970873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:17:22.970873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 30 21:17:22.970873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 30 21:17:22.970873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 21:17:22.970873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 21:17:22.970873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 21:17:22.970873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 21:17:22.970873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:17:22.970873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:17:22.970873 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:17:22.973128 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:17:22.973128 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:17:22.973128 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:17:22.973128 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:17:22.973128 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 21:17:22.973128 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:17:22.973128 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:17:22.973128 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:17:22.973128 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:17:22.973128 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:17:22.973128 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:17:22.973128 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:17:22.973128 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:17:22.973128 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 30 21:17:22.973128 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 21:17:22.973128 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: cd272a901746486ca368a951090b95c1. Jul 30 21:17:22.973128 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:17:22.974512 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2356/4694] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:17:22 2022] PATCH /identity/v3/domains/cd272a901746486ca368a951090b95c1 => generated 112 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:17:22.976384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bc48a-09e9-4914-adad-ed716e7fcf06 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:23.000637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bc48a-09e9-4914-adad-ed716e7fcf06 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:23.031132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7d581-795e-447b-afa6-229ce571dea4 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70c88881793f437d8b7b000085857ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa30c3e53c86400ab3c8d0d24048a429', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:23.031843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7d581-795e-447b-afa6-229ce571dea4 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:23.039754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7d581-795e-447b-afa6-229ce571dea4 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:23.040136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7d581-795e-447b-afa6-229ce571dea4 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] PATH_INFO: `/v3/domains/b969bf544da14fc5919dbc3edb143584` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:23.050006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7d581-795e-447b-afa6-229ce571dea4 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 21:17:23.054789 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-6ed7d581-795e-447b-afa6-229ce571dea4 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Could not find domain: b969bf544da14fc5919dbc3edb143584.: keystone.exception.DomainNotFound: Could not find domain: b969bf544da14fc5919dbc3edb143584. Jul 30 21:17:23.054789 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:17:23.054789 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 30 21:17:23.054789 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 30 21:17:23.054789 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 21:17:23.054789 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 21:17:23.054789 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 21:17:23.054789 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 21:17:23.054789 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b969bf544da14fc5919dbc3edb143584. Jul 30 21:17:23.054789 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:17:23.054789 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:17:23.054789 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:17:23.054789 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:17:23.054789 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:17:23.054789 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:17:23.054789 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:17:23.057003 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:17:23.057003 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:17:23.057003 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:17:23.057003 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:17:23.057003 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:17:23.057003 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:17:23.057003 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:17:23.057003 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 30 21:17:23.057003 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 30 21:17:23.057003 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 21:17:23.057003 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 21:17:23.057003 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 21:17:23.057003 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 21:17:23.057003 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:17:23.057003 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:17:23.057003 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:17:23.058341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:17:23.058341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:17:23.058341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:17:23.058341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:17:23.058341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 21:17:23.058341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:17:23.058341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:17:23.058341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:17:23.058341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:17:23.058341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:17:23.058341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:17:23.058341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:17:23.058341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:17:23.058341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 30 21:17:23.058341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 21:17:23.058341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b969bf544da14fc5919dbc3edb143584. Jul 30 21:17:23.058341 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:17:23.060002 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2339/4695] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:17:22 2022] PATCH /identity/v3/domains/b969bf544da14fc5919dbc3edb143584 => generated 112 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 30 21:17:23.060659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748402b3-dead-42b7-8a59-3e187ee23763 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:23.062679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-748402b3-dead-42b7-8a59-3e187ee23763 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:23.221712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748402b3-dead-42b7-8a59-3e187ee23763 tempest-TokensV3TestJSON-671413283 tempest-TokensV3TestJSON-671413283-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:23.237082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f0fed-825e-4fa6-8404-248a13500965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:23.238275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f0fed-825e-4fa6-8404-248a13500965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:23.238627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f0fed-825e-4fa6-8404-248a13500965 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:23.238921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f0fed-825e-4fa6-8404-248a13500965 admin admin] PATH_INFO: `/v3/users/2457f9b70fa448b4818ab503e58160a2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:23.240345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f0fed-825e-4fa6-8404-248a13500965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2457f9b70fa448b4818ab503e58160a2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:23.242390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f0fed-825e-4fa6-8404-248a13500965 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:23.374930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a32f0fed-825e-4fa6-8404-248a13500965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2457f9b70fa448b4818ab503e58160a2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:23.410532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a32f0fed-825e-4fa6-8404-248a13500965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2457f9b70fa448b4818ab503e58160a2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:23.411800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a32f0fed-825e-4fa6-8404-248a13500965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2457f9b70fa448b4818ab503e58160a2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:23.428540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a32f0fed-825e-4fa6-8404-248a13500965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2457f9b70fa448b4818ab503e58160a2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:23.429900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a32f0fed-825e-4fa6-8404-248a13500965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2457f9b70fa448b4818ab503e58160a2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:23.463319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:23.484598 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2357/4696] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:23 2022] DELETE /identity/v3/users/2457f9b70fa448b4818ab503e58160a2 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:23.489077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c74ba-de8a-488f-8868-9d906079482d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:23.489770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c74ba-de8a-488f-8868-9d906079482d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:23.489770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c74ba-de8a-488f-8868-9d906079482d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:23.554439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0c4c74ba-de8a-488f-8868-9d906079482d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:23.557529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0c4c74ba-de8a-488f-8868-9d906079482d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:23.727201 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2340/4697] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:23.749712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f0fed-825e-4fa6-8404-248a13500965 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:23.754252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a32f0fed-825e-4fa6-8404-248a13500965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:23.921329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f0fed-825e-4fa6-8404-248a13500965 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:23.935636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d492f9-7825-4f18-8913-28d190c0e2b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:23.939826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d492f9-7825-4f18-8913-28d190c0e2b2 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:23.941493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d492f9-7825-4f18-8913-28d190c0e2b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:23.941884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d492f9-7825-4f18-8913-28d190c0e2b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:23.967204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d492f9-7825-4f18-8913-28d190c0e2b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:23.970708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d492f9-7825-4f18-8913-28d190c0e2b2 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:24.001512 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2358/4698] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:17:25.819623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c74ba-de8a-488f-8868-9d906079482d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:25.823995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0c4c74ba-de8a-488f-8868-9d906079482d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:25.846534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c74ba-de8a-488f-8868-9d906079482d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:25.853312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdaa04e-0180-4a2f-86d3-a8cfd6a9956f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:25.854262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaa04e-0180-4a2f-86d3-a8cfd6a9956f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:25.854729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaa04e-0180-4a2f-86d3-a8cfd6a9956f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:25.855195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaa04e-0180-4a2f-86d3-a8cfd6a9956f admin admin] PATH_INFO: `/v3/users/20bea5c4d7ee4dec90aeda50c35f68e6` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:25.857492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdaa04e-0180-4a2f-86d3-a8cfd6a9956f admin admin] RBAC: Authorizing `identity:delete_user(user_id=20bea5c4d7ee4dec90aeda50c35f68e6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:25.861209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdaa04e-0180-4a2f-86d3-a8cfd6a9956f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:25.944405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2bdaa04e-0180-4a2f-86d3-a8cfd6a9956f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20bea5c4d7ee4dec90aeda50c35f68e6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:25.945207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2bdaa04e-0180-4a2f-86d3-a8cfd6a9956f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20bea5c4d7ee4dec90aeda50c35f68e6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:25.958636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2bdaa04e-0180-4a2f-86d3-a8cfd6a9956f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20bea5c4d7ee4dec90aeda50c35f68e6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:25.959476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2bdaa04e-0180-4a2f-86d3-a8cfd6a9956f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20bea5c4d7ee4dec90aeda50c35f68e6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:25.970027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2bdaa04e-0180-4a2f-86d3-a8cfd6a9956f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20bea5c4d7ee4dec90aeda50c35f68e6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:25.981919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:25.988933 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2341/4699] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:25 2022] DELETE /identity/v3/users/20bea5c4d7ee4dec90aeda50c35f68e6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:25.994344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ff094-b62e-4e4a-a043-b75d22279b4f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:25.994920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ff094-b62e-4e4a-a043-b75d22279b4f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:25.995050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ff094-b62e-4e4a-a043-b75d22279b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:26.004245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdaa04e-0180-4a2f-86d3-a8cfd6a9956f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:26.011149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2bdaa04e-0180-4a2f-86d3-a8cfd6a9956f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:26.025644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3b7ff094-b62e-4e4a-a043-b75d22279b4f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:26.027181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3b7ff094-b62e-4e4a-a043-b75d22279b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:26.102135 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2359/4700] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:26.107860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ff094-b62e-4e4a-a043-b75d22279b4f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:26.109622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3b7ff094-b62e-4e4a-a043-b75d22279b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:26.126241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdaa04e-0180-4a2f-86d3-a8cfd6a9956f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:26.127156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ff094-b62e-4e4a-a043-b75d22279b4f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:26.132758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9bc7c-32bf-4043-97a0-f6bf85c5bc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:26.133405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9bc7c-32bf-4043-97a0-f6bf85c5bc13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:26.133757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9bc7c-32bf-4043-97a0-f6bf85c5bc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:26.134040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9bc7c-32bf-4043-97a0-f6bf85c5bc13 admin admin] PATH_INFO: `/v3/projects/818eed3e1a5148dfa032c63907f1c9ec` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:26.135314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9bc7c-32bf-4043-97a0-f6bf85c5bc13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=818eed3e1a5148dfa032c63907f1c9ec)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:26.137584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9bc7c-32bf-4043-97a0-f6bf85c5bc13 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:26.161629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0532c5-6787-452b-99ae-dedd8750d055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:26.162361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0532c5-6787-452b-99ae-dedd8750d055 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:26.162649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0532c5-6787-452b-99ae-dedd8750d055 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:26.162926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0532c5-6787-452b-99ae-dedd8750d055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:26.165961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cf0532c5-6787-452b-99ae-dedd8750d055 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:26.251916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a4a9bc7c-32bf-4043-97a0-f6bf85c5bc13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818eed3e1a5148dfa032c63907f1c9ec', 'request_id': 'req-a4a9bc7c-32bf-4043-97a0-f6bf85c5bc13'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:26.264349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a4a9bc7c-32bf-4043-97a0-f6bf85c5bc13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818eed3e1a5148dfa032c63907f1c9ec', 'request_id': 'req-a4a9bc7c-32bf-4043-97a0-f6bf85c5bc13'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:26.295329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a4a9bc7c-32bf-4043-97a0-f6bf85c5bc13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818eed3e1a5148dfa032c63907f1c9ec', 'request_id': 'req-a4a9bc7c-32bf-4043-97a0-f6bf85c5bc13'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:26.295561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0532c5-6787-452b-99ae-dedd8750d055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:26.295561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0532c5-6787-452b-99ae-dedd8750d055 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:26.309307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a4a9bc7c-32bf-4043-97a0-f6bf85c5bc13 admin admin] The token cache is being invalidate because project 818eed3e1a5148dfa032c63907f1c9ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:26.309609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a4a9bc7c-32bf-4043-97a0-f6bf85c5bc13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:26.310308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a4a9bc7c-32bf-4043-97a0-f6bf85c5bc13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:26.312424 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2360/4701] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:26 2022] DELETE /identity/v3/projects/818eed3e1a5148dfa032c63907f1c9ec => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:26.315316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9bc7c-32bf-4043-97a0-f6bf85c5bc13 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:26.316039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a4a9bc7c-32bf-4043-97a0-f6bf85c5bc13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:26.340233 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2342/4702] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:17:26.342706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0532c5-6787-452b-99ae-dedd8750d055 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:26.368252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0532c5-6787-452b-99ae-dedd8750d055 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:26.379632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:26.450060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9bc7c-32bf-4043-97a0-f6bf85c5bc13 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:26.463473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f5b5a-fc4f-4a66-a287-4abcb4b68381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:26.464129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f5b5a-fc4f-4a66-a287-4abcb4b68381 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:26.464477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f5b5a-fc4f-4a66-a287-4abcb4b68381 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:26.464826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f5b5a-fc4f-4a66-a287-4abcb4b68381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:26.470020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7b7f5b5a-fc4f-4a66-a287-4abcb4b68381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:26.492908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8572c-e518-4d4d-bd1d-8a53d5b3cb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:26.495836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8572c-e518-4d4d-bd1d-8a53d5b3cb4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:26.496344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8572c-e518-4d4d-bd1d-8a53d5b3cb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:26.496946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8572c-e518-4d4d-bd1d-8a53d5b3cb4d admin admin] PATH_INFO: `/v3/users/70c88881793f437d8b7b000085857ccb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:26.501869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8572c-e518-4d4d-bd1d-8a53d5b3cb4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=70c88881793f437d8b7b000085857ccb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:26.504534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8572c-e518-4d4d-bd1d-8a53d5b3cb4d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:26.561639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:26.589258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f5b5a-fc4f-4a66-a287-4abcb4b68381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:26.595495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0ba8572c-e518-4d4d-bd1d-8a53d5b3cb4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70c88881793f437d8b7b000085857ccb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:26.596550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0ba8572c-e518-4d4d-bd1d-8a53d5b3cb4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70c88881793f437d8b7b000085857ccb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:26.597402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f5b5a-fc4f-4a66-a287-4abcb4b68381 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:26.614235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0ba8572c-e518-4d4d-bd1d-8a53d5b3cb4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70c88881793f437d8b7b000085857ccb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:26.615516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0ba8572c-e518-4d4d-bd1d-8a53d5b3cb4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70c88881793f437d8b7b000085857ccb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:26.623212 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2361/4703] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:17:26.631314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0ba8572c-e518-4d4d-bd1d-8a53d5b3cb4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70c88881793f437d8b7b000085857ccb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:26.660663 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2343/4704] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:26 2022] DELETE /identity/v3/users/70c88881793f437d8b7b000085857ccb => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:26.744649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf3530-d2c2-4d4e-a989-c00aeac0a74e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:26.745295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf3530-d2c2-4d4e-a989-c00aeac0a74e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:26.745295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf3530-d2c2-4d4e-a989-c00aeac0a74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:26.801420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c0cf3530-d2c2-4d4e-a989-c00aeac0a74e None None] MFA Rules not processed for user `86e4e88cd2154fa09d15bffe4e644a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:26.805516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c0cf3530-d2c2-4d4e-a989-c00aeac0a74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:26.905270 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2362/4705] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:26.917933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab73050-9813-4c9b-b7ef-37f5b6975285 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:26.918887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab73050-9813-4c9b-b7ef-37f5b6975285 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:26.919481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab73050-9813-4c9b-b7ef-37f5b6975285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:26.958861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0ab73050-9813-4c9b-b7ef-37f5b6975285 None None] MFA Rules not processed for user `86e4e88cd2154fa09d15bffe4e644a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:26.960447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0ab73050-9813-4c9b-b7ef-37f5b6975285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:26.984446 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2344/4706] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:27.059239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf3530-d2c2-4d4e-a989-c00aeac0a74e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:27.061226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c0cf3530-d2c2-4d4e-a989-c00aeac0a74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:27.212168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:27.229963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf3530-d2c2-4d4e-a989-c00aeac0a74e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:27.231341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fe380-464f-4b51-ac5d-41fba42c8a0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:27.231876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fe380-464f-4b51-ac5d-41fba42c8a0a service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:27.232224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fe380-464f-4b51-ac5d-41fba42c8a0a service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:27.233281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fe380-464f-4b51-ac5d-41fba42c8a0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:27.246619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fe380-464f-4b51-ac5d-41fba42c8a0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:27.249738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fe380-464f-4b51-ac5d-41fba42c8a0a service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:27.266403 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2363/4707] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:17:27.366913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab73050-9813-4c9b-b7ef-37f5b6975285 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:27.369309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0ab73050-9813-4c9b-b7ef-37f5b6975285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:27.593135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab73050-9813-4c9b-b7ef-37f5b6975285 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:27.600739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d744e-8b15-4d01-a1a1-fc40ea21b59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:27.602163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d744e-8b15-4d01-a1a1-fc40ea21b59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:27.602843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d744e-8b15-4d01-a1a1-fc40ea21b59a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:27.603323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d744e-8b15-4d01-a1a1-fc40ea21b59a admin admin] PATH_INFO: `/v3/projects/337bb83600d7464bad03a15d3bbe7d6f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:27.604605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d744e-8b15-4d01-a1a1-fc40ea21b59a admin admin] RBAC: Authorizing `identity:delete_project(project_id=337bb83600d7464bad03a15d3bbe7d6f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:27.606666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d744e-8b15-4d01-a1a1-fc40ea21b59a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:27.706341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-034d744e-8b15-4d01-a1a1-fc40ea21b59a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '337bb83600d7464bad03a15d3bbe7d6f', 'request_id': 'req-034d744e-8b15-4d01-a1a1-fc40ea21b59a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:27.727261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-034d744e-8b15-4d01-a1a1-fc40ea21b59a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '337bb83600d7464bad03a15d3bbe7d6f', 'request_id': 'req-034d744e-8b15-4d01-a1a1-fc40ea21b59a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:27.742164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-034d744e-8b15-4d01-a1a1-fc40ea21b59a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '337bb83600d7464bad03a15d3bbe7d6f', 'request_id': 'req-034d744e-8b15-4d01-a1a1-fc40ea21b59a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:27.778045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-034d744e-8b15-4d01-a1a1-fc40ea21b59a admin admin] The token cache is being invalidate because project 337bb83600d7464bad03a15d3bbe7d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:27.778417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-034d744e-8b15-4d01-a1a1-fc40ea21b59a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:27.780318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-034d744e-8b15-4d01-a1a1-fc40ea21b59a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:27.788788 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2345/4708] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:27 2022] DELETE /identity/v3/projects/337bb83600d7464bad03a15d3bbe7d6f => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:27.791049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fe380-464f-4b51-ac5d-41fba42c8a0a service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:27.808062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fe380-464f-4b51-ac5d-41fba42c8a0a service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:27.903008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2633e-6fd4-40dc-b876-993b20a5d419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:27.903718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2633e-6fd4-40dc-b876-993b20a5d419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:27.904003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2633e-6fd4-40dc-b876-993b20a5d419 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:27.904439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2633e-6fd4-40dc-b876-993b20a5d419 admin admin] PATH_INFO: `/v3/users/20078c39c8c9465d853138c72693dac8` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:27.905725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2633e-6fd4-40dc-b876-993b20a5d419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20078c39c8c9465d853138c72693dac8)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:27.908446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2633e-6fd4-40dc-b876-993b20a5d419 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:28.000229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e9d2633e-6fd4-40dc-b876-993b20a5d419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20078c39c8c9465d853138c72693dac8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:28.033605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e9d2633e-6fd4-40dc-b876-993b20a5d419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20078c39c8c9465d853138c72693dac8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:28.034713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e9d2633e-6fd4-40dc-b876-993b20a5d419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20078c39c8c9465d853138c72693dac8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:28.062207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e9d2633e-6fd4-40dc-b876-993b20a5d419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20078c39c8c9465d853138c72693dac8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:28.063352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e9d2633e-6fd4-40dc-b876-993b20a5d419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20078c39c8c9465d853138c72693dac8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:28.074060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d744e-8b15-4d01-a1a1-fc40ea21b59a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:28.076402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-034d744e-8b15-4d01-a1a1-fc40ea21b59a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:28.100393 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2364/4709] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:27 2022] DELETE /identity/v3/users/20078c39c8c9465d853138c72693dac8 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:28.107236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d744e-8b15-4d01-a1a1-fc40ea21b59a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:28.186337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:28.244985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a1eee-863e-41f3-b817-1f51a3634320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:28.245941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a1eee-863e-41f3-b817-1f51a3634320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:28.246438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a1eee-863e-41f3-b817-1f51a3634320 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:28.247093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a1eee-863e-41f3-b817-1f51a3634320 admin admin] PATH_INFO: `/v3/projects/fa30c3e53c86400ab3c8d0d24048a429` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:28.249485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a1eee-863e-41f3-b817-1f51a3634320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa30c3e53c86400ab3c8d0d24048a429)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:28.258026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a1eee-863e-41f3-b817-1f51a3634320 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:28.398568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7a8a1eee-863e-41f3-b817-1f51a3634320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa30c3e53c86400ab3c8d0d24048a429', 'request_id': 'req-7a8a1eee-863e-41f3-b817-1f51a3634320'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:28.438351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7a8a1eee-863e-41f3-b817-1f51a3634320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa30c3e53c86400ab3c8d0d24048a429', 'request_id': 'req-7a8a1eee-863e-41f3-b817-1f51a3634320'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:28.447592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7a8a1eee-863e-41f3-b817-1f51a3634320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa30c3e53c86400ab3c8d0d24048a429', 'request_id': 'req-7a8a1eee-863e-41f3-b817-1f51a3634320'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:28.487202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7a8a1eee-863e-41f3-b817-1f51a3634320 admin admin] The token cache is being invalidate because project fa30c3e53c86400ab3c8d0d24048a429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:28.488385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7a8a1eee-863e-41f3-b817-1f51a3634320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:28.490123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7a8a1eee-863e-41f3-b817-1f51a3634320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:28.495558 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2346/4710] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:28 2022] DELETE /identity/v3/projects/fa30c3e53c86400ab3c8d0d24048a429 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:17:28.499567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2633e-6fd4-40dc-b876-993b20a5d419 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:28.501027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e9d2633e-6fd4-40dc-b876-993b20a5d419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:28.535619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2633e-6fd4-40dc-b876-993b20a5d419 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:28.666890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649e420-bd6f-46c0-a0d3-1f43de05c305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:28.668176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649e420-bd6f-46c0-a0d3-1f43de05c305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:28.668742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649e420-bd6f-46c0-a0d3-1f43de05c305 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:28.669350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649e420-bd6f-46c0-a0d3-1f43de05c305 admin admin] PATH_INFO: `/v3/users/c96d0b373d2348d9bdf4a1585fb3ae44` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:28.671147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649e420-bd6f-46c0-a0d3-1f43de05c305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96d0b373d2348d9bdf4a1585fb3ae44)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:28.674153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649e420-bd6f-46c0-a0d3-1f43de05c305 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:28.689600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:28.775781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1649e420-bd6f-46c0-a0d3-1f43de05c305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96d0b373d2348d9bdf4a1585fb3ae44'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:28.813356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1649e420-bd6f-46c0-a0d3-1f43de05c305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96d0b373d2348d9bdf4a1585fb3ae44'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:28.815154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1649e420-bd6f-46c0-a0d3-1f43de05c305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96d0b373d2348d9bdf4a1585fb3ae44'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:28.832794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1649e420-bd6f-46c0-a0d3-1f43de05c305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96d0b373d2348d9bdf4a1585fb3ae44'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:28.835070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1649e420-bd6f-46c0-a0d3-1f43de05c305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96d0b373d2348d9bdf4a1585fb3ae44'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:28.873381 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2365/4711] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:28 2022] DELETE /identity/v3/users/c96d0b373d2348d9bdf4a1585fb3ae44 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:29.847041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a1eee-863e-41f3-b817-1f51a3634320 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:29.849039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7a8a1eee-863e-41f3-b817-1f51a3634320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:29.898730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a1eee-863e-41f3-b817-1f51a3634320 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:29.928873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649e420-bd6f-46c0-a0d3-1f43de05c305 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:29.931092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1649e420-bd6f-46c0-a0d3-1f43de05c305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:30.058349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649e420-bd6f-46c0-a0d3-1f43de05c305 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:30.067677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81002bb-1d8a-4eaf-a867-416c75993a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:30.068574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81002bb-1d8a-4eaf-a867-416c75993a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:30.068940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81002bb-1d8a-4eaf-a867-416c75993a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:30.069449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81002bb-1d8a-4eaf-a867-416c75993a2a admin admin] PATH_INFO: `/v3/projects/ccc7a3b0d2e8441ba879ddc51378d941` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:30.070935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81002bb-1d8a-4eaf-a867-416c75993a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc7a3b0d2e8441ba879ddc51378d941)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:30.074586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81002bb-1d8a-4eaf-a867-416c75993a2a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:30.089029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf723292-ceab-4c02-bcc9-f5cda177642c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:30.089701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf723292-ceab-4c02-bcc9-f5cda177642c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:30.089991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf723292-ceab-4c02-bcc9-f5cda177642c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:30.090271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf723292-ceab-4c02-bcc9-f5cda177642c admin admin] PATH_INFO: `/v3/projects/72205a9d5b204c1381410e9c3ba0d6be` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:30.097896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf723292-ceab-4c02-bcc9-f5cda177642c admin admin] RBAC: Authorizing `identity:delete_project(project_id=72205a9d5b204c1381410e9c3ba0d6be)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:30.105129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf723292-ceab-4c02-bcc9-f5cda177642c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:30.168846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b81002bb-1d8a-4eaf-a867-416c75993a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc7a3b0d2e8441ba879ddc51378d941', 'request_id': 'req-b81002bb-1d8a-4eaf-a867-416c75993a2a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:30.182284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b81002bb-1d8a-4eaf-a867-416c75993a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc7a3b0d2e8441ba879ddc51378d941', 'request_id': 'req-b81002bb-1d8a-4eaf-a867-416c75993a2a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:30.207003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b81002bb-1d8a-4eaf-a867-416c75993a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc7a3b0d2e8441ba879ddc51378d941', 'request_id': 'req-b81002bb-1d8a-4eaf-a867-416c75993a2a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:30.243147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b81002bb-1d8a-4eaf-a867-416c75993a2a admin admin] The token cache is being invalidate because project ccc7a3b0d2e8441ba879ddc51378d941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:30.243338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b81002bb-1d8a-4eaf-a867-416c75993a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:30.244497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b81002bb-1d8a-4eaf-a867-416c75993a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:30.246115 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2366/4712] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:29 2022] DELETE /identity/v3/projects/ccc7a3b0d2e8441ba879ddc51378d941 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:30.257615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9100da7-a388-4f74-bf90-1a77e061a8f9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:30.257924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9100da7-a388-4f74-bf90-1a77e061a8f9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:30.258276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9100da7-a388-4f74-bf90-1a77e061a8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:30.267064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bf723292-ceab-4c02-bcc9-f5cda177642c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72205a9d5b204c1381410e9c3ba0d6be', 'request_id': 'req-bf723292-ceab-4c02-bcc9-f5cda177642c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:30.281398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bf723292-ceab-4c02-bcc9-f5cda177642c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72205a9d5b204c1381410e9c3ba0d6be', 'request_id': 'req-bf723292-ceab-4c02-bcc9-f5cda177642c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:30.296731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bf723292-ceab-4c02-bcc9-f5cda177642c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72205a9d5b204c1381410e9c3ba0d6be', 'request_id': 'req-bf723292-ceab-4c02-bcc9-f5cda177642c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:30.296925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a9100da7-a388-4f74-bf90-1a77e061a8f9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:30.297703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a9100da7-a388-4f74-bf90-1a77e061a8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:30.301978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:30.328263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bf723292-ceab-4c02-bcc9-f5cda177642c admin admin] The token cache is being invalidate because project 72205a9d5b204c1381410e9c3ba0d6be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:30.330137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:30.330942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bf723292-ceab-4c02-bcc9-f5cda177642c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:30.332093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bf723292-ceab-4c02-bcc9-f5cda177642c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:30.339684 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2347/4713] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:29 2022] DELETE /identity/v3/projects/72205a9d5b204c1381410e9c3ba0d6be => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:30.341316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e550839-9110-40f0-af0b-85fdb77b1611 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:30.341620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e550839-9110-40f0-af0b-85fdb77b1611 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:30.342012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e550839-9110-40f0-af0b-85fdb77b1611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:30.435839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1e550839-9110-40f0-af0b-85fdb77b1611 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:30.436975 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2367/4714] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:17:30.437118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1e550839-9110-40f0-af0b-85fdb77b1611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:30.462090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c257ea1-07f3-4f4b-8abb-4ef871771c8e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:30.462743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c257ea1-07f3-4f4b-8abb-4ef871771c8e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:30.463230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c257ea1-07f3-4f4b-8abb-4ef871771c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:30.465584 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2348/4715] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:30.473567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127aaaaf-48a8-4dd4-ac91-ecf756d8a602 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:30.474151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127aaaaf-48a8-4dd4-ac91-ecf756d8a602 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:30.474508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127aaaaf-48a8-4dd4-ac91-ecf756d8a602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:30.504238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3c257ea1-07f3-4f4b-8abb-4ef871771c8e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:30.506357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3c257ea1-07f3-4f4b-8abb-4ef871771c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:30.521706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-127aaaaf-48a8-4dd4-ac91-ecf756d8a602 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:30.523007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-127aaaaf-48a8-4dd4-ac91-ecf756d8a602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:30.530815 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2368/4716] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:30.531878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c257ea1-07f3-4f4b-8abb-4ef871771c8e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:30.543981 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2349/4717] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:30.545620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127aaaaf-48a8-4dd4-ac91-ecf756d8a602 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:30.556862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c257ea1-07f3-4f4b-8abb-4ef871771c8e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:30.563261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127aaaaf-48a8-4dd4-ac91-ecf756d8a602 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:30.574026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23b733-f4b1-4d1c-8b54-35d784efb9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:30.574695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23b733-f4b1-4d1c-8b54-35d784efb9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:30.574983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23b733-f4b1-4d1c-8b54-35d784efb9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:30.575262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23b733-f4b1-4d1c-8b54-35d784efb9e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:30.575570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9523d-8149-440a-8d5f-aadf88f84bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:30.576029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23b733-f4b1-4d1c-8b54-35d784efb9e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:17:30.576245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9523d-8149-440a-8d5f-aadf88f84bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:30.576362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23b733-f4b1-4d1c-8b54-35d784efb9e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:30.576550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9523d-8149-440a-8d5f-aadf88f84bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:30.576814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9523d-8149-440a-8d5f-aadf88f84bf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:30.577808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9523d-8149-440a-8d5f-aadf88f84bf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:17:30.579428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9523d-8149-440a-8d5f-aadf88f84bf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:30.585162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9523d-8149-440a-8d5f-aadf88f84bf6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:30.588729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23b733-f4b1-4d1c-8b54-35d784efb9e8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:30.624423 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2369/4718] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:17:30.625216 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2350/4719] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:17:30.626029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23b733-f4b1-4d1c-8b54-35d784efb9e8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:30.626734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9523d-8149-440a-8d5f-aadf88f84bf6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:30.652891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23b733-f4b1-4d1c-8b54-35d784efb9e8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:30.662966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9523d-8149-440a-8d5f-aadf88f84bf6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:30.666456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a1905-2df0-45d4-b247-8c7028c94bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:30.667226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a1905-2df0-45d4-b247-8c7028c94bef admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:30.667558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a1905-2df0-45d4-b247-8c7028c94bef admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:30.667840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a1905-2df0-45d4-b247-8c7028c94bef admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:30.669433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a1905-2df0-45d4-b247-8c7028c94bef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:30.675989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a1905-2df0-45d4-b247-8c7028c94bef admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:30.678144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a2f7d-542b-4f01-ad39-cb82929dcfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:30.678860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a2f7d-542b-4f01-ad39-cb82929dcfe5 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:30.679047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a2f7d-542b-4f01-ad39-cb82929dcfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:30.679367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a2f7d-542b-4f01-ad39-cb82929dcfe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:30.680017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a2f7d-542b-4f01-ad39-cb82929dcfe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:30.682463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a2f7d-542b-4f01-ad39-cb82929dcfe5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:30.773410 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2351/4720] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:30 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:30.774555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a2f7d-542b-4f01-ad39-cb82929dcfe5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:30.790087 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2370/4721] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:30 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:30.797254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a1905-2df0-45d4-b247-8c7028c94bef admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:30.982014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a1905-2df0-45d4-b247-8c7028c94bef admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:31.018467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b6a51-9f2a-4ac4-8098-f2c32270b29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:31.019427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b6a51-9f2a-4ac4-8098-f2c32270b29c admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:31.019891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b6a51-9f2a-4ac4-8098-f2c32270b29c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:31.020578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b6a51-9f2a-4ac4-8098-f2c32270b29c admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:31.021430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b6a51-9f2a-4ac4-8098-f2c32270b29c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:31.026002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b6a51-9f2a-4ac4-8098-f2c32270b29c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:31.053915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a2f7d-542b-4f01-ad39-cb82929dcfe5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:31.071474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d137a6d-06c3-4d6c-abcc-13463ff5ce7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:31.072548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d137a6d-06c3-4d6c-abcc-13463ff5ce7f admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:31.072848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d137a6d-06c3-4d6c-abcc-13463ff5ce7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:31.073131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d137a6d-06c3-4d6c-abcc-13463ff5ce7f admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:31.075052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d137a6d-06c3-4d6c-abcc-13463ff5ce7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:31.082511 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2371/4722] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:17:30 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:31.082742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d137a6d-06c3-4d6c-abcc-13463ff5ce7f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:31.084455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b6a51-9f2a-4ac4-8098-f2c32270b29c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:31.119826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b6a51-9f2a-4ac4-8098-f2c32270b29c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:31.137367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceed70d-051d-4e0d-89dd-359b1d1bb5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:31.138295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceed70d-051d-4e0d-89dd-359b1d1bb5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:31.140008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceed70d-051d-4e0d-89dd-359b1d1bb5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:31.140489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceed70d-051d-4e0d-89dd-359b1d1bb5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:31.143537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceed70d-051d-4e0d-89dd-359b1d1bb5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:31.147998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceed70d-051d-4e0d-89dd-359b1d1bb5a1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:31.177164 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2352/4723] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:17:30 2022] POST /identity/v3/users => generated 291 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:17:31.181406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d137a6d-06c3-4d6c-abcc-13463ff5ce7f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:31.182087 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2372/4724] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:17:31.185643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceed70d-051d-4e0d-89dd-359b1d1bb5a1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:31.208078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceed70d-051d-4e0d-89dd-359b1d1bb5a1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:31.214877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d137a6d-06c3-4d6c-abcc-13463ff5ce7f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:31.220711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00b760-76a0-428d-b9af-f91f7c6cf3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:31.221717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00b760-76a0-428d-b9af-f91f7c6cf3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:31.222452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00b760-76a0-428d-b9af-f91f7c6cf3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:31.222982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00b760-76a0-428d-b9af-f91f7c6cf3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:31.223951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00b760-76a0-428d-b9af-f91f7c6cf3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:31.225819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00b760-76a0-428d-b9af-f91f7c6cf3b1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:31.232429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d784fef-ab02-4aa4-88e4-afe5101e9665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:31.233020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d784fef-ab02-4aa4-88e4-afe5101e9665 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:31.233328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d784fef-ab02-4aa4-88e4-afe5101e9665 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:31.236466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d784fef-ab02-4aa4-88e4-afe5101e9665 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:31.237215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d784fef-ab02-4aa4-88e4-afe5101e9665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:31.238863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d784fef-ab02-4aa4-88e4-afe5101e9665 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:31.255667 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2373/4725] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:31.260761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00b760-76a0-428d-b9af-f91f7c6cf3b1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:31.277752 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2353/4726] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:31.281824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d784fef-ab02-4aa4-88e4-afe5101e9665 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:31.284412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00b760-76a0-428d-b9af-f91f7c6cf3b1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:31.298904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf5126-1c77-4716-8cbe-fba061887d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:31.299936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf5126-1c77-4716-8cbe-fba061887d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:31.300444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf5126-1c77-4716-8cbe-fba061887d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:31.300938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf5126-1c77-4716-8cbe-fba061887d0a admin admin] PATH_INFO: `/v3/projects/3382562e84764eb78a1ecd96cdb34842/users/90655f3641c349388f0afd179d3336d8/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:31.311940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d784fef-ab02-4aa4-88e4-afe5101e9665 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:31.327913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72ac85-3ab8-4a4d-be7a-c49f7e2231b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:31.330720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72ac85-3ab8-4a4d-be7a-c49f7e2231b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:31.331029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72ac85-3ab8-4a4d-be7a-c49f7e2231b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:31.332588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72ac85-3ab8-4a4d-be7a-c49f7e2231b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:31.333763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72ac85-3ab8-4a4d-be7a-c49f7e2231b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:31.334037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf5126-1c77-4716-8cbe-fba061887d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3382562e84764eb78a1ecd96cdb34842, user_id=90655f3641c349388f0afd179d3336d8, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:31.336055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72ac85-3ab8-4a4d-be7a-c49f7e2231b7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:31.337298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf5126-1c77-4716-8cbe-fba061887d0a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:31.379102 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2374/4727] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:31 2022] PUT /identity/v3/projects/3382562e84764eb78a1ecd96cdb34842/users/90655f3641c349388f0afd179d3336d8/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:31.389663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cf70e-af24-4eb8-98c9-46f358c3bd55 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:31.390275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cf70e-af24-4eb8-98c9-46f358c3bd55 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:31.390787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cf70e-af24-4eb8-98c9-46f358c3bd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:31.391487 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2354/4728] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:31.397211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72ac85-3ab8-4a4d-be7a-c49f7e2231b7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:31.441222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72ac85-3ab8-4a4d-be7a-c49f7e2231b7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:31.489013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-950cf70e-af24-4eb8-98c9-46f358c3bd55 None None] MFA Rules not processed for user `90655f3641c349388f0afd179d3336d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:31.490536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-950cf70e-af24-4eb8-98c9-46f358c3bd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:31.525777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:31.731230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c1bc3-6e39-4721-bf1b-cdc2744782fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:31.732023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c1bc3-6e39-4721-bf1b-cdc2744782fc admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:31.732295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c1bc3-6e39-4721-bf1b-cdc2744782fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:31.732580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c1bc3-6e39-4721-bf1b-cdc2744782fc admin admin] PATH_INFO: `/v3/projects/1c817036e10a44bfa71d235dd8a3b0e7/users/f879fe7d81cd467ea6dba3e2b483a5cc/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:31.770378 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2375/4729] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:17:31.772280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c1bc3-6e39-4721-bf1b-cdc2744782fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c817036e10a44bfa71d235dd8a3b0e7, user_id=f879fe7d81cd467ea6dba3e2b483a5cc, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:31.780099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cf70e-af24-4eb8-98c9-46f358c3bd55 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:31.781848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-950cf70e-af24-4eb8-98c9-46f358c3bd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:31.798517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c1bc3-6e39-4721-bf1b-cdc2744782fc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:31.804361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:31.832044 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2355/4730] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:31 2022] PUT /identity/v3/projects/1c817036e10a44bfa71d235dd8a3b0e7/users/f879fe7d81cd467ea6dba3e2b483a5cc/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:31.848685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59d355-8fac-4eee-9dea-0c29b2530f06 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:31.849064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59d355-8fac-4eee-9dea-0c29b2530f06 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:31.849752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59d355-8fac-4eee-9dea-0c29b2530f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:31.934080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3f59d355-8fac-4eee-9dea-0c29b2530f06 None None] MFA Rules not processed for user `f879fe7d81cd467ea6dba3e2b483a5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:31.935874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3f59d355-8fac-4eee-9dea-0c29b2530f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:32.020292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cf70e-af24-4eb8-98c9-46f358c3bd55 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:32.044393 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2356/4731] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:32.049544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59d355-8fac-4eee-9dea-0c29b2530f06 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:32.179577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdb86d-f5c1-4b72-a32b-fdcf3bd23fef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:32.184983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdb86d-f5c1-4b72-a32b-fdcf3bd23fef service glance] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:32.185573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdb86d-f5c1-4b72-a32b-fdcf3bd23fef service glance] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:32.186183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdb86d-f5c1-4b72-a32b-fdcf3bd23fef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:32.240167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59d355-8fac-4eee-9dea-0c29b2530f06 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:32.274255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180782ea-ff1f-474f-b1a6-da2d4800b03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:32.279784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180782ea-ff1f-474f-b1a6-da2d4800b03e admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:32.280086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180782ea-ff1f-474f-b1a6-da2d4800b03e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:32.280377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180782ea-ff1f-474f-b1a6-da2d4800b03e admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:32.281073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180782ea-ff1f-474f-b1a6-da2d4800b03e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:32.287774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180782ea-ff1f-474f-b1a6-da2d4800b03e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:32.373783 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2357/4732] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:32 2022] POST /identity/v3/projects => generated 379 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:32.378301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180782ea-ff1f-474f-b1a6-da2d4800b03e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:32.392492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdb86d-f5c1-4b72-a32b-fdcf3bd23fef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:32.394039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdb86d-f5c1-4b72-a32b-fdcf3bd23fef service glance] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:32.412861 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2376/4733] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:17:32.524043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180782ea-ff1f-474f-b1a6-da2d4800b03e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:32.569426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866870b-21e4-4c0f-9550-54b5cf8f8150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:32.571067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866870b-21e4-4c0f-9550-54b5cf8f8150 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:32.571781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866870b-21e4-4c0f-9550-54b5cf8f8150 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:32.572245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866870b-21e4-4c0f-9550-54b5cf8f8150 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:32.573432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866870b-21e4-4c0f-9550-54b5cf8f8150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:32.576771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866870b-21e4-4c0f-9550-54b5cf8f8150 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:32.620631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:32.638707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdb86d-f5c1-4b72-a32b-fdcf3bd23fef service glance] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:32.639143 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2358/4734] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:17:32 2022] POST /identity/v3/users => generated 296 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:17:32.671117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdb86d-f5c1-4b72-a32b-fdcf3bd23fef service glance] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:32.705545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301068d-c63a-4e82-b1d0-ecd7803781fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:32.706357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301068d-c63a-4e82-b1d0-ecd7803781fe admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:32.706679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301068d-c63a-4e82-b1d0-ecd7803781fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:32.709280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301068d-c63a-4e82-b1d0-ecd7803781fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:32.710056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301068d-c63a-4e82-b1d0-ecd7803781fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:32.713872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301068d-c63a-4e82-b1d0-ecd7803781fe admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:32.734562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:32.752442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866870b-21e4-4c0f-9550-54b5cf8f8150 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:32.760153 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2377/4735] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:32.761667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c6dd2-a5aa-4062-8cf3-0386a805e3ee None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:32.765730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866870b-21e4-4c0f-9550-54b5cf8f8150 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:32.777982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c6dd2-a5aa-4062-8cf3-0386a805e3ee None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:32.777982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c6dd2-a5aa-4062-8cf3-0386a805e3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:32.785817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895a238-e769-426b-88ff-dfd469603c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:32.787801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895a238-e769-426b-88ff-dfd469603c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:32.788537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895a238-e769-426b-88ff-dfd469603c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:32.788929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895a238-e769-426b-88ff-dfd469603c05 admin admin] PATH_INFO: `/v3/projects/1bad1cb020eb478884e71b78106c2519/users/a65d5b846668460a81fbeecf2f0fb4f0/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:32.819158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-201c6dd2-a5aa-4062-8cf3-0386a805e3ee None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:32.832098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-201c6dd2-a5aa-4062-8cf3-0386a805e3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:32.833571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895a238-e769-426b-88ff-dfd469603c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bad1cb020eb478884e71b78106c2519, user_id=a65d5b846668460a81fbeecf2f0fb4f0, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:32.838646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895a238-e769-426b-88ff-dfd469603c05 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:32.881773 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2359/4736] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:32 2022] PUT /identity/v3/projects/1bad1cb020eb478884e71b78106c2519/users/a65d5b846668460a81fbeecf2f0fb4f0/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:32.882766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895a238-e769-426b-88ff-dfd469603c05 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:32.962618 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2378/4737] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:17:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:33.073756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895a238-e769-426b-88ff-dfd469603c05 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:33.088793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ece051-987a-4880-9fac-3f9e9fe5242d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:33.089462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ece051-987a-4880-9fac-3f9e9fe5242d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:33.089766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ece051-987a-4880-9fac-3f9e9fe5242d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:33.093650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ece051-987a-4880-9fac-3f9e9fe5242d admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:33.094753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ece051-987a-4880-9fac-3f9e9fe5242d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:33.106694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c6dd2-a5aa-4062-8cf3-0386a805e3ee None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:33.109259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-201c6dd2-a5aa-4062-8cf3-0386a805e3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:33.132825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ece051-987a-4880-9fac-3f9e9fe5242d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:33.189271 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2360/4738] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:33.193325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ece051-987a-4880-9fac-3f9e9fe5242d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:33.216983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ece051-987a-4880-9fac-3f9e9fe5242d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:33.236056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdf1fd-d3ab-485c-8107-72c3dcd2a139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:33.239419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdf1fd-d3ab-485c-8107-72c3dcd2a139 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:33.239861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdf1fd-d3ab-485c-8107-72c3dcd2a139 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:33.240242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdf1fd-d3ab-485c-8107-72c3dcd2a139 admin admin] PATH_INFO: `/v3/projects/1bad1cb020eb478884e71b78106c2519/users/a65d5b846668460a81fbeecf2f0fb4f0/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:33.246943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdf1fd-d3ab-485c-8107-72c3dcd2a139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bad1cb020eb478884e71b78106c2519, user_id=a65d5b846668460a81fbeecf2f0fb4f0, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:33.255444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdf1fd-d3ab-485c-8107-72c3dcd2a139 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:33.285158 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2361/4739] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:33 2022] PUT /identity/v3/projects/1bad1cb020eb478884e71b78106c2519/users/a65d5b846668460a81fbeecf2f0fb4f0/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:33.298662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6eef4-82a7-4c6b-8555-11aecf6fd64e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:33.299537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6eef4-82a7-4c6b-8555-11aecf6fd64e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:33.299832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6eef4-82a7-4c6b-8555-11aecf6fd64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:33.367815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c6dd2-a5aa-4062-8cf3-0386a805e3ee None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:33.390338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a0f6eef4-82a7-4c6b-8555-11aecf6fd64e None None] MFA Rules not processed for user `a65d5b846668460a81fbeecf2f0fb4f0`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:33.391602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a0f6eef4-82a7-4c6b-8555-11aecf6fd64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:33.527100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d0731-ec1e-46ee-a951-e2239ed695b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:33.527875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d0731-ec1e-46ee-a951-e2239ed695b8 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:33.528166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d0731-ec1e-46ee-a951-e2239ed695b8 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:33.528450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d0731-ec1e-46ee-a951-e2239ed695b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:33.533919 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2362/4740] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:33.550558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6eef4-82a7-4c6b-8555-11aecf6fd64e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:33.555337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a0f6eef4-82a7-4c6b-8555-11aecf6fd64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:33.619577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:33.691206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d0731-ec1e-46ee-a951-e2239ed695b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:33.695173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d0731-ec1e-46ee-a951-e2239ed695b8 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:33.724063 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2379/4741] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:17:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:17:33.725267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:33.746639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6eef4-82a7-4c6b-8555-11aecf6fd64e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:33.752499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae207ca5-fd91-4c4a-804a-2ff05a29dac2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:33.753661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae207ca5-fd91-4c4a-804a-2ff05a29dac2 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:33.754624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae207ca5-fd91-4c4a-804a-2ff05a29dac2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:33.754907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae207ca5-fd91-4c4a-804a-2ff05a29dac2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:33.786462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae207ca5-fd91-4c4a-804a-2ff05a29dac2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:33.797089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae207ca5-fd91-4c4a-804a-2ff05a29dac2 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:33.822165 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2363/4742] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:17:33.965954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d0731-ec1e-46ee-a951-e2239ed695b8 service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:33.983331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d0731-ec1e-46ee-a951-e2239ed695b8 service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:33.989008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033851c-b9a6-4160-ac92-4ec5d90bcda7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:33.990549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033851c-b9a6-4160-ac92-4ec5d90bcda7 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:33.991104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033851c-b9a6-4160-ac92-4ec5d90bcda7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:33.992193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033851c-b9a6-4160-ac92-4ec5d90bcda7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:34.128500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033851c-b9a6-4160-ac92-4ec5d90bcda7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:34.129890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033851c-b9a6-4160-ac92-4ec5d90bcda7 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:34.141924 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2380/4743] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:17:34.351822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e653c81-0c0e-4718-9171-df2c3de68431 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:34.353492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e653c81-0c0e-4718-9171-df2c3de68431 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:34.355670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e653c81-0c0e-4718-9171-df2c3de68431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:34.382165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80797f8c-f411-4263-9557-75a4216c31cb None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:34.382796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80797f8c-f411-4263-9557-75a4216c31cb None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:34.382796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80797f8c-f411-4263-9557-75a4216c31cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:34.432213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1e653c81-0c0e-4718-9171-df2c3de68431 None None] MFA Rules not processed for user `23ba5ddf22424eff840602440872f86e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:34.437652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1e653c81-0c0e-4718-9171-df2c3de68431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:34.443523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-80797f8c-f411-4263-9557-75a4216c31cb None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:34.447579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-80797f8c-f411-4263-9557-75a4216c31cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:34.468871 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2381/4744] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:17:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:17:34.494221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80797f8c-f411-4263-9557-75a4216c31cb None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:34.516967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80797f8c-f411-4263-9557-75a4216c31cb None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:34.530821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242594e5-bf17-4d88-a489-3c3e6a44544b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:34.532647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242594e5-bf17-4d88-a489-3c3e6a44544b service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:34.533169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242594e5-bf17-4d88-a489-3c3e6a44544b service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:34.533664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242594e5-bf17-4d88-a489-3c3e6a44544b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:34.555790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242594e5-bf17-4d88-a489-3c3e6a44544b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:34.561096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242594e5-bf17-4d88-a489-3c3e6a44544b service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:34.575859 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2364/4745] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:34.606539 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2382/4746] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:17:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 30 21:17:35.350590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234dc35-6790-4ac6-bdb2-3c01cce187d2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:35.350895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234dc35-6790-4ac6-bdb2-3c01cce187d2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:35.351960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234dc35-6790-4ac6-bdb2-3c01cce187d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:35.399703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f234dc35-6790-4ac6-bdb2-3c01cce187d2 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:35.400977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f234dc35-6790-4ac6-bdb2-3c01cce187d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:35.418273 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2365/4747] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:17:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:35.432517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242594e5-bf17-4d88-a489-3c3e6a44544b service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:35.445056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242594e5-bf17-4d88-a489-3c3e6a44544b service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:35.459113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613c7f0-b1a3-4c58-9d55-d5e4f836edcd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:35.460310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613c7f0-b1a3-4c58-9d55-d5e4f836edcd service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:35.460787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613c7f0-b1a3-4c58-9d55-d5e4f836edcd service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:35.461404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613c7f0-b1a3-4c58-9d55-d5e4f836edcd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:35.480171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613c7f0-b1a3-4c58-9d55-d5e4f836edcd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:35.481794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613c7f0-b1a3-4c58-9d55-d5e4f836edcd service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:35.491306 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2383/4748] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:17:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:17:35.692347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b097a-f99a-44d7-aa50-d7e076db5ecb None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:35.692889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b097a-f99a-44d7-aa50-d7e076db5ecb None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:35.693437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b097a-f99a-44d7-aa50-d7e076db5ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:35.741580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-af1b097a-f99a-44d7-aa50-d7e076db5ecb None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:35.743421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-af1b097a-f99a-44d7-aa50-d7e076db5ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:35.777753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bfa34-5104-42d2-b0e4-efe6580b97da None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:35.778435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bfa34-5104-42d2-b0e4-efe6580b97da None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:35.778940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bfa34-5104-42d2-b0e4-efe6580b97da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:35.785549 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2366/4749] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:17:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:35.786556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b097a-f99a-44d7-aa50-d7e076db5ecb None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:35.834237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b097a-f99a-44d7-aa50-d7e076db5ecb None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:35.840255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c51bfa34-5104-42d2-b0e4-efe6580b97da None None] MFA Rules not processed for user `4a01092bfa5a4118a5fe61a6dc9c5460`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:35.843549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c51bfa34-5104-42d2-b0e4-efe6580b97da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:35.845083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60effed3-10f4-4d73-8318-3f52d3d7285b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:35.845918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60effed3-10f4-4d73-8318-3f52d3d7285b service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:35.846437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60effed3-10f4-4d73-8318-3f52d3d7285b service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:35.846929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60effed3-10f4-4d73-8318-3f52d3d7285b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:35.879366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60effed3-10f4-4d73-8318-3f52d3d7285b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:35.881314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60effed3-10f4-4d73-8318-3f52d3d7285b service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:35.902029 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2367/4750] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:17:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:17:35.989961 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2384/4751] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:17:36.557819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa9cea-52fa-4c2e-9b6f-b3244defcec0 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:36.558475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa9cea-52fa-4c2e-9b6f-b3244defcec0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:36.558475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa9cea-52fa-4c2e-9b6f-b3244defcec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:36.595005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-dcaa9cea-52fa-4c2e-9b6f-b3244defcec0 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:36.596332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dcaa9cea-52fa-4c2e-9b6f-b3244defcec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:36.605664 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2368/4752] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:17:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:36.621732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bfa34-5104-42d2-b0e4-efe6580b97da None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:36.645072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bfa34-5104-42d2-b0e4-efe6580b97da None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:36.665321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26766809-a357-4b4b-986b-7ab4d0b26cd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:36.665982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26766809-a357-4b4b-986b-7ab4d0b26cd7 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:36.666586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26766809-a357-4b4b-986b-7ab4d0b26cd7 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:36.666805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26766809-a357-4b4b-986b-7ab4d0b26cd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:36.688004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26766809-a357-4b4b-986b-7ab4d0b26cd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:36.688004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26766809-a357-4b4b-986b-7ab4d0b26cd7 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:36.710671 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2385/4753] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:17:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:17:37.063142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c969902-469c-4876-b77f-4ac5a565de2d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:37.063501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c969902-469c-4876-b77f-4ac5a565de2d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:37.063807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c969902-469c-4876-b77f-4ac5a565de2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:37.088016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6c969902-469c-4876-b77f-4ac5a565de2d None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:37.089532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6c969902-469c-4876-b77f-4ac5a565de2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:37.122381 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2369/4754] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:37.136164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26766809-a357-4b4b-986b-7ab4d0b26cd7 service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:37.155808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26766809-a357-4b4b-986b-7ab4d0b26cd7 service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:37.163032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c5bc9-a194-4852-aae8-532f5920ff5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:37.165224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c5bc9-a194-4852-aae8-532f5920ff5f service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:37.165657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c5bc9-a194-4852-aae8-532f5920ff5f service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:37.166077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c5bc9-a194-4852-aae8-532f5920ff5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:37.177941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c5bc9-a194-4852-aae8-532f5920ff5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:37.179946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c5bc9-a194-4852-aae8-532f5920ff5f service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:37.191452 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2386/4755] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:17:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 30 21:17:37.419167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c969902-469c-4876-b77f-4ac5a565de2d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:37.446895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c5bc9-a194-4852-aae8-532f5920ff5f service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:37.474402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:37.535508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c5bc9-a194-4852-aae8-532f5920ff5f service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:37.541875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b7cba-b663-4b2e-a178-0b39bd7cdcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:37.543012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b7cba-b663-4b2e-a178-0b39bd7cdcf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:37.543680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b7cba-b663-4b2e-a178-0b39bd7cdcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:37.544306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b7cba-b663-4b2e-a178-0b39bd7cdcf6 admin admin] PATH_INFO: `/v3/users/f879fe7d81cd467ea6dba3e2b483a5cc` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:37.545950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b7cba-b663-4b2e-a178-0b39bd7cdcf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f879fe7d81cd467ea6dba3e2b483a5cc)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:37.548458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b7cba-b663-4b2e-a178-0b39bd7cdcf6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:37.585391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c969902-469c-4876-b77f-4ac5a565de2d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:37.593805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54809853-8fd1-4e70-b773-049683c9916a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:37.595516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54809853-8fd1-4e70-b773-049683c9916a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:37.596245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54809853-8fd1-4e70-b773-049683c9916a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:37.597823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54809853-8fd1-4e70-b773-049683c9916a admin admin] PATH_INFO: `/v3/users/90655f3641c349388f0afd179d3336d8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:37.601420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54809853-8fd1-4e70-b773-049683c9916a admin admin] RBAC: Authorizing `identity:delete_user(user_id=90655f3641c349388f0afd179d3336d8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:37.604275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54809853-8fd1-4e70-b773-049683c9916a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:37.642482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b2b7cba-b663-4b2e-a178-0b39bd7cdcf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f879fe7d81cd467ea6dba3e2b483a5cc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:37.676577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b2b7cba-b663-4b2e-a178-0b39bd7cdcf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f879fe7d81cd467ea6dba3e2b483a5cc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:37.677580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b2b7cba-b663-4b2e-a178-0b39bd7cdcf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f879fe7d81cd467ea6dba3e2b483a5cc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:37.688933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b2b7cba-b663-4b2e-a178-0b39bd7cdcf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f879fe7d81cd467ea6dba3e2b483a5cc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:37.689873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b2b7cba-b663-4b2e-a178-0b39bd7cdcf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f879fe7d81cd467ea6dba3e2b483a5cc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:37.714136 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2387/4756] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:37 2022] DELETE /identity/v3/users/f879fe7d81cd467ea6dba3e2b483a5cc => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:37.718990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e633f61-e451-430f-a24b-e1a150bdcd20 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:37.719441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e633f61-e451-430f-a24b-e1a150bdcd20 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:37.719875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e633f61-e451-430f-a24b-e1a150bdcd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:37.723385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-54809853-8fd1-4e70-b773-049683c9916a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90655f3641c349388f0afd179d3336d8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:37.724190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-54809853-8fd1-4e70-b773-049683c9916a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90655f3641c349388f0afd179d3336d8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:37.738337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:37.750141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-54809853-8fd1-4e70-b773-049683c9916a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90655f3641c349388f0afd179d3336d8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:37.753881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-54809853-8fd1-4e70-b773-049683c9916a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90655f3641c349388f0afd179d3336d8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:37.761272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1e633f61-e451-430f-a24b-e1a150bdcd20 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:37.763041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1e633f61-e451-430f-a24b-e1a150bdcd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:37.771829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-54809853-8fd1-4e70-b773-049683c9916a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90655f3641c349388f0afd179d3336d8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:37.806296 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2370/4757] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:37 2022] DELETE /identity/v3/users/90655f3641c349388f0afd179d3336d8 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:37.812020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f6a1d-bb31-497f-8e70-b40bfd18bf0a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:37.812485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f6a1d-bb31-497f-8e70-b40bfd18bf0a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:37.812900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f6a1d-bb31-497f-8e70-b40bfd18bf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:37.837615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f18f6a1d-bb31-497f-8e70-b40bfd18bf0a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:37.839348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f18f6a1d-bb31-497f-8e70-b40bfd18bf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:37.907372 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2388/4758] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:17:37.925948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e633f61-e451-430f-a24b-e1a150bdcd20 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:37.928614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1e633f61-e451-430f-a24b-e1a150bdcd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:37.951024 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2371/4759] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:37.975823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f6a1d-bb31-497f-8e70-b40bfd18bf0a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:37.978058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f18f6a1d-bb31-497f-8e70-b40bfd18bf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:38.052862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:38.092073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e633f61-e451-430f-a24b-e1a150bdcd20 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:38.132846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f6a1d-bb31-497f-8e70-b40bfd18bf0a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:38.145311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1395af-ce6a-445e-8cac-0f49d8d30820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:38.146018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1395af-ce6a-445e-8cac-0f49d8d30820 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:38.146302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1395af-ce6a-445e-8cac-0f49d8d30820 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:38.146702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1395af-ce6a-445e-8cac-0f49d8d30820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:38.169324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1395af-ce6a-445e-8cac-0f49d8d30820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:38.170838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1395af-ce6a-445e-8cac-0f49d8d30820 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:38.191644 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2372/4760] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:17:38.232129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce206d8f-c8d7-4bfe-a31b-bc62c7cf6dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:38.233305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce206d8f-c8d7-4bfe-a31b-bc62c7cf6dfd service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:38.233737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce206d8f-c8d7-4bfe-a31b-bc62c7cf6dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:38.234261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce206d8f-c8d7-4bfe-a31b-bc62c7cf6dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:38.254852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce206d8f-c8d7-4bfe-a31b-bc62c7cf6dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:38.256519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce206d8f-c8d7-4bfe-a31b-bc62c7cf6dfd service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:38.271619 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2389/4761] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:17:40.340429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1395af-ce6a-445e-8cac-0f49d8d30820 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:40.342173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fe1395af-ce6a-445e-8cac-0f49d8d30820 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:40.365575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1395af-ce6a-445e-8cac-0f49d8d30820 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:40.381145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e30eb2-9ebf-46fc-a33e-9d6398124126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:40.381815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e30eb2-9ebf-46fc-a33e-9d6398124126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:40.382252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e30eb2-9ebf-46fc-a33e-9d6398124126 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:40.382677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e30eb2-9ebf-46fc-a33e-9d6398124126 admin admin] PATH_INFO: `/v3/projects/3382562e84764eb78a1ecd96cdb34842` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:40.384016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e30eb2-9ebf-46fc-a33e-9d6398124126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3382562e84764eb78a1ecd96cdb34842)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:40.386178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e30eb2-9ebf-46fc-a33e-9d6398124126 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:40.467169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-57e30eb2-9ebf-46fc-a33e-9d6398124126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3382562e84764eb78a1ecd96cdb34842', 'request_id': 'req-57e30eb2-9ebf-46fc-a33e-9d6398124126'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:40.481443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-57e30eb2-9ebf-46fc-a33e-9d6398124126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3382562e84764eb78a1ecd96cdb34842', 'request_id': 'req-57e30eb2-9ebf-46fc-a33e-9d6398124126'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:40.493620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-57e30eb2-9ebf-46fc-a33e-9d6398124126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3382562e84764eb78a1ecd96cdb34842', 'request_id': 'req-57e30eb2-9ebf-46fc-a33e-9d6398124126'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:40.502414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:40.509200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-57e30eb2-9ebf-46fc-a33e-9d6398124126 admin admin] The token cache is being invalidate because project 3382562e84764eb78a1ecd96cdb34842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:40.509579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-57e30eb2-9ebf-46fc-a33e-9d6398124126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:40.510418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-57e30eb2-9ebf-46fc-a33e-9d6398124126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:40.515885 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2373/4762] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:40 2022] DELETE /identity/v3/projects/3382562e84764eb78a1ecd96cdb34842 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:40.519997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256470cf-9660-4d44-a245-5da506bccbaf None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:40.521638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256470cf-9660-4d44-a245-5da506bccbaf None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:40.522011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256470cf-9660-4d44-a245-5da506bccbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:40.549686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-256470cf-9660-4d44-a245-5da506bccbaf None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:40.551875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-256470cf-9660-4d44-a245-5da506bccbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:40.644244 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2390/4763] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:40.648433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e30eb2-9ebf-46fc-a33e-9d6398124126 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:40.650817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-57e30eb2-9ebf-46fc-a33e-9d6398124126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:40.654345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e77c36-bf32-4d12-8d84-df9b6d1c6828 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:40.654695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e77c36-bf32-4d12-8d84-df9b6d1c6828 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:40.655353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e77c36-bf32-4d12-8d84-df9b6d1c6828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:40.669565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e30eb2-9ebf-46fc-a33e-9d6398124126 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:40.677691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9581f0e-ac8e-483c-88b7-54ececc93758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:40.679053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9581f0e-ac8e-483c-88b7-54ececc93758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:40.679547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9581f0e-ac8e-483c-88b7-54ececc93758 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:40.680003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9581f0e-ac8e-483c-88b7-54ececc93758 admin admin] PATH_INFO: `/v3/projects/1c817036e10a44bfa71d235dd8a3b0e7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:40.681511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9581f0e-ac8e-483c-88b7-54ececc93758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c817036e10a44bfa71d235dd8a3b0e7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:40.683695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9581f0e-ac8e-483c-88b7-54ececc93758 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:40.688504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b1e77c36-bf32-4d12-8d84-df9b6d1c6828 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:40.689769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b1e77c36-bf32-4d12-8d84-df9b6d1c6828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:40.721518 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2391/4764] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:40.726450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e77c36-bf32-4d12-8d84-df9b6d1c6828 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:40.762094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e77c36-bf32-4d12-8d84-df9b6d1c6828 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:40.768917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c9581f0e-ac8e-483c-88b7-54ececc93758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c817036e10a44bfa71d235dd8a3b0e7', 'request_id': 'req-c9581f0e-ac8e-483c-88b7-54ececc93758'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:40.791897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c9581f0e-ac8e-483c-88b7-54ececc93758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c817036e10a44bfa71d235dd8a3b0e7', 'request_id': 'req-c9581f0e-ac8e-483c-88b7-54ececc93758'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:40.801373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c9581f0e-ac8e-483c-88b7-54ececc93758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c817036e10a44bfa71d235dd8a3b0e7', 'request_id': 'req-c9581f0e-ac8e-483c-88b7-54ececc93758'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:40.828212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c9581f0e-ac8e-483c-88b7-54ececc93758 admin admin] The token cache is being invalidate because project 1c817036e10a44bfa71d235dd8a3b0e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:40.828609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c9581f0e-ac8e-483c-88b7-54ececc93758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:40.830357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c9581f0e-ac8e-483c-88b7-54ececc93758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:40.832332 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2374/4765] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:40 2022] DELETE /identity/v3/projects/1c817036e10a44bfa71d235dd8a3b0e7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:40.837068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9581f0e-ac8e-483c-88b7-54ececc93758 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:40.840129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c9581f0e-ac8e-483c-88b7-54ececc93758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:40.876073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42d928-1a0a-4335-9eaf-5f0a8922f211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:40.876974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42d928-1a0a-4335-9eaf-5f0a8922f211 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:40.877230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42d928-1a0a-4335-9eaf-5f0a8922f211 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:40.877526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42d928-1a0a-4335-9eaf-5f0a8922f211 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:40.879620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42d928-1a0a-4335-9eaf-5f0a8922f211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:17:40.880378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42d928-1a0a-4335-9eaf-5f0a8922f211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:40.881926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42d928-1a0a-4335-9eaf-5f0a8922f211 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:40.916299 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2392/4766] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:17:40.921153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42d928-1a0a-4335-9eaf-5f0a8922f211 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:40.925234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6c42d928-1a0a-4335-9eaf-5f0a8922f211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:40.943485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42d928-1a0a-4335-9eaf-5f0a8922f211 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:40.963724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9581f0e-ac8e-483c-88b7-54ececc93758 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:40.974460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04b668-7ca3-4a1f-bc22-a5fb9bdb4931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:40.975124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04b668-7ca3-4a1f-bc22-a5fb9bdb4931 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:40.975418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04b668-7ca3-4a1f-bc22-a5fb9bdb4931 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:40.975704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04b668-7ca3-4a1f-bc22-a5fb9bdb4931 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:40.976390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04b668-7ca3-4a1f-bc22-a5fb9bdb4931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:40.977956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b4532-7062-40ff-ad2b-3c6da4f93bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:40.980574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b4532-7062-40ff-ad2b-3c6da4f93bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:40.980574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b4532-7062-40ff-ad2b-3c6da4f93bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:40.980574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b4532-7062-40ff-ad2b-3c6da4f93bfe admin admin] PATH_INFO: `/v3/users/a65d5b846668460a81fbeecf2f0fb4f0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:40.982002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b4532-7062-40ff-ad2b-3c6da4f93bfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a65d5b846668460a81fbeecf2f0fb4f0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:40.983750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b4532-7062-40ff-ad2b-3c6da4f93bfe admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:40.987222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04b668-7ca3-4a1f-bc22-a5fb9bdb4931 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:41.043084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:41.068451 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2393/4767] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:40 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:41.074396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04b668-7ca3-4a1f-bc22-a5fb9bdb4931 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:41.122530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-514b4532-7062-40ff-ad2b-3c6da4f93bfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a65d5b846668460a81fbeecf2f0fb4f0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:41.123440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-514b4532-7062-40ff-ad2b-3c6da4f93bfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a65d5b846668460a81fbeecf2f0fb4f0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:41.147394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-514b4532-7062-40ff-ad2b-3c6da4f93bfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a65d5b846668460a81fbeecf2f0fb4f0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:41.148214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-514b4532-7062-40ff-ad2b-3c6da4f93bfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a65d5b846668460a81fbeecf2f0fb4f0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:41.166527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-514b4532-7062-40ff-ad2b-3c6da4f93bfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a65d5b846668460a81fbeecf2f0fb4f0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:41.182301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:41.186027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04b668-7ca3-4a1f-bc22-a5fb9bdb4931 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:41.191832 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2375/4768] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:40 2022] DELETE /identity/v3/users/a65d5b846668460a81fbeecf2f0fb4f0 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:41.293311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea380a-866e-4fc7-89d0-ad7a31e6f4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:41.294455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea380a-866e-4fc7-89d0-ad7a31e6f4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:41.294894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea380a-866e-4fc7-89d0-ad7a31e6f4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:41.295529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea380a-866e-4fc7-89d0-ad7a31e6f4c2 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:41.301250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea380a-866e-4fc7-89d0-ad7a31e6f4c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:41.310636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea380a-866e-4fc7-89d0-ad7a31e6f4c2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:41.351077 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2394/4769] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:17:41 2022] POST /identity/v3/users => generated 288 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:41.352762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b4532-7062-40ff-ad2b-3c6da4f93bfe admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:41.354240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-514b4532-7062-40ff-ad2b-3c6da4f93bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:41.369438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b4532-7062-40ff-ad2b-3c6da4f93bfe admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:41.374522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc6ff8-890f-4b25-9bab-de7d8e188ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:41.375779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc6ff8-890f-4b25-9bab-de7d8e188ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:41.375779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc6ff8-890f-4b25-9bab-de7d8e188ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:41.375779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc6ff8-890f-4b25-9bab-de7d8e188ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:41.376586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc6ff8-890f-4b25-9bab-de7d8e188ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:41.381885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc6ff8-890f-4b25-9bab-de7d8e188ce1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:41.398127 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2376/4770] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:41.399531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea380a-866e-4fc7-89d0-ad7a31e6f4c2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:41.424574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea380a-866e-4fc7-89d0-ad7a31e6f4c2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:41.435345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fa2cb-7953-4d0c-97d1-91679d0616b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:41.436509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fa2cb-7953-4d0c-97d1-91679d0616b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:41.436879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fa2cb-7953-4d0c-97d1-91679d0616b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:41.437228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fa2cb-7953-4d0c-97d1-91679d0616b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:41.438549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fa2cb-7953-4d0c-97d1-91679d0616b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:41.440987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fa2cb-7953-4d0c-97d1-91679d0616b4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:41.463213 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2395/4771] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:41.464171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc6ff8-890f-4b25-9bab-de7d8e188ce1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:41.491474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc6ff8-890f-4b25-9bab-de7d8e188ce1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:41.504885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b63392-14e1-4444-8e8f-3943968b7727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:41.505593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b63392-14e1-4444-8e8f-3943968b7727 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:41.509584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b63392-14e1-4444-8e8f-3943968b7727 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:41.509780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b63392-14e1-4444-8e8f-3943968b7727 admin admin] PATH_INFO: `/v3/projects/f624ef957bcf4b8abaf801d006e3c67c/users/7a68fd0a1fe84e928a37b474412accc4/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:41.563611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b63392-14e1-4444-8e8f-3943968b7727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f624ef957bcf4b8abaf801d006e3c67c, user_id=7a68fd0a1fe84e928a37b474412accc4, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:41.567572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b63392-14e1-4444-8e8f-3943968b7727 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:41.605893 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2377/4772] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:41 2022] PUT /identity/v3/projects/f624ef957bcf4b8abaf801d006e3c67c/users/7a68fd0a1fe84e928a37b474412accc4/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:41.617084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f3d0c-2a46-42fa-bbac-cf67ca5b0a92 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:41.618280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f3d0c-2a46-42fa-bbac-cf67ca5b0a92 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:41.618280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f3d0c-2a46-42fa-bbac-cf67ca5b0a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:41.676603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1f5f3d0c-2a46-42fa-bbac-cf67ca5b0a92 None None] MFA Rules not processed for user `7a68fd0a1fe84e928a37b474412accc4`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:41.678118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1f5f3d0c-2a46-42fa-bbac-cf67ca5b0a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:41.808697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b63392-14e1-4444-8e8f-3943968b7727 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:41.811460 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2396/4773] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:41.894894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b63392-14e1-4444-8e8f-3943968b7727 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:41.900910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742a798-4221-4b27-aaa1-70ce69329b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:41.901683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742a798-4221-4b27-aaa1-70ce69329b91 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:41.901975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742a798-4221-4b27-aaa1-70ce69329b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:41.903239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742a798-4221-4b27-aaa1-70ce69329b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:41.903239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742a798-4221-4b27-aaa1-70ce69329b91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:41.904876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742a798-4221-4b27-aaa1-70ce69329b91 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:41.941782 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2378/4774] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:41 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:41.945074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f3d0c-2a46-42fa-bbac-cf67ca5b0a92 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:41.959199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f3d0c-2a46-42fa-bbac-cf67ca5b0a92 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:41.973666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:42.042747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d7050-7716-453a-a8d5-758373a27db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:42.043482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d7050-7716-453a-a8d5-758373a27db1 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:42.043770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d7050-7716-453a-a8d5-758373a27db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:42.044124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d7050-7716-453a-a8d5-758373a27db1 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:42.044877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d7050-7716-453a-a8d5-758373a27db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:42.046858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d7050-7716-453a-a8d5-758373a27db1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:42.092931 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2397/4775] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:17:41 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:42.093763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742a798-4221-4b27-aaa1-70ce69329b91 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:42.106505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742a798-4221-4b27-aaa1-70ce69329b91 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:42.114603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5745f46-002b-4976-b0f1-eaec5f5caf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:42.116039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5745f46-002b-4976-b0f1-eaec5f5caf9c admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:42.117766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5745f46-002b-4976-b0f1-eaec5f5caf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:42.118377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5745f46-002b-4976-b0f1-eaec5f5caf9c admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:42.119257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5745f46-002b-4976-b0f1-eaec5f5caf9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:42.121914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5745f46-002b-4976-b0f1-eaec5f5caf9c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:42.134231 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2379/4776] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:17:42.138190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d7050-7716-453a-a8d5-758373a27db1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:42.150959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d7050-7716-453a-a8d5-758373a27db1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:42.156445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30d4f7-41c4-4855-a744-ff14286a7a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:42.157425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30d4f7-41c4-4855-a744-ff14286a7a4e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:42.157786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30d4f7-41c4-4855-a744-ff14286a7a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:42.158141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30d4f7-41c4-4855-a744-ff14286a7a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:42.159014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30d4f7-41c4-4855-a744-ff14286a7a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:42.161045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30d4f7-41c4-4855-a744-ff14286a7a4e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:42.176545 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2398/4777] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:42.192720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5745f46-002b-4976-b0f1-eaec5f5caf9c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:42.216301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5745f46-002b-4976-b0f1-eaec5f5caf9c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:42.223648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d884df3-c28b-4a0f-a722-8763365103d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:42.224742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d884df3-c28b-4a0f-a722-8763365103d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:42.225332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d884df3-c28b-4a0f-a722-8763365103d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:42.225849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d884df3-c28b-4a0f-a722-8763365103d1 admin admin] PATH_INFO: `/v3/projects/cf0f4e701c5f4cf1982f59164a160de5/users/176b8604a67f4059bd6a58a75186bf04/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:42.246426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d884df3-c28b-4a0f-a722-8763365103d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0f4e701c5f4cf1982f59164a160de5, user_id=176b8604a67f4059bd6a58a75186bf04, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:42.262105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d884df3-c28b-4a0f-a722-8763365103d1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:42.318202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced66fda-0e67-4ba1-8609-21e8db98ddfa None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:42.318996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced66fda-0e67-4ba1-8609-21e8db98ddfa None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:42.319372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced66fda-0e67-4ba1-8609-21e8db98ddfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:42.319513 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2380/4778] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:42 2022] PUT /identity/v3/projects/cf0f4e701c5f4cf1982f59164a160de5/users/176b8604a67f4059bd6a58a75186bf04/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:42.408031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ced66fda-0e67-4ba1-8609-21e8db98ddfa None None] MFA Rules not processed for user `176b8604a67f4059bd6a58a75186bf04`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:42.409276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ced66fda-0e67-4ba1-8609-21e8db98ddfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:42.511042 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2399/4779] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:42.533999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d884df3-c28b-4a0f-a722-8763365103d1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:42.536197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6d884df3-c28b-4a0f-a722-8763365103d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:42.673686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d884df3-c28b-4a0f-a722-8763365103d1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:42.682468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c635d3-7922-44d6-bd20-f513fe62e17b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:42.685220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c635d3-7922-44d6-bd20-f513fe62e17b service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:42.685521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c635d3-7922-44d6-bd20-f513fe62e17b service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:42.685807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c635d3-7922-44d6-bd20-f513fe62e17b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:42.756937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:42.828575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c635d3-7922-44d6-bd20-f513fe62e17b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:42.830813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c635d3-7922-44d6-bd20-f513fe62e17b service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:42.849092 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2381/4780] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:17:42.979502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced66fda-0e67-4ba1-8609-21e8db98ddfa None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:42.981069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ced66fda-0e67-4ba1-8609-21e8db98ddfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:43.092306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9e83c-7165-434a-8846-f9216214db83 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:43.092306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9e83c-7165-434a-8846-f9216214db83 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:43.092306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9e83c-7165-434a-8846-f9216214db83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:43.101069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced66fda-0e67-4ba1-8609-21e8db98ddfa None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:43.134407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff15770-c850-4843-808a-2679a6dcc461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:43.135083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff15770-c850-4843-808a-2679a6dcc461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:43.135400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff15770-c850-4843-808a-2679a6dcc461 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:43.135693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff15770-c850-4843-808a-2679a6dcc461 admin admin] PATH_INFO: `/v3/projects/1bad1cb020eb478884e71b78106c2519` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:43.138935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff15770-c850-4843-808a-2679a6dcc461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bad1cb020eb478884e71b78106c2519)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:43.140956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff15770-c850-4843-808a-2679a6dcc461 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:43.155694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6be9e83c-7165-434a-8846-f9216214db83 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:43.156945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6be9e83c-7165-434a-8846-f9216214db83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:43.189918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:43.223012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1ff15770-c850-4843-808a-2679a6dcc461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bad1cb020eb478884e71b78106c2519', 'request_id': 'req-1ff15770-c850-4843-808a-2679a6dcc461'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:43.233443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1ff15770-c850-4843-808a-2679a6dcc461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bad1cb020eb478884e71b78106c2519', 'request_id': 'req-1ff15770-c850-4843-808a-2679a6dcc461'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:43.248693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1ff15770-c850-4843-808a-2679a6dcc461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bad1cb020eb478884e71b78106c2519', 'request_id': 'req-1ff15770-c850-4843-808a-2679a6dcc461'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:43.268328 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2382/4781] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:17:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 30 21:17:43.288271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9e83c-7165-434a-8846-f9216214db83 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:43.292464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6be9e83c-7165-434a-8846-f9216214db83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:43.323537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1ff15770-c850-4843-808a-2679a6dcc461 admin admin] The token cache is being invalidate because project 1bad1cb020eb478884e71b78106c2519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:43.323886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1ff15770-c850-4843-808a-2679a6dcc461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:43.325998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1ff15770-c850-4843-808a-2679a6dcc461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:43.328945 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2400/4782] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:42 2022] DELETE /identity/v3/projects/1bad1cb020eb478884e71b78106c2519 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:43.334078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ff667-2326-402f-9995-daa5e44823a9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:43.334377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ff667-2326-402f-9995-daa5e44823a9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:43.334663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ff667-2326-402f-9995-daa5e44823a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:43.395469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b37ff667-2326-402f-9995-daa5e44823a9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:43.396813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b37ff667-2326-402f-9995-daa5e44823a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:43.456691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9e83c-7165-434a-8846-f9216214db83 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:43.531014 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2401/4783] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:17:43.539056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07273236-4cc6-4dc6-9a6a-27859ec8979a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:43.541364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07273236-4cc6-4dc6-9a6a-27859ec8979a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:43.541973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07273236-4cc6-4dc6-9a6a-27859ec8979a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:43.556932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f9b38-6073-435d-b2c1-4cc42ff6564d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:43.557580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f9b38-6073-435d-b2c1-4cc42ff6564d service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:43.557869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f9b38-6073-435d-b2c1-4cc42ff6564d service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:43.558561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f9b38-6073-435d-b2c1-4cc42ff6564d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:43.561588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f36f9b38-6073-435d-b2c1-4cc42ff6564d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:43.574466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-07273236-4cc6-4dc6-9a6a-27859ec8979a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:43.576028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-07273236-4cc6-4dc6-9a6a-27859ec8979a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:43.588418 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2402/4784] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:43.592839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07273236-4cc6-4dc6-9a6a-27859ec8979a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:43.602513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:43.613218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07273236-4cc6-4dc6-9a6a-27859ec8979a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:43.627489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1153f0-0e79-4a9f-8d28-56d03b31df72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:43.628554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1153f0-0e79-4a9f-8d28-56d03b31df72 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:43.628931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1153f0-0e79-4a9f-8d28-56d03b31df72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:43.629305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1153f0-0e79-4a9f-8d28-56d03b31df72 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:43.630259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1153f0-0e79-4a9f-8d28-56d03b31df72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:17:43.630666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1153f0-0e79-4a9f-8d28-56d03b31df72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:43.632713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1153f0-0e79-4a9f-8d28-56d03b31df72 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:43.652345 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2403/4785] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:17:43.654066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1153f0-0e79-4a9f-8d28-56d03b31df72 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:43.665637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1153f0-0e79-4a9f-8d28-56d03b31df72 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:43.672826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4f74b-8e35-4372-9897-44f0e47182a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:43.673656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4f74b-8e35-4372-9897-44f0e47182a7 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:43.673911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4f74b-8e35-4372-9897-44f0e47182a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:43.674402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4f74b-8e35-4372-9897-44f0e47182a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:43.675177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4f74b-8e35-4372-9897-44f0e47182a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:43.678114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4f74b-8e35-4372-9897-44f0e47182a7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:43.701733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f9b38-6073-435d-b2c1-4cc42ff6564d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:43.703989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f9b38-6073-435d-b2c1-4cc42ff6564d service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:43.715384 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2404/4786] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:43 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:43.719220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4f74b-8e35-4372-9897-44f0e47182a7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:43.727473 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2383/4787] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:17:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:17:43.942459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4f74b-8e35-4372-9897-44f0e47182a7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:43.968337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a24840-40a8-41ae-9a49-a8f361ac18e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:43.968999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24840-40a8-41ae-9a49-a8f361ac18e3 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:43.969289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24840-40a8-41ae-9a49-a8f361ac18e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:43.969568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24840-40a8-41ae-9a49-a8f361ac18e3 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:43.970239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a24840-40a8-41ae-9a49-a8f361ac18e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:43.976429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a24840-40a8-41ae-9a49-a8f361ac18e3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:44.011565 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2405/4788] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:17:43 2022] POST /identity/v3/users => generated 291 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:44.015540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f9b38-6073-435d-b2c1-4cc42ff6564d service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:44.029975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f9b38-6073-435d-b2c1-4cc42ff6564d service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:44.038404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec45f8-6e04-4573-b0d8-7459375efaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:44.040162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec45f8-6e04-4573-b0d8-7459375efaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:44.040646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec45f8-6e04-4573-b0d8-7459375efaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:44.041142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec45f8-6e04-4573-b0d8-7459375efaf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:44.042266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec45f8-6e04-4573-b0d8-7459375efaf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:44.044858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec45f8-6e04-4573-b0d8-7459375efaf2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:44.060606 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2384/4789] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:44.064381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a24840-40a8-41ae-9a49-a8f361ac18e3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:44.093658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:44.123549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a24840-40a8-41ae-9a49-a8f361ac18e3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:44.132920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec45f8-6e04-4573-b0d8-7459375efaf2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:44.135455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-20ec45f8-6e04-4573-b0d8-7459375efaf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:44.140068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ed00a-6ae4-4ddd-976c-2f5b08cd3580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:44.140852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ed00a-6ae4-4ddd-976c-2f5b08cd3580 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:44.141259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ed00a-6ae4-4ddd-976c-2f5b08cd3580 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:44.141641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ed00a-6ae4-4ddd-976c-2f5b08cd3580 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:44.142467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ed00a-6ae4-4ddd-976c-2f5b08cd3580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:44.144360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ed00a-6ae4-4ddd-976c-2f5b08cd3580 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:44.168121 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2406/4790] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:17:44.169414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ed00a-6ae4-4ddd-976c-2f5b08cd3580 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:44.179694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ed00a-6ae4-4ddd-976c-2f5b08cd3580 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:44.186500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f652a-800a-4524-a677-3b4375c81cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:44.187038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f652a-800a-4524-a677-3b4375c81cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:44.187533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f652a-800a-4524-a677-3b4375c81cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:44.187909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f652a-800a-4524-a677-3b4375c81cd2 admin admin] PATH_INFO: `/v3/projects/f5dbb8df83904ce1b3e63f2a3c52a50a/users/b7652e6749ae4dcf8ef297cc38b8004b/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:44.204875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f652a-800a-4524-a677-3b4375c81cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5dbb8df83904ce1b3e63f2a3c52a50a, user_id=b7652e6749ae4dcf8ef297cc38b8004b, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:44.207540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f652a-800a-4524-a677-3b4375c81cd2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:44.245164 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2407/4791] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:44 2022] PUT /identity/v3/projects/f5dbb8df83904ce1b3e63f2a3c52a50a/users/b7652e6749ae4dcf8ef297cc38b8004b/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:44.246869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf88bb1-1f93-4888-9f6d-6ceb3edbaeca None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:44.248490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf88bb1-1f93-4888-9f6d-6ceb3edbaeca None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:44.248780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf88bb1-1f93-4888-9f6d-6ceb3edbaeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:44.254378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec45f8-6e04-4573-b0d8-7459375efaf2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:44.287721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7cf88bb1-1f93-4888-9f6d-6ceb3edbaeca None None] MFA Rules not processed for user `b7652e6749ae4dcf8ef297cc38b8004b`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:44.289137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7cf88bb1-1f93-4888-9f6d-6ceb3edbaeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:44.365822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10b928-eeb6-44f7-b4d5-edb19956f9f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:44.367689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10b928-eeb6-44f7-b4d5-edb19956f9f4 service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:44.368276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10b928-eeb6-44f7-b4d5-edb19956f9f4 service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:44.368744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10b928-eeb6-44f7-b4d5-edb19956f9f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:44.371136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9f10b928-eeb6-44f7-b4d5-edb19956f9f4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:44.389953 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2408/4792] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:44.390933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf88bb1-1f93-4888-9f6d-6ceb3edbaeca None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:44.480264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf88bb1-1f93-4888-9f6d-6ceb3edbaeca None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:44.486073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6883b-8e6e-4d19-9c73-21e8bcf9faa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:44.486878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6883b-8e6e-4d19-9c73-21e8bcf9faa4 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:44.487171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6883b-8e6e-4d19-9c73-21e8bcf9faa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:44.487503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6883b-8e6e-4d19-9c73-21e8bcf9faa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:44.488318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6883b-8e6e-4d19-9c73-21e8bcf9faa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:44.490724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6883b-8e6e-4d19-9c73-21e8bcf9faa4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:44.495820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10b928-eeb6-44f7-b4d5-edb19956f9f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:44.497942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10b928-eeb6-44f7-b4d5-edb19956f9f4 service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:44.519483 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2385/4793] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:17:44.534354 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2409/4794] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:44 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:44.535192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10b928-eeb6-44f7-b4d5-edb19956f9f4 service glance] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:44.555996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10b928-eeb6-44f7-b4d5-edb19956f9f4 service glance] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:44.574872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:44.631899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424c3eb-c24a-4094-9014-73ba54fc81d9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:44.632192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424c3eb-c24a-4094-9014-73ba54fc81d9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:44.632481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424c3eb-c24a-4094-9014-73ba54fc81d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:44.660723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7424c3eb-c24a-4094-9014-73ba54fc81d9 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:44.662265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7424c3eb-c24a-4094-9014-73ba54fc81d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:44.665494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a236dd-3057-4343-9cdf-5b753aaeaddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:44.666529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a236dd-3057-4343-9cdf-5b753aaeaddc admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:44.666949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a236dd-3057-4343-9cdf-5b753aaeaddc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:44.667458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a236dd-3057-4343-9cdf-5b753aaeaddc admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:44.668276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a236dd-3057-4343-9cdf-5b753aaeaddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:44.671862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a236dd-3057-4343-9cdf-5b753aaeaddc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:44.713554 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2386/4795] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:17:44 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:44.717720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a236dd-3057-4343-9cdf-5b753aaeaddc admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:44.740870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:44.743604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a236dd-3057-4343-9cdf-5b753aaeaddc admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:44.764671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c4909-fd41-495b-b668-23f662e69294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:44.766958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c4909-fd41-495b-b668-23f662e69294 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:44.768306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c4909-fd41-495b-b668-23f662e69294 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:44.769526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c4909-fd41-495b-b668-23f662e69294 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:44.770859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c4909-fd41-495b-b668-23f662e69294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:44.774803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c4909-fd41-495b-b668-23f662e69294 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:44.776565 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2410/4796] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:17:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:44.778217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424c3eb-c24a-4094-9014-73ba54fc81d9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:44.779797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7424c3eb-c24a-4094-9014-73ba54fc81d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:44.793580 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2387/4797] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:17:44.794556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c4909-fd41-495b-b668-23f662e69294 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:44.808658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c4909-fd41-495b-b668-23f662e69294 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:44.815737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6b0e6-97c3-48a4-8894-c2a9b418f580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:44.816434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6b0e6-97c3-48a4-8894-c2a9b418f580 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:44.817387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6b0e6-97c3-48a4-8894-c2a9b418f580 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:44.817601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6b0e6-97c3-48a4-8894-c2a9b418f580 admin admin] PATH_INFO: `/v3/projects/e0f1220695fc482e8e06391285979cdd/users/7974409262c24cdfbb3b95e9f8f9ff05/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:44.843070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6b0e6-97c3-48a4-8894-c2a9b418f580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f1220695fc482e8e06391285979cdd, user_id=7974409262c24cdfbb3b95e9f8f9ff05, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:44.847940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6b0e6-97c3-48a4-8894-c2a9b418f580 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:44.871706 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2388/4798] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:44 2022] PUT /identity/v3/projects/e0f1220695fc482e8e06391285979cdd/users/7974409262c24cdfbb3b95e9f8f9ff05/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:44.873006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6b0e6-97c3-48a4-8894-c2a9b418f580 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:44.874320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424c3eb-c24a-4094-9014-73ba54fc81d9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:44.951597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cbb8a-15d3-4042-8503-872eead2c5fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:44.952415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cbb8a-15d3-4042-8503-872eead2c5fe service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:44.952908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cbb8a-15d3-4042-8503-872eead2c5fe service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:44.953285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cbb8a-15d3-4042-8503-872eead2c5fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:44.968748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6b0e6-97c3-48a4-8894-c2a9b418f580 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:44.975170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea63ee-b6f0-4e45-a3cd-6b12e574a214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:44.976500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea63ee-b6f0-4e45-a3cd-6b12e574a214 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:44.978648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea63ee-b6f0-4e45-a3cd-6b12e574a214 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:44.978948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea63ee-b6f0-4e45-a3cd-6b12e574a214 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:44.980206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea63ee-b6f0-4e45-a3cd-6b12e574a214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:44.983140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea63ee-b6f0-4e45-a3cd-6b12e574a214 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:45.003382 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2389/4799] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:45.016389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea63ee-b6f0-4e45-a3cd-6b12e574a214 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:45.029628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea63ee-b6f0-4e45-a3cd-6b12e574a214 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:45.037331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f45143-835b-424c-ae57-6ef5239eefc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:45.038575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f45143-835b-424c-ae57-6ef5239eefc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:45.039107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f45143-835b-424c-ae57-6ef5239eefc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:45.039692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f45143-835b-424c-ae57-6ef5239eefc9 admin admin] PATH_INFO: `/v3/projects/e0f1220695fc482e8e06391285979cdd/users/7974409262c24cdfbb3b95e9f8f9ff05/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:45.042133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f45143-835b-424c-ae57-6ef5239eefc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f1220695fc482e8e06391285979cdd, user_id=7974409262c24cdfbb3b95e9f8f9ff05, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:45.045754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f45143-835b-424c-ae57-6ef5239eefc9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:45.047317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cbb8a-15d3-4042-8503-872eead2c5fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:45.049992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cbb8a-15d3-4042-8503-872eead2c5fe service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:45.062635 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2390/4800] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:45 2022] PUT /identity/v3/projects/e0f1220695fc482e8e06391285979cdd/users/7974409262c24cdfbb3b95e9f8f9ff05/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:45.069290 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2411/4801] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:17:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:17:45.074007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea485c4-047f-4637-9459-363eff8678d0 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:45.074310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea485c4-047f-4637-9459-363eff8678d0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:45.074630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea485c4-047f-4637-9459-363eff8678d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:45.106719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-aea485c4-047f-4637-9459-363eff8678d0 None None] MFA Rules not processed for user `7974409262c24cdfbb3b95e9f8f9ff05`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:45.108347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-aea485c4-047f-4637-9459-363eff8678d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:45.169242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:45.207214 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2391/4802] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:45.216614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cbb8a-15d3-4042-8503-872eead2c5fe service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:45.218574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d06cbb8a-15d3-4042-8503-872eead2c5fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:45.265540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:45.298592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cbb8a-15d3-4042-8503-872eead2c5fe service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:45.374291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf063e-d2b3-46bc-a89a-b42d6c815e18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:45.375709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf063e-d2b3-46bc-a89a-b42d6c815e18 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:45.377616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf063e-d2b3-46bc-a89a-b42d6c815e18 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:45.378437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf063e-d2b3-46bc-a89a-b42d6c815e18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:45.390319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf063e-d2b3-46bc-a89a-b42d6c815e18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:45.391881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf063e-d2b3-46bc-a89a-b42d6c815e18 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:45.398890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea485c4-047f-4637-9459-363eff8678d0 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:45.400350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-aea485c4-047f-4637-9459-363eff8678d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:45.407535 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2412/4803] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:17:45.524213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea485c4-047f-4637-9459-363eff8678d0 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:45.533416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53d232-0a1e-497d-984c-2254b750ad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:45.534213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53d232-0a1e-497d-984c-2254b750ad63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:45.534580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53d232-0a1e-497d-984c-2254b750ad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:45.535320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53d232-0a1e-497d-984c-2254b750ad63 admin admin] PATH_INFO: `/v3/users/7a68fd0a1fe84e928a37b474412accc4` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:45.536325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53d232-0a1e-497d-984c-2254b750ad63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a68fd0a1fe84e928a37b474412accc4)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:45.538607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53d232-0a1e-497d-984c-2254b750ad63 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:45.613058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ca53d232-0a1e-497d-984c-2254b750ad63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a68fd0a1fe84e928a37b474412accc4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:45.613800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ca53d232-0a1e-497d-984c-2254b750ad63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a68fd0a1fe84e928a37b474412accc4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:45.657737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ca53d232-0a1e-497d-984c-2254b750ad63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a68fd0a1fe84e928a37b474412accc4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:45.658661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ca53d232-0a1e-497d-984c-2254b750ad63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a68fd0a1fe84e928a37b474412accc4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:45.681676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ca53d232-0a1e-497d-984c-2254b750ad63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a68fd0a1fe84e928a37b474412accc4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:45.716477 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2392/4804] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:45 2022] DELETE /identity/v3/users/7a68fd0a1fe84e928a37b474412accc4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:17:45.722978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90f41c-40bc-4a88-ab6b-eeeb23090348 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:45.722978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90f41c-40bc-4a88-ab6b-eeeb23090348 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:45.723209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90f41c-40bc-4a88-ab6b-eeeb23090348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:45.762939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3c90f41c-40bc-4a88-ab6b-eeeb23090348 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:45.774173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3c90f41c-40bc-4a88-ab6b-eeeb23090348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:45.884410 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2413/4805] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:45.947400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53d232-0a1e-497d-984c-2254b750ad63 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:45.949470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ca53d232-0a1e-497d-984c-2254b750ad63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:46.033088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53d232-0a1e-497d-984c-2254b750ad63 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:46.040524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca5f5f-aeae-40f3-ad35-e747b63db0d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:46.041517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca5f5f-aeae-40f3-ad35-e747b63db0d4 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:46.041788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca5f5f-aeae-40f3-ad35-e747b63db0d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:46.042223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca5f5f-aeae-40f3-ad35-e747b63db0d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:46.060767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca5f5f-aeae-40f3-ad35-e747b63db0d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:46.061627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca5f5f-aeae-40f3-ad35-e747b63db0d4 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:46.077816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90f41c-40bc-4a88-ab6b-eeeb23090348 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:46.080854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3c90f41c-40bc-4a88-ab6b-eeeb23090348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:46.094964 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2393/4806] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:17:46.098751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90f41c-40bc-4a88-ab6b-eeeb23090348 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:46.103711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452531c6-9442-4013-86a0-c61bdc1f77c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:46.104862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452531c6-9442-4013-86a0-c61bdc1f77c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:46.104862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452531c6-9442-4013-86a0-c61bdc1f77c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:46.105068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452531c6-9442-4013-86a0-c61bdc1f77c1 admin admin] PATH_INFO: `/v3/users/b7652e6749ae4dcf8ef297cc38b8004b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:46.107864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452531c6-9442-4013-86a0-c61bdc1f77c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7652e6749ae4dcf8ef297cc38b8004b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:46.110999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452531c6-9442-4013-86a0-c61bdc1f77c1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:46.167147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-452531c6-9442-4013-86a0-c61bdc1f77c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7652e6749ae4dcf8ef297cc38b8004b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:46.182572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-452531c6-9442-4013-86a0-c61bdc1f77c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7652e6749ae4dcf8ef297cc38b8004b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:46.183368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-452531c6-9442-4013-86a0-c61bdc1f77c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7652e6749ae4dcf8ef297cc38b8004b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:46.194688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-452531c6-9442-4013-86a0-c61bdc1f77c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7652e6749ae4dcf8ef297cc38b8004b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:46.196358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-452531c6-9442-4013-86a0-c61bdc1f77c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7652e6749ae4dcf8ef297cc38b8004b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:46.212916 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2414/4807] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:46 2022] DELETE /identity/v3/users/b7652e6749ae4dcf8ef297cc38b8004b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:46.217637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41f5e6-eaa9-4c8b-924d-257e560645cf None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:46.217911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41f5e6-eaa9-4c8b-924d-257e560645cf None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:46.218194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41f5e6-eaa9-4c8b-924d-257e560645cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:46.236644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:46.276143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7a41f5e6-eaa9-4c8b-924d-257e560645cf None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:46.277605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7a41f5e6-eaa9-4c8b-924d-257e560645cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:46.459246 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2394/4808] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:46.496583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452531c6-9442-4013-86a0-c61bdc1f77c1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:46.498446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-452531c6-9442-4013-86a0-c61bdc1f77c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:46.507023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:46.611959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452531c6-9442-4013-86a0-c61bdc1f77c1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:46.616542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45b3d6-b678-4dbd-843f-90179bcb28fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:46.618150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45b3d6-b678-4dbd-843f-90179bcb28fa service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:46.618444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45b3d6-b678-4dbd-843f-90179bcb28fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:46.618732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45b3d6-b678-4dbd-843f-90179bcb28fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:46.635780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45b3d6-b678-4dbd-843f-90179bcb28fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:46.637577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45b3d6-b678-4dbd-843f-90179bcb28fa service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:46.657012 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2415/4809] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:17:47.688732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41f5e6-eaa9-4c8b-924d-257e560645cf None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:47.691984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7a41f5e6-eaa9-4c8b-924d-257e560645cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:47.719570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41f5e6-eaa9-4c8b-924d-257e560645cf None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:47.736744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d16b5-2403-4b56-8828-ac11a8fed9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:47.738319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d16b5-2403-4b56-8828-ac11a8fed9a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:47.738784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d16b5-2403-4b56-8828-ac11a8fed9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:47.739355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d16b5-2403-4b56-8828-ac11a8fed9a8 admin admin] PATH_INFO: `/v3/projects/f624ef957bcf4b8abaf801d006e3c67c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:47.741296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d16b5-2403-4b56-8828-ac11a8fed9a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f624ef957bcf4b8abaf801d006e3c67c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:47.745475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d16b5-2403-4b56-8828-ac11a8fed9a8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:47.816252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c81d16b5-2403-4b56-8828-ac11a8fed9a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f624ef957bcf4b8abaf801d006e3c67c', 'request_id': 'req-c81d16b5-2403-4b56-8828-ac11a8fed9a8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:47.841410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c81d16b5-2403-4b56-8828-ac11a8fed9a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f624ef957bcf4b8abaf801d006e3c67c', 'request_id': 'req-c81d16b5-2403-4b56-8828-ac11a8fed9a8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:47.856167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c81d16b5-2403-4b56-8828-ac11a8fed9a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f624ef957bcf4b8abaf801d006e3c67c', 'request_id': 'req-c81d16b5-2403-4b56-8828-ac11a8fed9a8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:47.881082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45b3d6-b678-4dbd-843f-90179bcb28fa service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:47.882938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c81d16b5-2403-4b56-8828-ac11a8fed9a8 admin admin] The token cache is being invalidate because project f624ef957bcf4b8abaf801d006e3c67c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:47.883075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1c45b3d6-b678-4dbd-843f-90179bcb28fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:47.883275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c81d16b5-2403-4b56-8828-ac11a8fed9a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:47.884060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c81d16b5-2403-4b56-8828-ac11a8fed9a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:47.885934 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2395/4810] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:47 2022] DELETE /identity/v3/projects/f624ef957bcf4b8abaf801d006e3c67c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:47.894192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d16b5-2403-4b56-8828-ac11a8fed9a8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:47.896351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c81d16b5-2403-4b56-8828-ac11a8fed9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:47.909155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45b3d6-b678-4dbd-843f-90179bcb28fa service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:47.996107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d16b5-2403-4b56-8828-ac11a8fed9a8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:48.004073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785257a0-e683-4dd0-abf2-0cac9b805773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:48.005084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785257a0-e683-4dd0-abf2-0cac9b805773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:48.005477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785257a0-e683-4dd0-abf2-0cac9b805773 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:48.005856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785257a0-e683-4dd0-abf2-0cac9b805773 admin admin] PATH_INFO: `/v3/users/176b8604a67f4059bd6a58a75186bf04` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:48.008033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785257a0-e683-4dd0-abf2-0cac9b805773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=176b8604a67f4059bd6a58a75186bf04)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:48.010238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785257a0-e683-4dd0-abf2-0cac9b805773 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:48.017769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419cba0-cafe-4457-8e27-bc264305caff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:48.018592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419cba0-cafe-4457-8e27-bc264305caff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:48.018881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419cba0-cafe-4457-8e27-bc264305caff admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:48.019164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419cba0-cafe-4457-8e27-bc264305caff admin admin] PATH_INFO: `/v3/projects/f5dbb8df83904ce1b3e63f2a3c52a50a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:48.021859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419cba0-cafe-4457-8e27-bc264305caff admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5dbb8df83904ce1b3e63f2a3c52a50a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:48.025294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419cba0-cafe-4457-8e27-bc264305caff admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:48.058069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:48.094710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-785257a0-e683-4dd0-abf2-0cac9b805773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '176b8604a67f4059bd6a58a75186bf04'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:48.095405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-785257a0-e683-4dd0-abf2-0cac9b805773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '176b8604a67f4059bd6a58a75186bf04'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:48.117305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-785257a0-e683-4dd0-abf2-0cac9b805773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '176b8604a67f4059bd6a58a75186bf04'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:48.118175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-785257a0-e683-4dd0-abf2-0cac9b805773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '176b8604a67f4059bd6a58a75186bf04'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:48.137435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4419cba0-cafe-4457-8e27-bc264305caff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5dbb8df83904ce1b3e63f2a3c52a50a', 'request_id': 'req-4419cba0-cafe-4457-8e27-bc264305caff'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:48.145482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4419cba0-cafe-4457-8e27-bc264305caff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5dbb8df83904ce1b3e63f2a3c52a50a', 'request_id': 'req-4419cba0-cafe-4457-8e27-bc264305caff'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:48.146381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-785257a0-e683-4dd0-abf2-0cac9b805773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '176b8604a67f4059bd6a58a75186bf04'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:48.156542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4419cba0-cafe-4457-8e27-bc264305caff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5dbb8df83904ce1b3e63f2a3c52a50a', 'request_id': 'req-4419cba0-cafe-4457-8e27-bc264305caff'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:48.166232 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2396/4811] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:47 2022] DELETE /identity/v3/users/176b8604a67f4059bd6a58a75186bf04 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:48.173610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4419cba0-cafe-4457-8e27-bc264305caff admin admin] The token cache is being invalidate because project f5dbb8df83904ce1b3e63f2a3c52a50a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:48.174162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4419cba0-cafe-4457-8e27-bc264305caff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:48.176026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4419cba0-cafe-4457-8e27-bc264305caff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:48.177711 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2416/4812] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:47 2022] DELETE /identity/v3/projects/f5dbb8df83904ce1b3e63f2a3c52a50a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:48.182272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785257a0-e683-4dd0-abf2-0cac9b805773 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:48.184166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-785257a0-e683-4dd0-abf2-0cac9b805773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:48.271978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785257a0-e683-4dd0-abf2-0cac9b805773 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:48.292632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af321d0-0ca9-4e6f-9a74-15bbc93f3a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:48.293328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af321d0-0ca9-4e6f-9a74-15bbc93f3a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:48.293733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af321d0-0ca9-4e6f-9a74-15bbc93f3a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:48.293917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af321d0-0ca9-4e6f-9a74-15bbc93f3a74 admin admin] PATH_INFO: `/v3/users/7974409262c24cdfbb3b95e9f8f9ff05` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:48.295675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af321d0-0ca9-4e6f-9a74-15bbc93f3a74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7974409262c24cdfbb3b95e9f8f9ff05)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:48.297708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af321d0-0ca9-4e6f-9a74-15bbc93f3a74 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:48.370487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0af321d0-0ca9-4e6f-9a74-15bbc93f3a74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7974409262c24cdfbb3b95e9f8f9ff05'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:48.371265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0af321d0-0ca9-4e6f-9a74-15bbc93f3a74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7974409262c24cdfbb3b95e9f8f9ff05'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:48.389145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0af321d0-0ca9-4e6f-9a74-15bbc93f3a74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7974409262c24cdfbb3b95e9f8f9ff05'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:48.389957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0af321d0-0ca9-4e6f-9a74-15bbc93f3a74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7974409262c24cdfbb3b95e9f8f9ff05'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:48.400655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0af321d0-0ca9-4e6f-9a74-15bbc93f3a74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7974409262c24cdfbb3b95e9f8f9ff05'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:48.436532 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2397/4813] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:48 2022] DELETE /identity/v3/users/7974409262c24cdfbb3b95e9f8f9ff05 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:49.185280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419cba0-cafe-4457-8e27-bc264305caff admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:49.187248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4419cba0-cafe-4457-8e27-bc264305caff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:49.240947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:49.281913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419cba0-cafe-4457-8e27-bc264305caff admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:49.365736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db54c58-11de-4d94-96a3-93ee28bca5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:49.366567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db54c58-11de-4d94-96a3-93ee28bca5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:49.366750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db54c58-11de-4d94-96a3-93ee28bca5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:49.367814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db54c58-11de-4d94-96a3-93ee28bca5f9 admin admin] PATH_INFO: `/v3/projects/e0f1220695fc482e8e06391285979cdd` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:49.369876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db54c58-11de-4d94-96a3-93ee28bca5f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0f1220695fc482e8e06391285979cdd)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:49.372313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db54c58-11de-4d94-96a3-93ee28bca5f9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:49.437299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9db54c58-11de-4d94-96a3-93ee28bca5f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0f1220695fc482e8e06391285979cdd', 'request_id': 'req-9db54c58-11de-4d94-96a3-93ee28bca5f9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:49.446725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9db54c58-11de-4d94-96a3-93ee28bca5f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0f1220695fc482e8e06391285979cdd', 'request_id': 'req-9db54c58-11de-4d94-96a3-93ee28bca5f9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:49.459267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9db54c58-11de-4d94-96a3-93ee28bca5f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0f1220695fc482e8e06391285979cdd', 'request_id': 'req-9db54c58-11de-4d94-96a3-93ee28bca5f9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:49.475859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9db54c58-11de-4d94-96a3-93ee28bca5f9 admin admin] The token cache is being invalidate because project e0f1220695fc482e8e06391285979cdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:49.477379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9db54c58-11de-4d94-96a3-93ee28bca5f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:49.477898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9db54c58-11de-4d94-96a3-93ee28bca5f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:49.480074 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2417/4814] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:49 2022] DELETE /identity/v3/projects/e0f1220695fc482e8e06391285979cdd => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:49.486369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc37933-a9c1-450b-9a15-8518785b5582 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:49.486904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc37933-a9c1-450b-9a15-8518785b5582 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:49.486981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc37933-a9c1-450b-9a15-8518785b5582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:49.717222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db54c58-11de-4d94-96a3-93ee28bca5f9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:49.718976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9db54c58-11de-4d94-96a3-93ee28bca5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:49.771179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4cc37933-a9c1-450b-9a15-8518785b5582 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:49.772445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4cc37933-a9c1-450b-9a15-8518785b5582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:49.794330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:49.851167 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2398/4815] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:49.859861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286ce48-6002-4c44-acf5-7d7581e3c241 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:49.860472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286ce48-6002-4c44-acf5-7d7581e3c241 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:49.860752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286ce48-6002-4c44-acf5-7d7581e3c241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:49.884484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f286ce48-6002-4c44-acf5-7d7581e3c241 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:49.886226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f286ce48-6002-4c44-acf5-7d7581e3c241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:49.893495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db54c58-11de-4d94-96a3-93ee28bca5f9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:49.898676 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2399/4816] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:17:49.899982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286ce48-6002-4c44-acf5-7d7581e3c241 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:49.920716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286ce48-6002-4c44-acf5-7d7581e3c241 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:49.928522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2cdde-6153-470e-b746-6f57212e20b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:49.932168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be24225-cdfb-42f5-b5fb-75ee99438a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:49.932899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be24225-cdfb-42f5-b5fb-75ee99438a45 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:49.933132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2cdde-6153-470e-b746-6f57212e20b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:49.933609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2cdde-6153-470e-b746-6f57212e20b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:49.934911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be24225-cdfb-42f5-b5fb-75ee99438a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:49.935259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be24225-cdfb-42f5-b5fb-75ee99438a45 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:49.937444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be24225-cdfb-42f5-b5fb-75ee99438a45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:17:49.937835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2cdde-6153-470e-b746-6f57212e20b7 admin admin] PATH_INFO: `/v3/projects/cf0f4e701c5f4cf1982f59164a160de5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:49.938179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be24225-cdfb-42f5-b5fb-75ee99438a45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:49.941405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2cdde-6153-470e-b746-6f57212e20b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf0f4e701c5f4cf1982f59164a160de5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:49.942808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be24225-cdfb-42f5-b5fb-75ee99438a45 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:49.950163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2cdde-6153-470e-b746-6f57212e20b7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:49.985237 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2400/4817] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:17:50.013402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:50.021788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be24225-cdfb-42f5-b5fb-75ee99438a45 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:50.040356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be24225-cdfb-42f5-b5fb-75ee99438a45 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:50.061621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b67a5-9c49-4b61-b657-56c3e275fbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:50.062380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b67a5-9c49-4b61-b657-56c3e275fbb9 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:50.062642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b67a5-9c49-4b61-b657-56c3e275fbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:50.062912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b67a5-9c49-4b61-b657-56c3e275fbb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:50.064172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b67a5-9c49-4b61-b657-56c3e275fbb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:50.066059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b67a5-9c49-4b61-b657-56c3e275fbb9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:50.090848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0ce2cdde-6153-470e-b746-6f57212e20b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf0f4e701c5f4cf1982f59164a160de5', 'request_id': 'req-0ce2cdde-6153-470e-b746-6f57212e20b7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:50.102641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0ce2cdde-6153-470e-b746-6f57212e20b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf0f4e701c5f4cf1982f59164a160de5', 'request_id': 'req-0ce2cdde-6153-470e-b746-6f57212e20b7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:50.108916 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2401/4818] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:49 2022] POST /identity/v3/projects => generated 389 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:50.112792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b67a5-9c49-4b61-b657-56c3e275fbb9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:50.128808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0ce2cdde-6153-470e-b746-6f57212e20b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf0f4e701c5f4cf1982f59164a160de5', 'request_id': 'req-0ce2cdde-6153-470e-b746-6f57212e20b7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:50.145698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0ce2cdde-6153-470e-b746-6f57212e20b7 admin admin] The token cache is being invalidate because project cf0f4e701c5f4cf1982f59164a160de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:50.146545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0ce2cdde-6153-470e-b746-6f57212e20b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:50.147761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0ce2cdde-6153-470e-b746-6f57212e20b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:50.150564 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2418/4819] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:49 2022] DELETE /identity/v3/projects/cf0f4e701c5f4cf1982f59164a160de5 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:50.157063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f1f7a-213a-4156-8e4f-29aeef94eaa4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:50.157899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f1f7a-213a-4156-8e4f-29aeef94eaa4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:50.158266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f1f7a-213a-4156-8e4f-29aeef94eaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:50.196113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-212f1f7a-213a-4156-8e4f-29aeef94eaa4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:50.198418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-212f1f7a-213a-4156-8e4f-29aeef94eaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:50.248476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b67a5-9c49-4b61-b657-56c3e275fbb9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:50.260653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4721b9e-e215-468b-a69a-2c656c2b0aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:50.261093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4721b9e-e215-468b-a69a-2c656c2b0aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:50.261269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4721b9e-e215-468b-a69a-2c656c2b0aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:50.261545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4721b9e-e215-468b-a69a-2c656c2b0aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:50.262261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4721b9e-e215-468b-a69a-2c656c2b0aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:50.269290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4721b9e-e215-468b-a69a-2c656c2b0aa1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:50.321809 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2402/4820] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:17:50 2022] POST /identity/v3/users => generated 295 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:17:50.325752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4721b9e-e215-468b-a69a-2c656c2b0aa1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:50.327740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f4721b9e-e215-468b-a69a-2c656c2b0aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:50.361475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4721b9e-e215-468b-a69a-2c656c2b0aa1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:50.371471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92aa97f-0079-49ab-8124-007f04fc8ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:50.372168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92aa97f-0079-49ab-8124-007f04fc8ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:50.372394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92aa97f-0079-49ab-8124-007f04fc8ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:50.372668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92aa97f-0079-49ab-8124-007f04fc8ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:50.373609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92aa97f-0079-49ab-8124-007f04fc8ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:50.376686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92aa97f-0079-49ab-8124-007f04fc8ca1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:50.377865 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2419/4821] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:17:50.387031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55c26e-c601-4909-bae4-52365ecb03e4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:50.388416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55c26e-c601-4909-bae4-52365ecb03e4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:50.388794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55c26e-c601-4909-bae4-52365ecb03e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:50.399771 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2403/4822] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:50.403435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92aa97f-0079-49ab-8124-007f04fc8ca1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:50.431230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92aa97f-0079-49ab-8124-007f04fc8ca1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:50.446832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8ab49-9aac-494d-bc07-9b04fd357523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:50.448493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8ab49-9aac-494d-bc07-9b04fd357523 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:50.449091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8ab49-9aac-494d-bc07-9b04fd357523 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:50.449218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8ab49-9aac-494d-bc07-9b04fd357523 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:50.452094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8ab49-9aac-494d-bc07-9b04fd357523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:50.456372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ca55c26e-c601-4909-bae4-52365ecb03e4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:50.459009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8ab49-9aac-494d-bc07-9b04fd357523 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:50.459352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ca55c26e-c601-4909-bae4-52365ecb03e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:50.490701 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2404/4823] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:50.491399 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2420/4824] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:50.492395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55c26e-c601-4909-bae4-52365ecb03e4 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:50.492562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8ab49-9aac-494d-bc07-9b04fd357523 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:50.505909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55c26e-c601-4909-bae4-52365ecb03e4 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:50.516366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8ab49-9aac-494d-bc07-9b04fd357523 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:50.521878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858f9b3-2462-4595-a882-e88d0cd9341f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:50.522524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858f9b3-2462-4595-a882-e88d0cd9341f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:50.522861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858f9b3-2462-4595-a882-e88d0cd9341f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:50.523189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858f9b3-2462-4595-a882-e88d0cd9341f admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:50.524859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858f9b3-2462-4595-a882-e88d0cd9341f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:17:50.525256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858f9b3-2462-4595-a882-e88d0cd9341f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:50.527788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858f9b3-2462-4595-a882-e88d0cd9341f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:50.532983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21584e52-7459-4ae6-8ee1-814fd82ac97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:50.533993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21584e52-7459-4ae6-8ee1-814fd82ac97e admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:50.540118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21584e52-7459-4ae6-8ee1-814fd82ac97e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:50.540606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21584e52-7459-4ae6-8ee1-814fd82ac97e admin admin] PATH_INFO: `/v3/projects/ad18d4d568444acfa7bf7410eaa3f633/users/bc7af1a887eb4a19b89465e67ae0833c/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:50.568799 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2405/4825] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:17:50.569803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858f9b3-2462-4595-a882-e88d0cd9341f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:50.582805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858f9b3-2462-4595-a882-e88d0cd9341f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:50.583900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21584e52-7459-4ae6-8ee1-814fd82ac97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad18d4d568444acfa7bf7410eaa3f633, user_id=bc7af1a887eb4a19b89465e67ae0833c, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:50.587593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21584e52-7459-4ae6-8ee1-814fd82ac97e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:50.588476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a709f-3121-4172-8069-e2a8996cbab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:50.589108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a709f-3121-4172-8069-e2a8996cbab1 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:50.589393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a709f-3121-4172-8069-e2a8996cbab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:50.589676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a709f-3121-4172-8069-e2a8996cbab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:50.590333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a709f-3121-4172-8069-e2a8996cbab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:50.593374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a709f-3121-4172-8069-e2a8996cbab1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:50.617376 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2421/4826] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:50 2022] PUT /identity/v3/projects/ad18d4d568444acfa7bf7410eaa3f633/users/bc7af1a887eb4a19b89465e67ae0833c/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:50.630814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b483ea-e247-4ca6-b271-7a62b7428556 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:50.631043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b483ea-e247-4ca6-b271-7a62b7428556 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:50.631411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b483ea-e247-4ca6-b271-7a62b7428556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:50.652570 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2406/4827] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:50 2022] POST /identity/v3/projects => generated 389 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:50.658915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a709f-3121-4172-8069-e2a8996cbab1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:50.673865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-93b483ea-e247-4ca6-b271-7a62b7428556 None None] MFA Rules not processed for user `bc7af1a887eb4a19b89465e67ae0833c`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:50.675560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-93b483ea-e247-4ca6-b271-7a62b7428556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:50.680982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:50.747904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a709f-3121-4172-8069-e2a8996cbab1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:50.755426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e7649-3b45-4860-8fae-ffb716a84300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:50.756457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e7649-3b45-4860-8fae-ffb716a84300 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:50.757351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e7649-3b45-4860-8fae-ffb716a84300 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:50.758655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e7649-3b45-4860-8fae-ffb716a84300 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:50.759806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e7649-3b45-4860-8fae-ffb716a84300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:50.762419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e7649-3b45-4860-8fae-ffb716a84300 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:50.806308 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2407/4828] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:17:50 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:50.807313 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2422/4829] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:17:50.813143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e7649-3b45-4860-8fae-ffb716a84300 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:50.819717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b483ea-e247-4ca6-b271-7a62b7428556 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:50.822759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-93b483ea-e247-4ca6-b271-7a62b7428556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:50.832284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:50.846656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e7649-3b45-4860-8fae-ffb716a84300 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:50.858503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039b913-473d-481c-927d-0a50c30e456b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:50.859339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039b913-473d-481c-927d-0a50c30e456b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:50.859629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039b913-473d-481c-927d-0a50c30e456b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:50.861983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039b913-473d-481c-927d-0a50c30e456b admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:50.875386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039b913-473d-481c-927d-0a50c30e456b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:50.875386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039b913-473d-481c-927d-0a50c30e456b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:50.895772 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2408/4830] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:50.900028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039b913-473d-481c-927d-0a50c30e456b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:50.915325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039b913-473d-481c-927d-0a50c30e456b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:50.922280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6a504-1d9e-4df3-b325-ab5f78a08830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:50.928651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6a504-1d9e-4df3-b325-ab5f78a08830 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:50.931035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6a504-1d9e-4df3-b325-ab5f78a08830 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:50.931035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6a504-1d9e-4df3-b325-ab5f78a08830 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:50.931035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6a504-1d9e-4df3-b325-ab5f78a08830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:50.932900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6a504-1d9e-4df3-b325-ab5f78a08830 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:50.950992 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2409/4831] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:50.955162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6a504-1d9e-4df3-b325-ab5f78a08830 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:50.966404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6a504-1d9e-4df3-b325-ab5f78a08830 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:50.972224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdfa60-f574-45b0-8a77-998d2babb314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:50.972913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdfa60-f574-45b0-8a77-998d2babb314 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:50.973205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdfa60-f574-45b0-8a77-998d2babb314 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:50.973486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdfa60-f574-45b0-8a77-998d2babb314 admin admin] PATH_INFO: `/v3/projects/86394f8c86f34d2ea033bfbf89a48ae5/users/3f667feb105c48ea95bf98a25994cc1b/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:50.998208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bdfa60-f574-45b0-8a77-998d2babb314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86394f8c86f34d2ea033bfbf89a48ae5, user_id=3f667feb105c48ea95bf98a25994cc1b, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:50.998208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bdfa60-f574-45b0-8a77-998d2babb314 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:51.033744 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2410/4832] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:50 2022] PUT /identity/v3/projects/86394f8c86f34d2ea033bfbf89a48ae5/users/3f667feb105c48ea95bf98a25994cc1b/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:17:51.037202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b5897-4c5f-4348-832d-5ebc6525804b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:51.037574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b5897-4c5f-4348-832d-5ebc6525804b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:51.037931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b5897-4c5f-4348-832d-5ebc6525804b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:51.072954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d84b5897-4c5f-4348-832d-5ebc6525804b None None] MFA Rules not processed for user `3f667feb105c48ea95bf98a25994cc1b`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:51.074541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d84b5897-4c5f-4348-832d-5ebc6525804b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:51.083912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b483ea-e247-4ca6-b271-7a62b7428556 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:51.145106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52ffbd-6d3a-4088-a099-0f136ac7a95b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:51.145731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52ffbd-6d3a-4088-a099-0f136ac7a95b service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:51.146023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52ffbd-6d3a-4088-a099-0f136ac7a95b service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:51.146330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52ffbd-6d3a-4088-a099-0f136ac7a95b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:51.152896 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2411/4833] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:51.157915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b5897-4c5f-4348-832d-5ebc6525804b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:51.215303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52ffbd-6d3a-4088-a099-0f136ac7a95b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:51.217656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52ffbd-6d3a-4088-a099-0f136ac7a95b service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:51.222617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:51.231582 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2423/4834] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:17:51.242858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b5897-4c5f-4348-832d-5ebc6525804b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:51.253223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ff98a-b360-47b4-89c3-56a7203d4970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:51.253958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ff98a-b360-47b4-89c3-56a7203d4970 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:51.254473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ff98a-b360-47b4-89c3-56a7203d4970 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:51.255545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ff98a-b360-47b4-89c3-56a7203d4970 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:51.256509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ff98a-b360-47b4-89c3-56a7203d4970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:51.260324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ff98a-b360-47b4-89c3-56a7203d4970 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:51.309417 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2412/4835] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:51 2022] POST /identity/v3/projects => generated 389 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:51.313374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52ffbd-6d3a-4088-a099-0f136ac7a95b service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:51.333513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52ffbd-6d3a-4088-a099-0f136ac7a95b service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:51.459001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de46ee-3179-4344-b431-b68323056415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:51.459776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de46ee-3179-4344-b431-b68323056415 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:51.460113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de46ee-3179-4344-b431-b68323056415 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:51.460395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de46ee-3179-4344-b431-b68323056415 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:51.461186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de46ee-3179-4344-b431-b68323056415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:51.463548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de46ee-3179-4344-b431-b68323056415 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:51.507032 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2424/4836] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:17:51 2022] POST /identity/v3/users => generated 301 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:17:51.511506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ff98a-b360-47b4-89c3-56a7203d4970 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:51.525817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ff98a-b360-47b4-89c3-56a7203d4970 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:51.532852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd7d83-7206-49ef-9e4f-56aa2ca83104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:51.533509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd7d83-7206-49ef-9e4f-56aa2ca83104 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:51.533800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd7d83-7206-49ef-9e4f-56aa2ca83104 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:51.534068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd7d83-7206-49ef-9e4f-56aa2ca83104 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:51.534789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd7d83-7206-49ef-9e4f-56aa2ca83104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:51.536772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd7d83-7206-49ef-9e4f-56aa2ca83104 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:51.552576 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2413/4837] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:17:51.558182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de46ee-3179-4344-b431-b68323056415 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:51.564121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:51.587649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de46ee-3179-4344-b431-b68323056415 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:51.602600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e1d26-6fcf-4deb-8dc9-7c481d3fd37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:51.605323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e1d26-6fcf-4deb-8dc9-7c481d3fd37b admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:51.606702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e1d26-6fcf-4deb-8dc9-7c481d3fd37b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:51.608102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e1d26-6fcf-4deb-8dc9-7c481d3fd37b admin admin] PATH_INFO: `/v3/projects/b30854930b8741fb93dd1c615c1e86d2/users/9ab95db7f6884aaabe4ed551e2731c19/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:51.661852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e1d26-6fcf-4deb-8dc9-7c481d3fd37b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30854930b8741fb93dd1c615c1e86d2, user_id=9ab95db7f6884aaabe4ed551e2731c19, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:51.667513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e1d26-6fcf-4deb-8dc9-7c481d3fd37b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:51.706225 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2425/4838] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:51 2022] PUT /identity/v3/projects/b30854930b8741fb93dd1c615c1e86d2/users/9ab95db7f6884aaabe4ed551e2731c19/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:51.710013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd7d83-7206-49ef-9e4f-56aa2ca83104 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:51.725746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd7d83-7206-49ef-9e4f-56aa2ca83104 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:51.892120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ead0ae-c411-481e-b120-3f6ad3e8ac47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:51.892844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ead0ae-c411-481e-b120-3f6ad3e8ac47 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:51.893196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ead0ae-c411-481e-b120-3f6ad3e8ac47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:51.893706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ead0ae-c411-481e-b120-3f6ad3e8ac47 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:51.894474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ead0ae-c411-481e-b120-3f6ad3e8ac47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:51.900588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ead0ae-c411-481e-b120-3f6ad3e8ac47 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:51.934284 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2414/4839] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:51.935259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e1d26-6fcf-4deb-8dc9-7c481d3fd37b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:51.954270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e1d26-6fcf-4deb-8dc9-7c481d3fd37b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:51.967969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bced07-3812-4848-8d61-0e8ce685c71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:51.969030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bced07-3812-4848-8d61-0e8ce685c71e admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:51.969384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bced07-3812-4848-8d61-0e8ce685c71e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:51.969724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bced07-3812-4848-8d61-0e8ce685c71e admin admin] PATH_INFO: `/v3/projects/b30854930b8741fb93dd1c615c1e86d2/users/9ab95db7f6884aaabe4ed551e2731c19/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:51.972634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bced07-3812-4848-8d61-0e8ce685c71e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30854930b8741fb93dd1c615c1e86d2, user_id=9ab95db7f6884aaabe4ed551e2731c19, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:51.975992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bced07-3812-4848-8d61-0e8ce685c71e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:52.040391 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2426/4840] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:51 2022] PUT /identity/v3/projects/b30854930b8741fb93dd1c615c1e86d2/users/9ab95db7f6884aaabe4ed551e2731c19/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:52.043005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd9504-6ad4-47b8-9b91-045ef2a364a6 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:52.043323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd9504-6ad4-47b8-9b91-045ef2a364a6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:52.044215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd9504-6ad4-47b8-9b91-045ef2a364a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:52.104293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-aefd9504-6ad4-47b8-9b91-045ef2a364a6 None None] MFA Rules not processed for user `9ab95db7f6884aaabe4ed551e2731c19`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:52.105567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-aefd9504-6ad4-47b8-9b91-045ef2a364a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:52.286775 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2415/4841] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:52.306928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bced07-3812-4848-8d61-0e8ce685c71e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:52.309461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-74bced07-3812-4848-8d61-0e8ce685c71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:52.442223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bced07-3812-4848-8d61-0e8ce685c71e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:52.448349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc6900-d2e0-4b01-9f63-09261bdbae52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:52.448981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc6900-d2e0-4b01-9f63-09261bdbae52 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:52.449257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc6900-d2e0-4b01-9f63-09261bdbae52 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:52.449534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc6900-d2e0-4b01-9f63-09261bdbae52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:52.530824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc6900-d2e0-4b01-9f63-09261bdbae52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:52.532373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc6900-d2e0-4b01-9f63-09261bdbae52 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:52.543252 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2427/4842] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:17:54.396319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd9504-6ad4-47b8-9b91-045ef2a364a6 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:54.397933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-aefd9504-6ad4-47b8-9b91-045ef2a364a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:54.502172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:54.586987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc6900-d2e0-4b01-9f63-09261bdbae52 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:54.588899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-18fc6900-d2e0-4b01-9f63-09261bdbae52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:54.591657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd9504-6ad4-47b8-9b91-045ef2a364a6 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:54.604688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354c81a-82f9-4bee-a76e-f67a8f39347b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:54.605342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354c81a-82f9-4bee-a76e-f67a8f39347b service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:54.605626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354c81a-82f9-4bee-a76e-f67a8f39347b service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:54.605899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354c81a-82f9-4bee-a76e-f67a8f39347b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:54.610474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0354c81a-82f9-4bee-a76e-f67a8f39347b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:54.637416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354c81a-82f9-4bee-a76e-f67a8f39347b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:54.639563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354c81a-82f9-4bee-a76e-f67a8f39347b service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:54.663448 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2416/4843] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:17:54.801076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc6900-d2e0-4b01-9f63-09261bdbae52 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:54.807492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca71ea-fd4c-4e5a-af40-783d06a6bf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:54.808169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca71ea-fd4c-4e5a-af40-783d06a6bf52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:54.808457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca71ea-fd4c-4e5a-af40-783d06a6bf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:54.808741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca71ea-fd4c-4e5a-af40-783d06a6bf52 admin admin] PATH_INFO: `/v3/users/5f6545058c3d465992b5761677dc5261` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:54.809942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca71ea-fd4c-4e5a-af40-783d06a6bf52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f6545058c3d465992b5761677dc5261)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:54.825458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca71ea-fd4c-4e5a-af40-783d06a6bf52 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:54.881553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:54.940536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6cca71ea-fd4c-4e5a-af40-783d06a6bf52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f6545058c3d465992b5761677dc5261'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:54.956749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6cca71ea-fd4c-4e5a-af40-783d06a6bf52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f6545058c3d465992b5761677dc5261'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:54.957585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6cca71ea-fd4c-4e5a-af40-783d06a6bf52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f6545058c3d465992b5761677dc5261'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:54.966970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6cca71ea-fd4c-4e5a-af40-783d06a6bf52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f6545058c3d465992b5761677dc5261'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:54.968136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6cca71ea-fd4c-4e5a-af40-783d06a6bf52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f6545058c3d465992b5761677dc5261'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:54.990029 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2428/4844] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:17:54 2022] DELETE /identity/v3/users/5f6545058c3d465992b5761677dc5261 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:55.350808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354c81a-82f9-4bee-a76e-f67a8f39347b service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:55.366477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354c81a-82f9-4bee-a76e-f67a8f39347b service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:55.461052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ece62-f9fe-4685-9f87-d172273d9fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:55.463544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ece62-f9fe-4685-9f87-d172273d9fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:55.464325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ece62-f9fe-4685-9f87-d172273d9fad admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:55.464903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ece62-f9fe-4685-9f87-d172273d9fad admin admin] PATH_INFO: `/v3/projects/90a8a347af0e497dbd65c1b79f4cde22` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:55.467011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ece62-f9fe-4685-9f87-d172273d9fad admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a8a347af0e497dbd65c1b79f4cde22)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:55.470125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ece62-f9fe-4685-9f87-d172273d9fad admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:55.552340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6c2ece62-f9fe-4685-9f87-d172273d9fad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a8a347af0e497dbd65c1b79f4cde22', 'request_id': 'req-6c2ece62-f9fe-4685-9f87-d172273d9fad'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:55.564564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6c2ece62-f9fe-4685-9f87-d172273d9fad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a8a347af0e497dbd65c1b79f4cde22', 'request_id': 'req-6c2ece62-f9fe-4685-9f87-d172273d9fad'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:55.572614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6c2ece62-f9fe-4685-9f87-d172273d9fad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a8a347af0e497dbd65c1b79f4cde22', 'request_id': 'req-6c2ece62-f9fe-4685-9f87-d172273d9fad'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:55.585764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6c2ece62-f9fe-4685-9f87-d172273d9fad admin admin] The token cache is being invalidate because project 90a8a347af0e497dbd65c1b79f4cde22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:17:55.586061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6c2ece62-f9fe-4685-9f87-d172273d9fad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:55.586749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6c2ece62-f9fe-4685-9f87-d172273d9fad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:17:55.592072 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2417/4845] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:17:55 2022] DELETE /identity/v3/projects/90a8a347af0e497dbd65c1b79f4cde22 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:55.594070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b257ed-40b0-48af-9319-3087205b9b71 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:55.594555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b257ed-40b0-48af-9319-3087205b9b71 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:55.594632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b257ed-40b0-48af-9319-3087205b9b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:55.617891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-13b257ed-40b0-48af-9319-3087205b9b71 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:55.619264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-13b257ed-40b0-48af-9319-3087205b9b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:55.724558 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2429/4846] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:55.734093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d41aa2-fbda-4292-8aca-9ee893c2f818 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:55.734699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d41aa2-fbda-4292-8aca-9ee893c2f818 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:55.735227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d41aa2-fbda-4292-8aca-9ee893c2f818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:55.805232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b5d41aa2-fbda-4292-8aca-9ee893c2f818 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:55.806632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b5d41aa2-fbda-4292-8aca-9ee893c2f818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:55.846151 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2418/4847] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:55.848062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b257ed-40b0-48af-9319-3087205b9b71 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:55.868329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b257ed-40b0-48af-9319-3087205b9b71 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:55.875605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418d3ac-6afa-4bc1-a081-6ed2c08d3ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:55.876243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418d3ac-6afa-4bc1-a081-6ed2c08d3ffc admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:55.876520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418d3ac-6afa-4bc1-a081-6ed2c08d3ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:55.876790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418d3ac-6afa-4bc1-a081-6ed2c08d3ffc admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:55.878755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418d3ac-6afa-4bc1-a081-6ed2c08d3ffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:17:55.879070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418d3ac-6afa-4bc1-a081-6ed2c08d3ffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:55.881328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418d3ac-6afa-4bc1-a081-6ed2c08d3ffc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:55.902467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d41aa2-fbda-4292-8aca-9ee893c2f818 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:55.913153 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2430/4848] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:17:55.922605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d41aa2-fbda-4292-8aca-9ee893c2f818 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:55.938677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51751330-17a0-4d94-8b3e-e7c69ddbbec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:55.938840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51751330-17a0-4d94-8b3e-e7c69ddbbec3 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:55.939069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51751330-17a0-4d94-8b3e-e7c69ddbbec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:55.939376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51751330-17a0-4d94-8b3e-e7c69ddbbec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:55.940212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51751330-17a0-4d94-8b3e-e7c69ddbbec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:55.942147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51751330-17a0-4d94-8b3e-e7c69ddbbec3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:56.029368 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2419/4849] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:17:55 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:17:56.030510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418d3ac-6afa-4bc1-a081-6ed2c08d3ffc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:56.047115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418d3ac-6afa-4bc1-a081-6ed2c08d3ffc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:56.239348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704182f5-949f-4c1b-8f37-9eff59335a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:56.241599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704182f5-949f-4c1b-8f37-9eff59335a35 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:56.242070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704182f5-949f-4c1b-8f37-9eff59335a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:56.242676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704182f5-949f-4c1b-8f37-9eff59335a35 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:56.244395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704182f5-949f-4c1b-8f37-9eff59335a35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:56.246725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704182f5-949f-4c1b-8f37-9eff59335a35 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:56.304192 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2431/4850] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:17:56 2022] POST /identity/v3/users => generated 290 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:17:56.308339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51751330-17a0-4d94-8b3e-e7c69ddbbec3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:56.318804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51751330-17a0-4d94-8b3e-e7c69ddbbec3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:56.336824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0994cd4-2b12-48e3-8fcf-59751d2e4f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:56.337493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0994cd4-2b12-48e3-8fcf-59751d2e4f32 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:56.337774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0994cd4-2b12-48e3-8fcf-59751d2e4f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:56.338027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0994cd4-2b12-48e3-8fcf-59751d2e4f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:56.338733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0994cd4-2b12-48e3-8fcf-59751d2e4f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:56.342051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0994cd4-2b12-48e3-8fcf-59751d2e4f32 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:56.368764 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2420/4851] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:56.373865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704182f5-949f-4c1b-8f37-9eff59335a35 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:56.407820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704182f5-949f-4c1b-8f37-9eff59335a35 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:56.414486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de90f3-6b3e-490c-b42f-72220a5aed98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:56.415452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de90f3-6b3e-490c-b42f-72220a5aed98 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:56.415742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de90f3-6b3e-490c-b42f-72220a5aed98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:56.417118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de90f3-6b3e-490c-b42f-72220a5aed98 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:56.417882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de90f3-6b3e-490c-b42f-72220a5aed98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:56.419572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de90f3-6b3e-490c-b42f-72220a5aed98 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:56.437517 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2432/4852] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:17:56.438669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0994cd4-2b12-48e3-8fcf-59751d2e4f32 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:56.449963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0994cd4-2b12-48e3-8fcf-59751d2e4f32 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:56.457563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea035b57-7d1e-43d8-b004-9ad1f3ea3d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:56.458262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea035b57-7d1e-43d8-b004-9ad1f3ea3d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:56.458748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea035b57-7d1e-43d8-b004-9ad1f3ea3d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:56.459172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea035b57-7d1e-43d8-b004-9ad1f3ea3d91 admin admin] PATH_INFO: `/v3/projects/116c26d6b98641bb8ed5ff5dcdd966c8/users/c025e35fd22a4895a5d0301c1d5b0e8e/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:56.474496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:56.479934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea035b57-7d1e-43d8-b004-9ad1f3ea3d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=116c26d6b98641bb8ed5ff5dcdd966c8, user_id=c025e35fd22a4895a5d0301c1d5b0e8e, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:56.483165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea035b57-7d1e-43d8-b004-9ad1f3ea3d91 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:56.508092 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2421/4853] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:17:56 2022] PUT /identity/v3/projects/116c26d6b98641bb8ed5ff5dcdd966c8/users/c025e35fd22a4895a5d0301c1d5b0e8e/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:17:56.513086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde58c7-b2c0-486d-b726-920175b88b37 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:56.513366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde58c7-b2c0-486d-b726-920175b88b37 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:56.513644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde58c7-b2c0-486d-b726-920175b88b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:56.522961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:56.540644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-cfde58c7-b2c0-486d-b726-920175b88b37 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:17:56.543075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cfde58c7-b2c0-486d-b726-920175b88b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:56.681540 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2433/4854] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:17:56.734661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea035b57-7d1e-43d8-b004-9ad1f3ea3d91 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:56.738963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ea035b57-7d1e-43d8-b004-9ad1f3ea3d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:56.831633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea035b57-7d1e-43d8-b004-9ad1f3ea3d91 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:56.837732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5be4ef-15f4-4247-a511-c37e2f8d614e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:56.838466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5be4ef-15f4-4247-a511-c37e2f8d614e service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:56.838811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5be4ef-15f4-4247-a511-c37e2f8d614e service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:56.839166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5be4ef-15f4-4247-a511-c37e2f8d614e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:56.852507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5be4ef-15f4-4247-a511-c37e2f8d614e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:56.855084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5be4ef-15f4-4247-a511-c37e2f8d614e service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:56.869585 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2422/4855] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:17:58.296968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde58c7-b2c0-486d-b726-920175b88b37 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:17:58.313930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde58c7-b2c0-486d-b726-920175b88b37 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:17:58.321290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e0b54-c3a0-4d8f-b4b3-e9e265727d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:17:58.322671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e0b54-c3a0-4d8f-b4b3-e9e265727d68 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:17:58.322968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e0b54-c3a0-4d8f-b4b3-e9e265727d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:17:58.323248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e0b54-c3a0-4d8f-b4b3-e9e265727d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:17:58.326060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-820e0b54-c3a0-4d8f-b4b3-e9e265727d68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:17:58.438453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e0b54-c3a0-4d8f-b4b3-e9e265727d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:17:58.440278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e0b54-c3a0-4d8f-b4b3-e9e265727d68 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:17:58.452401 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2434/4856] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:17:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:18:03.092407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5be4ef-15f4-4247-a511-c37e2f8d614e service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:03.098617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5b5be4ef-15f4-4247-a511-c37e2f8d614e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:03.391441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e0b54-c3a0-4d8f-b4b3-e9e265727d68 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:03.393427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-820e0b54-c3a0-4d8f-b4b3-e9e265727d68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:03.409677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5be4ef-15f4-4247-a511-c37e2f8d614e service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:03.423019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d18347-afee-4eec-8e23-b9654e9ba426 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:03.423852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d18347-afee-4eec-8e23-b9654e9ba426 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:03.424325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d18347-afee-4eec-8e23-b9654e9ba426 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:03.424667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d18347-afee-4eec-8e23-b9654e9ba426 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:03.429940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-14d18347-afee-4eec-8e23-b9654e9ba426 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:03.433197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e0b54-c3a0-4d8f-b4b3-e9e265727d68 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:03.453241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf202f85-96ae-4ce4-b774-83ff800610d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:03.454130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf202f85-96ae-4ce4-b774-83ff800610d9 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:03.454610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf202f85-96ae-4ce4-b774-83ff800610d9 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:03.455031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf202f85-96ae-4ce4-b774-83ff800610d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:03.459488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cf202f85-96ae-4ce4-b774-83ff800610d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:03.460338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d18347-afee-4eec-8e23-b9654e9ba426 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:03.469468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d18347-afee-4eec-8e23-b9654e9ba426 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:03.503584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf202f85-96ae-4ce4-b774-83ff800610d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:03.510054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf202f85-96ae-4ce4-b774-83ff800610d9 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:03.510998 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2423/4857] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:18:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:18:03.526280 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2435/4858] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:18:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:18:04.060370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d18347-afee-4eec-8e23-b9654e9ba426 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:04.062005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-14d18347-afee-4eec-8e23-b9654e9ba426 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:04.113532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d18347-afee-4eec-8e23-b9654e9ba426 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:04.127324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8038152-752f-4ad5-93bf-62f62a332438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:04.128476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8038152-752f-4ad5-93bf-62f62a332438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:04.128808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8038152-752f-4ad5-93bf-62f62a332438 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:04.129094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8038152-752f-4ad5-93bf-62f62a332438 admin admin] PATH_INFO: `/v3/users/bc7af1a887eb4a19b89465e67ae0833c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:04.132541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8038152-752f-4ad5-93bf-62f62a332438 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc7af1a887eb4a19b89465e67ae0833c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:04.136615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8038152-752f-4ad5-93bf-62f62a332438 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:04.178754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a8678-6af6-474f-8961-de0b40473b6c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:04.179778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a8678-6af6-474f-8961-de0b40473b6c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:04.180123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a8678-6af6-474f-8961-de0b40473b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:04.204062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2e8a8678-6af6-474f-8961-de0b40473b6c None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:18:04.206029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2e8a8678-6af6-474f-8961-de0b40473b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:04.217857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c8038152-752f-4ad5-93bf-62f62a332438 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc7af1a887eb4a19b89465e67ae0833c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:04.218884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c8038152-752f-4ad5-93bf-62f62a332438 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc7af1a887eb4a19b89465e67ae0833c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:04.238418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c8038152-752f-4ad5-93bf-62f62a332438 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc7af1a887eb4a19b89465e67ae0833c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:04.239205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c8038152-752f-4ad5-93bf-62f62a332438 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc7af1a887eb4a19b89465e67ae0833c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:04.251169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:04.258826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c8038152-752f-4ad5-93bf-62f62a332438 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc7af1a887eb4a19b89465e67ae0833c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:04.283118 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2424/4859] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:18:04 2022] DELETE /identity/v3/users/bc7af1a887eb4a19b89465e67ae0833c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:18:04.287655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b217db-8bbb-4a73-826e-004f5342f7a2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:04.287982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b217db-8bbb-4a73-826e-004f5342f7a2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:04.288267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b217db-8bbb-4a73-826e-004f5342f7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:04.290564 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2436/4860] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:18:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:18:04.311041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a8678-6af6-474f-8961-de0b40473b6c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:04.312762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2e8a8678-6af6-474f-8961-de0b40473b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:04.349543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b2b217db-8bbb-4a73-826e-004f5342f7a2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:18:04.356129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b2b217db-8bbb-4a73-826e-004f5342f7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:04.386610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:04.467728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a8678-6af6-474f-8961-de0b40473b6c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:04.546554 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2425/4861] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:18:04.568662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b217db-8bbb-4a73-826e-004f5342f7a2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:04.570141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b2b217db-8bbb-4a73-826e-004f5342f7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:04.600620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1522c-0e06-44df-af6f-7c47d134ffd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:04.602058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1522c-0e06-44df-af6f-7c47d134ffd5 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:04.602847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1522c-0e06-44df-af6f-7c47d134ffd5 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:04.602847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1522c-0e06-44df-af6f-7c47d134ffd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:04.714697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1522c-0e06-44df-af6f-7c47d134ffd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:04.716695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1522c-0e06-44df-af6f-7c47d134ffd5 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:04.744882 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2437/4862] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:18:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:18:04.750150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b217db-8bbb-4a73-826e-004f5342f7a2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:04.759279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c3fe6-3e78-47ce-a1b3-ec76090bffd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:04.760258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c3fe6-3e78-47ce-a1b3-ec76090bffd3 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:04.760721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c3fe6-3e78-47ce-a1b3-ec76090bffd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:04.761171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c3fe6-3e78-47ce-a1b3-ec76090bffd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:04.786788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c3fe6-3e78-47ce-a1b3-ec76090bffd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:04.788586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c3fe6-3e78-47ce-a1b3-ec76090bffd3 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:04.810709 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2426/4863] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:18:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:18:06.724901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1522c-0e06-44df-af6f-7c47d134ffd5 service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:06.727052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6ef1522c-0e06-44df-af6f-7c47d134ffd5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:06.759598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1522c-0e06-44df-af6f-7c47d134ffd5 service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:06.768969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b2677-30fa-4515-b47b-6491da03be7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:06.769887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b2677-30fa-4515-b47b-6491da03be7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:06.770416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b2677-30fa-4515-b47b-6491da03be7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:06.770905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b2677-30fa-4515-b47b-6491da03be7e admin admin] PATH_INFO: `/v3/users/3f667feb105c48ea95bf98a25994cc1b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:06.773966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b2677-30fa-4515-b47b-6491da03be7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f667feb105c48ea95bf98a25994cc1b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:06.784038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b2677-30fa-4515-b47b-6491da03be7e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:06.916533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-082b2677-30fa-4515-b47b-6491da03be7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f667feb105c48ea95bf98a25994cc1b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:06.958665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-082b2677-30fa-4515-b47b-6491da03be7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f667feb105c48ea95bf98a25994cc1b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:06.958665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-082b2677-30fa-4515-b47b-6491da03be7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f667feb105c48ea95bf98a25994cc1b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:06.968959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:06.976809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-082b2677-30fa-4515-b47b-6491da03be7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f667feb105c48ea95bf98a25994cc1b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:06.977934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-082b2677-30fa-4515-b47b-6491da03be7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f667feb105c48ea95bf98a25994cc1b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:07.025176 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2438/4864] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:18:06 2022] DELETE /identity/v3/users/3f667feb105c48ea95bf98a25994cc1b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:18:07.031952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82c3af-83c5-4a91-b6c3-8796db180c9f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:07.032423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82c3af-83c5-4a91-b6c3-8796db180c9f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:07.032423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82c3af-83c5-4a91-b6c3-8796db180c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:07.074417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bc82c3af-83c5-4a91-b6c3-8796db180c9f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:18:07.076515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bc82c3af-83c5-4a91-b6c3-8796db180c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:07.171020 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2427/4865] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:18:07.233269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b2677-30fa-4515-b47b-6491da03be7e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:07.241526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-082b2677-30fa-4515-b47b-6491da03be7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:07.454497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b2677-30fa-4515-b47b-6491da03be7e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:07.465169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32404e9e-fa99-4225-a909-238b3be7f439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:07.465730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32404e9e-fa99-4225-a909-238b3be7f439 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:07.466015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32404e9e-fa99-4225-a909-238b3be7f439 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:07.466290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32404e9e-fa99-4225-a909-238b3be7f439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:07.490199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32404e9e-fa99-4225-a909-238b3be7f439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:07.492452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32404e9e-fa99-4225-a909-238b3be7f439 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:07.538452 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2439/4866] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:18:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:18:07.629429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82c3af-83c5-4a91-b6c3-8796db180c9f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:07.630859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bc82c3af-83c5-4a91-b6c3-8796db180c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:07.704907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:07.800813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82c3af-83c5-4a91-b6c3-8796db180c9f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:07.821953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b44258-bd6b-4cb5-8b67-4f84ecb0ee6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:07.826092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b44258-bd6b-4cb5-8b67-4f84ecb0ee6d service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:07.826496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b44258-bd6b-4cb5-8b67-4f84ecb0ee6d service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:07.830847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b44258-bd6b-4cb5-8b67-4f84ecb0ee6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:07.840652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-91b44258-bd6b-4cb5-8b67-4f84ecb0ee6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:07.880449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32404e9e-fa99-4225-a909-238b3be7f439 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:07.880449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-32404e9e-fa99-4225-a909-238b3be7f439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:07.909461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b44258-bd6b-4cb5-8b67-4f84ecb0ee6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:07.915178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32404e9e-fa99-4225-a909-238b3be7f439 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:07.916430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b44258-bd6b-4cb5-8b67-4f84ecb0ee6d service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:07.937540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b0bb2-f56a-4981-bd8a-919396bd1f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:07.938202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b0bb2-f56a-4981-bd8a-919396bd1f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:07.938549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b0bb2-f56a-4981-bd8a-919396bd1f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:07.943016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b0bb2-f56a-4981-bd8a-919396bd1f09 admin admin] PATH_INFO: `/v3/projects/ad18d4d568444acfa7bf7410eaa3f633` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:07.952783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b0bb2-f56a-4981-bd8a-919396bd1f09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad18d4d568444acfa7bf7410eaa3f633)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:07.954728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b0bb2-f56a-4981-bd8a-919396bd1f09 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:07.964591 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2428/4867] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:18:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:18:08.175852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3f7b0bb2-f56a-4981-bd8a-919396bd1f09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad18d4d568444acfa7bf7410eaa3f633', 'request_id': 'req-3f7b0bb2-f56a-4981-bd8a-919396bd1f09'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:08.207173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3f7b0bb2-f56a-4981-bd8a-919396bd1f09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad18d4d568444acfa7bf7410eaa3f633', 'request_id': 'req-3f7b0bb2-f56a-4981-bd8a-919396bd1f09'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:08.225851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3f7b0bb2-f56a-4981-bd8a-919396bd1f09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad18d4d568444acfa7bf7410eaa3f633', 'request_id': 'req-3f7b0bb2-f56a-4981-bd8a-919396bd1f09'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:08.253218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3f7b0bb2-f56a-4981-bd8a-919396bd1f09 admin admin] The token cache is being invalidate because project ad18d4d568444acfa7bf7410eaa3f633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:18:08.254019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3f7b0bb2-f56a-4981-bd8a-919396bd1f09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:08.256223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3f7b0bb2-f56a-4981-bd8a-919396bd1f09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:08.261054 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2440/4868] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:18:07 2022] DELETE /identity/v3/projects/ad18d4d568444acfa7bf7410eaa3f633 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:18:08.266428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38675b22-8803-4f5b-89f2-3b764ca1fc48 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:08.267764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38675b22-8803-4f5b-89f2-3b764ca1fc48 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:08.268187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38675b22-8803-4f5b-89f2-3b764ca1fc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:08.289543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b0bb2-f56a-4981-bd8a-919396bd1f09 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:08.292605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3f7b0bb2-f56a-4981-bd8a-919396bd1f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:08.333688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-38675b22-8803-4f5b-89f2-3b764ca1fc48 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:18:08.336471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-38675b22-8803-4f5b-89f2-3b764ca1fc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:08.479571 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2429/4869] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:18:08.481258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a7a8b-0b92-4d04-8881-309b8a5e5db1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:08.481552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a7a8b-0b92-4d04-8881-309b8a5e5db1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:08.481833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a7a8b-0b92-4d04-8881-309b8a5e5db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:08.512152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2a4a7a8b-0b92-4d04-8881-309b8a5e5db1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:18:08.513707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2a4a7a8b-0b92-4d04-8881-309b8a5e5db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:08.556826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b0bb2-f56a-4981-bd8a-919396bd1f09 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:08.557836 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2430/4870] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:18:08.560266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a7a8b-0b92-4d04-8881-309b8a5e5db1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:08.570361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f07e4-ed9f-4ad8-8d8a-aae418f4e9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:08.571195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f07e4-ed9f-4ad8-8d8a-aae418f4e9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:08.573048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f07e4-ed9f-4ad8-8d8a-aae418f4e9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:08.573048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f07e4-ed9f-4ad8-8d8a-aae418f4e9bd admin admin] PATH_INFO: `/v3/projects/86394f8c86f34d2ea033bfbf89a48ae5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:08.576999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f07e4-ed9f-4ad8-8d8a-aae418f4e9bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=86394f8c86f34d2ea033bfbf89a48ae5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:08.584543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f07e4-ed9f-4ad8-8d8a-aae418f4e9bd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:08.622080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a7a8b-0b92-4d04-8881-309b8a5e5db1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:08.633802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27167f87-9362-4f4d-b084-256c9bdcdf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:08.635095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27167f87-9362-4f4d-b084-256c9bdcdf82 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:08.635649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27167f87-9362-4f4d-b084-256c9bdcdf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:08.637172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27167f87-9362-4f4d-b084-256c9bdcdf82 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:08.639733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27167f87-9362-4f4d-b084-256c9bdcdf82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:18:08.640412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27167f87-9362-4f4d-b084-256c9bdcdf82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:08.643955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27167f87-9362-4f4d-b084-256c9bdcdf82 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:08.649733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:08.688533 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2431/4871] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:18:08.689615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27167f87-9362-4f4d-b084-256c9bdcdf82 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:08.723193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27167f87-9362-4f4d-b084-256c9bdcdf82 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:08.735355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e9f07e4-ed9f-4ad8-8d8a-aae418f4e9bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86394f8c86f34d2ea033bfbf89a48ae5', 'request_id': 'req-1e9f07e4-ed9f-4ad8-8d8a-aae418f4e9bd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:08.761812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e9f07e4-ed9f-4ad8-8d8a-aae418f4e9bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86394f8c86f34d2ea033bfbf89a48ae5', 'request_id': 'req-1e9f07e4-ed9f-4ad8-8d8a-aae418f4e9bd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:08.786205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e9f07e4-ed9f-4ad8-8d8a-aae418f4e9bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86394f8c86f34d2ea033bfbf89a48ae5', 'request_id': 'req-1e9f07e4-ed9f-4ad8-8d8a-aae418f4e9bd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:08.817333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e9f07e4-ed9f-4ad8-8d8a-aae418f4e9bd admin admin] The token cache is being invalidate because project 86394f8c86f34d2ea033bfbf89a48ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:18:08.817652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e9f07e4-ed9f-4ad8-8d8a-aae418f4e9bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:08.818993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e9f07e4-ed9f-4ad8-8d8a-aae418f4e9bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:08.823791 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2441/4872] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:18:08 2022] DELETE /identity/v3/projects/86394f8c86f34d2ea033bfbf89a48ae5 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:18:08.828263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f07e4-ed9f-4ad8-8d8a-aae418f4e9bd admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:08.830015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1e9f07e4-ed9f-4ad8-8d8a-aae418f4e9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:08.969076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d914b9c-95e3-4bc1-ae69-4331a908c380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:08.969903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d914b9c-95e3-4bc1-ae69-4331a908c380 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:08.970300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d914b9c-95e3-4bc1-ae69-4331a908c380 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:08.970687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d914b9c-95e3-4bc1-ae69-4331a908c380 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:08.971507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d914b9c-95e3-4bc1-ae69-4331a908c380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:08.973526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d914b9c-95e3-4bc1-ae69-4331a908c380 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:09.056919 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2432/4873] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:18:08 2022] POST /identity/v3/projects => generated 383 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:18:09.063526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f07e4-ed9f-4ad8-8d8a-aae418f4e9bd admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:09.064455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d914b9c-95e3-4bc1-ae69-4331a908c380 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:09.066702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4d914b9c-95e3-4bc1-ae69-4331a908c380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:09.152783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:09.219252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30113e-80a1-4e07-9a8d-f2c5bad1b620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:09.221284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30113e-80a1-4e07-9a8d-f2c5bad1b620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:09.221581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30113e-80a1-4e07-9a8d-f2c5bad1b620 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:09.221925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30113e-80a1-4e07-9a8d-f2c5bad1b620 admin admin] PATH_INFO: `/v3/users/9ab95db7f6884aaabe4ed551e2731c19` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:09.227025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30113e-80a1-4e07-9a8d-f2c5bad1b620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ab95db7f6884aaabe4ed551e2731c19)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:09.229036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30113e-80a1-4e07-9a8d-f2c5bad1b620 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:09.255005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d914b9c-95e3-4bc1-ae69-4331a908c380 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:09.269587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810bd71-0a38-41a1-9b7d-78ae571bb215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:09.271505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810bd71-0a38-41a1-9b7d-78ae571bb215 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:09.271800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810bd71-0a38-41a1-9b7d-78ae571bb215 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:09.272089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810bd71-0a38-41a1-9b7d-78ae571bb215 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:09.272830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810bd71-0a38-41a1-9b7d-78ae571bb215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:09.280474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810bd71-0a38-41a1-9b7d-78ae571bb215 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:09.333530 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2433/4874] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:18:09 2022] POST /identity/v3/users => generated 292 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:18:09.337627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810bd71-0a38-41a1-9b7d-78ae571bb215 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:09.348814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5d30113e-80a1-4e07-9a8d-f2c5bad1b620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ab95db7f6884aaabe4ed551e2731c19'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:09.355195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:09.358034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810bd71-0a38-41a1-9b7d-78ae571bb215 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:09.367375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7622-bcbd-482c-ad8f-ff3a7efa7e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:09.368006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7622-bcbd-482c-ad8f-ff3a7efa7e0a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:09.369332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5d30113e-80a1-4e07-9a8d-f2c5bad1b620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ab95db7f6884aaabe4ed551e2731c19'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:09.370423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5d30113e-80a1-4e07-9a8d-f2c5bad1b620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ab95db7f6884aaabe4ed551e2731c19'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:09.371474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7622-bcbd-482c-ad8f-ff3a7efa7e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:09.371951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7622-bcbd-482c-ad8f-ff3a7efa7e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:09.373134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc7622-bcbd-482c-ad8f-ff3a7efa7e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:09.374324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc7622-bcbd-482c-ad8f-ff3a7efa7e0a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:09.386831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5d30113e-80a1-4e07-9a8d-f2c5bad1b620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ab95db7f6884aaabe4ed551e2731c19'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:09.388494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5d30113e-80a1-4e07-9a8d-f2c5bad1b620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ab95db7f6884aaabe4ed551e2731c19'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:09.414844 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2434/4875] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:18:09.415599 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2442/4876] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:18:08 2022] DELETE /identity/v3/users/9ab95db7f6884aaabe4ed551e2731c19 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:18:09.421003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7622-bcbd-482c-ad8f-ff3a7efa7e0a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:09.424532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e5fc7622-bcbd-482c-ad8f-ff3a7efa7e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:09.455998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7622-bcbd-482c-ad8f-ff3a7efa7e0a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:09.620927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180dbd1-ee4d-4d7b-b4cf-649b8728aea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:09.622147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180dbd1-ee4d-4d7b-b4cf-649b8728aea9 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:09.622461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180dbd1-ee4d-4d7b-b4cf-649b8728aea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:09.623400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180dbd1-ee4d-4d7b-b4cf-649b8728aea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:09.625641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180dbd1-ee4d-4d7b-b4cf-649b8728aea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:09.628690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180dbd1-ee4d-4d7b-b4cf-649b8728aea9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:09.647671 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2435/4877] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:18:09.649751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30113e-80a1-4e07-9a8d-f2c5bad1b620 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:09.684762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30113e-80a1-4e07-9a8d-f2c5bad1b620 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:09.697321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb6fed-6c0d-4f90-a862-5839ae82450b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:09.697630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb6fed-6c0d-4f90-a862-5839ae82450b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:09.697908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb6fed-6c0d-4f90-a862-5839ae82450b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:09.700737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a402e-e145-496f-82bb-33523bcb1a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:09.702817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a402e-e145-496f-82bb-33523bcb1a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:09.703139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a402e-e145-496f-82bb-33523bcb1a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:09.703497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a402e-e145-496f-82bb-33523bcb1a2c admin admin] PATH_INFO: `/v3/projects/cd884e1c0861450e9049a966a5931675/users/f4b80fe0ec404f0480948be6e051c9e4/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:09.759461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a402e-e145-496f-82bb-33523bcb1a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd884e1c0861450e9049a966a5931675, user_id=f4b80fe0ec404f0480948be6e051c9e4, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:09.768629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a402e-e145-496f-82bb-33523bcb1a2c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:09.774533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6aeb6fed-6c0d-4f90-a862-5839ae82450b None None] MFA Rules not processed for user `4a01092bfa5a4118a5fe61a6dc9c5460`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:18:09.776171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6aeb6fed-6c0d-4f90-a862-5839ae82450b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:09.813412 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2443/4878] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:18:09 2022] PUT /identity/v3/projects/cd884e1c0861450e9049a966a5931675/users/f4b80fe0ec404f0480948be6e051c9e4/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:18:09.819752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8234ec-9698-4dbc-812d-0e3becb87fd1 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:09.820052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8234ec-9698-4dbc-812d-0e3becb87fd1 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:09.821236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8234ec-9698-4dbc-812d-0e3becb87fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:09.862604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0c8234ec-9698-4dbc-812d-0e3becb87fd1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:18:09.867019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0c8234ec-9698-4dbc-812d-0e3becb87fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:09.955814 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2436/4879] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:18:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:18:10.125155 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2444/4880] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:18:10.149047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb6fed-6c0d-4f90-a862-5839ae82450b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:10.150589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6aeb6fed-6c0d-4f90-a862-5839ae82450b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:10.230728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:10.254766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb6fed-6c0d-4f90-a862-5839ae82450b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:10.317394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388932f4-cf94-4dbb-bba4-5f4fb9b4ff00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:10.318045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388932f4-cf94-4dbb-bba4-5f4fb9b4ff00 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:10.318336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388932f4-cf94-4dbb-bba4-5f4fb9b4ff00 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:10.318619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388932f4-cf94-4dbb-bba4-5f4fb9b4ff00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:10.341339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388932f4-cf94-4dbb-bba4-5f4fb9b4ff00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:10.346063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388932f4-cf94-4dbb-bba4-5f4fb9b4ff00 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:10.373415 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2437/4881] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:18:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:18:10.661578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8234ec-9698-4dbc-812d-0e3becb87fd1 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:10.662607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0c8234ec-9698-4dbc-812d-0e3becb87fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:10.685524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8234ec-9698-4dbc-812d-0e3becb87fd1 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:10.692683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b4836-4190-44c0-a84f-71f03d1d2445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:10.693469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b4836-4190-44c0-a84f-71f03d1d2445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:10.693871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b4836-4190-44c0-a84f-71f03d1d2445 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:10.694266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b4836-4190-44c0-a84f-71f03d1d2445 admin admin] PATH_INFO: `/v3/projects/b30854930b8741fb93dd1c615c1e86d2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:10.702728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b4836-4190-44c0-a84f-71f03d1d2445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b30854930b8741fb93dd1c615c1e86d2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:10.704892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b4836-4190-44c0-a84f-71f03d1d2445 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:10.832394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8a9b4836-4190-44c0-a84f-71f03d1d2445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b30854930b8741fb93dd1c615c1e86d2', 'request_id': 'req-8a9b4836-4190-44c0-a84f-71f03d1d2445'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:10.843978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8a9b4836-4190-44c0-a84f-71f03d1d2445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b30854930b8741fb93dd1c615c1e86d2', 'request_id': 'req-8a9b4836-4190-44c0-a84f-71f03d1d2445'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:10.862877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8a9b4836-4190-44c0-a84f-71f03d1d2445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b30854930b8741fb93dd1c615c1e86d2', 'request_id': 'req-8a9b4836-4190-44c0-a84f-71f03d1d2445'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:10.901909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8a9b4836-4190-44c0-a84f-71f03d1d2445 admin admin] The token cache is being invalidate because project b30854930b8741fb93dd1c615c1e86d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:18:10.902379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8a9b4836-4190-44c0-a84f-71f03d1d2445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:10.907232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8a9b4836-4190-44c0-a84f-71f03d1d2445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:10.914714 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2445/4882] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:18:10 2022] DELETE /identity/v3/projects/b30854930b8741fb93dd1c615c1e86d2 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:18:10.916612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3f08a-01f0-4ce2-a561-7c3ec3964fab None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:10.916927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3f08a-01f0-4ce2-a561-7c3ec3964fab None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:10.917230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3f08a-01f0-4ce2-a561-7c3ec3964fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:10.940237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-dce3f08a-01f0-4ce2-a561-7c3ec3964fab None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:18:10.941506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dce3f08a-01f0-4ce2-a561-7c3ec3964fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:11.025959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9400527-e6d7-43ac-b88e-1fef5cc224cb None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:11.026508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9400527-e6d7-43ac-b88e-1fef5cc224cb None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:11.026944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9400527-e6d7-43ac-b88e-1fef5cc224cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:11.030783 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2438/4883] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:18:11.056546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c9400527-e6d7-43ac-b88e-1fef5cc224cb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:18:11.058239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c9400527-e6d7-43ac-b88e-1fef5cc224cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:11.088988 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2446/4884] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:18:11.090498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3f08a-01f0-4ce2-a561-7c3ec3964fab None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:11.102703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3f08a-01f0-4ce2-a561-7c3ec3964fab None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:11.108532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b96b8-3d59-4650-8633-ca020cc26159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:11.109670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b96b8-3d59-4650-8633-ca020cc26159 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:11.110176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b96b8-3d59-4650-8633-ca020cc26159 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:11.110606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b96b8-3d59-4650-8633-ca020cc26159 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:11.111859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b96b8-3d59-4650-8633-ca020cc26159 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:18:11.112374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b96b8-3d59-4650-8633-ca020cc26159 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:11.114501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b96b8-3d59-4650-8633-ca020cc26159 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:11.131780 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2439/4885] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:18:11.136562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9400527-e6d7-43ac-b88e-1fef5cc224cb None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:11.151706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9400527-e6d7-43ac-b88e-1fef5cc224cb None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:11.162119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c59acb-6e3e-49ec-a905-e4729ff907e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:11.162932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c59acb-6e3e-49ec-a905-e4729ff907e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:11.164081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c59acb-6e3e-49ec-a905-e4729ff907e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:11.164636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c59acb-6e3e-49ec-a905-e4729ff907e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:11.165609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c59acb-6e3e-49ec-a905-e4729ff907e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:11.171357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c59acb-6e3e-49ec-a905-e4729ff907e9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:11.206211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:11.234273 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2447/4886] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:18:11 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:18:11.235771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b96b8-3d59-4650-8633-ca020cc26159 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:11.250529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b96b8-3d59-4650-8633-ca020cc26159 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:11.447383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f9c0c-2016-45b5-8165-7aae78de7d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:11.448020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f9c0c-2016-45b5-8165-7aae78de7d1d admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:11.448300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f9c0c-2016-45b5-8165-7aae78de7d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:11.448744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f9c0c-2016-45b5-8165-7aae78de7d1d admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:11.449569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f9c0c-2016-45b5-8165-7aae78de7d1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:11.454589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f9c0c-2016-45b5-8165-7aae78de7d1d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:11.530729 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2440/4887] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:18:11 2022] POST /identity/v3/users => generated 294 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:18:11.535530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c59acb-6e3e-49ec-a905-e4729ff907e9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:11.566355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c59acb-6e3e-49ec-a905-e4729ff907e9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:11.614017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed68c29-0d9d-4b46-a473-e0ce8ca8fe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:11.614668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed68c29-0d9d-4b46-a473-e0ce8ca8fe75 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:11.614957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed68c29-0d9d-4b46-a473-e0ce8ca8fe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:11.617613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed68c29-0d9d-4b46-a473-e0ce8ca8fe75 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:11.621010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed68c29-0d9d-4b46-a473-e0ce8ca8fe75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:11.628867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed68c29-0d9d-4b46-a473-e0ce8ca8fe75 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:11.673557 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2448/4888] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:18:11.677319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f9c0c-2016-45b5-8165-7aae78de7d1d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:11.697768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f9c0c-2016-45b5-8165-7aae78de7d1d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:11.725791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad2799-6fbd-4cf8-b396-b4e7e00fe316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:11.725791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad2799-6fbd-4cf8-b396-b4e7e00fe316 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:11.726123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad2799-6fbd-4cf8-b396-b4e7e00fe316 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:11.726475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad2799-6fbd-4cf8-b396-b4e7e00fe316 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:11.727445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad2799-6fbd-4cf8-b396-b4e7e00fe316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:11.732334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad2799-6fbd-4cf8-b396-b4e7e00fe316 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:11.768168 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2441/4889] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:18:11.772289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed68c29-0d9d-4b46-a473-e0ce8ca8fe75 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:11.790235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed68c29-0d9d-4b46-a473-e0ce8ca8fe75 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:11.807479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba645c-269b-4da4-baaa-cbdaab5b5588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:11.808484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba645c-269b-4da4-baaa-cbdaab5b5588 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:11.810356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba645c-269b-4da4-baaa-cbdaab5b5588 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:11.810794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba645c-269b-4da4-baaa-cbdaab5b5588 admin admin] PATH_INFO: `/v3/projects/bb3d5d56c12b44588c7bc4a5dcaae622/users/ef96cb7f40424d7fa1ddfd463efb746a/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:11.860093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba645c-269b-4da4-baaa-cbdaab5b5588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3d5d56c12b44588c7bc4a5dcaae622, user_id=ef96cb7f40424d7fa1ddfd463efb746a, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:11.864610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba645c-269b-4da4-baaa-cbdaab5b5588 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:11.918068 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2449/4890] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:18:11 2022] PUT /identity/v3/projects/bb3d5d56c12b44588c7bc4a5dcaae622/users/ef96cb7f40424d7fa1ddfd463efb746a/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:18:11.918472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbe327-6f5e-4de0-a227-24f99e7ecc37 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:11.919020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbe327-6f5e-4de0-a227-24f99e7ecc37 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:11.919564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbe327-6f5e-4de0-a227-24f99e7ecc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:11.983760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:12.065156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d94b4b-0189-4251-b48d-d9557f67e406 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:12.065854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d94b4b-0189-4251-b48d-d9557f67e406 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:12.067056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d94b4b-0189-4251-b48d-d9557f67e406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:12.073771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-99fbe327-6f5e-4de0-a227-24f99e7ecc37 None None] MFA Rules not processed for user `ef96cb7f40424d7fa1ddfd463efb746a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:18:12.074686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-99fbe327-6f5e-4de0-a227-24f99e7ecc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:12.188993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-47d94b4b-0189-4251-b48d-d9557f67e406 None None] MFA Rules not processed for user `c025e35fd22a4895a5d0301c1d5b0e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:18:12.190266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-47d94b4b-0189-4251-b48d-d9557f67e406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:12.405880 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2450/4891] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:18:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:18:12.424601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d94b4b-0189-4251-b48d-d9557f67e406 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:12.426857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-47d94b4b-0189-4251-b48d-d9557f67e406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:12.433663 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2442/4892] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:18:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:18:12.452571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbe327-6f5e-4de0-a227-24f99e7ecc37 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:12.453477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-99fbe327-6f5e-4de0-a227-24f99e7ecc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:12.653380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbe327-6f5e-4de0-a227-24f99e7ecc37 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:12.660945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d94b4b-0189-4251-b48d-d9557f67e406 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:12.662955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4e539-a6d3-45a3-bbae-3236ec7b0d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:12.663683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4e539-a6d3-45a3-bbae-3236ec7b0d61 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:12.665720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4e539-a6d3-45a3-bbae-3236ec7b0d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:12.666611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4e539-a6d3-45a3-bbae-3236ec7b0d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:12.677494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14076f-4c52-4d62-a6f6-f4762dc97cf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:12.681498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14076f-4c52-4d62-a6f6-f4762dc97cf4 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:12.681834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14076f-4c52-4d62-a6f6-f4762dc97cf4 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:12.682124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14076f-4c52-4d62-a6f6-f4762dc97cf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:12.700885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4e539-a6d3-45a3-bbae-3236ec7b0d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:12.703046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4e539-a6d3-45a3-bbae-3236ec7b0d61 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:12.716984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14076f-4c52-4d62-a6f6-f4762dc97cf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:12.718626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14076f-4c52-4d62-a6f6-f4762dc97cf4 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:12.745333 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2443/4893] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:18:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:18:12.759247 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2451/4894] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:18:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:18:16.503334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4e539-a6d3-45a3-bbae-3236ec7b0d61 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:16.504814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9ac4e539-a6d3-45a3-bbae-3236ec7b0d61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:16.577573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4e539-a6d3-45a3-bbae-3236ec7b0d61 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:16.589184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ef7f9-2cee-4f28-b60d-78d2be89b606 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:16.590080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ef7f9-2cee-4f28-b60d-78d2be89b606 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:16.590522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ef7f9-2cee-4f28-b60d-78d2be89b606 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:16.590937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ef7f9-2cee-4f28-b60d-78d2be89b606 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:16.604088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ef3ef7f9-2cee-4f28-b60d-78d2be89b606 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:16.810253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ef7f9-2cee-4f28-b60d-78d2be89b606 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:16.814827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ef7f9-2cee-4f28-b60d-78d2be89b606 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:16.877597 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2444/4895] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:18:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:18:22.738315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=81,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:24.641799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a8603-f4e0-434f-89c5-8bbdb3267341 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:24.642770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a8603-f4e0-434f-89c5-8bbdb3267341 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:24.643258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a8603-f4e0-434f-89c5-8bbdb3267341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:24.684900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a35a8603-f4e0-434f-89c5-8bbdb3267341 None None] MFA Rules not processed for user `c025e35fd22a4895a5d0301c1d5b0e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:18:24.686529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a35a8603-f4e0-434f-89c5-8bbdb3267341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:24.728402 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2452/4896] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:18:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:18:26.867030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:34.189643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9dbb3-02c3-4f5c-9ba8-30c298c8bbdd None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:34.190515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9dbb3-02c3-4f5c-9ba8-30c298c8bbdd None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:34.190952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9dbb3-02c3-4f5c-9ba8-30c298c8bbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:34.286928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-79e9dbb3-02c3-4f5c-9ba8-30c298c8bbdd None None] MFA Rules not processed for user `f4b80fe0ec404f0480948be6e051c9e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:18:34.289528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-79e9dbb3-02c3-4f5c-9ba8-30c298c8bbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:34.443484 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2445/4897] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:18:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:18:34.447991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a8603-f4e0-434f-89c5-8bbdb3267341 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:34.449935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a35a8603-f4e0-434f-89c5-8bbdb3267341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:34.598933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a8603-f4e0-434f-89c5-8bbdb3267341 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:34.606314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f08ed5-a185-4631-bd9e-5c0e8d395f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:34.607009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08ed5-a185-4631-bd9e-5c0e8d395f9d admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:34.607708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08ed5-a185-4631-bd9e-5c0e8d395f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:34.608227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08ed5-a185-4631-bd9e-5c0e8d395f9d admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:34.609108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f08ed5-a185-4631-bd9e-5c0e8d395f9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:34.612037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f08ed5-a185-4631-bd9e-5c0e8d395f9d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:34.648773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9dbb3-02c3-4f5c-9ba8-30c298c8bbdd None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:34.656427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-79e9dbb3-02c3-4f5c-9ba8-30c298c8bbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:34.699534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9dbb3-02c3-4f5c-9ba8-30c298c8bbdd None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:34.702126 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2453/4898] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:18:34 2022] POST /identity/v3/projects => generated 383 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:18:34.705970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f08ed5-a185-4631-bd9e-5c0e8d395f9d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:34.826526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f08ed5-a185-4631-bd9e-5c0e8d395f9d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:34.837948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b2826-8be0-4e81-b6bb-3a9a8b94510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:34.838828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b2826-8be0-4e81-b6bb-3a9a8b94510d admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:34.839319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b2826-8be0-4e81-b6bb-3a9a8b94510d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:34.839899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b2826-8be0-4e81-b6bb-3a9a8b94510d admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:34.840874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b2826-8be0-4e81-b6bb-3a9a8b94510d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:34.842976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b2826-8be0-4e81-b6bb-3a9a8b94510d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:34.862385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb51d5-2fa4-4819-89fb-f4ce9c48b984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:34.863138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb51d5-2fa4-4819-89fb-f4ce9c48b984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:34.864259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb51d5-2fa4-4819-89fb-f4ce9c48b984 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:34.864708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb51d5-2fa4-4819-89fb-f4ce9c48b984 admin admin] PATH_INFO: `/v3/users/86e4e88cd2154fa09d15bffe4e644a8b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:34.866135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb51d5-2fa4-4819-89fb-f4ce9c48b984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86e4e88cd2154fa09d15bffe4e644a8b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:34.868980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb51d5-2fa4-4819-89fb-f4ce9c48b984 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:34.891017 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2454/4899] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:18:34 2022] POST /identity/v3/users => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:18:34.892259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b2826-8be0-4e81-b6bb-3a9a8b94510d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:34.915583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b2826-8be0-4e81-b6bb-3a9a8b94510d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:34.924871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00060671-6612-4fe4-b3b7-4cebe8a8341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:34.925542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00060671-6612-4fe4-b3b7-4cebe8a8341b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:34.925885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00060671-6612-4fe4-b3b7-4cebe8a8341b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:34.926140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00060671-6612-4fe4-b3b7-4cebe8a8341b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:34.926857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00060671-6612-4fe4-b3b7-4cebe8a8341b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:34.929019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00060671-6612-4fe4-b3b7-4cebe8a8341b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:34.948435 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2455/4900] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:18:34.950298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00060671-6612-4fe4-b3b7-4cebe8a8341b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:34.952819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7fdb51d5-2fa4-4819-89fb-f4ce9c48b984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86e4e88cd2154fa09d15bffe4e644a8b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:34.953516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7fdb51d5-2fa4-4819-89fb-f4ce9c48b984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86e4e88cd2154fa09d15bffe4e644a8b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:34.963997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00060671-6612-4fe4-b3b7-4cebe8a8341b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:34.971018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98de80-f53b-4c2e-8aaa-2ce125be41cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:34.972541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98de80-f53b-4c2e-8aaa-2ce125be41cf admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:34.972656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7fdb51d5-2fa4-4819-89fb-f4ce9c48b984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86e4e88cd2154fa09d15bffe4e644a8b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:34.973288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98de80-f53b-4c2e-8aaa-2ce125be41cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:34.973469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7fdb51d5-2fa4-4819-89fb-f4ce9c48b984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86e4e88cd2154fa09d15bffe4e644a8b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:34.974034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98de80-f53b-4c2e-8aaa-2ce125be41cf admin admin] PATH_INFO: `/v3/projects/5fd1f1c4241c4e5499843e55c3150ad8/users/8ee0399bb37d4be7a37d5d26b1bb68c5/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:34.986109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7fdb51d5-2fa4-4819-89fb-f4ce9c48b984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86e4e88cd2154fa09d15bffe4e644a8b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:35.005362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98de80-f53b-4c2e-8aaa-2ce125be41cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fd1f1c4241c4e5499843e55c3150ad8, user_id=8ee0399bb37d4be7a37d5d26b1bb68c5, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:35.022348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98de80-f53b-4c2e-8aaa-2ce125be41cf admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:35.036049 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2446/4901] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:18:34 2022] DELETE /identity/v3/users/86e4e88cd2154fa09d15bffe4e644a8b => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:18:35.057911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb51d5-2fa4-4819-89fb-f4ce9c48b984 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:35.059583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7fdb51d5-2fa4-4819-89fb-f4ce9c48b984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:35.060613 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2456/4902] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:18:34 2022] PUT /identity/v3/projects/5fd1f1c4241c4e5499843e55c3150ad8/users/8ee0399bb37d4be7a37d5d26b1bb68c5/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:18:35.077347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:35.154929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb51d5-2fa4-4819-89fb-f4ce9c48b984 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:35.251581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63cf40-ead9-4dd9-b7dd-e5101e61f4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:35.253309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63cf40-ead9-4dd9-b7dd-e5101e61f4bb admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:35.254416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63cf40-ead9-4dd9-b7dd-e5101e61f4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:35.254952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63cf40-ead9-4dd9-b7dd-e5101e61f4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:35.256718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63cf40-ead9-4dd9-b7dd-e5101e61f4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:35.258609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63cf40-ead9-4dd9-b7dd-e5101e61f4bb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:35.280697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98de80-f53b-4c2e-8aaa-2ce125be41cf admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:35.290712 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2447/4903] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:18:35.297999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98de80-f53b-4c2e-8aaa-2ce125be41cf admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:35.305006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76410621-1a70-4264-8a0b-5ef328cbfb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:35.306025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76410621-1a70-4264-8a0b-5ef328cbfb40 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:35.306532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76410621-1a70-4264-8a0b-5ef328cbfb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:35.307105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76410621-1a70-4264-8a0b-5ef328cbfb40 admin admin] PATH_INFO: `/v3/projects/5fd1f1c4241c4e5499843e55c3150ad8/users/8ee0399bb37d4be7a37d5d26b1bb68c5/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:35.310669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76410621-1a70-4264-8a0b-5ef328cbfb40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fd1f1c4241c4e5499843e55c3150ad8, user_id=8ee0399bb37d4be7a37d5d26b1bb68c5, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:35.315220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76410621-1a70-4264-8a0b-5ef328cbfb40 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:35.337568 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2457/4904] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:18:35 2022] PUT /identity/v3/projects/5fd1f1c4241c4e5499843e55c3150ad8/users/8ee0399bb37d4be7a37d5d26b1bb68c5/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:18:35.926791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63cf40-ead9-4dd9-b7dd-e5101e61f4bb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:35.930158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-df63cf40-ead9-4dd9-b7dd-e5101e61f4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:35.979479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63cf40-ead9-4dd9-b7dd-e5101e61f4bb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:36.078770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77717a83-85c2-4a42-9ae2-6c34838dfc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:36.081342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77717a83-85c2-4a42-9ae2-6c34838dfc0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:36.081733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77717a83-85c2-4a42-9ae2-6c34838dfc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:36.082233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77717a83-85c2-4a42-9ae2-6c34838dfc0d admin admin] PATH_INFO: `/v3/projects/995094f55a1a4d51bba197347e510968` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:36.083631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77717a83-85c2-4a42-9ae2-6c34838dfc0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=995094f55a1a4d51bba197347e510968)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:36.086351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77717a83-85c2-4a42-9ae2-6c34838dfc0d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:36.168610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-77717a83-85c2-4a42-9ae2-6c34838dfc0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '995094f55a1a4d51bba197347e510968', 'request_id': 'req-77717a83-85c2-4a42-9ae2-6c34838dfc0d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:36.175550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:36.184720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-77717a83-85c2-4a42-9ae2-6c34838dfc0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '995094f55a1a4d51bba197347e510968', 'request_id': 'req-77717a83-85c2-4a42-9ae2-6c34838dfc0d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:36.196118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-77717a83-85c2-4a42-9ae2-6c34838dfc0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '995094f55a1a4d51bba197347e510968', 'request_id': 'req-77717a83-85c2-4a42-9ae2-6c34838dfc0d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:36.212765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-77717a83-85c2-4a42-9ae2-6c34838dfc0d admin admin] The token cache is being invalidate because project 995094f55a1a4d51bba197347e510968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:18:36.213390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-77717a83-85c2-4a42-9ae2-6c34838dfc0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:36.214290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-77717a83-85c2-4a42-9ae2-6c34838dfc0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:18:36.216515 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2448/4905] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:18:35 2022] DELETE /identity/v3/projects/995094f55a1a4d51bba197347e510968 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:18:36.221533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb01520-96ea-49cc-a006-54308e3aaa64 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:36.221982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb01520-96ea-49cc-a006-54308e3aaa64 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:36.222075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb01520-96ea-49cc-a006-54308e3aaa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:36.265439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9bb01520-96ea-49cc-a006-54308e3aaa64 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:18:36.267772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9bb01520-96ea-49cc-a006-54308e3aaa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:36.290024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:36.444272 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2458/4906] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:18:36.452451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31624b-60b1-4518-887e-2946bfe75d9e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:36.452981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31624b-60b1-4518-887e-2946bfe75d9e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:36.453401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31624b-60b1-4518-887e-2946bfe75d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:36.504820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-cd31624b-60b1-4518-887e-2946bfe75d9e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:18:36.511731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cd31624b-60b1-4518-887e-2946bfe75d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:36.554074 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2449/4907] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:18:36.558050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb01520-96ea-49cc-a006-54308e3aaa64 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:36.575601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb01520-96ea-49cc-a006-54308e3aaa64 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:36.582086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b518434-db1f-4efe-af57-7e25e17fcada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:36.582984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518434-db1f-4efe-af57-7e25e17fcada admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:36.583521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518434-db1f-4efe-af57-7e25e17fcada admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:36.583980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518434-db1f-4efe-af57-7e25e17fcada admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:36.585419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b518434-db1f-4efe-af57-7e25e17fcada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:18:36.585907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b518434-db1f-4efe-af57-7e25e17fcada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:36.592096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b518434-db1f-4efe-af57-7e25e17fcada admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:36.613618 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2459/4908] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:18:36.618791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31624b-60b1-4518-887e-2946bfe75d9e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:36.630249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31624b-60b1-4518-887e-2946bfe75d9e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:36.644736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5652f-0cf5-491f-9952-b04db418ff9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:36.645676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5652f-0cf5-491f-9952-b04db418ff9c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:36.646232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5652f-0cf5-491f-9952-b04db418ff9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:36.647469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5652f-0cf5-491f-9952-b04db418ff9c admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:36.648330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5652f-0cf5-491f-9952-b04db418ff9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:36.650400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5652f-0cf5-491f-9952-b04db418ff9c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:36.694756 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2450/4909] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:18:36 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:18:36.698742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b518434-db1f-4efe-af57-7e25e17fcada admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:36.710289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b518434-db1f-4efe-af57-7e25e17fcada admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:36.832606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca29d9-1c8a-4c68-b02b-b42f8b052577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:36.833885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca29d9-1c8a-4c68-b02b-b42f8b052577 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:36.834510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca29d9-1c8a-4c68-b02b-b42f8b052577 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:36.834893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca29d9-1c8a-4c68-b02b-b42f8b052577 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:36.836088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca29d9-1c8a-4c68-b02b-b42f8b052577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:36.838962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca29d9-1c8a-4c68-b02b-b42f8b052577 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:36.882672 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2460/4910] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:18:36 2022] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:18:36.886923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5652f-0cf5-491f-9952-b04db418ff9c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:36.901205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5652f-0cf5-491f-9952-b04db418ff9c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:36.906454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3ca95-8628-4d55-81c5-e035c59bd432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:36.907147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3ca95-8628-4d55-81c5-e035c59bd432 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:36.907495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3ca95-8628-4d55-81c5-e035c59bd432 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:36.908082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3ca95-8628-4d55-81c5-e035c59bd432 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:36.908795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3ca95-8628-4d55-81c5-e035c59bd432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:36.919336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3ca95-8628-4d55-81c5-e035c59bd432 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:36.939454 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2451/4911] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:18:36.943377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca29d9-1c8a-4c68-b02b-b42f8b052577 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:36.957889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca29d9-1c8a-4c68-b02b-b42f8b052577 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:36.982706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a3961-2ca0-4ceb-b2f8-a529bf2a82d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:36.983607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a3961-2ca0-4ceb-b2f8-a529bf2a82d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:36.983894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a3961-2ca0-4ceb-b2f8-a529bf2a82d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:36.984170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a3961-2ca0-4ceb-b2f8-a529bf2a82d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:36.986930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a3961-2ca0-4ceb-b2f8-a529bf2a82d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:36.988483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a3961-2ca0-4ceb-b2f8-a529bf2a82d4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:37.025862 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2461/4912] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:18:37.030726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3ca95-8628-4d55-81c5-e035c59bd432 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:37.047684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3ca95-8628-4d55-81c5-e035c59bd432 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:37.054965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d59bf-b428-45b9-859a-13ebb413f861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:37.056749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d59bf-b428-45b9-859a-13ebb413f861 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:37.057206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d59bf-b428-45b9-859a-13ebb413f861 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:37.057629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d59bf-b428-45b9-859a-13ebb413f861 admin admin] PATH_INFO: `/v3/projects/cab0816ccd114c45b178df1c7ede5705/users/3c77b6ab96684386ace13eef85513e9f/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:37.080036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d59bf-b428-45b9-859a-13ebb413f861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab0816ccd114c45b178df1c7ede5705, user_id=3c77b6ab96684386ace13eef85513e9f, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:37.085411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d59bf-b428-45b9-859a-13ebb413f861 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:37.112905 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2452/4913] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:18:37 2022] PUT /identity/v3/projects/cab0816ccd114c45b178df1c7ede5705/users/3c77b6ab96684386ace13eef85513e9f/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:18:37.118211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72b973-a540-42dc-b614-f7f9a8157758 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:37.118665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72b973-a540-42dc-b614-f7f9a8157758 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:37.119872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72b973-a540-42dc-b614-f7f9a8157758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:37.166657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2f72b973-a540-42dc-b614-f7f9a8157758 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:18:37.167956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2f72b973-a540-42dc-b614-f7f9a8157758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:37.293393 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2462/4914] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:18:37.306020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d59bf-b428-45b9-859a-13ebb413f861 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:37.308092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-392d59bf-b428-45b9-859a-13ebb413f861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:37.463729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d59bf-b428-45b9-859a-13ebb413f861 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:37.468496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aedf44-ddc3-4411-bccc-a67015ccb5b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:37.469320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aedf44-ddc3-4411-bccc-a67015ccb5b4 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:37.469747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aedf44-ddc3-4411-bccc-a67015ccb5b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:37.470322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aedf44-ddc3-4411-bccc-a67015ccb5b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:37.485583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aedf44-ddc3-4411-bccc-a67015ccb5b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:37.489625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aedf44-ddc3-4411-bccc-a67015ccb5b4 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:37.508250 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2453/4915] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:18:40.158122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72b973-a540-42dc-b614-f7f9a8157758 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:40.160496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2f72b973-a540-42dc-b614-f7f9a8157758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:40.207217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:40.250355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72b973-a540-42dc-b614-f7f9a8157758 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:40.256398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe072f-85af-4c8a-a5eb-86fb9366b906 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:40.257161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe072f-85af-4c8a-a5eb-86fb9366b906 service glance] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:40.257451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe072f-85af-4c8a-a5eb-86fb9366b906 service glance] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:40.257730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe072f-85af-4c8a-a5eb-86fb9366b906 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:40.260446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a2fe072f-85af-4c8a-a5eb-86fb9366b906 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:40.454516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe072f-85af-4c8a-a5eb-86fb9366b906 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:40.456152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe072f-85af-4c8a-a5eb-86fb9366b906 service glance] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:40.498902 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2463/4916] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:18:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:18:40.610347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aedf44-ddc3-4411-bccc-a67015ccb5b4 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:40.641084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aedf44-ddc3-4411-bccc-a67015ccb5b4 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:40.650646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cf13e-cf1c-4994-95a7-8a200b386229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:40.651339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cf13e-cf1c-4994-95a7-8a200b386229 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:40.651628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cf13e-cf1c-4994-95a7-8a200b386229 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:40.651900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cf13e-cf1c-4994-95a7-8a200b386229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:40.653719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4a4cf13e-cf1c-4994-95a7-8a200b386229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:40.666390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cf13e-cf1c-4994-95a7-8a200b386229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:40.676985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cf13e-cf1c-4994-95a7-8a200b386229 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:40.697659 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2454/4917] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:18:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:18:47.086709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73d592-d9d0-4818-97c1-fd54feae3bed None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:47.087723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73d592-d9d0-4818-97c1-fd54feae3bed None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:47.088232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73d592-d9d0-4818-97c1-fd54feae3bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:47.137944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ec73d592-d9d0-4818-97c1-fd54feae3bed None None] MFA Rules not processed for user `4a01092bfa5a4118a5fe61a6dc9c5460`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:18:47.142756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ec73d592-d9d0-4818-97c1-fd54feae3bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:47.289023 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2464/4918] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:18:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:18:48.572169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475f8d8-40af-49df-bfc6-ad4695b57439 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:48.573217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475f8d8-40af-49df-bfc6-ad4695b57439 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:48.573783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475f8d8-40af-49df-bfc6-ad4695b57439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:48.595918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3475f8d8-40af-49df-bfc6-ad4695b57439 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:18:48.597479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3475f8d8-40af-49df-bfc6-ad4695b57439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:48.712131 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2455/4919] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:18:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:18:48.720261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73d592-d9d0-4818-97c1-fd54feae3bed None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:48.721697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ec73d592-d9d0-4818-97c1-fd54feae3bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:48.786279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:48.805191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73d592-d9d0-4818-97c1-fd54feae3bed None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:48.822492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab985fd-6fc6-4dee-879d-3bb10d5b4fb9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:48.823557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab985fd-6fc6-4dee-879d-3bb10d5b4fb9 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:48.823987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab985fd-6fc6-4dee-879d-3bb10d5b4fb9 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:48.824411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab985fd-6fc6-4dee-879d-3bb10d5b4fb9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:48.833970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab985fd-6fc6-4dee-879d-3bb10d5b4fb9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:48.835865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab985fd-6fc6-4dee-879d-3bb10d5b4fb9 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:48.863701 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2465/4920] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:18:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:18:55.065152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a349a-e261-4adc-b2fc-4320a96569f1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:55.065942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a349a-e261-4adc-b2fc-4320a96569f1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:55.066713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a349a-e261-4adc-b2fc-4320a96569f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:55.123526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:55.128318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2b1a349a-e261-4adc-b2fc-4320a96569f1 None None] MFA Rules not processed for user `8ee0399bb37d4be7a37d5d26b1bb68c5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:18:55.133952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2b1a349a-e261-4adc-b2fc-4320a96569f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:55.282346 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2456/4921] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:18:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:18:55.301621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab985fd-6fc6-4dee-879d-3bb10d5b4fb9 service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:55.316469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab985fd-6fc6-4dee-879d-3bb10d5b4fb9 service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:55.335310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5e914-cc17-4042-9149-01fc7532a459 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:55.336052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5e914-cc17-4042-9149-01fc7532a459 service glance] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:55.336490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5e914-cc17-4042-9149-01fc7532a459 service glance] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:55.336905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5e914-cc17-4042-9149-01fc7532a459 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:55.340590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a3e5e914-cc17-4042-9149-01fc7532a459 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:55.528378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5e914-cc17-4042-9149-01fc7532a459 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:55.542712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5e914-cc17-4042-9149-01fc7532a459 service glance] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:55.580174 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2466/4922] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:18:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:18:56.934383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f17e1b-029b-447b-8ce4-16fd05cfbfd8 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:56.935018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f17e1b-029b-447b-8ce4-16fd05cfbfd8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:56.935018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f17e1b-029b-447b-8ce4-16fd05cfbfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:57.086183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-62f17e1b-029b-447b-8ce4-16fd05cfbfd8 None None] MFA Rules not processed for user `3c77b6ab96684386ace13eef85513e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:18:57.087662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-62f17e1b-029b-447b-8ce4-16fd05cfbfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:57.340984 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2457/4923] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:18:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:18:57.363572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5e914-cc17-4042-9149-01fc7532a459 service glance] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:18:57.365848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a3e5e914-cc17-4042-9149-01fc7532a459 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:18:57.399905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5e914-cc17-4042-9149-01fc7532a459 service glance] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:18:57.414942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75877ca1-0220-4d31-a150-348318ccd83b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:18:57.415906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75877ca1-0220-4d31-a150-348318ccd83b service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:18:57.420359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75877ca1-0220-4d31-a150-348318ccd83b service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:18:57.421149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75877ca1-0220-4d31-a150-348318ccd83b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:18:57.448169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75877ca1-0220-4d31-a150-348318ccd83b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:18:57.454151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75877ca1-0220-4d31-a150-348318ccd83b service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:18:57.483676 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2467/4924] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:18:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:19:07.332147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=60 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:07.471866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=41 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:08.553961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f17e1b-029b-447b-8ce4-16fd05cfbfd8 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:08.577291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f17e1b-029b-447b-8ce4-16fd05cfbfd8 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:08.586523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd63f96-f29a-40e0-bd5c-7b02c39bf1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:08.587932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd63f96-f29a-40e0-bd5c-7b02c39bf1a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:08.588435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd63f96-f29a-40e0-bd5c-7b02c39bf1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:08.588862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd63f96-f29a-40e0-bd5c-7b02c39bf1a6 admin admin] PATH_INFO: `/v3/users/3c77b6ab96684386ace13eef85513e9f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:08.590257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd63f96-f29a-40e0-bd5c-7b02c39bf1a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c77b6ab96684386ace13eef85513e9f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:08.592588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd63f96-f29a-40e0-bd5c-7b02c39bf1a6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:08.785747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9bd63f96-f29a-40e0-bd5c-7b02c39bf1a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c77b6ab96684386ace13eef85513e9f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:08.790840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9bd63f96-f29a-40e0-bd5c-7b02c39bf1a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c77b6ab96684386ace13eef85513e9f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:08.835832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9bd63f96-f29a-40e0-bd5c-7b02c39bf1a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c77b6ab96684386ace13eef85513e9f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:08.837507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9bd63f96-f29a-40e0-bd5c-7b02c39bf1a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c77b6ab96684386ace13eef85513e9f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:08.877809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9bd63f96-f29a-40e0-bd5c-7b02c39bf1a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c77b6ab96684386ace13eef85513e9f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:08.905074 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2458/4925] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:08 2022] DELETE /identity/v3/users/3c77b6ab96684386ace13eef85513e9f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:09.609985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75877ca1-0220-4d31-a150-348318ccd83b service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:09.625221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75877ca1-0220-4d31-a150-348318ccd83b service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:09.756774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b46e6a-7268-468f-888c-974c3a766b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:09.757456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b46e6a-7268-468f-888c-974c3a766b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:09.757787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b46e6a-7268-468f-888c-974c3a766b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:09.758122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b46e6a-7268-468f-888c-974c3a766b3c admin admin] PATH_INFO: `/v3/projects/cab0816ccd114c45b178df1c7ede5705` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:09.760779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b46e6a-7268-468f-888c-974c3a766b3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cab0816ccd114c45b178df1c7ede5705)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:09.762813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b46e6a-7268-468f-888c-974c3a766b3c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:09.847235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-32b46e6a-7268-468f-888c-974c3a766b3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cab0816ccd114c45b178df1c7ede5705', 'request_id': 'req-32b46e6a-7268-468f-888c-974c3a766b3c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:09.858942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-32b46e6a-7268-468f-888c-974c3a766b3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cab0816ccd114c45b178df1c7ede5705', 'request_id': 'req-32b46e6a-7268-468f-888c-974c3a766b3c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:09.870724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-32b46e6a-7268-468f-888c-974c3a766b3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cab0816ccd114c45b178df1c7ede5705', 'request_id': 'req-32b46e6a-7268-468f-888c-974c3a766b3c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:09.890587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-32b46e6a-7268-468f-888c-974c3a766b3c admin admin] The token cache is being invalidate because project cab0816ccd114c45b178df1c7ede5705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:09.890913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-32b46e6a-7268-468f-888c-974c3a766b3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:09.891652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-32b46e6a-7268-468f-888c-974c3a766b3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:09.893149 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2468/4926] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:09 2022] DELETE /identity/v3/projects/cab0816ccd114c45b178df1c7ede5705 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:19:09.900764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547942b-330a-4320-8778-7b5c3ee71a16 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:09.901271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547942b-330a-4320-8778-7b5c3ee71a16 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:09.901348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547942b-330a-4320-8778-7b5c3ee71a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:09.926503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5547942b-330a-4320-8778-7b5c3ee71a16 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:09.928347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5547942b-330a-4320-8778-7b5c3ee71a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:10.054919 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2459/4927] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:19:10.062359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07436e76-f541-4928-a7b1-43455f451f00 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:10.062560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07436e76-f541-4928-a7b1-43455f451f00 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:10.062771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07436e76-f541-4928-a7b1-43455f451f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:10.107435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-07436e76-f541-4928-a7b1-43455f451f00 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:10.109030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-07436e76-f541-4928-a7b1-43455f451f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:10.120271 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2469/4928] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:10.124839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547942b-330a-4320-8778-7b5c3ee71a16 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:10.144731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547942b-330a-4320-8778-7b5c3ee71a16 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:10.189733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e4e48-d640-48fa-8b96-3e90f6a8e19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:10.190382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e4e48-d640-48fa-8b96-3e90f6a8e19d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:10.190669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e4e48-d640-48fa-8b96-3e90f6a8e19d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:10.190944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e4e48-d640-48fa-8b96-3e90f6a8e19d admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:10.192019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e4e48-d640-48fa-8b96-3e90f6a8e19d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:19:10.193273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e4e48-d640-48fa-8b96-3e90f6a8e19d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:10.195740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e4e48-d640-48fa-8b96-3e90f6a8e19d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:10.217758 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2460/4929] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:10.223871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07436e76-f541-4928-a7b1-43455f451f00 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:10.237409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07436e76-f541-4928-a7b1-43455f451f00 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:10.250208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dcb23-47dc-4a66-8b07-6bf98071512b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:10.250848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dcb23-47dc-4a66-8b07-6bf98071512b admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:10.251202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dcb23-47dc-4a66-8b07-6bf98071512b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:10.251625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dcb23-47dc-4a66-8b07-6bf98071512b admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:10.252754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709dcb23-47dc-4a66-8b07-6bf98071512b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:10.262855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709dcb23-47dc-4a66-8b07-6bf98071512b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:10.348059 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2470/4930] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:10 2022] POST /identity/v3/projects => generated 363 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:10.352563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e4e48-d640-48fa-8b96-3e90f6a8e19d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:10.369757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e4e48-d640-48fa-8b96-3e90f6a8e19d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:10.464219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c29b53-004c-418a-b106-dac3cfd71f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:10.464869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c29b53-004c-418a-b106-dac3cfd71f27 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:10.465158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c29b53-004c-418a-b106-dac3cfd71f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:10.465440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c29b53-004c-418a-b106-dac3cfd71f27 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:10.466116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c29b53-004c-418a-b106-dac3cfd71f27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:10.468356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c29b53-004c-418a-b106-dac3cfd71f27 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:10.477825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:10.508374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dcb23-47dc-4a66-8b07-6bf98071512b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:10.508825 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2461/4931] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:10 2022] POST /identity/v3/users => generated 282 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:19:10.521135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dcb23-47dc-4a66-8b07-6bf98071512b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:10.527242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8441dcc-7849-45d3-ad05-8db4ef3a60aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:10.528084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8441dcc-7849-45d3-ad05-8db4ef3a60aa admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:10.528569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8441dcc-7849-45d3-ad05-8db4ef3a60aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:10.528891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8441dcc-7849-45d3-ad05-8db4ef3a60aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:10.529816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8441dcc-7849-45d3-ad05-8db4ef3a60aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:10.531636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8441dcc-7849-45d3-ad05-8db4ef3a60aa admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:10.543700 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2471/4932] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:19:10.548334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c29b53-004c-418a-b106-dac3cfd71f27 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:10.561764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c29b53-004c-418a-b106-dac3cfd71f27 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:10.566604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368e439-2430-45a3-b7bd-0f7422bf94df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:10.567900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368e439-2430-45a3-b7bd-0f7422bf94df admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:10.568192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368e439-2430-45a3-b7bd-0f7422bf94df admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:10.568473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368e439-2430-45a3-b7bd-0f7422bf94df admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:10.569179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368e439-2430-45a3-b7bd-0f7422bf94df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:10.570807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368e439-2430-45a3-b7bd-0f7422bf94df admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:10.582520 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2462/4933] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:10.587601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8441dcc-7849-45d3-ad05-8db4ef3a60aa admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:10.604780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8441dcc-7849-45d3-ad05-8db4ef3a60aa admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:10.612346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e320e-ea0c-45e5-9276-504964b3b5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:10.613149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e320e-ea0c-45e5-9276-504964b3b5f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:10.613627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e320e-ea0c-45e5-9276-504964b3b5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:10.613712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e320e-ea0c-45e5-9276-504964b3b5f2 admin admin] PATH_INFO: `/v3/projects/631a4d16f7ba46de9b55755ea405cf81/users/c82f919b7409432d84a0c2409ed0d95b/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:10.631903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e320e-ea0c-45e5-9276-504964b3b5f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=631a4d16f7ba46de9b55755ea405cf81, user_id=c82f919b7409432d84a0c2409ed0d95b, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:10.634674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e320e-ea0c-45e5-9276-504964b3b5f2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:10.654259 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2472/4934] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:10 2022] PUT /identity/v3/projects/631a4d16f7ba46de9b55755ea405cf81/users/c82f919b7409432d84a0c2409ed0d95b/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:10.665714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7b0a7-b81f-4ac4-a6b9-a1254027cc66 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:10.666005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7b0a7-b81f-4ac4-a6b9-a1254027cc66 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:10.666498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7b0a7-b81f-4ac4-a6b9-a1254027cc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:10.703418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-baa7b0a7-b81f-4ac4-a6b9-a1254027cc66 None None] MFA Rules not processed for user `c82f919b7409432d84a0c2409ed0d95b`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:10.705278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-baa7b0a7-b81f-4ac4-a6b9-a1254027cc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:10.735876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23428a-78f2-441a-834f-017ade03eb84 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:10.736310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23428a-78f2-441a-834f-017ade03eb84 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:10.736691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23428a-78f2-441a-834f-017ade03eb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:10.764190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5e23428a-78f2-441a-834f-017ade03eb84 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:10.765904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5e23428a-78f2-441a-834f-017ade03eb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:10.807460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:10.815229 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2463/4935] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:10 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:10.837814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7b0a7-b81f-4ac4-a6b9-a1254027cc66 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:10.839778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-baa7b0a7-b81f-4ac4-a6b9-a1254027cc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:10.876993 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2473/4936] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:19:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:10.893991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23428a-78f2-441a-834f-017ade03eb84 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:10.896544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5e23428a-78f2-441a-834f-017ade03eb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:11.017732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7b0a7-b81f-4ac4-a6b9-a1254027cc66 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:11.038279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210aa60-ba18-4cf8-9c28-74d7f0b6eb26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:11.039178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210aa60-ba18-4cf8-9c28-74d7f0b6eb26 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:11.039785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210aa60-ba18-4cf8-9c28-74d7f0b6eb26 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:11.049624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210aa60-ba18-4cf8-9c28-74d7f0b6eb26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:11.075254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210aa60-ba18-4cf8-9c28-74d7f0b6eb26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:11.077758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23428a-78f2-441a-834f-017ade03eb84 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:11.078909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210aa60-ba18-4cf8-9c28-74d7f0b6eb26 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:11.099129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc161d-738e-448b-ae3c-c0022c2eb047 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:11.101701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc161d-738e-448b-ae3c-c0022c2eb047 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:11.102254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc161d-738e-448b-ae3c-c0022c2eb047 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:11.103594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc161d-738e-448b-ae3c-c0022c2eb047 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:11.110362 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2464/4937] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:19:10 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:19:11.129279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc161d-738e-448b-ae3c-c0022c2eb047 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:11.133049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc161d-738e-448b-ae3c-c0022c2eb047 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:11.162675 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2474/4938] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:19:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 30 21:19:11.200027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210aa60-ba18-4cf8-9c28-74d7f0b6eb26 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:11.325179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc161d-738e-448b-ae3c-c0022c2eb047 service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:11.326788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-28bc161d-738e-448b-ae3c-c0022c2eb047 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:11.368908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:11.419140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210aa60-ba18-4cf8-9c28-74d7f0b6eb26 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:11.429936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b838b-0fac-4873-a099-ce0de5f5990f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:11.430498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b838b-0fac-4873-a099-ce0de5f5990f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:11.430782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b838b-0fac-4873-a099-ce0de5f5990f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:11.431122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b838b-0fac-4873-a099-ce0de5f5990f admin admin] PATH_INFO: `/v3/users/c82f919b7409432d84a0c2409ed0d95b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:11.436217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b838b-0fac-4873-a099-ce0de5f5990f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c82f919b7409432d84a0c2409ed0d95b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:11.438271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b838b-0fac-4873-a099-ce0de5f5990f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:11.555103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc161d-738e-448b-ae3c-c0022c2eb047 service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:11.570119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e97e1d-bd02-4552-92de-9af713d6fa18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:11.570808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e97e1d-bd02-4552-92de-9af713d6fa18 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:11.571099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e97e1d-bd02-4552-92de-9af713d6fa18 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:11.571382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e97e1d-bd02-4552-92de-9af713d6fa18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:11.574903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-04e97e1d-bd02-4552-92de-9af713d6fa18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:11.605596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e97e1d-bd02-4552-92de-9af713d6fa18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:11.607410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e97e1d-bd02-4552-92de-9af713d6fa18 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:11.615099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e94b838b-0fac-4873-a099-ce0de5f5990f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c82f919b7409432d84a0c2409ed0d95b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:11.615843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e94b838b-0fac-4873-a099-ce0de5f5990f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c82f919b7409432d84a0c2409ed0d95b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:11.633903 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2475/4939] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:19:11.640751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e94b838b-0fac-4873-a099-ce0de5f5990f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c82f919b7409432d84a0c2409ed0d95b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:11.641836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e94b838b-0fac-4873-a099-ce0de5f5990f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c82f919b7409432d84a0c2409ed0d95b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:11.658211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e94b838b-0fac-4873-a099-ce0de5f5990f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c82f919b7409432d84a0c2409ed0d95b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:11.684311 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2465/4940] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:11 2022] DELETE /identity/v3/users/c82f919b7409432d84a0c2409ed0d95b => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:11.689410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c2098-ca2f-4d97-abd5-57e722d3121c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:11.690249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c2098-ca2f-4d97-abd5-57e722d3121c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:11.691595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c2098-ca2f-4d97-abd5-57e722d3121c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:11.727993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7a8c2098-ca2f-4d97-abd5-57e722d3121c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:11.729735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7a8c2098-ca2f-4d97-abd5-57e722d3121c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:11.851199 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2476/4941] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:19:11.863255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b838b-0fac-4873-a099-ce0de5f5990f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:11.865304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e94b838b-0fac-4873-a099-ce0de5f5990f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:11.978919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b838b-0fac-4873-a099-ce0de5f5990f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:12.000959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ce905-45f9-40a9-bd66-88ee5d1236d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:12.001631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ce905-45f9-40a9-bd66-88ee5d1236d4 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:12.002672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ce905-45f9-40a9-bd66-88ee5d1236d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:12.002672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ce905-45f9-40a9-bd66-88ee5d1236d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:12.026659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ce905-45f9-40a9-bd66-88ee5d1236d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:12.029393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ce905-45f9-40a9-bd66-88ee5d1236d4 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:12.045602 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2466/4942] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:19:12.518197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c2098-ca2f-4d97-abd5-57e722d3121c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:12.522251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7a8c2098-ca2f-4d97-abd5-57e722d3121c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:12.536991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:12.542235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c2098-ca2f-4d97-abd5-57e722d3121c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:12.549824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877c14e-1bd1-4604-a775-338a87b2a4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:12.550585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877c14e-1bd1-4604-a775-338a87b2a4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:12.550950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877c14e-1bd1-4604-a775-338a87b2a4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:12.551350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877c14e-1bd1-4604-a775-338a87b2a4fd admin admin] PATH_INFO: `/v3/projects/631a4d16f7ba46de9b55755ea405cf81` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:12.553365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877c14e-1bd1-4604-a775-338a87b2a4fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=631a4d16f7ba46de9b55755ea405cf81)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:12.557404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877c14e-1bd1-4604-a775-338a87b2a4fd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:12.641662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8877c14e-1bd1-4604-a775-338a87b2a4fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '631a4d16f7ba46de9b55755ea405cf81', 'request_id': 'req-8877c14e-1bd1-4604-a775-338a87b2a4fd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:12.649589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8877c14e-1bd1-4604-a775-338a87b2a4fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '631a4d16f7ba46de9b55755ea405cf81', 'request_id': 'req-8877c14e-1bd1-4604-a775-338a87b2a4fd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:12.662167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8877c14e-1bd1-4604-a775-338a87b2a4fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '631a4d16f7ba46de9b55755ea405cf81', 'request_id': 'req-8877c14e-1bd1-4604-a775-338a87b2a4fd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:12.688735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8877c14e-1bd1-4604-a775-338a87b2a4fd admin admin] The token cache is being invalidate because project 631a4d16f7ba46de9b55755ea405cf81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:12.689526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8877c14e-1bd1-4604-a775-338a87b2a4fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:12.693063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8877c14e-1bd1-4604-a775-338a87b2a4fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:12.695135 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2477/4943] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:12 2022] DELETE /identity/v3/projects/631a4d16f7ba46de9b55755ea405cf81 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:12.703163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cde29-a6c9-4b9d-9a17-d7b1a9d99927 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:12.703619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cde29-a6c9-4b9d-9a17-d7b1a9d99927 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:12.704810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cde29-a6c9-4b9d-9a17-d7b1a9d99927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:12.737208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-024cde29-a6c9-4b9d-9a17-d7b1a9d99927 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:12.738895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-024cde29-a6c9-4b9d-9a17-d7b1a9d99927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:12.845408 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2467/4944] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:12.856843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c023e-13e1-4d4e-bce9-4ab094b8cc87 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:12.857144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c023e-13e1-4d4e-bce9-4ab094b8cc87 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:12.857528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c023e-13e1-4d4e-bce9-4ab094b8cc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:12.893623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-dd4c023e-13e1-4d4e-bce9-4ab094b8cc87 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:12.897811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-dd4c023e-13e1-4d4e-bce9-4ab094b8cc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:12.915784 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2478/4945] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:12.917723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cde29-a6c9-4b9d-9a17-d7b1a9d99927 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:12.929963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cde29-a6c9-4b9d-9a17-d7b1a9d99927 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:12.936837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f2163-e8d1-4050-8229-cdabc3a996f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:12.937640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f2163-e8d1-4050-8229-cdabc3a996f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:12.938288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f2163-e8d1-4050-8229-cdabc3a996f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:12.938756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f2163-e8d1-4050-8229-cdabc3a996f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:12.941988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f2163-e8d1-4050-8229-cdabc3a996f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:19:12.941988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f2163-e8d1-4050-8229-cdabc3a996f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:12.942741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f2163-e8d1-4050-8229-cdabc3a996f8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:12.959501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c023e-13e1-4d4e-bce9-4ab094b8cc87 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:12.962114 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2468/4946] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:12.962391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-dd4c023e-13e1-4d4e-bce9-4ab094b8cc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:12.968404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f2163-e8d1-4050-8229-cdabc3a996f8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:12.977038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:12.987886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f2163-e8d1-4050-8229-cdabc3a996f8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:13.013172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c023e-13e1-4d4e-bce9-4ab094b8cc87 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:13.019216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae980c3-60bf-49bd-bd66-b9c35e81b79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:13.020832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae980c3-60bf-49bd-bd66-b9c35e81b79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:13.021346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae980c3-60bf-49bd-bd66-b9c35e81b79c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:13.021779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae980c3-60bf-49bd-bd66-b9c35e81b79c admin admin] PATH_INFO: `/v3/users/ef96cb7f40424d7fa1ddfd463efb746a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:13.022080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1274dce-262e-4cdb-bfdc-82a5c2e30844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:13.022783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1274dce-262e-4cdb-bfdc-82a5c2e30844 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:13.023142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1274dce-262e-4cdb-bfdc-82a5c2e30844 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:13.023507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1274dce-262e-4cdb-bfdc-82a5c2e30844 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:13.024250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1274dce-262e-4cdb-bfdc-82a5c2e30844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:13.024602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae980c3-60bf-49bd-bd66-b9c35e81b79c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef96cb7f40424d7fa1ddfd463efb746a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:13.026442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1274dce-262e-4cdb-bfdc-82a5c2e30844 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:13.027097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae980c3-60bf-49bd-bd66-b9c35e81b79c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:13.070725 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2469/4947] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:12 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:13.075543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1274dce-262e-4cdb-bfdc-82a5c2e30844 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:13.102653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7ae980c3-60bf-49bd-bd66-b9c35e81b79c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef96cb7f40424d7fa1ddfd463efb746a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:13.118395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7ae980c3-60bf-49bd-bd66-b9c35e81b79c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef96cb7f40424d7fa1ddfd463efb746a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:13.119185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7ae980c3-60bf-49bd-bd66-b9c35e81b79c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef96cb7f40424d7fa1ddfd463efb746a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:13.129432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7ae980c3-60bf-49bd-bd66-b9c35e81b79c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef96cb7f40424d7fa1ddfd463efb746a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:13.130744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7ae980c3-60bf-49bd-bd66-b9c35e81b79c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef96cb7f40424d7fa1ddfd463efb746a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:13.152305 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2479/4948] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:12 2022] DELETE /identity/v3/users/ef96cb7f40424d7fa1ddfd463efb746a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:13.153706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d2a43-29d4-46a6-962c-edf063aca1bc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:13.154004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d2a43-29d4-46a6-962c-edf063aca1bc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:13.154285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d2a43-29d4-46a6-962c-edf063aca1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:13.167837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1274dce-262e-4cdb-bfdc-82a5c2e30844 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:13.175679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-513d2a43-29d4-46a6-962c-edf063aca1bc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:13.177031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-513d2a43-29d4-46a6-962c-edf063aca1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:13.249520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:13.257242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb6f28-7a20-4679-88db-27cd0f738d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:13.258471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb6f28-7a20-4679-88db-27cd0f738d96 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:13.258759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb6f28-7a20-4679-88db-27cd0f738d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:13.259030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb6f28-7a20-4679-88db-27cd0f738d96 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:13.259735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb6f28-7a20-4679-88db-27cd0f738d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:13.261689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb6f28-7a20-4679-88db-27cd0f738d96 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:13.278597 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2480/4949] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:13.288851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d2a43-29d4-46a6-962c-edf063aca1bc None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:13.291708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-513d2a43-29d4-46a6-962c-edf063aca1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:13.300274 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2470/4950] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:13 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:19:13.304727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb6f28-7a20-4679-88db-27cd0f738d96 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:13.307495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f2eb6f28-7a20-4679-88db-27cd0f738d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:13.324190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb6f28-7a20-4679-88db-27cd0f738d96 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:13.332540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e50db-e459-477f-b6d4-6ff0a24ae0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:13.334600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e50db-e459-477f-b6d4-6ff0a24ae0ed admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:13.335068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e50db-e459-477f-b6d4-6ff0a24ae0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:13.335597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e50db-e459-477f-b6d4-6ff0a24ae0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:13.336480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e50db-e459-477f-b6d4-6ff0a24ae0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:13.338496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e50db-e459-477f-b6d4-6ff0a24ae0ed admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:13.354953 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2471/4951] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:13.360830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e50db-e459-477f-b6d4-6ff0a24ae0ed admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:13.378346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e50db-e459-477f-b6d4-6ff0a24ae0ed admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:13.384902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e43c5a-4c4c-49f3-a722-9c3f27494f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:13.385577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e43c5a-4c4c-49f3-a722-9c3f27494f63 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:13.385866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e43c5a-4c4c-49f3-a722-9c3f27494f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:13.386148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e43c5a-4c4c-49f3-a722-9c3f27494f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:13.386910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e43c5a-4c4c-49f3-a722-9c3f27494f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:13.388665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e43c5a-4c4c-49f3-a722-9c3f27494f63 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:13.407100 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2472/4952] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:13.408161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e43c5a-4c4c-49f3-a722-9c3f27494f63 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:13.419250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d2a43-29d4-46a6-962c-edf063aca1bc None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:13.423338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ca4d3-ec90-449f-a6fd-e44b3f3c83d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:13.424188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ca4d3-ec90-449f-a6fd-e44b3f3c83d8 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:13.424581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ca4d3-ec90-449f-a6fd-e44b3f3c83d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:13.424863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ca4d3-ec90-449f-a6fd-e44b3f3c83d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:13.428460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e43c5a-4c4c-49f3-a722-9c3f27494f63 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:13.434683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fce7e1-fdc6-47c5-9d4a-5d8a68f7bb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:13.436045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fce7e1-fdc6-47c5-9d4a-5d8a68f7bb68 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:13.436363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fce7e1-fdc6-47c5-9d4a-5d8a68f7bb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:13.436634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fce7e1-fdc6-47c5-9d4a-5d8a68f7bb68 admin admin] PATH_INFO: `/v3/projects/22f3ed9dac874222887caf7309fbd0c2/users/a4222752638644ebb6b829e67434030a/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:13.439796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ca4d3-ec90-449f-a6fd-e44b3f3c83d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:13.441484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ca4d3-ec90-449f-a6fd-e44b3f3c83d8 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:13.459600 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2481/4953] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:19:13.471628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fce7e1-fdc6-47c5-9d4a-5d8a68f7bb68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f3ed9dac874222887caf7309fbd0c2, user_id=a4222752638644ebb6b829e67434030a, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:13.476576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fce7e1-fdc6-47c5-9d4a-5d8a68f7bb68 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:13.499417 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2473/4954] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:13 2022] PUT /identity/v3/projects/22f3ed9dac874222887caf7309fbd0c2/users/a4222752638644ebb6b829e67434030a/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:13.510027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee47e47-1337-42a9-a9d8-77bb8bcb8803 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:13.511060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee47e47-1337-42a9-a9d8-77bb8bcb8803 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:13.511692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee47e47-1337-42a9-a9d8-77bb8bcb8803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:13.549112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5ee47e47-1337-42a9-a9d8-77bb8bcb8803 None None] MFA Rules not processed for user `a4222752638644ebb6b829e67434030a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:13.550453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5ee47e47-1337-42a9-a9d8-77bb8bcb8803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:13.667337 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2482/4955] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:13.676228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fce7e1-fdc6-47c5-9d4a-5d8a68f7bb68 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:13.728751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee47e47-1337-42a9-a9d8-77bb8bcb8803 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:13.732496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5ee47e47-1337-42a9-a9d8-77bb8bcb8803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:13.759113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:13.826938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fce7e1-fdc6-47c5-9d4a-5d8a68f7bb68 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:13.835129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac692f0-991c-4f75-ab32-d6fb6de9853a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:13.835842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac692f0-991c-4f75-ab32-d6fb6de9853a admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:13.837378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac692f0-991c-4f75-ab32-d6fb6de9853a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:13.837816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac692f0-991c-4f75-ab32-d6fb6de9853a admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:13.840248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac692f0-991c-4f75-ab32-d6fb6de9853a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:13.843067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac692f0-991c-4f75-ab32-d6fb6de9853a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:13.916253 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2474/4956] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:13 2022] POST /identity/v3/projects => generated 371 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:13.921230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac692f0-991c-4f75-ab32-d6fb6de9853a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:13.954851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee47e47-1337-42a9-a9d8-77bb8bcb8803 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:14.029701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:14.076216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac692f0-991c-4f75-ab32-d6fb6de9853a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:14.076930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58c11f-fc32-4912-8e77-88217e0630ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:14.077434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58c11f-fc32-4912-8e77-88217e0630ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:14.078412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58c11f-fc32-4912-8e77-88217e0630ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:14.078789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58c11f-fc32-4912-8e77-88217e0630ec admin admin] PATH_INFO: `/v3/projects/bb3d5d56c12b44588c7bc4a5dcaae622` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:14.085156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58c11f-fc32-4912-8e77-88217e0630ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb3d5d56c12b44588c7bc4a5dcaae622)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:14.085314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd53af-8aea-4f9b-9f9c-c3f2e1e14205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:14.085314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd53af-8aea-4f9b-9f9c-c3f2e1e14205 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:14.085314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd53af-8aea-4f9b-9f9c-c3f2e1e14205 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:14.085546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58c11f-fc32-4912-8e77-88217e0630ec admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:14.085621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd53af-8aea-4f9b-9f9c-c3f2e1e14205 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:14.088127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd53af-8aea-4f9b-9f9c-c3f2e1e14205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:14.090744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd53af-8aea-4f9b-9f9c-c3f2e1e14205 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:14.131318 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2475/4957] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:13 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:14.137573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd53af-8aea-4f9b-9f9c-c3f2e1e14205 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:14.155470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd53af-8aea-4f9b-9f9c-c3f2e1e14205 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:14.167896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dc77b-cff2-4225-860c-8a546f2ba14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:14.168656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dc77b-cff2-4225-860c-8a546f2ba14a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:14.168911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dc77b-cff2-4225-860c-8a546f2ba14a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:14.169249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dc77b-cff2-4225-860c-8a546f2ba14a admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:14.170035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581dc77b-cff2-4225-860c-8a546f2ba14a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:14.171902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581dc77b-cff2-4225-860c-8a546f2ba14a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:14.178789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd58c11f-fc32-4912-8e77-88217e0630ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb3d5d56c12b44588c7bc4a5dcaae622', 'request_id': 'req-dd58c11f-fc32-4912-8e77-88217e0630ec'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:14.191450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd58c11f-fc32-4912-8e77-88217e0630ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb3d5d56c12b44588c7bc4a5dcaae622', 'request_id': 'req-dd58c11f-fc32-4912-8e77-88217e0630ec'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:14.192304 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2476/4958] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:14.196957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dc77b-cff2-4225-860c-8a546f2ba14a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:14.210242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd58c11f-fc32-4912-8e77-88217e0630ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb3d5d56c12b44588c7bc4a5dcaae622', 'request_id': 'req-dd58c11f-fc32-4912-8e77-88217e0630ec'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:14.211240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dc77b-cff2-4225-860c-8a546f2ba14a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:14.235394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd58c11f-fc32-4912-8e77-88217e0630ec admin admin] The token cache is being invalidate because project bb3d5d56c12b44588c7bc4a5dcaae622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:14.235703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd58c11f-fc32-4912-8e77-88217e0630ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:14.236348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd58c11f-fc32-4912-8e77-88217e0630ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:14.241273 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2483/4959] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:13 2022] DELETE /identity/v3/projects/bb3d5d56c12b44588c7bc4a5dcaae622 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:14.247475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec5e55-5102-4f97-9731-411bd8f85414 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:14.247776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec5e55-5102-4f97-9731-411bd8f85414 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:14.248659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec5e55-5102-4f97-9731-411bd8f85414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:14.277448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-48ec5e55-5102-4f97-9731-411bd8f85414 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:14.278689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-48ec5e55-5102-4f97-9731-411bd8f85414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:14.306858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca28ed-7133-4456-a49d-4be417925361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:14.307773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca28ed-7133-4456-a49d-4be417925361 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:14.308283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca28ed-7133-4456-a49d-4be417925361 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:14.308738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca28ed-7133-4456-a49d-4be417925361 admin admin] PATH_INFO: `/v3/projects/d6c00874ed1a47fcbbc6e919405c3b97/users/a59ff84f6a74446e95dfaf632ba67a2f/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:14.329324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca28ed-7133-4456-a49d-4be417925361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c00874ed1a47fcbbc6e919405c3b97, user_id=a59ff84f6a74446e95dfaf632ba67a2f, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:14.332656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca28ed-7133-4456-a49d-4be417925361 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:14.354715 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2477/4960] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:14 2022] PUT /identity/v3/projects/d6c00874ed1a47fcbbc6e919405c3b97/users/a59ff84f6a74446e95dfaf632ba67a2f/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:19:14.358866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca28ed-7133-4456-a49d-4be417925361 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:14.361767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a3ca28ed-7133-4456-a49d-4be417925361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:14.412146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:14.421432 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2484/4961] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:14.423814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75a63d-910d-43e3-a49f-2cd6f5d2823d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:14.424202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75a63d-910d-43e3-a49f-2cd6f5d2823d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:14.424727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75a63d-910d-43e3-a49f-2cd6f5d2823d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:14.474420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4e75a63d-910d-43e3-a49f-2cd6f5d2823d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:14.476308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4e75a63d-910d-43e3-a49f-2cd6f5d2823d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:14.485500 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2485/4962] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:14.487777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca28ed-7133-4456-a49d-4be417925361 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:14.490355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75a63d-910d-43e3-a49f-2cd6f5d2823d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:14.494933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374cf0f-ae3b-4448-aa59-5be96d7724ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:14.495975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374cf0f-ae3b-4448-aa59-5be96d7724ea admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:14.496266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374cf0f-ae3b-4448-aa59-5be96d7724ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:14.496554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374cf0f-ae3b-4448-aa59-5be96d7724ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:14.498388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374cf0f-ae3b-4448-aa59-5be96d7724ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:14.501176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374cf0f-ae3b-4448-aa59-5be96d7724ea admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:14.503671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75a63d-910d-43e3-a49f-2cd6f5d2823d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:14.510527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58c166-306c-4539-a0f5-a06e64df5827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:14.516379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58c166-306c-4539-a0f5-a06e64df5827 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:14.516379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58c166-306c-4539-a0f5-a06e64df5827 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:14.516379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58c166-306c-4539-a0f5-a06e64df5827 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:14.516379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58c166-306c-4539-a0f5-a06e64df5827 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:19:14.516379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58c166-306c-4539-a0f5-a06e64df5827 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:14.516379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58c166-306c-4539-a0f5-a06e64df5827 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:14.522203 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2478/4963] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:14.523339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374cf0f-ae3b-4448-aa59-5be96d7724ea admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:14.537526 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2486/4964] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:14.541594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58c166-306c-4539-a0f5-a06e64df5827 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:14.544270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374cf0f-ae3b-4448-aa59-5be96d7724ea admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:14.549965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6cbfe-b8a0-4871-9750-b3b26e0612c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:14.552135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6cbfe-b8a0-4871-9750-b3b26e0612c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:14.552425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6cbfe-b8a0-4871-9750-b3b26e0612c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:14.552707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6cbfe-b8a0-4871-9750-b3b26e0612c6 admin admin] PATH_INFO: `/v3/projects/d6c00874ed1a47fcbbc6e919405c3b97/users/a59ff84f6a74446e95dfaf632ba67a2f/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:14.554833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6cbfe-b8a0-4871-9750-b3b26e0612c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c00874ed1a47fcbbc6e919405c3b97, user_id=a59ff84f6a74446e95dfaf632ba67a2f, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:14.558436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6cbfe-b8a0-4871-9750-b3b26e0612c6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:14.558582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58c166-306c-4539-a0f5-a06e64df5827 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:14.567574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4310ae8-ddbe-40b2-9c26-5433f626e3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:14.568987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4310ae8-ddbe-40b2-9c26-5433f626e3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:14.569653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4310ae8-ddbe-40b2-9c26-5433f626e3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:14.570053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4310ae8-ddbe-40b2-9c26-5433f626e3b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:14.570830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4310ae8-ddbe-40b2-9c26-5433f626e3b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:14.572671 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2479/4965] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:14 2022] PUT /identity/v3/projects/d6c00874ed1a47fcbbc6e919405c3b97/users/a59ff84f6a74446e95dfaf632ba67a2f/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:14.575603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4310ae8-ddbe-40b2-9c26-5433f626e3b2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:14.586301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279b636-a48a-44a5-843b-697ce4994906 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:14.588982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279b636-a48a-44a5-843b-697ce4994906 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:14.589268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279b636-a48a-44a5-843b-697ce4994906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:14.623618 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2487/4966] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:14 2022] POST /identity/v3/projects => generated 393 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:19:14.625568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4310ae8-ddbe-40b2-9c26-5433f626e3b2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:14.644288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7279b636-a48a-44a5-843b-697ce4994906 None None] MFA Rules not processed for user `a59ff84f6a74446e95dfaf632ba67a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:14.646850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7279b636-a48a-44a5-843b-697ce4994906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:14.664784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:14.718370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4310ae8-ddbe-40b2-9c26-5433f626e3b2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:14.724118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e104299-1003-4200-b170-f520579f53b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:14.725766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e104299-1003-4200-b170-f520579f53b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:14.726086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e104299-1003-4200-b170-f520579f53b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:14.726458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e104299-1003-4200-b170-f520579f53b1 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:14.727098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e104299-1003-4200-b170-f520579f53b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:14.729606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e104299-1003-4200-b170-f520579f53b1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:14.768318 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2488/4967] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:14 2022] POST /identity/v3/users => generated 297 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:14.769474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e104299-1003-4200-b170-f520579f53b1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:14.779532 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2480/4968] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:14 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:14.783104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279b636-a48a-44a5-843b-697ce4994906 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:14.798978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e104299-1003-4200-b170-f520579f53b1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:14.800197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279b636-a48a-44a5-843b-697ce4994906 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:14.808431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a3a3e-5dab-40e9-aba8-e98dea5cffd6 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:14.809424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a3a3e-5dab-40e9-aba8-e98dea5cffd6 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:14.809716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a3a3e-5dab-40e9-aba8-e98dea5cffd6 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:14.810181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a3a3e-5dab-40e9-aba8-e98dea5cffd6 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:14.811112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a3a3e-5dab-40e9-aba8-e98dea5cffd6 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:14.812398 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-189a3a3e-5dab-40e9-aba8-e98dea5cffd6 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:14.812398 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:19:14.812398 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:19:14.812648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0c3a7-3667-4cc4-bec4-2044f7e11c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:14.813403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a3a3e-5dab-40e9-aba8-e98dea5cffd6 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:14.813745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0c3a7-3667-4cc4-bec4-2044f7e11c71 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:14.813906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0c3a7-3667-4cc4-bec4-2044f7e11c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:14.814189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0c3a7-3667-4cc4-bec4-2044f7e11c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:14.821505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0c3a7-3667-4cc4-bec4-2044f7e11c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:14.838357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0c3a7-3667-4cc4-bec4-2044f7e11c71 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:14.855079 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2481/4969] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:14 2022] POST /identity/v3/services => generated 289 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:14.858206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a3a3e-5dab-40e9-aba8-e98dea5cffd6 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:14.872288 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2489/4970] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:14.874042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0c3a7-3667-4cc4-bec4-2044f7e11c71 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:14.888563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0c3a7-3667-4cc4-bec4-2044f7e11c71 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:14.920379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4581c-712e-4d51-b708-c61f92b2f1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:14.921463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4581c-712e-4d51-b708-c61f92b2f1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:14.922223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4581c-712e-4d51-b708-c61f92b2f1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:14.923033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4581c-712e-4d51-b708-c61f92b2f1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:14.924005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4581c-712e-4d51-b708-c61f92b2f1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:14.935211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a3a3e-5dab-40e9-aba8-e98dea5cffd6 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:14.941655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4581c-712e-4d51-b708-c61f92b2f1a9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:14.945106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a1682-a9e1-437d-a4ec-a4630c415f97 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:14.945715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a1682-a9e1-437d-a4ec-a4630c415f97 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:14.946005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a1682-a9e1-437d-a4ec-a4630c415f97 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:14.946307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a1682-a9e1-437d-a4ec-a4630c415f97 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:14.947107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a1682-a9e1-437d-a4ec-a4630c415f97 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:14.954487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a1682-a9e1-437d-a4ec-a4630c415f97 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:14.981358 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2490/4971] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:14.984464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4581c-712e-4d51-b708-c61f92b2f1a9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:14.995835 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-390a1682-a9e1-437d-a4ec-a4630c415f97 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-28877852. To ensure interoperability, identifiers should be a valid uuid. Jul 30 21:19:14.995835 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 30 21:19:14.995835 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:19:15.018712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4581c-712e-4d51-b708-c61f92b2f1a9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:15.044454 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2482/4972] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Jul 30 21:19:14 2022] POST /identity/v3/endpoints => generated 357 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:15.047273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a1682-a9e1-437d-a4ec-a4630c415f97 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:15.065270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310f96d-f99c-4e37-9ae8-8f18c21a9591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:15.068427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310f96d-f99c-4e37-9ae8-8f18c21a9591 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:15.070644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310f96d-f99c-4e37-9ae8-8f18c21a9591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:15.071105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310f96d-f99c-4e37-9ae8-8f18c21a9591 admin admin] PATH_INFO: `/v3/projects/7ae391c8485c4c4798315492f26b1e5d/users/d94469966ff249bf8e774836f65e4658/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:15.091631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a1682-a9e1-437d-a4ec-a4630c415f97 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:15.099118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075e9de-b48c-4cd5-9aa9-6757e621b4a2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:15.100708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075e9de-b48c-4cd5-9aa9-6757e621b4a2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:15.101041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075e9de-b48c-4cd5-9aa9-6757e621b4a2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:15.101328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075e9de-b48c-4cd5-9aa9-6757e621b4a2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/regions/tempest-region-28877852` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:15.102028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075e9de-b48c-4cd5-9aa9-6757e621b4a2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-28877852)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:15.103633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075e9de-b48c-4cd5-9aa9-6757e621b4a2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:15.112576 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2483/4973] 10.222.0.17 () {58 vars in 1200 bytes} [Sat Jul 30 21:19:15 2022] GET /identity/v3/regions/tempest-region-28877852 => generated 176 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:15.112945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310f96d-f99c-4e37-9ae8-8f18c21a9591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae391c8485c4c4798315492f26b1e5d, user_id=d94469966ff249bf8e774836f65e4658, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:15.115869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075e9de-b48c-4cd5-9aa9-6757e621b4a2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:15.119684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310f96d-f99c-4e37-9ae8-8f18c21a9591 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:15.152296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075e9de-b48c-4cd5-9aa9-6757e621b4a2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:15.215175 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2491/4974] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:14 2022] PUT /identity/v3/projects/7ae391c8485c4c4798315492f26b1e5d/users/d94469966ff249bf8e774836f65e4658/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:15.215452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9f7ba-7354-427d-a617-76083191931a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:15.215452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9f7ba-7354-427d-a617-76083191931a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:15.215452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9f7ba-7354-427d-a617-76083191931a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:15.215681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9f7ba-7354-427d-a617-76083191931a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:15.215681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9f7ba-7354-427d-a617-76083191931a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:15.216940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc73bf-c24f-4c06-92e7-af30551cba57 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:15.217223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc73bf-c24f-4c06-92e7-af30551cba57 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:15.217506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc73bf-c24f-4c06-92e7-af30551cba57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:15.219774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9f7ba-7354-427d-a617-76083191931a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:15.259500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:15.266566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d8fc73bf-c24f-4c06-92e7-af30551cba57 None None] MFA Rules not processed for user `d94469966ff249bf8e774836f65e4658`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:15.269231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d8fc73bf-c24f-4c06-92e7-af30551cba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:15.282752 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2484/4975] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:15 2022] POST /identity/v3/services => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:15.284213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9f7ba-7354-427d-a617-76083191931a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:15.359715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9f7ba-7354-427d-a617-76083191931a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:15.434694 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2492/4976] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:15 2022] POST /identity/v3/auth/tokens => generated 3705 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:15.468820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc73bf-c24f-4c06-92e7-af30551cba57 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:15.484188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d8fc73bf-c24f-4c06-92e7-af30551cba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:15.501721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369298d8-08a3-4393-81f2-542fdf993759 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:15.502575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369298d8-08a3-4393-81f2-542fdf993759 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:15.502869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369298d8-08a3-4393-81f2-542fdf993759 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:15.503500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369298d8-08a3-4393-81f2-542fdf993759 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:15.504587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369298d8-08a3-4393-81f2-542fdf993759 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:15.507334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369298d8-08a3-4393-81f2-542fdf993759 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:15.548272 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-369298d8-08a3-4393-81f2-542fdf993759 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-461590316. To ensure interoperability, identifiers should be a valid uuid. Jul 30 21:19:15.548272 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 30 21:19:15.548272 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:19:15.561411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:15.609274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc73bf-c24f-4c06-92e7-af30551cba57 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:15.610495 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2485/4977] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Jul 30 21:19:15 2022] POST /identity/v3/endpoints => generated 361 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:15.620114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369298d8-08a3-4393-81f2-542fdf993759 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:15.635154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb4ff7-bef5-4558-89fe-19b0ad2bd023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:15.636187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb4ff7-bef5-4558-89fe-19b0ad2bd023 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:15.636316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb4ff7-bef5-4558-89fe-19b0ad2bd023 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:15.636716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb4ff7-bef5-4558-89fe-19b0ad2bd023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:15.647896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb4ff7-bef5-4558-89fe-19b0ad2bd023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:15.649330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb4ff7-bef5-4558-89fe-19b0ad2bd023 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:15.675041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369298d8-08a3-4393-81f2-542fdf993759 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:15.685834 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2493/4978] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:19:15 2022] GET /identity/v3/auth/tokens => generated 3888 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:19:15.686901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8ebb5-d036-485d-a8cf-a5451c7bdd77 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:15.688263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8ebb5-d036-485d-a8cf-a5451c7bdd77 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:15.688263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8ebb5-d036-485d-a8cf-a5451c7bdd77 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:15.688263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8ebb5-d036-485d-a8cf-a5451c7bdd77 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/regions/tempest-region-461590316` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:15.688959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8ebb5-d036-485d-a8cf-a5451c7bdd77 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-461590316)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:15.690319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8ebb5-d036-485d-a8cf-a5451c7bdd77 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:15.694218 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2486/4979] 10.222.0.17 () {58 vars in 1203 bytes} [Sat Jul 30 21:19:15 2022] GET /identity/v3/regions/tempest-region-461590316 => generated 178 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:15.699692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb4ff7-bef5-4558-89fe-19b0ad2bd023 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:15.715958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb4ff7-bef5-4558-89fe-19b0ad2bd023 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:15.727398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0367961-3574-432f-a4f7-039877ee6332 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:15.729975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0367961-3574-432f-a4f7-039877ee6332 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:15.731414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0367961-3574-432f-a4f7-039877ee6332 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:15.732266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0367961-3574-432f-a4f7-039877ee6332 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:15.733436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0367961-3574-432f-a4f7-039877ee6332 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:15.735658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0367961-3574-432f-a4f7-039877ee6332 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:15.780243 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-f0367961-3574-432f-a4f7-039877ee6332 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1159589330. To ensure interoperability, identifiers should be a valid uuid. Jul 30 21:19:15.780243 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 30 21:19:15.780243 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:19:15.820396 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2494/4980] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Jul 30 21:19:15 2022] POST /identity/v3/endpoints => generated 360 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:15.826917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8ebb5-d036-485d-a8cf-a5451c7bdd77 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:15.851307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8ebb5-d036-485d-a8cf-a5451c7bdd77 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:15.898485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff47a3b-ae67-4d16-9845-f143acf2d0eb tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:15.900621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff47a3b-ae67-4d16-9845-f143acf2d0eb tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:15.901988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff47a3b-ae67-4d16-9845-f143acf2d0eb tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:15.903241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff47a3b-ae67-4d16-9845-f143acf2d0eb tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/regions/tempest-region-1159589330` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:15.904146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff47a3b-ae67-4d16-9845-f143acf2d0eb tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1159589330)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:15.906662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff47a3b-ae67-4d16-9845-f143acf2d0eb tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:15.916906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0367961-3574-432f-a4f7-039877ee6332 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:15.917602 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2487/4981] 10.222.0.17 () {58 vars in 1206 bytes} [Sat Jul 30 21:19:15 2022] GET /identity/v3/regions/tempest-region-1159589330 => generated 180 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:15.944868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0367961-3574-432f-a4f7-039877ee6332 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:15.965814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03449ba2-19a1-430e-8798-92adc6153018 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:15.968338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03449ba2-19a1-430e-8798-92adc6153018 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:15.969445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03449ba2-19a1-430e-8798-92adc6153018 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:15.971457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03449ba2-19a1-430e-8798-92adc6153018 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:15.973729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03449ba2-19a1-430e-8798-92adc6153018 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:15.975897 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-03449ba2-19a1-430e-8798-92adc6153018 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:15.975897 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:19:15.975897 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:19:15.977797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03449ba2-19a1-430e-8798-92adc6153018 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:16.002602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff47a3b-ae67-4d16-9845-f143acf2d0eb tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:16.015769 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2495/4982] 10.222.0.17 () {58 vars in 1134 bytes} [Sat Jul 30 21:19:15 2022] GET /identity/v3/endpoints => generated 4382 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:16.025981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff47a3b-ae67-4d16-9845-f143acf2d0eb tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:16.037379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd1616-753e-4de1-a34b-b5fcbe74dbe9 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:16.038453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd1616-753e-4de1-a34b-b5fcbe74dbe9 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:16.038953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd1616-753e-4de1-a34b-b5fcbe74dbe9 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:16.039515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd1616-753e-4de1-a34b-b5fcbe74dbe9 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/endpoints/596413d71d854939af37995052a674dd` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:16.050476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd1616-753e-4de1-a34b-b5fcbe74dbe9 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=596413d71d854939af37995052a674dd)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:16.052516 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-52dd1616-753e-4de1-a34b-b5fcbe74dbe9 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:16.052516 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:19:16.052516 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:19:16.055464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd1616-753e-4de1-a34b-b5fcbe74dbe9 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:16.067725 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2488/4983] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:15 2022] GET /identity/v3/endpoints/596413d71d854939af37995052a674dd => generated 360 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:16.072733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03449ba2-19a1-430e-8798-92adc6153018 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:16.110177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03449ba2-19a1-430e-8798-92adc6153018 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:16.143055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45411107-35e9-407d-b258-15d7d2087815 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:16.145167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45411107-35e9-407d-b258-15d7d2087815 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:16.145167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45411107-35e9-407d-b258-15d7d2087815 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:16.145167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45411107-35e9-407d-b258-15d7d2087815 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/endpoints/596413d71d854939af37995052a674dd` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:16.147085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45411107-35e9-407d-b258-15d7d2087815 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=596413d71d854939af37995052a674dd)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:16.148877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45411107-35e9-407d-b258-15d7d2087815 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:16.198308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-45411107-35e9-407d-b258-15d7d2087815 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '596413d71d854939af37995052a674dd', 'request_id': 'req-45411107-35e9-407d-b258-15d7d2087815'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:16.219127 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2496/4984] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:16 2022] DELETE /identity/v3/endpoints/596413d71d854939af37995052a674dd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:16.224649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd1616-753e-4de1-a34b-b5fcbe74dbe9 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:16.244433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd1616-753e-4de1-a34b-b5fcbe74dbe9 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:16.308504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf2f6d-184b-4d5f-b784-7c6518e88c7b tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:16.308881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf2f6d-184b-4d5f-b784-7c6518e88c7b tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:16.309177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf2f6d-184b-4d5f-b784-7c6518e88c7b tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:16.309458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf2f6d-184b-4d5f-b784-7c6518e88c7b tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:16.310373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf2f6d-184b-4d5f-b784-7c6518e88c7b tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:16.311716 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-efdf2f6d-184b-4d5f-b784-7c6518e88c7b tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:16.311716 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:19:16.311716 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:19:16.322320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf2f6d-184b-4d5f-b784-7c6518e88c7b tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:16.349799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45411107-35e9-407d-b258-15d7d2087815 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:16.370954 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2489/4985] 10.222.0.17 () {58 vars in 1134 bytes} [Sat Jul 30 21:19:16 2022] GET /identity/v3/endpoints => generated 4035 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:16.379881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45411107-35e9-407d-b258-15d7d2087815 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:16.391496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81319253-8d53-4434-b7f7-0d0d561c4d68 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:16.392540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81319253-8d53-4434-b7f7-0d0d561c4d68 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:16.393153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81319253-8d53-4434-b7f7-0d0d561c4d68 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:16.394003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81319253-8d53-4434-b7f7-0d0d561c4d68 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/endpoints/596413d71d854939af37995052a674dd` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:16.403470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81319253-8d53-4434-b7f7-0d0d561c4d68 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 21:19:16.437015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-81319253-8d53-4434-b7f7-0d0d561c4d68 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Could not find endpoint: 596413d71d854939af37995052a674dd.: keystone.exception.EndpointNotFound: Could not find endpoint: 596413d71d854939af37995052a674dd. Jul 30 21:19:16.437015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:19:16.437015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Jul 30 21:19:16.437015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Jul 30 21:19:16.437015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 30 21:19:16.437015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._iter().one() Jul 30 21:19:16.437015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 30 21:19:16.437015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._only_one_row( Jul 30 21:19:16.437015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 30 21:19:16.437015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 30 21:19:16.437015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 30 21:19:16.437015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:16.437015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:19:16.437015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:16.437015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:19:16.437015 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Jul 30 21:19:16.438254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Jul 30 21:19:16.438254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Jul 30 21:19:16.438254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Jul 30 21:19:16.438254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Jul 30 21:19:16.438254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jul 30 21:19:16.438254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 596413d71d854939af37995052a674dd. Jul 30 21:19:16.438254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:16.438254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:19:16.438254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:16.438254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:19:16.438254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:19:16.438254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:19:16.438254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:19:16.438254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:19:16.438254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:19:16.438254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:19:16.438254 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:19:16.439434 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:19:16.439434 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:19:16.439434 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:19:16.439434 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Jul 30 21:19:16.439434 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Jul 30 21:19:16.439434 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 21:19:16.439434 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 21:19:16.439434 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 21:19:16.439434 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 21:19:16.439434 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:19:16.439434 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:19:16.439434 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:19:16.439434 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:19:16.439434 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:19:16.439434 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:19:16.439434 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:19:16.441268 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 21:19:16.441268 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:19:16.441268 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:19:16.441268 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:19:16.441268 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:19:16.441268 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:19:16.441268 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:19:16.441268 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:19:16.441268 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:19:16.441268 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Jul 30 21:19:16.441268 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jul 30 21:19:16.441268 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 596413d71d854939af37995052a674dd. Jul 30 21:19:16.441268 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:16.441268 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2497/4986] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:16 2022] DELETE /identity/v3/endpoints/596413d71d854939af37995052a674dd => generated 114 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:19:16.445425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf2f6d-184b-4d5f-b784-7c6518e88c7b tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:16.487138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf2f6d-184b-4d5f-b784-7c6518e88c7b tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:16.521510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d32ec-52b7-46af-b965-026bace85037 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:16.522488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d32ec-52b7-46af-b965-026bace85037 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:16.522931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d32ec-52b7-46af-b965-026bace85037 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:16.523758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d32ec-52b7-46af-b965-026bace85037 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/regions/tempest-region-1159589330` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:16.524565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d32ec-52b7-46af-b965-026bace85037 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1159589330)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:16.526611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d32ec-52b7-46af-b965-026bace85037 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:16.555627 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-a82d32ec-52b7-46af-b965-026bace85037 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1159589330. To ensure interoperability, identifiers should be a valid uuid. Jul 30 21:19:16.555627 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 30 21:19:16.555627 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:19:16.596471 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2490/4987] 10.222.0.17 () {58 vars in 1209 bytes} [Sat Jul 30 21:19:16 2022] DELETE /identity/v3/regions/tempest-region-1159589330 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:16.603212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81319253-8d53-4434-b7f7-0d0d561c4d68 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:16.639925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81319253-8d53-4434-b7f7-0d0d561c4d68 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:16.687357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2c7a4-6b7f-4bc9-aa2f-026842088cd2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:16.688125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2c7a4-6b7f-4bc9-aa2f-026842088cd2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:16.688511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2c7a4-6b7f-4bc9-aa2f-026842088cd2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:16.689690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2c7a4-6b7f-4bc9-aa2f-026842088cd2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:16.696595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2c7a4-6b7f-4bc9-aa2f-026842088cd2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:16.696595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2c7a4-6b7f-4bc9-aa2f-026842088cd2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:16.720537 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2498/4988] 10.222.0.17 () {58 vars in 1134 bytes} [Sat Jul 30 21:19:16 2022] GET /identity/v3/endpoints => generated 4035 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:16.722420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d32ec-52b7-46af-b965-026bace85037 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:16.739389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d32ec-52b7-46af-b965-026bace85037 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:16.750070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd7aa0-e1dd-4323-9270-e872fde02b89 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:16.752882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd7aa0-e1dd-4323-9270-e872fde02b89 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:16.753595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd7aa0-e1dd-4323-9270-e872fde02b89 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:16.753756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd7aa0-e1dd-4323-9270-e872fde02b89 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:16.756250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd7aa0-e1dd-4323-9270-e872fde02b89 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Adding query filter params (service_id=f79edd13eb4e49c9ba1a27529cdab45c) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:19:16.756250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd7aa0-e1dd-4323-9270-e872fde02b89 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:16.759888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd7aa0-e1dd-4323-9270-e872fde02b89 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:16.775628 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2491/4989] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:19:16 2022] GET /identity/v3/endpoints?service_id=f79edd13eb4e49c9ba1a27529cdab45c => generated 499 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:16.776882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2c7a4-6b7f-4bc9-aa2f-026842088cd2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:16.797745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2c7a4-6b7f-4bc9-aa2f-026842088cd2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:16.807089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe9041-02e2-4229-8ed0-ad631096d3c8 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:16.807450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe9041-02e2-4229-8ed0-ad631096d3c8 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:16.807744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe9041-02e2-4229-8ed0-ad631096d3c8 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:16.808030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe9041-02e2-4229-8ed0-ad631096d3c8 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:16.808754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe9041-02e2-4229-8ed0-ad631096d3c8 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Adding query filter params (service_id=342bd71b10494101954bcbc732e5439e) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:19:16.809075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe9041-02e2-4229-8ed0-ad631096d3c8 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:16.810690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe9041-02e2-4229-8ed0-ad631096d3c8 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:16.818614 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2499/4990] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:19:16 2022] GET /identity/v3/endpoints?service_id=342bd71b10494101954bcbc732e5439e => generated 503 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:16.824171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd7aa0-e1dd-4323-9270-e872fde02b89 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:16.849853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd7aa0-e1dd-4323-9270-e872fde02b89 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:16.868598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09f140-b5e4-42c1-be30-96ecdd606e39 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:16.869435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09f140-b5e4-42c1-be30-96ecdd606e39 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:16.870607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09f140-b5e4-42c1-be30-96ecdd606e39 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:16.871188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09f140-b5e4-42c1-be30-96ecdd606e39 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:16.872095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09f140-b5e4-42c1-be30-96ecdd606e39 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:19:16.874461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09f140-b5e4-42c1-be30-96ecdd606e39 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:16.876974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09f140-b5e4-42c1-be30-96ecdd606e39 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:16.917343 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2492/4991] 10.222.0.17 () {58 vars in 1167 bytes} [Sat Jul 30 21:19:16 2022] GET /identity/v3/endpoints?interface=public => generated 3392 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:16.922023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe9041-02e2-4229-8ed0-ad631096d3c8 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:16.938644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe9041-02e2-4229-8ed0-ad631096d3c8 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:16.946204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc60552-9675-41e4-926b-da0726ef2b35 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:16.946958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc60552-9675-41e4-926b-da0726ef2b35 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:16.947580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc60552-9675-41e4-926b-da0726ef2b35 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:16.947977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc60552-9675-41e4-926b-da0726ef2b35 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:16.950385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc60552-9675-41e4-926b-da0726ef2b35 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:19:16.951129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc60552-9675-41e4-926b-da0726ef2b35 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:16.953379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc60552-9675-41e4-926b-da0726ef2b35 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:16.966441 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2500/4992] 10.222.0.17 () {58 vars in 1171 bytes} [Sat Jul 30 21:19:16 2022] GET /identity/v3/endpoints?interface=internal => generated 478 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:16.971817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09f140-b5e4-42c1-be30-96ecdd606e39 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:16.990998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09f140-b5e4-42c1-be30-96ecdd606e39 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:17.026522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf909-5411-43ff-8bbd-9468271eb97c tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:17.027939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf909-5411-43ff-8bbd-9468271eb97c tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:17.028348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf909-5411-43ff-8bbd-9468271eb97c tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:17.028737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf909-5411-43ff-8bbd-9468271eb97c tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:17.031036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbf909-5411-43ff-8bbd-9468271eb97c tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:17.033639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbf909-5411-43ff-8bbd-9468271eb97c tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:17.107763 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2493/4993] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:16 2022] POST /identity/v3/services => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:17.111626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc60552-9675-41e4-926b-da0726ef2b35 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:17.127126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc60552-9675-41e4-926b-da0726ef2b35 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:17.158369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e2914-86b9-4038-9e10-056936363848 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:17.160134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e2914-86b9-4038-9e10-056936363848 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:17.160513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e2914-86b9-4038-9e10-056936363848 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:17.160743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e2914-86b9-4038-9e10-056936363848 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:17.161500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e2914-86b9-4038-9e10-056936363848 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:17.165071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e2914-86b9-4038-9e10-056936363848 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:17.223898 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-271e2914-86b9-4038-9e10-056936363848 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-939354866. To ensure interoperability, identifiers should be a valid uuid. Jul 30 21:19:17.223898 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 30 21:19:17.223898 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:19:17.275715 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2501/4994] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Jul 30 21:19:17 2022] POST /identity/v3/endpoints => generated 358 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:19:17.280127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf909-5411-43ff-8bbd-9468271eb97c tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:17.318558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf909-5411-43ff-8bbd-9468271eb97c tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:17.340140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:17.345047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de0e7f-c4a3-4e35-80a6-137071ecd6d1 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:17.346028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de0e7f-c4a3-4e35-80a6-137071ecd6d1 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:17.346698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de0e7f-c4a3-4e35-80a6-137071ecd6d1 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:17.347516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de0e7f-c4a3-4e35-80a6-137071ecd6d1 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/regions/tempest-region-939354866` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:17.350646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de0e7f-c4a3-4e35-80a6-137071ecd6d1 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-939354866)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:17.352067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de0e7f-c4a3-4e35-80a6-137071ecd6d1 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:17.355259 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2494/4995] 10.222.0.17 () {58 vars in 1203 bytes} [Sat Jul 30 21:19:17 2022] GET /identity/v3/regions/tempest-region-939354866 => generated 178 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:17.359265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e2914-86b9-4038-9e10-056936363848 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:17.372948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e2914-86b9-4038-9e10-056936363848 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:17.388097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43070015-95ac-4394-a190-81b3881b0c93 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:17.388939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43070015-95ac-4394-a190-81b3881b0c93 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:17.389407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43070015-95ac-4394-a190-81b3881b0c93 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:17.391432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43070015-95ac-4394-a190-81b3881b0c93 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/endpoints/89c22830bc1a4b32a2d25a8b737cd2de` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:17.406360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43070015-95ac-4394-a190-81b3881b0c93 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=89c22830bc1a4b32a2d25a8b737cd2de)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:17.407124 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-43070015-95ac-4394-a190-81b3881b0c93 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:17.407124 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:19:17.407124 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:19:17.408278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43070015-95ac-4394-a190-81b3881b0c93 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:17.430792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:17.455541 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-43070015-95ac-4394-a190-81b3881b0c93 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-653611383. To ensure interoperability, identifiers should be a valid uuid. Jul 30 21:19:17.455541 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 30 21:19:17.455541 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:19:17.529029 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2502/4996] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Jul 30 21:19:17 2022] PATCH /identity/v3/endpoints/89c22830bc1a4b32a2d25a8b737cd2de => generated 361 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:19:17.532967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de0e7f-c4a3-4e35-80a6-137071ecd6d1 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:17.559789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de0e7f-c4a3-4e35-80a6-137071ecd6d1 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:17.578340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800428e8-df8a-43d7-9431-0000f4087489 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:17.578987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800428e8-df8a-43d7-9431-0000f4087489 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:17.579273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800428e8-df8a-43d7-9431-0000f4087489 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:17.579595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800428e8-df8a-43d7-9431-0000f4087489 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/regions/tempest-region-653611383` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:17.580203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800428e8-df8a-43d7-9431-0000f4087489 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-653611383)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:17.581285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800428e8-df8a-43d7-9431-0000f4087489 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:17.586547 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2495/4997] 10.222.0.17 () {58 vars in 1203 bytes} [Sat Jul 30 21:19:17 2022] GET /identity/v3/regions/tempest-region-653611383 => generated 178 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:17.590355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43070015-95ac-4394-a190-81b3881b0c93 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:17.609266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43070015-95ac-4394-a190-81b3881b0c93 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:17.629018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55cddf-ca61-4cfd-a95f-a99e7809e1cd tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:17.635471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55cddf-ca61-4cfd-a95f-a99e7809e1cd tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:17.635471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55cddf-ca61-4cfd-a95f-a99e7809e1cd tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:17.635471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55cddf-ca61-4cfd-a95f-a99e7809e1cd tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/endpoints/89c22830bc1a4b32a2d25a8b737cd2de` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:17.646709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55cddf-ca61-4cfd-a95f-a99e7809e1cd tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=89c22830bc1a4b32a2d25a8b737cd2de)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:17.648625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55cddf-ca61-4cfd-a95f-a99e7809e1cd tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:17.677246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9a55cddf-ca61-4cfd-a95f-a99e7809e1cd tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '89c22830bc1a4b32a2d25a8b737cd2de', 'request_id': 'req-9a55cddf-ca61-4cfd-a95f-a99e7809e1cd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:17.701771 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2503/4998] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:17 2022] DELETE /identity/v3/endpoints/89c22830bc1a4b32a2d25a8b737cd2de => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:19:17.705775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800428e8-df8a-43d7-9431-0000f4087489 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:17.738882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800428e8-df8a-43d7-9431-0000f4087489 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:17.777766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969512b0-371d-4439-a436-c22758c3e505 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:17.778736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969512b0-371d-4439-a436-c22758c3e505 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:17.779167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969512b0-371d-4439-a436-c22758c3e505 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:17.779662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969512b0-371d-4439-a436-c22758c3e505 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/regions/tempest-region-653611383` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:17.781191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969512b0-371d-4439-a436-c22758c3e505 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-653611383)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:17.783562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969512b0-371d-4439-a436-c22758c3e505 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:17.804285 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-969512b0-371d-4439-a436-c22758c3e505 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-653611383. To ensure interoperability, identifiers should be a valid uuid. Jul 30 21:19:17.804285 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 30 21:19:17.804285 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:19:17.819006 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2496/4999] 10.222.0.17 () {58 vars in 1206 bytes} [Sat Jul 30 21:19:17 2022] DELETE /identity/v3/regions/tempest-region-653611383 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:17.823085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55cddf-ca61-4cfd-a95f-a99e7809e1cd tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:17.841146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55cddf-ca61-4cfd-a95f-a99e7809e1cd tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:17.896262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174afdc-e7ec-4731-aff6-610866158c78 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:17.898536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174afdc-e7ec-4731-aff6-610866158c78 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:17.899061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174afdc-e7ec-4731-aff6-610866158c78 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:17.901246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174afdc-e7ec-4731-aff6-610866158c78 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/regions/tempest-region-939354866` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:17.902776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174afdc-e7ec-4731-aff6-610866158c78 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-939354866)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:17.904140 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-e174afdc-e7ec-4731-aff6-610866158c78 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:17.904140 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:19:17.904140 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:19:17.906093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174afdc-e7ec-4731-aff6-610866158c78 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:17.956331 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2504/5000] 10.222.0.17 () {58 vars in 1206 bytes} [Sat Jul 30 21:19:17 2022] DELETE /identity/v3/regions/tempest-region-939354866 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:17.960927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969512b0-371d-4439-a436-c22758c3e505 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:17.974664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969512b0-371d-4439-a436-c22758c3e505 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:18.056403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462f352-ee47-4426-a6c3-80c1605b6a32 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:18.057058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462f352-ee47-4426-a6c3-80c1605b6a32 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:18.057340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462f352-ee47-4426-a6c3-80c1605b6a32 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:18.057612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462f352-ee47-4426-a6c3-80c1605b6a32 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/services/63cdccc658674799a825df8da8cc91fe` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:18.058451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462f352-ee47-4426-a6c3-80c1605b6a32 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:delete_service(service_id=63cdccc658674799a825df8da8cc91fe)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:18.060124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462f352-ee47-4426-a6c3-80c1605b6a32 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:18.100625 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2497/5001] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:17 2022] DELETE /identity/v3/services/63cdccc658674799a825df8da8cc91fe => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:18.106244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174afdc-e7ec-4731-aff6-610866158c78 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:18.132061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174afdc-e7ec-4731-aff6-610866158c78 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:18.183233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374595e6-d338-4145-8a91-6363349ebb4e tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:18.183898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374595e6-d338-4145-8a91-6363349ebb4e tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:18.184186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374595e6-d338-4145-8a91-6363349ebb4e tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:18.185170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374595e6-d338-4145-8a91-6363349ebb4e tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/endpoints/eaa2bb4ee6e64e02b74bbe9ef8b7db8c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:18.197419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374595e6-d338-4145-8a91-6363349ebb4e tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=eaa2bb4ee6e64e02b74bbe9ef8b7db8c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:18.201215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374595e6-d338-4145-8a91-6363349ebb4e tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:18.234988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-374595e6-d338-4145-8a91-6363349ebb4e tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'eaa2bb4ee6e64e02b74bbe9ef8b7db8c', 'request_id': 'req-374595e6-d338-4145-8a91-6363349ebb4e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:18.282940 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2505/5002] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:18 2022] DELETE /identity/v3/endpoints/eaa2bb4ee6e64e02b74bbe9ef8b7db8c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:18.287946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462f352-ee47-4426-a6c3-80c1605b6a32 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:18.309112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462f352-ee47-4426-a6c3-80c1605b6a32 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:18.344736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f3d11-bbc3-4977-a99a-850e33b706e2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:18.345829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f3d11-bbc3-4977-a99a-850e33b706e2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:18.346607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f3d11-bbc3-4977-a99a-850e33b706e2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:18.347099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f3d11-bbc3-4977-a99a-850e33b706e2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/regions/tempest-region-461590316` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:18.347994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f3d11-bbc3-4977-a99a-850e33b706e2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-461590316)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:18.351714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f3d11-bbc3-4977-a99a-850e33b706e2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:18.414118 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2498/5003] 10.222.0.17 () {58 vars in 1206 bytes} [Sat Jul 30 21:19:18 2022] DELETE /identity/v3/regions/tempest-region-461590316 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:19:18.416066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374595e6-d338-4145-8a91-6363349ebb4e tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:18.448223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374595e6-d338-4145-8a91-6363349ebb4e tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:18.478488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bfbe0-0825-4bad-808f-ceb801e2a6d9 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:18.479450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bfbe0-0825-4bad-808f-ceb801e2a6d9 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:18.479591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bfbe0-0825-4bad-808f-ceb801e2a6d9 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:18.479813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bfbe0-0825-4bad-808f-ceb801e2a6d9 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/services/342bd71b10494101954bcbc732e5439e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:18.480638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bfbe0-0825-4bad-808f-ceb801e2a6d9 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:delete_service(service_id=342bd71b10494101954bcbc732e5439e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:18.482403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bfbe0-0825-4bad-808f-ceb801e2a6d9 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:18.555625 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2506/5004] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:18 2022] DELETE /identity/v3/services/342bd71b10494101954bcbc732e5439e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:18.559597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f3d11-bbc3-4977-a99a-850e33b706e2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:18.581697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f3d11-bbc3-4977-a99a-850e33b706e2 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:18.669761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0406810-e0dd-4c4f-9213-c12daa803f8a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:18.670831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0406810-e0dd-4c4f-9213-c12daa803f8a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:18.671406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0406810-e0dd-4c4f-9213-c12daa803f8a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:18.673309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0406810-e0dd-4c4f-9213-c12daa803f8a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/endpoints/79c1ca916ae04d70a7c063b9f7e10f75` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:18.690448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0406810-e0dd-4c4f-9213-c12daa803f8a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=79c1ca916ae04d70a7c063b9f7e10f75)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:18.696950 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-d0406810-e0dd-4c4f-9213-c12daa803f8a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:18.696950 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:19:18.696950 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:19:18.698075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0406810-e0dd-4c4f-9213-c12daa803f8a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:18.712915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d0406810-e0dd-4c4f-9213-c12daa803f8a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '79c1ca916ae04d70a7c063b9f7e10f75', 'request_id': 'req-d0406810-e0dd-4c4f-9213-c12daa803f8a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:18.727950 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2499/5005] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:18 2022] DELETE /identity/v3/endpoints/79c1ca916ae04d70a7c063b9f7e10f75 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:18.732036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bfbe0-0825-4bad-808f-ceb801e2a6d9 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:18.762886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bfbe0-0825-4bad-808f-ceb801e2a6d9 tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:18.786979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0f70c-5591-44c3-8c5b-be8e6199ef5b tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:18.790566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0f70c-5591-44c3-8c5b-be8e6199ef5b tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:18.791113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0f70c-5591-44c3-8c5b-be8e6199ef5b tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:18.791799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0f70c-5591-44c3-8c5b-be8e6199ef5b tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/regions/tempest-region-28877852` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:18.794344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0f70c-5591-44c3-8c5b-be8e6199ef5b tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-28877852)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:18.796375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0f70c-5591-44c3-8c5b-be8e6199ef5b tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:18.849983 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-dde0f70c-5591-44c3-8c5b-be8e6199ef5b tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-28877852. To ensure interoperability, identifiers should be a valid uuid. Jul 30 21:19:18.849983 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 30 21:19:18.849983 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:19:18.890311 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2507/5006] 10.222.0.17 () {58 vars in 1203 bytes} [Sat Jul 30 21:19:18 2022] DELETE /identity/v3/regions/tempest-region-28877852 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:18.896274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0406810-e0dd-4c4f-9213-c12daa803f8a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:18.922591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0406810-e0dd-4c4f-9213-c12daa803f8a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:18.966887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a2d53-ea75-4fb0-8542-427b3f63ed8a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59ff84f6a74446e95dfaf632ba67a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6c00874ed1a47fcbbc6e919405c3b97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:18.967695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a2d53-ea75-4fb0-8542-427b3f63ed8a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:18.967847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a2d53-ea75-4fb0-8542-427b3f63ed8a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:18.968135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a2d53-ea75-4fb0-8542-427b3f63ed8a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] PATH_INFO: `/v3/services/f79edd13eb4e49c9ba1a27529cdab45c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:18.968786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a2d53-ea75-4fb0-8542-427b3f63ed8a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f79edd13eb4e49c9ba1a27529cdab45c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:18.970442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a2d53-ea75-4fb0-8542-427b3f63ed8a tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:19.054625 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2500/5007] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:18 2022] DELETE /identity/v3/services/f79edd13eb4e49c9ba1a27529cdab45c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:19.060181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0f70c-5591-44c3-8c5b-be8e6199ef5b tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:19.237476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=8 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:19.320211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0f70c-5591-44c3-8c5b-be8e6199ef5b tempest-EndPointsTestJSON-1209065752 tempest-EndPointsTestJSON-1209065752-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:19.367351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6739b-40f6-4141-9a20-6b334ece93e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:19.368026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6739b-40f6-4141-9a20-6b334ece93e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:19.368448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6739b-40f6-4141-9a20-6b334ece93e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:19.368770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6739b-40f6-4141-9a20-6b334ece93e0 admin admin] PATH_INFO: `/v3/users/a4222752638644ebb6b829e67434030a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:19.370226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6739b-40f6-4141-9a20-6b334ece93e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4222752638644ebb6b829e67434030a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:19.372394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6739b-40f6-4141-9a20-6b334ece93e0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:19.520792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-34e6739b-40f6-4141-9a20-6b334ece93e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4222752638644ebb6b829e67434030a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:19.550171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-34e6739b-40f6-4141-9a20-6b334ece93e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4222752638644ebb6b829e67434030a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:19.551557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-34e6739b-40f6-4141-9a20-6b334ece93e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4222752638644ebb6b829e67434030a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:19.562927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-34e6739b-40f6-4141-9a20-6b334ece93e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4222752638644ebb6b829e67434030a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:19.568410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-34e6739b-40f6-4141-9a20-6b334ece93e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4222752638644ebb6b829e67434030a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:19.600815 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2508/5008] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:19 2022] DELETE /identity/v3/users/a4222752638644ebb6b829e67434030a => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:19.607369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3ce25-e224-4678-80ce-97862e4ff4dc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:19.608416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3ce25-e224-4678-80ce-97862e4ff4dc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:19.609029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3ce25-e224-4678-80ce-97862e4ff4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:19.648842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-25f3ce25-e224-4678-80ce-97862e4ff4dc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:19.650215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-25f3ce25-e224-4678-80ce-97862e4ff4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:19.711016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:19.770672 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2501/5009] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:19.832039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6739b-40f6-4141-9a20-6b334ece93e0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:19.835432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-34e6739b-40f6-4141-9a20-6b334ece93e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:20.038696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6739b-40f6-4141-9a20-6b334ece93e0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:20.079310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab7cc0-c191-425f-a50a-b79f89a51614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:20.080122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab7cc0-c191-425f-a50a-b79f89a51614 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:20.080572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab7cc0-c191-425f-a50a-b79f89a51614 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:20.080861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab7cc0-c191-425f-a50a-b79f89a51614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:20.120834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab7cc0-c191-425f-a50a-b79f89a51614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:20.123930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab7cc0-c191-425f-a50a-b79f89a51614 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:20.162725 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2509/5010] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:19:22.131938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3ce25-e224-4678-80ce-97862e4ff4dc None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:22.134020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-25f3ce25-e224-4678-80ce-97862e4ff4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:22.158365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3ce25-e224-4678-80ce-97862e4ff4dc None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:22.168205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652cf07-80a8-493b-94eb-c27b9e17b4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:22.169269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652cf07-80a8-493b-94eb-c27b9e17b4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:22.170141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652cf07-80a8-493b-94eb-c27b9e17b4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:22.170605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652cf07-80a8-493b-94eb-c27b9e17b4c0 admin admin] PATH_INFO: `/v3/projects/22f3ed9dac874222887caf7309fbd0c2` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:22.172285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652cf07-80a8-493b-94eb-c27b9e17b4c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f3ed9dac874222887caf7309fbd0c2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:22.176893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652cf07-80a8-493b-94eb-c27b9e17b4c0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:22.320620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2652cf07-80a8-493b-94eb-c27b9e17b4c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f3ed9dac874222887caf7309fbd0c2', 'request_id': 'req-2652cf07-80a8-493b-94eb-c27b9e17b4c0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:22.350258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2652cf07-80a8-493b-94eb-c27b9e17b4c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f3ed9dac874222887caf7309fbd0c2', 'request_id': 'req-2652cf07-80a8-493b-94eb-c27b9e17b4c0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:22.359105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2652cf07-80a8-493b-94eb-c27b9e17b4c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f3ed9dac874222887caf7309fbd0c2', 'request_id': 'req-2652cf07-80a8-493b-94eb-c27b9e17b4c0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:22.376854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2652cf07-80a8-493b-94eb-c27b9e17b4c0 admin admin] The token cache is being invalidate because project 22f3ed9dac874222887caf7309fbd0c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:22.377429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2652cf07-80a8-493b-94eb-c27b9e17b4c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:22.378364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2652cf07-80a8-493b-94eb-c27b9e17b4c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:22.383145 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2502/5011] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:22 2022] DELETE /identity/v3/projects/22f3ed9dac874222887caf7309fbd0c2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:22.385261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab7cc0-c191-425f-a50a-b79f89a51614 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:22.420141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab7cc0-c191-425f-a50a-b79f89a51614 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:22.549826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:22.606482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa7bde-4479-487a-9800-fc02e9957adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:22.607806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa7bde-4479-487a-9800-fc02e9957adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:22.608328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa7bde-4479-487a-9800-fc02e9957adc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:22.608826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa7bde-4479-487a-9800-fc02e9957adc admin admin] PATH_INFO: `/v3/users/a59ff84f6a74446e95dfaf632ba67a2f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:22.610887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa7bde-4479-487a-9800-fc02e9957adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a59ff84f6a74446e95dfaf632ba67a2f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:22.615845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa7bde-4479-487a-9800-fc02e9957adc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:22.764275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d4aa7bde-4479-487a-9800-fc02e9957adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a59ff84f6a74446e95dfaf632ba67a2f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:22.816681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d4aa7bde-4479-487a-9800-fc02e9957adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a59ff84f6a74446e95dfaf632ba67a2f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:22.825536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d4aa7bde-4479-487a-9800-fc02e9957adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a59ff84f6a74446e95dfaf632ba67a2f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:22.846547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d4aa7bde-4479-487a-9800-fc02e9957adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a59ff84f6a74446e95dfaf632ba67a2f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:22.854210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d4aa7bde-4479-487a-9800-fc02e9957adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a59ff84f6a74446e95dfaf632ba67a2f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:22.898351 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2510/5012] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:22 2022] DELETE /identity/v3/users/a59ff84f6a74446e95dfaf632ba67a2f => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:24.150787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652cf07-80a8-493b-94eb-c27b9e17b4c0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:24.152890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2652cf07-80a8-493b-94eb-c27b9e17b4c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:24.180386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652cf07-80a8-493b-94eb-c27b9e17b4c0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:24.321524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5b5bb-579b-4371-87c2-cf6b7fc0ad3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:24.322441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5b5bb-579b-4371-87c2-cf6b7fc0ad3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:24.322909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5b5bb-579b-4371-87c2-cf6b7fc0ad3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:24.323405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5b5bb-579b-4371-87c2-cf6b7fc0ad3a admin admin] PATH_INFO: `/v3/projects/d6c00874ed1a47fcbbc6e919405c3b97` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:24.324997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5b5bb-579b-4371-87c2-cf6b7fc0ad3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c00874ed1a47fcbbc6e919405c3b97)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:24.327608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5b5bb-579b-4371-87c2-cf6b7fc0ad3a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:24.452542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9fb5b5bb-579b-4371-87c2-cf6b7fc0ad3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c00874ed1a47fcbbc6e919405c3b97', 'request_id': 'req-9fb5b5bb-579b-4371-87c2-cf6b7fc0ad3a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:24.475972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9fb5b5bb-579b-4371-87c2-cf6b7fc0ad3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c00874ed1a47fcbbc6e919405c3b97', 'request_id': 'req-9fb5b5bb-579b-4371-87c2-cf6b7fc0ad3a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:24.498238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9fb5b5bb-579b-4371-87c2-cf6b7fc0ad3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c00874ed1a47fcbbc6e919405c3b97', 'request_id': 'req-9fb5b5bb-579b-4371-87c2-cf6b7fc0ad3a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:24.520664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:24.528876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9fb5b5bb-579b-4371-87c2-cf6b7fc0ad3a admin admin] The token cache is being invalidate because project d6c00874ed1a47fcbbc6e919405c3b97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:24.529096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9fb5b5bb-579b-4371-87c2-cf6b7fc0ad3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:24.530618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9fb5b5bb-579b-4371-87c2-cf6b7fc0ad3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:24.534112 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2503/5013] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:24 2022] DELETE /identity/v3/projects/d6c00874ed1a47fcbbc6e919405c3b97 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:19:24.539018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29d4ac-1c9f-4e09-b327-7259e5650313 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:24.539610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29d4ac-1c9f-4e09-b327-7259e5650313 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:24.539610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29d4ac-1c9f-4e09-b327-7259e5650313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:24.579406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ed29d4ac-1c9f-4e09-b327-7259e5650313 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:24.580660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ed29d4ac-1c9f-4e09-b327-7259e5650313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:24.721285 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2511/5014] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:24.722123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93586a-de15-4d1b-b537-7860597c05c2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:24.724149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93586a-de15-4d1b-b537-7860597c05c2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:24.724777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93586a-de15-4d1b-b537-7860597c05c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:24.768408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-cd93586a-de15-4d1b-b537-7860597c05c2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:24.771966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cd93586a-de15-4d1b-b537-7860597c05c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:24.784955 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2504/5015] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:24.790041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29d4ac-1c9f-4e09-b327-7259e5650313 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:24.808451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29d4ac-1c9f-4e09-b327-7259e5650313 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:24.817955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d7637-c912-47c2-be59-0a4e32e5eb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:24.819318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d7637-c912-47c2-be59-0a4e32e5eb95 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:24.820137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d7637-c912-47c2-be59-0a4e32e5eb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:24.820137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d7637-c912-47c2-be59-0a4e32e5eb95 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:24.821053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d7637-c912-47c2-be59-0a4e32e5eb95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:19:24.821579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d7637-c912-47c2-be59-0a4e32e5eb95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:24.823886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d7637-c912-47c2-be59-0a4e32e5eb95 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:24.842458 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2512/5016] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:24.846684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93586a-de15-4d1b-b537-7860597c05c2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:24.864762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93586a-de15-4d1b-b537-7860597c05c2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:24.882659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5cf6e-a4d1-4f56-9491-7ad511bcdbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:24.883356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5cf6e-a4d1-4f56-9491-7ad511bcdbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:24.883651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5cf6e-a4d1-4f56-9491-7ad511bcdbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:24.883929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5cf6e-a4d1-4f56-9491-7ad511bcdbf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:24.884608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5cf6e-a4d1-4f56-9491-7ad511bcdbf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:24.887910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5cf6e-a4d1-4f56-9491-7ad511bcdbf1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:24.931888 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2505/5017] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:24 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:24.938163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d7637-c912-47c2-be59-0a4e32e5eb95 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:24.963087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d7637-c912-47c2-be59-0a4e32e5eb95 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:25.072043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:25.114083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e6428-7bf6-4886-b13a-fe18f5abf8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:25.114832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e6428-7bf6-4886-b13a-fe18f5abf8fd admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:25.115320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e6428-7bf6-4886-b13a-fe18f5abf8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:25.115934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e6428-7bf6-4886-b13a-fe18f5abf8fd admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:25.118854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e6428-7bf6-4886-b13a-fe18f5abf8fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:25.122052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e6428-7bf6-4886-b13a-fe18f5abf8fd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:25.173929 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2513/5018] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:24 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:25.177935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5cf6e-a4d1-4f56-9491-7ad511bcdbf1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:25.210190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5cf6e-a4d1-4f56-9491-7ad511bcdbf1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:25.215329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e720d13-d5c7-4340-8f35-9e0f61a802fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:25.217293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e720d13-d5c7-4340-8f35-9e0f61a802fe admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:25.217293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e720d13-d5c7-4340-8f35-9e0f61a802fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:25.219691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e720d13-d5c7-4340-8f35-9e0f61a802fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:25.220418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e720d13-d5c7-4340-8f35-9e0f61a802fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:25.227018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e720d13-d5c7-4340-8f35-9e0f61a802fe admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:25.266351 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2506/5019] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:25.270821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e6428-7bf6-4886-b13a-fe18f5abf8fd admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:25.306304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e6428-7bf6-4886-b13a-fe18f5abf8fd admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:25.325234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59339be-3d46-4231-aa8a-07a179593d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:25.326536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59339be-3d46-4231-aa8a-07a179593d57 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:25.326980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59339be-3d46-4231-aa8a-07a179593d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:25.327478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59339be-3d46-4231-aa8a-07a179593d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:25.328806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59339be-3d46-4231-aa8a-07a179593d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:25.334465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59339be-3d46-4231-aa8a-07a179593d57 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:25.368162 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2514/5020] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:25.373677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e720d13-d5c7-4340-8f35-9e0f61a802fe admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:25.401669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e720d13-d5c7-4340-8f35-9e0f61a802fe admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:25.410858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0c7ce-8e39-416e-aeca-5b81ddc1f080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:25.412189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0c7ce-8e39-416e-aeca-5b81ddc1f080 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:25.412630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0c7ce-8e39-416e-aeca-5b81ddc1f080 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:25.413767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0c7ce-8e39-416e-aeca-5b81ddc1f080 admin admin] PATH_INFO: `/v3/projects/522276a1daae47fbb869cab1322b148a/users/8854ce58db244c6ab5f74868adba1ee1/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:25.469830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0c7ce-8e39-416e-aeca-5b81ddc1f080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522276a1daae47fbb869cab1322b148a, user_id=8854ce58db244c6ab5f74868adba1ee1, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:25.472661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0c7ce-8e39-416e-aeca-5b81ddc1f080 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:25.515181 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2507/5021] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:25 2022] PUT /identity/v3/projects/522276a1daae47fbb869cab1322b148a/users/8854ce58db244c6ab5f74868adba1ee1/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:25.527152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb4e51-8d3c-4087-9ee2-de54bee4333d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:25.527700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb4e51-8d3c-4087-9ee2-de54bee4333d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:25.528212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb4e51-8d3c-4087-9ee2-de54bee4333d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:25.613356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b4bb4e51-8d3c-4087-9ee2-de54bee4333d None None] MFA Rules not processed for user `8854ce58db244c6ab5f74868adba1ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:25.624705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b4bb4e51-8d3c-4087-9ee2-de54bee4333d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:25.759793 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2515/5022] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:25.764340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0c7ce-8e39-416e-aeca-5b81ddc1f080 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:25.885580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0c7ce-8e39-416e-aeca-5b81ddc1f080 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:25.907525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76ebfc-9fdb-40e6-a10a-76d6a69b1ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:25.909078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76ebfc-9fdb-40e6-a10a-76d6a69b1ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:25.910117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76ebfc-9fdb-40e6-a10a-76d6a69b1ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:25.910650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76ebfc-9fdb-40e6-a10a-76d6a69b1ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:25.911830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76ebfc-9fdb-40e6-a10a-76d6a69b1ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:25.914466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76ebfc-9fdb-40e6-a10a-76d6a69b1ec0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:25.960228 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2508/5023] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:25 2022] POST /identity/v3/projects => generated 371 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:25.964783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb4e51-8d3c-4087-9ee2-de54bee4333d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:25.987585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb4e51-8d3c-4087-9ee2-de54bee4333d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:26.118761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed51f84-b21b-4cdd-b1fa-41e788bbfd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:26.119529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed51f84-b21b-4cdd-b1fa-41e788bbfd9f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:26.120162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed51f84-b21b-4cdd-b1fa-41e788bbfd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:26.121936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed51f84-b21b-4cdd-b1fa-41e788bbfd9f admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:26.122773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed51f84-b21b-4cdd-b1fa-41e788bbfd9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:26.125298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed51f84-b21b-4cdd-b1fa-41e788bbfd9f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:26.189498 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2516/5024] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:25 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:26.190767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76ebfc-9fdb-40e6-a10a-76d6a69b1ec0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:26.203724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76ebfc-9fdb-40e6-a10a-76d6a69b1ec0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:26.210085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336583c2-f2fc-4997-a1c2-fb8b47f5f493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:26.211511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336583c2-f2fc-4997-a1c2-fb8b47f5f493 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:26.213016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336583c2-f2fc-4997-a1c2-fb8b47f5f493 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:26.213465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336583c2-f2fc-4997-a1c2-fb8b47f5f493 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:26.214335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336583c2-f2fc-4997-a1c2-fb8b47f5f493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:26.216304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336583c2-f2fc-4997-a1c2-fb8b47f5f493 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:26.229413 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2509/5025] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:26.233914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed51f84-b21b-4cdd-b1fa-41e788bbfd9f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:26.252031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed51f84-b21b-4cdd-b1fa-41e788bbfd9f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:26.263938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560726f-76e4-44bf-af95-dafcea59904e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:26.264634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560726f-76e4-44bf-af95-dafcea59904e admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:26.264925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560726f-76e4-44bf-af95-dafcea59904e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:26.265207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560726f-76e4-44bf-af95-dafcea59904e admin admin] PATH_INFO: `/v3/projects/8ff72b6742dd4b79b92387ec359804a2/users/19c5ca79c2f44edf885be5e941af1543/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:26.297792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560726f-76e4-44bf-af95-dafcea59904e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff72b6742dd4b79b92387ec359804a2, user_id=19c5ca79c2f44edf885be5e941af1543, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:26.300671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560726f-76e4-44bf-af95-dafcea59904e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:26.339554 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2517/5026] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:26 2022] PUT /identity/v3/projects/8ff72b6742dd4b79b92387ec359804a2/users/19c5ca79c2f44edf885be5e941af1543/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:26.340862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336583c2-f2fc-4997-a1c2-fb8b47f5f493 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:26.353263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336583c2-f2fc-4997-a1c2-fb8b47f5f493 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:26.519128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a2561-3373-49fd-a79e-17963b4e2471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:26.520235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a2561-3373-49fd-a79e-17963b4e2471 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:26.520654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a2561-3373-49fd-a79e-17963b4e2471 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:26.521545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a2561-3373-49fd-a79e-17963b4e2471 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:26.522318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a2561-3373-49fd-a79e-17963b4e2471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:26.528291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a2561-3373-49fd-a79e-17963b4e2471 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:26.562480 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2510/5027] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:26.563560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560726f-76e4-44bf-af95-dafcea59904e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:26.594234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560726f-76e4-44bf-af95-dafcea59904e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:26.613363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e8bde-c453-4e68-84e3-4c0d5f788ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:26.615590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e8bde-c453-4e68-84e3-4c0d5f788ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:26.615590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e8bde-c453-4e68-84e3-4c0d5f788ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:26.615590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e8bde-c453-4e68-84e3-4c0d5f788ffe admin admin] PATH_INFO: `/v3/projects/8ff72b6742dd4b79b92387ec359804a2/users/19c5ca79c2f44edf885be5e941af1543/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:26.619653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e8bde-c453-4e68-84e3-4c0d5f788ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff72b6742dd4b79b92387ec359804a2, user_id=19c5ca79c2f44edf885be5e941af1543, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:26.626749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e8bde-c453-4e68-84e3-4c0d5f788ffe admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:26.641988 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2518/5028] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:26 2022] PUT /identity/v3/projects/8ff72b6742dd4b79b92387ec359804a2/users/19c5ca79c2f44edf885be5e941af1543/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:26.654127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c5f07-5763-4666-9cb5-54700df7e57a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:26.654442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c5f07-5763-4666-9cb5-54700df7e57a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:26.654688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c5f07-5763-4666-9cb5-54700df7e57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:26.671187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:26.721733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-603c5f07-5763-4666-9cb5-54700df7e57a None None] MFA Rules not processed for user `19c5ca79c2f44edf885be5e941af1543`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:26.725213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-603c5f07-5763-4666-9cb5-54700df7e57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:26.906227 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2511/5029] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:26.911026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e8bde-c453-4e68-84e3-4c0d5f788ffe admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:26.924433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e8bde-c453-4e68-84e3-4c0d5f788ffe admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:26.932928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc2b2b-104b-4937-a3c2-e179f2da9532 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:26.934610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc2b2b-104b-4937-a3c2-e179f2da9532 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:26.934990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc2b2b-104b-4937-a3c2-e179f2da9532 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:26.935582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc2b2b-104b-4937-a3c2-e179f2da9532 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:26.936362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc2b2b-104b-4937-a3c2-e179f2da9532 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:26.939276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc2b2b-104b-4937-a3c2-e179f2da9532 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:26.944914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:26.981095 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2519/5030] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:19:26 2022] POST /identity/v3/domains => generated 275 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:26.981299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c5f07-5763-4666-9cb5-54700df7e57a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:27.000920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c5f07-5763-4666-9cb5-54700df7e57a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:27.159799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f8907-5ae5-4348-996f-325bbc76b362 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:27.159799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f8907-5ae5-4348-996f-325bbc76b362 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:27.159799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f8907-5ae5-4348-996f-325bbc76b362 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:27.160084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f8907-5ae5-4348-996f-325bbc76b362 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:27.166746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f8907-5ae5-4348-996f-325bbc76b362 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:27.168735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f8907-5ae5-4348-996f-325bbc76b362 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:27.262135 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2512/5031] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:26 2022] POST /identity/v3/projects => generated 403 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:27.265610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc2b2b-104b-4937-a3c2-e179f2da9532 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:27.284936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc2b2b-104b-4937-a3c2-e179f2da9532 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:27.390566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c96c5a-7685-4962-8166-8e212c2b8230 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:27.392133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c96c5a-7685-4962-8166-8e212c2b8230 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:27.392133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c96c5a-7685-4962-8166-8e212c2b8230 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:27.392133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c96c5a-7685-4962-8166-8e212c2b8230 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/groups` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:27.392811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c96c5a-7685-4962-8166-8e212c2b8230 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:27.397297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c96c5a-7685-4962-8166-8e212c2b8230 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:27.437630 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2520/5032] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:19:27 2022] POST /identity/v3/groups => generated 302 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:27.439315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f8907-5ae5-4348-996f-325bbc76b362 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:27.473604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f8907-5ae5-4348-996f-325bbc76b362 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:27.493657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f60801-44f6-4510-9a25-d4dddc950591 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:27.495403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f60801-44f6-4510-9a25-d4dddc950591 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:27.495816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f60801-44f6-4510-9a25-d4dddc950591 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:27.499882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f60801-44f6-4510-9a25-d4dddc950591 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:27.501491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f60801-44f6-4510-9a25-d4dddc950591 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:27.508304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f60801-44f6-4510-9a25-d4dddc950591 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:27.599244 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2513/5033] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:27 2022] POST /identity/v3/users => generated 442 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:27.605630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c96c5a-7685-4962-8166-8e212c2b8230 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:27.643505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c96c5a-7685-4962-8166-8e212c2b8230 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:27.657873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108f8d8-3908-41ca-ba2e-75f8249426f4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:27.660244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108f8d8-3908-41ca-ba2e-75f8249426f4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:27.660920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108f8d8-3908-41ca-ba2e-75f8249426f4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:27.661320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108f8d8-3908-41ca-ba2e-75f8249426f4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:27.670856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108f8d8-3908-41ca-ba2e-75f8249426f4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:27.670856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108f8d8-3908-41ca-ba2e-75f8249426f4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:27.704822 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2521/5034] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:19:27 2022] POST /identity/v3/roles => generated 240 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:27.709038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f60801-44f6-4510-9a25-d4dddc950591 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:27.724785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f60801-44f6-4510-9a25-d4dddc950591 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:27.740620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a9e2f-a7b2-4c1d-b9a1-13aa95eb30b3 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:27.741332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a9e2f-a7b2-4c1d-b9a1-13aa95eb30b3 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:27.742548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a9e2f-a7b2-4c1d-b9a1-13aa95eb30b3 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:27.742548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a9e2f-a7b2-4c1d-b9a1-13aa95eb30b3 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/e5ecf602b60d4646b7d77ba847d4fa59/groups/df1d82591d85452493710111215ddba1/roles/0571972a2379436ebe10308c9dbaae67/inherited_to_projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:27.752190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a9e2f-a7b2-4c1d-b9a1-13aa95eb30b3 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e5ecf602b60d4646b7d77ba847d4fa59, group_id=df1d82591d85452493710111215ddba1, role_id=0571972a2379436ebe10308c9dbaae67)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:27.758106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a9e2f-a7b2-4c1d-b9a1-13aa95eb30b3 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:27.781572 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2514/5035] 10.222.0.17 () {60 vars in 1585 bytes} [Sat Jul 30 21:19:27 2022] PUT /identity/v3/OS-INHERIT/projects/e5ecf602b60d4646b7d77ba847d4fa59/groups/df1d82591d85452493710111215ddba1/roles/0571972a2379436ebe10308c9dbaae67/inherited_to_projects => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:27.784076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108f8d8-3908-41ca-ba2e-75f8249426f4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:27.795257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108f8d8-3908-41ca-ba2e-75f8249426f4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:27.899436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a94fc-d95b-461c-a93e-b35fc8ebe76b tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:27.900170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a94fc-d95b-461c-a93e-b35fc8ebe76b tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:27.900462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a94fc-d95b-461c-a93e-b35fc8ebe76b tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:27.900748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a94fc-d95b-461c-a93e-b35fc8ebe76b tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/e5ecf602b60d4646b7d77ba847d4fa59/groups/df1d82591d85452493710111215ddba1/roles/0571972a2379436ebe10308c9dbaae67/inherited_to_projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:27.909290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a94fc-d95b-461c-a93e-b35fc8ebe76b tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:check_grant(project_id=e5ecf602b60d4646b7d77ba847d4fa59, group_id=df1d82591d85452493710111215ddba1, role_id=0571972a2379436ebe10308c9dbaae67)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:27.910386 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-f99a94fc-d95b-461c-a93e-b35fc8ebe76b tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:27.910386 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:19:27.910386 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:19:27.912980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a94fc-d95b-461c-a93e-b35fc8ebe76b tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:27.932130 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2522/5036] 10.222.0.17 () {58 vars in 1567 bytes} [Sat Jul 30 21:19:27 2022] HEAD /identity/v3/OS-INHERIT/projects/e5ecf602b60d4646b7d77ba847d4fa59/groups/df1d82591d85452493710111215ddba1/roles/0571972a2379436ebe10308c9dbaae67/inherited_to_projects => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:19:27.936432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a9e2f-a7b2-4c1d-b9a1-13aa95eb30b3 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:27.959493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a9e2f-a7b2-4c1d-b9a1-13aa95eb30b3 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:27.984436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af5066-33d4-4641-849c-e9b5ae19c77c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:27.986702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af5066-33d4-4641-849c-e9b5ae19c77c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:27.987152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af5066-33d4-4641-849c-e9b5ae19c77c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:27.987675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af5066-33d4-4641-849c-e9b5ae19c77c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/e5ecf602b60d4646b7d77ba847d4fa59/groups/df1d82591d85452493710111215ddba1/roles/0571972a2379436ebe10308c9dbaae67/inherited_to_projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:27.991323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af5066-33d4-4641-849c-e9b5ae19c77c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=e5ecf602b60d4646b7d77ba847d4fa59, group_id=df1d82591d85452493710111215ddba1, role_id=0571972a2379436ebe10308c9dbaae67)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:27.994504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af5066-33d4-4641-849c-e9b5ae19c77c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:28.017888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c8af5066-33d4-4641-849c-e9b5ae19c77c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invalidating the token cache because role 0571972a2379436ebe10308c9dbaae67 was removed from group df1d82591d85452493710111215ddba1 on project e5ecf602b60d4646b7d77ba847d4fa59. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:28.018204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c8af5066-33d4-4641-849c-e9b5ae19c77c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:28.025645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c8af5066-33d4-4641-849c-e9b5ae19c77c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:28.046777 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2515/5037] 10.222.0.17 () {58 vars in 1569 bytes} [Sat Jul 30 21:19:27 2022] DELETE /identity/v3/OS-INHERIT/projects/e5ecf602b60d4646b7d77ba847d4fa59/groups/df1d82591d85452493710111215ddba1/roles/0571972a2379436ebe10308c9dbaae67/inherited_to_projects => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:28.048972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a94fc-d95b-461c-a93e-b35fc8ebe76b tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:28.052796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f99a94fc-d95b-461c-a93e-b35fc8ebe76b tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:28.076707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a94fc-d95b-461c-a93e-b35fc8ebe76b tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:28.186467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa71492-0cab-4d91-a6e2-779dc603257e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:28.187236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa71492-0cab-4d91-a6e2-779dc603257e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:28.187629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa71492-0cab-4d91-a6e2-779dc603257e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:28.187976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa71492-0cab-4d91-a6e2-779dc603257e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/roles/0571972a2379436ebe10308c9dbaae67` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:28.190314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa71492-0cab-4d91-a6e2-779dc603257e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0571972a2379436ebe10308c9dbaae67)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:28.193349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa71492-0cab-4d91-a6e2-779dc603257e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:28.212361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=3,keystone:SELECT=95,keystone:DELETE=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:28.269336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1fa71492-0cab-4d91-a6e2-779dc603257e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invalidating the token cache because role 0571972a2379436ebe10308c9dbaae67 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:28.269721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1fa71492-0cab-4d91-a6e2-779dc603257e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:28.273358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1fa71492-0cab-4d91-a6e2-779dc603257e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:28.277932 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2523/5038] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:28 2022] DELETE /identity/v3/roles/0571972a2379436ebe10308c9dbaae67 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:28.285397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af5066-33d4-4641-849c-e9b5ae19c77c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:28.300381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af5066-33d4-4641-849c-e9b5ae19c77c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:28.312115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:28.406278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ae20b-faae-4668-b58c-d25548529a9f tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:28.407845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ae20b-faae-4668-b58c-d25548529a9f tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:28.408412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ae20b-faae-4668-b58c-d25548529a9f tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:28.408996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ae20b-faae-4668-b58c-d25548529a9f tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:28.410942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ae20b-faae-4668-b58c-d25548529a9f tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:28.413074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ae20b-faae-4668-b58c-d25548529a9f tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:28.439341 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2516/5039] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:19:28 2022] POST /identity/v3/roles => generated 240 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:28.444136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa71492-0cab-4d91-a6e2-779dc603257e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:28.446238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1fa71492-0cab-4d91-a6e2-779dc603257e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:28.464969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa71492-0cab-4d91-a6e2-779dc603257e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:28.471734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15267a-6c16-4c03-8cf8-74e965b12476 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:28.472639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15267a-6c16-4c03-8cf8-74e965b12476 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:28.473417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15267a-6c16-4c03-8cf8-74e965b12476 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:28.473876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15267a-6c16-4c03-8cf8-74e965b12476 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/e5ecf602b60d4646b7d77ba847d4fa59/users/3e068311d4464358b37e6cb44442bb46/roles/acd2b7ae47cc450d83d1eb430fee515c/inherited_to_projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:28.498060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15267a-6c16-4c03-8cf8-74e965b12476 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e5ecf602b60d4646b7d77ba847d4fa59, user_id=3e068311d4464358b37e6cb44442bb46, role_id=acd2b7ae47cc450d83d1eb430fee515c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:28.501853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15267a-6c16-4c03-8cf8-74e965b12476 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:28.522136 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2524/5040] 10.222.0.17 () {60 vars in 1582 bytes} [Sat Jul 30 21:19:28 2022] PUT /identity/v3/OS-INHERIT/projects/e5ecf602b60d4646b7d77ba847d4fa59/users/3e068311d4464358b37e6cb44442bb46/roles/acd2b7ae47cc450d83d1eb430fee515c/inherited_to_projects => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:28.526832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ae20b-faae-4668-b58c-d25548529a9f tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:28.539933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ae20b-faae-4668-b58c-d25548529a9f tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:28.650189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09569fea-78e2-4269-8a48-6eefbcb510ab tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:28.651318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09569fea-78e2-4269-8a48-6eefbcb510ab tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:28.651827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09569fea-78e2-4269-8a48-6eefbcb510ab tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:28.652299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09569fea-78e2-4269-8a48-6eefbcb510ab tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/e5ecf602b60d4646b7d77ba847d4fa59/users/3e068311d4464358b37e6cb44442bb46/roles/acd2b7ae47cc450d83d1eb430fee515c/inherited_to_projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:28.655278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09569fea-78e2-4269-8a48-6eefbcb510ab tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:check_grant(project_id=e5ecf602b60d4646b7d77ba847d4fa59, user_id=3e068311d4464358b37e6cb44442bb46, role_id=acd2b7ae47cc450d83d1eb430fee515c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:28.656618 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-09569fea-78e2-4269-8a48-6eefbcb510ab tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:28.656618 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:19:28.656618 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:19:28.659745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09569fea-78e2-4269-8a48-6eefbcb510ab tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:28.669705 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2517/5041] 10.222.0.17 () {58 vars in 1564 bytes} [Sat Jul 30 21:19:28 2022] HEAD /identity/v3/OS-INHERIT/projects/e5ecf602b60d4646b7d77ba847d4fa59/users/3e068311d4464358b37e6cb44442bb46/roles/acd2b7ae47cc450d83d1eb430fee515c/inherited_to_projects => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:19:28.676512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15267a-6c16-4c03-8cf8-74e965b12476 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:28.691247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15267a-6c16-4c03-8cf8-74e965b12476 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:28.697513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53029c-4ddf-42bb-b1f9-11f3b17602f4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:28.698582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53029c-4ddf-42bb-b1f9-11f3b17602f4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:28.699567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53029c-4ddf-42bb-b1f9-11f3b17602f4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:28.700811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53029c-4ddf-42bb-b1f9-11f3b17602f4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/e5ecf602b60d4646b7d77ba847d4fa59/users/3e068311d4464358b37e6cb44442bb46/roles/acd2b7ae47cc450d83d1eb430fee515c/inherited_to_projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:28.703718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53029c-4ddf-42bb-b1f9-11f3b17602f4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=e5ecf602b60d4646b7d77ba847d4fa59, user_id=3e068311d4464358b37e6cb44442bb46, role_id=acd2b7ae47cc450d83d1eb430fee515c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:28.706734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53029c-4ddf-42bb-b1f9-11f3b17602f4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:28.714068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d53029c-4ddf-42bb-b1f9-11f3b17602f4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invalidating the token cache because role acd2b7ae47cc450d83d1eb430fee515c was removed from user 3e068311d4464358b37e6cb44442bb46 on project e5ecf602b60d4646b7d77ba847d4fa59. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:28.714659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d53029c-4ddf-42bb-b1f9-11f3b17602f4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:28.715775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d53029c-4ddf-42bb-b1f9-11f3b17602f4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:28.761618 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2525/5042] 10.222.0.17 () {58 vars in 1566 bytes} [Sat Jul 30 21:19:28 2022] DELETE /identity/v3/OS-INHERIT/projects/e5ecf602b60d4646b7d77ba847d4fa59/users/3e068311d4464358b37e6cb44442bb46/roles/acd2b7ae47cc450d83d1eb430fee515c/inherited_to_projects => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:28.762782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09569fea-78e2-4269-8a48-6eefbcb510ab tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:28.765184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-09569fea-78e2-4269-8a48-6eefbcb510ab tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:28.783635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09569fea-78e2-4269-8a48-6eefbcb510ab tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:28.822171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53029c-4ddf-42bb-b1f9-11f3b17602f4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:28.825082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1d53029c-4ddf-42bb-b1f9-11f3b17602f4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:28.909774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e1928-b3da-4f06-9c7c-6967ff2285d5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:28.910119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e1928-b3da-4f06-9c7c-6967ff2285d5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:28.911081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e1928-b3da-4f06-9c7c-6967ff2285d5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:28.911409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e1928-b3da-4f06-9c7c-6967ff2285d5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/roles/acd2b7ae47cc450d83d1eb430fee515c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:28.912897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e1928-b3da-4f06-9c7c-6967ff2285d5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:delete_role(role_id=acd2b7ae47cc450d83d1eb430fee515c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:28.914508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e1928-b3da-4f06-9c7c-6967ff2285d5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:28.966790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53029c-4ddf-42bb-b1f9-11f3b17602f4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:28.977862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b0398-56d0-4292-abad-eb6dad0a2361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:28.978551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b0398-56d0-4292-abad-eb6dad0a2361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:28.979091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b0398-56d0-4292-abad-eb6dad0a2361 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:28.979091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b0398-56d0-4292-abad-eb6dad0a2361 admin admin] PATH_INFO: `/v3/users/d94469966ff249bf8e774836f65e4658` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:28.980424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b0398-56d0-4292-abad-eb6dad0a2361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94469966ff249bf8e774836f65e4658)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:28.982455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b0398-56d0-4292-abad-eb6dad0a2361 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:29.017056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-474e1928-b3da-4f06-9c7c-6967ff2285d5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invalidating the token cache because role acd2b7ae47cc450d83d1eb430fee515c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:29.017454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-474e1928-b3da-4f06-9c7c-6967ff2285d5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:29.023758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-474e1928-b3da-4f06-9c7c-6967ff2285d5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:29.027237 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2518/5043] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:28 2022] DELETE /identity/v3/roles/acd2b7ae47cc450d83d1eb430fee515c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:29.028096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e1928-b3da-4f06-9c7c-6967ff2285d5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:29.033373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-474e1928-b3da-4f06-9c7c-6967ff2285d5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:29.071251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:29.135855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f90b0398-56d0-4292-abad-eb6dad0a2361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94469966ff249bf8e774836f65e4658'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:29.151980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e1928-b3da-4f06-9c7c-6967ff2285d5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:29.163027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f90b0398-56d0-4292-abad-eb6dad0a2361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94469966ff249bf8e774836f65e4658'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:29.163803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f90b0398-56d0-4292-abad-eb6dad0a2361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94469966ff249bf8e774836f65e4658'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:29.169335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01f1ae-3b04-4301-8bad-4efc426be13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:29.172578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01f1ae-3b04-4301-8bad-4efc426be13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:29.172725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f90b0398-56d0-4292-abad-eb6dad0a2361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94469966ff249bf8e774836f65e4658'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:29.173168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01f1ae-3b04-4301-8bad-4efc426be13a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:29.173325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f90b0398-56d0-4292-abad-eb6dad0a2361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94469966ff249bf8e774836f65e4658'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:29.173893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01f1ae-3b04-4301-8bad-4efc426be13a admin admin] PATH_INFO: `/v3/users/c4fc3f756d034b339878ee04f0469df0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:29.175633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01f1ae-3b04-4301-8bad-4efc426be13a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4fc3f756d034b339878ee04f0469df0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:29.179847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01f1ae-3b04-4301-8bad-4efc426be13a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:29.201932 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2526/5044] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:28 2022] DELETE /identity/v3/users/d94469966ff249bf8e774836f65e4658 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:19:29.202973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b0398-56d0-4292-abad-eb6dad0a2361 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:29.209180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f90b0398-56d0-4292-abad-eb6dad0a2361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:29.254915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:29.259863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3a01f1ae-3b04-4301-8bad-4efc426be13a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4fc3f756d034b339878ee04f0469df0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:29.262054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3a01f1ae-3b04-4301-8bad-4efc426be13a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4fc3f756d034b339878ee04f0469df0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:29.344471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b0398-56d0-4292-abad-eb6dad0a2361 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:29.346575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3a01f1ae-3b04-4301-8bad-4efc426be13a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4fc3f756d034b339878ee04f0469df0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:29.348537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3a01f1ae-3b04-4301-8bad-4efc426be13a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4fc3f756d034b339878ee04f0469df0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:29.352271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3170c3e-5c7b-4217-a95b-1ee13be3967c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:29.353405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3170c3e-5c7b-4217-a95b-1ee13be3967c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:29.353405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3170c3e-5c7b-4217-a95b-1ee13be3967c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:29.353900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3170c3e-5c7b-4217-a95b-1ee13be3967c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:29.355052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3170c3e-5c7b-4217-a95b-1ee13be3967c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:29.358847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3170c3e-5c7b-4217-a95b-1ee13be3967c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:29.362439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3a01f1ae-3b04-4301-8bad-4efc426be13a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4fc3f756d034b339878ee04f0469df0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:29.387787 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2527/5045] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:19:29 2022] POST /identity/v3/roles => generated 239 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:29.387787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43e287-d23b-4216-bb96-61ff7bcad52b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:29.387787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43e287-d23b-4216-bb96-61ff7bcad52b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:29.387787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43e287-d23b-4216-bb96-61ff7bcad52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:29.389886 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2519/5046] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:29 2022] DELETE /identity/v3/users/c4fc3f756d034b339878ee04f0469df0 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:29.391091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01f1ae-3b04-4301-8bad-4efc426be13a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:29.392894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3a01f1ae-3b04-4301-8bad-4efc426be13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:29.423475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5f43e287-d23b-4216-bb96-61ff7bcad52b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:29.424725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5f43e287-d23b-4216-bb96-61ff7bcad52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:29.523009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01f1ae-3b04-4301-8bad-4efc426be13a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:29.533889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5b210-7e8a-4846-a4c8-a8ef45b161a0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:29.534760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5b210-7e8a-4846-a4c8-a8ef45b161a0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:29.535058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5b210-7e8a-4846-a4c8-a8ef45b161a0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:29.536764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5b210-7e8a-4846-a4c8-a8ef45b161a0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/82e8951aecca41af8ef6bc4a528a4fa0/groups/df1d82591d85452493710111215ddba1/roles/f87b98e001a74357a8d4faad8d3c6c0d/inherited_to_projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:29.538868 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2528/5047] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:29.543081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5b210-7e8a-4846-a4c8-a8ef45b161a0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=82e8951aecca41af8ef6bc4a528a4fa0, group_id=df1d82591d85452493710111215ddba1, role_id=f87b98e001a74357a8d4faad8d3c6c0d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:29.549558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43e287-d23b-4216-bb96-61ff7bcad52b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:29.551592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5f43e287-d23b-4216-bb96-61ff7bcad52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:29.556648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5b210-7e8a-4846-a4c8-a8ef45b161a0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:29.579015 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2520/5048] 10.222.0.17 () {60 vars in 1582 bytes} [Sat Jul 30 21:19:29 2022] PUT /identity/v3/OS-INHERIT/domains/82e8951aecca41af8ef6bc4a528a4fa0/groups/df1d82591d85452493710111215ddba1/roles/f87b98e001a74357a8d4faad8d3c6c0d/inherited_to_projects => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:29.584796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5b210-7e8a-4846-a4c8-a8ef45b161a0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:29.652130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43e287-d23b-4216-bb96-61ff7bcad52b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:29.689502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:29.772872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531040b2-2cbc-44b2-b9a4-411e46ce4794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:29.773641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531040b2-2cbc-44b2-b9a4-411e46ce4794 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:29.773933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531040b2-2cbc-44b2-b9a4-411e46ce4794 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:29.774209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531040b2-2cbc-44b2-b9a4-411e46ce4794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:29.776088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5b210-7e8a-4846-a4c8-a8ef45b161a0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:29.800046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb2f06-b7ce-413e-b53d-08c79f6604c1 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:29.801385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb2f06-b7ce-413e-b53d-08c79f6604c1 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:29.801764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb2f06-b7ce-413e-b53d-08c79f6604c1 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:29.802175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb2f06-b7ce-413e-b53d-08c79f6604c1 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/82e8951aecca41af8ef6bc4a528a4fa0/groups/df1d82591d85452493710111215ddba1/roles/inherited_to_projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:29.804920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb2f06-b7ce-413e-b53d-08c79f6604c1 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=82e8951aecca41af8ef6bc4a528a4fa0, group_id=df1d82591d85452493710111215ddba1)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:29.806677 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-02cb2f06-b7ce-413e-b53d-08c79f6604c1 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:29.806677 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:19:29.806677 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:19:29.808843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb2f06-b7ce-413e-b53d-08c79f6604c1 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:29.851927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:29.864574 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2521/5049] 10.222.0.17 () {58 vars in 1464 bytes} [Sat Jul 30 21:19:29 2022] GET /identity/v3/OS-INHERIT/domains/82e8951aecca41af8ef6bc4a528a4fa0/groups/df1d82591d85452493710111215ddba1/roles/inherited_to_projects => generated 447 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:29.865742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb2f06-b7ce-413e-b53d-08c79f6604c1 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:29.869934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-02cb2f06-b7ce-413e-b53d-08c79f6604c1 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:29.939035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531040b2-2cbc-44b2-b9a4-411e46ce4794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:29.940632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531040b2-2cbc-44b2-b9a4-411e46ce4794 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:29.958197 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2529/5050] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:19:29.960781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531040b2-2cbc-44b2-b9a4-411e46ce4794 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:30.002686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531040b2-2cbc-44b2-b9a4-411e46ce4794 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:30.024693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd27f7-f10f-4850-90e1-7eb2d9ad69d0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:30.025950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd27f7-f10f-4850-90e1-7eb2d9ad69d0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:30.026395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd27f7-f10f-4850-90e1-7eb2d9ad69d0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:30.026732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd27f7-f10f-4850-90e1-7eb2d9ad69d0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/82e8951aecca41af8ef6bc4a528a4fa0/groups/df1d82591d85452493710111215ddba1/roles/f87b98e001a74357a8d4faad8d3c6c0d/inherited_to_projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:30.027067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb2f06-b7ce-413e-b53d-08c79f6604c1 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:30.031212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd27f7-f10f-4850-90e1-7eb2d9ad69d0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=82e8951aecca41af8ef6bc4a528a4fa0, group_id=df1d82591d85452493710111215ddba1, role_id=f87b98e001a74357a8d4faad8d3c6c0d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:30.034424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd27f7-f10f-4850-90e1-7eb2d9ad69d0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:30.037916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1965487-5cfc-496e-bb9c-2a491499419d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:30.038710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1965487-5cfc-496e-bb9c-2a491499419d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:30.039250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1965487-5cfc-496e-bb9c-2a491499419d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:30.039714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1965487-5cfc-496e-bb9c-2a491499419d admin admin] PATH_INFO: `/v3/projects/a2471207e4614f369934b1723545d1f3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:30.041103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1965487-5cfc-496e-bb9c-2a491499419d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2471207e4614f369934b1723545d1f3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:30.044021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1965487-5cfc-496e-bb9c-2a491499419d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:30.046453 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2530/5051] 10.222.0.17 () {58 vars in 1564 bytes} [Sat Jul 30 21:19:29 2022] HEAD /identity/v3/OS-INHERIT/domains/82e8951aecca41af8ef6bc4a528a4fa0/groups/df1d82591d85452493710111215ddba1/roles/f87b98e001a74357a8d4faad8d3c6c0d/inherited_to_projects => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:30.051783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd27f7-f10f-4850-90e1-7eb2d9ad69d0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:30.063276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd27f7-f10f-4850-90e1-7eb2d9ad69d0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:30.071209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be79f73-5d13-4cc7-ab59-910573607cdb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:30.072037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be79f73-5d13-4cc7-ab59-910573607cdb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:30.072339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be79f73-5d13-4cc7-ab59-910573607cdb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:30.072621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be79f73-5d13-4cc7-ab59-910573607cdb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/82e8951aecca41af8ef6bc4a528a4fa0/groups/df1d82591d85452493710111215ddba1/roles/f87b98e001a74357a8d4faad8d3c6c0d/inherited_to_projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:30.077599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be79f73-5d13-4cc7-ab59-910573607cdb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=82e8951aecca41af8ef6bc4a528a4fa0, group_id=df1d82591d85452493710111215ddba1, role_id=f87b98e001a74357a8d4faad8d3c6c0d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:30.080674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be79f73-5d13-4cc7-ab59-910573607cdb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:30.089962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4be79f73-5d13-4cc7-ab59-910573607cdb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invalidating the token cache because role f87b98e001a74357a8d4faad8d3c6c0d was removed from group df1d82591d85452493710111215ddba1 on domain 82e8951aecca41af8ef6bc4a528a4fa0. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:30.090291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4be79f73-5d13-4cc7-ab59-910573607cdb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:30.091120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4be79f73-5d13-4cc7-ab59-910573607cdb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:30.109172 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2531/5052] 10.222.0.17 () {58 vars in 1566 bytes} [Sat Jul 30 21:19:30 2022] DELETE /identity/v3/OS-INHERIT/domains/82e8951aecca41af8ef6bc4a528a4fa0/groups/df1d82591d85452493710111215ddba1/roles/f87b98e001a74357a8d4faad8d3c6c0d/inherited_to_projects => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:19:30.115228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be79f73-5d13-4cc7-ab59-910573607cdb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:30.118360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4be79f73-5d13-4cc7-ab59-910573607cdb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:30.124225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f1965487-5cfc-496e-bb9c-2a491499419d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2471207e4614f369934b1723545d1f3', 'request_id': 'req-f1965487-5cfc-496e-bb9c-2a491499419d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:30.134409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f1965487-5cfc-496e-bb9c-2a491499419d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2471207e4614f369934b1723545d1f3', 'request_id': 'req-f1965487-5cfc-496e-bb9c-2a491499419d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:30.141182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f1965487-5cfc-496e-bb9c-2a491499419d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2471207e4614f369934b1723545d1f3', 'request_id': 'req-f1965487-5cfc-496e-bb9c-2a491499419d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:30.172926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f1965487-5cfc-496e-bb9c-2a491499419d admin admin] The token cache is being invalidate because project a2471207e4614f369934b1723545d1f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:30.173276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f1965487-5cfc-496e-bb9c-2a491499419d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:30.179116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f1965487-5cfc-496e-bb9c-2a491499419d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:30.181538 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2522/5053] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:29 2022] DELETE /identity/v3/projects/a2471207e4614f369934b1723545d1f3 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:30.187643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1965487-5cfc-496e-bb9c-2a491499419d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:30.189751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f1965487-5cfc-496e-bb9c-2a491499419d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:30.263628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be79f73-5d13-4cc7-ab59-910573607cdb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:30.271947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217a1b9-7f8d-4c2a-9bc7-ee4621975155 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:30.273421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217a1b9-7f8d-4c2a-9bc7-ee4621975155 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:30.273957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217a1b9-7f8d-4c2a-9bc7-ee4621975155 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:30.274733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217a1b9-7f8d-4c2a-9bc7-ee4621975155 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/roles/f87b98e001a74357a8d4faad8d3c6c0d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:30.276803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217a1b9-7f8d-4c2a-9bc7-ee4621975155 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f87b98e001a74357a8d4faad8d3c6c0d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:30.278807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217a1b9-7f8d-4c2a-9bc7-ee4621975155 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:30.339642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:30.350255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e217a1b9-7f8d-4c2a-9bc7-ee4621975155 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invalidating the token cache because role f87b98e001a74357a8d4faad8d3c6c0d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:30.351224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e217a1b9-7f8d-4c2a-9bc7-ee4621975155 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:30.354068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e217a1b9-7f8d-4c2a-9bc7-ee4621975155 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:30.361909 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2532/5054] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:30 2022] DELETE /identity/v3/roles/f87b98e001a74357a8d4faad8d3c6c0d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:30.362948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217a1b9-7f8d-4c2a-9bc7-ee4621975155 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:30.365384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e217a1b9-7f8d-4c2a-9bc7-ee4621975155 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:30.381034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1965487-5cfc-496e-bb9c-2a491499419d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:30.544854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:30.546056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3d900-3f6d-4841-a99b-26b5b7d5cea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:30.547622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3d900-3f6d-4841-a99b-26b5b7d5cea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:30.547622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3d900-3f6d-4841-a99b-26b5b7d5cea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:30.547622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3d900-3f6d-4841-a99b-26b5b7d5cea0 admin admin] PATH_INFO: `/v3/users/bc511889bc8746918744f88856db87fe` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:30.550533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3d900-3f6d-4841-a99b-26b5b7d5cea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc511889bc8746918744f88856db87fe)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:30.554388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3d900-3f6d-4841-a99b-26b5b7d5cea0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:30.554712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217a1b9-7f8d-4c2a-9bc7-ee4621975155 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:30.562798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbfdb7-b7a3-4585-8098-b86951931d2d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:30.567122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbfdb7-b7a3-4585-8098-b86951931d2d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:30.568346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbfdb7-b7a3-4585-8098-b86951931d2d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:30.568748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbfdb7-b7a3-4585-8098-b86951931d2d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:30.569640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbfdb7-b7a3-4585-8098-b86951931d2d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:30.572048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbfdb7-b7a3-4585-8098-b86951931d2d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:30.636853 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2533/5055] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:19:30 2022] POST /identity/v3/roles => generated 239 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:30.638038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbfdb7-b7a3-4585-8098-b86951931d2d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:30.643761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-dafbfdb7-b7a3-4585-8098-b86951931d2d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:30.671429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbfdb7-b7a3-4585-8098-b86951931d2d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:30.681345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44359517-9bcc-4235-8874-d0143e52eaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:30.682448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44359517-9bcc-4235-8874-d0143e52eaec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:30.682936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44359517-9bcc-4235-8874-d0143e52eaec admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:30.683681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44359517-9bcc-4235-8874-d0143e52eaec admin admin] PATH_INFO: `/v3/projects/7ae391c8485c4c4798315492f26b1e5d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:30.687053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44359517-9bcc-4235-8874-d0143e52eaec admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ae391c8485c4c4798315492f26b1e5d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:30.687898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8ca3d900-3f6d-4841-a99b-26b5b7d5cea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc511889bc8746918744f88856db87fe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:30.688618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8ca3d900-3f6d-4841-a99b-26b5b7d5cea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc511889bc8746918744f88856db87fe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:30.691351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44359517-9bcc-4235-8874-d0143e52eaec admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:30.719471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8ca3d900-3f6d-4841-a99b-26b5b7d5cea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc511889bc8746918744f88856db87fe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:30.720504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8ca3d900-3f6d-4841-a99b-26b5b7d5cea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc511889bc8746918744f88856db87fe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:30.748027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8ca3d900-3f6d-4841-a99b-26b5b7d5cea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc511889bc8746918744f88856db87fe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:30.789460 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2523/5056] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:30 2022] DELETE /identity/v3/users/bc511889bc8746918744f88856db87fe => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:30.789460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3d900-3f6d-4841-a99b-26b5b7d5cea0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:30.789460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8ca3d900-3f6d-4841-a99b-26b5b7d5cea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:30.849326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-44359517-9bcc-4235-8874-d0143e52eaec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ae391c8485c4c4798315492f26b1e5d', 'request_id': 'req-44359517-9bcc-4235-8874-d0143e52eaec'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:30.870351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-44359517-9bcc-4235-8874-d0143e52eaec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ae391c8485c4c4798315492f26b1e5d', 'request_id': 'req-44359517-9bcc-4235-8874-d0143e52eaec'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:30.894111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-44359517-9bcc-4235-8874-d0143e52eaec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ae391c8485c4c4798315492f26b1e5d', 'request_id': 'req-44359517-9bcc-4235-8874-d0143e52eaec'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:30.915002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3d900-3f6d-4841-a99b-26b5b7d5cea0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:30.918441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-44359517-9bcc-4235-8874-d0143e52eaec admin admin] The token cache is being invalidate because project 7ae391c8485c4c4798315492f26b1e5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:30.918441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-44359517-9bcc-4235-8874-d0143e52eaec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:30.919528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-44359517-9bcc-4235-8874-d0143e52eaec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:30.920184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c94dd-2ef6-4fe9-9895-229174d2153e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:30.920973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c94dd-2ef6-4fe9-9895-229174d2153e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:30.921270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c94dd-2ef6-4fe9-9895-229174d2153e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:30.921641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c94dd-2ef6-4fe9-9895-229174d2153e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/82e8951aecca41af8ef6bc4a528a4fa0/users/3e068311d4464358b37e6cb44442bb46/roles/fc0b7e102a794cc2afc8615893f202d3/inherited_to_projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:30.924203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c94dd-2ef6-4fe9-9895-229174d2153e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=82e8951aecca41af8ef6bc4a528a4fa0, user_id=3e068311d4464358b37e6cb44442bb46, role_id=fc0b7e102a794cc2afc8615893f202d3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:30.924913 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2534/5057] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:30 2022] DELETE /identity/v3/projects/7ae391c8485c4c4798315492f26b1e5d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:30.927061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021170f-9e61-46d2-b5eb-c37d68c1a082 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:30.927536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021170f-9e61-46d2-b5eb-c37d68c1a082 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:30.928334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c94dd-2ef6-4fe9-9895-229174d2153e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:30.928473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021170f-9e61-46d2-b5eb-c37d68c1a082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:30.972146 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2524/5058] 10.222.0.17 () {60 vars in 1579 bytes} [Sat Jul 30 21:19:30 2022] PUT /identity/v3/OS-INHERIT/domains/82e8951aecca41af8ef6bc4a528a4fa0/users/3e068311d4464358b37e6cb44442bb46/roles/fc0b7e102a794cc2afc8615893f202d3/inherited_to_projects => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:30.979578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c94dd-2ef6-4fe9-9895-229174d2153e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:30.980870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a021170f-9e61-46d2-b5eb-c37d68c1a082 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:30.983279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a021170f-9e61-46d2-b5eb-c37d68c1a082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:30.985264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7a0c94dd-2ef6-4fe9-9895-229174d2153e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:31.030387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:31.174510 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2535/5059] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:31.192581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e49c8-04a4-43e6-8712-e27d53e6f97e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:31.193707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e49c8-04a4-43e6-8712-e27d53e6f97e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:31.194803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e49c8-04a4-43e6-8712-e27d53e6f97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:31.194942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c94dd-2ef6-4fe9-9895-229174d2153e tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:31.215627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ded28-88a8-4591-9751-5bfcb192fae4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:31.216615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ded28-88a8-4591-9751-5bfcb192fae4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:31.217185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ded28-88a8-4591-9751-5bfcb192fae4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:31.218098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ded28-88a8-4591-9751-5bfcb192fae4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/82e8951aecca41af8ef6bc4a528a4fa0/users/3e068311d4464358b37e6cb44442bb46/roles/inherited_to_projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:31.220297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ded28-88a8-4591-9751-5bfcb192fae4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=82e8951aecca41af8ef6bc4a528a4fa0, user_id=3e068311d4464358b37e6cb44442bb46)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:31.225255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ded28-88a8-4591-9751-5bfcb192fae4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:31.257843 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2525/5060] 10.222.0.17 () {58 vars in 1461 bytes} [Sat Jul 30 21:19:30 2022] GET /identity/v3/OS-INHERIT/domains/82e8951aecca41af8ef6bc4a528a4fa0/users/3e068311d4464358b37e6cb44442bb46/roles/inherited_to_projects => generated 446 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:31.257843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ded28-88a8-4591-9751-5bfcb192fae4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:31.259669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6d6ded28-88a8-4591-9751-5bfcb192fae4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:31.277838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b59e49c8-04a4-43e6-8712-e27d53e6f97e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:31.284769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ded28-88a8-4591-9751-5bfcb192fae4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:31.285109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b59e49c8-04a4-43e6-8712-e27d53e6f97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:31.292276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9b720-3161-4955-b1ca-4b33ded80fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:31.293455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9b720-3161-4955-b1ca-4b33ded80fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:31.293758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9b720-3161-4955-b1ca-4b33ded80fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:31.294110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9b720-3161-4955-b1ca-4b33ded80fa0 admin admin] PATH_INFO: `/v3/projects/02630ca446a44e888f364be7e0668001` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:31.295380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9b720-3161-4955-b1ca-4b33ded80fa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02630ca446a44e888f364be7e0668001)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:31.297322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9b720-3161-4955-b1ca-4b33ded80fa0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:31.308808 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2536/5061] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:31.310014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e49c8-04a4-43e6-8712-e27d53e6f97e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:31.325415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e49c8-04a4-43e6-8712-e27d53e6f97e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:31.333385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25203a-dab4-4e95-b75c-fc34f4f95845 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:31.335042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25203a-dab4-4e95-b75c-fc34f4f95845 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:31.335381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25203a-dab4-4e95-b75c-fc34f4f95845 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:31.336542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25203a-dab4-4e95-b75c-fc34f4f95845 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/82e8951aecca41af8ef6bc4a528a4fa0/users/3e068311d4464358b37e6cb44442bb46/roles/fc0b7e102a794cc2afc8615893f202d3/inherited_to_projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:31.339923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25203a-dab4-4e95-b75c-fc34f4f95845 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=82e8951aecca41af8ef6bc4a528a4fa0, user_id=3e068311d4464358b37e6cb44442bb46, role_id=fc0b7e102a794cc2afc8615893f202d3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:31.346049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25203a-dab4-4e95-b75c-fc34f4f95845 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:31.382257 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2537/5062] 10.222.0.17 () {58 vars in 1561 bytes} [Sat Jul 30 21:19:31 2022] HEAD /identity/v3/OS-INHERIT/domains/82e8951aecca41af8ef6bc4a528a4fa0/users/3e068311d4464358b37e6cb44442bb46/roles/fc0b7e102a794cc2afc8615893f202d3/inherited_to_projects => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:31.386919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25203a-dab4-4e95-b75c-fc34f4f95845 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:31.421090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7be9b720-3161-4955-b1ca-4b33ded80fa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02630ca446a44e888f364be7e0668001', 'request_id': 'req-7be9b720-3161-4955-b1ca-4b33ded80fa0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:31.453356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7be9b720-3161-4955-b1ca-4b33ded80fa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02630ca446a44e888f364be7e0668001', 'request_id': 'req-7be9b720-3161-4955-b1ca-4b33ded80fa0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:31.455741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25203a-dab4-4e95-b75c-fc34f4f95845 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:31.464692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7be9b720-3161-4955-b1ca-4b33ded80fa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02630ca446a44e888f364be7e0668001', 'request_id': 'req-7be9b720-3161-4955-b1ca-4b33ded80fa0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:31.486103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7be9b720-3161-4955-b1ca-4b33ded80fa0 admin admin] The token cache is being invalidate because project 02630ca446a44e888f364be7e0668001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:31.486881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7be9b720-3161-4955-b1ca-4b33ded80fa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:31.488333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7be9b720-3161-4955-b1ca-4b33ded80fa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:31.494375 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2526/5063] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:31 2022] DELETE /identity/v3/projects/02630ca446a44e888f364be7e0668001 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:31.495512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9b720-3161-4955-b1ca-4b33ded80fa0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:31.498028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7be9b720-3161-4955-b1ca-4b33ded80fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:31.579022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:31.587489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba3498-c2e7-43b5-bc96-0d201ab5ed3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:31.588802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba3498-c2e7-43b5-bc96-0d201ab5ed3c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:31.589995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba3498-c2e7-43b5-bc96-0d201ab5ed3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:31.590450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba3498-c2e7-43b5-bc96-0d201ab5ed3c admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:31.592377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba3498-c2e7-43b5-bc96-0d201ab5ed3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:19:31.593525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba3498-c2e7-43b5-bc96-0d201ab5ed3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:31.596241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba3498-c2e7-43b5-bc96-0d201ab5ed3c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:31.616034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9b720-3161-4955-b1ca-4b33ded80fa0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:31.617947 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2538/5064] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:31.619229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f831ca-00f8-4ff3-8eaa-d083d27ebeea None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:31.619562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f831ca-00f8-4ff3-8eaa-d083d27ebeea None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:31.619844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f831ca-00f8-4ff3-8eaa-d083d27ebeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:31.627758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fee7f-ade7-4c50-8af2-6cad43febd7d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:31.628970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fee7f-ade7-4c50-8af2-6cad43febd7d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:31.629302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fee7f-ade7-4c50-8af2-6cad43febd7d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:31.629768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fee7f-ade7-4c50-8af2-6cad43febd7d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/82e8951aecca41af8ef6bc4a528a4fa0/users/3e068311d4464358b37e6cb44442bb46/roles/fc0b7e102a794cc2afc8615893f202d3/inherited_to_projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:31.633798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fee7f-ade7-4c50-8af2-6cad43febd7d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=82e8951aecca41af8ef6bc4a528a4fa0, user_id=3e068311d4464358b37e6cb44442bb46, role_id=fc0b7e102a794cc2afc8615893f202d3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:31.636867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fee7f-ade7-4c50-8af2-6cad43febd7d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:31.644446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-001fee7f-ade7-4c50-8af2-6cad43febd7d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invalidating the token cache because role fc0b7e102a794cc2afc8615893f202d3 was removed from user 3e068311d4464358b37e6cb44442bb46 on domain 82e8951aecca41af8ef6bc4a528a4fa0. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:31.645205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-001fee7f-ade7-4c50-8af2-6cad43febd7d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:31.646413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-001fee7f-ade7-4c50-8af2-6cad43febd7d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:31.650286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-31f831ca-00f8-4ff3-8eaa-d083d27ebeea None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:31.652448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-31f831ca-00f8-4ff3-8eaa-d083d27ebeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:31.673465 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2527/5065] 10.222.0.17 () {58 vars in 1563 bytes} [Sat Jul 30 21:19:31 2022] DELETE /identity/v3/OS-INHERIT/domains/82e8951aecca41af8ef6bc4a528a4fa0/users/3e068311d4464358b37e6cb44442bb46/roles/fc0b7e102a794cc2afc8615893f202d3/inherited_to_projects => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:31.673465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fee7f-ade7-4c50-8af2-6cad43febd7d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:31.673774 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2539/5066] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:31.675162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-001fee7f-ade7-4c50-8af2-6cad43febd7d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:31.677227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f831ca-00f8-4ff3-8eaa-d083d27ebeea None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:31.693062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-31f831ca-00f8-4ff3-8eaa-d083d27ebeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:31.718039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:31.727369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f831ca-00f8-4ff3-8eaa-d083d27ebeea None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:31.811518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fee7f-ade7-4c50-8af2-6cad43febd7d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:31.825612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a5331-8ca5-489c-91bc-7469873c11cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:31.826269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a5331-8ca5-489c-91bc-7469873c11cb admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:31.826831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a5331-8ca5-489c-91bc-7469873c11cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:31.827129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a5331-8ca5-489c-91bc-7469873c11cb admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:31.827896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a5331-8ca5-489c-91bc-7469873c11cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:31.830223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a5331-8ca5-489c-91bc-7469873c11cb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:31.860240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737b75b-b5e3-48f5-98d5-52c034321a60 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:31.860933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737b75b-b5e3-48f5-98d5-52c034321a60 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:31.861227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737b75b-b5e3-48f5-98d5-52c034321a60 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:31.861534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737b75b-b5e3-48f5-98d5-52c034321a60 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/roles/fc0b7e102a794cc2afc8615893f202d3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:31.864436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737b75b-b5e3-48f5-98d5-52c034321a60 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fc0b7e102a794cc2afc8615893f202d3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:31.866119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737b75b-b5e3-48f5-98d5-52c034321a60 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:31.879442 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2528/5067] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:31 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:31.881258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e6364-2bf7-4058-bde8-a86af507580a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:31.881594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e6364-2bf7-4058-bde8-a86af507580a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:31.881864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e6364-2bf7-4058-bde8-a86af507580a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:31.911627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bd9e6364-2bf7-4058-bde8-a86af507580a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:31.913153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bd9e6364-2bf7-4058-bde8-a86af507580a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:31.919891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1737b75b-b5e3-48f5-98d5-52c034321a60 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invalidating the token cache because role fc0b7e102a794cc2afc8615893f202d3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:31.920372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1737b75b-b5e3-48f5-98d5-52c034321a60 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:31.921937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1737b75b-b5e3-48f5-98d5-52c034321a60 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:31.924909 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2540/5068] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:31 2022] DELETE /identity/v3/roles/fc0b7e102a794cc2afc8615893f202d3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:31.925956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737b75b-b5e3-48f5-98d5-52c034321a60 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:31.930528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1737b75b-b5e3-48f5-98d5-52c034321a60 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:32.044982 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2529/5069] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:32.047725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e6364-2bf7-4058-bde8-a86af507580a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:32.049860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bd9e6364-2bf7-4058-bde8-a86af507580a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:32.087766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737b75b-b5e3-48f5-98d5-52c034321a60 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:32.096655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6da1f-e244-4d79-9287-b560aca5a92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:32.098075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6da1f-e244-4d79-9287-b560aca5a92e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:32.098249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6da1f-e244-4d79-9287-b560aca5a92e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:32.098572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6da1f-e244-4d79-9287-b560aca5a92e admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:32.099361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6da1f-e244-4d79-9287-b560aca5a92e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:32.101685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6da1f-e244-4d79-9287-b560aca5a92e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:32.154323 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2541/5070] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:31 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:32.156651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6da1f-e244-4d79-9287-b560aca5a92e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:32.187329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6da1f-e244-4d79-9287-b560aca5a92e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:32.205774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf240e5d-fe93-46bd-9a6c-d4c05ab1aab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:32.206463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf240e5d-fe93-46bd-9a6c-d4c05ab1aab3 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:32.206775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf240e5d-fe93-46bd-9a6c-d4c05ab1aab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:32.207106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf240e5d-fe93-46bd-9a6c-d4c05ab1aab3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:32.208007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf240e5d-fe93-46bd-9a6c-d4c05ab1aab3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:19:32.208316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf240e5d-fe93-46bd-9a6c-d4c05ab1aab3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:32.210548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf240e5d-fe93-46bd-9a6c-d4c05ab1aab3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:32.242052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e6364-2bf7-4058-bde8-a86af507580a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:32.253538 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2542/5071] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:32.255401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf240e5d-fe93-46bd-9a6c-d4c05ab1aab3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:32.275330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf240e5d-fe93-46bd-9a6c-d4c05ab1aab3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:32.282441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b519c-71b4-4f01-8d1c-99fffc0b9d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:32.283407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b519c-71b4-4f01-8d1c-99fffc0b9d33 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:32.283770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b519c-71b4-4f01-8d1c-99fffc0b9d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:32.284181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b519c-71b4-4f01-8d1c-99fffc0b9d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:32.285102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b519c-71b4-4f01-8d1c-99fffc0b9d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:32.287849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b519c-71b4-4f01-8d1c-99fffc0b9d33 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:32.305663 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2543/5072] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:32.307234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b519c-71b4-4f01-8d1c-99fffc0b9d33 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:32.325002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b519c-71b4-4f01-8d1c-99fffc0b9d33 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:32.335987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:32.338058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34aa79-eb9e-459a-8f8e-74c6f136acf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:32.339179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34aa79-eb9e-459a-8f8e-74c6f136acf0 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:32.339733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34aa79-eb9e-459a-8f8e-74c6f136acf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:32.340248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34aa79-eb9e-459a-8f8e-74c6f136acf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:32.341076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34aa79-eb9e-459a-8f8e-74c6f136acf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:32.344012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34aa79-eb9e-459a-8f8e-74c6f136acf0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:32.382788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:32.393543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364e368-c946-41b1-8dee-08d071e795f5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:32.394744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364e368-c946-41b1-8dee-08d071e795f5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:32.395545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364e368-c946-41b1-8dee-08d071e795f5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:32.395545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364e368-c946-41b1-8dee-08d071e795f5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:32.396345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364e368-c946-41b1-8dee-08d071e795f5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:32.398338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364e368-c946-41b1-8dee-08d071e795f5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:32.402068 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2544/5073] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:32 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:32.402978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34aa79-eb9e-459a-8f8e-74c6f136acf0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:32.428384 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2530/5074] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:19:32 2022] POST /identity/v3/roles => generated 239 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:32.432850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364e368-c946-41b1-8dee-08d071e795f5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:32.447136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364e368-c946-41b1-8dee-08d071e795f5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:32.516304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34aa79-eb9e-459a-8f8e-74c6f136acf0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:32.530216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62c60a-2b2b-451e-8a42-e16f004d6ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:32.530941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62c60a-2b2b-451e-8a42-e16f004d6ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:32.531355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62c60a-2b2b-451e-8a42-e16f004d6ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:32.531667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62c60a-2b2b-451e-8a42-e16f004d6ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:32.532649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62c60a-2b2b-451e-8a42-e16f004d6ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:32.534573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62c60a-2b2b-451e-8a42-e16f004d6ad5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:32.553137 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2545/5075] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:32 2022] GET /identity/v3/roles => generated 1650 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:32.554002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62c60a-2b2b-451e-8a42-e16f004d6ad5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:32.569999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860c579-934b-4161-9244-23a35ca291c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:32.572689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860c579-934b-4161-9244-23a35ca291c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:32.572689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860c579-934b-4161-9244-23a35ca291c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:32.572689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860c579-934b-4161-9244-23a35ca291c7 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:32.575350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860c579-934b-4161-9244-23a35ca291c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:32.575350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860c579-934b-4161-9244-23a35ca291c7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:32.608635 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2531/5076] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:32 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:32.609807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860c579-934b-4161-9244-23a35ca291c7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:32.638995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860c579-934b-4161-9244-23a35ca291c7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:32.650818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c18f6-b6d7-43c2-a774-b17ace333dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:32.653050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c18f6-b6d7-43c2-a774-b17ace333dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:32.654033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c18f6-b6d7-43c2-a774-b17ace333dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:32.654399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c18f6-b6d7-43c2-a774-b17ace333dc7 admin admin] PATH_INFO: `/v3/projects/1ba657cc1e8340da883099b39486582b/users/71c580205a4940afa7f4d1ede7073386/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:32.677110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c18f6-b6d7-43c2-a774-b17ace333dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ba657cc1e8340da883099b39486582b, user_id=71c580205a4940afa7f4d1ede7073386, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:32.682051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c18f6-b6d7-43c2-a774-b17ace333dc7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:32.686422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62c60a-2b2b-451e-8a42-e16f004d6ad5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:32.694744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3b094-03f2-4660-9262-852de2191033 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:32.694744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3b094-03f2-4660-9262-852de2191033 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:32.694744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3b094-03f2-4660-9262-852de2191033 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:32.695157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3b094-03f2-4660-9262-852de2191033 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:32.695763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3b094-03f2-4660-9262-852de2191033 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:32.698210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3b094-03f2-4660-9262-852de2191033 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:32.710219 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2532/5077] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:32 2022] PUT /identity/v3/projects/1ba657cc1e8340da883099b39486582b/users/71c580205a4940afa7f4d1ede7073386/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:32.713856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c18f6-b6d7-43c2-a774-b17ace333dc7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:32.770627 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2546/5078] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:32 2022] POST /identity/v3/projects => generated 410 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:32.773642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad2d39-a0bc-4a1b-869e-d54c3807b69a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:32.774067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad2d39-a0bc-4a1b-869e-d54c3807b69a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:32.774361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad2d39-a0bc-4a1b-869e-d54c3807b69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:32.829124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d1ad2d39-a0bc-4a1b-869e-d54c3807b69a None None] MFA Rules not processed for user `71c580205a4940afa7f4d1ede7073386`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:32.830972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d1ad2d39-a0bc-4a1b-869e-d54c3807b69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:32.893759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c18f6-b6d7-43c2-a774-b17ace333dc7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:32.968665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:32.987750 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2547/5079] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:32.992354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad2d39-a0bc-4a1b-869e-d54c3807b69a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:32.997715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:33.043240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68351ee4-df52-440d-be43-449079066357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:33.043978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68351ee4-df52-440d-be43-449079066357 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:33.044265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68351ee4-df52-440d-be43-449079066357 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:33.044544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68351ee4-df52-440d-be43-449079066357 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:33.045320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68351ee4-df52-440d-be43-449079066357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:33.047009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68351ee4-df52-440d-be43-449079066357 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:33.063971 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2533/5080] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:32 2022] GET /identity/v3/roles => generated 1650 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:33.065010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68351ee4-df52-440d-be43-449079066357 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:33.067460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-68351ee4-df52-440d-be43-449079066357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:33.134233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad2d39-a0bc-4a1b-869e-d54c3807b69a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:33.144545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf8717-8efb-4c92-8ae6-bce888e03140 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:33.145798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf8717-8efb-4c92-8ae6-bce888e03140 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:33.145990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf8717-8efb-4c92-8ae6-bce888e03140 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:33.146269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf8717-8efb-4c92-8ae6-bce888e03140 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/82e8951aecca41af8ef6bc4a528a4fa0/users/3e068311d4464358b37e6cb44442bb46/roles/eff66dcf13454eaa987db294768da024/inherited_to_projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:33.150579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf8717-8efb-4c92-8ae6-bce888e03140 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=82e8951aecca41af8ef6bc4a528a4fa0, user_id=3e068311d4464358b37e6cb44442bb46, role_id=eff66dcf13454eaa987db294768da024)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:33.153337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf8717-8efb-4c92-8ae6-bce888e03140 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:33.172902 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2548/5081] 10.222.0.17 () {60 vars in 1579 bytes} [Sat Jul 30 21:19:32 2022] PUT /identity/v3/OS-INHERIT/domains/82e8951aecca41af8ef6bc4a528a4fa0/users/3e068311d4464358b37e6cb44442bb46/roles/eff66dcf13454eaa987db294768da024/inherited_to_projects => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:33.173783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf8717-8efb-4c92-8ae6-bce888e03140 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:33.181943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68351ee4-df52-440d-be43-449079066357 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:33.340900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea5255-19ec-4065-9c73-5b0941d582c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:33.341638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea5255-19ec-4065-9c73-5b0941d582c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:33.342013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea5255-19ec-4065-9c73-5b0941d582c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:33.343725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea5255-19ec-4065-9c73-5b0941d582c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:33.352697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf8717-8efb-4c92-8ae6-bce888e03140 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:33.358761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cd87a-4936-417b-8990-24c27f8b8591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:33.359775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cd87a-4936-417b-8990-24c27f8b8591 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:33.361248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cd87a-4936-417b-8990-24c27f8b8591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:33.361442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cd87a-4936-417b-8990-24c27f8b8591 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:33.362306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cd87a-4936-417b-8990-24c27f8b8591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:33.364901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cd87a-4936-417b-8990-24c27f8b8591 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:33.400478 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2549/5082] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:33 2022] GET /identity/v3/roles => generated 1650 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:33.400478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cd87a-4936-417b-8990-24c27f8b8591 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:33.475074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea5255-19ec-4065-9c73-5b0941d582c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:33.479325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea5255-19ec-4065-9c73-5b0941d582c9 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:33.506139 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2534/5083] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:19:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:19:33.508179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea5255-19ec-4065-9c73-5b0941d582c9 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:33.525073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea5255-19ec-4065-9c73-5b0941d582c9 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:33.532340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c695a-8fa2-40d4-b2b7-2b7216f8e133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:33.533179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c695a-8fa2-40d4-b2b7-2b7216f8e133 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:33.533460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c695a-8fa2-40d4-b2b7-2b7216f8e133 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:33.533742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c695a-8fa2-40d4-b2b7-2b7216f8e133 admin admin] PATH_INFO: `/v3/projects/d1dfadc4695d4ebbb3cd887d9c0fc95f/users/ab9b5bcec45242d583f09a8aca6d89c3/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:33.552558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cd87a-4936-417b-8990-24c27f8b8591 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:33.561969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae201468-1965-40ed-ae8e-92358c9373fb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:33.562756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae201468-1965-40ed-ae8e-92358c9373fb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:33.563415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae201468-1965-40ed-ae8e-92358c9373fb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:33.564593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae201468-1965-40ed-ae8e-92358c9373fb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:33.565540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae201468-1965-40ed-ae8e-92358c9373fb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Adding query filter params (scope.project.id=e5ecf602b60d4646b7d77ba847d4fa59, user.id=3e068311d4464358b37e6cb44442bb46) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:19:33.565958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae201468-1965-40ed-ae8e-92358c9373fb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:33.566581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c695a-8fa2-40d4-b2b7-2b7216f8e133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1dfadc4695d4ebbb3cd887d9c0fc95f, user_id=ab9b5bcec45242d583f09a8aca6d89c3, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:33.567454 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-ae201468-1965-40ed-ae8e-92358c9373fb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:33.567454 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:19:33.567454 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:19:33.568989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae201468-1965-40ed-ae8e-92358c9373fb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:33.570114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c695a-8fa2-40d4-b2b7-2b7216f8e133 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:33.612283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:33.627502 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2535/5084] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:33 2022] PUT /identity/v3/projects/d1dfadc4695d4ebbb3cd887d9c0fc95f/users/ab9b5bcec45242d583f09a8aca6d89c3/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:33.642305 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2550/5085] 10.222.0.17 () {58 vars in 1356 bytes} [Sat Jul 30 21:19:33 2022] GET /identity/v3/role_assignments?scope.project.id=e5ecf602b60d4646b7d77ba847d4fa59&user.id=3e068311d4464358b37e6cb44442bb46&effective => generated 648 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:33.642527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d126462-efcb-4f21-9de6-d4aa397107c4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:33.642857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d126462-efcb-4f21-9de6-d4aa397107c4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:33.645042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae201468-1965-40ed-ae8e-92358c9373fb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:33.645816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d126462-efcb-4f21-9de6-d4aa397107c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:33.657964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae201468-1965-40ed-ae8e-92358c9373fb tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:33.705233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3d126462-efcb-4f21-9de6-d4aa397107c4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:33.708088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3d126462-efcb-4f21-9de6-d4aa397107c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:33.838590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303af9d-1cbe-4721-95e9-6ffc80981c1f tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:33.840748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303af9d-1cbe-4721-95e9-6ffc80981c1f tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:33.841316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303af9d-1cbe-4721-95e9-6ffc80981c1f tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:33.841816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303af9d-1cbe-4721-95e9-6ffc80981c1f tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:33.843414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303af9d-1cbe-4721-95e9-6ffc80981c1f tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Adding query filter params (scope.project.id=625fc4104e7d4fb69430b60225d84346, user.id=3e068311d4464358b37e6cb44442bb46) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:19:33.844144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303af9d-1cbe-4721-95e9-6ffc80981c1f tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:33.846314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303af9d-1cbe-4721-95e9-6ffc80981c1f tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:33.891862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:33.997645 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2551/5086] 10.222.0.17 () {58 vars in 1356 bytes} [Sat Jul 30 21:19:33 2022] GET /identity/v3/role_assignments?scope.project.id=625fc4104e7d4fb69430b60225d84346&user.id=3e068311d4464358b37e6cb44442bb46&effective => generated 648 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:34.005949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303af9d-1cbe-4721-95e9-6ffc80981c1f tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:34.007745 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2536/5087] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:34.018799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d126462-efcb-4f21-9de6-d4aa397107c4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:34.021336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3d126462-efcb-4f21-9de6-d4aa397107c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:34.037506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303af9d-1cbe-4721-95e9-6ffc80981c1f tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:34.050047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52317b98-77cb-492f-9487-124973e7362d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:34.051698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52317b98-77cb-492f-9487-124973e7362d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:34.052202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52317b98-77cb-492f-9487-124973e7362d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:34.052687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52317b98-77cb-492f-9487-124973e7362d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/82e8951aecca41af8ef6bc4a528a4fa0/users/3e068311d4464358b37e6cb44442bb46/roles/eff66dcf13454eaa987db294768da024/inherited_to_projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:34.055831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52317b98-77cb-492f-9487-124973e7362d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=82e8951aecca41af8ef6bc4a528a4fa0, user_id=3e068311d4464358b37e6cb44442bb46, role_id=eff66dcf13454eaa987db294768da024)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:34.060057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52317b98-77cb-492f-9487-124973e7362d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:34.069187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-52317b98-77cb-492f-9487-124973e7362d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invalidating the token cache because role eff66dcf13454eaa987db294768da024 was removed from user 3e068311d4464358b37e6cb44442bb46 on domain 82e8951aecca41af8ef6bc4a528a4fa0. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:34.069919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-52317b98-77cb-492f-9487-124973e7362d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:34.071075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-52317b98-77cb-492f-9487-124973e7362d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:34.106504 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2552/5088] 10.222.0.17 () {58 vars in 1563 bytes} [Sat Jul 30 21:19:34 2022] DELETE /identity/v3/OS-INHERIT/domains/82e8951aecca41af8ef6bc4a528a4fa0/users/3e068311d4464358b37e6cb44442bb46/roles/eff66dcf13454eaa987db294768da024/inherited_to_projects => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:19:34.111141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52317b98-77cb-492f-9487-124973e7362d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:34.113115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-52317b98-77cb-492f-9487-124973e7362d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:34.213784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d126462-efcb-4f21-9de6-d4aa397107c4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:34.294799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52317b98-77cb-492f-9487-124973e7362d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:34.303930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200e2a8-a579-4513-a683-752bd72cac3c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:34.304761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200e2a8-a579-4513-a683-752bd72cac3c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:34.305063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200e2a8-a579-4513-a683-752bd72cac3c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:34.305351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200e2a8-a579-4513-a683-752bd72cac3c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:34.306601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200e2a8-a579-4513-a683-752bd72cac3c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Adding query filter params (scope.project.id=e5ecf602b60d4646b7d77ba847d4fa59, user.id=3e068311d4464358b37e6cb44442bb46) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:19:34.308028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200e2a8-a579-4513-a683-752bd72cac3c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:34.319115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200e2a8-a579-4513-a683-752bd72cac3c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:34.336314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e1164-43de-4591-a4e1-e5a7d7058bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:34.336786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e1164-43de-4591-a4e1-e5a7d7058bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:34.337183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e1164-43de-4591-a4e1-e5a7d7058bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:34.337675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e1164-43de-4591-a4e1-e5a7d7058bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:34.341805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-478e1164-43de-4591-a4e1-e5a7d7058bf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:34.425410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:34.489492 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2553/5089] 10.222.0.17 () {58 vars in 1356 bytes} [Sat Jul 30 21:19:34 2022] GET /identity/v3/role_assignments?scope.project.id=e5ecf602b60d4646b7d77ba847d4fa59&user.id=3e068311d4464358b37e6cb44442bb46&effective => generated 228 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:34.505381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200e2a8-a579-4513-a683-752bd72cac3c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:34.534818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200e2a8-a579-4513-a683-752bd72cac3c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:34.549494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be82e66-6fe3-484b-bad8-cdf88a3fa620 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:34.550157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be82e66-6fe3-484b-bad8-cdf88a3fa620 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:34.550423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be82e66-6fe3-484b-bad8-cdf88a3fa620 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:34.551220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be82e66-6fe3-484b-bad8-cdf88a3fa620 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:34.554746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be82e66-6fe3-484b-bad8-cdf88a3fa620 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Adding query filter params (scope.project.id=625fc4104e7d4fb69430b60225d84346, user.id=3e068311d4464358b37e6cb44442bb46) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:19:34.555115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be82e66-6fe3-484b-bad8-cdf88a3fa620 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:34.564489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be82e66-6fe3-484b-bad8-cdf88a3fa620 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:34.619445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e1164-43de-4591-a4e1-e5a7d7058bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:34.623772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e1164-43de-4591-a4e1-e5a7d7058bf0 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:34.661674 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2537/5090] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:19:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:19:34.663060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4f51a-037a-4596-80e4-6b7f3762ace2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:34.663440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4f51a-037a-4596-80e4-6b7f3762ace2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:34.664199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4f51a-037a-4596-80e4-6b7f3762ace2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:34.693935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b0a4f51a-037a-4596-80e4-6b7f3762ace2 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:34.696156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b0a4f51a-037a-4596-80e4-6b7f3762ace2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:34.734343 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2554/5091] 10.222.0.17 () {58 vars in 1356 bytes} [Sat Jul 30 21:19:34 2022] GET /identity/v3/role_assignments?scope.project.id=625fc4104e7d4fb69430b60225d84346&user.id=3e068311d4464358b37e6cb44442bb46&effective => generated 228 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:34.742429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be82e66-6fe3-484b-bad8-cdf88a3fa620 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:34.784875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be82e66-6fe3-484b-bad8-cdf88a3fa620 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:34.804526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:34.827143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb659b3b-4502-451c-8de1-f9f8923639ad tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:34.830480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb659b3b-4502-451c-8de1-f9f8923639ad tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:34.830857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb659b3b-4502-451c-8de1-f9f8923639ad tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:34.831199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb659b3b-4502-451c-8de1-f9f8923639ad tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/projects/625fc4104e7d4fb69430b60225d84346` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:34.836482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb659b3b-4502-451c-8de1-f9f8923639ad tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:delete_project(project_id=625fc4104e7d4fb69430b60225d84346)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:34.839760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb659b3b-4502-451c-8de1-f9f8923639ad tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:34.867526 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2538/5092] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:19:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:34.925580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4f51a-037a-4596-80e4-6b7f3762ace2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:34.928454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b0a4f51a-037a-4596-80e4-6b7f3762ace2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:34.981031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb659b3b-4502-451c-8de1-f9f8923639ad tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '625fc4104e7d4fb69430b60225d84346', 'request_id': 'req-fb659b3b-4502-451c-8de1-f9f8923639ad'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:35.002505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb659b3b-4502-451c-8de1-f9f8923639ad tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '625fc4104e7d4fb69430b60225d84346', 'request_id': 'req-fb659b3b-4502-451c-8de1-f9f8923639ad'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:35.041164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb659b3b-4502-451c-8de1-f9f8923639ad tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '625fc4104e7d4fb69430b60225d84346', 'request_id': 'req-fb659b3b-4502-451c-8de1-f9f8923639ad'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:35.065716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb659b3b-4502-451c-8de1-f9f8923639ad tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] The token cache is being invalidate because project 625fc4104e7d4fb69430b60225d84346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:35.068675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb659b3b-4502-451c-8de1-f9f8923639ad tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:35.071933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb659b3b-4502-451c-8de1-f9f8923639ad tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:35.075511 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2555/5093] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:34 2022] DELETE /identity/v3/projects/625fc4104e7d4fb69430b60225d84346 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:35.082342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb659b3b-4502-451c-8de1-f9f8923639ad tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:35.083958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fb659b3b-4502-451c-8de1-f9f8923639ad tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:35.135221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4f51a-037a-4596-80e4-6b7f3762ace2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:35.298676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce053b-caa0-44ed-bcec-2be7791b881f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:35.299579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce053b-caa0-44ed-bcec-2be7791b881f service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:35.299871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce053b-caa0-44ed-bcec-2be7791b881f service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:35.300156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce053b-caa0-44ed-bcec-2be7791b881f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:35.302687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-46ce053b-caa0-44ed-bcec-2be7791b881f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:35.310664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb659b3b-4502-451c-8de1-f9f8923639ad tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:35.324979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822744ca-2f2f-450a-b4fc-3009d4e8e5a5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:35.325714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822744ca-2f2f-450a-b4fc-3009d4e8e5a5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:35.325965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822744ca-2f2f-450a-b4fc-3009d4e8e5a5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:35.326245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822744ca-2f2f-450a-b4fc-3009d4e8e5a5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/roles/eff66dcf13454eaa987db294768da024` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:35.329102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822744ca-2f2f-450a-b4fc-3009d4e8e5a5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:delete_role(role_id=eff66dcf13454eaa987db294768da024)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:35.330738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822744ca-2f2f-450a-b4fc-3009d4e8e5a5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:35.371931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:35.438585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce053b-caa0-44ed-bcec-2be7791b881f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:35.441795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce053b-caa0-44ed-bcec-2be7791b881f service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:35.452020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-822744ca-2f2f-450a-b4fc-3009d4e8e5a5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invalidating the token cache because role eff66dcf13454eaa987db294768da024 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:35.452567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-822744ca-2f2f-450a-b4fc-3009d4e8e5a5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:35.453951 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2539/5094] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:19:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:19:35.466282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-822744ca-2f2f-450a-b4fc-3009d4e8e5a5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:35.480557 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2556/5095] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:35 2022] DELETE /identity/v3/roles/eff66dcf13454eaa987db294768da024 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:35.480900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce053b-caa0-44ed-bcec-2be7791b881f service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:35.526394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce053b-caa0-44ed-bcec-2be7791b881f service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:35.546642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:35.616478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58057a59-832a-4ef4-9b0d-81ac416591f0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:35.617129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58057a59-832a-4ef4-9b0d-81ac416591f0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:35.617419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58057a59-832a-4ef4-9b0d-81ac416591f0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:35.617703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58057a59-832a-4ef4-9b0d-81ac416591f0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:35.618422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58057a59-832a-4ef4-9b0d-81ac416591f0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:35.620250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58057a59-832a-4ef4-9b0d-81ac416591f0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:35.648198 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2540/5096] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:19:35 2022] POST /identity/v3/roles => generated 240 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:35.652074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822744ca-2f2f-450a-b4fc-3009d4e8e5a5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:35.653571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-822744ca-2f2f-450a-b4fc-3009d4e8e5a5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:35.673843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822744ca-2f2f-450a-b4fc-3009d4e8e5a5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:35.680384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05881dd2-4d82-4b8b-af38-fcd1df5d8f70 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:35.681074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05881dd2-4d82-4b8b-af38-fcd1df5d8f70 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:35.681484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05881dd2-4d82-4b8b-af38-fcd1df5d8f70 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:35.682301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05881dd2-4d82-4b8b-af38-fcd1df5d8f70 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:35.683046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05881dd2-4d82-4b8b-af38-fcd1df5d8f70 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:35.685218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05881dd2-4d82-4b8b-af38-fcd1df5d8f70 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:35.768239 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2557/5097] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:35 2022] POST /identity/v3/projects => generated 407 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:35.770663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58057a59-832a-4ef4-9b0d-81ac416591f0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:35.787657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58057a59-832a-4ef4-9b0d-81ac416591f0 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:35.913654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e304ba-25a0-46c3-87f7-9d23d32b4078 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:35.914603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e304ba-25a0-46c3-87f7-9d23d32b4078 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:35.914928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e304ba-25a0-46c3-87f7-9d23d32b4078 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:35.915161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e304ba-25a0-46c3-87f7-9d23d32b4078 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/e5ecf602b60d4646b7d77ba847d4fa59/users/3e068311d4464358b37e6cb44442bb46/roles/5610d71590eb4fdf84d763c4b59bfe89/inherited_to_projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:35.917989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e304ba-25a0-46c3-87f7-9d23d32b4078 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e5ecf602b60d4646b7d77ba847d4fa59, user_id=3e068311d4464358b37e6cb44442bb46, role_id=5610d71590eb4fdf84d763c4b59bfe89)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:35.921834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e304ba-25a0-46c3-87f7-9d23d32b4078 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:35.943544 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2541/5098] 10.222.0.17 () {60 vars in 1582 bytes} [Sat Jul 30 21:19:35 2022] PUT /identity/v3/OS-INHERIT/projects/e5ecf602b60d4646b7d77ba847d4fa59/users/3e068311d4464358b37e6cb44442bb46/roles/5610d71590eb4fdf84d763c4b59bfe89/inherited_to_projects => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:35.948193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05881dd2-4d82-4b8b-af38-fcd1df5d8f70 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:35.962622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05881dd2-4d82-4b8b-af38-fcd1df5d8f70 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:36.087132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef787e-3027-47b8-89fa-a42a95349ea9 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:36.088069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef787e-3027-47b8-89fa-a42a95349ea9 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:36.088516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef787e-3027-47b8-89fa-a42a95349ea9 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:36.088897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef787e-3027-47b8-89fa-a42a95349ea9 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:36.089812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef787e-3027-47b8-89fa-a42a95349ea9 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Adding query filter params (scope.project.id=15134c47a2444aa98c16fd63616dcfd6, user.id=3e068311d4464358b37e6cb44442bb46) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:19:36.090226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef787e-3027-47b8-89fa-a42a95349ea9 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:36.093977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef787e-3027-47b8-89fa-a42a95349ea9 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:36.224951 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2558/5099] 10.222.0.17 () {58 vars in 1356 bytes} [Sat Jul 30 21:19:35 2022] GET /identity/v3/role_assignments?scope.project.id=15134c47a2444aa98c16fd63616dcfd6&user.id=3e068311d4464358b37e6cb44442bb46&effective => generated 649 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:36.225881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e304ba-25a0-46c3-87f7-9d23d32b4078 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:36.228249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063fad9-da17-4b17-8274-2a64ed4a3f27 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:36.228745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063fad9-da17-4b17-8274-2a64ed4a3f27 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:36.229182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063fad9-da17-4b17-8274-2a64ed4a3f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:36.245169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e304ba-25a0-46c3-87f7-9d23d32b4078 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:36.275677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5063fad9-da17-4b17-8274-2a64ed4a3f27 None None] MFA Rules not processed for user `ab9b5bcec45242d583f09a8aca6d89c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:36.279018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5063fad9-da17-4b17-8274-2a64ed4a3f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:36.286463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe56dd-d004-4041-85ce-5d38ce447dce tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:36.288210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe56dd-d004-4041-85ce-5d38ce447dce tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:36.291271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe56dd-d004-4041-85ce-5d38ce447dce tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:36.291510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe56dd-d004-4041-85ce-5d38ce447dce tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/e5ecf602b60d4646b7d77ba847d4fa59/users/3e068311d4464358b37e6cb44442bb46/roles/5610d71590eb4fdf84d763c4b59bfe89/inherited_to_projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:36.302952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe56dd-d004-4041-85ce-5d38ce447dce tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=e5ecf602b60d4646b7d77ba847d4fa59, user_id=3e068311d4464358b37e6cb44442bb46, role_id=5610d71590eb4fdf84d763c4b59bfe89)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:36.326469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe56dd-d004-4041-85ce-5d38ce447dce tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:36.367496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4efe56dd-d004-4041-85ce-5d38ce447dce tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invalidating the token cache because role 5610d71590eb4fdf84d763c4b59bfe89 was removed from user 3e068311d4464358b37e6cb44442bb46 on project e5ecf602b60d4646b7d77ba847d4fa59. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:36.367815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4efe56dd-d004-4041-85ce-5d38ce447dce tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:36.371862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4efe56dd-d004-4041-85ce-5d38ce447dce tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:36.388644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:36.416595 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2542/5100] 10.222.0.17 () {58 vars in 1566 bytes} [Sat Jul 30 21:19:36 2022] DELETE /identity/v3/OS-INHERIT/projects/e5ecf602b60d4646b7d77ba847d4fa59/users/3e068311d4464358b37e6cb44442bb46/roles/5610d71590eb4fdf84d763c4b59bfe89/inherited_to_projects => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:19:36.421910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe56dd-d004-4041-85ce-5d38ce447dce tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:36.432570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4efe56dd-d004-4041-85ce-5d38ce447dce tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:36.443062 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2559/5101] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:36.445409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04563a-fce4-45ec-adab-80232676c389 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:36.445933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04563a-fce4-45ec-adab-80232676c389 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:36.446421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04563a-fce4-45ec-adab-80232676c389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:36.501908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5f04563a-fce4-45ec-adab-80232676c389 None None] MFA Rules not processed for user `ab9b5bcec45242d583f09a8aca6d89c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:36.507931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5f04563a-fce4-45ec-adab-80232676c389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:36.600179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe56dd-d004-4041-85ce-5d38ce447dce tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:36.606708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6ef20-b6be-4f98-b6b1-b09323ce2aca tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:36.608606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6ef20-b6be-4f98-b6b1-b09323ce2aca tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:36.609454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6ef20-b6be-4f98-b6b1-b09323ce2aca tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:36.609774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6ef20-b6be-4f98-b6b1-b09323ce2aca tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:36.611808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6ef20-b6be-4f98-b6b1-b09323ce2aca tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Adding query filter params (scope.project.id=15134c47a2444aa98c16fd63616dcfd6, user.id=3e068311d4464358b37e6cb44442bb46) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:19:36.611808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6ef20-b6be-4f98-b6b1-b09323ce2aca tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:36.613719 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-67c6ef20-b6be-4f98-b6b1-b09323ce2aca tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:36.613719 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:19:36.613719 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:19:36.616177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6ef20-b6be-4f98-b6b1-b09323ce2aca tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:36.664704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:36.714601 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2560/5102] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:36.721481 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2543/5103] 10.222.0.17 () {58 vars in 1356 bytes} [Sat Jul 30 21:19:36 2022] GET /identity/v3/role_assignments?scope.project.id=15134c47a2444aa98c16fd63616dcfd6&user.id=3e068311d4464358b37e6cb44442bb46&effective => generated 228 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:36.729448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04563a-fce4-45ec-adab-80232676c389 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:36.736603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6ef20-b6be-4f98-b6b1-b09323ce2aca tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:36.746290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-67c6ef20-b6be-4f98-b6b1-b09323ce2aca tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:36.760572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04563a-fce4-45ec-adab-80232676c389 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:36.768191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac03c0-db9a-4697-b436-82d7ace26d5c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:36.769112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac03c0-db9a-4697-b436-82d7ace26d5c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:36.769980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac03c0-db9a-4697-b436-82d7ace26d5c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:36.770537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac03c0-db9a-4697-b436-82d7ace26d5c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/projects/15134c47a2444aa98c16fd63616dcfd6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:36.772873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac03c0-db9a-4697-b436-82d7ace26d5c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:delete_project(project_id=15134c47a2444aa98c16fd63616dcfd6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:36.774855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac03c0-db9a-4697-b436-82d7ace26d5c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:36.888472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-94ac03c0-db9a-4697-b436-82d7ace26d5c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15134c47a2444aa98c16fd63616dcfd6', 'request_id': 'req-94ac03c0-db9a-4697-b436-82d7ace26d5c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:36.899890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-94ac03c0-db9a-4697-b436-82d7ace26d5c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15134c47a2444aa98c16fd63616dcfd6', 'request_id': 'req-94ac03c0-db9a-4697-b436-82d7ace26d5c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:36.916928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-94ac03c0-db9a-4697-b436-82d7ace26d5c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15134c47a2444aa98c16fd63616dcfd6', 'request_id': 'req-94ac03c0-db9a-4697-b436-82d7ace26d5c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:36.937254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-94ac03c0-db9a-4697-b436-82d7ace26d5c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] The token cache is being invalidate because project 15134c47a2444aa98c16fd63616dcfd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:36.938134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-94ac03c0-db9a-4697-b436-82d7ace26d5c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:36.938822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-94ac03c0-db9a-4697-b436-82d7ace26d5c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:36.941315 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2561/5104] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:36 2022] DELETE /identity/v3/projects/15134c47a2444aa98c16fd63616dcfd6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:36.945797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac03c0-db9a-4697-b436-82d7ace26d5c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:36.948410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-94ac03c0-db9a-4697-b436-82d7ace26d5c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:37.007341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6ef20-b6be-4f98-b6b1-b09323ce2aca tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:37.145850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac03c0-db9a-4697-b436-82d7ace26d5c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:37.157724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc64e07-e487-470c-bd51-5182624f1cde tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:37.158457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc64e07-e487-470c-bd51-5182624f1cde tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:37.158842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc64e07-e487-470c-bd51-5182624f1cde tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:37.160866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc64e07-e487-470c-bd51-5182624f1cde tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/roles/5610d71590eb4fdf84d763c4b59bfe89` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:37.163529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc64e07-e487-470c-bd51-5182624f1cde tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5610d71590eb4fdf84d763c4b59bfe89)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:37.168075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc64e07-e487-470c-bd51-5182624f1cde tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:37.194203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:37.231642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fcc64e07-e487-470c-bd51-5182624f1cde tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invalidating the token cache because role 5610d71590eb4fdf84d763c4b59bfe89 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:37.231954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fcc64e07-e487-470c-bd51-5182624f1cde tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:37.233204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fcc64e07-e487-470c-bd51-5182624f1cde tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:37.241764 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2562/5105] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:36 2022] DELETE /identity/v3/roles/5610d71590eb4fdf84d763c4b59bfe89 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:37.244556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc64e07-e487-470c-bd51-5182624f1cde tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:37.247672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fcc64e07-e487-470c-bd51-5182624f1cde tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:37.261772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06fceef-17f3-4223-91b4-07b39fb82a5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:37.264566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fceef-17f3-4223-91b4-07b39fb82a5e service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:37.266619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fceef-17f3-4223-91b4-07b39fb82a5e service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:37.267578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fceef-17f3-4223-91b4-07b39fb82a5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:37.272601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b06fceef-17f3-4223-91b4-07b39fb82a5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:37.372228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc64e07-e487-470c-bd51-5182624f1cde tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:37.379183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bba6c-6535-4f24-b0ee-23796fbce4b4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:37.380112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bba6c-6535-4f24-b0ee-23796fbce4b4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:37.380557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bba6c-6535-4f24-b0ee-23796fbce4b4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:37.381022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bba6c-6535-4f24-b0ee-23796fbce4b4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/users/3e068311d4464358b37e6cb44442bb46` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:37.382488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bba6c-6535-4f24-b0ee-23796fbce4b4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3e068311d4464358b37e6cb44442bb46)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:37.386679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bba6c-6535-4f24-b0ee-23796fbce4b4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:37.450410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-184bba6c-6535-4f24-b0ee-23796fbce4b4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e068311d4464358b37e6cb44442bb46'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:37.467958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-184bba6c-6535-4f24-b0ee-23796fbce4b4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e068311d4464358b37e6cb44442bb46'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:37.469165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-184bba6c-6535-4f24-b0ee-23796fbce4b4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e068311d4464358b37e6cb44442bb46'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:37.479433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-184bba6c-6535-4f24-b0ee-23796fbce4b4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e068311d4464358b37e6cb44442bb46'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:37.480706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06fceef-17f3-4223-91b4-07b39fb82a5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:37.482328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06fceef-17f3-4223-91b4-07b39fb82a5e service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:37.483770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-184bba6c-6535-4f24-b0ee-23796fbce4b4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e068311d4464358b37e6cb44442bb46'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:37.513293 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2563/5106] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:37 2022] DELETE /identity/v3/users/3e068311d4464358b37e6cb44442bb46 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:37.519911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bba6c-6535-4f24-b0ee-23796fbce4b4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:37.520844 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2544/5107] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:19:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 785 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:19:37.523666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-184bba6c-6535-4f24-b0ee-23796fbce4b4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:37.654509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bba6c-6535-4f24-b0ee-23796fbce4b4 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:37.669506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cba34-cb88-41ec-9b56-a5ba79d5e9c5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:37.670189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cba34-cb88-41ec-9b56-a5ba79d5e9c5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:37.670474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cba34-cb88-41ec-9b56-a5ba79d5e9c5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:37.670754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cba34-cb88-41ec-9b56-a5ba79d5e9c5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/groups/df1d82591d85452493710111215ddba1` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:37.674148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cba34-cb88-41ec-9b56-a5ba79d5e9c5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:delete_group(group_id=df1d82591d85452493710111215ddba1)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:37.680373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cba34-cb88-41ec-9b56-a5ba79d5e9c5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:37.698645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:37.795501 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2564/5108] 10.222.0.17 () {58 vars in 1227 bytes} [Sat Jul 30 21:19:37 2022] DELETE /identity/v3/groups/df1d82591d85452493710111215ddba1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:37.799259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06fceef-17f3-4223-91b4-07b39fb82a5e service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:37.814851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:37.824990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06fceef-17f3-4223-91b4-07b39fb82a5e service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:37.935509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b213076-f7ab-4984-9856-c8419d5cb54c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:37.936534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b213076-f7ab-4984-9856-c8419d5cb54c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:37.937447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b213076-f7ab-4984-9856-c8419d5cb54c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:37.938117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b213076-f7ab-4984-9856-c8419d5cb54c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/projects/e5ecf602b60d4646b7d77ba847d4fa59` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:37.940244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b213076-f7ab-4984-9856-c8419d5cb54c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e5ecf602b60d4646b7d77ba847d4fa59)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:37.943129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b213076-f7ab-4984-9856-c8419d5cb54c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:38.100734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1b213076-f7ab-4984-9856-c8419d5cb54c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ecf602b60d4646b7d77ba847d4fa59', 'request_id': 'req-1b213076-f7ab-4984-9856-c8419d5cb54c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:38.115475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1b213076-f7ab-4984-9856-c8419d5cb54c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ecf602b60d4646b7d77ba847d4fa59', 'request_id': 'req-1b213076-f7ab-4984-9856-c8419d5cb54c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:38.160331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1b213076-f7ab-4984-9856-c8419d5cb54c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ecf602b60d4646b7d77ba847d4fa59', 'request_id': 'req-1b213076-f7ab-4984-9856-c8419d5cb54c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:38.192181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1b213076-f7ab-4984-9856-c8419d5cb54c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] The token cache is being invalidate because project e5ecf602b60d4646b7d77ba847d4fa59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:38.193088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1b213076-f7ab-4984-9856-c8419d5cb54c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:38.194354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1b213076-f7ab-4984-9856-c8419d5cb54c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:38.200477 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2545/5109] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:37 2022] DELETE /identity/v3/projects/e5ecf602b60d4646b7d77ba847d4fa59 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:38.204420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cba34-cb88-41ec-9b56-a5ba79d5e9c5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:38.206500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cb4cba34-cb88-41ec-9b56-a5ba79d5e9c5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:38.241040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cba34-cb88-41ec-9b56-a5ba79d5e9c5 tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:38.390851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b52a2-a335-4833-8617-f892f4a9004d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:38.391663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b52a2-a335-4833-8617-f892f4a9004d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:38.392019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b52a2-a335-4833-8617-f892f4a9004d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:38.392374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b52a2-a335-4833-8617-f892f4a9004d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/domains/82e8951aecca41af8ef6bc4a528a4fa0` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:38.394458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b52a2-a335-4833-8617-f892f4a9004d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=82e8951aecca41af8ef6bc4a528a4fa0)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:38.396675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b52a2-a335-4833-8617-f892f4a9004d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:38.469083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e62b52a2-a335-4833-8617-f892f4a9004d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '82e8951aecca41af8ef6bc4a528a4fa0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:38.470318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e62b52a2-a335-4833-8617-f892f4a9004d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '82e8951aecca41af8ef6bc4a528a4fa0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:38.564629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e62b52a2-a335-4833-8617-f892f4a9004d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '82e8951aecca41af8ef6bc4a528a4fa0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:38.566558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e62b52a2-a335-4833-8617-f892f4a9004d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '82e8951aecca41af8ef6bc4a528a4fa0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:38.572467 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2565/5110] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:19:38 2022] PATCH /identity/v3/domains/82e8951aecca41af8ef6bc4a528a4fa0 => generated 276 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:38.577202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b213076-f7ab-4984-9856-c8419d5cb54c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:38.591717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b213076-f7ab-4984-9856-c8419d5cb54c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:38.748828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a34eb-36c1-4981-a7f7-468d687c227c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c5ca79c2f44edf885be5e941af1543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff72b6742dd4b79b92387ec359804a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:38.749656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a34eb-36c1-4981-a7f7-468d687c227c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:38.750046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a34eb-36c1-4981-a7f7-468d687c227c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:38.750462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a34eb-36c1-4981-a7f7-468d687c227c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] PATH_INFO: `/v3/domains/82e8951aecca41af8ef6bc4a528a4fa0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:38.776332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a34eb-36c1-4981-a7f7-468d687c227c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=82e8951aecca41af8ef6bc4a528a4fa0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:38.778021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a34eb-36c1-4981-a7f7-468d687c227c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:38.838713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-700a34eb-36c1-4981-a7f7-468d687c227c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '82e8951aecca41af8ef6bc4a528a4fa0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:38.846430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-700a34eb-36c1-4981-a7f7-468d687c227c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '82e8951aecca41af8ef6bc4a528a4fa0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:38.854864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:38.947835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b52a2-a335-4833-8617-f892f4a9004d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:38.949378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e62b52a2-a335-4833-8617-f892f4a9004d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:39.009483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-700a34eb-36c1-4981-a7f7-468d687c227c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e8951aecca41af8ef6bc4a528a4fa0', 'request_id': 'req-700a34eb-36c1-4981-a7f7-468d687c227c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:39.022536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-700a34eb-36c1-4981-a7f7-468d687c227c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e8951aecca41af8ef6bc4a528a4fa0', 'request_id': 'req-700a34eb-36c1-4981-a7f7-468d687c227c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:39.045988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-700a34eb-36c1-4981-a7f7-468d687c227c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e8951aecca41af8ef6bc4a528a4fa0', 'request_id': 'req-700a34eb-36c1-4981-a7f7-468d687c227c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:39.109234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-700a34eb-36c1-4981-a7f7-468d687c227c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] The token cache is being invalidate because project 82e8951aecca41af8ef6bc4a528a4fa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:39.110273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-700a34eb-36c1-4981-a7f7-468d687c227c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:39.111838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-700a34eb-36c1-4981-a7f7-468d687c227c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:39.138033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-700a34eb-36c1-4981-a7f7-468d687c227c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '82e8951aecca41af8ef6bc4a528a4fa0', 'request_id': 'req-700a34eb-36c1-4981-a7f7-468d687c227c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:39.138319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b52a2-a335-4833-8617-f892f4a9004d tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:39.152559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-700a34eb-36c1-4981-a7f7-468d687c227c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '82e8951aecca41af8ef6bc4a528a4fa0', 'request_id': 'req-700a34eb-36c1-4981-a7f7-468d687c227c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:39.153867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-700a34eb-36c1-4981-a7f7-468d687c227c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '82e8951aecca41af8ef6bc4a528a4fa0', 'request_id': 'req-700a34eb-36c1-4981-a7f7-468d687c227c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:39.173163 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2546/5111] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:19:38 2022] DELETE /identity/v3/domains/82e8951aecca41af8ef6bc4a528a4fa0 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:39.177104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a34eb-36c1-4981-a7f7-468d687c227c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:39.180411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-700a34eb-36c1-4981-a7f7-468d687c227c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:39.249840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:39.276249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb15ea-b9e7-4dc5-a6e8-19eff62d4ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:39.276932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb15ea-b9e7-4dc5-a6e8-19eff62d4ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:39.277551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb15ea-b9e7-4dc5-a6e8-19eff62d4ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:39.278403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb15ea-b9e7-4dc5-a6e8-19eff62d4ddf admin admin] PATH_INFO: `/v3/users/ab9b5bcec45242d583f09a8aca6d89c3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:39.280395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb15ea-b9e7-4dc5-a6e8-19eff62d4ddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab9b5bcec45242d583f09a8aca6d89c3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:39.282786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb15ea-b9e7-4dc5-a6e8-19eff62d4ddf admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:39.354289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a34eb-36c1-4981-a7f7-468d687c227c tempest-InheritsV3TestJSON-762410396 tempest-InheritsV3TestJSON-762410396-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:39.365849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-64fb15ea-b9e7-4dc5-a6e8-19eff62d4ddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab9b5bcec45242d583f09a8aca6d89c3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:39.368880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2f1ab-cc8f-46a3-b97c-4863dde1cfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:39.371041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2f1ab-cc8f-46a3-b97c-4863dde1cfec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:39.371394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2f1ab-cc8f-46a3-b97c-4863dde1cfec admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:39.371694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2f1ab-cc8f-46a3-b97c-4863dde1cfec admin admin] PATH_INFO: `/v3/users/8854ce58db244c6ab5f74868adba1ee1` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:39.374790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2f1ab-cc8f-46a3-b97c-4863dde1cfec admin admin] RBAC: Authorizing `identity:delete_user(user_id=8854ce58db244c6ab5f74868adba1ee1)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:39.382264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-64fb15ea-b9e7-4dc5-a6e8-19eff62d4ddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab9b5bcec45242d583f09a8aca6d89c3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:39.382435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2f1ab-cc8f-46a3-b97c-4863dde1cfec admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:39.384535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-64fb15ea-b9e7-4dc5-a6e8-19eff62d4ddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab9b5bcec45242d583f09a8aca6d89c3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:39.394340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-64fb15ea-b9e7-4dc5-a6e8-19eff62d4ddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab9b5bcec45242d583f09a8aca6d89c3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:39.395320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-64fb15ea-b9e7-4dc5-a6e8-19eff62d4ddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab9b5bcec45242d583f09a8aca6d89c3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:39.430060 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2566/5112] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:38 2022] DELETE /identity/v3/users/ab9b5bcec45242d583f09a8aca6d89c3 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:39.543484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f0f2f1ab-cc8f-46a3-b97c-4863dde1cfec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8854ce58db244c6ab5f74868adba1ee1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:39.546797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f0f2f1ab-cc8f-46a3-b97c-4863dde1cfec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8854ce58db244c6ab5f74868adba1ee1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:39.591646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f0f2f1ab-cc8f-46a3-b97c-4863dde1cfec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8854ce58db244c6ab5f74868adba1ee1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:39.593914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f0f2f1ab-cc8f-46a3-b97c-4863dde1cfec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8854ce58db244c6ab5f74868adba1ee1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:39.610287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f0f2f1ab-cc8f-46a3-b97c-4863dde1cfec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8854ce58db244c6ab5f74868adba1ee1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:39.618353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:39.639673 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2547/5113] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:39 2022] DELETE /identity/v3/users/8854ce58db244c6ab5f74868adba1ee1 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:39.644433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44df0c-18a2-4cdd-a5e3-3b5575fa05f8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:39.644837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44df0c-18a2-4cdd-a5e3-3b5575fa05f8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:39.645203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44df0c-18a2-4cdd-a5e3-3b5575fa05f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:39.672534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8c44df0c-18a2-4cdd-a5e3-3b5575fa05f8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:39.674127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8c44df0c-18a2-4cdd-a5e3-3b5575fa05f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:39.762641 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2567/5114] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:39.795119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2f1ab-cc8f-46a3-b97c-4863dde1cfec admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:39.796914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f0f2f1ab-cc8f-46a3-b97c-4863dde1cfec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:39.930040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44df0c-18a2-4cdd-a5e3-3b5575fa05f8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:39.932201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8c44df0c-18a2-4cdd-a5e3-3b5575fa05f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:39.957823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2f1ab-cc8f-46a3-b97c-4863dde1cfec admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:39.959475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44df0c-18a2-4cdd-a5e3-3b5575fa05f8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:39.964919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad684c7e-b53d-426e-9304-80ef16563f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:39.966093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad684c7e-b53d-426e-9304-80ef16563f16 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:39.966578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad684c7e-b53d-426e-9304-80ef16563f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:39.967006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad684c7e-b53d-426e-9304-80ef16563f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:39.978869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9149b-c5dc-4071-a054-1d27c81e2c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:39.979718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9149b-c5dc-4071-a054-1d27c81e2c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:39.980104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9149b-c5dc-4071-a054-1d27c81e2c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:39.980474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9149b-c5dc-4071-a054-1d27c81e2c63 admin admin] PATH_INFO: `/v3/projects/d1dfadc4695d4ebbb3cd887d9c0fc95f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:39.982523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9149b-c5dc-4071-a054-1d27c81e2c63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1dfadc4695d4ebbb3cd887d9c0fc95f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:39.984785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9149b-c5dc-4071-a054-1d27c81e2c63 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:39.993965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad684c7e-b53d-426e-9304-80ef16563f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:39.995644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad684c7e-b53d-426e-9304-80ef16563f16 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:40.036018 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2548/5115] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:19:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:19:40.162236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72c9149b-c5dc-4071-a054-1d27c81e2c63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1dfadc4695d4ebbb3cd887d9c0fc95f', 'request_id': 'req-72c9149b-c5dc-4071-a054-1d27c81e2c63'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:40.191951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72c9149b-c5dc-4071-a054-1d27c81e2c63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1dfadc4695d4ebbb3cd887d9c0fc95f', 'request_id': 'req-72c9149b-c5dc-4071-a054-1d27c81e2c63'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:40.196299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:40.217804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72c9149b-c5dc-4071-a054-1d27c81e2c63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1dfadc4695d4ebbb3cd887d9c0fc95f', 'request_id': 'req-72c9149b-c5dc-4071-a054-1d27c81e2c63'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:40.238778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72c9149b-c5dc-4071-a054-1d27c81e2c63 admin admin] The token cache is being invalidate because project d1dfadc4695d4ebbb3cd887d9c0fc95f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:40.242614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72c9149b-c5dc-4071-a054-1d27c81e2c63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:40.243779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72c9149b-c5dc-4071-a054-1d27c81e2c63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:40.256302 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2568/5116] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:39 2022] DELETE /identity/v3/projects/d1dfadc4695d4ebbb3cd887d9c0fc95f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:40.258039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a104c-1890-4e97-ba9a-3163bf5238a9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:40.258597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a104c-1890-4e97-ba9a-3163bf5238a9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:40.259085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a104c-1890-4e97-ba9a-3163bf5238a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:40.299848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3b8a104c-1890-4e97-ba9a-3163bf5238a9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:40.303913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3b8a104c-1890-4e97-ba9a-3163bf5238a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:40.395569 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2549/5117] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:19:40.404898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a65077-e58d-4c49-9435-b2ceae289041 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:40.405202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a65077-e58d-4c49-9435-b2ceae289041 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:40.405489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a65077-e58d-4c49-9435-b2ceae289041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:40.437672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e0a65077-e58d-4c49-9435-b2ceae289041 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:40.439127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e0a65077-e58d-4c49-9435-b2ceae289041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:40.454054 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2569/5118] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:40.455055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a104c-1890-4e97-ba9a-3163bf5238a9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:40.474661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a104c-1890-4e97-ba9a-3163bf5238a9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:40.485384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfaf962-8741-4e75-ae0a-62d93caddb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:40.486845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfaf962-8741-4e75-ae0a-62d93caddb0e admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:40.487152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfaf962-8741-4e75-ae0a-62d93caddb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:40.487468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfaf962-8741-4e75-ae0a-62d93caddb0e admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:40.490109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfaf962-8741-4e75-ae0a-62d93caddb0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:19:40.490431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfaf962-8741-4e75-ae0a-62d93caddb0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:40.493354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfaf962-8741-4e75-ae0a-62d93caddb0e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:40.514749 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2550/5119] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:19:40.515942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a65077-e58d-4c49-9435-b2ceae289041 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:40.529358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a65077-e58d-4c49-9435-b2ceae289041 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:40.556708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a949b5-30df-4cf0-b562-0aec28e6e34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:40.557359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a949b5-30df-4cf0-b562-0aec28e6e34d admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:40.557830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a949b5-30df-4cf0-b562-0aec28e6e34d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:40.558136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a949b5-30df-4cf0-b562-0aec28e6e34d admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:40.558840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a949b5-30df-4cf0-b562-0aec28e6e34d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:40.561061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a949b5-30df-4cf0-b562-0aec28e6e34d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:40.627562 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2570/5120] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:40 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:19:40.629070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfaf962-8741-4e75-ae0a-62d93caddb0e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:40.643165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfaf962-8741-4e75-ae0a-62d93caddb0e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:40.714526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6de065-3370-4a37-aa6a-b807cac2bdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:40.715516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6de065-3370-4a37-aa6a-b807cac2bdf2 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:40.716269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6de065-3370-4a37-aa6a-b807cac2bdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:40.716786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6de065-3370-4a37-aa6a-b807cac2bdf2 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:40.717830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6de065-3370-4a37-aa6a-b807cac2bdf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:40.720197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6de065-3370-4a37-aa6a-b807cac2bdf2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:40.762814 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2551/5121] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:40 2022] POST /identity/v3/users => generated 291 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:40.763518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a949b5-30df-4cf0-b562-0aec28e6e34d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:40.782683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a949b5-30df-4cf0-b562-0aec28e6e34d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:40.804062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450c2dd-dc4f-49ea-acf0-11f30c3c5f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:40.804710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450c2dd-dc4f-49ea-acf0-11f30c3c5f27 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:40.804999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450c2dd-dc4f-49ea-acf0-11f30c3c5f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:40.805280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450c2dd-dc4f-49ea-acf0-11f30c3c5f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:40.805991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450c2dd-dc4f-49ea-acf0-11f30c3c5f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:40.807659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450c2dd-dc4f-49ea-acf0-11f30c3c5f27 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:40.855521 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2571/5122] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:40.860348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6de065-3370-4a37-aa6a-b807cac2bdf2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:40.876694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6de065-3370-4a37-aa6a-b807cac2bdf2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:40.883932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a19eb-2fa1-4a8c-9b6c-8755a818cf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:40.884628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a19eb-2fa1-4a8c-9b6c-8755a818cf6f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:40.884925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a19eb-2fa1-4a8c-9b6c-8755a818cf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:40.885210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a19eb-2fa1-4a8c-9b6c-8755a818cf6f admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:40.885978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a19eb-2fa1-4a8c-9b6c-8755a818cf6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:40.889007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a19eb-2fa1-4a8c-9b6c-8755a818cf6f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:40.896660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:40.900733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450c2dd-dc4f-49ea-acf0-11f30c3c5f27 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:40.902856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0450c2dd-dc4f-49ea-acf0-11f30c3c5f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:40.911753 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2552/5123] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:40.912918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a19eb-2fa1-4a8c-9b6c-8755a818cf6f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:40.929889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a19eb-2fa1-4a8c-9b6c-8755a818cf6f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:40.935800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c10401-36b5-4cbf-992e-d88e43b691db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:40.936528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c10401-36b5-4cbf-992e-d88e43b691db admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:40.936890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c10401-36b5-4cbf-992e-d88e43b691db admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:40.937284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c10401-36b5-4cbf-992e-d88e43b691db admin admin] PATH_INFO: `/v3/projects/5dce83da5a8440d8a085c55ecc1c2a30/users/4d662626988746d9833006cfa01e28b2/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:40.959733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c10401-36b5-4cbf-992e-d88e43b691db admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dce83da5a8440d8a085c55ecc1c2a30, user_id=4d662626988746d9833006cfa01e28b2, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:40.962777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c10401-36b5-4cbf-992e-d88e43b691db admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:40.972134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450c2dd-dc4f-49ea-acf0-11f30c3c5f27 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:41.011888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725b378-0971-4ae1-9ec6-ecd6f841a4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:41.012641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725b378-0971-4ae1-9ec6-ecd6f841a4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:41.012935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725b378-0971-4ae1-9ec6-ecd6f841a4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:41.013225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725b378-0971-4ae1-9ec6-ecd6f841a4c5 admin admin] PATH_INFO: `/v3/projects/522276a1daae47fbb869cab1322b148a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:41.017124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725b378-0971-4ae1-9ec6-ecd6f841a4c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=522276a1daae47fbb869cab1322b148a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:41.063554 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2553/5124] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:40 2022] PUT /identity/v3/projects/5dce83da5a8440d8a085c55ecc1c2a30/users/4d662626988746d9833006cfa01e28b2/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:41.064644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725b378-0971-4ae1-9ec6-ecd6f841a4c5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:41.064768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba8e7f-b259-4e08-8572-312c97f6b594 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:41.064768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba8e7f-b259-4e08-8572-312c97f6b594 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:41.064768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba8e7f-b259-4e08-8572-312c97f6b594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:41.139526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-93ba8e7f-b259-4e08-8572-312c97f6b594 None None] MFA Rules not processed for user `4d662626988746d9833006cfa01e28b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:41.139881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-93ba8e7f-b259-4e08-8572-312c97f6b594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:41.218549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7725b378-0971-4ae1-9ec6-ecd6f841a4c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522276a1daae47fbb869cab1322b148a', 'request_id': 'req-7725b378-0971-4ae1-9ec6-ecd6f841a4c5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:41.239453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7725b378-0971-4ae1-9ec6-ecd6f841a4c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522276a1daae47fbb869cab1322b148a', 'request_id': 'req-7725b378-0971-4ae1-9ec6-ecd6f841a4c5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:41.240719 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2554/5125] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:41.245227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba8e7f-b259-4e08-8572-312c97f6b594 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:41.268644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7725b378-0971-4ae1-9ec6-ecd6f841a4c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522276a1daae47fbb869cab1322b148a', 'request_id': 'req-7725b378-0971-4ae1-9ec6-ecd6f841a4c5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:41.284770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7725b378-0971-4ae1-9ec6-ecd6f841a4c5 admin admin] The token cache is being invalidate because project 522276a1daae47fbb869cab1322b148a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:41.285131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7725b378-0971-4ae1-9ec6-ecd6f841a4c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:41.287236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7725b378-0971-4ae1-9ec6-ecd6f841a4c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:41.291591 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2572/5126] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:40 2022] DELETE /identity/v3/projects/522276a1daae47fbb869cab1322b148a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:41.295135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725b378-0971-4ae1-9ec6-ecd6f841a4c5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:41.297515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7725b378-0971-4ae1-9ec6-ecd6f841a4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:41.376762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba8e7f-b259-4e08-8572-312c97f6b594 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:41.449954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725b378-0971-4ae1-9ec6-ecd6f841a4c5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:41.460724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffc29a-35c6-4f3a-8dfa-bfcf08586dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:41.461546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffc29a-35c6-4f3a-8dfa-bfcf08586dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:41.462013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffc29a-35c6-4f3a-8dfa-bfcf08586dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:41.462395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffc29a-35c6-4f3a-8dfa-bfcf08586dc3 admin admin] PATH_INFO: `/v3/users/19c5ca79c2f44edf885be5e941af1543` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:41.463801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffc29a-35c6-4f3a-8dfa-bfcf08586dc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19c5ca79c2f44edf885be5e941af1543)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:41.466052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffc29a-35c6-4f3a-8dfa-bfcf08586dc3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:41.481192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591f38b-5a18-49e7-8ea0-6bc938a65f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:41.481871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591f38b-5a18-49e7-8ea0-6bc938a65f76 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:41.482156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591f38b-5a18-49e7-8ea0-6bc938a65f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:41.482532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591f38b-5a18-49e7-8ea0-6bc938a65f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:41.484606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591f38b-5a18-49e7-8ea0-6bc938a65f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:41.487279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591f38b-5a18-49e7-8ea0-6bc938a65f76 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:41.529942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:41.542310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=3,keystone:DELETE=15,keystone:SELECT=82 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:41.555437 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2555/5127] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:41 2022] POST /identity/v3/projects => generated 381 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:19:41.556441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591f38b-5a18-49e7-8ea0-6bc938a65f76 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:41.558474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2591f38b-5a18-49e7-8ea0-6bc938a65f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:41.649423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-96ffc29a-35c6-4f3a-8dfa-bfcf08586dc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19c5ca79c2f44edf885be5e941af1543'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:41.685977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-96ffc29a-35c6-4f3a-8dfa-bfcf08586dc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19c5ca79c2f44edf885be5e941af1543'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:41.687588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-96ffc29a-35c6-4f3a-8dfa-bfcf08586dc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19c5ca79c2f44edf885be5e941af1543'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:41.704814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-96ffc29a-35c6-4f3a-8dfa-bfcf08586dc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19c5ca79c2f44edf885be5e941af1543'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:41.708258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591f38b-5a18-49e7-8ea0-6bc938a65f76 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:41.709061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-96ffc29a-35c6-4f3a-8dfa-bfcf08586dc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19c5ca79c2f44edf885be5e941af1543'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:41.714851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9118a5-c2b3-4c3b-bbfa-022108988982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:41.715761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9118a5-c2b3-4c3b-bbfa-022108988982 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:41.716616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9118a5-c2b3-4c3b-bbfa-022108988982 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:41.716616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9118a5-c2b3-4c3b-bbfa-022108988982 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:41.717291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9118a5-c2b3-4c3b-bbfa-022108988982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:41.719407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9118a5-c2b3-4c3b-bbfa-022108988982 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:41.737306 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2573/5128] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:41 2022] DELETE /identity/v3/users/19c5ca79c2f44edf885be5e941af1543 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:41.758326 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2556/5129] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:41 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:19:41.759824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffc29a-35c6-4f3a-8dfa-bfcf08586dc3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:41.761986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-96ffc29a-35c6-4f3a-8dfa-bfcf08586dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:41.862564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffc29a-35c6-4f3a-8dfa-bfcf08586dc3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:41.871059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3468b-09d9-4f35-bd7b-dd3b273b90e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:41.871903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3468b-09d9-4f35-bd7b-dd3b273b90e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:41.872223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3468b-09d9-4f35-bd7b-dd3b273b90e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:41.873935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3468b-09d9-4f35-bd7b-dd3b273b90e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:41.875679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3468b-09d9-4f35-bd7b-dd3b273b90e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:41.877751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3468b-09d9-4f35-bd7b-dd3b273b90e6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:41.893629 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2574/5130] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:41.898859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9118a5-c2b3-4c3b-bbfa-022108988982 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:41.935837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9118a5-c2b3-4c3b-bbfa-022108988982 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:41.952618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ba118-e7bf-48a2-83bb-1ed555ee8b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:41.954102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ba118-e7bf-48a2-83bb-1ed555ee8b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:41.954221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ba118-e7bf-48a2-83bb-1ed555ee8b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:41.954416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ba118-e7bf-48a2-83bb-1ed555ee8b3a admin admin] PATH_INFO: `/v3/projects/b38f68fb142d4bf48567eda6d4bb20f8/users/c9f80c6bf0aa4ca3b0831b5257bb14e6/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:41.980257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ba118-e7bf-48a2-83bb-1ed555ee8b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b38f68fb142d4bf48567eda6d4bb20f8, user_id=c9f80c6bf0aa4ca3b0831b5257bb14e6, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:41.984159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ba118-e7bf-48a2-83bb-1ed555ee8b3a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:42.038383 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2557/5131] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:41 2022] PUT /identity/v3/projects/b38f68fb142d4bf48567eda6d4bb20f8/users/c9f80c6bf0aa4ca3b0831b5257bb14e6/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:42.042576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3468b-09d9-4f35-bd7b-dd3b273b90e6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:42.067442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3468b-09d9-4f35-bd7b-dd3b273b90e6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:42.221959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc40e5-a93a-404c-85b2-337e94a4e236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:42.224496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc40e5-a93a-404c-85b2-337e94a4e236 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:42.224496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc40e5-a93a-404c-85b2-337e94a4e236 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:42.224496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc40e5-a93a-404c-85b2-337e94a4e236 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:42.225414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc40e5-a93a-404c-85b2-337e94a4e236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:42.229912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc40e5-a93a-404c-85b2-337e94a4e236 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:42.292039 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2575/5132] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:42.302715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ba118-e7bf-48a2-83bb-1ed555ee8b3a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:42.314942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ba118-e7bf-48a2-83bb-1ed555ee8b3a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:42.324149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b1116-9587-4c49-982e-5f6a9a5a8144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:42.335685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b1116-9587-4c49-982e-5f6a9a5a8144 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:42.335685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b1116-9587-4c49-982e-5f6a9a5a8144 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:42.335685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b1116-9587-4c49-982e-5f6a9a5a8144 admin admin] PATH_INFO: `/v3/projects/b38f68fb142d4bf48567eda6d4bb20f8/users/c9f80c6bf0aa4ca3b0831b5257bb14e6/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:42.335685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b1116-9587-4c49-982e-5f6a9a5a8144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b38f68fb142d4bf48567eda6d4bb20f8, user_id=c9f80c6bf0aa4ca3b0831b5257bb14e6, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:42.335685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b1116-9587-4c49-982e-5f6a9a5a8144 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:42.349391 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2558/5133] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:42 2022] PUT /identity/v3/projects/b38f68fb142d4bf48567eda6d4bb20f8/users/c9f80c6bf0aa4ca3b0831b5257bb14e6/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:42.459945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848b34d-554c-424a-86b4-aa508fe8e7ad None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:42.460254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848b34d-554c-424a-86b4-aa508fe8e7ad None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:42.460546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848b34d-554c-424a-86b4-aa508fe8e7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:42.517311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a848b34d-554c-424a-86b4-aa508fe8e7ad None None] MFA Rules not processed for user `c9f80c6bf0aa4ca3b0831b5257bb14e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:42.520678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a848b34d-554c-424a-86b4-aa508fe8e7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:42.591213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:42.691817 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2576/5134] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:42.697634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b1116-9587-4c49-982e-5f6a9a5a8144 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:42.738359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b1116-9587-4c49-982e-5f6a9a5a8144 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:42.752104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e9495-25d7-4686-b405-c35e31116262 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9f80c6bf0aa4ca3b0831b5257bb14e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38f68fb142d4bf48567eda6d4bb20f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:42.753305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e9495-25d7-4686-b405-c35e31116262 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:42.753899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e9495-25d7-4686-b405-c35e31116262 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:42.754502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e9495-25d7-4686-b405-c35e31116262 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:42.755994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e9495-25d7-4686-b405-c35e31116262 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:42.757925 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-c61e9495-25d7-4686-b405-c35e31116262 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:42.757925 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:19:42.757925 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:19:42.759315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e9495-25d7-4686-b405-c35e31116262 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-c61e9495-25d7-4686-b405-c35e31116262 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invalid input for field 'name': '' is too short Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: Failed validating 'minLength' in schema['properties']['name']: Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: On instance['name']: Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: Failed validating 'minLength' in schema['properties']['name']: Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: On instance['name']: Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: '' Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise error Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application On instance['name']: Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application '' Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:19:42.773733 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:19:42.775251 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:19:42.775251 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:19:42.775251 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:19:42.775251 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:19:42.775251 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:19:42.775251 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:19:42.775251 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:19:42.775251 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:19:42.775251 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:19:42.775251 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:19:42.775251 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:19:42.775251 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:19:42.775251 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jul 30 21:19:42.775251 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jul 30 21:19:42.775251 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 30 21:19:42.775251 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 30 21:19:42.775251 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 30 21:19:42.776902 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 30 21:19:42.776902 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 30 21:19:42.776902 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:19:42.776902 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 30 21:19:42.776902 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 30 21:19:42.776902 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:19:42.776902 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application On instance['name']: Jul 30 21:19:42.776902 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application '' Jul 30 21:19:42.776902 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:19:42.780109 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2559/5135] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:19:42 2022] POST /identity/v3/domains => generated 283 bytes in 83 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 30 21:19:42.786149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848b34d-554c-424a-86b4-aa508fe8e7ad None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:42.805988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848b34d-554c-424a-86b4-aa508fe8e7ad None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:42.814925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc7519-a6f7-45f1-a074-52e8aaceb672 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9f80c6bf0aa4ca3b0831b5257bb14e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38f68fb142d4bf48567eda6d4bb20f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:42.816023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc7519-a6f7-45f1-a074-52e8aaceb672 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:42.816566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc7519-a6f7-45f1-a074-52e8aaceb672 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:42.817061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc7519-a6f7-45f1-a074-52e8aaceb672 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:42.818734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc7519-a6f7-45f1-a074-52e8aaceb672 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:42.821621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc7519-a6f7-45f1-a074-52e8aaceb672 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:42.841351 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-13dc7519-a6f7-45f1-a074-52e8aaceb672 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:19:42.841351 ncdv-master-1 devstack@keystone.service[91085]: Failed validating 'maxLength' in schema['properties']['name']: Jul 30 21:19:42.841351 ncdv-master-1 devstack@keystone.service[91085]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 30 21:19:42.841351 ncdv-master-1 devstack@keystone.service[91085]: On instance['name']: Jul 30 21:19:42.841351 ncdv-master-1 devstack@keystone.service[91085]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:19:42.841351 ncdv-master-1 devstack@keystone.service[91085]: Failed validating 'maxLength' in schema['properties']['name']: Jul 30 21:19:42.841351 ncdv-master-1 devstack@keystone.service[91085]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 30 21:19:42.841351 ncdv-master-1 devstack@keystone.service[91085]: On instance['name']: Jul 30 21:19:42.841351 ncdv-master-1 devstack@keystone.service[91085]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 30 21:19:42.841351 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:19:42.841351 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 30 21:19:42.841351 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 30 21:19:42.841351 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:19:42.841351 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise error Jul 30 21:19:42.841351 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:19:42.841351 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:42.841351 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 30 21:19:42.841351 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 30 21:19:42.841351 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:42.842580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application On instance['name']: Jul 30 21:19:42.842580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 30 21:19:42.842580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:42.842580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:19:42.842580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:42.842580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:19:42.842580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:19:42.842580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:19:42.842580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:19:42.842580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:19:42.842580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:19:42.842580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:19:42.842580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:19:42.842580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:19:42.842580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:19:42.842580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:19:42.842580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jul 30 21:19:42.842580 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jul 30 21:19:42.843691 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 30 21:19:42.843691 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 30 21:19:42.843691 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 30 21:19:42.843691 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 30 21:19:42.843691 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:19:42.843691 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:42.843691 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 30 21:19:42.843691 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 30 21:19:42.843691 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:42.843691 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application On instance['name']: Jul 30 21:19:42.843691 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 30 21:19:42.843691 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:42.852407 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2577/5136] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:19:42 2022] POST /identity/v3/domains => generated 412 bytes in 67 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jul 30 21:19:42.852833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e9495-25d7-4686-b405-c35e31116262 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:42.875641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e9495-25d7-4686-b405-c35e31116262 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:42.887036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fe3af-d07c-4134-8159-fb60ae8b8043 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9f80c6bf0aa4ca3b0831b5257bb14e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38f68fb142d4bf48567eda6d4bb20f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:42.887796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fe3af-d07c-4134-8159-fb60ae8b8043 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:42.888087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fe3af-d07c-4134-8159-fb60ae8b8043 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:42.888376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fe3af-d07c-4134-8159-fb60ae8b8043 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:42.889192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fe3af-d07c-4134-8159-fb60ae8b8043 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:42.890934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fe3af-d07c-4134-8159-fb60ae8b8043 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:42.923062 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2560/5137] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:19:42 2022] POST /identity/v3/domains => generated 274 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:42.927467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc7519-a6f7-45f1-a074-52e8aaceb672 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:42.947727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc7519-a6f7-45f1-a074-52e8aaceb672 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:43.100179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf4799-6995-4222-905d-eceeb85733e5 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9f80c6bf0aa4ca3b0831b5257bb14e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38f68fb142d4bf48567eda6d4bb20f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:43.100888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf4799-6995-4222-905d-eceeb85733e5 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:43.101341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf4799-6995-4222-905d-eceeb85733e5 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:43.102164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf4799-6995-4222-905d-eceeb85733e5 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] PATH_INFO: `/v3/domains/27907a96983a4cb3a172645fa411800e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:43.131704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf4799-6995-4222-905d-eceeb85733e5 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=27907a96983a4cb3a172645fa411800e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:43.132995 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-1ebf4799-6995-4222-905d-eceeb85733e5 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:43.132995 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:19:43.132995 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:19:43.134084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf4799-6995-4222-905d-eceeb85733e5 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:43.156985 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-1ebf4799-6995-4222-905d-eceeb85733e5 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jul 30 21:19:43.156985 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:19:43.156985 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:19:43.156985 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:19:43.156985 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:19:43.156985 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:19:43.156985 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:19:43.156985 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:19:43.156985 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:19:43.156985 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:19:43.156985 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:19:43.156985 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:19:43.156985 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Jul 30 21:19:43.156985 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Jul 30 21:19:43.157870 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:19:43.157870 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:19:43.157870 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Jul 30 21:19:43.157870 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Jul 30 21:19:43.157870 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Jul 30 21:19:43.157870 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jul 30 21:19:43.157870 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jul 30 21:19:43.157870 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:43.161051 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2578/5138] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:19:42 2022] DELETE /identity/v3/domains/27907a96983a4cb3a172645fa411800e => generated 120 bytes in 233 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:19:43.164208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fe3af-d07c-4134-8159-fb60ae8b8043 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:43.178158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fe3af-d07c-4134-8159-fb60ae8b8043 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:43.187124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ad9fa-1dc3-4937-83df-672804055fc1 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9f80c6bf0aa4ca3b0831b5257bb14e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38f68fb142d4bf48567eda6d4bb20f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:43.188049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ad9fa-1dc3-4937-83df-672804055fc1 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:43.189770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ad9fa-1dc3-4937-83df-672804055fc1 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:43.190715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ad9fa-1dc3-4937-83df-672804055fc1 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] PATH_INFO: `/v3/domains/27907a96983a4cb3a172645fa411800e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:43.192911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ad9fa-1dc3-4937-83df-672804055fc1 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=27907a96983a4cb3a172645fa411800e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:43.195100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ad9fa-1dc3-4937-83df-672804055fc1 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:43.235366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-259ad9fa-1dc3-4937-83df-672804055fc1 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '27907a96983a4cb3a172645fa411800e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:43.237048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-259ad9fa-1dc3-4937-83df-672804055fc1 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '27907a96983a4cb3a172645fa411800e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:43.385591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-259ad9fa-1dc3-4937-83df-672804055fc1 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '27907a96983a4cb3a172645fa411800e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:43.389460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-259ad9fa-1dc3-4937-83df-672804055fc1 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '27907a96983a4cb3a172645fa411800e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:43.403442 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2561/5139] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:19:43 2022] PATCH /identity/v3/domains/27907a96983a4cb3a172645fa411800e => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:43.405580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf4799-6995-4222-905d-eceeb85733e5 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:43.414091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1ebf4799-6995-4222-905d-eceeb85733e5 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:43.461244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf4799-6995-4222-905d-eceeb85733e5 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:43.575672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5336de3-e5dc-4886-a915-ce3056349ade tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9f80c6bf0aa4ca3b0831b5257bb14e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38f68fb142d4bf48567eda6d4bb20f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:43.576666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5336de3-e5dc-4886-a915-ce3056349ade tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:43.577638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5336de3-e5dc-4886-a915-ce3056349ade tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:43.578046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5336de3-e5dc-4886-a915-ce3056349ade tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] PATH_INFO: `/v3/domains/27907a96983a4cb3a172645fa411800e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:43.598824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ad9fa-1dc3-4937-83df-672804055fc1 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:43.603947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-259ad9fa-1dc3-4937-83df-672804055fc1 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:43.613539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5336de3-e5dc-4886-a915-ce3056349ade tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=27907a96983a4cb3a172645fa411800e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:43.617481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5336de3-e5dc-4886-a915-ce3056349ade tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:43.727243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c5336de3-e5dc-4886-a915-ce3056349ade tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '27907a96983a4cb3a172645fa411800e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:43.758849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c5336de3-e5dc-4886-a915-ce3056349ade tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '27907a96983a4cb3a172645fa411800e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:43.814008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:43.892206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c5336de3-e5dc-4886-a915-ce3056349ade tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27907a96983a4cb3a172645fa411800e', 'request_id': 'req-c5336de3-e5dc-4886-a915-ce3056349ade'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:43.902725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c5336de3-e5dc-4886-a915-ce3056349ade tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27907a96983a4cb3a172645fa411800e', 'request_id': 'req-c5336de3-e5dc-4886-a915-ce3056349ade'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:43.923328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:UPDATE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:43.925946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c5336de3-e5dc-4886-a915-ce3056349ade tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27907a96983a4cb3a172645fa411800e', 'request_id': 'req-c5336de3-e5dc-4886-a915-ce3056349ade'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:43.944352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c5336de3-e5dc-4886-a915-ce3056349ade tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] The token cache is being invalidate because project 27907a96983a4cb3a172645fa411800e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:43.944705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c5336de3-e5dc-4886-a915-ce3056349ade tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:43.948299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c5336de3-e5dc-4886-a915-ce3056349ade tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:43.954881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ad9fa-1dc3-4937-83df-672804055fc1 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:43.979017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c5336de3-e5dc-4886-a915-ce3056349ade tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '27907a96983a4cb3a172645fa411800e', 'request_id': 'req-c5336de3-e5dc-4886-a915-ce3056349ade'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:43.980283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c5336de3-e5dc-4886-a915-ce3056349ade tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '27907a96983a4cb3a172645fa411800e', 'request_id': 'req-c5336de3-e5dc-4886-a915-ce3056349ade'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:43.984014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c5336de3-e5dc-4886-a915-ce3056349ade tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '27907a96983a4cb3a172645fa411800e', 'request_id': 'req-c5336de3-e5dc-4886-a915-ce3056349ade'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:44.006282 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2579/5140] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:19:43 2022] DELETE /identity/v3/domains/27907a96983a4cb3a172645fa411800e => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:44.007406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5336de3-e5dc-4886-a915-ce3056349ade tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:44.012367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c5336de3-e5dc-4886-a915-ce3056349ade tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:44.165725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5336de3-e5dc-4886-a915-ce3056349ade tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:44.182296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ddaa1-ad12-4385-b6b6-80d59683a6b6 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9f80c6bf0aa4ca3b0831b5257bb14e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38f68fb142d4bf48567eda6d4bb20f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:44.182983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ddaa1-ad12-4385-b6b6-80d59683a6b6 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:44.183274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ddaa1-ad12-4385-b6b6-80d59683a6b6 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:44.183606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ddaa1-ad12-4385-b6b6-80d59683a6b6 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] PATH_INFO: `/v3/domains/31d74a3c08e24b98ad4007fb532df1d3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:44.198373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ddaa1-ad12-4385-b6b6-80d59683a6b6 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 21:19:44.218222 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-873ddaa1-ad12-4385-b6b6-80d59683a6b6 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Could not find domain: 31d74a3c08e24b98ad4007fb532df1d3.: keystone.exception.DomainNotFound: Could not find domain: 31d74a3c08e24b98ad4007fb532df1d3. Jul 30 21:19:44.218222 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:19:44.218222 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 30 21:19:44.218222 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 30 21:19:44.218222 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 21:19:44.218222 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 21:19:44.218222 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 21:19:44.218222 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 21:19:44.218222 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 31d74a3c08e24b98ad4007fb532df1d3. Jul 30 21:19:44.218222 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:44.218222 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:19:44.218222 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:44.218222 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:19:44.218222 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:19:44.218222 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:19:44.219493 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:19:44.219493 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:19:44.219493 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:19:44.219493 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:19:44.219493 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:19:44.219493 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:19:44.219493 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:19:44.219493 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:19:44.219493 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Jul 30 21:19:44.219493 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Jul 30 21:19:44.219493 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 21:19:44.219493 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 21:19:44.219493 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 21:19:44.219493 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 21:19:44.219493 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:19:44.219493 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:19:44.220401 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:19:44.220401 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:19:44.220401 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:19:44.220401 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:19:44.220401 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:19:44.220401 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 21:19:44.220401 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:19:44.220401 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:19:44.220401 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:19:44.220401 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:19:44.220401 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:19:44.220401 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:19:44.220401 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:19:44.220401 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:19:44.220401 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 30 21:19:44.220401 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 21:19:44.220401 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 31d74a3c08e24b98ad4007fb532df1d3. Jul 30 21:19:44.221362 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:44.221362 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2580/5141] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:19:44 2022] DELETE /identity/v3/domains/31d74a3c08e24b98ad4007fb532df1d3 => generated 112 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:19:44.233892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ddaa1-ad12-4385-b6b6-80d59683a6b6 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:44.271227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ddaa1-ad12-4385-b6b6-80d59683a6b6 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:44.293406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc21950-2076-4f09-a6b0-5abaf43998f6 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9f80c6bf0aa4ca3b0831b5257bb14e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38f68fb142d4bf48567eda6d4bb20f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:44.294100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc21950-2076-4f09-a6b0-5abaf43998f6 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:44.294453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc21950-2076-4f09-a6b0-5abaf43998f6 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:44.294783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc21950-2076-4f09-a6b0-5abaf43998f6 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:44.300426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc8642-5bee-48e4-81f7-c00932c18a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:44.301948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc21950-2076-4f09-a6b0-5abaf43998f6 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:44.304485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc8642-5bee-48e4-81f7-c00932c18a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:44.304786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc8642-5bee-48e4-81f7-c00932c18a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:44.305072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc8642-5bee-48e4-81f7-c00932c18a86 admin admin] PATH_INFO: `/v3/projects/8ff72b6742dd4b79b92387ec359804a2` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:44.310122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc21950-2076-4f09-a6b0-5abaf43998f6 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:44.314766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc8642-5bee-48e4-81f7-c00932c18a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ff72b6742dd4b79b92387ec359804a2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:44.325399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc8642-5bee-48e4-81f7-c00932c18a86 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:44.360421 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2581/5142] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:19:44 2022] POST /identity/v3/domains => generated 253 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:44.364788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc21950-2076-4f09-a6b0-5abaf43998f6 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:44.520298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dccc8642-5bee-48e4-81f7-c00932c18a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ff72b6742dd4b79b92387ec359804a2', 'request_id': 'req-dccc8642-5bee-48e4-81f7-c00932c18a86'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:44.552499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dccc8642-5bee-48e4-81f7-c00932c18a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ff72b6742dd4b79b92387ec359804a2', 'request_id': 'req-dccc8642-5bee-48e4-81f7-c00932c18a86'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:44.564838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dccc8642-5bee-48e4-81f7-c00932c18a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ff72b6742dd4b79b92387ec359804a2', 'request_id': 'req-dccc8642-5bee-48e4-81f7-c00932c18a86'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:44.589755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dccc8642-5bee-48e4-81f7-c00932c18a86 admin admin] The token cache is being invalidate because project 8ff72b6742dd4b79b92387ec359804a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:44.589947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dccc8642-5bee-48e4-81f7-c00932c18a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:44.592611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dccc8642-5bee-48e4-81f7-c00932c18a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:44.594351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc21950-2076-4f09-a6b0-5abaf43998f6 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:44.607484 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2562/5143] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:43 2022] DELETE /identity/v3/projects/8ff72b6742dd4b79b92387ec359804a2 => generated 0 bytes in 1017 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:44.611592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb8f22-34d6-47f9-bc81-0e76479ad05f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:44.611927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb8f22-34d6-47f9-bc81-0e76479ad05f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:44.612218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb8f22-34d6-47f9-bc81-0e76479ad05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:44.616353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:44.674227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e4eb8f22-34d6-47f9-bc81-0e76479ad05f None None] MFA Rules not processed for user `f4b80fe0ec404f0480948be6e051c9e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:44.681724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e4eb8f22-34d6-47f9-bc81-0e76479ad05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:44.739894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179b3f2-1c3a-401e-b7e1-9e6c7b8045da tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9f80c6bf0aa4ca3b0831b5257bb14e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38f68fb142d4bf48567eda6d4bb20f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:44.740412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179b3f2-1c3a-401e-b7e1-9e6c7b8045da tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:44.740712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179b3f2-1c3a-401e-b7e1-9e6c7b8045da tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:44.741004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179b3f2-1c3a-401e-b7e1-9e6c7b8045da tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:44.741750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179b3f2-1c3a-401e-b7e1-9e6c7b8045da tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:44.754088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179b3f2-1c3a-401e-b7e1-9e6c7b8045da tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:44.773327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.sql.core [None req-b179b3f2-1c3a-401e-b7e1-9e6c7b8045da tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-2068306841' for key 'project.ixu_project_name_domain_id'") Jul 30 21:19:44.773327 ncdv-master-1 devstack@keystone.service[91085]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 30 21:19:44.773327 ncdv-master-1 devstack@keystone.service[91085]: [parameters: {'id': 'f97ce779c01b40a0b51299547e66bf68', 'name': 'tempest-domain-dup-2068306841', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jul 30 21:19:44.773327 ncdv-master-1 devstack@keystone.service[91085]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91085) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 30 21:19:44.786967 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-b179b3f2-1c3a-401e-b7e1-9e6c7b8045da tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-2068306841.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-2068306841. Jul 30 21:19:44.786967 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:19:44.786967 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 30 21:19:44.786967 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 30 21:19:44.786967 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 30 21:19:44.786967 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 30 21:19:44.786967 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 30 21:19:44.786967 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application result = self._query(query) Jul 30 21:19:44.786967 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 30 21:19:44.786967 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application conn.query(q) Jul 30 21:19:44.786967 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 30 21:19:44.786967 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 30 21:19:44.786967 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 30 21:19:44.788879 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application result.read() Jul 30 21:19:44.788879 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 30 21:19:44.788879 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 30 21:19:44.788879 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 30 21:19:44.788879 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 30 21:19:44.788879 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 30 21:19:44.788879 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 30 21:19:44.788879 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 30 21:19:44.788879 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 30 21:19:44.788879 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-2068306841' for key 'project.ixu_project_name_domain_id'") Jul 30 21:19:44.788879 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:44.788879 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 30 21:19:44.788879 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:44.788879 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:19:44.788879 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 30 21:19:44.788879 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 30 21:19:44.788879 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 30 21:19:44.788879 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 30 21:19:44.792527 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 30 21:19:44.792527 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application next(self.gen) Jul 30 21:19:44.792527 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 30 21:19:44.792527 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application yield resource Jul 30 21:19:44.792527 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 30 21:19:44.792527 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application next(self.gen) Jul 30 21:19:44.792527 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 30 21:19:44.792527 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.session.rollback() Jul 30 21:19:44.792527 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:19:44.792527 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.force_reraise() Jul 30 21:19:44.792527 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:19:44.792527 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise self.value Jul 30 21:19:44.792527 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 30 21:19:44.792527 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 30 21:19:44.792527 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 30 21:19:44.792527 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application session.commit() Jul 30 21:19:44.792527 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 30 21:19:44.794088 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 30 21:19:44.794088 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 30 21:19:44.794088 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._prepare_impl() Jul 30 21:19:44.794088 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 30 21:19:44.794088 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.session.flush() Jul 30 21:19:44.794088 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 30 21:19:44.794088 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._flush(objects) Jul 30 21:19:44.794088 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 30 21:19:44.794088 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 30 21:19:44.794088 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 30 21:19:44.794088 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application compat.raise_( Jul 30 21:19:44.794088 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 30 21:19:44.794088 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception Jul 30 21:19:44.794088 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 30 21:19:44.794088 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application flush_context.execute() Jul 30 21:19:44.794088 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 30 21:19:44.794088 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rec.execute(self) Jul 30 21:19:44.796470 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 30 21:19:44.796470 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 30 21:19:44.796470 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 30 21:19:44.796470 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 30 21:19:44.796470 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 30 21:19:44.796470 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 30 21:19:44.796470 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 30 21:19:44.796470 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 30 21:19:44.796470 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 30 21:19:44.796470 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 30 21:19:44.796470 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 30 21:19:44.796470 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 30 21:19:44.796470 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 30 21:19:44.796470 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 30 21:19:44.796470 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 30 21:19:44.798436 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 30 21:19:44.798436 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 30 21:19:44.798436 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception Jul 30 21:19:44.798436 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 30 21:19:44.798436 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 30 21:19:44.798436 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 30 21:19:44.798436 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 30 21:19:44.798436 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 30 21:19:44.798436 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application result = self._query(query) Jul 30 21:19:44.798436 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 30 21:19:44.798436 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application conn.query(q) Jul 30 21:19:44.798436 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 30 21:19:44.798436 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 30 21:19:44.798436 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 30 21:19:44.798436 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application result.read() Jul 30 21:19:44.798436 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 30 21:19:44.798436 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 30 21:19:44.801586 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 30 21:19:44.801586 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 30 21:19:44.801586 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 30 21:19:44.801586 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 30 21:19:44.801586 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 30 21:19:44.801586 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 30 21:19:44.801586 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-2068306841' for key 'project.ixu_project_name_domain_id'") Jul 30 21:19:44.801586 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 30 21:19:44.801586 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [parameters: {'id': 'f97ce779c01b40a0b51299547e66bf68', 'name': 'tempest-domain-dup-2068306841', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jul 30 21:19:44.801586 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 30 21:19:44.801586 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:44.801586 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:19:44.801586 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:44.801586 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:19:44.804594 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 30 21:19:44.804594 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 30 21:19:44.804594 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 30 21:19:44.804594 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 30 21:19:44.804594 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-2068306841. Jul 30 21:19:44.804594 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:44.804594 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:19:44.804594 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:44.804594 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:19:44.804594 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:19:44.804594 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:19:44.804594 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:19:44.804594 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:19:44.804594 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:19:44.804594 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:19:44.804594 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:19:44.804594 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:19:44.807042 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:19:44.807042 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:19:44.807042 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Jul 30 21:19:44.807042 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Jul 30 21:19:44.807042 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:19:44.807042 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:19:44.807042 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Jul 30 21:19:44.807042 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Jul 30 21:19:44.807042 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:19:44.807042 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:19:44.807042 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 30 21:19:44.807042 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 30 21:19:44.807042 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-2068306841. Jul 30 21:19:44.807042 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:19:44.807042 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2582/5144] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:19:44 2022] POST /identity/v3/domains => generated 212 bytes in 425 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 30 21:19:44.810114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c291f-0643-460a-beac-cf5561897e0b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:44.810114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c291f-0643-460a-beac-cf5561897e0b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:44.810114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c291f-0643-460a-beac-cf5561897e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:44.840599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d75c291f-0643-460a-beac-cf5561897e0b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:44.851924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d75c291f-0643-460a-beac-cf5561897e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:44.879074 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2563/5145] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:44.884688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb8f22-34d6-47f9-bc81-0e76479ad05f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:44.888327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e4eb8f22-34d6-47f9-bc81-0e76479ad05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:44.942329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb8f22-34d6-47f9-bc81-0e76479ad05f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:44.961636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd8ccb-b436-40e4-b2ae-d7394533e460 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9f80c6bf0aa4ca3b0831b5257bb14e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38f68fb142d4bf48567eda6d4bb20f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:44.963951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd8ccb-b436-40e4-b2ae-d7394533e460 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:44.964474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd8ccb-b436-40e4-b2ae-d7394533e460 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:44.964906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd8ccb-b436-40e4-b2ae-d7394533e460 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] PATH_INFO: `/v3/domains/4c363d455e194bb097c6fbe5ae601ebc` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:45.015067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd8ccb-b436-40e4-b2ae-d7394533e460 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4c363d455e194bb097c6fbe5ae601ebc)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:45.016857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd8ccb-b436-40e4-b2ae-d7394533e460 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:45.067423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:45.087054 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2583/5146] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:45.091159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b98bac-61ab-415e-aeba-c178344e73b6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:45.091482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b98bac-61ab-415e-aeba-c178344e73b6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:45.091730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b98bac-61ab-415e-aeba-c178344e73b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:45.118514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f2fd8ccb-b436-40e4-b2ae-d7394533e460 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4c363d455e194bb097c6fbe5ae601ebc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:45.119754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f2fd8ccb-b436-40e4-b2ae-d7394533e460 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4c363d455e194bb097c6fbe5ae601ebc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:45.155739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c5b98bac-61ab-415e-aeba-c178344e73b6 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:45.157519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c5b98bac-61ab-415e-aeba-c178344e73b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:45.183562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f2fd8ccb-b436-40e4-b2ae-d7394533e460 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4c363d455e194bb097c6fbe5ae601ebc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:45.184762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f2fd8ccb-b436-40e4-b2ae-d7394533e460 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4c363d455e194bb097c6fbe5ae601ebc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:45.196388 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2564/5147] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:19:44 2022] PATCH /identity/v3/domains/4c363d455e194bb097c6fbe5ae601ebc => generated 254 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:45.197506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd8ccb-b436-40e4-b2ae-d7394533e460 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:45.199237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f2fd8ccb-b436-40e4-b2ae-d7394533e460 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:45.295428 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2584/5148] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:45.301002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b98bac-61ab-415e-aeba-c178344e73b6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:45.323160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b98bac-61ab-415e-aeba-c178344e73b6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:45.337560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ce48e-3b74-459e-9dae-823269792ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:45.338355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ce48e-3b74-459e-9dae-823269792ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:45.338570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ce48e-3b74-459e-9dae-823269792ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:45.338860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ce48e-3b74-459e-9dae-823269792ba4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:45.339609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ce48e-3b74-459e-9dae-823269792ba4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:19:45.339913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ce48e-3b74-459e-9dae-823269792ba4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:45.341745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ce48e-3b74-459e-9dae-823269792ba4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:45.373018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd8ccb-b436-40e4-b2ae-d7394533e460 tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:45.376200 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2585/5149] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:45.381407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ce48e-3b74-459e-9dae-823269792ba4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:45.382333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259502a2-d7ea-4204-ae8a-22d645e859bc tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9f80c6bf0aa4ca3b0831b5257bb14e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38f68fb142d4bf48567eda6d4bb20f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:45.383161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259502a2-d7ea-4204-ae8a-22d645e859bc tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:45.383493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259502a2-d7ea-4204-ae8a-22d645e859bc tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:45.383809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259502a2-d7ea-4204-ae8a-22d645e859bc tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] PATH_INFO: `/v3/domains/4c363d455e194bb097c6fbe5ae601ebc` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:45.411612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ce48e-3b74-459e-9dae-823269792ba4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:45.417499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259502a2-d7ea-4204-ae8a-22d645e859bc tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4c363d455e194bb097c6fbe5ae601ebc)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:45.419197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259502a2-d7ea-4204-ae8a-22d645e859bc tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:45.426682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2a3fa-9f59-474e-a2d0-a92a620be34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:45.427351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2a3fa-9f59-474e-a2d0-a92a620be34b admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:45.427651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2a3fa-9f59-474e-a2d0-a92a620be34b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:45.427929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2a3fa-9f59-474e-a2d0-a92a620be34b admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:45.428604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2a3fa-9f59-474e-a2d0-a92a620be34b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:45.430616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2a3fa-9f59-474e-a2d0-a92a620be34b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:45.471174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-259502a2-d7ea-4204-ae8a-22d645e859bc tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4c363d455e194bb097c6fbe5ae601ebc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:45.479270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-259502a2-d7ea-4204-ae8a-22d645e859bc tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4c363d455e194bb097c6fbe5ae601ebc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:45.509004 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2586/5150] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:45 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:19:45.513434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2a3fa-9f59-474e-a2d0-a92a620be34b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:45.555571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:45.666035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2a3fa-9f59-474e-a2d0-a92a620be34b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:45.708214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-259502a2-d7ea-4204-ae8a-22d645e859bc tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c363d455e194bb097c6fbe5ae601ebc', 'request_id': 'req-259502a2-d7ea-4204-ae8a-22d645e859bc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:45.751956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-259502a2-d7ea-4204-ae8a-22d645e859bc tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c363d455e194bb097c6fbe5ae601ebc', 'request_id': 'req-259502a2-d7ea-4204-ae8a-22d645e859bc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:45.776993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-259502a2-d7ea-4204-ae8a-22d645e859bc tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c363d455e194bb097c6fbe5ae601ebc', 'request_id': 'req-259502a2-d7ea-4204-ae8a-22d645e859bc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:45.808359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-259502a2-d7ea-4204-ae8a-22d645e859bc tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] The token cache is being invalidate because project 4c363d455e194bb097c6fbe5ae601ebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:45.809897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-259502a2-d7ea-4204-ae8a-22d645e859bc tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:45.812635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-259502a2-d7ea-4204-ae8a-22d645e859bc tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:45.852006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-259502a2-d7ea-4204-ae8a-22d645e859bc tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4c363d455e194bb097c6fbe5ae601ebc', 'request_id': 'req-259502a2-d7ea-4204-ae8a-22d645e859bc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:45.869466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-259502a2-d7ea-4204-ae8a-22d645e859bc tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4c363d455e194bb097c6fbe5ae601ebc', 'request_id': 'req-259502a2-d7ea-4204-ae8a-22d645e859bc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:45.873022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-259502a2-d7ea-4204-ae8a-22d645e859bc tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4c363d455e194bb097c6fbe5ae601ebc', 'request_id': 'req-259502a2-d7ea-4204-ae8a-22d645e859bc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:45.880031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91645e-b02c-46b3-96f6-6121bf9486b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:45.882710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91645e-b02c-46b3-96f6-6121bf9486b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:45.883021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91645e-b02c-46b3-96f6-6121bf9486b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:45.883313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91645e-b02c-46b3-96f6-6121bf9486b4 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:45.884011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91645e-b02c-46b3-96f6-6121bf9486b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:45.893650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91645e-b02c-46b3-96f6-6121bf9486b4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:45.905579 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2565/5151] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:19:45 2022] DELETE /identity/v3/domains/4c363d455e194bb097c6fbe5ae601ebc => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:19:45.905579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259502a2-d7ea-4204-ae8a-22d645e859bc tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:45.906710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-259502a2-d7ea-4204-ae8a-22d645e859bc tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:45.933963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:45.963010 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2587/5152] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:45 2022] POST /identity/v3/users => generated 284 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:19:45.964731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91645e-b02c-46b3-96f6-6121bf9486b4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:45.969199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6c91645e-b02c-46b3-96f6-6121bf9486b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:46.014506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259502a2-d7ea-4204-ae8a-22d645e859bc tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:46.024749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9a605-5a26-4e52-ad75-5801e23185ce tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9f80c6bf0aa4ca3b0831b5257bb14e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38f68fb142d4bf48567eda6d4bb20f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:46.025554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9a605-5a26-4e52-ad75-5801e23185ce tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:46.025946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9a605-5a26-4e52-ad75-5801e23185ce tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:46.026490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9a605-5a26-4e52-ad75-5801e23185ce tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] PATH_INFO: `/v3/domains/27907a96983a4cb3a172645fa411800e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:46.029315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91645e-b02c-46b3-96f6-6121bf9486b4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:46.037655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e088b0-a7d4-4b73-8a02-57c7eaa1cc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:46.038378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e088b0-a7d4-4b73-8a02-57c7eaa1cc8a admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:46.038666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e088b0-a7d4-4b73-8a02-57c7eaa1cc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:46.039123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e088b0-a7d4-4b73-8a02-57c7eaa1cc8a admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:46.039926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e088b0-a7d4-4b73-8a02-57c7eaa1cc8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:46.041454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9a605-5a26-4e52-ad75-5801e23185ce tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 21:19:46.043842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e088b0-a7d4-4b73-8a02-57c7eaa1cc8a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:46.047999 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-f7c9a605-5a26-4e52-ad75-5801e23185ce tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Could not find domain: 27907a96983a4cb3a172645fa411800e.: keystone.exception.DomainNotFound: Could not find domain: 27907a96983a4cb3a172645fa411800e. Jul 30 21:19:46.047999 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:19:46.047999 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 30 21:19:46.047999 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 30 21:19:46.047999 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 21:19:46.047999 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 21:19:46.047999 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 21:19:46.047999 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 21:19:46.047999 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 27907a96983a4cb3a172645fa411800e. Jul 30 21:19:46.047999 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:19:46.047999 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:19:46.047999 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:19:46.047999 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:19:46.047999 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:19:46.047999 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:19:46.049222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:19:46.049222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:19:46.049222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:19:46.049222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:19:46.049222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:19:46.049222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:19:46.049222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:19:46.049222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:19:46.049222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 30 21:19:46.049222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 30 21:19:46.049222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 21:19:46.049222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 21:19:46.049222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 21:19:46.049222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 21:19:46.049222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:19:46.049222 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:19:46.050171 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:19:46.050171 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:19:46.050171 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:19:46.050171 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:19:46.050171 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:19:46.050171 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 21:19:46.050171 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:19:46.050171 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:19:46.050171 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:19:46.050171 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:19:46.050171 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:19:46.050171 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:19:46.050171 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:19:46.050171 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:19:46.050171 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 30 21:19:46.050171 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 21:19:46.050171 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 27907a96983a4cb3a172645fa411800e. Jul 30 21:19:46.051393 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:19:46.054887 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2566/5153] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:19:45 2022] PATCH /identity/v3/domains/27907a96983a4cb3a172645fa411800e => generated 112 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:19:46.056540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9a605-5a26-4e52-ad75-5801e23185ce tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:46.059134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f7c9a605-5a26-4e52-ad75-5801e23185ce tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:46.078618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9a605-5a26-4e52-ad75-5801e23185ce tempest-DomainsNegativeTestJSON-313676777 tempest-DomainsNegativeTestJSON-313676777-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:46.085002 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2588/5154] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:46.086426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e088b0-a7d4-4b73-8a02-57c7eaa1cc8a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:46.086847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f28914-edf8-429a-8438-43c94314e89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:46.087561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f28914-edf8-429a-8438-43c94314e89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:46.087936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f28914-edf8-429a-8438-43c94314e89e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:46.088220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f28914-edf8-429a-8438-43c94314e89e admin admin] PATH_INFO: `/v3/users/4d662626988746d9833006cfa01e28b2` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:46.089556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f28914-edf8-429a-8438-43c94314e89e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d662626988746d9833006cfa01e28b2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:46.093159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f28914-edf8-429a-8438-43c94314e89e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:46.112270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e088b0-a7d4-4b73-8a02-57c7eaa1cc8a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:46.127521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651c2ca-b2bf-497a-bf85-fc3c94efedcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:46.129691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651c2ca-b2bf-497a-bf85-fc3c94efedcd admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:46.130960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651c2ca-b2bf-497a-bf85-fc3c94efedcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:46.133048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651c2ca-b2bf-497a-bf85-fc3c94efedcd admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:46.135785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651c2ca-b2bf-497a-bf85-fc3c94efedcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:46.147869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651c2ca-b2bf-497a-bf85-fc3c94efedcd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:46.193851 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2589/5155] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:46.194852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651c2ca-b2bf-497a-bf85-fc3c94efedcd admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:46.196005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-73f28914-edf8-429a-8438-43c94314e89e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d662626988746d9833006cfa01e28b2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:46.197506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-73f28914-edf8-429a-8438-43c94314e89e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d662626988746d9833006cfa01e28b2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:46.234476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-73f28914-edf8-429a-8438-43c94314e89e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d662626988746d9833006cfa01e28b2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:46.236044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-73f28914-edf8-429a-8438-43c94314e89e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d662626988746d9833006cfa01e28b2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:46.236315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651c2ca-b2bf-497a-bf85-fc3c94efedcd admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:46.255932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830cdc2-cf67-4830-ac50-d1eeed6020a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:46.257380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830cdc2-cf67-4830-ac50-d1eeed6020a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:46.258078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-73f28914-edf8-429a-8438-43c94314e89e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d662626988746d9833006cfa01e28b2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:46.258244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830cdc2-cf67-4830-ac50-d1eeed6020a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:46.258546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830cdc2-cf67-4830-ac50-d1eeed6020a3 admin admin] PATH_INFO: `/v3/projects/9567b7f5b2404b98b11d747bbeccd4c7/users/31fd27a06d78454e82f4afa9097d275d/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:46.317052 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2567/5156] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:46 2022] DELETE /identity/v3/users/4d662626988746d9833006cfa01e28b2 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:46.322904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1829c-c8db-41c4-bd05-b2161922304b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:46.324733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1829c-c8db-41c4-bd05-b2161922304b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:46.325919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1829c-c8db-41c4-bd05-b2161922304b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:46.336702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830cdc2-cf67-4830-ac50-d1eeed6020a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9567b7f5b2404b98b11d747bbeccd4c7, user_id=31fd27a06d78454e82f4afa9097d275d, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:46.347657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830cdc2-cf67-4830-ac50-d1eeed6020a3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:46.401205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-75b1829c-c8db-41c4-bd05-b2161922304b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:46.402255 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2590/5157] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:46 2022] PUT /identity/v3/projects/9567b7f5b2404b98b11d747bbeccd4c7/users/31fd27a06d78454e82f4afa9097d275d/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:46.412504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-75b1829c-c8db-41c4-bd05-b2161922304b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:46.415470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b4a54-4765-40c1-9625-7a958d4765e5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:46.415869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b4a54-4765-40c1-9625-7a958d4765e5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:46.416251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b4a54-4765-40c1-9625-7a958d4765e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:46.502806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c08b4a54-4765-40c1-9625-7a958d4765e5 None None] MFA Rules not processed for user `31fd27a06d78454e82f4afa9097d275d`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:46.504677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c08b4a54-4765-40c1-9625-7a958d4765e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:46.568668 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2568/5158] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:46.608434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1829c-c8db-41c4-bd05-b2161922304b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:46.610517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-75b1829c-c8db-41c4-bd05-b2161922304b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:46.635271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:46.659208 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2591/5159] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:46.665217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b4a54-4765-40c1-9625-7a958d4765e5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:46.668495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c08b4a54-4765-40c1-9625-7a958d4765e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:46.700164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:46.718664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b4a54-4765-40c1-9625-7a958d4765e5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:46.734248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f256fc-b3df-4e02-8cba-9d00684085e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:46.744344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f256fc-b3df-4e02-8cba-9d00684085e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:46.744787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f256fc-b3df-4e02-8cba-9d00684085e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:46.745157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f256fc-b3df-4e02-8cba-9d00684085e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:46.746039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f256fc-b3df-4e02-8cba-9d00684085e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:46.751711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f256fc-b3df-4e02-8cba-9d00684085e9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:46.839358 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2592/5160] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:46 2022] POST /identity/v3/projects => generated 365 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:46.845638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f256fc-b3df-4e02-8cba-9d00684085e9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:46.868336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1829c-c8db-41c4-bd05-b2161922304b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:47.045243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b640fe6-17a5-4ff9-a3f5-16c8ada52ac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:47.046029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b640fe6-17a5-4ff9-a3f5-16c8ada52ac7 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:47.046320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b640fe6-17a5-4ff9-a3f5-16c8ada52ac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:47.046599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b640fe6-17a5-4ff9-a3f5-16c8ada52ac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:47.059188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f256fc-b3df-4e02-8cba-9d00684085e9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:47.071229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0038e9-4097-48fd-b92e-2af16f6ee737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:47.074292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0038e9-4097-48fd-b92e-2af16f6ee737 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:47.074821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0038e9-4097-48fd-b92e-2af16f6ee737 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:47.082823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b640fe6-17a5-4ff9-a3f5-16c8ada52ac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:47.091715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b640fe6-17a5-4ff9-a3f5-16c8ada52ac7 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:47.096389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0038e9-4097-48fd-b92e-2af16f6ee737 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:47.097796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0038e9-4097-48fd-b92e-2af16f6ee737 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:47.110385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0038e9-4097-48fd-b92e-2af16f6ee737 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:47.118452 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2569/5161] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:19:47.180879 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2593/5162] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:46 2022] POST /identity/v3/users => generated 289 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:47.183142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b640fe6-17a5-4ff9-a3f5-16c8ada52ac7 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:47.200742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b640fe6-17a5-4ff9-a3f5-16c8ada52ac7 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:47.213582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb8b2b-4d26-458b-a1e8-422fc25f8ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:47.217989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb8b2b-4d26-458b-a1e8-422fc25f8ded admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:47.220153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb8b2b-4d26-458b-a1e8-422fc25f8ded admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:47.220699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb8b2b-4d26-458b-a1e8-422fc25f8ded admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:47.224078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb8b2b-4d26-458b-a1e8-422fc25f8ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:47.229438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb8b2b-4d26-458b-a1e8-422fc25f8ded admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:47.268136 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2570/5163] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:47.273319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0038e9-4097-48fd-b92e-2af16f6ee737 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:47.315741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0038e9-4097-48fd-b92e-2af16f6ee737 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:47.335396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab4efb-b20c-4ab4-ab71-25c2935dbebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:47.336305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab4efb-b20c-4ab4-ab71-25c2935dbebe admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:47.336603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab4efb-b20c-4ab4-ab71-25c2935dbebe admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:47.336922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab4efb-b20c-4ab4-ab71-25c2935dbebe admin admin] PATH_INFO: `/v3/projects/dd62e2bc29dd427495fa6947b61122e6/users/521f65645ae6410482f6e1570a221629/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:47.438782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab4efb-b20c-4ab4-ab71-25c2935dbebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd62e2bc29dd427495fa6947b61122e6, user_id=521f65645ae6410482f6e1570a221629, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:47.450588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab4efb-b20c-4ab4-ab71-25c2935dbebe admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:47.509562 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2594/5164] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:47 2022] PUT /identity/v3/projects/dd62e2bc29dd427495fa6947b61122e6/users/521f65645ae6410482f6e1570a221629/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:19:47.513576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb8b2b-4d26-458b-a1e8-422fc25f8ded admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:47.535883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb8b2b-4d26-458b-a1e8-422fc25f8ded admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:47.725926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bb12a-7366-4bc8-8a4d-3fca9d0975ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:47.728251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bb12a-7366-4bc8-8a4d-3fca9d0975ea admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:47.729889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bb12a-7366-4bc8-8a4d-3fca9d0975ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:47.731790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bb12a-7366-4bc8-8a4d-3fca9d0975ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:47.734820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26bb12a-7366-4bc8-8a4d-3fca9d0975ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:47.740787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26bb12a-7366-4bc8-8a4d-3fca9d0975ea admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:47.770380 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2571/5165] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:19:47.780319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab4efb-b20c-4ab4-ab71-25c2935dbebe admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:47.806304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab4efb-b20c-4ab4-ab71-25c2935dbebe admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:47.822196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33489-138f-4c97-8451-4988f180f852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:47.823845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33489-138f-4c97-8451-4988f180f852 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:47.824142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33489-138f-4c97-8451-4988f180f852 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:47.824432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33489-138f-4c97-8451-4988f180f852 admin admin] PATH_INFO: `/v3/projects/dd62e2bc29dd427495fa6947b61122e6/users/521f65645ae6410482f6e1570a221629/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:47.835318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd33489-138f-4c97-8451-4988f180f852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd62e2bc29dd427495fa6947b61122e6, user_id=521f65645ae6410482f6e1570a221629, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:47.838219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd33489-138f-4c97-8451-4988f180f852 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:47.874680 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2595/5166] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:47 2022] PUT /identity/v3/projects/dd62e2bc29dd427495fa6947b61122e6/users/521f65645ae6410482f6e1570a221629/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:47.891806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d261300-462c-4b10-869a-55e6a3aadb16 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:47.892381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d261300-462c-4b10-869a-55e6a3aadb16 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:47.892839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d261300-462c-4b10-869a-55e6a3aadb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:48.016501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2d261300-462c-4b10-869a-55e6a3aadb16 None None] MFA Rules not processed for user `521f65645ae6410482f6e1570a221629`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:48.020331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2d261300-462c-4b10-869a-55e6a3aadb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:48.158405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:48.198574 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2572/5167] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:47 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:48.204573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33489-138f-4c97-8451-4988f180f852 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:48.223268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33489-138f-4c97-8451-4988f180f852 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:48.235601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779504d2-bf99-495b-a62d-5007828f4077 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:48.236256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779504d2-bf99-495b-a62d-5007828f4077 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:48.236716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779504d2-bf99-495b-a62d-5007828f4077 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:48.238208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779504d2-bf99-495b-a62d-5007828f4077 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:48.239001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779504d2-bf99-495b-a62d-5007828f4077 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:48.240872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779504d2-bf99-495b-a62d-5007828f4077 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:48.309911 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2596/5168] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:48 2022] POST /identity/v3/projects => generated 360 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:48.311451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d261300-462c-4b10-869a-55e6a3aadb16 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:48.323130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d261300-462c-4b10-869a-55e6a3aadb16 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:48.489141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7e5e3-0323-4c6a-bda2-2e3cdee9ddb9 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:48.489862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7e5e3-0323-4c6a-bda2-2e3cdee9ddb9 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:48.490153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7e5e3-0323-4c6a-bda2-2e3cdee9ddb9 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:48.490436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7e5e3-0323-4c6a-bda2-2e3cdee9ddb9 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:48.491129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7e5e3-0323-4c6a-bda2-2e3cdee9ddb9 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:48.493051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7e5e3-0323-4c6a-bda2-2e3cdee9ddb9 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:48.560092 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2573/5169] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:48 2022] POST /identity/v3/users => generated 373 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:48.562662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779504d2-bf99-495b-a62d-5007828f4077 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:48.582991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779504d2-bf99-495b-a62d-5007828f4077 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:48.598108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9437ec-65a7-4bf5-a205-dd1b10f370e0 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:48.600163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9437ec-65a7-4bf5-a205-dd1b10f370e0 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:48.600471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9437ec-65a7-4bf5-a205-dd1b10f370e0 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:48.600782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9437ec-65a7-4bf5-a205-dd1b10f370e0 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/users/43333abaa82d49bb990ced8623a700db` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:48.657711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9437ec-65a7-4bf5-a205-dd1b10f370e0 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:get_user(user_id=43333abaa82d49bb990ced8623a700db)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:48.660740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9437ec-65a7-4bf5-a205-dd1b10f370e0 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:48.668270 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2597/5170] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:19:48 2022] GET /identity/v3/users/43333abaa82d49bb990ced8623a700db => generated 373 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:48.669684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7e5e3-0323-4c6a-bda2-2e3cdee9ddb9 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:48.691141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7e5e3-0323-4c6a-bda2-2e3cdee9ddb9 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:48.701301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b0974-0f5a-4cf9-9b56-4d81617339c3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:48.701976 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b0974-0f5a-4cf9-9b56-4d81617339c3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:48.702394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b0974-0f5a-4cf9-9b56-4d81617339c3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:48.702525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b0974-0f5a-4cf9-9b56-4d81617339c3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/users/43333abaa82d49bb990ced8623a700db` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:48.704382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b0974-0f5a-4cf9-9b56-4d81617339c3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:delete_user(user_id=43333abaa82d49bb990ced8623a700db)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:48.707099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b0974-0f5a-4cf9-9b56-4d81617339c3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:48.835502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4c8b0974-0f5a-4cf9-9b56-4d81617339c3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43333abaa82d49bb990ced8623a700db'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:48.836567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4c8b0974-0f5a-4cf9-9b56-4d81617339c3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43333abaa82d49bb990ced8623a700db'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:48.875705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4c8b0974-0f5a-4cf9-9b56-4d81617339c3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43333abaa82d49bb990ced8623a700db'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:48.877531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4c8b0974-0f5a-4cf9-9b56-4d81617339c3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43333abaa82d49bb990ced8623a700db'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:48.909294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4c8b0974-0f5a-4cf9-9b56-4d81617339c3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43333abaa82d49bb990ced8623a700db'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:48.962746 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2574/5171] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:48 2022] DELETE /identity/v3/users/43333abaa82d49bb990ced8623a700db => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:48.964281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9437ec-65a7-4bf5-a205-dd1b10f370e0 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:48.966878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cd9437ec-65a7-4bf5-a205-dd1b10f370e0 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:48.994891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9437ec-65a7-4bf5-a205-dd1b10f370e0 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:49.142411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:49.165514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5c57e-f17d-42b9-8e6b-22f8ce07bc21 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:49.166260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5c57e-f17d-42b9-8e6b-22f8ce07bc21 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:49.166686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5c57e-f17d-42b9-8e6b-22f8ce07bc21 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:49.167037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5c57e-f17d-42b9-8e6b-22f8ce07bc21 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/projects/00e9c0f62cae485eb4bd38e3e078ecf9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:49.169765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5c57e-f17d-42b9-8e6b-22f8ce07bc21 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:delete_project(project_id=00e9c0f62cae485eb4bd38e3e078ecf9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:49.172372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5c57e-f17d-42b9-8e6b-22f8ce07bc21 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:49.244299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b0974-0f5a-4cf9-9b56-4d81617339c3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:49.245958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4c8b0974-0f5a-4cf9-9b56-4d81617339c3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:49.379584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-61c5c57e-f17d-42b9-8e6b-22f8ce07bc21 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e9c0f62cae485eb4bd38e3e078ecf9', 'request_id': 'req-61c5c57e-f17d-42b9-8e6b-22f8ce07bc21'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:49.402969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-61c5c57e-f17d-42b9-8e6b-22f8ce07bc21 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e9c0f62cae485eb4bd38e3e078ecf9', 'request_id': 'req-61c5c57e-f17d-42b9-8e6b-22f8ce07bc21'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:49.426561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-61c5c57e-f17d-42b9-8e6b-22f8ce07bc21 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e9c0f62cae485eb4bd38e3e078ecf9', 'request_id': 'req-61c5c57e-f17d-42b9-8e6b-22f8ce07bc21'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:49.450468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-61c5c57e-f17d-42b9-8e6b-22f8ce07bc21 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] The token cache is being invalidate because project 00e9c0f62cae485eb4bd38e3e078ecf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:49.452769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-61c5c57e-f17d-42b9-8e6b-22f8ce07bc21 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:49.454929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-61c5c57e-f17d-42b9-8e6b-22f8ce07bc21 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:49.459488 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2598/5172] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:48 2022] DELETE /identity/v3/projects/00e9c0f62cae485eb4bd38e3e078ecf9 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:49.465310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5c57e-f17d-42b9-8e6b-22f8ce07bc21 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:49.468079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-61c5c57e-f17d-42b9-8e6b-22f8ce07bc21 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:49.498964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:49.548199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b0974-0f5a-4cf9-9b56-4d81617339c3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:49.642253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5c57e-f17d-42b9-8e6b-22f8ce07bc21 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:49.651694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3d6d5-a612-4136-86a2-3c1142034b37 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:49.652568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3d6d5-a612-4136-86a2-3c1142034b37 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:49.655420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3d6d5-a612-4136-86a2-3c1142034b37 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:49.655420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3d6d5-a612-4136-86a2-3c1142034b37 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:49.655420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3d6d5-a612-4136-86a2-3c1142034b37 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:49.656824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3d6d5-a612-4136-86a2-3c1142034b37 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:49.720567 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2599/5173] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:49 2022] POST /identity/v3/projects => generated 360 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:49.728061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3d6d5-a612-4136-86a2-3c1142034b37 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:49.790394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e729e-52af-47eb-8030-c86cbd7b65eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:49.791215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e729e-52af-47eb-8030-c86cbd7b65eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:49.792759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e729e-52af-47eb-8030-c86cbd7b65eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:49.793551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e729e-52af-47eb-8030-c86cbd7b65eb admin admin] PATH_INFO: `/v3/users/23ba5ddf22424eff840602440872f86e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:49.798644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e729e-52af-47eb-8030-c86cbd7b65eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ba5ddf22424eff840602440872f86e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:49.808032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e729e-52af-47eb-8030-c86cbd7b65eb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:49.911149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3d6d5-a612-4136-86a2-3c1142034b37 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:49.942393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5dc42-09f3-4f96-bffa-b3fc39e2bb61 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:49.944286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5dc42-09f3-4f96-bffa-b3fc39e2bb61 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:49.945833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5dc42-09f3-4f96-bffa-b3fc39e2bb61 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:49.946963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5dc42-09f3-4f96-bffa-b3fc39e2bb61 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:49.950937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5dc42-09f3-4f96-bffa-b3fc39e2bb61 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:49.958481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5dc42-09f3-4f96-bffa-b3fc39e2bb61 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:50.051620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:50.063694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8f1e729e-52af-47eb-8030-c86cbd7b65eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ba5ddf22424eff840602440872f86e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:50.075339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8f1e729e-52af-47eb-8030-c86cbd7b65eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ba5ddf22424eff840602440872f86e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:50.099912 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2600/5174] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:49 2022] POST /identity/v3/users => generated 414 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:50.103227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5dc42-09f3-4f96-bffa-b3fc39e2bb61 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:50.116626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e0a5dc42-09f3-4f96-bffa-b3fc39e2bb61 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:50.121499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8f1e729e-52af-47eb-8030-c86cbd7b65eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ba5ddf22424eff840602440872f86e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:50.125029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8f1e729e-52af-47eb-8030-c86cbd7b65eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ba5ddf22424eff840602440872f86e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:50.179154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8f1e729e-52af-47eb-8030-c86cbd7b65eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ba5ddf22424eff840602440872f86e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:50.261688 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2575/5175] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:49 2022] DELETE /identity/v3/users/23ba5ddf22424eff840602440872f86e => generated 0 bytes in 989 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:50.261688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e729e-52af-47eb-8030-c86cbd7b65eb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:50.261688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8f1e729e-52af-47eb-8030-c86cbd7b65eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:50.437233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e729e-52af-47eb-8030-c86cbd7b65eb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:50.460505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5dc42-09f3-4f96-bffa-b3fc39e2bb61 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:50.485466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11843e5-551a-4205-809a-c48981f44509 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:50.489047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11843e5-551a-4205-809a-c48981f44509 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:50.491249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11843e5-551a-4205-809a-c48981f44509 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:50.492088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11843e5-551a-4205-809a-c48981f44509 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:50.494224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11843e5-551a-4205-809a-c48981f44509 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:50.497366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11843e5-551a-4205-809a-c48981f44509 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:50.557470 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2576/5176] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:19:50 2022] POST /identity/v3/roles => generated 239 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:50.561331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11843e5-551a-4205-809a-c48981f44509 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:50.586887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11843e5-551a-4205-809a-c48981f44509 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:50.598610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21601eb6-a9f2-4186-89e4-1f0e85766c89 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:50.599365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21601eb6-a9f2-4186-89e4-1f0e85766c89 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:50.599719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21601eb6-a9f2-4186-89e4-1f0e85766c89 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:50.599997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21601eb6-a9f2-4186-89e4-1f0e85766c89 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/users/a6ab4d17cdde4a9a90b91a5a81a81db6` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:50.629542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:50.640010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21601eb6-a9f2-4186-89e4-1f0e85766c89 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:get_user(user_id=a6ab4d17cdde4a9a90b91a5a81a81db6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:50.642285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21601eb6-a9f2-4186-89e4-1f0e85766c89 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:50.651723 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2577/5177] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:19:50 2022] GET /identity/v3/users/a6ab4d17cdde4a9a90b91a5a81a81db6 => generated 414 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:50.652703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21601eb6-a9f2-4186-89e4-1f0e85766c89 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:50.656047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351927d-951b-480b-8165-ace4e3f1024e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:50.656720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351927d-951b-480b-8165-ace4e3f1024e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:50.657220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351927d-951b-480b-8165-ace4e3f1024e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:50.657674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351927d-951b-480b-8165-ace4e3f1024e admin admin] PATH_INFO: `/v3/projects/5dce83da5a8440d8a085c55ecc1c2a30` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:50.664104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351927d-951b-480b-8165-ace4e3f1024e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dce83da5a8440d8a085c55ecc1c2a30)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:50.668837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351927d-951b-480b-8165-ace4e3f1024e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:50.716759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21601eb6-a9f2-4186-89e4-1f0e85766c89 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:50.741049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add21cdd-e463-465d-821b-cefaa0d8b2cb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:50.741942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add21cdd-e463-465d-821b-cefaa0d8b2cb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:50.742400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add21cdd-e463-465d-821b-cefaa0d8b2cb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:50.742834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add21cdd-e463-465d-821b-cefaa0d8b2cb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/roles/f59c7adb8fdb45bc960503c0737deb0c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:50.746849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add21cdd-e463-465d-821b-cefaa0d8b2cb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:get_role(role_id=f59c7adb8fdb45bc960503c0737deb0c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:50.748295 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-add21cdd-e463-465d-821b-cefaa0d8b2cb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:50.748295 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:19:50.748295 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:19:50.752434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add21cdd-e463-465d-821b-cefaa0d8b2cb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:50.758066 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2578/5178] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:19:50 2022] GET /identity/v3/roles/f59c7adb8fdb45bc960503c0737deb0c => generated 239 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:50.761963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add21cdd-e463-465d-821b-cefaa0d8b2cb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:50.783932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add21cdd-e463-465d-821b-cefaa0d8b2cb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:50.813434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840ef1e-65d6-4c98-94ec-ddc0600a0a0f tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:50.814921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840ef1e-65d6-4c98-94ec-ddc0600a0a0f tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:50.815511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840ef1e-65d6-4c98-94ec-ddc0600a0a0f tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:50.816027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840ef1e-65d6-4c98-94ec-ddc0600a0a0f tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:50.817040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840ef1e-65d6-4c98-94ec-ddc0600a0a0f tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:50.820628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840ef1e-65d6-4c98-94ec-ddc0600a0a0f tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:50.852940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e351927d-951b-480b-8165-ace4e3f1024e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dce83da5a8440d8a085c55ecc1c2a30', 'request_id': 'req-e351927d-951b-480b-8165-ace4e3f1024e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:50.879948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e351927d-951b-480b-8165-ace4e3f1024e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dce83da5a8440d8a085c55ecc1c2a30', 'request_id': 'req-e351927d-951b-480b-8165-ace4e3f1024e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:50.894804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e351927d-951b-480b-8165-ace4e3f1024e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dce83da5a8440d8a085c55ecc1c2a30', 'request_id': 'req-e351927d-951b-480b-8165-ace4e3f1024e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:50.919834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e351927d-951b-480b-8165-ace4e3f1024e admin admin] The token cache is being invalidate because project 5dce83da5a8440d8a085c55ecc1c2a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:50.920377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e351927d-951b-480b-8165-ace4e3f1024e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:50.921459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e351927d-951b-480b-8165-ace4e3f1024e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:50.927177 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2601/5179] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:50 2022] DELETE /identity/v3/projects/5dce83da5a8440d8a085c55ecc1c2a30 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:50.928286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351927d-951b-480b-8165-ace4e3f1024e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:50.936745 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2579/5180] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:50 2022] POST /identity/v3/projects => generated 359 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:19:50.941538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840ef1e-65d6-4c98-94ec-ddc0600a0a0f tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:50.945415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7840ef1e-65d6-4c98-94ec-ddc0600a0a0f tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:50.968862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e351927d-951b-480b-8165-ace4e3f1024e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:51.150168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840ef1e-65d6-4c98-94ec-ddc0600a0a0f tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:51.188283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e2c88-8f57-4e5e-9088-5fa066cdfbe5 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:51.195685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e2c88-8f57-4e5e-9088-5fa066cdfbe5 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:51.196204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e2c88-8f57-4e5e-9088-5fa066cdfbe5 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:51.199086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e2c88-8f57-4e5e-9088-5fa066cdfbe5 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/projects/73eb8dbf8bc642dea19cdbca4eb16364` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:51.201324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:51.213152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e2c88-8f57-4e5e-9088-5fa066cdfbe5 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:get_project(project_id=73eb8dbf8bc642dea19cdbca4eb16364)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:51.216325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e2c88-8f57-4e5e-9088-5fa066cdfbe5 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:51.236166 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2580/5181] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:19:50 2022] GET /identity/v3/projects/73eb8dbf8bc642dea19cdbca4eb16364 => generated 359 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:19:51.238126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e2c88-8f57-4e5e-9088-5fa066cdfbe5 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:51.247184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-358e2c88-8f57-4e5e-9088-5fa066cdfbe5 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:51.273261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351927d-951b-480b-8165-ace4e3f1024e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:51.442247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e2c88-8f57-4e5e-9088-5fa066cdfbe5 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:51.452169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62150a-89a1-42a0-8031-cb714d036516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:51.454318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62150a-89a1-42a0-8031-cb714d036516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:51.454846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62150a-89a1-42a0-8031-cb714d036516 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:51.455394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62150a-89a1-42a0-8031-cb714d036516 admin admin] PATH_INFO: `/v3/users/c9f80c6bf0aa4ca3b0831b5257bb14e6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:51.455607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b622510-0897-4fbc-b215-0830eecaea2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:51.457559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b622510-0897-4fbc-b215-0830eecaea2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:51.458694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b622510-0897-4fbc-b215-0830eecaea2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:51.459118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b622510-0897-4fbc-b215-0830eecaea2a admin admin] PATH_INFO: `/v3/projects/73245fdcb10c4144a60fa8ca6b6a7ab8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:51.460051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62150a-89a1-42a0-8031-cb714d036516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9f80c6bf0aa4ca3b0831b5257bb14e6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:51.461282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b622510-0897-4fbc-b215-0830eecaea2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=73245fdcb10c4144a60fa8ca6b6a7ab8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:51.465257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62150a-89a1-42a0-8031-cb714d036516 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:51.466771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b622510-0897-4fbc-b215-0830eecaea2a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:51.594592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fe62150a-89a1-42a0-8031-cb714d036516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9f80c6bf0aa4ca3b0831b5257bb14e6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:51.602155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4b622510-0897-4fbc-b215-0830eecaea2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'request_id': 'req-4b622510-0897-4fbc-b215-0830eecaea2a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:51.617411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4b622510-0897-4fbc-b215-0830eecaea2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'request_id': 'req-4b622510-0897-4fbc-b215-0830eecaea2a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:51.625361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4b622510-0897-4fbc-b215-0830eecaea2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'request_id': 'req-4b622510-0897-4fbc-b215-0830eecaea2a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:51.647672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fe62150a-89a1-42a0-8031-cb714d036516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9f80c6bf0aa4ca3b0831b5257bb14e6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:51.648548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fe62150a-89a1-42a0-8031-cb714d036516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9f80c6bf0aa4ca3b0831b5257bb14e6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:51.651799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4b622510-0897-4fbc-b215-0830eecaea2a admin admin] The token cache is being invalidate because project 73245fdcb10c4144a60fa8ca6b6a7ab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:51.652494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4b622510-0897-4fbc-b215-0830eecaea2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:51.654352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4b622510-0897-4fbc-b215-0830eecaea2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:51.658550 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2581/5182] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:51 2022] DELETE /identity/v3/projects/73245fdcb10c4144a60fa8ca6b6a7ab8 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:51.660017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b622510-0897-4fbc-b215-0830eecaea2a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:51.667629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4b622510-0897-4fbc-b215-0830eecaea2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:51.685739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:51.685935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fe62150a-89a1-42a0-8031-cb714d036516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9f80c6bf0aa4ca3b0831b5257bb14e6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:51.687684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fe62150a-89a1-42a0-8031-cb714d036516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9f80c6bf0aa4ca3b0831b5257bb14e6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:51.712836 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2602/5183] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:50 2022] DELETE /identity/v3/users/c9f80c6bf0aa4ca3b0831b5257bb14e6 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:51.714943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06abe0-6a40-47f4-aba8-c439e41bd3da None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:51.716162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06abe0-6a40-47f4-aba8-c439e41bd3da None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:51.716603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06abe0-6a40-47f4-aba8-c439e41bd3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:51.763742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0f06abe0-6a40-47f4-aba8-c439e41bd3da None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:51.773014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0f06abe0-6a40-47f4-aba8-c439e41bd3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:51.826660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b622510-0897-4fbc-b215-0830eecaea2a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:51.908873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:51.922686 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2603/5184] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:51.932236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1acc23-a693-4d8c-93d6-272e0e857203 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:51.932786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1acc23-a693-4d8c-93d6-272e0e857203 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:51.933374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1acc23-a693-4d8c-93d6-272e0e857203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:51.984636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2e1acc23-a693-4d8c-93d6-272e0e857203 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:51.985815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2e1acc23-a693-4d8c-93d6-272e0e857203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:52.009759 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2604/5185] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:52.011757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1acc23-a693-4d8c-93d6-272e0e857203 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:52.017827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37cfa2-957d-423e-a184-35aca95ce31e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:52.021629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37cfa2-957d-423e-a184-35aca95ce31e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:52.024331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37cfa2-957d-423e-a184-35aca95ce31e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:52.025288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37cfa2-957d-423e-a184-35aca95ce31e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/projects/73eb8dbf8bc642dea19cdbca4eb16364/users/a6ab4d17cdde4a9a90b91a5a81a81db6/roles/f59c7adb8fdb45bc960503c0737deb0c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:52.028424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1acc23-a693-4d8c-93d6-272e0e857203 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:52.030256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37cfa2-957d-423e-a184-35aca95ce31e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:create_grant(project_id=73eb8dbf8bc642dea19cdbca4eb16364, user_id=a6ab4d17cdde4a9a90b91a5a81a81db6, role_id=f59c7adb8fdb45bc960503c0737deb0c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:52.038323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37cfa2-957d-423e-a184-35aca95ce31e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:52.046637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2018f37-007a-4533-8189-c33156c1de18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:52.047649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2018f37-007a-4533-8189-c33156c1de18 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:52.047948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2018f37-007a-4533-8189-c33156c1de18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:52.048174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2018f37-007a-4533-8189-c33156c1de18 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:52.050964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2018f37-007a-4533-8189-c33156c1de18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:19:52.051110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2018f37-007a-4533-8189-c33156c1de18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:52.056691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2018f37-007a-4533-8189-c33156c1de18 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:52.071634 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2582/5186] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:51 2022] PUT /identity/v3/projects/73eb8dbf8bc642dea19cdbca4eb16364/users/a6ab4d17cdde4a9a90b91a5a81a81db6/roles/f59c7adb8fdb45bc960503c0737deb0c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:52.076264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37cfa2-957d-423e-a184-35aca95ce31e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:52.084736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ca37cfa2-957d-423e-a184-35aca95ce31e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:52.102722 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2605/5187] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:19:52.106212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2018f37-007a-4533-8189-c33156c1de18 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:52.142010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2018f37-007a-4533-8189-c33156c1de18 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:52.266942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37cfa2-957d-423e-a184-35aca95ce31e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:52.276732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd23103-93db-4879-bca7-5cc7233b6573 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:52.277977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd23103-93db-4879-bca7-5cc7233b6573 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:52.278590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd23103-93db-4879-bca7-5cc7233b6573 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:52.279139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd23103-93db-4879-bca7-5cc7233b6573 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:52.281418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd23103-93db-4879-bca7-5cc7233b6573 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:52.284118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd23103-93db-4879-bca7-5cc7233b6573 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:52.343551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8493f2-3ad4-4b96-8fe8-dd712788db36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:52.344313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8493f2-3ad4-4b96-8fe8-dd712788db36 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:52.344472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8493f2-3ad4-4b96-8fe8-dd712788db36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:52.346899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8493f2-3ad4-4b96-8fe8-dd712788db36 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:52.348889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8493f2-3ad4-4b96-8fe8-dd712788db36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:52.349622 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2583/5188] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:52 2022] POST /identity/v3/projects => generated 358 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:52.354258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8493f2-3ad4-4b96-8fe8-dd712788db36 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:52.355782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd23103-93db-4879-bca7-5cc7233b6573 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:52.421099 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2606/5189] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:52 2022] POST /identity/v3/projects => generated 385 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:52.426667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8493f2-3ad4-4b96-8fe8-dd712788db36 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:52.485434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:52.568592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd23103-93db-4879-bca7-5cc7233b6573 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:52.619911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8493f2-3ad4-4b96-8fe8-dd712788db36 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:52.639672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6a3ff-d65a-4add-84ea-380bc7f86ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:52.640630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6a3ff-d65a-4add-84ea-380bc7f86ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:52.642662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6a3ff-d65a-4add-84ea-380bc7f86ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:52.644857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6a3ff-d65a-4add-84ea-380bc7f86ae5 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:52.645841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6a3ff-d65a-4add-84ea-380bc7f86ae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:52.651531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6a3ff-d65a-4add-84ea-380bc7f86ae5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:52.731467 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2607/5190] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:52 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:52.732833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6a3ff-d65a-4add-84ea-380bc7f86ae5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:52.750904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab4ea0-4cc4-4cb0-af4c-442923f4ad27 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:52.754241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab4ea0-4cc4-4cb0-af4c-442923f4ad27 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:52.755024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab4ea0-4cc4-4cb0-af4c-442923f4ad27 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:52.756792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab4ea0-4cc4-4cb0-af4c-442923f4ad27 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/projects/6d765d298d5540eb81abf4c01924c43c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:52.763121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab4ea0-4cc4-4cb0-af4c-442923f4ad27 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:get_project(project_id=6d765d298d5540eb81abf4c01924c43c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:52.764435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6a3ff-d65a-4add-84ea-380bc7f86ae5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:52.767079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab4ea0-4cc4-4cb0-af4c-442923f4ad27 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:52.772536 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2584/5191] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:19:52 2022] GET /identity/v3/projects/6d765d298d5540eb81abf4c01924c43c => generated 358 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:52.776372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab4ea0-4cc4-4cb0-af4c-442923f4ad27 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:52.779820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a1799-427e-4d97-a371-cd5929c101d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:52.781737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a1799-427e-4d97-a371-cd5929c101d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:52.781737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a1799-427e-4d97-a371-cd5929c101d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:52.782073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a1799-427e-4d97-a371-cd5929c101d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:52.783226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a1799-427e-4d97-a371-cd5929c101d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:52.789102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a1799-427e-4d97-a371-cd5929c101d1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:52.793940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab4ea0-4cc4-4cb0-af4c-442923f4ad27 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:52.802185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92287d85-a8ab-40f8-b3f0-7b7205349942 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:52.804109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287d85-a8ab-40f8-b3f0-7b7205349942 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:52.804656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287d85-a8ab-40f8-b3f0-7b7205349942 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:52.805184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287d85-a8ab-40f8-b3f0-7b7205349942 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/projects/6d765d298d5540eb81abf4c01924c43c/users/a6ab4d17cdde4a9a90b91a5a81a81db6/roles/f59c7adb8fdb45bc960503c0737deb0c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:52.808545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92287d85-a8ab-40f8-b3f0-7b7205349942 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6d765d298d5540eb81abf4c01924c43c, user_id=a6ab4d17cdde4a9a90b91a5a81a81db6, role_id=f59c7adb8fdb45bc960503c0737deb0c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:52.813891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92287d85-a8ab-40f8-b3f0-7b7205349942 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:52.823780 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2608/5192] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:52 2022] GET /identity/v3/roles => generated 1650 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:52.827507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a1799-427e-4d97-a371-cd5929c101d1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:52.845459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a1799-427e-4d97-a371-cd5929c101d1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:52.872501 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2585/5193] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:52 2022] PUT /identity/v3/projects/6d765d298d5540eb81abf4c01924c43c/users/a6ab4d17cdde4a9a90b91a5a81a81db6/roles/f59c7adb8fdb45bc960503c0737deb0c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:52.878790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92287d85-a8ab-40f8-b3f0-7b7205349942 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:52.930567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:52.961517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ae636-fc1d-4139-9730-59d229113ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:52.962599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ae636-fc1d-4139-9730-59d229113ebc admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:52.963756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ae636-fc1d-4139-9730-59d229113ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:52.964251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ae636-fc1d-4139-9730-59d229113ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:52.965115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ae636-fc1d-4139-9730-59d229113ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:52.967388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ae636-fc1d-4139-9730-59d229113ebc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:53.013079 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2609/5194] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:52 2022] GET /identity/v3/roles => generated 1650 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:53.016219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ae636-fc1d-4139-9730-59d229113ebc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:53.025860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92287d85-a8ab-40f8-b3f0-7b7205349942 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:53.042507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3b1c3-5530-48ed-b95b-73e98e688380 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:53.043196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b1c3-5530-48ed-b95b-73e98e688380 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:53.043496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b1c3-5530-48ed-b95b-73e98e688380 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:53.044468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b1c3-5530-48ed-b95b-73e98e688380 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/users/a6ab4d17cdde4a9a90b91a5a81a81db6/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:53.046927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3b1c3-5530-48ed-b95b-73e98e688380 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=a6ab4d17cdde4a9a90b91a5a81a81db6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:53.048248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ae636-fc1d-4139-9730-59d229113ebc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:53.049121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3b1c3-5530-48ed-b95b-73e98e688380 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:53.063069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d764c04-0e84-406d-b642-fc23ee33c8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:53.065303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d764c04-0e84-406d-b642-fc23ee33c8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:53.067424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d764c04-0e84-406d-b642-fc23ee33c8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:53.069386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d764c04-0e84-406d-b642-fc23ee33c8f7 admin admin] PATH_INFO: `/v3/projects/77f90380b12343a0988af717ce0323e7/users/3ef2a5ef6d7b4a36b2ead7e1e605430c/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:53.107804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d764c04-0e84-406d-b642-fc23ee33c8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f90380b12343a0988af717ce0323e7, user_id=3ef2a5ef6d7b4a36b2ead7e1e605430c, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:53.112084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d764c04-0e84-406d-b642-fc23ee33c8f7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:53.138950 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2610/5195] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:53 2022] PUT /identity/v3/projects/77f90380b12343a0988af717ce0323e7/users/3ef2a5ef6d7b4a36b2ead7e1e605430c/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:53.144750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab30a8-568c-42d0-b9e5-6b2061c4ee61 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:53.145161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab30a8-568c-42d0-b9e5-6b2061c4ee61 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:53.150494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab30a8-568c-42d0-b9e5-6b2061c4ee61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:53.152156 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2586/5196] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:19:52 2022] GET /identity/v3/users/a6ab4d17cdde4a9a90b91a5a81a81db6/projects => generated 841 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:53.156576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3b1c3-5530-48ed-b95b-73e98e688380 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:53.172891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bfab30a8-568c-42d0-b9e5-6b2061c4ee61 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:53.174844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bfab30a8-568c-42d0-b9e5-6b2061c4ee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:53.176622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3b1c3-5530-48ed-b95b-73e98e688380 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:53.291801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:53.328809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4164d74-bdab-46f5-91ee-9efa4f3d42d7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:53.330176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4164d74-bdab-46f5-91ee-9efa4f3d42d7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:53.330663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4164d74-bdab-46f5-91ee-9efa4f3d42d7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:53.331358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4164d74-bdab-46f5-91ee-9efa4f3d42d7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/projects/6d765d298d5540eb81abf4c01924c43c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:53.332977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4164d74-bdab-46f5-91ee-9efa4f3d42d7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6d765d298d5540eb81abf4c01924c43c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:53.335430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4164d74-bdab-46f5-91ee-9efa4f3d42d7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:53.353849 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2611/5197] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:53.421850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab30a8-568c-42d0-b9e5-6b2061c4ee61 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:53.424104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bfab30a8-568c-42d0-b9e5-6b2061c4ee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:53.517263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e4164d74-bdab-46f5-91ee-9efa4f3d42d7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d765d298d5540eb81abf4c01924c43c', 'request_id': 'req-e4164d74-bdab-46f5-91ee-9efa4f3d42d7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:53.558857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e4164d74-bdab-46f5-91ee-9efa4f3d42d7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d765d298d5540eb81abf4c01924c43c', 'request_id': 'req-e4164d74-bdab-46f5-91ee-9efa4f3d42d7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:53.577624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e4164d74-bdab-46f5-91ee-9efa4f3d42d7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d765d298d5540eb81abf4c01924c43c', 'request_id': 'req-e4164d74-bdab-46f5-91ee-9efa4f3d42d7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:53.603568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab30a8-568c-42d0-b9e5-6b2061c4ee61 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:53.605680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e4164d74-bdab-46f5-91ee-9efa4f3d42d7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] The token cache is being invalidate because project 6d765d298d5540eb81abf4c01924c43c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:53.606049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e4164d74-bdab-46f5-91ee-9efa4f3d42d7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:53.607108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e4164d74-bdab-46f5-91ee-9efa4f3d42d7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:53.610412 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2587/5198] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:53 2022] DELETE /identity/v3/projects/6d765d298d5540eb81abf4c01924c43c => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:19:53.616264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4164d74-bdab-46f5-91ee-9efa4f3d42d7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:53.620993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e4164d74-bdab-46f5-91ee-9efa4f3d42d7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:53.754177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb979b-9455-4cd8-b1f1-132e65aef738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:53.755992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb979b-9455-4cd8-b1f1-132e65aef738 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:53.756281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb979b-9455-4cd8-b1f1-132e65aef738 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:53.756562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb979b-9455-4cd8-b1f1-132e65aef738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:53.761171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-53fb979b-9455-4cd8-b1f1-132e65aef738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:53.826029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4164d74-bdab-46f5-91ee-9efa4f3d42d7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:53.838490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:53.842099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bb900-c52c-4732-b637-b4af37cc8ddb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:53.843986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bb900-c52c-4732-b637-b4af37cc8ddb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:53.845048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bb900-c52c-4732-b637-b4af37cc8ddb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:53.846293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bb900-c52c-4732-b637-b4af37cc8ddb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/projects/73eb8dbf8bc642dea19cdbca4eb16364` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:53.848981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bb900-c52c-4732-b637-b4af37cc8ddb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:delete_project(project_id=73eb8dbf8bc642dea19cdbca4eb16364)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:53.853927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bb900-c52c-4732-b637-b4af37cc8ddb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:53.923190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb979b-9455-4cd8-b1f1-132e65aef738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:53.925628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb979b-9455-4cd8-b1f1-132e65aef738 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:53.947351 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2612/5199] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:19:53.959656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb979b-9455-4cd8-b1f1-132e65aef738 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:53.962660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-53fb979b-9455-4cd8-b1f1-132e65aef738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:53.969693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9a4bb900-c52c-4732-b637-b4af37cc8ddb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73eb8dbf8bc642dea19cdbca4eb16364', 'request_id': 'req-9a4bb900-c52c-4732-b637-b4af37cc8ddb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:53.985549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb979b-9455-4cd8-b1f1-132e65aef738 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:53.989989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9a4bb900-c52c-4732-b637-b4af37cc8ddb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73eb8dbf8bc642dea19cdbca4eb16364', 'request_id': 'req-9a4bb900-c52c-4732-b637-b4af37cc8ddb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:53.997405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9a4bb900-c52c-4732-b637-b4af37cc8ddb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73eb8dbf8bc642dea19cdbca4eb16364', 'request_id': 'req-9a4bb900-c52c-4732-b637-b4af37cc8ddb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:54.013295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:54.025377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9a4bb900-c52c-4732-b637-b4af37cc8ddb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] The token cache is being invalidate because project 73eb8dbf8bc642dea19cdbca4eb16364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:54.026798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9a4bb900-c52c-4732-b637-b4af37cc8ddb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:54.029783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9a4bb900-c52c-4732-b637-b4af37cc8ddb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:54.032467 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2588/5200] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:53 2022] DELETE /identity/v3/projects/73eb8dbf8bc642dea19cdbca4eb16364 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:54.036593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bb900-c52c-4732-b637-b4af37cc8ddb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:54.039173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9a4bb900-c52c-4732-b637-b4af37cc8ddb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:54.157784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d91408-f379-42a8-858f-257c16453446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:54.158454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d91408-f379-42a8-858f-257c16453446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:54.159269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d91408-f379-42a8-858f-257c16453446 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:54.159724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d91408-f379-42a8-858f-257c16453446 admin admin] PATH_INFO: `/v3/projects/b38f68fb142d4bf48567eda6d4bb20f8` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:54.164497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d91408-f379-42a8-858f-257c16453446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b38f68fb142d4bf48567eda6d4bb20f8)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:54.166933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d91408-f379-42a8-858f-257c16453446 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:54.220528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bb900-c52c-4732-b637-b4af37cc8ddb tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:54.233768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a759d-922f-47c0-9080-20ba3cbf73a8 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:54.234462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a759d-922f-47c0-9080-20ba3cbf73a8 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:54.235442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a759d-922f-47c0-9080-20ba3cbf73a8 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:54.235615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a759d-922f-47c0-9080-20ba3cbf73a8 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/roles/f59c7adb8fdb45bc960503c0737deb0c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:54.239010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a759d-922f-47c0-9080-20ba3cbf73a8 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f59c7adb8fdb45bc960503c0737deb0c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:54.241403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a759d-922f-47c0-9080-20ba3cbf73a8 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:54.295061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-05d91408-f379-42a8-858f-257c16453446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b38f68fb142d4bf48567eda6d4bb20f8', 'request_id': 'req-05d91408-f379-42a8-858f-257c16453446'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:54.311705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-05d91408-f379-42a8-858f-257c16453446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b38f68fb142d4bf48567eda6d4bb20f8', 'request_id': 'req-05d91408-f379-42a8-858f-257c16453446'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:54.330212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-05d91408-f379-42a8-858f-257c16453446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b38f68fb142d4bf48567eda6d4bb20f8', 'request_id': 'req-05d91408-f379-42a8-858f-257c16453446'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:54.345582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-298a759d-922f-47c0-9080-20ba3cbf73a8 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invalidating the token cache because role f59c7adb8fdb45bc960503c0737deb0c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:54.346131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-298a759d-922f-47c0-9080-20ba3cbf73a8 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:54.348567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-298a759d-922f-47c0-9080-20ba3cbf73a8 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:54.354183 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2589/5201] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:54 2022] DELETE /identity/v3/roles/f59c7adb8fdb45bc960503c0737deb0c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:54.358022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a759d-922f-47c0-9080-20ba3cbf73a8 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:54.361787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-298a759d-922f-47c0-9080-20ba3cbf73a8 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:54.364885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-05d91408-f379-42a8-858f-257c16453446 admin admin] The token cache is being invalidate because project b38f68fb142d4bf48567eda6d4bb20f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:54.365426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-05d91408-f379-42a8-858f-257c16453446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:54.368549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-05d91408-f379-42a8-858f-257c16453446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:54.372678 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2613/5202] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:53 2022] DELETE /identity/v3/projects/b38f68fb142d4bf48567eda6d4bb20f8 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:54.380424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3df1af-e53f-4fcc-ab9a-9d7d7946bcdf None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:54.380756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3df1af-e53f-4fcc-ab9a-9d7d7946bcdf None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:54.380924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3df1af-e53f-4fcc-ab9a-9d7d7946bcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:54.437656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ed3df1af-e53f-4fcc-ab9a-9d7d7946bcdf None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:54.438995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ed3df1af-e53f-4fcc-ab9a-9d7d7946bcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:54.516887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:54.542131 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2614/5203] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:54.551506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3c8d8-a5cc-4bba-bb29-46b23258e6d6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:54.551909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3c8d8-a5cc-4bba-bb29-46b23258e6d6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:54.553541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3c8d8-a5cc-4bba-bb29-46b23258e6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:54.558210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a759d-922f-47c0-9080-20ba3cbf73a8 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:54.569652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8498b0-9400-4433-b602-2283f4adcc8c tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:54.570663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8498b0-9400-4433-b602-2283f4adcc8c tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:54.572078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8498b0-9400-4433-b602-2283f4adcc8c tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:54.572375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8498b0-9400-4433-b602-2283f4adcc8c tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/users/a6ab4d17cdde4a9a90b91a5a81a81db6` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:54.577021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8498b0-9400-4433-b602-2283f4adcc8c tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a6ab4d17cdde4a9a90b91a5a81a81db6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:54.580500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8498b0-9400-4433-b602-2283f4adcc8c tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:54.609178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-82a3c8d8-a5cc-4bba-bb29-46b23258e6d6 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:54.617027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-82a3c8d8-a5cc-4bba-bb29-46b23258e6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:54.640497 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2615/5204] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:19:54.644964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3c8d8-a5cc-4bba-bb29-46b23258e6d6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:54.664685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3c8d8-a5cc-4bba-bb29-46b23258e6d6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:54.671937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7e8498b0-9400-4433-b602-2283f4adcc8c tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6ab4d17cdde4a9a90b91a5a81a81db6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:54.673524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7e8498b0-9400-4433-b602-2283f4adcc8c tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6ab4d17cdde4a9a90b91a5a81a81db6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:54.682901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7deece-05f6-4686-bee5-e8ef8c58deda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:54.683757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7deece-05f6-4686-bee5-e8ef8c58deda admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:54.684792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7deece-05f6-4686-bee5-e8ef8c58deda admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:54.684792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7deece-05f6-4686-bee5-e8ef8c58deda admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:54.685291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7deece-05f6-4686-bee5-e8ef8c58deda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:19:54.686916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7deece-05f6-4686-bee5-e8ef8c58deda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:54.689768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7deece-05f6-4686-bee5-e8ef8c58deda admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:54.693819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7e8498b0-9400-4433-b602-2283f4adcc8c tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6ab4d17cdde4a9a90b91a5a81a81db6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:54.696412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7e8498b0-9400-4433-b602-2283f4adcc8c tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6ab4d17cdde4a9a90b91a5a81a81db6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:54.699689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=12 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:54.719688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7e8498b0-9400-4433-b602-2283f4adcc8c tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6ab4d17cdde4a9a90b91a5a81a81db6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:54.727255 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2616/5205] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:19:54.729636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7deece-05f6-4686-bee5-e8ef8c58deda admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:54.735031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6c7deece-05f6-4686-bee5-e8ef8c58deda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:54.756502 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2590/5206] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:54 2022] DELETE /identity/v3/users/a6ab4d17cdde4a9a90b91a5a81a81db6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:54.759688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8498b0-9400-4433-b602-2283f4adcc8c tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:54.762995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7e8498b0-9400-4433-b602-2283f4adcc8c tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:54.763480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7deece-05f6-4686-bee5-e8ef8c58deda admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:54.865972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b049c8-3184-418e-9885-820a1cf70257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:54.866668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b049c8-3184-418e-9885-820a1cf70257 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:54.867129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b049c8-3184-418e-9885-820a1cf70257 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:54.870405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b049c8-3184-418e-9885-820a1cf70257 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:54.870975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b049c8-3184-418e-9885-820a1cf70257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:54.876167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b049c8-3184-418e-9885-820a1cf70257 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:54.942622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8498b0-9400-4433-b602-2283f4adcc8c tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:54.954632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81608de2-a2d8-4828-87d0-daded359835a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:54.959113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81608de2-a2d8-4828-87d0-daded359835a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:54.959573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81608de2-a2d8-4828-87d0-daded359835a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:54.960408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81608de2-a2d8-4828-87d0-daded359835a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/projects/6710f057eecf4d60957204063ce83deb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:54.963330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81608de2-a2d8-4828-87d0-daded359835a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6710f057eecf4d60957204063ce83deb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:54.968944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81608de2-a2d8-4828-87d0-daded359835a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:54.971243 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2617/5207] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:54 2022] POST /identity/v3/projects => generated 369 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:19:54.974114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b049c8-3184-418e-9885-820a1cf70257 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:55.101824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b049c8-3184-418e-9885-820a1cf70257 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:55.123728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-81608de2-a2d8-4828-87d0-daded359835a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6710f057eecf4d60957204063ce83deb', 'request_id': 'req-81608de2-a2d8-4828-87d0-daded359835a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:55.166339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-81608de2-a2d8-4828-87d0-daded359835a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6710f057eecf4d60957204063ce83deb', 'request_id': 'req-81608de2-a2d8-4828-87d0-daded359835a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:55.180039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-81608de2-a2d8-4828-87d0-daded359835a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6710f057eecf4d60957204063ce83deb', 'request_id': 'req-81608de2-a2d8-4828-87d0-daded359835a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:55.209669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-81608de2-a2d8-4828-87d0-daded359835a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] The token cache is being invalidate because project 6710f057eecf4d60957204063ce83deb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:55.211422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-81608de2-a2d8-4828-87d0-daded359835a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:55.212561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-81608de2-a2d8-4828-87d0-daded359835a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:55.216927 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2591/5208] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:19:54 2022] DELETE /identity/v3/projects/6710f057eecf4d60957204063ce83deb => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:19:55.223569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81608de2-a2d8-4828-87d0-daded359835a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:55.227070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-81608de2-a2d8-4828-87d0-daded359835a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:55.229857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bfcdf-33a9-499c-9063-e7ad87363f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:55.230690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bfcdf-33a9-499c-9063-e7ad87363f88 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:55.230973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bfcdf-33a9-499c-9063-e7ad87363f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:55.231245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bfcdf-33a9-499c-9063-e7ad87363f88 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:55.232537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5bfcdf-33a9-499c-9063-e7ad87363f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:55.236203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5bfcdf-33a9-499c-9063-e7ad87363f88 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:55.251712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:55.280858 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2618/5209] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:54 2022] POST /identity/v3/users => generated 285 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:55.281602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bfcdf-33a9-499c-9063-e7ad87363f88 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:55.283919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-eb5bfcdf-33a9-499c-9063-e7ad87363f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:55.305516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bfcdf-33a9-499c-9063-e7ad87363f88 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:55.319010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b81666-bc0f-4efb-8ff2-52aff85e6eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:55.319687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b81666-bc0f-4efb-8ff2-52aff85e6eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:55.319967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b81666-bc0f-4efb-8ff2-52aff85e6eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:55.321199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b81666-bc0f-4efb-8ff2-52aff85e6eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:55.322166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b81666-bc0f-4efb-8ff2-52aff85e6eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:55.326724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b81666-bc0f-4efb-8ff2-52aff85e6eb5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:55.357465 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2619/5210] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:55.362502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b81666-bc0f-4efb-8ff2-52aff85e6eb5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:55.378843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b81666-bc0f-4efb-8ff2-52aff85e6eb5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:55.387478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc821d42-00f5-4103-9026-afced6e5df41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:55.388171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc821d42-00f5-4103-9026-afced6e5df41 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:55.388461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc821d42-00f5-4103-9026-afced6e5df41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:55.388831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc821d42-00f5-4103-9026-afced6e5df41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:55.389528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc821d42-00f5-4103-9026-afced6e5df41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:55.391866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc821d42-00f5-4103-9026-afced6e5df41 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:55.410245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81608de2-a2d8-4828-87d0-daded359835a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:55.415602 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2620/5211] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:55.420718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc821d42-00f5-4103-9026-afced6e5df41 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:55.433439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52f569-0d93-4a64-9d1f-0697a0aeecb7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:55.435697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52f569-0d93-4a64-9d1f-0697a0aeecb7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:55.436964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52f569-0d93-4a64-9d1f-0697a0aeecb7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:55.438206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52f569-0d93-4a64-9d1f-0697a0aeecb7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/users/31fd27a06d78454e82f4afa9097d275d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:55.444047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52f569-0d93-4a64-9d1f-0697a0aeecb7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:update_user(user_id=31fd27a06d78454e82f4afa9097d275d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:55.453602 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-df52f569-0d93-4a64-9d1f-0697a0aeecb7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:55.453602 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:19:55.453602 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:19:55.461147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52f569-0d93-4a64-9d1f-0697a0aeecb7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:55.470802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc821d42-00f5-4103-9026-afced6e5df41 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:55.489518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7742ad-4fa4-44f6-af44-7d07005f16b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:55.490572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7742ad-4fa4-44f6-af44-7d07005f16b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:55.491369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7742ad-4fa4-44f6-af44-7d07005f16b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:55.492227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7742ad-4fa4-44f6-af44-7d07005f16b0 admin admin] PATH_INFO: `/v3/projects/27de08780b44409bb343b9a468e8d344/users/b9b9298f6cf14dc189e4a238bf8ba0a0/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:55.522735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7742ad-4fa4-44f6-af44-7d07005f16b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27de08780b44409bb343b9a468e8d344, user_id=b9b9298f6cf14dc189e4a238bf8ba0a0, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:55.524474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=3,keystone:DELETE=8,keystone:SELECT=88,keystone:UPDATE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:55.526337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7742ad-4fa4-44f6-af44-7d07005f16b0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:55.555011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-df52f569-0d93-4a64-9d1f-0697a0aeecb7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '31fd27a06d78454e82f4afa9097d275d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:55.558913 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2621/5212] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:55 2022] PUT /identity/v3/projects/27de08780b44409bb343b9a468e8d344/users/b9b9298f6cf14dc189e4a238bf8ba0a0/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:55.569053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2732-b58e-46a6-a47f-ede5de578461 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:55.569332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2732-b58e-46a6-a47f-ede5de578461 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:55.569596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2732-b58e-46a6-a47f-ede5de578461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:55.576248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-df52f569-0d93-4a64-9d1f-0697a0aeecb7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invalidating the token cache because user 31fd27a06d78454e82f4afa9097d275d was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:55.577162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-df52f569-0d93-4a64-9d1f-0697a0aeecb7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:55.578062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-df52f569-0d93-4a64-9d1f-0697a0aeecb7 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:55.581059 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2592/5213] 10.222.0.17 () {60 vars in 1243 bytes} [Sat Jul 30 21:19:55 2022] PATCH /identity/v3/users/31fd27a06d78454e82f4afa9097d275d => generated 297 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:55.587109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e9370-37e5-4c1d-ac34-7bed948882b6 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:55.587514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e9370-37e5-4c1d-ac34-7bed948882b6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:55.589437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e9370-37e5-4c1d-ac34-7bed948882b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:55.613989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c4dc2732-b58e-46a6-a47f-ede5de578461 None None] MFA Rules not processed for user `b9b9298f6cf14dc189e4a238bf8ba0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:55.616192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c4dc2732-b58e-46a6-a47f-ede5de578461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:55.655941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3c6e9370-37e5-4c1d-ac34-7bed948882b6 None None] MFA Rules not processed for user `31fd27a06d78454e82f4afa9097d275d`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:55.657296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3c6e9370-37e5-4c1d-ac34-7bed948882b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:55.662673 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2593/5214] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:55 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 21:19:55.668012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e9370-37e5-4c1d-ac34-7bed948882b6 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:55.669585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3c6e9370-37e5-4c1d-ac34-7bed948882b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:55.724316 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2622/5215] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:55.725842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc2732-b58e-46a6-a47f-ede5de578461 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:55.729023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c4dc2732-b58e-46a6-a47f-ede5de578461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:55.800776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e9370-37e5-4c1d-ac34-7bed948882b6 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:55.833257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba401097-fe66-42bf-ad61-99945fb7d430 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:55.834298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba401097-fe66-42bf-ad61-99945fb7d430 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:55.834696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba401097-fe66-42bf-ad61-99945fb7d430 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:55.835476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba401097-fe66-42bf-ad61-99945fb7d430 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/users/31fd27a06d78454e82f4afa9097d275d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:55.838631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba401097-fe66-42bf-ad61-99945fb7d430 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:update_user(user_id=31fd27a06d78454e82f4afa9097d275d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:55.843109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba401097-fe66-42bf-ad61-99945fb7d430 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:55.893391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc2732-b58e-46a6-a47f-ede5de578461 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:55.902525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0f392-d69a-4935-93e1-5c02dac55831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:55.904061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0f392-d69a-4935-93e1-5c02dac55831 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:55.904936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0f392-d69a-4935-93e1-5c02dac55831 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:55.908506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0f392-d69a-4935-93e1-5c02dac55831 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:55.912971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0f392-d69a-4935-93e1-5c02dac55831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:55.918390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0f392-d69a-4935-93e1-5c02dac55831 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:55.924494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ba401097-fe66-42bf-ad61-99945fb7d430 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '31fd27a06d78454e82f4afa9097d275d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:55.955174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ba401097-fe66-42bf-ad61-99945fb7d430 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invalidating the token cache because user 31fd27a06d78454e82f4afa9097d275d was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:55.955867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ba401097-fe66-42bf-ad61-99945fb7d430 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:55.956842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ba401097-fe66-42bf-ad61-99945fb7d430 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:55.962185 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2594/5216] 10.222.0.17 () {60 vars in 1243 bytes} [Sat Jul 30 21:19:55 2022] PATCH /identity/v3/users/31fd27a06d78454e82f4afa9097d275d => generated 297 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:55.965220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba401097-fe66-42bf-ad61-99945fb7d430 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:55.974026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ba401097-fe66-42bf-ad61-99945fb7d430 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:56.010062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba401097-fe66-42bf-ad61-99945fb7d430 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:56.015728 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2623/5217] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:55 2022] POST /identity/v3/projects => generated 369 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:56.019316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0f392-d69a-4935-93e1-5c02dac55831 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:56.021396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-25a0f392-d69a-4935-93e1-5c02dac55831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:56.037663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a7f12-c191-4d1f-8144-a2d50dd145dd tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:56.040425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a7f12-c191-4d1f-8144-a2d50dd145dd tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:56.040991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a7f12-c191-4d1f-8144-a2d50dd145dd tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:56.041958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a7f12-c191-4d1f-8144-a2d50dd145dd tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/users/31fd27a06d78454e82f4afa9097d275d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:56.083855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a7f12-c191-4d1f-8144-a2d50dd145dd tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:update_user(user_id=31fd27a06d78454e82f4afa9097d275d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:56.090077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a7f12-c191-4d1f-8144-a2d50dd145dd tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:56.093946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:56.169975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5a7a7f12-c191-4d1f-8144-a2d50dd145dd tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '31fd27a06d78454e82f4afa9097d275d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:56.180551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0f392-d69a-4935-93e1-5c02dac55831 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:56.191419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5a7a7f12-c191-4d1f-8144-a2d50dd145dd tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invalidating the token cache because user 31fd27a06d78454e82f4afa9097d275d was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:56.191919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5a7a7f12-c191-4d1f-8144-a2d50dd145dd tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:56.192431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5a7a7f12-c191-4d1f-8144-a2d50dd145dd tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:56.194241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ac419-9c1f-434a-82b5-335037cf8716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:56.194391 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2595/5218] 10.222.0.17 () {60 vars in 1243 bytes} [Sat Jul 30 21:19:55 2022] PATCH /identity/v3/users/31fd27a06d78454e82f4afa9097d275d => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:56.195986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ac419-9c1f-434a-82b5-335037cf8716 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:56.196755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ac419-9c1f-434a-82b5-335037cf8716 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:56.197182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ac419-9c1f-434a-82b5-335037cf8716 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:56.198736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3130b1e-03bb-4cf4-8fae-3daac7465002 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:56.199029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3130b1e-03bb-4cf4-8fae-3daac7465002 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:56.199270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ac419-9c1f-434a-82b5-335037cf8716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:56.199414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3130b1e-03bb-4cf4-8fae-3daac7465002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:56.204649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ac419-9c1f-434a-82b5-335037cf8716 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:56.280956 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2624/5219] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:56 2022] POST /identity/v3/users => generated 291 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:19:56.284287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d3130b1e-03bb-4cf4-8fae-3daac7465002 None None] MFA Rules not processed for user `31fd27a06d78454e82f4afa9097d275d`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:56.285878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d3130b1e-03bb-4cf4-8fae-3daac7465002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:56.286560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ac419-9c1f-434a-82b5-335037cf8716 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:56.290186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f39ac419-9c1f-434a-82b5-335037cf8716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:56.292740 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2596/5220] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:56 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 30 21:19:56.301596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3130b1e-03bb-4cf4-8fae-3daac7465002 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:56.307730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d3130b1e-03bb-4cf4-8fae-3daac7465002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:56.316166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ac419-9c1f-434a-82b5-335037cf8716 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:56.321936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf32e3b-dc45-486e-adb3-debfdf71aecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:56.322568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf32e3b-dc45-486e-adb3-debfdf71aecb admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:56.322849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf32e3b-dc45-486e-adb3-debfdf71aecb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:56.323403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf32e3b-dc45-486e-adb3-debfdf71aecb admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:56.323892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf32e3b-dc45-486e-adb3-debfdf71aecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:56.325501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf32e3b-dc45-486e-adb3-debfdf71aecb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:56.340941 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2625/5221] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:56.345100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf32e3b-dc45-486e-adb3-debfdf71aecb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:56.356785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf32e3b-dc45-486e-adb3-debfdf71aecb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:56.363521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b7a37-bc54-49be-9eec-0e46ec8111cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:56.363908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b7a37-bc54-49be-9eec-0e46ec8111cb admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:56.364326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b7a37-bc54-49be-9eec-0e46ec8111cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:56.364456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b7a37-bc54-49be-9eec-0e46ec8111cb admin admin] PATH_INFO: `/v3/projects/8d0ac15a16534d67a4a32fb3b90700ca/users/ec8d63ac05e5441a887f5fd367528449/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:56.384121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b7a37-bc54-49be-9eec-0e46ec8111cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d0ac15a16534d67a4a32fb3b90700ca, user_id=ec8d63ac05e5441a887f5fd367528449, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:56.386930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b7a37-bc54-49be-9eec-0e46ec8111cb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:56.431642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=4,keystone:UPDATE=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:56.460333 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2626/5222] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:56 2022] PUT /identity/v3/projects/8d0ac15a16534d67a4a32fb3b90700ca/users/ec8d63ac05e5441a887f5fd367528449/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:56.461313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b7a37-bc54-49be-9eec-0e46ec8111cb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:56.478732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3130b1e-03bb-4cf4-8fae-3daac7465002 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:56.618611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b7a37-bc54-49be-9eec-0e46ec8111cb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:56.629526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6d8b1-5fba-459c-8039-84c1a1144191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:56.630484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6d8b1-5fba-459c-8039-84c1a1144191 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:56.630981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6d8b1-5fba-459c-8039-84c1a1144191 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:56.631398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6d8b1-5fba-459c-8039-84c1a1144191 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:56.632418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6d8b1-5fba-459c-8039-84c1a1144191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:56.633817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dd802-d6a9-4133-8216-0bc642144b6e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:56.634429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6d8b1-5fba-459c-8039-84c1a1144191 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:56.634551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dd802-d6a9-4133-8216-0bc642144b6e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:56.634767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dd802-d6a9-4133-8216-0bc642144b6e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:56.635051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dd802-d6a9-4133-8216-0bc642144b6e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/users/31fd27a06d78454e82f4afa9097d275d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:56.648186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dd802-d6a9-4133-8216-0bc642144b6e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:update_user(user_id=31fd27a06d78454e82f4afa9097d275d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:56.650265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dd802-d6a9-4133-8216-0bc642144b6e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:56.654503 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2627/5223] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:56.656474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6d8b1-5fba-459c-8039-84c1a1144191 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:56.672899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6d8b1-5fba-459c-8039-84c1a1144191 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:56.686162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f8dd9-92c6-4c7a-95b5-22bf690d34c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:56.686944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f8dd9-92c6-4c7a-95b5-22bf690d34c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:56.688011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f8dd9-92c6-4c7a-95b5-22bf690d34c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:56.688448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f8dd9-92c6-4c7a-95b5-22bf690d34c1 admin admin] PATH_INFO: `/v3/projects/8d0ac15a16534d67a4a32fb3b90700ca/users/ec8d63ac05e5441a887f5fd367528449/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:56.691612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f8dd9-92c6-4c7a-95b5-22bf690d34c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d0ac15a16534d67a4a32fb3b90700ca, user_id=ec8d63ac05e5441a887f5fd367528449, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:56.695311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f8dd9-92c6-4c7a-95b5-22bf690d34c1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:56.726044 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2628/5224] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:19:56 2022] PUT /identity/v3/projects/8d0ac15a16534d67a4a32fb3b90700ca/users/ec8d63ac05e5441a887f5fd367528449/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:56.726255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-319dd802-d6a9-4133-8216-0bc642144b6e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '31fd27a06d78454e82f4afa9097d275d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:56.744329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-319dd802-d6a9-4133-8216-0bc642144b6e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invalidating the token cache because user 31fd27a06d78454e82f4afa9097d275d was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:19:56.744725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-319dd802-d6a9-4133-8216-0bc642144b6e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:56.745392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-319dd802-d6a9-4133-8216-0bc642144b6e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:56.750786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d092a-4aff-44cd-a235-dc50e9aca059 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:56.752238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d092a-4aff-44cd-a235-dc50e9aca059 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:56.753546 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2597/5225] 10.222.0.17 () {60 vars in 1243 bytes} [Sat Jul 30 21:19:56 2022] PATCH /identity/v3/users/31fd27a06d78454e82f4afa9097d275d => generated 297 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:56.754580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dd802-d6a9-4133-8216-0bc642144b6e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:56.754704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d092a-4aff-44cd-a235-dc50e9aca059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:56.763519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-319dd802-d6a9-4133-8216-0bc642144b6e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:56.787047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dd802-d6a9-4133-8216-0bc642144b6e tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:56.813018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-074d092a-4aff-44cd-a235-dc50e9aca059 None None] MFA Rules not processed for user `ec8d63ac05e5441a887f5fd367528449`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:56.816017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-074d092a-4aff-44cd-a235-dc50e9aca059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:56.994079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff71a2-ab99-4706-866f-f1262fad7305 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:56.999316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff71a2-ab99-4706-866f-f1262fad7305 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:56.999316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff71a2-ab99-4706-866f-f1262fad7305 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:56.999316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff71a2-ab99-4706-866f-f1262fad7305 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:56.999316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff71a2-ab99-4706-866f-f1262fad7305 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:57.003512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff71a2-ab99-4706-866f-f1262fad7305 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:57.059249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:57.087126 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2598/5226] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:19:56 2022] POST /identity/v3/users => generated 264 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:57.089518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff71a2-ab99-4706-866f-f1262fad7305 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:57.117153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff71a2-ab99-4706-866f-f1262fad7305 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:57.126994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e8111-294d-4651-8a0c-ca636c91443a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:57.128718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e8111-294d-4651-8a0c-ca636c91443a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:57.129087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e8111-294d-4651-8a0c-ca636c91443a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:57.129381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e8111-294d-4651-8a0c-ca636c91443a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/users/094eed9cc7f047789ffcdf79ed6b12c6/password` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:57.137664 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2629/5227] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:56 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:19:57.142381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d092a-4aff-44cd-a235-dc50e9aca059 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:57.180022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d092a-4aff-44cd-a235-dc50e9aca059 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:57.196845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093fed9-b6a5-4bf3-88f6-bbccce727578 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:57.200078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093fed9-b6a5-4bf3-88f6-bbccce727578 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:57.200492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093fed9-b6a5-4bf3-88f6-bbccce727578 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:57.201115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093fed9-b6a5-4bf3-88f6-bbccce727578 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:57.204737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093fed9-b6a5-4bf3-88f6-bbccce727578 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:57.210744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093fed9-b6a5-4bf3-88f6-bbccce727578 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:57.259060 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2630/5228] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:19:57 2022] POST /identity/v3/domains => generated 276 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:57.276711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093fed9-b6a5-4bf3-88f6-bbccce727578 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:57.291222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9d2e8111-294d-4651-8a0c-ca636c91443a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '094eed9cc7f047789ffcdf79ed6b12c6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:57.322596 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2599/5229] 10.222.0.17 () {60 vars in 1269 bytes} [Sat Jul 30 21:19:57 2022] POST /identity/v3/users/094eed9cc7f047789ffcdf79ed6b12c6/password => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:57.504778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093fed9-b6a5-4bf3-88f6-bbccce727578 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:57.512087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4690b85-e08c-429a-8d30-570d8bad3ffc tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:57.513791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4690b85-e08c-429a-8d30-570d8bad3ffc tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:57.514659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4690b85-e08c-429a-8d30-570d8bad3ffc tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:57.515187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4690b85-e08c-429a-8d30-570d8bad3ffc tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:57.516207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4690b85-e08c-429a-8d30-570d8bad3ffc tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:57.518378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4690b85-e08c-429a-8d30-570d8bad3ffc tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:57.571258 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2631/5230] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:19:57 2022] POST /identity/v3/groups => generated 280 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:57.575227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e8111-294d-4651-8a0c-ca636c91443a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:57.600605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e8111-294d-4651-8a0c-ca636c91443a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:57.611891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e384c19-69bb-4f4e-afbe-fc7d88fff580 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:57.612865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e384c19-69bb-4f4e-afbe-fc7d88fff580 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:57.613176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e384c19-69bb-4f4e-afbe-fc7d88fff580 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:57.613466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e384c19-69bb-4f4e-afbe-fc7d88fff580 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/486ca3cc8c0d4ca9adead00dfde314f7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:57.625575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:UPDATE=2,keystone:INSERT=7,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:57.630919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e384c19-69bb-4f4e-afbe-fc7d88fff580 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:update_group(group_id=486ca3cc8c0d4ca9adead00dfde314f7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:57.632681 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-5e384c19-69bb-4f4e-afbe-fc7d88fff580 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:57.632681 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:19:57.632681 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:19:57.634045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e384c19-69bb-4f4e-afbe-fc7d88fff580 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:57.684269 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2600/5231] 10.222.0.17 () {60 vars in 1247 bytes} [Sat Jul 30 21:19:57 2022] PATCH /identity/v3/groups/486ca3cc8c0d4ca9adead00dfde314f7 => generated 292 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:57.688181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4690b85-e08c-429a-8d30-570d8bad3ffc tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:57.704046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4690b85-e08c-429a-8d30-570d8bad3ffc tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:57.729420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b713d96-da43-4c5e-b1a5-8973e0cd240c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:57.730721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b713d96-da43-4c5e-b1a5-8973e0cd240c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:57.731899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b713d96-da43-4c5e-b1a5-8973e0cd240c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:57.732521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b713d96-da43-4c5e-b1a5-8973e0cd240c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/486ca3cc8c0d4ca9adead00dfde314f7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:57.742853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b713d96-da43-4c5e-b1a5-8973e0cd240c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:get_group(group_id=486ca3cc8c0d4ca9adead00dfde314f7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:57.745976 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-6b713d96-da43-4c5e-b1a5-8973e0cd240c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:57.745976 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:19:57.745976 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:19:57.748383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b713d96-da43-4c5e-b1a5-8973e0cd240c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:57.753822 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2632/5232] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:57 2022] GET /identity/v3/groups/486ca3cc8c0d4ca9adead00dfde314f7 => generated 292 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:57.757480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e384c19-69bb-4f4e-afbe-fc7d88fff580 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:57.776741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e384c19-69bb-4f4e-afbe-fc7d88fff580 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:57.783710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243e570-e792-463c-b29a-3a0c9c7c6153 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:57.785096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243e570-e792-463c-b29a-3a0c9c7c6153 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:57.785682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243e570-e792-463c-b29a-3a0c9c7c6153 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:57.786195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243e570-e792-463c-b29a-3a0c9c7c6153 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/486ca3cc8c0d4ca9adead00dfde314f7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:57.788068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243e570-e792-463c-b29a-3a0c9c7c6153 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:update_group(group_id=486ca3cc8c0d4ca9adead00dfde314f7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:57.792006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243e570-e792-463c-b29a-3a0c9c7c6153 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:57.822312 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2601/5233] 10.222.0.17 () {60 vars in 1246 bytes} [Sat Jul 30 21:19:57 2022] PATCH /identity/v3/groups/486ca3cc8c0d4ca9adead00dfde314f7 => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:19:57.826827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b713d96-da43-4c5e-b1a5-8973e0cd240c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:57.839859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b713d96-da43-4c5e-b1a5-8973e0cd240c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:57.846137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1aed5-3eab-49dc-ae07-184d07d38d46 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:57.846912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1aed5-3eab-49dc-ae07-184d07d38d46 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:57.847426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1aed5-3eab-49dc-ae07-184d07d38d46 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:57.847718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1aed5-3eab-49dc-ae07-184d07d38d46 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/486ca3cc8c0d4ca9adead00dfde314f7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:57.855169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1aed5-3eab-49dc-ae07-184d07d38d46 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:delete_group(group_id=486ca3cc8c0d4ca9adead00dfde314f7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:57.857216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1aed5-3eab-49dc-ae07-184d07d38d46 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:57.923345 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2633/5234] 10.222.0.17 () {58 vars in 1227 bytes} [Sat Jul 30 21:19:57 2022] DELETE /identity/v3/groups/486ca3cc8c0d4ca9adead00dfde314f7 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:57.925811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243e570-e792-463c-b29a-3a0c9c7c6153 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:57.938631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243e570-e792-463c-b29a-3a0c9c7c6153 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:58.012805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0b01d-829d-4fce-b1b5-0d2fc4f30176 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:58.013414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0b01d-829d-4fce-b1b5-0d2fc4f30176 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:58.013701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0b01d-829d-4fce-b1b5-0d2fc4f30176 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:58.013979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0b01d-829d-4fce-b1b5-0d2fc4f30176 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:58.014985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0b01d-829d-4fce-b1b5-0d2fc4f30176 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:58.016104 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-99a0b01d-829d-4fce-b1b5-0d2fc4f30176 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:58.016104 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:19:58.016104 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:19:58.018375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0b01d-829d-4fce-b1b5-0d2fc4f30176 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:58.051875 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2602/5235] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:19:57 2022] POST /identity/v3/groups => generated 327 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:58.053098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1aed5-3eab-49dc-ae07-184d07d38d46 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:58.071430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1aed5-3eab-49dc-ae07-184d07d38d46 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:58.088442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9777d-a57f-4f61-887b-d3d7c49492da tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:58.089737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9777d-a57f-4f61-887b-d3d7c49492da tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:58.090828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9777d-a57f-4f61-887b-d3d7c49492da tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:58.092671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9777d-a57f-4f61-887b-d3d7c49492da tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:58.097526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9777d-a57f-4f61-887b-d3d7c49492da tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:58.102117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9777d-a57f-4f61-887b-d3d7c49492da tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:58.176104 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2634/5236] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:58 2022] POST /identity/v3/users => generated 321 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:58.176307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0b01d-829d-4fce-b1b5-0d2fc4f30176 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:58.189701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0b01d-829d-4fce-b1b5-0d2fc4f30176 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:58.197592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad7424-db8b-4608-b8cc-5877b6578371 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:58.198371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad7424-db8b-4608-b8cc-5877b6578371 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:58.198791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad7424-db8b-4608-b8cc-5877b6578371 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:58.199139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad7424-db8b-4608-b8cc-5877b6578371 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users/7b25fd808fc14c33821ff9e62ae47a4f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:58.227855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad7424-db8b-4608-b8cc-5877b6578371 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=4eb994cd02fc4e54a59471f1b5311a39, user_id=7b25fd808fc14c33821ff9e62ae47a4f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:58.231593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad7424-db8b-4608-b8cc-5877b6578371 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:58.270742 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2603/5237] 10.222.0.17 () {60 vars in 1360 bytes} [Sat Jul 30 21:19:58 2022] PUT /identity/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users/7b25fd808fc14c33821ff9e62ae47a4f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:19:58.272497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9777d-a57f-4f61-887b-d3d7c49492da tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:58.292392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9777d-a57f-4f61-887b-d3d7c49492da tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:58.329490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc72cb3-e1d6-4264-b599-afd63dadd94a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:58.330057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc72cb3-e1d6-4264-b599-afd63dadd94a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:58.330225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc72cb3-e1d6-4264-b599-afd63dadd94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:58.370379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4fc72cb3-e1d6-4264-b599-afd63dadd94a None None] MFA Rules not processed for user `094eed9cc7f047789ffcdf79ed6b12c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:19:58.373840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4fc72cb3-e1d6-4264-b599-afd63dadd94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:58.385549 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2604/5238] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:19:58 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 21:19:58.388680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc72cb3-e1d6-4264-b599-afd63dadd94a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:58.394299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:58.465372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6a7f2-61fb-47f4-9eea-763c1946787f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:58.466045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6a7f2-61fb-47f4-9eea-763c1946787f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:58.466351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6a7f2-61fb-47f4-9eea-763c1946787f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:58.466644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6a7f2-61fb-47f4-9eea-763c1946787f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:58.467384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6a7f2-61fb-47f4-9eea-763c1946787f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:58.469885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6a7f2-61fb-47f4-9eea-763c1946787f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:58.533665 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2635/5239] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:58 2022] POST /identity/v3/users => generated 323 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:58.539891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6a7f2-61fb-47f4-9eea-763c1946787f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:58.559973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6a7f2-61fb-47f4-9eea-763c1946787f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:58.567048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4fc3b-9e0c-4d38-9263-0216c4c21c0d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:58.568237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4fc3b-9e0c-4d38-9263-0216c4c21c0d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:58.569417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4fc3b-9e0c-4d38-9263-0216c4c21c0d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:58.569952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4fc3b-9e0c-4d38-9263-0216c4c21c0d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users/e012817e33314ba7af14a32ebd827e1e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:58.577801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc72cb3-e1d6-4264-b599-afd63dadd94a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:58.595310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7d854-0c96-4d67-8b93-a9a2b66e3224 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:58.596289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7d854-0c96-4d67-8b93-a9a2b66e3224 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:58.596852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7d854-0c96-4d67-8b93-a9a2b66e3224 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:58.597301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7d854-0c96-4d67-8b93-a9a2b66e3224 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:58.620791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7d854-0c96-4d67-8b93-a9a2b66e3224 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:58.624773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7d854-0c96-4d67-8b93-a9a2b66e3224 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:58.645839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4fc3b-9e0c-4d38-9263-0216c4c21c0d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=4eb994cd02fc4e54a59471f1b5311a39, user_id=e012817e33314ba7af14a32ebd827e1e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:58.647535 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2605/5240] 10.222.0.17 () {56 vars in 1263 bytes} [Sat Jul 30 21:19:58 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:58.652388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7d854-0c96-4d67-8b93-a9a2b66e3224 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:58.658129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4fc3b-9e0c-4d38-9263-0216c4c21c0d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:58.677357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7d854-0c96-4d67-8b93-a9a2b66e3224 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:58.690006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afac6c-2066-467b-aea0-c0d01448b3f3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:58.691638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afac6c-2066-467b-aea0-c0d01448b3f3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:58.692092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afac6c-2066-467b-aea0-c0d01448b3f3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:58.692571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afac6c-2066-467b-aea0-c0d01448b3f3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/users/094eed9cc7f047789ffcdf79ed6b12c6` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:58.699852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afac6c-2066-467b-aea0-c0d01448b3f3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:delete_user(user_id=094eed9cc7f047789ffcdf79ed6b12c6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:58.702816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afac6c-2066-467b-aea0-c0d01448b3f3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:58.715915 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2636/5241] 10.222.0.17 () {60 vars in 1360 bytes} [Sat Jul 30 21:19:58 2022] PUT /identity/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users/e012817e33314ba7af14a32ebd827e1e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:19:58.721362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4fc3b-9e0c-4d38-9263-0216c4c21c0d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:58.729713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:UPDATE=2,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:58.842446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-70afac6c-2066-467b-aea0-c0d01448b3f3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094eed9cc7f047789ffcdf79ed6b12c6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:58.843474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-70afac6c-2066-467b-aea0-c0d01448b3f3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094eed9cc7f047789ffcdf79ed6b12c6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:58.849119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4fc3b-9e0c-4d38-9263-0216c4c21c0d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:58.859193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59737b6-9c3d-417a-9b39-3f48cba2e24c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:58.860500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59737b6-9c3d-417a-9b39-3f48cba2e24c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:58.860804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59737b6-9c3d-417a-9b39-3f48cba2e24c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:58.863420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59737b6-9c3d-417a-9b39-3f48cba2e24c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:58.864137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59737b6-9c3d-417a-9b39-3f48cba2e24c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:58.869445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59737b6-9c3d-417a-9b39-3f48cba2e24c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:58.876191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-70afac6c-2066-467b-aea0-c0d01448b3f3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094eed9cc7f047789ffcdf79ed6b12c6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:58.878898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-70afac6c-2066-467b-aea0-c0d01448b3f3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094eed9cc7f047789ffcdf79ed6b12c6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:58.900831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-70afac6c-2066-467b-aea0-c0d01448b3f3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094eed9cc7f047789ffcdf79ed6b12c6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:19:58.932690 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2606/5242] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:19:58 2022] DELETE /identity/v3/users/094eed9cc7f047789ffcdf79ed6b12c6 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:58.933758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afac6c-2066-467b-aea0-c0d01448b3f3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:58.935272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-70afac6c-2066-467b-aea0-c0d01448b3f3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:58.941042 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2637/5243] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:58 2022] POST /identity/v3/users => generated 323 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:58.949962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59737b6-9c3d-417a-9b39-3f48cba2e24c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:58.957070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a59737b6-9c3d-417a-9b39-3f48cba2e24c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:19:58.990839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59737b6-9c3d-417a-9b39-3f48cba2e24c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:59.156096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c428fe-8b1b-499f-bb91-96ec1c1a61d0 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:59.156941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c428fe-8b1b-499f-bb91-96ec1c1a61d0 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:59.157612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c428fe-8b1b-499f-bb91-96ec1c1a61d0 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:59.157612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c428fe-8b1b-499f-bb91-96ec1c1a61d0 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users/2679b154ef9c43d592f20f14330ee6b4` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:59.230834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c428fe-8b1b-499f-bb91-96ec1c1a61d0 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=4eb994cd02fc4e54a59471f1b5311a39, user_id=2679b154ef9c43d592f20f14330ee6b4)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:59.249302 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c428fe-8b1b-499f-bb91-96ec1c1a61d0 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:59.280879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afac6c-2066-467b-aea0-c0d01448b3f3 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:59.298520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e02d68-c20b-49b7-9c7b-0031c609834f tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:59.300340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e02d68-c20b-49b7-9c7b-0031c609834f tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:59.300627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e02d68-c20b-49b7-9c7b-0031c609834f tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:59.300906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e02d68-c20b-49b7-9c7b-0031c609834f tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:59.302114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e02d68-c20b-49b7-9c7b-0031c609834f tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:59.326848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e02d68-c20b-49b7-9c7b-0031c609834f tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:59.356214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:59.376340 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2638/5244] 10.222.0.17 () {60 vars in 1360 bytes} [Sat Jul 30 21:19:58 2022] PUT /identity/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users/2679b154ef9c43d592f20f14330ee6b4 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:59.381353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c428fe-8b1b-499f-bb91-96ec1c1a61d0 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:59.507513 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2607/5245] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:19:58 2022] POST /identity/v3/users => generated 367 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:59.511408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e02d68-c20b-49b7-9c7b-0031c609834f tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:59.542694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e02d68-c20b-49b7-9c7b-0031c609834f tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:59.614218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c428fe-8b1b-499f-bb91-96ec1c1a61d0 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:59.617628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025042bd-29a8-48f3-bd07-c3e693e41278 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:59.618552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025042bd-29a8-48f3-bd07-c3e693e41278 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:59.618974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025042bd-29a8-48f3-bd07-c3e693e41278 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:59.619449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025042bd-29a8-48f3-bd07-c3e693e41278 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:59.621034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025042bd-29a8-48f3-bd07-c3e693e41278 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=4eb994cd02fc4e54a59471f1b5311a39)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:59.622641 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-025042bd-29a8-48f3-bd07-c3e693e41278 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:59.622641 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:19:59.622641 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:19:59.624768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025042bd-29a8-48f3-bd07-c3e693e41278 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:59.654953 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2639/5246] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Jul 30 21:19:59 2022] GET /identity/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users => generated 1083 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:19:59.660146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025042bd-29a8-48f3-bd07-c3e693e41278 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:59.679186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025042bd-29a8-48f3-bd07-c3e693e41278 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:19:59.687902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942253f3-ffe8-4271-8149-a13b3db5d40c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:59.695901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942253f3-ffe8-4271-8149-a13b3db5d40c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:59.696513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942253f3-ffe8-4271-8149-a13b3db5d40c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:59.696870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942253f3-ffe8-4271-8149-a13b3db5d40c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users/7b25fd808fc14c33821ff9e62ae47a4f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:59.699151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942253f3-ffe8-4271-8149-a13b3db5d40c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=4eb994cd02fc4e54a59471f1b5311a39, user_id=7b25fd808fc14c33821ff9e62ae47a4f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:59.700401 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-942253f3-ffe8-4271-8149-a13b3db5d40c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:19:59.700401 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:19:59.700401 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:19:59.701489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0ce7e-67ad-4d60-8dde-076899bf2554 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:19:59.702416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942253f3-ffe8-4271-8149-a13b3db5d40c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:59.703236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0ce7e-67ad-4d60-8dde-076899bf2554 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:19:59.704340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0ce7e-67ad-4d60-8dde-076899bf2554 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:19:59.705330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0ce7e-67ad-4d60-8dde-076899bf2554 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:19:59.707165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0ce7e-67ad-4d60-8dde-076899bf2554 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:19:59.712136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0ce7e-67ad-4d60-8dde-076899bf2554 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:19:59.763878 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2640/5247] 10.222.0.17 () {58 vars in 1342 bytes} [Sat Jul 30 21:19:59 2022] HEAD /identity/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users/7b25fd808fc14c33821ff9e62ae47a4f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:19:59.770086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942253f3-ffe8-4271-8149-a13b3db5d40c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:59.791378 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2608/5248] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:19:59 2022] POST /identity/v3/projects => generated 360 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:19:59.796721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0ce7e-67ad-4d60-8dde-076899bf2554 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:19:59.814954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=10,keystone:SELECT=85,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:59.817659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942253f3-ffe8-4271-8149-a13b3db5d40c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:00.054382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0ce7e-67ad-4d60-8dde-076899bf2554 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:00.073701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ee80b-2562-44a9-9ca6-f9b574cea3ee tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:00.073701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ee80b-2562-44a9-9ca6-f9b574cea3ee tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:00.075254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ee80b-2562-44a9-9ca6-f9b574cea3ee tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:00.075990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ee80b-2562-44a9-9ca6-f9b574cea3ee tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/users/63b7674305de491d820c77973a5ac9a6` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:00.107904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ce878-e277-49b6-85f4-f27f7935d634 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:00.109884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ce878-e277-49b6-85f4-f27f7935d634 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:00.110394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ce878-e277-49b6-85f4-f27f7935d634 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:00.110860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ce878-e277-49b6-85f4-f27f7935d634 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users/7b25fd808fc14c33821ff9e62ae47a4f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:00.119507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ce878-e277-49b6-85f4-f27f7935d634 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=4eb994cd02fc4e54a59471f1b5311a39, user_id=7b25fd808fc14c33821ff9e62ae47a4f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:00.122450 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-7d6ce878-e277-49b6-85f4-f27f7935d634 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:20:00.122450 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:20:00.122450 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:20:00.126387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ce878-e277-49b6-85f4-f27f7935d634 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:00.130459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ee80b-2562-44a9-9ca6-f9b574cea3ee tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:update_user(user_id=63b7674305de491d820c77973a5ac9a6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:00.136221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ee80b-2562-44a9-9ca6-f9b574cea3ee tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:00.158905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7d6ce878-e277-49b6-85f4-f27f7935d634 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7b25fd808fc14c33821ff9e62ae47a4f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:00.198595 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2641/5249] 10.222.0.17 () {58 vars in 1344 bytes} [Sat Jul 30 21:19:59 2022] DELETE /identity/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users/7b25fd808fc14c33821ff9e62ae47a4f => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:00.203331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ce878-e277-49b6-85f4-f27f7935d634 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:00.268653 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2609/5250] 10.222.0.17 () {60 vars in 1244 bytes} [Sat Jul 30 21:19:59 2022] PATCH /identity/v3/users/63b7674305de491d820c77973a5ac9a6 => generated 524 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:20:00.271268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ee80b-2562-44a9-9ca6-f9b574cea3ee tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:00.298289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ee80b-2562-44a9-9ca6-f9b574cea3ee tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:00.451182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ce878-e277-49b6-85f4-f27f7935d634 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:00.458018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b7ecb-8636-4e77-b3f0-b912b9fbb49a tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:00.459157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b7ecb-8636-4e77-b3f0-b912b9fbb49a tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:00.459649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b7ecb-8636-4e77-b3f0-b912b9fbb49a tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:00.460101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b7ecb-8636-4e77-b3f0-b912b9fbb49a tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users/e012817e33314ba7af14a32ebd827e1e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:00.464716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b7ecb-8636-4e77-b3f0-b912b9fbb49a tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=4eb994cd02fc4e54a59471f1b5311a39, user_id=e012817e33314ba7af14a32ebd827e1e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:00.467579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b7ecb-8636-4e77-b3f0-b912b9fbb49a tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:00.474217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:00.490239 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2642/5251] 10.222.0.17 () {58 vars in 1342 bytes} [Sat Jul 30 21:20:00 2022] HEAD /identity/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users/e012817e33314ba7af14a32ebd827e1e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:00.494122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b7ecb-8636-4e77-b3f0-b912b9fbb49a tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:00.512874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b7ecb-8636-4e77-b3f0-b912b9fbb49a tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:00.518627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48c0e1-e11b-4e27-b6f6-c87d9eeeff01 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:00.519645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48c0e1-e11b-4e27-b6f6-c87d9eeeff01 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:00.520284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48c0e1-e11b-4e27-b6f6-c87d9eeeff01 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:00.520728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48c0e1-e11b-4e27-b6f6-c87d9eeeff01 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users/e012817e33314ba7af14a32ebd827e1e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:00.522964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48c0e1-e11b-4e27-b6f6-c87d9eeeff01 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=4eb994cd02fc4e54a59471f1b5311a39, user_id=e012817e33314ba7af14a32ebd827e1e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:00.526197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48c0e1-e11b-4e27-b6f6-c87d9eeeff01 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:00.540083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb773a-e4fb-4737-8497-163d991b990a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:00.541845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb773a-e4fb-4737-8497-163d991b990a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:00.542471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb773a-e4fb-4737-8497-163d991b990a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:00.543239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb773a-e4fb-4737-8497-163d991b990a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/users/63b7674305de491d820c77973a5ac9a6` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:00.554901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5c48c0e1-e11b-4e27-b6f6-c87d9eeeff01 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e012817e33314ba7af14a32ebd827e1e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:00.588888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb773a-e4fb-4737-8497-163d991b990a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:get_user(user_id=63b7674305de491d820c77973a5ac9a6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:00.593167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb773a-e4fb-4737-8497-163d991b990a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:00.601002 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2643/5252] 10.222.0.17 () {58 vars in 1344 bytes} [Sat Jul 30 21:20:00 2022] DELETE /identity/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users/e012817e33314ba7af14a32ebd827e1e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:20:00.607493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48c0e1-e11b-4e27-b6f6-c87d9eeeff01 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:00.628918 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2610/5253] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:20:00 2022] GET /identity/v3/users/63b7674305de491d820c77973a5ac9a6 => generated 390 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:00.632716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb773a-e4fb-4737-8497-163d991b990a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:00.654988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb773a-e4fb-4737-8497-163d991b990a tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:00.802327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757fa884-89be-4dd7-903f-4f689e6211df tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:00.803073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fa884-89be-4dd7-903f-4f689e6211df tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:00.805960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fa884-89be-4dd7-903f-4f689e6211df tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:00.806343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fa884-89be-4dd7-903f-4f689e6211df tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/projects/3d81bcaeec554eeab12ab80760df7425` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:00.807033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48c0e1-e11b-4e27-b6f6-c87d9eeeff01 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:00.810897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757fa884-89be-4dd7-903f-4f689e6211df tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3d81bcaeec554eeab12ab80760df7425)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:00.812865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757fa884-89be-4dd7-903f-4f689e6211df tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:00.813310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b35fcb-ad77-484b-9975-75d0dcda477e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:00.814210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b35fcb-ad77-484b-9975-75d0dcda477e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:00.814508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b35fcb-ad77-484b-9975-75d0dcda477e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:00.814864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b35fcb-ad77-484b-9975-75d0dcda477e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users/2679b154ef9c43d592f20f14330ee6b4` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:00.818140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b35fcb-ad77-484b-9975-75d0dcda477e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=4eb994cd02fc4e54a59471f1b5311a39, user_id=2679b154ef9c43d592f20f14330ee6b4)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:00.820462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b35fcb-ad77-484b-9975-75d0dcda477e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:00.839457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:UPDATE=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:00.857938 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2644/5254] 10.222.0.17 () {58 vars in 1342 bytes} [Sat Jul 30 21:20:00 2022] HEAD /identity/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users/2679b154ef9c43d592f20f14330ee6b4 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:00.873513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b35fcb-ad77-484b-9975-75d0dcda477e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:00.908321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b35fcb-ad77-484b-9975-75d0dcda477e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:00.949927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-757fa884-89be-4dd7-903f-4f689e6211df tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d81bcaeec554eeab12ab80760df7425', 'request_id': 'req-757fa884-89be-4dd7-903f-4f689e6211df'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:00.982094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-757fa884-89be-4dd7-903f-4f689e6211df tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d81bcaeec554eeab12ab80760df7425', 'request_id': 'req-757fa884-89be-4dd7-903f-4f689e6211df'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:01.014347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-757fa884-89be-4dd7-903f-4f689e6211df tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d81bcaeec554eeab12ab80760df7425', 'request_id': 'req-757fa884-89be-4dd7-903f-4f689e6211df'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:01.070715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-757fa884-89be-4dd7-903f-4f689e6211df tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] The token cache is being invalidate because project 3d81bcaeec554eeab12ab80760df7425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:01.071342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-757fa884-89be-4dd7-903f-4f689e6211df tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:01.075611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-757fa884-89be-4dd7-903f-4f689e6211df tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:01.087908 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2611/5255] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:00 2022] DELETE /identity/v3/projects/3d81bcaeec554eeab12ab80760df7425 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:01.089602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757fa884-89be-4dd7-903f-4f689e6211df tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:01.093505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e6099-eb19-4fc9-ad06-1d2c1c324bbb tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:01.094933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e6099-eb19-4fc9-ad06-1d2c1c324bbb tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:01.095149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-757fa884-89be-4dd7-903f-4f689e6211df tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:01.095995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e6099-eb19-4fc9-ad06-1d2c1c324bbb tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:01.096612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e6099-eb19-4fc9-ad06-1d2c1c324bbb tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users/2679b154ef9c43d592f20f14330ee6b4` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:01.099762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e6099-eb19-4fc9-ad06-1d2c1c324bbb tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=4eb994cd02fc4e54a59471f1b5311a39, user_id=2679b154ef9c43d592f20f14330ee6b4)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:01.102282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e6099-eb19-4fc9-ad06-1d2c1c324bbb tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:01.140773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-650e6099-eb19-4fc9-ad06-1d2c1c324bbb tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2679b154ef9c43d592f20f14330ee6b4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:01.169872 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2645/5256] 10.222.0.17 () {58 vars in 1344 bytes} [Sat Jul 30 21:20:00 2022] DELETE /identity/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users/2679b154ef9c43d592f20f14330ee6b4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:01.177025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e6099-eb19-4fc9-ad06-1d2c1c324bbb tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:01.180341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-650e6099-eb19-4fc9-ad06-1d2c1c324bbb tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:01.289859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:01.341672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e6099-eb19-4fc9-ad06-1d2c1c324bbb tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:01.352079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac68b7f-6aa9-42de-a4d4-3142d948db74 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:01.353516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac68b7f-6aa9-42de-a4d4-3142d948db74 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:01.353814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac68b7f-6aa9-42de-a4d4-3142d948db74 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:01.354334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac68b7f-6aa9-42de-a4d4-3142d948db74 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:01.357055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac68b7f-6aa9-42de-a4d4-3142d948db74 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=4eb994cd02fc4e54a59471f1b5311a39)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:01.359385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac68b7f-6aa9-42de-a4d4-3142d948db74 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:01.377636 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2646/5257] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Jul 30 21:20:01 2022] GET /identity/v3/groups/4eb994cd02fc4e54a59471f1b5311a39/users => generated 145 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:01.381955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac68b7f-6aa9-42de-a4d4-3142d948db74 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:01.418075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757fa884-89be-4dd7-903f-4f689e6211df tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:01.420656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac68b7f-6aa9-42de-a4d4-3142d948db74 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:01.432874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db060111-8239-4b49-89fb-3832cd897263 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:01.433718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db060111-8239-4b49-89fb-3832cd897263 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:01.434179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db060111-8239-4b49-89fb-3832cd897263 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:01.434470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db060111-8239-4b49-89fb-3832cd897263 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/users/2679b154ef9c43d592f20f14330ee6b4` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:01.438593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db060111-8239-4b49-89fb-3832cd897263 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2679b154ef9c43d592f20f14330ee6b4)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:01.441310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db060111-8239-4b49-89fb-3832cd897263 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:01.598083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-db060111-8239-4b49-89fb-3832cd897263 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2679b154ef9c43d592f20f14330ee6b4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:01.672959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-db060111-8239-4b49-89fb-3832cd897263 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2679b154ef9c43d592f20f14330ee6b4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:01.682693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-db060111-8239-4b49-89fb-3832cd897263 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2679b154ef9c43d592f20f14330ee6b4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:01.738032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-db060111-8239-4b49-89fb-3832cd897263 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2679b154ef9c43d592f20f14330ee6b4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:01.746604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-db060111-8239-4b49-89fb-3832cd897263 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2679b154ef9c43d592f20f14330ee6b4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:01.781402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f60b22-99a8-4508-bfd6-9f6a8e545352 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f65645ae6410482f6e1570a221629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62e2bc29dd427495fa6947b61122e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:01.782195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f60b22-99a8-4508-bfd6-9f6a8e545352 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:01.782430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f60b22-99a8-4508-bfd6-9f6a8e545352 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:01.784729 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2647/5258] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:01 2022] DELETE /identity/v3/users/2679b154ef9c43d592f20f14330ee6b4 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:01.788910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db060111-8239-4b49-89fb-3832cd897263 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:01.791076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-db060111-8239-4b49-89fb-3832cd897263 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:01.797448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f60b22-99a8-4508-bfd6-9f6a8e545352 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] PATH_INFO: `/v3/users/63b7674305de491d820c77973a5ac9a6` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:01.817782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f60b22-99a8-4508-bfd6-9f6a8e545352 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorizing `identity:delete_user(user_id=63b7674305de491d820c77973a5ac9a6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:01.820430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f60b22-99a8-4508-bfd6-9f6a8e545352 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:01.968759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db060111-8239-4b49-89fb-3832cd897263 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:01.981523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:01.987250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6dc1c-c048-450d-8199-366a8be4750f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:01.988387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6dc1c-c048-450d-8199-366a8be4750f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:01.988751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6dc1c-c048-450d-8199-366a8be4750f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:01.988945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6dc1c-c048-450d-8199-366a8be4750f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/users/e012817e33314ba7af14a32ebd827e1e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:01.990380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-04f60b22-99a8-4508-bfd6-9f6a8e545352 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63b7674305de491d820c77973a5ac9a6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:01.992164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6dc1c-c048-450d-8199-366a8be4750f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e012817e33314ba7af14a32ebd827e1e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:01.994157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6dc1c-c048-450d-8199-366a8be4750f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:02.000965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-04f60b22-99a8-4508-bfd6-9f6a8e545352 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63b7674305de491d820c77973a5ac9a6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:02.045826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-04f60b22-99a8-4508-bfd6-9f6a8e545352 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63b7674305de491d820c77973a5ac9a6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:02.050699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-04f60b22-99a8-4508-bfd6-9f6a8e545352 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63b7674305de491d820c77973a5ac9a6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:02.074167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-04f60b22-99a8-4508-bfd6-9f6a8e545352 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63b7674305de491d820c77973a5ac9a6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:02.105309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-41a6dc1c-c048-450d-8199-366a8be4750f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e012817e33314ba7af14a32ebd827e1e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:02.120038 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2612/5259] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:01 2022] DELETE /identity/v3/users/63b7674305de491d820c77973a5ac9a6 => generated 0 bytes in 1026 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:02.123526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f60b22-99a8-4508-bfd6-9f6a8e545352 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:02.124977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-04f60b22-99a8-4508-bfd6-9f6a8e545352 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:02.131089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:02.135783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-41a6dc1c-c048-450d-8199-366a8be4750f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e012817e33314ba7af14a32ebd827e1e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:02.140207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-41a6dc1c-c048-450d-8199-366a8be4750f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e012817e33314ba7af14a32ebd827e1e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:02.160967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-41a6dc1c-c048-450d-8199-366a8be4750f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e012817e33314ba7af14a32ebd827e1e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:02.163099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-41a6dc1c-c048-450d-8199-366a8be4750f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e012817e33314ba7af14a32ebd827e1e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:02.249318 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2648/5260] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:01 2022] DELETE /identity/v3/users/e012817e33314ba7af14a32ebd827e1e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:02.253577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6dc1c-c048-450d-8199-366a8be4750f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:02.264021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-41a6dc1c-c048-450d-8199-366a8be4750f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:02.402785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f60b22-99a8-4508-bfd6-9f6a8e545352 tempest-UsersV3TestJSON-939579393 tempest-UsersV3TestJSON-939579393-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:02.430451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6dc1c-c048-450d-8199-366a8be4750f tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:02.438794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118a611-9a63-4d9c-b6d4-a8c3f26fc1c3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:02.441181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118a611-9a63-4d9c-b6d4-a8c3f26fc1c3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:02.442004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118a611-9a63-4d9c-b6d4-a8c3f26fc1c3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:02.442393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118a611-9a63-4d9c-b6d4-a8c3f26fc1c3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/users/7b25fd808fc14c33821ff9e62ae47a4f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:02.445204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118a611-9a63-4d9c-b6d4-a8c3f26fc1c3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7b25fd808fc14c33821ff9e62ae47a4f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:02.451676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118a611-9a63-4d9c-b6d4-a8c3f26fc1c3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:02.640165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775f6cd-a60c-4617-89f6-9e4d67858f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:02.651887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1118a611-9a63-4d9c-b6d4-a8c3f26fc1c3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b25fd808fc14c33821ff9e62ae47a4f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:02.659774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775f6cd-a60c-4617-89f6-9e4d67858f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:02.664431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775f6cd-a60c-4617-89f6-9e4d67858f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:02.665048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775f6cd-a60c-4617-89f6-9e4d67858f15 admin admin] PATH_INFO: `/v3/users/31fd27a06d78454e82f4afa9097d275d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:02.686322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1118a611-9a63-4d9c-b6d4-a8c3f26fc1c3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b25fd808fc14c33821ff9e62ae47a4f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:02.686664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1118a611-9a63-4d9c-b6d4-a8c3f26fc1c3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b25fd808fc14c33821ff9e62ae47a4f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:02.698400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1118a611-9a63-4d9c-b6d4-a8c3f26fc1c3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b25fd808fc14c33821ff9e62ae47a4f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:02.699648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1118a611-9a63-4d9c-b6d4-a8c3f26fc1c3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b25fd808fc14c33821ff9e62ae47a4f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:02.718840 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2649/5261] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:02 2022] DELETE /identity/v3/users/7b25fd808fc14c33821ff9e62ae47a4f => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:20:02.725041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118a611-9a63-4d9c-b6d4-a8c3f26fc1c3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:02.727779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1118a611-9a63-4d9c-b6d4-a8c3f26fc1c3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:02.733555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775f6cd-a60c-4617-89f6-9e4d67858f15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31fd27a06d78454e82f4afa9097d275d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:02.741803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775f6cd-a60c-4617-89f6-9e4d67858f15 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:02.825650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:02.837981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118a611-9a63-4d9c-b6d4-a8c3f26fc1c3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:02.855392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3894e4-c772-4379-897c-1bebe68e4bc3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:02.858026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3894e4-c772-4379-897c-1bebe68e4bc3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:02.859132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3894e4-c772-4379-897c-1bebe68e4bc3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:02.859537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3894e4-c772-4379-897c-1bebe68e4bc3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/4eb994cd02fc4e54a59471f1b5311a39` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:02.865734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3894e4-c772-4379-897c-1bebe68e4bc3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4eb994cd02fc4e54a59471f1b5311a39)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:02.871836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3894e4-c772-4379-897c-1bebe68e4bc3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:02.932526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4775f6cd-a60c-4617-89f6-9e4d67858f15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31fd27a06d78454e82f4afa9097d275d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:02.934709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4775f6cd-a60c-4617-89f6-9e4d67858f15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31fd27a06d78454e82f4afa9097d275d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:02.973850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:02.978024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4775f6cd-a60c-4617-89f6-9e4d67858f15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31fd27a06d78454e82f4afa9097d275d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:02.979949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4775f6cd-a60c-4617-89f6-9e4d67858f15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31fd27a06d78454e82f4afa9097d275d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:03.004605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4775f6cd-a60c-4617-89f6-9e4d67858f15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31fd27a06d78454e82f4afa9097d275d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:03.037347 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2613/5262] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:02 2022] DELETE /identity/v3/users/31fd27a06d78454e82f4afa9097d275d => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:03.042304 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2650/5263] 10.222.0.17 () {58 vars in 1227 bytes} [Sat Jul 30 21:20:02 2022] DELETE /identity/v3/groups/4eb994cd02fc4e54a59471f1b5311a39 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:20:03.052143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6762a8a-8818-4f10-b09d-6ade56d9a5a6 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:03.052347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3894e4-c772-4379-897c-1bebe68e4bc3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:03.053468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6762a8a-8818-4f10-b09d-6ade56d9a5a6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:03.053931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6762a8a-8818-4f10-b09d-6ade56d9a5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:03.054664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3f3894e4-c772-4379-897c-1bebe68e4bc3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:03.098746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a6762a8a-8818-4f10-b09d-6ade56d9a5a6 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:03.102562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a6762a8a-8818-4f10-b09d-6ade56d9a5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:03.174251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3894e4-c772-4379-897c-1bebe68e4bc3 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:03.183011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb1072-bc7b-495e-b98a-5a9ff64f7953 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:03.184004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb1072-bc7b-495e-b98a-5a9ff64f7953 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:03.184361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb1072-bc7b-495e-b98a-5a9ff64f7953 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:03.184715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb1072-bc7b-495e-b98a-5a9ff64f7953 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:03.185499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb1072-bc7b-495e-b98a-5a9ff64f7953 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:03.188125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb1072-bc7b-495e-b98a-5a9ff64f7953 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:03.215763 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2651/5264] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:20:03 2022] POST /identity/v3/groups => generated 326 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:03.216185 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2614/5265] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:03.220474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6762a8a-8818-4f10-b09d-6ade56d9a5a6 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:03.245613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6762a8a-8818-4f10-b09d-6ade56d9a5a6 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:03.256073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f7340-9412-4e6c-8457-3e863c172e84 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:03.256715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f7340-9412-4e6c-8457-3e863c172e84 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:03.257005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f7340-9412-4e6c-8457-3e863c172e84 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:03.259405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f7340-9412-4e6c-8457-3e863c172e84 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:03.259405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f7340-9412-4e6c-8457-3e863c172e84 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:03.273762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f7340-9412-4e6c-8457-3e863c172e84 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:03.299189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb1072-bc7b-495e-b98a-5a9ff64f7953 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:03.304392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a2eb1072-bc7b-495e-b98a-5a9ff64f7953 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:03.328541 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2615/5266] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:20:03 2022] POST /identity/v3/groups => generated 326 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:03.331631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f7340-9412-4e6c-8457-3e863c172e84 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:03.371571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f7340-9412-4e6c-8457-3e863c172e84 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:03.402262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5ae0b-632f-4927-87d8-fe0d8f86eca8 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:03.406033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5ae0b-632f-4927-87d8-fe0d8f86eca8 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:03.407364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5ae0b-632f-4927-87d8-fe0d8f86eca8 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:03.409763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5ae0b-632f-4927-87d8-fe0d8f86eca8 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:03.412741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5ae0b-632f-4927-87d8-fe0d8f86eca8 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:03.422973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5ae0b-632f-4927-87d8-fe0d8f86eca8 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:03.449940 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2616/5267] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:20:03 2022] POST /identity/v3/groups => generated 326 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:03.455876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5ae0b-632f-4927-87d8-fe0d8f86eca8 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:03.472031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5ae0b-632f-4927-87d8-fe0d8f86eca8 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:03.484927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3b88c-6c6d-4372-be2d-85062eeba0c8 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:03.485604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3b88c-6c6d-4372-be2d-85062eeba0c8 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:03.486283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3b88c-6c6d-4372-be2d-85062eeba0c8 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:03.486583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3b88c-6c6d-4372-be2d-85062eeba0c8 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:03.489072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3b88c-6c6d-4372-be2d-85062eeba0c8 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:03.491364 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-cce3b88c-6c6d-4372-be2d-85062eeba0c8 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:20:03.491364 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:20:03.491364 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:20:03.493169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3b88c-6c6d-4372-be2d-85062eeba0c8 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:03.506586 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2617/5268] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Jul 30 21:20:03 2022] GET /identity/v3/groups => generated 1488 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:03.508058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3b88c-6c6d-4372-be2d-85062eeba0c8 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:03.524149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3b88c-6c6d-4372-be2d-85062eeba0c8 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:03.533459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dcdba-b683-4ffb-8ed1-1f0def32884b tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:03.534951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dcdba-b683-4ffb-8ed1-1f0def32884b tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:03.535399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dcdba-b683-4ffb-8ed1-1f0def32884b tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:03.535653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dcdba-b683-4ffb-8ed1-1f0def32884b tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/b723cb8511754501a02f8980e5c2b4cf` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:03.536550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb1072-bc7b-495e-b98a-5a9ff64f7953 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:03.548479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2511b-0695-4a31-b7a4-b29899010a3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:03.551811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2511b-0695-4a31-b7a4-b29899010a3e service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:03.552208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816dcdba-b683-4ffb-8ed1-1f0def32884b tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b723cb8511754501a02f8980e5c2b4cf)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:03.553216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2511b-0695-4a31-b7a4-b29899010a3e service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:03.555121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2511b-0695-4a31-b7a4-b29899010a3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:03.556771 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-816dcdba-b683-4ffb-8ed1-1f0def32884b tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:20:03.556771 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:20:03.556771 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:20:03.559351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816dcdba-b683-4ffb-8ed1-1f0def32884b tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:03.586489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2511b-0695-4a31-b7a4-b29899010a3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:03.589433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2511b-0695-4a31-b7a4-b29899010a3e service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:03.639795 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2652/5269] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:03.719494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2511b-0695-4a31-b7a4-b29899010a3e service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:03.721340 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2618/5270] 10.222.0.17 () {58 vars in 1227 bytes} [Sat Jul 30 21:20:03 2022] DELETE /identity/v3/groups/b723cb8511754501a02f8980e5c2b4cf => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:03.734535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2511b-0695-4a31-b7a4-b29899010a3e service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:03.818894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:03.833743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f4caa-a3c4-466d-ba92-f6abc3a4c72d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:03.834413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4caa-a3c4-466d-ba92-f6abc3a4c72d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:03.834699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4caa-a3c4-466d-ba92-f6abc3a4c72d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:03.835028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4caa-a3c4-466d-ba92-f6abc3a4c72d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/2adf4ff9386d45a89b5c2422f2f726d8` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:03.842709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f4caa-a3c4-466d-ba92-f6abc3a4c72d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2adf4ff9386d45a89b5c2422f2f726d8)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:03.845119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f4caa-a3c4-466d-ba92-f6abc3a4c72d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:03.928726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dcdba-b683-4ffb-8ed1-1f0def32884b tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:03.939452 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2653/5271] 10.222.0.17 () {58 vars in 1227 bytes} [Sat Jul 30 21:20:03 2022] DELETE /identity/v3/groups/2adf4ff9386d45a89b5c2422f2f726d8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:03.943755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dcdba-b683-4ffb-8ed1-1f0def32884b tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:04.044127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:04.062123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a39bc-63ed-482a-803f-9501c496d82b tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:04.063330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a39bc-63ed-482a-803f-9501c496d82b tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:04.064369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a39bc-63ed-482a-803f-9501c496d82b tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:04.064954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a39bc-63ed-482a-803f-9501c496d82b tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/82c9321d021a415f81dc03c069ae9ddd` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:04.075417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a39bc-63ed-482a-803f-9501c496d82b tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:delete_group(group_id=82c9321d021a415f81dc03c069ae9ddd)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:04.077942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a39bc-63ed-482a-803f-9501c496d82b tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:04.207690 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2619/5272] 10.222.0.17 () {58 vars in 1227 bytes} [Sat Jul 30 21:20:03 2022] DELETE /identity/v3/groups/82c9321d021a415f81dc03c069ae9ddd => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:04.208335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f4caa-a3c4-466d-ba92-f6abc3a4c72d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:04.224965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f4caa-a3c4-466d-ba92-f6abc3a4c72d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:04.345312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d80906-f2c5-4d27-8321-f496b7a9e567 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:04.347211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d80906-f2c5-4d27-8321-f496b7a9e567 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:04.347211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d80906-f2c5-4d27-8321-f496b7a9e567 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:04.348252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d80906-f2c5-4d27-8321-f496b7a9e567 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:04.351329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d80906-f2c5-4d27-8321-f496b7a9e567 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:04.353955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d80906-f2c5-4d27-8321-f496b7a9e567 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:04.402443 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2654/5273] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:04 2022] POST /identity/v3/users => generated 321 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:04.403928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a39bc-63ed-482a-803f-9501c496d82b tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:04.418045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a39bc-63ed-482a-803f-9501c496d82b tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:04.426603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaf27f-eb25-47e9-8b74-48a962b2b50c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:04.427438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaf27f-eb25-47e9-8b74-48a962b2b50c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:04.427783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaf27f-eb25-47e9-8b74-48a962b2b50c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:04.428089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaf27f-eb25-47e9-8b74-48a962b2b50c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:04.430171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaf27f-eb25-47e9-8b74-48a962b2b50c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:04.441109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaf27f-eb25-47e9-8b74-48a962b2b50c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:04.470724 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2620/5274] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:20:04 2022] POST /identity/v3/groups => generated 327 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:20:04.471752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d80906-f2c5-4d27-8321-f496b7a9e567 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:04.491397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d80906-f2c5-4d27-8321-f496b7a9e567 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:04.507657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaa9a1-408f-4e30-9366-4deddb6fcf44 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:04.508501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaa9a1-408f-4e30-9366-4deddb6fcf44 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:04.508622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaa9a1-408f-4e30-9366-4deddb6fcf44 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:04.508889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaa9a1-408f-4e30-9366-4deddb6fcf44 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/79296ebfe6ee4a8abc910157e380c8c5/users/6e7aae617ded45de965b1ac19b1263a5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:04.533836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caaa9a1-408f-4e30-9366-4deddb6fcf44 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=79296ebfe6ee4a8abc910157e380c8c5, user_id=6e7aae617ded45de965b1ac19b1263a5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:04.537164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caaa9a1-408f-4e30-9366-4deddb6fcf44 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:04.585521 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2655/5275] 10.222.0.17 () {60 vars in 1360 bytes} [Sat Jul 30 21:20:04 2022] PUT /identity/v3/groups/79296ebfe6ee4a8abc910157e380c8c5/users/6e7aae617ded45de965b1ac19b1263a5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:04.589959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaf27f-eb25-47e9-8b74-48a962b2b50c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:04.604292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaf27f-eb25-47e9-8b74-48a962b2b50c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:04.702191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94723a-da91-49b5-9a17-f130da835994 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:04.703304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94723a-da91-49b5-9a17-f130da835994 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:04.703795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94723a-da91-49b5-9a17-f130da835994 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:04.704086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94723a-da91-49b5-9a17-f130da835994 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:04.704881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94723a-da91-49b5-9a17-f130da835994 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:04.707512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94723a-da91-49b5-9a17-f130da835994 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:04.744573 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2621/5276] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:20:04 2022] POST /identity/v3/groups => generated 324 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:04.745915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaa9a1-408f-4e30-9366-4deddb6fcf44 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:04.767093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaa9a1-408f-4e30-9366-4deddb6fcf44 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:04.794138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dabbca-085b-4c95-8a95-2ea37898daed tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:04.796589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dabbca-085b-4c95-8a95-2ea37898daed tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:04.797463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dabbca-085b-4c95-8a95-2ea37898daed tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:04.797917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dabbca-085b-4c95-8a95-2ea37898daed tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/ae107e8ef61c4a959adbec033944db2a/users/6e7aae617ded45de965b1ac19b1263a5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:04.809448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dabbca-085b-4c95-8a95-2ea37898daed tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=ae107e8ef61c4a959adbec033944db2a, user_id=6e7aae617ded45de965b1ac19b1263a5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:04.811827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dabbca-085b-4c95-8a95-2ea37898daed tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:04.854396 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2656/5277] 10.222.0.17 () {60 vars in 1360 bytes} [Sat Jul 30 21:20:04 2022] PUT /identity/v3/groups/ae107e8ef61c4a959adbec033944db2a/users/6e7aae617ded45de965b1ac19b1263a5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:04.859390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94723a-da91-49b5-9a17-f130da835994 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:04.897989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94723a-da91-49b5-9a17-f130da835994 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:05.010300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b3b3e-bc44-475f-96f7-61891ca14a38 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:05.011017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b3b3e-bc44-475f-96f7-61891ca14a38 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:05.011457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b3b3e-bc44-475f-96f7-61891ca14a38 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:05.020844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b3b3e-bc44-475f-96f7-61891ca14a38 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/users/6e7aae617ded45de965b1ac19b1263a5/groups` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:05.022665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b3b3e-bc44-475f-96f7-61891ca14a38 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=6e7aae617ded45de965b1ac19b1263a5)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:05.027910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b3b3e-bc44-475f-96f7-61891ca14a38 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:05.052313 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2622/5278] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Jul 30 21:20:04 2022] GET /identity/v3/users/6e7aae617ded45de965b1ac19b1263a5/groups => generated 837 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:05.056511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dabbca-085b-4c95-8a95-2ea37898daed tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:05.076748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dabbca-085b-4c95-8a95-2ea37898daed tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:05.092982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc53e4-c72b-4021-884d-ff0013c7628c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:05.093724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc53e4-c72b-4021-884d-ff0013c7628c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:05.093925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc53e4-c72b-4021-884d-ff0013c7628c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:05.094351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc53e4-c72b-4021-884d-ff0013c7628c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/ae107e8ef61c4a959adbec033944db2a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:05.098128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc53e4-c72b-4021-884d-ff0013c7628c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ae107e8ef61c4a959adbec033944db2a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:05.103573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc53e4-c72b-4021-884d-ff0013c7628c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:05.195500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:05.246276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b3b3e-bc44-475f-96f7-61891ca14a38 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:05.250659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-678b3b3e-bc44-475f-96f7-61891ca14a38 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:05.275467 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2657/5279] 10.222.0.17 () {58 vars in 1227 bytes} [Sat Jul 30 21:20:05 2022] DELETE /identity/v3/groups/ae107e8ef61c4a959adbec033944db2a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:05.276481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc53e4-c72b-4021-884d-ff0013c7628c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:05.306172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:05.419005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc53e4-c72b-4021-884d-ff0013c7628c tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:05.440199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88425a39-fb35-4f7d-b7e1-f1535fdb7fc2 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:05.440973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88425a39-fb35-4f7d-b7e1-f1535fdb7fc2 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:05.441260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88425a39-fb35-4f7d-b7e1-f1535fdb7fc2 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:05.441672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88425a39-fb35-4f7d-b7e1-f1535fdb7fc2 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/groups/79296ebfe6ee4a8abc910157e380c8c5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:05.443042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88425a39-fb35-4f7d-b7e1-f1535fdb7fc2 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:delete_group(group_id=79296ebfe6ee4a8abc910157e380c8c5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:05.445148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88425a39-fb35-4f7d-b7e1-f1535fdb7fc2 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:05.457136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b3b3e-bc44-475f-96f7-61891ca14a38 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:05.538412 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2658/5280] 10.222.0.17 () {58 vars in 1227 bytes} [Sat Jul 30 21:20:05 2022] DELETE /identity/v3/groups/79296ebfe6ee4a8abc910157e380c8c5 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:05.542661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88425a39-fb35-4f7d-b7e1-f1535fdb7fc2 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:05.625398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab086256-ee0e-45f9-ba86-fc0cdf39efee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:05.626086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab086256-ee0e-45f9-ba86-fc0cdf39efee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:05.626357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab086256-ee0e-45f9-ba86-fc0cdf39efee admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:05.626863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab086256-ee0e-45f9-ba86-fc0cdf39efee admin admin] PATH_INFO: `/v3/users/4a01092bfa5a4118a5fe61a6dc9c5460` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:05.633358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab086256-ee0e-45f9-ba86-fc0cdf39efee admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a01092bfa5a4118a5fe61a6dc9c5460)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:05.635446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab086256-ee0e-45f9-ba86-fc0cdf39efee admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:05.684712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88425a39-fb35-4f7d-b7e1-f1535fdb7fc2 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:05.695660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587be01-880f-46f4-bfcb-e72706ac190e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:05.696586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587be01-880f-46f4-bfcb-e72706ac190e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:05.696870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587be01-880f-46f4-bfcb-e72706ac190e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:05.697266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587be01-880f-46f4-bfcb-e72706ac190e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/users/6e7aae617ded45de965b1ac19b1263a5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:05.698832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587be01-880f-46f4-bfcb-e72706ac190e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6e7aae617ded45de965b1ac19b1263a5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:05.701175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587be01-880f-46f4-bfcb-e72706ac190e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:05.732349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ab086256-ee0e-45f9-ba86-fc0cdf39efee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a01092bfa5a4118a5fe61a6dc9c5460'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:05.733255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ab086256-ee0e-45f9-ba86-fc0cdf39efee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a01092bfa5a4118a5fe61a6dc9c5460'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:05.763271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ab086256-ee0e-45f9-ba86-fc0cdf39efee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a01092bfa5a4118a5fe61a6dc9c5460'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:05.764424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ab086256-ee0e-45f9-ba86-fc0cdf39efee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a01092bfa5a4118a5fe61a6dc9c5460'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:05.783722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ab086256-ee0e-45f9-ba86-fc0cdf39efee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a01092bfa5a4118a5fe61a6dc9c5460'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:05.799868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:DELETE=12 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:05.811403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1587be01-880f-46f4-bfcb-e72706ac190e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e7aae617ded45de965b1ac19b1263a5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:05.814651 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2623/5281] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:05 2022] DELETE /identity/v3/users/4a01092bfa5a4118a5fe61a6dc9c5460 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:05.817262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab086256-ee0e-45f9-ba86-fc0cdf39efee admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:05.820130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ab086256-ee0e-45f9-ba86-fc0cdf39efee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:05.844688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1587be01-880f-46f4-bfcb-e72706ac190e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e7aae617ded45de965b1ac19b1263a5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:05.850072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1587be01-880f-46f4-bfcb-e72706ac190e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e7aae617ded45de965b1ac19b1263a5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:05.876775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1587be01-880f-46f4-bfcb-e72706ac190e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e7aae617ded45de965b1ac19b1263a5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:05.879321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1587be01-880f-46f4-bfcb-e72706ac190e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e7aae617ded45de965b1ac19b1263a5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:05.908888 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2659/5282] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:05 2022] DELETE /identity/v3/users/6e7aae617ded45de965b1ac19b1263a5 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:20:05.919249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587be01-880f-46f4-bfcb-e72706ac190e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:05.921733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1587be01-880f-46f4-bfcb-e72706ac190e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:06.052765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:06.061296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587be01-880f-46f4-bfcb-e72706ac190e tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:06.070129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c4e45-9c20-4be8-a7b1-517b7e8a1017 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:06.071188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c4e45-9c20-4be8-a7b1-517b7e8a1017 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:06.071771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c4e45-9c20-4be8-a7b1-517b7e8a1017 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:06.072273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c4e45-9c20-4be8-a7b1-517b7e8a1017 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/domains/765f2880e38843c4ad5adfc6563ad977` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:06.074515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c4e45-9c20-4be8-a7b1-517b7e8a1017 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=765f2880e38843c4ad5adfc6563ad977)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:06.077102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c4e45-9c20-4be8-a7b1-517b7e8a1017 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:06.109952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab086256-ee0e-45f9-ba86-fc0cdf39efee admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:06.140167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d72c4e45-9c20-4be8-a7b1-517b7e8a1017 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '765f2880e38843c4ad5adfc6563ad977'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.140978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d72c4e45-9c20-4be8-a7b1-517b7e8a1017 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '765f2880e38843c4ad5adfc6563ad977'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.202798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d72c4e45-9c20-4be8-a7b1-517b7e8a1017 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '765f2880e38843c4ad5adfc6563ad977'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.203832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d72c4e45-9c20-4be8-a7b1-517b7e8a1017 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '765f2880e38843c4ad5adfc6563ad977'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.213878 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2660/5283] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:20:05 2022] PATCH /identity/v3/domains/765f2880e38843c4ad5adfc6563ad977 => generated 277 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:06.216465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c4e45-9c20-4be8-a7b1-517b7e8a1017 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:06.219811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d72c4e45-9c20-4be8-a7b1-517b7e8a1017 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:06.233226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20bb6d-7036-4573-a76a-6900f87e0ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:06.234697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20bb6d-7036-4573-a76a-6900f87e0ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:06.235544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20bb6d-7036-4573-a76a-6900f87e0ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:06.236053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20bb6d-7036-4573-a76a-6900f87e0ebd admin admin] PATH_INFO: `/v3/projects/9567b7f5b2404b98b11d747bbeccd4c7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:06.239897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20bb6d-7036-4573-a76a-6900f87e0ebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9567b7f5b2404b98b11d747bbeccd4c7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:06.243113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20bb6d-7036-4573-a76a-6900f87e0ebd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:06.378955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c4e45-9c20-4be8-a7b1-517b7e8a1017 tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:06.394597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8d20bb6d-7036-4573-a76a-6900f87e0ebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9567b7f5b2404b98b11d747bbeccd4c7', 'request_id': 'req-8d20bb6d-7036-4573-a76a-6900f87e0ebd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.418194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8d20bb6d-7036-4573-a76a-6900f87e0ebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9567b7f5b2404b98b11d747bbeccd4c7', 'request_id': 'req-8d20bb6d-7036-4573-a76a-6900f87e0ebd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.433576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8d20bb6d-7036-4573-a76a-6900f87e0ebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9567b7f5b2404b98b11d747bbeccd4c7', 'request_id': 'req-8d20bb6d-7036-4573-a76a-6900f87e0ebd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.440222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:06.452851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8d20bb6d-7036-4573-a76a-6900f87e0ebd admin admin] The token cache is being invalidate because project 9567b7f5b2404b98b11d747bbeccd4c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:06.453149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8d20bb6d-7036-4573-a76a-6900f87e0ebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.454658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8d20bb6d-7036-4573-a76a-6900f87e0ebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.457801 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2624/5284] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:05 2022] DELETE /identity/v3/projects/9567b7f5b2404b98b11d747bbeccd4c7 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:06.464926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20bb6d-7036-4573-a76a-6900f87e0ebd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:06.470530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8d20bb6d-7036-4573-a76a-6900f87e0ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:06.488632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8d63ac05e5441a887f5fd367528449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d0ac15a16534d67a4a32fb3b90700ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:06.489359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:06.489664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:06.489947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] PATH_INFO: `/v3/domains/765f2880e38843c4ad5adfc6563ad977` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:06.507186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=765f2880e38843c4ad5adfc6563ad977)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:06.513170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:06.554642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '765f2880e38843c4ad5adfc6563ad977'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.568092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '765f2880e38843c4ad5adfc6563ad977'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.586543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20bb6d-7036-4573-a76a-6900f87e0ebd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:06.594198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbcb65-cbfc-4ee9-a70b-84323339a110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:06.595685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbcb65-cbfc-4ee9-a70b-84323339a110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:06.596133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbcb65-cbfc-4ee9-a70b-84323339a110 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:06.597189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbcb65-cbfc-4ee9-a70b-84323339a110 admin admin] PATH_INFO: `/v3/users/521f65645ae6410482f6e1570a221629` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:06.598688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbcb65-cbfc-4ee9-a70b-84323339a110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=521f65645ae6410482f6e1570a221629)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:06.602101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbcb65-cbfc-4ee9-a70b-84323339a110 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:06.665617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:06.668767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765f2880e38843c4ad5adfc6563ad977', 'request_id': 'req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.686673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765f2880e38843c4ad5adfc6563ad977', 'request_id': 'req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.705031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765f2880e38843c4ad5adfc6563ad977', 'request_id': 'req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.715542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a6dbcb65-cbfc-4ee9-a70b-84323339a110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '521f65645ae6410482f6e1570a221629'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.716668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a6dbcb65-cbfc-4ee9-a70b-84323339a110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '521f65645ae6410482f6e1570a221629'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.734214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a6dbcb65-cbfc-4ee9-a70b-84323339a110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '521f65645ae6410482f6e1570a221629'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.734983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] The token cache is being invalidate because project 765f2880e38843c4ad5adfc6563ad977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:06.735323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.735874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a6dbcb65-cbfc-4ee9-a70b-84323339a110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '521f65645ae6410482f6e1570a221629'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.737436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.747225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a6dbcb65-cbfc-4ee9-a70b-84323339a110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '521f65645ae6410482f6e1570a221629'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.749407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '765f2880e38843c4ad5adfc6563ad977', 'request_id': 'req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.750457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '765f2880e38843c4ad5adfc6563ad977', 'request_id': 'req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.751216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '765f2880e38843c4ad5adfc6563ad977', 'request_id': 'req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:06.761616 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2661/5285] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:20:06 2022] DELETE /identity/v3/domains/765f2880e38843c4ad5adfc6563ad977 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:06.765530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:06.767038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:06.774332 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2625/5286] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:06 2022] DELETE /identity/v3/users/521f65645ae6410482f6e1570a221629 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:06.896544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21b78c-0f5d-46e4-9c88-12ae7e75dc4d tempest-GroupsV3TestJSON-1758261209 tempest-GroupsV3TestJSON-1758261209-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:06.938498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:07.031599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f5214-6b61-4290-ae00-7bea5a2d41e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:07.032933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f5214-6b61-4290-ae00-7bea5a2d41e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:07.032933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f5214-6b61-4290-ae00-7bea5a2d41e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:07.033085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f5214-6b61-4290-ae00-7bea5a2d41e5 admin admin] PATH_INFO: `/v3/users/b9b9298f6cf14dc189e4a238bf8ba0a0` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:07.035661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f5214-6b61-4290-ae00-7bea5a2d41e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9b9298f6cf14dc189e4a238bf8ba0a0)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:07.037775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f5214-6b61-4290-ae00-7bea5a2d41e5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:07.130806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bd6f5214-6b61-4290-ae00-7bea5a2d41e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9b9298f6cf14dc189e4a238bf8ba0a0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:07.147008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bd6f5214-6b61-4290-ae00-7bea5a2d41e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9b9298f6cf14dc189e4a238bf8ba0a0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:07.147967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bd6f5214-6b61-4290-ae00-7bea5a2d41e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9b9298f6cf14dc189e4a238bf8ba0a0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:07.157522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bd6f5214-6b61-4290-ae00-7bea5a2d41e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9b9298f6cf14dc189e4a238bf8ba0a0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:07.158389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bd6f5214-6b61-4290-ae00-7bea5a2d41e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9b9298f6cf14dc189e4a238bf8ba0a0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:07.181597 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2662/5287] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:06 2022] DELETE /identity/v3/users/b9b9298f6cf14dc189e4a238bf8ba0a0 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:07.183489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9d18e-206e-4ab9-906f-527d40740707 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:07.183957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9d18e-206e-4ab9-906f-527d40740707 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:07.191994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9d18e-206e-4ab9-906f-527d40740707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:07.252530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-86d9d18e-206e-4ab9-906f-527d40740707 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:07.254846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-86d9d18e-206e-4ab9-906f-527d40740707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:07.287889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f5214-6b61-4290-ae00-7bea5a2d41e5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:07.292628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bd6f5214-6b61-4290-ae00-7bea5a2d41e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:07.391668 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2626/5288] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:07.391668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d223d-20bf-462b-8600-8979cefbb942 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:07.391668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d223d-20bf-462b-8600-8979cefbb942 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:07.391668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d223d-20bf-462b-8600-8979cefbb942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:07.441979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3e0d223d-20bf-462b-8600-8979cefbb942 None None] MFA Rules not processed for user `3ef2a5ef6d7b4a36b2ead7e1e605430c`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:07.443416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3e0d223d-20bf-462b-8600-8979cefbb942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:07.480846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f5214-6b61-4290-ae00-7bea5a2d41e5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:07.487984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220745a-e560-4d3e-b5b3-e958b460a884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:07.488698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220745a-e560-4d3e-b5b3-e958b460a884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:07.489426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220745a-e560-4d3e-b5b3-e958b460a884 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:07.489426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220745a-e560-4d3e-b5b3-e958b460a884 admin admin] PATH_INFO: `/v3/projects/acc6c23a959246638169178d6a5acd4c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:07.491309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220745a-e560-4d3e-b5b3-e958b460a884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acc6c23a959246638169178d6a5acd4c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:07.498551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220745a-e560-4d3e-b5b3-e958b460a884 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:07.605061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:07.629427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1220745a-e560-4d3e-b5b3-e958b460a884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acc6c23a959246638169178d6a5acd4c', 'request_id': 'req-1220745a-e560-4d3e-b5b3-e958b460a884'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:07.646467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1220745a-e560-4d3e-b5b3-e958b460a884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acc6c23a959246638169178d6a5acd4c', 'request_id': 'req-1220745a-e560-4d3e-b5b3-e958b460a884'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:07.663237 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2627/5289] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:07.680442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1220745a-e560-4d3e-b5b3-e958b460a884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acc6c23a959246638169178d6a5acd4c', 'request_id': 'req-1220745a-e560-4d3e-b5b3-e958b460a884'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:07.681189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d223d-20bf-462b-8600-8979cefbb942 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:07.683459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3e0d223d-20bf-462b-8600-8979cefbb942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:07.712767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1220745a-e560-4d3e-b5b3-e958b460a884 admin admin] The token cache is being invalidate because project acc6c23a959246638169178d6a5acd4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:07.714748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1220745a-e560-4d3e-b5b3-e958b460a884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:07.716644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1220745a-e560-4d3e-b5b3-e958b460a884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:07.728733 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2663/5290] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:07 2022] DELETE /identity/v3/projects/acc6c23a959246638169178d6a5acd4c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:07.730541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4b1b7-8a07-43ec-af89-c68b79cd2b0a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:07.730841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4b1b7-8a07-43ec-af89-c68b79cd2b0a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:07.731127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4b1b7-8a07-43ec-af89-c68b79cd2b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:07.764290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:07.769172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d8e4b1b7-8a07-43ec-af89-c68b79cd2b0a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:07.771424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d8e4b1b7-8a07-43ec-af89-c68b79cd2b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:07.804901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d223d-20bf-462b-8600-8979cefbb942 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:07.908822 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2664/5291] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:20:07.916757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb8950-0abb-4205-87e0-68ce577dce68 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:07.917054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb8950-0abb-4205-87e0-68ce577dce68 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:07.917341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb8950-0abb-4205-87e0-68ce577dce68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:07.925876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db242fa-ba9f-49d4-8ff7-89ddcdd6c9ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:07.929326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db242fa-ba9f-49d4-8ff7-89ddcdd6c9ef service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:07.929986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db242fa-ba9f-49d4-8ff7-89ddcdd6c9ef service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:07.939416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db242fa-ba9f-49d4-8ff7-89ddcdd6c9ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:07.948147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4db242fa-ba9f-49d4-8ff7-89ddcdd6c9ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:07.951728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c4fb8950-0abb-4205-87e0-68ce577dce68 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:07.953170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c4fb8950-0abb-4205-87e0-68ce577dce68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:07.970181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db242fa-ba9f-49d4-8ff7-89ddcdd6c9ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:07.971512 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2665/5292] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:20:07.976586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb8950-0abb-4205-87e0-68ce577dce68 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:07.977376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db242fa-ba9f-49d4-8ff7-89ddcdd6c9ef service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:07.991377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb8950-0abb-4205-87e0-68ce577dce68 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:07.997128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717045b-ce25-4f78-a86d-64c6b08d838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:07.999570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717045b-ce25-4f78-a86d-64c6b08d838c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:07.999570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717045b-ce25-4f78-a86d-64c6b08d838c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:07.999570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717045b-ce25-4f78-a86d-64c6b08d838c admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:07.999570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717045b-ce25-4f78-a86d-64c6b08d838c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:20:07.999570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717045b-ce25-4f78-a86d-64c6b08d838c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:08.001649 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2628/5293] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:08.001783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717045b-ce25-4f78-a86d-64c6b08d838c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:08.037827 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2666/5294] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:20:08.040170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db242fa-ba9f-49d4-8ff7-89ddcdd6c9ef service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:08.066598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db242fa-ba9f-49d4-8ff7-89ddcdd6c9ef service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:08.084272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d5d9d-d36e-4aef-bec7-738c91062a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:08.084919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d5d9d-d36e-4aef-bec7-738c91062a20 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:08.085199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d5d9d-d36e-4aef-bec7-738c91062a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:08.086097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d5d9d-d36e-4aef-bec7-738c91062a20 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:08.086786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d5d9d-d36e-4aef-bec7-738c91062a20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:08.090229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d5d9d-d36e-4aef-bec7-738c91062a20 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:08.147365 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2629/5295] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:08 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:08.152758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717045b-ce25-4f78-a86d-64c6b08d838c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:08.167317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717045b-ce25-4f78-a86d-64c6b08d838c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:08.257093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d5d9d-d36e-4aef-bec7-738c91062a20 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:08.259387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2c0d5d9d-d36e-4aef-bec7-738c91062a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:08.332881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8aac7-d027-4fce-9521-4b4a3156fe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:08.334057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8aac7-d027-4fce-9521-4b4a3156fe6f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:08.334354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8aac7-d027-4fce-9521-4b4a3156fe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:08.336769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8aac7-d027-4fce-9521-4b4a3156fe6f admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:08.337479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8aac7-d027-4fce-9521-4b4a3156fe6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:08.339770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8aac7-d027-4fce-9521-4b4a3156fe6f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:08.395771 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2667/5296] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:08 2022] POST /identity/v3/users => generated 286 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:20:08.401575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8aac7-d027-4fce-9521-4b4a3156fe6f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:08.437214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8aac7-d027-4fce-9521-4b4a3156fe6f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:08.455118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5ecee-2654-4b36-916a-b5f1d782163b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:08.456147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5ecee-2654-4b36-916a-b5f1d782163b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:08.456708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5ecee-2654-4b36-916a-b5f1d782163b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:08.458115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5ecee-2654-4b36-916a-b5f1d782163b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:08.459990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5ecee-2654-4b36-916a-b5f1d782163b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:08.462020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5ecee-2654-4b36-916a-b5f1d782163b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:08.472306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d5d9d-d36e-4aef-bec7-738c91062a20 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:08.488029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239bf27-0dba-48b9-86da-7fe9b78c88b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:08.490045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239bf27-0dba-48b9-86da-7fe9b78c88b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:08.491607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239bf27-0dba-48b9-86da-7fe9b78c88b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:08.492257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239bf27-0dba-48b9-86da-7fe9b78c88b3 admin admin] PATH_INFO: `/v3/projects/dd62e2bc29dd427495fa6947b61122e6` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:08.494926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239bf27-0dba-48b9-86da-7fe9b78c88b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd62e2bc29dd427495fa6947b61122e6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:08.500709 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2668/5297] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:08.503381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5ecee-2654-4b36-916a-b5f1d782163b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:08.503510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239bf27-0dba-48b9-86da-7fe9b78c88b3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:08.520148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5ecee-2654-4b36-916a-b5f1d782163b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:08.526967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9acb1-a407-45a2-9f11-61b7fc2754a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:08.528071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9acb1-a407-45a2-9f11-61b7fc2754a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:08.528742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9acb1-a407-45a2-9f11-61b7fc2754a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:08.529160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9acb1-a407-45a2-9f11-61b7fc2754a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:08.530076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9acb1-a407-45a2-9f11-61b7fc2754a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:08.533016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9acb1-a407-45a2-9f11-61b7fc2754a7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:08.556493 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2669/5298] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:08.558218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9acb1-a407-45a2-9f11-61b7fc2754a7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:08.584418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9acb1-a407-45a2-9f11-61b7fc2754a7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:08.617357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d239bf27-0dba-48b9-86da-7fe9b78c88b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd62e2bc29dd427495fa6947b61122e6', 'request_id': 'req-d239bf27-0dba-48b9-86da-7fe9b78c88b3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:08.617787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:08.653545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d239bf27-0dba-48b9-86da-7fe9b78c88b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd62e2bc29dd427495fa6947b61122e6', 'request_id': 'req-d239bf27-0dba-48b9-86da-7fe9b78c88b3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:08.666491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d239bf27-0dba-48b9-86da-7fe9b78c88b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd62e2bc29dd427495fa6947b61122e6', 'request_id': 'req-d239bf27-0dba-48b9-86da-7fe9b78c88b3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:08.691182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:08.709524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d239bf27-0dba-48b9-86da-7fe9b78c88b3 admin admin] The token cache is being invalidate because project dd62e2bc29dd427495fa6947b61122e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:08.710090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d239bf27-0dba-48b9-86da-7fe9b78c88b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:08.712409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d239bf27-0dba-48b9-86da-7fe9b78c88b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:08.714645 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2630/5299] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:08 2022] DELETE /identity/v3/projects/dd62e2bc29dd427495fa6947b61122e6 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:08.720120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7f5f0-77e8-452b-a64d-e852dea8a8a4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:08.722188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7f5f0-77e8-452b-a64d-e852dea8a8a4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:08.722678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7f5f0-77e8-452b-a64d-e852dea8a8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:08.739772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f4350-ac51-4041-b501-94faf6c2aade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:08.740539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f4350-ac51-4041-b501-94faf6c2aade admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:08.741748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f4350-ac51-4041-b501-94faf6c2aade admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:08.743341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f4350-ac51-4041-b501-94faf6c2aade admin admin] PATH_INFO: `/v3/projects/e51697dcd2494de8b5490f69ff651744/users/7e4674f50d704f93a4c488a7c83056bb/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:08.758100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2dd7f5f0-77e8-452b-a64d-e852dea8a8a4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:08.759796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2dd7f5f0-77e8-452b-a64d-e852dea8a8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:08.769957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f4350-ac51-4041-b501-94faf6c2aade admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51697dcd2494de8b5490f69ff651744, user_id=7e4674f50d704f93a4c488a7c83056bb, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:08.770266 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2631/5300] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:08.771281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7f5f0-77e8-452b-a64d-e852dea8a8a4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:08.773144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2dd7f5f0-77e8-452b-a64d-e852dea8a8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:08.774495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f4350-ac51-4041-b501-94faf6c2aade admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:08.796103 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2670/5301] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:08 2022] PUT /identity/v3/projects/e51697dcd2494de8b5490f69ff651744/users/7e4674f50d704f93a4c488a7c83056bb/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:08.811261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594830f0-96bd-48f3-ba23-96b6e4297d18 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:08.811513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594830f0-96bd-48f3-ba23-96b6e4297d18 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:08.811810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594830f0-96bd-48f3-ba23-96b6e4297d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:08.853655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-594830f0-96bd-48f3-ba23-96b6e4297d18 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:08.855181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-594830f0-96bd-48f3-ba23-96b6e4297d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:08.887872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7f5f0-77e8-452b-a64d-e852dea8a8a4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:09.024190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e003b-9297-47f9-9a52-c5724f566e3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:09.024852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e003b-9297-47f9-9a52-c5724f566e3d service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:09.025139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e003b-9297-47f9-9a52-c5724f566e3d service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:09.025459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e003b-9297-47f9-9a52-c5724f566e3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:09.029678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dd1e003b-9297-47f9-9a52-c5724f566e3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:09.061172 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2671/5302] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:09.062561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be526dbd-27ad-4fcb-aab7-03f8402fdbbe None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:09.064125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be526dbd-27ad-4fcb-aab7-03f8402fdbbe None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:09.064617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be526dbd-27ad-4fcb-aab7-03f8402fdbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:09.128850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-be526dbd-27ad-4fcb-aab7-03f8402fdbbe None None] MFA Rules not processed for user `7e4674f50d704f93a4c488a7c83056bb`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:09.131578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-be526dbd-27ad-4fcb-aab7-03f8402fdbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:09.217761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e003b-9297-47f9-9a52-c5724f566e3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:09.219399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e003b-9297-47f9-9a52-c5724f566e3d service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:09.261364 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2632/5303] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:09.262806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e003b-9297-47f9-9a52-c5724f566e3d service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:09.280530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e003b-9297-47f9-9a52-c5724f566e3d service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:09.291465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7eff49-3703-4cc6-a34a-276d2cdaf286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:09.293545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7eff49-3703-4cc6-a34a-276d2cdaf286 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:09.293545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7eff49-3703-4cc6-a34a-276d2cdaf286 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:09.293545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7eff49-3703-4cc6-a34a-276d2cdaf286 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:09.293545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7eff49-3703-4cc6-a34a-276d2cdaf286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:20:09.293966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7eff49-3703-4cc6-a34a-276d2cdaf286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:09.297204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7eff49-3703-4cc6-a34a-276d2cdaf286 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:09.331336 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2672/5304] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:09.331811 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2633/5305] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:09.332670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be526dbd-27ad-4fcb-aab7-03f8402fdbbe None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:09.338886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7eff49-3703-4cc6-a34a-276d2cdaf286 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:09.345475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-be526dbd-27ad-4fcb-aab7-03f8402fdbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:09.378542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7eff49-3703-4cc6-a34a-276d2cdaf286 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:09.395922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff905a-be38-4abd-9878-d4f493078860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:09.397370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff905a-be38-4abd-9878-d4f493078860 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:09.397639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff905a-be38-4abd-9878-d4f493078860 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:09.398344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff905a-be38-4abd-9878-d4f493078860 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:09.398610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff905a-be38-4abd-9878-d4f493078860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:09.400519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be526dbd-27ad-4fcb-aab7-03f8402fdbbe None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:09.403093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff905a-be38-4abd-9878-d4f493078860 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:09.414725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a2b87-0512-4af2-8adb-b6abd32816a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:09.415005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a2b87-0512-4af2-8adb-b6abd32816a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:09.415281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a2b87-0512-4af2-8adb-b6abd32816a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:09.416103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a2b87-0512-4af2-8adb-b6abd32816a6 admin admin] PATH_INFO: `/v3/projects/27de08780b44409bb343b9a468e8d344` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:09.417637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a2b87-0512-4af2-8adb-b6abd32816a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27de08780b44409bb343b9a468e8d344)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:09.419717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a2b87-0512-4af2-8adb-b6abd32816a6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:09.475199 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2634/5306] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:09 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:09.476166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff905a-be38-4abd-9878-d4f493078860 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:09.479166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8fff905a-be38-4abd-9878-d4f493078860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:09.482508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:09.507583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:09.539376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-459a2b87-0512-4af2-8adb-b6abd32816a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27de08780b44409bb343b9a468e8d344', 'request_id': 'req-459a2b87-0512-4af2-8adb-b6abd32816a6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:09.553652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-459a2b87-0512-4af2-8adb-b6abd32816a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27de08780b44409bb343b9a468e8d344', 'request_id': 'req-459a2b87-0512-4af2-8adb-b6abd32816a6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:09.573145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-459a2b87-0512-4af2-8adb-b6abd32816a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27de08780b44409bb343b9a468e8d344', 'request_id': 'req-459a2b87-0512-4af2-8adb-b6abd32816a6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:09.590096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-459a2b87-0512-4af2-8adb-b6abd32816a6 admin admin] The token cache is being invalidate because project 27de08780b44409bb343b9a468e8d344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:09.590436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-459a2b87-0512-4af2-8adb-b6abd32816a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:09.593474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-459a2b87-0512-4af2-8adb-b6abd32816a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:09.596819 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2673/5307] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:09 2022] DELETE /identity/v3/projects/27de08780b44409bb343b9a468e8d344 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:09.597727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a2b87-0512-4af2-8adb-b6abd32816a6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:09.601852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-459a2b87-0512-4af2-8adb-b6abd32816a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:09.654768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff905a-be38-4abd-9878-d4f493078860 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:09.759198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a2b87-0512-4af2-8adb-b6abd32816a6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:09.773526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305929d7-f9ef-4181-8f79-e4ad58636e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:09.774540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305929d7-f9ef-4181-8f79-e4ad58636e7e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:09.776126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305929d7-f9ef-4181-8f79-e4ad58636e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:09.776529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305929d7-f9ef-4181-8f79-e4ad58636e7e admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:09.778119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305929d7-f9ef-4181-8f79-e4ad58636e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:09.787964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305929d7-f9ef-4181-8f79-e4ad58636e7e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:09.840301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80888145-fb2d-4c8c-885c-7e49711a6cdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:09.849355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80888145-fb2d-4c8c-885c-7e49711a6cdd service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:09.850539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80888145-fb2d-4c8c-885c-7e49711a6cdd service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:09.850927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80888145-fb2d-4c8c-885c-7e49711a6cdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:09.853657 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2674/5308] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:09 2022] POST /identity/v3/users => generated 286 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:09.855553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305929d7-f9ef-4181-8f79-e4ad58636e7e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:09.857692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-80888145-fb2d-4c8c-885c-7e49711a6cdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:09.863006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-305929d7-f9ef-4181-8f79-e4ad58636e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:09.896677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305929d7-f9ef-4181-8f79-e4ad58636e7e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:09.919915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d637b-89d2-49d7-a0c9-b4cd80622f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:09.920775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d637b-89d2-49d7-a0c9-b4cd80622f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:09.921171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d637b-89d2-49d7-a0c9-b4cd80622f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:09.921560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d637b-89d2-49d7-a0c9-b4cd80622f7e admin admin] PATH_INFO: `/v3/users/ec8d63ac05e5441a887f5fd367528449` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:09.925692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d637b-89d2-49d7-a0c9-b4cd80622f7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8d63ac05e5441a887f5fd367528449)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:09.927842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d637b-89d2-49d7-a0c9-b4cd80622f7e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:10.009510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80888145-fb2d-4c8c-885c-7e49711a6cdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:10.010396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80888145-fb2d-4c8c-885c-7e49711a6cdd service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:10.035806 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2635/5309] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:10.036841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80888145-fb2d-4c8c-885c-7e49711a6cdd service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:10.044028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-428d637b-89d2-49d7-a0c9-b4cd80622f7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8d63ac05e5441a887f5fd367528449'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:10.068126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-428d637b-89d2-49d7-a0c9-b4cd80622f7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8d63ac05e5441a887f5fd367528449'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:10.069056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-428d637b-89d2-49d7-a0c9-b4cd80622f7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8d63ac05e5441a887f5fd367528449'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:10.081949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-428d637b-89d2-49d7-a0c9-b4cd80622f7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8d63ac05e5441a887f5fd367528449'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:10.082799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80888145-fb2d-4c8c-885c-7e49711a6cdd service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:10.082920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-428d637b-89d2-49d7-a0c9-b4cd80622f7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8d63ac05e5441a887f5fd367528449'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:10.095099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c8153-1ae3-471c-bdd9-f25778a13071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:10.097619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c8153-1ae3-471c-bdd9-f25778a13071 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:10.099513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c8153-1ae3-471c-bdd9-f25778a13071 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:10.100040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c8153-1ae3-471c-bdd9-f25778a13071 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:10.101563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c8153-1ae3-471c-bdd9-f25778a13071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:10.107834 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2675/5310] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:09 2022] DELETE /identity/v3/users/ec8d63ac05e5441a887f5fd367528449 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:10.109694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c8153-1ae3-471c-bdd9-f25778a13071 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:10.136685 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2636/5311] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:10.140517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d637b-89d2-49d7-a0c9-b4cd80622f7e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:10.142116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-428d637b-89d2-49d7-a0c9-b4cd80622f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:10.182280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=17,keystone:SELECT=78,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:10.286837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d637b-89d2-49d7-a0c9-b4cd80622f7e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:10.310619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d58f0d-34e9-429b-a889-6e36de238929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:10.310619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d58f0d-34e9-429b-a889-6e36de238929 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:10.311860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d58f0d-34e9-429b-a889-6e36de238929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:10.312507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d58f0d-34e9-429b-a889-6e36de238929 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:10.316892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d58f0d-34e9-429b-a889-6e36de238929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:10.322655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d58f0d-34e9-429b-a889-6e36de238929 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:10.353361 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2676/5312] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:20:10.358565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c8153-1ae3-471c-bdd9-f25778a13071 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:10.394466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c8153-1ae3-471c-bdd9-f25778a13071 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:10.408054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2564ad6-5ffa-47ad-a44c-5150bb44a9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:10.409289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2564ad6-5ffa-47ad-a44c-5150bb44a9b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:10.409624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2564ad6-5ffa-47ad-a44c-5150bb44a9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:10.410059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2564ad6-5ffa-47ad-a44c-5150bb44a9b7 admin admin] PATH_INFO: `/v3/projects/e06d2a93a41f4f32b63c14b8a8cb0f39/users/2b22b19ec69e44059078b5bb0aaadf1d/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:10.465395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2564ad6-5ffa-47ad-a44c-5150bb44a9b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06d2a93a41f4f32b63c14b8a8cb0f39, user_id=2b22b19ec69e44059078b5bb0aaadf1d, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:10.473427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2564ad6-5ffa-47ad-a44c-5150bb44a9b7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:10.506950 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2637/5313] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:10 2022] PUT /identity/v3/projects/e06d2a93a41f4f32b63c14b8a8cb0f39/users/2b22b19ec69e44059078b5bb0aaadf1d/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:20:10.517534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f90b22-4cae-4bf5-bf1c-650977feb0b5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:10.518668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f90b22-4cae-4bf5-bf1c-650977feb0b5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:10.519335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f90b22-4cae-4bf5-bf1c-650977feb0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:10.598470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-13f90b22-4cae-4bf5-bf1c-650977feb0b5 None None] MFA Rules not processed for user `2b22b19ec69e44059078b5bb0aaadf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:10.599964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-13f90b22-4cae-4bf5-bf1c-650977feb0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:10.805723 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2677/5314] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:10.810684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2564ad6-5ffa-47ad-a44c-5150bb44a9b7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:10.823990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9935918-f1f8-4d5f-a646-1edd51d0b881 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:10.824536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9935918-f1f8-4d5f-a646-1edd51d0b881 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:10.824967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9935918-f1f8-4d5f-a646-1edd51d0b881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:10.837361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:10.863007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b9935918-f1f8-4d5f-a646-1edd51d0b881 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:10.865231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b9935918-f1f8-4d5f-a646-1edd51d0b881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:11.000403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2564ad6-5ffa-47ad-a44c-5150bb44a9b7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:11.012162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80917beb-ae14-4c37-a0fb-ed4f3e221e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:11.012828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80917beb-ae14-4c37-a0fb-ed4f3e221e54 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:11.014518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80917beb-ae14-4c37-a0fb-ed4f3e221e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:11.014640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80917beb-ae14-4c37-a0fb-ed4f3e221e54 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:11.015393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80917beb-ae14-4c37-a0fb-ed4f3e221e54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:11.021792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80917beb-ae14-4c37-a0fb-ed4f3e221e54 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:11.039836 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2678/5315] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:20:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:11.045757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9935918-f1f8-4d5f-a646-1edd51d0b881 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:11.047359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b9935918-f1f8-4d5f-a646-1edd51d0b881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:11.093737 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2638/5316] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:10 2022] POST /identity/v3/projects => generated 371 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:11.098370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80917beb-ae14-4c37-a0fb-ed4f3e221e54 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:11.163507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:11.211426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9935918-f1f8-4d5f-a646-1edd51d0b881 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:11.213306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80917beb-ae14-4c37-a0fb-ed4f3e221e54 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:11.219671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45517c84-561f-4d39-9fdc-8cd51fa8cb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:11.220449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45517c84-561f-4d39-9fdc-8cd51fa8cb96 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:11.221650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45517c84-561f-4d39-9fdc-8cd51fa8cb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:11.221650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45517c84-561f-4d39-9fdc-8cd51fa8cb96 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:11.222134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45517c84-561f-4d39-9fdc-8cd51fa8cb96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:11.224401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45517c84-561f-4d39-9fdc-8cd51fa8cb96 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:11.261496 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2639/5317] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:11 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:20:11.262992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45517c84-561f-4d39-9fdc-8cd51fa8cb96 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:11.285340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45517c84-561f-4d39-9fdc-8cd51fa8cb96 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:11.294377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99295c44-0f66-4dd6-9d38-28e34d96ceea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:11.296103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99295c44-0f66-4dd6-9d38-28e34d96ceea admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:11.296916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99295c44-0f66-4dd6-9d38-28e34d96ceea admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:11.296916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99295c44-0f66-4dd6-9d38-28e34d96ceea admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:11.297582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99295c44-0f66-4dd6-9d38-28e34d96ceea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:11.302170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99295c44-0f66-4dd6-9d38-28e34d96ceea admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:11.323401 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2640/5318] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:11.325747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99295c44-0f66-4dd6-9d38-28e34d96ceea admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:11.350577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99295c44-0f66-4dd6-9d38-28e34d96ceea admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:11.365243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e1b43-a975-4be7-a868-8121bab1d654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:11.366729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e1b43-a975-4be7-a868-8121bab1d654 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:11.367870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e1b43-a975-4be7-a868-8121bab1d654 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:11.368417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e1b43-a975-4be7-a868-8121bab1d654 admin admin] PATH_INFO: `/v3/projects/c37c304b2022435fb290b9f39b0a5a66/users/9088f29d5d304d9ca508dd59bd91593b/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:11.390772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec3203-e96f-4bf5-9851-3b841dba4491 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:11.391713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec3203-e96f-4bf5-9851-3b841dba4491 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:11.392588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec3203-e96f-4bf5-9851-3b841dba4491 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:11.393061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec3203-e96f-4bf5-9851-3b841dba4491 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:11.402787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e1b43-a975-4be7-a868-8121bab1d654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37c304b2022435fb290b9f39b0a5a66, user_id=9088f29d5d304d9ca508dd59bd91593b, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:11.407626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e1b43-a975-4be7-a868-8121bab1d654 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:11.438669 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2641/5319] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:11 2022] PUT /identity/v3/projects/c37c304b2022435fb290b9f39b0a5a66/users/9088f29d5d304d9ca508dd59bd91593b/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:11.438669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e1b43-a975-4be7-a868-8121bab1d654 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:11.447416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-470e1b43-a975-4be7-a868-8121bab1d654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:11.536367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:11.552746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec3203-e96f-4bf5-9851-3b841dba4491 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:11.554304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec3203-e96f-4bf5-9851-3b841dba4491 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:11.595514 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2679/5320] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:20:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:20:11.598153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e1b43-a975-4be7-a868-8121bab1d654 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:11.598911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec3203-e96f-4bf5-9851-3b841dba4491 service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:11.614054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c89893-0c87-4a16-adbb-3a23871839bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:11.615065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c89893-0c87-4a16-adbb-3a23871839bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:11.615671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c89893-0c87-4a16-adbb-3a23871839bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:11.616062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c89893-0c87-4a16-adbb-3a23871839bb admin admin] PATH_INFO: `/v3/projects/8d0ac15a16534d67a4a32fb3b90700ca` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:11.617855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c89893-0c87-4a16-adbb-3a23871839bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d0ac15a16534d67a4a32fb3b90700ca)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:11.620925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c89893-0c87-4a16-adbb-3a23871839bb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:11.629044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec3203-e96f-4bf5-9851-3b841dba4491 service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:11.657663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906c938-3bc4-4967-b1e7-8d2d69122c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:11.658387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906c938-3bc4-4967-b1e7-8d2d69122c1d admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:11.662032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906c938-3bc4-4967-b1e7-8d2d69122c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:11.662411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906c938-3bc4-4967-b1e7-8d2d69122c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:11.664186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906c938-3bc4-4967-b1e7-8d2d69122c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:11.665858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906c938-3bc4-4967-b1e7-8d2d69122c1d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:11.700618 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2680/5321] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:11.707128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906c938-3bc4-4967-b1e7-8d2d69122c1d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:11.738622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906c938-3bc4-4967-b1e7-8d2d69122c1d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:11.755075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045459a-35a5-46d7-94cb-e0146caa8f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:11.758571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045459a-35a5-46d7-94cb-e0146caa8f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:11.759006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045459a-35a5-46d7-94cb-e0146caa8f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:11.759324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045459a-35a5-46d7-94cb-e0146caa8f43 admin admin] PATH_INFO: `/v3/projects/c37c304b2022435fb290b9f39b0a5a66/users/9088f29d5d304d9ca508dd59bd91593b/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:11.765055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045459a-35a5-46d7-94cb-e0146caa8f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37c304b2022435fb290b9f39b0a5a66, user_id=9088f29d5d304d9ca508dd59bd91593b, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:11.772735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045459a-35a5-46d7-94cb-e0146caa8f43 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:11.807129 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2681/5322] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:11 2022] PUT /identity/v3/projects/c37c304b2022435fb290b9f39b0a5a66/users/9088f29d5d304d9ca508dd59bd91593b/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:11.815981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c6c89893-0c87-4a16-adbb-3a23871839bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d0ac15a16534d67a4a32fb3b90700ca', 'request_id': 'req-c6c89893-0c87-4a16-adbb-3a23871839bb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:11.817785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8b229-1f62-4e14-bb72-1ae37b769ad9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:11.821977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8b229-1f62-4e14-bb72-1ae37b769ad9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:11.822382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8b229-1f62-4e14-bb72-1ae37b769ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:11.848747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c6c89893-0c87-4a16-adbb-3a23871839bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d0ac15a16534d67a4a32fb3b90700ca', 'request_id': 'req-c6c89893-0c87-4a16-adbb-3a23871839bb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:11.885233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c6c89893-0c87-4a16-adbb-3a23871839bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d0ac15a16534d67a4a32fb3b90700ca', 'request_id': 'req-c6c89893-0c87-4a16-adbb-3a23871839bb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:11.915412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c6c89893-0c87-4a16-adbb-3a23871839bb admin admin] The token cache is being invalidate because project 8d0ac15a16534d67a4a32fb3b90700ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:11.915634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c6c89893-0c87-4a16-adbb-3a23871839bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:11.918330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c6c89893-0c87-4a16-adbb-3a23871839bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:11.925557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-12f8b229-1f62-4e14-bb72-1ae37b769ad9 None None] MFA Rules not processed for user `9088f29d5d304d9ca508dd59bd91593b`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:11.928523 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2642/5323] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:11 2022] DELETE /identity/v3/projects/8d0ac15a16534d67a4a32fb3b90700ca => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:11.929140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-12f8b229-1f62-4e14-bb72-1ae37b769ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:11.933709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5ceab-a0c5-4ecd-8dc1-bc16e107d9c8 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:11.934351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5ceab-a0c5-4ecd-8dc1-bc16e107d9c8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:11.934913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5ceab-a0c5-4ecd-8dc1-bc16e107d9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:11.972822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5ca5ceab-a0c5-4ecd-8dc1-bc16e107d9c8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:11.975769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5ca5ceab-a0c5-4ecd-8dc1-bc16e107d9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:12.187211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:12.189321 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2643/5324] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:12.198575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773666cb-15f8-4ff2-a8c3-63fdae531244 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:12.199021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773666cb-15f8-4ff2-a8c3-63fdae531244 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:12.199479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773666cb-15f8-4ff2-a8c3-63fdae531244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:12.254878 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2682/5325] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:12.268152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8b229-1f62-4e14-bb72-1ae37b769ad9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:12.274067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-773666cb-15f8-4ff2-a8c3-63fdae531244 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:12.275545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-773666cb-15f8-4ff2-a8c3-63fdae531244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:12.304948 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2644/5326] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:12.309140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773666cb-15f8-4ff2-a8c3-63fdae531244 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:12.311947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8b229-1f62-4e14-bb72-1ae37b769ad9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:12.329694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e850c4-9a98-4dce-8464-dbe7455bb18a tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9088f29d5d304d9ca508dd59bd91593b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37c304b2022435fb290b9f39b0a5a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:12.330344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e850c4-9a98-4dce-8464-dbe7455bb18a tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:12.330667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e850c4-9a98-4dce-8464-dbe7455bb18a tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:12.330946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e850c4-9a98-4dce-8464-dbe7455bb18a tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:12.331660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e850c4-9a98-4dce-8464-dbe7455bb18a tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:12.337222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e850c4-9a98-4dce-8464-dbe7455bb18a tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:12.350338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773666cb-15f8-4ff2-a8c3-63fdae531244 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:12.384054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645c0f8-9dd8-45b5-8a02-6532b6fe4b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:12.385399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645c0f8-9dd8-45b5-8a02-6532b6fe4b34 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:12.386178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645c0f8-9dd8-45b5-8a02-6532b6fe4b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:12.387648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645c0f8-9dd8-45b5-8a02-6532b6fe4b34 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:12.388650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645c0f8-9dd8-45b5-8a02-6532b6fe4b34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:20:12.390376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645c0f8-9dd8-45b5-8a02-6532b6fe4b34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:12.395454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645c0f8-9dd8-45b5-8a02-6532b6fe4b34 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:12.421618 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2645/5327] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:12.423049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645c0f8-9dd8-45b5-8a02-6532b6fe4b34 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:12.426656 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2683/5328] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:12 2022] POST /identity/v3/projects => generated 360 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:12.428028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e850c4-9a98-4dce-8464-dbe7455bb18a tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:12.457177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645c0f8-9dd8-45b5-8a02-6532b6fe4b34 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:12.630486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e850c4-9a98-4dce-8464-dbe7455bb18a tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:12.671674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12056f65-4966-4139-a067-163b9fe209c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:12.673192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12056f65-4966-4139-a067-163b9fe209c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:12.674122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12056f65-4966-4139-a067-163b9fe209c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:12.674853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12056f65-4966-4139-a067-163b9fe209c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:12.676655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12056f65-4966-4139-a067-163b9fe209c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:12.685432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12056f65-4966-4139-a067-163b9fe209c8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:12.753772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7da00d-26e9-47cc-9994-07caf8171d68 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9088f29d5d304d9ca508dd59bd91593b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37c304b2022435fb290b9f39b0a5a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:12.755827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7da00d-26e9-47cc-9994-07caf8171d68 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:12.756396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7da00d-26e9-47cc-9994-07caf8171d68 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:12.757528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7da00d-26e9-47cc-9994-07caf8171d68 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:12.764978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7da00d-26e9-47cc-9994-07caf8171d68 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:12.765386 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2684/5329] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:12 2022] POST /identity/v3/projects => generated 365 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:12.766949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7da00d-26e9-47cc-9994-07caf8171d68 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:12.767499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12056f65-4966-4139-a067-163b9fe209c8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:12.801232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:12.839190 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2646/5330] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:12 2022] POST /identity/v3/users => generated 373 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:12.842693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7da00d-26e9-47cc-9994-07caf8171d68 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:12.869026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7da00d-26e9-47cc-9994-07caf8171d68 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:12.922096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12056f65-4966-4139-a067-163b9fe209c8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:12.931343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba9938-b8c1-47f9-89ec-4f8646a77d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:12.932204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba9938-b8c1-47f9-89ec-4f8646a77d6f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:12.932677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba9938-b8c1-47f9-89ec-4f8646a77d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:12.933360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba9938-b8c1-47f9-89ec-4f8646a77d6f admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:12.934358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba9938-b8c1-47f9-89ec-4f8646a77d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:12.936585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba9938-b8c1-47f9-89ec-4f8646a77d6f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:12.987788 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2685/5331] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:12 2022] POST /identity/v3/users => generated 283 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:12.990999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba9938-b8c1-47f9-89ec-4f8646a77d6f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:13.017567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba9938-b8c1-47f9-89ec-4f8646a77d6f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:13.032381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986a4bf-37ec-4c27-8e0f-0e8e81ce2b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:13.032812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986a4bf-37ec-4c27-8e0f-0e8e81ce2b5d admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:13.033709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986a4bf-37ec-4c27-8e0f-0e8e81ce2b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:13.033709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986a4bf-37ec-4c27-8e0f-0e8e81ce2b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:13.034675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986a4bf-37ec-4c27-8e0f-0e8e81ce2b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:13.042707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986a4bf-37ec-4c27-8e0f-0e8e81ce2b5d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:13.067150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1147bd-424e-4c38-b637-d9c03d1cd9e0 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9088f29d5d304d9ca508dd59bd91593b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37c304b2022435fb290b9f39b0a5a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:13.069371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1147bd-424e-4c38-b637-d9c03d1cd9e0 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:13.070069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1147bd-424e-4c38-b637-d9c03d1cd9e0 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:13.072366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1147bd-424e-4c38-b637-d9c03d1cd9e0 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:13.073455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1147bd-424e-4c38-b637-d9c03d1cd9e0 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:20:13.076292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1147bd-424e-4c38-b637-d9c03d1cd9e0 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:13.080172 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-7b1147bd-424e-4c38-b637-d9c03d1cd9e0 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:20:13.080172 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:20:13.080172 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:20:13.089482 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2686/5332] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:20:13.090502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986a4bf-37ec-4c27-8e0f-0e8e81ce2b5d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:13.092752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1147bd-424e-4c38-b637-d9c03d1cd9e0 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:13.117739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986a4bf-37ec-4c27-8e0f-0e8e81ce2b5d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:13.139321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb4f8a-835f-4063-be81-f9c2c729dd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:13.144145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb4f8a-835f-4063-be81-f9c2c729dd36 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:13.144438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb4f8a-835f-4063-be81-f9c2c729dd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:13.144870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb4f8a-835f-4063-be81-f9c2c729dd36 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:13.145616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb4f8a-835f-4063-be81-f9c2c729dd36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:13.147259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb4f8a-835f-4063-be81-f9c2c729dd36 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:13.178661 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2687/5333] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:13.179688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb4f8a-835f-4063-be81-f9c2c729dd36 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:13.206799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb4f8a-835f-4063-be81-f9c2c729dd36 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:13.219331 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2647/5334] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 30 21:20:12 2022] GET /identity/v3/users?domain_id=default => generated 8299 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:13.223721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1147bd-424e-4c38-b637-d9c03d1cd9e0 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:13.226702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29fcae-4313-4870-a8a9-4efb2f8f22f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:13.227470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29fcae-4313-4870-a8a9-4efb2f8f22f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:13.227826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29fcae-4313-4870-a8a9-4efb2f8f22f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:13.228212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29fcae-4313-4870-a8a9-4efb2f8f22f7 admin admin] PATH_INFO: `/v3/projects/bc58f3ffc7414c7aa53f10f0cc00522a/users/941f28063b584263bc5557864529e44c/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:13.253529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1147bd-424e-4c38-b637-d9c03d1cd9e0 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:13.260377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29fcae-4313-4870-a8a9-4efb2f8f22f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc58f3ffc7414c7aa53f10f0cc00522a, user_id=941f28063b584263bc5557864529e44c, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:13.263111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29fcae-4313-4870-a8a9-4efb2f8f22f7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:13.270641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:13.272516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f9800-f7b2-407b-a8ba-04723cb4ee7e tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9088f29d5d304d9ca508dd59bd91593b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37c304b2022435fb290b9f39b0a5a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:13.273205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f9800-f7b2-407b-a8ba-04723cb4ee7e tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:13.273540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f9800-f7b2-407b-a8ba-04723cb4ee7e tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:13.273826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f9800-f7b2-407b-a8ba-04723cb4ee7e tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] PATH_INFO: `/v3/users/f5124304e84545c687612b6f737a694c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:13.298852 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2688/5335] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:13 2022] PUT /identity/v3/projects/bc58f3ffc7414c7aa53f10f0cc00522a/users/941f28063b584263bc5557864529e44c/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:13.312550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f89d9-733b-4f38-b9fd-dec31463dfc5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:13.313042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f89d9-733b-4f38-b9fd-dec31463dfc5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:13.313546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f89d9-733b-4f38-b9fd-dec31463dfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:13.317351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f9800-f7b2-407b-a8ba-04723cb4ee7e tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: Authorizing `identity:update_user(user_id=f5124304e84545c687612b6f737a694c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:13.332018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f9800-f7b2-407b-a8ba-04723cb4ee7e tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:13.374222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c08f89d9-733b-4f38-b9fd-dec31463dfc5 None None] MFA Rules not processed for user `941f28063b584263bc5557864529e44c`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:13.376316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c08f89d9-733b-4f38-b9fd-dec31463dfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:13.442505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-207f9800-f7b2-407b-a8ba-04723cb4ee7e tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f5124304e84545c687612b6f737a694c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:13.472595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-207f9800-f7b2-407b-a8ba-04723cb4ee7e tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Invalidating the token cache because user f5124304e84545c687612b6f737a694c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:13.472851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-207f9800-f7b2-407b-a8ba-04723cb4ee7e tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:13.473678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-207f9800-f7b2-407b-a8ba-04723cb4ee7e tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:13.477772 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2648/5336] 10.222.0.17 () {60 vars in 1244 bytes} [Sat Jul 30 21:20:13 2022] PATCH /identity/v3/users/f5124304e84545c687612b6f737a694c => generated 488 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:13.488812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f75b3-8d38-4429-aa71-02822fc88ec0 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:13.489158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f75b3-8d38-4429-aa71-02822fc88ec0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:13.489517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f75b3-8d38-4429-aa71-02822fc88ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:13.526577 ncdv-master-1 devstack@keystone.service[91086]: WARNING keystone.auth.plugins.core [None req-c54f75b3-8d38-4429-aa71-02822fc88ec0 None None] User is disabled: f5124304e84545c687612b6f737a694c: AssertionError: User is disabled: f5124304e84545c687612b6f737a694c Jul 30 21:20:13.542832 ncdv-master-1 devstack@keystone.service[91086]: WARNING keystone.server.flask.application [None req-c54f75b3-8d38-4429-aa71-02822fc88ec0 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.17: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 30 21:20:13.548543 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2649/5337] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:13 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 62 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 30 21:20:13.550361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f75b3-8d38-4429-aa71-02822fc88ec0 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:13.555198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c54f75b3-8d38-4429-aa71-02822fc88ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:13.562437 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2689/5338] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:13.563712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f89d9-733b-4f38-b9fd-dec31463dfc5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:13.570309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c08f89d9-733b-4f38-b9fd-dec31463dfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:13.758925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f75b3-8d38-4429-aa71-02822fc88ec0 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:13.770526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5616e38-67bb-4078-9594-e60ee95d245d tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9088f29d5d304d9ca508dd59bd91593b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37c304b2022435fb290b9f39b0a5a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:13.771469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5616e38-67bb-4078-9594-e60ee95d245d tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:13.771592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5616e38-67bb-4078-9594-e60ee95d245d tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:13.771901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5616e38-67bb-4078-9594-e60ee95d245d tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] PATH_INFO: `/v3/users/f5124304e84545c687612b6f737a694c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:13.802152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f89d9-733b-4f38-b9fd-dec31463dfc5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:13.809862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5616e38-67bb-4078-9594-e60ee95d245d tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f5124304e84545c687612b6f737a694c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:13.812262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5616e38-67bb-4078-9594-e60ee95d245d tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:13.825460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53642fc3-fd3d-4f23-9c26-83a21f9a25a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:13.828554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53642fc3-fd3d-4f23-9c26-83a21f9a25a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:13.829750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53642fc3-fd3d-4f23-9c26-83a21f9a25a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:13.833247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53642fc3-fd3d-4f23-9c26-83a21f9a25a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:13.836530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53642fc3-fd3d-4f23-9c26-83a21f9a25a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:13.843448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53642fc3-fd3d-4f23-9c26-83a21f9a25a1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:13.916473 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2690/5339] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:13 2022] POST /identity/v3/projects => generated 367 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:13.920571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53642fc3-fd3d-4f23-9c26-83a21f9a25a1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:13.966155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:14.026144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c5616e38-67bb-4078-9594-e60ee95d245d tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5124304e84545c687612b6f737a694c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:14.030212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c5616e38-67bb-4078-9594-e60ee95d245d tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5124304e84545c687612b6f737a694c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:14.074774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c5616e38-67bb-4078-9594-e60ee95d245d tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5124304e84545c687612b6f737a694c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:14.076480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c5616e38-67bb-4078-9594-e60ee95d245d tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5124304e84545c687612b6f737a694c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:14.097300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c5616e38-67bb-4078-9594-e60ee95d245d tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5124304e84545c687612b6f737a694c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:14.103652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53642fc3-fd3d-4f23-9c26-83a21f9a25a1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:14.125878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eeae8-39d8-4d82-8b61-0d07e47fe21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:14.126977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eeae8-39d8-4d82-8b61-0d07e47fe21c admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:14.127671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eeae8-39d8-4d82-8b61-0d07e47fe21c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:14.128580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eeae8-39d8-4d82-8b61-0d07e47fe21c admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:14.128800 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2650/5340] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:13 2022] DELETE /identity/v3/users/f5124304e84545c687612b6f737a694c => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:14.129903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61eeae8-39d8-4d82-8b61-0d07e47fe21c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:14.131305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5616e38-67bb-4078-9594-e60ee95d245d tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:14.135609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61eeae8-39d8-4d82-8b61-0d07e47fe21c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:14.136181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c5616e38-67bb-4078-9594-e60ee95d245d tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:14.185045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:14.215487 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2691/5341] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:13 2022] POST /identity/v3/users => generated 290 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:14.217519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eeae8-39d8-4d82-8b61-0d07e47fe21c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:14.224177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c61eeae8-39d8-4d82-8b61-0d07e47fe21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:14.264958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eeae8-39d8-4d82-8b61-0d07e47fe21c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:14.337143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5616e38-67bb-4078-9594-e60ee95d245d tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:14.347719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4e8e1-7cce-4322-b4dd-690259d3a901 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9088f29d5d304d9ca508dd59bd91593b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37c304b2022435fb290b9f39b0a5a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:14.348744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4e8e1-7cce-4322-b4dd-690259d3a901 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:14.349186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4e8e1-7cce-4322-b4dd-690259d3a901 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:14.349791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4e8e1-7cce-4322-b4dd-690259d3a901 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] PATH_INFO: `/v3/projects/77ab7d4529534570a6bbbe00752773f1` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:14.351037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4e8e1-7cce-4322-b4dd-690259d3a901 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: Authorizing `identity:delete_project(project_id=77ab7d4529534570a6bbbe00752773f1)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:14.353425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4e8e1-7cce-4322-b4dd-690259d3a901 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:14.399898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfd185-6f40-48eb-8754-409963ff4888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:14.400587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfd185-6f40-48eb-8754-409963ff4888 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:14.400874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfd185-6f40-48eb-8754-409963ff4888 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:14.401154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfd185-6f40-48eb-8754-409963ff4888 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:14.410110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfd185-6f40-48eb-8754-409963ff4888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:14.412435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfd185-6f40-48eb-8754-409963ff4888 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:14.434388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75f4e8e1-7cce-4322-b4dd-690259d3a901 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ab7d4529534570a6bbbe00752773f1', 'request_id': 'req-75f4e8e1-7cce-4322-b4dd-690259d3a901'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:14.450161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75f4e8e1-7cce-4322-b4dd-690259d3a901 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ab7d4529534570a6bbbe00752773f1', 'request_id': 'req-75f4e8e1-7cce-4322-b4dd-690259d3a901'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:14.462093 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2692/5342] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:14.462972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75f4e8e1-7cce-4322-b4dd-690259d3a901 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ab7d4529534570a6bbbe00752773f1', 'request_id': 'req-75f4e8e1-7cce-4322-b4dd-690259d3a901'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:14.469928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfd185-6f40-48eb-8754-409963ff4888 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:14.499171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75f4e8e1-7cce-4322-b4dd-690259d3a901 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] The token cache is being invalidate because project 77ab7d4529534570a6bbbe00752773f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:14.499572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75f4e8e1-7cce-4322-b4dd-690259d3a901 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:14.500288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfd185-6f40-48eb-8754-409963ff4888 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:14.502801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75f4e8e1-7cce-4322-b4dd-690259d3a901 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:14.511198 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2651/5343] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:14 2022] DELETE /identity/v3/projects/77ab7d4529534570a6bbbe00752773f1 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:14.516767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4e8e1-7cce-4322-b4dd-690259d3a901 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:14.521397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-75f4e8e1-7cce-4322-b4dd-690259d3a901 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:14.644591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450dd20-f5ce-47da-9270-770f5204f6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:14.645916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450dd20-f5ce-47da-9270-770f5204f6cc admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:14.648099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450dd20-f5ce-47da-9270-770f5204f6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:14.651487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450dd20-f5ce-47da-9270-770f5204f6cc admin admin] PATH_INFO: `/v3/projects/949efa2215b34642aec9acf6553c2d52/users/76bd43d0a4224b57a1ebec981e232eaf/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:14.668009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:14.710270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450dd20-f5ce-47da-9270-770f5204f6cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=949efa2215b34642aec9acf6553c2d52, user_id=76bd43d0a4224b57a1ebec981e232eaf, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:14.712444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4e8e1-7cce-4322-b4dd-690259d3a901 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:14.718029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450dd20-f5ce-47da-9270-770f5204f6cc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:14.719861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8f7c6-1755-4a92-8470-349ba0ba34a1 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9088f29d5d304d9ca508dd59bd91593b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37c304b2022435fb290b9f39b0a5a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:14.720645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8f7c6-1755-4a92-8470-349ba0ba34a1 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:14.720977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8f7c6-1755-4a92-8470-349ba0ba34a1 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:14.721360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8f7c6-1755-4a92-8470-349ba0ba34a1 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:14.723038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8f7c6-1755-4a92-8470-349ba0ba34a1 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:14.727354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8f7c6-1755-4a92-8470-349ba0ba34a1 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:14.746641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-cbc8f7c6-1755-4a92-8470-349ba0ba34a1 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Could not find domain: bb36952e701543198c662e194632d21e.: keystone.exception.DomainNotFound: Could not find domain: bb36952e701543198c662e194632d21e. Jul 30 21:20:14.746641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:20:14.746641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 30 21:20:14.746641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 30 21:20:14.746641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 21:20:14.746641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 21:20:14.746641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 21:20:14.746641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 21:20:14.746641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: bb36952e701543198c662e194632d21e. Jul 30 21:20:14.746641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:20:14.746641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:20:14.746641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:20:14.746641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:20:14.746641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:20:14.746641 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:20:14.748303 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:20:14.748303 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:20:14.748303 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:20:14.748303 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:20:14.748303 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:20:14.748303 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:20:14.748303 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:20:14.748303 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:20:14.748303 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 30 21:20:14.748303 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 30 21:20:14.748303 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:20:14.748303 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:20:14.748303 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 21:20:14.748303 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 21:20:14.748303 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 21:20:14.748303 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 21:20:14.748303 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Jul 30 21:20:14.749670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Jul 30 21:20:14.749670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:20:14.749670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:20:14.749670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:20:14.749670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:20:14.749670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:20:14.749670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:20:14.749670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:20:14.749670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 21:20:14.749670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:20:14.749670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:20:14.749670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:20:14.749670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:20:14.749670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:20:14.749670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:20:14.749670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:20:14.749670 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:20:14.751017 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 30 21:20:14.751017 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 21:20:14.751017 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: bb36952e701543198c662e194632d21e. Jul 30 21:20:14.751017 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:20:14.753878 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2652/5344] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:14 2022] POST /identity/v3/users => generated 112 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:20:14.754843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8f7c6-1755-4a92-8470-349ba0ba34a1 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:14.760950 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2693/5345] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:14 2022] PUT /identity/v3/projects/949efa2215b34642aec9acf6553c2d52/users/76bd43d0a4224b57a1ebec981e232eaf/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:14.762339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450dd20-f5ce-47da-9270-770f5204f6cc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:14.766056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b450dd20-f5ce-47da-9270-770f5204f6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:14.768007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cbc8f7c6-1755-4a92-8470-349ba0ba34a1 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:14.805981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8f7c6-1755-4a92-8470-349ba0ba34a1 tempest-UsersNegativeTest-2017634997 tempest-UsersNegativeTest-2017634997-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:14.964375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450dd20-f5ce-47da-9270-770f5204f6cc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:14.979164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde6665-b783-458b-9cb9-b134f7310b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:14.991262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde6665-b783-458b-9cb9-b134f7310b22 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:14.993259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde6665-b783-458b-9cb9-b134f7310b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:15.004110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde6665-b783-458b-9cb9-b134f7310b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:15.009391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde6665-b783-458b-9cb9-b134f7310b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:15.011057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde6665-b783-458b-9cb9-b134f7310b22 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:15.050440 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2694/5346] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:15.051661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde6665-b783-458b-9cb9-b134f7310b22 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:15.055713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add74b9-040c-4d8e-abb7-6ca2e2d85a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:15.057436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add74b9-040c-4d8e-abb7-6ca2e2d85a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:15.059430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add74b9-040c-4d8e-abb7-6ca2e2d85a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:15.060539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add74b9-040c-4d8e-abb7-6ca2e2d85a42 admin admin] PATH_INFO: `/v3/users/2b22b19ec69e44059078b5bb0aaadf1d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:15.064227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bbde6665-b783-458b-9cb9-b134f7310b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:15.066802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add74b9-040c-4d8e-abb7-6ca2e2d85a42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b22b19ec69e44059078b5bb0aaadf1d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:15.070025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add74b9-040c-4d8e-abb7-6ca2e2d85a42 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:15.089415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde6665-b783-458b-9cb9-b134f7310b22 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:15.099230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d2b15-fa0e-4a7b-9aaf-a51017d54117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:15.100059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d2b15-fa0e-4a7b-9aaf-a51017d54117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:15.100331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d2b15-fa0e-4a7b-9aaf-a51017d54117 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:15.100601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d2b15-fa0e-4a7b-9aaf-a51017d54117 admin admin] PATH_INFO: `/v3/users/7e4674f50d704f93a4c488a7c83056bb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:15.109448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d2b15-fa0e-4a7b-9aaf-a51017d54117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e4674f50d704f93a4c488a7c83056bb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:15.111475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d2b15-fa0e-4a7b-9aaf-a51017d54117 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:15.129233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:15.216330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5add74b9-040c-4d8e-abb7-6ca2e2d85a42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b22b19ec69e44059078b5bb0aaadf1d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:15.218997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4b7d2b15-fa0e-4a7b-9aaf-a51017d54117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e4674f50d704f93a4c488a7c83056bb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:15.219405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5add74b9-040c-4d8e-abb7-6ca2e2d85a42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b22b19ec69e44059078b5bb0aaadf1d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:15.235896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5add74b9-040c-4d8e-abb7-6ca2e2d85a42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b22b19ec69e44059078b5bb0aaadf1d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:15.237444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5add74b9-040c-4d8e-abb7-6ca2e2d85a42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b22b19ec69e44059078b5bb0aaadf1d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:15.241697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4b7d2b15-fa0e-4a7b-9aaf-a51017d54117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e4674f50d704f93a4c488a7c83056bb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:15.242538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4b7d2b15-fa0e-4a7b-9aaf-a51017d54117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e4674f50d704f93a4c488a7c83056bb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:15.259429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4b7d2b15-fa0e-4a7b-9aaf-a51017d54117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e4674f50d704f93a4c488a7c83056bb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:15.260140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4b7d2b15-fa0e-4a7b-9aaf-a51017d54117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e4674f50d704f93a4c488a7c83056bb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:15.277559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5add74b9-040c-4d8e-abb7-6ca2e2d85a42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b22b19ec69e44059078b5bb0aaadf1d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:15.292852 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2695/5347] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:15 2022] DELETE /identity/v3/users/7e4674f50d704f93a4c488a7c83056bb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:15.296024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d2b15-fa0e-4a7b-9aaf-a51017d54117 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:15.298386 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2653/5348] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:14 2022] DELETE /identity/v3/users/2b22b19ec69e44059078b5bb0aaadf1d => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:15.299844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4b7d2b15-fa0e-4a7b-9aaf-a51017d54117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:15.301084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561540fe-8c82-4349-b6b3-417c0dceab2e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:15.301367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561540fe-8c82-4349-b6b3-417c0dceab2e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:15.301892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561540fe-8c82-4349-b6b3-417c0dceab2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:15.329667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-561540fe-8c82-4349-b6b3-417c0dceab2e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:15.338336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-561540fe-8c82-4349-b6b3-417c0dceab2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:15.453723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d2b15-fa0e-4a7b-9aaf-a51017d54117 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:15.467098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:15.502561 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2654/5349] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:15.510284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca55f6-8921-4f54-9c2b-4c2107159a38 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:15.511506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca55f6-8921-4f54-9c2b-4c2107159a38 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:15.511506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca55f6-8921-4f54-9c2b-4c2107159a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:15.567443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09f73d-0efc-430b-9492-42914a589d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:15.570690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09f73d-0efc-430b-9492-42914a589d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:15.571084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09f73d-0efc-430b-9492-42914a589d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:15.571524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09f73d-0efc-430b-9492-42914a589d17 admin admin] PATH_INFO: `/v3/projects/949efa2215b34642aec9acf6553c2d52/users/76bd43d0a4224b57a1ebec981e232eaf/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:15.574820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09f73d-0efc-430b-9492-42914a589d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=949efa2215b34642aec9acf6553c2d52, user_id=76bd43d0a4224b57a1ebec981e232eaf, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:15.577999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09f73d-0efc-430b-9492-42914a589d17 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:15.601755 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2696/5350] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:15 2022] PUT /identity/v3/projects/949efa2215b34642aec9acf6553c2d52/users/76bd43d0a4224b57a1ebec981e232eaf/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:15.603000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09f73d-0efc-430b-9492-42914a589d17 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:15.606398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-af09f73d-0efc-430b-9492-42914a589d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:15.618468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-30ca55f6-8921-4f54-9c2b-4c2107159a38 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:15.619962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-30ca55f6-8921-4f54-9c2b-4c2107159a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:15.670235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:15.742021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09f73d-0efc-430b-9492-42914a589d17 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:15.749590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcfc60-2051-4cf7-8365-c5a9e31ae67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:15.751060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcfc60-2051-4cf7-8365-c5a9e31ae67d service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:15.751429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcfc60-2051-4cf7-8365-c5a9e31ae67d service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:15.751960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcfc60-2051-4cf7-8365-c5a9e31ae67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:15.770747 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2655/5351] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:15.801453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6a4b2-7e6a-4523-ba9f-8ef4f6fbff28 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:15.801957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6a4b2-7e6a-4523-ba9f-8ef4f6fbff28 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:15.802427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6a4b2-7e6a-4523-ba9f-8ef4f6fbff28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:15.828422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcfc60-2051-4cf7-8365-c5a9e31ae67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:15.829977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcfc60-2051-4cf7-8365-c5a9e31ae67d service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:15.847348 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2697/5352] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:15.848244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcfc60-2051-4cf7-8365-c5a9e31ae67d service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:15.862762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d4e6a4b2-7e6a-4523-ba9f-8ef4f6fbff28 None None] MFA Rules not processed for user `76bd43d0a4224b57a1ebec981e232eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:15.865307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcfc60-2051-4cf7-8365-c5a9e31ae67d service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:15.868763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d4e6a4b2-7e6a-4523-ba9f-8ef4f6fbff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:15.870544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8046c-7bce-4f6f-8f19-8db60547f8f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:15.871191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8046c-7bce-4f6f-8f19-8db60547f8f4 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:15.871563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8046c-7bce-4f6f-8f19-8db60547f8f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:15.871847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8046c-7bce-4f6f-8f19-8db60547f8f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:15.891041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8046c-7bce-4f6f-8f19-8db60547f8f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:15.893460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8046c-7bce-4f6f-8f19-8db60547f8f4 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:15.911733 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2698/5353] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:16.058562 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2656/5354] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:15 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:16.059842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8046c-7bce-4f6f-8f19-8db60547f8f4 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:16.084371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8046c-7bce-4f6f-8f19-8db60547f8f4 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:16.112760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385dff5-8a94-450b-bc46-e02e80634b08 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76bd43d0a4224b57a1ebec981e232eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '949efa2215b34642aec9acf6553c2d52', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:16.116321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385dff5-8a94-450b-bc46-e02e80634b08 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:16.117472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385dff5-8a94-450b-bc46-e02e80634b08 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:16.117974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385dff5-8a94-450b-bc46-e02e80634b08 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] PATH_INFO: `/v3/regions` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:16.121573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385dff5-8a94-450b-bc46-e02e80634b08 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:16.125884 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-e385dff5-8a94-450b-bc46-e02e80634b08 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:20:16.125884 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:20:16.125884 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:20:16.139131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385dff5-8a94-450b-bc46-e02e80634b08 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:16.217241 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2699/5355] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:20:16 2022] POST /identity/v3/regions => generated 224 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:16.223575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6a4b2-7e6a-4523-ba9f-8ef4f6fbff28 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:16.241647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6a4b2-7e6a-4523-ba9f-8ef4f6fbff28 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:16.336586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934aaef-89fa-4532-9f23-ea82e2ed5005 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76bd43d0a4224b57a1ebec981e232eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '949efa2215b34642aec9acf6553c2d52', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:16.340311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934aaef-89fa-4532-9f23-ea82e2ed5005 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:16.341530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934aaef-89fa-4532-9f23-ea82e2ed5005 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:16.344860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934aaef-89fa-4532-9f23-ea82e2ed5005 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] PATH_INFO: `/v3/regions` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:16.348927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934aaef-89fa-4532-9f23-ea82e2ed5005 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:16.354267 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-2934aaef-89fa-4532-9f23-ea82e2ed5005 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:20:16.354267 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:20:16.354267 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:20:16.357163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934aaef-89fa-4532-9f23-ea82e2ed5005 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:16.439049 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2657/5356] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:20:16 2022] POST /identity/v3/regions => generated 224 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:16.439826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385dff5-8a94-450b-bc46-e02e80634b08 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:16.464733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385dff5-8a94-450b-bc46-e02e80634b08 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:16.515117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec0c45-8564-48c8-ae97-2b8ce3c1cabf tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76bd43d0a4224b57a1ebec981e232eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '949efa2215b34642aec9acf6553c2d52', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:16.516196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec0c45-8564-48c8-ae97-2b8ce3c1cabf tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:16.516736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec0c45-8564-48c8-ae97-2b8ce3c1cabf tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:16.517171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec0c45-8564-48c8-ae97-2b8ce3c1cabf tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] PATH_INFO: `/v3/regions/712fc801-a172-49cb-b7d4-f9ae5bbd7da6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:16.518166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec0c45-8564-48c8-ae97-2b8ce3c1cabf tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorizing `identity:create_region(region_id=712fc801-a172-49cb-b7d4-f9ae5bbd7da6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:16.520605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec0c45-8564-48c8-ae97-2b8ce3c1cabf tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:16.576487 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2700/5357] 10.222.0.17 () {60 vars in 1259 bytes} [Sat Jul 30 21:20:16 2022] PUT /identity/v3/regions/712fc801-a172-49cb-b7d4-f9ae5bbd7da6 => generated 232 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:16.580761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934aaef-89fa-4532-9f23-ea82e2ed5005 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:16.606682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934aaef-89fa-4532-9f23-ea82e2ed5005 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:16.680778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec0c45-8564-48c8-ae97-2b8ce3c1cabf tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:16.684277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b6ec0c45-8564-48c8-ae97-2b8ce3c1cabf tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:16.702377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe97fb-26ae-4061-a482-01e01be45b4b tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76bd43d0a4224b57a1ebec981e232eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '949efa2215b34642aec9acf6553c2d52', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:16.712251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe97fb-26ae-4061-a482-01e01be45b4b tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:16.712605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe97fb-26ae-4061-a482-01e01be45b4b tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:16.712892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe97fb-26ae-4061-a482-01e01be45b4b tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] PATH_INFO: `/v3/regions/712fc801-a172-49cb-b7d4-f9ae5bbd7da6` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:16.713566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe97fb-26ae-4061-a482-01e01be45b4b tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorizing `identity:delete_region(region_id=712fc801-a172-49cb-b7d4-f9ae5bbd7da6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:16.722671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe97fb-26ae-4061-a482-01e01be45b4b tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:16.745531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec0c45-8564-48c8-ae97-2b8ce3c1cabf tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:16.758808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad15643-2b8f-4845-b3e7-5328d06c6b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:16.759849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad15643-2b8f-4845-b3e7-5328d06c6b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:16.761950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad15643-2b8f-4845-b3e7-5328d06c6b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:16.762453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad15643-2b8f-4845-b3e7-5328d06c6b98 admin admin] PATH_INFO: `/v3/projects/e51697dcd2494de8b5490f69ff651744` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:16.764671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad15643-2b8f-4845-b3e7-5328d06c6b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e51697dcd2494de8b5490f69ff651744)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:16.773674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad15643-2b8f-4845-b3e7-5328d06c6b98 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:16.831556 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2658/5358] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Jul 30 21:20:16 2022] DELETE /identity/v3/regions/712fc801-a172-49cb-b7d4-f9ae5bbd7da6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:16.831556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe97fb-26ae-4061-a482-01e01be45b4b tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:16.838312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a2fe97fb-26ae-4061-a482-01e01be45b4b tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:16.851780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1ad15643-2b8f-4845-b3e7-5328d06c6b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e51697dcd2494de8b5490f69ff651744', 'request_id': 'req-1ad15643-2b8f-4845-b3e7-5328d06c6b98'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:16.860772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1ad15643-2b8f-4845-b3e7-5328d06c6b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e51697dcd2494de8b5490f69ff651744', 'request_id': 'req-1ad15643-2b8f-4845-b3e7-5328d06c6b98'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:16.888559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1ad15643-2b8f-4845-b3e7-5328d06c6b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e51697dcd2494de8b5490f69ff651744', 'request_id': 'req-1ad15643-2b8f-4845-b3e7-5328d06c6b98'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:16.899534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:16.920986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1ad15643-2b8f-4845-b3e7-5328d06c6b98 admin admin] The token cache is being invalidate because project e51697dcd2494de8b5490f69ff651744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:16.926500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1ad15643-2b8f-4845-b3e7-5328d06c6b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:16.928589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1ad15643-2b8f-4845-b3e7-5328d06c6b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:16.929834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe97fb-26ae-4061-a482-01e01be45b4b tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:16.937022 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2701/5359] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:16 2022] DELETE /identity/v3/projects/e51697dcd2494de8b5490f69ff651744 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:20:16.938097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad15643-2b8f-4845-b3e7-5328d06c6b98 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:16.941401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1ad15643-2b8f-4845-b3e7-5328d06c6b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:16.988035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:17.104722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad15643-2b8f-4845-b3e7-5328d06c6b98 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:17.132389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a961c3-25f8-494d-afe5-f5cde047cb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:17.133326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a961c3-25f8-494d-afe5-f5cde047cb6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:17.133481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a961c3-25f8-494d-afe5-f5cde047cb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:17.133926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a961c3-25f8-494d-afe5-f5cde047cb6b admin admin] PATH_INFO: `/v3/projects/e06d2a93a41f4f32b63c14b8a8cb0f39` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:17.135968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a961c3-25f8-494d-afe5-f5cde047cb6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e06d2a93a41f4f32b63c14b8a8cb0f39)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:17.138804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a961c3-25f8-494d-afe5-f5cde047cb6b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:17.149730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afca2f1-7c9c-4450-b7ca-23c4bdcd8504 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76bd43d0a4224b57a1ebec981e232eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '949efa2215b34642aec9acf6553c2d52', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:17.150437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afca2f1-7c9c-4450-b7ca-23c4bdcd8504 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:17.150702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afca2f1-7c9c-4450-b7ca-23c4bdcd8504 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:17.150986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afca2f1-7c9c-4450-b7ca-23c4bdcd8504 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] PATH_INFO: `/v3/regions` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:17.154113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afca2f1-7c9c-4450-b7ca-23c4bdcd8504 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:17.156166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afca2f1-7c9c-4450-b7ca-23c4bdcd8504 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:17.192040 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2702/5360] 10.222.0.17 () {60 vars in 1150 bytes} [Sat Jul 30 21:20:16 2022] POST /identity/v3/regions => generated 254 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:17.193395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f1b8e-d700-404f-964b-5b38f19368df None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:17.193737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f1b8e-d700-404f-964b-5b38f19368df None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:17.194027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f1b8e-d700-404f-964b-5b38f19368df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:17.223089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ac9f1b8e-d700-404f-964b-5b38f19368df None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:17.224531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ac9f1b8e-d700-404f-964b-5b38f19368df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:17.262993 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2703/5361] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:17.264784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f1b8e-d700-404f-964b-5b38f19368df None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:17.298702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f1b8e-d700-404f-964b-5b38f19368df None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:17.300267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-97a961c3-25f8-494d-afe5-f5cde047cb6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e06d2a93a41f4f32b63c14b8a8cb0f39', 'request_id': 'req-97a961c3-25f8-494d-afe5-f5cde047cb6b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:17.319817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-97a961c3-25f8-494d-afe5-f5cde047cb6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e06d2a93a41f4f32b63c14b8a8cb0f39', 'request_id': 'req-97a961c3-25f8-494d-afe5-f5cde047cb6b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:17.336049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-97a961c3-25f8-494d-afe5-f5cde047cb6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e06d2a93a41f4f32b63c14b8a8cb0f39', 'request_id': 'req-97a961c3-25f8-494d-afe5-f5cde047cb6b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:17.364329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-97a961c3-25f8-494d-afe5-f5cde047cb6b admin admin] The token cache is being invalidate because project e06d2a93a41f4f32b63c14b8a8cb0f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:17.364752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-97a961c3-25f8-494d-afe5-f5cde047cb6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:17.365672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-97a961c3-25f8-494d-afe5-f5cde047cb6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:17.370938 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2659/5362] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:16 2022] DELETE /identity/v3/projects/e06d2a93a41f4f32b63c14b8a8cb0f39 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:17.372978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b0abc-98eb-47b5-8ed3-d60463b3545c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:17.373422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b0abc-98eb-47b5-8ed3-d60463b3545c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:17.373567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b0abc-98eb-47b5-8ed3-d60463b3545c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:17.446471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4d9b0abc-98eb-47b5-8ed3-d60463b3545c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:17.447113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9deb47-6a12-4b89-8420-d3256e8fb4a2 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76bd43d0a4224b57a1ebec981e232eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '949efa2215b34642aec9acf6553c2d52', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:17.447870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4d9b0abc-98eb-47b5-8ed3-d60463b3545c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:17.448333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9deb47-6a12-4b89-8420-d3256e8fb4a2 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:17.448743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9deb47-6a12-4b89-8420-d3256e8fb4a2 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:17.449273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9deb47-6a12-4b89-8420-d3256e8fb4a2 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] PATH_INFO: `/v3/regions/650bff549491400e9fb4ae482f31a62c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:17.450172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9deb47-6a12-4b89-8420-d3256e8fb4a2 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorizing `identity:update_region(region_id=650bff549491400e9fb4ae482f31a62c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:17.451348 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-dc9deb47-6a12-4b89-8420-d3256e8fb4a2 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:20:17.451348 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:20:17.451348 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:20:17.454061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9deb47-6a12-4b89-8420-d3256e8fb4a2 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:17.487225 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2704/5363] 10.222.0.17 () {60 vars in 1250 bytes} [Sat Jul 30 21:20:17 2022] PATCH /identity/v3/regions/650bff549491400e9fb4ae482f31a62c => generated 253 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:17.488361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9deb47-6a12-4b89-8420-d3256e8fb4a2 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:17.490432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-dc9deb47-6a12-4b89-8420-d3256e8fb4a2 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:17.588870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:17.621434 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2660/5364] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:17.623109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b0abc-98eb-47b5-8ed3-d60463b3545c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:17.626162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4d9b0abc-98eb-47b5-8ed3-d60463b3545c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:17.681278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9deb47-6a12-4b89-8420-d3256e8fb4a2 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:17.691011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c09e4-d628-4bad-b0bb-776595a5ca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:17.692405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c09e4-d628-4bad-b0bb-776595a5ca04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:17.694454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c09e4-d628-4bad-b0bb-776595a5ca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:17.695016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c09e4-d628-4bad-b0bb-776595a5ca04 admin admin] PATH_INFO: `/v3/users/9088f29d5d304d9ca508dd59bd91593b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:17.696725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c09e4-d628-4bad-b0bb-776595a5ca04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9088f29d5d304d9ca508dd59bd91593b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:17.696910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b0abc-98eb-47b5-8ed3-d60463b3545c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:17.699426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c09e4-d628-4bad-b0bb-776595a5ca04 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:17.717792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f4c66-0e2a-425f-8c46-80b6b035679e tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76bd43d0a4224b57a1ebec981e232eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '949efa2215b34642aec9acf6553c2d52', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:17.718789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f4c66-0e2a-425f-8c46-80b6b035679e tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:17.719088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f4c66-0e2a-425f-8c46-80b6b035679e tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:17.719411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f4c66-0e2a-425f-8c46-80b6b035679e tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] PATH_INFO: `/v3/regions/650bff549491400e9fb4ae482f31a62c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:17.720056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f4c66-0e2a-425f-8c46-80b6b035679e tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorizing `identity:get_region(region_id=650bff549491400e9fb4ae482f31a62c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:17.721672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f4c66-0e2a-425f-8c46-80b6b035679e tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:17.745693 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2661/5365] 10.222.0.17 () {58 vars in 1227 bytes} [Sat Jul 30 21:20:17 2022] GET /identity/v3/regions/650bff549491400e9fb4ae482f31a62c => generated 253 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:17.746782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f4c66-0e2a-425f-8c46-80b6b035679e tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:17.786148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f4c66-0e2a-425f-8c46-80b6b035679e tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:17.797738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe03ab6-4929-476f-81c1-c4c2059fb171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:17.800374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe03ab6-4929-476f-81c1-c4c2059fb171 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:17.800971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe03ab6-4929-476f-81c1-c4c2059fb171 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:17.801844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe03ab6-4929-476f-81c1-c4c2059fb171 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:17.803118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe03ab6-4929-476f-81c1-c4c2059fb171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:20:17.803887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe03ab6-4929-476f-81c1-c4c2059fb171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:17.806797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe03ab6-4929-476f-81c1-c4c2059fb171 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:17.807409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4a2c09e4-d628-4bad-b0bb-776595a5ca04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9088f29d5d304d9ca508dd59bd91593b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:17.838929 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2662/5366] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:17.840651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe03ab6-4929-476f-81c1-c4c2059fb171 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:17.850545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4a2c09e4-d628-4bad-b0bb-776595a5ca04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9088f29d5d304d9ca508dd59bd91593b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:17.852236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4a2c09e4-d628-4bad-b0bb-776595a5ca04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9088f29d5d304d9ca508dd59bd91593b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:17.877107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4a2c09e4-d628-4bad-b0bb-776595a5ca04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9088f29d5d304d9ca508dd59bd91593b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:17.880799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4a2c09e4-d628-4bad-b0bb-776595a5ca04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9088f29d5d304d9ca508dd59bd91593b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:17.893395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe03ab6-4929-476f-81c1-c4c2059fb171 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:17.916116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c429c8-296c-4fa6-a3ee-50f04dee92d1 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76bd43d0a4224b57a1ebec981e232eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '949efa2215b34642aec9acf6553c2d52', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:17.917352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c429c8-296c-4fa6-a3ee-50f04dee92d1 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:17.919142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c429c8-296c-4fa6-a3ee-50f04dee92d1 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:17.920445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c429c8-296c-4fa6-a3ee-50f04dee92d1 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] PATH_INFO: `/v3/regions/650bff549491400e9fb4ae482f31a62c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:17.921480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c429c8-296c-4fa6-a3ee-50f04dee92d1 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorizing `identity:delete_region(region_id=650bff549491400e9fb4ae482f31a62c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:17.922848 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2705/5367] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:17 2022] DELETE /identity/v3/users/9088f29d5d304d9ca508dd59bd91593b => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:17.924412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c09e4-d628-4bad-b0bb-776595a5ca04 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:17.928741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c429c8-296c-4fa6-a3ee-50f04dee92d1 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:17.930636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4a2c09e4-d628-4bad-b0bb-776595a5ca04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:17.938120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:17.975069 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2663/5368] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:20:17 2022] DELETE /identity/v3/regions/650bff549491400e9fb4ae482f31a62c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:17.976079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c429c8-296c-4fa6-a3ee-50f04dee92d1 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:17.981133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b1c429c8-296c-4fa6-a3ee-50f04dee92d1 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:18.068026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c429c8-296c-4fa6-a3ee-50f04dee92d1 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:18.127460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c09e4-d628-4bad-b0bb-776595a5ca04 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:18.147638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be021171-cc21-4576-b3e6-1cb2435a1cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:18.148368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be021171-cc21-4576-b3e6-1cb2435a1cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:18.148708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be021171-cc21-4576-b3e6-1cb2435a1cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:18.149025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be021171-cc21-4576-b3e6-1cb2435a1cd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:18.151813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be021171-cc21-4576-b3e6-1cb2435a1cd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:18.156869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be021171-cc21-4576-b3e6-1cb2435a1cd8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:18.218436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aff018-4261-48ff-96ab-2da31eec4763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:18.220111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aff018-4261-48ff-96ab-2da31eec4763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:18.220401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aff018-4261-48ff-96ab-2da31eec4763 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:18.221058 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2706/5369] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:17 2022] POST /identity/v3/projects => generated 363 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:18.221996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be021171-cc21-4576-b3e6-1cb2435a1cd8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:18.222323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aff018-4261-48ff-96ab-2da31eec4763 admin admin] PATH_INFO: `/v3/users/3ef2a5ef6d7b4a36b2ead7e1e605430c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:18.224212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aff018-4261-48ff-96ab-2da31eec4763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef2a5ef6d7b4a36b2ead7e1e605430c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:18.226233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aff018-4261-48ff-96ab-2da31eec4763 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:18.227860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-be021171-cc21-4576-b3e6-1cb2435a1cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:18.330000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-35aff018-4261-48ff-96ab-2da31eec4763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef2a5ef6d7b4a36b2ead7e1e605430c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:18.330799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-35aff018-4261-48ff-96ab-2da31eec4763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef2a5ef6d7b4a36b2ead7e1e605430c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:18.335125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:18.350396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-35aff018-4261-48ff-96ab-2da31eec4763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef2a5ef6d7b4a36b2ead7e1e605430c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:18.351484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-35aff018-4261-48ff-96ab-2da31eec4763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef2a5ef6d7b4a36b2ead7e1e605430c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:18.368753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-35aff018-4261-48ff-96ab-2da31eec4763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef2a5ef6d7b4a36b2ead7e1e605430c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:18.415732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be021171-cc21-4576-b3e6-1cb2435a1cd8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:18.418812 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2664/5370] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:17 2022] DELETE /identity/v3/users/3ef2a5ef6d7b4a36b2ead7e1e605430c => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:18.419927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aff018-4261-48ff-96ab-2da31eec4763 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:18.422803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-35aff018-4261-48ff-96ab-2da31eec4763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:18.438529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cb78f-d5e1-4462-8881-98c54de89147 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76bd43d0a4224b57a1ebec981e232eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '949efa2215b34642aec9acf6553c2d52', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:18.440980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cb78f-d5e1-4462-8881-98c54de89147 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:18.441445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cb78f-d5e1-4462-8881-98c54de89147 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:18.441919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cb78f-d5e1-4462-8881-98c54de89147 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] PATH_INFO: `/v3/regions` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:18.444651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cb78f-d5e1-4462-8881-98c54de89147 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:18.448283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cb78f-d5e1-4462-8881-98c54de89147 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:18.467649 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2707/5371] 10.222.0.17 () {58 vars in 1128 bytes} [Sat Jul 30 21:20:18 2022] GET /identity/v3/regions => generated 670 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:18.469387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cb78f-d5e1-4462-8881-98c54de89147 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:18.475080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6c4cb78f-d5e1-4462-8881-98c54de89147 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:18.592218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aff018-4261-48ff-96ab-2da31eec4763 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:18.611127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b55e4-008a-4fb2-ac37-e0f175a8e19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:18.619833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b55e4-008a-4fb2-ac37-e0f175a8e19e admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:18.620212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b55e4-008a-4fb2-ac37-e0f175a8e19e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:18.620580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b55e4-008a-4fb2-ac37-e0f175a8e19e admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:18.621801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b55e4-008a-4fb2-ac37-e0f175a8e19e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:18.625984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b55e4-008a-4fb2-ac37-e0f175a8e19e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:18.637181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:18.671654 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2665/5372] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:18 2022] POST /identity/v3/users => generated 282 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:18.672778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b55e4-008a-4fb2-ac37-e0f175a8e19e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:18.674950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cb78f-d5e1-4462-8881-98c54de89147 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:18.677301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-427b55e4-008a-4fb2-ac37-e0f175a8e19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:18.691676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0190c84-9a44-4c56-b096-eb2326212e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:18.692650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0190c84-9a44-4c56-b096-eb2326212e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:18.694338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0190c84-9a44-4c56-b096-eb2326212e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:18.694624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0190c84-9a44-4c56-b096-eb2326212e42 admin admin] PATH_INFO: `/v3/projects/c37c304b2022435fb290b9f39b0a5a66` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:18.699378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0190c84-9a44-4c56-b096-eb2326212e42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c37c304b2022435fb290b9f39b0a5a66)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:18.701419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0190c84-9a44-4c56-b096-eb2326212e42 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:18.881005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c0190c84-9a44-4c56-b096-eb2326212e42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c37c304b2022435fb290b9f39b0a5a66', 'request_id': 'req-c0190c84-9a44-4c56-b096-eb2326212e42'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:18.885219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b55e4-008a-4fb2-ac37-e0f175a8e19e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:18.891820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c0190c84-9a44-4c56-b096-eb2326212e42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c37c304b2022435fb290b9f39b0a5a66', 'request_id': 'req-c0190c84-9a44-4c56-b096-eb2326212e42'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:18.905155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c0190c84-9a44-4c56-b096-eb2326212e42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c37c304b2022435fb290b9f39b0a5a66', 'request_id': 'req-c0190c84-9a44-4c56-b096-eb2326212e42'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:18.923890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c0190c84-9a44-4c56-b096-eb2326212e42 admin admin] The token cache is being invalidate because project c37c304b2022435fb290b9f39b0a5a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:18.924479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c0190c84-9a44-4c56-b096-eb2326212e42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:18.925627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c0190c84-9a44-4c56-b096-eb2326212e42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:18.929241 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2708/5373] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:18 2022] DELETE /identity/v3/projects/c37c304b2022435fb290b9f39b0a5a66 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:18.930538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0190c84-9a44-4c56-b096-eb2326212e42 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:18.938250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c0190c84-9a44-4c56-b096-eb2326212e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:19.021827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe9ed9-5514-4859-8559-4f92b55f1ae1 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76bd43d0a4224b57a1ebec981e232eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '949efa2215b34642aec9acf6553c2d52', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:19.022447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe9ed9-5514-4859-8559-4f92b55f1ae1 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:19.022751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe9ed9-5514-4859-8559-4f92b55f1ae1 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:19.023100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe9ed9-5514-4859-8559-4f92b55f1ae1 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] PATH_INFO: `/v3/regions/650bff549491400e9fb4ae482f31a62c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:19.027765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe9ed9-5514-4859-8559-4f92b55f1ae1 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorizing `identity:delete_region(region_id=650bff549491400e9fb4ae482f31a62c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:19.030667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe9ed9-5514-4859-8559-4f92b55f1ae1 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:19.057646 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-8ffe9ed9-5514-4859-8559-4f92b55f1ae1 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Could not find region: 650bff549491400e9fb4ae482f31a62c.: keystone.exception.RegionNotFound: Could not find region: 650bff549491400e9fb4ae482f31a62c. Jul 30 21:20:19.057646 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:20:19.057646 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Jul 30 21:20:19.057646 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Jul 30 21:20:19.057646 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Jul 30 21:20:19.057646 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Jul 30 21:20:19.057646 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Jul 30 21:20:19.057646 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jul 30 21:20:19.057646 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 650bff549491400e9fb4ae482f31a62c. Jul 30 21:20:19.057646 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:20:19.057646 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:20:19.057646 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:20:19.057646 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:20:19.057646 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:20:19.057646 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:20:19.057646 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:20:19.058827 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:20:19.058827 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:20:19.058827 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:20:19.058827 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:20:19.058827 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:20:19.058827 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:20:19.058827 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:20:19.058827 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Jul 30 21:20:19.058827 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Jul 30 21:20:19.058827 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:20:19.058827 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:20:19.058827 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Jul 30 21:20:19.058827 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jul 30 21:20:19.058827 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 650bff549491400e9fb4ae482f31a62c. Jul 30 21:20:19.058827 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:20:19.061321 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2666/5374] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:20:18 2022] DELETE /identity/v3/regions/650bff549491400e9fb4ae482f31a62c => generated 112 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:20:19.061683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe9ed9-5514-4859-8559-4f92b55f1ae1 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:19.067007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8ffe9ed9-5514-4859-8559-4f92b55f1ae1 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:19.095432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0190c84-9a44-4c56-b096-eb2326212e42 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:19.100024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe9ed9-5514-4859-8559-4f92b55f1ae1 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:19.105910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d17526-aa57-4006-b7ac-43e92a59301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:19.106560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d17526-aa57-4006-b7ac-43e92a59301e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:19.106826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d17526-aa57-4006-b7ac-43e92a59301e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:19.107275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d17526-aa57-4006-b7ac-43e92a59301e admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:19.110625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d17526-aa57-4006-b7ac-43e92a59301e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:19.111906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6d866-c6d5-4caf-9e39-c0d0da86afc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:19.114184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6d866-c6d5-4caf-9e39-c0d0da86afc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:19.114464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6d866-c6d5-4caf-9e39-c0d0da86afc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:19.114693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6d866-c6d5-4caf-9e39-c0d0da86afc3 admin admin] PATH_INFO: `/v3/projects/77f90380b12343a0988af717ce0323e7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:19.115611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d17526-aa57-4006-b7ac-43e92a59301e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:19.117548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6d866-c6d5-4caf-9e39-c0d0da86afc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f90380b12343a0988af717ce0323e7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:19.119048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:19.121565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6d866-c6d5-4caf-9e39-c0d0da86afc3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:19.150611 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2709/5375] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:19.152099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacfa59-7b2a-4908-ad5d-a4f6f87297c5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:19.152392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacfa59-7b2a-4908-ad5d-a4f6f87297c5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:19.152673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacfa59-7b2a-4908-ad5d-a4f6f87297c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:19.202269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2bacfa59-7b2a-4908-ad5d-a4f6f87297c5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:19.202755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2bacfa59-7b2a-4908-ad5d-a4f6f87297c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:19.217209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4ad6d866-c6d5-4caf-9e39-c0d0da86afc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f90380b12343a0988af717ce0323e7', 'request_id': 'req-4ad6d866-c6d5-4caf-9e39-c0d0da86afc3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:19.244918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4ad6d866-c6d5-4caf-9e39-c0d0da86afc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f90380b12343a0988af717ce0323e7', 'request_id': 'req-4ad6d866-c6d5-4caf-9e39-c0d0da86afc3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:19.262234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4ad6d866-c6d5-4caf-9e39-c0d0da86afc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f90380b12343a0988af717ce0323e7', 'request_id': 'req-4ad6d866-c6d5-4caf-9e39-c0d0da86afc3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:19.417911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4ad6d866-c6d5-4caf-9e39-c0d0da86afc3 admin admin] The token cache is being invalidate because project 77f90380b12343a0988af717ce0323e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:19.418426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4ad6d866-c6d5-4caf-9e39-c0d0da86afc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:19.423541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4ad6d866-c6d5-4caf-9e39-c0d0da86afc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:19.432475 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2667/5376] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:19 2022] DELETE /identity/v3/projects/77f90380b12343a0988af717ce0323e7 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:19.442438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6d866-c6d5-4caf-9e39-c0d0da86afc3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:19.449746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4ad6d866-c6d5-4caf-9e39-c0d0da86afc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:19.534543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:19.548879 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2710/5377] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:19.552672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacfa59-7b2a-4908-ad5d-a4f6f87297c5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:19.557987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2bacfa59-7b2a-4908-ad5d-a4f6f87297c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:19.579143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacfa59-7b2a-4908-ad5d-a4f6f87297c5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:19.588398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b1117-0af4-4433-831a-a2087c476f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:19.589712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b1117-0af4-4433-831a-a2087c476f8c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:19.590229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b1117-0af4-4433-831a-a2087c476f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:19.590749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b1117-0af4-4433-831a-a2087c476f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:19.591726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b1117-0af4-4433-831a-a2087c476f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:19.593922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b1117-0af4-4433-831a-a2087c476f8c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:19.607508 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2711/5378] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:19.609365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed90c4-3a13-4617-a230-73bcee7767ae None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:19.609887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed90c4-3a13-4617-a230-73bcee7767ae None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:19.610699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed90c4-3a13-4617-a230-73bcee7767ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:19.635386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-19ed90c4-3a13-4617-a230-73bcee7767ae None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:19.637278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-19ed90c4-3a13-4617-a230-73bcee7767ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:19.662179 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2712/5379] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:19.664175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7ffaf-3b14-4e4e-9297-2c0e9c3911fb None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:19.664700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7ffaf-3b14-4e4e-9297-2c0e9c3911fb None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:19.666015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7ffaf-3b14-4e4e-9297-2c0e9c3911fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:19.684978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6d866-c6d5-4caf-9e39-c0d0da86afc3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:19.700815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d026492-b2ae-4b7b-a28e-1a2f51b15695 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76bd43d0a4224b57a1ebec981e232eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '949efa2215b34642aec9acf6553c2d52', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:19.701634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d026492-b2ae-4b7b-a28e-1a2f51b15695 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:19.702003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d026492-b2ae-4b7b-a28e-1a2f51b15695 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:19.702290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d026492-b2ae-4b7b-a28e-1a2f51b15695 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] PATH_INFO: `/v3/regions` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:19.702952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d026492-b2ae-4b7b-a28e-1a2f51b15695 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:19.704160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d026492-b2ae-4b7b-a28e-1a2f51b15695 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:19.722754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-70b7ffaf-3b14-4e4e-9297-2c0e9c3911fb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:19.723889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-70b7ffaf-3b14-4e4e-9297-2c0e9c3911fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:19.731176 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2668/5380] 10.222.0.17 () {58 vars in 1128 bytes} [Sat Jul 30 21:20:19 2022] GET /identity/v3/regions => generated 670 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:19.732504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d026492-b2ae-4b7b-a28e-1a2f51b15695 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:19.748134 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2713/5381] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:19.750546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc090e7-3f71-461f-925a-379bf6c28aae None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:19.750835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc090e7-3f71-461f-925a-379bf6c28aae None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:19.755330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc090e7-3f71-461f-925a-379bf6c28aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:19.766127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d026492-b2ae-4b7b-a28e-1a2f51b15695 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:19.780023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5bd47-0d2e-4664-8007-1b25ddf4320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:19.781032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5bd47-0d2e-4664-8007-1b25ddf4320e admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:19.781356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5bd47-0d2e-4664-8007-1b25ddf4320e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:19.781737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5bd47-0d2e-4664-8007-1b25ddf4320e admin admin] PATH_INFO: `/v3/projects/017c04296e5b4a8e814f13f6d224425e/users/0eca9023a66146138deb388370723103/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:19.813798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9fc090e7-3f71-461f-925a-379bf6c28aae None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:19.818627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9fc090e7-3f71-461f-925a-379bf6c28aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:19.821204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5bd47-0d2e-4664-8007-1b25ddf4320e admin admin] RBAC: Authorizing `identity:create_grant(project_id=017c04296e5b4a8e814f13f6d224425e, user_id=0eca9023a66146138deb388370723103, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:19.825256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5bd47-0d2e-4664-8007-1b25ddf4320e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:19.847831 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2714/5382] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:19.849845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc090e7-3f71-461f-925a-379bf6c28aae None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:19.861963 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2669/5383] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:19 2022] PUT /identity/v3/projects/017c04296e5b4a8e814f13f6d224425e/users/0eca9023a66146138deb388370723103/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:19.863113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5bd47-0d2e-4664-8007-1b25ddf4320e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:19.902438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc090e7-3f71-461f-925a-379bf6c28aae None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:20.052776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8b0dd-3a92-4c09-98ee-6c0dff9e3ec0 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76bd43d0a4224b57a1ebec981e232eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '949efa2215b34642aec9acf6553c2d52', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:20.053596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b0dd-3a92-4c09-98ee-6c0dff9e3ec0 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:20.054022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b0dd-3a92-4c09-98ee-6c0dff9e3ec0 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:20.054378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b0dd-3a92-4c09-98ee-6c0dff9e3ec0 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] PATH_INFO: `/v3/regions` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:20.055156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8b0dd-3a92-4c09-98ee-6c0dff9e3ec0 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:20.057291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8b0dd-3a92-4c09-98ee-6c0dff9e3ec0 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:20.071709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5bd47-0d2e-4664-8007-1b25ddf4320e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:20.088456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff32e98-4775-45f3-93ba-daa71745f3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:20.089393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff32e98-4775-45f3-93ba-daa71745f3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:20.089677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff32e98-4775-45f3-93ba-daa71745f3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:20.091938 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2715/5384] 10.222.0.17 () {60 vars in 1150 bytes} [Sat Jul 30 21:20:19 2022] POST /identity/v3/regions => generated 253 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:20.092149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff32e98-4775-45f3-93ba-daa71745f3d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:20.092935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff32e98-4775-45f3-93ba-daa71745f3d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:20:20.093442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8b0dd-3a92-4c09-98ee-6c0dff9e3ec0 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:20.095802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff32e98-4775-45f3-93ba-daa71745f3d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:20.097598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff32e98-4775-45f3-93ba-daa71745f3d8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:20.121981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8b0dd-3a92-4c09-98ee-6c0dff9e3ec0 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:20.133092 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2670/5385] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:20.133092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ded5d-b4b6-42cc-a0f4-74796f12d95f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:20.134099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ded5d-b4b6-42cc-a0f4-74796f12d95f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:20.135731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ded5d-b4b6-42cc-a0f4-74796f12d95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:20.136575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195a2dd-7f69-4149-a77d-d7341a1afa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:20.137791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195a2dd-7f69-4149-a77d-d7341a1afa79 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:20.139183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195a2dd-7f69-4149-a77d-d7341a1afa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:20.139596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195a2dd-7f69-4149-a77d-d7341a1afa79 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:20.140838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195a2dd-7f69-4149-a77d-d7341a1afa79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:20:20.142357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195a2dd-7f69-4149-a77d-d7341a1afa79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:20.145368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195a2dd-7f69-4149-a77d-d7341a1afa79 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:20.176113 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2716/5386] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:20.179059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195a2dd-7f69-4149-a77d-d7341a1afa79 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:20.206506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-278ded5d-b4b6-42cc-a0f4-74796f12d95f None None] MFA Rules not processed for user `0eca9023a66146138deb388370723103`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:20.211796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-278ded5d-b4b6-42cc-a0f4-74796f12d95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:20.231088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195a2dd-7f69-4149-a77d-d7341a1afa79 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:20.245575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e85c42-ef77-43bc-b567-970d489449a9 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76bd43d0a4224b57a1ebec981e232eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '949efa2215b34642aec9acf6553c2d52', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:20.246333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e85c42-ef77-43bc-b567-970d489449a9 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:20.246695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e85c42-ef77-43bc-b567-970d489449a9 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:20.247051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e85c42-ef77-43bc-b567-970d489449a9 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] PATH_INFO: `/v3/regions` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:20.247883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e85c42-ef77-43bc-b567-970d489449a9 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Adding query filter params (parent_region_id=9644fbba69d046b79fc16d93d5068197) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:20:20.248266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e85c42-ef77-43bc-b567-970d489449a9 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:20.249963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e85c42-ef77-43bc-b567-970d489449a9 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:20.260982 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2717/5387] 10.222.0.17 () {58 vars in 1227 bytes} [Sat Jul 30 21:20:20 2022] GET /identity/v3/regions?parent_region_id=9644fbba69d046b79fc16d93d5068197 => generated 399 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:20.269182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e85c42-ef77-43bc-b567-970d489449a9 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:20.291469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e85c42-ef77-43bc-b567-970d489449a9 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:20.306986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e2605-9bbd-407b-8a30-d410c19bed6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:20.307742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e2605-9bbd-407b-8a30-d410c19bed6d admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:20.308423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e2605-9bbd-407b-8a30-d410c19bed6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:20.308423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e2605-9bbd-407b-8a30-d410c19bed6d admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:20.309184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e2605-9bbd-407b-8a30-d410c19bed6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:20.311859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e2605-9bbd-407b-8a30-d410c19bed6d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:20.342428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:20.364650 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2671/5388] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:20.365665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ded5d-b4b6-42cc-a0f4-74796f12d95f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:20.378222 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2718/5389] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:20 2022] POST /identity/v3/projects => generated 399 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:20.379237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e2605-9bbd-407b-8a30-d410c19bed6d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:20.415111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ded5d-b4b6-42cc-a0f4-74796f12d95f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:20.445353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:20.551169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e2605-9bbd-407b-8a30-d410c19bed6d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:20.558530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de44c9d-404d-4cc0-aa85-7de957f0f8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:20.559538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de44c9d-404d-4cc0-aa85-7de957f0f8cb admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:20.560597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de44c9d-404d-4cc0-aa85-7de957f0f8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:20.560717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de44c9d-404d-4cc0-aa85-7de957f0f8cb admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:20.561867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de44c9d-404d-4cc0-aa85-7de957f0f8cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:20.565040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de44c9d-404d-4cc0-aa85-7de957f0f8cb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:20.566063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4240a-5865-4618-8989-1a901352bd09 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76bd43d0a4224b57a1ebec981e232eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '949efa2215b34642aec9acf6553c2d52', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:20.567063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4240a-5865-4618-8989-1a901352bd09 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:20.567741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4240a-5865-4618-8989-1a901352bd09 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:20.568025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4240a-5865-4618-8989-1a901352bd09 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] PATH_INFO: `/v3/regions/47e6fda3e27d4519bdcd4e8604f88f37` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:20.568748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4240a-5865-4618-8989-1a901352bd09 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorizing `identity:delete_region(region_id=47e6fda3e27d4519bdcd4e8604f88f37)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:20.570862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4240a-5865-4618-8989-1a901352bd09 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:20.619856 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2719/5390] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:20:20 2022] DELETE /identity/v3/regions/47e6fda3e27d4519bdcd4e8604f88f37 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:20.621573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4240a-5865-4618-8989-1a901352bd09 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:20.637740 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2672/5391] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:20 2022] POST /identity/v3/projects => generated 359 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:20.640645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de44c9d-404d-4cc0-aa85-7de957f0f8cb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:20.677671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4240a-5865-4618-8989-1a901352bd09 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:20.828304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de44c9d-404d-4cc0-aa85-7de957f0f8cb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:20.841077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc851e-7dbc-4980-9d5b-0b55da0193a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:20.842495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc851e-7dbc-4980-9d5b-0b55da0193a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:20.842772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc851e-7dbc-4980-9d5b-0b55da0193a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:20.843061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc851e-7dbc-4980-9d5b-0b55da0193a0 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:20.843777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc851e-7dbc-4980-9d5b-0b55da0193a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:20.848529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc851e-7dbc-4980-9d5b-0b55da0193a0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:20.852400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aeb54c-4110-46b5-8828-ab8ca0bb053a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:20.853051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aeb54c-4110-46b5-8828-ab8ca0bb053a admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:20.853333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aeb54c-4110-46b5-8828-ab8ca0bb053a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:20.853672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aeb54c-4110-46b5-8828-ab8ca0bb053a admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:20.854437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aeb54c-4110-46b5-8828-ab8ca0bb053a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:20.861143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aeb54c-4110-46b5-8828-ab8ca0bb053a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:20.905877 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2673/5392] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:20 2022] POST /identity/v3/users => generated 306 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:20.907859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc851e-7dbc-4980-9d5b-0b55da0193a0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:20.938817 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2720/5393] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:20 2022] POST /identity/v3/projects => generated 363 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:20.940551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aeb54c-4110-46b5-8828-ab8ca0bb053a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:21.108883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:21.126324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc851e-7dbc-4980-9d5b-0b55da0193a0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:21.131782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aeb54c-4110-46b5-8828-ab8ca0bb053a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:21.146767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc38cf1-0cd9-4f15-859f-9e8dea78a857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:21.148479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc38cf1-0cd9-4f15-859f-9e8dea78a857 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:21.150388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc38cf1-0cd9-4f15-859f-9e8dea78a857 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:21.151114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc38cf1-0cd9-4f15-859f-9e8dea78a857 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:21.153519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc38cf1-0cd9-4f15-859f-9e8dea78a857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:21.159834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc38cf1-0cd9-4f15-859f-9e8dea78a857 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:21.194358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:21.218085 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2721/5394] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:20 2022] POST /identity/v3/users => generated 280 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:21.218085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc38cf1-0cd9-4f15-859f-9e8dea78a857 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:21.247894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc38cf1-0cd9-4f15-859f-9e8dea78a857 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:21.259473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15816a6f-2614-4338-b839-7962c168c959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:21.260118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15816a6f-2614-4338-b839-7962c168c959 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:21.260403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15816a6f-2614-4338-b839-7962c168c959 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:21.260679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15816a6f-2614-4338-b839-7962c168c959 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:21.261397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15816a6f-2614-4338-b839-7962c168c959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:21.263024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15816a6f-2614-4338-b839-7962c168c959 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:21.280875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdeb98-5d2b-4aaf-93d9-accfa17a5233 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76bd43d0a4224b57a1ebec981e232eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '949efa2215b34642aec9acf6553c2d52', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:21.281530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdeb98-5d2b-4aaf-93d9-accfa17a5233 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:21.281816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdeb98-5d2b-4aaf-93d9-accfa17a5233 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:21.282193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdeb98-5d2b-4aaf-93d9-accfa17a5233 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] PATH_INFO: `/v3/regions/2f5dea71a95c46cc991e6c6e8918bbcc` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:21.282921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdeb98-5d2b-4aaf-93d9-accfa17a5233 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorizing `identity:delete_region(region_id=2f5dea71a95c46cc991e6c6e8918bbcc)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:21.285332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdeb98-5d2b-4aaf-93d9-accfa17a5233 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:21.297199 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2722/5395] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:21.298190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15816a6f-2614-4338-b839-7962c168c959 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:21.316569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15816a6f-2614-4338-b839-7962c168c959 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:21.323486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0690c-9cfd-4923-99b8-68ae58172ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:21.324049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0690c-9cfd-4923-99b8-68ae58172ecc admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:21.324411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0690c-9cfd-4923-99b8-68ae58172ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:21.324755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0690c-9cfd-4923-99b8-68ae58172ecc admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:21.325684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0690c-9cfd-4923-99b8-68ae58172ecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:21.327962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0690c-9cfd-4923-99b8-68ae58172ecc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:21.334541 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2674/5396] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:20:20 2022] DELETE /identity/v3/regions/2f5dea71a95c46cc991e6c6e8918bbcc => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:21.336035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdeb98-5d2b-4aaf-93d9-accfa17a5233 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:21.360609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdeb98-5d2b-4aaf-93d9-accfa17a5233 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:21.371258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea477ed-a244-449f-89e4-baf1d436d0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:21.374300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea477ed-a244-449f-89e4-baf1d436d0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:21.375076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea477ed-a244-449f-89e4-baf1d436d0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:21.376212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea477ed-a244-449f-89e4-baf1d436d0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:21.378406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea477ed-a244-449f-89e4-baf1d436d0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:21.380782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea477ed-a244-449f-89e4-baf1d436d0f1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:21.396129 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2723/5397] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:21 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:21.398191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0690c-9cfd-4923-99b8-68ae58172ecc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:21.413498 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2675/5398] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:21.416452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea477ed-a244-449f-89e4-baf1d436d0f1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:21.420402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0690c-9cfd-4923-99b8-68ae58172ecc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:21.428811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae35f06-4c13-4640-be4d-de7338241e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:21.429729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae35f06-4c13-4640-be4d-de7338241e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:21.430204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae35f06-4c13-4640-be4d-de7338241e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:21.430819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae35f06-4c13-4640-be4d-de7338241e8f admin admin] PATH_INFO: `/v3/projects/af8d952b52d9454c8c4cfe245a241727/users/f47f4199d21f4028840c0d31dc321992/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:21.465306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae35f06-4c13-4640-be4d-de7338241e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8d952b52d9454c8c4cfe245a241727, user_id=f47f4199d21f4028840c0d31dc321992, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:21.468289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae35f06-4c13-4640-be4d-de7338241e8f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:21.481604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea477ed-a244-449f-89e4-baf1d436d0f1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:21.492665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b4929-d71d-4d40-8947-ebdfde476dc6 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76bd43d0a4224b57a1ebec981e232eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '949efa2215b34642aec9acf6553c2d52', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:21.493633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b4929-d71d-4d40-8947-ebdfde476dc6 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:21.493965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b4929-d71d-4d40-8947-ebdfde476dc6 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:21.494251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b4929-d71d-4d40-8947-ebdfde476dc6 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] PATH_INFO: `/v3/regions/9644fbba69d046b79fc16d93d5068197` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:21.494967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b4929-d71d-4d40-8947-ebdfde476dc6 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorizing `identity:delete_region(region_id=9644fbba69d046b79fc16d93d5068197)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:21.496820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b4929-d71d-4d40-8947-ebdfde476dc6 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:21.500283 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2724/5399] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:21 2022] PUT /identity/v3/projects/af8d952b52d9454c8c4cfe245a241727/users/f47f4199d21f4028840c0d31dc321992/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:21.501291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae35f06-4c13-4640-be4d-de7338241e8f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:21.535539 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2676/5400] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:20:21 2022] DELETE /identity/v3/regions/9644fbba69d046b79fc16d93d5068197 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:21.539915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b4929-d71d-4d40-8947-ebdfde476dc6 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:21.600605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b4929-d71d-4d40-8947-ebdfde476dc6 tempest-RegionsTestJSON-1452349402 tempest-RegionsTestJSON-1452349402-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:21.651584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae35f06-4c13-4640-be4d-de7338241e8f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:21.668865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e734e6-c922-4182-af1f-478586a8ce55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:21.669517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e734e6-c922-4182-af1f-478586a8ce55 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:21.669811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e734e6-c922-4182-af1f-478586a8ce55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:21.670095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e734e6-c922-4182-af1f-478586a8ce55 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:21.670814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e734e6-c922-4182-af1f-478586a8ce55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:21.672492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e734e6-c922-4182-af1f-478586a8ce55 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:21.710491 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2725/5401] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:21.711545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e734e6-c922-4182-af1f-478586a8ce55 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:21.739401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e734e6-c922-4182-af1f-478586a8ce55 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:21.759896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7708ba-962e-4f49-81fb-2298c7bb40e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:21.760576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7708ba-962e-4f49-81fb-2298c7bb40e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:21.760982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7708ba-962e-4f49-81fb-2298c7bb40e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:21.761372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7708ba-962e-4f49-81fb-2298c7bb40e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:21.762327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7708ba-962e-4f49-81fb-2298c7bb40e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:21.764113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7708ba-962e-4f49-81fb-2298c7bb40e4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:21.772182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765f23d-1b4b-434e-81ba-a1ebdf2ffb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:21.772867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765f23d-1b4b-434e-81ba-a1ebdf2ffb18 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:21.773169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765f23d-1b4b-434e-81ba-a1ebdf2ffb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:21.777633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765f23d-1b4b-434e-81ba-a1ebdf2ffb18 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:21.778456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765f23d-1b4b-434e-81ba-a1ebdf2ffb18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:21.781999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765f23d-1b4b-434e-81ba-a1ebdf2ffb18 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:21.793028 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2677/5402] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:21.793738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7708ba-962e-4f49-81fb-2298c7bb40e4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:21.800074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-be7708ba-962e-4f49-81fb-2298c7bb40e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:21.811684 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2726/5403] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:21.812618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765f23d-1b4b-434e-81ba-a1ebdf2ffb18 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:21.822877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7708ba-962e-4f49-81fb-2298c7bb40e4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:21.836633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765f23d-1b4b-434e-81ba-a1ebdf2ffb18 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:21.839066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddf73e-5607-4707-ab30-bc36e47d6e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:21.839886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddf73e-5607-4707-ab30-bc36e47d6e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:21.840279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddf73e-5607-4707-ab30-bc36e47d6e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:21.840667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddf73e-5607-4707-ab30-bc36e47d6e34 admin admin] PATH_INFO: `/v3/users/941f28063b584263bc5557864529e44c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:21.844524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af5c6f-222a-4241-88df-a0c7e2e67a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:21.844721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddf73e-5607-4707-ab30-bc36e47d6e34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=941f28063b584263bc5557864529e44c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:21.847324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af5c6f-222a-4241-88df-a0c7e2e67a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:21.847638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af5c6f-222a-4241-88df-a0c7e2e67a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:21.847928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af5c6f-222a-4241-88df-a0c7e2e67a12 admin admin] PATH_INFO: `/v3/projects/8d1ea33dec73407aabab93b3750383a9/users/e33d508620aa474ebf9252dba782b13e/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:21.849232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddf73e-5607-4707-ab30-bc36e47d6e34 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:21.883926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af5c6f-222a-4241-88df-a0c7e2e67a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d1ea33dec73407aabab93b3750383a9, user_id=e33d508620aa474ebf9252dba782b13e, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:21.890374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af5c6f-222a-4241-88df-a0c7e2e67a12 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:21.927669 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2727/5404] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:21 2022] PUT /identity/v3/projects/8d1ea33dec73407aabab93b3750383a9/users/e33d508620aa474ebf9252dba782b13e/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:21.930672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af5c6f-222a-4241-88df-a0c7e2e67a12 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:21.947081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:21.949873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9eddf73e-5607-4707-ab30-bc36e47d6e34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '941f28063b584263bc5557864529e44c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:21.953117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9eddf73e-5607-4707-ab30-bc36e47d6e34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '941f28063b584263bc5557864529e44c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:21.980581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9eddf73e-5607-4707-ab30-bc36e47d6e34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '941f28063b584263bc5557864529e44c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:21.982879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9eddf73e-5607-4707-ab30-bc36e47d6e34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '941f28063b584263bc5557864529e44c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:22.005315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9eddf73e-5607-4707-ab30-bc36e47d6e34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '941f28063b584263bc5557864529e44c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:22.032583 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2678/5405] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:21 2022] DELETE /identity/v3/users/941f28063b584263bc5557864529e44c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:22.034677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddf73e-5607-4707-ab30-bc36e47d6e34 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:22.041150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9eddf73e-5607-4707-ab30-bc36e47d6e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:22.130586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:22.154164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af5c6f-222a-4241-88df-a0c7e2e67a12 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:22.203411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddf73e-5607-4707-ab30-bc36e47d6e34 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:22.216383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd17b6a-ce93-45d2-ac41-38a01ce9cca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:22.217091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd17b6a-ce93-45d2-ac41-38a01ce9cca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:22.217389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd17b6a-ce93-45d2-ac41-38a01ce9cca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:22.217655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd17b6a-ce93-45d2-ac41-38a01ce9cca2 admin admin] PATH_INFO: `/v3/projects/af8d952b52d9454c8c4cfe245a241727/users/f47f4199d21f4028840c0d31dc321992/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:22.220712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd17b6a-ce93-45d2-ac41-38a01ce9cca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8d952b52d9454c8c4cfe245a241727, user_id=f47f4199d21f4028840c0d31dc321992, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:22.226431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd17b6a-ce93-45d2-ac41-38a01ce9cca2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:22.251002 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2679/5406] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:22 2022] PUT /identity/v3/projects/af8d952b52d9454c8c4cfe245a241727/users/f47f4199d21f4028840c0d31dc321992/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:22.251521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd17b6a-ce93-45d2-ac41-38a01ce9cca2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:22.262481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8cd17b6a-ce93-45d2-ac41-38a01ce9cca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:22.367645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9557faf-f744-44bb-8cd2-87be9c06ecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:22.369277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9557faf-f744-44bb-8cd2-87be9c06ecf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:22.369995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9557faf-f744-44bb-8cd2-87be9c06ecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:22.371139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9557faf-f744-44bb-8cd2-87be9c06ecf4 admin admin] PATH_INFO: `/v3/projects/c248bcc7947447f394c77cce7e74fc51/users/d6c6670a22aa49158398ff6fa4cba427/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:22.412415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9557faf-f744-44bb-8cd2-87be9c06ecf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c248bcc7947447f394c77cce7e74fc51, user_id=d6c6670a22aa49158398ff6fa4cba427, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:22.419064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9557faf-f744-44bb-8cd2-87be9c06ecf4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:22.447387 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2728/5407] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:21 2022] PUT /identity/v3/projects/c248bcc7947447f394c77cce7e74fc51/users/d6c6670a22aa49158398ff6fa4cba427/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:22.449272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbfa4a-105c-476e-9689-90a4f24b7eeb None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:22.451978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbfa4a-105c-476e-9689-90a4f24b7eeb None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:22.452540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbfa4a-105c-476e-9689-90a4f24b7eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:22.458173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd17b6a-ce93-45d2-ac41-38a01ce9cca2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:22.497858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-01dbfa4a-105c-476e-9689-90a4f24b7eeb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:22.500306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-01dbfa4a-105c-476e-9689-90a4f24b7eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:22.613241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5719791-a09b-4896-a562-1c963832dbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:22.613897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5719791-a09b-4896-a562-1c963832dbdf admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:22.614190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5719791-a09b-4896-a562-1c963832dbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:22.620720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5719791-a09b-4896-a562-1c963832dbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:22.621520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5719791-a09b-4896-a562-1c963832dbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:22.626705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5719791-a09b-4896-a562-1c963832dbdf admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:22.637208 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2729/5408] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:22.639136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55058377-4603-4891-8d41-675c48881f3a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:22.639962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55058377-4603-4891-8d41-675c48881f3a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:22.640571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55058377-4603-4891-8d41-675c48881f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:22.645053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:22.658136 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2680/5409] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:22.664221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a46ded-bc0f-41dd-9e48-19eb5c48fc41 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:22.664449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a46ded-bc0f-41dd-9e48-19eb5c48fc41 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:22.665234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a46ded-bc0f-41dd-9e48-19eb5c48fc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:22.693755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-55058377-4603-4891-8d41-675c48881f3a None None] MFA Rules not processed for user `f47f4199d21f4028840c0d31dc321992`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:22.698627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-55058377-4603-4891-8d41-675c48881f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:22.764338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-22a46ded-bc0f-41dd-9e48-19eb5c48fc41 None None] MFA Rules not processed for user `d6c6670a22aa49158398ff6fa4cba427`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:22.767246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-22a46ded-bc0f-41dd-9e48-19eb5c48fc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:22.835358 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2730/5410] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:22 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:22.836327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55058377-4603-4891-8d41-675c48881f3a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:22.868726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55058377-4603-4891-8d41-675c48881f3a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:22.874262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c0787-2643-44b6-97fe-f8efd57cff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:22.875241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0787-2643-44b6-97fe-f8efd57cff5d admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:22.875241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0787-2643-44b6-97fe-f8efd57cff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:22.875541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0787-2643-44b6-97fe-f8efd57cff5d admin admin] PATH_INFO: `/v3/projects/8d1ea33dec73407aabab93b3750383a9/users/e33d508620aa474ebf9252dba782b13e/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:22.881867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c0787-2643-44b6-97fe-f8efd57cff5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d1ea33dec73407aabab93b3750383a9, user_id=e33d508620aa474ebf9252dba782b13e, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:22.884739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c0787-2643-44b6-97fe-f8efd57cff5d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:22.889914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:22.916801 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2731/5411] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:22 2022] PUT /identity/v3/projects/8d1ea33dec73407aabab93b3750383a9/users/e33d508620aa474ebf9252dba782b13e/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:22.918126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c0787-2643-44b6-97fe-f8efd57cff5d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:22.931082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-607c0787-2643-44b6-97fe-f8efd57cff5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:22.992656 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2681/5412] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:22 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:22.999306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a46ded-bc0f-41dd-9e48-19eb5c48fc41 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:23.049915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a46ded-bc0f-41dd-9e48-19eb5c48fc41 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:23.086577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c0787-2643-44b6-97fe-f8efd57cff5d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:23.096372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aced4-eea3-4e0a-8b2c-48c24161869d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:23.097033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aced4-eea3-4e0a-8b2c-48c24161869d service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:23.097386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aced4-eea3-4e0a-8b2c-48c24161869d service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:23.097666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aced4-eea3-4e0a-8b2c-48c24161869d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:23.158907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65f8b5-d9fc-4086-abee-3e54539aeb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:23.159591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65f8b5-d9fc-4086-abee-3e54539aeb6d admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:23.160174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65f8b5-d9fc-4086-abee-3e54539aeb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:23.160465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65f8b5-d9fc-4086-abee-3e54539aeb6d admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:23.161213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65f8b5-d9fc-4086-abee-3e54539aeb6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:23.164139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65f8b5-d9fc-4086-abee-3e54539aeb6d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:23.228251 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2682/5413] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:22 2022] POST /identity/v3/projects => generated 397 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:23.236822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ca7c8-ace3-4898-9ef5-b37d8f237ec8 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:23.237168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ca7c8-ace3-4898-9ef5-b37d8f237ec8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:23.237459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ca7c8-ace3-4898-9ef5-b37d8f237ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:23.327784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b97ca7c8-ace3-4898-9ef5-b37d8f237ec8 None None] MFA Rules not processed for user `e33d508620aa474ebf9252dba782b13e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:23.331182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b97ca7c8-ace3-4898-9ef5-b37d8f237ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:23.336812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95aced4-eea3-4e0a-8b2c-48c24161869d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:23.368542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95aced4-eea3-4e0a-8b2c-48c24161869d service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:23.387198 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2732/5414] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:23.388600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aced4-eea3-4e0a-8b2c-48c24161869d service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:23.391449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f95aced4-eea3-4e0a-8b2c-48c24161869d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:23.421210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aced4-eea3-4e0a-8b2c-48c24161869d service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:23.609048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcc5fc-5b0a-4a36-ae4e-3c752c66ec5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:23.610439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcc5fc-5b0a-4a36-ae4e-3c752c66ec5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:23.610936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:23.612696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcc5fc-5b0a-4a36-ae4e-3c752c66ec5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:23.614442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcc5fc-5b0a-4a36-ae4e-3c752c66ec5e admin admin] PATH_INFO: `/v3/users/d6c6670a22aa49158398ff6fa4cba427` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:23.616057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcc5fc-5b0a-4a36-ae4e-3c752c66ec5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6c6670a22aa49158398ff6fa4cba427)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:23.623635 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2683/5415] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:23 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:23.624754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ca7c8-ace3-4898-9ef5-b37d8f237ec8 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:23.630707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcc5fc-5b0a-4a36-ae4e-3c752c66ec5e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:23.664192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ca7c8-ace3-4898-9ef5-b37d8f237ec8 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:23.670569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11770a8-25df-41a2-91e2-3bdc9bba02af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:23.671523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11770a8-25df-41a2-91e2-3bdc9bba02af admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:23.671980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11770a8-25df-41a2-91e2-3bdc9bba02af admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:23.672424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11770a8-25df-41a2-91e2-3bdc9bba02af admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:23.673342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11770a8-25df-41a2-91e2-3bdc9bba02af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:23.676560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11770a8-25df-41a2-91e2-3bdc9bba02af admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:23.727358 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2684/5416] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:23 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:23.728682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11770a8-25df-41a2-91e2-3bdc9bba02af admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:23.753737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=1,keystone:SELECT=94,keystone:DELETE=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:23.760271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11770a8-25df-41a2-91e2-3bdc9bba02af admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:23.776967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a511e-2b65-4fb7-a01b-d234e4725dec tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:23.777619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a511e-2b65-4fb7-a01b-d234e4725dec tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:23.777922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a511e-2b65-4fb7-a01b-d234e4725dec tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:23.778212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a511e-2b65-4fb7-a01b-d234e4725dec tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:23.779427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a511e-2b65-4fb7-a01b-d234e4725dec tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:23.781213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a511e-2b65-4fb7-a01b-d234e4725dec tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:23.787081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7fbcc5fc-5b0a-4a36-ae4e-3c752c66ec5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6c6670a22aa49158398ff6fa4cba427'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:23.818208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7fbcc5fc-5b0a-4a36-ae4e-3c752c66ec5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6c6670a22aa49158398ff6fa4cba427'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:23.819766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7fbcc5fc-5b0a-4a36-ae4e-3c752c66ec5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6c6670a22aa49158398ff6fa4cba427'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:23.828375 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2685/5417] 10.222.0.17 () {60 vars in 1150 bytes} [Sat Jul 30 21:20:23 2022] POST /identity/v3/domains => generated 275 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:23.831810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a511e-2b65-4fb7-a01b-d234e4725dec tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:23.843046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7fbcc5fc-5b0a-4a36-ae4e-3c752c66ec5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6c6670a22aa49158398ff6fa4cba427'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:23.845405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7fbcc5fc-5b0a-4a36-ae4e-3c752c66ec5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6c6670a22aa49158398ff6fa4cba427'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:23.882201 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2733/5418] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:23 2022] DELETE /identity/v3/users/d6c6670a22aa49158398ff6fa4cba427 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:23.883149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcc5fc-5b0a-4a36-ae4e-3c752c66ec5e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:23.887174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7fbcc5fc-5b0a-4a36-ae4e-3c752c66ec5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:24.066659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a511e-2b65-4fb7-a01b-d234e4725dec tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:24.070016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcc5fc-5b0a-4a36-ae4e-3c752c66ec5e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:24.082813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b3635-0acc-4d9f-ab03-726b82f9b20f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:24.083630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b3635-0acc-4d9f-ab03-726b82f9b20f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:24.084729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b3635-0acc-4d9f-ab03-726b82f9b20f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:24.084729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b3635-0acc-4d9f-ab03-726b82f9b20f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:24.087141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b3635-0acc-4d9f-ab03-726b82f9b20f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:24.089184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b3635-0acc-4d9f-ab03-726b82f9b20f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:24.136080 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2734/5419] 10.222.0.17 () {60 vars in 1150 bytes} [Sat Jul 30 21:20:23 2022] POST /identity/v3/domains => generated 276 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:24.149041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2411b54-92bb-4c5d-b928-ba28c594efc2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:24.149382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2411b54-92bb-4c5d-b928-ba28c594efc2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:24.150039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2411b54-92bb-4c5d-b928-ba28c594efc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:24.233667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df12df-499a-44f8-bc04-c8e8ae82f3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:24.233916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b2411b54-92bb-4c5d-b928-ba28c594efc2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:24.234305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df12df-499a-44f8-bc04-c8e8ae82f3aa admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:24.234704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df12df-499a-44f8-bc04-c8e8ae82f3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:24.234986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df12df-499a-44f8-bc04-c8e8ae82f3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:24.235721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df12df-499a-44f8-bc04-c8e8ae82f3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:24.238004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df12df-499a-44f8-bc04-c8e8ae82f3aa admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:24.238233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b2411b54-92bb-4c5d-b928-ba28c594efc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:24.263240 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2686/5420] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:24.265730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df12df-499a-44f8-bc04-c8e8ae82f3aa admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:24.295552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df12df-499a-44f8-bc04-c8e8ae82f3aa admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:24.409144 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2735/5421] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:24.412527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2411b54-92bb-4c5d-b928-ba28c594efc2 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:24.418252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b2411b54-92bb-4c5d-b928-ba28c594efc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:24.451372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2411b54-92bb-4c5d-b928-ba28c594efc2 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:24.463495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbee29a-e2a9-4e8a-b9bd-6329381cd6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:24.464629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbee29a-e2a9-4e8a-b9bd-6329381cd6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:24.464914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbee29a-e2a9-4e8a-b9bd-6329381cd6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:24.465187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbee29a-e2a9-4e8a-b9bd-6329381cd6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:24.467671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbee29a-e2a9-4e8a-b9bd-6329381cd6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:24.468637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d32693-10bb-4539-a5cb-e126976fab76 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:24.471390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d32693-10bb-4539-a5cb-e126976fab76 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:24.471726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d32693-10bb-4539-a5cb-e126976fab76 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:24.472242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d32693-10bb-4539-a5cb-e126976fab76 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:24.473505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d32693-10bb-4539-a5cb-e126976fab76 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:24.474068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbee29a-e2a9-4e8a-b9bd-6329381cd6e6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:24.477446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d32693-10bb-4539-a5cb-e126976fab76 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:24.503747 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2736/5422] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:24.503747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbee29a-e2a9-4e8a-b9bd-6329381cd6e6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:24.531354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7fbee29a-e2a9-4e8a-b9bd-6329381cd6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:24.549797 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2687/5423] 10.222.0.17 () {60 vars in 1150 bytes} [Sat Jul 30 21:20:24 2022] POST /identity/v3/domains => generated 275 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:24.555087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d32693-10bb-4539-a5cb-e126976fab76 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:24.594422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:24.679218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:24.702211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d32693-10bb-4539-a5cb-e126976fab76 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:24.708374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dba412-fdd6-4e64-b745-3af9b633905b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:24.709502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dba412-fdd6-4e64-b745-3af9b633905b admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:24.709802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dba412-fdd6-4e64-b745-3af9b633905b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:24.710971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dba412-fdd6-4e64-b745-3af9b633905b admin admin] PATH_INFO: `/v3/projects/a44b336bee1e4aa38ba0972914ca6cc0/users/2a9b7906c58444889c80695dfdade78f/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:24.725613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbee29a-e2a9-4e8a-b9bd-6329381cd6e6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:24.736070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dba412-fdd6-4e64-b745-3af9b633905b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a44b336bee1e4aa38ba0972914ca6cc0, user_id=2a9b7906c58444889c80695dfdade78f, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:24.747189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dba412-fdd6-4e64-b745-3af9b633905b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:24.777436 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2688/5424] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:24 2022] PUT /identity/v3/projects/a44b336bee1e4aa38ba0972914ca6cc0/users/2a9b7906c58444889c80695dfdade78f/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:24.777436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dba412-fdd6-4e64-b745-3af9b633905b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:24.873471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc467c97-597c-422f-a1e4-ee29b534bd28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:24.874422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc467c97-597c-422f-a1e4-ee29b534bd28 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:24.876656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc467c97-597c-422f-a1e4-ee29b534bd28 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:24.877241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc467c97-597c-422f-a1e4-ee29b534bd28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:24.903782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc467c97-597c-422f-a1e4-ee29b534bd28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:24.905371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc467c97-597c-422f-a1e4-ee29b534bd28 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:24.928163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dba412-fdd6-4e64-b745-3af9b633905b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:24.930671 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2737/5425] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:24.931839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc467c97-597c-422f-a1e4-ee29b534bd28 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:24.940257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cfe8a-0c46-414f-9e5e-fa8cac2f6a45 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:24.941094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cfe8a-0c46-414f-9e5e-fa8cac2f6a45 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:24.942075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cfe8a-0c46-414f-9e5e-fa8cac2f6a45 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:24.942379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cfe8a-0c46-414f-9e5e-fa8cac2f6a45 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:24.942630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cc467c97-597c-422f-a1e4-ee29b534bd28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:24.943581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cfe8a-0c46-414f-9e5e-fa8cac2f6a45 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:24.945798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cfe8a-0c46-414f-9e5e-fa8cac2f6a45 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:24.974405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc467c97-597c-422f-a1e4-ee29b534bd28 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:25.012959 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2689/5426] 10.222.0.17 () {60 vars in 1150 bytes} [Sat Jul 30 21:20:24 2022] POST /identity/v3/domains => generated 279 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:25.014650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9935a8f-b71a-4578-ace3-690b7f5e5c22 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:25.016664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9935a8f-b71a-4578-ace3-690b7f5e5c22 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:25.017149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9935a8f-b71a-4578-ace3-690b7f5e5c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:25.094865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d9935a8f-b71a-4578-ace3-690b7f5e5c22 None None] MFA Rules not processed for user `2a9b7906c58444889c80695dfdade78f`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:25.097745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d9935a8f-b71a-4578-ace3-690b7f5e5c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:25.129007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99adfc-756a-4b22-be11-7f69577cbbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:25.130250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99adfc-756a-4b22-be11-7f69577cbbdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:25.130544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99adfc-756a-4b22-be11-7f69577cbbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:25.130825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99adfc-756a-4b22-be11-7f69577cbbdc admin admin] PATH_INFO: `/v3/projects/bc58f3ffc7414c7aa53f10f0cc00522a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:25.135379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99adfc-756a-4b22-be11-7f69577cbbdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc58f3ffc7414c7aa53f10f0cc00522a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:25.138972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99adfc-756a-4b22-be11-7f69577cbbdc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:25.231597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5e99adfc-756a-4b22-be11-7f69577cbbdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc58f3ffc7414c7aa53f10f0cc00522a', 'request_id': 'req-5e99adfc-756a-4b22-be11-7f69577cbbdc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:25.244844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5e99adfc-756a-4b22-be11-7f69577cbbdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc58f3ffc7414c7aa53f10f0cc00522a', 'request_id': 'req-5e99adfc-756a-4b22-be11-7f69577cbbdc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:25.269976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5e99adfc-756a-4b22-be11-7f69577cbbdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc58f3ffc7414c7aa53f10f0cc00522a', 'request_id': 'req-5e99adfc-756a-4b22-be11-7f69577cbbdc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:25.307346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5e99adfc-756a-4b22-be11-7f69577cbbdc admin admin] The token cache is being invalidate because project bc58f3ffc7414c7aa53f10f0cc00522a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:25.307986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5e99adfc-756a-4b22-be11-7f69577cbbdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:25.309009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5e99adfc-756a-4b22-be11-7f69577cbbdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:25.313174 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2690/5427] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:25.315350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9935a8f-b71a-4578-ace3-690b7f5e5c22 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:25.325847 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2738/5428] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:24 2022] DELETE /identity/v3/projects/bc58f3ffc7414c7aa53f10f0cc00522a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:25.327428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99adfc-756a-4b22-be11-7f69577cbbdc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:25.329437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5e99adfc-756a-4b22-be11-7f69577cbbdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:25.356919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:25.448360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:25.512567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9935a8f-b71a-4578-ace3-690b7f5e5c22 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:25.537169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99adfc-756a-4b22-be11-7f69577cbbdc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:25.550443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4cf64-7af7-4fe6-9cdc-7f720dab6b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:25.551128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4cf64-7af7-4fe6-9cdc-7f720dab6b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:25.551451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4cf64-7af7-4fe6-9cdc-7f720dab6b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:25.551740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4cf64-7af7-4fe6-9cdc-7f720dab6b19 admin admin] PATH_INFO: `/v3/users/76bd43d0a4224b57a1ebec981e232eaf` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:25.556745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4cf64-7af7-4fe6-9cdc-7f720dab6b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76bd43d0a4224b57a1ebec981e232eaf)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:25.563964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4cf64-7af7-4fe6-9cdc-7f720dab6b19 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:25.690439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-58d4cf64-7af7-4fe6-9cdc-7f720dab6b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76bd43d0a4224b57a1ebec981e232eaf'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:25.702482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105659bd-98c0-404b-83fd-92d854dfe06e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:25.703784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105659bd-98c0-404b-83fd-92d854dfe06e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:25.704500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105659bd-98c0-404b-83fd-92d854dfe06e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:25.705030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105659bd-98c0-404b-83fd-92d854dfe06e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains/d5bd78ba9e364e33af14a169d8b50b0f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:25.728022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-58d4cf64-7af7-4fe6-9cdc-7f720dab6b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76bd43d0a4224b57a1ebec981e232eaf'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:25.732928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-58d4cf64-7af7-4fe6-9cdc-7f720dab6b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76bd43d0a4224b57a1ebec981e232eaf'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:25.740438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105659bd-98c0-404b-83fd-92d854dfe06e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d5bd78ba9e364e33af14a169d8b50b0f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:25.742506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105659bd-98c0-404b-83fd-92d854dfe06e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:25.747454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-58d4cf64-7af7-4fe6-9cdc-7f720dab6b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76bd43d0a4224b57a1ebec981e232eaf'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:25.751241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-58d4cf64-7af7-4fe6-9cdc-7f720dab6b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76bd43d0a4224b57a1ebec981e232eaf'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:25.863833 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2739/5429] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:25 2022] DELETE /identity/v3/users/76bd43d0a4224b57a1ebec981e232eaf => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:25.863833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4cf64-7af7-4fe6-9cdc-7f720dab6b19 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:25.863833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-58d4cf64-7af7-4fe6-9cdc-7f720dab6b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:25.966232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-105659bd-98c0-404b-83fd-92d854dfe06e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd5bd78ba9e364e33af14a169d8b50b0f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:25.987948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-105659bd-98c0-404b-83fd-92d854dfe06e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd5bd78ba9e364e33af14a169d8b50b0f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:26.041991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4cf64-7af7-4fe6-9cdc-7f720dab6b19 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:26.046611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012954d-63d5-41a1-9af2-ffd36dcf3340 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:26.047257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012954d-63d5-41a1-9af2-ffd36dcf3340 service glance] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:26.047614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012954d-63d5-41a1-9af2-ffd36dcf3340 service glance] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:26.047907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012954d-63d5-41a1-9af2-ffd36dcf3340 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:26.050325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2012954d-63d5-41a1-9af2-ffd36dcf3340 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:26.154624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:26.176620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-105659bd-98c0-404b-83fd-92d854dfe06e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5bd78ba9e364e33af14a169d8b50b0f', 'request_id': 'req-105659bd-98c0-404b-83fd-92d854dfe06e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:26.192364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-105659bd-98c0-404b-83fd-92d854dfe06e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5bd78ba9e364e33af14a169d8b50b0f', 'request_id': 'req-105659bd-98c0-404b-83fd-92d854dfe06e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:26.205180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012954d-63d5-41a1-9af2-ffd36dcf3340 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:26.213738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012954d-63d5-41a1-9af2-ffd36dcf3340 service glance] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:26.215514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-105659bd-98c0-404b-83fd-92d854dfe06e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5bd78ba9e364e33af14a169d8b50b0f', 'request_id': 'req-105659bd-98c0-404b-83fd-92d854dfe06e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:26.250605 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2740/5430] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:25 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:26.251073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-105659bd-98c0-404b-83fd-92d854dfe06e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] The token cache is being invalidate because project d5bd78ba9e364e33af14a169d8b50b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:26.251713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-105659bd-98c0-404b-83fd-92d854dfe06e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:26.252097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012954d-63d5-41a1-9af2-ffd36dcf3340 service glance] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:26.254133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2012954d-63d5-41a1-9af2-ffd36dcf3340 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:26.256673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-105659bd-98c0-404b-83fd-92d854dfe06e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:26.273316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-105659bd-98c0-404b-83fd-92d854dfe06e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd5bd78ba9e364e33af14a169d8b50b0f', 'request_id': 'req-105659bd-98c0-404b-83fd-92d854dfe06e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:26.283832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-105659bd-98c0-404b-83fd-92d854dfe06e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd5bd78ba9e364e33af14a169d8b50b0f', 'request_id': 'req-105659bd-98c0-404b-83fd-92d854dfe06e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:26.286346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-105659bd-98c0-404b-83fd-92d854dfe06e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd5bd78ba9e364e33af14a169d8b50b0f', 'request_id': 'req-105659bd-98c0-404b-83fd-92d854dfe06e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:26.289209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:26.296106 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2691/5431] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:20:25 2022] DELETE /identity/v3/domains/d5bd78ba9e364e33af14a169d8b50b0f => generated 0 bytes in 982 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:26.301003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105659bd-98c0-404b-83fd-92d854dfe06e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:26.302612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-105659bd-98c0-404b-83fd-92d854dfe06e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:26.452503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012954d-63d5-41a1-9af2-ffd36dcf3340 service glance] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:26.456017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105659bd-98c0-404b-83fd-92d854dfe06e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:26.477820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684535c2-532c-45a9-a36f-b0a3da44f722 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:26.478396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684535c2-532c-45a9-a36f-b0a3da44f722 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:26.478687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684535c2-532c-45a9-a36f-b0a3da44f722 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:26.478977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684535c2-532c-45a9-a36f-b0a3da44f722 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:26.479804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684535c2-532c-45a9-a36f-b0a3da44f722 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:26.481628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684535c2-532c-45a9-a36f-b0a3da44f722 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:26.520689 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2692/5432] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:20:26 2022] POST /identity/v3/domains => generated 248 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:26.521645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684535c2-532c-45a9-a36f-b0a3da44f722 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:26.617115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c90db-0119-4805-8af6-509a42ad633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:26.617931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c90db-0119-4805-8af6-509a42ad633e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:26.618063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c90db-0119-4805-8af6-509a42ad633e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:26.618352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c90db-0119-4805-8af6-509a42ad633e admin admin] PATH_INFO: `/v3/projects/c248bcc7947447f394c77cce7e74fc51` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:26.622932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c90db-0119-4805-8af6-509a42ad633e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c248bcc7947447f394c77cce7e74fc51)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:26.631618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c90db-0119-4805-8af6-509a42ad633e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:26.685504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684535c2-532c-45a9-a36f-b0a3da44f722 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:26.700594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7802229-19c7-4749-8323-22d77476a91f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:26.701757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7802229-19c7-4749-8323-22d77476a91f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:26.702209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7802229-19c7-4749-8323-22d77476a91f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:26.702674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7802229-19c7-4749-8323-22d77476a91f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains/e45ca9d6df3040eeabfb8de178fb9eef` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:26.729305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7802229-19c7-4749-8323-22d77476a91f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e45ca9d6df3040eeabfb8de178fb9eef)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:26.736491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7802229-19c7-4749-8323-22d77476a91f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:26.773994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-af4c90db-0119-4805-8af6-509a42ad633e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c248bcc7947447f394c77cce7e74fc51', 'request_id': 'req-af4c90db-0119-4805-8af6-509a42ad633e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:26.786364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-af4c90db-0119-4805-8af6-509a42ad633e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c248bcc7947447f394c77cce7e74fc51', 'request_id': 'req-af4c90db-0119-4805-8af6-509a42ad633e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:26.801493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-af4c90db-0119-4805-8af6-509a42ad633e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c248bcc7947447f394c77cce7e74fc51', 'request_id': 'req-af4c90db-0119-4805-8af6-509a42ad633e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:26.817673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-af4c90db-0119-4805-8af6-509a42ad633e admin admin] The token cache is being invalidate because project c248bcc7947447f394c77cce7e74fc51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:26.818666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-af4c90db-0119-4805-8af6-509a42ad633e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:26.819780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-af4c90db-0119-4805-8af6-509a42ad633e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:26.823498 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2741/5433] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:26 2022] DELETE /identity/v3/projects/c248bcc7947447f394c77cce7e74fc51 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:26.824451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f7802229-19c7-4749-8323-22d77476a91f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e45ca9d6df3040eeabfb8de178fb9eef'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:26.826858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f7802229-19c7-4749-8323-22d77476a91f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e45ca9d6df3040eeabfb8de178fb9eef'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:26.835025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d5edf-3c8e-4bc9-9189-0bc782b7b449 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:26.835871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d5edf-3c8e-4bc9-9189-0bc782b7b449 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:26.836515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d5edf-3c8e-4bc9-9189-0bc782b7b449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:26.876538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f7802229-19c7-4749-8323-22d77476a91f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e45ca9d6df3040eeabfb8de178fb9eef'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:26.877861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f7802229-19c7-4749-8323-22d77476a91f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e45ca9d6df3040eeabfb8de178fb9eef'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:26.884805 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2693/5434] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:20:26 2022] PATCH /identity/v3/domains/e45ca9d6df3040eeabfb8de178fb9eef => generated 249 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:26.885695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b38d5edf-3c8e-4bc9-9189-0bc782b7b449 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:26.885855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7802229-19c7-4749-8323-22d77476a91f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:26.887397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f7802229-19c7-4749-8323-22d77476a91f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:26.887855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b38d5edf-3c8e-4bc9-9189-0bc782b7b449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:26.957902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:27.027965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:27.063697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7802229-19c7-4749-8323-22d77476a91f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:27.074655 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2742/5435] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:27.075813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d5edf-3c8e-4bc9-9189-0bc782b7b449 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:27.078629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b38d5edf-3c8e-4bc9-9189-0bc782b7b449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:27.089369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4f55a-6b13-4346-9881-b50304b654fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:27.092127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4f55a-6b13-4346-9881-b50304b654fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:27.093193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4f55a-6b13-4346-9881-b50304b654fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:27.093658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4f55a-6b13-4346-9881-b50304b654fa admin admin] PATH_INFO: `/v3/projects/949efa2215b34642aec9acf6553c2d52` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:27.098860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4f55a-6b13-4346-9881-b50304b654fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=949efa2215b34642aec9acf6553c2d52)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:27.101268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4f55a-6b13-4346-9881-b50304b654fa admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:27.224507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d5edf-3c8e-4bc9-9189-0bc782b7b449 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:27.230286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-30d4f55a-6b13-4346-9881-b50304b654fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '949efa2215b34642aec9acf6553c2d52', 'request_id': 'req-30d4f55a-6b13-4346-9881-b50304b654fa'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:27.247188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-30d4f55a-6b13-4346-9881-b50304b654fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '949efa2215b34642aec9acf6553c2d52', 'request_id': 'req-30d4f55a-6b13-4346-9881-b50304b654fa'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:27.276141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-30d4f55a-6b13-4346-9881-b50304b654fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '949efa2215b34642aec9acf6553c2d52', 'request_id': 'req-30d4f55a-6b13-4346-9881-b50304b654fa'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:27.314897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-30d4f55a-6b13-4346-9881-b50304b654fa admin admin] The token cache is being invalidate because project 949efa2215b34642aec9acf6553c2d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:27.315279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-30d4f55a-6b13-4346-9881-b50304b654fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:27.318026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-30d4f55a-6b13-4346-9881-b50304b654fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:27.334356 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2694/5436] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:26 2022] DELETE /identity/v3/projects/949efa2215b34642aec9acf6553c2d52 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:27.335962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869ef0d-b755-4492-b156-4dbb59406763 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:27.336209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869ef0d-b755-4492-b156-4dbb59406763 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:27.336488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869ef0d-b755-4492-b156-4dbb59406763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:27.423338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e869ef0d-b755-4492-b156-4dbb59406763 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:27.431560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e869ef0d-b755-4492-b156-4dbb59406763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:27.446867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7a2ec-2913-4d9d-ab03-5f63f514939d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:27.449894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7a2ec-2913-4d9d-ab03-5f63f514939d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:27.450128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7a2ec-2913-4d9d-ab03-5f63f514939d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:27.450391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7a2ec-2913-4d9d-ab03-5f63f514939d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains/e45ca9d6df3040eeabfb8de178fb9eef` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:27.487701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7a2ec-2913-4d9d-ab03-5f63f514939d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e45ca9d6df3040eeabfb8de178fb9eef)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:27.489350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7a2ec-2913-4d9d-ab03-5f63f514939d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:27.554231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46e7a2ec-2913-4d9d-ab03-5f63f514939d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e45ca9d6df3040eeabfb8de178fb9eef'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:27.565776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46e7a2ec-2913-4d9d-ab03-5f63f514939d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e45ca9d6df3040eeabfb8de178fb9eef'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:27.606488 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2695/5437] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:27.608023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cbeed-58bb-4b98-b063-08687edc101f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:27.608309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cbeed-58bb-4b98-b063-08687edc101f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:27.608613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cbeed-58bb-4b98-b063-08687edc101f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:27.675635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-717cbeed-58bb-4b98-b063-08687edc101f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:27.677687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-717cbeed-58bb-4b98-b063-08687edc101f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:27.682610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:27.693792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46e7a2ec-2913-4d9d-ab03-5f63f514939d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45ca9d6df3040eeabfb8de178fb9eef', 'request_id': 'req-46e7a2ec-2913-4d9d-ab03-5f63f514939d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:27.703641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46e7a2ec-2913-4d9d-ab03-5f63f514939d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45ca9d6df3040eeabfb8de178fb9eef', 'request_id': 'req-46e7a2ec-2913-4d9d-ab03-5f63f514939d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:27.720473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46e7a2ec-2913-4d9d-ab03-5f63f514939d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45ca9d6df3040eeabfb8de178fb9eef', 'request_id': 'req-46e7a2ec-2913-4d9d-ab03-5f63f514939d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:27.773022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46e7a2ec-2913-4d9d-ab03-5f63f514939d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] The token cache is being invalidate because project e45ca9d6df3040eeabfb8de178fb9eef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:27.774020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46e7a2ec-2913-4d9d-ab03-5f63f514939d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:27.776431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46e7a2ec-2913-4d9d-ab03-5f63f514939d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:27.797383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46e7a2ec-2913-4d9d-ab03-5f63f514939d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e45ca9d6df3040eeabfb8de178fb9eef', 'request_id': 'req-46e7a2ec-2913-4d9d-ab03-5f63f514939d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:27.800471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46e7a2ec-2913-4d9d-ab03-5f63f514939d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e45ca9d6df3040eeabfb8de178fb9eef', 'request_id': 'req-46e7a2ec-2913-4d9d-ab03-5f63f514939d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:27.802257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46e7a2ec-2913-4d9d-ab03-5f63f514939d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e45ca9d6df3040eeabfb8de178fb9eef', 'request_id': 'req-46e7a2ec-2913-4d9d-ab03-5f63f514939d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:27.817725 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2743/5438] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:20:27 2022] DELETE /identity/v3/domains/e45ca9d6df3040eeabfb8de178fb9eef => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:27.819647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7a2ec-2913-4d9d-ab03-5f63f514939d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:27.821559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-46e7a2ec-2913-4d9d-ab03-5f63f514939d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:27.831340 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2696/5439] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:27.831340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cbeed-58bb-4b98-b063-08687edc101f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:27.831340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-717cbeed-58bb-4b98-b063-08687edc101f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:27.851491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cbeed-58bb-4b98-b063-08687edc101f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:27.859509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828907a0-354d-44ed-a85d-03c889ec322e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:27.860179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828907a0-354d-44ed-a85d-03c889ec322e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:27.860468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828907a0-354d-44ed-a85d-03c889ec322e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:27.860750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828907a0-354d-44ed-a85d-03c889ec322e admin admin] PATH_INFO: `/v3/users/f47f4199d21f4028840c0d31dc321992` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:27.863456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828907a0-354d-44ed-a85d-03c889ec322e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f47f4199d21f4028840c0d31dc321992)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:27.865652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828907a0-354d-44ed-a85d-03c889ec322e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:27.866826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7a2ec-2913-4d9d-ab03-5f63f514939d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:27.874730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea2f0b-2123-446f-88f5-abe63f7186db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:27.876406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea2f0b-2123-446f-88f5-abe63f7186db admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:27.878350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea2f0b-2123-446f-88f5-abe63f7186db admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:27.879327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea2f0b-2123-446f-88f5-abe63f7186db admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:27.883331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea2f0b-2123-446f-88f5-abe63f7186db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:20:27.884157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea2f0b-2123-446f-88f5-abe63f7186db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:27.890876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea2f0b-2123-446f-88f5-abe63f7186db admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:27.891920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:27.914360 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2744/5440] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:27.915970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea2f0b-2123-446f-88f5-abe63f7186db admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:27.919405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-caea2f0b-2123-446f-88f5-abe63f7186db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:27.990496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-828907a0-354d-44ed-a85d-03c889ec322e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f47f4199d21f4028840c0d31dc321992'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:27.991919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-828907a0-354d-44ed-a85d-03c889ec322e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f47f4199d21f4028840c0d31dc321992'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:28.035711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-828907a0-354d-44ed-a85d-03c889ec322e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f47f4199d21f4028840c0d31dc321992'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:28.036548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-828907a0-354d-44ed-a85d-03c889ec322e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f47f4199d21f4028840c0d31dc321992'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:28.055114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea2f0b-2123-446f-88f5-abe63f7186db admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:28.060346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-828907a0-354d-44ed-a85d-03c889ec322e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f47f4199d21f4028840c0d31dc321992'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:28.061786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76ab77-c80c-4733-85b4-b93ff39f3b67 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:28.062785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76ab77-c80c-4733-85b4-b93ff39f3b67 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:28.063336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76ab77-c80c-4733-85b4-b93ff39f3b67 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:28.063614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76ab77-c80c-4733-85b4-b93ff39f3b67 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:28.065403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76ab77-c80c-4733-85b4-b93ff39f3b67 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:28.068069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76ab77-c80c-4733-85b4-b93ff39f3b67 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:28.090017 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2697/5441] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:27 2022] DELETE /identity/v3/users/f47f4199d21f4028840c0d31dc321992 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:28.093186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8804ba8-3daa-4238-8443-28c119a79b60 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:28.093666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8804ba8-3daa-4238-8443-28c119a79b60 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:28.093969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8804ba8-3daa-4238-8443-28c119a79b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:28.114608 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2745/5442] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:20:27 2022] POST /identity/v3/domains => generated 278 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:28.116923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76ab77-c80c-4733-85b4-b93ff39f3b67 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:28.122051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fb76ab77-c80c-4733-85b4-b93ff39f3b67 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:28.126390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d8804ba8-3daa-4238-8443-28c119a79b60 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:28.128203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d8804ba8-3daa-4238-8443-28c119a79b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:28.216601 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2698/5443] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:28.216601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026674a1-177e-44ed-8f94-8dd1c186fe35 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:28.216601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026674a1-177e-44ed-8f94-8dd1c186fe35 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:28.216601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026674a1-177e-44ed-8f94-8dd1c186fe35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:28.243628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-026674a1-177e-44ed-8f94-8dd1c186fe35 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:28.244789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-026674a1-177e-44ed-8f94-8dd1c186fe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:28.264758 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2699/5444] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:28.265917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026674a1-177e-44ed-8f94-8dd1c186fe35 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:28.270900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-026674a1-177e-44ed-8f94-8dd1c186fe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:28.298423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76ab77-c80c-4733-85b4-b93ff39f3b67 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:28.319077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab4684-e741-4133-aae4-fd0cbb421cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:28.319865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab4684-e741-4133-aae4-fd0cbb421cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:28.320808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab4684-e741-4133-aae4-fd0cbb421cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:28.321998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab4684-e741-4133-aae4-fd0cbb421cd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:28.323085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab4684-e741-4133-aae4-fd0cbb421cd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:28.328641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab4684-e741-4133-aae4-fd0cbb421cd3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:28.396582 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2746/5445] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:28 2022] POST /identity/v3/projects => generated 385 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:28.396582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab4684-e741-4133-aae4-fd0cbb421cd3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:28.462354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:28.469396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026674a1-177e-44ed-8f94-8dd1c186fe35 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:28.553887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:28.575200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab4684-e741-4133-aae4-fd0cbb421cd3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:28.587395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cb44b-bfed-4e87-9233-e848e0c59859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:28.587807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cb44b-bfed-4e87-9233-e848e0c59859 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:28.588105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cb44b-bfed-4e87-9233-e848e0c59859 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:28.588399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cb44b-bfed-4e87-9233-e848e0c59859 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:28.589118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cb44b-bfed-4e87-9233-e848e0c59859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:20:28.590177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cb44b-bfed-4e87-9233-e848e0c59859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:28.591148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cb44b-bfed-4e87-9233-e848e0c59859 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:28.626157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bfd22-d6b5-4ca0-ae67-e7db24c21d05 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:28.627434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bfd22-d6b5-4ca0-ae67-e7db24c21d05 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:28.627903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bfd22-d6b5-4ca0-ae67-e7db24c21d05 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:28.628382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bfd22-d6b5-4ca0-ae67-e7db24c21d05 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains/71d1146d4118448880635aa8af89a54a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:28.633886 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2747/5446] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:28.634923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cb44b-bfed-4e87-9233-e848e0c59859 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:28.640174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-828cb44b-bfed-4e87-9233-e848e0c59859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:28.667958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7bfd22-d6b5-4ca0-ae67-e7db24c21d05 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=71d1146d4118448880635aa8af89a54a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:28.671574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7bfd22-d6b5-4ca0-ae67-e7db24c21d05 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:28.712813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1a7bfd22-d6b5-4ca0-ae67-e7db24c21d05 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '71d1146d4118448880635aa8af89a54a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:28.714607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1a7bfd22-d6b5-4ca0-ae67-e7db24c21d05 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '71d1146d4118448880635aa8af89a54a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:28.779699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1a7bfd22-d6b5-4ca0-ae67-e7db24c21d05 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '71d1146d4118448880635aa8af89a54a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:28.780365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cb44b-bfed-4e87-9233-e848e0c59859 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:28.781351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1a7bfd22-d6b5-4ca0-ae67-e7db24c21d05 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '71d1146d4118448880635aa8af89a54a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:28.788684 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2700/5447] 10.222.0.17 () {60 vars in 1250 bytes} [Sat Jul 30 21:20:28 2022] PATCH /identity/v3/domains/71d1146d4118448880635aa8af89a54a => generated 278 bytes in 520 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:28.789698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bfd22-d6b5-4ca0-ae67-e7db24c21d05 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:28.794680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1a7bfd22-d6b5-4ca0-ae67-e7db24c21d05 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:28.892189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bfd22-d6b5-4ca0-ae67-e7db24c21d05 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:28.893456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d47ea6-d57b-4063-8847-c0ee96c1789c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:28.894645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d47ea6-d57b-4063-8847-c0ee96c1789c service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:28.895204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d47ea6-d57b-4063-8847-c0ee96c1789c service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:28.895836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d47ea6-d57b-4063-8847-c0ee96c1789c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:28.898274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d1691-fffd-4223-845e-a0fb60207ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:28.899017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d1691-fffd-4223-845e-a0fb60207ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:28.899548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d1691-fffd-4223-845e-a0fb60207ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:28.899685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d1691-fffd-4223-845e-a0fb60207ef5 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:28.900444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d1691-fffd-4223-845e-a0fb60207ef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:28.903221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d1691-fffd-4223-845e-a0fb60207ef5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:28.919940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-90d47ea6-d57b-4063-8847-c0ee96c1789c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:28.932670 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2701/5448] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:28 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:28.933579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d1691-fffd-4223-845e-a0fb60207ef5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:28.940829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c79d1691-fffd-4223-845e-a0fb60207ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:28.956045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d47ea6-d57b-4063-8847-c0ee96c1789c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:28.957753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d47ea6-d57b-4063-8847-c0ee96c1789c service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:28.960477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d1691-fffd-4223-845e-a0fb60207ef5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:28.970949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35780173-de7e-42bf-b180-fa939a048ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:28.971933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35780173-de7e-42bf-b180-fa939a048ceb admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:28.972227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35780173-de7e-42bf-b180-fa939a048ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:28.973825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35780173-de7e-42bf-b180-fa939a048ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:28.975819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35780173-de7e-42bf-b180-fa939a048ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:28.977010 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2748/5449] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:28.978093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35780173-de7e-42bf-b180-fa939a048ceb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:28.978479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d47ea6-d57b-4063-8847-c0ee96c1789c service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:28.980635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-90d47ea6-d57b-4063-8847-c0ee96c1789c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:29.041430 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2702/5450] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:28 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:29.041430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35780173-de7e-42bf-b180-fa939a048ceb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:29.088067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d47ea6-d57b-4063-8847-c0ee96c1789c service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:29.118273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:29.195943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:29.203142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35780173-de7e-42bf-b180-fa939a048ceb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:29.216203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613edc7-cd77-48b7-bbad-0cc3a55f9856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:29.216907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613edc7-cd77-48b7-bbad-0cc3a55f9856 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:29.217052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613edc7-cd77-48b7-bbad-0cc3a55f9856 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:29.217315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613edc7-cd77-48b7-bbad-0cc3a55f9856 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:29.219652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613edc7-cd77-48b7-bbad-0cc3a55f9856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:29.227327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613edc7-cd77-48b7-bbad-0cc3a55f9856 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:29.241473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a34ac-cd88-4461-967a-733fb3a18064 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:29.242413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a34ac-cd88-4461-967a-733fb3a18064 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:29.242413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a34ac-cd88-4461-967a-733fb3a18064 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:29.242775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a34ac-cd88-4461-967a-733fb3a18064 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains/71d1146d4118448880635aa8af89a54a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:29.255196 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2703/5451] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:29.255196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613edc7-cd77-48b7-bbad-0cc3a55f9856 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:29.272573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a34ac-cd88-4461-967a-733fb3a18064 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=71d1146d4118448880635aa8af89a54a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:29.278407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a34ac-cd88-4461-967a-733fb3a18064 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:29.284467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613edc7-cd77-48b7-bbad-0cc3a55f9856 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:29.285526 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2749/5452] 10.222.0.17 () {58 vars in 1227 bytes} [Sat Jul 30 21:20:28 2022] GET /identity/v3/domains/71d1146d4118448880635aa8af89a54a => generated 278 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:29.288040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a34ac-cd88-4461-967a-733fb3a18064 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:29.298338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601acdb-98d4-4388-9baf-6d8a2dda8375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:29.299355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601acdb-98d4-4388-9baf-6d8a2dda8375 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:29.299888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601acdb-98d4-4388-9baf-6d8a2dda8375 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:29.300394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601acdb-98d4-4388-9baf-6d8a2dda8375 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:29.301087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601acdb-98d4-4388-9baf-6d8a2dda8375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:29.303355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601acdb-98d4-4388-9baf-6d8a2dda8375 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:29.310063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a34ac-cd88-4461-967a-733fb3a18064 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:29.319388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610659e6-ece8-40a0-aa75-1eba9767f55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:29.321655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610659e6-ece8-40a0-aa75-1eba9767f55f admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:29.322382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610659e6-ece8-40a0-aa75-1eba9767f55f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:29.322702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610659e6-ece8-40a0-aa75-1eba9767f55f admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:29.323395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610659e6-ece8-40a0-aa75-1eba9767f55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:29.325954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610659e6-ece8-40a0-aa75-1eba9767f55f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:29.346787 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2750/5453] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:29.346787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610659e6-ece8-40a0-aa75-1eba9767f55f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:29.353058 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2704/5454] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:29 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:29.355579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601acdb-98d4-4388-9baf-6d8a2dda8375 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:29.378467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601acdb-98d4-4388-9baf-6d8a2dda8375 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:29.386128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610659e6-ece8-40a0-aa75-1eba9767f55f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:29.391184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbe1c1-91de-44fd-81d0-523f13866cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:29.395648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbe1c1-91de-44fd-81d0-523f13866cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:29.399013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbe1c1-91de-44fd-81d0-523f13866cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:29.401023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbe1c1-91de-44fd-81d0-523f13866cfd admin admin] PATH_INFO: `/v3/projects/5850a54af6204e2f83d8e61141a04013/users/6896ccb6369541d5a552f3373f39c64d/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:29.413089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9322d-e521-42e4-b7c5-e133be9145e2 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:29.414374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9322d-e521-42e4-b7c5-e133be9145e2 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:29.415125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9322d-e521-42e4-b7c5-e133be9145e2 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:29.416591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9322d-e521-42e4-b7c5-e133be9145e2 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains/71d1146d4118448880635aa8af89a54a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:29.425349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9322d-e521-42e4-b7c5-e133be9145e2 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=71d1146d4118448880635aa8af89a54a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:29.430409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9322d-e521-42e4-b7c5-e133be9145e2 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:29.454421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbe1c1-91de-44fd-81d0-523f13866cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5850a54af6204e2f83d8e61141a04013, user_id=6896ccb6369541d5a552f3373f39c64d, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:29.471038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbe1c1-91de-44fd-81d0-523f13866cfd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:29.490002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-76f9322d-e521-42e4-b7c5-e133be9145e2 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '71d1146d4118448880635aa8af89a54a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:29.495635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-76f9322d-e521-42e4-b7c5-e133be9145e2 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '71d1146d4118448880635aa8af89a54a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:29.519493 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2705/5455] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:29 2022] PUT /identity/v3/projects/5850a54af6204e2f83d8e61141a04013/users/6896ccb6369541d5a552f3373f39c64d/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:29.521054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbe1c1-91de-44fd-81d0-523f13866cfd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:29.640993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-76f9322d-e521-42e4-b7c5-e133be9145e2 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d1146d4118448880635aa8af89a54a', 'request_id': 'req-76f9322d-e521-42e4-b7c5-e133be9145e2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:29.662855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-76f9322d-e521-42e4-b7c5-e133be9145e2 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d1146d4118448880635aa8af89a54a', 'request_id': 'req-76f9322d-e521-42e4-b7c5-e133be9145e2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:29.679019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-76f9322d-e521-42e4-b7c5-e133be9145e2 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d1146d4118448880635aa8af89a54a', 'request_id': 'req-76f9322d-e521-42e4-b7c5-e133be9145e2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:29.683267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbe1c1-91de-44fd-81d0-523f13866cfd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:29.699101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-76f9322d-e521-42e4-b7c5-e133be9145e2 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] The token cache is being invalidate because project 71d1146d4118448880635aa8af89a54a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:29.699980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-76f9322d-e521-42e4-b7c5-e133be9145e2 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:29.700991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-76f9322d-e521-42e4-b7c5-e133be9145e2 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:29.715128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-76f9322d-e521-42e4-b7c5-e133be9145e2 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '71d1146d4118448880635aa8af89a54a', 'request_id': 'req-76f9322d-e521-42e4-b7c5-e133be9145e2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:29.716325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-76f9322d-e521-42e4-b7c5-e133be9145e2 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '71d1146d4118448880635aa8af89a54a', 'request_id': 'req-76f9322d-e521-42e4-b7c5-e133be9145e2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:29.718923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-76f9322d-e521-42e4-b7c5-e133be9145e2 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '71d1146d4118448880635aa8af89a54a', 'request_id': 'req-76f9322d-e521-42e4-b7c5-e133be9145e2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:29.733714 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2751/5456] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:20:29 2022] DELETE /identity/v3/domains/71d1146d4118448880635aa8af89a54a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:29.733714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbb9ab-2396-4d72-9638-972b89ee5250 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:29.733714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbb9ab-2396-4d72-9638-972b89ee5250 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:29.733714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbb9ab-2396-4d72-9638-972b89ee5250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:29.768315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8bdbb9ab-2396-4d72-9638-972b89ee5250 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:29.770453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8bdbb9ab-2396-4d72-9638-972b89ee5250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:29.820739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:29.838924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aae2c7-6f19-4453-bcd4-140c8430d27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:29.840925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aae2c7-6f19-4453-bcd4-140c8430d27a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:29.841698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aae2c7-6f19-4453-bcd4-140c8430d27a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:29.842191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aae2c7-6f19-4453-bcd4-140c8430d27a admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:29.843049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aae2c7-6f19-4453-bcd4-140c8430d27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:29.849031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aae2c7-6f19-4453-bcd4-140c8430d27a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:29.886178 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2706/5457] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:29.896484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aae2c7-6f19-4453-bcd4-140c8430d27a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:29.901001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f5aae2c7-6f19-4453-bcd4-140c8430d27a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:29.906862 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2752/5458] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:29.908746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbb9ab-2396-4d72-9638-972b89ee5250 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:29.913676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8bdbb9ab-2396-4d72-9638-972b89ee5250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:29.934134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbb9ab-2396-4d72-9638-972b89ee5250 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:29.941150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d878ba3-e16e-4247-a385-ebf8b65ecfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:29.941795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d878ba3-e16e-4247-a385-ebf8b65ecfbd admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:29.942211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d878ba3-e16e-4247-a385-ebf8b65ecfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:29.942607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d878ba3-e16e-4247-a385-ebf8b65ecfbd admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:29.943209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d878ba3-e16e-4247-a385-ebf8b65ecfbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:29.944887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d878ba3-e16e-4247-a385-ebf8b65ecfbd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:29.959762 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2753/5459] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:29.960566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d878ba3-e16e-4247-a385-ebf8b65ecfbd admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:29.966337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0d878ba3-e16e-4247-a385-ebf8b65ecfbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:30.086911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:30.098079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aae2c7-6f19-4453-bcd4-140c8430d27a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:30.119598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de24ccf-26c4-421f-a2d2-b7e9db852480 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:30.120349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de24ccf-26c4-421f-a2d2-b7e9db852480 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:30.120598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de24ccf-26c4-421f-a2d2-b7e9db852480 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:30.120869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de24ccf-26c4-421f-a2d2-b7e9db852480 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:30.121629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de24ccf-26c4-421f-a2d2-b7e9db852480 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:30.123821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de24ccf-26c4-421f-a2d2-b7e9db852480 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:30.126162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d878ba3-e16e-4247-a385-ebf8b65ecfbd admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:30.138141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065427d1-90a2-4fb9-96e0-04b661f5a657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:30.139271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065427d1-90a2-4fb9-96e0-04b661f5a657 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:30.139271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065427d1-90a2-4fb9-96e0-04b661f5a657 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:30.139271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065427d1-90a2-4fb9-96e0-04b661f5a657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:30.167945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065427d1-90a2-4fb9-96e0-04b661f5a657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:30.169705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065427d1-90a2-4fb9-96e0-04b661f5a657 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:30.172863 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2707/5460] 10.222.0.17 () {58 vars in 1128 bytes} [Sat Jul 30 21:20:29 2022] GET /identity/v3/domains => generated 1344 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:30.176349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de24ccf-26c4-421f-a2d2-b7e9db852480 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:30.257878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de24ccf-26c4-421f-a2d2-b7e9db852480 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:30.258782 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2754/5461] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:30.258944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ab4e4-08b2-45e6-8162-fa5b9567b1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:30.262594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065427d1-90a2-4fb9-96e0-04b661f5a657 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:30.263060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ab4e4-08b2-45e6-8162-fa5b9567b1a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:30.263060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ab4e4-08b2-45e6-8162-fa5b9567b1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:30.263060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ab4e4-08b2-45e6-8162-fa5b9567b1a7 admin admin] PATH_INFO: `/v3/projects/925a2d0bbe0649d3af58710271baa448/users/c196700f74a54093aa923b505a29fcac/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:30.263725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065427d1-90a2-4fb9-96e0-04b661f5a657 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:30.263845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ab4e4-08b2-45e6-8162-fa5b9567b1a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=925a2d0bbe0649d3af58710271baa448, user_id=c196700f74a54093aa923b505a29fcac, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:30.263845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ab4e4-08b2-45e6-8162-fa5b9567b1a7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:30.270237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fa8c2-9278-448b-b5d3-6a9e37814218 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:30.270237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fa8c2-9278-448b-b5d3-6a9e37814218 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:30.270237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fa8c2-9278-448b-b5d3-6a9e37814218 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:30.271972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fa8c2-9278-448b-b5d3-6a9e37814218 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains/71d1146d4118448880635aa8af89a54a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:30.290751 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2708/5462] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:30 2022] PUT /identity/v3/projects/925a2d0bbe0649d3af58710271baa448/users/c196700f74a54093aa923b505a29fcac/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:30.296498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b94586-2417-4959-923f-601ac415a685 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:30.297148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b94586-2417-4959-923f-601ac415a685 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:30.297663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b94586-2417-4959-923f-601ac415a685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:30.324316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fa8c2-9278-448b-b5d3-6a9e37814218 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 21:20:30.336609 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-f67fa8c2-9278-448b-b5d3-6a9e37814218 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Could not find domain: 71d1146d4118448880635aa8af89a54a.: keystone.exception.DomainNotFound: Could not find domain: 71d1146d4118448880635aa8af89a54a. Jul 30 21:20:30.336609 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:20:30.336609 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 30 21:20:30.336609 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 30 21:20:30.336609 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 21:20:30.336609 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 21:20:30.336609 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 21:20:30.336609 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 21:20:30.336609 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 71d1146d4118448880635aa8af89a54a. Jul 30 21:20:30.336609 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:20:30.336609 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:20:30.336609 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:20:30.336609 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:20:30.336609 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:20:30.336609 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:20:30.336609 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:20:30.337806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:20:30.337806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:20:30.337806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:20:30.337806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:20:30.337806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:20:30.337806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:20:30.337806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:20:30.337806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 30 21:20:30.337806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 30 21:20:30.337806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 21:20:30.337806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 21:20:30.337806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 21:20:30.337806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 21:20:30.337806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:20:30.337806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:20:30.337806 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:20:30.338768 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:20:30.338768 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:20:30.338768 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:20:30.338768 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:20:30.338768 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 21:20:30.338768 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:20:30.338768 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:20:30.338768 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:20:30.338768 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:20:30.338768 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:20:30.338768 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:20:30.338768 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:20:30.338768 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:20:30.338768 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 30 21:20:30.338768 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 21:20:30.338768 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 71d1146d4118448880635aa8af89a54a. Jul 30 21:20:30.338768 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:20:30.342898 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2755/5463] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:20:30 2022] PATCH /identity/v3/domains/71d1146d4118448880635aa8af89a54a => generated 112 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:20:30.359387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fa8c2-9278-448b-b5d3-6a9e37814218 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:30.384074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fa8c2-9278-448b-b5d3-6a9e37814218 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:30.397731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d5b94586-2417-4959-923f-601ac415a685 None None] MFA Rules not processed for user `c196700f74a54093aa923b505a29fcac`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:30.406937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d5b94586-2417-4959-923f-601ac415a685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:30.577508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00e87b-0fb2-4dbf-83c0-54e976108adc tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:30.579210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00e87b-0fb2-4dbf-83c0-54e976108adc tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:30.580723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00e87b-0fb2-4dbf-83c0-54e976108adc tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:30.581287 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2709/5464] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:20:30.581414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00e87b-0fb2-4dbf-83c0-54e976108adc tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:30.582097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00e87b-0fb2-4dbf-83c0-54e976108adc tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:30.583969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00e87b-0fb2-4dbf-83c0-54e976108adc tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:30.586164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b94586-2417-4959-923f-601ac415a685 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:30.604550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b94586-2417-4959-923f-601ac415a685 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:30.624616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055374d-bdf9-413d-88b4-48b607e5b012 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c196700f74a54093aa923b505a29fcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '925a2d0bbe0649d3af58710271baa448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:30.625325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055374d-bdf9-413d-88b4-48b607e5b012 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:30.625622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055374d-bdf9-413d-88b4-48b607e5b012 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:30.625972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055374d-bdf9-413d-88b4-48b607e5b012 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] PATH_INFO: `/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:30.626642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055374d-bdf9-413d-88b4-48b607e5b012 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=c196700f74a54093aa923b505a29fcac)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:30.628531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055374d-bdf9-413d-88b4-48b607e5b012 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:30.631335 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2756/5465] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:20:30 2022] POST /identity/v3/domains => generated 276 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:30.635548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00e87b-0fb2-4dbf-83c0-54e976108adc tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:30.690181 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2710/5466] 10.222.0.17 () {60 vars in 1299 bytes} [Sat Jul 30 21:20:30 2022] POST /identity/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2 => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:20:30.695075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055374d-bdf9-413d-88b4-48b607e5b012 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:30.713240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055374d-bdf9-413d-88b4-48b607e5b012 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:30.788876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:30.799368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00e87b-0fb2-4dbf-83c0-54e976108adc tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:30.812440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500de1b-39d8-40d7-8568-1232b11392eb tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:30.813276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500de1b-39d8-40d7-8568-1232b11392eb tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:30.814075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500de1b-39d8-40d7-8568-1232b11392eb tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:30.815026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500de1b-39d8-40d7-8568-1232b11392eb tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:30.816629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500de1b-39d8-40d7-8568-1232b11392eb tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:30.819199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500de1b-39d8-40d7-8568-1232b11392eb tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:30.866098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b54d1-dbab-4538-94bf-deff2d6c41ba tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c196700f74a54093aa923b505a29fcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '925a2d0bbe0649d3af58710271baa448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:30.868050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b54d1-dbab-4538-94bf-deff2d6c41ba tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:30.868380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b54d1-dbab-4538-94bf-deff2d6c41ba tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:30.870258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b54d1-dbab-4538-94bf-deff2d6c41ba tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] PATH_INFO: `/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2/174a8167ac034221bad97191f6ae5e8c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:30.878790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b54d1-dbab-4538-94bf-deff2d6c41ba tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=c196700f74a54093aa923b505a29fcac, credential_id=174a8167ac034221bad97191f6ae5e8c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:30.881596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b54d1-dbab-4538-94bf-deff2d6c41ba tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:30.905286 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2757/5467] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:30 2022] POST /identity/v3/users => generated 346 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:20:30.907416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500de1b-39d8-40d7-8568-1232b11392eb tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:30.910646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9500de1b-39d8-40d7-8568-1232b11392eb tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:30.932830 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2711/5468] 10.222.0.17 () {58 vars in 1380 bytes} [Sat Jul 30 21:20:30 2022] DELETE /identity/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2/174a8167ac034221bad97191f6ae5e8c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:30.932830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa959c-0744-4c63-b127-5906a70a9dbe None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:30.932830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa959c-0744-4c63-b127-5906a70a9dbe None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:30.933979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa959c-0744-4c63-b127-5906a70a9dbe None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:30.940688 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2712/5469] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:20:30 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:20:30.941413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa959c-0744-4c63-b127-5906a70a9dbe None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:30.980666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa959c-0744-4c63-b127-5906a70a9dbe None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:30.997283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f80036-4a5e-456a-a42d-e0532d5d650e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:30.997283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f80036-4a5e-456a-a42d-e0532d5d650e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:30.997515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f80036-4a5e-456a-a42d-e0532d5d650e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:30.997961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f80036-4a5e-456a-a42d-e0532d5d650e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/groups` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:31.000669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f80036-4a5e-456a-a42d-e0532d5d650e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:31.009476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f80036-4a5e-456a-a42d-e0532d5d650e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:31.045740 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2713/5470] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:20:30 2022] POST /identity/v3/groups => generated 324 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:31.046913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f80036-4a5e-456a-a42d-e0532d5d650e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:31.078754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f80036-4a5e-456a-a42d-e0532d5d650e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:31.080779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500de1b-39d8-40d7-8568-1232b11392eb tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:31.092374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2629e-436b-4c44-9ce6-b0b9f7834caf tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c196700f74a54093aa923b505a29fcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '925a2d0bbe0649d3af58710271baa448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:31.094926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2629e-436b-4c44-9ce6-b0b9f7834caf tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:31.095074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1e042-0aeb-4d89-82a5-b6c55c92a52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:31.095484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2629e-436b-4c44-9ce6-b0b9f7834caf tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:31.096445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1e042-0aeb-4d89-82a5-b6c55c92a52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:31.096814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2629e-436b-4c44-9ce6-b0b9f7834caf tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] PATH_INFO: `/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:31.096978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1e042-0aeb-4d89-82a5-b6c55c92a52f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:31.097523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1e042-0aeb-4d89-82a5-b6c55c92a52f admin admin] PATH_INFO: `/v3/projects/af8d952b52d9454c8c4cfe245a241727` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:31.099102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1e042-0aeb-4d89-82a5-b6c55c92a52f admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8d952b52d9454c8c4cfe245a241727)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:31.099254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2629e-436b-4c44-9ce6-b0b9f7834caf tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=c196700f74a54093aa923b505a29fcac)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:31.101630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1e042-0aeb-4d89-82a5-b6c55c92a52f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:31.102619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2629e-436b-4c44-9ce6-b0b9f7834caf tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:31.139327 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2714/5471] 10.222.0.17 () {60 vars in 1299 bytes} [Sat Jul 30 21:20:31 2022] POST /identity/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2 => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:31.140627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e801f0-98a7-4214-9670-c7cdda00f79d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:31.140932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e801f0-98a7-4214-9670-c7cdda00f79d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:31.141208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e801f0-98a7-4214-9670-c7cdda00f79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:31.190861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-40e801f0-98a7-4214-9670-c7cdda00f79d None None] MFA Rules not processed for user `4a886ccf9590432caf209526410a7b53`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:31.194065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-40e801f0-98a7-4214-9670-c7cdda00f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:31.211031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:31.225550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bed1e042-0aeb-4d89-82a5-b6c55c92a52f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8d952b52d9454c8c4cfe245a241727', 'request_id': 'req-bed1e042-0aeb-4d89-82a5-b6c55c92a52f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:31.248604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bed1e042-0aeb-4d89-82a5-b6c55c92a52f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8d952b52d9454c8c4cfe245a241727', 'request_id': 'req-bed1e042-0aeb-4d89-82a5-b6c55c92a52f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:31.272874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bed1e042-0aeb-4d89-82a5-b6c55c92a52f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8d952b52d9454c8c4cfe245a241727', 'request_id': 'req-bed1e042-0aeb-4d89-82a5-b6c55c92a52f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:31.299696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bed1e042-0aeb-4d89-82a5-b6c55c92a52f admin admin] The token cache is being invalidate because project af8d952b52d9454c8c4cfe245a241727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:31.300101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bed1e042-0aeb-4d89-82a5-b6c55c92a52f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:31.306546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bed1e042-0aeb-4d89-82a5-b6c55c92a52f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:31.318054 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2758/5472] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:30 2022] DELETE /identity/v3/projects/af8d952b52d9454c8c4cfe245a241727 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:31.318897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1e042-0aeb-4d89-82a5-b6c55c92a52f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:31.325520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bed1e042-0aeb-4d89-82a5-b6c55c92a52f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:31.385016 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2715/5473] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:31.386157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e801f0-98a7-4214-9670-c7cdda00f79d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:31.389372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-40e801f0-98a7-4214-9670-c7cdda00f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:31.459979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1e042-0aeb-4d89-82a5-b6c55c92a52f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:31.465470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c5433-5cd0-4134-958a-0ac75324cb8a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:31.466196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c5433-5cd0-4134-958a-0ac75324cb8a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:31.466593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c5433-5cd0-4134-958a-0ac75324cb8a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:31.466874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c5433-5cd0-4134-958a-0ac75324cb8a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains/7513f3e363cb4f17b709c088324d372f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:31.468445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c5433-5cd0-4134-958a-0ac75324cb8a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7513f3e363cb4f17b709c088324d372f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:31.470088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c5433-5cd0-4134-958a-0ac75324cb8a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:31.484428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:31.513230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-563c5433-5cd0-4134-958a-0ac75324cb8a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7513f3e363cb4f17b709c088324d372f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:31.518295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-563c5433-5cd0-4134-958a-0ac75324cb8a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7513f3e363cb4f17b709c088324d372f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:31.551951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e801f0-98a7-4214-9670-c7cdda00f79d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:31.580353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-563c5433-5cd0-4134-958a-0ac75324cb8a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7513f3e363cb4f17b709c088324d372f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:31.581925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-563c5433-5cd0-4134-958a-0ac75324cb8a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7513f3e363cb4f17b709c088324d372f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:31.589568 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2759/5474] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:20:31 2022] PATCH /identity/v3/domains/7513f3e363cb4f17b709c088324d372f => generated 277 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:31.591087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c5433-5cd0-4134-958a-0ac75324cb8a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:31.593396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-563c5433-5cd0-4134-958a-0ac75324cb8a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:31.678870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca6f6b-7193-455f-b42b-6033253bb809 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c196700f74a54093aa923b505a29fcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '925a2d0bbe0649d3af58710271baa448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:31.683646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca6f6b-7193-455f-b42b-6033253bb809 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:31.684232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca6f6b-7193-455f-b42b-6033253bb809 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:31.684767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca6f6b-7193-455f-b42b-6033253bb809 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] PATH_INFO: `/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2/534976b4b7184436b4e2a7ea9f86f387` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:31.693964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca6f6b-7193-455f-b42b-6033253bb809 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=c196700f74a54093aa923b505a29fcac, credential_id=534976b4b7184436b4e2a7ea9f86f387)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:31.698844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca6f6b-7193-455f-b42b-6033253bb809 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:31.726398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c5433-5cd0-4134-958a-0ac75324cb8a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:31.760204 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2716/5475] 10.222.0.17 () {58 vars in 1380 bytes} [Sat Jul 30 21:20:31 2022] DELETE /identity/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2/534976b4b7184436b4e2a7ea9f86f387 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:31.760861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff97de-9d56-4b32-baee-4babfcff311c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:31.761704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff97de-9d56-4b32-baee-4babfcff311c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:31.761998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff97de-9d56-4b32-baee-4babfcff311c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:31.762289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff97de-9d56-4b32-baee-4babfcff311c admin admin] PATH_INFO: `/v3/users/2a9b7906c58444889c80695dfdade78f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:31.762602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca6f6b-7193-455f-b42b-6033253bb809 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:31.765555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dbca6f6b-7193-455f-b42b-6033253bb809 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:31.775066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff97de-9d56-4b32-baee-4babfcff311c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a9b7906c58444889c80695dfdade78f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:31.781728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff97de-9d56-4b32-baee-4babfcff311c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:31.898722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca6f6b-7193-455f-b42b-6033253bb809 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:31.902768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c3ff97de-9d56-4b32-baee-4babfcff311c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a9b7906c58444889c80695dfdade78f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:31.908291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4f105-af84-44b7-a2da-0468c916f3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:31.909439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4f105-af84-44b7-a2da-0468c916f3bc service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:31.909439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4f105-af84-44b7-a2da-0468c916f3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:31.909905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4f105-af84-44b7-a2da-0468c916f3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:31.916024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-00f4f105-af84-44b7-a2da-0468c916f3bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:31.936958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c3ff97de-9d56-4b32-baee-4babfcff311c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a9b7906c58444889c80695dfdade78f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:31.937798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c3ff97de-9d56-4b32-baee-4babfcff311c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a9b7906c58444889c80695dfdade78f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:31.938161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4f105-af84-44b7-a2da-0468c916f3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:31.940522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4f105-af84-44b7-a2da-0468c916f3bc service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:31.954433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c3ff97de-9d56-4b32-baee-4babfcff311c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a9b7906c58444889c80695dfdade78f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:31.955856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c3ff97de-9d56-4b32-baee-4babfcff311c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a9b7906c58444889c80695dfdade78f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:31.963963 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2717/5476] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:31.965180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4f105-af84-44b7-a2da-0468c916f3bc service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:31.968850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-00f4f105-af84-44b7-a2da-0468c916f3bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:31.999916 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2760/5477] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:31 2022] DELETE /identity/v3/users/2a9b7906c58444889c80695dfdade78f => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:32.002183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff97de-9d56-4b32-baee-4babfcff311c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:32.009900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c3ff97de-9d56-4b32-baee-4babfcff311c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:32.055331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:32.151616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:32.175459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff97de-9d56-4b32-baee-4babfcff311c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:32.192061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d2d8b-7dff-46bb-8a5f-20f4c4a2ee1d tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c196700f74a54093aa923b505a29fcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '925a2d0bbe0649d3af58710271baa448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:32.192839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d2d8b-7dff-46bb-8a5f-20f4c4a2ee1d tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:32.194780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d2d8b-7dff-46bb-8a5f-20f4c4a2ee1d tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:32.195752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d2d8b-7dff-46bb-8a5f-20f4c4a2ee1d tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] PATH_INFO: `/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2/534976b4b7184436b4e2a7ea9f86f387` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:32.246350 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-663d2d8b-7dff-46bb-8a5f-20f4c4a2ee1d tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Could not find credential: 57f1b052bcdb9ff95dec1211bd5a0bd69bd62dedb17606383ba5cd2eec0a57ae.: keystone.exception.CredentialNotFound: Could not find credential: 57f1b052bcdb9ff95dec1211bd5a0bd69bd62dedb17606383ba5cd2eec0a57ae. Jul 30 21:20:32.246350 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:20:32.246350 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:20:32.246350 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:20:32.246350 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:20:32.246350 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:20:32.246350 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:20:32.246350 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:20:32.246350 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:20:32.246350 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:20:32.246350 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:20:32.246350 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:20:32.246350 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Jul 30 21:20:32.246350 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 30 21:20:32.247902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 30 21:20:32.247902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 30 21:20:32.247902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Jul 30 21:20:32.247902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Jul 30 21:20:32.247902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:20:32.247902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:20:32.247902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Jul 30 21:20:32.247902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Jul 30 21:20:32.247902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:20:32.247902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:20:32.247902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:20:32.247902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:20:32.247902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:20:32.247902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 21:20:32.247902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:20:32.247902 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:20:32.249225 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:20:32.249225 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:20:32.249225 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:20:32.249225 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:20:32.249225 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:20:32.249225 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:20:32.249225 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Jul 30 21:20:32.249225 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Jul 30 21:20:32.249225 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Jul 30 21:20:32.249225 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Jul 30 21:20:32.249225 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Jul 30 21:20:32.249225 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Jul 30 21:20:32.249225 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 57f1b052bcdb9ff95dec1211bd5a0bd69bd62dedb17606383ba5cd2eec0a57ae. Jul 30 21:20:32.249225 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:20:32.249225 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2761/5478] 10.222.0.17 () {58 vars in 1377 bytes} [Sat Jul 30 21:20:32 2022] GET /identity/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2/534976b4b7184436b4e2a7ea9f86f387 => generated 148 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:20:32.256835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d2d8b-7dff-46bb-8a5f-20f4c4a2ee1d tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:32.286053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d2d8b-7dff-46bb-8a5f-20f4c4a2ee1d tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:32.323727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db5160-e7f2-4387-8720-fbf78d03169e tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c196700f74a54093aa923b505a29fcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '925a2d0bbe0649d3af58710271baa448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:32.324388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db5160-e7f2-4387-8720-fbf78d03169e tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:32.324703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db5160-e7f2-4387-8720-fbf78d03169e tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:32.324984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db5160-e7f2-4387-8720-fbf78d03169e tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] PATH_INFO: `/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:32.330805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db5160-e7f2-4387-8720-fbf78d03169e tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=c196700f74a54093aa923b505a29fcac)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:32.334806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4f105-af84-44b7-a2da-0468c916f3bc service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:32.341807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db5160-e7f2-4387-8720-fbf78d03169e tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:32.396369 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2762/5479] 10.222.0.17 () {60 vars in 1299 bytes} [Sat Jul 30 21:20:32 2022] POST /identity/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2 => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:32.398579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db5160-e7f2-4387-8720-fbf78d03169e tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:32.435735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db5160-e7f2-4387-8720-fbf78d03169e tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:32.469751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6dba3b-020b-47fd-9355-469863d2f2a9 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c196700f74a54093aa923b505a29fcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '925a2d0bbe0649d3af58710271baa448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:32.473745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dba3b-020b-47fd-9355-469863d2f2a9 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:32.476353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dba3b-020b-47fd-9355-469863d2f2a9 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:32.477069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dba3b-020b-47fd-9355-469863d2f2a9 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] PATH_INFO: `/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:32.478887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6dba3b-020b-47fd-9355-469863d2f2a9 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=c196700f74a54093aa923b505a29fcac)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:32.484550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6dba3b-020b-47fd-9355-469863d2f2a9 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:32.579400 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2763/5480] 10.222.0.17 () {60 vars in 1299 bytes} [Sat Jul 30 21:20:32 2022] POST /identity/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2 => generated 367 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:32.579400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6dba3b-020b-47fd-9355-469863d2f2a9 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:32.582436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:32.582436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:32.582436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:32.591037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains/7513f3e363cb4f17b709c088324d372f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:32.649661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7513f3e363cb4f17b709c088324d372f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:32.650747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6dba3b-020b-47fd-9355-469863d2f2a9 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:32.651340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:32.667199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c13b75-3253-450a-8d8a-a3b0ae297e3b tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c196700f74a54093aa923b505a29fcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '925a2d0bbe0649d3af58710271baa448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:32.668465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c13b75-3253-450a-8d8a-a3b0ae297e3b tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:32.668967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c13b75-3253-450a-8d8a-a3b0ae297e3b tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:32.669958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c13b75-3253-450a-8d8a-a3b0ae297e3b tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] PATH_INFO: `/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:32.671720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c13b75-3253-450a-8d8a-a3b0ae297e3b tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=c196700f74a54093aa923b505a29fcac)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:32.676161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c13b75-3253-450a-8d8a-a3b0ae297e3b tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:32.725510 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2764/5481] 10.222.0.17 () {58 vars in 1278 bytes} [Sat Jul 30 21:20:32 2022] GET /identity/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2 => generated 865 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:32.731122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7513f3e363cb4f17b709c088324d372f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:32.735406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c13b75-3253-450a-8d8a-a3b0ae297e3b tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:32.741783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7513f3e363cb4f17b709c088324d372f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:32.791372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c13b75-3253-450a-8d8a-a3b0ae297e3b tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:32.799162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b30ca5-6a45-4308-8906-b302bbb57767 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c196700f74a54093aa923b505a29fcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '925a2d0bbe0649d3af58710271baa448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:32.800018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b30ca5-6a45-4308-8906-b302bbb57767 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:32.800409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b30ca5-6a45-4308-8906-b302bbb57767 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:32.801150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b30ca5-6a45-4308-8906-b302bbb57767 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] PATH_INFO: `/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2/6d4e562049b54a70b8e3dad6b610d9dc` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:32.805583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b30ca5-6a45-4308-8906-b302bbb57767 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=c196700f74a54093aa923b505a29fcac, credential_id=6d4e562049b54a70b8e3dad6b610d9dc)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:32.808376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b30ca5-6a45-4308-8906-b302bbb57767 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:32.859272 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2765/5482] 10.222.0.17 () {58 vars in 1380 bytes} [Sat Jul 30 21:20:32 2022] DELETE /identity/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2/6d4e562049b54a70b8e3dad6b610d9dc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:32.871792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b30ca5-6a45-4308-8906-b302bbb57767 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:32.905306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b30ca5-6a45-4308-8906-b302bbb57767 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:32.946981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:32.997346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a77d0bf01a49a9baad7f4a6a8f4218'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:32.998504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a77d0bf01a49a9baad7f4a6a8f4218'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:33.040251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a77d0bf01a49a9baad7f4a6a8f4218'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:33.048265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a77d0bf01a49a9baad7f4a6a8f4218'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:33.052817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1dee9-649e-4b6e-a086-e1572f664d39 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c196700f74a54093aa923b505a29fcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '925a2d0bbe0649d3af58710271baa448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:33.053668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1dee9-649e-4b6e-a086-e1572f664d39 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:33.053866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1dee9-649e-4b6e-a086-e1572f664d39 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:33.054164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1dee9-649e-4b6e-a086-e1572f664d39 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] PATH_INFO: `/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2/f4be0d3d8fda4e09aa1533682409181c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:33.062786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1dee9-649e-4b6e-a086-e1572f664d39 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=c196700f74a54093aa923b505a29fcac, credential_id=f4be0d3d8fda4e09aa1533682409181c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:33.065101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1dee9-649e-4b6e-a086-e1572f664d39 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:33.069783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a77d0bf01a49a9baad7f4a6a8f4218'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:33.102055 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2766/5483] 10.222.0.17 () {58 vars in 1380 bytes} [Sat Jul 30 21:20:32 2022] DELETE /identity/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2/f4be0d3d8fda4e09aa1533682409181c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:33.103259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1dee9-649e-4b6e-a086-e1572f664d39 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:33.111909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7fe1dee9-649e-4b6e-a086-e1572f664d39 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:33.148956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1dee9-649e-4b6e-a086-e1572f664d39 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:33.177018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7513f3e363cb4f17b709c088324d372f', 'request_id': 'req-89ce41fb-de01-44d1-a1d1-96c9ab3775db'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:33.197612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7513f3e363cb4f17b709c088324d372f', 'request_id': 'req-89ce41fb-de01-44d1-a1d1-96c9ab3775db'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:33.207271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7513f3e363cb4f17b709c088324d372f', 'request_id': 'req-89ce41fb-de01-44d1-a1d1-96c9ab3775db'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:33.236443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] The token cache is being invalidate because project 7513f3e363cb4f17b709c088324d372f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:33.236827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:33.239449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:33.261502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7513f3e363cb4f17b709c088324d372f', 'request_id': 'req-89ce41fb-de01-44d1-a1d1-96c9ab3775db'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:33.269590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7513f3e363cb4f17b709c088324d372f', 'request_id': 'req-89ce41fb-de01-44d1-a1d1-96c9ab3775db'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:33.271000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7513f3e363cb4f17b709c088324d372f', 'request_id': 'req-89ce41fb-de01-44d1-a1d1-96c9ab3775db'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:33.286672 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2718/5484] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:20:31 2022] DELETE /identity/v3/domains/7513f3e363cb4f17b709c088324d372f => generated 0 bytes in 1322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:33.290597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:33.292403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:33.305806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7f393-8155-49e0-bb7c-17236881aef3 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c196700f74a54093aa923b505a29fcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '925a2d0bbe0649d3af58710271baa448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:33.306518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7f393-8155-49e0-bb7c-17236881aef3 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:33.307419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7f393-8155-49e0-bb7c-17236881aef3 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:33.307419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7f393-8155-49e0-bb7c-17236881aef3 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] PATH_INFO: `/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:33.307820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7f393-8155-49e0-bb7c-17236881aef3 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=c196700f74a54093aa923b505a29fcac)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:33.309407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7f393-8155-49e0-bb7c-17236881aef3 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:33.347505 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2767/5485] 10.222.0.17 () {60 vars in 1299 bytes} [Sat Jul 30 21:20:33 2022] POST /identity/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2 => generated 367 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:33.351479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7f393-8155-49e0-bb7c-17236881aef3 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:33.356805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ebc7f393-8155-49e0-bb7c-17236881aef3 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:33.389159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7f393-8155-49e0-bb7c-17236881aef3 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:33.400455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d94f0-ae15-4bc1-99f8-e598d39e8fa8 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c196700f74a54093aa923b505a29fcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '925a2d0bbe0649d3af58710271baa448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:33.402399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d94f0-ae15-4bc1-99f8-e598d39e8fa8 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:33.402707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d94f0-ae15-4bc1-99f8-e598d39e8fa8 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:33.403102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d94f0-ae15-4bc1-99f8-e598d39e8fa8 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] PATH_INFO: `/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2/a5d567f1e0d14addbb94ece58153be9d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:33.410829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d94f0-ae15-4bc1-99f8-e598d39e8fa8 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=c196700f74a54093aa923b505a29fcac, credential_id=a5d567f1e0d14addbb94ece58153be9d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:33.412467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d94f0-ae15-4bc1-99f8-e598d39e8fa8 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:33.427897 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2768/5486] 10.222.0.17 () {58 vars in 1377 bytes} [Sat Jul 30 21:20:33 2022] GET /identity/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2/a5d567f1e0d14addbb94ece58153be9d => generated 367 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:33.431938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d94f0-ae15-4bc1-99f8-e598d39e8fa8 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:33.460002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d94f0-ae15-4bc1-99f8-e598d39e8fa8 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:33.483008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce41fb-de01-44d1-a1d1-96c9ab3775db tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:33.483308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2baec-3677-415f-b602-0a6a4cc79b71 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c196700f74a54093aa923b505a29fcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '925a2d0bbe0649d3af58710271baa448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:33.483977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2baec-3677-415f-b602-0a6a4cc79b71 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:33.486702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2baec-3677-415f-b602-0a6a4cc79b71 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:33.489114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2baec-3677-415f-b602-0a6a4cc79b71 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] PATH_INFO: `/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2/a5d567f1e0d14addbb94ece58153be9d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:33.490747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1014b95-e5c9-404f-89b1-fb63152690fc tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:33.491510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1014b95-e5c9-404f-89b1-fb63152690fc tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:33.491801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1014b95-e5c9-404f-89b1-fb63152690fc tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:33.492019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2baec-3677-415f-b602-0a6a4cc79b71 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=c196700f74a54093aa923b505a29fcac, credential_id=a5d567f1e0d14addbb94ece58153be9d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:33.492153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1014b95-e5c9-404f-89b1-fb63152690fc tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains/7513f3e363cb4f17b709c088324d372f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:33.493638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2baec-3677-415f-b602-0a6a4cc79b71 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:33.504598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1014b95-e5c9-404f-89b1-fb63152690fc tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=7513f3e363cb4f17b709c088324d372f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:33.509880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1014b95-e5c9-404f-89b1-fb63152690fc tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:33.537904 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2769/5487] 10.222.0.17 () {58 vars in 1380 bytes} [Sat Jul 30 21:20:33 2022] DELETE /identity/v3/users/c196700f74a54093aa923b505a29fcac/credentials/OS-EC2/a5d567f1e0d14addbb94ece58153be9d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:33.545451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2baec-3677-415f-b602-0a6a4cc79b71 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:33.551144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3bf2baec-3677-415f-b602-0a6a4cc79b71 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:33.553510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-a1014b95-e5c9-404f-89b1-fb63152690fc tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Could not find domain: 7513f3e363cb4f17b709c088324d372f.: keystone.exception.DomainNotFound: Could not find domain: 7513f3e363cb4f17b709c088324d372f. Jul 30 21:20:33.553510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:20:33.553510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 30 21:20:33.553510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 30 21:20:33.553510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 21:20:33.553510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 21:20:33.553510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 21:20:33.553510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 21:20:33.553510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7513f3e363cb4f17b709c088324d372f. Jul 30 21:20:33.553510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:20:33.553510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:20:33.553510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:20:33.553510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:20:33.553510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:20:33.553510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:20:33.553510 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:20:33.554818 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:20:33.554818 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:20:33.554818 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:20:33.554818 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:20:33.554818 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:20:33.554818 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:20:33.554818 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:20:33.554818 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 30 21:20:33.554818 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 30 21:20:33.554818 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 30 21:20:33.554818 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 30 21:20:33.554818 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:20:33.554818 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:20:33.554818 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:20:33.554818 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:20:33.554818 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:20:33.554818 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:20:33.557011 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:20:33.557011 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 21:20:33.557011 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:20:33.557011 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:20:33.557011 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:20:33.557011 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:20:33.557011 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:20:33.557011 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:20:33.557011 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:20:33.557011 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:20:33.557011 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 30 21:20:33.557011 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 21:20:33.557011 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 7513f3e363cb4f17b709c088324d372f. Jul 30 21:20:33.557011 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:20:33.558749 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2719/5488] 10.222.0.17 () {58 vars in 1227 bytes} [Sat Jul 30 21:20:33 2022] GET /identity/v3/domains/7513f3e363cb4f17b709c088324d372f => generated 112 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:20:33.562529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1014b95-e5c9-404f-89b1-fb63152690fc tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:33.581662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1014b95-e5c9-404f-89b1-fb63152690fc tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:33.597028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d33340-545b-402d-bfc9-0bc0a102f17f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:33.597781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d33340-545b-402d-bfc9-0bc0a102f17f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:33.597975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d33340-545b-402d-bfc9-0bc0a102f17f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:33.598519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d33340-545b-402d-bfc9-0bc0a102f17f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/users/23a77d0bf01a49a9baad7f4a6a8f4218` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:33.600728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:33.607278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:33.620712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d33340-545b-402d-bfc9-0bc0a102f17f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:get_user(user_id=23a77d0bf01a49a9baad7f4a6a8f4218)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:33.630585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d33340-545b-402d-bfc9-0bc0a102f17f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:33.659611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-79d33340-545b-402d-bfc9-0bc0a102f17f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Could not find user: 23a77d0bf01a49a9baad7f4a6a8f4218.: keystone.exception.UserNotFound: Could not find user: 23a77d0bf01a49a9baad7f4a6a8f4218. Jul 30 21:20:33.659611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:20:33.659611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:20:33.659611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:20:33.659611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:20:33.659611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:20:33.659611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:20:33.659611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:20:33.659611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:20:33.659611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:20:33.659611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:20:33.659611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:20:33.659611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 30 21:20:33.659611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 30 21:20:33.659611 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 30 21:20:33.661016 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 30 21:20:33.661016 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:20:33.661016 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:20:33.661016 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 21:20:33.661016 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 21:20:33.661016 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 21:20:33.661016 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 21:20:33.661016 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:20:33.661016 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:20:33.661016 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:20:33.661016 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:20:33.661016 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:20:33.661016 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 21:20:33.661016 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:20:33.661016 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:20:33.661016 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:20:33.661016 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:20:33.662188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:20:33.662188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:20:33.662188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:20:33.662188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:20:33.662188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 21:20:33.662188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 21:20:33.662188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 21:20:33.662188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 21:20:33.662188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 21:20:33.662188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 21:20:33.662188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 23a77d0bf01a49a9baad7f4a6a8f4218. Jul 30 21:20:33.662188 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:20:33.662188 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2720/5489] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:20:33 2022] GET /identity/v3/users/23a77d0bf01a49a9baad7f4a6a8f4218 => generated 110 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:20:33.662188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d33340-545b-402d-bfc9-0bc0a102f17f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:33.670513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-79d33340-545b-402d-bfc9-0bc0a102f17f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:33.738841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2baec-3677-415f-b602-0a6a4cc79b71 tempest-EC2CredentialsTest-263025353 tempest-EC2CredentialsTest-263025353-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:33.749556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175a8c9-7b9d-4ee1-8221-0ba5ce82c5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:33.750259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175a8c9-7b9d-4ee1-8221-0ba5ce82c5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:33.750506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175a8c9-7b9d-4ee1-8221-0ba5ce82c5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:33.753492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175a8c9-7b9d-4ee1-8221-0ba5ce82c5d3 admin admin] PATH_INFO: `/v3/users/c196700f74a54093aa923b505a29fcac` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:33.760396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175a8c9-7b9d-4ee1-8221-0ba5ce82c5d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c196700f74a54093aa923b505a29fcac)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:33.762399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175a8c9-7b9d-4ee1-8221-0ba5ce82c5d3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:33.850312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d33340-545b-402d-bfc9-0bc0a102f17f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:33.870981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfee93-de98-4133-b499-62eaca2657d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:33.871835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfee93-de98-4133-b499-62eaca2657d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:33.872223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfee93-de98-4133-b499-62eaca2657d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:33.872564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfee93-de98-4133-b499-62eaca2657d0 admin admin] PATH_INFO: `/v3/projects/a44b336bee1e4aa38ba0972914ca6cc0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:33.874294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfee93-de98-4133-b499-62eaca2657d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a44b336bee1e4aa38ba0972914ca6cc0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:33.876947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfee93-de98-4133-b499-62eaca2657d0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:33.915561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9175a8c9-7b9d-4ee1-8221-0ba5ce82c5d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c196700f74a54093aa923b505a29fcac'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:33.948484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9175a8c9-7b9d-4ee1-8221-0ba5ce82c5d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c196700f74a54093aa923b505a29fcac'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:33.950794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9175a8c9-7b9d-4ee1-8221-0ba5ce82c5d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c196700f74a54093aa923b505a29fcac'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:33.966711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9175a8c9-7b9d-4ee1-8221-0ba5ce82c5d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c196700f74a54093aa923b505a29fcac'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:33.967671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9175a8c9-7b9d-4ee1-8221-0ba5ce82c5d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c196700f74a54093aa923b505a29fcac'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:34.026971 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2770/5490] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:33 2022] DELETE /identity/v3/users/c196700f74a54093aa923b505a29fcac => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:34.026971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175a8c9-7b9d-4ee1-8221-0ba5ce82c5d3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:34.030596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9175a8c9-7b9d-4ee1-8221-0ba5ce82c5d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:34.035709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-64bfee93-de98-4133-b499-62eaca2657d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a44b336bee1e4aa38ba0972914ca6cc0', 'request_id': 'req-64bfee93-de98-4133-b499-62eaca2657d0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:34.066217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-64bfee93-de98-4133-b499-62eaca2657d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a44b336bee1e4aa38ba0972914ca6cc0', 'request_id': 'req-64bfee93-de98-4133-b499-62eaca2657d0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:34.078221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-64bfee93-de98-4133-b499-62eaca2657d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a44b336bee1e4aa38ba0972914ca6cc0', 'request_id': 'req-64bfee93-de98-4133-b499-62eaca2657d0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:34.109181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-64bfee93-de98-4133-b499-62eaca2657d0 admin admin] The token cache is being invalidate because project a44b336bee1e4aa38ba0972914ca6cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:34.109559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-64bfee93-de98-4133-b499-62eaca2657d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:34.110786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-64bfee93-de98-4133-b499-62eaca2657d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:34.117681 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2721/5491] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:33 2022] DELETE /identity/v3/projects/a44b336bee1e4aa38ba0972914ca6cc0 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:34.120559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6f4ef-6ded-42db-a9d3-768821f9e449 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:34.120795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6f4ef-6ded-42db-a9d3-768821f9e449 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:34.122722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6f4ef-6ded-42db-a9d3-768821f9e449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:34.171793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-24e6f4ef-6ded-42db-a9d3-768821f9e449 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:34.175345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-24e6f4ef-6ded-42db-a9d3-768821f9e449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:34.219143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175a8c9-7b9d-4ee1-8221-0ba5ce82c5d3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:34.229525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7c098-2c4b-428a-aa7f-2ce876839231 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:34.230824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7c098-2c4b-428a-aa7f-2ce876839231 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:34.231156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7c098-2c4b-428a-aa7f-2ce876839231 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:34.232508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7c098-2c4b-428a-aa7f-2ce876839231 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/groups/0d08348b86994d328aefb95bb41bb422` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:34.245015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7c098-2c4b-428a-aa7f-2ce876839231 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:get_group(group_id=0d08348b86994d328aefb95bb41bb422)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:34.248512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7c098-2c4b-428a-aa7f-2ce876839231 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:34.276777 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-d3a7c098-2c4b-428a-aa7f-2ce876839231 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Could not find group: 0d08348b86994d328aefb95bb41bb422.: keystone.exception.GroupNotFound: Could not find group: 0d08348b86994d328aefb95bb41bb422. Jul 30 21:20:34.276777 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:20:34.276777 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:20:34.276777 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:20:34.276777 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:20:34.276777 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:20:34.276777 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:20:34.276777 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:20:34.276777 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:20:34.276777 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:20:34.276777 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:20:34.276777 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:20:34.276777 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Jul 30 21:20:34.276777 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_group(group_id) Jul 30 21:20:34.278112 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Jul 30 21:20:34.278112 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Jul 30 21:20:34.278112 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:20:34.278112 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:20:34.278112 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 21:20:34.278112 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 21:20:34.278112 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 21:20:34.278112 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 21:20:34.278112 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:20:34.278112 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:20:34.278112 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:20:34.278112 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:20:34.278112 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:20:34.278112 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 21:20:34.278112 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:20:34.278112 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:20:34.278112 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:20:34.279382 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:20:34.279382 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:20:34.279382 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:20:34.279382 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:20:34.279382 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:20:34.279382 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jul 30 21:20:34.279382 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jul 30 21:20:34.279382 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jul 30 21:20:34.279382 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jul 30 21:20:34.279382 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jul 30 21:20:34.279382 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jul 30 21:20:34.279382 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 0d08348b86994d328aefb95bb41bb422. Jul 30 21:20:34.279382 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:20:34.281177 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2771/5492] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:34 2022] GET /identity/v3/groups/0d08348b86994d328aefb95bb41bb422 => generated 111 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:20:34.286917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfacbd-c2de-41c9-8809-1004fdfd4ff0 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:34.287599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfacbd-c2de-41c9-8809-1004fdfd4ff0 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:34.288431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfacbd-c2de-41c9-8809-1004fdfd4ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:34.346104 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2722/5493] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:34.347366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6f4ef-6ded-42db-a9d3-768821f9e449 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:34.351143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-24e6f4ef-6ded-42db-a9d3-768821f9e449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:34.352018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-20bfacbd-c2de-41c9-8809-1004fdfd4ff0 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:34.354572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-20bfacbd-c2de-41c9-8809-1004fdfd4ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:34.375056 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2772/5494] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:34.384715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fba504-5a71-4e59-a6f0-26ce71043409 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:34.386973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fba504-5a71-4e59-a6f0-26ce71043409 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:34.388084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fba504-5a71-4e59-a6f0-26ce71043409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:34.389946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6f4ef-6ded-42db-a9d3-768821f9e449 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:34.402252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcef343-b2fa-4928-80fb-6869b80bc450 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:34.403206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcef343-b2fa-4928-80fb-6869b80bc450 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:34.404992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcef343-b2fa-4928-80fb-6869b80bc450 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:34.407554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcef343-b2fa-4928-80fb-6869b80bc450 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/groups/0d08348b86994d328aefb95bb41bb422` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:34.426845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcef343-b2fa-4928-80fb-6869b80bc450 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 21:20:34.438389 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-5fcef343-b2fa-4928-80fb-6869b80bc450 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Could not find group: 0d08348b86994d328aefb95bb41bb422.: keystone.exception.GroupNotFound: Could not find group: 0d08348b86994d328aefb95bb41bb422. Jul 30 21:20:34.438389 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:20:34.438389 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:20:34.438389 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:20:34.438389 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:20:34.438389 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:20:34.438389 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:20:34.438389 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:20:34.438389 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:20:34.438389 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:20:34.438389 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:20:34.438389 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:20:34.438389 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Jul 30 21:20:34.438389 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Jul 30 21:20:34.439570 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 21:20:34.439570 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 21:20:34.439570 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 21:20:34.439570 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 21:20:34.439570 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:20:34.439570 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:20:34.439570 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 21:20:34.439570 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 21:20:34.439570 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 21:20:34.439570 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 21:20:34.439570 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:20:34.439570 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:20:34.439570 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:20:34.439570 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:20:34.439570 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:20:34.439570 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 21:20:34.439570 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:20:34.440702 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:20:34.440702 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:20:34.440702 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:20:34.440702 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:20:34.440702 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:20:34.440702 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:20:34.440702 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:20:34.440702 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jul 30 21:20:34.440702 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jul 30 21:20:34.440702 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jul 30 21:20:34.440702 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jul 30 21:20:34.440702 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jul 30 21:20:34.440702 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jul 30 21:20:34.440702 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 0d08348b86994d328aefb95bb41bb422. Jul 30 21:20:34.440702 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:20:34.444030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-41fba504-5a71-4e59-a6f0-26ce71043409 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:34.444998 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2723/5495] 10.222.0.17 () {58 vars in 1227 bytes} [Sat Jul 30 21:20:34 2022] DELETE /identity/v3/groups/0d08348b86994d328aefb95bb41bb422 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:20:34.445975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcef343-b2fa-4928-80fb-6869b80bc450 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:34.447335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-41fba504-5a71-4e59-a6f0-26ce71043409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:34.452166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5fcef343-b2fa-4928-80fb-6869b80bc450 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:34.496419 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2773/5496] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:34.499451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fba504-5a71-4e59-a6f0-26ce71043409 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:34.525075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:34.531411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fba504-5a71-4e59-a6f0-26ce71043409 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:34.549233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff682dd-41e2-4c24-9ce1-f8bfe1bb090a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:34.550943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff682dd-41e2-4c24-9ce1-f8bfe1bb090a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:34.552313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff682dd-41e2-4c24-9ce1-f8bfe1bb090a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:34.553644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff682dd-41e2-4c24-9ce1-f8bfe1bb090a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/users/23a77d0bf01a49a9baad7f4a6a8f4218` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:34.573719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff682dd-41e2-4c24-9ce1-f8bfe1bb090a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:delete_user(user_id=23a77d0bf01a49a9baad7f4a6a8f4218)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:34.576109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff682dd-41e2-4c24-9ce1-f8bfe1bb090a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:34.610208 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-0ff682dd-41e2-4c24-9ce1-f8bfe1bb090a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Could not find user: 23a77d0bf01a49a9baad7f4a6a8f4218.: keystone.exception.UserNotFound: Could not find user: 23a77d0bf01a49a9baad7f4a6a8f4218. Jul 30 21:20:34.610208 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:20:34.610208 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:20:34.610208 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:20:34.610208 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:20:34.610208 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:20:34.610208 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:20:34.610208 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:20:34.610208 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:20:34.610208 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:20:34.610208 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:20:34.610208 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:20:34.610208 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Jul 30 21:20:34.610208 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Jul 30 21:20:34.613075 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:20:34.613075 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:20:34.613075 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 21:20:34.613075 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 21:20:34.613075 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 21:20:34.613075 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 21:20:34.613075 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Jul 30 21:20:34.613075 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Jul 30 21:20:34.613075 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:20:34.613075 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:20:34.613075 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 30 21:20:34.613075 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 21:20:34.613075 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 30 21:20:34.613075 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 30 21:20:34.613075 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:20:34.613075 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:20:34.613075 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:20:34.613075 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:20:34.614512 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:20:34.614512 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 21:20:34.614512 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:20:34.614512 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:20:34.614512 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:20:34.614512 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:20:34.614512 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:20:34.614512 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:20:34.614512 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:20:34.614512 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:20:34.614512 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 30 21:20:34.614512 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 30 21:20:34.614512 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 30 21:20:34.614512 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 30 21:20:34.614512 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 30 21:20:34.614512 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 30 21:20:34.614512 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 23a77d0bf01a49a9baad7f4a6a8f4218. Jul 30 21:20:34.614512 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:20:34.620516 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2774/5497] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:34 2022] DELETE /identity/v3/users/23a77d0bf01a49a9baad7f4a6a8f4218 => generated 110 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:20:34.624114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff682dd-41e2-4c24-9ce1-f8bfe1bb090a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:34.638702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:34.645982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcef343-b2fa-4928-80fb-6869b80bc450 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:34.658984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddad575-2491-4149-a2af-94b5f7243dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:34.659658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff682dd-41e2-4c24-9ce1-f8bfe1bb090a tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:34.660287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddad575-2491-4149-a2af-94b5f7243dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:34.661391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddad575-2491-4149-a2af-94b5f7243dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:34.662080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddad575-2491-4149-a2af-94b5f7243dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:34.672230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88954a34-f2d5-48e8-a5ea-7dcb88d96833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:34.674123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88954a34-f2d5-48e8-a5ea-7dcb88d96833 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:34.676218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88954a34-f2d5-48e8-a5ea-7dcb88d96833 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:34.676589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88954a34-f2d5-48e8-a5ea-7dcb88d96833 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:34.677480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88954a34-f2d5-48e8-a5ea-7dcb88d96833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:20:34.677792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88954a34-f2d5-48e8-a5ea-7dcb88d96833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:34.681699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88954a34-f2d5-48e8-a5ea-7dcb88d96833 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:34.685793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddad575-2491-4149-a2af-94b5f7243dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:34.691153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddad575-2491-4149-a2af-94b5f7243dc9 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:34.723405 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2775/5498] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:34.725064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88954a34-f2d5-48e8-a5ea-7dcb88d96833 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:34.728087 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2724/5499] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:34.729074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddad575-2491-4149-a2af-94b5f7243dc9 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:34.753445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88954a34-f2d5-48e8-a5ea-7dcb88d96833 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:34.763633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debeac60-91e0-4c4c-9715-87447edf9edd tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:34.765331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debeac60-91e0-4c4c-9715-87447edf9edd tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:34.766611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debeac60-91e0-4c4c-9715-87447edf9edd tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:34.767066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debeac60-91e0-4c4c-9715-87447edf9edd tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains/7513f3e363cb4f17b709c088324d372f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:34.770948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddad575-2491-4149-a2af-94b5f7243dc9 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:34.778798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c0368-0777-4d1d-9905-65c6dbfd592a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:34.779826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c0368-0777-4d1d-9905-65c6dbfd592a admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:34.780935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c0368-0777-4d1d-9905-65c6dbfd592a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:34.780935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c0368-0777-4d1d-9905-65c6dbfd592a admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:34.781778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c0368-0777-4d1d-9905-65c6dbfd592a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:34.787660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debeac60-91e0-4c4c-9715-87447edf9edd tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 21:20:34.793039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c0368-0777-4d1d-9905-65c6dbfd592a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:34.795192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-debeac60-91e0-4c4c-9715-87447edf9edd tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Could not find domain: 7513f3e363cb4f17b709c088324d372f.: keystone.exception.DomainNotFound: Could not find domain: 7513f3e363cb4f17b709c088324d372f. Jul 30 21:20:34.795192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:20:34.795192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 30 21:20:34.795192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 30 21:20:34.795192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 21:20:34.795192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 21:20:34.795192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 21:20:34.795192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 21:20:34.795192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7513f3e363cb4f17b709c088324d372f. Jul 30 21:20:34.795192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:20:34.795192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:20:34.795192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:20:34.795192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:20:34.795192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:20:34.795192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:20:34.795192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:20:34.796464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:20:34.796464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:20:34.796464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:20:34.796464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:20:34.796464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:20:34.796464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:20:34.796464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:20:34.796464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 30 21:20:34.796464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 30 21:20:34.796464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 21:20:34.796464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 21:20:34.796464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 21:20:34.796464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 21:20:34.796464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:20:34.796464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:20:34.796464 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:20:34.797555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:20:34.797555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:20:34.797555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:20:34.797555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:20:34.797555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 21:20:34.797555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:20:34.797555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:20:34.797555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:20:34.797555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:20:34.797555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:20:34.797555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:20:34.797555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:20:34.797555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:20:34.797555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 30 21:20:34.797555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 21:20:34.797555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 7513f3e363cb4f17b709c088324d372f. Jul 30 21:20:34.797555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:20:34.798584 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2776/5500] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:20:34 2022] PATCH /identity/v3/domains/7513f3e363cb4f17b709c088324d372f => generated 112 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:20:34.802383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debeac60-91e0-4c4c-9715-87447edf9edd tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:34.819917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debeac60-91e0-4c4c-9715-87447edf9edd tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:34.828571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b80c38-188a-47aa-b771-e7a612e526e6 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:34.828695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b80c38-188a-47aa-b771-e7a612e526e6 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:34.829139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b80c38-188a-47aa-b771-e7a612e526e6 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:34.829298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b80c38-188a-47aa-b771-e7a612e526e6 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:34.831045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b80c38-188a-47aa-b771-e7a612e526e6 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:34.832811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b80c38-188a-47aa-b771-e7a612e526e6 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:34.846862 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2725/5501] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:34 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:34.851101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c0368-0777-4d1d-9905-65c6dbfd592a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:34.871467 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2777/5502] 10.222.0.17 () {58 vars in 1128 bytes} [Sat Jul 30 21:20:34 2022] GET /identity/v3/domains => generated 1344 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:34.874680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b80c38-188a-47aa-b771-e7a612e526e6 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:34.897306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b80c38-188a-47aa-b771-e7a612e526e6 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:35.034176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c0368-0777-4d1d-9905-65c6dbfd592a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:35.051481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacacc7-0a98-4b1d-ae3d-794de31efb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:35.053981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacacc7-0a98-4b1d-ae3d-794de31efb60 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:35.054914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacacc7-0a98-4b1d-ae3d-794de31efb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:35.055274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacacc7-0a98-4b1d-ae3d-794de31efb60 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:35.058613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cacacc7-0a98-4b1d-ae3d-794de31efb60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:35.067171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cacacc7-0a98-4b1d-ae3d-794de31efb60 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:35.085759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a10e2-5cad-416b-b296-8e0375d3046f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:35.086896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a10e2-5cad-416b-b296-8e0375d3046f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:35.087450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a10e2-5cad-416b-b296-8e0375d3046f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:35.087841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a10e2-5cad-416b-b296-8e0375d3046f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:35.088817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a10e2-5cad-416b-b296-8e0375d3046f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:20:35.089266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a10e2-5cad-416b-b296-8e0375d3046f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:35.092413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a10e2-5cad-416b-b296-8e0375d3046f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:35.120959 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2726/5503] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:34 2022] POST /identity/v3/users => generated 299 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:35.122112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacacc7-0a98-4b1d-ae3d-794de31efb60 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:35.123137 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2778/5504] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:20:34 2022] GET /identity/v3/domains?enabled=True => generated 1093 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:20:35.128954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a10e2-5cad-416b-b296-8e0375d3046f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:35.150172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacacc7-0a98-4b1d-ae3d-794de31efb60 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:35.156436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a10e2-5cad-416b-b296-8e0375d3046f tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:35.158978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890f94e-8431-42bc-a61c-06aedbc1d1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:35.166460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890f94e-8431-42bc-a61c-06aedbc1d1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:35.167113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890f94e-8431-42bc-a61c-06aedbc1d1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:35.167646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890f94e-8431-42bc-a61c-06aedbc1d1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:35.168939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890f94e-8431-42bc-a61c-06aedbc1d1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:35.171823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890f94e-8431-42bc-a61c-06aedbc1d1a2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:35.181626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85e5f8-cbfe-45ce-94fc-dfbd845eb936 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:35.186058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85e5f8-cbfe-45ce-94fc-dfbd845eb936 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:35.186430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85e5f8-cbfe-45ce-94fc-dfbd845eb936 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:35.186697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85e5f8-cbfe-45ce-94fc-dfbd845eb936 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:35.188272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85e5f8-cbfe-45ce-94fc-dfbd845eb936 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-601822466) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:20:35.188667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85e5f8-cbfe-45ce-94fc-dfbd845eb936 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:35.193063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85e5f8-cbfe-45ce-94fc-dfbd845eb936 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:35.205154 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2727/5505] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:35.209683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890f94e-8431-42bc-a61c-06aedbc1d1a2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:35.225542 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2779/5506] 10.222.0.17 () {58 vars in 1197 bytes} [Sat Jul 30 21:20:35 2022] GET /identity/v3/domains?name=tempest-test_domain-601822466 => generated 406 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:35.227071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85e5f8-cbfe-45ce-94fc-dfbd845eb936 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:35.237873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890f94e-8431-42bc-a61c-06aedbc1d1a2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:35.246108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f663c-b7f3-4bce-8612-25498c79f04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:35.247103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f663c-b7f3-4bce-8612-25498c79f04c admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:35.247594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f663c-b7f3-4bce-8612-25498c79f04c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:35.247971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f663c-b7f3-4bce-8612-25498c79f04c admin admin] PATH_INFO: `/v3/projects/62c880ce8c254b51b599c9a7f39111b3/users/57d87b65dc164c76b8878da471bec4f5/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:35.256276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85e5f8-cbfe-45ce-94fc-dfbd845eb936 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:35.272167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec5745-9943-47db-b301-2686ae37e06d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:35.273919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec5745-9943-47db-b301-2686ae37e06d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:35.274712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec5745-9943-47db-b301-2686ae37e06d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:35.274894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec5745-9943-47db-b301-2686ae37e06d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains/7513f3e363cb4f17b709c088324d372f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:35.292207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f663c-b7f3-4bce-8612-25498c79f04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c880ce8c254b51b599c9a7f39111b3, user_id=57d87b65dc164c76b8878da471bec4f5, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:35.294415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec5745-9943-47db-b301-2686ae37e06d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 21:20:35.298071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f663c-b7f3-4bce-8612-25498c79f04c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:35.312547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-dbec5745-9943-47db-b301-2686ae37e06d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Could not find domain: 7513f3e363cb4f17b709c088324d372f.: keystone.exception.DomainNotFound: Could not find domain: 7513f3e363cb4f17b709c088324d372f. Jul 30 21:20:35.312547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:20:35.312547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 30 21:20:35.312547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 30 21:20:35.312547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 21:20:35.312547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 21:20:35.312547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 21:20:35.312547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 21:20:35.312547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7513f3e363cb4f17b709c088324d372f. Jul 30 21:20:35.312547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:20:35.312547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:20:35.312547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:20:35.312547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:20:35.312547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:20:35.312547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:20:35.312547 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:20:35.313922 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:20:35.313922 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:20:35.313922 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:20:35.313922 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:20:35.313922 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:20:35.313922 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:20:35.313922 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:20:35.313922 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 30 21:20:35.313922 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 30 21:20:35.313922 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 21:20:35.313922 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 21:20:35.313922 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 21:20:35.313922 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 21:20:35.313922 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:20:35.313922 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:20:35.313922 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:20:35.315805 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:20:35.315805 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:20:35.315805 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:20:35.315805 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:20:35.315805 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 21:20:35.315805 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:20:35.315805 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:20:35.315805 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:20:35.315805 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:20:35.315805 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:20:35.315805 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:20:35.315805 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:20:35.315805 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:20:35.315805 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 30 21:20:35.315805 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 21:20:35.315805 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 7513f3e363cb4f17b709c088324d372f. Jul 30 21:20:35.315805 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:20:35.318166 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2780/5507] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:20:35 2022] PATCH /identity/v3/domains/7513f3e363cb4f17b709c088324d372f => generated 112 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:20:35.322889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec5745-9943-47db-b301-2686ae37e06d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:35.340615 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2728/5508] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:35 2022] PUT /identity/v3/projects/62c880ce8c254b51b599c9a7f39111b3/users/57d87b65dc164c76b8878da471bec4f5/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:20:35.346588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f663c-b7f3-4bce-8612-25498c79f04c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:35.369542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec5745-9943-47db-b301-2686ae37e06d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:35.557840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:35.580409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f663c-b7f3-4bce-8612-25498c79f04c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:35.595843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc303e4-6dc0-4f70-9988-96e3b8f37382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:35.597359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc303e4-6dc0-4f70-9988-96e3b8f37382 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:35.597650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc303e4-6dc0-4f70-9988-96e3b8f37382 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:35.597928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc303e4-6dc0-4f70-9988-96e3b8f37382 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:35.606658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc303e4-6dc0-4f70-9988-96e3b8f37382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:35.608982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc303e4-6dc0-4f70-9988-96e3b8f37382 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:35.615108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351ab99-dfb3-4031-be33-6b837d7fd137 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:35.618384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351ab99-dfb3-4031-be33-6b837d7fd137 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:35.618902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351ab99-dfb3-4031-be33-6b837d7fd137 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:35.619373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351ab99-dfb3-4031-be33-6b837d7fd137 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains/676d6fe25286493684119978836a1a25` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:35.635273 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2729/5509] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:35.638211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351ab99-dfb3-4031-be33-6b837d7fd137 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=676d6fe25286493684119978836a1a25)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:35.639563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc303e4-6dc0-4f70-9988-96e3b8f37382 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:35.641385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351ab99-dfb3-4031-be33-6b837d7fd137 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:35.661746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc303e4-6dc0-4f70-9988-96e3b8f37382 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:35.670938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcfad1-a46f-45c4-8ea2-c84679c5d449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:35.671926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcfad1-a46f-45c4-8ea2-c84679c5d449 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:35.672577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcfad1-a46f-45c4-8ea2-c84679c5d449 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:35.672938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcfad1-a46f-45c4-8ea2-c84679c5d449 admin admin] PATH_INFO: `/v3/projects/62c880ce8c254b51b599c9a7f39111b3/users/57d87b65dc164c76b8878da471bec4f5/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:35.676608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcfad1-a46f-45c4-8ea2-c84679c5d449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c880ce8c254b51b599c9a7f39111b3, user_id=57d87b65dc164c76b8878da471bec4f5, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:35.680489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcfad1-a46f-45c4-8ea2-c84679c5d449 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:35.706571 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2730/5510] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:35 2022] PUT /identity/v3/projects/62c880ce8c254b51b599c9a7f39111b3/users/57d87b65dc164c76b8878da471bec4f5/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:35.718294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104e15b-5db5-4220-a3b9-7156225564fe None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:35.718748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104e15b-5db5-4220-a3b9-7156225564fe None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:35.719251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104e15b-5db5-4220-a3b9-7156225564fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:35.768211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:35.780982 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2781/5511] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:20:35 2022] PATCH /identity/v3/domains/676d6fe25286493684119978836a1a25 => generated 275 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:35.782041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351ab99-dfb3-4031-be33-6b837d7fd137 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:35.801612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351ab99-dfb3-4031-be33-6b837d7fd137 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:35.812828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b104e15b-5db5-4220-a3b9-7156225564fe None None] MFA Rules not processed for user `57d87b65dc164c76b8878da471bec4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:35.814242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b104e15b-5db5-4220-a3b9-7156225564fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:35.928652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6037b4-435d-44af-a965-0a993f77c141 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:35.929498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6037b4-435d-44af-a965-0a993f77c141 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:35.931029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6037b4-435d-44af-a965-0a993f77c141 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:35.931500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6037b4-435d-44af-a965-0a993f77c141 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains/676d6fe25286493684119978836a1a25` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:35.998384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6037b4-435d-44af-a965-0a993f77c141 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=676d6fe25286493684119978836a1a25)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:36.011862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6037b4-435d-44af-a965-0a993f77c141 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:36.105887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eb6037b4-435d-44af-a965-0a993f77c141 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '676d6fe25286493684119978836a1a25'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:36.112243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eb6037b4-435d-44af-a965-0a993f77c141 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '676d6fe25286493684119978836a1a25'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:36.134002 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2731/5512] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:20:36.135370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104e15b-5db5-4220-a3b9-7156225564fe None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:36.137094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b104e15b-5db5-4220-a3b9-7156225564fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:36.204092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eb6037b4-435d-44af-a965-0a993f77c141 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '676d6fe25286493684119978836a1a25', 'request_id': 'req-eb6037b4-435d-44af-a965-0a993f77c141'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:36.216865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eb6037b4-435d-44af-a965-0a993f77c141 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '676d6fe25286493684119978836a1a25', 'request_id': 'req-eb6037b4-435d-44af-a965-0a993f77c141'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:36.232995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eb6037b4-435d-44af-a965-0a993f77c141 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '676d6fe25286493684119978836a1a25', 'request_id': 'req-eb6037b4-435d-44af-a965-0a993f77c141'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:36.255393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eb6037b4-435d-44af-a965-0a993f77c141 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] The token cache is being invalidate because project 676d6fe25286493684119978836a1a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:36.255740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eb6037b4-435d-44af-a965-0a993f77c141 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:36.256410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eb6037b4-435d-44af-a965-0a993f77c141 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:36.268712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eb6037b4-435d-44af-a965-0a993f77c141 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '676d6fe25286493684119978836a1a25', 'request_id': 'req-eb6037b4-435d-44af-a965-0a993f77c141'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:36.269508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eb6037b4-435d-44af-a965-0a993f77c141 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '676d6fe25286493684119978836a1a25', 'request_id': 'req-eb6037b4-435d-44af-a965-0a993f77c141'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:36.270189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eb6037b4-435d-44af-a965-0a993f77c141 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '676d6fe25286493684119978836a1a25', 'request_id': 'req-eb6037b4-435d-44af-a965-0a993f77c141'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:36.283497 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2782/5513] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:20:35 2022] DELETE /identity/v3/domains/676d6fe25286493684119978836a1a25 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:36.286952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6037b4-435d-44af-a965-0a993f77c141 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:36.286952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-eb6037b4-435d-44af-a965-0a993f77c141 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:36.318271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104e15b-5db5-4220-a3b9-7156225564fe None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:36.410742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:36.430800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06790000-e25b-4b5f-b344-d1ba84a75edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:36.431789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06790000-e25b-4b5f-b344-d1ba84a75edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:36.433503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06790000-e25b-4b5f-b344-d1ba84a75edb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:36.433503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06790000-e25b-4b5f-b344-d1ba84a75edb admin admin] PATH_INFO: `/v3/projects/925a2d0bbe0649d3af58710271baa448` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:36.434982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06790000-e25b-4b5f-b344-d1ba84a75edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=925a2d0bbe0649d3af58710271baa448)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:36.438883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06790000-e25b-4b5f-b344-d1ba84a75edb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:36.454250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:36.467313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6037b4-435d-44af-a965-0a993f77c141 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:36.473543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d29aa-0a12-43f0-a74e-1a93d3a8741f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:36.474531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d29aa-0a12-43f0-a74e-1a93d3a8741f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:36.474998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d29aa-0a12-43f0-a74e-1a93d3a8741f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:36.475126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d29aa-0a12-43f0-a74e-1a93d3a8741f admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:36.475926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d29aa-0a12-43f0-a74e-1a93d3a8741f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:36.478622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d29aa-0a12-43f0-a74e-1a93d3a8741f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:36.521476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-06790000-e25b-4b5f-b344-d1ba84a75edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925a2d0bbe0649d3af58710271baa448', 'request_id': 'req-06790000-e25b-4b5f-b344-d1ba84a75edb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:36.531626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-06790000-e25b-4b5f-b344-d1ba84a75edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925a2d0bbe0649d3af58710271baa448', 'request_id': 'req-06790000-e25b-4b5f-b344-d1ba84a75edb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:36.537794 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2783/5514] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:36 2022] POST /identity/v3/projects => generated 387 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:36.537794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d29aa-0a12-43f0-a74e-1a93d3a8741f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:36.541080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-06790000-e25b-4b5f-b344-d1ba84a75edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925a2d0bbe0649d3af58710271baa448', 'request_id': 'req-06790000-e25b-4b5f-b344-d1ba84a75edb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:36.550758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-578d29aa-0a12-43f0-a74e-1a93d3a8741f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:36.560215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-06790000-e25b-4b5f-b344-d1ba84a75edb admin admin] The token cache is being invalidate because project 925a2d0bbe0649d3af58710271baa448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:36.560829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-06790000-e25b-4b5f-b344-d1ba84a75edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:36.561624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-06790000-e25b-4b5f-b344-d1ba84a75edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:36.572915 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2732/5515] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:36 2022] DELETE /identity/v3/projects/925a2d0bbe0649d3af58710271baa448 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:36.574449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06790000-e25b-4b5f-b344-d1ba84a75edb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:36.576419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-06790000-e25b-4b5f-b344-d1ba84a75edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:36.688481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06790000-e25b-4b5f-b344-d1ba84a75edb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:36.716958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d29aa-0a12-43f0-a74e-1a93d3a8741f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:36.731706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d54f91-a0a2-4a30-8451-be2518b45358 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:36.732352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d54f91-a0a2-4a30-8451-be2518b45358 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:36.732673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d54f91-a0a2-4a30-8451-be2518b45358 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:36.732994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d54f91-a0a2-4a30-8451-be2518b45358 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains/b980eec2a2ed428e8a513fa6d0f79805` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:36.771323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d54f91-a0a2-4a30-8451-be2518b45358 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b980eec2a2ed428e8a513fa6d0f79805)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:36.778000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d54f91-a0a2-4a30-8451-be2518b45358 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:36.818513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13459858-1196-4ec9-a843-547a3595d0cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:36.820441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13459858-1196-4ec9-a843-547a3595d0cb service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:36.820636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13459858-1196-4ec9-a843-547a3595d0cb service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:36.821079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13459858-1196-4ec9-a843-547a3595d0cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:36.828031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-13459858-1196-4ec9-a843-547a3595d0cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:36.842156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-05d54f91-a0a2-4a30-8451-be2518b45358 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b980eec2a2ed428e8a513fa6d0f79805'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:36.842156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-05d54f91-a0a2-4a30-8451-be2518b45358 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b980eec2a2ed428e8a513fa6d0f79805'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:36.899653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-05d54f91-a0a2-4a30-8451-be2518b45358 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b980eec2a2ed428e8a513fa6d0f79805'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:36.901446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-05d54f91-a0a2-4a30-8451-be2518b45358 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b980eec2a2ed428e8a513fa6d0f79805'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:36.921852 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2784/5516] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:20:36 2022] PATCH /identity/v3/domains/b980eec2a2ed428e8a513fa6d0f79805 => generated 277 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:36.922976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d54f91-a0a2-4a30-8451-be2518b45358 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:36.933612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-05d54f91-a0a2-4a30-8451-be2518b45358 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:37.020851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:37.031547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13459858-1196-4ec9-a843-547a3595d0cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:37.037743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13459858-1196-4ec9-a843-547a3595d0cb service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:37.090004 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2733/5517] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:37.092081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c576dc4-5fba-4f82-9ede-1e5df8b72392 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:37.092703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c576dc4-5fba-4f82-9ede-1e5df8b72392 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:37.092981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c576dc4-5fba-4f82-9ede-1e5df8b72392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:37.101481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d54f91-a0a2-4a30-8451-be2518b45358 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:37.116490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be5b6e-aa3a-4762-bf5a-dc160c8c9f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:37.118650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5b6e-aa3a-4762-bf5a-dc160c8c9f52 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:37.118941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5b6e-aa3a-4762-bf5a-dc160c8c9f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:37.119710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5b6e-aa3a-4762-bf5a-dc160c8c9f52 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:37.120092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be5b6e-aa3a-4762-bf5a-dc160c8c9f52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:37.121986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be5b6e-aa3a-4762-bf5a-dc160c8c9f52 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:37.126280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8c576dc4-5fba-4f82-9ede-1e5df8b72392 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:37.128493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8c576dc4-5fba-4f82-9ede-1e5df8b72392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:37.140349 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2734/5518] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:37.141225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c576dc4-5fba-4f82-9ede-1e5df8b72392 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:37.144482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8c576dc4-5fba-4f82-9ede-1e5df8b72392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:37.183401 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2785/5519] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:36 2022] POST /identity/v3/users => generated 294 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:37.184863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8488fa-ecbf-478d-b9d6-e5a169f3fa8b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:37.185160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8488fa-ecbf-478d-b9d6-e5a169f3fa8b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:37.185440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8488fa-ecbf-478d-b9d6-e5a169f3fa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:37.239383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ac8488fa-ecbf-478d-b9d6-e5a169f3fa8b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:37.242371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ac8488fa-ecbf-478d-b9d6-e5a169f3fa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:37.267784 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2786/5520] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:37.268851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8488fa-ecbf-478d-b9d6-e5a169f3fa8b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:37.280901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:37.293392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8488fa-ecbf-478d-b9d6-e5a169f3fa8b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:37.297830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c576dc4-5fba-4f82-9ede-1e5df8b72392 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:37.302110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f93ef3-65af-4deb-ab7d-bcf24b8810f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:37.302868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f93ef3-65af-4deb-ab7d-bcf24b8810f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:37.303354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f93ef3-65af-4deb-ab7d-bcf24b8810f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:37.303762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f93ef3-65af-4deb-ab7d-bcf24b8810f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:37.304541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f93ef3-65af-4deb-ab7d-bcf24b8810f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:37.306620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f93ef3-65af-4deb-ab7d-bcf24b8810f2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:37.315231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b0a2f-29ad-4c89-a9f0-1ab050089699 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:37.315972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b0a2f-29ad-4c89-a9f0-1ab050089699 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:37.316261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b0a2f-29ad-4c89-a9f0-1ab050089699 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:37.316544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b0a2f-29ad-4c89-a9f0-1ab050089699 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains/b980eec2a2ed428e8a513fa6d0f79805` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:37.323914 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2787/5521] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:37.327743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f93ef3-65af-4deb-ab7d-bcf24b8810f2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:37.342169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f93ef3-65af-4deb-ab7d-bcf24b8810f2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:37.350589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210a131-55e0-41c5-ba12-ceae8e16464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:37.351575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210a131-55e0-41c5-ba12-ceae8e16464b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:37.352432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210a131-55e0-41c5-ba12-ceae8e16464b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:37.352432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210a131-55e0-41c5-ba12-ceae8e16464b admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:37.353226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210a131-55e0-41c5-ba12-ceae8e16464b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:20:37.353863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210a131-55e0-41c5-ba12-ceae8e16464b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:37.354346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b0a2f-29ad-4c89-a9f0-1ab050089699 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b980eec2a2ed428e8a513fa6d0f79805)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:37.356344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210a131-55e0-41c5-ba12-ceae8e16464b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:37.358127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b0a2f-29ad-4c89-a9f0-1ab050089699 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:37.374986 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2788/5522] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:37.376321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210a131-55e0-41c5-ba12-ceae8e16464b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:37.429032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210a131-55e0-41c5-ba12-ceae8e16464b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:37.432933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-723b0a2f-29ad-4c89-a9f0-1ab050089699 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b980eec2a2ed428e8a513fa6d0f79805'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:37.441417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f30567-b120-45c7-ade5-5b95cfbf0a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:37.442300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f30567-b120-45c7-ade5-5b95cfbf0a40 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:37.442583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f30567-b120-45c7-ade5-5b95cfbf0a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:37.445409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f30567-b120-45c7-ade5-5b95cfbf0a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:37.448314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f30567-b120-45c7-ade5-5b95cfbf0a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:37.448467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-723b0a2f-29ad-4c89-a9f0-1ab050089699 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b980eec2a2ed428e8a513fa6d0f79805'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:37.455646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f30567-b120-45c7-ade5-5b95cfbf0a40 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:37.488192 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2789/5523] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:37.489876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f30567-b120-45c7-ade5-5b95cfbf0a40 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:37.513689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f30567-b120-45c7-ade5-5b95cfbf0a40 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:37.526621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82852243-d5d8-4d05-904c-3125d79c875a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:37.527422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82852243-d5d8-4d05-904c-3125d79c875a admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:37.527713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82852243-d5d8-4d05-904c-3125d79c875a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:37.527990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82852243-d5d8-4d05-904c-3125d79c875a admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:37.529615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82852243-d5d8-4d05-904c-3125d79c875a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:37.537339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82852243-d5d8-4d05-904c-3125d79c875a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:37.566597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-723b0a2f-29ad-4c89-a9f0-1ab050089699 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b980eec2a2ed428e8a513fa6d0f79805', 'request_id': 'req-723b0a2f-29ad-4c89-a9f0-1ab050089699'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:37.589506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-723b0a2f-29ad-4c89-a9f0-1ab050089699 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b980eec2a2ed428e8a513fa6d0f79805', 'request_id': 'req-723b0a2f-29ad-4c89-a9f0-1ab050089699'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:37.606187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-723b0a2f-29ad-4c89-a9f0-1ab050089699 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b980eec2a2ed428e8a513fa6d0f79805', 'request_id': 'req-723b0a2f-29ad-4c89-a9f0-1ab050089699'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:37.618828 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2790/5524] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:37 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:37.620208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82852243-d5d8-4d05-904c-3125d79c875a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:37.635684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-723b0a2f-29ad-4c89-a9f0-1ab050089699 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] The token cache is being invalidate because project b980eec2a2ed428e8a513fa6d0f79805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:37.637207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-723b0a2f-29ad-4c89-a9f0-1ab050089699 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:37.638494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-723b0a2f-29ad-4c89-a9f0-1ab050089699 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:37.652194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-723b0a2f-29ad-4c89-a9f0-1ab050089699 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b980eec2a2ed428e8a513fa6d0f79805', 'request_id': 'req-723b0a2f-29ad-4c89-a9f0-1ab050089699'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:37.658808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-723b0a2f-29ad-4c89-a9f0-1ab050089699 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b980eec2a2ed428e8a513fa6d0f79805', 'request_id': 'req-723b0a2f-29ad-4c89-a9f0-1ab050089699'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:37.661121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-723b0a2f-29ad-4c89-a9f0-1ab050089699 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b980eec2a2ed428e8a513fa6d0f79805', 'request_id': 'req-723b0a2f-29ad-4c89-a9f0-1ab050089699'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:37.684613 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2735/5525] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:20:37 2022] DELETE /identity/v3/domains/b980eec2a2ed428e8a513fa6d0f79805 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:37.686756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b0a2f-29ad-4c89-a9f0-1ab050089699 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:37.692998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-723b0a2f-29ad-4c89-a9f0-1ab050089699 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:37.780971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:37.813717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82852243-d5d8-4d05-904c-3125d79c875a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:37.834371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7606c-40e4-4199-b705-5cee444d21d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:37.835198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7606c-40e4-4199-b705-5cee444d21d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:37.835522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7606c-40e4-4199-b705-5cee444d21d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:37.836203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7606c-40e4-4199-b705-5cee444d21d4 admin admin] PATH_INFO: `/v3/projects/ea0af90e1758412d8902ad32905272c5/users/26864429e8874d858a823ec42502f736/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:37.870940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7606c-40e4-4199-b705-5cee444d21d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea0af90e1758412d8902ad32905272c5, user_id=26864429e8874d858a823ec42502f736, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:37.875937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7606c-40e4-4199-b705-5cee444d21d4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:37.886688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b0a2f-29ad-4c89-a9f0-1ab050089699 tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:37.930404 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2791/5526] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:37 2022] PUT /identity/v3/projects/ea0af90e1758412d8902ad32905272c5/users/26864429e8874d858a823ec42502f736/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:37.931370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7606c-40e4-4199-b705-5cee444d21d4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:37.943800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0ca7606c-40e4-4199-b705-5cee444d21d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:37.983846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02624af-f0ef-4b80-bb58-f5cbf76e86a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:37.986362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02624af-f0ef-4b80-bb58-f5cbf76e86a0 service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:37.986854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02624af-f0ef-4b80-bb58-f5cbf76e86a0 service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:37.987589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02624af-f0ef-4b80-bb58-f5cbf76e86a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:37.990616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f02624af-f0ef-4b80-bb58-f5cbf76e86a0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:38.135845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02624af-f0ef-4b80-bb58-f5cbf76e86a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:38.137291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02624af-f0ef-4b80-bb58-f5cbf76e86a0 service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:38.143807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7606c-40e4-4199-b705-5cee444d21d4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:38.156416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad879890-365d-448b-8fc8-cca91713202e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:38.157071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad879890-365d-448b-8fc8-cca91713202e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:38.157352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad879890-365d-448b-8fc8-cca91713202e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:38.158008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad879890-365d-448b-8fc8-cca91713202e admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:38.158476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad879890-365d-448b-8fc8-cca91713202e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:38.169225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad879890-365d-448b-8fc8-cca91713202e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:38.170847 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2736/5527] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:38.174791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02624af-f0ef-4b80-bb58-f5cbf76e86a0 service glance] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:38.179160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f02624af-f0ef-4b80-bb58-f5cbf76e86a0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:38.227695 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2792/5528] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:37 2022] POST /identity/v3/users => generated 285 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:38.235191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851c9e0-a6d0-496a-9714-dfd07240d001 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:38.236617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851c9e0-a6d0-496a-9714-dfd07240d001 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:38.236896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851c9e0-a6d0-496a-9714-dfd07240d001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:38.322781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4851c9e0-a6d0-496a-9714-dfd07240d001 None None] MFA Rules not processed for user `26864429e8874d858a823ec42502f736`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:38.324065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4851c9e0-a6d0-496a-9714-dfd07240d001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:38.347893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:38.399718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02624af-f0ef-4b80-bb58-f5cbf76e86a0 service glance] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:38.447874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:38.519090 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2793/5529] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:38.520151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851c9e0-a6d0-496a-9714-dfd07240d001 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:38.539910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851c9e0-a6d0-496a-9714-dfd07240d001 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:38.545304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874e5a1-38a5-4667-a64a-05f85caa777e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:38.546299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd3ea7-8ce7-44bd-8087-75c0214ab212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:38.546480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874e5a1-38a5-4667-a64a-05f85caa777e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:38.546583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874e5a1-38a5-4667-a64a-05f85caa777e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:38.546674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd3ea7-8ce7-44bd-8087-75c0214ab212 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:38.546904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd3ea7-8ce7-44bd-8087-75c0214ab212 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:38.547029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874e5a1-38a5-4667-a64a-05f85caa777e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains/4f136c90b97b41fa97ada29963fd25cd` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:38.547236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd3ea7-8ce7-44bd-8087-75c0214ab212 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:38.548159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd3ea7-8ce7-44bd-8087-75c0214ab212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:38.550924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd3ea7-8ce7-44bd-8087-75c0214ab212 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:38.574393 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2794/5530] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:38.575653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd3ea7-8ce7-44bd-8087-75c0214ab212 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:38.577129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874e5a1-38a5-4667-a64a-05f85caa777e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4f136c90b97b41fa97ada29963fd25cd)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:38.578957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874e5a1-38a5-4667-a64a-05f85caa777e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:38.634776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d874e5a1-38a5-4667-a64a-05f85caa777e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4f136c90b97b41fa97ada29963fd25cd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:38.638016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d874e5a1-38a5-4667-a64a-05f85caa777e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4f136c90b97b41fa97ada29963fd25cd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:38.714540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d874e5a1-38a5-4667-a64a-05f85caa777e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4f136c90b97b41fa97ada29963fd25cd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:38.716541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d874e5a1-38a5-4667-a64a-05f85caa777e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4f136c90b97b41fa97ada29963fd25cd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:38.727456 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2737/5531] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:20:38 2022] PATCH /identity/v3/domains/4f136c90b97b41fa97ada29963fd25cd => generated 276 bytes in 553 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:38.728550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874e5a1-38a5-4667-a64a-05f85caa777e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:38.729037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd3ea7-8ce7-44bd-8087-75c0214ab212 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:38.733325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d874e5a1-38a5-4667-a64a-05f85caa777e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:38.822056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a105c-fa1e-4f53-9729-383a04fd8d3b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:38.822806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a105c-fa1e-4f53-9729-383a04fd8d3b service glance] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:38.823089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a105c-fa1e-4f53-9729-383a04fd8d3b service glance] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:38.823388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a105c-fa1e-4f53-9729-383a04fd8d3b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:38.825703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-078a105c-fa1e-4f53-9729-383a04fd8d3b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:38.869098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874e5a1-38a5-4667-a64a-05f85caa777e tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:38.885029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9629434-8ddb-4949-b883-f3c5aafb013d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:38.885974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9629434-8ddb-4949-b883-f3c5aafb013d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:38.886451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9629434-8ddb-4949-b883-f3c5aafb013d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:38.886893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9629434-8ddb-4949-b883-f3c5aafb013d admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:38.887824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9629434-8ddb-4949-b883-f3c5aafb013d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:38.894457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9629434-8ddb-4949-b883-f3c5aafb013d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:38.944800 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2738/5532] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:38.945613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9629434-8ddb-4949-b883-f3c5aafb013d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:38.953476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f9629434-8ddb-4949-b883-f3c5aafb013d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:38.981989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a105c-fa1e-4f53-9729-383a04fd8d3b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:38.985349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a105c-fa1e-4f53-9729-383a04fd8d3b service glance] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:39.039585 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2795/5533] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:39.040554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a105c-fa1e-4f53-9729-383a04fd8d3b service glance] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:39.081105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:39.100537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a105c-fa1e-4f53-9729-383a04fd8d3b service glance] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:39.117230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0a994-5e20-43b2-ac26-ae33017001fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:39.117989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0a994-5e20-43b2-ac26-ae33017001fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:39.118276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0a994-5e20-43b2-ac26-ae33017001fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:39.122844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0a994-5e20-43b2-ac26-ae33017001fb admin admin] PATH_INFO: `/v3/projects/deb2310709174e288f857715071a00f3/users/9c90566035954c90aee066b6606adc43/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:39.159809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0a994-5e20-43b2-ac26-ae33017001fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb2310709174e288f857715071a00f3, user_id=9c90566035954c90aee066b6606adc43, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:39.168801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0a994-5e20-43b2-ac26-ae33017001fb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:39.191775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9629434-8ddb-4949-b883-f3c5aafb013d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:39.206544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33d508620aa474ebf9252dba782b13e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d1ea33dec73407aabab93b3750383a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:39.208215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:39.209192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:39.211067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] PATH_INFO: `/v3/domains/4f136c90b97b41fa97ada29963fd25cd` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:39.217112 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2796/5534] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:39 2022] PUT /identity/v3/projects/deb2310709174e288f857715071a00f3/users/9c90566035954c90aee066b6606adc43/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:39.230476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3de44-1763-420d-95b0-e5a602b7a627 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:39.230992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3de44-1763-420d-95b0-e5a602b7a627 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:39.231300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3de44-1763-420d-95b0-e5a602b7a627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:39.257183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4f136c90b97b41fa97ada29963fd25cd)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:39.260598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:39.283508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:39.302730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4f136c90b97b41fa97ada29963fd25cd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:39.308004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4f136c90b97b41fa97ada29963fd25cd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:39.316637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-74f3de44-1763-420d-95b0-e5a602b7a627 None None] MFA Rules not processed for user `9c90566035954c90aee066b6606adc43`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:39.322212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-74f3de44-1763-420d-95b0-e5a602b7a627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:39.383776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f136c90b97b41fa97ada29963fd25cd', 'request_id': 'req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:39.394834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f136c90b97b41fa97ada29963fd25cd', 'request_id': 'req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:39.411840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f136c90b97b41fa97ada29963fd25cd', 'request_id': 'req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:39.427712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] The token cache is being invalidate because project 4f136c90b97b41fa97ada29963fd25cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:39.428034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:39.429080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:39.443475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4f136c90b97b41fa97ada29963fd25cd', 'request_id': 'req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:39.451235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4f136c90b97b41fa97ada29963fd25cd', 'request_id': 'req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:39.452604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4f136c90b97b41fa97ada29963fd25cd', 'request_id': 'req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:39.468765 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2739/5535] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:20:38 2022] DELETE /identity/v3/domains/4f136c90b97b41fa97ada29963fd25cd => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:39.470947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:39.477953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:39.575571 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2797/5536] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:39.578781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507df001-4dcc-46eb-a41f-6aa9ed888eb2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:39.580295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507df001-4dcc-46eb-a41f-6aa9ed888eb2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:39.581556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507df001-4dcc-46eb-a41f-6aa9ed888eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:39.614651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae61e53-d9eb-4465-aae2-13b6f19d9b2d tempest-DomainsTestJSON-95330833 tempest-DomainsTestJSON-95330833-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:39.638033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7c247-19ae-42f2-9aa4-c8dbe4ccab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:39.638990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7c247-19ae-42f2-9aa4-c8dbe4ccab2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:39.639419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7c247-19ae-42f2-9aa4-c8dbe4ccab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:39.640152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7c247-19ae-42f2-9aa4-c8dbe4ccab2d admin admin] PATH_INFO: `/v3/users/0eca9023a66146138deb388370723103` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:39.641185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7c247-19ae-42f2-9aa4-c8dbe4ccab2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eca9023a66146138deb388370723103)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:39.652923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7c247-19ae-42f2-9aa4-c8dbe4ccab2d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:39.663040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-507df001-4dcc-46eb-a41f-6aa9ed888eb2 None None] MFA Rules not processed for user `6896ccb6369541d5a552f3373f39c64d`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:39.666448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-507df001-4dcc-46eb-a41f-6aa9ed888eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:39.762388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-81b7c247-19ae-42f2-9aa4-c8dbe4ccab2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eca9023a66146138deb388370723103'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:39.763258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-81b7c247-19ae-42f2-9aa4-c8dbe4ccab2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eca9023a66146138deb388370723103'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:39.772156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:39.785756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-81b7c247-19ae-42f2-9aa4-c8dbe4ccab2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eca9023a66146138deb388370723103'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:39.787827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-81b7c247-19ae-42f2-9aa4-c8dbe4ccab2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eca9023a66146138deb388370723103'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:39.803601 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2798/5537] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:39.803814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-81b7c247-19ae-42f2-9aa4-c8dbe4ccab2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eca9023a66146138deb388370723103'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:39.803908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507df001-4dcc-46eb-a41f-6aa9ed888eb2 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:39.804137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-507df001-4dcc-46eb-a41f-6aa9ed888eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:39.819870 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2740/5538] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:39 2022] DELETE /identity/v3/users/0eca9023a66146138deb388370723103 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:39.820775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7c247-19ae-42f2-9aa4-c8dbe4ccab2d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:39.822775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-81b7c247-19ae-42f2-9aa4-c8dbe4ccab2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:39.823742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507df001-4dcc-46eb-a41f-6aa9ed888eb2 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:39.948522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:39.962923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e416bc8-5419-4ff1-97fe-3cf951f53e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:39.965654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e416bc8-5419-4ff1-97fe-3cf951f53e74 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:39.969162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e416bc8-5419-4ff1-97fe-3cf951f53e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:39.969780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e416bc8-5419-4ff1-97fe-3cf951f53e74 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:39.971116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e416bc8-5419-4ff1-97fe-3cf951f53e74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:39.974913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e416bc8-5419-4ff1-97fe-3cf951f53e74 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:40.016040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7c247-19ae-42f2-9aa4-c8dbe4ccab2d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:40.024247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf973ff9-0ad3-4897-a19a-d21aa23fb4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:40.025045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf973ff9-0ad3-4897-a19a-d21aa23fb4b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:40.025470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf973ff9-0ad3-4897-a19a-d21aa23fb4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:40.025790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf973ff9-0ad3-4897-a19a-d21aa23fb4b4 admin admin] PATH_INFO: `/v3/users/57d87b65dc164c76b8878da471bec4f5` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:40.028083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf973ff9-0ad3-4897-a19a-d21aa23fb4b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57d87b65dc164c76b8878da471bec4f5)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:40.030145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf973ff9-0ad3-4897-a19a-d21aa23fb4b4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:40.030604 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2799/5539] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:39 2022] POST /identity/v3/projects => generated 369 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:40.033096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e416bc8-5419-4ff1-97fe-3cf951f53e74 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:40.036013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7e416bc8-5419-4ff1-97fe-3cf951f53e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:40.137959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cf973ff9-0ad3-4897-a19a-d21aa23fb4b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57d87b65dc164c76b8878da471bec4f5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:40.138953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cf973ff9-0ad3-4897-a19a-d21aa23fb4b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57d87b65dc164c76b8878da471bec4f5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:40.146624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e416bc8-5419-4ff1-97fe-3cf951f53e74 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:40.156874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70b0fc-a80c-4bde-a103-85e3255137c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:40.158427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70b0fc-a80c-4bde-a103-85e3255137c2 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:40.158971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70b0fc-a80c-4bde-a103-85e3255137c2 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:40.163169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cf973ff9-0ad3-4897-a19a-d21aa23fb4b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57d87b65dc164c76b8878da471bec4f5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:40.164538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cf973ff9-0ad3-4897-a19a-d21aa23fb4b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57d87b65dc164c76b8878da471bec4f5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:40.167844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70b0fc-a80c-4bde-a103-85e3255137c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:40.171673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6a70b0fc-a80c-4bde-a103-85e3255137c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:40.189904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cf973ff9-0ad3-4897-a19a-d21aa23fb4b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57d87b65dc164c76b8878da471bec4f5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:40.212536 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2741/5540] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:39 2022] DELETE /identity/v3/users/57d87b65dc164c76b8878da471bec4f5 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:40.213872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835fb2c-1ccc-4d46-a760-a810cf44169b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:40.214227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835fb2c-1ccc-4d46-a760-a810cf44169b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:40.214515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835fb2c-1ccc-4d46-a760-a810cf44169b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:40.239612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c835fb2c-1ccc-4d46-a760-a810cf44169b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:40.241049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c835fb2c-1ccc-4d46-a760-a810cf44169b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:40.312817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70b0fc-a80c-4bde-a103-85e3255137c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:40.316090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70b0fc-a80c-4bde-a103-85e3255137c2 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:40.339714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:40.346519 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2800/5541] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:40.347429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70b0fc-a80c-4bde-a103-85e3255137c2 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:40.353853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6a70b0fc-a80c-4bde-a103-85e3255137c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:40.361992 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2742/5542] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:40.363967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2b323-16ae-48de-9b66-04645571a799 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:40.364273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2b323-16ae-48de-9b66-04645571a799 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:40.364979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2b323-16ae-48de-9b66-04645571a799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:40.390794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b3d2b323-16ae-48de-9b66-04645571a799 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:40.392327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b3d2b323-16ae-48de-9b66-04645571a799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:40.406633 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2743/5543] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:40.406633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2b323-16ae-48de-9b66-04645571a799 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:40.416212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b3d2b323-16ae-48de-9b66-04645571a799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:40.546047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70b0fc-a80c-4bde-a103-85e3255137c2 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:40.574910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411e22f-cf8f-4f8c-9651-180e647fdcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:40.575685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411e22f-cf8f-4f8c-9651-180e647fdcda admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:40.575978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411e22f-cf8f-4f8c-9651-180e647fdcda admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:40.576258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411e22f-cf8f-4f8c-9651-180e647fdcda admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:40.576997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411e22f-cf8f-4f8c-9651-180e647fdcda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:40.578410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2b323-16ae-48de-9b66-04645571a799 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:40.586798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411e22f-cf8f-4f8c-9651-180e647fdcda admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:40.597128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2a193-af0d-491b-bbcd-3f3f58a72f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:40.598400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2a193-af0d-491b-bbcd-3f3f58a72f5e service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:40.598777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2a193-af0d-491b-bbcd-3f3f58a72f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:40.599218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2a193-af0d-491b-bbcd-3f3f58a72f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:40.619673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2a193-af0d-491b-bbcd-3f3f58a72f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:40.621718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2a193-af0d-491b-bbcd-3f3f58a72f5e service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:40.625474 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2801/5544] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:40 2022] POST /identity/v3/users => generated 291 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:40.626464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411e22f-cf8f-4f8c-9651-180e647fdcda admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:40.648129 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2744/5545] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:40.649575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2a193-af0d-491b-bbcd-3f3f58a72f5e service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:40.662280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411e22f-cf8f-4f8c-9651-180e647fdcda admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:40.667014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faaf04-fd6a-4f07-88e7-8f7506d6f928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:40.668613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faaf04-fd6a-4f07-88e7-8f7506d6f928 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:40.668909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faaf04-fd6a-4f07-88e7-8f7506d6f928 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:40.669245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faaf04-fd6a-4f07-88e7-8f7506d6f928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:40.670770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2a193-af0d-491b-bbcd-3f3f58a72f5e service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:40.679034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19c248-2ae9-4253-9bfe-c8b71fd1a37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:40.679420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19c248-2ae9-4253-9bfe-c8b71fd1a37a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:40.679686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19c248-2ae9-4253-9bfe-c8b71fd1a37a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:40.680392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:40.680695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19c248-2ae9-4253-9bfe-c8b71fd1a37a admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:40.682423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19c248-2ae9-4253-9bfe-c8b71fd1a37a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:40.684515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97faaf04-fd6a-4f07-88e7-8f7506d6f928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:40.684774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19c248-2ae9-4253-9bfe-c8b71fd1a37a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:40.687273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97faaf04-fd6a-4f07-88e7-8f7506d6f928 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:40.706530 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2802/5546] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:40.716011 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2745/5547] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:40.721377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faaf04-fd6a-4f07-88e7-8f7506d6f928 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:40.737586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faaf04-fd6a-4f07-88e7-8f7506d6f928 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:40.746707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f4451-073a-4141-bc1b-1f3d7d55773f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:40.747448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f4451-073a-4141-bc1b-1f3d7d55773f admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:40.747743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f4451-073a-4141-bc1b-1f3d7d55773f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:40.748084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f4451-073a-4141-bc1b-1f3d7d55773f admin admin] PATH_INFO: `/v3/projects/e4a9dadb374c433fa05eb554a48046d4/users/af06d33e9645402d937a50ab306a0ca2/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:40.768962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f4451-073a-4141-bc1b-1f3d7d55773f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a9dadb374c433fa05eb554a48046d4, user_id=af06d33e9645402d937a50ab306a0ca2, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:40.772255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f4451-073a-4141-bc1b-1f3d7d55773f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:40.802689 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2803/5548] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:40 2022] PUT /identity/v3/projects/e4a9dadb374c433fa05eb554a48046d4/users/af06d33e9645402d937a50ab306a0ca2/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:40.807029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19c248-2ae9-4253-9bfe-c8b71fd1a37a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:40.826953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19c248-2ae9-4253-9bfe-c8b71fd1a37a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:40.951931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6209fa-2b6d-4beb-9bda-f7c921ab7df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:40.952653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6209fa-2b6d-4beb-9bda-f7c921ab7df1 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:40.952944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6209fa-2b6d-4beb-9bda-f7c921ab7df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:40.953228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6209fa-2b6d-4beb-9bda-f7c921ab7df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:40.955075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6209fa-2b6d-4beb-9bda-f7c921ab7df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:40.956538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6209fa-2b6d-4beb-9bda-f7c921ab7df1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:40.977404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f4451-073a-4141-bc1b-1f3d7d55773f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:40.977849 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2746/5549] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:40.990914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f4451-073a-4141-bc1b-1f3d7d55773f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:41.012340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a756913-083c-4d6d-bc64-4f1ec9a449c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:41.015162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a756913-083c-4d6d-bc64-4f1ec9a449c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:41.015396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a756913-083c-4d6d-bc64-4f1ec9a449c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:41.016686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a756913-083c-4d6d-bc64-4f1ec9a449c3 admin admin] PATH_INFO: `/v3/projects/e4a9dadb374c433fa05eb554a48046d4/users/af06d33e9645402d937a50ab306a0ca2/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:41.028267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a756913-083c-4d6d-bc64-4f1ec9a449c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a9dadb374c433fa05eb554a48046d4, user_id=af06d33e9645402d937a50ab306a0ca2, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:41.031101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a756913-083c-4d6d-bc64-4f1ec9a449c3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:41.051792 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2804/5550] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:40 2022] PUT /identity/v3/projects/e4a9dadb374c433fa05eb554a48046d4/users/af06d33e9645402d937a50ab306a0ca2/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:41.062090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190a501-dce1-4e40-b11e-2993a8cf4f61 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:41.062381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190a501-dce1-4e40-b11e-2993a8cf4f61 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:41.062663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190a501-dce1-4e40-b11e-2993a8cf4f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:41.118741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4190a501-dce1-4e40-b11e-2993a8cf4f61 None None] MFA Rules not processed for user `af06d33e9645402d937a50ab306a0ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:41.120132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4190a501-dce1-4e40-b11e-2993a8cf4f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:41.265199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:41.278156 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2747/5551] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:41.316300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a756913-083c-4d6d-bc64-4f1ec9a449c3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:41.517659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a756913-083c-4d6d-bc64-4f1ec9a449c3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:41.530222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561bdb2-8e6f-4b05-83cc-f18937277147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:41.530222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561bdb2-8e6f-4b05-83cc-f18937277147 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:41.530222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561bdb2-8e6f-4b05-83cc-f18937277147 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:41.530860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561bdb2-8e6f-4b05-83cc-f18937277147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:41.545496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561bdb2-8e6f-4b05-83cc-f18937277147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:41.547283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561bdb2-8e6f-4b05-83cc-f18937277147 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:41.560959 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2805/5552] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:41 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:41.963666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190a501-dce1-4e40-b11e-2993a8cf4f61 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:41.965456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4190a501-dce1-4e40-b11e-2993a8cf4f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:42.066507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561bdb2-8e6f-4b05-83cc-f18937277147 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:42.068876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f561bdb2-8e6f-4b05-83cc-f18937277147 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:42.121934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190a501-dce1-4e40-b11e-2993a8cf4f61 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:42.129979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a627a-5152-46aa-b573-38ea19aec98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:42.130905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a627a-5152-46aa-b573-38ea19aec98a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:42.131469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a627a-5152-46aa-b573-38ea19aec98a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:42.134446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a627a-5152-46aa-b573-38ea19aec98a admin admin] PATH_INFO: `/v3/projects/017c04296e5b4a8e814f13f6d224425e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:42.136716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a627a-5152-46aa-b573-38ea19aec98a admin admin] RBAC: Authorizing `identity:delete_project(project_id=017c04296e5b4a8e814f13f6d224425e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:42.139970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a627a-5152-46aa-b573-38ea19aec98a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:42.214245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-825a627a-5152-46aa-b573-38ea19aec98a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017c04296e5b4a8e814f13f6d224425e', 'request_id': 'req-825a627a-5152-46aa-b573-38ea19aec98a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:42.227520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-825a627a-5152-46aa-b573-38ea19aec98a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017c04296e5b4a8e814f13f6d224425e', 'request_id': 'req-825a627a-5152-46aa-b573-38ea19aec98a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:42.244018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-825a627a-5152-46aa-b573-38ea19aec98a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017c04296e5b4a8e814f13f6d224425e', 'request_id': 'req-825a627a-5152-46aa-b573-38ea19aec98a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:42.272522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-825a627a-5152-46aa-b573-38ea19aec98a admin admin] The token cache is being invalidate because project 017c04296e5b4a8e814f13f6d224425e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:42.273640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-825a627a-5152-46aa-b573-38ea19aec98a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:42.277147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-825a627a-5152-46aa-b573-38ea19aec98a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:42.284093 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2748/5553] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:41 2022] DELETE /identity/v3/projects/017c04296e5b4a8e814f13f6d224425e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:42.285508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a627a-5152-46aa-b573-38ea19aec98a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:42.290190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-825a627a-5152-46aa-b573-38ea19aec98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:42.295086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561bdb2-8e6f-4b05-83cc-f18937277147 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:42.434108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d06c2d-458e-4b56-91a2-af31a188127f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:42.434875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d06c2d-458e-4b56-91a2-af31a188127f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:42.435962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d06c2d-458e-4b56-91a2-af31a188127f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:42.436255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d06c2d-458e-4b56-91a2-af31a188127f admin admin] PATH_INFO: `/v3/projects/62c880ce8c254b51b599c9a7f39111b3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:42.438208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d06c2d-458e-4b56-91a2-af31a188127f admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c880ce8c254b51b599c9a7f39111b3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:42.441523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d06c2d-458e-4b56-91a2-af31a188127f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:42.466344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:42.516307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a627a-5152-46aa-b573-38ea19aec98a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:42.545472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d6d06c2d-458e-4b56-91a2-af31a188127f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c880ce8c254b51b599c9a7f39111b3', 'request_id': 'req-d6d06c2d-458e-4b56-91a2-af31a188127f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:42.555089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d6d06c2d-458e-4b56-91a2-af31a188127f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c880ce8c254b51b599c9a7f39111b3', 'request_id': 'req-d6d06c2d-458e-4b56-91a2-af31a188127f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:42.568868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d6d06c2d-458e-4b56-91a2-af31a188127f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c880ce8c254b51b599c9a7f39111b3', 'request_id': 'req-d6d06c2d-458e-4b56-91a2-af31a188127f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:42.588170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d6d06c2d-458e-4b56-91a2-af31a188127f admin admin] The token cache is being invalidate because project 62c880ce8c254b51b599c9a7f39111b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:42.588623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d6d06c2d-458e-4b56-91a2-af31a188127f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:42.589816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d6d06c2d-458e-4b56-91a2-af31a188127f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:42.595801 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2806/5554] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:42 2022] DELETE /identity/v3/projects/62c880ce8c254b51b599c9a7f39111b3 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:20:42.597153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:42.597294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d06c2d-458e-4b56-91a2-af31a188127f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:42.598580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d6d06c2d-458e-4b56-91a2-af31a188127f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:42.641697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287d4db-0a1e-4128-9861-bc54f26f9d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:42.642899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287d4db-0a1e-4128-9861-bc54f26f9d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:42.643248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287d4db-0a1e-4128-9861-bc54f26f9d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:42.643669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287d4db-0a1e-4128-9861-bc54f26f9d3b admin admin] PATH_INFO: `/v3/users/e33d508620aa474ebf9252dba782b13e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:42.645635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287d4db-0a1e-4128-9861-bc54f26f9d3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e33d508620aa474ebf9252dba782b13e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:42.647708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287d4db-0a1e-4128-9861-bc54f26f9d3b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:42.744984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4287d4db-0a1e-4128-9861-bc54f26f9d3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e33d508620aa474ebf9252dba782b13e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:42.746847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4287d4db-0a1e-4128-9861-bc54f26f9d3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e33d508620aa474ebf9252dba782b13e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:42.760130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d06c2d-458e-4b56-91a2-af31a188127f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:42.767784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccacb64-2a76-4ba7-a876-bcacf345a64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:42.769126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccacb64-2a76-4ba7-a876-bcacf345a64a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:42.769449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccacb64-2a76-4ba7-a876-bcacf345a64a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:42.769806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccacb64-2a76-4ba7-a876-bcacf345a64a admin admin] PATH_INFO: `/v3/users/26864429e8874d858a823ec42502f736` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:42.771584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccacb64-2a76-4ba7-a876-bcacf345a64a admin admin] RBAC: Authorizing `identity:delete_user(user_id=26864429e8874d858a823ec42502f736)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:42.774055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccacb64-2a76-4ba7-a876-bcacf345a64a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:42.775749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4287d4db-0a1e-4128-9861-bc54f26f9d3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e33d508620aa474ebf9252dba782b13e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:42.777437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4287d4db-0a1e-4128-9861-bc54f26f9d3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e33d508620aa474ebf9252dba782b13e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:42.791588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4287d4db-0a1e-4128-9861-bc54f26f9d3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e33d508620aa474ebf9252dba782b13e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:42.834226 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2749/5555] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:42 2022] DELETE /identity/v3/users/e33d508620aa474ebf9252dba782b13e => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:42.860181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bccacb64-2a76-4ba7-a876-bcacf345a64a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26864429e8874d858a823ec42502f736'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:42.891275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bccacb64-2a76-4ba7-a876-bcacf345a64a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26864429e8874d858a823ec42502f736'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:42.906141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bccacb64-2a76-4ba7-a876-bcacf345a64a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26864429e8874d858a823ec42502f736'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:42.920382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bccacb64-2a76-4ba7-a876-bcacf345a64a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26864429e8874d858a823ec42502f736'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:42.922021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bccacb64-2a76-4ba7-a876-bcacf345a64a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26864429e8874d858a823ec42502f736'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:42.951613 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2807/5556] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:42 2022] DELETE /identity/v3/users/26864429e8874d858a823ec42502f736 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:20:42.987988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4670c76-f9e4-4019-a818-1d8dd4e9ed12 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:42.988464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4670c76-f9e4-4019-a818-1d8dd4e9ed12 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:42.988665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4670c76-f9e4-4019-a818-1d8dd4e9ed12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:43.035876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f4670c76-f9e4-4019-a818-1d8dd4e9ed12 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:43.035876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f4670c76-f9e4-4019-a818-1d8dd4e9ed12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:43.209976 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2750/5557] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:20:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:43.249582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccacb64-2a76-4ba7-a876-bcacf345a64a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:43.251967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bccacb64-2a76-4ba7-a876-bcacf345a64a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:43.308780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:43.434082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccacb64-2a76-4ba7-a876-bcacf345a64a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:43.440658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f511d0c-88d4-4cd4-a51a-f12ffae259d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:43.441338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f511d0c-88d4-4cd4-a51a-f12ffae259d1 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:43.441573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f511d0c-88d4-4cd4-a51a-f12ffae259d1 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:43.441913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f511d0c-88d4-4cd4-a51a-f12ffae259d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:43.452495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f511d0c-88d4-4cd4-a51a-f12ffae259d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:43.455378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f511d0c-88d4-4cd4-a51a-f12ffae259d1 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:43.466255 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2808/5558] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:20:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:20:44.614853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4670c76-f9e4-4019-a818-1d8dd4e9ed12 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:44.616653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f4670c76-f9e4-4019-a818-1d8dd4e9ed12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:44.813271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:44.862099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4670c76-f9e4-4019-a818-1d8dd4e9ed12 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:44.869800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9c29d-b25b-4c15-b075-facea58fe6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:44.870481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9c29d-b25b-4c15-b075-facea58fe6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:44.870769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9c29d-b25b-4c15-b075-facea58fe6db admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:44.871048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9c29d-b25b-4c15-b075-facea58fe6db admin admin] PATH_INFO: `/v3/projects/ea0af90e1758412d8902ad32905272c5` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:44.874524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9c29d-b25b-4c15-b075-facea58fe6db admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea0af90e1758412d8902ad32905272c5)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:44.880101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9c29d-b25b-4c15-b075-facea58fe6db admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:45.036322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ec9c29d-b25b-4c15-b075-facea58fe6db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea0af90e1758412d8902ad32905272c5', 'request_id': 'req-6ec9c29d-b25b-4c15-b075-facea58fe6db'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:45.056645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ec9c29d-b25b-4c15-b075-facea58fe6db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea0af90e1758412d8902ad32905272c5', 'request_id': 'req-6ec9c29d-b25b-4c15-b075-facea58fe6db'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:45.066810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ec9c29d-b25b-4c15-b075-facea58fe6db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea0af90e1758412d8902ad32905272c5', 'request_id': 'req-6ec9c29d-b25b-4c15-b075-facea58fe6db'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:45.094382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ec9c29d-b25b-4c15-b075-facea58fe6db admin admin] The token cache is being invalidate because project ea0af90e1758412d8902ad32905272c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:45.096452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ec9c29d-b25b-4c15-b075-facea58fe6db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:45.098918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ec9c29d-b25b-4c15-b075-facea58fe6db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:45.105387 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2751/5559] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:44 2022] DELETE /identity/v3/projects/ea0af90e1758412d8902ad32905272c5 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:45.107641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927189fc-c618-4239-bbcf-f9af826f2360 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:45.108602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927189fc-c618-4239-bbcf-f9af826f2360 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:45.109119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927189fc-c618-4239-bbcf-f9af826f2360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:45.172512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-927189fc-c618-4239-bbcf-f9af826f2360 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:45.177578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-927189fc-c618-4239-bbcf-f9af826f2360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:45.364475 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2809/5560] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:45.373994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645a86a-3ea9-4754-964e-abf23a0adb23 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:45.374296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645a86a-3ea9-4754-964e-abf23a0adb23 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:45.374584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645a86a-3ea9-4754-964e-abf23a0adb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:45.437235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8645a86a-3ea9-4754-964e-abf23a0adb23 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:45.445719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8645a86a-3ea9-4754-964e-abf23a0adb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:45.479817 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2752/5561] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:45.484496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927189fc-c618-4239-bbcf-f9af826f2360 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:45.520496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927189fc-c618-4239-bbcf-f9af826f2360 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:45.541930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f37bc-7987-40ae-adb3-3a1ce23326b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:45.542694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f37bc-7987-40ae-adb3-3a1ce23326b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:45.544340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f37bc-7987-40ae-adb3-3a1ce23326b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:45.544858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f37bc-7987-40ae-adb3-3a1ce23326b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:45.545698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f37bc-7987-40ae-adb3-3a1ce23326b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:20:45.551592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f37bc-7987-40ae-adb3-3a1ce23326b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:45.555567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f37bc-7987-40ae-adb3-3a1ce23326b7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:45.600060 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2810/5562] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:45.601848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645a86a-3ea9-4754-964e-abf23a0adb23 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:45.627607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645a86a-3ea9-4754-964e-abf23a0adb23 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:45.642506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a09a1-80a9-48f9-bef9-724d9abe3cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:45.643161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a09a1-80a9-48f9-bef9-724d9abe3cca admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:45.643474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a09a1-80a9-48f9-bef9-724d9abe3cca admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:45.643751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a09a1-80a9-48f9-bef9-724d9abe3cca admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:45.644898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a09a1-80a9-48f9-bef9-724d9abe3cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:45.651460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a09a1-80a9-48f9-bef9-724d9abe3cca admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:45.710229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc296d8-512c-436e-870c-5270ee471e73 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:45.710833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc296d8-512c-436e-870c-5270ee471e73 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:45.711271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc296d8-512c-436e-870c-5270ee471e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:45.763916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3cc296d8-512c-436e-870c-5270ee471e73 None None] MFA Rules not processed for user `6896ccb6369541d5a552f3373f39c64d`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:45.767417 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2753/5563] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:45 2022] POST /identity/v3/projects => generated 405 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:20:45.768422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a09a1-80a9-48f9-bef9-724d9abe3cca admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:45.768938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3cc296d8-512c-436e-870c-5270ee471e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:45.888665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a09a1-80a9-48f9-bef9-724d9abe3cca admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:45.896005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b451488-db9b-4b7c-96ad-acdf8d8da951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:45.896961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b451488-db9b-4b7c-96ad-acdf8d8da951 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:45.897408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b451488-db9b-4b7c-96ad-acdf8d8da951 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:45.897848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b451488-db9b-4b7c-96ad-acdf8d8da951 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:45.898717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b451488-db9b-4b7c-96ad-acdf8d8da951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:45.901085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b451488-db9b-4b7c-96ad-acdf8d8da951 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:45.937695 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2811/5564] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:20:45.957089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc296d8-512c-436e-870c-5270ee471e73 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:45.958349 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2754/5565] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:45 2022] POST /identity/v3/users => generated 303 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:45.979379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc296d8-512c-436e-870c-5270ee471e73 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:46.012486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb3509-cbbc-42cd-9b1a-b11ab6264c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:46.013306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb3509-cbbc-42cd-9b1a-b11ab6264c4c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:46.013604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb3509-cbbc-42cd-9b1a-b11ab6264c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:46.013889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb3509-cbbc-42cd-9b1a-b11ab6264c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:46.015669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b451488-db9b-4b7c-96ad-acdf8d8da951 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:46.018034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0b451488-db9b-4b7c-96ad-acdf8d8da951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:46.028582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb3509-cbbc-42cd-9b1a-b11ab6264c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:46.039846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb3509-cbbc-42cd-9b1a-b11ab6264c4c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:46.053808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b451488-db9b-4b7c-96ad-acdf8d8da951 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:46.066690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b323ccf-8b83-4457-a827-0f56b4d3e25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:46.067419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b323ccf-8b83-4457-a827-0f56b4d3e25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:46.067711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b323ccf-8b83-4457-a827-0f56b4d3e25c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:46.068013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b323ccf-8b83-4457-a827-0f56b4d3e25c admin admin] PATH_INFO: `/v3/projects/8d1ea33dec73407aabab93b3750383a9` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:46.077667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b323ccf-8b83-4457-a827-0f56b4d3e25c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d1ea33dec73407aabab93b3750383a9)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:46.086775 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2812/5566] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:20:46.088306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb3509-cbbc-42cd-9b1a-b11ab6264c4c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:46.091914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b323ccf-8b83-4457-a827-0f56b4d3e25c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:46.130274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb3509-cbbc-42cd-9b1a-b11ab6264c4c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:46.146156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992fe37-2a79-4383-b465-33ec0f08f363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:46.146816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992fe37-2a79-4383-b465-33ec0f08f363 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:46.147111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992fe37-2a79-4383-b465-33ec0f08f363 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:46.152777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992fe37-2a79-4383-b465-33ec0f08f363 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:46.153534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992fe37-2a79-4383-b465-33ec0f08f363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:46.160953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992fe37-2a79-4383-b465-33ec0f08f363 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:46.190042 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2813/5567] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:46.199500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992fe37-2a79-4383-b465-33ec0f08f363 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:46.226934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:46.234170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992fe37-2a79-4383-b465-33ec0f08f363 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:46.246957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:46.248012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8b323ccf-8b83-4457-a827-0f56b4d3e25c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d1ea33dec73407aabab93b3750383a9', 'request_id': 'req-8b323ccf-8b83-4457-a827-0f56b4d3e25c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:46.271173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8b323ccf-8b83-4457-a827-0f56b4d3e25c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d1ea33dec73407aabab93b3750383a9', 'request_id': 'req-8b323ccf-8b83-4457-a827-0f56b4d3e25c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:46.282300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8b323ccf-8b83-4457-a827-0f56b4d3e25c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d1ea33dec73407aabab93b3750383a9', 'request_id': 'req-8b323ccf-8b83-4457-a827-0f56b4d3e25c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:46.309744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8b323ccf-8b83-4457-a827-0f56b4d3e25c admin admin] The token cache is being invalidate because project 8d1ea33dec73407aabab93b3750383a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:46.310178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8b323ccf-8b83-4457-a827-0f56b4d3e25c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:46.311022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8b323ccf-8b83-4457-a827-0f56b4d3e25c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:46.317904 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2755/5568] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:46 2022] DELETE /identity/v3/projects/8d1ea33dec73407aabab93b3750383a9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:20:46.323156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14288-a2c5-4115-8980-756fc3282d0d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:46.323408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14288-a2c5-4115-8980-756fc3282d0d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:46.323625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14288-a2c5-4115-8980-756fc3282d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:46.388943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5815f2-b6ef-4afd-b1f0-f33a4cfded5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:46.391015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5815f2-b6ef-4afd-b1f0-f33a4cfded5d admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:46.391379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5815f2-b6ef-4afd-b1f0-f33a4cfded5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:46.391676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5815f2-b6ef-4afd-b1f0-f33a4cfded5d admin admin] PATH_INFO: `/v3/projects/9538f5570ad74876bf00d20278d6478a/users/e52e4d7cd24c4153a6eef2f867edb5dd/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:46.405614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f5c14288-a2c5-4115-8980-756fc3282d0d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:46.410983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f5c14288-a2c5-4115-8980-756fc3282d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:46.442141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5815f2-b6ef-4afd-b1f0-f33a4cfded5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9538f5570ad74876bf00d20278d6478a, user_id=e52e4d7cd24c4153a6eef2f867edb5dd, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:46.444352 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2756/5569] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:46.444776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5815f2-b6ef-4afd-b1f0-f33a4cfded5d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:46.446836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae8463-aad4-41d0-830e-a4786ff01311 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:46.447485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae8463-aad4-41d0-830e-a4786ff01311 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:46.447978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae8463-aad4-41d0-830e-a4786ff01311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:46.495412 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2814/5570] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:46 2022] PUT /identity/v3/projects/9538f5570ad74876bf00d20278d6478a/users/e52e4d7cd24c4153a6eef2f867edb5dd/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:46.497147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-49ae8463-aad4-41d0-830e-a4786ff01311 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:46.498626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-49ae8463-aad4-41d0-830e-a4786ff01311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:46.512126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02ab9a-61c5-4d95-b335-315c037d85ab None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:46.512126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02ab9a-61c5-4d95-b335-315c037d85ab None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:46.512414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02ab9a-61c5-4d95-b335-315c037d85ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:46.612258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-fd02ab9a-61c5-4d95-b335-315c037d85ab None None] MFA Rules not processed for user `e52e4d7cd24c4153a6eef2f867edb5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:46.616509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fd02ab9a-61c5-4d95-b335-315c037d85ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:46.722034 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2757/5571] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:46.724064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae8463-aad4-41d0-830e-a4786ff01311 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:46.749522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae8463-aad4-41d0-830e-a4786ff01311 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:46.761831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bda3f7-7994-4af7-974d-c4e9436d6484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:46.762820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bda3f7-7994-4af7-974d-c4e9436d6484 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:46.764256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bda3f7-7994-4af7-974d-c4e9436d6484 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:46.765104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bda3f7-7994-4af7-974d-c4e9436d6484 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:46.767320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bda3f7-7994-4af7-974d-c4e9436d6484 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:20:46.769104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bda3f7-7994-4af7-974d-c4e9436d6484 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:46.772906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bda3f7-7994-4af7-974d-c4e9436d6484 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:46.800895 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2758/5572] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:46.805451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bda3f7-7994-4af7-974d-c4e9436d6484 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:46.806247 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2815/5573] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:46 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:20:46.810607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02ab9a-61c5-4d95-b335-315c037d85ab None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:46.812440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fd02ab9a-61c5-4d95-b335-315c037d85ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:46.830496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02ab9a-61c5-4d95-b335-315c037d85ab None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:46.831662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bda3f7-7994-4af7-974d-c4e9436d6484 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:46.837503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069d177-8339-4b3b-8c00-6eecd0b8d0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:46.838480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069d177-8339-4b3b-8c00-6eecd0b8d0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:46.838980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069d177-8339-4b3b-8c00-6eecd0b8d0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:46.839511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069d177-8339-4b3b-8c00-6eecd0b8d0a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:46.840626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069d177-8339-4b3b-8c00-6eecd0b8d0a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:46.842402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b78b3-5c72-4787-b32c-1b3d17b4b575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:46.843064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b78b3-5c72-4787-b32c-1b3d17b4b575 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:46.843377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b78b3-5c72-4787-b32c-1b3d17b4b575 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:46.843649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b78b3-5c72-4787-b32c-1b3d17b4b575 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:46.844164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069d177-8339-4b3b-8c00-6eecd0b8d0a9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:46.844382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b78b3-5c72-4787-b32c-1b3d17b4b575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:46.851826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b78b3-5c72-4787-b32c-1b3d17b4b575 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:46.893719 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2816/5574] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:46 2022] POST /identity/v3/projects => generated 405 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:20:46.899328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069d177-8339-4b3b-8c00-6eecd0b8d0a9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:46.919657 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2759/5575] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:46 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:46.924519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b78b3-5c72-4787-b32c-1b3d17b4b575 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:47.069315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069d177-8339-4b3b-8c00-6eecd0b8d0a9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:47.086478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:47.166675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b78b3-5c72-4787-b32c-1b3d17b4b575 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:47.181463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb397616-abff-4cfb-aebe-1adf314599ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:47.182120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb397616-abff-4cfb-aebe-1adf314599ff admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:47.182533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb397616-abff-4cfb-aebe-1adf314599ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:47.182801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb397616-abff-4cfb-aebe-1adf314599ff admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:47.183515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb397616-abff-4cfb-aebe-1adf314599ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:47.195872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb397616-abff-4cfb-aebe-1adf314599ff admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:47.258851 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2760/5576] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:46 2022] POST /identity/v3/users => generated 284 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:47.261482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6849354-1996-47f8-b028-8d71d5654f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:47.263045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6849354-1996-47f8-b028-8d71d5654f02 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:47.264439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6849354-1996-47f8-b028-8d71d5654f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:47.264971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6849354-1996-47f8-b028-8d71d5654f02 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:47.266371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6849354-1996-47f8-b028-8d71d5654f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:47.267333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb397616-abff-4cfb-aebe-1adf314599ff admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:47.279171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6849354-1996-47f8-b028-8d71d5654f02 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:47.305043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb397616-abff-4cfb-aebe-1adf314599ff admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:47.325281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35d5c6-d302-425d-95c8-cae63792bafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:47.326464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35d5c6-d302-425d-95c8-cae63792bafa admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:47.326898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35d5c6-d302-425d-95c8-cae63792bafa admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:47.327191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35d5c6-d302-425d-95c8-cae63792bafa admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:47.327996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35d5c6-d302-425d-95c8-cae63792bafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:47.334013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35d5c6-d302-425d-95c8-cae63792bafa admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:47.342117 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2817/5577] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:46 2022] POST /identity/v3/users => generated 309 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:47.346102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6849354-1996-47f8-b028-8d71d5654f02 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:47.354748 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2761/5578] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:47.359938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35d5c6-d302-425d-95c8-cae63792bafa admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:47.371581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:47.382039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6849354-1996-47f8-b028-8d71d5654f02 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:47.389536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43c9b7-7d9f-4017-aa09-121cf76f93ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:47.391101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43c9b7-7d9f-4017-aa09-121cf76f93ad admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:47.391956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43c9b7-7d9f-4017-aa09-121cf76f93ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:47.392840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43c9b7-7d9f-4017-aa09-121cf76f93ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:47.393778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43c9b7-7d9f-4017-aa09-121cf76f93ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:47.395220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35d5c6-d302-425d-95c8-cae63792bafa admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:47.396205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43c9b7-7d9f-4017-aa09-121cf76f93ad admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:47.412227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edd81b-90da-47de-bb44-ae509de2ccef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:47.412879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edd81b-90da-47de-bb44-ae509de2ccef admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:47.413245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edd81b-90da-47de-bb44-ae509de2ccef admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:47.413438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edd81b-90da-47de-bb44-ae509de2ccef admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:47.414145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edd81b-90da-47de-bb44-ae509de2ccef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:47.414813 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2818/5579] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:47.419262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edd81b-90da-47de-bb44-ae509de2ccef admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:47.426504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43c9b7-7d9f-4017-aa09-121cf76f93ad admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:47.448905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43c9b7-7d9f-4017-aa09-121cf76f93ad admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:47.449158 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2762/5580] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:47.450129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edd81b-90da-47de-bb44-ae509de2ccef admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:47.456429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a64a2c-58f8-4d1e-9ebe-03b3c222380b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:47.457239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a64a2c-58f8-4d1e-9ebe-03b3c222380b admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:47.458010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a64a2c-58f8-4d1e-9ebe-03b3c222380b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:47.458355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a64a2c-58f8-4d1e-9ebe-03b3c222380b admin admin] PATH_INFO: `/v3/projects/f4d0274186914200be712db2ff986325/users/665a5ff0010f4230827a7b54a4c43f6d/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:47.473991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edd81b-90da-47de-bb44-ae509de2ccef admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:47.486782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c4cc3-8efc-4521-91de-af61f8131dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:47.487452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a64a2c-58f8-4d1e-9ebe-03b3c222380b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d0274186914200be712db2ff986325, user_id=665a5ff0010f4230827a7b54a4c43f6d, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:47.487627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c4cc3-8efc-4521-91de-af61f8131dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:47.487893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c4cc3-8efc-4521-91de-af61f8131dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:47.488177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c4cc3-8efc-4521-91de-af61f8131dd9 admin admin] PATH_INFO: `/v3/projects/ecdb6aafe4c04b65b0505261304644bd/users/d22c669d9ae94f45a43954d82e5291be/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:47.490539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a64a2c-58f8-4d1e-9ebe-03b3c222380b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:47.524638 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2819/5581] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:47 2022] PUT /identity/v3/projects/f4d0274186914200be712db2ff986325/users/665a5ff0010f4230827a7b54a4c43f6d/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:47.529454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a64a2c-58f8-4d1e-9ebe-03b3c222380b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:47.536417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c4cc3-8efc-4521-91de-af61f8131dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecdb6aafe4c04b65b0505261304644bd, user_id=d22c669d9ae94f45a43954d82e5291be, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:47.539132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c4cc3-8efc-4521-91de-af61f8131dd9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:47.571825 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2763/5582] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:47 2022] PUT /identity/v3/projects/ecdb6aafe4c04b65b0505261304644bd/users/d22c669d9ae94f45a43954d82e5291be/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:47.576129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddaa4f-c9da-4714-891a-8cf00dbbaad5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:47.576129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddaa4f-c9da-4714-891a-8cf00dbbaad5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:47.576129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddaa4f-c9da-4714-891a-8cf00dbbaad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:47.647870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b9ddaa4f-c9da-4714-891a-8cf00dbbaad5 None None] MFA Rules not processed for user `d22c669d9ae94f45a43954d82e5291be`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:47.649137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b9ddaa4f-c9da-4714-891a-8cf00dbbaad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:47.696926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a64a2c-58f8-4d1e-9ebe-03b3c222380b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:47.814664 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2764/5583] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:47.816156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddaa4f-c9da-4714-891a-8cf00dbbaad5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:47.837150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785009d8-2d3f-4403-9bd1-a684fabbaf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:47.838076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785009d8-2d3f-4403-9bd1-a684fabbaf95 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:47.838367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785009d8-2d3f-4403-9bd1-a684fabbaf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:47.838645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785009d8-2d3f-4403-9bd1-a684fabbaf95 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:47.839371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785009d8-2d3f-4403-9bd1-a684fabbaf95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:47.841935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785009d8-2d3f-4403-9bd1-a684fabbaf95 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:47.855664 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2820/5584] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:20:47.859819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785009d8-2d3f-4403-9bd1-a684fabbaf95 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:47.868891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:47.877652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785009d8-2d3f-4403-9bd1-a684fabbaf95 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:47.888144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a81c99-8836-45ea-b2f2-7a98269fad26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:47.888998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a81c99-8836-45ea-b2f2-7a98269fad26 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:47.889402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a81c99-8836-45ea-b2f2-7a98269fad26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:47.889780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a81c99-8836-45ea-b2f2-7a98269fad26 admin admin] PATH_INFO: `/v3/projects/f4d0274186914200be712db2ff986325/users/665a5ff0010f4230827a7b54a4c43f6d/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:47.894996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a81c99-8836-45ea-b2f2-7a98269fad26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d0274186914200be712db2ff986325, user_id=665a5ff0010f4230827a7b54a4c43f6d, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:47.903723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a81c99-8836-45ea-b2f2-7a98269fad26 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:47.932268 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2821/5585] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:47 2022] PUT /identity/v3/projects/f4d0274186914200be712db2ff986325/users/665a5ff0010f4230827a7b54a4c43f6d/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:47.943793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddaa4f-c9da-4714-891a-8cf00dbbaad5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:47.946373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae46270-93dd-4e61-aee8-3cd2498e5288 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:47.946828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae46270-93dd-4e61-aee8-3cd2498e5288 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:47.947674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae46270-93dd-4e61-aee8-3cd2498e5288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:48.020316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2ae46270-93dd-4e61-aee8-3cd2498e5288 None None] MFA Rules not processed for user `665a5ff0010f4230827a7b54a4c43f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:48.022291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2ae46270-93dd-4e61-aee8-3cd2498e5288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:48.072584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51061458-d4f6-44e6-a6d0-3b28414e7a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:48.073196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51061458-d4f6-44e6-a6d0-3b28414e7a9a admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:48.074025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51061458-d4f6-44e6-a6d0-3b28414e7a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:48.074328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51061458-d4f6-44e6-a6d0-3b28414e7a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:48.075405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51061458-d4f6-44e6-a6d0-3b28414e7a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:48.077398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51061458-d4f6-44e6-a6d0-3b28414e7a9a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:48.090362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:48.124959 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2765/5586] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:47 2022] POST /identity/v3/projects => generated 369 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:48.131784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51061458-d4f6-44e6-a6d0-3b28414e7a9a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:48.196295 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2822/5587] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:47 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:48.207594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae46270-93dd-4e61-aee8-3cd2498e5288 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:48.209273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2ae46270-93dd-4e61-aee8-3cd2498e5288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:48.213757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51061458-d4f6-44e6-a6d0-3b28414e7a9a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:48.219327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc7a82-400c-4f9b-bc20-205fb368d5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:48.220177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc7a82-400c-4f9b-bc20-205fb368d5af admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:48.220535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc7a82-400c-4f9b-bc20-205fb368d5af admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:48.220824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc7a82-400c-4f9b-bc20-205fb368d5af admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:48.221858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc7a82-400c-4f9b-bc20-205fb368d5af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:48.224001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc7a82-400c-4f9b-bc20-205fb368d5af admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:48.269110 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2766/5588] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:48 2022] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:48.271034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc7a82-400c-4f9b-bc20-205fb368d5af admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:48.292171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc7a82-400c-4f9b-bc20-205fb368d5af admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:48.329361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae46270-93dd-4e61-aee8-3cd2498e5288 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:48.342267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86800129-2c14-4cfe-a2eb-45cd041a01af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:48.344544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86800129-2c14-4cfe-a2eb-45cd041a01af admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:48.347307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86800129-2c14-4cfe-a2eb-45cd041a01af admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:48.347307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86800129-2c14-4cfe-a2eb-45cd041a01af admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:48.348867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86800129-2c14-4cfe-a2eb-45cd041a01af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:48.350834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86800129-2c14-4cfe-a2eb-45cd041a01af admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:48.366779 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2767/5589] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:48.372246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86800129-2c14-4cfe-a2eb-45cd041a01af admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:48.386230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86800129-2c14-4cfe-a2eb-45cd041a01af admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:48.393720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09876c-6e9a-463a-a0e9-2610be4383a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:48.394536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09876c-6e9a-463a-a0e9-2610be4383a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:48.394834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09876c-6e9a-463a-a0e9-2610be4383a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:48.395366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09876c-6e9a-463a-a0e9-2610be4383a5 admin admin] PATH_INFO: `/v3/projects/2f96179eb81e43ab85801eff6a7d19dc/users/5d76a75925cf44a2815d502d35aeb81c/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:48.407940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555fa30-e144-47ef-a219-c5fc6b13d31e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:48.409926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555fa30-e144-47ef-a219-c5fc6b13d31e service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:48.410485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555fa30-e144-47ef-a219-c5fc6b13d31e service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:48.411168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555fa30-e144-47ef-a219-c5fc6b13d31e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:48.420249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09876c-6e9a-463a-a0e9-2610be4383a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f96179eb81e43ab85801eff6a7d19dc, user_id=5d76a75925cf44a2815d502d35aeb81c, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:48.424013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09876c-6e9a-463a-a0e9-2610be4383a5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:48.459051 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2768/5590] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:48 2022] PUT /identity/v3/projects/2f96179eb81e43ab85801eff6a7d19dc/users/5d76a75925cf44a2815d502d35aeb81c/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:48.461087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09876c-6e9a-463a-a0e9-2610be4383a5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:48.479186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:48.500672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555fa30-e144-47ef-a219-c5fc6b13d31e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:48.503452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555fa30-e144-47ef-a219-c5fc6b13d31e service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:48.516149 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2823/5591] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:48 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:20:48.583145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09876c-6e9a-463a-a0e9-2610be4383a5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:48.591461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d18c78-5f42-48f9-9eb5-6db82f87e6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:48.592253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d18c78-5f42-48f9-9eb5-6db82f87e6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:48.592555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d18c78-5f42-48f9-9eb5-6db82f87e6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:48.593863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d18c78-5f42-48f9-9eb5-6db82f87e6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:48.594666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d18c78-5f42-48f9-9eb5-6db82f87e6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:48.599463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d18c78-5f42-48f9-9eb5-6db82f87e6b2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:48.632339 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2769/5592] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:48.632849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555fa30-e144-47ef-a219-c5fc6b13d31e service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:48.650804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555fa30-e144-47ef-a219-c5fc6b13d31e service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:48.664544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5541d-647a-46fb-a5f6-f9242cf55103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:48.666832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5541d-647a-46fb-a5f6-f9242cf55103 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:48.667367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5541d-647a-46fb-a5f6-f9242cf55103 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:48.667888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5541d-647a-46fb-a5f6-f9242cf55103 admin admin] PATH_INFO: `/v3/projects/2f96179eb81e43ab85801eff6a7d19dc/users/5d76a75925cf44a2815d502d35aeb81c/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:48.678128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5541d-647a-46fb-a5f6-f9242cf55103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f96179eb81e43ab85801eff6a7d19dc, user_id=5d76a75925cf44a2815d502d35aeb81c, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:48.680865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5541d-647a-46fb-a5f6-f9242cf55103 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:48.725494 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2824/5593] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:20:48 2022] PUT /identity/v3/projects/2f96179eb81e43ab85801eff6a7d19dc/users/5d76a75925cf44a2815d502d35aeb81c/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:48.729681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecd126-9ab7-43db-a110-42b3e5353baf None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:48.730102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecd126-9ab7-43db-a110-42b3e5353baf None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:48.731447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecd126-9ab7-43db-a110-42b3e5353baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:48.737675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5541d-647a-46fb-a5f6-f9242cf55103 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:48.748165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cdd5541d-647a-46fb-a5f6-f9242cf55103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:48.807974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-56ecd126-9ab7-43db-a110-42b3e5353baf None None] MFA Rules not processed for user `5d76a75925cf44a2815d502d35aeb81c`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:20:48.809567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-56ecd126-9ab7-43db-a110-42b3e5353baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:48.909628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:49.070719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5541d-647a-46fb-a5f6-f9242cf55103 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:49.089211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491b0f5-9353-4fea-930c-49f68c7eaa85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:49.089855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491b0f5-9353-4fea-930c-49f68c7eaa85 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:49.090145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491b0f5-9353-4fea-930c-49f68c7eaa85 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:49.090459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491b0f5-9353-4fea-930c-49f68c7eaa85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:49.093736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f491b0f5-9353-4fea-930c-49f68c7eaa85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:49.111694 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2770/5594] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:20:48 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:20:49.117280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecd126-9ab7-43db-a110-42b3e5353baf None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:49.132993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491b0f5-9353-4fea-930c-49f68c7eaa85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:49.136269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491b0f5-9353-4fea-930c-49f68c7eaa85 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:49.142076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecd126-9ab7-43db-a110-42b3e5353baf None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:49.151910 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2825/5595] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:49.158277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3b204-b93e-4869-b931-539cabdb17c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:49.159206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3b204-b93e-4869-b931-539cabdb17c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:49.176803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3b204-b93e-4869-b931-539cabdb17c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:49.177095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3b204-b93e-4869-b931-539cabdb17c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:49.177823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3b204-b93e-4869-b931-539cabdb17c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:49.179745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3b204-b93e-4869-b931-539cabdb17c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:49.257883 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2771/5596] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:49 2022] POST /identity/v3/projects => generated 359 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:20:49.260423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491b0f5-9353-4fea-930c-49f68c7eaa85 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:49.283680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491b0f5-9353-4fea-930c-49f68c7eaa85 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:49.394171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8c1ee-1543-4d1b-a15d-5b3aba8ac33d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:49.395062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8c1ee-1543-4d1b-a15d-5b3aba8ac33d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:49.395628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8c1ee-1543-4d1b-a15d-5b3aba8ac33d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:49.396069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8c1ee-1543-4d1b-a15d-5b3aba8ac33d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:49.397224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8c1ee-1543-4d1b-a15d-5b3aba8ac33d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:49.400071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8c1ee-1543-4d1b-a15d-5b3aba8ac33d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:49.455736 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2826/5597] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:20:49 2022] POST /identity/v3/users => generated 413 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:49.457919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3b204-b93e-4869-b931-539cabdb17c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:49.473159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3b204-b93e-4869-b931-539cabdb17c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:49.481920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcccf1-c04d-44e0-a06c-6aaebc612089 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:49.482704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcccf1-c04d-44e0-a06c-6aaebc612089 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:49.483130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcccf1-c04d-44e0-a06c-6aaebc612089 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:49.483495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcccf1-c04d-44e0-a06c-6aaebc612089 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/users/5c09e47464284682a5f5477689094268` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:49.501453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcccf1-c04d-44e0-a06c-6aaebc612089 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:get_user(user_id=5c09e47464284682a5f5477689094268)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:49.504689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcccf1-c04d-44e0-a06c-6aaebc612089 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:49.509722 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2772/5598] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:20:49 2022] GET /identity/v3/users/5c09e47464284682a5f5477689094268 => generated 413 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:49.512106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8c1ee-1543-4d1b-a15d-5b3aba8ac33d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:49.528406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8c1ee-1543-4d1b-a15d-5b3aba8ac33d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:49.550435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d453785-4a9b-465f-a61a-4c8622f09062 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:49.551372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d453785-4a9b-465f-a61a-4c8622f09062 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:49.553278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d453785-4a9b-465f-a61a-4c8622f09062 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:49.553893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d453785-4a9b-465f-a61a-4c8622f09062 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/users/5c09e47464284682a5f5477689094268` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:49.560355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d453785-4a9b-465f-a61a-4c8622f09062 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5c09e47464284682a5f5477689094268)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:49.563102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d453785-4a9b-465f-a61a-4c8622f09062 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:49.676360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:49.689156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3d453785-4a9b-465f-a61a-4c8622f09062 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c09e47464284682a5f5477689094268'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:49.729902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3d453785-4a9b-465f-a61a-4c8622f09062 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c09e47464284682a5f5477689094268'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:49.731996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3d453785-4a9b-465f-a61a-4c8622f09062 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c09e47464284682a5f5477689094268'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:49.743666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3d453785-4a9b-465f-a61a-4c8622f09062 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c09e47464284682a5f5477689094268'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:49.744523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3d453785-4a9b-465f-a61a-4c8622f09062 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c09e47464284682a5f5477689094268'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:49.776299 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2827/5599] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:20:49 2022] DELETE /identity/v3/users/5c09e47464284682a5f5477689094268 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:49.780285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcccf1-c04d-44e0-a06c-6aaebc612089 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:49.784069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cedcccf1-c04d-44e0-a06c-6aaebc612089 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:49.815097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcccf1-c04d-44e0-a06c-6aaebc612089 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:50.037441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d453785-4a9b-465f-a61a-4c8622f09062 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:50.039179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3d453785-4a9b-465f-a61a-4c8622f09062 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:50.041057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b769b-1fab-46c7-8ddf-e7f2a5b5b229 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:50.043941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b769b-1fab-46c7-8ddf-e7f2a5b5b229 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:50.044241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b769b-1fab-46c7-8ddf-e7f2a5b5b229 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:50.046714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b769b-1fab-46c7-8ddf-e7f2a5b5b229 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/e9eb5f05864c449da4e4458ef12540e1` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:50.049634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b769b-1fab-46c7-8ddf-e7f2a5b5b229 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e9eb5f05864c449da4e4458ef12540e1)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:50.054805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b769b-1fab-46c7-8ddf-e7f2a5b5b229 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:50.208960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e99b769b-1fab-46c7-8ddf-e7f2a5b5b229 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9eb5f05864c449da4e4458ef12540e1', 'request_id': 'req-e99b769b-1fab-46c7-8ddf-e7f2a5b5b229'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:50.221856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d453785-4a9b-465f-a61a-4c8622f09062 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:50.225743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e99b769b-1fab-46c7-8ddf-e7f2a5b5b229 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9eb5f05864c449da4e4458ef12540e1', 'request_id': 'req-e99b769b-1fab-46c7-8ddf-e7f2a5b5b229'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:50.238365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e99b769b-1fab-46c7-8ddf-e7f2a5b5b229 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9eb5f05864c449da4e4458ef12540e1', 'request_id': 'req-e99b769b-1fab-46c7-8ddf-e7f2a5b5b229'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:50.263669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e99b769b-1fab-46c7-8ddf-e7f2a5b5b229 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] The token cache is being invalidate because project e9eb5f05864c449da4e4458ef12540e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:50.263970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e99b769b-1fab-46c7-8ddf-e7f2a5b5b229 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:50.265706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e99b769b-1fab-46c7-8ddf-e7f2a5b5b229 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:50.269353 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2773/5600] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:49 2022] DELETE /identity/v3/projects/e9eb5f05864c449da4e4458ef12540e1 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:20:50.276308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b769b-1fab-46c7-8ddf-e7f2a5b5b229 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:50.278042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e99b769b-1fab-46c7-8ddf-e7f2a5b5b229 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:50.330046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:50.437471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b769b-1fab-46c7-8ddf-e7f2a5b5b229 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:50.444706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2ecb6-5bfd-4921-908c-808f42ffafd9 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:50.445341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2ecb6-5bfd-4921-908c-808f42ffafd9 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:50.445739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2ecb6-5bfd-4921-908c-808f42ffafd9 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:50.446177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2ecb6-5bfd-4921-908c-808f42ffafd9 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:50.446876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2ecb6-5bfd-4921-908c-808f42ffafd9 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:50.450527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2ecb6-5bfd-4921-908c-808f42ffafd9 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:50.492276 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2774/5601] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:50 2022] POST /identity/v3/projects => generated 348 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:20:50.493569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2ecb6-5bfd-4921-908c-808f42ffafd9 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:50.506328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bc443-5fff-4370-9bc3-c2c3ab2927b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:50.506986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bc443-5fff-4370-9bc3-c2c3ab2927b4 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:50.507925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bc443-5fff-4370-9bc3-c2c3ab2927b4 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:50.508227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bc443-5fff-4370-9bc3-c2c3ab2927b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:50.511357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d97bc443-5fff-4370-9bc3-c2c3ab2927b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:50.592906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2ecb6-5bfd-4921-908c-808f42ffafd9 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:50.602223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d88dad-2ae7-4967-9f5f-485eaebb9ecc tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:50.603127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d88dad-2ae7-4967-9f5f-485eaebb9ecc tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:50.603698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d88dad-2ae7-4967-9f5f-485eaebb9ecc tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:50.603929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d88dad-2ae7-4967-9f5f-485eaebb9ecc tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:50.604680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d88dad-2ae7-4967-9f5f-485eaebb9ecc tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:20:50.605000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d88dad-2ae7-4967-9f5f-485eaebb9ecc tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:50.610916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d88dad-2ae7-4967-9f5f-485eaebb9ecc tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:50.625775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:50.645968 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2775/5602] 10.222.0.17 () {58 vars in 1160 bytes} [Sat Jul 30 21:20:50 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:50.650470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d88dad-2ae7-4967-9f5f-485eaebb9ecc tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:50.662451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bc443-5fff-4370-9bc3-c2c3ab2927b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:50.665531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bc443-5fff-4370-9bc3-c2c3ab2927b4 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:50.671919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d88dad-2ae7-4967-9f5f-485eaebb9ecc tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:50.688311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5647b8-96f6-4153-a4d3-b663695c0355 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:50.690101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5647b8-96f6-4153-a4d3-b663695c0355 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:50.690101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5647b8-96f6-4153-a4d3-b663695c0355 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:50.690778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5647b8-96f6-4153-a4d3-b663695c0355 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:50.691818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5647b8-96f6-4153-a4d3-b663695c0355 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:50.693460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5647b8-96f6-4153-a4d3-b663695c0355 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:50.697023 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2828/5603] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:50 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:20:50.729971 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2776/5604] 10.222.0.17 () {58 vars in 1128 bytes} [Sat Jul 30 21:20:50 2022] GET /identity/v3/domains => generated 829 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:50.734531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bc443-5fff-4370-9bc3-c2c3ab2927b4 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:50.799782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bc443-5fff-4370-9bc3-c2c3ab2927b4 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:50.816522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ef938-ffca-4059-88ee-0679cfb27aff tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:50.817540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ef938-ffca-4059-88ee-0679cfb27aff tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:50.818002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ef938-ffca-4059-88ee-0679cfb27aff tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:50.818432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ef938-ffca-4059-88ee-0679cfb27aff tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/eed78b0f758b4399aa3c56a3ae2726ad` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:50.824197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ef938-ffca-4059-88ee-0679cfb27aff tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:update_project(project_id=eed78b0f758b4399aa3c56a3ae2726ad)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:50.825536 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-1d7ef938-ffca-4059-88ee-0679cfb27aff tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:20:50.825536 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:20:50.825536 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:20:50.830569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ef938-ffca-4059-88ee-0679cfb27aff tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:50.867400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d7ef938-ffca-4059-88ee-0679cfb27aff tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'eed78b0f758b4399aa3c56a3ae2726ad'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:50.869384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d7ef938-ffca-4059-88ee-0679cfb27aff tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'eed78b0f758b4399aa3c56a3ae2726ad'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:50.989946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d7ef938-ffca-4059-88ee-0679cfb27aff tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'eed78b0f758b4399aa3c56a3ae2726ad'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:51.004749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d7ef938-ffca-4059-88ee-0679cfb27aff tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'eed78b0f758b4399aa3c56a3ae2726ad'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:51.016083 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2829/5605] 10.222.0.17 () {60 vars in 1252 bytes} [Sat Jul 30 21:20:50 2022] PATCH /identity/v3/projects/eed78b0f758b4399aa3c56a3ae2726ad => generated 362 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:51.021526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5647b8-96f6-4153-a4d3-b663695c0355 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:51.023419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2e5647b8-96f6-4153-a4d3-b663695c0355 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:51.055493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5647b8-96f6-4153-a4d3-b663695c0355 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:51.211766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:51.212581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:51.213067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:51.213381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/eed78b0f758b4399aa3c56a3ae2726ad` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:51.228424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:delete_project(project_id=eed78b0f758b4399aa3c56a3ae2726ad)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:51.230643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:51.268272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'eed78b0f758b4399aa3c56a3ae2726ad'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:51.275272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'eed78b0f758b4399aa3c56a3ae2726ad'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:51.278586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:51.374986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eed78b0f758b4399aa3c56a3ae2726ad', 'request_id': 'req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:51.414678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eed78b0f758b4399aa3c56a3ae2726ad', 'request_id': 'req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:51.431179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eed78b0f758b4399aa3c56a3ae2726ad', 'request_id': 'req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:51.465274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] The token cache is being invalidate because project eed78b0f758b4399aa3c56a3ae2726ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:51.465608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:51.468844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:51.490455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'eed78b0f758b4399aa3c56a3ae2726ad', 'request_id': 'req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:51.499063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'eed78b0f758b4399aa3c56a3ae2726ad', 'request_id': 'req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:51.500387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'eed78b0f758b4399aa3c56a3ae2726ad', 'request_id': 'req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:51.519476 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2777/5606] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:51 2022] DELETE /identity/v3/projects/eed78b0f758b4399aa3c56a3ae2726ad => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:51.520957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ef938-ffca-4059-88ee-0679cfb27aff tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:51.544041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ef938-ffca-4059-88ee-0679cfb27aff tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:51.632922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08548d93-1c68-4c9f-8b37-2d354297ff83 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:51.633931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08548d93-1c68-4c9f-8b37-2d354297ff83 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:51.634223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08548d93-1c68-4c9f-8b37-2d354297ff83 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:51.634528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08548d93-1c68-4c9f-8b37-2d354297ff83 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:51.636423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08548d93-1c68-4c9f-8b37-2d354297ff83 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:51.638938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08548d93-1c68-4c9f-8b37-2d354297ff83 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:51.768607 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2830/5607] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:51 2022] POST /identity/v3/projects => generated 360 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:51.770320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:51.771989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:51.796995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e33ca-8a0f-4eab-bb0d-3858a9ea7968 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:51.978003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53646380-7b53-4ae6-81da-5395ead8e5d8 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:51.978003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53646380-7b53-4ae6-81da-5395ead8e5d8 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:51.978003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53646380-7b53-4ae6-81da-5395ead8e5d8 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:51.978383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53646380-7b53-4ae6-81da-5395ead8e5d8 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/86f6755a5580472db8624af65a963a99` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:51.978383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53646380-7b53-4ae6-81da-5395ead8e5d8 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:get_project(project_id=86f6755a5580472db8624af65a963a99)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:51.978383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53646380-7b53-4ae6-81da-5395ead8e5d8 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:51.978383 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2778/5608] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:20:51 2022] GET /identity/v3/projects/86f6755a5580472db8624af65a963a99 => generated 360 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:51.979938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08548d93-1c68-4c9f-8b37-2d354297ff83 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:52.037180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08548d93-1c68-4c9f-8b37-2d354297ff83 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:52.066396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b762b34-6ee5-41a7-a7cf-a10e8f3cd839 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:52.069033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b762b34-6ee5-41a7-a7cf-a10e8f3cd839 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:52.071968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b762b34-6ee5-41a7-a7cf-a10e8f3cd839 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:52.077490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b762b34-6ee5-41a7-a7cf-a10e8f3cd839 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/86f6755a5580472db8624af65a963a99` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:52.080621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b762b34-6ee5-41a7-a7cf-a10e8f3cd839 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:delete_project(project_id=86f6755a5580472db8624af65a963a99)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:52.093063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b762b34-6ee5-41a7-a7cf-a10e8f3cd839 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:52.199919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0b762b34-6ee5-41a7-a7cf-a10e8f3cd839 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86f6755a5580472db8624af65a963a99', 'request_id': 'req-0b762b34-6ee5-41a7-a7cf-a10e8f3cd839'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:52.215368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0b762b34-6ee5-41a7-a7cf-a10e8f3cd839 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86f6755a5580472db8624af65a963a99', 'request_id': 'req-0b762b34-6ee5-41a7-a7cf-a10e8f3cd839'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:52.229238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0b762b34-6ee5-41a7-a7cf-a10e8f3cd839 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86f6755a5580472db8624af65a963a99', 'request_id': 'req-0b762b34-6ee5-41a7-a7cf-a10e8f3cd839'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:52.249622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0b762b34-6ee5-41a7-a7cf-a10e8f3cd839 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] The token cache is being invalidate because project 86f6755a5580472db8624af65a963a99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:52.250380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0b762b34-6ee5-41a7-a7cf-a10e8f3cd839 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:52.253996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0b762b34-6ee5-41a7-a7cf-a10e8f3cd839 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:52.256591 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2831/5609] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:51 2022] DELETE /identity/v3/projects/86f6755a5580472db8624af65a963a99 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:52.262206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53646380-7b53-4ae6-81da-5395ead8e5d8 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:52.268572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-53646380-7b53-4ae6-81da-5395ead8e5d8 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:52.291682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53646380-7b53-4ae6-81da-5395ead8e5d8 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:52.474772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc06af-f43a-487a-a8fd-d892b3d3c942 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:52.475842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc06af-f43a-487a-a8fd-d892b3d3c942 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:52.476482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc06af-f43a-487a-a8fd-d892b3d3c942 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:52.476914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc06af-f43a-487a-a8fd-d892b3d3c942 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:52.483743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc06af-f43a-487a-a8fd-d892b3d3c942 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:52.486556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc06af-f43a-487a-a8fd-d892b3d3c942 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:52.552965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:52.572072 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2779/5610] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:52 2022] POST /identity/v3/projects => generated 361 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:52.576459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b762b34-6ee5-41a7-a7cf-a10e8f3cd839 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:52.606993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b762b34-6ee5-41a7-a7cf-a10e8f3cd839 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:52.695206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:52.894111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a3a53-2ef6-4ba9-8550-5308b5879ad0 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:52.894811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a3a53-2ef6-4ba9-8550-5308b5879ad0 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:52.895102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a3a53-2ef6-4ba9-8550-5308b5879ad0 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:52.900343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a3a53-2ef6-4ba9-8550-5308b5879ad0 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/8bdea90df71f425ea208f9445c2f8c6c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:52.904168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a3a53-2ef6-4ba9-8550-5308b5879ad0 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:get_project(project_id=8bdea90df71f425ea208f9445c2f8c6c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:52.907715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a3a53-2ef6-4ba9-8550-5308b5879ad0 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:52.913512 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2832/5611] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:20:52 2022] GET /identity/v3/projects/8bdea90df71f425ea208f9445c2f8c6c => generated 361 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:52.915089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc06af-f43a-487a-a8fd-d892b3d3c942 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:52.950052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc06af-f43a-487a-a8fd-d892b3d3c942 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:52.988002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c722b-09ee-4670-858b-71422ed93b72 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:53.020121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c722b-09ee-4670-858b-71422ed93b72 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:53.020498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c722b-09ee-4670-858b-71422ed93b72 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:53.028921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c722b-09ee-4670-858b-71422ed93b72 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/8bdea90df71f425ea208f9445c2f8c6c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:53.040440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c722b-09ee-4670-858b-71422ed93b72 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8bdea90df71f425ea208f9445c2f8c6c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:53.053538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c722b-09ee-4670-858b-71422ed93b72 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:53.236307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8c8c722b-09ee-4670-858b-71422ed93b72 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bdea90df71f425ea208f9445c2f8c6c', 'request_id': 'req-8c8c722b-09ee-4670-858b-71422ed93b72'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:53.260086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8c8c722b-09ee-4670-858b-71422ed93b72 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bdea90df71f425ea208f9445c2f8c6c', 'request_id': 'req-8c8c722b-09ee-4670-858b-71422ed93b72'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:53.273666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8c8c722b-09ee-4670-858b-71422ed93b72 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bdea90df71f425ea208f9445c2f8c6c', 'request_id': 'req-8c8c722b-09ee-4670-858b-71422ed93b72'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:53.299114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8c8c722b-09ee-4670-858b-71422ed93b72 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] The token cache is being invalidate because project 8bdea90df71f425ea208f9445c2f8c6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:53.299464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8c8c722b-09ee-4670-858b-71422ed93b72 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:53.300476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8c8c722b-09ee-4670-858b-71422ed93b72 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:53.303925 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2780/5612] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:52 2022] DELETE /identity/v3/projects/8bdea90df71f425ea208f9445c2f8c6c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:53.309216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a3a53-2ef6-4ba9-8550-5308b5879ad0 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:53.315628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d24a3a53-2ef6-4ba9-8550-5308b5879ad0 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:53.358774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a3a53-2ef6-4ba9-8550-5308b5879ad0 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:53.560300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303df3a8-3b1b-4be5-935e-8175e4212de7 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:53.560964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303df3a8-3b1b-4be5-935e-8175e4212de7 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:53.561257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303df3a8-3b1b-4be5-935e-8175e4212de7 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:53.561544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303df3a8-3b1b-4be5-935e-8175e4212de7 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:53.562228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303df3a8-3b1b-4be5-935e-8175e4212de7 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:53.564325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303df3a8-3b1b-4be5-935e-8175e4212de7 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:53.655974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c722b-09ee-4670-858b-71422ed93b72 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:53.659179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8c8c722b-09ee-4670-858b-71422ed93b72 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:53.726799 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2833/5613] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 30 21:20:53 2022] POST /identity/v3/projects => generated 348 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:53.730959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303df3a8-3b1b-4be5-935e-8175e4212de7 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:53.841874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c722b-09ee-4670-858b-71422ed93b72 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:53.933671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6052c-1c68-484b-9247-7765330a7172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:53.934327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6052c-1c68-484b-9247-7765330a7172 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:53.935510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6052c-1c68-484b-9247-7765330a7172 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:53.936122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6052c-1c68-484b-9247-7765330a7172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:53.939966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-56f6052c-1c68-484b-9247-7765330a7172 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:53.953764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6052c-1c68-484b-9247-7765330a7172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:53.957269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6052c-1c68-484b-9247-7765330a7172 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:53.974673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303df3a8-3b1b-4be5-935e-8175e4212de7 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:53.981603 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2781/5614] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:20:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:20:53.985708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507807b-b028-4132-8734-8fe046519391 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:53.986749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507807b-b028-4132-8734-8fe046519391 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:53.987203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507807b-b028-4132-8734-8fe046519391 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:53.987761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507807b-b028-4132-8734-8fe046519391 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/0eb62dbad7684eec952749962ac1b64b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:53.989817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507807b-b028-4132-8734-8fe046519391 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:get_project(project_id=0eb62dbad7684eec952749962ac1b64b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:53.992424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507807b-b028-4132-8734-8fe046519391 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:53.994824 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2834/5615] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:20:53 2022] GET /identity/v3/projects/0eb62dbad7684eec952749962ac1b64b => generated 348 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:53.998891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6052c-1c68-484b-9247-7765330a7172 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:54.034920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6052c-1c68-484b-9247-7765330a7172 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:54.051106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22634a7-cebd-48bb-9104-ba4653b1b564 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:54.051969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22634a7-cebd-48bb-9104-ba4653b1b564 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:54.052374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22634a7-cebd-48bb-9104-ba4653b1b564 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:54.052803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22634a7-cebd-48bb-9104-ba4653b1b564 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/0eb62dbad7684eec952749962ac1b64b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:54.055231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22634a7-cebd-48bb-9104-ba4653b1b564 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0eb62dbad7684eec952749962ac1b64b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:54.057641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22634a7-cebd-48bb-9104-ba4653b1b564 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:54.141175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:54.169242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d22634a7-cebd-48bb-9104-ba4653b1b564 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eb62dbad7684eec952749962ac1b64b', 'request_id': 'req-d22634a7-cebd-48bb-9104-ba4653b1b564'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:54.190349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d22634a7-cebd-48bb-9104-ba4653b1b564 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eb62dbad7684eec952749962ac1b64b', 'request_id': 'req-d22634a7-cebd-48bb-9104-ba4653b1b564'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:54.203879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d22634a7-cebd-48bb-9104-ba4653b1b564 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eb62dbad7684eec952749962ac1b64b', 'request_id': 'req-d22634a7-cebd-48bb-9104-ba4653b1b564'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:54.228762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d22634a7-cebd-48bb-9104-ba4653b1b564 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] The token cache is being invalidate because project 0eb62dbad7684eec952749962ac1b64b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:54.229491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d22634a7-cebd-48bb-9104-ba4653b1b564 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:54.229968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d22634a7-cebd-48bb-9104-ba4653b1b564 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:54.238826 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2782/5616] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:53 2022] DELETE /identity/v3/projects/0eb62dbad7684eec952749962ac1b64b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:54.239497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507807b-b028-4132-8734-8fe046519391 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:54.242026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6507807b-b028-4132-8734-8fe046519391 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:54.281520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507807b-b028-4132-8734-8fe046519391 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:54.417727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:54.432729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8586aa-bcdb-46d8-8dec-3456748f5860 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:54.433574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8586aa-bcdb-46d8-8dec-3456748f5860 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:54.434246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8586aa-bcdb-46d8-8dec-3456748f5860 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:54.437900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8586aa-bcdb-46d8-8dec-3456748f5860 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:54.439303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8586aa-bcdb-46d8-8dec-3456748f5860 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:54.441221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8586aa-bcdb-46d8-8dec-3456748f5860 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:54.490113 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2835/5617] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:20:54 2022] POST /identity/v3/domains => generated 277 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:20:54.495007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22634a7-cebd-48bb-9104-ba4653b1b564 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:54.512552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22634a7-cebd-48bb-9104-ba4653b1b564 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:54.744276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d53b9f-a0f8-42b6-bdfa-c2e3e75de2ca tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:54.749386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d53b9f-a0f8-42b6-bdfa-c2e3e75de2ca tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:54.750138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d53b9f-a0f8-42b6-bdfa-c2e3e75de2ca tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:54.751467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d53b9f-a0f8-42b6-bdfa-c2e3e75de2ca tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:54.756727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d53b9f-a0f8-42b6-bdfa-c2e3e75de2ca tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:54.762679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d53b9f-a0f8-42b6-bdfa-c2e3e75de2ca tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:54.884247 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2783/5618] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:54 2022] POST /identity/v3/projects => generated 404 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:54.888769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8586aa-bcdb-46d8-8dec-3456748f5860 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:54.905073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8586aa-bcdb-46d8-8dec-3456748f5860 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:55.151079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce0b7d-ef91-4844-bec1-9032cc0661db tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:55.155473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce0b7d-ef91-4844-bec1-9032cc0661db tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:55.155473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce0b7d-ef91-4844-bec1-9032cc0661db tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:55.162904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce0b7d-ef91-4844-bec1-9032cc0661db tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/bfbedfafeeef4ab7bd119a54dc4fd4fd` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:55.168324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce0b7d-ef91-4844-bec1-9032cc0661db tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:get_project(project_id=bfbedfafeeef4ab7bd119a54dc4fd4fd)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:55.181685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce0b7d-ef91-4844-bec1-9032cc0661db tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:55.189507 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2836/5619] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:20:54 2022] GET /identity/v3/projects/bfbedfafeeef4ab7bd119a54dc4fd4fd => generated 404 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:55.193440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d53b9f-a0f8-42b6-bdfa-c2e3e75de2ca tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:55.204532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d53b9f-a0f8-42b6-bdfa-c2e3e75de2ca tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:55.244310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda935e-ee36-40e8-add2-806f173d15fa tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:55.245095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda935e-ee36-40e8-add2-806f173d15fa tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:55.245457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda935e-ee36-40e8-add2-806f173d15fa tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:55.245856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda935e-ee36-40e8-add2-806f173d15fa tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/bfbedfafeeef4ab7bd119a54dc4fd4fd` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:55.252290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda935e-ee36-40e8-add2-806f173d15fa tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bfbedfafeeef4ab7bd119a54dc4fd4fd)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:55.258390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda935e-ee36-40e8-add2-806f173d15fa tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:55.380851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2bda935e-ee36-40e8-add2-806f173d15fa tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfbedfafeeef4ab7bd119a54dc4fd4fd', 'request_id': 'req-2bda935e-ee36-40e8-add2-806f173d15fa'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:55.395478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2bda935e-ee36-40e8-add2-806f173d15fa tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfbedfafeeef4ab7bd119a54dc4fd4fd', 'request_id': 'req-2bda935e-ee36-40e8-add2-806f173d15fa'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:55.406092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2bda935e-ee36-40e8-add2-806f173d15fa tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfbedfafeeef4ab7bd119a54dc4fd4fd', 'request_id': 'req-2bda935e-ee36-40e8-add2-806f173d15fa'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:55.429511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2bda935e-ee36-40e8-add2-806f173d15fa tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] The token cache is being invalidate because project bfbedfafeeef4ab7bd119a54dc4fd4fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:55.431110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2bda935e-ee36-40e8-add2-806f173d15fa tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:55.431110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2bda935e-ee36-40e8-add2-806f173d15fa tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:55.437140 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2784/5620] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:55 2022] DELETE /identity/v3/projects/bfbedfafeeef4ab7bd119a54dc4fd4fd => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:20:55.438580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce0b7d-ef91-4844-bec1-9032cc0661db tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:55.441864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c4ce0b7d-ef91-4844-bec1-9032cc0661db tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:55.483144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce0b7d-ef91-4844-bec1-9032cc0661db tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:55.668594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681204e0-ee66-4241-b417-1b53b0da9024 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:55.669723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681204e0-ee66-4241-b417-1b53b0da9024 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:55.670205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681204e0-ee66-4241-b417-1b53b0da9024 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:55.671317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681204e0-ee66-4241-b417-1b53b0da9024 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/domains/653390e3c5274c74bc1087a036a2cd38` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:55.674059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681204e0-ee66-4241-b417-1b53b0da9024 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=653390e3c5274c74bc1087a036a2cd38)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:55.682692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681204e0-ee66-4241-b417-1b53b0da9024 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:55.754820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-681204e0-ee66-4241-b417-1b53b0da9024 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '653390e3c5274c74bc1087a036a2cd38'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:55.757977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-681204e0-ee66-4241-b417-1b53b0da9024 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '653390e3c5274c74bc1087a036a2cd38'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:55.830154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-681204e0-ee66-4241-b417-1b53b0da9024 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '653390e3c5274c74bc1087a036a2cd38'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:55.831168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-681204e0-ee66-4241-b417-1b53b0da9024 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '653390e3c5274c74bc1087a036a2cd38'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:55.834969 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2837/5621] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:20:55 2022] PATCH /identity/v3/domains/653390e3c5274c74bc1087a036a2cd38 => generated 278 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:55.840398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda935e-ee36-40e8-add2-806f173d15fa tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:55.880631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda935e-ee36-40e8-add2-806f173d15fa tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:55.927584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:56.012049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0231cf-fda9-4c38-87c2-8470a92463c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:56.012788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0231cf-fda9-4c38-87c2-8470a92463c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:56.013117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0231cf-fda9-4c38-87c2-8470a92463c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:56.013405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0231cf-fda9-4c38-87c2-8470a92463c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/domains/653390e3c5274c74bc1087a036a2cd38` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:56.038715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0231cf-fda9-4c38-87c2-8470a92463c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=653390e3c5274c74bc1087a036a2cd38)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:56.043278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0231cf-fda9-4c38-87c2-8470a92463c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:56.086378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb0231cf-fda9-4c38-87c2-8470a92463c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '653390e3c5274c74bc1087a036a2cd38'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:56.101162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb0231cf-fda9-4c38-87c2-8470a92463c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '653390e3c5274c74bc1087a036a2cd38'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:56.222495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb0231cf-fda9-4c38-87c2-8470a92463c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '653390e3c5274c74bc1087a036a2cd38', 'request_id': 'req-cb0231cf-fda9-4c38-87c2-8470a92463c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:56.235334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb0231cf-fda9-4c38-87c2-8470a92463c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '653390e3c5274c74bc1087a036a2cd38', 'request_id': 'req-cb0231cf-fda9-4c38-87c2-8470a92463c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:56.243196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb0231cf-fda9-4c38-87c2-8470a92463c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '653390e3c5274c74bc1087a036a2cd38', 'request_id': 'req-cb0231cf-fda9-4c38-87c2-8470a92463c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:56.266278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb0231cf-fda9-4c38-87c2-8470a92463c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] The token cache is being invalidate because project 653390e3c5274c74bc1087a036a2cd38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:56.267316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb0231cf-fda9-4c38-87c2-8470a92463c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:56.269833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb0231cf-fda9-4c38-87c2-8470a92463c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:56.293285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb0231cf-fda9-4c38-87c2-8470a92463c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '653390e3c5274c74bc1087a036a2cd38', 'request_id': 'req-cb0231cf-fda9-4c38-87c2-8470a92463c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:56.303729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb0231cf-fda9-4c38-87c2-8470a92463c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '653390e3c5274c74bc1087a036a2cd38', 'request_id': 'req-cb0231cf-fda9-4c38-87c2-8470a92463c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:56.305117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb0231cf-fda9-4c38-87c2-8470a92463c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '653390e3c5274c74bc1087a036a2cd38', 'request_id': 'req-cb0231cf-fda9-4c38-87c2-8470a92463c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:56.311872 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2785/5622] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:20:55 2022] DELETE /identity/v3/domains/653390e3c5274c74bc1087a036a2cd38 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:56.318347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681204e0-ee66-4241-b417-1b53b0da9024 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:56.322937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-681204e0-ee66-4241-b417-1b53b0da9024 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:56.356553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681204e0-ee66-4241-b417-1b53b0da9024 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:56.481342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:56.502116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd236e-fd05-430c-8c50-90e0d5a2a191 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:56.502801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd236e-fd05-430c-8c50-90e0d5a2a191 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:56.503414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd236e-fd05-430c-8c50-90e0d5a2a191 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:56.503706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd236e-fd05-430c-8c50-90e0d5a2a191 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:56.505227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd236e-fd05-430c-8c50-90e0d5a2a191 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:56.506990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd236e-fd05-430c-8c50-90e0d5a2a191 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:56.536800 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2838/5623] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:20:56 2022] POST /identity/v3/domains => generated 276 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:56.540715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0231cf-fda9-4c38-87c2-8470a92463c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:56.542506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cb0231cf-fda9-4c38-87c2-8470a92463c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:56.563158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0231cf-fda9-4c38-87c2-8470a92463c3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:56.693441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f9ab2-cb3f-46da-9295-bdd97cbb65bb tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:56.694433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f9ab2-cb3f-46da-9295-bdd97cbb65bb tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:56.695223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f9ab2-cb3f-46da-9295-bdd97cbb65bb tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:56.695683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f9ab2-cb3f-46da-9295-bdd97cbb65bb tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:56.696654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f9ab2-cb3f-46da-9295-bdd97cbb65bb tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:56.699192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f9ab2-cb3f-46da-9295-bdd97cbb65bb tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:56.705164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:56.800749 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2786/5624] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:56 2022] POST /identity/v3/projects => generated 409 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:56.806037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd236e-fd05-430c-8c50-90e0d5a2a191 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:56.839731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd236e-fd05-430c-8c50-90e0d5a2a191 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:57.006430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691f4c4-0b73-46bd-879b-f3430d3ca722 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:57.009419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691f4c4-0b73-46bd-879b-f3430d3ca722 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:57.010011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691f4c4-0b73-46bd-879b-f3430d3ca722 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:57.010533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691f4c4-0b73-46bd-879b-f3430d3ca722 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:57.011633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691f4c4-0b73-46bd-879b-f3430d3ca722 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:57.018447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691f4c4-0b73-46bd-879b-f3430d3ca722 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:57.119669 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2839/5625] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:56 2022] POST /identity/v3/projects => generated 404 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:57.124190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f9ab2-cb3f-46da-9295-bdd97cbb65bb tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:57.140524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f9ab2-cb3f-46da-9295-bdd97cbb65bb tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:57.293279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e2730-bace-4357-ac0b-578eeac52b90 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:57.295942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e2730-bace-4357-ac0b-578eeac52b90 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:57.296246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e2730-bace-4357-ac0b-578eeac52b90 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:57.299817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e2730-bace-4357-ac0b-578eeac52b90 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/a76cdbf0cec746f99f9003d8338d74f7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:57.303194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e2730-bace-4357-ac0b-578eeac52b90 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a76cdbf0cec746f99f9003d8338d74f7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:57.310186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e2730-bace-4357-ac0b-578eeac52b90 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:57.448250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4f4e2730-bace-4357-ac0b-578eeac52b90 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a76cdbf0cec746f99f9003d8338d74f7', 'request_id': 'req-4f4e2730-bace-4357-ac0b-578eeac52b90'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:57.472225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4f4e2730-bace-4357-ac0b-578eeac52b90 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a76cdbf0cec746f99f9003d8338d74f7', 'request_id': 'req-4f4e2730-bace-4357-ac0b-578eeac52b90'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:57.480606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4f4e2730-bace-4357-ac0b-578eeac52b90 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a76cdbf0cec746f99f9003d8338d74f7', 'request_id': 'req-4f4e2730-bace-4357-ac0b-578eeac52b90'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:57.501942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4f4e2730-bace-4357-ac0b-578eeac52b90 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] The token cache is being invalidate because project a76cdbf0cec746f99f9003d8338d74f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:57.502762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4f4e2730-bace-4357-ac0b-578eeac52b90 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:57.504258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4f4e2730-bace-4357-ac0b-578eeac52b90 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:57.507060 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2787/5626] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:57 2022] DELETE /identity/v3/projects/a76cdbf0cec746f99f9003d8338d74f7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:57.511357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691f4c4-0b73-46bd-879b-f3430d3ca722 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:57.513659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3691f4c4-0b73-46bd-879b-f3430d3ca722 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:57.543245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691f4c4-0b73-46bd-879b-f3430d3ca722 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:57.657354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254e3a3-e388-4c8c-bc51-e38015f5af78 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:57.658391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254e3a3-e388-4c8c-bc51-e38015f5af78 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:57.659142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254e3a3-e388-4c8c-bc51-e38015f5af78 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:57.659646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254e3a3-e388-4c8c-bc51-e38015f5af78 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/9b9f9b38db5e4dc7b430af8370767dc1` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:57.662599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254e3a3-e388-4c8c-bc51-e38015f5af78 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9b9f9b38db5e4dc7b430af8370767dc1)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:57.665354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254e3a3-e388-4c8c-bc51-e38015f5af78 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:57.782934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4254e3a3-e388-4c8c-bc51-e38015f5af78 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9f9b38db5e4dc7b430af8370767dc1', 'request_id': 'req-4254e3a3-e388-4c8c-bc51-e38015f5af78'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:57.810948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4254e3a3-e388-4c8c-bc51-e38015f5af78 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9f9b38db5e4dc7b430af8370767dc1', 'request_id': 'req-4254e3a3-e388-4c8c-bc51-e38015f5af78'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:57.833201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4254e3a3-e388-4c8c-bc51-e38015f5af78 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9f9b38db5e4dc7b430af8370767dc1', 'request_id': 'req-4254e3a3-e388-4c8c-bc51-e38015f5af78'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:57.846065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:57.852959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4254e3a3-e388-4c8c-bc51-e38015f5af78 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] The token cache is being invalidate because project 9b9f9b38db5e4dc7b430af8370767dc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:57.853417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4254e3a3-e388-4c8c-bc51-e38015f5af78 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:57.854161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4254e3a3-e388-4c8c-bc51-e38015f5af78 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:57.856148 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2840/5627] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:57 2022] DELETE /identity/v3/projects/9b9f9b38db5e4dc7b430af8370767dc1 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:57.860898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e2730-bace-4357-ac0b-578eeac52b90 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:57.873691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e2730-bace-4357-ac0b-578eeac52b90 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:58.021886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039cfef-d25b-4d15-a350-a5e52a575d30 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:58.022787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039cfef-d25b-4d15-a350-a5e52a575d30 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:58.023073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039cfef-d25b-4d15-a350-a5e52a575d30 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:58.023387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039cfef-d25b-4d15-a350-a5e52a575d30 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/domains/1305f6da033d433d9e9aff47fa12f99c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:58.024955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039cfef-d25b-4d15-a350-a5e52a575d30 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1305f6da033d433d9e9aff47fa12f99c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:58.027723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039cfef-d25b-4d15-a350-a5e52a575d30 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:58.043178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:58.085755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0039cfef-d25b-4d15-a350-a5e52a575d30 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1305f6da033d433d9e9aff47fa12f99c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:58.086444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0039cfef-d25b-4d15-a350-a5e52a575d30 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1305f6da033d433d9e9aff47fa12f99c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:58.167826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0039cfef-d25b-4d15-a350-a5e52a575d30 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1305f6da033d433d9e9aff47fa12f99c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:58.169731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0039cfef-d25b-4d15-a350-a5e52a575d30 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1305f6da033d433d9e9aff47fa12f99c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:58.174230 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2788/5628] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:20:57 2022] PATCH /identity/v3/domains/1305f6da033d433d9e9aff47fa12f99c => generated 277 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:58.178947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254e3a3-e388-4c8c-bc51-e38015f5af78 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:58.182115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4254e3a3-e388-4c8c-bc51-e38015f5af78 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:58.221940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254e3a3-e388-4c8c-bc51-e38015f5af78 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:58.366918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e87a7-6351-4307-bbcb-2e33d4802e1d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:58.367417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e87a7-6351-4307-bbcb-2e33d4802e1d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:58.368489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e87a7-6351-4307-bbcb-2e33d4802e1d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:58.368872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e87a7-6351-4307-bbcb-2e33d4802e1d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/domains/1305f6da033d433d9e9aff47fa12f99c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:58.389259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e87a7-6351-4307-bbcb-2e33d4802e1d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1305f6da033d433d9e9aff47fa12f99c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:58.391411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e87a7-6351-4307-bbcb-2e33d4802e1d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:58.431145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-574e87a7-6351-4307-bbcb-2e33d4802e1d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1305f6da033d433d9e9aff47fa12f99c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:58.436463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-574e87a7-6351-4307-bbcb-2e33d4802e1d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1305f6da033d433d9e9aff47fa12f99c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:58.542300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-574e87a7-6351-4307-bbcb-2e33d4802e1d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1305f6da033d433d9e9aff47fa12f99c', 'request_id': 'req-574e87a7-6351-4307-bbcb-2e33d4802e1d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:58.553288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-574e87a7-6351-4307-bbcb-2e33d4802e1d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1305f6da033d433d9e9aff47fa12f99c', 'request_id': 'req-574e87a7-6351-4307-bbcb-2e33d4802e1d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:58.569613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-574e87a7-6351-4307-bbcb-2e33d4802e1d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1305f6da033d433d9e9aff47fa12f99c', 'request_id': 'req-574e87a7-6351-4307-bbcb-2e33d4802e1d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:58.593417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-574e87a7-6351-4307-bbcb-2e33d4802e1d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] The token cache is being invalidate because project 1305f6da033d433d9e9aff47fa12f99c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:58.595447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-574e87a7-6351-4307-bbcb-2e33d4802e1d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:58.602301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-574e87a7-6351-4307-bbcb-2e33d4802e1d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:58.613671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-574e87a7-6351-4307-bbcb-2e33d4802e1d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1305f6da033d433d9e9aff47fa12f99c', 'request_id': 'req-574e87a7-6351-4307-bbcb-2e33d4802e1d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:58.614591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-574e87a7-6351-4307-bbcb-2e33d4802e1d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1305f6da033d433d9e9aff47fa12f99c', 'request_id': 'req-574e87a7-6351-4307-bbcb-2e33d4802e1d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:58.615498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-574e87a7-6351-4307-bbcb-2e33d4802e1d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1305f6da033d433d9e9aff47fa12f99c', 'request_id': 'req-574e87a7-6351-4307-bbcb-2e33d4802e1d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:58.634676 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2841/5629] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:20:58 2022] DELETE /identity/v3/domains/1305f6da033d433d9e9aff47fa12f99c => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:58.639565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039cfef-d25b-4d15-a350-a5e52a575d30 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:58.641000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0039cfef-d25b-4d15-a350-a5e52a575d30 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:58.665505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039cfef-d25b-4d15-a350-a5e52a575d30 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:58.799737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed1621-0ecc-47d6-914a-e3ddee47755f tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:58.801795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed1621-0ecc-47d6-914a-e3ddee47755f tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:58.802065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed1621-0ecc-47d6-914a-e3ddee47755f tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:58.803675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed1621-0ecc-47d6-914a-e3ddee47755f tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:58.805507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed1621-0ecc-47d6-914a-e3ddee47755f tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:58.807975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed1621-0ecc-47d6-914a-e3ddee47755f tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:58.902627 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2789/5630] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:20:58 2022] POST /identity/v3/projects => generated 377 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:20:58.907756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e87a7-6351-4307-bbcb-2e33d4802e1d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:58.909348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-574e87a7-6351-4307-bbcb-2e33d4802e1d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:58.933934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e87a7-6351-4307-bbcb-2e33d4802e1d tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:59.014822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:59.072686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4df71-d258-4612-9176-b69deb8b948c tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:59.075753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4df71-d258-4612-9176-b69deb8b948c tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:59.076311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4df71-d258-4612-9176-b69deb8b948c tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:59.079939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4df71-d258-4612-9176-b69deb8b948c tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/b8289b6d8aa04c7a89bb0b9ed1856faf` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:59.079939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4df71-d258-4612-9176-b69deb8b948c tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:get_project(project_id=b8289b6d8aa04c7a89bb0b9ed1856faf)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:59.082813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4df71-d258-4612-9176-b69deb8b948c tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:59.086634 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2842/5631] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:20:58 2022] GET /identity/v3/projects/b8289b6d8aa04c7a89bb0b9ed1856faf => generated 377 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:20:59.099129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed1621-0ecc-47d6-914a-e3ddee47755f tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:59.122896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed1621-0ecc-47d6-914a-e3ddee47755f tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:59.140617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01da8a-fe91-4876-b65e-e79eae8b0046 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:59.141920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01da8a-fe91-4876-b65e-e79eae8b0046 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:59.144531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01da8a-fe91-4876-b65e-e79eae8b0046 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:59.144911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01da8a-fe91-4876-b65e-e79eae8b0046 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:59.146480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01da8a-fe91-4876-b65e-e79eae8b0046 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:59.149384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01da8a-fe91-4876-b65e-e79eae8b0046 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:59.183978 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2790/5632] 10.222.0.17 () {58 vars in 1131 bytes} [Sat Jul 30 21:20:59 2022] GET /identity/v3/projects => generated 7723 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:20:59.187833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4df71-d258-4612-9176-b69deb8b948c tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:59.210919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4df71-d258-4612-9176-b69deb8b948c tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:59.229053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed78989-d642-47b2-9487-79ae42c29fd3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:59.229549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed78989-d642-47b2-9487-79ae42c29fd3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:59.229943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed78989-d642-47b2-9487-79ae42c29fd3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:59.231002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed78989-d642-47b2-9487-79ae42c29fd3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/b8289b6d8aa04c7a89bb0b9ed1856faf` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:59.235679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed78989-d642-47b2-9487-79ae42c29fd3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b8289b6d8aa04c7a89bb0b9ed1856faf)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:59.241512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed78989-d642-47b2-9487-79ae42c29fd3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:59.564185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7ed78989-d642-47b2-9487-79ae42c29fd3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8289b6d8aa04c7a89bb0b9ed1856faf', 'request_id': 'req-7ed78989-d642-47b2-9487-79ae42c29fd3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:59.595213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7ed78989-d642-47b2-9487-79ae42c29fd3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8289b6d8aa04c7a89bb0b9ed1856faf', 'request_id': 'req-7ed78989-d642-47b2-9487-79ae42c29fd3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:59.627840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7ed78989-d642-47b2-9487-79ae42c29fd3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8289b6d8aa04c7a89bb0b9ed1856faf', 'request_id': 'req-7ed78989-d642-47b2-9487-79ae42c29fd3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:59.668377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7ed78989-d642-47b2-9487-79ae42c29fd3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] The token cache is being invalidate because project b8289b6d8aa04c7a89bb0b9ed1856faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:20:59.668682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7ed78989-d642-47b2-9487-79ae42c29fd3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:59.670165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7ed78989-d642-47b2-9487-79ae42c29fd3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:20:59.696467 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2843/5633] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:20:59 2022] DELETE /identity/v3/projects/b8289b6d8aa04c7a89bb0b9ed1856faf => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:20:59.697302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01da8a-fe91-4876-b65e-e79eae8b0046 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:59.699492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6b01da8a-fe91-4876-b65e-e79eae8b0046 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:59.716501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01da8a-fe91-4876-b65e-e79eae8b0046 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:20:59.831972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aedcb4-c548-40a9-a7b2-bf2fca23b871 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:20:59.832607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aedcb4-c548-40a9-a7b2-bf2fca23b871 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:20:59.832927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aedcb4-c548-40a9-a7b2-bf2fca23b871 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:20:59.833202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aedcb4-c548-40a9-a7b2-bf2fca23b871 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:20:59.834061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aedcb4-c548-40a9-a7b2-bf2fca23b871 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:20:59.836293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aedcb4-c548-40a9-a7b2-bf2fca23b871 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:20:59.939752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed78989-d642-47b2-9487-79ae42c29fd3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:20:59.941259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7ed78989-d642-47b2-9487-79ae42c29fd3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:20:59.957910 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2791/5634] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 30 21:20:59 2022] POST /identity/v3/projects => generated 347 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:20:59.966250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aedcb4-c548-40a9-a7b2-bf2fca23b871 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:00.069807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:00.101492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed78989-d642-47b2-9487-79ae42c29fd3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:00.127176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aedcb4-c548-40a9-a7b2-bf2fca23b871 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:00.135387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ffcb9-4bdb-4173-8d79-48cbc625144f tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:00.139268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ffcb9-4bdb-4173-8d79-48cbc625144f tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:00.145007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ffcb9-4bdb-4173-8d79-48cbc625144f tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:00.146203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ffcb9-4bdb-4173-8d79-48cbc625144f tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/0343f11e8e8648dfb11d97007aa839eb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:00.148773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ffcb9-4bdb-4173-8d79-48cbc625144f tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:update_project(project_id=0343f11e8e8648dfb11d97007aa839eb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:00.150517 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-346ffcb9-4bdb-4173-8d79-48cbc625144f tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:00.150517 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:21:00.150517 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:21:00.152550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ffcb9-4bdb-4173-8d79-48cbc625144f tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:00.244880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbbbec-9cd9-4d1b-9e0c-ed4e1449dc4e tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af06d33e9645402d937a50ab306a0ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a9dadb374c433fa05eb554a48046d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:00.246208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbbbec-9cd9-4d1b-9e0c-ed4e1449dc4e tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:00.246629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbbbec-9cd9-4d1b-9e0c-ed4e1449dc4e tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:00.248564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbbbec-9cd9-4d1b-9e0c-ed4e1449dc4e tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:00.250878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbbbec-9cd9-4d1b-9e0c-ed4e1449dc4e tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:21:00.257796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbbbec-9cd9-4d1b-9e0c-ed4e1449dc4e tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:00.259894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbbbec-9cd9-4d1b-9e0c-ed4e1449dc4e tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:00.264213 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2792/5635] 10.222.0.17 () {60 vars in 1252 bytes} [Sat Jul 30 21:20:59 2022] PATCH /identity/v3/projects/0343f11e8e8648dfb11d97007aa839eb => generated 360 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:00.267940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ffcb9-4bdb-4173-8d79-48cbc625144f tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:00.281080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:00.289891 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2844/5636] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:21:00.292063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbbbec-9cd9-4d1b-9e0c-ed4e1449dc4e tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:00.296647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ffcb9-4bdb-4173-8d79-48cbc625144f tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:00.305364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf5fb3-d729-4c16-8cc1-3c6f0947e2d6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:00.306206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf5fb3-d729-4c16-8cc1-3c6f0947e2d6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:00.306662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf5fb3-d729-4c16-8cc1-3c6f0947e2d6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:00.306967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf5fb3-d729-4c16-8cc1-3c6f0947e2d6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/0343f11e8e8648dfb11d97007aa839eb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:00.318572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbbbec-9cd9-4d1b-9e0c-ed4e1449dc4e tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:00.332930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf5fb3-d729-4c16-8cc1-3c6f0947e2d6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:get_project(project_id=0343f11e8e8648dfb11d97007aa839eb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:00.335148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf5fb3-d729-4c16-8cc1-3c6f0947e2d6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:00.340856 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2793/5637] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:21:00 2022] GET /identity/v3/projects/0343f11e8e8648dfb11d97007aa839eb => generated 347 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:00.342600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf5fb3-d729-4c16-8cc1-3c6f0947e2d6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:00.343939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f94fc4-e847-4a25-9449-25b50998a33e tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af06d33e9645402d937a50ab306a0ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a9dadb374c433fa05eb554a48046d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:00.348318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f94fc4-e847-4a25-9449-25b50998a33e tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:00.348731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f94fc4-e847-4a25-9449-25b50998a33e tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:00.349182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f94fc4-e847-4a25-9449-25b50998a33e tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:00.349948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f94fc4-e847-4a25-9449-25b50998a33e tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:00.352327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f94fc4-e847-4a25-9449-25b50998a33e tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:00.356422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf5fb3-d729-4c16-8cc1-3c6f0947e2d6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:00.363903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389a47b-eed7-4f16-887b-e76652980f91 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:00.364859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389a47b-eed7-4f16-887b-e76652980f91 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:00.365345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389a47b-eed7-4f16-887b-e76652980f91 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:00.365907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389a47b-eed7-4f16-887b-e76652980f91 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/0343f11e8e8648dfb11d97007aa839eb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:00.368234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389a47b-eed7-4f16-887b-e76652980f91 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0343f11e8e8648dfb11d97007aa839eb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:00.372043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389a47b-eed7-4f16-887b-e76652980f91 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:00.405004 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2845/5638] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:21:00 2022] POST /identity/v3/projects => generated 347 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:00.408920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f94fc4-e847-4a25-9449-25b50998a33e tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:00.484127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7389a47b-eed7-4f16-887b-e76652980f91 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0343f11e8e8648dfb11d97007aa839eb', 'request_id': 'req-7389a47b-eed7-4f16-887b-e76652980f91'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:00.504091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7389a47b-eed7-4f16-887b-e76652980f91 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0343f11e8e8648dfb11d97007aa839eb', 'request_id': 'req-7389a47b-eed7-4f16-887b-e76652980f91'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:00.526438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7389a47b-eed7-4f16-887b-e76652980f91 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0343f11e8e8648dfb11d97007aa839eb', 'request_id': 'req-7389a47b-eed7-4f16-887b-e76652980f91'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:00.554383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7389a47b-eed7-4f16-887b-e76652980f91 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] The token cache is being invalidate because project 0343f11e8e8648dfb11d97007aa839eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:00.554383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7389a47b-eed7-4f16-887b-e76652980f91 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:00.555634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7389a47b-eed7-4f16-887b-e76652980f91 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:00.558450 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2794/5639] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:00 2022] DELETE /identity/v3/projects/0343f11e8e8648dfb11d97007aa839eb => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:00.564393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389a47b-eed7-4f16-887b-e76652980f91 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:00.566835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7389a47b-eed7-4f16-887b-e76652980f91 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:00.567063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f94fc4-e847-4a25-9449-25b50998a33e tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:00.663003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ee301-ac2c-4bf1-b92c-5c6f166d6105 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af06d33e9645402d937a50ab306a0ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a9dadb374c433fa05eb554a48046d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:00.664189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ee301-ac2c-4bf1-b92c-5c6f166d6105 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:00.664780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ee301-ac2c-4bf1-b92c-5c6f166d6105 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:00.665284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ee301-ac2c-4bf1-b92c-5c6f166d6105 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:00.666874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ee301-ac2c-4bf1-b92c-5c6f166d6105 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:21:00.668069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ee301-ac2c-4bf1-b92c-5c6f166d6105 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:00.669998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ee301-ac2c-4bf1-b92c-5c6f166d6105 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:00.699771 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2846/5640] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:00.740689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389a47b-eed7-4f16-887b-e76652980f91 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:00.757432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39b430-2c4a-4164-9789-58fc5610dbe1 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:00.759136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39b430-2c4a-4164-9789-58fc5610dbe1 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:00.761601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39b430-2c4a-4164-9789-58fc5610dbe1 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:00.761939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39b430-2c4a-4164-9789-58fc5610dbe1 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:00.763321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39b430-2c4a-4164-9789-58fc5610dbe1 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:00.765419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39b430-2c4a-4164-9789-58fc5610dbe1 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:00.831723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:00.849019 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2795/5641] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:21:00 2022] POST /identity/v3/projects => generated 361 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:00.853532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ee301-ac2c-4bf1-b92c-5c6f166d6105 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:00.873352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ee301-ac2c-4bf1-b92c-5c6f166d6105 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:01.100435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90beeb-4e69-4158-8371-999ffc32351e tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:01.102043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90beeb-4e69-4158-8371-999ffc32351e tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:01.102457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90beeb-4e69-4158-8371-999ffc32351e tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:01.103899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90beeb-4e69-4158-8371-999ffc32351e tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/b0044c2b33c144efab79f4caf307945c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:01.106347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90beeb-4e69-4158-8371-999ffc32351e tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:update_project(project_id=b0044c2b33c144efab79f4caf307945c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:01.111321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90beeb-4e69-4158-8371-999ffc32351e tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:01.180502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:01.250137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39b430-2c4a-4164-9789-58fc5610dbe1 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:01.251595 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2847/5642] 10.222.0.17 () {60 vars in 1252 bytes} [Sat Jul 30 21:21:00 2022] PATCH /identity/v3/projects/b0044c2b33c144efab79f4caf307945c => generated 373 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:01.267413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39b430-2c4a-4164-9789-58fc5610dbe1 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:01.290226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bc4a2-e51d-41cf-8dc5-60bacd8cdf89 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:01.290944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bc4a2-e51d-41cf-8dc5-60bacd8cdf89 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:01.291377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bc4a2-e51d-41cf-8dc5-60bacd8cdf89 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:01.291737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bc4a2-e51d-41cf-8dc5-60bacd8cdf89 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/b0044c2b33c144efab79f4caf307945c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:01.314056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bc4a2-e51d-41cf-8dc5-60bacd8cdf89 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:get_project(project_id=b0044c2b33c144efab79f4caf307945c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:01.316689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bc4a2-e51d-41cf-8dc5-60bacd8cdf89 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:01.323148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90beeb-4e69-4158-8371-999ffc32351e tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:01.330006 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2796/5643] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:21:01 2022] GET /identity/v3/projects/b0044c2b33c144efab79f4caf307945c => generated 360 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:01.338018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90beeb-4e69-4158-8371-999ffc32351e tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:01.352692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5ed4d-839f-4ab5-8b80-6a9143a28bf6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:01.353499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5ed4d-839f-4ab5-8b80-6a9143a28bf6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:01.353857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5ed4d-839f-4ab5-8b80-6a9143a28bf6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:01.354519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5ed4d-839f-4ab5-8b80-6a9143a28bf6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/b0044c2b33c144efab79f4caf307945c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:01.356264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5ed4d-839f-4ab5-8b80-6a9143a28bf6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b0044c2b33c144efab79f4caf307945c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:01.358407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5ed4d-839f-4ab5-8b80-6a9143a28bf6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:01.533310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-14d5ed4d-839f-4ab5-8b80-6a9143a28bf6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0044c2b33c144efab79f4caf307945c', 'request_id': 'req-14d5ed4d-839f-4ab5-8b80-6a9143a28bf6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:01.552675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-14d5ed4d-839f-4ab5-8b80-6a9143a28bf6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0044c2b33c144efab79f4caf307945c', 'request_id': 'req-14d5ed4d-839f-4ab5-8b80-6a9143a28bf6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:01.577144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-14d5ed4d-839f-4ab5-8b80-6a9143a28bf6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0044c2b33c144efab79f4caf307945c', 'request_id': 'req-14d5ed4d-839f-4ab5-8b80-6a9143a28bf6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:01.602259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-14d5ed4d-839f-4ab5-8b80-6a9143a28bf6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] The token cache is being invalidate because project b0044c2b33c144efab79f4caf307945c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:01.602593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-14d5ed4d-839f-4ab5-8b80-6a9143a28bf6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:01.605306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-14d5ed4d-839f-4ab5-8b80-6a9143a28bf6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:01.623637 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2848/5644] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:01 2022] DELETE /identity/v3/projects/b0044c2b33c144efab79f4caf307945c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:01.629490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bc4a2-e51d-41cf-8dc5-60bacd8cdf89 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:01.632027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-196bc4a2-e51d-41cf-8dc5-60bacd8cdf89 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:01.676322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bc4a2-e51d-41cf-8dc5-60bacd8cdf89 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:01.843077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b740d95-4f2d-4d3f-97ca-c13edd330971 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:01.844141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b740d95-4f2d-4d3f-97ca-c13edd330971 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:01.845532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b740d95-4f2d-4d3f-97ca-c13edd330971 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:01.846070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b740d95-4f2d-4d3f-97ca-c13edd330971 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:01.846925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b740d95-4f2d-4d3f-97ca-c13edd330971 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:01.855046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b740d95-4f2d-4d3f-97ca-c13edd330971 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:01.913289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5ed4d-839f-4ab5-8b80-6a9143a28bf6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:01.915992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-14d5ed4d-839f-4ab5-8b80-6a9143a28bf6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:01.966125 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2797/5645] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:21:01 2022] POST /identity/v3/projects => generated 355 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:01.970557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b740d95-4f2d-4d3f-97ca-c13edd330971 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:02.095003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5ed4d-839f-4ab5-8b80-6a9143a28bf6 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:02.175998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b740d95-4f2d-4d3f-97ca-c13edd330971 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:02.185852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9c26c-2bbf-4fad-ac87-e74979304016 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af06d33e9645402d937a50ab306a0ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a9dadb374c433fa05eb554a48046d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:02.187184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9c26c-2bbf-4fad-ac87-e74979304016 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:02.187876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9c26c-2bbf-4fad-ac87-e74979304016 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:02.188923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9c26c-2bbf-4fad-ac87-e74979304016 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] PATH_INFO: `/v3/projects/4b84ce7df8474f7b9fd40770e373a539` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:02.190563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0582540-9570-4937-91ce-8a75bfef62e9 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:02.191089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9c26c-2bbf-4fad-ac87-e74979304016 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4b84ce7df8474f7b9fd40770e373a539)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:02.191564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0582540-9570-4937-91ce-8a75bfef62e9 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:02.191846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0582540-9570-4937-91ce-8a75bfef62e9 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:02.192488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0582540-9570-4937-91ce-8a75bfef62e9 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/7ba8eff56ea84635a616fe01476b022e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:02.194063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9c26c-2bbf-4fad-ac87-e74979304016 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:02.195133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0582540-9570-4937-91ce-8a75bfef62e9 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:update_project(project_id=7ba8eff56ea84635a616fe01476b022e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:02.198770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0582540-9570-4937-91ce-8a75bfef62e9 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:02.239323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:02.316060 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2798/5646] 10.222.0.17 () {60 vars in 1252 bytes} [Sat Jul 30 21:21:01 2022] PATCH /identity/v3/projects/7ba8eff56ea84635a616fe01476b022e => generated 369 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:21:02.324158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0582540-9570-4937-91ce-8a75bfef62e9 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:02.327973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3ad9c26c-2bbf-4fad-ac87-e74979304016 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b84ce7df8474f7b9fd40770e373a539', 'request_id': 'req-3ad9c26c-2bbf-4fad-ac87-e74979304016'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:02.345899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3ad9c26c-2bbf-4fad-ac87-e74979304016 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b84ce7df8474f7b9fd40770e373a539', 'request_id': 'req-3ad9c26c-2bbf-4fad-ac87-e74979304016'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:02.352842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0582540-9570-4937-91ce-8a75bfef62e9 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:02.377771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3ad9c26c-2bbf-4fad-ac87-e74979304016 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b84ce7df8474f7b9fd40770e373a539', 'request_id': 'req-3ad9c26c-2bbf-4fad-ac87-e74979304016'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:02.399197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3ad9c26c-2bbf-4fad-ac87-e74979304016 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] The token cache is being invalidate because project 4b84ce7df8474f7b9fd40770e373a539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:02.399520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3ad9c26c-2bbf-4fad-ac87-e74979304016 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:02.401351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3ad9c26c-2bbf-4fad-ac87-e74979304016 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:02.410583 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2849/5647] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:01 2022] DELETE /identity/v3/projects/4b84ce7df8474f7b9fd40770e373a539 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:02.453405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9c26c-2bbf-4fad-ac87-e74979304016 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:02.455653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3ad9c26c-2bbf-4fad-ac87-e74979304016 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:02.461716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:02.480241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a146121-e043-4148-9b15-3b9006706046 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:02.481001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a146121-e043-4148-9b15-3b9006706046 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:02.481290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a146121-e043-4148-9b15-3b9006706046 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:02.481573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a146121-e043-4148-9b15-3b9006706046 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/7ba8eff56ea84635a616fe01476b022e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:02.505447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a146121-e043-4148-9b15-3b9006706046 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:get_project(project_id=7ba8eff56ea84635a616fe01476b022e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:02.507694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a146121-e043-4148-9b15-3b9006706046 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:02.517417 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2799/5648] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:21:02 2022] GET /identity/v3/projects/7ba8eff56ea84635a616fe01476b022e => generated 356 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:02.518207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a146121-e043-4148-9b15-3b9006706046 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:02.525522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7a146121-e043-4148-9b15-3b9006706046 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:02.547248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a146121-e043-4148-9b15-3b9006706046 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:02.565061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced69d76-3a4a-4d7b-b160-f14d41886245 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:02.565718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced69d76-3a4a-4d7b-b160-f14d41886245 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:02.565996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced69d76-3a4a-4d7b-b160-f14d41886245 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:02.566275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced69d76-3a4a-4d7b-b160-f14d41886245 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/projects/7ba8eff56ea84635a616fe01476b022e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:02.567513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced69d76-3a4a-4d7b-b160-f14d41886245 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7ba8eff56ea84635a616fe01476b022e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:02.569471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced69d76-3a4a-4d7b-b160-f14d41886245 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:02.581964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9c26c-2bbf-4fad-ac87-e74979304016 tempest-RoutersAdminTest-1943910311 tempest-RoutersAdminTest-1943910311-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:02.590010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dea610-6336-4dc4-b5a1-0a9c36d7d440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:02.591408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dea610-6336-4dc4-b5a1-0a9c36d7d440 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:02.591975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dea610-6336-4dc4-b5a1-0a9c36d7d440 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:02.592598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dea610-6336-4dc4-b5a1-0a9c36d7d440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:02.595579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-16dea610-6336-4dc4-b5a1-0a9c36d7d440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:02.712590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dea610-6336-4dc4-b5a1-0a9c36d7d440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:02.714524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dea610-6336-4dc4-b5a1-0a9c36d7d440 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:02.716905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ced69d76-3a4a-4d7b-b160-f14d41886245 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba8eff56ea84635a616fe01476b022e', 'request_id': 'req-ced69d76-3a4a-4d7b-b160-f14d41886245'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:02.746369 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2850/5649] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:21:02.749987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ced69d76-3a4a-4d7b-b160-f14d41886245 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba8eff56ea84635a616fe01476b022e', 'request_id': 'req-ced69d76-3a4a-4d7b-b160-f14d41886245'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:02.768268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ced69d76-3a4a-4d7b-b160-f14d41886245 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba8eff56ea84635a616fe01476b022e', 'request_id': 'req-ced69d76-3a4a-4d7b-b160-f14d41886245'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:02.787050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ced69d76-3a4a-4d7b-b160-f14d41886245 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] The token cache is being invalidate because project 7ba8eff56ea84635a616fe01476b022e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:02.787511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ced69d76-3a4a-4d7b-b160-f14d41886245 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:02.788553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ced69d76-3a4a-4d7b-b160-f14d41886245 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:02.790774 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2800/5650] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:02 2022] DELETE /identity/v3/projects/7ba8eff56ea84635a616fe01476b022e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:02.797261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dea610-6336-4dc4-b5a1-0a9c36d7d440 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:02.817852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dea610-6336-4dc4-b5a1-0a9c36d7d440 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:02.955469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:02.978902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd91d3-6204-48bf-a8aa-5d635ad949e3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:02.980245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd91d3-6204-48bf-a8aa-5d635ad949e3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:02.980458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd91d3-6204-48bf-a8aa-5d635ad949e3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:02.980692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd91d3-6204-48bf-a8aa-5d635ad949e3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/domains/1305f6da033d433d9e9aff47fa12f99c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:03.000203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd91d3-6204-48bf-a8aa-5d635ad949e3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 21:21:03.011658 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-5ddd91d3-6204-48bf-a8aa-5d635ad949e3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Could not find domain: 1305f6da033d433d9e9aff47fa12f99c.: keystone.exception.DomainNotFound: Could not find domain: 1305f6da033d433d9e9aff47fa12f99c. Jul 30 21:21:03.011658 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:21:03.011658 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 30 21:21:03.011658 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 30 21:21:03.011658 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 21:21:03.011658 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 21:21:03.011658 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 21:21:03.011658 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 21:21:03.011658 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1305f6da033d433d9e9aff47fa12f99c. Jul 30 21:21:03.011658 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:21:03.011658 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:21:03.011658 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:21:03.011658 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:21:03.011658 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:21:03.011658 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:21:03.011658 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:21:03.012856 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:21:03.012856 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:21:03.012856 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:21:03.012856 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:21:03.012856 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:21:03.012856 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:21:03.012856 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:21:03.012856 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 30 21:21:03.012856 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 30 21:21:03.012856 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 21:21:03.012856 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 21:21:03.012856 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 21:21:03.012856 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 21:21:03.012856 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:21:03.012856 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:21:03.012856 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:21:03.013904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:21:03.013904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:21:03.013904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:21:03.013904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:21:03.013904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 21:21:03.013904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:21:03.013904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:21:03.013904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:21:03.013904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:21:03.013904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:21:03.013904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:21:03.013904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:21:03.013904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:21:03.013904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 30 21:21:03.013904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 21:21:03.013904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1305f6da033d433d9e9aff47fa12f99c. Jul 30 21:21:03.013904 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:21:03.024318 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2851/5651] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:21:02 2022] PATCH /identity/v3/domains/1305f6da033d433d9e9aff47fa12f99c => generated 112 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:21:03.025479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced69d76-3a4a-4d7b-b160-f14d41886245 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:03.027154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ced69d76-3a4a-4d7b-b160-f14d41886245 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:03.046891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced69d76-3a4a-4d7b-b160-f14d41886245 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:03.057416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188aef9b-3a04-430e-9423-d854a9c536de tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d76a75925cf44a2815d502d35aeb81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f96179eb81e43ab85801eff6a7d19dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:03.058870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aef9b-3a04-430e-9423-d854a9c536de tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:03.060061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aef9b-3a04-430e-9423-d854a9c536de tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:03.060061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aef9b-3a04-430e-9423-d854a9c536de tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] PATH_INFO: `/v3/domains/653390e3c5274c74bc1087a036a2cd38` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:03.075354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188aef9b-3a04-430e-9423-d854a9c536de tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 21:21:03.082619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-188aef9b-3a04-430e-9423-d854a9c536de tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Could not find domain: 653390e3c5274c74bc1087a036a2cd38.: keystone.exception.DomainNotFound: Could not find domain: 653390e3c5274c74bc1087a036a2cd38. Jul 30 21:21:03.082619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:21:03.082619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 30 21:21:03.082619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 30 21:21:03.082619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 21:21:03.082619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 21:21:03.082619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 21:21:03.082619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 21:21:03.082619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 653390e3c5274c74bc1087a036a2cd38. Jul 30 21:21:03.082619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:21:03.082619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:21:03.082619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:21:03.082619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:21:03.082619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:21:03.082619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:21:03.082619 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:21:03.087729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:21:03.087729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:21:03.087729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:21:03.087729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:21:03.087729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:21:03.087729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:21:03.087729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:21:03.087729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 30 21:21:03.087729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 30 21:21:03.087729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 21:21:03.087729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 21:21:03.087729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 21:21:03.087729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 21:21:03.087729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:21:03.087729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:21:03.087729 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:21:03.088690 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:21:03.088690 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:21:03.088690 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:21:03.088690 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:21:03.088690 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 21:21:03.088690 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:21:03.088690 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:21:03.088690 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:21:03.088690 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:21:03.088690 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:21:03.088690 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:21:03.088690 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:21:03.088690 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:21:03.088690 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 30 21:21:03.088690 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 21:21:03.088690 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 653390e3c5274c74bc1087a036a2cd38. Jul 30 21:21:03.088690 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:21:03.089824 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2801/5652] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:21:03 2022] PATCH /identity/v3/domains/653390e3c5274c74bc1087a036a2cd38 => generated 112 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:21:03.089907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd91d3-6204-48bf-a8aa-5d635ad949e3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:03.093405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5ddd91d3-6204-48bf-a8aa-5d635ad949e3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:03.284439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd91d3-6204-48bf-a8aa-5d635ad949e3 tempest-ProjectsTestJSON-1917022755 tempest-ProjectsTestJSON-1917022755-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:03.299197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b47a6-f5f2-48ca-848a-2614d8e897fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:03.300075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b47a6-f5f2-48ca-848a-2614d8e897fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:03.300470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b47a6-f5f2-48ca-848a-2614d8e897fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:03.300853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b47a6-f5f2-48ca-848a-2614d8e897fd admin admin] PATH_INFO: `/v3/users/d22c669d9ae94f45a43954d82e5291be` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:03.305568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b47a6-f5f2-48ca-848a-2614d8e897fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d22c669d9ae94f45a43954d82e5291be)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:03.319166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b47a6-f5f2-48ca-848a-2614d8e897fd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:03.451558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4d5b47a6-f5f2-48ca-848a-2614d8e897fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd22c669d9ae94f45a43954d82e5291be'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:03.477318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4d5b47a6-f5f2-48ca-848a-2614d8e897fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd22c669d9ae94f45a43954d82e5291be'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:03.479523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4d5b47a6-f5f2-48ca-848a-2614d8e897fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd22c669d9ae94f45a43954d82e5291be'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:03.497658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4d5b47a6-f5f2-48ca-848a-2614d8e897fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd22c669d9ae94f45a43954d82e5291be'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:03.501461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4d5b47a6-f5f2-48ca-848a-2614d8e897fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd22c669d9ae94f45a43954d82e5291be'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:03.542525 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2852/5653] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:03 2022] DELETE /identity/v3/users/d22c669d9ae94f45a43954d82e5291be => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:03.548187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200a1e5-a381-4b08-b588-de8496554b5a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:03.548792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200a1e5-a381-4b08-b588-de8496554b5a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:03.549029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200a1e5-a381-4b08-b588-de8496554b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:03.605965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a200a1e5-a381-4b08-b588-de8496554b5a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:03.608187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a200a1e5-a381-4b08-b588-de8496554b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:03.749960 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2802/5654] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:03.785673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b47a6-f5f2-48ca-848a-2614d8e897fd admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:03.787317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4d5b47a6-f5f2-48ca-848a-2614d8e897fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:03.903416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b47a6-f5f2-48ca-848a-2614d8e897fd admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:03.909129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59c468-1b49-437f-b3a9-e40fa3258086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:03.909778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59c468-1b49-437f-b3a9-e40fa3258086 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:03.910764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59c468-1b49-437f-b3a9-e40fa3258086 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:03.911171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59c468-1b49-437f-b3a9-e40fa3258086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:03.926660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59c468-1b49-437f-b3a9-e40fa3258086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:03.929233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59c468-1b49-437f-b3a9-e40fa3258086 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:03.941870 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2853/5655] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:21:04.920371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200a1e5-a381-4b08-b588-de8496554b5a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:04.920371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a200a1e5-a381-4b08-b588-de8496554b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:04.937157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200a1e5-a381-4b08-b588-de8496554b5a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:04.955355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a87e5-987f-4000-aac6-e769d4c94a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:04.956090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a87e5-987f-4000-aac6-e769d4c94a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:04.960018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a87e5-987f-4000-aac6-e769d4c94a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:04.960397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a87e5-987f-4000-aac6-e769d4c94a9f admin admin] PATH_INFO: `/v3/projects/ecdb6aafe4c04b65b0505261304644bd` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:04.964741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a87e5-987f-4000-aac6-e769d4c94a9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecdb6aafe4c04b65b0505261304644bd)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:04.966775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a87e5-987f-4000-aac6-e769d4c94a9f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:05.115659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-074a87e5-987f-4000-aac6-e769d4c94a9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecdb6aafe4c04b65b0505261304644bd', 'request_id': 'req-074a87e5-987f-4000-aac6-e769d4c94a9f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:05.123918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:05.141325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-074a87e5-987f-4000-aac6-e769d4c94a9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecdb6aafe4c04b65b0505261304644bd', 'request_id': 'req-074a87e5-987f-4000-aac6-e769d4c94a9f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:05.163696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-074a87e5-987f-4000-aac6-e769d4c94a9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecdb6aafe4c04b65b0505261304644bd', 'request_id': 'req-074a87e5-987f-4000-aac6-e769d4c94a9f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:05.195772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-074a87e5-987f-4000-aac6-e769d4c94a9f admin admin] The token cache is being invalidate because project ecdb6aafe4c04b65b0505261304644bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:05.196341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-074a87e5-987f-4000-aac6-e769d4c94a9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:05.197917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-074a87e5-987f-4000-aac6-e769d4c94a9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:05.205277 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2803/5656] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:04 2022] DELETE /identity/v3/projects/ecdb6aafe4c04b65b0505261304644bd => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:05.205520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59c468-1b49-437f-b3a9-e40fa3258086 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:05.215949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59c468-1b49-437f-b3a9-e40fa3258086 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:05.275046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:05.411322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891a70a-9fe9-4977-8264-cfb03b54129b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:05.412281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a70a-9fe9-4977-8264-cfb03b54129b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:05.412725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a70a-9fe9-4977-8264-cfb03b54129b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:05.413151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a70a-9fe9-4977-8264-cfb03b54129b admin admin] PATH_INFO: `/v3/users/5d76a75925cf44a2815d502d35aeb81c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:05.418003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891a70a-9fe9-4977-8264-cfb03b54129b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d76a75925cf44a2815d502d35aeb81c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:05.420275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891a70a-9fe9-4977-8264-cfb03b54129b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:05.520102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4891a70a-9fe9-4977-8264-cfb03b54129b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d76a75925cf44a2815d502d35aeb81c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:05.538708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4891a70a-9fe9-4977-8264-cfb03b54129b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d76a75925cf44a2815d502d35aeb81c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:05.540006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4891a70a-9fe9-4977-8264-cfb03b54129b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d76a75925cf44a2815d502d35aeb81c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:05.548474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4891a70a-9fe9-4977-8264-cfb03b54129b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d76a75925cf44a2815d502d35aeb81c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:05.549701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4891a70a-9fe9-4977-8264-cfb03b54129b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d76a75925cf44a2815d502d35aeb81c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:05.571908 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2854/5657] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:05 2022] DELETE /identity/v3/users/5d76a75925cf44a2815d502d35aeb81c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:21:06.797805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a87e5-987f-4000-aac6-e769d4c94a9f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:06.799225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-074a87e5-987f-4000-aac6-e769d4c94a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:06.818687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a87e5-987f-4000-aac6-e769d4c94a9f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:07.020188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d76f7-999e-49b4-b56f-64bf72604d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:07.021540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d76f7-999e-49b4-b56f-64bf72604d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:07.022144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d76f7-999e-49b4-b56f-64bf72604d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:07.022646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d76f7-999e-49b4-b56f-64bf72604d6f admin admin] PATH_INFO: `/v3/projects/2f96179eb81e43ab85801eff6a7d19dc` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:07.024616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d76f7-999e-49b4-b56f-64bf72604d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f96179eb81e43ab85801eff6a7d19dc)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:07.028320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d76f7-999e-49b4-b56f-64bf72604d6f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:07.106934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d58d76f7-999e-49b4-b56f-64bf72604d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f96179eb81e43ab85801eff6a7d19dc', 'request_id': 'req-d58d76f7-999e-49b4-b56f-64bf72604d6f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:07.135398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d58d76f7-999e-49b4-b56f-64bf72604d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f96179eb81e43ab85801eff6a7d19dc', 'request_id': 'req-d58d76f7-999e-49b4-b56f-64bf72604d6f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:07.145896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d58d76f7-999e-49b4-b56f-64bf72604d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f96179eb81e43ab85801eff6a7d19dc', 'request_id': 'req-d58d76f7-999e-49b4-b56f-64bf72604d6f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:07.168984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d58d76f7-999e-49b4-b56f-64bf72604d6f admin admin] The token cache is being invalidate because project 2f96179eb81e43ab85801eff6a7d19dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:07.169639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d58d76f7-999e-49b4-b56f-64bf72604d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:07.170801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d58d76f7-999e-49b4-b56f-64bf72604d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:07.180406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140568b9-90af-49d5-a3ec-e5da2bccf9c5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:07.180985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140568b9-90af-49d5-a3ec-e5da2bccf9c5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:07.180985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140568b9-90af-49d5-a3ec-e5da2bccf9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:07.181985 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2804/5658] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:06 2022] DELETE /identity/v3/projects/2f96179eb81e43ab85801eff6a7d19dc => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:07.211584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-140568b9-90af-49d5-a3ec-e5da2bccf9c5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:07.212918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-140568b9-90af-49d5-a3ec-e5da2bccf9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:07.320748 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2855/5659] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:07.323028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dbbfa-ba1b-43eb-9fc9-e6223511d8c7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:07.324263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dbbfa-ba1b-43eb-9fc9-e6223511d8c7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:07.324726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dbbfa-ba1b-43eb-9fc9-e6223511d8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:07.407590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1a6dbbfa-ba1b-43eb-9fc9-e6223511d8c7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:07.409419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1a6dbbfa-ba1b-43eb-9fc9-e6223511d8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:07.435214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140568b9-90af-49d5-a3ec-e5da2bccf9c5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:07.435662 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2805/5660] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:07.448270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140568b9-90af-49d5-a3ec-e5da2bccf9c5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:07.465243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c664c2-371a-4d0a-b61f-c4fdbd284fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:07.465895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c664c2-371a-4d0a-b61f-c4fdbd284fea admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:07.466266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c664c2-371a-4d0a-b61f-c4fdbd284fea admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:07.466551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c664c2-371a-4d0a-b61f-c4fdbd284fea admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:07.467271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c664c2-371a-4d0a-b61f-c4fdbd284fea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:21:07.467609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c664c2-371a-4d0a-b61f-c4fdbd284fea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:07.473383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c664c2-371a-4d0a-b61f-c4fdbd284fea admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:07.511765 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2856/5661] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:07.512864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dbbfa-ba1b-43eb-9fc9-e6223511d8c7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:07.537992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dbbfa-ba1b-43eb-9fc9-e6223511d8c7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:07.559060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc9e85-3e7b-44bd-94be-212b2dae29df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:07.560634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc9e85-3e7b-44bd-94be-212b2dae29df admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:07.562324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc9e85-3e7b-44bd-94be-212b2dae29df admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:07.564921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc9e85-3e7b-44bd-94be-212b2dae29df admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:07.569377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fc9e85-3e7b-44bd-94be-212b2dae29df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:07.580777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fc9e85-3e7b-44bd-94be-212b2dae29df admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:07.669384 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2806/5662] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:21:07 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:07.670229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c664c2-371a-4d0a-b61f-c4fdbd284fea admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:07.684603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c664c2-371a-4d0a-b61f-c4fdbd284fea admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:07.741391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:07.804748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c02265-edc2-4eac-afd5-03d49512611a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:07.807104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c02265-edc2-4eac-afd5-03d49512611a admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:07.807679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c02265-edc2-4eac-afd5-03d49512611a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:07.808276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c02265-edc2-4eac-afd5-03d49512611a admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:07.809170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c02265-edc2-4eac-afd5-03d49512611a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:07.812135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c02265-edc2-4eac-afd5-03d49512611a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:07.851835 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2857/5663] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:21:07 2022] POST /identity/v3/users => generated 283 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:07.857186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc9e85-3e7b-44bd-94be-212b2dae29df admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:07.877624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc9e85-3e7b-44bd-94be-212b2dae29df admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:07.900309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccf5b0-8939-41e9-baf4-7edad45488cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:07.900309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccf5b0-8939-41e9-baf4-7edad45488cb admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:07.900309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccf5b0-8939-41e9-baf4-7edad45488cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:07.900309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccf5b0-8939-41e9-baf4-7edad45488cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:07.909315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccf5b0-8939-41e9-baf4-7edad45488cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:07.909315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccf5b0-8939-41e9-baf4-7edad45488cb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:07.918199 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2807/5664] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:21:07.920104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c02265-edc2-4eac-afd5-03d49512611a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:07.934536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c02265-edc2-4eac-afd5-03d49512611a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:07.940918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53de0b0-6683-46b2-9662-0169da18b45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:07.941541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53de0b0-6683-46b2-9662-0169da18b45b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:07.941931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53de0b0-6683-46b2-9662-0169da18b45b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:07.952926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53de0b0-6683-46b2-9662-0169da18b45b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:07.954358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53de0b0-6683-46b2-9662-0169da18b45b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:07.957699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53de0b0-6683-46b2-9662-0169da18b45b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:07.985105 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2858/5665] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:07.986487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccf5b0-8939-41e9-baf4-7edad45488cb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:08.000830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccf5b0-8939-41e9-baf4-7edad45488cb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:08.011994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba61ba5-00d7-40f3-888a-9d0a38265d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:08.013196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba61ba5-00d7-40f3-888a-9d0a38265d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:08.013801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba61ba5-00d7-40f3-888a-9d0a38265d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:08.014294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba61ba5-00d7-40f3-888a-9d0a38265d18 admin admin] PATH_INFO: `/v3/projects/4df1c886bba342ec9d5f80936df09047/users/c3a31699cbf4402abbbc4c242bde4d26/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:08.053588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba61ba5-00d7-40f3-888a-9d0a38265d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4df1c886bba342ec9d5f80936df09047, user_id=c3a31699cbf4402abbbc4c242bde4d26, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:08.058817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba61ba5-00d7-40f3-888a-9d0a38265d18 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:08.099666 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2808/5666] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:07 2022] PUT /identity/v3/projects/4df1c886bba342ec9d5f80936df09047/users/c3a31699cbf4402abbbc4c242bde4d26/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:21:08.207077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c993098-fe70-4880-a587-6079f686255b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:08.207747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c993098-fe70-4880-a587-6079f686255b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:08.207747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c993098-fe70-4880-a587-6079f686255b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:08.241522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2c993098-fe70-4880-a587-6079f686255b None None] MFA Rules not processed for user `c3a31699cbf4402abbbc4c242bde4d26`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:08.242789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2c993098-fe70-4880-a587-6079f686255b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:08.352414 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2859/5667] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:08.357090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba61ba5-00d7-40f3-888a-9d0a38265d18 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:08.373071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:08.447955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba61ba5-00d7-40f3-888a-9d0a38265d18 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:08.470375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e40874-791c-478c-97d6-d96e64d172e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:08.471072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e40874-791c-478c-97d6-d96e64d172e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:08.471306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e40874-791c-478c-97d6-d96e64d172e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:08.473550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e40874-791c-478c-97d6-d96e64d172e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:08.474245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e40874-791c-478c-97d6-d96e64d172e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:08.476228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e40874-791c-478c-97d6-d96e64d172e8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:08.539857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c993098-fe70-4880-a587-6079f686255b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:08.540106 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2809/5668] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:21:08 2022] POST /identity/v3/projects => generated 367 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:08.552568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c993098-fe70-4880-a587-6079f686255b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:08.650568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5086e3-3b22-4875-b4d2-a396deaedb8a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:08.650862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5086e3-3b22-4875-b4d2-a396deaedb8a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:08.651144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5086e3-3b22-4875-b4d2-a396deaedb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:08.656441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f6927-152e-45f0-815d-8d07eb0a273e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:08.659167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f6927-152e-45f0-815d-8d07eb0a273e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:08.659755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f6927-152e-45f0-815d-8d07eb0a273e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:08.660479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f6927-152e-45f0-815d-8d07eb0a273e admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:08.661948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f6927-152e-45f0-815d-8d07eb0a273e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:08.664475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f6927-152e-45f0-815d-8d07eb0a273e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:08.705683 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2860/5669] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:21:08 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:21:08.712095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f6927-152e-45f0-815d-8d07eb0a273e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:08.724485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f6927-152e-45f0-815d-8d07eb0a273e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:08.726911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-af5086e3-3b22-4875-b4d2-a396deaedb8a None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:08.728335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-af5086e3-3b22-4875-b4d2-a396deaedb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:08.731546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4f5e3-5f38-4284-b597-fe456932e9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:08.732379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4f5e3-5f38-4284-b597-fe456932e9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:08.732869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4f5e3-5f38-4284-b597-fe456932e9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:08.733354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4f5e3-5f38-4284-b597-fe456932e9b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:08.734225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4f5e3-5f38-4284-b597-fe456932e9b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:08.736603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4f5e3-5f38-4284-b597-fe456932e9b1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:08.749691 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2861/5670] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:08.751217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4f5e3-5f38-4284-b597-fe456932e9b1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:08.755099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-83b4f5e3-5f38-4284-b597-fe456932e9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:08.782117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4f5e3-5f38-4284-b597-fe456932e9b1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:08.790528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43525c27-469e-407f-b6f7-9d7c985d8d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:08.791187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43525c27-469e-407f-b6f7-9d7c985d8d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:08.791514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43525c27-469e-407f-b6f7-9d7c985d8d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:08.792377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43525c27-469e-407f-b6f7-9d7c985d8d0b admin admin] PATH_INFO: `/v3/users/e52e4d7cd24c4153a6eef2f867edb5dd` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:08.793618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43525c27-469e-407f-b6f7-9d7c985d8d0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e52e4d7cd24c4153a6eef2f867edb5dd)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:08.796918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43525c27-469e-407f-b6f7-9d7c985d8d0b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:08.807318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:08.822937 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2810/5671] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:21:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:21:08.824288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5086e3-3b22-4875-b4d2-a396deaedb8a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:08.840538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5086e3-3b22-4875-b4d2-a396deaedb8a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:08.848254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0b86a-b9bf-4f43-a162-4ee14b9b2f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:08.849173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0b86a-b9bf-4f43-a162-4ee14b9b2f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:08.849549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0b86a-b9bf-4f43-a162-4ee14b9b2f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:08.849910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0b86a-b9bf-4f43-a162-4ee14b9b2f7e admin admin] PATH_INFO: `/v3/projects/82da7b630410424a962055626fa46641/users/549efd1cb1e54df9a739e59953e0715f/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:08.873147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0b86a-b9bf-4f43-a162-4ee14b9b2f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=82da7b630410424a962055626fa46641, user_id=549efd1cb1e54df9a739e59953e0715f, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:08.877737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0b86a-b9bf-4f43-a162-4ee14b9b2f7e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:08.900773 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2811/5672] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:08 2022] PUT /identity/v3/projects/82da7b630410424a962055626fa46641/users/549efd1cb1e54df9a739e59953e0715f/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:08.901681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0b86a-b9bf-4f43-a162-4ee14b9b2f7e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:08.904174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43525c27-469e-407f-b6f7-9d7c985d8d0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e52e4d7cd24c4153a6eef2f867edb5dd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:08.904372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-79a0b86a-b9bf-4f43-a162-4ee14b9b2f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:08.928305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43525c27-469e-407f-b6f7-9d7c985d8d0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e52e4d7cd24c4153a6eef2f867edb5dd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:08.929339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43525c27-469e-407f-b6f7-9d7c985d8d0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e52e4d7cd24c4153a6eef2f867edb5dd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:08.941445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43525c27-469e-407f-b6f7-9d7c985d8d0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e52e4d7cd24c4153a6eef2f867edb5dd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:08.944852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43525c27-469e-407f-b6f7-9d7c985d8d0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e52e4d7cd24c4153a6eef2f867edb5dd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:08.965546 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2862/5673] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:08 2022] DELETE /identity/v3/users/e52e4d7cd24c4153a6eef2f867edb5dd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:08.966667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43525c27-469e-407f-b6f7-9d7c985d8d0b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:08.968739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-43525c27-469e-407f-b6f7-9d7c985d8d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:08.977850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:09.016178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0b86a-b9bf-4f43-a162-4ee14b9b2f7e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:09.099166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43525c27-469e-407f-b6f7-9d7c985d8d0b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:09.110646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b0f28-0db7-448f-859b-39fe2b99b993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:09.111349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b0f28-0db7-448f-859b-39fe2b99b993 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:09.112124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b0f28-0db7-448f-859b-39fe2b99b993 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:09.112253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b0f28-0db7-448f-859b-39fe2b99b993 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:09.113038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b0f28-0db7-448f-859b-39fe2b99b993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:09.114776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b0f28-0db7-448f-859b-39fe2b99b993 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:09.119410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f88ef0-4043-44ee-80be-43883688acb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:09.120068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f88ef0-4043-44ee-80be-43883688acb7 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:09.120419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f88ef0-4043-44ee-80be-43883688acb7 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:09.120713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f88ef0-4043-44ee-80be-43883688acb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:09.124153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-51f88ef0-4043-44ee-80be-43883688acb7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:09.129220 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2863/5674] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:09.131000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546ee96-21f8-4a32-a407-2a67e2df63f7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:09.131671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546ee96-21f8-4a32-a407-2a67e2df63f7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:09.132594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546ee96-21f8-4a32-a407-2a67e2df63f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:09.162308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5546ee96-21f8-4a32-a407-2a67e2df63f7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:09.163728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5546ee96-21f8-4a32-a407-2a67e2df63f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:09.175589 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2864/5675] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:09.183023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546ee96-21f8-4a32-a407-2a67e2df63f7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:09.198199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546ee96-21f8-4a32-a407-2a67e2df63f7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:09.206161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660aebb-37cc-4f7e-8ac7-832d05b2a758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:09.207796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660aebb-37cc-4f7e-8ac7-832d05b2a758 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:09.208404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660aebb-37cc-4f7e-8ac7-832d05b2a758 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:09.208690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660aebb-37cc-4f7e-8ac7-832d05b2a758 admin admin] PATH_INFO: `/v3/projects/82da7b630410424a962055626fa46641/users/549efd1cb1e54df9a739e59953e0715f/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:09.213929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660aebb-37cc-4f7e-8ac7-832d05b2a758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82da7b630410424a962055626fa46641, user_id=549efd1cb1e54df9a739e59953e0715f, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:09.217237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660aebb-37cc-4f7e-8ac7-832d05b2a758 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:09.235120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f88ef0-4043-44ee-80be-43883688acb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:09.237449 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2865/5676] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:09 2022] PUT /identity/v3/projects/82da7b630410424a962055626fa46641/users/549efd1cb1e54df9a739e59953e0715f/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:09.243012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f88ef0-4043-44ee-80be-43883688acb7 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:09.248414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660aebb-37cc-4f7e-8ac7-832d05b2a758 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:09.251185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9660aebb-37cc-4f7e-8ac7-832d05b2a758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:09.265655 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2812/5677] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:21:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:21:09.274238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6da41-f916-4f05-bf49-6f8903f43e84 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:09.274756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6da41-f916-4f05-bf49-6f8903f43e84 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:09.275193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6da41-f916-4f05-bf49-6f8903f43e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:09.314416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c9e6da41-f916-4f05-bf49-6f8903f43e84 None None] MFA Rules not processed for user `549efd1cb1e54df9a739e59953e0715f`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:09.317004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c9e6da41-f916-4f05-bf49-6f8903f43e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:09.347478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660aebb-37cc-4f7e-8ac7-832d05b2a758 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:09.356652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4658ed-1eae-4f1d-acc1-4b269c8a56a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:09.359599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4658ed-1eae-4f1d-acc1-4b269c8a56a5 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:09.360709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4658ed-1eae-4f1d-acc1-4b269c8a56a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:09.361067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4658ed-1eae-4f1d-acc1-4b269c8a56a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:09.413256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:09.423196 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2813/5678] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:09.428576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6da41-f916-4f05-bf49-6f8903f43e84 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:09.451101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6da41-f916-4f05-bf49-6f8903f43e84 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:09.463106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee7727-61a9-4a69-9aa0-eb02cace9e22 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:09.463775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee7727-61a9-4a69-9aa0-eb02cace9e22 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:09.464085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee7727-61a9-4a69-9aa0-eb02cace9e22 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:09.466175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee7727-61a9-4a69-9aa0-eb02cace9e22 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:09.466895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee7727-61a9-4a69-9aa0-eb02cace9e22 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:09.468623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee7727-61a9-4a69-9aa0-eb02cace9e22 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:09.481249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:09.501940 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2814/5679] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:21:09 2022] POST /identity/v3/roles => generated 235 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:09.505007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee7727-61a9-4a69-9aa0-eb02cace9e22 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:09.520591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4658ed-1eae-4f1d-acc1-4b269c8a56a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:09.521698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4658ed-1eae-4f1d-acc1-4b269c8a56a5 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:09.524951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee7727-61a9-4a69-9aa0-eb02cace9e22 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:09.533660 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2866/5680] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:21:09.537401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353ca77-47d9-47d3-841e-79917032fd10 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:09.538132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353ca77-47d9-47d3-841e-79917032fd10 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:09.538426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353ca77-47d9-47d3-841e-79917032fd10 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:09.539261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353ca77-47d9-47d3-841e-79917032fd10 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:09.539574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353ca77-47d9-47d3-841e-79917032fd10 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:09.541603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353ca77-47d9-47d3-841e-79917032fd10 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:09.565222 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2815/5681] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:21:09 2022] POST /identity/v3/roles => generated 234 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:09.569722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4658ed-1eae-4f1d-acc1-4b269c8a56a5 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:09.583620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4658ed-1eae-4f1d-acc1-4b269c8a56a5 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:09.600788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e42d29-1634-4829-ac45-05070b9cda7b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:09.601230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e42d29-1634-4829-ac45-05070b9cda7b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:09.601875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e42d29-1634-4829-ac45-05070b9cda7b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:09.602178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e42d29-1634-4829-ac45-05070b9cda7b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:09.603405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e42d29-1634-4829-ac45-05070b9cda7b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:09.608861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e42d29-1634-4829-ac45-05070b9cda7b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:09.638901 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2867/5682] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:21:09 2022] POST /identity/v3/roles => generated 234 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:09.642822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353ca77-47d9-47d3-841e-79917032fd10 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:09.673684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353ca77-47d9-47d3-841e-79917032fd10 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:09.688101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26beb68c-1db0-464e-b37e-034cd59bb43b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:09.688802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26beb68c-1db0-464e-b37e-034cd59bb43b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:09.689099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26beb68c-1db0-464e-b37e-034cd59bb43b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:09.689399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26beb68c-1db0-464e-b37e-034cd59bb43b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:09.690136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26beb68c-1db0-464e-b37e-034cd59bb43b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:09.691946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26beb68c-1db0-464e-b37e-034cd59bb43b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:09.716875 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2816/5683] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:21:09 2022] POST /identity/v3/domains => generated 276 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:09.721476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e42d29-1634-4829-ac45-05070b9cda7b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:09.738626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e42d29-1634-4829-ac45-05070b9cda7b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:09.744315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26beb68c-1db0-464e-b37e-034cd59bb43b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:09.746786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-26beb68c-1db0-464e-b37e-034cd59bb43b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:09.861029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26beb68c-1db0-464e-b37e-034cd59bb43b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:09.868144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1632f-f5ca-4c7a-8b3b-c407ab8414f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:09.868920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1632f-f5ca-4c7a-8b3b-c407ab8414f7 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:09.869290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1632f-f5ca-4c7a-8b3b-c407ab8414f7 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:09.869718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1632f-f5ca-4c7a-8b3b-c407ab8414f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:09.873076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c8b1632f-f5ca-4c7a-8b3b-c407ab8414f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:09.874962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27379ec-cce3-4a48-a199-308d632ff292 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:09.877694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27379ec-cce3-4a48-a199-308d632ff292 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:09.878542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27379ec-cce3-4a48-a199-308d632ff292 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:09.879668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27379ec-cce3-4a48-a199-308d632ff292 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:09.880558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27379ec-cce3-4a48-a199-308d632ff292 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:09.890718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27379ec-cce3-4a48-a199-308d632ff292 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:09.896974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1632f-f5ca-4c7a-8b3b-c407ab8414f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:09.898759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1632f-f5ca-4c7a-8b3b-c407ab8414f7 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:09.926171 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2817/5684] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:21:09.977761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1632f-f5ca-4c7a-8b3b-c407ab8414f7 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:09.980840 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2868/5685] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:21:09 2022] POST /identity/v3/projects => generated 399 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:09.993231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1632f-f5ca-4c7a-8b3b-c407ab8414f7 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:10.074862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51f222-91ff-4cc9-a132-0def73fb5624 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:10.075850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51f222-91ff-4cc9-a132-0def73fb5624 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:10.076315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51f222-91ff-4cc9-a132-0def73fb5624 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:10.076778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51f222-91ff-4cc9-a132-0def73fb5624 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/groups` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:10.078014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51f222-91ff-4cc9-a132-0def73fb5624 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:10.081831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51f222-91ff-4cc9-a132-0def73fb5624 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:10.113199 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2818/5686] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:21:09 2022] POST /identity/v3/groups => generated 301 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:10.117278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27379ec-cce3-4a48-a199-308d632ff292 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:10.129293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27379ec-cce3-4a48-a199-308d632ff292 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:10.134386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89b662-dba6-483a-8739-85720e236926 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:10.135029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89b662-dba6-483a-8739-85720e236926 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:10.135342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89b662-dba6-483a-8739-85720e236926 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:10.135632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89b662-dba6-483a-8739-85720e236926 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:10.136537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89b662-dba6-483a-8739-85720e236926 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:10.138163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89b662-dba6-483a-8739-85720e236926 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:10.207667 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2869/5687] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:21:10 2022] POST /identity/v3/roles => generated 234 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:10.214882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51f222-91ff-4cc9-a132-0def73fb5624 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:10.230969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89b662-dba6-483a-8739-85720e236926 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:10.242285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ee89b662-dba6-483a-8739-85720e236926 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:10.243885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51f222-91ff-4cc9-a132-0def73fb5624 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:10.264661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bfad9-4b66-4247-aa75-0a027c641c61 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:10.267879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bfad9-4b66-4247-aa75-0a027c641c61 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:10.267879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bfad9-4b66-4247-aa75-0a027c641c61 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:10.270376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bfad9-4b66-4247-aa75-0a027c641c61 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:10.272981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bfad9-4b66-4247-aa75-0a027c641c61 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:10.280233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bfad9-4b66-4247-aa75-0a027c641c61 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:10.333207 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2819/5688] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:21:10 2022] POST /identity/v3/users => generated 442 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:21:10.334753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bfad9-4b66-4247-aa75-0a027c641c61 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:10.350597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bfad9-4b66-4247-aa75-0a027c641c61 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:10.357172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed725619-9228-4e63-a31b-6cfafbb6511e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:10.358211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725619-9228-4e63-a31b-6cfafbb6511e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:10.358716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725619-9228-4e63-a31b-6cfafbb6511e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:10.359231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725619-9228-4e63-a31b-6cfafbb6511e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:10.361139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed725619-9228-4e63-a31b-6cfafbb6511e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:10.363054 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-ed725619-9228-4e63-a31b-6cfafbb6511e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:10.363054 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:21:10.363054 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:21:10.365089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed725619-9228-4e63-a31b-6cfafbb6511e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:10.395701 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2820/5689] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:21:10 2022] POST /identity/v3/roles => generated 270 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:21:10.397286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed725619-9228-4e63-a31b-6cfafbb6511e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:10.412085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed725619-9228-4e63-a31b-6cfafbb6511e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:10.419098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e02954-9c3a-4caf-b4b8-dafe56c5952f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:10.420166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e02954-9c3a-4caf-b4b8-dafe56c5952f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:10.420671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e02954-9c3a-4caf-b4b8-dafe56c5952f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:10.421182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e02954-9c3a-4caf-b4b8-dafe56c5952f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/projects/b7d1798a587e4d4084d02f2cc536268e/users/0eaf24e2b09e406ebde3b74b77175f05/roles/dfbd0aee583b454c896c9ef3425cf42e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:10.452040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89b662-dba6-483a-8739-85720e236926 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:10.454857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e02954-9c3a-4caf-b4b8-dafe56c5952f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b7d1798a587e4d4084d02f2cc536268e, user_id=0eaf24e2b09e406ebde3b74b77175f05, role_id=dfbd0aee583b454c896c9ef3425cf42e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:10.462359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e02954-9c3a-4caf-b4b8-dafe56c5952f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:10.467673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:10.468073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd3586-b958-4ee4-b023-789ff718f66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:10.468773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd3586-b958-4ee4-b023-789ff718f66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:10.469270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd3586-b958-4ee4-b023-789ff718f66a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:10.469669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd3586-b958-4ee4-b023-789ff718f66a admin admin] PATH_INFO: `/v3/projects/9538f5570ad74876bf00d20278d6478a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:10.470937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd3586-b958-4ee4-b023-789ff718f66a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9538f5570ad74876bf00d20278d6478a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:10.473185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd3586-b958-4ee4-b023-789ff718f66a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:10.476308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:10.492759 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2821/5690] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:10 2022] PUT /identity/v3/projects/b7d1798a587e4d4084d02f2cc536268e/users/0eaf24e2b09e406ebde3b74b77175f05/roles/dfbd0aee583b454c896c9ef3425cf42e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:10.502217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e02954-9c3a-4caf-b4b8-dafe56c5952f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:10.586255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a8cd3586-b958-4ee4-b023-789ff718f66a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9538f5570ad74876bf00d20278d6478a', 'request_id': 'req-a8cd3586-b958-4ee4-b023-789ff718f66a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:10.593491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a8cd3586-b958-4ee4-b023-789ff718f66a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9538f5570ad74876bf00d20278d6478a', 'request_id': 'req-a8cd3586-b958-4ee4-b023-789ff718f66a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:10.613362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a8cd3586-b958-4ee4-b023-789ff718f66a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9538f5570ad74876bf00d20278d6478a', 'request_id': 'req-a8cd3586-b958-4ee4-b023-789ff718f66a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:10.622886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e02954-9c3a-4caf-b4b8-dafe56c5952f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:10.636999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a8cd3586-b958-4ee4-b023-789ff718f66a admin admin] The token cache is being invalidate because project 9538f5570ad74876bf00d20278d6478a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:10.637319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a8cd3586-b958-4ee4-b023-789ff718f66a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:10.638354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a8cd3586-b958-4ee4-b023-789ff718f66a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:10.640452 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2870/5691] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:10 2022] DELETE /identity/v3/projects/9538f5570ad74876bf00d20278d6478a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:10.644760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd3586-b958-4ee4-b023-789ff718f66a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:10.646498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a8cd3586-b958-4ee4-b023-789ff718f66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:10.728118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54124d2a-d360-496d-a364-8f39346d7fc8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:10.731419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54124d2a-d360-496d-a364-8f39346d7fc8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:10.731944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54124d2a-d360-496d-a364-8f39346d7fc8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:10.732319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54124d2a-d360-496d-a364-8f39346d7fc8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:10.733431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54124d2a-d360-496d-a364-8f39346d7fc8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Adding query filter params (scope.project.id=b7d1798a587e4d4084d02f2cc536268e, user.id=0eaf24e2b09e406ebde3b74b77175f05) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:21:10.733924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54124d2a-d360-496d-a364-8f39346d7fc8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:10.737031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54124d2a-d360-496d-a364-8f39346d7fc8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:10.799959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd3586-b958-4ee4-b023-789ff718f66a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:10.815021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d220268-929d-4cb3-806c-306dc93458e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:10.815734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d220268-929d-4cb3-806c-306dc93458e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:10.816019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d220268-929d-4cb3-806c-306dc93458e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:10.816375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d220268-929d-4cb3-806c-306dc93458e0 admin admin] PATH_INFO: `/v3/users/665a5ff0010f4230827a7b54a4c43f6d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:10.817951 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2822/5692] 10.222.0.17 () {58 vars in 1356 bytes} [Sat Jul 30 21:21:10 2022] GET /identity/v3/role_assignments?scope.project.id=b7d1798a587e4d4084d02f2cc536268e&user.id=0eaf24e2b09e406ebde3b74b77175f05&effective => generated 228 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:10.819227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54124d2a-d360-496d-a364-8f39346d7fc8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:10.819482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d220268-929d-4cb3-806c-306dc93458e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=665a5ff0010f4230827a7b54a4c43f6d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:10.821159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-54124d2a-d360-496d-a364-8f39346d7fc8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:10.821434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d220268-929d-4cb3-806c-306dc93458e0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:10.843075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54124d2a-d360-496d-a364-8f39346d7fc8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:10.850348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445e18b-3afb-446d-922f-7d9b9799317d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:10.851101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445e18b-3afb-446d-922f-7d9b9799317d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:10.851480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445e18b-3afb-446d-922f-7d9b9799317d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:10.851770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445e18b-3afb-446d-922f-7d9b9799317d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/projects/b7d1798a587e4d4084d02f2cc536268e/users/0eaf24e2b09e406ebde3b74b77175f05/roles/dfbd0aee583b454c896c9ef3425cf42e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:10.855061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445e18b-3afb-446d-922f-7d9b9799317d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b7d1798a587e4d4084d02f2cc536268e, user_id=0eaf24e2b09e406ebde3b74b77175f05, role_id=dfbd0aee583b454c896c9ef3425cf42e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:10.860308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445e18b-3afb-446d-922f-7d9b9799317d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:10.869848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2445e18b-3afb-446d-922f-7d9b9799317d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invalidating the token cache because role dfbd0aee583b454c896c9ef3425cf42e was removed from user 0eaf24e2b09e406ebde3b74b77175f05 on project b7d1798a587e4d4084d02f2cc536268e. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:10.870074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2445e18b-3afb-446d-922f-7d9b9799317d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:10.871560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2445e18b-3afb-446d-922f-7d9b9799317d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:10.900433 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2823/5693] 10.222.0.17 () {58 vars in 1467 bytes} [Sat Jul 30 21:21:10 2022] DELETE /identity/v3/projects/b7d1798a587e4d4084d02f2cc536268e/users/0eaf24e2b09e406ebde3b74b77175f05/roles/dfbd0aee583b454c896c9ef3425cf42e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:10.901237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445e18b-3afb-446d-922f-7d9b9799317d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:10.919699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2445e18b-3afb-446d-922f-7d9b9799317d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:10.972988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d220268-929d-4cb3-806c-306dc93458e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665a5ff0010f4230827a7b54a4c43f6d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:11.003980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d220268-929d-4cb3-806c-306dc93458e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665a5ff0010f4230827a7b54a4c43f6d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:11.010651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d220268-929d-4cb3-806c-306dc93458e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665a5ff0010f4230827a7b54a4c43f6d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:11.024852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d220268-929d-4cb3-806c-306dc93458e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665a5ff0010f4230827a7b54a4c43f6d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:11.025668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d220268-929d-4cb3-806c-306dc93458e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665a5ff0010f4230827a7b54a4c43f6d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:11.033610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=1,keystone:SELECT=98,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:11.053506 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2871/5694] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:10 2022] DELETE /identity/v3/users/665a5ff0010f4230827a7b54a4c43f6d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:11.067519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b97000-47fe-4885-998a-d2dc40655133 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:11.068077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b97000-47fe-4885-998a-d2dc40655133 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:11.068365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b97000-47fe-4885-998a-d2dc40655133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:11.074871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445e18b-3afb-446d-922f-7d9b9799317d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:11.107920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-42b97000-47fe-4885-998a-d2dc40655133 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:11.112598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-42b97000-47fe-4885-998a-d2dc40655133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:11.121224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:11.164055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43927e6f-41e4-4fdd-8f3a-9d0f52232407 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:11.165126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43927e6f-41e4-4fdd-8f3a-9d0f52232407 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:11.165467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43927e6f-41e4-4fdd-8f3a-9d0f52232407 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:11.166276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43927e6f-41e4-4fdd-8f3a-9d0f52232407 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/dfbd0aee583b454c896c9ef3425cf42e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:11.168670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43927e6f-41e4-4fdd-8f3a-9d0f52232407 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=dfbd0aee583b454c896c9ef3425cf42e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:11.178364 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-43927e6f-41e4-4fdd-8f3a-9d0f52232407 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:11.178364 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:21:11.178364 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:21:11.180186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43927e6f-41e4-4fdd-8f3a-9d0f52232407 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:11.242404 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2872/5695] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:21:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:21:11.247490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-43927e6f-41e4-4fdd-8f3a-9d0f52232407 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invalidating the token cache because role dfbd0aee583b454c896c9ef3425cf42e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:11.247834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-43927e6f-41e4-4fdd-8f3a-9d0f52232407 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:11.248996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-43927e6f-41e4-4fdd-8f3a-9d0f52232407 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:11.252269 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2824/5696] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:10 2022] DELETE /identity/v3/roles/dfbd0aee583b454c896c9ef3425cf42e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:11.260110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b97000-47fe-4885-998a-d2dc40655133 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:11.263218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-42b97000-47fe-4885-998a-d2dc40655133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:11.292894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43927e6f-41e4-4fdd-8f3a-9d0f52232407 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:11.294660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-43927e6f-41e4-4fdd-8f3a-9d0f52232407 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:11.295450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b97000-47fe-4885-998a-d2dc40655133 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:11.429624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b422ebc-b607-4b96-bbb7-063cc84da157 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:11.430641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43927e6f-41e4-4fdd-8f3a-9d0f52232407 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:11.430784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b422ebc-b607-4b96-bbb7-063cc84da157 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:11.431333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b422ebc-b607-4b96-bbb7-063cc84da157 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:11.432006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b422ebc-b607-4b96-bbb7-063cc84da157 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/projects/b7d1798a587e4d4084d02f2cc536268e/users/0eaf24e2b09e406ebde3b74b77175f05/roles/c347f51961024f78b3063a3f928b2ac0` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:11.438358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ecdad-c5ff-476d-8a00-7dc1f37e4940 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:11.439262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ecdad-c5ff-476d-8a00-7dc1f37e4940 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:11.439728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ecdad-c5ff-476d-8a00-7dc1f37e4940 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:11.440106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ecdad-c5ff-476d-8a00-7dc1f37e4940 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:11.444109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0e4ecdad-c5ff-476d-8a00-7dc1f37e4940 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:11.446105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b422ebc-b607-4b96-bbb7-063cc84da157 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b7d1798a587e4d4084d02f2cc536268e, user_id=0eaf24e2b09e406ebde3b74b77175f05, role_id=c347f51961024f78b3063a3f928b2ac0)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:11.449955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b422ebc-b607-4b96-bbb7-063cc84da157 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:11.475597 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2873/5697] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:11 2022] PUT /identity/v3/projects/b7d1798a587e4d4084d02f2cc536268e/users/0eaf24e2b09e406ebde3b74b77175f05/roles/c347f51961024f78b3063a3f928b2ac0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:11.481665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b422ebc-b607-4b96-bbb7-063cc84da157 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:11.484590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4b422ebc-b607-4b96-bbb7-063cc84da157 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:11.544184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:11.556865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ecdad-c5ff-476d-8a00-7dc1f37e4940 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:11.559959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ecdad-c5ff-476d-8a00-7dc1f37e4940 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:11.598953 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2825/5698] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:21:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 30 21:21:11.625774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b422ebc-b607-4b96-bbb7-063cc84da157 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:11.634639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac509ba-31b3-4ff0-8932-e02ecd1d55f3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:11.635385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac509ba-31b3-4ff0-8932-e02ecd1d55f3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:11.635675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac509ba-31b3-4ff0-8932-e02ecd1d55f3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:11.636121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac509ba-31b3-4ff0-8932-e02ecd1d55f3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:11.638536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac509ba-31b3-4ff0-8932-e02ecd1d55f3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c347f51961024f78b3063a3f928b2ac0, implied_role_id=6003a5fcb1844a579ac718983cdbf2f6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:11.647195 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-cac509ba-31b3-4ff0-8932-e02ecd1d55f3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:11.647195 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:21:11.647195 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:21:11.650434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac509ba-31b3-4ff0-8932-e02ecd1d55f3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:11.729350 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2874/5699] 10.222.0.17 () {60 vars in 1363 bytes} [Sat Jul 30 21:21:11 2022] PUT /identity/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6 => generated 520 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:11.730921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ecdad-c5ff-476d-8a00-7dc1f37e4940 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:11.749226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ecdad-c5ff-476d-8a00-7dc1f37e4940 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:11.959510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3227a9f-303f-4faa-b324-27028998c85b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:11.960254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3227a9f-303f-4faa-b324-27028998c85b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:11.960513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3227a9f-303f-4faa-b324-27028998c85b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:11.960802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3227a9f-303f-4faa-b324-27028998c85b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:11.964911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3227a9f-303f-4faa-b324-27028998c85b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Adding query filter params (scope.project.id=b7d1798a587e4d4084d02f2cc536268e, user.id=0eaf24e2b09e406ebde3b74b77175f05) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:21:11.965269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3227a9f-303f-4faa-b324-27028998c85b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:11.970745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3227a9f-303f-4faa-b324-27028998c85b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:12.105637 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2826/5700] 10.222.0.17 () {58 vars in 1356 bytes} [Sat Jul 30 21:21:11 2022] GET /identity/v3/role_assignments?scope.project.id=b7d1798a587e4d4084d02f2cc536268e&user.id=0eaf24e2b09e406ebde3b74b77175f05&effective => generated 1061 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:12.109783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac509ba-31b3-4ff0-8932-e02ecd1d55f3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:12.123728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac509ba-31b3-4ff0-8932-e02ecd1d55f3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:12.134291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405b514-0b98-489f-8b31-d4be09dd1cea tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:12.134890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405b514-0b98-489f-8b31-d4be09dd1cea tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:12.135204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405b514-0b98-489f-8b31-d4be09dd1cea tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:12.135892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405b514-0b98-489f-8b31-d4be09dd1cea tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:12.142480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405b514-0b98-489f-8b31-d4be09dd1cea tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c347f51961024f78b3063a3f928b2ac0, implied_role_id=6003a5fcb1844a579ac718983cdbf2f6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:12.149183 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-d405b514-0b98-489f-8b31-d4be09dd1cea tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:12.149183 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:21:12.149183 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:21:12.149976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405b514-0b98-489f-8b31-d4be09dd1cea tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:12.178209 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2875/5701] 10.222.0.17 () {58 vars in 1347 bytes} [Sat Jul 30 21:21:12 2022] DELETE /identity/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:12.179489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3227a9f-303f-4faa-b324-27028998c85b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:12.193963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3227a9f-303f-4faa-b324-27028998c85b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:12.259536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405b514-0b98-489f-8b31-d4be09dd1cea tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:12.261420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d405b514-0b98-489f-8b31-d4be09dd1cea tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:12.303834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:12.333703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba441a-4e77-4ded-a70a-ac43bfed10a8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:12.334639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba441a-4e77-4ded-a70a-ac43bfed10a8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:12.334937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba441a-4e77-4ded-a70a-ac43bfed10a8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:12.335222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba441a-4e77-4ded-a70a-ac43bfed10a8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:12.336189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba441a-4e77-4ded-a70a-ac43bfed10a8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Adding query filter params (scope.project.id=b7d1798a587e4d4084d02f2cc536268e, user.id=0eaf24e2b09e406ebde3b74b77175f05) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:21:12.336518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba441a-4e77-4ded-a70a-ac43bfed10a8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:12.338518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba441a-4e77-4ded-a70a-ac43bfed10a8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:12.362270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405b514-0b98-489f-8b31-d4be09dd1cea tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:12.371437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f935d0-9ed8-4327-b07e-2d585563dd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:12.372556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f935d0-9ed8-4327-b07e-2d585563dd5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:12.373472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f935d0-9ed8-4327-b07e-2d585563dd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:12.373864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f935d0-9ed8-4327-b07e-2d585563dd5a admin admin] PATH_INFO: `/v3/projects/f4d0274186914200be712db2ff986325` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:12.375819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f935d0-9ed8-4327-b07e-2d585563dd5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d0274186914200be712db2ff986325)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:12.378662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f935d0-9ed8-4327-b07e-2d585563dd5a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:12.453331 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2827/5702] 10.222.0.17 () {58 vars in 1356 bytes} [Sat Jul 30 21:21:12 2022] GET /identity/v3/role_assignments?scope.project.id=b7d1798a587e4d4084d02f2cc536268e&user.id=0eaf24e2b09e406ebde3b74b77175f05&effective => generated 577 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:12.460884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a24277-37de-47c7-95e7-887fa337db2b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:12.463233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a24277-37de-47c7-95e7-887fa337db2b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:12.463428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a24277-37de-47c7-95e7-887fa337db2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:12.492895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d4f935d0-9ed8-4327-b07e-2d585563dd5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d0274186914200be712db2ff986325', 'request_id': 'req-d4f935d0-9ed8-4327-b07e-2d585563dd5a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:12.506018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d4f935d0-9ed8-4327-b07e-2d585563dd5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d0274186914200be712db2ff986325', 'request_id': 'req-d4f935d0-9ed8-4327-b07e-2d585563dd5a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:12.509152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-01a24277-37de-47c7-95e7-887fa337db2b None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:12.510174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-01a24277-37de-47c7-95e7-887fa337db2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:12.519798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:12.522827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d4f935d0-9ed8-4327-b07e-2d585563dd5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d0274186914200be712db2ff986325', 'request_id': 'req-d4f935d0-9ed8-4327-b07e-2d585563dd5a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:12.540331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d4f935d0-9ed8-4327-b07e-2d585563dd5a admin admin] The token cache is being invalidate because project f4d0274186914200be712db2ff986325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:12.540947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d4f935d0-9ed8-4327-b07e-2d585563dd5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:12.541789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d4f935d0-9ed8-4327-b07e-2d585563dd5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:12.550196 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2876/5703] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:12 2022] DELETE /identity/v3/projects/f4d0274186914200be712db2ff986325 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:12.551496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f935d0-9ed8-4327-b07e-2d585563dd5a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:12.553243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d4f935d0-9ed8-4327-b07e-2d585563dd5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:12.623689 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2828/5704] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:21:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:12.625651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490543a1-e97c-4dd9-b66b-31abf3d2cb4a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:12.625951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490543a1-e97c-4dd9-b66b-31abf3d2cb4a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:12.626272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490543a1-e97c-4dd9-b66b-31abf3d2cb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:12.652231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f935d0-9ed8-4327-b07e-2d585563dd5a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:12.661777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e089d4-2b34-4376-bf59-44deefe8a587 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:12.662482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e089d4-2b34-4376-bf59-44deefe8a587 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:12.662866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e089d4-2b34-4376-bf59-44deefe8a587 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:12.663158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e089d4-2b34-4376-bf59-44deefe8a587 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:12.664151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-490543a1-e97c-4dd9-b66b-31abf3d2cb4a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:12.665577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-490543a1-e97c-4dd9-b66b-31abf3d2cb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:12.665707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e089d4-2b34-4376-bf59-44deefe8a587 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c347f51961024f78b3063a3f928b2ac0, implied_role_id=6003a5fcb1844a579ac718983cdbf2f6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:12.667736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e089d4-2b34-4376-bf59-44deefe8a587 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:12.688356 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-23e089d4-2b34-4376-bf59-44deefe8a587 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] c347f51961024f78b3063a3f928b2ac0 does not imply 6003a5fcb1844a579ac718983cdbf2f6.: keystone.exception.ImpliedRoleNotFound: c347f51961024f78b3063a3f928b2ac0 does not imply 6003a5fcb1844a579ac718983cdbf2f6. Jul 30 21:21:12.688356 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:21:12.688356 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 30 21:21:12.688356 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = query.one() Jul 30 21:21:12.688356 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 30 21:21:12.688356 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._iter().one() Jul 30 21:21:12.688356 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 30 21:21:12.688356 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._only_one_row( Jul 30 21:21:12.688356 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 30 21:21:12.688356 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 30 21:21:12.688356 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 30 21:21:12.688356 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:21:12.688356 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:21:12.688356 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:21:12.688356 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:21:12.688356 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:21:12.689644 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:21:12.689644 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:21:12.689644 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:21:12.689644 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:21:12.689644 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:21:12.689644 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:21:12.689644 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:21:12.689644 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:21:12.689644 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:21:12.689644 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jul 30 21:21:12.689644 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jul 30 21:21:12.689644 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:21:12.689644 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:21:12.689644 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jul 30 21:21:12.689644 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jul 30 21:21:12.689644 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jul 30 21:21:12.690741 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 30 21:21:12.690741 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 30 21:21:12.690741 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 30 21:21:12.690741 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: c347f51961024f78b3063a3f928b2ac0 does not imply 6003a5fcb1844a579ac718983cdbf2f6. Jul 30 21:21:12.690741 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:21:12.693112 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2877/5705] 10.222.0.17 () {58 vars in 1347 bytes} [Sat Jul 30 21:21:12 2022] DELETE /identity/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6 => generated 137 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:21:12.696213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e089d4-2b34-4376-bf59-44deefe8a587 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:12.698822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-23e089d4-2b34-4376-bf59-44deefe8a587 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:12.757191 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2829/5706] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:12.758204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490543a1-e97c-4dd9-b66b-31abf3d2cb4a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:12.770569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490543a1-e97c-4dd9-b66b-31abf3d2cb4a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:12.777718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62aef3c-a29f-4b14-bd5f-8b24f2267cb5 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:12.778425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aef3c-a29f-4b14-bd5f-8b24f2267cb5 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:12.779460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aef3c-a29f-4b14-bd5f-8b24f2267cb5 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:12.779760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aef3c-a29f-4b14-bd5f-8b24f2267cb5 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/projects/b7d1798a587e4d4084d02f2cc536268e/users/0eaf24e2b09e406ebde3b74b77175f05/roles/c347f51961024f78b3063a3f928b2ac0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:12.782662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62aef3c-a29f-4b14-bd5f-8b24f2267cb5 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b7d1798a587e4d4084d02f2cc536268e, user_id=0eaf24e2b09e406ebde3b74b77175f05, role_id=c347f51961024f78b3063a3f928b2ac0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:12.786240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62aef3c-a29f-4b14-bd5f-8b24f2267cb5 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:12.793114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c62aef3c-a29f-4b14-bd5f-8b24f2267cb5 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invalidating the token cache because role c347f51961024f78b3063a3f928b2ac0 was removed from user 0eaf24e2b09e406ebde3b74b77175f05 on project b7d1798a587e4d4084d02f2cc536268e. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:12.793266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c62aef3c-a29f-4b14-bd5f-8b24f2267cb5 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:12.794405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c62aef3c-a29f-4b14-bd5f-8b24f2267cb5 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:12.819387 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2830/5707] 10.222.0.17 () {58 vars in 1467 bytes} [Sat Jul 30 21:21:12 2022] DELETE /identity/v3/projects/b7d1798a587e4d4084d02f2cc536268e/users/0eaf24e2b09e406ebde3b74b77175f05/roles/c347f51961024f78b3063a3f928b2ac0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:12.821015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37752e5d-d7ac-4786-85d7-7ccade759f02 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:12.821315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37752e5d-d7ac-4786-85d7-7ccade759f02 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:12.821832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37752e5d-d7ac-4786-85d7-7ccade759f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:12.839907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:12.861035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-37752e5d-d7ac-4786-85d7-7ccade759f02 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:12.862291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-37752e5d-d7ac-4786-85d7-7ccade759f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:12.897474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e089d4-2b34-4376-bf59-44deefe8a587 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:12.992604 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2831/5708] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:12.996189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37752e5d-d7ac-4786-85d7-7ccade759f02 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:12.996189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-37752e5d-d7ac-4786-85d7-7ccade759f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:13.047923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e10b5-714e-4ced-b391-419bd50e463c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:13.048698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e10b5-714e-4ced-b391-419bd50e463c service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:13.048992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e10b5-714e-4ced-b391-419bd50e463c service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:13.049274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e10b5-714e-4ced-b391-419bd50e463c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:13.056895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4e3e10b5-714e-4ced-b391-419bd50e463c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:13.086838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:13.136219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37752e5d-d7ac-4786-85d7-7ccade759f02 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:13.141803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa81273-7efe-45f4-9e63-36a202f7a4d2 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:13.142768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa81273-7efe-45f4-9e63-36a202f7a4d2 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:13.143311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa81273-7efe-45f4-9e63-36a202f7a4d2 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:13.143801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa81273-7efe-45f4-9e63-36a202f7a4d2 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:13.144923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa81273-7efe-45f4-9e63-36a202f7a4d2 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:13.147662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa81273-7efe-45f4-9e63-36a202f7a4d2 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:13.176901 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2832/5709] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:21:12 2022] POST /identity/v3/roles => generated 272 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:13.178859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa81273-7efe-45f4-9e63-36a202f7a4d2 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:13.194648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa81273-7efe-45f4-9e63-36a202f7a4d2 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:13.200439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e10b5-714e-4ced-b391-419bd50e463c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:13.202311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e10b5-714e-4ced-b391-419bd50e463c service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:13.210322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30398029-3238-4c8d-94c5-bda5b4c7257e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:13.211656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30398029-3238-4c8d-94c5-bda5b4c7257e admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:13.212183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30398029-3238-4c8d-94c5-bda5b4c7257e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:13.212686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30398029-3238-4c8d-94c5-bda5b4c7257e admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:13.213346 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2878/5710] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:21:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:21:13.213966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30398029-3238-4c8d-94c5-bda5b4c7257e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:21:13.214854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e10b5-714e-4ced-b391-419bd50e463c service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:13.215499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30398029-3238-4c8d-94c5-bda5b4c7257e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:13.217902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30398029-3238-4c8d-94c5-bda5b4c7257e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:13.236842 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2833/5711] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:13.241473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e10b5-714e-4ced-b391-419bd50e463c service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:13.247660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30398029-3238-4c8d-94c5-bda5b4c7257e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:13.249365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c83ff-7a0b-49db-878a-6463b1047c18 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:13.257059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c83ff-7a0b-49db-878a-6463b1047c18 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:13.262395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30398029-3238-4c8d-94c5-bda5b4c7257e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:13.272071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c83ff-7a0b-49db-878a-6463b1047c18 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:13.272586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c83ff-7a0b-49db-878a-6463b1047c18 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:13.273435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c83ff-7a0b-49db-878a-6463b1047c18 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Adding query filter params (domain_id=d53086ac837b4901862596b4c8094055) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:21:13.273708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c83ff-7a0b-49db-878a-6463b1047c18 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:13.280414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbafa9-5e50-4126-943a-0aec67e7ee6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:13.284057 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-cf4c83ff-7a0b-49db-878a-6463b1047c18 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:13.284057 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:21:13.284057 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:21:13.285473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbafa9-5e50-4126-943a-0aec67e7ee6d admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:13.285973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbafa9-5e50-4126-943a-0aec67e7ee6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:13.286093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c83ff-7a0b-49db-878a-6463b1047c18 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:13.287498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbafa9-5e50-4126-943a-0aec67e7ee6d admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:13.288437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbafa9-5e50-4126-943a-0aec67e7ee6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:13.296146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbafa9-5e50-4126-943a-0aec67e7ee6d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:13.296338 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2879/5712] 10.222.0.17 () {58 vars in 1207 bytes} [Sat Jul 30 21:21:13 2022] GET /identity/v3/roles?domain_id=d53086ac837b4901862596b4c8094055 => generated 409 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:13.320533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c83ff-7a0b-49db-878a-6463b1047c18 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:13.350192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c83ff-7a0b-49db-878a-6463b1047c18 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:13.364050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223ea62-818d-4973-84b3-a4587f8a9369 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:13.366001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223ea62-818d-4973-84b3-a4587f8a9369 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:13.366566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223ea62-818d-4973-84b3-a4587f8a9369 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:13.366866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223ea62-818d-4973-84b3-a4587f8a9369 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/f9d98e837655499e9623350d1dadb7c5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:13.371040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223ea62-818d-4973-84b3-a4587f8a9369 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=f9d98e837655499e9623350d1dadb7c5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:13.374667 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-c223ea62-818d-4973-84b3-a4587f8a9369 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:13.374667 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:21:13.374667 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:21:13.380547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223ea62-818d-4973-84b3-a4587f8a9369 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:13.399840 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2834/5713] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:21:13 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:13.404441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbafa9-5e50-4126-943a-0aec67e7ee6d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:13.500391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c223ea62-818d-4973-84b3-a4587f8a9369 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invalidating the token cache because role f9d98e837655499e9623350d1dadb7c5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:13.501107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c223ea62-818d-4973-84b3-a4587f8a9369 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:13.502511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c223ea62-818d-4973-84b3-a4587f8a9369 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:13.505761 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2880/5714] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:13 2022] DELETE /identity/v3/roles/f9d98e837655499e9623350d1dadb7c5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:13.509562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223ea62-818d-4973-84b3-a4587f8a9369 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:13.513074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c223ea62-818d-4973-84b3-a4587f8a9369 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:13.570843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbafa9-5e50-4126-943a-0aec67e7ee6d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:13.605921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:13.648433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223ea62-818d-4973-84b3-a4587f8a9369 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:13.690218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5b2fa-e890-4c9a-9918-b6224b78d039 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:13.691129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5b2fa-e890-4c9a-9918-b6224b78d039 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:13.691752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5b2fa-e890-4c9a-9918-b6224b78d039 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:13.692224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5b2fa-e890-4c9a-9918-b6224b78d039 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:13.693241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5b2fa-e890-4c9a-9918-b6224b78d039 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Adding query filter params (domain_id=d53086ac837b4901862596b4c8094055) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:21:13.693749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5b2fa-e890-4c9a-9918-b6224b78d039 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:13.695759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5b2fa-e890-4c9a-9918-b6224b78d039 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:13.706694 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2881/5715] 10.222.0.17 () {58 vars in 1207 bytes} [Sat Jul 30 21:21:13 2022] GET /identity/v3/roles?domain_id=d53086ac837b4901862596b4c8094055 => generated 148 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:13.711134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5b2fa-e890-4c9a-9918-b6224b78d039 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:13.712753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef79a4d-4827-4eb8-a8e7-496c0457f0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:13.713403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef79a4d-4827-4eb8-a8e7-496c0457f0bf admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:13.713685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef79a4d-4827-4eb8-a8e7-496c0457f0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:13.713959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef79a4d-4827-4eb8-a8e7-496c0457f0bf admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:13.714745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef79a4d-4827-4eb8-a8e7-496c0457f0bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:13.717710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef79a4d-4827-4eb8-a8e7-496c0457f0bf admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:13.728796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5b2fa-e890-4c9a-9918-b6224b78d039 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:13.737325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59d3b3-767e-41c4-903e-df620553fd1e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:13.738351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59d3b3-767e-41c4-903e-df620553fd1e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:13.739245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59d3b3-767e-41c4-903e-df620553fd1e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:13.739821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59d3b3-767e-41c4-903e-df620553fd1e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/f9d98e837655499e9623350d1dadb7c5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:13.758590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59d3b3-767e-41c4-903e-df620553fd1e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 21:21:13.766296 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-8b59d3b3-767e-41c4-903e-df620553fd1e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Could not find role: f9d98e837655499e9623350d1dadb7c5.: keystone.exception.RoleNotFound: Could not find role: f9d98e837655499e9623350d1dadb7c5. Jul 30 21:21:13.766296 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:21:13.766296 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:21:13.766296 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:21:13.766296 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:21:13.766296 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:21:13.766296 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:21:13.766296 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:21:13.766296 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:21:13.766296 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:21:13.766296 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:21:13.766296 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:21:13.766296 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Jul 30 21:21:13.766296 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Jul 30 21:21:13.767498 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 21:21:13.767498 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 21:21:13.767498 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 21:21:13.767498 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 21:21:13.767498 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:21:13.767498 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:21:13.767498 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:21:13.767498 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:21:13.767498 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:21:13.767498 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:21:13.767498 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:21:13.767498 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 21:21:13.767498 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:21:13.767498 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:21:13.767498 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:21:13.767498 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:21:13.768484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:21:13.768484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:21:13.768484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:21:13.768484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:21:13.768484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 30 21:21:13.768484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 30 21:21:13.768484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 30 21:21:13.768484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 30 21:21:13.768484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 30 21:21:13.768484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 21:21:13.768484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: f9d98e837655499e9623350d1dadb7c5. Jul 30 21:21:13.768484 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:21:13.769237 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2835/5716] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:21:13 2022] POST /identity/v3/users => generated 289 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:21:13.771694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef79a4d-4827-4eb8-a8e7-496c0457f0bf admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:13.772466 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2882/5717] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:13 2022] DELETE /identity/v3/roles/f9d98e837655499e9623350d1dadb7c5 => generated 110 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:21:13.775248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7ef79a4d-4827-4eb8-a8e7-496c0457f0bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:13.783003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59d3b3-767e-41c4-903e-df620553fd1e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:13.806589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59d3b3-767e-41c4-903e-df620553fd1e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:13.817608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035d7d0-94bd-4512-bb47-dda01a727868 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:13.819132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035d7d0-94bd-4512-bb47-dda01a727868 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:13.819721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035d7d0-94bd-4512-bb47-dda01a727868 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:13.820120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035d7d0-94bd-4512-bb47-dda01a727868 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/domains/d53086ac837b4901862596b4c8094055/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles/793609bec0f04b79a618305fad77bbed` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:13.825192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef79a4d-4827-4eb8-a8e7-496c0457f0bf admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:13.830538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035d7d0-94bd-4512-bb47-dda01a727868 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=d53086ac837b4901862596b4c8094055, group_id=15cfaa9d84a2464fb7f7cfdead3ccf69, role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:13.834212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035d7d0-94bd-4512-bb47-dda01a727868 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:13.850624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dec38-8b1a-4aaf-890a-9288390e0d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:13.851267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dec38-8b1a-4aaf-890a-9288390e0d93 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:13.851626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dec38-8b1a-4aaf-890a-9288390e0d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:13.851887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dec38-8b1a-4aaf-890a-9288390e0d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:13.852679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376dec38-8b1a-4aaf-890a-9288390e0d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:13.854317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376dec38-8b1a-4aaf-890a-9288390e0d93 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:13.859937 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2883/5718] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:13 2022] PUT /identity/v3/domains/d53086ac837b4901862596b4c8094055/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:13.863878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035d7d0-94bd-4512-bb47-dda01a727868 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:13.878159 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2836/5719] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:13 2022] GET /identity/v3/roles => generated 2321 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:13.885085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dec38-8b1a-4aaf-890a-9288390e0d93 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:13.910361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dec38-8b1a-4aaf-890a-9288390e0d93 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:13.951730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:14.037558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28554657-7295-4eab-b507-1e4395dbb3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:14.038237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28554657-7295-4eab-b507-1e4395dbb3df admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:14.038588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28554657-7295-4eab-b507-1e4395dbb3df admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:14.039045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28554657-7295-4eab-b507-1e4395dbb3df admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:14.039866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28554657-7295-4eab-b507-1e4395dbb3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:14.041844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28554657-7295-4eab-b507-1e4395dbb3df admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:14.049568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035d7d0-94bd-4512-bb47-dda01a727868 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:14.063152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245c8f1-227d-415c-804b-28d4c2eba3cd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:14.063940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245c8f1-227d-415c-804b-28d4c2eba3cd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:14.064240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245c8f1-227d-415c-804b-28d4c2eba3cd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:14.064535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245c8f1-227d-415c-804b-28d4c2eba3cd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/domains/d53086ac837b4901862596b4c8094055/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:14.070274 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2837/5720] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:13 2022] GET /identity/v3/roles => generated 2321 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:14.074841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245c8f1-227d-415c-804b-28d4c2eba3cd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=d53086ac837b4901862596b4c8094055, group_id=15cfaa9d84a2464fb7f7cfdead3ccf69)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:14.075916 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-9245c8f1-227d-415c-804b-28d4c2eba3cd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:14.075916 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:21:14.075916 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:21:14.076786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28554657-7295-4eab-b507-1e4395dbb3df admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:14.077884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245c8f1-227d-415c-804b-28d4c2eba3cd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:14.101391 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2884/5721] 10.222.0.17 () {58 vars in 1365 bytes} [Sat Jul 30 21:21:13 2022] GET /identity/v3/domains/d53086ac837b4901862596b4c8094055/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles => generated 409 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:14.101600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28554657-7295-4eab-b507-1e4395dbb3df admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:14.102918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245c8f1-227d-415c-804b-28d4c2eba3cd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:14.115506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bbdb6-9cf1-4708-94d7-61080cb5fb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:14.116210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bbdb6-9cf1-4708-94d7-61080cb5fb0a admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:14.116981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bbdb6-9cf1-4708-94d7-61080cb5fb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:14.116981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bbdb6-9cf1-4708-94d7-61080cb5fb0a admin admin] PATH_INFO: `/v3/projects/1f491880ac3e4b2f96c966fe114a7f80/users/c7210483238e44348a3b0bc69e09579f/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:14.120202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245c8f1-227d-415c-804b-28d4c2eba3cd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:14.137665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72091595-5ebf-4441-97ee-4f0497e919bb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:14.138566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72091595-5ebf-4441-97ee-4f0497e919bb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:14.138870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72091595-5ebf-4441-97ee-4f0497e919bb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:14.139156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72091595-5ebf-4441-97ee-4f0497e919bb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/domains/d53086ac837b4901862596b4c8094055/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles/793609bec0f04b79a618305fad77bbed` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:14.143539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72091595-5ebf-4441-97ee-4f0497e919bb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=d53086ac837b4901862596b4c8094055, group_id=15cfaa9d84a2464fb7f7cfdead3ccf69, role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:14.146822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72091595-5ebf-4441-97ee-4f0497e919bb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:14.155802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bbdb6-9cf1-4708-94d7-61080cb5fb0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f491880ac3e4b2f96c966fe114a7f80, user_id=c7210483238e44348a3b0bc69e09579f, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:14.158655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bbdb6-9cf1-4708-94d7-61080cb5fb0a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:14.163635 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2885/5722] 10.222.0.17 () {58 vars in 1465 bytes} [Sat Jul 30 21:21:14 2022] HEAD /identity/v3/domains/d53086ac837b4901862596b4c8094055/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:14.167494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72091595-5ebf-4441-97ee-4f0497e919bb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:14.184811 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2838/5723] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:14 2022] PUT /identity/v3/projects/1f491880ac3e4b2f96c966fe114a7f80/users/c7210483238e44348a3b0bc69e09579f/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:14.198312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a4d68-b65a-4782-b8d6-070e8773e49f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:14.199336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a4d68-b65a-4782-b8d6-070e8773e49f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:14.199873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a4d68-b65a-4782-b8d6-070e8773e49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:14.200334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72091595-5ebf-4441-97ee-4f0497e919bb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:14.264346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f01a4d68-b65a-4782-b8d6-070e8773e49f None None] MFA Rules not processed for user `c7210483238e44348a3b0bc69e09579f`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:14.266028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f01a4d68-b65a-4782-b8d6-070e8773e49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:14.328161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d0895-4cc0-4690-9c33-7242a547d133 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:14.329993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d0895-4cc0-4690-9c33-7242a547d133 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:14.330941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d0895-4cc0-4690-9c33-7242a547d133 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:14.331803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d0895-4cc0-4690-9c33-7242a547d133 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/domains/d53086ac837b4901862596b4c8094055/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles/793609bec0f04b79a618305fad77bbed` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:14.336737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d0895-4cc0-4690-9c33-7242a547d133 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=d53086ac837b4901862596b4c8094055, group_id=15cfaa9d84a2464fb7f7cfdead3ccf69, role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:14.345902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d0895-4cc0-4690-9c33-7242a547d133 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:14.362884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3d1d0895-4cc0-4690-9c33-7242a547d133 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invalidating the token cache because role 793609bec0f04b79a618305fad77bbed was removed from group 15cfaa9d84a2464fb7f7cfdead3ccf69 on domain d53086ac837b4901862596b4c8094055. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:14.363313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3d1d0895-4cc0-4690-9c33-7242a547d133 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:14.364766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3d1d0895-4cc0-4690-9c33-7242a547d133 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:14.391537 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2886/5724] 10.222.0.17 () {58 vars in 1467 bytes} [Sat Jul 30 21:21:14 2022] DELETE /identity/v3/domains/d53086ac837b4901862596b4c8094055/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:14.397330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d0895-4cc0-4690-9c33-7242a547d133 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:14.399923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3d1d0895-4cc0-4690-9c33-7242a547d133 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:14.430999 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2839/5725] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:14.433422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:14.477738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a4d68-b65a-4782-b8d6-070e8773e49f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:14.479324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f01a4d68-b65a-4782-b8d6-070e8773e49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:14.506953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d0895-4cc0-4690-9c33-7242a547d133 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:14.512397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f98e7-8752-4ebe-94b2-7f60f09fe8c9 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:14.513728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f98e7-8752-4ebe-94b2-7f60f09fe8c9 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:14.514173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f98e7-8752-4ebe-94b2-7f60f09fe8c9 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:14.514809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f98e7-8752-4ebe-94b2-7f60f09fe8c9 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/projects/b7d1798a587e4d4084d02f2cc536268e/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles/793609bec0f04b79a618305fad77bbed` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:14.518469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f98e7-8752-4ebe-94b2-7f60f09fe8c9 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b7d1798a587e4d4084d02f2cc536268e, group_id=15cfaa9d84a2464fb7f7cfdead3ccf69, role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:14.522075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f98e7-8752-4ebe-94b2-7f60f09fe8c9 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:14.545936 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2887/5726] 10.222.0.17 () {60 vars in 1486 bytes} [Sat Jul 30 21:21:14 2022] PUT /identity/v3/projects/b7d1798a587e4d4084d02f2cc536268e/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:21:14.554179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f98e7-8752-4ebe-94b2-7f60f09fe8c9 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:14.604260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a4d68-b65a-4782-b8d6-070e8773e49f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:14.689057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:14.699662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f98e7-8752-4ebe-94b2-7f60f09fe8c9 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:14.708416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a0b5a-96bb-409a-a317-da789ae4db8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:14.709130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a0b5a-96bb-409a-a317-da789ae4db8d service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:14.709422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a0b5a-96bb-409a-a317-da789ae4db8d service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:14.709810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a0b5a-96bb-409a-a317-da789ae4db8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:14.711617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec9f7d-eb87-4c19-a644-7e1df74dd1a6 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:14.712710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec9f7d-eb87-4c19-a644-7e1df74dd1a6 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:14.713215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec9f7d-eb87-4c19-a644-7e1df74dd1a6 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:14.723322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec9f7d-eb87-4c19-a644-7e1df74dd1a6 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/projects/b7d1798a587e4d4084d02f2cc536268e/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:14.731853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec9f7d-eb87-4c19-a644-7e1df74dd1a6 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:list_grants(project_id=b7d1798a587e4d4084d02f2cc536268e, group_id=15cfaa9d84a2464fb7f7cfdead3ccf69)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:14.735268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec9f7d-eb87-4c19-a644-7e1df74dd1a6 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:14.765637 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2888/5727] 10.222.0.17 () {58 vars in 1368 bytes} [Sat Jul 30 21:21:14 2022] GET /identity/v3/projects/b7d1798a587e4d4084d02f2cc536268e/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles => generated 410 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:14.766864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec9f7d-eb87-4c19-a644-7e1df74dd1a6 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:14.790028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec9f7d-eb87-4c19-a644-7e1df74dd1a6 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:14.807191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3dfd1-3133-4f82-9d99-18b26778448e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:14.808420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3dfd1-3133-4f82-9d99-18b26778448e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:14.809037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3dfd1-3133-4f82-9d99-18b26778448e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:14.809478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3dfd1-3133-4f82-9d99-18b26778448e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/users/0eaf24e2b09e406ebde3b74b77175f05` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:14.812414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3dfd1-3133-4f82-9d99-18b26778448e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=15cfaa9d84a2464fb7f7cfdead3ccf69, user_id=0eaf24e2b09e406ebde3b74b77175f05)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:14.816340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3dfd1-3133-4f82-9d99-18b26778448e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:14.834354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a0b5a-96bb-409a-a317-da789ae4db8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:14.835875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a0b5a-96bb-409a-a317-da789ae4db8d service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:14.853346 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2840/5728] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:21:14.864822 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2889/5729] 10.222.0.17 () {60 vars in 1360 bytes} [Sat Jul 30 21:21:14 2022] PUT /identity/v3/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/users/0eaf24e2b09e406ebde3b74b77175f05 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:14.869202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b6099-6d10-4fe2-b7b4-bb6d4c50ceb9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:14.871698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b6099-6d10-4fe2-b7b4-bb6d4c50ceb9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:14.872075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b6099-6d10-4fe2-b7b4-bb6d4c50ceb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:14.934909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-624b6099-6d10-4fe2-b7b4-bb6d4c50ceb9 None None] MFA Rules not processed for user `0eaf24e2b09e406ebde3b74b77175f05`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:14.935969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-624b6099-6d10-4fe2-b7b4-bb6d4c50ceb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:15.111415 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2841/5730] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:15.114113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3dfd1-3133-4f82-9d99-18b26778448e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:15.226482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3dfd1-3133-4f82-9d99-18b26778448e tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:15.260813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69a8a0-5020-4a7f-be19-0b4a47e4c8df tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:15.261347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69a8a0-5020-4a7f-be19-0b4a47e4c8df tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:15.262585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69a8a0-5020-4a7f-be19-0b4a47e4c8df tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:15.263395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69a8a0-5020-4a7f-be19-0b4a47e4c8df tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/projects/b7d1798a587e4d4084d02f2cc536268e/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles/793609bec0f04b79a618305fad77bbed` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:15.267089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69a8a0-5020-4a7f-be19-0b4a47e4c8df tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:check_grant(project_id=b7d1798a587e4d4084d02f2cc536268e, group_id=15cfaa9d84a2464fb7f7cfdead3ccf69, role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:15.270550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69a8a0-5020-4a7f-be19-0b4a47e4c8df tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:15.292545 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2890/5731] 10.222.0.17 () {58 vars in 1468 bytes} [Sat Jul 30 21:21:15 2022] HEAD /identity/v3/projects/b7d1798a587e4d4084d02f2cc536268e/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:21:15.302490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b6099-6d10-4fe2-b7b4-bb6d4c50ceb9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:15.368814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b6099-6d10-4fe2-b7b4-bb6d4c50ceb9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:15.383935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd55ce-063b-4284-844e-fad9fa93f6f5 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:15.384662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd55ce-063b-4284-844e-fad9fa93f6f5 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:15.384936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd55ce-063b-4284-844e-fad9fa93f6f5 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:15.385211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd55ce-063b-4284-844e-fad9fa93f6f5 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/projects/b7d1798a587e4d4084d02f2cc536268e/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles/793609bec0f04b79a618305fad77bbed` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:15.389404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd55ce-063b-4284-844e-fad9fa93f6f5 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b7d1798a587e4d4084d02f2cc536268e, group_id=15cfaa9d84a2464fb7f7cfdead3ccf69, role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:15.393183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd55ce-063b-4284-844e-fad9fa93f6f5 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:15.399521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dcfd55ce-063b-4284-844e-fad9fa93f6f5 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invalidating the token cache because role 793609bec0f04b79a618305fad77bbed was removed from group 15cfaa9d84a2464fb7f7cfdead3ccf69 on project b7d1798a587e4d4084d02f2cc536268e. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:15.399818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dcfd55ce-063b-4284-844e-fad9fa93f6f5 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:15.401179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dcfd55ce-063b-4284-844e-fad9fa93f6f5 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:15.423821 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2842/5732] 10.222.0.17 () {58 vars in 1470 bytes} [Sat Jul 30 21:21:15 2022] DELETE /identity/v3/projects/b7d1798a587e4d4084d02f2cc536268e/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:15.424707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69a8a0-5020-4a7f-be19-0b4a47e4c8df tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:15.427154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4b69a8a0-5020-4a7f-be19-0b4a47e4c8df tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:15.448560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69a8a0-5020-4a7f-be19-0b4a47e4c8df tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:15.477468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:15.539009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058a4f3-f47c-4eac-b3b7-37a347d8aba0 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:15.539985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058a4f3-f47c-4eac-b3b7-37a347d8aba0 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:15.540339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058a4f3-f47c-4eac-b3b7-37a347d8aba0 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:15.540804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058a4f3-f47c-4eac-b3b7-37a347d8aba0 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/users/0eaf24e2b09e406ebde3b74b77175f05` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:15.542834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058a4f3-f47c-4eac-b3b7-37a347d8aba0 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=15cfaa9d84a2464fb7f7cfdead3ccf69, user_id=0eaf24e2b09e406ebde3b74b77175f05)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:15.545491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058a4f3-f47c-4eac-b3b7-37a347d8aba0 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:15.557818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9058a4f3-f47c-4eac-b3b7-37a347d8aba0 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0eaf24e2b09e406ebde3b74b77175f05'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:15.586936 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2891/5733] 10.222.0.17 () {58 vars in 1344 bytes} [Sat Jul 30 21:21:15 2022] DELETE /identity/v3/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/users/0eaf24e2b09e406ebde3b74b77175f05 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:21:15.593194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd55ce-063b-4284-844e-fad9fa93f6f5 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:15.594087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058a4f3-f47c-4eac-b3b7-37a347d8aba0 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:15.597141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9058a4f3-f47c-4eac-b3b7-37a347d8aba0 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:15.626130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd55ce-063b-4284-844e-fad9fa93f6f5 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:15.676310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:15.709561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058a4f3-f47c-4eac-b3b7-37a347d8aba0 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:15.716852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5a839-6dbd-47a7-962f-991c3098de5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:15.718516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5a839-6dbd-47a7-962f-991c3098de5e service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:15.719257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5a839-6dbd-47a7-962f-991c3098de5e service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:15.722617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5a839-6dbd-47a7-962f-991c3098de5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:15.725064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-74d5a839-6dbd-47a7-962f-991c3098de5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:15.727520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f697bbe-a5da-47be-a93a-ec39476f6933 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:15.728384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f697bbe-a5da-47be-a93a-ec39476f6933 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:15.728671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f697bbe-a5da-47be-a93a-ec39476f6933 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:15.728947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f697bbe-a5da-47be-a93a-ec39476f6933 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/system/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles/793609bec0f04b79a618305fad77bbed` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:15.736618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f697bbe-a5da-47be-a93a-ec39476f6933 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=15cfaa9d84a2464fb7f7cfdead3ccf69, role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:15.737757 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-5f697bbe-a5da-47be-a93a-ec39476f6933 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:15.737757 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:21:15.737757 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:21:15.738863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f697bbe-a5da-47be-a93a-ec39476f6933 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:15.754992 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2843/5734] 10.222.0.17 () {60 vars in 1381 bytes} [Sat Jul 30 21:21:15 2022] PUT /identity/v3/system/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:15.759377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f697bbe-a5da-47be-a93a-ec39476f6933 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:15.762482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5a839-6dbd-47a7-962f-991c3098de5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:15.764372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5a839-6dbd-47a7-962f-991c3098de5e service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:15.781506 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2892/5735] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:21:15.784426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f697bbe-a5da-47be-a93a-ec39476f6933 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:15.789908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cf5ff-e22c-4586-a513-2a5caf1b8fea tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:15.790583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cf5ff-e22c-4586-a513-2a5caf1b8fea tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:15.791027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cf5ff-e22c-4586-a513-2a5caf1b8fea tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:15.791436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cf5ff-e22c-4586-a513-2a5caf1b8fea tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/system/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:15.792915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cf5ff-e22c-4586-a513-2a5caf1b8fea tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=15cfaa9d84a2464fb7f7cfdead3ccf69)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:15.794062 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-5f5cf5ff-e22c-4586-a513-2a5caf1b8fea tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:15.794062 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:21:15.794062 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:21:15.794972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cf5ff-e22c-4586-a513-2a5caf1b8fea tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:15.812302 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2844/5736] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:21:15 2022] GET /identity/v3/system/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles => generated 375 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:15.816978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5a839-6dbd-47a7-962f-991c3098de5e service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:15.833064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5a839-6dbd-47a7-962f-991c3098de5e service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:15.839255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31def7-cf62-44c7-a3ed-c4464d5b7910 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:15.840170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31def7-cf62-44c7-a3ed-c4464d5b7910 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:15.840466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31def7-cf62-44c7-a3ed-c4464d5b7910 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:15.840754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31def7-cf62-44c7-a3ed-c4464d5b7910 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/system/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles/793609bec0f04b79a618305fad77bbed` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:15.844135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31def7-cf62-44c7-a3ed-c4464d5b7910 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=15cfaa9d84a2464fb7f7cfdead3ccf69, role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:15.845190 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-9e31def7-cf62-44c7-a3ed-c4464d5b7910 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:15.845190 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:21:15.845190 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:21:15.847093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31def7-cf62-44c7-a3ed-c4464d5b7910 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:15.861839 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2893/5737] 10.222.0.17 () {58 vars in 1363 bytes} [Sat Jul 30 21:21:15 2022] HEAD /identity/v3/system/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:21:15.862158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cf5ff-e22c-4586-a513-2a5caf1b8fea tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:15.877419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cf5ff-e22c-4586-a513-2a5caf1b8fea tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:15.885442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6c909-cb40-42ee-82a2-25dd0eee0a3c tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:15.886666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6c909-cb40-42ee-82a2-25dd0eee0a3c tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:15.891582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6c909-cb40-42ee-82a2-25dd0eee0a3c tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:15.892109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6c909-cb40-42ee-82a2-25dd0eee0a3c tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/system/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles/793609bec0f04b79a618305fad77bbed` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:15.894360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6c909-cb40-42ee-82a2-25dd0eee0a3c tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=15cfaa9d84a2464fb7f7cfdead3ccf69, role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:15.895555 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-7be6c909-cb40-42ee-82a2-25dd0eee0a3c tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:15.895555 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:21:15.895555 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:21:15.897645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6c909-cb40-42ee-82a2-25dd0eee0a3c tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:15.912706 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2845/5738] 10.222.0.17 () {58 vars in 1365 bytes} [Sat Jul 30 21:21:15 2022] DELETE /identity/v3/system/groups/15cfaa9d84a2464fb7f7cfdead3ccf69/roles/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:15.919371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31def7-cf62-44c7-a3ed-c4464d5b7910 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:15.940453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31def7-cf62-44c7-a3ed-c4464d5b7910 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:15.949937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0a515-43da-46a8-8d58-9457120802bc tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:15.950702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0a515-43da-46a8-8d58-9457120802bc tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:15.965021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0a515-43da-46a8-8d58-9457120802bc tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:15.965324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0a515-43da-46a8-8d58-9457120802bc tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/domains/d53086ac837b4901862596b4c8094055/users/0eaf24e2b09e406ebde3b74b77175f05/roles/793609bec0f04b79a618305fad77bbed` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:15.970277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0a515-43da-46a8-8d58-9457120802bc tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=d53086ac837b4901862596b4c8094055, user_id=0eaf24e2b09e406ebde3b74b77175f05, role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:15.973119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0a515-43da-46a8-8d58-9457120802bc tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:15.994415 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2894/5739] 10.222.0.17 () {60 vars in 1480 bytes} [Sat Jul 30 21:21:15 2022] PUT /identity/v3/domains/d53086ac837b4901862596b4c8094055/users/0eaf24e2b09e406ebde3b74b77175f05/roles/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:15.996529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6c909-cb40-42ee-82a2-25dd0eee0a3c tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:16.013942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6c909-cb40-42ee-82a2-25dd0eee0a3c tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:16.147801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08bd41-92de-4cfc-971b-407cfdaa7218 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:16.149465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08bd41-92de-4cfc-971b-407cfdaa7218 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:16.150121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08bd41-92de-4cfc-971b-407cfdaa7218 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:16.150635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08bd41-92de-4cfc-971b-407cfdaa7218 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/domains/d53086ac837b4901862596b4c8094055/users/0eaf24e2b09e406ebde3b74b77175f05/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:16.153945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08bd41-92de-4cfc-971b-407cfdaa7218 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=d53086ac837b4901862596b4c8094055, user_id=0eaf24e2b09e406ebde3b74b77175f05)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:16.158362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08bd41-92de-4cfc-971b-407cfdaa7218 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:16.187340 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2846/5740] 10.222.0.17 () {58 vars in 1362 bytes} [Sat Jul 30 21:21:15 2022] GET /identity/v3/domains/d53086ac837b4901862596b4c8094055/users/0eaf24e2b09e406ebde3b74b77175f05/roles => generated 408 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:21:16.191577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0a515-43da-46a8-8d58-9457120802bc tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:16.205680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0a515-43da-46a8-8d58-9457120802bc tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:16.214931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d960085-c7a9-4950-b6d4-0304a392d2ab tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:16.215983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d960085-c7a9-4950-b6d4-0304a392d2ab tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:16.216342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d960085-c7a9-4950-b6d4-0304a392d2ab tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:16.217833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d960085-c7a9-4950-b6d4-0304a392d2ab tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/domains/d53086ac837b4901862596b4c8094055/users/0eaf24e2b09e406ebde3b74b77175f05/roles/793609bec0f04b79a618305fad77bbed` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:16.220899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d960085-c7a9-4950-b6d4-0304a392d2ab tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=d53086ac837b4901862596b4c8094055, user_id=0eaf24e2b09e406ebde3b74b77175f05, role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:16.225317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d960085-c7a9-4950-b6d4-0304a392d2ab tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:16.250943 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2895/5741] 10.222.0.17 () {58 vars in 1462 bytes} [Sat Jul 30 21:21:16 2022] HEAD /identity/v3/domains/d53086ac837b4901862596b4c8094055/users/0eaf24e2b09e406ebde3b74b77175f05/roles/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:16.258567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08bd41-92de-4cfc-971b-407cfdaa7218 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:16.273099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08bd41-92de-4cfc-971b-407cfdaa7218 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:16.279674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2690502-37eb-47f9-bf7a-753429679968 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:16.280643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2690502-37eb-47f9-bf7a-753429679968 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:16.281732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2690502-37eb-47f9-bf7a-753429679968 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:16.282253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2690502-37eb-47f9-bf7a-753429679968 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/domains/d53086ac837b4901862596b4c8094055/users/0eaf24e2b09e406ebde3b74b77175f05/roles/793609bec0f04b79a618305fad77bbed` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:16.285071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2690502-37eb-47f9-bf7a-753429679968 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=d53086ac837b4901862596b4c8094055, user_id=0eaf24e2b09e406ebde3b74b77175f05, role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:16.288905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2690502-37eb-47f9-bf7a-753429679968 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:16.295117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d2690502-37eb-47f9-bf7a-753429679968 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invalidating the token cache because role 793609bec0f04b79a618305fad77bbed was removed from user 0eaf24e2b09e406ebde3b74b77175f05 on domain d53086ac837b4901862596b4c8094055. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:16.295716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d2690502-37eb-47f9-bf7a-753429679968 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:16.298423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d2690502-37eb-47f9-bf7a-753429679968 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:16.325781 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2847/5742] 10.222.0.17 () {58 vars in 1464 bytes} [Sat Jul 30 21:21:16 2022] DELETE /identity/v3/domains/d53086ac837b4901862596b4c8094055/users/0eaf24e2b09e406ebde3b74b77175f05/roles/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:16.330894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d960085-c7a9-4950-b6d4-0304a392d2ab tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:16.332840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2d960085-c7a9-4950-b6d4-0304a392d2ab tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:16.352192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d960085-c7a9-4950-b6d4-0304a392d2ab tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:16.499156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa209a58-ddd3-4b86-8657-9f0743295341 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:16.499864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa209a58-ddd3-4b86-8657-9f0743295341 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:16.500729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa209a58-ddd3-4b86-8657-9f0743295341 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:16.501016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa209a58-ddd3-4b86-8657-9f0743295341 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/projects/b7d1798a587e4d4084d02f2cc536268e/users/0eaf24e2b09e406ebde3b74b77175f05/roles/793609bec0f04b79a618305fad77bbed` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:16.506604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa209a58-ddd3-4b86-8657-9f0743295341 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b7d1798a587e4d4084d02f2cc536268e, user_id=0eaf24e2b09e406ebde3b74b77175f05, role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:16.509676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa209a58-ddd3-4b86-8657-9f0743295341 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:16.538396 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2896/5743] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:16 2022] PUT /identity/v3/projects/b7d1798a587e4d4084d02f2cc536268e/users/0eaf24e2b09e406ebde3b74b77175f05/roles/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:16.539777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2690502-37eb-47f9-bf7a-753429679968 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:16.554618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2690502-37eb-47f9-bf7a-753429679968 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:16.637888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12934c8a-c125-499a-b044-763de40b513a tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:16.638885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12934c8a-c125-499a-b044-763de40b513a tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:16.639406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12934c8a-c125-499a-b044-763de40b513a tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:16.639869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12934c8a-c125-499a-b044-763de40b513a tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/projects/b7d1798a587e4d4084d02f2cc536268e/users/0eaf24e2b09e406ebde3b74b77175f05/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:16.642196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12934c8a-c125-499a-b044-763de40b513a tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:list_grants(project_id=b7d1798a587e4d4084d02f2cc536268e, user_id=0eaf24e2b09e406ebde3b74b77175f05)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:16.645735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12934c8a-c125-499a-b044-763de40b513a tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:16.663341 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2848/5744] 10.222.0.17 () {58 vars in 1365 bytes} [Sat Jul 30 21:21:16 2022] GET /identity/v3/projects/b7d1798a587e4d4084d02f2cc536268e/users/0eaf24e2b09e406ebde3b74b77175f05/roles => generated 409 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:16.664362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa209a58-ddd3-4b86-8657-9f0743295341 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:16.686299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa209a58-ddd3-4b86-8657-9f0743295341 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:16.704792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3994767-7aee-438a-985d-2c2c3eec4723 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:16.705818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3994767-7aee-438a-985d-2c2c3eec4723 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:16.706396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3994767-7aee-438a-985d-2c2c3eec4723 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:16.706835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3994767-7aee-438a-985d-2c2c3eec4723 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/projects/b7d1798a587e4d4084d02f2cc536268e/users/0eaf24e2b09e406ebde3b74b77175f05/roles/793609bec0f04b79a618305fad77bbed` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:16.710964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3994767-7aee-438a-985d-2c2c3eec4723 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:check_grant(project_id=b7d1798a587e4d4084d02f2cc536268e, user_id=0eaf24e2b09e406ebde3b74b77175f05, role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:16.714352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3994767-7aee-438a-985d-2c2c3eec4723 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:16.724637 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2897/5745] 10.222.0.17 () {58 vars in 1465 bytes} [Sat Jul 30 21:21:16 2022] HEAD /identity/v3/projects/b7d1798a587e4d4084d02f2cc536268e/users/0eaf24e2b09e406ebde3b74b77175f05/roles/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:21:16.728848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12934c8a-c125-499a-b044-763de40b513a tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:16.744948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12934c8a-c125-499a-b044-763de40b513a tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:16.752815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4b760-caff-456f-9a89-64810b59c401 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:16.756080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4b760-caff-456f-9a89-64810b59c401 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:16.756384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4b760-caff-456f-9a89-64810b59c401 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:16.756604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4b760-caff-456f-9a89-64810b59c401 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/projects/b7d1798a587e4d4084d02f2cc536268e/users/0eaf24e2b09e406ebde3b74b77175f05/roles/793609bec0f04b79a618305fad77bbed` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:16.764799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4b760-caff-456f-9a89-64810b59c401 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b7d1798a587e4d4084d02f2cc536268e, user_id=0eaf24e2b09e406ebde3b74b77175f05, role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:16.767546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4b760-caff-456f-9a89-64810b59c401 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:16.790573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b7a4b760-caff-456f-9a89-64810b59c401 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invalidating the token cache because role 793609bec0f04b79a618305fad77bbed was removed from user 0eaf24e2b09e406ebde3b74b77175f05 on project b7d1798a587e4d4084d02f2cc536268e. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:16.791510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b7a4b760-caff-456f-9a89-64810b59c401 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:16.793019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b7a4b760-caff-456f-9a89-64810b59c401 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:16.801172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:16.821966 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2849/5746] 10.222.0.17 () {58 vars in 1467 bytes} [Sat Jul 30 21:21:16 2022] DELETE /identity/v3/projects/b7d1798a587e4d4084d02f2cc536268e/users/0eaf24e2b09e406ebde3b74b77175f05/roles/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:16.827342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3994767-7aee-438a-985d-2c2c3eec4723 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:16.829229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b3994767-7aee-438a-985d-2c2c3eec4723 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:16.846189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:16.854992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3994767-7aee-438a-985d-2c2c3eec4723 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:17.035638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1ca24-7e79-4776-9186-e1388be010a3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:17.036344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1ca24-7e79-4776-9186-e1388be010a3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:17.036639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1ca24-7e79-4776-9186-e1388be010a3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:17.036922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1ca24-7e79-4776-9186-e1388be010a3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/system/users/0eaf24e2b09e406ebde3b74b77175f05/roles/793609bec0f04b79a618305fad77bbed` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:17.052455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1ca24-7e79-4776-9186-e1388be010a3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0eaf24e2b09e406ebde3b74b77175f05, role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:17.053522 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-01b1ca24-7e79-4776-9186-e1388be010a3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:17.053522 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:21:17.053522 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:21:17.064715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1ca24-7e79-4776-9186-e1388be010a3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:17.081609 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2898/5747] 10.222.0.17 () {60 vars in 1378 bytes} [Sat Jul 30 21:21:16 2022] PUT /identity/v3/system/users/0eaf24e2b09e406ebde3b74b77175f05/roles/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:17.085610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4b760-caff-456f-9a89-64810b59c401 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:17.106914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4b760-caff-456f-9a89-64810b59c401 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:17.117919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692afda-ec36-41cc-8e10-d52bb355c037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:17.118740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692afda-ec36-41cc-8e10-d52bb355c037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:17.119134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692afda-ec36-41cc-8e10-d52bb355c037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:17.119503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692afda-ec36-41cc-8e10-d52bb355c037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/system/users/0eaf24e2b09e406ebde3b74b77175f05/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:17.125503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692afda-ec36-41cc-8e10-d52bb355c037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=0eaf24e2b09e406ebde3b74b77175f05)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:17.126694 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-8692afda-ec36-41cc-8e10-d52bb355c037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:17.126694 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:21:17.126694 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:21:17.128722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692afda-ec36-41cc-8e10-d52bb355c037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:17.165021 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2850/5748] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Jul 30 21:21:17 2022] GET /identity/v3/system/users/0eaf24e2b09e406ebde3b74b77175f05/roles => generated 374 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:17.167130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1ca24-7e79-4776-9186-e1388be010a3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:17.181452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1ca24-7e79-4776-9186-e1388be010a3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:17.205389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dc4ef-5ea0-493d-9268-84421c7914a7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:17.206323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dc4ef-5ea0-493d-9268-84421c7914a7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:17.206550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dc4ef-5ea0-493d-9268-84421c7914a7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:17.206731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dc4ef-5ea0-493d-9268-84421c7914a7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/system/users/0eaf24e2b09e406ebde3b74b77175f05/roles/793609bec0f04b79a618305fad77bbed` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:17.220216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dc4ef-5ea0-493d-9268-84421c7914a7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=0eaf24e2b09e406ebde3b74b77175f05, role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:17.221294 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-965dc4ef-5ea0-493d-9268-84421c7914a7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:17.221294 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:21:17.221294 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:21:17.222213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dc4ef-5ea0-493d-9268-84421c7914a7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:17.242047 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2899/5749] 10.222.0.17 () {58 vars in 1360 bytes} [Sat Jul 30 21:21:17 2022] HEAD /identity/v3/system/users/0eaf24e2b09e406ebde3b74b77175f05/roles/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:17.246220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692afda-ec36-41cc-8e10-d52bb355c037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:17.261611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692afda-ec36-41cc-8e10-d52bb355c037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:17.275730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56f033-d7ad-4b11-88b8-f305fe37b92b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:17.276428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56f033-d7ad-4b11-88b8-f305fe37b92b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:17.276755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56f033-d7ad-4b11-88b8-f305fe37b92b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:17.276995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56f033-d7ad-4b11-88b8-f305fe37b92b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/system/users/0eaf24e2b09e406ebde3b74b77175f05/roles/793609bec0f04b79a618305fad77bbed` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:17.285460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56f033-d7ad-4b11-88b8-f305fe37b92b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=0eaf24e2b09e406ebde3b74b77175f05, role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:17.286379 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-be56f033-d7ad-4b11-88b8-f305fe37b92b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:17.286379 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:21:17.286379 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:21:17.287335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56f033-d7ad-4b11-88b8-f305fe37b92b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:17.305589 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2851/5750] 10.222.0.17 () {58 vars in 1362 bytes} [Sat Jul 30 21:21:17 2022] DELETE /identity/v3/system/users/0eaf24e2b09e406ebde3b74b77175f05/roles/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:17.310514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dc4ef-5ea0-493d-9268-84421c7914a7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:17.329500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dc4ef-5ea0-493d-9268-84421c7914a7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:17.342225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d64939-fe18-47e9-8d9c-a712b76b6368 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:17.342926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d64939-fe18-47e9-8d9c-a712b76b6368 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:17.343215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d64939-fe18-47e9-8d9c-a712b76b6368 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:17.343572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d64939-fe18-47e9-8d9c-a712b76b6368 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:17.346410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d64939-fe18-47e9-8d9c-a712b76b6368 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:17.347693 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-98d64939-fe18-47e9-8d9c-a712b76b6368 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:17.347693 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:21:17.347693 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:21:17.348992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d64939-fe18-47e9-8d9c-a712b76b6368 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:17.383172 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2900/5751] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:21:17 2022] POST /identity/v3/roles => generated 269 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:17.384463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56f033-d7ad-4b11-88b8-f305fe37b92b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:17.401752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56f033-d7ad-4b11-88b8-f305fe37b92b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:17.415056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be339e97-24a8-4be0-90d9-8a96ff580a1d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:17.416114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be339e97-24a8-4be0-90d9-8a96ff580a1d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:17.416663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be339e97-24a8-4be0-90d9-8a96ff580a1d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:17.417131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be339e97-24a8-4be0-90d9-8a96ff580a1d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:17.418066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be339e97-24a8-4be0-90d9-8a96ff580a1d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:17.420548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be339e97-24a8-4be0-90d9-8a96ff580a1d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:17.443799 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2852/5752] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:21:17 2022] POST /identity/v3/roles => generated 269 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:17.450041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d64939-fe18-47e9-8d9c-a712b76b6368 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:17.466219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d64939-fe18-47e9-8d9c-a712b76b6368 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:17.474982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757a6a9-ba0a-461f-a6f2-b618329f64ae tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:17.475487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757a6a9-ba0a-461f-a6f2-b618329f64ae tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:17.475841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757a6a9-ba0a-461f-a6f2-b618329f64ae tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:17.476244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757a6a9-ba0a-461f-a6f2-b618329f64ae tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/a0527dd826754997874bf3d9feb5e7de/implies/cc3ecddc78a146c38874eb71e1664eeb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:17.479263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757a6a9-ba0a-461f-a6f2-b618329f64ae tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=a0527dd826754997874bf3d9feb5e7de, implied_role_id=cc3ecddc78a146c38874eb71e1664eeb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:17.481049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757a6a9-ba0a-461f-a6f2-b618329f64ae tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:17.524812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be339e97-24a8-4be0-90d9-8a96ff580a1d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:17.525966 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2901/5753] 10.222.0.17 () {60 vars in 1363 bytes} [Sat Jul 30 21:21:17 2022] PUT /identity/v3/roles/a0527dd826754997874bf3d9feb5e7de/implies/cc3ecddc78a146c38874eb71e1664eeb => generated 529 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:17.537907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be339e97-24a8-4be0-90d9-8a96ff580a1d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:17.616570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdb661-67e2-4d9a-a85e-f967979bedec tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:17.618007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdb661-67e2-4d9a-a85e-f967979bedec tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:17.619204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdb661-67e2-4d9a-a85e-f967979bedec tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:17.619204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdb661-67e2-4d9a-a85e-f967979bedec tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:17.620195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdb661-67e2-4d9a-a85e-f967979bedec tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:17.622015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdb661-67e2-4d9a-a85e-f967979bedec tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:17.650449 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2853/5754] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:21:17 2022] POST /identity/v3/domains => generated 276 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:17.654686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757a6a9-ba0a-461f-a6f2-b618329f64ae tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:17.675604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757a6a9-ba0a-461f-a6f2-b618329f64ae tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:17.764436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85293088-cd7c-43b4-a360-066e35374109 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:17.766292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85293088-cd7c-43b4-a360-066e35374109 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:17.766792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85293088-cd7c-43b4-a360-066e35374109 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:17.767351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85293088-cd7c-43b4-a360-066e35374109 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:17.768333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85293088-cd7c-43b4-a360-066e35374109 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:17.770271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85293088-cd7c-43b4-a360-066e35374109 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:17.797009 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2902/5755] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:21:17 2022] POST /identity/v3/roles => generated 270 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:17.801090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdb661-67e2-4d9a-a85e-f967979bedec tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:17.825179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdb661-67e2-4d9a-a85e-f967979bedec tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:17.845885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71545355-513e-43a6-9972-5b2b707cc62d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:17.846777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71545355-513e-43a6-9972-5b2b707cc62d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:17.847184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71545355-513e-43a6-9972-5b2b707cc62d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:17.847821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71545355-513e-43a6-9972-5b2b707cc62d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/a0527dd826754997874bf3d9feb5e7de/implies/b7111f894e064e44a3c6d7d32755857b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:17.849790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71545355-513e-43a6-9972-5b2b707cc62d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=a0527dd826754997874bf3d9feb5e7de, implied_role_id=b7111f894e064e44a3c6d7d32755857b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:17.851853 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-71545355-513e-43a6-9972-5b2b707cc62d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:17.851853 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:21:17.851853 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:21:17.854386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71545355-513e-43a6-9972-5b2b707cc62d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:17.915227 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2854/5756] 10.222.0.17 () {60 vars in 1363 bytes} [Sat Jul 30 21:21:17 2022] PUT /identity/v3/roles/a0527dd826754997874bf3d9feb5e7de/implies/b7111f894e064e44a3c6d7d32755857b => generated 530 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:17.916773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85293088-cd7c-43b4-a360-066e35374109 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:17.944320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85293088-cd7c-43b4-a360-066e35374109 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:18.016558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:18.036670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d6dbc-eee3-4e71-9a2c-7c06f5ae56db tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:18.037596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d6dbc-eee3-4e71-9a2c-7c06f5ae56db tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:18.037895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d6dbc-eee3-4e71-9a2c-7c06f5ae56db tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:18.038313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d6dbc-eee3-4e71-9a2c-7c06f5ae56db tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/a0527dd826754997874bf3d9feb5e7de/implies/793609bec0f04b79a618305fad77bbed` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:18.040947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d6dbc-eee3-4e71-9a2c-7c06f5ae56db tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=a0527dd826754997874bf3d9feb5e7de, implied_role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:18.042818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d6dbc-eee3-4e71-9a2c-7c06f5ae56db tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:18.091461 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2903/5757] 10.222.0.17 () {60 vars in 1363 bytes} [Sat Jul 30 21:21:17 2022] PUT /identity/v3/roles/a0527dd826754997874bf3d9feb5e7de/implies/793609bec0f04b79a618305fad77bbed => generated 524 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:21:18.096413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71545355-513e-43a6-9972-5b2b707cc62d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:18.112481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71545355-513e-43a6-9972-5b2b707cc62d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:18.211475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c71c2-074e-4ca2-8fd5-82a4a64fc712 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:18.212387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c71c2-074e-4ca2-8fd5-82a4a64fc712 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:18.212478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c71c2-074e-4ca2-8fd5-82a4a64fc712 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:18.213324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c71c2-074e-4ca2-8fd5-82a4a64fc712 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/793609bec0f04b79a618305fad77bbed/implies/a0527dd826754997874bf3d9feb5e7de` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:18.215139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c71c2-074e-4ca2-8fd5-82a4a64fc712 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=793609bec0f04b79a618305fad77bbed, implied_role_id=a0527dd826754997874bf3d9feb5e7de)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:18.217926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c71c2-074e-4ca2-8fd5-82a4a64fc712 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:18.241270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-d70c71c2-074e-4ca2-8fd5-82a4a64fc712 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] a0527dd826754997874bf3d9feb5e7de cannot be an implied roles.: keystone.exception.InvalidImpliedRole: a0527dd826754997874bf3d9feb5e7de cannot be an implied roles. Jul 30 21:21:18.241270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:21:18.241270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:21:18.241270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:21:18.241270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:21:18.241270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:21:18.241270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:21:18.241270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:21:18.241270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:21:18.241270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:21:18.241270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:21:18.241270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:21:18.241270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Jul 30 21:21:18.241270 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Jul 30 21:21:18.242626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:21:18.242626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:21:18.242626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Jul 30 21:21:18.242626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Jul 30 21:21:18.242626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: a0527dd826754997874bf3d9feb5e7de cannot be an implied roles. Jul 30 21:21:18.242626 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:21:18.246765 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2855/5758] 10.222.0.17 () {60 vars in 1363 bytes} [Sat Jul 30 21:21:18 2022] PUT /identity/v3/roles/793609bec0f04b79a618305fad77bbed/implies/a0527dd826754997874bf3d9feb5e7de => generated 116 bytes in 151 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:21:18.247036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d6dbc-eee3-4e71-9a2c-7c06f5ae56db tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:18.258991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d6dbc-eee3-4e71-9a2c-7c06f5ae56db tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:18.265785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33f73b-d74f-41e7-9411-20ede34540f6 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:18.266411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33f73b-d74f-41e7-9411-20ede34540f6 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:18.266718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33f73b-d74f-41e7-9411-20ede34540f6 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:18.266966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33f73b-d74f-41e7-9411-20ede34540f6 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/a0527dd826754997874bf3d9feb5e7de/implies/793609bec0f04b79a618305fad77bbed` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:18.268734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33f73b-d74f-41e7-9411-20ede34540f6 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=a0527dd826754997874bf3d9feb5e7de, implied_role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:18.270430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33f73b-d74f-41e7-9411-20ede34540f6 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:18.286035 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2904/5759] 10.222.0.17 () {58 vars in 1347 bytes} [Sat Jul 30 21:21:18 2022] DELETE /identity/v3/roles/a0527dd826754997874bf3d9feb5e7de/implies/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:21:18.290407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c71c2-074e-4ca2-8fd5-82a4a64fc712 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:18.308098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c71c2-074e-4ca2-8fd5-82a4a64fc712 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:18.347444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:18.435654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e210e03-04dd-4f5f-8796-4b6b402c78b3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:18.436942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e210e03-04dd-4f5f-8796-4b6b402c78b3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:18.436942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e210e03-04dd-4f5f-8796-4b6b402c78b3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:18.437220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e210e03-04dd-4f5f-8796-4b6b402c78b3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/a0527dd826754997874bf3d9feb5e7de/implies/b7111f894e064e44a3c6d7d32755857b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:18.444179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e210e03-04dd-4f5f-8796-4b6b402c78b3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=a0527dd826754997874bf3d9feb5e7de, implied_role_id=b7111f894e064e44a3c6d7d32755857b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:18.446282 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-3e210e03-04dd-4f5f-8796-4b6b402c78b3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:18.446282 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:21:18.446282 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:21:18.447687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e210e03-04dd-4f5f-8796-4b6b402c78b3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:18.472302 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2856/5760] 10.222.0.17 () {58 vars in 1347 bytes} [Sat Jul 30 21:21:18 2022] DELETE /identity/v3/roles/a0527dd826754997874bf3d9feb5e7de/implies/b7111f894e064e44a3c6d7d32755857b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:18.472738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33f73b-d74f-41e7-9411-20ede34540f6 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:18.485573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33f73b-d74f-41e7-9411-20ede34540f6 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:18.584725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77320d78-4eb4-4b8e-bec8-435943d4d19d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:18.586449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77320d78-4eb4-4b8e-bec8-435943d4d19d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:18.586954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77320d78-4eb4-4b8e-bec8-435943d4d19d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:18.587531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77320d78-4eb4-4b8e-bec8-435943d4d19d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/b7111f894e064e44a3c6d7d32755857b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:18.589520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77320d78-4eb4-4b8e-bec8-435943d4d19d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=b7111f894e064e44a3c6d7d32755857b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:18.592772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77320d78-4eb4-4b8e-bec8-435943d4d19d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:18.664346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-77320d78-4eb4-4b8e-bec8-435943d4d19d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invalidating the token cache because role b7111f894e064e44a3c6d7d32755857b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:18.664965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-77320d78-4eb4-4b8e-bec8-435943d4d19d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:18.665809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-77320d78-4eb4-4b8e-bec8-435943d4d19d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:18.668271 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2905/5761] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:18 2022] DELETE /identity/v3/roles/b7111f894e064e44a3c6d7d32755857b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:21:18.673033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e210e03-04dd-4f5f-8796-4b6b402c78b3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:18.675404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3e210e03-04dd-4f5f-8796-4b6b402c78b3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:18.700515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e210e03-04dd-4f5f-8796-4b6b402c78b3 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:18.806156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed024151-93b4-4cf8-a300-66889dfd1437 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:18.806585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed024151-93b4-4cf8-a300-66889dfd1437 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:18.807224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed024151-93b4-4cf8-a300-66889dfd1437 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:18.807754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed024151-93b4-4cf8-a300-66889dfd1437 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/domains/d34c51439d2c4fa68903b53b0e8e8977` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:18.829909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed024151-93b4-4cf8-a300-66889dfd1437 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d34c51439d2c4fa68903b53b0e8e8977)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:18.832604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed024151-93b4-4cf8-a300-66889dfd1437 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:18.879177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ed024151-93b4-4cf8-a300-66889dfd1437 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd34c51439d2c4fa68903b53b0e8e8977'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:18.880393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ed024151-93b4-4cf8-a300-66889dfd1437 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd34c51439d2c4fa68903b53b0e8e8977'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:18.952595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ed024151-93b4-4cf8-a300-66889dfd1437 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd34c51439d2c4fa68903b53b0e8e8977'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:18.955516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ed024151-93b4-4cf8-a300-66889dfd1437 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd34c51439d2c4fa68903b53b0e8e8977'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:18.974780 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2857/5762] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:21:18 2022] PATCH /identity/v3/domains/d34c51439d2c4fa68903b53b0e8e8977 => generated 277 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:21:18.977212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77320d78-4eb4-4b8e-bec8-435943d4d19d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:18.997066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77320d78-4eb4-4b8e-bec8-435943d4d19d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:19.134116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b1c68-5f81-4fd2-a954-58a16840f787 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:19.134322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b1c68-5f81-4fd2-a954-58a16840f787 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:19.134602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b1c68-5f81-4fd2-a954-58a16840f787 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:19.135022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b1c68-5f81-4fd2-a954-58a16840f787 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/domains/d34c51439d2c4fa68903b53b0e8e8977` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:19.153250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b1c68-5f81-4fd2-a954-58a16840f787 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d34c51439d2c4fa68903b53b0e8e8977)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:19.154948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b1c68-5f81-4fd2-a954-58a16840f787 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:19.180625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:19.195573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-998b1c68-5f81-4fd2-a954-58a16840f787 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd34c51439d2c4fa68903b53b0e8e8977'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:19.204988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-998b1c68-5f81-4fd2-a954-58a16840f787 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd34c51439d2c4fa68903b53b0e8e8977'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:19.291579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-998b1c68-5f81-4fd2-a954-58a16840f787 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd34c51439d2c4fa68903b53b0e8e8977', 'request_id': 'req-998b1c68-5f81-4fd2-a954-58a16840f787'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:19.302622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-998b1c68-5f81-4fd2-a954-58a16840f787 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd34c51439d2c4fa68903b53b0e8e8977', 'request_id': 'req-998b1c68-5f81-4fd2-a954-58a16840f787'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:19.321806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-998b1c68-5f81-4fd2-a954-58a16840f787 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd34c51439d2c4fa68903b53b0e8e8977', 'request_id': 'req-998b1c68-5f81-4fd2-a954-58a16840f787'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:19.341910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-998b1c68-5f81-4fd2-a954-58a16840f787 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] The token cache is being invalidate because project d34c51439d2c4fa68903b53b0e8e8977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:19.342666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-998b1c68-5f81-4fd2-a954-58a16840f787 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:19.344885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-998b1c68-5f81-4fd2-a954-58a16840f787 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:19.360137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-998b1c68-5f81-4fd2-a954-58a16840f787 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd34c51439d2c4fa68903b53b0e8e8977', 'request_id': 'req-998b1c68-5f81-4fd2-a954-58a16840f787'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:19.361311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-998b1c68-5f81-4fd2-a954-58a16840f787 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd34c51439d2c4fa68903b53b0e8e8977', 'request_id': 'req-998b1c68-5f81-4fd2-a954-58a16840f787'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:19.362597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-998b1c68-5f81-4fd2-a954-58a16840f787 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd34c51439d2c4fa68903b53b0e8e8977', 'request_id': 'req-998b1c68-5f81-4fd2-a954-58a16840f787'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:19.380117 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2906/5763] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:21:18 2022] DELETE /identity/v3/domains/d34c51439d2c4fa68903b53b0e8e8977 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:19.384195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed024151-93b4-4cf8-a300-66889dfd1437 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:19.386530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ed024151-93b4-4cf8-a300-66889dfd1437 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:19.402373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed024151-93b4-4cf8-a300-66889dfd1437 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:19.492780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fe31f-34fc-4a25-965a-15fce080a8ab tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:19.493833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fe31f-34fc-4a25-965a-15fce080a8ab tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:19.494175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fe31f-34fc-4a25-965a-15fce080a8ab tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:19.494620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fe31f-34fc-4a25-965a-15fce080a8ab tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/a0527dd826754997874bf3d9feb5e7de/implies/cc3ecddc78a146c38874eb71e1664eeb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:19.497014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169fe31f-34fc-4a25-965a-15fce080a8ab tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=a0527dd826754997874bf3d9feb5e7de, implied_role_id=cc3ecddc78a146c38874eb71e1664eeb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:19.499314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169fe31f-34fc-4a25-965a-15fce080a8ab tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:19.515331 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2858/5764] 10.222.0.17 () {58 vars in 1347 bytes} [Sat Jul 30 21:21:19 2022] DELETE /identity/v3/roles/a0527dd826754997874bf3d9feb5e7de/implies/cc3ecddc78a146c38874eb71e1664eeb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:21:19.519652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b1c68-5f81-4fd2-a954-58a16840f787 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:19.521037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-998b1c68-5f81-4fd2-a954-58a16840f787 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:19.534734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b1c68-5f81-4fd2-a954-58a16840f787 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:19.624915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fafa5-dfc6-4a47-85f9-6e6462950e8d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:19.626249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fafa5-dfc6-4a47-85f9-6e6462950e8d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:19.627053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fafa5-dfc6-4a47-85f9-6e6462950e8d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:19.627053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fafa5-dfc6-4a47-85f9-6e6462950e8d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/cc3ecddc78a146c38874eb71e1664eeb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:19.629076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fafa5-dfc6-4a47-85f9-6e6462950e8d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=cc3ecddc78a146c38874eb71e1664eeb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:19.631500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fafa5-dfc6-4a47-85f9-6e6462950e8d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:19.697779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-006fafa5-dfc6-4a47-85f9-6e6462950e8d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invalidating the token cache because role cc3ecddc78a146c38874eb71e1664eeb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:19.698384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-006fafa5-dfc6-4a47-85f9-6e6462950e8d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:19.699837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-006fafa5-dfc6-4a47-85f9-6e6462950e8d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:19.705147 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2907/5765] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:19 2022] DELETE /identity/v3/roles/cc3ecddc78a146c38874eb71e1664eeb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:19.707380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fe31f-34fc-4a25-965a-15fce080a8ab tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:19.709689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-169fe31f-34fc-4a25-965a-15fce080a8ab tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:19.722577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:19.729955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fe31f-34fc-4a25-965a-15fce080a8ab tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:19.818502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad248cf-fdfa-4e1f-8ccd-8385b83a3a08 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:19.818907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad248cf-fdfa-4e1f-8ccd-8385b83a3a08 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:19.820033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad248cf-fdfa-4e1f-8ccd-8385b83a3a08 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:19.820033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad248cf-fdfa-4e1f-8ccd-8385b83a3a08 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/a0527dd826754997874bf3d9feb5e7de` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:19.821540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad248cf-fdfa-4e1f-8ccd-8385b83a3a08 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=a0527dd826754997874bf3d9feb5e7de)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:19.823320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad248cf-fdfa-4e1f-8ccd-8385b83a3a08 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:19.876227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ad248cf-fdfa-4e1f-8ccd-8385b83a3a08 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invalidating the token cache because role a0527dd826754997874bf3d9feb5e7de has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:19.876599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ad248cf-fdfa-4e1f-8ccd-8385b83a3a08 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:19.877207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6ad248cf-fdfa-4e1f-8ccd-8385b83a3a08 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:19.884033 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2859/5766] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:19 2022] DELETE /identity/v3/roles/a0527dd826754997874bf3d9feb5e7de => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:19.887564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fafa5-dfc6-4a47-85f9-6e6462950e8d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:19.909689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fafa5-dfc6-4a47-85f9-6e6462950e8d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:19.965018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:20.045041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a307c0e-a0b9-46b8-8095-dac2c658e333 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:20.045940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a307c0e-a0b9-46b8-8095-dac2c658e333 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:20.046349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a307c0e-a0b9-46b8-8095-dac2c658e333 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:20.046666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a307c0e-a0b9-46b8-8095-dac2c658e333 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:20.049695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a307c0e-a0b9-46b8-8095-dac2c658e333 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c347f51961024f78b3063a3f928b2ac0, implied_role_id=6003a5fcb1844a579ac718983cdbf2f6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:20.051851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a307c0e-a0b9-46b8-8095-dac2c658e333 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:20.093254 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2908/5767] 10.222.0.17 () {60 vars in 1363 bytes} [Sat Jul 30 21:21:19 2022] PUT /identity/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6 => generated 520 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:20.095454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad248cf-fdfa-4e1f-8ccd-8385b83a3a08 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:20.097699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6ad248cf-fdfa-4e1f-8ccd-8385b83a3a08 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:20.118707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad248cf-fdfa-4e1f-8ccd-8385b83a3a08 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:20.209097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54281a0-3c47-4c69-bb2f-a3060e9cf196 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:20.209869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54281a0-3c47-4c69-bb2f-a3060e9cf196 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:20.210245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54281a0-3c47-4c69-bb2f-a3060e9cf196 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:20.210592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54281a0-3c47-4c69-bb2f-a3060e9cf196 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:20.212745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54281a0-3c47-4c69-bb2f-a3060e9cf196 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=c347f51961024f78b3063a3f928b2ac0, implied_role_id=6003a5fcb1844a579ac718983cdbf2f6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:20.213849 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-c54281a0-3c47-4c69-bb2f-a3060e9cf196 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:20.213849 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:21:20.213849 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:21:20.216985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54281a0-3c47-4c69-bb2f-a3060e9cf196 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:20.216985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54281a0-3c47-4c69-bb2f-a3060e9cf196 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=c347f51961024f78b3063a3f928b2ac0, implied_role_id=6003a5fcb1844a579ac718983cdbf2f6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:20.217472 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-c54281a0-3c47-4c69-bb2f-a3060e9cf196 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:20.217472 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:21:20.217472 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:21:20.218325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54281a0-3c47-4c69-bb2f-a3060e9cf196 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:20.235921 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2860/5768] 10.222.0.17 () {58 vars in 1345 bytes} [Sat Jul 30 21:21:20 2022] HEAD /identity/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:20.240978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a307c0e-a0b9-46b8-8095-dac2c658e333 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:20.263590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a307c0e-a0b9-46b8-8095-dac2c658e333 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:20.272818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec02d17-14d0-40a4-acad-f3ea04d484a4 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:20.274065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec02d17-14d0-40a4-acad-f3ea04d484a4 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:20.274391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec02d17-14d0-40a4-acad-f3ea04d484a4 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:20.274734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec02d17-14d0-40a4-acad-f3ea04d484a4 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:20.276551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec02d17-14d0-40a4-acad-f3ea04d484a4 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=c347f51961024f78b3063a3f928b2ac0, implied_role_id=6003a5fcb1844a579ac718983cdbf2f6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:20.277916 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-8ec02d17-14d0-40a4-acad-f3ea04d484a4 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:20.277916 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:21:20.277916 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:21:20.278690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec02d17-14d0-40a4-acad-f3ea04d484a4 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:20.291421 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2909/5769] 10.222.0.17 () {58 vars in 1344 bytes} [Sat Jul 30 21:21:20 2022] GET /identity/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6 => generated 520 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:20.293197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54281a0-3c47-4c69-bb2f-a3060e9cf196 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:20.305087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54281a0-3c47-4c69-bb2f-a3060e9cf196 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:20.313528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece69134-0790-4413-a8b8-597f0e8f316f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:20.314233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69134-0790-4413-a8b8-597f0e8f316f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:20.314518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69134-0790-4413-a8b8-597f0e8f316f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:20.314814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69134-0790-4413-a8b8-597f0e8f316f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:20.319709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece69134-0790-4413-a8b8-597f0e8f316f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c347f51961024f78b3063a3f928b2ac0, implied_role_id=6003a5fcb1844a579ac718983cdbf2f6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:20.321545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece69134-0790-4413-a8b8-597f0e8f316f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:20.335945 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2861/5770] 10.222.0.17 () {58 vars in 1347 bytes} [Sat Jul 30 21:21:20 2022] DELETE /identity/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:20.340126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec02d17-14d0-40a4-acad-f3ea04d484a4 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:20.360038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec02d17-14d0-40a4-acad-f3ea04d484a4 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:20.452743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc101625-f139-4b6e-b9cd-32fb0d3a1dbb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:20.456036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc101625-f139-4b6e-b9cd-32fb0d3a1dbb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:20.456332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc101625-f139-4b6e-b9cd-32fb0d3a1dbb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:20.456614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc101625-f139-4b6e-b9cd-32fb0d3a1dbb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:20.459025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc101625-f139-4b6e-b9cd-32fb0d3a1dbb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=c347f51961024f78b3063a3f928b2ac0, implied_role_id=6003a5fcb1844a579ac718983cdbf2f6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:20.461144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc101625-f139-4b6e-b9cd-32fb0d3a1dbb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:20.479916 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-cc101625-f139-4b6e-b9cd-32fb0d3a1dbb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] c347f51961024f78b3063a3f928b2ac0 does not imply 6003a5fcb1844a579ac718983cdbf2f6.: keystone.exception.ImpliedRoleNotFound: c347f51961024f78b3063a3f928b2ac0 does not imply 6003a5fcb1844a579ac718983cdbf2f6. Jul 30 21:21:20.479916 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:21:20.479916 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 30 21:21:20.479916 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = query.one() Jul 30 21:21:20.479916 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 30 21:21:20.479916 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._iter().one() Jul 30 21:21:20.479916 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 30 21:21:20.479916 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._only_one_row( Jul 30 21:21:20.479916 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 30 21:21:20.479916 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 30 21:21:20.479916 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 30 21:21:20.479916 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:21:20.479916 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:21:20.479916 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:21:20.479916 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:21:20.479916 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:21:20.481192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:21:20.481192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:21:20.481192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:21:20.481192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:21:20.481192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:21:20.481192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:21:20.481192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:21:20.481192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:21:20.481192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:21:20.481192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Jul 30 21:21:20.481192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Jul 30 21:21:20.481192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Jul 30 21:21:20.481192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Jul 30 21:21:20.481192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Jul 30 21:21:20.481192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 30 21:21:20.481192 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 30 21:21:20.482179 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 30 21:21:20.482179 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: c347f51961024f78b3063a3f928b2ac0 does not imply 6003a5fcb1844a579ac718983cdbf2f6. Jul 30 21:21:20.482179 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:21:20.482179 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2910/5771] 10.222.0.17 () {58 vars in 1344 bytes} [Sat Jul 30 21:21:20 2022] GET /identity/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6 => generated 137 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:21:20.486962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece69134-0790-4413-a8b8-597f0e8f316f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:20.501937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece69134-0790-4413-a8b8-597f0e8f316f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:20.508403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cdcc1-82a8-4c62-a223-a47f4719313b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:20.509587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cdcc1-82a8-4c62-a223-a47f4719313b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:20.509891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cdcc1-82a8-4c62-a223-a47f4719313b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:20.510186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cdcc1-82a8-4c62-a223-a47f4719313b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:20.512168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596cdcc1-82a8-4c62-a223-a47f4719313b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c347f51961024f78b3063a3f928b2ac0, implied_role_id=6003a5fcb1844a579ac718983cdbf2f6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:20.514100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596cdcc1-82a8-4c62-a223-a47f4719313b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:20.527920 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-596cdcc1-82a8-4c62-a223-a47f4719313b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] c347f51961024f78b3063a3f928b2ac0 does not imply 6003a5fcb1844a579ac718983cdbf2f6.: keystone.exception.ImpliedRoleNotFound: c347f51961024f78b3063a3f928b2ac0 does not imply 6003a5fcb1844a579ac718983cdbf2f6. Jul 30 21:21:20.527920 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:21:20.527920 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 30 21:21:20.527920 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = query.one() Jul 30 21:21:20.527920 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 30 21:21:20.527920 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._iter().one() Jul 30 21:21:20.527920 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 30 21:21:20.527920 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._only_one_row( Jul 30 21:21:20.527920 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 30 21:21:20.527920 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 30 21:21:20.527920 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 30 21:21:20.527920 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:21:20.527920 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:21:20.527920 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:21:20.527920 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:21:20.527920 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:21:20.529218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:21:20.529218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:21:20.529218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:21:20.529218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:21:20.529218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:21:20.529218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:21:20.529218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:21:20.529218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:21:20.529218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:21:20.529218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jul 30 21:21:20.529218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jul 30 21:21:20.529218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:21:20.529218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:21:20.529218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jul 30 21:21:20.529218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jul 30 21:21:20.529218 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jul 30 21:21:20.530449 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 30 21:21:20.530449 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 30 21:21:20.530449 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 30 21:21:20.530449 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: c347f51961024f78b3063a3f928b2ac0 does not imply 6003a5fcb1844a579ac718983cdbf2f6. Jul 30 21:21:20.530449 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:21:20.532405 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2862/5772] 10.222.0.17 () {58 vars in 1347 bytes} [Sat Jul 30 21:21:20 2022] DELETE /identity/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6 => generated 137 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 30 21:21:20.537371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc101625-f139-4b6e-b9cd-32fb0d3a1dbb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:20.549376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc101625-f139-4b6e-b9cd-32fb0d3a1dbb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:20.554256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1215a-e19c-4bb0-b596-2691d94fef0f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:20.554915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1215a-e19c-4bb0-b596-2691d94fef0f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:20.555201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1215a-e19c-4bb0-b596-2691d94fef0f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:20.555535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1215a-e19c-4bb0-b596-2691d94fef0f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:20.557234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1215a-e19c-4bb0-b596-2691d94fef0f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c347f51961024f78b3063a3f928b2ac0, implied_role_id=6003a5fcb1844a579ac718983cdbf2f6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:20.558823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1215a-e19c-4bb0-b596-2691d94fef0f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:20.590848 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2911/5773] 10.222.0.17 () {60 vars in 1363 bytes} [Sat Jul 30 21:21:20 2022] PUT /identity/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6 => generated 520 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:20.595424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cdcc1-82a8-4c62-a223-a47f4719313b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:20.611396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cdcc1-82a8-4c62-a223-a47f4719313b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:20.694266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:20.719961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d955b-7c2c-4c61-8753-c0a2419e1525 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:20.720840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d955b-7c2c-4c61-8753-c0a2419e1525 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:20.721517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d955b-7c2c-4c61-8753-c0a2419e1525 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:20.721871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d955b-7c2c-4c61-8753-c0a2419e1525 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/47eddb14cc354036b4a6f50bf7d46b79` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:20.723734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d955b-7c2c-4c61-8753-c0a2419e1525 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c347f51961024f78b3063a3f928b2ac0, implied_role_id=47eddb14cc354036b4a6f50bf7d46b79)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:20.725426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d955b-7c2c-4c61-8753-c0a2419e1525 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:20.763205 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2863/5774] 10.222.0.17 () {60 vars in 1363 bytes} [Sat Jul 30 21:21:20 2022] PUT /identity/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/47eddb14cc354036b4a6f50bf7d46b79 => generated 520 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:20.764657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1215a-e19c-4bb0-b596-2691d94fef0f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:20.782709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1215a-e19c-4bb0-b596-2691d94fef0f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:20.870011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f27ab-fd65-4aa8-a9f6-5b9818a0e43d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:20.870843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f27ab-fd65-4aa8-a9f6-5b9818a0e43d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:20.871227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f27ab-fd65-4aa8-a9f6-5b9818a0e43d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:20.871522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f27ab-fd65-4aa8-a9f6-5b9818a0e43d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/47eddb14cc354036b4a6f50bf7d46b79/implies/793609bec0f04b79a618305fad77bbed` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:20.873834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f27ab-fd65-4aa8-a9f6-5b9818a0e43d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=47eddb14cc354036b4a6f50bf7d46b79, implied_role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:20.877009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f27ab-fd65-4aa8-a9f6-5b9818a0e43d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:20.895865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:20.915895 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2912/5775] 10.222.0.17 () {60 vars in 1363 bytes} [Sat Jul 30 21:21:20 2022] PUT /identity/v3/roles/47eddb14cc354036b4a6f50bf7d46b79/implies/793609bec0f04b79a618305fad77bbed => generated 519 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:20.919927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d955b-7c2c-4c61-8753-c0a2419e1525 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:20.940405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d955b-7c2c-4c61-8753-c0a2419e1525 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:21.078621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c162073-c257-49be-9b69-d26e3a0dafa7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:21.079713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c162073-c257-49be-9b69-d26e3a0dafa7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:21.080189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c162073-c257-49be-9b69-d26e3a0dafa7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:21.081615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c162073-c257-49be-9b69-d26e3a0dafa7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:21.087341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c162073-c257-49be-9b69-d26e3a0dafa7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:21.088905 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-2c162073-c257-49be-9b69-d26e3a0dafa7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:21.088905 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:21:21.088905 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:21:21.091467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c162073-c257-49be-9b69-d26e3a0dafa7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:21.124253 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2864/5776] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:21:20 2022] GET /identity/v3/role_inferences => generated 1604 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:21.130122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f27ab-fd65-4aa8-a9f6-5b9818a0e43d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:21.141707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f27ab-fd65-4aa8-a9f6-5b9818a0e43d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:21.146594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575bc6c-3a2b-4b77-93b5-92b9b740af05 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:21.147374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575bc6c-3a2b-4b77-93b5-92b9b740af05 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:21.147663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575bc6c-3a2b-4b77-93b5-92b9b740af05 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:21.148572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575bc6c-3a2b-4b77-93b5-92b9b740af05 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/47eddb14cc354036b4a6f50bf7d46b79/implies/793609bec0f04b79a618305fad77bbed` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:21.150682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8575bc6c-3a2b-4b77-93b5-92b9b740af05 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=47eddb14cc354036b4a6f50bf7d46b79, implied_role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:21.152056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8575bc6c-3a2b-4b77-93b5-92b9b740af05 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:21.164098 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2913/5777] 10.222.0.17 () {58 vars in 1347 bytes} [Sat Jul 30 21:21:21 2022] DELETE /identity/v3/roles/47eddb14cc354036b4a6f50bf7d46b79/implies/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:21.169104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c162073-c257-49be-9b69-d26e3a0dafa7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:21.184417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c162073-c257-49be-9b69-d26e3a0dafa7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:21.276419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d7897-93c6-4c90-bebd-f83f2b55e58a tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:21.277443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d7897-93c6-4c90-bebd-f83f2b55e58a tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:21.277741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d7897-93c6-4c90-bebd-f83f2b55e58a tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:21.278081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d7897-93c6-4c90-bebd-f83f2b55e58a tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/47eddb14cc354036b4a6f50bf7d46b79` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:21.281658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d7897-93c6-4c90-bebd-f83f2b55e58a tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c347f51961024f78b3063a3f928b2ac0, implied_role_id=47eddb14cc354036b4a6f50bf7d46b79)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:21.284229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d7897-93c6-4c90-bebd-f83f2b55e58a tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:21.302505 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2865/5778] 10.222.0.17 () {58 vars in 1347 bytes} [Sat Jul 30 21:21:21 2022] DELETE /identity/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/47eddb14cc354036b4a6f50bf7d46b79 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:21.305766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575bc6c-3a2b-4b77-93b5-92b9b740af05 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:21.320027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575bc6c-3a2b-4b77-93b5-92b9b740af05 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:21.396508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820c014-69be-484c-89d9-d84cffca072f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:21.397424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820c014-69be-484c-89d9-d84cffca072f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:21.397564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820c014-69be-484c-89d9-d84cffca072f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:21.398217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820c014-69be-484c-89d9-d84cffca072f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:21.400268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820c014-69be-484c-89d9-d84cffca072f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c347f51961024f78b3063a3f928b2ac0, implied_role_id=6003a5fcb1844a579ac718983cdbf2f6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:21.402565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820c014-69be-484c-89d9-d84cffca072f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:21.415200 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2914/5779] 10.222.0.17 () {58 vars in 1347 bytes} [Sat Jul 30 21:21:21 2022] DELETE /identity/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:21.421329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d7897-93c6-4c90-bebd-f83f2b55e58a tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:21.434644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d7897-93c6-4c90-bebd-f83f2b55e58a tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:21.516296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:21.529650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82c4b8-ffa0-45f8-9289-aba4ab6d3ff7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:21.530664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82c4b8-ffa0-45f8-9289-aba4ab6d3ff7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:21.532354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82c4b8-ffa0-45f8-9289-aba4ab6d3ff7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:21.532837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82c4b8-ffa0-45f8-9289-aba4ab6d3ff7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:21.534037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82c4b8-ffa0-45f8-9289-aba4ab6d3ff7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:21.536365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82c4b8-ffa0-45f8-9289-aba4ab6d3ff7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:21.558108 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2866/5780] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:21 2022] GET /identity/v3/roles => generated 2321 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:21.563408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820c014-69be-484c-89d9-d84cffca072f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:21.576905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820c014-69be-484c-89d9-d84cffca072f tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:21.584893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae71d5f-23e9-4392-b725-1e864d27a100 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:21.586156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae71d5f-23e9-4392-b725-1e864d27a100 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:21.586547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae71d5f-23e9-4392-b725-1e864d27a100 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:21.587919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae71d5f-23e9-4392-b725-1e864d27a100 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:21.589080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae71d5f-23e9-4392-b725-1e864d27a100 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:21.592396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae71d5f-23e9-4392-b725-1e864d27a100 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:21.616558 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2915/5781] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:21:21 2022] POST /identity/v3/roles => generated 235 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:21.621174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82c4b8-ffa0-45f8-9289-aba4ab6d3ff7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:21.636486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82c4b8-ffa0-45f8-9289-aba4ab6d3ff7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:21.646933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b05879-5d83-4857-9b3b-4b30b9db5fa0 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:21.648134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b05879-5d83-4857-9b3b-4b30b9db5fa0 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:21.648134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b05879-5d83-4857-9b3b-4b30b9db5fa0 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:21.648506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b05879-5d83-4857-9b3b-4b30b9db5fa0 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/ae28e98592db4f7ca46c3547730b2a7d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:21.650824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b05879-5d83-4857-9b3b-4b30b9db5fa0 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:update_role(role_id=ae28e98592db4f7ca46c3547730b2a7d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:21.652053 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-77b05879-5d83-4857-9b3b-4b30b9db5fa0 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:21.652053 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:21:21.652053 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:21:21.653444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b05879-5d83-4857-9b3b-4b30b9db5fa0 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:21.694868 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2867/5782] 10.222.0.17 () {60 vars in 1243 bytes} [Sat Jul 30 21:21:21 2022] PATCH /identity/v3/roles/ae28e98592db4f7ca46c3547730b2a7d => generated 238 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:21.698592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae71d5f-23e9-4392-b725-1e864d27a100 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:21.710388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae71d5f-23e9-4392-b725-1e864d27a100 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:21.716533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bcdac-7bd4-4d82-ac5b-889d1bc58e6d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:21.717415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bcdac-7bd4-4d82-ac5b-889d1bc58e6d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:21.717770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bcdac-7bd4-4d82-ac5b-889d1bc58e6d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:21.718161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bcdac-7bd4-4d82-ac5b-889d1bc58e6d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/ae28e98592db4f7ca46c3547730b2a7d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:21.730100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bcdac-7bd4-4d82-ac5b-889d1bc58e6d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:get_role(role_id=ae28e98592db4f7ca46c3547730b2a7d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:21.732682 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-5a8bcdac-7bd4-4d82-ac5b-889d1bc58e6d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:21.732682 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:21:21.732682 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:21:21.735073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bcdac-7bd4-4d82-ac5b-889d1bc58e6d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:21.749224 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2916/5783] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:21:21 2022] GET /identity/v3/roles/ae28e98592db4f7ca46c3547730b2a7d => generated 238 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:21:21.756780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b05879-5d83-4857-9b3b-4b30b9db5fa0 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:21.776202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b05879-5d83-4857-9b3b-4b30b9db5fa0 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:21.782561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21ef4b-e237-4b82-b1e0-ec19377e36bd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:21.783204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21ef4b-e237-4b82-b1e0-ec19377e36bd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:21.783573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21ef4b-e237-4b82-b1e0-ec19377e36bd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:21.784374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21ef4b-e237-4b82-b1e0-ec19377e36bd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:21.785839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21ef4b-e237-4b82-b1e0-ec19377e36bd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:21.789148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21ef4b-e237-4b82-b1e0-ec19377e36bd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:21.813830 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2868/5784] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:21 2022] GET /identity/v3/roles => generated 2550 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:21.817707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bcdac-7bd4-4d82-ac5b-889d1bc58e6d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:21.837070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bcdac-7bd4-4d82-ac5b-889d1bc58e6d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:21.850783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a60635-13bc-4880-88d3-232afdfc7ba1 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:21.851774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a60635-13bc-4880-88d3-232afdfc7ba1 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:21.852235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a60635-13bc-4880-88d3-232afdfc7ba1 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:21.852523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a60635-13bc-4880-88d3-232afdfc7ba1 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/ae28e98592db4f7ca46c3547730b2a7d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:21.854462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a60635-13bc-4880-88d3-232afdfc7ba1 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ae28e98592db4f7ca46c3547730b2a7d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:21.856420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a60635-13bc-4880-88d3-232afdfc7ba1 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:21.944760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c3a60635-13bc-4880-88d3-232afdfc7ba1 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invalidating the token cache because role ae28e98592db4f7ca46c3547730b2a7d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:21.945254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c3a60635-13bc-4880-88d3-232afdfc7ba1 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:21.946390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c3a60635-13bc-4880-88d3-232afdfc7ba1 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:21.954498 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2917/5785] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:21 2022] DELETE /identity/v3/roles/ae28e98592db4f7ca46c3547730b2a7d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:21:21.955872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21ef4b-e237-4b82-b1e0-ec19377e36bd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:21.958196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0f21ef4b-e237-4b82-b1e0-ec19377e36bd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:21.987826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21ef4b-e237-4b82-b1e0-ec19377e36bd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:22.132740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a60635-13bc-4880-88d3-232afdfc7ba1 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:22.134457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c3a60635-13bc-4880-88d3-232afdfc7ba1 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:22.140460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910a62f-f028-448b-86b7-ff4225322641 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:22.141919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910a62f-f028-448b-86b7-ff4225322641 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:22.142950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910a62f-f028-448b-86b7-ff4225322641 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:22.143519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910a62f-f028-448b-86b7-ff4225322641 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:22.146177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910a62f-f028-448b-86b7-ff4225322641 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c347f51961024f78b3063a3f928b2ac0, implied_role_id=6003a5fcb1844a579ac718983cdbf2f6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:22.148133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910a62f-f028-448b-86b7-ff4225322641 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:22.221215 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2869/5786] 10.222.0.17 () {60 vars in 1363 bytes} [Sat Jul 30 21:21:21 2022] PUT /identity/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6 => generated 520 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:22.223168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910a62f-f028-448b-86b7-ff4225322641 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:22.338962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910a62f-f028-448b-86b7-ff4225322641 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:22.357385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9a9f5-1c0e-4f96-9e16-fd48b1eba099 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:22.357857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9a9f5-1c0e-4f96-9e16-fd48b1eba099 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:22.358146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9a9f5-1c0e-4f96-9e16-fd48b1eba099 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:22.358886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a60635-13bc-4880-88d3-232afdfc7ba1 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:22.362747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9a9f5-1c0e-4f96-9e16-fd48b1eba099 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/47eddb14cc354036b4a6f50bf7d46b79` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:22.367761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9a9f5-1c0e-4f96-9e16-fd48b1eba099 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c347f51961024f78b3063a3f928b2ac0, implied_role_id=47eddb14cc354036b4a6f50bf7d46b79)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:22.370475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:22.370859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9a9f5-1c0e-4f96-9e16-fd48b1eba099 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:22.434582 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2870/5787] 10.222.0.17 () {60 vars in 1363 bytes} [Sat Jul 30 21:21:22 2022] PUT /identity/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/47eddb14cc354036b4a6f50bf7d46b79 => generated 520 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:22.437026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9a9f5-1c0e-4f96-9e16-fd48b1eba099 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:22.475424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:22.547730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9a9f5-1c0e-4f96-9e16-fd48b1eba099 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:22.555389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb520d-a940-4193-9746-99cd16137c8b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:22.556371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb520d-a940-4193-9746-99cd16137c8b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:22.556856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb520d-a940-4193-9746-99cd16137c8b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:22.557152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb520d-a940-4193-9746-99cd16137c8b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/47eddb14cc354036b4a6f50bf7d46b79/implies/793609bec0f04b79a618305fad77bbed` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:22.559136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb520d-a940-4193-9746-99cd16137c8b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=47eddb14cc354036b4a6f50bf7d46b79, implied_role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:22.566554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f880360-8d3b-4833-894e-3ad58aba0aff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:22.567240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f880360-8d3b-4833-894e-3ad58aba0aff service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:22.567572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f880360-8d3b-4833-894e-3ad58aba0aff service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:22.567836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f880360-8d3b-4833-894e-3ad58aba0aff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:22.574412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9f880360-8d3b-4833-894e-3ad58aba0aff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:22.576772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb520d-a940-4193-9746-99cd16137c8b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:22.614031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f880360-8d3b-4833-894e-3ad58aba0aff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:22.619927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f880360-8d3b-4833-894e-3ad58aba0aff service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:22.649234 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2918/5788] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:21:22.666808 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2871/5789] 10.222.0.17 () {60 vars in 1363 bytes} [Sat Jul 30 21:21:22 2022] PUT /identity/v3/roles/47eddb14cc354036b4a6f50bf7d46b79/implies/793609bec0f04b79a618305fad77bbed => generated 519 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:22.670523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f880360-8d3b-4833-894e-3ad58aba0aff service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:22.692459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f880360-8d3b-4833-894e-3ad58aba0aff service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:22.841338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22013e91-662e-49bc-9d74-55dc8e1633fb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:22.842941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22013e91-662e-49bc-9d74-55dc8e1633fb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:22.844158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22013e91-662e-49bc-9d74-55dc8e1633fb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:22.845381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22013e91-662e-49bc-9d74-55dc8e1633fb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/47eddb14cc354036b4a6f50bf7d46b79/implies` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:22.847503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22013e91-662e-49bc-9d74-55dc8e1633fb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=47eddb14cc354036b4a6f50bf7d46b79)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:22.849415 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-22013e91-662e-49bc-9d74-55dc8e1633fb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:22.849415 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:21:22.849415 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:21:22.850725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22013e91-662e-49bc-9d74-55dc8e1633fb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:22.865505 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2919/5790] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:21:22 2022] GET /identity/v3/roles/47eddb14cc354036b4a6f50bf7d46b79/implies => generated 488 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:22.866628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb520d-a940-4193-9746-99cd16137c8b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:22.881693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb520d-a940-4193-9746-99cd16137c8b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:22.891327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccedecc-40f6-4cbc-968b-8a0b423fd37c tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:22.895305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccedecc-40f6-4cbc-968b-8a0b423fd37c tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:22.895927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccedecc-40f6-4cbc-968b-8a0b423fd37c tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:22.897552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccedecc-40f6-4cbc-968b-8a0b423fd37c tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:22.899823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccedecc-40f6-4cbc-968b-8a0b423fd37c tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=c347f51961024f78b3063a3f928b2ac0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:22.901709 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-0ccedecc-40f6-4cbc-968b-8a0b423fd37c tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:21:22.901709 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:21:22.901709 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:21:22.903808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccedecc-40f6-4cbc-968b-8a0b423fd37c tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:22.916549 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2872/5791] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:21:22 2022] GET /identity/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies => generated 659 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:22.923272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22013e91-662e-49bc-9d74-55dc8e1633fb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:22.938159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22013e91-662e-49bc-9d74-55dc8e1633fb tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:22.954203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84521026-63b8-40fe-b68f-f18b6aeae119 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:22.955281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84521026-63b8-40fe-b68f-f18b6aeae119 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:22.956909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84521026-63b8-40fe-b68f-f18b6aeae119 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:22.957765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84521026-63b8-40fe-b68f-f18b6aeae119 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/47eddb14cc354036b4a6f50bf7d46b79/implies/793609bec0f04b79a618305fad77bbed` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:22.964207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84521026-63b8-40fe-b68f-f18b6aeae119 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=47eddb14cc354036b4a6f50bf7d46b79, implied_role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:22.969177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84521026-63b8-40fe-b68f-f18b6aeae119 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:22.994428 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2920/5792] 10.222.0.17 () {58 vars in 1347 bytes} [Sat Jul 30 21:21:22 2022] DELETE /identity/v3/roles/47eddb14cc354036b4a6f50bf7d46b79/implies/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:22.998548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccedecc-40f6-4cbc-968b-8a0b423fd37c tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:23.017584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccedecc-40f6-4cbc-968b-8a0b423fd37c tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:23.164181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19affedf-0671-427f-b7a8-efaac8e2da97 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:23.164877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19affedf-0671-427f-b7a8-efaac8e2da97 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:23.165165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19affedf-0671-427f-b7a8-efaac8e2da97 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:23.165448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19affedf-0671-427f-b7a8-efaac8e2da97 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/47eddb14cc354036b4a6f50bf7d46b79` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:23.172670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19affedf-0671-427f-b7a8-efaac8e2da97 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c347f51961024f78b3063a3f928b2ac0, implied_role_id=47eddb14cc354036b4a6f50bf7d46b79)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:23.174307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19affedf-0671-427f-b7a8-efaac8e2da97 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:23.194648 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2873/5793] 10.222.0.17 () {58 vars in 1347 bytes} [Sat Jul 30 21:21:22 2022] DELETE /identity/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/47eddb14cc354036b4a6f50bf7d46b79 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:23.195914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84521026-63b8-40fe-b68f-f18b6aeae119 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:23.210546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84521026-63b8-40fe-b68f-f18b6aeae119 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:23.290456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8260e-350f-4807-a14e-19592ae3f64d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:23.291891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8260e-350f-4807-a14e-19592ae3f64d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:23.292272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8260e-350f-4807-a14e-19592ae3f64d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:23.292560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8260e-350f-4807-a14e-19592ae3f64d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:23.295185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8260e-350f-4807-a14e-19592ae3f64d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c347f51961024f78b3063a3f928b2ac0, implied_role_id=6003a5fcb1844a579ac718983cdbf2f6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:23.296614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8260e-350f-4807-a14e-19592ae3f64d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:23.311325 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2921/5794] 10.222.0.17 () {58 vars in 1347 bytes} [Sat Jul 30 21:21:23 2022] DELETE /identity/v3/roles/c347f51961024f78b3063a3f928b2ac0/implies/6003a5fcb1844a579ac718983cdbf2f6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:23.316605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19affedf-0671-427f-b7a8-efaac8e2da97 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:23.333251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19affedf-0671-427f-b7a8-efaac8e2da97 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:23.426255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c99ef2-3495-4088-bded-5aadea01ea50 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:23.427322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c99ef2-3495-4088-bded-5aadea01ea50 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:23.427322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c99ef2-3495-4088-bded-5aadea01ea50 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:23.427728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c99ef2-3495-4088-bded-5aadea01ea50 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/domains/d34c51439d2c4fa68903b53b0e8e8977` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:23.436606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c99ef2-3495-4088-bded-5aadea01ea50 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 21:21:23.442442 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-b5c99ef2-3495-4088-bded-5aadea01ea50 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Could not find domain: d34c51439d2c4fa68903b53b0e8e8977.: keystone.exception.DomainNotFound: Could not find domain: d34c51439d2c4fa68903b53b0e8e8977. Jul 30 21:21:23.442442 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:21:23.442442 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 30 21:21:23.442442 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 30 21:21:23.442442 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 21:21:23.442442 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 21:21:23.442442 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 21:21:23.442442 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 21:21:23.442442 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d34c51439d2c4fa68903b53b0e8e8977. Jul 30 21:21:23.442442 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:21:23.442442 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:21:23.442442 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:21:23.442442 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:21:23.442442 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:21:23.442442 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:21:23.442442 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:21:23.443728 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:21:23.443728 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:21:23.443728 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:21:23.443728 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:21:23.443728 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:21:23.443728 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:21:23.443728 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:21:23.443728 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 30 21:21:23.443728 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 30 21:21:23.443728 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 21:21:23.443728 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 21:21:23.443728 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 21:21:23.443728 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 21:21:23.443728 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:21:23.443728 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:21:23.443728 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:21:23.444832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:21:23.444832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:21:23.444832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:21:23.444832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:21:23.444832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 21:21:23.444832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:21:23.444832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:21:23.444832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:21:23.444832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:21:23.444832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:21:23.444832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:21:23.444832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:21:23.444832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:21:23.444832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 30 21:21:23.444832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 21:21:23.444832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d34c51439d2c4fa68903b53b0e8e8977. Jul 30 21:21:23.444832 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:21:23.446041 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2874/5795] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:21:23 2022] PATCH /identity/v3/domains/d34c51439d2c4fa68903b53b0e8e8977 => generated 112 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:21:23.448867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8260e-350f-4807-a14e-19592ae3f64d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:23.465613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8260e-350f-4807-a14e-19592ae3f64d tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:23.472068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca217c-ff49-4d7b-9ec8-694df30c44af tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:23.473468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca217c-ff49-4d7b-9ec8-694df30c44af tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:23.473856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca217c-ff49-4d7b-9ec8-694df30c44af tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:23.474154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca217c-ff49-4d7b-9ec8-694df30c44af tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/users/0eaf24e2b09e406ebde3b74b77175f05` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:23.475950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca217c-ff49-4d7b-9ec8-694df30c44af tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0eaf24e2b09e406ebde3b74b77175f05)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:23.478316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca217c-ff49-4d7b-9ec8-694df30c44af tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:23.492209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:23.577131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6dca217c-ff49-4d7b-9ec8-694df30c44af tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eaf24e2b09e406ebde3b74b77175f05'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:23.593471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6dca217c-ff49-4d7b-9ec8-694df30c44af tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eaf24e2b09e406ebde3b74b77175f05'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:23.594225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6dca217c-ff49-4d7b-9ec8-694df30c44af tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eaf24e2b09e406ebde3b74b77175f05'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:23.607179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6dca217c-ff49-4d7b-9ec8-694df30c44af tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eaf24e2b09e406ebde3b74b77175f05'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:23.608336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6dca217c-ff49-4d7b-9ec8-694df30c44af tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eaf24e2b09e406ebde3b74b77175f05'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:23.628878 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2922/5796] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:23 2022] DELETE /identity/v3/users/0eaf24e2b09e406ebde3b74b77175f05 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:23.633844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c99ef2-3495-4088-bded-5aadea01ea50 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:23.635921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b5c99ef2-3495-4088-bded-5aadea01ea50 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:23.660031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c99ef2-3495-4088-bded-5aadea01ea50 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:23.694772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:23.767480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f8632-fe2f-4999-bd69-a1b05907b98b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:23.768723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f8632-fe2f-4999-bd69-a1b05907b98b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:23.769194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f8632-fe2f-4999-bd69-a1b05907b98b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:23.769709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f8632-fe2f-4999-bd69-a1b05907b98b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/793609bec0f04b79a618305fad77bbed` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:23.771757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f8632-fe2f-4999-bd69-a1b05907b98b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_role(role_id=793609bec0f04b79a618305fad77bbed)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:23.773489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f8632-fe2f-4999-bd69-a1b05907b98b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:23.825430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2f7f8632-fe2f-4999-bd69-a1b05907b98b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invalidating the token cache because role 793609bec0f04b79a618305fad77bbed has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:23.825649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2f7f8632-fe2f-4999-bd69-a1b05907b98b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:23.826850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2f7f8632-fe2f-4999-bd69-a1b05907b98b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:23.832516 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2875/5797] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:23 2022] DELETE /identity/v3/roles/793609bec0f04b79a618305fad77bbed => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:23.833805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca217c-ff49-4d7b-9ec8-694df30c44af tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:23.852039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca217c-ff49-4d7b-9ec8-694df30c44af tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:23.936001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b171d68-9679-40bb-95b1-a338f40e29ed tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:23.937054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b171d68-9679-40bb-95b1-a338f40e29ed tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:23.938021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b171d68-9679-40bb-95b1-a338f40e29ed tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:23.938408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b171d68-9679-40bb-95b1-a338f40e29ed tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/groups/15cfaa9d84a2464fb7f7cfdead3ccf69` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:23.939905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b171d68-9679-40bb-95b1-a338f40e29ed tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_group(group_id=15cfaa9d84a2464fb7f7cfdead3ccf69)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:23.941929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b171d68-9679-40bb-95b1-a338f40e29ed tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:24.024226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f8632-fe2f-4999-bd69-a1b05907b98b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:24.026701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2f7f8632-fe2f-4999-bd69-a1b05907b98b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:24.027554 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2923/5798] 10.222.0.17 () {58 vars in 1227 bytes} [Sat Jul 30 21:21:23 2022] DELETE /identity/v3/groups/15cfaa9d84a2464fb7f7cfdead3ccf69 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:24.045484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f8632-fe2f-4999-bd69-a1b05907b98b tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:24.191930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056ce21-288b-4b6c-b7c0-b3c0812942b8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:24.192800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056ce21-288b-4b6c-b7c0-b3c0812942b8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:24.192961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056ce21-288b-4b6c-b7c0-b3c0812942b8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:24.193441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056ce21-288b-4b6c-b7c0-b3c0812942b8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/projects/b7d1798a587e4d4084d02f2cc536268e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:24.194942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056ce21-288b-4b6c-b7c0-b3c0812942b8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b7d1798a587e4d4084d02f2cc536268e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:24.196748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056ce21-288b-4b6c-b7c0-b3c0812942b8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:24.265602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e056ce21-288b-4b6c-b7c0-b3c0812942b8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7d1798a587e4d4084d02f2cc536268e', 'request_id': 'req-e056ce21-288b-4b6c-b7c0-b3c0812942b8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.274193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e056ce21-288b-4b6c-b7c0-b3c0812942b8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7d1798a587e4d4084d02f2cc536268e', 'request_id': 'req-e056ce21-288b-4b6c-b7c0-b3c0812942b8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.281458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e056ce21-288b-4b6c-b7c0-b3c0812942b8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7d1798a587e4d4084d02f2cc536268e', 'request_id': 'req-e056ce21-288b-4b6c-b7c0-b3c0812942b8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.294278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e056ce21-288b-4b6c-b7c0-b3c0812942b8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] The token cache is being invalidate because project b7d1798a587e4d4084d02f2cc536268e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:24.294709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e056ce21-288b-4b6c-b7c0-b3c0812942b8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.296024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e056ce21-288b-4b6c-b7c0-b3c0812942b8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.300937 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2876/5799] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:24 2022] DELETE /identity/v3/projects/b7d1798a587e4d4084d02f2cc536268e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:24.302069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b171d68-9679-40bb-95b1-a338f40e29ed tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:24.304628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6b171d68-9679-40bb-95b1-a338f40e29ed tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:24.318811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b171d68-9679-40bb-95b1-a338f40e29ed tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:24.374898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:24.394660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2a90d-aca4-4fcf-93d2-7a2a742adfdd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:24.395634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2a90d-aca4-4fcf-93d2-7a2a742adfdd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:24.396120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2a90d-aca4-4fcf-93d2-7a2a742adfdd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:24.396509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2a90d-aca4-4fcf-93d2-7a2a742adfdd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/domains/d53086ac837b4901862596b4c8094055` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:24.398055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2a90d-aca4-4fcf-93d2-7a2a742adfdd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d53086ac837b4901862596b4c8094055)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:24.399853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2a90d-aca4-4fcf-93d2-7a2a742adfdd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:24.428720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cdd2a90d-aca4-4fcf-93d2-7a2a742adfdd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd53086ac837b4901862596b4c8094055'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.429654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cdd2a90d-aca4-4fcf-93d2-7a2a742adfdd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd53086ac837b4901862596b4c8094055'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.470725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cdd2a90d-aca4-4fcf-93d2-7a2a742adfdd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd53086ac837b4901862596b4c8094055'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.471755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cdd2a90d-aca4-4fcf-93d2-7a2a742adfdd tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd53086ac837b4901862596b4c8094055'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.477206 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2924/5800] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:21:24 2022] PATCH /identity/v3/domains/d53086ac837b4901862596b4c8094055 => generated 277 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:24.478519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056ce21-288b-4b6c-b7c0-b3c0812942b8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:24.495583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056ce21-288b-4b6c-b7c0-b3c0812942b8 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:24.519585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:24.566926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec8046-4467-421a-9943-d1446f3a1549 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:24.567631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec8046-4467-421a-9943-d1446f3a1549 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:24.567919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec8046-4467-421a-9943-d1446f3a1549 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:24.568335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec8046-4467-421a-9943-d1446f3a1549 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/domains/d53086ac837b4901862596b4c8094055` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:24.580799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec8046-4467-421a-9943-d1446f3a1549 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d53086ac837b4901862596b4c8094055)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:24.584131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec8046-4467-421a-9943-d1446f3a1549 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:24.613115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-adec8046-4467-421a-9943-d1446f3a1549 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd53086ac837b4901862596b4c8094055'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.617205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-adec8046-4467-421a-9943-d1446f3a1549 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd53086ac837b4901862596b4c8094055'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.681082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-adec8046-4467-421a-9943-d1446f3a1549 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd53086ac837b4901862596b4c8094055', 'request_id': 'req-adec8046-4467-421a-9943-d1446f3a1549'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.689273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-adec8046-4467-421a-9943-d1446f3a1549 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd53086ac837b4901862596b4c8094055', 'request_id': 'req-adec8046-4467-421a-9943-d1446f3a1549'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.696759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-adec8046-4467-421a-9943-d1446f3a1549 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd53086ac837b4901862596b4c8094055', 'request_id': 'req-adec8046-4467-421a-9943-d1446f3a1549'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.697316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83912b-d77c-438d-9fef-20f2d7d618cf None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:24.697731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83912b-d77c-438d-9fef-20f2d7d618cf None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:24.698119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83912b-d77c-438d-9fef-20f2d7d618cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:24.712306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-adec8046-4467-421a-9943-d1446f3a1549 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] The token cache is being invalidate because project d53086ac837b4901862596b4c8094055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:24.712909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-adec8046-4467-421a-9943-d1446f3a1549 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.713836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-adec8046-4467-421a-9943-d1446f3a1549 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.725337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9f83912b-d77c-438d-9fef-20f2d7d618cf None None] MFA Rules not processed for user `c025e35fd22a4895a5d0301c1d5b0e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:24.727081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9f83912b-d77c-438d-9fef-20f2d7d618cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:24.728253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-adec8046-4467-421a-9943-d1446f3a1549 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd53086ac837b4901862596b4c8094055', 'request_id': 'req-adec8046-4467-421a-9943-d1446f3a1549'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.733766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-adec8046-4467-421a-9943-d1446f3a1549 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd53086ac837b4901862596b4c8094055', 'request_id': 'req-adec8046-4467-421a-9943-d1446f3a1549'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.735049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-adec8046-4467-421a-9943-d1446f3a1549 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd53086ac837b4901862596b4c8094055', 'request_id': 'req-adec8046-4467-421a-9943-d1446f3a1549'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.744007 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2877/5801] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:21:24 2022] DELETE /identity/v3/domains/d53086ac837b4901862596b4c8094055 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:24.749429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec8046-4467-421a-9943-d1446f3a1549 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:24.751275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-adec8046-4467-421a-9943-d1446f3a1549 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:24.821135 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2925/5802] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:21:24.848057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec8046-4467-421a-9943-d1446f3a1549 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:24.854395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ac2b8-75a9-4320-b4d8-82256f4e5037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:24.855732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ac2b8-75a9-4320-b4d8-82256f4e5037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:24.856126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ac2b8-75a9-4320-b4d8-82256f4e5037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:24.856862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ac2b8-75a9-4320-b4d8-82256f4e5037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/47eddb14cc354036b4a6f50bf7d46b79` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:24.858638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ac2b8-75a9-4320-b4d8-82256f4e5037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_role(role_id=47eddb14cc354036b4a6f50bf7d46b79)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:24.860970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ac2b8-75a9-4320-b4d8-82256f4e5037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:24.863335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:24.915602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c31ac2b8-75a9-4320-b4d8-82256f4e5037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invalidating the token cache because role 47eddb14cc354036b4a6f50bf7d46b79 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:24.916119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c31ac2b8-75a9-4320-b4d8-82256f4e5037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.917310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c31ac2b8-75a9-4320-b4d8-82256f4e5037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:24.920949 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2878/5803] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:24 2022] DELETE /identity/v3/roles/47eddb14cc354036b4a6f50bf7d46b79 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:24.925090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83912b-d77c-438d-9fef-20f2d7d618cf None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:24.943816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83912b-d77c-438d-9fef-20f2d7d618cf None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:25.021509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707addff-012e-4579-b411-b24f8348f1cc tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:25.023239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707addff-012e-4579-b411-b24f8348f1cc tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:25.023671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707addff-012e-4579-b411-b24f8348f1cc tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:25.024120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707addff-012e-4579-b411-b24f8348f1cc tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/6003a5fcb1844a579ac718983cdbf2f6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:25.026344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707addff-012e-4579-b411-b24f8348f1cc tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6003a5fcb1844a579ac718983cdbf2f6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:25.028802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707addff-012e-4579-b411-b24f8348f1cc tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:25.112795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-707addff-012e-4579-b411-b24f8348f1cc tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invalidating the token cache because role 6003a5fcb1844a579ac718983cdbf2f6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:25.113097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-707addff-012e-4579-b411-b24f8348f1cc tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:25.115787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-707addff-012e-4579-b411-b24f8348f1cc tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:25.118208 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2926/5804] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:24 2022] DELETE /identity/v3/roles/6003a5fcb1844a579ac718983cdbf2f6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:25.123050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ac2b8-75a9-4320-b4d8-82256f4e5037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:25.125612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c31ac2b8-75a9-4320-b4d8-82256f4e5037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:25.169829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ac2b8-75a9-4320-b4d8-82256f4e5037 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:25.299374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70b193-268c-41a6-b236-7e5995b595a7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549efd1cb1e54df9a739e59953e0715f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82da7b630410424a962055626fa46641', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:25.300490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70b193-268c-41a6-b236-7e5995b595a7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:25.301492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70b193-268c-41a6-b236-7e5995b595a7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:25.301948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70b193-268c-41a6-b236-7e5995b595a7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] PATH_INFO: `/v3/roles/c347f51961024f78b3063a3f928b2ac0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:25.303799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70b193-268c-41a6-b236-7e5995b595a7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c347f51961024f78b3063a3f928b2ac0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:25.305577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70b193-268c-41a6-b236-7e5995b595a7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:25.357336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e70b193-268c-41a6-b236-7e5995b595a7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invalidating the token cache because role c347f51961024f78b3063a3f928b2ac0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:25.357826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e70b193-268c-41a6-b236-7e5995b595a7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:25.359754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e70b193-268c-41a6-b236-7e5995b595a7 tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:25.367410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707addff-012e-4579-b411-b24f8348f1cc tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:25.367615 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2879/5805] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:25 2022] DELETE /identity/v3/roles/c347f51961024f78b3063a3f928b2ac0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:25.379718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-707addff-012e-4579-b411-b24f8348f1cc tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:25.411212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:25.509158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707addff-012e-4579-b411-b24f8348f1cc tempest-RolesV3TestJSON-1852994441 tempest-RolesV3TestJSON-1852994441-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:25.598129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36906dd2-d902-41c5-8a92-5d4acd804588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:25.599073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36906dd2-d902-41c5-8a92-5d4acd804588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:25.599335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36906dd2-d902-41c5-8a92-5d4acd804588 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:25.599964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36906dd2-d902-41c5-8a92-5d4acd804588 admin admin] PATH_INFO: `/v3/users/c3a31699cbf4402abbbc4c242bde4d26` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:25.601107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36906dd2-d902-41c5-8a92-5d4acd804588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3a31699cbf4402abbbc4c242bde4d26)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:25.603334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36906dd2-d902-41c5-8a92-5d4acd804588 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:25.689726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-36906dd2-d902-41c5-8a92-5d4acd804588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3a31699cbf4402abbbc4c242bde4d26'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:25.735575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-36906dd2-d902-41c5-8a92-5d4acd804588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3a31699cbf4402abbbc4c242bde4d26'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:25.736679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-36906dd2-d902-41c5-8a92-5d4acd804588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3a31699cbf4402abbbc4c242bde4d26'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:25.746541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-36906dd2-d902-41c5-8a92-5d4acd804588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3a31699cbf4402abbbc4c242bde4d26'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:25.747898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-36906dd2-d902-41c5-8a92-5d4acd804588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3a31699cbf4402abbbc4c242bde4d26'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:25.780556 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2927/5806] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:25 2022] DELETE /identity/v3/users/c3a31699cbf4402abbbc4c242bde4d26 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:25.785600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0458b91-7a7d-4bf4-a1b0-a34a076fea6d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:25.786518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0458b91-7a7d-4bf4-a1b0-a34a076fea6d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:25.786983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0458b91-7a7d-4bf4-a1b0-a34a076fea6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:25.827530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c0458b91-7a7d-4bf4-a1b0-a34a076fea6d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:25.835309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c0458b91-7a7d-4bf4-a1b0-a34a076fea6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:25.920555 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2880/5807] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:21:25.953552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36906dd2-d902-41c5-8a92-5d4acd804588 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:25.956358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-36906dd2-d902-41c5-8a92-5d4acd804588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:26.012868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:26.036716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36906dd2-d902-41c5-8a92-5d4acd804588 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:26.045432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0418d77-cc27-466c-af38-607518fb01cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:26.045432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0418d77-cc27-466c-af38-607518fb01cd service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:26.045432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0418d77-cc27-466c-af38-607518fb01cd service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:26.045432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0418d77-cc27-466c-af38-607518fb01cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:26.057360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0418d77-cc27-466c-af38-607518fb01cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:26.058881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0418d77-cc27-466c-af38-607518fb01cd service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:26.072021 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2928/5808] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:21:27.447105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0458b91-7a7d-4bf4-a1b0-a34a076fea6d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:27.450615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c0458b91-7a7d-4bf4-a1b0-a34a076fea6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:27.487273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0458b91-7a7d-4bf4-a1b0-a34a076fea6d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:27.509458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae1c15-3567-41ab-b7d0-15163d086b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:27.511911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae1c15-3567-41ab-b7d0-15163d086b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:27.512962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae1c15-3567-41ab-b7d0-15163d086b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:27.513475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae1c15-3567-41ab-b7d0-15163d086b76 admin admin] PATH_INFO: `/v3/projects/4df1c886bba342ec9d5f80936df09047` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:27.519205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae1c15-3567-41ab-b7d0-15163d086b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4df1c886bba342ec9d5f80936df09047)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:27.534517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae1c15-3567-41ab-b7d0-15163d086b76 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:27.658026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:27.700446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2ae1c15-3567-41ab-b7d0-15163d086b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4df1c886bba342ec9d5f80936df09047', 'request_id': 'req-c2ae1c15-3567-41ab-b7d0-15163d086b76'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:27.715768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2ae1c15-3567-41ab-b7d0-15163d086b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4df1c886bba342ec9d5f80936df09047', 'request_id': 'req-c2ae1c15-3567-41ab-b7d0-15163d086b76'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:27.725932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2ae1c15-3567-41ab-b7d0-15163d086b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4df1c886bba342ec9d5f80936df09047', 'request_id': 'req-c2ae1c15-3567-41ab-b7d0-15163d086b76'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:27.743375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2ae1c15-3567-41ab-b7d0-15163d086b76 admin admin] The token cache is being invalidate because project 4df1c886bba342ec9d5f80936df09047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:27.744277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2ae1c15-3567-41ab-b7d0-15163d086b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:27.745694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c2ae1c15-3567-41ab-b7d0-15163d086b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:27.751378 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2881/5809] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:27 2022] DELETE /identity/v3/projects/4df1c886bba342ec9d5f80936df09047 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:27.754579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0418d77-cc27-466c-af38-607518fb01cd service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:27.786506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0418d77-cc27-466c-af38-607518fb01cd service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:27.926102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b8386-0a3f-4a9f-b37b-eb699e201c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:27.927086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b8386-0a3f-4a9f-b37b-eb699e201c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:27.927477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b8386-0a3f-4a9f-b37b-eb699e201c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:27.927827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b8386-0a3f-4a9f-b37b-eb699e201c7a admin admin] PATH_INFO: `/v3/users/549efd1cb1e54df9a739e59953e0715f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:27.929840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b8386-0a3f-4a9f-b37b-eb699e201c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=549efd1cb1e54df9a739e59953e0715f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:27.933204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b8386-0a3f-4a9f-b37b-eb699e201c7a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:28.052108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-408b8386-0a3f-4a9f-b37b-eb699e201c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549efd1cb1e54df9a739e59953e0715f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:28.095928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-408b8386-0a3f-4a9f-b37b-eb699e201c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549efd1cb1e54df9a739e59953e0715f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:28.097097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-408b8386-0a3f-4a9f-b37b-eb699e201c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549efd1cb1e54df9a739e59953e0715f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:28.107880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-408b8386-0a3f-4a9f-b37b-eb699e201c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549efd1cb1e54df9a739e59953e0715f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:28.108930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-408b8386-0a3f-4a9f-b37b-eb699e201c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549efd1cb1e54df9a739e59953e0715f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:28.145862 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2929/5810] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:27 2022] DELETE /identity/v3/users/549efd1cb1e54df9a739e59953e0715f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:21:29.451992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae1c15-3567-41ab-b7d0-15163d086b76 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:29.454088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c2ae1c15-3567-41ab-b7d0-15163d086b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:29.475498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae1c15-3567-41ab-b7d0-15163d086b76 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:29.670641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58339929-7ca3-45ea-8342-53f0b1aed266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:29.672975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58339929-7ca3-45ea-8342-53f0b1aed266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:29.673433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58339929-7ca3-45ea-8342-53f0b1aed266 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:29.673865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58339929-7ca3-45ea-8342-53f0b1aed266 admin admin] PATH_INFO: `/v3/projects/82da7b630410424a962055626fa46641` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:29.676068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58339929-7ca3-45ea-8342-53f0b1aed266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82da7b630410424a962055626fa46641)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:29.678242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58339929-7ca3-45ea-8342-53f0b1aed266 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:29.762668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-58339929-7ca3-45ea-8342-53f0b1aed266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82da7b630410424a962055626fa46641', 'request_id': 'req-58339929-7ca3-45ea-8342-53f0b1aed266'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:29.787114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-58339929-7ca3-45ea-8342-53f0b1aed266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82da7b630410424a962055626fa46641', 'request_id': 'req-58339929-7ca3-45ea-8342-53f0b1aed266'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:29.800490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-58339929-7ca3-45ea-8342-53f0b1aed266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82da7b630410424a962055626fa46641', 'request_id': 'req-58339929-7ca3-45ea-8342-53f0b1aed266'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:29.829516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-58339929-7ca3-45ea-8342-53f0b1aed266 admin admin] The token cache is being invalidate because project 82da7b630410424a962055626fa46641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:29.829818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-58339929-7ca3-45ea-8342-53f0b1aed266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:29.833710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-58339929-7ca3-45ea-8342-53f0b1aed266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:29.836331 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2882/5811] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:29 2022] DELETE /identity/v3/projects/82da7b630410424a962055626fa46641 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:29.842580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d171a-0f81-4c5f-9fd6-aee3e91b998f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:29.843110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d171a-0f81-4c5f-9fd6-aee3e91b998f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:29.844503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d171a-0f81-4c5f-9fd6-aee3e91b998f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:29.878409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-cf0d171a-0f81-4c5f-9fd6-aee3e91b998f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:29.880113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cf0d171a-0f81-4c5f-9fd6-aee3e91b998f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:29.973992 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2930/5812] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:29.981557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6d39b-1a1d-4e8c-b285-9adc7d823961 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:29.981854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6d39b-1a1d-4e8c-b285-9adc7d823961 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:29.982125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6d39b-1a1d-4e8c-b285-9adc7d823961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:30.006445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c2a6d39b-1a1d-4e8c-b285-9adc7d823961 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:30.010947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c2a6d39b-1a1d-4e8c-b285-9adc7d823961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:30.021950 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2883/5813] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:30.025934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d171a-0f81-4c5f-9fd6-aee3e91b998f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:30.034342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:30.043953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d171a-0f81-4c5f-9fd6-aee3e91b998f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:30.053759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6451bdf-d465-412a-94e6-8e3cfa9614f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:30.054438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6451bdf-d465-412a-94e6-8e3cfa9614f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:30.054764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6451bdf-d465-412a-94e6-8e3cfa9614f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:30.056818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6451bdf-d465-412a-94e6-8e3cfa9614f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:30.056818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6451bdf-d465-412a-94e6-8e3cfa9614f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:21:30.057037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6451bdf-d465-412a-94e6-8e3cfa9614f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:30.060303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6451bdf-d465-412a-94e6-8e3cfa9614f1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:30.076508 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2931/5814] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:30.089948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6d39b-1a1d-4e8c-b285-9adc7d823961 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:30.114053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6d39b-1a1d-4e8c-b285-9adc7d823961 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:30.119014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5ca74-6df5-48c0-b7c5-a162f1cef3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:30.120141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5ca74-6df5-48c0-b7c5-a162f1cef3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:30.120141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5ca74-6df5-48c0-b7c5-a162f1cef3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:30.121011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5ca74-6df5-48c0-b7c5-a162f1cef3e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:30.121848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5ca74-6df5-48c0-b7c5-a162f1cef3e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:30.124104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5ca74-6df5-48c0-b7c5-a162f1cef3e6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:30.159778 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2884/5815] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:21:30 2022] POST /identity/v3/projects => generated 397 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:30.165473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6451bdf-d465-412a-94e6-8e3cfa9614f1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:30.180979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6451bdf-d465-412a-94e6-8e3cfa9614f1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:30.273549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8795a8b-c3e5-4839-9453-eb348d8cf13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:30.275387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8795a8b-c3e5-4839-9453-eb348d8cf13f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:30.275745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8795a8b-c3e5-4839-9453-eb348d8cf13f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:30.276030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8795a8b-c3e5-4839-9453-eb348d8cf13f admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:30.276711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8795a8b-c3e5-4839-9453-eb348d8cf13f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:30.278681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8795a8b-c3e5-4839-9453-eb348d8cf13f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:30.310700 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2932/5816] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:21:30 2022] POST /identity/v3/users => generated 305 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:21:30.312315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5ca74-6df5-48c0-b7c5-a162f1cef3e6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:30.324021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5ca74-6df5-48c0-b7c5-a162f1cef3e6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:30.329261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232e995-b8d0-4788-9676-ada1523ec92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:30.329978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232e995-b8d0-4788-9676-ada1523ec92a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:30.330401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232e995-b8d0-4788-9676-ada1523ec92a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:30.330751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232e995-b8d0-4788-9676-ada1523ec92a admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:30.331545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232e995-b8d0-4788-9676-ada1523ec92a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:30.333609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232e995-b8d0-4788-9676-ada1523ec92a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:30.352908 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2885/5817] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:30.364738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8795a8b-c3e5-4839-9453-eb348d8cf13f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:30.378392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8795a8b-c3e5-4839-9453-eb348d8cf13f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:30.385282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a6b71-562c-44fd-9245-4871becdd524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:30.386132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a6b71-562c-44fd-9245-4871becdd524 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:30.386511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a6b71-562c-44fd-9245-4871becdd524 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:30.386889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a6b71-562c-44fd-9245-4871becdd524 admin admin] PATH_INFO: `/v3/projects/1f43e804b43e4912a9377d41f807c5f5/users/204b3a4e22e94807bb5de07eb7064fc9/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:30.415403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a6b71-562c-44fd-9245-4871becdd524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f43e804b43e4912a9377d41f807c5f5, user_id=204b3a4e22e94807bb5de07eb7064fc9, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:30.419901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a6b71-562c-44fd-9245-4871becdd524 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:30.443023 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2933/5818] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:30 2022] PUT /identity/v3/projects/1f43e804b43e4912a9377d41f807c5f5/users/204b3a4e22e94807bb5de07eb7064fc9/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:21:30.448302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232e995-b8d0-4788-9676-ada1523ec92a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:30.457866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:30.465144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232e995-b8d0-4788-9676-ada1523ec92a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:30.549517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a28c2-0590-43e8-85a8-c725dc57e784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:30.550594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a28c2-0590-43e8-85a8-c725dc57e784 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:30.551842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a28c2-0590-43e8-85a8-c725dc57e784 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:30.552441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a28c2-0590-43e8-85a8-c725dc57e784 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:30.553457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a28c2-0590-43e8-85a8-c725dc57e784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:30.555872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a28c2-0590-43e8-85a8-c725dc57e784 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:30.575367 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2886/5819] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:30.576540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a6b71-562c-44fd-9245-4871becdd524 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:30.589896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a6b71-562c-44fd-9245-4871becdd524 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:30.596355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbf066-6c92-466b-825c-96bfba1aab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:30.597054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbf066-6c92-466b-825c-96bfba1aab8d admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:30.597338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbf066-6c92-466b-825c-96bfba1aab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:30.597608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbf066-6c92-466b-825c-96bfba1aab8d admin admin] PATH_INFO: `/v3/projects/1f43e804b43e4912a9377d41f807c5f5/users/204b3a4e22e94807bb5de07eb7064fc9/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:30.600052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbf066-6c92-466b-825c-96bfba1aab8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f43e804b43e4912a9377d41f807c5f5, user_id=204b3a4e22e94807bb5de07eb7064fc9, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:30.602664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbf066-6c92-466b-825c-96bfba1aab8d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:30.625344 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2934/5820] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:30 2022] PUT /identity/v3/projects/1f43e804b43e4912a9377d41f807c5f5/users/204b3a4e22e94807bb5de07eb7064fc9/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:30.627756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20e699-1742-4d0b-bdf7-b052598a84c7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:30.628307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20e699-1742-4d0b-bdf7-b052598a84c7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:30.628618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20e699-1742-4d0b-bdf7-b052598a84c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:30.664816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-cd20e699-1742-4d0b-bdf7-b052598a84c7 None None] MFA Rules not processed for user `204b3a4e22e94807bb5de07eb7064fc9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:30.666189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cd20e699-1742-4d0b-bdf7-b052598a84c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:30.787996 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2887/5821] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:30.789147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbf066-6c92-466b-825c-96bfba1aab8d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:30.874303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbf066-6c92-466b-825c-96bfba1aab8d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:30.884798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148ff17-645a-4112-90ec-0e3480028d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:30.885452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148ff17-645a-4112-90ec-0e3480028d30 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:30.885882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148ff17-645a-4112-90ec-0e3480028d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:30.886168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148ff17-645a-4112-90ec-0e3480028d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:30.887118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148ff17-645a-4112-90ec-0e3480028d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:30.890784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148ff17-645a-4112-90ec-0e3480028d30 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:30.951220 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2935/5822] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:21:30 2022] POST /identity/v3/projects => generated 397 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:30.952207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20e699-1742-4d0b-bdf7-b052598a84c7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:30.967874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20e699-1742-4d0b-bdf7-b052598a84c7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:31.112830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41393dce-0be4-4f76-804d-0fb0afdc8265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:31.112830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41393dce-0be4-4f76-804d-0fb0afdc8265 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:31.112830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41393dce-0be4-4f76-804d-0fb0afdc8265 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:31.112830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41393dce-0be4-4f76-804d-0fb0afdc8265 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:31.113282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41393dce-0be4-4f76-804d-0fb0afdc8265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:31.115154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41393dce-0be4-4f76-804d-0fb0afdc8265 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:31.156360 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2888/5823] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:21:30 2022] POST /identity/v3/users => generated 299 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:31.156885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148ff17-645a-4112-90ec-0e3480028d30 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:31.171010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148ff17-645a-4112-90ec-0e3480028d30 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:31.188260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5b4a0-8433-447a-9fd2-90045112afbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:31.189341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5b4a0-8433-447a-9fd2-90045112afbf admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:31.189684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5b4a0-8433-447a-9fd2-90045112afbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:31.190041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5b4a0-8433-447a-9fd2-90045112afbf admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:31.191158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5b4a0-8433-447a-9fd2-90045112afbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:31.192827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5b4a0-8433-447a-9fd2-90045112afbf admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:31.207618 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2936/5824] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:31.208646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41393dce-0be4-4f76-804d-0fb0afdc8265 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:31.230786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41393dce-0be4-4f76-804d-0fb0afdc8265 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:31.244033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc69560-57f1-4a5e-a735-0a56968154c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:31.244957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc69560-57f1-4a5e-a735-0a56968154c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:31.245471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc69560-57f1-4a5e-a735-0a56968154c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:31.245990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc69560-57f1-4a5e-a735-0a56968154c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:31.246910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc69560-57f1-4a5e-a735-0a56968154c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:31.248755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc69560-57f1-4a5e-a735-0a56968154c2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:31.270063 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2889/5825] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:31.274130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5b4a0-8433-447a-9fd2-90045112afbf admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:31.287045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5b4a0-8433-447a-9fd2-90045112afbf admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:31.298769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d71d5f-e538-4012-9177-c6267a757295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:31.299541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d71d5f-e538-4012-9177-c6267a757295 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:31.299838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d71d5f-e538-4012-9177-c6267a757295 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:31.300119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d71d5f-e538-4012-9177-c6267a757295 admin admin] PATH_INFO: `/v3/projects/7bea5874e2944250a9f4c44a8f435871/users/f8ebd2d392af4a7db78eb24072b66763/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:31.333275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:31.336530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d71d5f-e538-4012-9177-c6267a757295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bea5874e2944250a9f4c44a8f435871, user_id=f8ebd2d392af4a7db78eb24072b66763, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:31.339327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d71d5f-e538-4012-9177-c6267a757295 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:31.372300 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2937/5826] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:31 2022] PUT /identity/v3/projects/7bea5874e2944250a9f4c44a8f435871/users/f8ebd2d392af4a7db78eb24072b66763/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:31.386879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de4b09-a877-476a-9f31-b6628222cbfc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:31.387836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de4b09-a877-476a-9f31-b6628222cbfc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:31.388330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de4b09-a877-476a-9f31-b6628222cbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:31.404483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:31.442447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-57de4b09-a877-476a-9f31-b6628222cbfc None None] MFA Rules not processed for user `f8ebd2d392af4a7db78eb24072b66763`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:31.444253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-57de4b09-a877-476a-9f31-b6628222cbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:31.581735 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2890/5827] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:31.596261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d71d5f-e538-4012-9177-c6267a757295 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:31.598052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-83d71d5f-e538-4012-9177-c6267a757295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:31.738856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d71d5f-e538-4012-9177-c6267a757295 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:31.744180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31572539-0bcd-4f47-afe6-472ea625f4f0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:31.745085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31572539-0bcd-4f47-afe6-472ea625f4f0 service glance] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:31.745455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31572539-0bcd-4f47-afe6-472ea625f4f0 service glance] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:31.745949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31572539-0bcd-4f47-afe6-472ea625f4f0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:31.837991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31572539-0bcd-4f47-afe6-472ea625f4f0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:31.839990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31572539-0bcd-4f47-afe6-472ea625f4f0 service glance] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:31.853849 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2938/5828] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:21:32.463172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de4b09-a877-476a-9f31-b6628222cbfc None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:32.607851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de4b09-a877-476a-9f31-b6628222cbfc None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:32.622965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a43fe2-435e-4a32-b55e-219f525a0c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:32.624146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a43fe2-435e-4a32-b55e-219f525a0c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:32.625423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a43fe2-435e-4a32-b55e-219f525a0c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:32.625913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a43fe2-435e-4a32-b55e-219f525a0c42 admin admin] PATH_INFO: `/v3/users/204b3a4e22e94807bb5de07eb7064fc9` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:32.629540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a43fe2-435e-4a32-b55e-219f525a0c42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=204b3a4e22e94807bb5de07eb7064fc9)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:32.638558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a43fe2-435e-4a32-b55e-219f525a0c42 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:32.732173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b1a43fe2-435e-4a32-b55e-219f525a0c42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '204b3a4e22e94807bb5de07eb7064fc9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:32.733227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b1a43fe2-435e-4a32-b55e-219f525a0c42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '204b3a4e22e94807bb5de07eb7064fc9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:32.754749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b1a43fe2-435e-4a32-b55e-219f525a0c42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '204b3a4e22e94807bb5de07eb7064fc9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:32.755975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b1a43fe2-435e-4a32-b55e-219f525a0c42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '204b3a4e22e94807bb5de07eb7064fc9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:32.774407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b1a43fe2-435e-4a32-b55e-219f525a0c42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '204b3a4e22e94807bb5de07eb7064fc9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:32.815471 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2891/5829] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:32 2022] DELETE /identity/v3/users/204b3a4e22e94807bb5de07eb7064fc9 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:32.818121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f3d7d-94d0-4476-8699-fe07c4d6b97e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:32.818593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f3d7d-94d0-4476-8699-fe07c4d6b97e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:32.819063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f3d7d-94d0-4476-8699-fe07c4d6b97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:32.847347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-382f3d7d-94d0-4476-8699-fe07c4d6b97e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:32.849381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-382f3d7d-94d0-4476-8699-fe07c4d6b97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:32.967756 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2939/5830] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:33.012621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a43fe2-435e-4a32-b55e-219f525a0c42 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:33.014205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b1a43fe2-435e-4a32-b55e-219f525a0c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:33.049278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:33.112577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a43fe2-435e-4a32-b55e-219f525a0c42 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:33.117063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087107e-e4b5-41f3-b14a-61b723fcaa63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:33.117843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087107e-e4b5-41f3-b14a-61b723fcaa63 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:33.118190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087107e-e4b5-41f3-b14a-61b723fcaa63 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:33.118534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087107e-e4b5-41f3-b14a-61b723fcaa63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:33.130197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087107e-e4b5-41f3-b14a-61b723fcaa63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:33.131960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087107e-e4b5-41f3-b14a-61b723fcaa63 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:33.146449 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2892/5831] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:21:34.157090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f3d7d-94d0-4476-8699-fe07c4d6b97e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:34.163984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-382f3d7d-94d0-4476-8699-fe07c4d6b97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:34.202204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f3d7d-94d0-4476-8699-fe07c4d6b97e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:34.221629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f73cc-c22e-4055-8eec-25d7c9d66341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:34.222415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f73cc-c22e-4055-8eec-25d7c9d66341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:34.222773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f73cc-c22e-4055-8eec-25d7c9d66341 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:34.223128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f73cc-c22e-4055-8eec-25d7c9d66341 admin admin] PATH_INFO: `/v3/projects/1f43e804b43e4912a9377d41f807c5f5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:34.225970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f73cc-c22e-4055-8eec-25d7c9d66341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f43e804b43e4912a9377d41f807c5f5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:34.228468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f73cc-c22e-4055-8eec-25d7c9d66341 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:34.276537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:34.305903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-329f73cc-c22e-4055-8eec-25d7c9d66341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f43e804b43e4912a9377d41f807c5f5', 'request_id': 'req-329f73cc-c22e-4055-8eec-25d7c9d66341'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:34.315057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-329f73cc-c22e-4055-8eec-25d7c9d66341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f43e804b43e4912a9377d41f807c5f5', 'request_id': 'req-329f73cc-c22e-4055-8eec-25d7c9d66341'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:34.326845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-329f73cc-c22e-4055-8eec-25d7c9d66341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f43e804b43e4912a9377d41f807c5f5', 'request_id': 'req-329f73cc-c22e-4055-8eec-25d7c9d66341'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:34.342446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-329f73cc-c22e-4055-8eec-25d7c9d66341 admin admin] The token cache is being invalidate because project 1f43e804b43e4912a9377d41f807c5f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:34.342836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-329f73cc-c22e-4055-8eec-25d7c9d66341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:34.344369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-329f73cc-c22e-4055-8eec-25d7c9d66341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:34.347019 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2940/5832] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:34 2022] DELETE /identity/v3/projects/1f43e804b43e4912a9377d41f807c5f5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:34.350814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087107e-e4b5-41f3-b14a-61b723fcaa63 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:34.362407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087107e-e4b5-41f3-b14a-61b723fcaa63 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:34.430633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634174b2-c03d-437c-b920-db07d0041176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:34.431493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634174b2-c03d-437c-b920-db07d0041176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:34.431880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634174b2-c03d-437c-b920-db07d0041176 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:34.432266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634174b2-c03d-437c-b920-db07d0041176 admin admin] PATH_INFO: `/v3/users/f8ebd2d392af4a7db78eb24072b66763` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:34.433800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634174b2-c03d-437c-b920-db07d0041176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ebd2d392af4a7db78eb24072b66763)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:34.435975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634174b2-c03d-437c-b920-db07d0041176 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:34.495140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-634174b2-c03d-437c-b920-db07d0041176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ebd2d392af4a7db78eb24072b66763'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:34.496010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-634174b2-c03d-437c-b920-db07d0041176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ebd2d392af4a7db78eb24072b66763'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:34.512205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-634174b2-c03d-437c-b920-db07d0041176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ebd2d392af4a7db78eb24072b66763'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:34.513131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-634174b2-c03d-437c-b920-db07d0041176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ebd2d392af4a7db78eb24072b66763'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:34.523421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-634174b2-c03d-437c-b920-db07d0041176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ebd2d392af4a7db78eb24072b66763'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:34.544339 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2893/5833] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:34 2022] DELETE /identity/v3/users/f8ebd2d392af4a7db78eb24072b66763 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:35.241000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f73cc-c22e-4055-8eec-25d7c9d66341 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:35.242799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-329f73cc-c22e-4055-8eec-25d7c9d66341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:35.262223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f73cc-c22e-4055-8eec-25d7c9d66341 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:35.328767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401a866-751f-4710-b372-3a60aa8e953c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:35.329254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401a866-751f-4710-b372-3a60aa8e953c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:35.329542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401a866-751f-4710-b372-3a60aa8e953c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:35.329850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401a866-751f-4710-b372-3a60aa8e953c admin admin] PATH_INFO: `/v3/projects/7bea5874e2944250a9f4c44a8f435871` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:35.331052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401a866-751f-4710-b372-3a60aa8e953c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bea5874e2944250a9f4c44a8f435871)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:35.333011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401a866-751f-4710-b372-3a60aa8e953c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:35.397942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5401a866-751f-4710-b372-3a60aa8e953c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bea5874e2944250a9f4c44a8f435871', 'request_id': 'req-5401a866-751f-4710-b372-3a60aa8e953c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:35.405077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5401a866-751f-4710-b372-3a60aa8e953c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bea5874e2944250a9f4c44a8f435871', 'request_id': 'req-5401a866-751f-4710-b372-3a60aa8e953c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:35.423342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5401a866-751f-4710-b372-3a60aa8e953c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bea5874e2944250a9f4c44a8f435871', 'request_id': 'req-5401a866-751f-4710-b372-3a60aa8e953c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:35.439218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5401a866-751f-4710-b372-3a60aa8e953c admin admin] The token cache is being invalidate because project 7bea5874e2944250a9f4c44a8f435871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:35.439613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5401a866-751f-4710-b372-3a60aa8e953c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:35.440284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5401a866-751f-4710-b372-3a60aa8e953c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:35.441924 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2941/5834] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:35 2022] DELETE /identity/v3/projects/7bea5874e2944250a9f4c44a8f435871 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:35.447354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407d39-cb39-4d26-9bdf-6abebe6029e5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:35.447849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407d39-cb39-4d26-9bdf-6abebe6029e5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:35.448030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407d39-cb39-4d26-9bdf-6abebe6029e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:35.472032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-22407d39-cb39-4d26-9bdf-6abebe6029e5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:35.473265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-22407d39-cb39-4d26-9bdf-6abebe6029e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:35.516898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:35.555340 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2894/5835] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:21:35.562036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a5966-5f56-496a-b439-59bf0eede8c4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:35.563396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a5966-5f56-496a-b439-59bf0eede8c4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:35.563895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a5966-5f56-496a-b439-59bf0eede8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:35.588417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7c5a5966-5f56-496a-b439-59bf0eede8c4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:35.589533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7c5a5966-5f56-496a-b439-59bf0eede8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:35.615514 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2942/5836] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:35.617560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22407d39-cb39-4d26-9bdf-6abebe6029e5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:35.628819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22407d39-cb39-4d26-9bdf-6abebe6029e5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:35.634773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5584ab-7eae-46c8-a43b-dcb0fa72102f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:35.636207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5584ab-7eae-46c8-a43b-dcb0fa72102f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:35.636793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5584ab-7eae-46c8-a43b-dcb0fa72102f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:35.638630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5584ab-7eae-46c8-a43b-dcb0fa72102f admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:35.639575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5584ab-7eae-46c8-a43b-dcb0fa72102f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:21:35.639844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5584ab-7eae-46c8-a43b-dcb0fa72102f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:35.642081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5584ab-7eae-46c8-a43b-dcb0fa72102f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:35.659332 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2895/5837] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:35.662187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a5966-5f56-496a-b439-59bf0eede8c4 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:35.675557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a5966-5f56-496a-b439-59bf0eede8c4 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:35.681969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf541ea3-6a05-4506-a1b4-75d4f3b9310e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:35.682639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf541ea3-6a05-4506-a1b4-75d4f3b9310e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:35.683031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf541ea3-6a05-4506-a1b4-75d4f3b9310e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:35.683468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf541ea3-6a05-4506-a1b4-75d4f3b9310e admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:35.684249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf541ea3-6a05-4506-a1b4-75d4f3b9310e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:35.687459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf541ea3-6a05-4506-a1b4-75d4f3b9310e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:35.770666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5584ab-7eae-46c8-a43b-dcb0fa72102f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:35.772141 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2943/5838] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:21:35 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:35.789308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5584ab-7eae-46c8-a43b-dcb0fa72102f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:35.884992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f064d-02cd-4f17-8c95-426cc2ee102f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:35.889414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f064d-02cd-4f17-8c95-426cc2ee102f admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:35.890073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f064d-02cd-4f17-8c95-426cc2ee102f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:35.890602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f064d-02cd-4f17-8c95-426cc2ee102f admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:35.892995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f064d-02cd-4f17-8c95-426cc2ee102f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:35.896316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f064d-02cd-4f17-8c95-426cc2ee102f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:35.929726 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2896/5839] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:21:35 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:21:35.935833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf541ea3-6a05-4506-a1b4-75d4f3b9310e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:35.958319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf541ea3-6a05-4506-a1b4-75d4f3b9310e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:35.965669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c2754-fbdd-4956-b155-526b9d68981f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:35.967110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c2754-fbdd-4956-b155-526b9d68981f admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:35.967540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c2754-fbdd-4956-b155-526b9d68981f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:35.967833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c2754-fbdd-4956-b155-526b9d68981f admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:35.969423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c2754-fbdd-4956-b155-526b9d68981f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:35.971547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c2754-fbdd-4956-b155-526b9d68981f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:36.031719 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2944/5840] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:36.037078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f064d-02cd-4f17-8c95-426cc2ee102f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:36.048453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f064d-02cd-4f17-8c95-426cc2ee102f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:36.055897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79201ea6-253e-4299-b3fa-02c6190fd6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:36.057765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79201ea6-253e-4299-b3fa-02c6190fd6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:36.058086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79201ea6-253e-4299-b3fa-02c6190fd6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:36.058467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79201ea6-253e-4299-b3fa-02c6190fd6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:36.059192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79201ea6-253e-4299-b3fa-02c6190fd6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:36.060977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79201ea6-253e-4299-b3fa-02c6190fd6d7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:36.091840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c2754-fbdd-4956-b155-526b9d68981f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:36.105109 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2897/5841] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:36.111615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:36.120378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c2754-fbdd-4956-b155-526b9d68981f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:36.134235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6171a-f73f-49ec-96aa-1f87ee84ff99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:36.136099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6171a-f73f-49ec-96aa-1f87ee84ff99 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:36.136573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6171a-f73f-49ec-96aa-1f87ee84ff99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:36.144683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6171a-f73f-49ec-96aa-1f87ee84ff99 admin admin] PATH_INFO: `/v3/projects/22f8508cc1b34da08c4d41c92c965cda/users/95a9a51973ff4e038fbb8c9e2c370455/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:36.170311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6171a-f73f-49ec-96aa-1f87ee84ff99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f8508cc1b34da08c4d41c92c965cda, user_id=95a9a51973ff4e038fbb8c9e2c370455, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:36.185238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6171a-f73f-49ec-96aa-1f87ee84ff99 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:36.209245 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2945/5842] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:36 2022] PUT /identity/v3/projects/22f8508cc1b34da08c4d41c92c965cda/users/95a9a51973ff4e038fbb8c9e2c370455/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:36.225262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110eec1-047c-43fb-b2f8-fc27ab26f16b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:36.226882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110eec1-047c-43fb-b2f8-fc27ab26f16b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:36.226882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110eec1-047c-43fb-b2f8-fc27ab26f16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:36.268689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e110eec1-047c-43fb-b2f8-fc27ab26f16b None None] MFA Rules not processed for user `95a9a51973ff4e038fbb8c9e2c370455`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:36.270069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e110eec1-047c-43fb-b2f8-fc27ab26f16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:36.431130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6171a-f73f-49ec-96aa-1f87ee84ff99 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:36.450836 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2898/5843] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:36.569864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6171a-f73f-49ec-96aa-1f87ee84ff99 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:36.585962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c24201-5df7-45fa-94dc-ce1843d6a4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:36.586905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c24201-5df7-45fa-94dc-ce1843d6a4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:36.587412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c24201-5df7-45fa-94dc-ce1843d6a4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:36.587908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c24201-5df7-45fa-94dc-ce1843d6a4d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:36.588782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c24201-5df7-45fa-94dc-ce1843d6a4d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:36.592007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c24201-5df7-45fa-94dc-ce1843d6a4d2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:36.653391 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2946/5844] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:21:36 2022] POST /identity/v3/projects => generated 367 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:36.657472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110eec1-047c-43fb-b2f8-fc27ab26f16b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:36.669987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110eec1-047c-43fb-b2f8-fc27ab26f16b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:36.722474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:36.781906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b151c3-99d8-4769-ac35-af89ffe5851c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:36.782499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b151c3-99d8-4769-ac35-af89ffe5851c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:36.783083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b151c3-99d8-4769-ac35-af89ffe5851c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:36.783404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b151c3-99d8-4769-ac35-af89ffe5851c admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:36.786011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b151c3-99d8-4769-ac35-af89ffe5851c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:36.786435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b151c3-99d8-4769-ac35-af89ffe5851c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:36.829818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c24201-5df7-45fa-94dc-ce1843d6a4d2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:36.832316 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2899/5845] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:21:36 2022] POST /identity/v3/users => generated 284 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:36.843873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c24201-5df7-45fa-94dc-ce1843d6a4d2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:36.852544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111e9cd-81f8-4a3c-ac0b-0a91f2485314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:36.854093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111e9cd-81f8-4a3c-ac0b-0a91f2485314 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:36.854654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111e9cd-81f8-4a3c-ac0b-0a91f2485314 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:36.854856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111e9cd-81f8-4a3c-ac0b-0a91f2485314 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:36.855851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111e9cd-81f8-4a3c-ac0b-0a91f2485314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:36.859997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111e9cd-81f8-4a3c-ac0b-0a91f2485314 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:36.888465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b151c3-99d8-4769-ac35-af89ffe5851c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:36.901215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b151c3-99d8-4769-ac35-af89ffe5851c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:36.902117 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2947/5846] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:36.906547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ee962-78b9-44a3-9705-9e91779cc36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:36.907639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ee962-78b9-44a3-9705-9e91779cc36d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:36.907929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ee962-78b9-44a3-9705-9e91779cc36d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:36.908222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ee962-78b9-44a3-9705-9e91779cc36d admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:36.909137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ee962-78b9-44a3-9705-9e91779cc36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:36.912563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ee962-78b9-44a3-9705-9e91779cc36d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:36.937292 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2900/5847] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:36.938574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111e9cd-81f8-4a3c-ac0b-0a91f2485314 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:36.950747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111e9cd-81f8-4a3c-ac0b-0a91f2485314 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:36.957671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a375a48-91d4-4466-a6b4-57fe02926b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:36.958423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a375a48-91d4-4466-a6b4-57fe02926b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:36.958767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a375a48-91d4-4466-a6b4-57fe02926b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:36.959569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a375a48-91d4-4466-a6b4-57fe02926b07 admin admin] PATH_INFO: `/v3/projects/ad418c0b7c3a4ef48f0bf100d9dc576c/users/fb0d945979594e399e5a5ee46ef264f9/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:36.989112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a375a48-91d4-4466-a6b4-57fe02926b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad418c0b7c3a4ef48f0bf100d9dc576c, user_id=fb0d945979594e399e5a5ee46ef264f9, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:36.992603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a375a48-91d4-4466-a6b4-57fe02926b07 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:37.025944 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2948/5848] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:36 2022] PUT /identity/v3/projects/ad418c0b7c3a4ef48f0bf100d9dc576c/users/fb0d945979594e399e5a5ee46ef264f9/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:37.036969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dfe4d-aee8-4caf-b628-c04375cd65d2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:37.038534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dfe4d-aee8-4caf-b628-c04375cd65d2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:37.040356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dfe4d-aee8-4caf-b628-c04375cd65d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:37.119400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e11dfe4d-aee8-4caf-b628-c04375cd65d2 None None] MFA Rules not processed for user `fb0d945979594e399e5a5ee46ef264f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:37.121595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e11dfe4d-aee8-4caf-b628-c04375cd65d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:37.276209 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2901/5849] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:37.290699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a375a48-91d4-4466-a6b4-57fe02926b07 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:37.293495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1a375a48-91d4-4466-a6b4-57fe02926b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:37.473078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a375a48-91d4-4466-a6b4-57fe02926b07 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:37.484838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58af35-436d-48aa-9ef6-23e0c4485e56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:37.485792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58af35-436d-48aa-9ef6-23e0c4485e56 service glance] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:37.486118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58af35-436d-48aa-9ef6-23e0c4485e56 service glance] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:37.486983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58af35-436d-48aa-9ef6-23e0c4485e56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:37.623547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:37.651684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58af35-436d-48aa-9ef6-23e0c4485e56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:37.654476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58af35-436d-48aa-9ef6-23e0c4485e56 service glance] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:37.678225 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2949/5850] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:21:37.897497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11dfe4d-aee8-4caf-b628-c04375cd65d2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:37.922647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11dfe4d-aee8-4caf-b628-c04375cd65d2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:37.928400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889a8e1-9b46-495d-97f0-8a5d67337c40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:37.929949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889a8e1-9b46-495d-97f0-8a5d67337c40 service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:37.931136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889a8e1-9b46-495d-97f0-8a5d67337c40 service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:37.931881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889a8e1-9b46-495d-97f0-8a5d67337c40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:37.949530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889a8e1-9b46-495d-97f0-8a5d67337c40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:37.952129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889a8e1-9b46-495d-97f0-8a5d67337c40 service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:37.966380 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2902/5851] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:21:39.700226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58af35-436d-48aa-9ef6-23e0c4485e56 service glance] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:39.704481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-af58af35-436d-48aa-9ef6-23e0c4485e56 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:39.867883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58af35-436d-48aa-9ef6-23e0c4485e56 service glance] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:39.896085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c830f3-a03a-46fc-bcac-572c2c1332a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:39.897020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c830f3-a03a-46fc-bcac-572c2c1332a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:39.897428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c830f3-a03a-46fc-bcac-572c2c1332a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:39.899891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c830f3-a03a-46fc-bcac-572c2c1332a9 admin admin] PATH_INFO: `/v3/users/71c580205a4940afa7f4d1ede7073386` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:39.903305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c830f3-a03a-46fc-bcac-572c2c1332a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71c580205a4940afa7f4d1ede7073386)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:39.907144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c830f3-a03a-46fc-bcac-572c2c1332a9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:40.044993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-83c830f3-a03a-46fc-bcac-572c2c1332a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71c580205a4940afa7f4d1ede7073386'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:40.088653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-83c830f3-a03a-46fc-bcac-572c2c1332a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71c580205a4940afa7f4d1ede7073386'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:40.089921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-83c830f3-a03a-46fc-bcac-572c2c1332a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71c580205a4940afa7f4d1ede7073386'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:40.137164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-83c830f3-a03a-46fc-bcac-572c2c1332a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71c580205a4940afa7f4d1ede7073386'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:40.139567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-83c830f3-a03a-46fc-bcac-572c2c1332a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71c580205a4940afa7f4d1ede7073386'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:40.167689 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2950/5852] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:39 2022] DELETE /identity/v3/users/71c580205a4940afa7f4d1ede7073386 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:40.172438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cd9a3-c877-46dc-80fd-c85ca3036ca2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:40.173697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cd9a3-c877-46dc-80fd-c85ca3036ca2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:40.174248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cd9a3-c877-46dc-80fd-c85ca3036ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:40.190144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c830f3-a03a-46fc-bcac-572c2c1332a9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:40.191663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-83c830f3-a03a-46fc-bcac-572c2c1332a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:40.201819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b18cd9a3-c877-46dc-80fd-c85ca3036ca2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:40.203906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b18cd9a3-c877-46dc-80fd-c85ca3036ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:40.321291 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2903/5853] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:40.322194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cd9a3-c877-46dc-80fd-c85ca3036ca2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:40.323566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b18cd9a3-c877-46dc-80fd-c85ca3036ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:40.350650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cd9a3-c877-46dc-80fd-c85ca3036ca2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:40.362628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e1e61-f098-460f-9844-f96e1090eb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:40.363661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e1e61-f098-460f-9844-f96e1090eb66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:40.364057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e1e61-f098-460f-9844-f96e1090eb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:40.364455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e1e61-f098-460f-9844-f96e1090eb66 admin admin] PATH_INFO: `/v3/users/95a9a51973ff4e038fbb8c9e2c370455` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:40.366024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e1e61-f098-460f-9844-f96e1090eb66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a9a51973ff4e038fbb8c9e2c370455)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:40.369651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:40.375937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e1e61-f098-460f-9844-f96e1090eb66 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:40.387013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c830f3-a03a-46fc-bcac-572c2c1332a9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:40.402606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d5372-0a23-4c26-af0a-895846d368f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:40.403312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d5372-0a23-4c26-af0a-895846d368f1 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:40.403595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d5372-0a23-4c26-af0a-895846d368f1 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:40.403894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d5372-0a23-4c26-af0a-895846d368f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:40.407678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-654d5372-0a23-4c26-af0a-895846d368f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:40.428913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d5372-0a23-4c26-af0a-895846d368f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:40.430719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d5372-0a23-4c26-af0a-895846d368f1 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:40.433740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:40.461645 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2951/5854] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:21:40.463796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d5372-0a23-4c26-af0a-895846d368f1 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:40.467323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-654d5372-0a23-4c26-af0a-895846d368f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:40.552056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe3e1e61-f098-460f-9844-f96e1090eb66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a9a51973ff4e038fbb8c9e2c370455'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:40.553545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe3e1e61-f098-460f-9844-f96e1090eb66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a9a51973ff4e038fbb8c9e2c370455'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:40.586661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe3e1e61-f098-460f-9844-f96e1090eb66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a9a51973ff4e038fbb8c9e2c370455'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:40.587907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe3e1e61-f098-460f-9844-f96e1090eb66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a9a51973ff4e038fbb8c9e2c370455'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:40.616246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe3e1e61-f098-460f-9844-f96e1090eb66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a9a51973ff4e038fbb8c9e2c370455'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:40.636266 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2904/5855] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:40 2022] DELETE /identity/v3/users/95a9a51973ff4e038fbb8c9e2c370455 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:40.641793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ab74c-f8b2-4d16-8a21-ad2a24155e65 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:40.642264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ab74c-f8b2-4d16-8a21-ad2a24155e65 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:40.642461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ab74c-f8b2-4d16-8a21-ad2a24155e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:40.649908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d5372-0a23-4c26-af0a-895846d368f1 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:40.682738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-202ab74c-f8b2-4d16-8a21-ad2a24155e65 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:40.684111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-202ab74c-f8b2-4d16-8a21-ad2a24155e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:40.731884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfb48b-7c24-4db4-9a09-40a23e47cb1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:40.734212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfb48b-7c24-4db4-9a09-40a23e47cb1e service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:40.734883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfb48b-7c24-4db4-9a09-40a23e47cb1e service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:40.735998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfb48b-7c24-4db4-9a09-40a23e47cb1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:40.739020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-dbcfb48b-7c24-4db4-9a09-40a23e47cb1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:40.806137 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2905/5856] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:40.837890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ab74c-f8b2-4d16-8a21-ad2a24155e65 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:40.840000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-202ab74c-f8b2-4d16-8a21-ad2a24155e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:40.850232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcfb48b-7c24-4db4-9a09-40a23e47cb1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:40.851979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcfb48b-7c24-4db4-9a09-40a23e47cb1e service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:40.866682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ab74c-f8b2-4d16-8a21-ad2a24155e65 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:40.872705 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2952/5857] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:21:40.876915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e1e6a-2951-4f67-ac24-ebf43e49f502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:40.880668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e1e6a-2951-4f67-ac24-ebf43e49f502 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:40.880966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e1e6a-2951-4f67-ac24-ebf43e49f502 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:40.881131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e1e6a-2951-4f67-ac24-ebf43e49f502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:40.908447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e1e6a-2951-4f67-ac24-ebf43e49f502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:40.915651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e1e6a-2951-4f67-ac24-ebf43e49f502 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:40.945195 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2906/5858] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:21:41.700419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfb48b-7c24-4db4-9a09-40a23e47cb1e service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:41.701800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-dbcfb48b-7c24-4db4-9a09-40a23e47cb1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:41.744377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfb48b-7c24-4db4-9a09-40a23e47cb1e service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:41.755230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca3e8c-62ed-4259-9801-c8c95c77af41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:41.756873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca3e8c-62ed-4259-9801-c8c95c77af41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:41.760606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca3e8c-62ed-4259-9801-c8c95c77af41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:41.761382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca3e8c-62ed-4259-9801-c8c95c77af41 admin admin] PATH_INFO: `/v3/projects/1ba657cc1e8340da883099b39486582b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:41.763080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca3e8c-62ed-4259-9801-c8c95c77af41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ba657cc1e8340da883099b39486582b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:41.766054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca3e8c-62ed-4259-9801-c8c95c77af41 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:41.872492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5dca3e8c-62ed-4259-9801-c8c95c77af41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ba657cc1e8340da883099b39486582b', 'request_id': 'req-5dca3e8c-62ed-4259-9801-c8c95c77af41'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:41.874769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:41.886942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5dca3e8c-62ed-4259-9801-c8c95c77af41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ba657cc1e8340da883099b39486582b', 'request_id': 'req-5dca3e8c-62ed-4259-9801-c8c95c77af41'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:41.903259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5dca3e8c-62ed-4259-9801-c8c95c77af41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ba657cc1e8340da883099b39486582b', 'request_id': 'req-5dca3e8c-62ed-4259-9801-c8c95c77af41'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:41.907912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e1e6a-2951-4f67-ac24-ebf43e49f502 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:41.910770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7f8e1e6a-2951-4f67-ac24-ebf43e49f502 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:41.936865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e1e6a-2951-4f67-ac24-ebf43e49f502 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:41.948069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5dca3e8c-62ed-4259-9801-c8c95c77af41 admin admin] The token cache is being invalidate because project 1ba657cc1e8340da883099b39486582b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:41.948701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5dca3e8c-62ed-4259-9801-c8c95c77af41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:41.949928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5dca3e8c-62ed-4259-9801-c8c95c77af41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:41.954582 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2953/5859] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:41 2022] DELETE /identity/v3/projects/1ba657cc1e8340da883099b39486582b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:41.960366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf6d5c-430e-46e6-8402-b14007183f1b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:41.960980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf6d5c-430e-46e6-8402-b14007183f1b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:41.961427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf6d5c-430e-46e6-8402-b14007183f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:41.989967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f1bf6d5c-430e-46e6-8402-b14007183f1b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:41.991387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f1bf6d5c-430e-46e6-8402-b14007183f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:42.046744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb8876-4f7c-4ded-88fc-57f5a175a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:42.047717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb8876-4f7c-4ded-88fc-57f5a175a059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:42.048366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb8876-4f7c-4ded-88fc-57f5a175a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:42.048836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb8876-4f7c-4ded-88fc-57f5a175a059 admin admin] PATH_INFO: `/v3/projects/22f8508cc1b34da08c4d41c92c965cda` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:42.050360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb8876-4f7c-4ded-88fc-57f5a175a059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f8508cc1b34da08c4d41c92c965cda)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:42.053235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb8876-4f7c-4ded-88fc-57f5a175a059 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:42.107235 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2954/5860] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:42.116236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b832d9d-6bf4-4c7c-814b-90e5d18e3506 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:42.116987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b832d9d-6bf4-4c7c-814b-90e5d18e3506 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:42.117713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b832d9d-6bf4-4c7c-814b-90e5d18e3506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:42.121247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:42.150158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-26fb8876-4f7c-4ded-88fc-57f5a175a059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f8508cc1b34da08c4d41c92c965cda', 'request_id': 'req-26fb8876-4f7c-4ded-88fc-57f5a175a059'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:42.153085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9b832d9d-6bf4-4c7c-814b-90e5d18e3506 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:42.154924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9b832d9d-6bf4-4c7c-814b-90e5d18e3506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:42.170820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-26fb8876-4f7c-4ded-88fc-57f5a175a059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f8508cc1b34da08c4d41c92c965cda', 'request_id': 'req-26fb8876-4f7c-4ded-88fc-57f5a175a059'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:42.187565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-26fb8876-4f7c-4ded-88fc-57f5a175a059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f8508cc1b34da08c4d41c92c965cda', 'request_id': 'req-26fb8876-4f7c-4ded-88fc-57f5a175a059'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:42.203826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-26fb8876-4f7c-4ded-88fc-57f5a175a059 admin admin] The token cache is being invalidate because project 22f8508cc1b34da08c4d41c92c965cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:42.204513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-26fb8876-4f7c-4ded-88fc-57f5a175a059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:42.205451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-26fb8876-4f7c-4ded-88fc-57f5a175a059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:42.207818 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2907/5861] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:41 2022] DELETE /identity/v3/projects/22f8508cc1b34da08c4d41c92c965cda => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:42.211422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb8876-4f7c-4ded-88fc-57f5a175a059 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:42.213121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-26fb8876-4f7c-4ded-88fc-57f5a175a059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:42.235244 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2955/5862] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:42.240127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b832d9d-6bf4-4c7c-814b-90e5d18e3506 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:42.252139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b832d9d-6bf4-4c7c-814b-90e5d18e3506 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:42.258673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f270f6-12c4-4539-9e18-85265084e0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:42.259654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f270f6-12c4-4539-9e18-85265084e0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:42.259957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f270f6-12c4-4539-9e18-85265084e0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:42.260348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f270f6-12c4-4539-9e18-85265084e0a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:42.261096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f270f6-12c4-4539-9e18-85265084e0a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:21:42.261385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f270f6-12c4-4539-9e18-85265084e0a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:42.263104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f270f6-12c4-4539-9e18-85265084e0a6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:42.284877 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2956/5863] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:21:42.286461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f270f6-12c4-4539-9e18-85265084e0a6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:42.298933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f270f6-12c4-4539-9e18-85265084e0a6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:42.304822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85091761-1b8a-4cf2-8f40-f274ea5eb29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:42.305767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85091761-1b8a-4cf2-8f40-f274ea5eb29b admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:42.306059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85091761-1b8a-4cf2-8f40-f274ea5eb29b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:42.306338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85091761-1b8a-4cf2-8f40-f274ea5eb29b admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:42.307011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85091761-1b8a-4cf2-8f40-f274ea5eb29b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:42.308958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85091761-1b8a-4cf2-8f40-f274ea5eb29b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:42.316484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb8876-4f7c-4ded-88fc-57f5a175a059 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:42.324322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00021f3c-eb28-401b-bb4d-1b0d21548504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:42.324666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00021f3c-eb28-401b-bb4d-1b0d21548504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:42.325410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00021f3c-eb28-401b-bb4d-1b0d21548504 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:42.325410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00021f3c-eb28-401b-bb4d-1b0d21548504 admin admin] PATH_INFO: `/v3/users/fb0d945979594e399e5a5ee46ef264f9` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:42.327368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00021f3c-eb28-401b-bb4d-1b0d21548504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb0d945979594e399e5a5ee46ef264f9)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:42.329681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00021f3c-eb28-401b-bb4d-1b0d21548504 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:42.344295 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2957/5864] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:21:42 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:21:42.348584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85091761-1b8a-4cf2-8f40-f274ea5eb29b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:42.388112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-00021f3c-eb28-401b-bb4d-1b0d21548504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb0d945979594e399e5a5ee46ef264f9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:42.389354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-00021f3c-eb28-401b-bb4d-1b0d21548504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb0d945979594e399e5a5ee46ef264f9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:42.406705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-00021f3c-eb28-401b-bb4d-1b0d21548504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb0d945979594e399e5a5ee46ef264f9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:42.407496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-00021f3c-eb28-401b-bb4d-1b0d21548504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb0d945979594e399e5a5ee46ef264f9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:42.409636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:42.416957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-00021f3c-eb28-401b-bb4d-1b0d21548504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb0d945979594e399e5a5ee46ef264f9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:42.435331 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2908/5865] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:42 2022] DELETE /identity/v3/users/fb0d945979594e399e5a5ee46ef264f9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:42.437892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85091761-1b8a-4cf2-8f40-f274ea5eb29b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:42.517155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc28fc-a510-4223-a19d-00b573f80ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:42.517815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc28fc-a510-4223-a19d-00b573f80ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:42.518092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc28fc-a510-4223-a19d-00b573f80ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:42.518397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc28fc-a510-4223-a19d-00b573f80ef4 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:42.519061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc28fc-a510-4223-a19d-00b573f80ef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:42.521611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc28fc-a510-4223-a19d-00b573f80ef4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:42.551665 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2958/5866] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:21:42 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:42.553874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00021f3c-eb28-401b-bb4d-1b0d21548504 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:42.555562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-00021f3c-eb28-401b-bb4d-1b0d21548504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:42.572520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00021f3c-eb28-401b-bb4d-1b0d21548504 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:42.578116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2189d41-a1b1-4c04-818b-fbe31d86076f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:42.578315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2189d41-a1b1-4c04-818b-fbe31d86076f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:42.578586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2189d41-a1b1-4c04-818b-fbe31d86076f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:42.578863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2189d41-a1b1-4c04-818b-fbe31d86076f admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:42.579602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2189d41-a1b1-4c04-818b-fbe31d86076f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:42.581250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2189d41-a1b1-4c04-818b-fbe31d86076f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:42.593444 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2909/5867] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:42.598095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc28fc-a510-4223-a19d-00b573f80ef4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:42.614996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc28fc-a510-4223-a19d-00b573f80ef4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:42.620916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24799c56-9f38-44c8-a030-75a664f7e68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:42.621158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24799c56-9f38-44c8-a030-75a664f7e68b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:42.622185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24799c56-9f38-44c8-a030-75a664f7e68b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:42.622185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24799c56-9f38-44c8-a030-75a664f7e68b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:42.623112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24799c56-9f38-44c8-a030-75a664f7e68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:42.625271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24799c56-9f38-44c8-a030-75a664f7e68b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:42.649352 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2959/5868] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:42.650656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2189d41-a1b1-4c04-818b-fbe31d86076f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:42.690504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2189d41-a1b1-4c04-818b-fbe31d86076f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:42.705313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bc14f-6d02-46b4-a8a3-6a0bde850785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:42.706927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bc14f-6d02-46b4-a8a3-6a0bde850785 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:42.707448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bc14f-6d02-46b4-a8a3-6a0bde850785 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:42.707978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bc14f-6d02-46b4-a8a3-6a0bde850785 admin admin] PATH_INFO: `/v3/projects/c18fb03498c84b268fc33a8f1acbfcb3/users/2152c6020c354e65919434a7c3019df9/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:42.733605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bc14f-6d02-46b4-a8a3-6a0bde850785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c18fb03498c84b268fc33a8f1acbfcb3, user_id=2152c6020c354e65919434a7c3019df9, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:42.739254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bc14f-6d02-46b4-a8a3-6a0bde850785 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:42.755777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:42.774159 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2910/5869] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:42 2022] PUT /identity/v3/projects/c18fb03498c84b268fc33a8f1acbfcb3/users/2152c6020c354e65919434a7c3019df9/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:42.776334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32f612-7aca-4f8b-af00-a8fe4c4673dd None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:42.776794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32f612-7aca-4f8b-af00-a8fe4c4673dd None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:42.778037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32f612-7aca-4f8b-af00-a8fe4c4673dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:42.826886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-cb32f612-7aca-4f8b-af00-a8fe4c4673dd None None] MFA Rules not processed for user `2152c6020c354e65919434a7c3019df9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:42.828994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cb32f612-7aca-4f8b-af00-a8fe4c4673dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:42.923242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bc14f-6d02-46b4-a8a3-6a0bde850785 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:42.925920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-962bc14f-6d02-46b4-a8a3-6a0bde850785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:42.968543 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2960/5870] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:42.985796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32f612-7aca-4f8b-af00-a8fe4c4673dd None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:42.988222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cb32f612-7aca-4f8b-af00-a8fe4c4673dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:43.045161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bc14f-6d02-46b4-a8a3-6a0bde850785 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:43.051640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f989c-6f78-4843-9bb9-5b07b3a23b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:43.052442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f989c-6f78-4843-9bb9-5b07b3a23b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:43.052812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f989c-6f78-4843-9bb9-5b07b3a23b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:43.053138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f989c-6f78-4843-9bb9-5b07b3a23b85 admin admin] PATH_INFO: `/v3/projects/ad418c0b7c3a4ef48f0bf100d9dc576c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:43.055428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f989c-6f78-4843-9bb9-5b07b3a23b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad418c0b7c3a4ef48f0bf100d9dc576c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:43.058680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f989c-6f78-4843-9bb9-5b07b3a23b85 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:43.122946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32f612-7aca-4f8b-af00-a8fe4c4673dd None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:43.158937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:43.183949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1c7f989c-6f78-4843-9bb9-5b07b3a23b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad418c0b7c3a4ef48f0bf100d9dc576c', 'request_id': 'req-1c7f989c-6f78-4843-9bb9-5b07b3a23b85'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:43.201057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1c7f989c-6f78-4843-9bb9-5b07b3a23b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad418c0b7c3a4ef48f0bf100d9dc576c', 'request_id': 'req-1c7f989c-6f78-4843-9bb9-5b07b3a23b85'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:43.235323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1c7f989c-6f78-4843-9bb9-5b07b3a23b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad418c0b7c3a4ef48f0bf100d9dc576c', 'request_id': 'req-1c7f989c-6f78-4843-9bb9-5b07b3a23b85'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:43.245524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39556fa-6dfe-49b9-8450-a31b1f793b48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:43.246495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39556fa-6dfe-49b9-8450-a31b1f793b48 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:43.247031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39556fa-6dfe-49b9-8450-a31b1f793b48 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:43.247577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39556fa-6dfe-49b9-8450-a31b1f793b48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:43.256525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1c7f989c-6f78-4843-9bb9-5b07b3a23b85 admin admin] The token cache is being invalidate because project ad418c0b7c3a4ef48f0bf100d9dc576c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:43.258083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1c7f989c-6f78-4843-9bb9-5b07b3a23b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:43.258538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1c7f989c-6f78-4843-9bb9-5b07b3a23b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:43.276044 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2911/5871] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:42 2022] DELETE /identity/v3/projects/ad418c0b7c3a4ef48f0bf100d9dc576c => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:43.287943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910ec38-ab24-4dae-9dab-f29b4ec6f73c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:43.288473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910ec38-ab24-4dae-9dab-f29b4ec6f73c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:43.288855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910ec38-ab24-4dae-9dab-f29b4ec6f73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:43.335378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b910ec38-ab24-4dae-9dab-f29b4ec6f73c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:43.337632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b910ec38-ab24-4dae-9dab-f29b4ec6f73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:43.419219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39556fa-6dfe-49b9-8450-a31b1f793b48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:43.424374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39556fa-6dfe-49b9-8450-a31b1f793b48 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:43.448457 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2961/5872] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:21:43.480843 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2912/5873] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:43.491599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a821c-dd25-4ccb-8294-76a2a32311fc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:43.492011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a821c-dd25-4ccb-8294-76a2a32311fc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:43.492630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a821c-dd25-4ccb-8294-76a2a32311fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:43.519520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-6a4a821c-dd25-4ccb-8294-76a2a32311fc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:43.521880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6a4a821c-dd25-4ccb-8294-76a2a32311fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:43.535968 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2962/5874] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:43.540483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910ec38-ab24-4dae-9dab-f29b4ec6f73c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:43.557744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910ec38-ab24-4dae-9dab-f29b4ec6f73c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:43.565347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403e72a-0c0d-4a12-9e7b-39dc15e6a868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:43.566527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403e72a-0c0d-4a12-9e7b-39dc15e6a868 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:43.566870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403e72a-0c0d-4a12-9e7b-39dc15e6a868 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:43.567655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403e72a-0c0d-4a12-9e7b-39dc15e6a868 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:43.568726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403e72a-0c0d-4a12-9e7b-39dc15e6a868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:21:43.569437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403e72a-0c0d-4a12-9e7b-39dc15e6a868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:43.571616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403e72a-0c0d-4a12-9e7b-39dc15e6a868 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:43.590191 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2913/5875] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:43.597622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a821c-dd25-4ccb-8294-76a2a32311fc None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:43.611081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a821c-dd25-4ccb-8294-76a2a32311fc None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:43.618552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd2220-d323-4fd7-82ec-115d82ce0446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:43.619193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd2220-d323-4fd7-82ec-115d82ce0446 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:43.619604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd2220-d323-4fd7-82ec-115d82ce0446 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:43.620024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd2220-d323-4fd7-82ec-115d82ce0446 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:43.621312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd2220-d323-4fd7-82ec-115d82ce0446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:43.623616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd2220-d323-4fd7-82ec-115d82ce0446 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:43.691807 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2963/5876] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:21:43 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:43.698247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403e72a-0c0d-4a12-9e7b-39dc15e6a868 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:43.712707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403e72a-0c0d-4a12-9e7b-39dc15e6a868 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:43.728263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:43.804613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab86e55-2382-47e2-9bb5-87784cd0164a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:43.805256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab86e55-2382-47e2-9bb5-87784cd0164a admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:43.805547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab86e55-2382-47e2-9bb5-87784cd0164a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:43.805832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab86e55-2382-47e2-9bb5-87784cd0164a admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:43.806553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab86e55-2382-47e2-9bb5-87784cd0164a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:43.809526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab86e55-2382-47e2-9bb5-87784cd0164a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:43.827716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd2220-d323-4fd7-82ec-115d82ce0446 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:43.830998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-62dd2220-d323-4fd7-82ec-115d82ce0446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:43.852127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd2220-d323-4fd7-82ec-115d82ce0446 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:43.861247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf5497-7036-4176-abd9-ebedc5b3fc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:43.862629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf5497-7036-4176-abd9-ebedc5b3fc42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:43.863388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf5497-7036-4176-abd9-ebedc5b3fc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:43.867219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf5497-7036-4176-abd9-ebedc5b3fc42 admin admin] PATH_INFO: `/v3/users/c7210483238e44348a3b0bc69e09579f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:43.869116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf5497-7036-4176-abd9-ebedc5b3fc42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7210483238e44348a3b0bc69e09579f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:43.871937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf5497-7036-4176-abd9-ebedc5b3fc42 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:43.875358 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2914/5877] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:21:43 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:43.877460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab86e55-2382-47e2-9bb5-87784cd0164a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:43.904389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab86e55-2382-47e2-9bb5-87784cd0164a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:43.916515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc01b4-b91d-4f01-9268-708236f475c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:43.917496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc01b4-b91d-4f01-9268-708236f475c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:43.917792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc01b4-b91d-4f01-9268-708236f475c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:43.918112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc01b4-b91d-4f01-9268-708236f475c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:43.918832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc01b4-b91d-4f01-9268-708236f475c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:43.924943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc01b4-b91d-4f01-9268-708236f475c7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:43.946579 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2915/5878] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:43.948482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc01b4-b91d-4f01-9268-708236f475c7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:43.974779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc01b4-b91d-4f01-9268-708236f475c7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:43.985511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f6646-3b6c-4055-9b1b-ca34bd6d6adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:43.988033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f6646-3b6c-4055-9b1b-ca34bd6d6adc admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:43.988516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f6646-3b6c-4055-9b1b-ca34bd6d6adc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:43.989068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f6646-3b6c-4055-9b1b-ca34bd6d6adc admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:43.996742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f6646-3b6c-4055-9b1b-ca34bd6d6adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:44.004781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f6646-3b6c-4055-9b1b-ca34bd6d6adc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:44.035576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9ecf5497-7036-4176-abd9-ebedc5b3fc42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7210483238e44348a3b0bc69e09579f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:44.042992 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2916/5879] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:44.044005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f6646-3b6c-4055-9b1b-ca34bd6d6adc admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:44.053778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9ecf5497-7036-4176-abd9-ebedc5b3fc42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7210483238e44348a3b0bc69e09579f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:44.054633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9ecf5497-7036-4176-abd9-ebedc5b3fc42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7210483238e44348a3b0bc69e09579f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:44.060271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f6646-3b6c-4055-9b1b-ca34bd6d6adc admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:44.066706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9ecf5497-7036-4176-abd9-ebedc5b3fc42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7210483238e44348a3b0bc69e09579f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:44.067252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cb4d1-ee69-4886-8c98-af1512ca201b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:44.068072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cb4d1-ee69-4886-8c98-af1512ca201b admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:44.068304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9ecf5497-7036-4176-abd9-ebedc5b3fc42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7210483238e44348a3b0bc69e09579f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:44.068488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cb4d1-ee69-4886-8c98-af1512ca201b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:44.068935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cb4d1-ee69-4886-8c98-af1512ca201b admin admin] PATH_INFO: `/v3/projects/94c6d6d1474c42299edab069bb553866/users/3bc1a294fb01451bb5146921a9dd8262/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:44.093156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066cb4d1-ee69-4886-8c98-af1512ca201b admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c6d6d1474c42299edab069bb553866, user_id=3bc1a294fb01451bb5146921a9dd8262, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:44.098245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066cb4d1-ee69-4886-8c98-af1512ca201b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:44.105618 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2964/5880] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:43 2022] DELETE /identity/v3/users/c7210483238e44348a3b0bc69e09579f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:44.112927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27308d29-fa07-4660-b14a-f5a466656d28 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:44.113346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27308d29-fa07-4660-b14a-f5a466656d28 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:44.113925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27308d29-fa07-4660-b14a-f5a466656d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:44.132164 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2917/5881] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:44 2022] PUT /identity/v3/projects/94c6d6d1474c42299edab069bb553866/users/3bc1a294fb01451bb5146921a9dd8262/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:44.145643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad59c69-6ebd-4239-8f3d-d7725194351e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:44.146916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad59c69-6ebd-4239-8f3d-d7725194351e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:44.147410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad59c69-6ebd-4239-8f3d-d7725194351e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:44.164005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-27308d29-fa07-4660-b14a-f5a466656d28 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:44.165281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-27308d29-fa07-4660-b14a-f5a466656d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:44.186302 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:44.213785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-dad59c69-6ebd-4239-8f3d-d7725194351e None None] MFA Rules not processed for user `3bc1a294fb01451bb5146921a9dd8262`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:44.215176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dad59c69-6ebd-4239-8f3d-d7725194351e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:44.293841 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2965/5882] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:44.313863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27308d29-fa07-4660-b14a-f5a466656d28 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:44.315903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-27308d29-fa07-4660-b14a-f5a466656d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:44.373616 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2918/5883] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:44.375787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad59c69-6ebd-4239-8f3d-d7725194351e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:44.381140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dad59c69-6ebd-4239-8f3d-d7725194351e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:44.403449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad59c69-6ebd-4239-8f3d-d7725194351e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:44.412088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da492d-b592-4a72-9b0a-d5b302180dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:44.413104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da492d-b592-4a72-9b0a-d5b302180dcb admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:44.413821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da492d-b592-4a72-9b0a-d5b302180dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:44.414376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da492d-b592-4a72-9b0a-d5b302180dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:44.415359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da492d-b592-4a72-9b0a-d5b302180dcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:44.417981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da492d-b592-4a72-9b0a-d5b302180dcb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:44.422893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27308d29-fa07-4660-b14a-f5a466656d28 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:44.433255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252e7f6-4737-4421-b47a-44d71a3f3723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:44.433999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252e7f6-4737-4421-b47a-44d71a3f3723 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:44.434299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252e7f6-4737-4421-b47a-44d71a3f3723 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:44.434582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252e7f6-4737-4421-b47a-44d71a3f3723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:44.460896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252e7f6-4737-4421-b47a-44d71a3f3723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:44.466504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252e7f6-4737-4421-b47a-44d71a3f3723 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:44.474445 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2919/5884] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:21:44 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:44.475643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da492d-b592-4a72-9b0a-d5b302180dcb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:44.501247 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2966/5885] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:21:44.575175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:44.691360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da492d-b592-4a72-9b0a-d5b302180dcb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:44.716157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169bfe9-dae5-486e-a61a-70c40ff1eb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:44.716811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169bfe9-dae5-486e-a61a-70c40ff1eb86 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:44.717229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169bfe9-dae5-486e-a61a-70c40ff1eb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:44.717518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169bfe9-dae5-486e-a61a-70c40ff1eb86 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:44.720218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169bfe9-dae5-486e-a61a-70c40ff1eb86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:44.722217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169bfe9-dae5-486e-a61a-70c40ff1eb86 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:44.793953 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2920/5886] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:21:44 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:44.799359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252e7f6-4737-4421-b47a-44d71a3f3723 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:44.813175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252e7f6-4737-4421-b47a-44d71a3f3723 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:44.834997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c693d-726f-406a-be85-efb307f2f363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:44.837219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c693d-726f-406a-be85-efb307f2f363 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:44.837510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c693d-726f-406a-be85-efb307f2f363 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:44.839089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c693d-726f-406a-be85-efb307f2f363 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:44.843994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c693d-726f-406a-be85-efb307f2f363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:44.852036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c693d-726f-406a-be85-efb307f2f363 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:44.897471 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2967/5887] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:44.901166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169bfe9-dae5-486e-a61a-70c40ff1eb86 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:44.918422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169bfe9-dae5-486e-a61a-70c40ff1eb86 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:44.935797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabbb8d-d4d9-4710-9360-6cc1bbc9e1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:44.938154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabbb8d-d4d9-4710-9360-6cc1bbc9e1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:44.938657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabbb8d-d4d9-4710-9360-6cc1bbc9e1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:44.939144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabbb8d-d4d9-4710-9360-6cc1bbc9e1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:44.940191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabbb8d-d4d9-4710-9360-6cc1bbc9e1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:44.945653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabbb8d-d4d9-4710-9360-6cc1bbc9e1f4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:44.980528 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2921/5888] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:44.981927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c693d-726f-406a-be85-efb307f2f363 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:45.059958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c693d-726f-406a-be85-efb307f2f363 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:45.085191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabbb8d-d4d9-4710-9360-6cc1bbc9e1f4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:45.087902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-baabbb8d-d4d9-4710-9360-6cc1bbc9e1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:45.090759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2cd2a-101e-4616-8658-83768930999b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:45.101419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2cd2a-101e-4616-8658-83768930999b admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:45.108083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2cd2a-101e-4616-8658-83768930999b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:45.110812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabbb8d-d4d9-4710-9360-6cc1bbc9e1f4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:45.116909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2cd2a-101e-4616-8658-83768930999b admin admin] PATH_INFO: `/v3/projects/2d18559998f143d9a1d6927874adf7a6/users/78b36b806cff4b139de9849be82905d6/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:45.127837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ebbaa-1a52-4db2-9fdf-a5fe988fa80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:45.146861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ebbaa-1a52-4db2-9fdf-a5fe988fa80c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:45.147692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ebbaa-1a52-4db2-9fdf-a5fe988fa80c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:45.148209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ebbaa-1a52-4db2-9fdf-a5fe988fa80c admin admin] PATH_INFO: `/v3/projects/1f491880ac3e4b2f96c966fe114a7f80` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:45.153061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ebbaa-1a52-4db2-9fdf-a5fe988fa80c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f491880ac3e4b2f96c966fe114a7f80)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:45.160414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ebbaa-1a52-4db2-9fdf-a5fe988fa80c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:45.222156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2cd2a-101e-4616-8658-83768930999b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d18559998f143d9a1d6927874adf7a6, user_id=78b36b806cff4b139de9849be82905d6, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:45.225161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2cd2a-101e-4616-8658-83768930999b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:45.285997 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2968/5889] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:44 2022] PUT /identity/v3/projects/2d18559998f143d9a1d6927874adf7a6/users/78b36b806cff4b139de9849be82905d6/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:45.288280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f192b-3707-478b-8b3a-8711bf5b2167 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:45.288609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f192b-3707-478b-8b3a-8711bf5b2167 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:45.288945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f192b-3707-478b-8b3a-8711bf5b2167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:45.341536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e9ebbaa-1a52-4db2-9fdf-a5fe988fa80c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f491880ac3e4b2f96c966fe114a7f80', 'request_id': 'req-4e9ebbaa-1a52-4db2-9fdf-a5fe988fa80c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:45.359246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e9ebbaa-1a52-4db2-9fdf-a5fe988fa80c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f491880ac3e4b2f96c966fe114a7f80', 'request_id': 'req-4e9ebbaa-1a52-4db2-9fdf-a5fe988fa80c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:45.366669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e9ebbaa-1a52-4db2-9fdf-a5fe988fa80c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f491880ac3e4b2f96c966fe114a7f80', 'request_id': 'req-4e9ebbaa-1a52-4db2-9fdf-a5fe988fa80c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:45.367416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-001f192b-3707-478b-8b3a-8711bf5b2167 None None] MFA Rules not processed for user `78b36b806cff4b139de9849be82905d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:45.370074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-001f192b-3707-478b-8b3a-8711bf5b2167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:45.399423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e9ebbaa-1a52-4db2-9fdf-a5fe988fa80c admin admin] The token cache is being invalidate because project 1f491880ac3e4b2f96c966fe114a7f80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:45.399423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e9ebbaa-1a52-4db2-9fdf-a5fe988fa80c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:45.400057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4e9ebbaa-1a52-4db2-9fdf-a5fe988fa80c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:45.401929 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2922/5890] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:45 2022] DELETE /identity/v3/projects/1f491880ac3e4b2f96c966fe114a7f80 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:45.406930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70915a45-6ccc-4987-a1db-5fde6a27941b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:45.407139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70915a45-6ccc-4987-a1db-5fde6a27941b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:45.407328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70915a45-6ccc-4987-a1db-5fde6a27941b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:45.453238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-70915a45-6ccc-4987-a1db-5fde6a27941b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:45.458328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-70915a45-6ccc-4987-a1db-5fde6a27941b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:45.476324 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2969/5891] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:45.491214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f192b-3707-478b-8b3a-8711bf5b2167 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:45.493110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-001f192b-3707-478b-8b3a-8711bf5b2167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:45.521112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:45.632880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f192b-3707-478b-8b3a-8711bf5b2167 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:45.641213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ac8a7-b898-4fec-8616-4604e064fcfd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:45.642563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ac8a7-b898-4fec-8616-4604e064fcfd service glance] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:45.643191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ac8a7-b898-4fec-8616-4604e064fcfd service glance] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:45.643651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ac8a7-b898-4fec-8616-4604e064fcfd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:45.643944 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2923/5892] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:21:45.653094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8169f1-8089-4d12-aca5-a4908efa1281 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:45.653724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8169f1-8089-4d12-aca5-a4908efa1281 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:45.654305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8169f1-8089-4d12-aca5-a4908efa1281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:45.656159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-744ac8a7-b898-4fec-8616-4604e064fcfd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:45.700406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bb8169f1-8089-4d12-aca5-a4908efa1281 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:45.705210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bb8169f1-8089-4d12-aca5-a4908efa1281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:45.729102 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2924/5893] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:45.730730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8169f1-8089-4d12-aca5-a4908efa1281 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:45.752213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8169f1-8089-4d12-aca5-a4908efa1281 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:45.768911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f854605-a073-4c08-82cd-a6bb6f8e192d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:45.769559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f854605-a073-4c08-82cd-a6bb6f8e192d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:45.769843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f854605-a073-4c08-82cd-a6bb6f8e192d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:45.770124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f854605-a073-4c08-82cd-a6bb6f8e192d admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:45.770822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f854605-a073-4c08-82cd-a6bb6f8e192d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:21:45.771129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f854605-a073-4c08-82cd-a6bb6f8e192d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:45.772899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f854605-a073-4c08-82cd-a6bb6f8e192d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:45.808124 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2925/5894] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:45.809635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f854605-a073-4c08-82cd-a6bb6f8e192d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:45.817743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ac8a7-b898-4fec-8616-4604e064fcfd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:45.819632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ac8a7-b898-4fec-8616-4604e064fcfd service glance] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:45.845220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f854605-a073-4c08-82cd-a6bb6f8e192d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:45.857227 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2970/5895] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:21:45.859467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76660e70-9108-4478-a605-5da1bf101243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:45.860232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76660e70-9108-4478-a605-5da1bf101243 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:45.860540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76660e70-9108-4478-a605-5da1bf101243 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:45.860822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76660e70-9108-4478-a605-5da1bf101243 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:45.861589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76660e70-9108-4478-a605-5da1bf101243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:45.865974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76660e70-9108-4478-a605-5da1bf101243 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:45.891584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:45.924771 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2926/5896] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:21:45 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:21:45.927133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ac8a7-b898-4fec-8616-4604e064fcfd service glance] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:45.943055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ac8a7-b898-4fec-8616-4604e064fcfd service glance] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:46.099854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76660e70-9108-4478-a605-5da1bf101243 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:46.159465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ddec8-d642-4930-9c0f-e5b8ab61dc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:46.160527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ddec8-d642-4930-9c0f-e5b8ab61dc44 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:46.160816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ddec8-d642-4930-9c0f-e5b8ab61dc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:46.161862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ddec8-d642-4930-9c0f-e5b8ab61dc44 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:46.163342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ddec8-d642-4930-9c0f-e5b8ab61dc44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:46.165403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ddec8-d642-4930-9c0f-e5b8ab61dc44 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:46.226333 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2971/5897] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:21:45 2022] POST /identity/v3/users => generated 285 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:46.232610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ddec8-d642-4930-9c0f-e5b8ab61dc44 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:46.244350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76660e70-9108-4478-a605-5da1bf101243 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:46.256075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ddec8-d642-4930-9c0f-e5b8ab61dc44 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:46.264969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913af31-9965-4964-9dd1-8cc53b68526e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:46.265661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913af31-9965-4964-9dd1-8cc53b68526e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:46.267120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913af31-9965-4964-9dd1-8cc53b68526e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:46.267455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913af31-9965-4964-9dd1-8cc53b68526e admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:46.268523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913af31-9965-4964-9dd1-8cc53b68526e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:46.270796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913af31-9965-4964-9dd1-8cc53b68526e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:46.277774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4d6d9-f310-47de-b9b6-12f4da252336 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:46.281667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4d6d9-f310-47de-b9b6-12f4da252336 service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:46.282303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4d6d9-f310-47de-b9b6-12f4da252336 service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:46.283221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4d6d9-f310-47de-b9b6-12f4da252336 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:46.289106 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2972/5898] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:21:46.291834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913af31-9965-4964-9dd1-8cc53b68526e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:46.309167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913af31-9965-4964-9dd1-8cc53b68526e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:46.336783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b1a8f-d233-496c-b59a-b0d9954b9e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:46.336783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b1a8f-d233-496c-b59a-b0d9954b9e1e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:46.337271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b1a8f-d233-496c-b59a-b0d9954b9e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:46.337271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b1a8f-d233-496c-b59a-b0d9954b9e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:46.337996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b1a8f-d233-496c-b59a-b0d9954b9e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:46.354243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b1a8f-d233-496c-b59a-b0d9954b9e1e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:46.391337 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2973/5899] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:46.395904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b1a8f-d233-496c-b59a-b0d9954b9e1e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:46.418705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b1a8f-d233-496c-b59a-b0d9954b9e1e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:46.423786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4d6d9-f310-47de-b9b6-12f4da252336 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:46.425653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4d6d9-f310-47de-b9b6-12f4da252336 service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:46.429722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5e76e-379a-4a39-a764-49ca858c6b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:46.430519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5e76e-379a-4a39-a764-49ca858c6b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:46.430896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5e76e-379a-4a39-a764-49ca858c6b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:46.431240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5e76e-379a-4a39-a764-49ca858c6b00 admin admin] PATH_INFO: `/v3/projects/c25ee6c1ce5c40238cc6b084120a8880/users/9e524b6c859a4f62b4cdc3bead24046f/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:46.461784 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2927/5900] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:21:46.468560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5e76e-379a-4a39-a764-49ca858c6b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c25ee6c1ce5c40238cc6b084120a8880, user_id=9e524b6c859a4f62b4cdc3bead24046f, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:46.471708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5e76e-379a-4a39-a764-49ca858c6b00 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:46.515346 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2974/5901] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:46 2022] PUT /identity/v3/projects/c25ee6c1ce5c40238cc6b084120a8880/users/9e524b6c859a4f62b4cdc3bead24046f/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:46.525595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab3118-5688-4365-a94b-3f7b16edf717 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:46.527101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab3118-5688-4365-a94b-3f7b16edf717 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:46.527101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab3118-5688-4365-a94b-3f7b16edf717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:46.590254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1bab3118-5688-4365-a94b-3f7b16edf717 None None] MFA Rules not processed for user `9e524b6c859a4f62b4cdc3bead24046f`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:46.591992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1bab3118-5688-4365-a94b-3f7b16edf717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:46.774100 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2928/5902] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:46.832967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5e76e-379a-4a39-a764-49ca858c6b00 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:46.835506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4dd5e76e-379a-4a39-a764-49ca858c6b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:46.851426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:46.957896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5e76e-379a-4a39-a764-49ca858c6b00 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:46.964738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04abed2-c666-47c2-8431-507d4f0481b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:46.965801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04abed2-c666-47c2-8431-507d4f0481b7 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:46.966348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04abed2-c666-47c2-8431-507d4f0481b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:46.966842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04abed2-c666-47c2-8431-507d4f0481b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:46.980397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04abed2-c666-47c2-8431-507d4f0481b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:46.982567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04abed2-c666-47c2-8431-507d4f0481b7 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:47.017086 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2975/5903] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:46 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:21:47.070801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab3118-5688-4365-a94b-3f7b16edf717 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:47.073841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1bab3118-5688-4365-a94b-3f7b16edf717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:47.140438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:47.223932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab3118-5688-4365-a94b-3f7b16edf717 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:47.229943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef374bb5-84cb-41a4-9442-301fb353cfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:47.230823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef374bb5-84cb-41a4-9442-301fb353cfdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:47.231017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef374bb5-84cb-41a4-9442-301fb353cfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:47.231534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef374bb5-84cb-41a4-9442-301fb353cfdf admin admin] PATH_INFO: `/v3/users/3bc1a294fb01451bb5146921a9dd8262` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:47.233647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef374bb5-84cb-41a4-9442-301fb353cfdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc1a294fb01451bb5146921a9dd8262)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:47.241051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef374bb5-84cb-41a4-9442-301fb353cfdf admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:47.317886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ef374bb5-84cb-41a4-9442-301fb353cfdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc1a294fb01451bb5146921a9dd8262'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:47.318606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ef374bb5-84cb-41a4-9442-301fb353cfdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc1a294fb01451bb5146921a9dd8262'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:47.333927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ef374bb5-84cb-41a4-9442-301fb353cfdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc1a294fb01451bb5146921a9dd8262'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:47.334827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ef374bb5-84cb-41a4-9442-301fb353cfdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc1a294fb01451bb5146921a9dd8262'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:47.350066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ef374bb5-84cb-41a4-9442-301fb353cfdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc1a294fb01451bb5146921a9dd8262'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:47.371195 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2929/5904] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:47 2022] DELETE /identity/v3/users/3bc1a294fb01451bb5146921a9dd8262 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:47.374668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764f60a-1f11-4e2c-a33b-71879a9cc487 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:47.375162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764f60a-1f11-4e2c-a33b-71879a9cc487 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:47.376440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764f60a-1f11-4e2c-a33b-71879a9cc487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:47.407227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5764f60a-1f11-4e2c-a33b-71879a9cc487 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:47.410340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5764f60a-1f11-4e2c-a33b-71879a9cc487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:47.533260 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2976/5905] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:47.574283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef374bb5-84cb-41a4-9442-301fb353cfdf admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:47.575815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ef374bb5-84cb-41a4-9442-301fb353cfdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:47.650431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef374bb5-84cb-41a4-9442-301fb353cfdf admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:47.657562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701212fd-2ea7-4b10-bc83-07340bb39a0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:47.658368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701212fd-2ea7-4b10-bc83-07340bb39a0d service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:47.658717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701212fd-2ea7-4b10-bc83-07340bb39a0d service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:47.659143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701212fd-2ea7-4b10-bc83-07340bb39a0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:47.672022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701212fd-2ea7-4b10-bc83-07340bb39a0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:47.673663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701212fd-2ea7-4b10-bc83-07340bb39a0d service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:47.686726 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2930/5906] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:21:49.492918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764f60a-1f11-4e2c-a33b-71879a9cc487 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:49.496786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5764f60a-1f11-4e2c-a33b-71879a9cc487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:49.523805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764f60a-1f11-4e2c-a33b-71879a9cc487 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:49.533138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d59913-66f4-4c01-9370-ce9cbc9d37c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:49.535145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d59913-66f4-4c01-9370-ce9cbc9d37c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:49.536009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d59913-66f4-4c01-9370-ce9cbc9d37c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:49.536852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d59913-66f4-4c01-9370-ce9cbc9d37c6 admin admin] PATH_INFO: `/v3/projects/94c6d6d1474c42299edab069bb553866` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:49.541825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d59913-66f4-4c01-9370-ce9cbc9d37c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94c6d6d1474c42299edab069bb553866)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:49.546214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d59913-66f4-4c01-9370-ce9cbc9d37c6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:49.739994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5d59913-66f4-4c01-9370-ce9cbc9d37c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94c6d6d1474c42299edab069bb553866', 'request_id': 'req-b5d59913-66f4-4c01-9370-ce9cbc9d37c6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:49.772492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5d59913-66f4-4c01-9370-ce9cbc9d37c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94c6d6d1474c42299edab069bb553866', 'request_id': 'req-b5d59913-66f4-4c01-9370-ce9cbc9d37c6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:49.778474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701212fd-2ea7-4b10-bc83-07340bb39a0d service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:49.781773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-701212fd-2ea7-4b10-bc83-07340bb39a0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:49.810600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5d59913-66f4-4c01-9370-ce9cbc9d37c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94c6d6d1474c42299edab069bb553866', 'request_id': 'req-b5d59913-66f4-4c01-9370-ce9cbc9d37c6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:49.818893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701212fd-2ea7-4b10-bc83-07340bb39a0d service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:49.831842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5d59913-66f4-4c01-9370-ce9cbc9d37c6 admin admin] The token cache is being invalidate because project 94c6d6d1474c42299edab069bb553866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:49.836104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5d59913-66f4-4c01-9370-ce9cbc9d37c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:49.842508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5d59913-66f4-4c01-9370-ce9cbc9d37c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:49.845658 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2977/5907] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:49 2022] DELETE /identity/v3/projects/94c6d6d1474c42299edab069bb553866 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:49.850875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d59913-66f4-4c01-9370-ce9cbc9d37c6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:49.854809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b5d59913-66f4-4c01-9370-ce9cbc9d37c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:49.937235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:49.948319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c326d-211d-4f0e-9774-4875dedb03bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:49.949127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c326d-211d-4f0e-9774-4875dedb03bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:49.949529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c326d-211d-4f0e-9774-4875dedb03bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:49.949901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c326d-211d-4f0e-9774-4875dedb03bb admin admin] PATH_INFO: `/v3/users/f4b80fe0ec404f0480948be6e051c9e4` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:49.952802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c326d-211d-4f0e-9774-4875dedb03bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4b80fe0ec404f0480948be6e051c9e4)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:49.954869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c326d-211d-4f0e-9774-4875dedb03bb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:49.964784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:50.035078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4d8c326d-211d-4f0e-9774-4875dedb03bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4b80fe0ec404f0480948be6e051c9e4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:50.035271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d59913-66f4-4c01-9370-ce9cbc9d37c6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:50.037122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4d8c326d-211d-4f0e-9774-4875dedb03bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4b80fe0ec404f0480948be6e051c9e4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:50.042081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e5c38-a7da-43cd-8a86-fa7e166d5647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:50.043475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e5c38-a7da-43cd-8a86-fa7e166d5647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:50.043722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e5c38-a7da-43cd-8a86-fa7e166d5647 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:50.044192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e5c38-a7da-43cd-8a86-fa7e166d5647 admin admin] PATH_INFO: `/v3/users/78b36b806cff4b139de9849be82905d6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:50.045537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e5c38-a7da-43cd-8a86-fa7e166d5647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78b36b806cff4b139de9849be82905d6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:50.047998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e5c38-a7da-43cd-8a86-fa7e166d5647 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:50.078646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4d8c326d-211d-4f0e-9774-4875dedb03bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4b80fe0ec404f0480948be6e051c9e4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:50.079807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4d8c326d-211d-4f0e-9774-4875dedb03bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4b80fe0ec404f0480948be6e051c9e4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:50.101980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4d8c326d-211d-4f0e-9774-4875dedb03bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4b80fe0ec404f0480948be6e051c9e4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:50.155210 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2931/5908] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:49 2022] DELETE /identity/v3/users/f4b80fe0ec404f0480948be6e051c9e4 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:50.193601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c69e5c38-a7da-43cd-8a86-fa7e166d5647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78b36b806cff4b139de9849be82905d6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:50.217269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c69e5c38-a7da-43cd-8a86-fa7e166d5647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78b36b806cff4b139de9849be82905d6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:50.218258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c69e5c38-a7da-43cd-8a86-fa7e166d5647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78b36b806cff4b139de9849be82905d6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:50.227759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c69e5c38-a7da-43cd-8a86-fa7e166d5647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78b36b806cff4b139de9849be82905d6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:50.228726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c69e5c38-a7da-43cd-8a86-fa7e166d5647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78b36b806cff4b139de9849be82905d6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:50.263973 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2978/5909] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:49 2022] DELETE /identity/v3/users/78b36b806cff4b139de9849be82905d6 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:51.260589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c326d-211d-4f0e-9774-4875dedb03bb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:51.264862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4d8c326d-211d-4f0e-9774-4875dedb03bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:51.287975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e5c38-a7da-43cd-8a86-fa7e166d5647 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:51.290106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c69e5c38-a7da-43cd-8a86-fa7e166d5647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:51.490117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c326d-211d-4f0e-9774-4875dedb03bb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:51.498120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3568a1-0363-49cf-ba09-21ab9d4eb517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:51.501562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3568a1-0363-49cf-ba09-21ab9d4eb517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:51.502259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3568a1-0363-49cf-ba09-21ab9d4eb517 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:51.502391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e5c38-a7da-43cd-8a86-fa7e166d5647 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:51.503271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3568a1-0363-49cf-ba09-21ab9d4eb517 admin admin] PATH_INFO: `/v3/projects/cd884e1c0861450e9049a966a5931675` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:51.505547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3568a1-0363-49cf-ba09-21ab9d4eb517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd884e1c0861450e9049a966a5931675)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:51.509960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3568a1-0363-49cf-ba09-21ab9d4eb517 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:51.520459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbed3c-e9f5-4cf0-854a-7238ce28c46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:51.521282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbed3c-e9f5-4cf0-854a-7238ce28c46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:51.521402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbed3c-e9f5-4cf0-854a-7238ce28c46b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:51.521689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbed3c-e9f5-4cf0-854a-7238ce28c46b admin admin] PATH_INFO: `/v3/projects/2d18559998f143d9a1d6927874adf7a6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:51.523139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbed3c-e9f5-4cf0-854a-7238ce28c46b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d18559998f143d9a1d6927874adf7a6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:51.525191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbed3c-e9f5-4cf0-854a-7238ce28c46b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:51.603566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb3568a1-0363-49cf-ba09-21ab9d4eb517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd884e1c0861450e9049a966a5931675', 'request_id': 'req-cb3568a1-0363-49cf-ba09-21ab9d4eb517'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:51.624446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1dbbed3c-e9f5-4cf0-854a-7238ce28c46b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d18559998f143d9a1d6927874adf7a6', 'request_id': 'req-1dbbed3c-e9f5-4cf0-854a-7238ce28c46b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:51.635352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1dbbed3c-e9f5-4cf0-854a-7238ce28c46b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d18559998f143d9a1d6927874adf7a6', 'request_id': 'req-1dbbed3c-e9f5-4cf0-854a-7238ce28c46b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:51.640150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:51.640900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb3568a1-0363-49cf-ba09-21ab9d4eb517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd884e1c0861450e9049a966a5931675', 'request_id': 'req-cb3568a1-0363-49cf-ba09-21ab9d4eb517'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:51.657429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1dbbed3c-e9f5-4cf0-854a-7238ce28c46b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d18559998f143d9a1d6927874adf7a6', 'request_id': 'req-1dbbed3c-e9f5-4cf0-854a-7238ce28c46b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:51.664012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb3568a1-0363-49cf-ba09-21ab9d4eb517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd884e1c0861450e9049a966a5931675', 'request_id': 'req-cb3568a1-0363-49cf-ba09-21ab9d4eb517'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:51.679801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1dbbed3c-e9f5-4cf0-854a-7238ce28c46b admin admin] The token cache is being invalidate because project 2d18559998f143d9a1d6927874adf7a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:51.680077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1dbbed3c-e9f5-4cf0-854a-7238ce28c46b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:51.681115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1dbbed3c-e9f5-4cf0-854a-7238ce28c46b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:51.683971 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2979/5910] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:51 2022] DELETE /identity/v3/projects/2d18559998f143d9a1d6927874adf7a6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:51.689492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb3568a1-0363-49cf-ba09-21ab9d4eb517 admin admin] The token cache is being invalidate because project cd884e1c0861450e9049a966a5931675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:51.689492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb3568a1-0363-49cf-ba09-21ab9d4eb517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:51.689492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cb3568a1-0363-49cf-ba09-21ab9d4eb517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:51.689492 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2932/5911] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:51 2022] DELETE /identity/v3/projects/cd884e1c0861450e9049a966a5931675 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:51.699347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cf7cb-feee-4a2c-b839-eeebf6a71caf None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:51.699347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cf7cb-feee-4a2c-b839-eeebf6a71caf None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:51.699347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cf7cb-feee-4a2c-b839-eeebf6a71caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:51.699726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3568a1-0363-49cf-ba09-21ab9d4eb517 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:51.699726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cb3568a1-0363-49cf-ba09-21ab9d4eb517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:51.708806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:51.726219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d43cf7cb-feee-4a2c-b839-eeebf6a71caf None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:51.728127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d43cf7cb-feee-4a2c-b839-eeebf6a71caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:51.815428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3568a1-0363-49cf-ba09-21ab9d4eb517 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:51.855514 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2980/5912] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:51.863273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db874d4d-6ec3-459b-8f06-de462057484d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:51.864838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db874d4d-6ec3-459b-8f06-de462057484d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:51.865540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db874d4d-6ec3-459b-8f06-de462057484d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:51.901834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-db874d4d-6ec3-459b-8f06-de462057484d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:51.903826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-db874d4d-6ec3-459b-8f06-de462057484d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:51.921235 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2981/5913] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:51.923159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db874d4d-6ec3-459b-8f06-de462057484d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:51.938392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db874d4d-6ec3-459b-8f06-de462057484d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:51.946440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d50b1-4fb8-41be-8a5d-3fd9e640e8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:51.948711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d50b1-4fb8-41be-8a5d-3fd9e640e8ed admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:51.949361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d50b1-4fb8-41be-8a5d-3fd9e640e8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:51.949707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d50b1-4fb8-41be-8a5d-3fd9e640e8ed admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:51.950926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d50b1-4fb8-41be-8a5d-3fd9e640e8ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:21:51.951983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d50b1-4fb8-41be-8a5d-3fd9e640e8ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:51.952588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004e203-87ab-41e3-9cc2-2faf49db9cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:51.953386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004e203-87ab-41e3-9cc2-2faf49db9cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:51.953795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d50b1-4fb8-41be-8a5d-3fd9e640e8ed admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:51.953905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004e203-87ab-41e3-9cc2-2faf49db9cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:51.954000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004e203-87ab-41e3-9cc2-2faf49db9cd0 admin admin] PATH_INFO: `/v3/users/8ee0399bb37d4be7a37d5d26b1bb68c5` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:51.955166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004e203-87ab-41e3-9cc2-2faf49db9cd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee0399bb37d4be7a37d5d26b1bb68c5)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:51.957127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004e203-87ab-41e3-9cc2-2faf49db9cd0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:51.972922 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2982/5914] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:51.976141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d50b1-4fb8-41be-8a5d-3fd9e640e8ed admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:52.000477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d50b1-4fb8-41be-8a5d-3fd9e640e8ed admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:52.012922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a70af3-f080-4613-838a-ddb7b4d71a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:52.014427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a70af3-f080-4613-838a-ddb7b4d71a07 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:52.014881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a70af3-f080-4613-838a-ddb7b4d71a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:52.015362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a70af3-f080-4613-838a-ddb7b4d71a07 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:52.016717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a70af3-f080-4613-838a-ddb7b4d71a07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:52.018803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a70af3-f080-4613-838a-ddb7b4d71a07 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:52.092951 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2983/5915] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:21:51 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:21:52.094401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a70af3-f080-4613-838a-ddb7b4d71a07 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:52.097671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4004e203-87ab-41e3-9cc2-2faf49db9cd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee0399bb37d4be7a37d5d26b1bb68c5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:52.098704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4004e203-87ab-41e3-9cc2-2faf49db9cd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee0399bb37d4be7a37d5d26b1bb68c5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:52.117772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4004e203-87ab-41e3-9cc2-2faf49db9cd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee0399bb37d4be7a37d5d26b1bb68c5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:52.120193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4004e203-87ab-41e3-9cc2-2faf49db9cd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee0399bb37d4be7a37d5d26b1bb68c5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:52.132117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4004e203-87ab-41e3-9cc2-2faf49db9cd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee0399bb37d4be7a37d5d26b1bb68c5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:52.157086 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2933/5916] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:51 2022] DELETE /identity/v3/users/8ee0399bb37d4be7a37d5d26b1bb68c5 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:52.216811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a70af3-f080-4613-838a-ddb7b4d71a07 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:52.273258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:52.290611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40135fb6-254b-4a63-8e6c-c32795ff81b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:52.291373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40135fb6-254b-4a63-8e6c-c32795ff81b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:52.291669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40135fb6-254b-4a63-8e6c-c32795ff81b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:52.291979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40135fb6-254b-4a63-8e6c-c32795ff81b1 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:52.292703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40135fb6-254b-4a63-8e6c-c32795ff81b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:52.294783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40135fb6-254b-4a63-8e6c-c32795ff81b1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:52.322643 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2984/5917] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:21:52 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:52.326967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004e203-87ab-41e3-9cc2-2faf49db9cd0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:52.329331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4004e203-87ab-41e3-9cc2-2faf49db9cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:52.361230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004e203-87ab-41e3-9cc2-2faf49db9cd0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:52.368640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995d87c-31a2-4553-bbbb-11b9d703d0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:52.369034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995d87c-31a2-4553-bbbb-11b9d703d0fe admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:52.369322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995d87c-31a2-4553-bbbb-11b9d703d0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:52.370522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995d87c-31a2-4553-bbbb-11b9d703d0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:52.370522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995d87c-31a2-4553-bbbb-11b9d703d0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:52.372364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995d87c-31a2-4553-bbbb-11b9d703d0fe admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:52.387345 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2934/5918] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:52.390732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40135fb6-254b-4a63-8e6c-c32795ff81b1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:52.404316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40135fb6-254b-4a63-8e6c-c32795ff81b1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:52.410414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc91b63-a24e-4024-b50d-1b573ca56749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:52.411318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc91b63-a24e-4024-b50d-1b573ca56749 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:52.411548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc91b63-a24e-4024-b50d-1b573ca56749 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:52.412197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc91b63-a24e-4024-b50d-1b573ca56749 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:52.412867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc91b63-a24e-4024-b50d-1b573ca56749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:52.415135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc91b63-a24e-4024-b50d-1b573ca56749 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:52.428414 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2985/5919] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:52.433318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995d87c-31a2-4553-bbbb-11b9d703d0fe admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:52.451983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995d87c-31a2-4553-bbbb-11b9d703d0fe admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:52.459669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ff563-51dd-41dd-8eb2-8f082cf0332a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:52.460682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ff563-51dd-41dd-8eb2-8f082cf0332a admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:52.461226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ff563-51dd-41dd-8eb2-8f082cf0332a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:52.461689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ff563-51dd-41dd-8eb2-8f082cf0332a admin admin] PATH_INFO: `/v3/projects/4a430d98caf34e1598b5c3965ddf4b1a/users/e428ed749a2844df83d7e513eb5300fb/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:52.497120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ff563-51dd-41dd-8eb2-8f082cf0332a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a430d98caf34e1598b5c3965ddf4b1a, user_id=e428ed749a2844df83d7e513eb5300fb, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:52.502384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ff563-51dd-41dd-8eb2-8f082cf0332a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:52.507678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:52.532034 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2935/5920] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:52 2022] PUT /identity/v3/projects/4a430d98caf34e1598b5c3965ddf4b1a/users/e428ed749a2844df83d7e513eb5300fb/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:52.542859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef8300-9605-404a-84cf-fd02b812d6ac None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:52.543433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef8300-9605-404a-84cf-fd02b812d6ac None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:52.543991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef8300-9605-404a-84cf-fd02b812d6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:52.588893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-12ef8300-9605-404a-84cf-fd02b812d6ac None None] MFA Rules not processed for user `e428ed749a2844df83d7e513eb5300fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:52.590152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-12ef8300-9605-404a-84cf-fd02b812d6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:52.684034 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2986/5921] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:52.697944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ff563-51dd-41dd-8eb2-8f082cf0332a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:52.700091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-921ff563-51dd-41dd-8eb2-8f082cf0332a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:52.787329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ff563-51dd-41dd-8eb2-8f082cf0332a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:52.793290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57052a7-e6ea-4143-95c3-f7f9fe2a39f9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:52.794583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57052a7-e6ea-4143-95c3-f7f9fe2a39f9 service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:52.794923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57052a7-e6ea-4143-95c3-f7f9fe2a39f9 service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:52.795209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57052a7-e6ea-4143-95c3-f7f9fe2a39f9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:52.809240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57052a7-e6ea-4143-95c3-f7f9fe2a39f9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:52.812442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57052a7-e6ea-4143-95c3-f7f9fe2a39f9 service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:52.832837 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2936/5922] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:21:52.957894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef8300-9605-404a-84cf-fd02b812d6ac None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:52.999150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57052a7-e6ea-4143-95c3-f7f9fe2a39f9 service glance] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:53.000923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e57052a7-e6ea-4143-95c3-f7f9fe2a39f9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:53.094691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef8300-9605-404a-84cf-fd02b812d6ac None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:53.120145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3424229-1437-4784-9e59-122a7d6e3ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:53.120917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3424229-1437-4784-9e59-122a7d6e3ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:53.121328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3424229-1437-4784-9e59-122a7d6e3ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:53.122180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3424229-1437-4784-9e59-122a7d6e3ff3 admin admin] PATH_INFO: `/v3/users/e428ed749a2844df83d7e513eb5300fb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:53.124230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3424229-1437-4784-9e59-122a7d6e3ff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e428ed749a2844df83d7e513eb5300fb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:53.127510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3424229-1437-4784-9e59-122a7d6e3ff3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:53.132920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57052a7-e6ea-4143-95c3-f7f9fe2a39f9 service glance] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:53.157957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7af99a-0b04-4c3d-93e1-90c8e03bcf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:53.160678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7af99a-0b04-4c3d-93e1-90c8e03bcf31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:53.162716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7af99a-0b04-4c3d-93e1-90c8e03bcf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:53.167853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7af99a-0b04-4c3d-93e1-90c8e03bcf31 admin admin] PATH_INFO: `/v3/projects/5fd1f1c4241c4e5499843e55c3150ad8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:53.178465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7af99a-0b04-4c3d-93e1-90c8e03bcf31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fd1f1c4241c4e5499843e55c3150ad8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:53.180708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7af99a-0b04-4c3d-93e1-90c8e03bcf31 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:53.232056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f3424229-1437-4784-9e59-122a7d6e3ff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e428ed749a2844df83d7e513eb5300fb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:53.255760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:53.259612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f3424229-1437-4784-9e59-122a7d6e3ff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e428ed749a2844df83d7e513eb5300fb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:53.260623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f3424229-1437-4784-9e59-122a7d6e3ff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e428ed749a2844df83d7e513eb5300fb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:53.273544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f3424229-1437-4784-9e59-122a7d6e3ff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e428ed749a2844df83d7e513eb5300fb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:53.274181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f3424229-1437-4784-9e59-122a7d6e3ff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e428ed749a2844df83d7e513eb5300fb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:53.278129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9c7af99a-0b04-4c3d-93e1-90c8e03bcf31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fd1f1c4241c4e5499843e55c3150ad8', 'request_id': 'req-9c7af99a-0b04-4c3d-93e1-90c8e03bcf31'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:53.297416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9c7af99a-0b04-4c3d-93e1-90c8e03bcf31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fd1f1c4241c4e5499843e55c3150ad8', 'request_id': 'req-9c7af99a-0b04-4c3d-93e1-90c8e03bcf31'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:53.308780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9c7af99a-0b04-4c3d-93e1-90c8e03bcf31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fd1f1c4241c4e5499843e55c3150ad8', 'request_id': 'req-9c7af99a-0b04-4c3d-93e1-90c8e03bcf31'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:53.314715 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2987/5923] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:21:52 2022] DELETE /identity/v3/users/e428ed749a2844df83d7e513eb5300fb => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:53.319626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9325b-5311-4f55-9700-6c80f8349fcf None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:53.320175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9325b-5311-4f55-9700-6c80f8349fcf None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:53.320778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9325b-5311-4f55-9700-6c80f8349fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:53.331847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9c7af99a-0b04-4c3d-93e1-90c8e03bcf31 admin admin] The token cache is being invalidate because project 5fd1f1c4241c4e5499843e55c3150ad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:53.332329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9c7af99a-0b04-4c3d-93e1-90c8e03bcf31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:53.333371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9c7af99a-0b04-4c3d-93e1-90c8e03bcf31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:53.336044 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2937/5924] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:52 2022] DELETE /identity/v3/projects/5fd1f1c4241c4e5499843e55c3150ad8 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:21:53.427637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-15c9325b-5311-4f55-9700-6c80f8349fcf None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:53.431106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-15c9325b-5311-4f55-9700-6c80f8349fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:53.646355 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2988/5925] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:53.698685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7af99a-0b04-4c3d-93e1-90c8e03bcf31 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:53.700866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9c7af99a-0b04-4c3d-93e1-90c8e03bcf31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:53.778150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:53.833099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7af99a-0b04-4c3d-93e1-90c8e03bcf31 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:53.942602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed5869-3d95-43e9-bd4b-82b5ec106608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:53.945690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed5869-3d95-43e9-bd4b-82b5ec106608 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:53.946195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed5869-3d95-43e9-bd4b-82b5ec106608 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:53.946609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed5869-3d95-43e9-bd4b-82b5ec106608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:53.982440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed5869-3d95-43e9-bd4b-82b5ec106608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:53.985574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed5869-3d95-43e9-bd4b-82b5ec106608 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:54.016119 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2938/5926] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:21:54.424515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac78520-fd7d-4fcc-96a7-67b9d7ec40ff None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:54.425085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac78520-fd7d-4fcc-96a7-67b9d7ec40ff None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:54.425085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac78520-fd7d-4fcc-96a7-67b9d7ec40ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:54.453212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bac78520-fd7d-4fcc-96a7-67b9d7ec40ff None None] MFA Rules not processed for user `6896ccb6369541d5a552f3373f39c64d`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:54.456209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bac78520-fd7d-4fcc-96a7-67b9d7ec40ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:54.562558 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2989/5927] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:55.139799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed5869-3d95-43e9-bd4b-82b5ec106608 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:55.141448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4eed5869-3d95-43e9-bd4b-82b5ec106608 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:55.168985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed5869-3d95-43e9-bd4b-82b5ec106608 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:55.182192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97fbaf-af4e-4260-bb6f-4c0cd5c30e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:55.183204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97fbaf-af4e-4260-bb6f-4c0cd5c30e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:55.183770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97fbaf-af4e-4260-bb6f-4c0cd5c30e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:55.184214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97fbaf-af4e-4260-bb6f-4c0cd5c30e17 admin admin] PATH_INFO: `/v3/projects/4a430d98caf34e1598b5c3965ddf4b1a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:55.187504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97fbaf-af4e-4260-bb6f-4c0cd5c30e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a430d98caf34e1598b5c3965ddf4b1a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:55.191356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97fbaf-af4e-4260-bb6f-4c0cd5c30e17 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:55.294547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac78520-fd7d-4fcc-96a7-67b9d7ec40ff None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:55.305604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5b97fbaf-af4e-4260-bb6f-4c0cd5c30e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a430d98caf34e1598b5c3965ddf4b1a', 'request_id': 'req-5b97fbaf-af4e-4260-bb6f-4c0cd5c30e17'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:55.308413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac78520-fd7d-4fcc-96a7-67b9d7ec40ff None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:55.329381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5b97fbaf-af4e-4260-bb6f-4c0cd5c30e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a430d98caf34e1598b5c3965ddf4b1a', 'request_id': 'req-5b97fbaf-af4e-4260-bb6f-4c0cd5c30e17'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:55.346204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5b97fbaf-af4e-4260-bb6f-4c0cd5c30e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a430d98caf34e1598b5c3965ddf4b1a', 'request_id': 'req-5b97fbaf-af4e-4260-bb6f-4c0cd5c30e17'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:55.388961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5b97fbaf-af4e-4260-bb6f-4c0cd5c30e17 admin admin] The token cache is being invalidate because project 4a430d98caf34e1598b5c3965ddf4b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:21:55.391950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5b97fbaf-af4e-4260-bb6f-4c0cd5c30e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:55.391950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5b97fbaf-af4e-4260-bb6f-4c0cd5c30e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:21:55.394694 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2939/5928] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:21:55 2022] DELETE /identity/v3/projects/4a430d98caf34e1598b5c3965ddf4b1a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:55.400789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c23e06-5755-4f37-ab47-eea825eed38a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:55.401122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c23e06-5755-4f37-ab47-eea825eed38a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:55.401350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c23e06-5755-4f37-ab47-eea825eed38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:55.429754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73943b41-9ab6-4dde-8095-42c7fefe0572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:55.430395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73943b41-9ab6-4dde-8095-42c7fefe0572 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:55.430854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73943b41-9ab6-4dde-8095-42c7fefe0572 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:55.431800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73943b41-9ab6-4dde-8095-42c7fefe0572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:55.434405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-73943b41-9ab6-4dde-8095-42c7fefe0572 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:55.448147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e4c23e06-5755-4f37-ab47-eea825eed38a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:55.450550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e4c23e06-5755-4f37-ab47-eea825eed38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:55.454063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73943b41-9ab6-4dde-8095-42c7fefe0572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:55.457213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73943b41-9ab6-4dde-8095-42c7fefe0572 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:55.470732 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2990/5929] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:21:55.593710 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2940/5930] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:55.597344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9564717-15e2-4539-a74e-90eca71b1e82 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:55.597749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9564717-15e2-4539-a74e-90eca71b1e82 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:55.598987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9564717-15e2-4539-a74e-90eca71b1e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:55.647737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a9564717-15e2-4539-a74e-90eca71b1e82 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:55.648990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a9564717-15e2-4539-a74e-90eca71b1e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:55.659842 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2991/5931] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:55.664281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c23e06-5755-4f37-ab47-eea825eed38a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:55.675246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c23e06-5755-4f37-ab47-eea825eed38a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:55.681720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9847100-05fb-465d-a462-e05ba4103c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:55.682360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9847100-05fb-465d-a462-e05ba4103c7c admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:55.682639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9847100-05fb-465d-a462-e05ba4103c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:55.682912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9847100-05fb-465d-a462-e05ba4103c7c admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:55.683672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9847100-05fb-465d-a462-e05ba4103c7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:21:55.683977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9847100-05fb-465d-a462-e05ba4103c7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:55.685603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9847100-05fb-465d-a462-e05ba4103c7c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:55.698919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:55.716874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9564717-15e2-4539-a74e-90eca71b1e82 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:55.720565 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2941/5932] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:21:55.731202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9564717-15e2-4539-a74e-90eca71b1e82 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:55.743182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b6360-f4ca-40d7-8f29-13cf272c8657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:55.743182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b6360-f4ca-40d7-8f29-13cf272c8657 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:55.743571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b6360-f4ca-40d7-8f29-13cf272c8657 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:55.743745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b6360-f4ca-40d7-8f29-13cf272c8657 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:55.744424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b6360-f4ca-40d7-8f29-13cf272c8657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:55.750563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b6360-f4ca-40d7-8f29-13cf272c8657 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:55.798208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:55.812806 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2992/5933] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:21:55 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:21:55.813607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9847100-05fb-465d-a462-e05ba4103c7c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:55.828271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9847100-05fb-465d-a462-e05ba4103c7c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:55.920319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d186a0-11f3-4596-9ec0-4564a2e5895b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:55.921622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d186a0-11f3-4596-9ec0-4564a2e5895b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:55.922210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d186a0-11f3-4596-9ec0-4564a2e5895b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:55.922618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d186a0-11f3-4596-9ec0-4564a2e5895b admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:55.923601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d186a0-11f3-4596-9ec0-4564a2e5895b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:55.926105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d186a0-11f3-4596-9ec0-4564a2e5895b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:55.960280 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2942/5934] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:21:55 2022] POST /identity/v3/users => generated 291 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:21:55.964356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b6360-f4ca-40d7-8f29-13cf272c8657 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:55.978290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b6360-f4ca-40d7-8f29-13cf272c8657 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:55.986084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331caf6f-0af9-4e2f-9c95-237f45630469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:55.987136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331caf6f-0af9-4e2f-9c95-237f45630469 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:55.987701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331caf6f-0af9-4e2f-9c95-237f45630469 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:55.988231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331caf6f-0af9-4e2f-9c95-237f45630469 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:55.989665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331caf6f-0af9-4e2f-9c95-237f45630469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:55.991609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331caf6f-0af9-4e2f-9c95-237f45630469 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:56.008359 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2993/5935] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:56.012221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d186a0-11f3-4596-9ec0-4564a2e5895b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:56.025487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d186a0-11f3-4596-9ec0-4564a2e5895b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:56.031696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663de01-68e1-4862-b613-6f7b2e61e23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:56.032502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663de01-68e1-4862-b613-6f7b2e61e23d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:56.032935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663de01-68e1-4862-b613-6f7b2e61e23d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:56.033312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663de01-68e1-4862-b613-6f7b2e61e23d admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:56.034127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663de01-68e1-4862-b613-6f7b2e61e23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:56.035904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663de01-68e1-4862-b613-6f7b2e61e23d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:56.052280 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2943/5936] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:56.053460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331caf6f-0af9-4e2f-9c95-237f45630469 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:56.068680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331caf6f-0af9-4e2f-9c95-237f45630469 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:56.075915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe31e3-1fa4-4b90-b395-6046662fe707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:56.077539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe31e3-1fa4-4b90-b395-6046662fe707 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:56.078096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe31e3-1fa4-4b90-b395-6046662fe707 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:56.078529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe31e3-1fa4-4b90-b395-6046662fe707 admin admin] PATH_INFO: `/v3/projects/0e214093d7d84fe58e80edc5c2fe8734/users/b05bacfa8265402e85f005d38ec47e4e/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:56.098174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe31e3-1fa4-4b90-b395-6046662fe707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e214093d7d84fe58e80edc5c2fe8734, user_id=b05bacfa8265402e85f005d38ec47e4e, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:56.101222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe31e3-1fa4-4b90-b395-6046662fe707 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:56.125113 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2994/5937] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:56 2022] PUT /identity/v3/projects/0e214093d7d84fe58e80edc5c2fe8734/users/b05bacfa8265402e85f005d38ec47e4e/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:21:56.136839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c069a5f-5029-4ba4-8000-65567c706d5e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:56.137232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c069a5f-5029-4ba4-8000-65567c706d5e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:56.137843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c069a5f-5029-4ba4-8000-65567c706d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:56.171602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4c069a5f-5029-4ba4-8000-65567c706d5e None None] MFA Rules not processed for user `b05bacfa8265402e85f005d38ec47e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:56.173094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4c069a5f-5029-4ba4-8000-65567c706d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:56.435219 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2944/5938] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:21:56.439899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe31e3-1fa4-4b90-b395-6046662fe707 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:56.604207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe31e3-1fa4-4b90-b395-6046662fe707 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:56.614284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830ad84-23cc-4174-8dca-e4977e0374c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:56.615361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830ad84-23cc-4174-8dca-e4977e0374c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:56.615998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830ad84-23cc-4174-8dca-e4977e0374c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:56.616479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830ad84-23cc-4174-8dca-e4977e0374c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:56.617861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830ad84-23cc-4174-8dca-e4977e0374c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:56.621058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830ad84-23cc-4174-8dca-e4977e0374c9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:56.672485 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2995/5939] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:21:56 2022] POST /identity/v3/projects => generated 379 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:56.676965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c069a5f-5029-4ba4-8000-65567c706d5e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:56.697134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c069a5f-5029-4ba4-8000-65567c706d5e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:56.844368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952f147-c408-4e93-9e08-3e0509b21f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:56.845129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952f147-c408-4e93-9e08-3e0509b21f34 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:56.845611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952f147-c408-4e93-9e08-3e0509b21f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:56.845987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952f147-c408-4e93-9e08-3e0509b21f34 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:56.846915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952f147-c408-4e93-9e08-3e0509b21f34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:56.852324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952f147-c408-4e93-9e08-3e0509b21f34 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:56.876376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:56.901892 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2945/5940] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:21:56 2022] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:56.906271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830ad84-23cc-4174-8dca-e4977e0374c9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:56.926422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830ad84-23cc-4174-8dca-e4977e0374c9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:56.949677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6d174-5086-4bf0-86b8-960434edc2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:56.952224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6d174-5086-4bf0-86b8-960434edc2ce admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:56.952583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6d174-5086-4bf0-86b8-960434edc2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:56.954311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6d174-5086-4bf0-86b8-960434edc2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:56.956060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6d174-5086-4bf0-86b8-960434edc2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:56.959331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6d174-5086-4bf0-86b8-960434edc2ce admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:56.983618 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2996/5941] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:56.987834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952f147-c408-4e93-9e08-3e0509b21f34 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:57.003240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952f147-c408-4e93-9e08-3e0509b21f34 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:57.018053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692f8c7-7cea-4d5a-9a99-ec3443f71caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:57.018973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692f8c7-7cea-4d5a-9a99-ec3443f71caa admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:57.019627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692f8c7-7cea-4d5a-9a99-ec3443f71caa admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:57.020178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692f8c7-7cea-4d5a-9a99-ec3443f71caa admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:57.021590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692f8c7-7cea-4d5a-9a99-ec3443f71caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:57.024895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692f8c7-7cea-4d5a-9a99-ec3443f71caa admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:57.042845 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2946/5942] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:57.047510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6d174-5086-4bf0-86b8-960434edc2ce admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:57.061637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6d174-5086-4bf0-86b8-960434edc2ce admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:57.068345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41cf22-b135-422d-b84c-51b755db7d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:57.069217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41cf22-b135-422d-b84c-51b755db7d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:57.069624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41cf22-b135-422d-b84c-51b755db7d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:57.070023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41cf22-b135-422d-b84c-51b755db7d87 admin admin] PATH_INFO: `/v3/projects/99c4fb257d6c472988258e04ce9804f0/users/6791315b5ee4467e9636b0b2e46f02ac/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:57.091675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41cf22-b135-422d-b84c-51b755db7d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c4fb257d6c472988258e04ce9804f0, user_id=6791315b5ee4467e9636b0b2e46f02ac, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:57.094799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41cf22-b135-422d-b84c-51b755db7d87 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:57.125926 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2997/5943] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:57 2022] PUT /identity/v3/projects/99c4fb257d6c472988258e04ce9804f0/users/6791315b5ee4467e9636b0b2e46f02ac/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:57.136806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14a279-faf6-45b4-9575-4c3e5d7a3834 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:57.137530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14a279-faf6-45b4-9575-4c3e5d7a3834 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:57.138146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14a279-faf6-45b4-9575-4c3e5d7a3834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:57.205632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4b14a279-faf6-45b4-9575-4c3e5d7a3834 None None] MFA Rules not processed for user `6791315b5ee4467e9636b0b2e46f02ac`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:57.206423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4b14a279-faf6-45b4-9575-4c3e5d7a3834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:57.352193 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2947/5944] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:21:57.358891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41cf22-b135-422d-b84c-51b755db7d87 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:57.502063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41cf22-b135-422d-b84c-51b755db7d87 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:57.508471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc3cb0-1306-40f9-9bc9-2c13a59e6330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:57.512730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc3cb0-1306-40f9-9bc9-2c13a59e6330 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:57.513095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc3cb0-1306-40f9-9bc9-2c13a59e6330 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:57.513499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc3cb0-1306-40f9-9bc9-2c13a59e6330 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:57.515184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc3cb0-1306-40f9-9bc9-2c13a59e6330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:57.516917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc3cb0-1306-40f9-9bc9-2c13a59e6330 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:57.546677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:57.562070 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2998/5945] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:21:57 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:57.566085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14a279-faf6-45b4-9575-4c3e5d7a3834 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:57.596056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14a279-faf6-45b4-9575-4c3e5d7a3834 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:57.735333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f1343-5f84-42a8-9164-717638a4ec20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:57.735999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f1343-5f84-42a8-9164-717638a4ec20 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:57.736288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f1343-5f84-42a8-9164-717638a4ec20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:57.736751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f1343-5f84-42a8-9164-717638a4ec20 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:57.737613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f1343-5f84-42a8-9164-717638a4ec20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:57.739742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f1343-5f84-42a8-9164-717638a4ec20 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:57.784996 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2948/5946] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:21:57 2022] POST /identity/v3/users => generated 297 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:21:57.786940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc3cb0-1306-40f9-9bc9-2c13a59e6330 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:57.824110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc3cb0-1306-40f9-9bc9-2c13a59e6330 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:57.835173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9caf6cd-db1b-4411-a9e5-dec38139598c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:57.835711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9caf6cd-db1b-4411-a9e5-dec38139598c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:57.835998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9caf6cd-db1b-4411-a9e5-dec38139598c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:57.836277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9caf6cd-db1b-4411-a9e5-dec38139598c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:57.837943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9caf6cd-db1b-4411-a9e5-dec38139598c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:57.839749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9caf6cd-db1b-4411-a9e5-dec38139598c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:57.875484 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 2999/5947] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:57.879843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f1343-5f84-42a8-9164-717638a4ec20 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:57.899526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f1343-5f84-42a8-9164-717638a4ec20 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:57.915571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49aa16c-1475-48f8-b373-6480e489c844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:57.918059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49aa16c-1475-48f8-b373-6480e489c844 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:57.918374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49aa16c-1475-48f8-b373-6480e489c844 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:57.919601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49aa16c-1475-48f8-b373-6480e489c844 admin admin] PATH_INFO: `/v3/projects/56df18e439a94887aca4be7fc9e1a9b5/users/ca6345a0aa83463fb759cc335835fa63/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:57.943830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49aa16c-1475-48f8-b373-6480e489c844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56df18e439a94887aca4be7fc9e1a9b5, user_id=ca6345a0aa83463fb759cc335835fa63, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:57.947576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49aa16c-1475-48f8-b373-6480e489c844 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:57.979399 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2949/5948] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:57 2022] PUT /identity/v3/projects/56df18e439a94887aca4be7fc9e1a9b5/users/ca6345a0aa83463fb759cc335835fa63/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:57.983346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9caf6cd-db1b-4411-a9e5-dec38139598c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:58.001083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9caf6cd-db1b-4411-a9e5-dec38139598c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:58.073861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031721bc-6c1c-4ea4-826f-cf02b1b1c8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:58.074675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031721bc-6c1c-4ea4-826f-cf02b1b1c8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:58.075148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031721bc-6c1c-4ea4-826f-cf02b1b1c8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:58.075460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031721bc-6c1c-4ea4-826f-cf02b1b1c8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:58.077129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031721bc-6c1c-4ea4-826f-cf02b1b1c8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:58.079281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031721bc-6c1c-4ea4-826f-cf02b1b1c8c3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:58.095753 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3000/5949] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:21:58.100620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49aa16c-1475-48f8-b373-6480e489c844 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:58.126199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49aa16c-1475-48f8-b373-6480e489c844 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:58.141518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549f67d-a067-48d8-9761-5021253e3c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:58.142243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549f67d-a067-48d8-9761-5021253e3c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:58.142530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549f67d-a067-48d8-9761-5021253e3c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:58.143010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549f67d-a067-48d8-9761-5021253e3c97 admin admin] PATH_INFO: `/v3/projects/56df18e439a94887aca4be7fc9e1a9b5/users/ca6345a0aa83463fb759cc335835fa63/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:58.149412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549f67d-a067-48d8-9761-5021253e3c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56df18e439a94887aca4be7fc9e1a9b5, user_id=ca6345a0aa83463fb759cc335835fa63, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:58.152887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549f67d-a067-48d8-9761-5021253e3c97 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:58.183333 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2950/5950] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:21:58 2022] PUT /identity/v3/projects/56df18e439a94887aca4be7fc9e1a9b5/users/ca6345a0aa83463fb759cc335835fa63/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:21:58.195443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56d04e-d7ab-46f2-9e7b-9ecde316448a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:58.196020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56d04e-d7ab-46f2-9e7b-9ecde316448a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:58.196461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56d04e-d7ab-46f2-9e7b-9ecde316448a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:58.270186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bb56d04e-d7ab-46f2-9e7b-9ecde316448a None None] MFA Rules not processed for user `ca6345a0aa83463fb759cc335835fa63`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:21:58.271715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bb56d04e-d7ab-46f2-9e7b-9ecde316448a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:58.403450 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3001/5951] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:21:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:21:58.437592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549f67d-a067-48d8-9761-5021253e3c97 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:21:58.439578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5549f67d-a067-48d8-9761-5021253e3c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:21:58.492307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:58.567375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549f67d-a067-48d8-9761-5021253e3c97 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:21:58.572069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cd732-92e1-4176-8e21-bf68c70f91e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:21:58.573105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cd732-92e1-4176-8e21-bf68c70f91e5 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:21:58.574240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cd732-92e1-4176-8e21-bf68c70f91e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:21:58.576541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cd732-92e1-4176-8e21-bf68c70f91e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:21:58.716661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886cd732-92e1-4176-8e21-bf68c70f91e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:21:58.719008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886cd732-92e1-4176-8e21-bf68c70f91e5 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:21:58.735468 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2951/5952] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:21:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:22:00.371817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56d04e-d7ab-46f2-9e7b-9ecde316448a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:00.376669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bb56d04e-d7ab-46f2-9e7b-9ecde316448a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:00.515778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56d04e-d7ab-46f2-9e7b-9ecde316448a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:00.525070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216395ce-e053-47c4-9627-7a5863fa50a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:00.525900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216395ce-e053-47c4-9627-7a5863fa50a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:00.526283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216395ce-e053-47c4-9627-7a5863fa50a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:00.526655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216395ce-e053-47c4-9627-7a5863fa50a2 admin admin] PATH_INFO: `/v3/users/9c90566035954c90aee066b6606adc43` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:00.527999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216395ce-e053-47c4-9627-7a5863fa50a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c90566035954c90aee066b6606adc43)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:00.530878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216395ce-e053-47c4-9627-7a5863fa50a2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:00.554065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:00.668190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-216395ce-e053-47c4-9627-7a5863fa50a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c90566035954c90aee066b6606adc43'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:00.692084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-216395ce-e053-47c4-9627-7a5863fa50a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c90566035954c90aee066b6606adc43'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:00.694232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-216395ce-e053-47c4-9627-7a5863fa50a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c90566035954c90aee066b6606adc43'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:00.706969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-216395ce-e053-47c4-9627-7a5863fa50a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c90566035954c90aee066b6606adc43'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:00.707811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-216395ce-e053-47c4-9627-7a5863fa50a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c90566035954c90aee066b6606adc43'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:00.744829 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3002/5953] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:22:00 2022] DELETE /identity/v3/users/9c90566035954c90aee066b6606adc43 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:00.749224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e960414-8f34-460e-9232-2e8bb9a77d21 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:00.749706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e960414-8f34-460e-9232-2e8bb9a77d21 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:00.749790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e960414-8f34-460e-9232-2e8bb9a77d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:00.773759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6e960414-8f34-460e-9232-2e8bb9a77d21 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:00.776478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6e960414-8f34-460e-9232-2e8bb9a77d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:00.956222 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2952/5954] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:00.976635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216395ce-e053-47c4-9627-7a5863fa50a2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:00.978946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-216395ce-e053-47c4-9627-7a5863fa50a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:01.140229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216395ce-e053-47c4-9627-7a5863fa50a2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:01.145357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5dfcb-5555-4da9-96be-7c93c3966e7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:01.146257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5dfcb-5555-4da9-96be-7c93c3966e7e service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:01.148738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5dfcb-5555-4da9-96be-7c93c3966e7e service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:01.149220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5dfcb-5555-4da9-96be-7c93c3966e7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:01.197029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5dfcb-5555-4da9-96be-7c93c3966e7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:01.199630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5dfcb-5555-4da9-96be-7c93c3966e7e service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:01.245270 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3003/5955] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:22:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:22:03.476849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e960414-8f34-460e-9232-2e8bb9a77d21 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:03.478974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6e960414-8f34-460e-9232-2e8bb9a77d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:03.502112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e960414-8f34-460e-9232-2e8bb9a77d21 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:03.544341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80683154-7d78-4748-ba94-082038ac70a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:03.545101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80683154-7d78-4748-ba94-082038ac70a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:03.546121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80683154-7d78-4748-ba94-082038ac70a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:03.548589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80683154-7d78-4748-ba94-082038ac70a5 admin admin] PATH_INFO: `/v3/projects/deb2310709174e288f857715071a00f3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:03.557509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80683154-7d78-4748-ba94-082038ac70a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb2310709174e288f857715071a00f3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:03.561611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80683154-7d78-4748-ba94-082038ac70a5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:03.706023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-80683154-7d78-4748-ba94-082038ac70a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb2310709174e288f857715071a00f3', 'request_id': 'req-80683154-7d78-4748-ba94-082038ac70a5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:03.737072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-80683154-7d78-4748-ba94-082038ac70a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb2310709174e288f857715071a00f3', 'request_id': 'req-80683154-7d78-4748-ba94-082038ac70a5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:03.745913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-80683154-7d78-4748-ba94-082038ac70a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb2310709174e288f857715071a00f3', 'request_id': 'req-80683154-7d78-4748-ba94-082038ac70a5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:03.762969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-80683154-7d78-4748-ba94-082038ac70a5 admin admin] The token cache is being invalidate because project deb2310709174e288f857715071a00f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:22:03.764238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-80683154-7d78-4748-ba94-082038ac70a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:03.765511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-80683154-7d78-4748-ba94-082038ac70a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:03.767608 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2953/5956] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:22:03 2022] DELETE /identity/v3/projects/deb2310709174e288f857715071a00f3 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:03.772006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5dfcb-5555-4da9-96be-7c93c3966e7e service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:03.792057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5dfcb-5555-4da9-96be-7c93c3966e7e service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:03.941171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0c2a2-0995-4967-a64c-752f1944544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:03.942028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0c2a2-0995-4967-a64c-752f1944544d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:03.942401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0c2a2-0995-4967-a64c-752f1944544d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:03.942878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0c2a2-0995-4967-a64c-752f1944544d admin admin] PATH_INFO: `/v3/users/af06d33e9645402d937a50ab306a0ca2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:03.946127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0c2a2-0995-4967-a64c-752f1944544d admin admin] RBAC: Authorizing `identity:delete_user(user_id=af06d33e9645402d937a50ab306a0ca2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:03.948400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0c2a2-0995-4967-a64c-752f1944544d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:04.036547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:04.070739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-38b0c2a2-0995-4967-a64c-752f1944544d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af06d33e9645402d937a50ab306a0ca2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:04.108376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-38b0c2a2-0995-4967-a64c-752f1944544d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af06d33e9645402d937a50ab306a0ca2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:04.109523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-38b0c2a2-0995-4967-a64c-752f1944544d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af06d33e9645402d937a50ab306a0ca2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:04.120765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-38b0c2a2-0995-4967-a64c-752f1944544d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af06d33e9645402d937a50ab306a0ca2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:04.121760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-38b0c2a2-0995-4967-a64c-752f1944544d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af06d33e9645402d937a50ab306a0ca2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:04.155104 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3004/5957] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:22:03 2022] DELETE /identity/v3/users/af06d33e9645402d937a50ab306a0ca2 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:05.129180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80683154-7d78-4748-ba94-082038ac70a5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:05.130707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-80683154-7d78-4748-ba94-082038ac70a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:05.143443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:05.153309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80683154-7d78-4748-ba94-082038ac70a5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:05.274251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea3885-f141-4af0-94d2-65e3a23744d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:05.274934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea3885-f141-4af0-94d2-65e3a23744d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:05.275223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea3885-f141-4af0-94d2-65e3a23744d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:05.277176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea3885-f141-4af0-94d2-65e3a23744d9 admin admin] PATH_INFO: `/v3/projects/e4a9dadb374c433fa05eb554a48046d4` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:05.278411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea3885-f141-4af0-94d2-65e3a23744d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a9dadb374c433fa05eb554a48046d4)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:05.280930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea3885-f141-4af0-94d2-65e3a23744d9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:05.350740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f1ea3885-f141-4af0-94d2-65e3a23744d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a9dadb374c433fa05eb554a48046d4', 'request_id': 'req-f1ea3885-f141-4af0-94d2-65e3a23744d9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:05.365443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f1ea3885-f141-4af0-94d2-65e3a23744d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a9dadb374c433fa05eb554a48046d4', 'request_id': 'req-f1ea3885-f141-4af0-94d2-65e3a23744d9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:05.374057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f1ea3885-f141-4af0-94d2-65e3a23744d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a9dadb374c433fa05eb554a48046d4', 'request_id': 'req-f1ea3885-f141-4af0-94d2-65e3a23744d9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:05.388538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f1ea3885-f141-4af0-94d2-65e3a23744d9 admin admin] The token cache is being invalidate because project e4a9dadb374c433fa05eb554a48046d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:22:05.389404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f1ea3885-f141-4af0-94d2-65e3a23744d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:05.390932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f1ea3885-f141-4af0-94d2-65e3a23744d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:05.392531 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2954/5958] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:22:05 2022] DELETE /identity/v3/projects/e4a9dadb374c433fa05eb554a48046d4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:05.397496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e18097-b8b3-4143-a7dd-6bc755e9bf0e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:05.398003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e18097-b8b3-4143-a7dd-6bc755e9bf0e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:05.398153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e18097-b8b3-4143-a7dd-6bc755e9bf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:05.419612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-54e18097-b8b3-4143-a7dd-6bc755e9bf0e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:05.421347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-54e18097-b8b3-4143-a7dd-6bc755e9bf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:05.570070 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3005/5959] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:05.578281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a905-86b8-43d9-85bd-70f9b4beb00c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:05.578580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a905-86b8-43d9-85bd-70f9b4beb00c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:05.578865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a905-86b8-43d9-85bd-70f9b4beb00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:05.628559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c1d6a905-86b8-43d9-85bd-70f9b4beb00c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:05.630412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c1d6a905-86b8-43d9-85bd-70f9b4beb00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:05.650493 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2955/5960] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:05.656023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e18097-b8b3-4143-a7dd-6bc755e9bf0e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:05.672943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e18097-b8b3-4143-a7dd-6bc755e9bf0e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:05.691160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbabae3-c362-4e3c-a0c3-44606fca24b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:05.726227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbabae3-c362-4e3c-a0c3-44606fca24b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:05.729520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbabae3-c362-4e3c-a0c3-44606fca24b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:05.731850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbabae3-c362-4e3c-a0c3-44606fca24b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:05.732956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbabae3-c362-4e3c-a0c3-44606fca24b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:22:05.735237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbabae3-c362-4e3c-a0c3-44606fca24b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:05.740688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbabae3-c362-4e3c-a0c3-44606fca24b9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:05.765590 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3006/5961] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:22:05.769587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6a905-86b8-43d9-85bd-70f9b4beb00c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:05.790446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6a905-86b8-43d9-85bd-70f9b4beb00c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:05.831107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a31e1f-492f-4164-b5b2-43a1f8f81755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:05.832128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a31e1f-492f-4164-b5b2-43a1f8f81755 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:05.834425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a31e1f-492f-4164-b5b2-43a1f8f81755 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:05.836263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a31e1f-492f-4164-b5b2-43a1f8f81755 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:05.839823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a31e1f-492f-4164-b5b2-43a1f8f81755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:05.845585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a31e1f-492f-4164-b5b2-43a1f8f81755 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:05.921394 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2956/5962] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:22:05 2022] POST /identity/v3/projects => generated 363 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:22:05.928029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbabae3-c362-4e3c-a0c3-44606fca24b9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:05.940665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbabae3-c362-4e3c-a0c3-44606fca24b9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:06.072939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab87274-a586-43d7-9f68-70a465d11ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:06.073591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87274-a586-43d7-9f68-70a465d11ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:06.074197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87274-a586-43d7-9f68-70a465d11ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:06.074584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87274-a586-43d7-9f68-70a465d11ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:06.075549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab87274-a586-43d7-9f68-70a465d11ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:06.079017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab87274-a586-43d7-9f68-70a465d11ea1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:06.115929 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3007/5963] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:22:05 2022] POST /identity/v3/users => generated 282 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:22:06.124480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a31e1f-492f-4164-b5b2-43a1f8f81755 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:06.158403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a31e1f-492f-4164-b5b2-43a1f8f81755 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:06.166963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c528e66-7446-4d06-84a1-67a1974e70f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:06.169132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c528e66-7446-4d06-84a1-67a1974e70f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:06.169649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c528e66-7446-4d06-84a1-67a1974e70f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:06.170568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c528e66-7446-4d06-84a1-67a1974e70f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:06.171458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c528e66-7446-4d06-84a1-67a1974e70f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:06.193594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c528e66-7446-4d06-84a1-67a1974e70f4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:06.228021 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2957/5964] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:22:06.231832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab87274-a586-43d7-9f68-70a465d11ea1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:06.282316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab87274-a586-43d7-9f68-70a465d11ea1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:06.300973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8e18b-00b9-4dcf-9f56-42e0d34456d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:06.301624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8e18b-00b9-4dcf-9f56-42e0d34456d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:06.301909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8e18b-00b9-4dcf-9f56-42e0d34456d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:06.302187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8e18b-00b9-4dcf-9f56-42e0d34456d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:06.302888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8e18b-00b9-4dcf-9f56-42e0d34456d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:06.305352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8e18b-00b9-4dcf-9f56-42e0d34456d1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:06.347569 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3008/5965] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:22:06.348805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c528e66-7446-4d06-84a1-67a1974e70f4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:06.390553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c528e66-7446-4d06-84a1-67a1974e70f4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:06.400738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f72f2-0827-44ea-b330-a15ac04bf08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:06.401938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f72f2-0827-44ea-b330-a15ac04bf08d admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:06.402451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f72f2-0827-44ea-b330-a15ac04bf08d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:06.402964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f72f2-0827-44ea-b330-a15ac04bf08d admin admin] PATH_INFO: `/v3/projects/58e8d6e979b644588d27d4fffd7c7d0a/users/36d922ab74774f26833562a644ba5053/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:06.454474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f72f2-0827-44ea-b330-a15ac04bf08d admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e8d6e979b644588d27d4fffd7c7d0a, user_id=36d922ab74774f26833562a644ba5053, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:06.460047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f72f2-0827-44ea-b330-a15ac04bf08d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:06.479322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8e18b-00b9-4dcf-9f56-42e0d34456d1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:06.481471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d4f8e18b-00b9-4dcf-9f56-42e0d34456d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:06.507367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8e18b-00b9-4dcf-9f56-42e0d34456d1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:06.519526 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2958/5966] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:22:06 2022] PUT /identity/v3/projects/58e8d6e979b644588d27d4fffd7c7d0a/users/36d922ab74774f26833562a644ba5053/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:06.531693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df08d6-4ac0-490b-87c4-ef78feb7a173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:06.533309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df08d6-4ac0-490b-87c4-ef78feb7a173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:06.533598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd8565-ece1-4cb8-b0f0-c4c64c4c3079 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:06.533928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd8565-ece1-4cb8-b0f0-c4c64c4c3079 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:06.534041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df08d6-4ac0-490b-87c4-ef78feb7a173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:06.534308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd8565-ece1-4cb8-b0f0-c4c64c4c3079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:06.534697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df08d6-4ac0-490b-87c4-ef78feb7a173 admin admin] PATH_INFO: `/v3/users/2152c6020c354e65919434a7c3019df9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:06.539911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df08d6-4ac0-490b-87c4-ef78feb7a173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2152c6020c354e65919434a7c3019df9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:06.544099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df08d6-4ac0-490b-87c4-ef78feb7a173 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:06.597044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:06.608707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-cafd8565-ece1-4cb8-b0f0-c4c64c4c3079 None None] MFA Rules not processed for user `36d922ab74774f26833562a644ba5053`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:06.614316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cafd8565-ece1-4cb8-b0f0-c4c64c4c3079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:06.695696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-34df08d6-4ac0-490b-87c4-ef78feb7a173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2152c6020c354e65919434a7c3019df9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:06.703955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:06.727855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-34df08d6-4ac0-490b-87c4-ef78feb7a173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2152c6020c354e65919434a7c3019df9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:06.728726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-34df08d6-4ac0-490b-87c4-ef78feb7a173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2152c6020c354e65919434a7c3019df9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:06.740574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-34df08d6-4ac0-490b-87c4-ef78feb7a173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2152c6020c354e65919434a7c3019df9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:06.741463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-34df08d6-4ac0-490b-87c4-ef78feb7a173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2152c6020c354e65919434a7c3019df9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:06.767940 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3009/5967] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:22:06 2022] DELETE /identity/v3/users/2152c6020c354e65919434a7c3019df9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:22:06.772557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff592e5-15ae-410d-b7f6-36466a725a7c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:06.772790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff592e5-15ae-410d-b7f6-36466a725a7c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:06.776862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff592e5-15ae-410d-b7f6-36466a725a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:06.815946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0ff592e5-15ae-410d-b7f6-36466a725a7c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:06.817076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0ff592e5-15ae-410d-b7f6-36466a725a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:06.852460 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2959/5968] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:06 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:06.854150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd8565-ece1-4cb8-b0f0-c4c64c4c3079 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:06.855875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cafd8565-ece1-4cb8-b0f0-c4c64c4c3079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:06.908808 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3010/5969] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:06.936866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd8565-ece1-4cb8-b0f0-c4c64c4c3079 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:06.941540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff592e5-15ae-410d-b7f6-36466a725a7c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:06.941872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f68af-0a40-4c33-8c9a-f59d533fd3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:06.942525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f68af-0a40-4c33-8c9a-f59d533fd3e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:06.942815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f68af-0a40-4c33-8c9a-f59d533fd3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:06.943097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f68af-0a40-4c33-8c9a-f59d533fd3e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:06.943858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f68af-0a40-4c33-8c9a-f59d533fd3e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:06.945802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f68af-0a40-4c33-8c9a-f59d533fd3e4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:06.946781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0ff592e5-15ae-410d-b7f6-36466a725a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:06.983750 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2960/5970] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:22:06 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:22:06.985270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f68af-0a40-4c33-8c9a-f59d533fd3e4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:07.071483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f68af-0a40-4c33-8c9a-f59d533fd3e4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:07.079189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab47a6-b8fd-4b03-bc0a-bcfd0877f999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:07.080431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab47a6-b8fd-4b03-bc0a-bcfd0877f999 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:07.081020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab47a6-b8fd-4b03-bc0a-bcfd0877f999 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:07.081681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab47a6-b8fd-4b03-bc0a-bcfd0877f999 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:07.082595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab47a6-b8fd-4b03-bc0a-bcfd0877f999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:07.085334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab47a6-b8fd-4b03-bc0a-bcfd0877f999 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:07.087181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff592e5-15ae-410d-b7f6-36466a725a7c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:07.115955 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2961/5971] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:22:06 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:22:07.120048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab47a6-b8fd-4b03-bc0a-bcfd0877f999 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:07.137772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab47a6-b8fd-4b03-bc0a-bcfd0877f999 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:07.148215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:07.148552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c460186-a37a-4ca6-98ba-cad845336a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:07.150227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c460186-a37a-4ca6-98ba-cad845336a63 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:07.151203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c460186-a37a-4ca6-98ba-cad845336a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:07.151791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c460186-a37a-4ca6-98ba-cad845336a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:07.152718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c460186-a37a-4ca6-98ba-cad845336a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:07.156053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c460186-a37a-4ca6-98ba-cad845336a63 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:07.161157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693f43d-5fe3-4560-917d-24aa71847722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:07.164560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693f43d-5fe3-4560-917d-24aa71847722 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:07.164695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693f43d-5fe3-4560-917d-24aa71847722 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:07.164975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693f43d-5fe3-4560-917d-24aa71847722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:07.174196 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2962/5972] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:22:07.178061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c460186-a37a-4ca6-98ba-cad845336a63 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:07.184465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693f43d-5fe3-4560-917d-24aa71847722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:07.196029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c460186-a37a-4ca6-98ba-cad845336a63 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:07.197022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693f43d-5fe3-4560-917d-24aa71847722 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:07.202870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88855e4-943b-4d90-bb7b-8453f0d27d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:07.203866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88855e4-943b-4d90-bb7b-8453f0d27d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:07.204928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88855e4-943b-4d90-bb7b-8453f0d27d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:07.205433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88855e4-943b-4d90-bb7b-8453f0d27d68 admin admin] PATH_INFO: `/v3/projects/3bafbfb0e8bb48a09cf18ddc488f7ed9/users/76deb9db64c044018347db8f389fe8fc/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:07.221682 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3011/5973] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:22:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:22:07.226694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88855e4-943b-4d90-bb7b-8453f0d27d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bafbfb0e8bb48a09cf18ddc488f7ed9, user_id=76deb9db64c044018347db8f389fe8fc, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:07.232213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88855e4-943b-4d90-bb7b-8453f0d27d68 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:07.254173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:07.274361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693f43d-5fe3-4560-917d-24aa71847722 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:07.288723 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2963/5974] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:22:07 2022] PUT /identity/v3/projects/3bafbfb0e8bb48a09cf18ddc488f7ed9/users/76deb9db64c044018347db8f389fe8fc/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:07.289353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693f43d-5fe3-4560-917d-24aa71847722 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:07.403355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fdd181-5da6-4c29-acdf-266aaff27933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:07.404873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdd181-5da6-4c29-acdf-266aaff27933 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:07.405414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdd181-5da6-4c29-acdf-266aaff27933 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:07.405921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdd181-5da6-4c29-acdf-266aaff27933 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:07.406950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fdd181-5da6-4c29-acdf-266aaff27933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:07.419088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fdd181-5da6-4c29-acdf-266aaff27933 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:07.458941 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3012/5975] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:22:07.463964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88855e4-943b-4d90-bb7b-8453f0d27d68 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:07.483775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88855e4-943b-4d90-bb7b-8453f0d27d68 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:07.490171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a4c2f-2d8b-41d2-a01a-e7e2689a05cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:07.491035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a4c2f-2d8b-41d2-a01a-e7e2689a05cb admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:07.491456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a4c2f-2d8b-41d2-a01a-e7e2689a05cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:07.491834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a4c2f-2d8b-41d2-a01a-e7e2689a05cb admin admin] PATH_INFO: `/v3/projects/3bafbfb0e8bb48a09cf18ddc488f7ed9/users/76deb9db64c044018347db8f389fe8fc/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:07.494033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a4c2f-2d8b-41d2-a01a-e7e2689a05cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bafbfb0e8bb48a09cf18ddc488f7ed9, user_id=76deb9db64c044018347db8f389fe8fc, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:07.496930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a4c2f-2d8b-41d2-a01a-e7e2689a05cb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:07.527079 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2964/5976] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:22:07 2022] PUT /identity/v3/projects/3bafbfb0e8bb48a09cf18ddc488f7ed9/users/76deb9db64c044018347db8f389fe8fc/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:07.529464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eabb13-fe71-40c3-bc29-3ba2b572298f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:07.530591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eabb13-fe71-40c3-bc29-3ba2b572298f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:07.531091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eabb13-fe71-40c3-bc29-3ba2b572298f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:07.600626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-47eabb13-fe71-40c3-bc29-3ba2b572298f None None] MFA Rules not processed for user `76deb9db64c044018347db8f389fe8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:07.602518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-47eabb13-fe71-40c3-bc29-3ba2b572298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:07.693931 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3013/5977] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:22:07.706491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a4c2f-2d8b-41d2-a01a-e7e2689a05cb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:07.709538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a09a4c2f-2d8b-41d2-a01a-e7e2689a05cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:07.809163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a4c2f-2d8b-41d2-a01a-e7e2689a05cb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:07.817887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8587ae-dc4b-4030-b007-b161d8bab61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:07.820421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8587ae-dc4b-4030-b007-b161d8bab61e service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:07.820910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8587ae-dc4b-4030-b007-b161d8bab61e service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:07.821383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8587ae-dc4b-4030-b007-b161d8bab61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:07.848514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8587ae-dc4b-4030-b007-b161d8bab61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:07.852158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8587ae-dc4b-4030-b007-b161d8bab61e service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:07.868806 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2965/5978] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:22:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:22:08.027682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eabb13-fe71-40c3-bc29-3ba2b572298f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:08.029666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-47eabb13-fe71-40c3-bc29-3ba2b572298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:08.144439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eabb13-fe71-40c3-bc29-3ba2b572298f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:08.149816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f024b0c-7fc7-423f-9bfe-993d9c59541e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:08.150484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f024b0c-7fc7-423f-9bfe-993d9c59541e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:08.150773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f024b0c-7fc7-423f-9bfe-993d9c59541e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:08.151054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f024b0c-7fc7-423f-9bfe-993d9c59541e admin admin] PATH_INFO: `/v3/projects/c18fb03498c84b268fc33a8f1acbfcb3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:08.152388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f024b0c-7fc7-423f-9bfe-993d9c59541e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c18fb03498c84b268fc33a8f1acbfcb3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:08.155467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f024b0c-7fc7-423f-9bfe-993d9c59541e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:08.168363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:08.224305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6f024b0c-7fc7-423f-9bfe-993d9c59541e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c18fb03498c84b268fc33a8f1acbfcb3', 'request_id': 'req-6f024b0c-7fc7-423f-9bfe-993d9c59541e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:08.235316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6f024b0c-7fc7-423f-9bfe-993d9c59541e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c18fb03498c84b268fc33a8f1acbfcb3', 'request_id': 'req-6f024b0c-7fc7-423f-9bfe-993d9c59541e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:08.245244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6f024b0c-7fc7-423f-9bfe-993d9c59541e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c18fb03498c84b268fc33a8f1acbfcb3', 'request_id': 'req-6f024b0c-7fc7-423f-9bfe-993d9c59541e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:08.259372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6f024b0c-7fc7-423f-9bfe-993d9c59541e admin admin] The token cache is being invalidate because project c18fb03498c84b268fc33a8f1acbfcb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:22:08.259976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6f024b0c-7fc7-423f-9bfe-993d9c59541e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:08.261840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6f024b0c-7fc7-423f-9bfe-993d9c59541e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:08.270177 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3014/5979] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:22:08 2022] DELETE /identity/v3/projects/c18fb03498c84b268fc33a8f1acbfcb3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:08.270615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879509e4-8e95-4fb0-84c9-4e5f0428cc3b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:08.271135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879509e4-8e95-4fb0-84c9-4e5f0428cc3b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:08.271397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879509e4-8e95-4fb0-84c9-4e5f0428cc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:08.306832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-879509e4-8e95-4fb0-84c9-4e5f0428cc3b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:08.309568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-879509e4-8e95-4fb0-84c9-4e5f0428cc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:08.471339 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2966/5980] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:22:08.481245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b72b07-7b98-4d92-a6b4-36b7f3f57d84 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:08.481535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b72b07-7b98-4d92-a6b4-36b7f3f57d84 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:08.481813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b72b07-7b98-4d92-a6b4-36b7f3f57d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:08.547983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c0b72b07-7b98-4d92-a6b4-36b7f3f57d84 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:08.550193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c0b72b07-7b98-4d92-a6b4-36b7f3f57d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:08.562603 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3015/5981] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:08.564104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879509e4-8e95-4fb0-84c9-4e5f0428cc3b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:08.580642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879509e4-8e95-4fb0-84c9-4e5f0428cc3b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:08.597778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf5c77-dc78-4a91-9dc1-bb84930bfb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:08.598439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf5c77-dc78-4a91-9dc1-bb84930bfb56 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:08.598731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf5c77-dc78-4a91-9dc1-bb84930bfb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:08.599019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf5c77-dc78-4a91-9dc1-bb84930bfb56 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:08.599817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf5c77-dc78-4a91-9dc1-bb84930bfb56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:22:08.600107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf5c77-dc78-4a91-9dc1-bb84930bfb56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:08.602399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf5c77-dc78-4a91-9dc1-bb84930bfb56 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:08.625291 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2967/5982] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:22:08.631956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b72b07-7b98-4d92-a6b4-36b7f3f57d84 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:08.649730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b72b07-7b98-4d92-a6b4-36b7f3f57d84 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:08.658033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c6e74-b756-4765-a69a-1533d349553d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:08.658842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c6e74-b756-4765-a69a-1533d349553d admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:08.659315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c6e74-b756-4765-a69a-1533d349553d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:08.659695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c6e74-b756-4765-a69a-1533d349553d admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:08.661961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c6e74-b756-4765-a69a-1533d349553d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:08.665325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c6e74-b756-4765-a69a-1533d349553d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:08.717369 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3016/5983] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:22:08 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:22:08.717811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf5c77-dc78-4a91-9dc1-bb84930bfb56 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:08.728573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf5c77-dc78-4a91-9dc1-bb84930bfb56 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:08.798880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9945c-0716-4f29-8f31-20abe83d97a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:08.799093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9945c-0716-4f29-8f31-20abe83d97a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:08.799847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9945c-0716-4f29-8f31-20abe83d97a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:08.799847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9945c-0716-4f29-8f31-20abe83d97a4 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:08.800542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9945c-0716-4f29-8f31-20abe83d97a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:08.802688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9945c-0716-4f29-8f31-20abe83d97a4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:08.835356 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2968/5984] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:22:08 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:22:08.839127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c6e74-b756-4765-a69a-1533d349553d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:08.856335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c6e74-b756-4765-a69a-1533d349553d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:08.867446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b97e1-e6a5-415f-9c75-7bb0cfcef530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:08.868100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b97e1-e6a5-415f-9c75-7bb0cfcef530 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:08.868395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b97e1-e6a5-415f-9c75-7bb0cfcef530 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:08.869161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b97e1-e6a5-415f-9c75-7bb0cfcef530 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:08.869380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b97e1-e6a5-415f-9c75-7bb0cfcef530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:08.875734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b97e1-e6a5-415f-9c75-7bb0cfcef530 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:08.899421 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3017/5985] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:22:08.900707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9945c-0716-4f29-8f31-20abe83d97a4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:08.916774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9945c-0716-4f29-8f31-20abe83d97a4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:08.927233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb789d04-89a7-4f11-927e-81216ec1fa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:08.928195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb789d04-89a7-4f11-927e-81216ec1fa10 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:08.929197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb789d04-89a7-4f11-927e-81216ec1fa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:08.930233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb789d04-89a7-4f11-927e-81216ec1fa10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:08.931652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb789d04-89a7-4f11-927e-81216ec1fa10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:08.933840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb789d04-89a7-4f11-927e-81216ec1fa10 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:08.936480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:08.962099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b97e1-e6a5-415f-9c75-7bb0cfcef530 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:08.963067 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2969/5986] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:22:08.980769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b97e1-e6a5-415f-9c75-7bb0cfcef530 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:09.006429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad92425-e6a9-4723-9663-09bfa35791c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:09.008126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad92425-e6a9-4723-9663-09bfa35791c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:09.010241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad92425-e6a9-4723-9663-09bfa35791c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:09.011324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad92425-e6a9-4723-9663-09bfa35791c3 admin admin] PATH_INFO: `/v3/projects/caf6d7194a514189a7bb15fd5d786d32/users/1eefbe27ba2942188d42716e08f01264/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:09.055185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad92425-e6a9-4723-9663-09bfa35791c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf6d7194a514189a7bb15fd5d786d32, user_id=1eefbe27ba2942188d42716e08f01264, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:09.058969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad92425-e6a9-4723-9663-09bfa35791c3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:09.097736 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3018/5987] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:22:08 2022] PUT /identity/v3/projects/caf6d7194a514189a7bb15fd5d786d32/users/1eefbe27ba2942188d42716e08f01264/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:22:09.198760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4277708-07d4-4d1e-bb61-c1f09d72d7aa None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:09.199126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4277708-07d4-4d1e-bb61-c1f09d72d7aa None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:09.199350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4277708-07d4-4d1e-bb61-c1f09d72d7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:09.246276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c4277708-07d4-4d1e-bb61-c1f09d72d7aa None None] MFA Rules not processed for user `1eefbe27ba2942188d42716e08f01264`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:09.248638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c4277708-07d4-4d1e-bb61-c1f09d72d7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:09.346319 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2970/5988] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:09.376120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad92425-e6a9-4723-9663-09bfa35791c3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:09.379396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1ad92425-e6a9-4723-9663-09bfa35791c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:09.462061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad92425-e6a9-4723-9663-09bfa35791c3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:09.467676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a935ca4-0563-42d2-9c38-10b857a376b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:09.468414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a935ca4-0563-42d2-9c38-10b857a376b5 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:09.468706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a935ca4-0563-42d2-9c38-10b857a376b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:09.468987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a935ca4-0563-42d2-9c38-10b857a376b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:09.481945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a935ca4-0563-42d2-9c38-10b857a376b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:09.485175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a935ca4-0563-42d2-9c38-10b857a376b5 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:09.503363 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3019/5989] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:22:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:22:12.100603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4277708-07d4-4d1e-bb61-c1f09d72d7aa None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:12.102832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c4277708-07d4-4d1e-bb61-c1f09d72d7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:12.161113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4277708-07d4-4d1e-bb61-c1f09d72d7aa None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:12.202874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bed09e-3917-473b-924d-297c78b38fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:12.205482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bed09e-3917-473b-924d-297c78b38fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:12.206067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bed09e-3917-473b-924d-297c78b38fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:12.206571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bed09e-3917-473b-924d-297c78b38fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:12.213612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-40bed09e-3917-473b-924d-297c78b38fd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:12.437982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bed09e-3917-473b-924d-297c78b38fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:12.440915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bed09e-3917-473b-924d-297c78b38fd3 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:12.475880 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2971/5990] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:22:12 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:22:12.745534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a9657-562c-4de0-8783-f63ac9690ea6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:12.746686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a9657-562c-4de0-8783-f63ac9690ea6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:12.747448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a9657-562c-4de0-8783-f63ac9690ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:12.790532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4e1a9657-562c-4de0-8783-f63ac9690ea6 None None] MFA Rules not processed for user `c025e35fd22a4895a5d0301c1d5b0e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:12.793208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4e1a9657-562c-4de0-8783-f63ac9690ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:12.875784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:12.881159 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3020/5991] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:14.104121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bed09e-3917-473b-924d-297c78b38fd3 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:14.105945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-40bed09e-3917-473b-924d-297c78b38fd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:14.176838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a9657-562c-4de0-8783-f63ac9690ea6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:14.198811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a9657-562c-4de0-8783-f63ac9690ea6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:14.211442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fcca4-05ef-4ae5-a9e1-3809c9b3f097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:14.212569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fcca4-05ef-4ae5-a9e1-3809c9b3f097 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:14.213077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fcca4-05ef-4ae5-a9e1-3809c9b3f097 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:14.213570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fcca4-05ef-4ae5-a9e1-3809c9b3f097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:14.215897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-aa1fcca4-05ef-4ae5-a9e1-3809c9b3f097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:14.272558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bed09e-3917-473b-924d-297c78b38fd3 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:14.279979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb329bc7-38cf-4e11-89cc-89f21fe3507d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:14.280530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb329bc7-38cf-4e11-89cc-89f21fe3507d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:14.281829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb329bc7-38cf-4e11-89cc-89f21fe3507d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:14.283677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb329bc7-38cf-4e11-89cc-89f21fe3507d admin admin] PATH_INFO: `/v3/users/36d922ab74774f26833562a644ba5053` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:14.286176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb329bc7-38cf-4e11-89cc-89f21fe3507d admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d922ab74774f26833562a644ba5053)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:14.290438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb329bc7-38cf-4e11-89cc-89f21fe3507d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:14.347923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:14.406400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bb329bc7-38cf-4e11-89cc-89f21fe3507d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d922ab74774f26833562a644ba5053'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:14.407966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bb329bc7-38cf-4e11-89cc-89f21fe3507d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d922ab74774f26833562a644ba5053'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:14.416659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fcca4-05ef-4ae5-a9e1-3809c9b3f097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:14.418449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fcca4-05ef-4ae5-a9e1-3809c9b3f097 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:14.431850 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3021/5992] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:22:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:22:14.448316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bb329bc7-38cf-4e11-89cc-89f21fe3507d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d922ab74774f26833562a644ba5053'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:14.449751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bb329bc7-38cf-4e11-89cc-89f21fe3507d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d922ab74774f26833562a644ba5053'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:14.471538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bb329bc7-38cf-4e11-89cc-89f21fe3507d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d922ab74774f26833562a644ba5053'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:14.503962 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2972/5993] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:22:14 2022] DELETE /identity/v3/users/36d922ab74774f26833562a644ba5053 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:14.508106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0bbfe-f488-4d8a-9dda-32102fd32d23 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:14.509296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0bbfe-f488-4d8a-9dda-32102fd32d23 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:14.510042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0bbfe-f488-4d8a-9dda-32102fd32d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:14.538798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-91e0bbfe-f488-4d8a-9dda-32102fd32d23 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:14.540288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-91e0bbfe-f488-4d8a-9dda-32102fd32d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:14.668822 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3022/5994] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:14.709963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb329bc7-38cf-4e11-89cc-89f21fe3507d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:14.711799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bb329bc7-38cf-4e11-89cc-89f21fe3507d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:14.867665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb329bc7-38cf-4e11-89cc-89f21fe3507d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:14.873245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178a8fe-a31f-4b99-b268-603170c26328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:14.874124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178a8fe-a31f-4b99-b268-603170c26328 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:14.874409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178a8fe-a31f-4b99-b268-603170c26328 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:14.874693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178a8fe-a31f-4b99-b268-603170c26328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:14.900450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178a8fe-a31f-4b99-b268-603170c26328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:14.903176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178a8fe-a31f-4b99-b268-603170c26328 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:14.936516 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2973/5995] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:22:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:22:17.018887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0bbfe-f488-4d8a-9dda-32102fd32d23 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:17.021039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-91e0bbfe-f488-4d8a-9dda-32102fd32d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:17.043877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0bbfe-f488-4d8a-9dda-32102fd32d23 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:17.053206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d05bf8-6911-4485-8a17-0c5b80900c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:17.053898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d05bf8-6911-4485-8a17-0c5b80900c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:17.054232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d05bf8-6911-4485-8a17-0c5b80900c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:17.054525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d05bf8-6911-4485-8a17-0c5b80900c80 admin admin] PATH_INFO: `/v3/projects/58e8d6e979b644588d27d4fffd7c7d0a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:17.055821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d05bf8-6911-4485-8a17-0c5b80900c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58e8d6e979b644588d27d4fffd7c7d0a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:17.058030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d05bf8-6911-4485-8a17-0c5b80900c80 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:17.144078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-80d05bf8-6911-4485-8a17-0c5b80900c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e8d6e979b644588d27d4fffd7c7d0a', 'request_id': 'req-80d05bf8-6911-4485-8a17-0c5b80900c80'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:17.170032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-80d05bf8-6911-4485-8a17-0c5b80900c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e8d6e979b644588d27d4fffd7c7d0a', 'request_id': 'req-80d05bf8-6911-4485-8a17-0c5b80900c80'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:17.203275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-80d05bf8-6911-4485-8a17-0c5b80900c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e8d6e979b644588d27d4fffd7c7d0a', 'request_id': 'req-80d05bf8-6911-4485-8a17-0c5b80900c80'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:17.216406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:17.227323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-80d05bf8-6911-4485-8a17-0c5b80900c80 admin admin] The token cache is being invalidate because project 58e8d6e979b644588d27d4fffd7c7d0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:22:17.227654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-80d05bf8-6911-4485-8a17-0c5b80900c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:17.232751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-80d05bf8-6911-4485-8a17-0c5b80900c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:17.237794 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3023/5996] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:22:17 2022] DELETE /identity/v3/projects/58e8d6e979b644588d27d4fffd7c7d0a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:17.243316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178a8fe-a31f-4b99-b268-603170c26328 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:17.265770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178a8fe-a31f-4b99-b268-603170c26328 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:17.400386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b596d-ea8d-47e3-9b92-f8578de29c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:17.404081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b596d-ea8d-47e3-9b92-f8578de29c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:17.406308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b596d-ea8d-47e3-9b92-f8578de29c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:17.407590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b596d-ea8d-47e3-9b92-f8578de29c22 admin admin] PATH_INFO: `/v3/users/76deb9db64c044018347db8f389fe8fc` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:17.414615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b596d-ea8d-47e3-9b92-f8578de29c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76deb9db64c044018347db8f389fe8fc)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:17.422021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b596d-ea8d-47e3-9b92-f8578de29c22 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:17.560712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ee8b596d-ea8d-47e3-9b92-f8578de29c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76deb9db64c044018347db8f389fe8fc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:17.566461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ee8b596d-ea8d-47e3-9b92-f8578de29c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76deb9db64c044018347db8f389fe8fc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:17.568000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:17.597569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ee8b596d-ea8d-47e3-9b92-f8578de29c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76deb9db64c044018347db8f389fe8fc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:17.604340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ee8b596d-ea8d-47e3-9b92-f8578de29c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76deb9db64c044018347db8f389fe8fc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:17.618869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ee8b596d-ea8d-47e3-9b92-f8578de29c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76deb9db64c044018347db8f389fe8fc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:17.651958 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2974/5997] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:22:17 2022] DELETE /identity/v3/users/76deb9db64c044018347db8f389fe8fc => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:19.282741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d05bf8-6911-4485-8a17-0c5b80900c80 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:19.284609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-80d05bf8-6911-4485-8a17-0c5b80900c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:19.303691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d05bf8-6911-4485-8a17-0c5b80900c80 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:19.478952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9ec3d-a91a-4f21-b31f-69b1c1551cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:19.479932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9ec3d-a91a-4f21-b31f-69b1c1551cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:19.481529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9ec3d-a91a-4f21-b31f-69b1c1551cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:19.482182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9ec3d-a91a-4f21-b31f-69b1c1551cd9 admin admin] PATH_INFO: `/v3/projects/3bafbfb0e8bb48a09cf18ddc488f7ed9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:19.484588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9ec3d-a91a-4f21-b31f-69b1c1551cd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bafbfb0e8bb48a09cf18ddc488f7ed9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:19.490339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9ec3d-a91a-4f21-b31f-69b1c1551cd9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:19.619446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cea9ec3d-a91a-4f21-b31f-69b1c1551cd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bafbfb0e8bb48a09cf18ddc488f7ed9', 'request_id': 'req-cea9ec3d-a91a-4f21-b31f-69b1c1551cd9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:19.635467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cea9ec3d-a91a-4f21-b31f-69b1c1551cd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bafbfb0e8bb48a09cf18ddc488f7ed9', 'request_id': 'req-cea9ec3d-a91a-4f21-b31f-69b1c1551cd9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:19.651604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cea9ec3d-a91a-4f21-b31f-69b1c1551cd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bafbfb0e8bb48a09cf18ddc488f7ed9', 'request_id': 'req-cea9ec3d-a91a-4f21-b31f-69b1c1551cd9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:19.677536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cea9ec3d-a91a-4f21-b31f-69b1c1551cd9 admin admin] The token cache is being invalidate because project 3bafbfb0e8bb48a09cf18ddc488f7ed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:22:19.678075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cea9ec3d-a91a-4f21-b31f-69b1c1551cd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:19.679255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cea9ec3d-a91a-4f21-b31f-69b1c1551cd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:19.683692 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3024/5998] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:22:19 2022] DELETE /identity/v3/projects/3bafbfb0e8bb48a09cf18ddc488f7ed9 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:19.688766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad902892-2afd-4d55-978a-546731714c99 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:19.689257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad902892-2afd-4d55-978a-546731714c99 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:19.689660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad902892-2afd-4d55-978a-546731714c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:19.762279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ad902892-2afd-4d55-978a-546731714c99 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:19.765405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ad902892-2afd-4d55-978a-546731714c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:19.952343 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2975/5999] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:19.956253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1dd74-81b3-46d6-872d-e79ce1ac7cf5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:19.957171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1dd74-81b3-46d6-872d-e79ce1ac7cf5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:19.957579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1dd74-81b3-46d6-872d-e79ce1ac7cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:20.008893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-6ab1dd74-81b3-46d6-872d-e79ce1ac7cf5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:20.010149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6ab1dd74-81b3-46d6-872d-e79ce1ac7cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:20.034896 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3025/6000] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:20.036151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad902892-2afd-4d55-978a-546731714c99 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:20.049784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad902892-2afd-4d55-978a-546731714c99 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:20.062395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e61c4d-921e-4a84-9cc3-517cc01ed26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:20.063047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e61c4d-921e-4a84-9cc3-517cc01ed26b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:20.066875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e61c4d-921e-4a84-9cc3-517cc01ed26b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:20.067165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e61c4d-921e-4a84-9cc3-517cc01ed26b admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:20.070175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e61c4d-921e-4a84-9cc3-517cc01ed26b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:22:20.070175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e61c4d-921e-4a84-9cc3-517cc01ed26b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:20.076247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e61c4d-921e-4a84-9cc3-517cc01ed26b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:20.117218 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2976/6001] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:22:20.123468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1dd74-81b3-46d6-872d-e79ce1ac7cf5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:20.142132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1dd74-81b3-46d6-872d-e79ce1ac7cf5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:20.160867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62991dd-fca9-46dc-9315-2aa83c3e7d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:20.160867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62991dd-fca9-46dc-9315-2aa83c3e7d17 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:20.160867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62991dd-fca9-46dc-9315-2aa83c3e7d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:20.161285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62991dd-fca9-46dc-9315-2aa83c3e7d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:20.161706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62991dd-fca9-46dc-9315-2aa83c3e7d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:20.163661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62991dd-fca9-46dc-9315-2aa83c3e7d17 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:20.231077 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3026/6002] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:22:20 2022] POST /identity/v3/projects => generated 395 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:22:20.236531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e61c4d-921e-4a84-9cc3-517cc01ed26b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:20.258926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e61c4d-921e-4a84-9cc3-517cc01ed26b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:20.390456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833b926-b5a2-479c-8fcf-44d08cddbcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:20.391332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833b926-b5a2-479c-8fcf-44d08cddbcae admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:20.391911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833b926-b5a2-479c-8fcf-44d08cddbcae admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:20.393216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833b926-b5a2-479c-8fcf-44d08cddbcae admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:20.394332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833b926-b5a2-479c-8fcf-44d08cddbcae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:20.396532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833b926-b5a2-479c-8fcf-44d08cddbcae admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:20.431089 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2977/6003] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:22:20 2022] POST /identity/v3/users => generated 298 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:22:20.436289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62991dd-fca9-46dc-9315-2aa83c3e7d17 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:20.461091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62991dd-fca9-46dc-9315-2aa83c3e7d17 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:20.477746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2da12f-b75e-4994-a918-1bb39d78df8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:20.479424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2da12f-b75e-4994-a918-1bb39d78df8c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:20.479992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2da12f-b75e-4994-a918-1bb39d78df8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:20.481104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2da12f-b75e-4994-a918-1bb39d78df8c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:20.483221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2da12f-b75e-4994-a918-1bb39d78df8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:20.485538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2da12f-b75e-4994-a918-1bb39d78df8c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:20.529598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833b926-b5a2-479c-8fcf-44d08cddbcae admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:20.540932 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3027/6004] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:22:20.548332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833b926-b5a2-479c-8fcf-44d08cddbcae admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:20.557018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8684171-3c18-4499-bb9c-cd0ee2562f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:20.557939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8684171-3c18-4499-bb9c-cd0ee2562f71 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:20.558405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8684171-3c18-4499-bb9c-cd0ee2562f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:20.558688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8684171-3c18-4499-bb9c-cd0ee2562f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:20.559464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8684171-3c18-4499-bb9c-cd0ee2562f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:20.563212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8684171-3c18-4499-bb9c-cd0ee2562f71 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:20.589149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2da12f-b75e-4994-a918-1bb39d78df8c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:20.602594 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2978/6005] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:22:20.605233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2da12f-b75e-4994-a918-1bb39d78df8c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:20.612618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847315f1-5757-448e-82b3-4bc4d3b70ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:20.613317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847315f1-5757-448e-82b3-4bc4d3b70ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:20.613603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847315f1-5757-448e-82b3-4bc4d3b70ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:20.613883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847315f1-5757-448e-82b3-4bc4d3b70ef1 admin admin] PATH_INFO: `/v3/projects/b21828acf40d473d851e8c03a0ecbd53/users/359fb7c2ebdc4336a502b4df07d8719e/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:20.636594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847315f1-5757-448e-82b3-4bc4d3b70ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b21828acf40d473d851e8c03a0ecbd53, user_id=359fb7c2ebdc4336a502b4df07d8719e, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:20.640668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847315f1-5757-448e-82b3-4bc4d3b70ef1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:20.679528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94a71b-1748-424b-b1f2-9aa89bc14217 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:20.680042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94a71b-1748-424b-b1f2-9aa89bc14217 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:20.680213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94a71b-1748-424b-b1f2-9aa89bc14217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:20.684220 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3028/6006] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:22:20 2022] PUT /identity/v3/projects/b21828acf40d473d851e8c03a0ecbd53/users/359fb7c2ebdc4336a502b4df07d8719e/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:20.733658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0f94a71b-1748-424b-b1f2-9aa89bc14217 None None] MFA Rules not processed for user `359fb7c2ebdc4336a502b4df07d8719e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:20.738548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0f94a71b-1748-424b-b1f2-9aa89bc14217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:20.774429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:20.900658 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2979/6007] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:21.022573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847315f1-5757-448e-82b3-4bc4d3b70ef1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:21.024991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-847315f1-5757-448e-82b3-4bc4d3b70ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:21.189394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:21.329212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847315f1-5757-448e-82b3-4bc4d3b70ef1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:21.339728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f6878-fc0e-4b73-b1a6-5da916116f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:21.342943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f6878-fc0e-4b73-b1a6-5da916116f17 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:21.345775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f6878-fc0e-4b73-b1a6-5da916116f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:21.347258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f6878-fc0e-4b73-b1a6-5da916116f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:21.386029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f6878-fc0e-4b73-b1a6-5da916116f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:21.387566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f6878-fc0e-4b73-b1a6-5da916116f17 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:21.411583 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3029/6008] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:22:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:22:30.558016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94a71b-1748-424b-b1f2-9aa89bc14217 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:30.559592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0f94a71b-1748-424b-b1f2-9aa89bc14217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:30.582662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94a71b-1748-424b-b1f2-9aa89bc14217 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:30.587252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baec56-5be0-42de-a67a-5e536e650838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:30.588245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baec56-5be0-42de-a67a-5e536e650838 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:30.588773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baec56-5be0-42de-a67a-5e536e650838 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:30.589602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baec56-5be0-42de-a67a-5e536e650838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:30.592369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-17baec56-5be0-42de-a67a-5e536e650838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:30.681343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17baec56-5be0-42de-a67a-5e536e650838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:30.682815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17baec56-5be0-42de-a67a-5e536e650838 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:30.697489 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2980/6009] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:22:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:22:31.403103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=14 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:34.225386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f6878-fc0e-4b73-b1a6-5da916116f17 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:34.228428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e47f6878-fc0e-4b73-b1a6-5da916116f17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:34.345247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f6878-fc0e-4b73-b1a6-5da916116f17 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:34.360173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1db12-08d9-40d8-9308-f73b7ed5f168 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:34.360828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1db12-08d9-40d8-9308-f73b7ed5f168 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:34.361113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1db12-08d9-40d8-9308-f73b7ed5f168 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:34.361390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1db12-08d9-40d8-9308-f73b7ed5f168 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:34.364362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e5d1db12-08d9-40d8-9308-f73b7ed5f168 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:34.472126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1db12-08d9-40d8-9308-f73b7ed5f168 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:34.474303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1db12-08d9-40d8-9308-f73b7ed5f168 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:34.502106 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3030/6010] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:22:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:22:40.691697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=46 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:42.962857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baec56-5be0-42de-a67a-5e536e650838 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:42.964481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-17baec56-5be0-42de-a67a-5e536e650838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:43.088374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baec56-5be0-42de-a67a-5e536e650838 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:43.093350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8fa24-04af-42e4-b21e-5616f2a095e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:43.093941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8fa24-04af-42e4-b21e-5616f2a095e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:43.094421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8fa24-04af-42e4-b21e-5616f2a095e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:43.094870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8fa24-04af-42e4-b21e-5616f2a095e0 admin admin] PATH_INFO: `/v3/users/1eefbe27ba2942188d42716e08f01264` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:43.096285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8fa24-04af-42e4-b21e-5616f2a095e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eefbe27ba2942188d42716e08f01264)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:43.098403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8fa24-04af-42e4-b21e-5616f2a095e0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:43.174041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-23a8fa24-04af-42e4-b21e-5616f2a095e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eefbe27ba2942188d42716e08f01264'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:43.175009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-23a8fa24-04af-42e4-b21e-5616f2a095e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eefbe27ba2942188d42716e08f01264'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:43.190100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-23a8fa24-04af-42e4-b21e-5616f2a095e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eefbe27ba2942188d42716e08f01264'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:43.190860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-23a8fa24-04af-42e4-b21e-5616f2a095e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eefbe27ba2942188d42716e08f01264'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:43.203451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-23a8fa24-04af-42e4-b21e-5616f2a095e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eefbe27ba2942188d42716e08f01264'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:43.231458 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2981/6011] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:22:42 2022] DELETE /identity/v3/users/1eefbe27ba2942188d42716e08f01264 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:43.235681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff0d4c-84c0-4777-85e8-d230cd347bdd None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:43.236583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff0d4c-84c0-4777-85e8-d230cd347bdd None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:43.237312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff0d4c-84c0-4777-85e8-d230cd347bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:43.265316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8fff0d4c-84c0-4777-85e8-d230cd347bdd None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:43.269265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8fff0d4c-84c0-4777-85e8-d230cd347bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:43.379162 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3031/6012] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:43.402890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8fa24-04af-42e4-b21e-5616f2a095e0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:43.409341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-23a8fa24-04af-42e4-b21e-5616f2a095e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:43.512841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8fa24-04af-42e4-b21e-5616f2a095e0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:43.518449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ef03a-a123-4826-8bf0-38f05d22f4b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:43.519504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ef03a-a123-4826-8bf0-38f05d22f4b5 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:43.520015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ef03a-a123-4826-8bf0-38f05d22f4b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:43.520812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ef03a-a123-4826-8bf0-38f05d22f4b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:43.542742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ef03a-a123-4826-8bf0-38f05d22f4b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:43.545821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ef03a-a123-4826-8bf0-38f05d22f4b5 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:43.547721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff0d4c-84c0-4777-85e8-d230cd347bdd None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:43.549652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8fff0d4c-84c0-4777-85e8-d230cd347bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:43.570730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff0d4c-84c0-4777-85e8-d230cd347bdd None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:43.578389 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2982/6013] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:22:43.585199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c9b3b-036e-4b29-ac7f-060e65fa5893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:43.586364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c9b3b-036e-4b29-ac7f-060e65fa5893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:43.586875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c9b3b-036e-4b29-ac7f-060e65fa5893 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:43.587390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c9b3b-036e-4b29-ac7f-060e65fa5893 admin admin] PATH_INFO: `/v3/users/359fb7c2ebdc4336a502b4df07d8719e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:43.589050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c9b3b-036e-4b29-ac7f-060e65fa5893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=359fb7c2ebdc4336a502b4df07d8719e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:43.592575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c9b3b-036e-4b29-ac7f-060e65fa5893 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:43.632901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:43.687641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-312c9b3b-036e-4b29-ac7f-060e65fa5893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359fb7c2ebdc4336a502b4df07d8719e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:43.708904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-312c9b3b-036e-4b29-ac7f-060e65fa5893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359fb7c2ebdc4336a502b4df07d8719e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:43.710348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-312c9b3b-036e-4b29-ac7f-060e65fa5893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359fb7c2ebdc4336a502b4df07d8719e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:43.720599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-312c9b3b-036e-4b29-ac7f-060e65fa5893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359fb7c2ebdc4336a502b4df07d8719e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:43.721406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-312c9b3b-036e-4b29-ac7f-060e65fa5893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359fb7c2ebdc4336a502b4df07d8719e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:43.742987 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3032/6014] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:22:43 2022] DELETE /identity/v3/users/359fb7c2ebdc4336a502b4df07d8719e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:22:43.747969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c29ff-da50-49f5-b51a-21f9048bfb4c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:43.748910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c29ff-da50-49f5-b51a-21f9048bfb4c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:43.748910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c29ff-da50-49f5-b51a-21f9048bfb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:43.770908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5f9c29ff-da50-49f5-b51a-21f9048bfb4c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:43.772419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5f9c29ff-da50-49f5-b51a-21f9048bfb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:43.803056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:43.852364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c9b3b-036e-4b29-ac7f-060e65fa5893 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:43.853884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-312c9b3b-036e-4b29-ac7f-060e65fa5893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:43.917439 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2983/6015] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:43.925988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c29ff-da50-49f5-b51a-21f9048bfb4c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:43.927626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5f9c29ff-da50-49f5-b51a-21f9048bfb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:43.980619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c9b3b-036e-4b29-ac7f-060e65fa5893 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:43.988338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa7ffa-b79c-4522-9bab-72d060d71f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:43.989086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa7ffa-b79c-4522-9bab-72d060d71f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:43.989450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa7ffa-b79c-4522-9bab-72d060d71f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:43.989806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa7ffa-b79c-4522-9bab-72d060d71f1a admin admin] PATH_INFO: `/v3/projects/caf6d7194a514189a7bb15fd5d786d32` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:43.991106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa7ffa-b79c-4522-9bab-72d060d71f1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf6d7194a514189a7bb15fd5d786d32)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:43.993968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa7ffa-b79c-4522-9bab-72d060d71f1a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:44.025822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c29ff-da50-49f5-b51a-21f9048bfb4c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:44.031474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a66d0-6e77-490d-a71b-36003042170e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:44.032410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a66d0-6e77-490d-a71b-36003042170e service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:44.032917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a66d0-6e77-490d-a71b-36003042170e service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:44.033440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a66d0-6e77-490d-a71b-36003042170e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:44.045418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a66d0-6e77-490d-a71b-36003042170e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:44.047859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a66d0-6e77-490d-a71b-36003042170e service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:44.063964 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2984/6016] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:22:44.075768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-56aa7ffa-b79c-4522-9bab-72d060d71f1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf6d7194a514189a7bb15fd5d786d32', 'request_id': 'req-56aa7ffa-b79c-4522-9bab-72d060d71f1a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:44.085524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-56aa7ffa-b79c-4522-9bab-72d060d71f1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf6d7194a514189a7bb15fd5d786d32', 'request_id': 'req-56aa7ffa-b79c-4522-9bab-72d060d71f1a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:44.099774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-56aa7ffa-b79c-4522-9bab-72d060d71f1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf6d7194a514189a7bb15fd5d786d32', 'request_id': 'req-56aa7ffa-b79c-4522-9bab-72d060d71f1a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:44.116380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-56aa7ffa-b79c-4522-9bab-72d060d71f1a admin admin] The token cache is being invalidate because project caf6d7194a514189a7bb15fd5d786d32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:22:44.116655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-56aa7ffa-b79c-4522-9bab-72d060d71f1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:44.117522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-56aa7ffa-b79c-4522-9bab-72d060d71f1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:44.124279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef795c-6f9f-4ed5-aaf6-dd0c6437bb35 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:44.124502 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3033/6017] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:22:43 2022] DELETE /identity/v3/projects/caf6d7194a514189a7bb15fd5d786d32 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:22:44.124596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef795c-6f9f-4ed5-aaf6-dd0c6437bb35 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:44.124851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef795c-6f9f-4ed5-aaf6-dd0c6437bb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:44.171626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-10ef795c-6f9f-4ed5-aaf6-dd0c6437bb35 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:44.173293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-10ef795c-6f9f-4ed5-aaf6-dd0c6437bb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:44.261013 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2985/6018] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:22:44.269666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0078e6-5db6-463a-aec9-6bc87cf00def None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:44.270153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0078e6-5db6-463a-aec9-6bc87cf00def None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:44.271213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0078e6-5db6-463a-aec9-6bc87cf00def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:44.294375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0a0078e6-5db6-463a-aec9-6bc87cf00def None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:44.295954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0a0078e6-5db6-463a-aec9-6bc87cf00def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:44.311444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef795c-6f9f-4ed5-aaf6-dd0c6437bb35 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:44.312644 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3034/6019] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:44.323103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef795c-6f9f-4ed5-aaf6-dd0c6437bb35 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:44.331458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abf771-0f83-40e2-a945-91d4e5d17655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:44.332096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abf771-0f83-40e2-a945-91d4e5d17655 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:44.333497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abf771-0f83-40e2-a945-91d4e5d17655 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:44.333695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abf771-0f83-40e2-a945-91d4e5d17655 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:44.334526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abf771-0f83-40e2-a945-91d4e5d17655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:22:44.334754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abf771-0f83-40e2-a945-91d4e5d17655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:44.337031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abf771-0f83-40e2-a945-91d4e5d17655 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:44.358704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0078e6-5db6-463a-aec9-6bc87cf00def None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:44.360591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0a0078e6-5db6-463a-aec9-6bc87cf00def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:44.361630 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2986/6020] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:22:44.366370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abf771-0f83-40e2-a945-91d4e5d17655 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:44.380964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0078e6-5db6-463a-aec9-6bc87cf00def None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:44.392478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9b368-98d9-4f95-bd2d-735fa43cbbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:44.393635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9b368-98d9-4f95-bd2d-735fa43cbbb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:44.394682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9b368-98d9-4f95-bd2d-735fa43cbbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:44.394987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9b368-98d9-4f95-bd2d-735fa43cbbb2 admin admin] PATH_INFO: `/v3/projects/b21828acf40d473d851e8c03a0ecbd53` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:44.397775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9b368-98d9-4f95-bd2d-735fa43cbbb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b21828acf40d473d851e8c03a0ecbd53)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:44.402154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abf771-0f83-40e2-a945-91d4e5d17655 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:44.402666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9b368-98d9-4f95-bd2d-735fa43cbbb2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:44.409304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cbcf6-2a84-44e4-bf30-4da140b704b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:44.409974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cbcf6-2a84-44e4-bf30-4da140b704b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:44.410316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cbcf6-2a84-44e4-bf30-4da140b704b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:44.410603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cbcf6-2a84-44e4-bf30-4da140b704b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:44.411435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4cbcf6-2a84-44e4-bf30-4da140b704b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:44.413493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4cbcf6-2a84-44e4-bf30-4da140b704b1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:44.449204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:44.480536 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2987/6021] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:22:44 2022] POST /identity/v3/projects => generated 357 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:22:44.484112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cbcf6-2a84-44e4-bf30-4da140b704b1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:44.490591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4ae9b368-98d9-4f95-bd2d-735fa43cbbb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b21828acf40d473d851e8c03a0ecbd53', 'request_id': 'req-4ae9b368-98d9-4f95-bd2d-735fa43cbbb2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:44.500414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4ae9b368-98d9-4f95-bd2d-735fa43cbbb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b21828acf40d473d851e8c03a0ecbd53', 'request_id': 'req-4ae9b368-98d9-4f95-bd2d-735fa43cbbb2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:44.511838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4ae9b368-98d9-4f95-bd2d-735fa43cbbb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b21828acf40d473d851e8c03a0ecbd53', 'request_id': 'req-4ae9b368-98d9-4f95-bd2d-735fa43cbbb2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:44.527190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4ae9b368-98d9-4f95-bd2d-735fa43cbbb2 admin admin] The token cache is being invalidate because project b21828acf40d473d851e8c03a0ecbd53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:22:44.527190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4ae9b368-98d9-4f95-bd2d-735fa43cbbb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:44.528472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4ae9b368-98d9-4f95-bd2d-735fa43cbbb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:44.530830 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3035/6022] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:22:44 2022] DELETE /identity/v3/projects/b21828acf40d473d851e8c03a0ecbd53 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:44.534569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:44.536381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181524a-b215-4622-aa87-0b46e6ca498e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:44.536381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181524a-b215-4622-aa87-0b46e6ca498e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:44.536381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181524a-b215-4622-aa87-0b46e6ca498e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:44.561229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e181524a-b215-4622-aa87-0b46e6ca498e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:44.562567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e181524a-b215-4622-aa87-0b46e6ca498e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:44.571755 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3036/6023] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:22:44.576425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cbcf6-2a84-44e4-bf30-4da140b704b1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:44.580934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba1afc-c68f-4e09-86ca-9f03281baa04 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:44.581367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba1afc-c68f-4e09-86ca-9f03281baa04 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:44.581660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba1afc-c68f-4e09-86ca-9f03281baa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:44.583333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6309ab-b05b-41bb-92ee-688df15bd3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:44.584034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6309ab-b05b-41bb-92ee-688df15bd3bd admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:44.584386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6309ab-b05b-41bb-92ee-688df15bd3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:44.584735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6309ab-b05b-41bb-92ee-688df15bd3bd admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:44.585466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6309ab-b05b-41bb-92ee-688df15bd3bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:44.587481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6309ab-b05b-41bb-92ee-688df15bd3bd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:44.604467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e0ba1afc-c68f-4e09-86ca-9f03281baa04 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:44.605798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e0ba1afc-c68f-4e09-86ca-9f03281baa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:44.612075 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2988/6024] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:22:44 2022] POST /identity/v3/users => generated 279 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:22:44.614901 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3037/6025] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:22:44.616067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6309ab-b05b-41bb-92ee-688df15bd3bd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:44.617910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bc6309ab-b05b-41bb-92ee-688df15bd3bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:44.619400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba1afc-c68f-4e09-86ca-9f03281baa04 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:44.633076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6309ab-b05b-41bb-92ee-688df15bd3bd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:44.633984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba1afc-c68f-4e09-86ca-9f03281baa04 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:44.638968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbc88e-f1c5-4740-b374-3a4a5fc6ea80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:44.639981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3588de3-1a98-405d-b63c-84743fd11591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:44.640139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbc88e-f1c5-4740-b374-3a4a5fc6ea80 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:44.640139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbc88e-f1c5-4740-b374-3a4a5fc6ea80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:44.640369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbc88e-f1c5-4740-b374-3a4a5fc6ea80 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:44.640631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3588de3-1a98-405d-b63c-84743fd11591 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:44.640969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3588de3-1a98-405d-b63c-84743fd11591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:44.641104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbc88e-f1c5-4740-b374-3a4a5fc6ea80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:22:44.641357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbc88e-f1c5-4740-b374-3a4a5fc6ea80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:44.641491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3588de3-1a98-405d-b63c-84743fd11591 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:44.642291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3588de3-1a98-405d-b63c-84743fd11591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:44.643137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbc88e-f1c5-4740-b374-3a4a5fc6ea80 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:44.644866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3588de3-1a98-405d-b63c-84743fd11591 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:44.656892 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2989/6026] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:22:44.663251 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3038/6027] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:22:44.664458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3588de3-1a98-405d-b63c-84743fd11591 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:44.668303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbc88e-f1c5-4740-b374-3a4a5fc6ea80 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:44.675160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3588de3-1a98-405d-b63c-84743fd11591 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:44.681296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9ac33-d459-48b1-b384-b6f58994352e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:44.682429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9ac33-d459-48b1-b384-b6f58994352e admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:44.682937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9ac33-d459-48b1-b384-b6f58994352e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:44.683355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9ac33-d459-48b1-b384-b6f58994352e admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:44.684340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9ac33-d459-48b1-b384-b6f58994352e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:44.686073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9ac33-d459-48b1-b384-b6f58994352e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:44.692146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbc88e-f1c5-4740-b374-3a4a5fc6ea80 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:44.702391 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2990/6028] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:22:44.702603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc32ba-9e1b-42e7-a3f5-c3a9cd2e409b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:44.703646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc32ba-9e1b-42e7-a3f5-c3a9cd2e409b admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:44.703933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc32ba-9e1b-42e7-a3f5-c3a9cd2e409b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:44.704210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc32ba-9e1b-42e7-a3f5-c3a9cd2e409b admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:44.704343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9ac33-d459-48b1-b384-b6f58994352e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:44.705581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc32ba-9e1b-42e7-a3f5-c3a9cd2e409b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:44.709434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc32ba-9e1b-42e7-a3f5-c3a9cd2e409b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:44.717324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9ac33-d459-48b1-b384-b6f58994352e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:44.724543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f92a4c-efc6-4eff-95d0-0c1cd8c3c1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:44.725468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f92a4c-efc6-4eff-95d0-0c1cd8c3c1eb admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:44.725860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f92a4c-efc6-4eff-95d0-0c1cd8c3c1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:44.726267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f92a4c-efc6-4eff-95d0-0c1cd8c3c1eb admin admin] PATH_INFO: `/v3/projects/3589473ceec1425693f28fa3684ba739/users/a394a1c87bd54c63b6892615f144ac94/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:44.745463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f92a4c-efc6-4eff-95d0-0c1cd8c3c1eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3589473ceec1425693f28fa3684ba739, user_id=a394a1c87bd54c63b6892615f144ac94, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:44.751064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f92a4c-efc6-4eff-95d0-0c1cd8c3c1eb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:44.770650 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3039/6029] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:22:44 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:22:44.774893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc32ba-9e1b-42e7-a3f5-c3a9cd2e409b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:44.781121 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2991/6030] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:22:44 2022] PUT /identity/v3/projects/3589473ceec1425693f28fa3684ba739/users/a394a1c87bd54c63b6892615f144ac94/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:44.791163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f70fa-fef0-46aa-9c43-db4e6421aa79 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:44.791536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f70fa-fef0-46aa-9c43-db4e6421aa79 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:44.791698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f70fa-fef0-46aa-9c43-db4e6421aa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:44.835317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-757f70fa-fef0-46aa-9c43-db4e6421aa79 None None] MFA Rules not processed for user `a394a1c87bd54c63b6892615f144ac94`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:44.836686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-757f70fa-fef0-46aa-9c43-db4e6421aa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:44.884269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc32ba-9e1b-42e7-a3f5-c3a9cd2e409b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:44.889602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38aa0c-fc68-4560-b313-56f7ffc11b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:44.890691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38aa0c-fc68-4560-b313-56f7ffc11b08 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:44.891337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38aa0c-fc68-4560-b313-56f7ffc11b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:44.891799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38aa0c-fc68-4560-b313-56f7ffc11b08 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:44.893083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38aa0c-fc68-4560-b313-56f7ffc11b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:44.895350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38aa0c-fc68-4560-b313-56f7ffc11b08 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:44.922596 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3040/6031] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:22:44 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:22:44.927067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38aa0c-fc68-4560-b313-56f7ffc11b08 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:44.938668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38aa0c-fc68-4560-b313-56f7ffc11b08 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:44.942630 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2992/6032] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:44 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:44.950520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed614d9-33de-4da2-ad82-841b4f3b4b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:44.951165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed614d9-33de-4da2-ad82-841b4f3b4b30 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:44.951507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed614d9-33de-4da2-ad82-841b4f3b4b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:44.951784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed614d9-33de-4da2-ad82-841b4f3b4b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:44.952485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed614d9-33de-4da2-ad82-841b4f3b4b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:44.954199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed614d9-33de-4da2-ad82-841b4f3b4b30 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:44.956360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f70fa-fef0-46aa-9c43-db4e6421aa79 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:44.957965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-757f70fa-fef0-46aa-9c43-db4e6421aa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:44.971762 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3041/6033] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:22:44.975773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed614d9-33de-4da2-ad82-841b4f3b4b30 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:44.988997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed614d9-33de-4da2-ad82-841b4f3b4b30 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:45.004020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f0960-6aa4-4dc7-8186-68141e820eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:45.005550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f0960-6aa4-4dc7-8186-68141e820eed admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:45.005739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f0960-6aa4-4dc7-8186-68141e820eed admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:45.006029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f0960-6aa4-4dc7-8186-68141e820eed admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:45.007083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f0960-6aa4-4dc7-8186-68141e820eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:45.009665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f0960-6aa4-4dc7-8186-68141e820eed admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:45.023835 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3042/6034] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:22:45.028921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f0960-6aa4-4dc7-8186-68141e820eed admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:45.040187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f0960-6aa4-4dc7-8186-68141e820eed admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:45.045195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb625d7-7c20-4621-a465-8a87252c64d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:45.045500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f70fa-fef0-46aa-9c43-db4e6421aa79 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:45.046110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb625d7-7c20-4621-a465-8a87252c64d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:45.046404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb625d7-7c20-4621-a465-8a87252c64d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:45.046684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb625d7-7c20-4621-a465-8a87252c64d8 admin admin] PATH_INFO: `/v3/projects/a20553d5fd0845118bb60049eb78bf0c/users/ada51b21bedb4b329a7354b7b75766dc/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:45.051871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52cf55-4fb8-4993-8e11-5903c7aa6232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:45.052105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52cf55-4fb8-4993-8e11-5903c7aa6232 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:45.052276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52cf55-4fb8-4993-8e11-5903c7aa6232 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:45.052675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52cf55-4fb8-4993-8e11-5903c7aa6232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:45.063528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52cf55-4fb8-4993-8e11-5903c7aa6232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:45.064379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb625d7-7c20-4621-a465-8a87252c64d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a20553d5fd0845118bb60049eb78bf0c, user_id=ada51b21bedb4b329a7354b7b75766dc, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:45.065504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52cf55-4fb8-4993-8e11-5903c7aa6232 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:45.067045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb625d7-7c20-4621-a465-8a87252c64d8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:45.079335 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2993/6035] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:22:44 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:22:45.091422 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3043/6036] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:22:45 2022] PUT /identity/v3/projects/a20553d5fd0845118bb60049eb78bf0c/users/ada51b21bedb4b329a7354b7b75766dc/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:22:45.103581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c24b02-b5f7-4ba0-9479-c82f31246850 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:45.104711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c24b02-b5f7-4ba0-9479-c82f31246850 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:45.105004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c24b02-b5f7-4ba0-9479-c82f31246850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:45.121995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:45.144343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-68c24b02-b5f7-4ba0-9479-c82f31246850 None None] MFA Rules not processed for user `ada51b21bedb4b329a7354b7b75766dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:45.146048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-68c24b02-b5f7-4ba0-9479-c82f31246850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:45.249994 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2994/6037] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:45.261683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb625d7-7c20-4621-a465-8a87252c64d8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:45.267018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:45.339914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb625d7-7c20-4621-a465-8a87252c64d8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:45.343979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd23654-7d3d-483a-8c35-24fff5741e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:45.344978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd23654-7d3d-483a-8c35-24fff5741e06 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:45.345277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd23654-7d3d-483a-8c35-24fff5741e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:45.345559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd23654-7d3d-483a-8c35-24fff5741e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:45.356098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd23654-7d3d-483a-8c35-24fff5741e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:45.357544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd23654-7d3d-483a-8c35-24fff5741e06 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:45.368101 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3044/6038] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:22:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:22:46.011218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c24b02-b5f7-4ba0-9479-c82f31246850 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:46.153974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c24b02-b5f7-4ba0-9479-c82f31246850 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:46.160754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdb0ac-ffba-4aa8-a5b0-cd813cc48607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:46.161591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdb0ac-ffba-4aa8-a5b0-cd813cc48607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:46.161913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdb0ac-ffba-4aa8-a5b0-cd813cc48607 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:46.162459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdb0ac-ffba-4aa8-a5b0-cd813cc48607 admin admin] PATH_INFO: `/v3/users/ada51b21bedb4b329a7354b7b75766dc` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:46.164827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bdb0ac-ffba-4aa8-a5b0-cd813cc48607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada51b21bedb4b329a7354b7b75766dc)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:46.168086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bdb0ac-ffba-4aa8-a5b0-cd813cc48607 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:46.238209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-58bdb0ac-ffba-4aa8-a5b0-cd813cc48607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada51b21bedb4b329a7354b7b75766dc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:46.239224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-58bdb0ac-ffba-4aa8-a5b0-cd813cc48607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada51b21bedb4b329a7354b7b75766dc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:46.258883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-58bdb0ac-ffba-4aa8-a5b0-cd813cc48607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada51b21bedb4b329a7354b7b75766dc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:46.260848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-58bdb0ac-ffba-4aa8-a5b0-cd813cc48607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada51b21bedb4b329a7354b7b75766dc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:46.272311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-58bdb0ac-ffba-4aa8-a5b0-cd813cc48607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada51b21bedb4b329a7354b7b75766dc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:46.297818 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2995/6039] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:22:46 2022] DELETE /identity/v3/users/ada51b21bedb4b329a7354b7b75766dc => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:46.302113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab589e2b-ae81-4f92-b457-3d7a230d866b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:46.302408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab589e2b-ae81-4f92-b457-3d7a230d866b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:46.303226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab589e2b-ae81-4f92-b457-3d7a230d866b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:46.338962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ab589e2b-ae81-4f92-b457-3d7a230d866b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:46.341374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ab589e2b-ae81-4f92-b457-3d7a230d866b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:46.414036 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3045/6040] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:22:46.426600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdb0ac-ffba-4aa8-a5b0-cd813cc48607 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:46.428530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-58bdb0ac-ffba-4aa8-a5b0-cd813cc48607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:46.451369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:46.507007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdb0ac-ffba-4aa8-a5b0-cd813cc48607 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:46.511226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a192174-d472-4c6c-bcfd-6e7a39264509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:46.512797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a192174-d472-4c6c-bcfd-6e7a39264509 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:46.513236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a192174-d472-4c6c-bcfd-6e7a39264509 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:46.513545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a192174-d472-4c6c-bcfd-6e7a39264509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:46.525148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a192174-d472-4c6c-bcfd-6e7a39264509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:46.526925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a192174-d472-4c6c-bcfd-6e7a39264509 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:46.543071 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2996/6041] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:22:47.032147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab589e2b-ae81-4f92-b457-3d7a230d866b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:47.033871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ab589e2b-ae81-4f92-b457-3d7a230d866b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:47.047111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab589e2b-ae81-4f92-b457-3d7a230d866b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:47.053775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda66c08-fa09-4a1a-8ce7-0b7be670d0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:47.054449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda66c08-fa09-4a1a-8ce7-0b7be670d0fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:47.054738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda66c08-fa09-4a1a-8ce7-0b7be670d0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:47.055015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda66c08-fa09-4a1a-8ce7-0b7be670d0fc admin admin] PATH_INFO: `/v3/projects/a20553d5fd0845118bb60049eb78bf0c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:47.056269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda66c08-fa09-4a1a-8ce7-0b7be670d0fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a20553d5fd0845118bb60049eb78bf0c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:47.058369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda66c08-fa09-4a1a-8ce7-0b7be670d0fc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:47.112169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dda66c08-fa09-4a1a-8ce7-0b7be670d0fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a20553d5fd0845118bb60049eb78bf0c', 'request_id': 'req-dda66c08-fa09-4a1a-8ce7-0b7be670d0fc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:47.118960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dda66c08-fa09-4a1a-8ce7-0b7be670d0fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a20553d5fd0845118bb60049eb78bf0c', 'request_id': 'req-dda66c08-fa09-4a1a-8ce7-0b7be670d0fc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:47.132552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dda66c08-fa09-4a1a-8ce7-0b7be670d0fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a20553d5fd0845118bb60049eb78bf0c', 'request_id': 'req-dda66c08-fa09-4a1a-8ce7-0b7be670d0fc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:47.147056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dda66c08-fa09-4a1a-8ce7-0b7be670d0fc admin admin] The token cache is being invalidate because project a20553d5fd0845118bb60049eb78bf0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:22:47.147490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dda66c08-fa09-4a1a-8ce7-0b7be670d0fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:47.148221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dda66c08-fa09-4a1a-8ce7-0b7be670d0fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:47.149810 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3046/6042] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:22:47 2022] DELETE /identity/v3/projects/a20553d5fd0845118bb60049eb78bf0c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:47.155021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d602539-c156-48bd-96e3-bd474b7d47a0 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:47.155543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d602539-c156-48bd-96e3-bd474b7d47a0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:47.155638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d602539-c156-48bd-96e3-bd474b7d47a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:47.175799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0d602539-c156-48bd-96e3-bd474b7d47a0 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:47.177005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0d602539-c156-48bd-96e3-bd474b7d47a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:47.245068 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2997/6043] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:47.255327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396e590-31aa-4b12-b701-9d981c682945 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:47.255662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396e590-31aa-4b12-b701-9d981c682945 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:47.255951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396e590-31aa-4b12-b701-9d981c682945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:47.278575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4396e590-31aa-4b12-b701-9d981c682945 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:47.279850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4396e590-31aa-4b12-b701-9d981c682945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:47.288109 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3047/6044] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:47.292599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d602539-c156-48bd-96e3-bd474b7d47a0 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:47.303557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d602539-c156-48bd-96e3-bd474b7d47a0 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:47.309534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49a3cc-4d4f-44ae-8b5d-1b949a25f27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:47.310144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49a3cc-4d4f-44ae-8b5d-1b949a25f27d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:47.311326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49a3cc-4d4f-44ae-8b5d-1b949a25f27d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:47.311662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49a3cc-4d4f-44ae-8b5d-1b949a25f27d admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:47.312379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49a3cc-4d4f-44ae-8b5d-1b949a25f27d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:22:47.312691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49a3cc-4d4f-44ae-8b5d-1b949a25f27d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:47.314308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49a3cc-4d4f-44ae-8b5d-1b949a25f27d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:47.328392 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2998/6045] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:22:47.333341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396e590-31aa-4b12-b701-9d981c682945 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:47.343543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396e590-31aa-4b12-b701-9d981c682945 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:47.348460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923416a-d611-43b7-a6b0-a5fbf7ba90fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:47.349108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923416a-d611-43b7-a6b0-a5fbf7ba90fb admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:47.349398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923416a-d611-43b7-a6b0-a5fbf7ba90fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:47.349679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923416a-d611-43b7-a6b0-a5fbf7ba90fb admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:47.350347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923416a-d611-43b7-a6b0-a5fbf7ba90fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:47.352298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923416a-d611-43b7-a6b0-a5fbf7ba90fb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:47.378826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:47.393873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49a3cc-4d4f-44ae-8b5d-1b949a25f27d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:47.402186 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3048/6046] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:22:47 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:22:47.406206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49a3cc-4d4f-44ae-8b5d-1b949a25f27d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:47.498920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106f235-2642-420f-bc91-32991da5873b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:47.502310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106f235-2642-420f-bc91-32991da5873b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:47.502691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106f235-2642-420f-bc91-32991da5873b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:47.503356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106f235-2642-420f-bc91-32991da5873b admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:47.504383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106f235-2642-420f-bc91-32991da5873b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:47.506543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106f235-2642-420f-bc91-32991da5873b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:47.558823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923416a-d611-43b7-a6b0-a5fbf7ba90fb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:47.565042 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 2999/6047] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:22:47 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:22:47.572434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923416a-d611-43b7-a6b0-a5fbf7ba90fb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:47.579741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb87dcb-d720-4559-8be1-24c9e6e3c84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:47.580680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb87dcb-d720-4559-8be1-24c9e6e3c84d admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:47.581229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb87dcb-d720-4559-8be1-24c9e6e3c84d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:47.582796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb87dcb-d720-4559-8be1-24c9e6e3c84d admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:47.583949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb87dcb-d720-4559-8be1-24c9e6e3c84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:47.586052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb87dcb-d720-4559-8be1-24c9e6e3c84d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:47.609236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106f235-2642-420f-bc91-32991da5873b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:47.617613 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3049/6048] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:22:47.626272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106f235-2642-420f-bc91-32991da5873b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:47.636550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65bddc-6462-47c9-a028-cdf79ed8d653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:47.638100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65bddc-6462-47c9-a028-cdf79ed8d653 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:47.638702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65bddc-6462-47c9-a028-cdf79ed8d653 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:47.639249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65bddc-6462-47c9-a028-cdf79ed8d653 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:47.640802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65bddc-6462-47c9-a028-cdf79ed8d653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:47.642813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65bddc-6462-47c9-a028-cdf79ed8d653 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:47.678738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb87dcb-d720-4559-8be1-24c9e6e3c84d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:47.686496 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3000/6049] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:22:47.692338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb87dcb-d720-4559-8be1-24c9e6e3c84d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:47.704358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6fce8-c921-4fff-a0b6-d5c78bc6e01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:47.705725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6fce8-c921-4fff-a0b6-d5c78bc6e01c admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:47.706144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6fce8-c921-4fff-a0b6-d5c78bc6e01c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:47.706538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6fce8-c921-4fff-a0b6-d5c78bc6e01c admin admin] PATH_INFO: `/v3/projects/fe582500bd714ee28a4fa6839c7e2a1a/users/773947176f6a466496252a5c7139158d/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:47.742205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6fce8-c921-4fff-a0b6-d5c78bc6e01c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe582500bd714ee28a4fa6839c7e2a1a, user_id=773947176f6a466496252a5c7139158d, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:47.751887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6fce8-c921-4fff-a0b6-d5c78bc6e01c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:47.805664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d51f79-4e40-42f9-aa6b-73e716660709 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:47.806056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d51f79-4e40-42f9-aa6b-73e716660709 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:47.806457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d51f79-4e40-42f9-aa6b-73e716660709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:47.810468 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3050/6050] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:22:47 2022] PUT /identity/v3/projects/fe582500bd714ee28a4fa6839c7e2a1a/users/773947176f6a466496252a5c7139158d/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:47.850910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c2d51f79-4e40-42f9-aa6b-73e716660709 None None] MFA Rules not processed for user `773947176f6a466496252a5c7139158d`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:47.853086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c2d51f79-4e40-42f9-aa6b-73e716660709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:47.873999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:47.950631 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3001/6051] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:47.971323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6fce8-c921-4fff-a0b6-d5c78bc6e01c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:47.973536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4ff6fce8-c921-4fff-a0b6-d5c78bc6e01c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:48.081619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6fce8-c921-4fff-a0b6-d5c78bc6e01c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:48.090970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbca14-720e-4ee8-a277-0a6c83072de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:48.092010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbca14-720e-4ee8-a277-0a6c83072de3 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:48.092545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbca14-720e-4ee8-a277-0a6c83072de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:48.093000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbca14-720e-4ee8-a277-0a6c83072de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:48.107189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbca14-720e-4ee8-a277-0a6c83072de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:48.109231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbca14-720e-4ee8-a277-0a6c83072de3 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:48.122986 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3051/6052] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:22:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:22:50.476409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d51f79-4e40-42f9-aa6b-73e716660709 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:50.476983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c2d51f79-4e40-42f9-aa6b-73e716660709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:50.625843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d51f79-4e40-42f9-aa6b-73e716660709 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:50.635723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e74a82-ca38-4151-b911-dd8526c6c2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:50.636410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e74a82-ca38-4151-b911-dd8526c6c2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:50.636701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e74a82-ca38-4151-b911-dd8526c6c2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:50.637037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e74a82-ca38-4151-b911-dd8526c6c2e5 admin admin] PATH_INFO: `/v3/users/b05bacfa8265402e85f005d38ec47e4e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:50.638341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e74a82-ca38-4151-b911-dd8526c6c2e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05bacfa8265402e85f005d38ec47e4e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:50.640379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e74a82-ca38-4151-b911-dd8526c6c2e5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:50.720566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-95e74a82-ca38-4151-b911-dd8526c6c2e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05bacfa8265402e85f005d38ec47e4e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:50.721600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-95e74a82-ca38-4151-b911-dd8526c6c2e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05bacfa8265402e85f005d38ec47e4e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:50.743335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-95e74a82-ca38-4151-b911-dd8526c6c2e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05bacfa8265402e85f005d38ec47e4e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:50.744994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-95e74a82-ca38-4151-b911-dd8526c6c2e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05bacfa8265402e85f005d38ec47e4e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:50.789137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-95e74a82-ca38-4151-b911-dd8526c6c2e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05bacfa8265402e85f005d38ec47e4e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:50.807346 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3002/6053] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:22:50 2022] DELETE /identity/v3/users/b05bacfa8265402e85f005d38ec47e4e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:50.809943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4258d-72a9-4e36-992d-4674c055162d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:50.816327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4258d-72a9-4e36-992d-4674c055162d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:50.816782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4258d-72a9-4e36-992d-4674c055162d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:50.853007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f3b4258d-72a9-4e36-992d-4674c055162d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:50.854770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f3b4258d-72a9-4e36-992d-4674c055162d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:51.049192 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3052/6054] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:51.071961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e74a82-ca38-4151-b911-dd8526c6c2e5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:51.074289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-95e74a82-ca38-4151-b911-dd8526c6c2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:51.159821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:51.234402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e74a82-ca38-4151-b911-dd8526c6c2e5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:51.244739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd2c12-affa-4f4e-8a8a-1d230e73e71b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:51.245924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd2c12-affa-4f4e-8a8a-1d230e73e71b service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:51.246479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd2c12-affa-4f4e-8a8a-1d230e73e71b service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:51.246965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd2c12-affa-4f4e-8a8a-1d230e73e71b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:51.269688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd2c12-affa-4f4e-8a8a-1d230e73e71b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:51.271714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd2c12-affa-4f4e-8a8a-1d230e73e71b service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:51.297772 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3003/6055] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:22:53.012482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4258d-72a9-4e36-992d-4674c055162d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:53.016128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f3b4258d-72a9-4e36-992d-4674c055162d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:53.048270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4258d-72a9-4e36-992d-4674c055162d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:53.065037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aa826-e730-4788-ad4e-d91f69fc4cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:53.066578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa826-e730-4788-ad4e-d91f69fc4cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:53.067242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa826-e730-4788-ad4e-d91f69fc4cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:53.068489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa826-e730-4788-ad4e-d91f69fc4cf7 admin admin] PATH_INFO: `/v3/projects/0e214093d7d84fe58e80edc5c2fe8734` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:53.081664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939aa826-e730-4788-ad4e-d91f69fc4cf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e214093d7d84fe58e80edc5c2fe8734)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:53.084726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939aa826-e730-4788-ad4e-d91f69fc4cf7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:53.183802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-939aa826-e730-4788-ad4e-d91f69fc4cf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e214093d7d84fe58e80edc5c2fe8734', 'request_id': 'req-939aa826-e730-4788-ad4e-d91f69fc4cf7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:53.193322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-939aa826-e730-4788-ad4e-d91f69fc4cf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e214093d7d84fe58e80edc5c2fe8734', 'request_id': 'req-939aa826-e730-4788-ad4e-d91f69fc4cf7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:53.216227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-939aa826-e730-4788-ad4e-d91f69fc4cf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e214093d7d84fe58e80edc5c2fe8734', 'request_id': 'req-939aa826-e730-4788-ad4e-d91f69fc4cf7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:53.220906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:53.242917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-939aa826-e730-4788-ad4e-d91f69fc4cf7 admin admin] The token cache is being invalidate because project 0e214093d7d84fe58e80edc5c2fe8734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:22:53.247402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-939aa826-e730-4788-ad4e-d91f69fc4cf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:53.252121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-939aa826-e730-4788-ad4e-d91f69fc4cf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:53.257617 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3053/6056] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:22:53 2022] DELETE /identity/v3/projects/0e214093d7d84fe58e80edc5c2fe8734 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:53.258590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd2c12-affa-4f4e-8a8a-1d230e73e71b service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:53.271800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd2c12-affa-4f4e-8a8a-1d230e73e71b service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:53.442546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de849942-e901-4e51-85f7-910d4e19518e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:53.443757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de849942-e901-4e51-85f7-910d4e19518e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:53.443757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de849942-e901-4e51-85f7-910d4e19518e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:53.443757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de849942-e901-4e51-85f7-910d4e19518e admin admin] PATH_INFO: `/v3/users/6791315b5ee4467e9636b0b2e46f02ac` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:53.444964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de849942-e901-4e51-85f7-910d4e19518e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6791315b5ee4467e9636b0b2e46f02ac)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:53.446932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de849942-e901-4e51-85f7-910d4e19518e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:53.586161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-de849942-e901-4e51-85f7-910d4e19518e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6791315b5ee4467e9636b0b2e46f02ac'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:53.586914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-de849942-e901-4e51-85f7-910d4e19518e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6791315b5ee4467e9636b0b2e46f02ac'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:53.611929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-de849942-e901-4e51-85f7-910d4e19518e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6791315b5ee4467e9636b0b2e46f02ac'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:53.612674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-de849942-e901-4e51-85f7-910d4e19518e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6791315b5ee4467e9636b0b2e46f02ac'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:53.634598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-de849942-e901-4e51-85f7-910d4e19518e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6791315b5ee4467e9636b0b2e46f02ac'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:53.663993 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3004/6057] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:22:53 2022] DELETE /identity/v3/users/6791315b5ee4467e9636b0b2e46f02ac => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:22:54.260882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aa826-e730-4788-ad4e-d91f69fc4cf7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:54.262422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-939aa826-e730-4788-ad4e-d91f69fc4cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:54.283783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aa826-e730-4788-ad4e-d91f69fc4cf7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:54.438055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30707a6d-0992-4056-93d8-78e80467b403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:54.438752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30707a6d-0992-4056-93d8-78e80467b403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:54.439038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30707a6d-0992-4056-93d8-78e80467b403 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:54.439480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30707a6d-0992-4056-93d8-78e80467b403 admin admin] PATH_INFO: `/v3/users/9e524b6c859a4f62b4cdc3bead24046f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:54.441597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30707a6d-0992-4056-93d8-78e80467b403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e524b6c859a4f62b4cdc3bead24046f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:54.443787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30707a6d-0992-4056-93d8-78e80467b403 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:54.552509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-30707a6d-0992-4056-93d8-78e80467b403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e524b6c859a4f62b4cdc3bead24046f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:54.580854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-30707a6d-0992-4056-93d8-78e80467b403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e524b6c859a4f62b4cdc3bead24046f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:54.581788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-30707a6d-0992-4056-93d8-78e80467b403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e524b6c859a4f62b4cdc3bead24046f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:54.598854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-30707a6d-0992-4056-93d8-78e80467b403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e524b6c859a4f62b4cdc3bead24046f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:54.599744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-30707a6d-0992-4056-93d8-78e80467b403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e524b6c859a4f62b4cdc3bead24046f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:54.630349 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3054/6058] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:22:54 2022] DELETE /identity/v3/users/9e524b6c859a4f62b4cdc3bead24046f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:54.635150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fac873-b744-49d2-b22f-473cdfcc9150 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:54.635709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fac873-b744-49d2-b22f-473cdfcc9150 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:54.635963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fac873-b744-49d2-b22f-473cdfcc9150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:54.675823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-95fac873-b744-49d2-b22f-473cdfcc9150 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:54.677447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-95fac873-b744-49d2-b22f-473cdfcc9150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:54.791179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:54.812371 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3005/6059] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:54.858198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30707a6d-0992-4056-93d8-78e80467b403 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:54.859714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-30707a6d-0992-4056-93d8-78e80467b403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:54.970325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30707a6d-0992-4056-93d8-78e80467b403 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:54.975515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051d461-1d59-44c7-9855-531581ecf768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:54.976689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051d461-1d59-44c7-9855-531581ecf768 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:54.977120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051d461-1d59-44c7-9855-531581ecf768 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:54.977586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051d461-1d59-44c7-9855-531581ecf768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:55.010262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051d461-1d59-44c7-9855-531581ecf768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:55.012862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051d461-1d59-44c7-9855-531581ecf768 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:55.028404 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3055/6060] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:22:55.052326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fac873-b744-49d2-b22f-473cdfcc9150 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:55.053845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-95fac873-b744-49d2-b22f-473cdfcc9150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:55.075414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fac873-b744-49d2-b22f-473cdfcc9150 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:55.082658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040694c-c687-4dc8-9f53-c40b986a9ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:55.083972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040694c-c687-4dc8-9f53-c40b986a9ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:55.084574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040694c-c687-4dc8-9f53-c40b986a9ade admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:55.085014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040694c-c687-4dc8-9f53-c40b986a9ade admin admin] PATH_INFO: `/v3/projects/99c4fb257d6c472988258e04ce9804f0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:55.086564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040694c-c687-4dc8-9f53-c40b986a9ade admin admin] RBAC: Authorizing `identity:delete_project(project_id=99c4fb257d6c472988258e04ce9804f0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:55.088883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040694c-c687-4dc8-9f53-c40b986a9ade admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:55.229037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f040694c-c687-4dc8-9f53-c40b986a9ade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c4fb257d6c472988258e04ce9804f0', 'request_id': 'req-f040694c-c687-4dc8-9f53-c40b986a9ade'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:55.255827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f040694c-c687-4dc8-9f53-c40b986a9ade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c4fb257d6c472988258e04ce9804f0', 'request_id': 'req-f040694c-c687-4dc8-9f53-c40b986a9ade'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:55.265840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f040694c-c687-4dc8-9f53-c40b986a9ade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c4fb257d6c472988258e04ce9804f0', 'request_id': 'req-f040694c-c687-4dc8-9f53-c40b986a9ade'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:55.293948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f040694c-c687-4dc8-9f53-c40b986a9ade admin admin] The token cache is being invalidate because project 99c4fb257d6c472988258e04ce9804f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:22:55.298637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f040694c-c687-4dc8-9f53-c40b986a9ade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:55.302523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f040694c-c687-4dc8-9f53-c40b986a9ade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:55.304908 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3006/6061] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:22:55 2022] DELETE /identity/v3/projects/99c4fb257d6c472988258e04ce9804f0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:55.316247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051d461-1d59-44c7-9855-531581ecf768 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:55.330763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051d461-1d59-44c7-9855-531581ecf768 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:55.379028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:55.500988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd43a2-2306-4b0b-9710-daa98a288824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:55.501871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd43a2-2306-4b0b-9710-daa98a288824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:55.502281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd43a2-2306-4b0b-9710-daa98a288824 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:55.503436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd43a2-2306-4b0b-9710-daa98a288824 admin admin] PATH_INFO: `/v3/users/ca6345a0aa83463fb759cc335835fa63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:55.506252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd43a2-2306-4b0b-9710-daa98a288824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca6345a0aa83463fb759cc335835fa63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:55.513693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd43a2-2306-4b0b-9710-daa98a288824 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:55.664699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cffd43a2-2306-4b0b-9710-daa98a288824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca6345a0aa83463fb759cc335835fa63'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:55.682412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cffd43a2-2306-4b0b-9710-daa98a288824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca6345a0aa83463fb759cc335835fa63'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:55.683244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cffd43a2-2306-4b0b-9710-daa98a288824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca6345a0aa83463fb759cc335835fa63'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:55.698083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cffd43a2-2306-4b0b-9710-daa98a288824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca6345a0aa83463fb759cc335835fa63'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:55.699195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cffd43a2-2306-4b0b-9710-daa98a288824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca6345a0aa83463fb759cc335835fa63'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:55.732513 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3056/6062] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:22:55 2022] DELETE /identity/v3/users/ca6345a0aa83463fb759cc335835fa63 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:55.846889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040694c-c687-4dc8-9f53-c40b986a9ade admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:55.848599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f040694c-c687-4dc8-9f53-c40b986a9ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:55.870589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040694c-c687-4dc8-9f53-c40b986a9ade admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:55.971485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbde92-e217-4756-9ce1-c21185b08165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:55.972604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbde92-e217-4756-9ce1-c21185b08165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:55.973058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbde92-e217-4756-9ce1-c21185b08165 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:55.973888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbde92-e217-4756-9ce1-c21185b08165 admin admin] PATH_INFO: `/v3/projects/c25ee6c1ce5c40238cc6b084120a8880` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:55.978134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbde92-e217-4756-9ce1-c21185b08165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c25ee6c1ce5c40238cc6b084120a8880)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:55.981129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbde92-e217-4756-9ce1-c21185b08165 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:56.094258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-86bbde92-e217-4756-9ce1-c21185b08165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c25ee6c1ce5c40238cc6b084120a8880', 'request_id': 'req-86bbde92-e217-4756-9ce1-c21185b08165'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:56.109715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-86bbde92-e217-4756-9ce1-c21185b08165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c25ee6c1ce5c40238cc6b084120a8880', 'request_id': 'req-86bbde92-e217-4756-9ce1-c21185b08165'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:56.128100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-86bbde92-e217-4756-9ce1-c21185b08165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c25ee6c1ce5c40238cc6b084120a8880', 'request_id': 'req-86bbde92-e217-4756-9ce1-c21185b08165'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:56.181036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-86bbde92-e217-4756-9ce1-c21185b08165 admin admin] The token cache is being invalidate because project c25ee6c1ce5c40238cc6b084120a8880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:22:56.181390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-86bbde92-e217-4756-9ce1-c21185b08165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:56.182184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-86bbde92-e217-4756-9ce1-c21185b08165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:56.186446 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3007/6063] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:22:55 2022] DELETE /identity/v3/projects/c25ee6c1ce5c40238cc6b084120a8880 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:56.191547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7b22a-aab1-4017-bfe3-76eb45507787 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:56.191841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7b22a-aab1-4017-bfe3-76eb45507787 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:56.192123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7b22a-aab1-4017-bfe3-76eb45507787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:56.230747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-62a7b22a-aab1-4017-bfe3-76eb45507787 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:56.232024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-62a7b22a-aab1-4017-bfe3-76eb45507787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:56.397013 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3057/6064] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:56.405634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d1dc6-a8f2-4793-84fb-28a2f1bdf346 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:56.405885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d1dc6-a8f2-4793-84fb-28a2f1bdf346 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:56.406172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d1dc6-a8f2-4793-84fb-28a2f1bdf346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:56.440931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5c7d1dc6-a8f2-4793-84fb-28a2f1bdf346 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:56.441874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5c7d1dc6-a8f2-4793-84fb-28a2f1bdf346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:56.460998 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3008/6065] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:56.465639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7b22a-aab1-4017-bfe3-76eb45507787 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:56.488547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7b22a-aab1-4017-bfe3-76eb45507787 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:56.501498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250ed89-0717-4fc4-b7fe-6b8245061d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:56.502368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250ed89-0717-4fc4-b7fe-6b8245061d72 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:56.503072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250ed89-0717-4fc4-b7fe-6b8245061d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:56.504775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250ed89-0717-4fc4-b7fe-6b8245061d72 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:56.506537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250ed89-0717-4fc4-b7fe-6b8245061d72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:22:56.507108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250ed89-0717-4fc4-b7fe-6b8245061d72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:56.509007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250ed89-0717-4fc4-b7fe-6b8245061d72 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:56.570096 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3058/6066] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:22:56.576617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d1dc6-a8f2-4793-84fb-28a2f1bdf346 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:56.581703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:56.590251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d1dc6-a8f2-4793-84fb-28a2f1bdf346 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:56.605734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a576823-319e-4cae-b83b-58f564b30d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:56.607482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a576823-319e-4cae-b83b-58f564b30d41 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:56.608264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a576823-319e-4cae-b83b-58f564b30d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:56.610318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a576823-319e-4cae-b83b-58f564b30d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:56.612488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a576823-319e-4cae-b83b-58f564b30d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:56.618121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a576823-319e-4cae-b83b-58f564b30d41 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:56.709405 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3009/6067] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:22:56 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:22:56.710617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250ed89-0717-4fc4-b7fe-6b8245061d72 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:56.732600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250ed89-0717-4fc4-b7fe-6b8245061d72 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:56.810686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:56.935769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43764fe-59af-4425-8b4a-82d17af45cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:56.936421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43764fe-59af-4425-8b4a-82d17af45cdf admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:56.937813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43764fe-59af-4425-8b4a-82d17af45cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:56.943616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43764fe-59af-4425-8b4a-82d17af45cdf admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:56.948256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43764fe-59af-4425-8b4a-82d17af45cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:56.950550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43764fe-59af-4425-8b4a-82d17af45cdf admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:57.030826 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3059/6068] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:22:56 2022] POST /identity/v3/users => generated 286 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:22:57.034972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a576823-319e-4cae-b83b-58f564b30d41 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:57.065729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a576823-319e-4cae-b83b-58f564b30d41 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:57.091515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53c038-be2a-4689-a53e-cbfecc6c6885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:57.092160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53c038-be2a-4689-a53e-cbfecc6c6885 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:57.092629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53c038-be2a-4689-a53e-cbfecc6c6885 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:57.093093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53c038-be2a-4689-a53e-cbfecc6c6885 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:57.094047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53c038-be2a-4689-a53e-cbfecc6c6885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:57.096136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53c038-be2a-4689-a53e-cbfecc6c6885 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:57.123825 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3010/6069] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:22:57.127686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43764fe-59af-4425-8b4a-82d17af45cdf admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:57.152513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43764fe-59af-4425-8b4a-82d17af45cdf admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:57.159268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30f0a2-1bf0-4227-a521-2d126a682706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:57.160410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30f0a2-1bf0-4227-a521-2d126a682706 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:57.160925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30f0a2-1bf0-4227-a521-2d126a682706 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:57.161439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30f0a2-1bf0-4227-a521-2d126a682706 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:57.162591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30f0a2-1bf0-4227-a521-2d126a682706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:57.165704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30f0a2-1bf0-4227-a521-2d126a682706 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:57.216006 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3060/6070] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:22:57.219958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53c038-be2a-4689-a53e-cbfecc6c6885 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:57.258591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53c038-be2a-4689-a53e-cbfecc6c6885 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:57.275490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f32018-efae-4238-aa29-b014af0fc046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:57.277059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f32018-efae-4238-aa29-b014af0fc046 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:57.278486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f32018-efae-4238-aa29-b014af0fc046 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:57.279047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f32018-efae-4238-aa29-b014af0fc046 admin admin] PATH_INFO: `/v3/projects/0f69a55f2c2c4c918666e6e778883b8e/users/ba0a1fec448d4372a76218d2309ca296/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:57.339108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f32018-efae-4238-aa29-b014af0fc046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f69a55f2c2c4c918666e6e778883b8e, user_id=ba0a1fec448d4372a76218d2309ca296, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:57.349954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30f0a2-1bf0-4227-a521-2d126a682706 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:57.352331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9b30f0a2-1bf0-4227-a521-2d126a682706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:57.379623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f32018-efae-4238-aa29-b014af0fc046 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:57.380131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30f0a2-1bf0-4227-a521-2d126a682706 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:57.387036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214cbb3-bb2d-46bb-ab97-fe41acee2fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:57.387992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214cbb3-bb2d-46bb-ab97-fe41acee2fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:57.388561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214cbb3-bb2d-46bb-ab97-fe41acee2fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:57.389274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214cbb3-bb2d-46bb-ab97-fe41acee2fb2 admin admin] PATH_INFO: `/v3/projects/56df18e439a94887aca4be7fc9e1a9b5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:57.390561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214cbb3-bb2d-46bb-ab97-fe41acee2fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56df18e439a94887aca4be7fc9e1a9b5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:57.392533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214cbb3-bb2d-46bb-ab97-fe41acee2fb2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:57.441419 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3011/6071] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:22:57 2022] PUT /identity/v3/projects/0f69a55f2c2c4c918666e6e778883b8e/users/ba0a1fec448d4372a76218d2309ca296/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:57.443123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7cb7c-0df9-421a-b23d-17f95361d531 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:57.443481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7cb7c-0df9-421a-b23d-17f95361d531 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:57.443807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7cb7c-0df9-421a-b23d-17f95361d531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:57.546218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c214cbb3-bb2d-46bb-ab97-fe41acee2fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56df18e439a94887aca4be7fc9e1a9b5', 'request_id': 'req-c214cbb3-bb2d-46bb-ab97-fe41acee2fb2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:57.564489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9bd7cb7c-0df9-421a-b23d-17f95361d531 None None] MFA Rules not processed for user `ba0a1fec448d4372a76218d2309ca296`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:57.570286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9bd7cb7c-0df9-421a-b23d-17f95361d531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:57.571244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c214cbb3-bb2d-46bb-ab97-fe41acee2fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56df18e439a94887aca4be7fc9e1a9b5', 'request_id': 'req-c214cbb3-bb2d-46bb-ab97-fe41acee2fb2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:57.593752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c214cbb3-bb2d-46bb-ab97-fe41acee2fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56df18e439a94887aca4be7fc9e1a9b5', 'request_id': 'req-c214cbb3-bb2d-46bb-ab97-fe41acee2fb2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:57.623313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c214cbb3-bb2d-46bb-ab97-fe41acee2fb2 admin admin] The token cache is being invalidate because project 56df18e439a94887aca4be7fc9e1a9b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:22:57.625155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c214cbb3-bb2d-46bb-ab97-fe41acee2fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:57.626777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c214cbb3-bb2d-46bb-ab97-fe41acee2fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:22:57.634833 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3061/6072] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:22:57 2022] DELETE /identity/v3/projects/56df18e439a94887aca4be7fc9e1a9b5 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:57.639143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6887596-6ea3-4171-9fb2-262b78925172 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:57.640296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6887596-6ea3-4171-9fb2-262b78925172 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:57.642261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6887596-6ea3-4171-9fb2-262b78925172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:57.688758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b6887596-6ea3-4171-9fb2-262b78925172 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:57.690260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b6887596-6ea3-4171-9fb2-262b78925172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:57.795642 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3012/6073] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:22:57.797033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7cb7c-0df9-421a-b23d-17f95361d531 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:57.804911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9bd7cb7c-0df9-421a-b23d-17f95361d531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:57.919707 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3062/6074] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:57.927730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9678b66-f058-4c11-a2af-a5b0bf59cd44 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:57.928019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9678b66-f058-4c11-a2af-a5b0bf59cd44 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:57.928300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9678b66-f058-4c11-a2af-a5b0bf59cd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:57.966759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d9678b66-f058-4c11-a2af-a5b0bf59cd44 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:57.968904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d9678b66-f058-4c11-a2af-a5b0bf59cd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:57.975155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7cb7c-0df9-421a-b23d-17f95361d531 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:57.981711 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3063/6075] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:57.985565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9678b66-f058-4c11-a2af-a5b0bf59cd44 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:57.998294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a3def-474a-40da-acff-4cbfe258de57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:57.999155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a3def-474a-40da-acff-4cbfe258de57 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:57.999813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a3def-474a-40da-acff-4cbfe258de57 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:58.000513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a3def-474a-40da-acff-4cbfe258de57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:58.011421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9678b66-f058-4c11-a2af-a5b0bf59cd44 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:58.030394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e33f0-5a8d-40b5-b84f-4b08c48915f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:58.031659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e33f0-5a8d-40b5-b84f-4b08c48915f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:58.031954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e33f0-5a8d-40b5-b84f-4b08c48915f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:58.032280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e33f0-5a8d-40b5-b84f-4b08c48915f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:58.032964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e33f0-5a8d-40b5-b84f-4b08c48915f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:22:58.033275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e33f0-5a8d-40b5-b84f-4b08c48915f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:58.033391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a3def-474a-40da-acff-4cbfe258de57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:58.034937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a3def-474a-40da-acff-4cbfe258de57 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:58.037134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e33f0-5a8d-40b5-b84f-4b08c48915f4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:58.056195 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3013/6076] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:22:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:22:58.081769 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3064/6077] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:22:58.083331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a3def-474a-40da-acff-4cbfe258de57 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:58.100621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a3def-474a-40da-acff-4cbfe258de57 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:58.114238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3652c58-e476-4609-b067-483de5ffb31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:58.115049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652c58-e476-4609-b067-483de5ffb31c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:58.115492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652c58-e476-4609-b067-483de5ffb31c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:58.115880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652c58-e476-4609-b067-483de5ffb31c admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:58.116673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3652c58-e476-4609-b067-483de5ffb31c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:58.119164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3652c58-e476-4609-b067-483de5ffb31c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:58.160539 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3014/6078] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:22:58 2022] POST /identity/v3/projects => generated 391 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:22:58.164377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e33f0-5a8d-40b5-b84f-4b08c48915f4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:58.170331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:58.196837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e33f0-5a8d-40b5-b84f-4b08c48915f4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:58.308068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6acc9c-03cd-4d00-bd27-2e448cd60ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:58.310103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6acc9c-03cd-4d00-bd27-2e448cd60ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:58.310406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6acc9c-03cd-4d00-bd27-2e448cd60ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:58.310761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6acc9c-03cd-4d00-bd27-2e448cd60ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:58.311533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6acc9c-03cd-4d00-bd27-2e448cd60ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:58.319579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6acc9c-03cd-4d00-bd27-2e448cd60ea8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:58.403492 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3065/6079] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:22:58 2022] POST /identity/v3/users => generated 296 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:22:58.403986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3652c58-e476-4609-b067-483de5ffb31c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:58.418992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3652c58-e476-4609-b067-483de5ffb31c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:58.437146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41381678-2a97-4fd6-886d-bcf3423f365c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:58.438362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41381678-2a97-4fd6-886d-bcf3423f365c admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:58.438656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41381678-2a97-4fd6-886d-bcf3423f365c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:58.438939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41381678-2a97-4fd6-886d-bcf3423f365c admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:58.439753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41381678-2a97-4fd6-886d-bcf3423f365c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:58.442706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41381678-2a97-4fd6-886d-bcf3423f365c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:58.473711 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3015/6080] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:22:58.476708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6acc9c-03cd-4d00-bd27-2e448cd60ea8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:58.492259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6acc9c-03cd-4d00-bd27-2e448cd60ea8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:58.513191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12b6da-16f9-4833-85df-e535a2bbf544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:58.514319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12b6da-16f9-4833-85df-e535a2bbf544 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:58.514319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12b6da-16f9-4833-85df-e535a2bbf544 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:58.514513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12b6da-16f9-4833-85df-e535a2bbf544 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:58.515098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12b6da-16f9-4833-85df-e535a2bbf544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:58.516819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12b6da-16f9-4833-85df-e535a2bbf544 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:58.539151 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3066/6081] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:22:58.544712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41381678-2a97-4fd6-886d-bcf3423f365c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:58.551973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:58.561934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41381678-2a97-4fd6-886d-bcf3423f365c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:58.585833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c00d4-bdd3-4a39-9d8d-7626180db03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:58.586905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c00d4-bdd3-4a39-9d8d-7626180db03c admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:58.587267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c00d4-bdd3-4a39-9d8d-7626180db03c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:58.587645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c00d4-bdd3-4a39-9d8d-7626180db03c admin admin] PATH_INFO: `/v3/projects/2071c27c87474b30b4f76d18b6c8fc30/users/c8432f75013d47a9a849aceac49ba67b/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:58.616107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c00d4-bdd3-4a39-9d8d-7626180db03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2071c27c87474b30b4f76d18b6c8fc30, user_id=c8432f75013d47a9a849aceac49ba67b, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:58.619623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c00d4-bdd3-4a39-9d8d-7626180db03c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:58.646817 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3016/6082] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:22:58 2022] PUT /identity/v3/projects/2071c27c87474b30b4f76d18b6c8fc30/users/c8432f75013d47a9a849aceac49ba67b/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:58.657485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b02448-2672-457c-a0d7-fd040c10662a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:58.658092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b02448-2672-457c-a0d7-fd040c10662a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:58.658092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b02448-2672-457c-a0d7-fd040c10662a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:58.717504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c1b02448-2672-457c-a0d7-fd040c10662a None None] MFA Rules not processed for user `c8432f75013d47a9a849aceac49ba67b`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:58.719062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c1b02448-2672-457c-a0d7-fd040c10662a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:58.843182 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3067/6083] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:58.848025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c00d4-bdd3-4a39-9d8d-7626180db03c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:58.957736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c00d4-bdd3-4a39-9d8d-7626180db03c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:58.972484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de789d13-ccb1-433c-b46c-b5772b63613a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:58.973470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de789d13-ccb1-433c-b46c-b5772b63613a admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:58.973818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de789d13-ccb1-433c-b46c-b5772b63613a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:58.974536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de789d13-ccb1-433c-b46c-b5772b63613a admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:58.975308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de789d13-ccb1-433c-b46c-b5772b63613a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:58.977865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de789d13-ccb1-433c-b46c-b5772b63613a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:59.025675 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3017/6084] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:22:58 2022] POST /identity/v3/projects => generated 393 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:22:59.028613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b02448-2672-457c-a0d7-fd040c10662a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:59.042545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b02448-2672-457c-a0d7-fd040c10662a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:59.130826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fc880-2b33-46f1-9d3c-452831595ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:59.131687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fc880-2b33-46f1-9d3c-452831595ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:59.132048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fc880-2b33-46f1-9d3c-452831595ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:59.132330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fc880-2b33-46f1-9d3c-452831595ff4 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:59.133009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fc880-2b33-46f1-9d3c-452831595ff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:59.135192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fc880-2b33-46f1-9d3c-452831595ff4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:59.167765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:59.177984 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3068/6085] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:22:59 2022] POST /identity/v3/users => generated 303 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:22:59.181759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de789d13-ccb1-433c-b46c-b5772b63613a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:59.194336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de789d13-ccb1-433c-b46c-b5772b63613a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:59.201861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392d573-5f13-4b13-b902-74b25f33ad08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:59.202986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392d573-5f13-4b13-b902-74b25f33ad08 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:59.203554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392d573-5f13-4b13-b902-74b25f33ad08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:59.204049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392d573-5f13-4b13-b902-74b25f33ad08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:59.205181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392d573-5f13-4b13-b902-74b25f33ad08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:59.207306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392d573-5f13-4b13-b902-74b25f33ad08 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:59.224818 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3018/6086] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:22:59.226897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fc880-2b33-46f1-9d3c-452831595ff4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:59.244582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fc880-2b33-46f1-9d3c-452831595ff4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:59.250638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174aa5c3-1e9f-42ad-8886-52813e3a3823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:59.251372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aa5c3-1e9f-42ad-8886-52813e3a3823 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:59.251665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aa5c3-1e9f-42ad-8886-52813e3a3823 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:59.251945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aa5c3-1e9f-42ad-8886-52813e3a3823 admin admin] PATH_INFO: `/v3/projects/3537f713b5ab42b9a010eaae113c1f4e/users/302ec881f65344acbb35cfe23286ac8a/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:59.273164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174aa5c3-1e9f-42ad-8886-52813e3a3823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3537f713b5ab42b9a010eaae113c1f4e, user_id=302ec881f65344acbb35cfe23286ac8a, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:59.278903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174aa5c3-1e9f-42ad-8886-52813e3a3823 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:59.303487 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3069/6087] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:22:59 2022] PUT /identity/v3/projects/3537f713b5ab42b9a010eaae113c1f4e/users/302ec881f65344acbb35cfe23286ac8a/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:59.305178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392d573-5f13-4b13-b902-74b25f33ad08 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:59.317852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392d573-5f13-4b13-b902-74b25f33ad08 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:59.415711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c25d2-f70a-4f86-84c8-9c255ce35490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:59.417031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c25d2-f70a-4f86-84c8-9c255ce35490 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:59.417564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c25d2-f70a-4f86-84c8-9c255ce35490 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:59.418083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c25d2-f70a-4f86-84c8-9c255ce35490 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:59.419113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c25d2-f70a-4f86-84c8-9c255ce35490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:59.436613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c25d2-f70a-4f86-84c8-9c255ce35490 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:59.453596 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3019/6088] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:22:59.459130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174aa5c3-1e9f-42ad-8886-52813e3a3823 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:59.471855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174aa5c3-1e9f-42ad-8886-52813e3a3823 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:59.477564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3b0c3-dd4d-4a7e-81c9-e43f2623cbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:59.478477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3b0c3-dd4d-4a7e-81c9-e43f2623cbda admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:59.479190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3b0c3-dd4d-4a7e-81c9-e43f2623cbda admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:59.479527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3b0c3-dd4d-4a7e-81c9-e43f2623cbda admin admin] PATH_INFO: `/v3/projects/3537f713b5ab42b9a010eaae113c1f4e/users/302ec881f65344acbb35cfe23286ac8a/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:59.481658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3b0c3-dd4d-4a7e-81c9-e43f2623cbda admin admin] RBAC: Authorizing `identity:create_grant(project_id=3537f713b5ab42b9a010eaae113c1f4e, user_id=302ec881f65344acbb35cfe23286ac8a, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:59.486426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3b0c3-dd4d-4a7e-81c9-e43f2623cbda admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:59.512676 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3070/6089] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:22:59 2022] PUT /identity/v3/projects/3537f713b5ab42b9a010eaae113c1f4e/users/302ec881f65344acbb35cfe23286ac8a/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:22:59.523867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847ce9e-e7e7-407e-a8ac-f6607acbaa28 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:59.524275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847ce9e-e7e7-407e-a8ac-f6607acbaa28 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:59.524566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847ce9e-e7e7-407e-a8ac-f6607acbaa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:59.565590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e847ce9e-e7e7-407e-a8ac-f6607acbaa28 None None] MFA Rules not processed for user `302ec881f65344acbb35cfe23286ac8a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:22:59.567052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e847ce9e-e7e7-407e-a8ac-f6607acbaa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:59.701151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:59.764394 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3020/6090] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:22:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:22:59.790801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3b0c3-dd4d-4a7e-81c9-e43f2623cbda admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:22:59.792758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-74c3b0c3-dd4d-4a7e-81c9-e43f2623cbda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:22:59.926325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3b0c3-dd4d-4a7e-81c9-e43f2623cbda admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:22:59.930438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc260e9-1b60-40d9-a42e-b6ef9191e664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:22:59.931130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc260e9-1b60-40d9-a42e-b6ef9191e664 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:22:59.931457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc260e9-1b60-40d9-a42e-b6ef9191e664 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:22:59.931889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc260e9-1b60-40d9-a42e-b6ef9191e664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:22:59.962249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc260e9-1b60-40d9-a42e-b6ef9191e664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:22:59.963776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc260e9-1b60-40d9-a42e-b6ef9191e664 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:22:59.976345 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3071/6091] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:22:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:23:04.426384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847ce9e-e7e7-407e-a8ac-f6607acbaa28 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:04.427937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e847ce9e-e7e7-407e-a8ac-f6607acbaa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:04.589092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847ce9e-e7e7-407e-a8ac-f6607acbaa28 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:04.596838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4770f-daed-422b-8b9c-2969351a6581 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:04.597615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4770f-daed-422b-8b9c-2969351a6581 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:04.598001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4770f-daed-422b-8b9c-2969351a6581 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:04.598382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4770f-daed-422b-8b9c-2969351a6581 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:04.600620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-11e4770f-daed-422b-8b9c-2969351a6581 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:04.624442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4770f-daed-422b-8b9c-2969351a6581 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:04.626087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4770f-daed-422b-8b9c-2969351a6581 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:04.640258 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3021/6092] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:23:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:23:05.757996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc260e9-1b60-40d9-a42e-b6ef9191e664 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:05.774382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc260e9-1b60-40d9-a42e-b6ef9191e664 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:05.780945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bdf9f-7c7a-4a86-a4cd-6fd266a1bf03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:05.781661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bdf9f-7c7a-4a86-a4cd-6fd266a1bf03 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:05.782012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bdf9f-7c7a-4a86-a4cd-6fd266a1bf03 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:05.782374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bdf9f-7c7a-4a86-a4cd-6fd266a1bf03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:05.784527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3e0bdf9f-7c7a-4a86-a4cd-6fd266a1bf03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:05.799321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bdf9f-7c7a-4a86-a4cd-6fd266a1bf03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:05.801256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bdf9f-7c7a-4a86-a4cd-6fd266a1bf03 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:05.819562 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3072/6093] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:23:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:23:06.732064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4770f-daed-422b-8b9c-2969351a6581 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:06.872608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bdf9f-7c7a-4a86-a4cd-6fd266a1bf03 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:06.904288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bdf9f-7c7a-4a86-a4cd-6fd266a1bf03 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:06.920251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f50f7-cc87-417b-b217-e80a199dcbff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:06.922951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f50f7-cc87-417b-b217-e80a199dcbff service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:06.923675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f50f7-cc87-417b-b217-e80a199dcbff service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:06.926605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f50f7-cc87-417b-b217-e80a199dcbff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:06.930373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a67f50f7-cc87-417b-b217-e80a199dcbff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:06.974938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4770f-daed-422b-8b9c-2969351a6581 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:06.977712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f50f7-cc87-417b-b217-e80a199dcbff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:06.984953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f50f7-cc87-417b-b217-e80a199dcbff service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:06.997428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d880937-e6ab-4f6c-96ae-c8049443ab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:06.998110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d880937-e6ab-4f6c-96ae-c8049443ab7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:06.998392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d880937-e6ab-4f6c-96ae-c8049443ab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:06.998669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d880937-e6ab-4f6c-96ae-c8049443ab7b admin admin] PATH_INFO: `/v3/users/c8432f75013d47a9a849aceac49ba67b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:06.999959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d880937-e6ab-4f6c-96ae-c8049443ab7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8432f75013d47a9a849aceac49ba67b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:07.001922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d880937-e6ab-4f6c-96ae-c8049443ab7b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:07.020807 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3073/6094] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:23:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:23:07.126867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9d880937-e6ab-4f6c-96ae-c8049443ab7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8432f75013d47a9a849aceac49ba67b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:07.128037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9d880937-e6ab-4f6c-96ae-c8049443ab7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8432f75013d47a9a849aceac49ba67b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:07.164008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9d880937-e6ab-4f6c-96ae-c8049443ab7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8432f75013d47a9a849aceac49ba67b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:07.166329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9d880937-e6ab-4f6c-96ae-c8049443ab7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8432f75013d47a9a849aceac49ba67b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:07.176175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:07.197244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9d880937-e6ab-4f6c-96ae-c8049443ab7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8432f75013d47a9a849aceac49ba67b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:07.225333 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3022/6095] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:23:06 2022] DELETE /identity/v3/users/c8432f75013d47a9a849aceac49ba67b => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:23:07.229604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6298e5-0415-4710-8b7d-aa86252ed94f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:07.229898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6298e5-0415-4710-8b7d-aa86252ed94f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:07.230210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6298e5-0415-4710-8b7d-aa86252ed94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:07.273974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-fe6298e5-0415-4710-8b7d-aa86252ed94f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:23:07.275839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fe6298e5-0415-4710-8b7d-aa86252ed94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:07.416864 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3074/6096] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:23:07.432583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d880937-e6ab-4f6c-96ae-c8049443ab7b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:07.434650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9d880937-e6ab-4f6c-96ae-c8049443ab7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:07.528171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d880937-e6ab-4f6c-96ae-c8049443ab7b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:07.532862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea12bd5-0bc3-4567-bccd-4a3df29502f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:07.533287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea12bd5-0bc3-4567-bccd-4a3df29502f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:07.534833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea12bd5-0bc3-4567-bccd-4a3df29502f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:07.535032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea12bd5-0bc3-4567-bccd-4a3df29502f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:07.549477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea12bd5-0bc3-4567-bccd-4a3df29502f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:07.551892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea12bd5-0bc3-4567-bccd-4a3df29502f5 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:07.571501 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3023/6097] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:23:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:23:09.723955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6298e5-0415-4710-8b7d-aa86252ed94f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:09.725610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fe6298e5-0415-4710-8b7d-aa86252ed94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:09.739660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6298e5-0415-4710-8b7d-aa86252ed94f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:09.746530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef864305-22ed-4ba2-a4c4-b128b28aaef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:09.747608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef864305-22ed-4ba2-a4c4-b128b28aaef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:09.748084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef864305-22ed-4ba2-a4c4-b128b28aaef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:09.748546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef864305-22ed-4ba2-a4c4-b128b28aaef3 admin admin] PATH_INFO: `/v3/projects/2071c27c87474b30b4f76d18b6c8fc30` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:09.749997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef864305-22ed-4ba2-a4c4-b128b28aaef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2071c27c87474b30b4f76d18b6c8fc30)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:09.752524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef864305-22ed-4ba2-a4c4-b128b28aaef3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:09.814168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:09.838596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ef864305-22ed-4ba2-a4c4-b128b28aaef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2071c27c87474b30b4f76d18b6c8fc30', 'request_id': 'req-ef864305-22ed-4ba2-a4c4-b128b28aaef3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:09.851320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ef864305-22ed-4ba2-a4c4-b128b28aaef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2071c27c87474b30b4f76d18b6c8fc30', 'request_id': 'req-ef864305-22ed-4ba2-a4c4-b128b28aaef3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:09.870221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ef864305-22ed-4ba2-a4c4-b128b28aaef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2071c27c87474b30b4f76d18b6c8fc30', 'request_id': 'req-ef864305-22ed-4ba2-a4c4-b128b28aaef3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:09.894696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ef864305-22ed-4ba2-a4c4-b128b28aaef3 admin admin] The token cache is being invalidate because project 2071c27c87474b30b4f76d18b6c8fc30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:23:09.895021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ef864305-22ed-4ba2-a4c4-b128b28aaef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:09.899279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ef864305-22ed-4ba2-a4c4-b128b28aaef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:09.905474 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3075/6098] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:23:09 2022] DELETE /identity/v3/projects/2071c27c87474b30b4f76d18b6c8fc30 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:23:09.906552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea12bd5-0bc3-4567-bccd-4a3df29502f5 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:09.921821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea12bd5-0bc3-4567-bccd-4a3df29502f5 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:10.024792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20ea7d-47a4-46fa-a40e-ec2e97062772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:10.026224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20ea7d-47a4-46fa-a40e-ec2e97062772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:10.026666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20ea7d-47a4-46fa-a40e-ec2e97062772 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:10.027672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20ea7d-47a4-46fa-a40e-ec2e97062772 admin admin] PATH_INFO: `/v3/users/302ec881f65344acbb35cfe23286ac8a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:10.029217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20ea7d-47a4-46fa-a40e-ec2e97062772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=302ec881f65344acbb35cfe23286ac8a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:10.031413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20ea7d-47a4-46fa-a40e-ec2e97062772 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:10.115176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1d20ea7d-47a4-46fa-a40e-ec2e97062772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302ec881f65344acbb35cfe23286ac8a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:10.125659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1d20ea7d-47a4-46fa-a40e-ec2e97062772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302ec881f65344acbb35cfe23286ac8a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:10.150566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1d20ea7d-47a4-46fa-a40e-ec2e97062772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302ec881f65344acbb35cfe23286ac8a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:10.150990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1d20ea7d-47a4-46fa-a40e-ec2e97062772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302ec881f65344acbb35cfe23286ac8a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:10.164226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1d20ea7d-47a4-46fa-a40e-ec2e97062772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302ec881f65344acbb35cfe23286ac8a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:10.186174 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3024/6099] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:23:09 2022] DELETE /identity/v3/users/302ec881f65344acbb35cfe23286ac8a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:23:10.920197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef864305-22ed-4ba2-a4c4-b128b28aaef3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:10.924103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ef864305-22ed-4ba2-a4c4-b128b28aaef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:10.941994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef864305-22ed-4ba2-a4c4-b128b28aaef3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:11.038940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20ea7d-47a4-46fa-a40e-ec2e97062772 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:11.041988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1d20ea7d-47a4-46fa-a40e-ec2e97062772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:11.058641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f962455-0f42-4bb7-bfeb-7cc7681cd76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:11.058941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:11.059396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f962455-0f42-4bb7-bfeb-7cc7681cd76b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:11.059910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f962455-0f42-4bb7-bfeb-7cc7681cd76b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:11.060505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f962455-0f42-4bb7-bfeb-7cc7681cd76b admin admin] PATH_INFO: `/v3/projects/3537f713b5ab42b9a010eaae113c1f4e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:11.062187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f962455-0f42-4bb7-bfeb-7cc7681cd76b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3537f713b5ab42b9a010eaae113c1f4e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:11.064652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f962455-0f42-4bb7-bfeb-7cc7681cd76b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:11.144025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0f962455-0f42-4bb7-bfeb-7cc7681cd76b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3537f713b5ab42b9a010eaae113c1f4e', 'request_id': 'req-0f962455-0f42-4bb7-bfeb-7cc7681cd76b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:11.153929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0f962455-0f42-4bb7-bfeb-7cc7681cd76b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3537f713b5ab42b9a010eaae113c1f4e', 'request_id': 'req-0f962455-0f42-4bb7-bfeb-7cc7681cd76b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:11.162301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20ea7d-47a4-46fa-a40e-ec2e97062772 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:11.167172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0f962455-0f42-4bb7-bfeb-7cc7681cd76b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3537f713b5ab42b9a010eaae113c1f4e', 'request_id': 'req-0f962455-0f42-4bb7-bfeb-7cc7681cd76b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:11.181330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0f962455-0f42-4bb7-bfeb-7cc7681cd76b admin admin] The token cache is being invalidate because project 3537f713b5ab42b9a010eaae113c1f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:23:11.182020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0f962455-0f42-4bb7-bfeb-7cc7681cd76b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:11.183827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0f962455-0f42-4bb7-bfeb-7cc7681cd76b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:11.189415 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3076/6100] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:23:10 2022] DELETE /identity/v3/projects/3537f713b5ab42b9a010eaae113c1f4e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:23:11.190922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21972874-7b51-438f-89a0-96d921c97590 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:11.191226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21972874-7b51-438f-89a0-96d921c97590 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:11.191556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21972874-7b51-438f-89a0-96d921c97590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:11.219503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-21972874-7b51-438f-89a0-96d921c97590 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:23:11.222034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-21972874-7b51-438f-89a0-96d921c97590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:11.242118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096cd8c-51b4-412b-b76b-30b27ace9e59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:11.242753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096cd8c-51b4-412b-b76b-30b27ace9e59 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:11.243080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096cd8c-51b4-412b-b76b-30b27ace9e59 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:11.243728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096cd8c-51b4-412b-b76b-30b27ace9e59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:11.247175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a096cd8c-51b4-412b-b76b-30b27ace9e59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:11.286835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:11.328633 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3077/6101] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:23:11.330869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc687dcf-41c6-4e51-8c0a-69c056a07853 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:11.331411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc687dcf-41c6-4e51-8c0a-69c056a07853 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:11.331917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc687dcf-41c6-4e51-8c0a-69c056a07853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:11.356015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bc687dcf-41c6-4e51-8c0a-69c056a07853 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:23:11.358042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bc687dcf-41c6-4e51-8c0a-69c056a07853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:11.368347 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3078/6102] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:23:11.373826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc687dcf-41c6-4e51-8c0a-69c056a07853 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:11.392093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc687dcf-41c6-4e51-8c0a-69c056a07853 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:11.392692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096cd8c-51b4-412b-b76b-30b27ace9e59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:11.394590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096cd8c-51b4-412b-b76b-30b27ace9e59 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:11.404582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c3478-beba-4824-8454-0115bd7cee83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:11.405507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c3478-beba-4824-8454-0115bd7cee83 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:11.406045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c3478-beba-4824-8454-0115bd7cee83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:11.406510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c3478-beba-4824-8454-0115bd7cee83 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:11.408020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c3478-beba-4824-8454-0115bd7cee83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:23:11.408573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c3478-beba-4824-8454-0115bd7cee83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:11.411177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c3478-beba-4824-8454-0115bd7cee83 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:11.429508 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3079/6103] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:23:11.431140 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3025/6104] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:23:11.434032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c3478-beba-4824-8454-0115bd7cee83 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:11.447509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c3478-beba-4824-8454-0115bd7cee83 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:11.464829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cb118-b309-4699-993a-d1f69ce22a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:11.465445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cb118-b309-4699-993a-d1f69ce22a7a admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:11.465765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cb118-b309-4699-993a-d1f69ce22a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:11.466049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cb118-b309-4699-993a-d1f69ce22a7a admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:11.466733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cb118-b309-4699-993a-d1f69ce22a7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:11.468755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cb118-b309-4699-993a-d1f69ce22a7a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:11.533363 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3080/6105] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:23:11 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:23:11.537301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096cd8c-51b4-412b-b76b-30b27ace9e59 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:11.565399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096cd8c-51b4-412b-b76b-30b27ace9e59 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:11.722619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dd681-8d10-4043-a971-d59374bde134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:11.723898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dd681-8d10-4043-a971-d59374bde134 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:11.724183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dd681-8d10-4043-a971-d59374bde134 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:11.724462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dd681-8d10-4043-a971-d59374bde134 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:11.727446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dd681-8d10-4043-a971-d59374bde134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:11.735883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dd681-8d10-4043-a971-d59374bde134 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:11.785833 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3026/6106] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:23:11 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:23:11.790197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cb118-b309-4699-993a-d1f69ce22a7a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:11.805896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cb118-b309-4699-993a-d1f69ce22a7a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:11.816770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64ae83-8388-4c0d-b749-4f974e59f0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:11.817576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64ae83-8388-4c0d-b749-4f974e59f0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:11.817725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64ae83-8388-4c0d-b749-4f974e59f0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:11.817949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64ae83-8388-4c0d-b749-4f974e59f0a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:11.818775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64ae83-8388-4c0d-b749-4f974e59f0a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:11.820292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64ae83-8388-4c0d-b749-4f974e59f0a4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:11.850589 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3081/6107] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:23:11.852625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dd681-8d10-4043-a971-d59374bde134 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:11.864110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:11.881147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dd681-8d10-4043-a971-d59374bde134 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:11.898711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348af29-1873-4af3-9e53-d08b3014fbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:11.900300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348af29-1873-4af3-9e53-d08b3014fbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:11.901105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348af29-1873-4af3-9e53-d08b3014fbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:11.901105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348af29-1873-4af3-9e53-d08b3014fbf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:11.902440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348af29-1873-4af3-9e53-d08b3014fbf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:11.904591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348af29-1873-4af3-9e53-d08b3014fbf5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:11.933451 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3027/6108] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:23:11.938457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64ae83-8388-4c0d-b749-4f974e59f0a4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:11.965734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64ae83-8388-4c0d-b749-4f974e59f0a4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:11.975343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e55cd-fb96-43f7-b88f-f393c7c80789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:11.976375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e55cd-fb96-43f7-b88f-f393c7c80789 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:11.976829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e55cd-fb96-43f7-b88f-f393c7c80789 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:11.977275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e55cd-fb96-43f7-b88f-f393c7c80789 admin admin] PATH_INFO: `/v3/projects/29641ffc933740d4aa892df684ea50a9/users/3f38b3edc6114ea4823aff1f652db144/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:12.022223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e55cd-fb96-43f7-b88f-f393c7c80789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29641ffc933740d4aa892df684ea50a9, user_id=3f38b3edc6114ea4823aff1f652db144, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:12.025103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e55cd-fb96-43f7-b88f-f393c7c80789 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:12.055022 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3082/6109] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:23:11 2022] PUT /identity/v3/projects/29641ffc933740d4aa892df684ea50a9/users/3f38b3edc6114ea4823aff1f652db144/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:23:12.065846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10d06f-2d4f-4efd-8d9b-816994646d39 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:12.066675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10d06f-2d4f-4efd-8d9b-816994646d39 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:12.067361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10d06f-2d4f-4efd-8d9b-816994646d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:12.116934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9b10d06f-2d4f-4efd-8d9b-816994646d39 None None] MFA Rules not processed for user `3f38b3edc6114ea4823aff1f652db144`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:23:12.118207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9b10d06f-2d4f-4efd-8d9b-816994646d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:12.234692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e55cd-fb96-43f7-b88f-f393c7c80789 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:12.235121 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3028/6110] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:23:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:23:12.366919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e55cd-fb96-43f7-b88f-f393c7c80789 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:12.381669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143f8e9-1ebf-494b-9401-aa758d7e0b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:12.382409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143f8e9-1ebf-494b-9401-aa758d7e0b7e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:12.382706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143f8e9-1ebf-494b-9401-aa758d7e0b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:12.382992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143f8e9-1ebf-494b-9401-aa758d7e0b7e admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:12.383714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143f8e9-1ebf-494b-9401-aa758d7e0b7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:12.385948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143f8e9-1ebf-494b-9401-aa758d7e0b7e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:12.444011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10d06f-2d4f-4efd-8d9b-816994646d39 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:12.446139 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3083/6111] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:23:12 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:23:12.466559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10d06f-2d4f-4efd-8d9b-816994646d39 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:12.573110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd53ff1-9c02-4658-a87b-19fe3340fcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:12.575179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd53ff1-9c02-4658-a87b-19fe3340fcf7 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:12.575726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd53ff1-9c02-4658-a87b-19fe3340fcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:12.576702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd53ff1-9c02-4658-a87b-19fe3340fcf7 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:12.578494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd53ff1-9c02-4658-a87b-19fe3340fcf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:12.581054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd53ff1-9c02-4658-a87b-19fe3340fcf7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:12.617520 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3029/6112] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:23:12 2022] POST /identity/v3/users => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:23:12.622145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143f8e9-1ebf-494b-9401-aa758d7e0b7e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:12.641175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143f8e9-1ebf-494b-9401-aa758d7e0b7e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:12.648720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95fd54-4689-4756-950c-d5d8c796f165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:12.649344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95fd54-4689-4756-950c-d5d8c796f165 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:12.649740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95fd54-4689-4756-950c-d5d8c796f165 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:12.649940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95fd54-4689-4756-950c-d5d8c796f165 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:12.650790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95fd54-4689-4756-950c-d5d8c796f165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:12.653649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95fd54-4689-4756-950c-d5d8c796f165 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:12.673576 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3084/6113] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:23:12.675068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd53ff1-9c02-4658-a87b-19fe3340fcf7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:12.693901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd53ff1-9c02-4658-a87b-19fe3340fcf7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:12.699173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec9889-e01b-4165-b72d-0d6e181b1bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:12.700123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec9889-e01b-4165-b72d-0d6e181b1bde admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:12.700408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec9889-e01b-4165-b72d-0d6e181b1bde admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:12.700683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec9889-e01b-4165-b72d-0d6e181b1bde admin admin] PATH_INFO: `/v3/projects/d91267fc750b45039a3d7cb3e128527c/users/1789c94c6a8347a194e13e1f92083506/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:12.726611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec9889-e01b-4165-b72d-0d6e181b1bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91267fc750b45039a3d7cb3e128527c, user_id=1789c94c6a8347a194e13e1f92083506, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:12.730337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec9889-e01b-4165-b72d-0d6e181b1bde admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:12.751572 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3030/6114] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:23:12 2022] PUT /identity/v3/projects/d91267fc750b45039a3d7cb3e128527c/users/1789c94c6a8347a194e13e1f92083506/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:23:12.755389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95fd54-4689-4756-950c-d5d8c796f165 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:12.768179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95fd54-4689-4756-950c-d5d8c796f165 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:12.827390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:12.846332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb77c82-438d-4d3c-b8dd-74043f9599de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:12.847479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb77c82-438d-4d3c-b8dd-74043f9599de admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:12.848037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb77c82-438d-4d3c-b8dd-74043f9599de admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:12.848420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb77c82-438d-4d3c-b8dd-74043f9599de admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:12.849354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb77c82-438d-4d3c-b8dd-74043f9599de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:12.851233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb77c82-438d-4d3c-b8dd-74043f9599de admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:12.872618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec9889-e01b-4165-b72d-0d6e181b1bde admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:12.882219 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3085/6115] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:23:12.886848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec9889-e01b-4165-b72d-0d6e181b1bde admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:12.892550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386f3ea-b8f0-41ee-9bcc-f707f5d7a566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:12.893378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386f3ea-b8f0-41ee-9bcc-f707f5d7a566 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:12.893773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386f3ea-b8f0-41ee-9bcc-f707f5d7a566 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:12.894156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386f3ea-b8f0-41ee-9bcc-f707f5d7a566 admin admin] PATH_INFO: `/v3/projects/d91267fc750b45039a3d7cb3e128527c/users/1789c94c6a8347a194e13e1f92083506/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:12.896530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386f3ea-b8f0-41ee-9bcc-f707f5d7a566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91267fc750b45039a3d7cb3e128527c, user_id=1789c94c6a8347a194e13e1f92083506, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:12.899545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386f3ea-b8f0-41ee-9bcc-f707f5d7a566 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:12.923800 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3031/6116] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:23:12 2022] PUT /identity/v3/projects/d91267fc750b45039a3d7cb3e128527c/users/1789c94c6a8347a194e13e1f92083506/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:23:12.925771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c9ae5-4481-4a42-b234-f171e97bf075 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:12.926139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c9ae5-4481-4a42-b234-f171e97bf075 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:12.926498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c9ae5-4481-4a42-b234-f171e97bf075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:12.971505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-fa7c9ae5-4481-4a42-b234-f171e97bf075 None None] MFA Rules not processed for user `1789c94c6a8347a194e13e1f92083506`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:23:12.974166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fa7c9ae5-4481-4a42-b234-f171e97bf075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:13.151235 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3086/6117] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:23:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:23:13.407149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386f3ea-b8f0-41ee-9bcc-f707f5d7a566 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:13.410376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f386f3ea-b8f0-41ee-9bcc-f707f5d7a566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:13.471417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:13.521076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386f3ea-b8f0-41ee-9bcc-f707f5d7a566 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:13.537085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ae50c-68e0-4b3e-bdad-71a3bfe983bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:13.538241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ae50c-68e0-4b3e-bdad-71a3bfe983bd service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:13.538744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ae50c-68e0-4b3e-bdad-71a3bfe983bd service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:13.539253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ae50c-68e0-4b3e-bdad-71a3bfe983bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:13.554219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c9ae5-4481-4a42-b234-f171e97bf075 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:13.555789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fa7c9ae5-4481-4a42-b234-f171e97bf075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:13.585749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ae50c-68e0-4b3e-bdad-71a3bfe983bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:13.591071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ae50c-68e0-4b3e-bdad-71a3bfe983bd service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:13.618318 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3032/6118] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:23:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:23:13.675041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c9ae5-4481-4a42-b234-f171e97bf075 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:13.681498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7974d18-a8e3-45c6-9206-89cb7808347a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:13.682145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7974d18-a8e3-45c6-9206-89cb7808347a service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:13.682427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7974d18-a8e3-45c6-9206-89cb7808347a service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:13.682704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7974d18-a8e3-45c6-9206-89cb7808347a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:13.693223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a7974d18-a8e3-45c6-9206-89cb7808347a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:13.780521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7974d18-a8e3-45c6-9206-89cb7808347a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:13.783703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7974d18-a8e3-45c6-9206-89cb7808347a service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:13.811657 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3087/6119] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:23:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:23:17.280870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ae50c-68e0-4b3e-bdad-71a3bfe983bd service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:17.283834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-197ae50c-68e0-4b3e-bdad-71a3bfe983bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:17.455210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ae50c-68e0-4b3e-bdad-71a3bfe983bd service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:17.467070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973f8c8-d817-47c7-a72c-ed1eacb72418 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:17.468450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973f8c8-d817-47c7-a72c-ed1eacb72418 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:17.469565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973f8c8-d817-47c7-a72c-ed1eacb72418 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:17.469860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973f8c8-d817-47c7-a72c-ed1eacb72418 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:17.472849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0973f8c8-d817-47c7-a72c-ed1eacb72418 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:17.497849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973f8c8-d817-47c7-a72c-ed1eacb72418 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:17.500067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973f8c8-d817-47c7-a72c-ed1eacb72418 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:17.538105 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3033/6120] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:23:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:23:17.964630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec449-76a7-491d-9498-da39f887c45c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:17.965183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec449-76a7-491d-9498-da39f887c45c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:17.965839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec449-76a7-491d-9498-da39f887c45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:18.009848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8acec449-76a7-491d-9498-da39f887c45c None None] MFA Rules not processed for user `6896ccb6369541d5a552f3373f39c64d`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:23:18.012715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8acec449-76a7-491d-9498-da39f887c45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:18.026179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:18.159116 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3088/6121] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:23:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:23:22.339824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973f8c8-d817-47c7-a72c-ed1eacb72418 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:22.482437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973f8c8-d817-47c7-a72c-ed1eacb72418 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:22.510168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d01012-42a9-4a62-adad-8966d77eddf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:22.510966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d01012-42a9-4a62-adad-8966d77eddf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:22.511238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d01012-42a9-4a62-adad-8966d77eddf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:22.511540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d01012-42a9-4a62-adad-8966d77eddf6 admin admin] PATH_INFO: `/v3/users/3f38b3edc6114ea4823aff1f652db144` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:22.520327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d01012-42a9-4a62-adad-8966d77eddf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f38b3edc6114ea4823aff1f652db144)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:22.522277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d01012-42a9-4a62-adad-8966d77eddf6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:22.632838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-28d01012-42a9-4a62-adad-8966d77eddf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f38b3edc6114ea4823aff1f652db144'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:22.633811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-28d01012-42a9-4a62-adad-8966d77eddf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f38b3edc6114ea4823aff1f652db144'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:22.654570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-28d01012-42a9-4a62-adad-8966d77eddf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f38b3edc6114ea4823aff1f652db144'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:22.655457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-28d01012-42a9-4a62-adad-8966d77eddf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f38b3edc6114ea4823aff1f652db144'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:22.659630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:22.694648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-28d01012-42a9-4a62-adad-8966d77eddf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f38b3edc6114ea4823aff1f652db144'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:22.728060 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3034/6122] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:23:22 2022] DELETE /identity/v3/users/3f38b3edc6114ea4823aff1f652db144 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:23:22.733392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11144917-a752-486e-a06d-076db30e91c3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:22.734267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11144917-a752-486e-a06d-076db30e91c3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:22.734708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11144917-a752-486e-a06d-076db30e91c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:22.769478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-11144917-a752-486e-a06d-076db30e91c3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:23:22.771172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-11144917-a752-486e-a06d-076db30e91c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:22.937527 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3089/6123] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:23:22.966071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d01012-42a9-4a62-adad-8966d77eddf6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:22.968145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-28d01012-42a9-4a62-adad-8966d77eddf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:23.163777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d01012-42a9-4a62-adad-8966d77eddf6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:23.187777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3278509-ddd5-4fba-b64d-2312f22aa7a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:23.188719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3278509-ddd5-4fba-b64d-2312f22aa7a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:23.189207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3278509-ddd5-4fba-b64d-2312f22aa7a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:23.189640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3278509-ddd5-4fba-b64d-2312f22aa7a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:23.202259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3278509-ddd5-4fba-b64d-2312f22aa7a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:23.204668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3278509-ddd5-4fba-b64d-2312f22aa7a3 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:23.218699 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3035/6124] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:23:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:23:24.841682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11144917-a752-486e-a06d-076db30e91c3 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:24.843855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-11144917-a752-486e-a06d-076db30e91c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:24.859002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11144917-a752-486e-a06d-076db30e91c3 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:24.884436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35070d30-a61d-4443-82fc-6c9a1826be65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:24.886971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35070d30-a61d-4443-82fc-6c9a1826be65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:24.887901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35070d30-a61d-4443-82fc-6c9a1826be65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:24.888371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35070d30-a61d-4443-82fc-6c9a1826be65 admin admin] PATH_INFO: `/v3/projects/29641ffc933740d4aa892df684ea50a9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:24.890149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35070d30-a61d-4443-82fc-6c9a1826be65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29641ffc933740d4aa892df684ea50a9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:24.892431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35070d30-a61d-4443-82fc-6c9a1826be65 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:24.980154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-35070d30-a61d-4443-82fc-6c9a1826be65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29641ffc933740d4aa892df684ea50a9', 'request_id': 'req-35070d30-a61d-4443-82fc-6c9a1826be65'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:24.999043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-35070d30-a61d-4443-82fc-6c9a1826be65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29641ffc933740d4aa892df684ea50a9', 'request_id': 'req-35070d30-a61d-4443-82fc-6c9a1826be65'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:25.013009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-35070d30-a61d-4443-82fc-6c9a1826be65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29641ffc933740d4aa892df684ea50a9', 'request_id': 'req-35070d30-a61d-4443-82fc-6c9a1826be65'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:25.027128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-35070d30-a61d-4443-82fc-6c9a1826be65 admin admin] The token cache is being invalidate because project 29641ffc933740d4aa892df684ea50a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:23:25.027737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-35070d30-a61d-4443-82fc-6c9a1826be65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:25.028700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-35070d30-a61d-4443-82fc-6c9a1826be65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:25.030556 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3090/6125] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:23:24 2022] DELETE /identity/v3/projects/29641ffc933740d4aa892df684ea50a9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:23:25.034844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3278509-ddd5-4fba-b64d-2312f22aa7a3 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:25.046212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3278509-ddd5-4fba-b64d-2312f22aa7a3 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:25.128280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814103f-7637-43ec-bd4b-c24ad66f3196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:25.128945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814103f-7637-43ec-bd4b-c24ad66f3196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:25.129238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814103f-7637-43ec-bd4b-c24ad66f3196 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:25.129521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814103f-7637-43ec-bd4b-c24ad66f3196 admin admin] PATH_INFO: `/v3/users/1789c94c6a8347a194e13e1f92083506` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:25.130784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814103f-7637-43ec-bd4b-c24ad66f3196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1789c94c6a8347a194e13e1f92083506)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:25.132898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814103f-7637-43ec-bd4b-c24ad66f3196 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:25.215648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d814103f-7637-43ec-bd4b-c24ad66f3196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1789c94c6a8347a194e13e1f92083506'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:25.216410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d814103f-7637-43ec-bd4b-c24ad66f3196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1789c94c6a8347a194e13e1f92083506'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:25.239557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d814103f-7637-43ec-bd4b-c24ad66f3196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1789c94c6a8347a194e13e1f92083506'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:25.240256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d814103f-7637-43ec-bd4b-c24ad66f3196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1789c94c6a8347a194e13e1f92083506'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:25.252296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d814103f-7637-43ec-bd4b-c24ad66f3196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1789c94c6a8347a194e13e1f92083506'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:25.295183 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3036/6126] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:23:25 2022] DELETE /identity/v3/users/1789c94c6a8347a194e13e1f92083506 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:23:25.938791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35070d30-a61d-4443-82fc-6c9a1826be65 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:25.940693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-35070d30-a61d-4443-82fc-6c9a1826be65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:25.968508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35070d30-a61d-4443-82fc-6c9a1826be65 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:26.102152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:26.150345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d18838-55fb-444d-9856-b03175051f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:26.151744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d18838-55fb-444d-9856-b03175051f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:26.152280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d18838-55fb-444d-9856-b03175051f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:26.152784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d18838-55fb-444d-9856-b03175051f1d admin admin] PATH_INFO: `/v3/projects/d91267fc750b45039a3d7cb3e128527c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:26.154172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d18838-55fb-444d-9856-b03175051f1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d91267fc750b45039a3d7cb3e128527c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:26.156630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d18838-55fb-444d-9856-b03175051f1d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:26.232390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-80d18838-55fb-444d-9856-b03175051f1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd91267fc750b45039a3d7cb3e128527c', 'request_id': 'req-80d18838-55fb-444d-9856-b03175051f1d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:26.242903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-80d18838-55fb-444d-9856-b03175051f1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd91267fc750b45039a3d7cb3e128527c', 'request_id': 'req-80d18838-55fb-444d-9856-b03175051f1d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:26.254734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-80d18838-55fb-444d-9856-b03175051f1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd91267fc750b45039a3d7cb3e128527c', 'request_id': 'req-80d18838-55fb-444d-9856-b03175051f1d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:26.269986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-80d18838-55fb-444d-9856-b03175051f1d admin admin] The token cache is being invalidate because project d91267fc750b45039a3d7cb3e128527c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:23:26.270540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-80d18838-55fb-444d-9856-b03175051f1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:26.271533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-80d18838-55fb-444d-9856-b03175051f1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:26.273889 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3091/6127] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:23:25 2022] DELETE /identity/v3/projects/d91267fc750b45039a3d7cb3e128527c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:23:26.279076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71efcd7-9b7c-4058-a20e-4c22a020d753 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:26.280160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71efcd7-9b7c-4058-a20e-4c22a020d753 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:26.280678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71efcd7-9b7c-4058-a20e-4c22a020d753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:26.303348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:26.321415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e71efcd7-9b7c-4058-a20e-4c22a020d753 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:23:26.328150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e71efcd7-9b7c-4058-a20e-4c22a020d753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:26.453630 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3037/6128] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:23:26.454497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e1783-fa98-4c81-98b0-97ac88c1e70b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:26.454797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e1783-fa98-4c81-98b0-97ac88c1e70b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:26.455103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e1783-fa98-4c81-98b0-97ac88c1e70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:26.489025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3d9e1783-fa98-4c81-98b0-97ac88c1e70b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:23:26.490309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3d9e1783-fa98-4c81-98b0-97ac88c1e70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:26.501309 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3092/6129] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:23:26.505790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71efcd7-9b7c-4058-a20e-4c22a020d753 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:26.521722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71efcd7-9b7c-4058-a20e-4c22a020d753 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:26.529213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d99823-3c27-4cca-9cc9-a2ed5d023d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:26.529939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d99823-3c27-4cca-9cc9-a2ed5d023d43 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:26.530289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d99823-3c27-4cca-9cc9-a2ed5d023d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:26.530658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d99823-3c27-4cca-9cc9-a2ed5d023d43 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:26.531477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d99823-3c27-4cca-9cc9-a2ed5d023d43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:23:26.532451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d99823-3c27-4cca-9cc9-a2ed5d023d43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:26.534068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d99823-3c27-4cca-9cc9-a2ed5d023d43 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:26.551937 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3038/6130] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:23:26.555001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e1783-fa98-4c81-98b0-97ac88c1e70b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:26.566259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e1783-fa98-4c81-98b0-97ac88c1e70b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:26.571486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a489714-4c4b-4d85-9dd1-e2f5870a00cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:26.572134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a489714-4c4b-4d85-9dd1-e2f5870a00cc admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:26.572417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a489714-4c4b-4d85-9dd1-e2f5870a00cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:26.572692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a489714-4c4b-4d85-9dd1-e2f5870a00cc admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:26.573371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a489714-4c4b-4d85-9dd1-e2f5870a00cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:26.575384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a489714-4c4b-4d85-9dd1-e2f5870a00cc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:26.617478 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3093/6131] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:23:26 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:23:26.618759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d99823-3c27-4cca-9cc9-a2ed5d023d43 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:26.633297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d99823-3c27-4cca-9cc9-a2ed5d023d43 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:26.795212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f3b92-b7cc-4707-8fcb-44b50854752d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:26.796166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f3b92-b7cc-4707-8fcb-44b50854752d admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:26.796657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f3b92-b7cc-4707-8fcb-44b50854752d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:26.797153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f3b92-b7cc-4707-8fcb-44b50854752d admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:26.798189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f3b92-b7cc-4707-8fcb-44b50854752d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:26.800364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f3b92-b7cc-4707-8fcb-44b50854752d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:26.833769 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3039/6132] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:23:26 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:23:26.835180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a489714-4c4b-4d85-9dd1-e2f5870a00cc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:26.846987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a489714-4c4b-4d85-9dd1-e2f5870a00cc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:26.853025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f2849-8bd6-4a1d-9e8b-1b8d04d67f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:26.853565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f2849-8bd6-4a1d-9e8b-1b8d04d67f4f admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:26.854079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f2849-8bd6-4a1d-9e8b-1b8d04d67f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:26.855319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f2849-8bd6-4a1d-9e8b-1b8d04d67f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:26.856255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f2849-8bd6-4a1d-9e8b-1b8d04d67f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:26.857987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f2849-8bd6-4a1d-9e8b-1b8d04d67f4f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:26.871349 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3094/6133] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:23:26.875061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f3b92-b7cc-4707-8fcb-44b50854752d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:26.889563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f3b92-b7cc-4707-8fcb-44b50854752d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:26.896022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d9efd-b7a3-4f28-b811-90aed238c09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:26.897590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d9efd-b7a3-4f28-b811-90aed238c09d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:26.897918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d9efd-b7a3-4f28-b811-90aed238c09d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:26.898195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d9efd-b7a3-4f28-b811-90aed238c09d admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:26.899715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d9efd-b7a3-4f28-b811-90aed238c09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:26.902092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d9efd-b7a3-4f28-b811-90aed238c09d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:26.918404 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3040/6134] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:23:26.922384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f2849-8bd6-4a1d-9e8b-1b8d04d67f4f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:26.933511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f2849-8bd6-4a1d-9e8b-1b8d04d67f4f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:26.939666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed177cd-8bba-4ab7-813b-d014abce99fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:26.940361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed177cd-8bba-4ab7-813b-d014abce99fd admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:26.940876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed177cd-8bba-4ab7-813b-d014abce99fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:26.941157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed177cd-8bba-4ab7-813b-d014abce99fd admin admin] PATH_INFO: `/v3/projects/16545b352e5949c8b1b79e7ec54c359f/users/60dc563f96ef4421b61ad5645e0e5476/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:26.958109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed177cd-8bba-4ab7-813b-d014abce99fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=16545b352e5949c8b1b79e7ec54c359f, user_id=60dc563f96ef4421b61ad5645e0e5476, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:26.961264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed177cd-8bba-4ab7-813b-d014abce99fd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:26.976756 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3095/6135] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:23:26 2022] PUT /identity/v3/projects/16545b352e5949c8b1b79e7ec54c359f/users/60dc563f96ef4421b61ad5645e0e5476/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:23:26.989575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e13fcb-4f7a-4d30-9faf-093310dfca54 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:26.989874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e13fcb-4f7a-4d30-9faf-093310dfca54 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:26.990156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e13fcb-4f7a-4d30-9faf-093310dfca54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:27.034815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-51e13fcb-4f7a-4d30-9faf-093310dfca54 None None] MFA Rules not processed for user `60dc563f96ef4421b61ad5645e0e5476`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:23:27.036015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-51e13fcb-4f7a-4d30-9faf-093310dfca54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:27.141820 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3041/6136] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:23:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:23:27.202521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed177cd-8bba-4ab7-813b-d014abce99fd admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:27.205350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6ed177cd-8bba-4ab7-813b-d014abce99fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:27.302171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed177cd-8bba-4ab7-813b-d014abce99fd admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:27.320163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56465af-7de1-44cf-a1c4-97e3e6170916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:27.320936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56465af-7de1-44cf-a1c4-97e3e6170916 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:27.322167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56465af-7de1-44cf-a1c4-97e3e6170916 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:27.322573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56465af-7de1-44cf-a1c4-97e3e6170916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:27.337586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56465af-7de1-44cf-a1c4-97e3e6170916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:27.339567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56465af-7de1-44cf-a1c4-97e3e6170916 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:27.358692 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3096/6137] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:23:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:23:29.686517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e13fcb-4f7a-4d30-9faf-093310dfca54 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:29.688553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-51e13fcb-4f7a-4d30-9faf-093310dfca54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:29.694380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:29.797006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e13fcb-4f7a-4d30-9faf-093310dfca54 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:29.801930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fabdb5-264b-4ce3-beba-f056e581858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:29.802959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fabdb5-264b-4ce3-beba-f056e581858e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:29.803155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fabdb5-264b-4ce3-beba-f056e581858e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:29.803600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fabdb5-264b-4ce3-beba-f056e581858e admin admin] PATH_INFO: `/v3/users/7369e2a4c5b24e85b94816e6404b300f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:29.804996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fabdb5-264b-4ce3-beba-f056e581858e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7369e2a4c5b24e85b94816e6404b300f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:29.807758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fabdb5-264b-4ce3-beba-f056e581858e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:29.870908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9fabdb5-264b-4ce3-beba-f056e581858e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7369e2a4c5b24e85b94816e6404b300f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:29.871748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9fabdb5-264b-4ce3-beba-f056e581858e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7369e2a4c5b24e85b94816e6404b300f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:29.907947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9fabdb5-264b-4ce3-beba-f056e581858e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7369e2a4c5b24e85b94816e6404b300f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:29.909839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9fabdb5-264b-4ce3-beba-f056e581858e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7369e2a4c5b24e85b94816e6404b300f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:29.927872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f9fabdb5-264b-4ce3-beba-f056e581858e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7369e2a4c5b24e85b94816e6404b300f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:29.944864 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3042/6138] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:23:29 2022] DELETE /identity/v3/users/7369e2a4c5b24e85b94816e6404b300f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:23:30.834529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56465af-7de1-44cf-a1c4-97e3e6170916 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:30.854066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56465af-7de1-44cf-a1c4-97e3e6170916 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:30.868380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:31.012913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f7d67-1bdc-406f-97a5-f72614e4e4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:31.013636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f7d67-1bdc-406f-97a5-f72614e4e4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:31.013924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f7d67-1bdc-406f-97a5-f72614e4e4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:31.014203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f7d67-1bdc-406f-97a5-f72614e4e4e8 admin admin] PATH_INFO: `/v3/projects/8696e08b027f4d259759dff57403f900` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:31.022145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f7d67-1bdc-406f-97a5-f72614e4e4e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8696e08b027f4d259759dff57403f900)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:31.024133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f7d67-1bdc-406f-97a5-f72614e4e4e8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:31.116313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-154f7d67-1bdc-406f-97a5-f72614e4e4e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8696e08b027f4d259759dff57403f900', 'request_id': 'req-154f7d67-1bdc-406f-97a5-f72614e4e4e8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:31.131732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-154f7d67-1bdc-406f-97a5-f72614e4e4e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8696e08b027f4d259759dff57403f900', 'request_id': 'req-154f7d67-1bdc-406f-97a5-f72614e4e4e8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:31.160752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-154f7d67-1bdc-406f-97a5-f72614e4e4e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8696e08b027f4d259759dff57403f900', 'request_id': 'req-154f7d67-1bdc-406f-97a5-f72614e4e4e8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:31.180237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-154f7d67-1bdc-406f-97a5-f72614e4e4e8 admin admin] The token cache is being invalidate because project 8696e08b027f4d259759dff57403f900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:23:31.182761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-154f7d67-1bdc-406f-97a5-f72614e4e4e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:31.183935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-154f7d67-1bdc-406f-97a5-f72614e4e4e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:31.190752 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3097/6139] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:23:30 2022] DELETE /identity/v3/projects/8696e08b027f4d259759dff57403f900 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:23:31.190959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fabdb5-264b-4ce3-beba-f056e581858e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:31.193054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f9fabdb5-264b-4ce3-beba-f056e581858e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:31.209215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fabdb5-264b-4ce3-beba-f056e581858e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:31.313358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdadf30-a597-48a6-8a21-16d32b5ebcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:31.314781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdadf30-a597-48a6-8a21-16d32b5ebcbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:31.315620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdadf30-a597-48a6-8a21-16d32b5ebcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:31.316260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdadf30-a597-48a6-8a21-16d32b5ebcbb admin admin] PATH_INFO: `/v3/users/9ee43250738b4dcc91b2e09e0c060cb0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:31.318714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdadf30-a597-48a6-8a21-16d32b5ebcbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ee43250738b4dcc91b2e09e0c060cb0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:31.321759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdadf30-a597-48a6-8a21-16d32b5ebcbb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:31.360451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:31.416430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6fdadf30-a597-48a6-8a21-16d32b5ebcbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ee43250738b4dcc91b2e09e0c060cb0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:31.417982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6fdadf30-a597-48a6-8a21-16d32b5ebcbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ee43250738b4dcc91b2e09e0c060cb0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:31.453830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6fdadf30-a597-48a6-8a21-16d32b5ebcbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ee43250738b4dcc91b2e09e0c060cb0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:31.454794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6fdadf30-a597-48a6-8a21-16d32b5ebcbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ee43250738b4dcc91b2e09e0c060cb0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:31.478716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6fdadf30-a597-48a6-8a21-16d32b5ebcbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ee43250738b4dcc91b2e09e0c060cb0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:31.504754 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3043/6140] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:23:31 2022] DELETE /identity/v3/users/9ee43250738b4dcc91b2e09e0c060cb0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:23:32.819024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f7d67-1bdc-406f-97a5-f72614e4e4e8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:32.825378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-154f7d67-1bdc-406f-97a5-f72614e4e4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:32.866568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f7d67-1bdc-406f-97a5-f72614e4e4e8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:33.068611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d9f43-5b4e-4d7e-bc76-851c914ddd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:33.069327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d9f43-5b4e-4d7e-bc76-851c914ddd17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:33.069618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d9f43-5b4e-4d7e-bc76-851c914ddd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:33.069920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d9f43-5b4e-4d7e-bc76-851c914ddd17 admin admin] PATH_INFO: `/v3/projects/d330455f767649039170509c8e3ad25d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:33.071234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d9f43-5b4e-4d7e-bc76-851c914ddd17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d330455f767649039170509c8e3ad25d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:33.073696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d9f43-5b4e-4d7e-bc76-851c914ddd17 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:33.175791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:33.193159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-944d9f43-5b4e-4d7e-bc76-851c914ddd17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd330455f767649039170509c8e3ad25d', 'request_id': 'req-944d9f43-5b4e-4d7e-bc76-851c914ddd17'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:33.208359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-944d9f43-5b4e-4d7e-bc76-851c914ddd17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd330455f767649039170509c8e3ad25d', 'request_id': 'req-944d9f43-5b4e-4d7e-bc76-851c914ddd17'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:33.224134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-944d9f43-5b4e-4d7e-bc76-851c914ddd17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd330455f767649039170509c8e3ad25d', 'request_id': 'req-944d9f43-5b4e-4d7e-bc76-851c914ddd17'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:33.261943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-944d9f43-5b4e-4d7e-bc76-851c914ddd17 admin admin] The token cache is being invalidate because project d330455f767649039170509c8e3ad25d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:23:33.266494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-944d9f43-5b4e-4d7e-bc76-851c914ddd17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:33.271699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-944d9f43-5b4e-4d7e-bc76-851c914ddd17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:23:33.274469 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3098/6141] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:23:32 2022] DELETE /identity/v3/projects/d330455f767649039170509c8e3ad25d => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:23:33.280611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815d7b6-b413-4129-81ca-5423ef11dcb3 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:33.281254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815d7b6-b413-4129-81ca-5423ef11dcb3 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:33.281254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815d7b6-b413-4129-81ca-5423ef11dcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:33.319988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b815d7b6-b413-4129-81ca-5423ef11dcb3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:23:33.324889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b815d7b6-b413-4129-81ca-5423ef11dcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:33.484126 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3044/6142] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:23:33.485491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a0d5a-16e9-4fde-b384-28132515e33c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:33.485864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a0d5a-16e9-4fde-b384-28132515e33c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:33.486490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a0d5a-16e9-4fde-b384-28132515e33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:33.509391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-610a0d5a-16e9-4fde-b384-28132515e33c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:23:33.511950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-610a0d5a-16e9-4fde-b384-28132515e33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:33.523521 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3099/6143] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:23:33.529591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815d7b6-b413-4129-81ca-5423ef11dcb3 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:33.547931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815d7b6-b413-4129-81ca-5423ef11dcb3 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:33.565155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a423de7-4463-4419-bf4f-1a8365b7606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:33.566173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a423de7-4463-4419-bf4f-1a8365b7606d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:33.566173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a423de7-4463-4419-bf4f-1a8365b7606d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:33.566807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a423de7-4463-4419-bf4f-1a8365b7606d admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:33.567846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a423de7-4463-4419-bf4f-1a8365b7606d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:23:33.569427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a423de7-4463-4419-bf4f-1a8365b7606d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:33.577872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a423de7-4463-4419-bf4f-1a8365b7606d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:33.606495 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3045/6144] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:23:33.611133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a0d5a-16e9-4fde-b384-28132515e33c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:33.626199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a0d5a-16e9-4fde-b384-28132515e33c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:33.637218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681867c-21a2-4fab-9ebc-dfc7bcecbd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:33.637871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681867c-21a2-4fab-9ebc-dfc7bcecbd26 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:33.638163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681867c-21a2-4fab-9ebc-dfc7bcecbd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:33.638446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681867c-21a2-4fab-9ebc-dfc7bcecbd26 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:33.639130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681867c-21a2-4fab-9ebc-dfc7bcecbd26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:33.647925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681867c-21a2-4fab-9ebc-dfc7bcecbd26 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:33.725839 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3100/6145] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:23:33 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:23:33.731522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a423de7-4463-4419-bf4f-1a8365b7606d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:33.767194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a423de7-4463-4419-bf4f-1a8365b7606d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:33.996092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166cafd-9e17-4aa0-a393-f2b1b1487e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:33.997111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166cafd-9e17-4aa0-a393-f2b1b1487e38 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:33.997414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166cafd-9e17-4aa0-a393-f2b1b1487e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:33.998900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166cafd-9e17-4aa0-a393-f2b1b1487e38 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:34.002424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166cafd-9e17-4aa0-a393-f2b1b1487e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:34.009260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166cafd-9e17-4aa0-a393-f2b1b1487e38 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:34.068147 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3046/6146] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:23:33 2022] POST /identity/v3/users => generated 291 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:23:34.070523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681867c-21a2-4fab-9ebc-dfc7bcecbd26 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:34.086167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681867c-21a2-4fab-9ebc-dfc7bcecbd26 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:34.105851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029dc913-2c97-46a2-b18d-59725b22c82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:34.106830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dc913-2c97-46a2-b18d-59725b22c82b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:34.107117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dc913-2c97-46a2-b18d-59725b22c82b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:34.107663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dc913-2c97-46a2-b18d-59725b22c82b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:34.108648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029dc913-2c97-46a2-b18d-59725b22c82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:34.110714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029dc913-2c97-46a2-b18d-59725b22c82b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:34.139017 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3101/6147] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:23:34.143926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166cafd-9e17-4aa0-a393-f2b1b1487e38 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:34.163788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166cafd-9e17-4aa0-a393-f2b1b1487e38 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:34.184254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383020e-ae07-4916-938d-461029e493e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:34.184920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383020e-ae07-4916-938d-461029e493e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:34.185214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383020e-ae07-4916-938d-461029e493e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:34.186292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383020e-ae07-4916-938d-461029e493e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:34.186292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383020e-ae07-4916-938d-461029e493e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:34.187914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383020e-ae07-4916-938d-461029e493e8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:34.207727 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3047/6148] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:23:34.213051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029dc913-2c97-46a2-b18d-59725b22c82b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:34.257876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029dc913-2c97-46a2-b18d-59725b22c82b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:34.267933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962f8fb-044a-4c52-8e02-75398c5458ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:34.269242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962f8fb-044a-4c52-8e02-75398c5458ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:34.269757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962f8fb-044a-4c52-8e02-75398c5458ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:34.270261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962f8fb-044a-4c52-8e02-75398c5458ce admin admin] PATH_INFO: `/v3/projects/b87e9ef5272f4aac99f5fe95ca96219a/users/424bc1ec391d4b92beb35305d5060f42/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:34.319073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962f8fb-044a-4c52-8e02-75398c5458ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87e9ef5272f4aac99f5fe95ca96219a, user_id=424bc1ec391d4b92beb35305d5060f42, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:34.327857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962f8fb-044a-4c52-8e02-75398c5458ce admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:34.379077 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3102/6149] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:23:34 2022] PUT /identity/v3/projects/b87e9ef5272f4aac99f5fe95ca96219a/users/424bc1ec391d4b92beb35305d5060f42/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:23:34.384341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a04ee-dbea-438b-b550-981a7bb679d2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:34.384924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a04ee-dbea-438b-b550-981a7bb679d2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:34.384924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a04ee-dbea-438b-b550-981a7bb679d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:34.422182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:34.438498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4c3a04ee-dbea-438b-b550-981a7bb679d2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:23:34.439810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4c3a04ee-dbea-438b-b550-981a7bb679d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:34.554084 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3048/6150] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:23:34.632643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962f8fb-044a-4c52-8e02-75398c5458ce admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:34.634658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9962f8fb-044a-4c52-8e02-75398c5458ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:34.801309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962f8fb-044a-4c52-8e02-75398c5458ce admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:34.811711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a0a32-66ce-4910-86de-7cf8170d562b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:34.812971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a0a32-66ce-4910-86de-7cf8170d562b service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:34.813270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a0a32-66ce-4910-86de-7cf8170d562b service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:34.813549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a0a32-66ce-4910-86de-7cf8170d562b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:34.826475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a0a32-66ce-4910-86de-7cf8170d562b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:34.828136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a0a32-66ce-4910-86de-7cf8170d562b service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:34.839858 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3103/6151] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:23:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:23:44.542651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=24 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:44.834003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=63,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:53.726399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce86643-48bf-47c9-84d5-02b9e58b34a7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:53.727198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce86643-48bf-47c9-84d5-02b9e58b34a7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:53.727658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce86643-48bf-47c9-84d5-02b9e58b34a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:53.805587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-cce86643-48bf-47c9-84d5-02b9e58b34a7 None None] MFA Rules not processed for user `424bc1ec391d4b92beb35305d5060f42`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:23:53.806877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cce86643-48bf-47c9-84d5-02b9e58b34a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:53.970514 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3049/6152] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:23:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:23:53.972597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaa284-5c6d-48f6-9763-f8cce58e9c32 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:53.973083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaa284-5c6d-48f6-9763-f8cce58e9c32 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:53.973281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaa284-5c6d-48f6-9763-f8cce58e9c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:54.023131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2bbaa284-5c6d-48f6-9763-f8cce58e9c32 None None] MFA Rules not processed for user `424bc1ec391d4b92beb35305d5060f42`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:23:54.024364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2bbaa284-5c6d-48f6-9763-f8cce58e9c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:54.050361 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3104/6153] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:23:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:23:54.063454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce86643-48bf-47c9-84d5-02b9e58b34a7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:23:54.068893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cce86643-48bf-47c9-84d5-02b9e58b34a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:23:54.217119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce86643-48bf-47c9-84d5-02b9e58b34a7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:23:54.224763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef18c4f-3eab-4740-b845-944dc0cf1989 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:23:54.226277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef18c4f-3eab-4740-b845-944dc0cf1989 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:23:54.226661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef18c4f-3eab-4740-b845-944dc0cf1989 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:23:54.227003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef18c4f-3eab-4740-b845-944dc0cf1989 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:23:54.240152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef18c4f-3eab-4740-b845-944dc0cf1989 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:23:54.242728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef18c4f-3eab-4740-b845-944dc0cf1989 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:23:54.261510 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3050/6154] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:23:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:24:03.999508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:04.253721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=66 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:22.854049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11902e8-9068-404f-922c-35602660bda9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:24:22.855004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11902e8-9068-404f-922c-35602660bda9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:24:22.855604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11902e8-9068-404f-922c-35602660bda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:24:22.945592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c11902e8-9068-404f-922c-35602660bda9 None None] MFA Rules not processed for user `c025e35fd22a4895a5d0301c1d5b0e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:24:22.956148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c11902e8-9068-404f-922c-35602660bda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:24:23.163653 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3105/6155] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:24:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:24:33.136786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=25 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:43.087096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1770a-cbfa-4de1-88b7-972ea02af81a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:24:43.087784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1770a-cbfa-4de1-88b7-972ea02af81a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:24:43.087784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1770a-cbfa-4de1-88b7-972ea02af81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:24:43.130329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-13a1770a-cbfa-4de1-88b7-972ea02af81a None None] MFA Rules not processed for user `6896ccb6369541d5a552f3373f39c64d`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:24:43.133323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-13a1770a-cbfa-4de1-88b7-972ea02af81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:24:43.251572 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3051/6156] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:24:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:24:44.151102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11902e8-9068-404f-922c-35602660bda9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:24:44.167052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11902e8-9068-404f-922c-35602660bda9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:24:44.184600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e93301-182f-4d16-9f76-2dd88e14ef60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:24:44.186280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e93301-182f-4d16-9f76-2dd88e14ef60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:24:44.187796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e93301-182f-4d16-9f76-2dd88e14ef60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:24:44.188103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e93301-182f-4d16-9f76-2dd88e14ef60 admin admin] PATH_INFO: `/v3/users/424bc1ec391d4b92beb35305d5060f42` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:24:44.189552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e93301-182f-4d16-9f76-2dd88e14ef60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=424bc1ec391d4b92beb35305d5060f42)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:24:44.203725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e93301-182f-4d16-9f76-2dd88e14ef60 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:24:44.306276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f8e93301-182f-4d16-9f76-2dd88e14ef60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '424bc1ec391d4b92beb35305d5060f42'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:24:44.323851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f8e93301-182f-4d16-9f76-2dd88e14ef60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '424bc1ec391d4b92beb35305d5060f42'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:24:44.324994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f8e93301-182f-4d16-9f76-2dd88e14ef60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '424bc1ec391d4b92beb35305d5060f42'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:24:44.334411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f8e93301-182f-4d16-9f76-2dd88e14ef60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '424bc1ec391d4b92beb35305d5060f42'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:24:44.335635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f8e93301-182f-4d16-9f76-2dd88e14ef60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '424bc1ec391d4b92beb35305d5060f42'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:24:44.359533 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3106/6157] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:24:44 2022] DELETE /identity/v3/users/424bc1ec391d4b92beb35305d5060f42 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:24:44.911688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1770a-cbfa-4de1-88b7-972ea02af81a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:24:44.943126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1770a-cbfa-4de1-88b7-972ea02af81a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:24:45.079777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d72659-9e46-49c4-abec-716ea2f46de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:24:45.081336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d72659-9e46-49c4-abec-716ea2f46de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:24:45.081837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d72659-9e46-49c4-abec-716ea2f46de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:24:45.082341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d72659-9e46-49c4-abec-716ea2f46de3 admin admin] PATH_INFO: `/v3/projects/b87e9ef5272f4aac99f5fe95ca96219a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:24:45.084450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d72659-9e46-49c4-abec-716ea2f46de3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b87e9ef5272f4aac99f5fe95ca96219a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:24:45.087956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d72659-9e46-49c4-abec-716ea2f46de3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:24:45.185576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-36d72659-9e46-49c4-abec-716ea2f46de3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b87e9ef5272f4aac99f5fe95ca96219a', 'request_id': 'req-36d72659-9e46-49c4-abec-716ea2f46de3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:24:45.206691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-36d72659-9e46-49c4-abec-716ea2f46de3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b87e9ef5272f4aac99f5fe95ca96219a', 'request_id': 'req-36d72659-9e46-49c4-abec-716ea2f46de3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:24:45.216945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-36d72659-9e46-49c4-abec-716ea2f46de3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b87e9ef5272f4aac99f5fe95ca96219a', 'request_id': 'req-36d72659-9e46-49c4-abec-716ea2f46de3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:24:45.235084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-36d72659-9e46-49c4-abec-716ea2f46de3 admin admin] The token cache is being invalidate because project b87e9ef5272f4aac99f5fe95ca96219a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:24:45.235935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-36d72659-9e46-49c4-abec-716ea2f46de3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:24:45.237011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-36d72659-9e46-49c4-abec-716ea2f46de3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:24:45.244468 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3052/6158] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:24:44 2022] DELETE /identity/v3/projects/b87e9ef5272f4aac99f5fe95ca96219a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:24:45.250039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3e196-ece2-4e3d-92e4-6dad8bf49b40 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:24:45.250681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3e196-ece2-4e3d-92e4-6dad8bf49b40 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:24:45.251642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3e196-ece2-4e3d-92e4-6dad8bf49b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:24:45.305552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-fef3e196-ece2-4e3d-92e4-6dad8bf49b40 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:24:45.307153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fef3e196-ece2-4e3d-92e4-6dad8bf49b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:24:45.455481 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3107/6159] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:24:45.462316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53247d75-d920-4c84-83ea-659c9d269adf None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:24:45.462726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53247d75-d920-4c84-83ea-659c9d269adf None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:24:45.463280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53247d75-d920-4c84-83ea-659c9d269adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:24:45.496825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-53247d75-d920-4c84-83ea-659c9d269adf None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:24:45.499084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-53247d75-d920-4c84-83ea-659c9d269adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:24:45.520906 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3053/6160] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:24:45.521609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3e196-ece2-4e3d-92e4-6dad8bf49b40 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:24:45.536337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3e196-ece2-4e3d-92e4-6dad8bf49b40 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:24:45.547965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b1b38-21f9-4f26-906b-62480b882832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:24:45.548609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b1b38-21f9-4f26-906b-62480b882832 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:24:45.549107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b1b38-21f9-4f26-906b-62480b882832 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:24:45.549551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b1b38-21f9-4f26-906b-62480b882832 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:24:45.550448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b1b38-21f9-4f26-906b-62480b882832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:24:45.550946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b1b38-21f9-4f26-906b-62480b882832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:24:45.552775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b1b38-21f9-4f26-906b-62480b882832 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:24:45.582727 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3108/6161] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:24:45.589608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53247d75-d920-4c84-83ea-659c9d269adf None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:24:45.609875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53247d75-d920-4c84-83ea-659c9d269adf None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:24:45.644531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca84ad-1ab9-4927-8798-48ffefc0a7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:24:45.645601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca84ad-1ab9-4927-8798-48ffefc0a7ed admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:24:45.649384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca84ad-1ab9-4927-8798-48ffefc0a7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:24:45.649798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca84ad-1ab9-4927-8798-48ffefc0a7ed admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:24:45.650756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca84ad-1ab9-4927-8798-48ffefc0a7ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:24:45.654253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca84ad-1ab9-4927-8798-48ffefc0a7ed admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:24:45.769507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b1b38-21f9-4f26-906b-62480b882832 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:24:45.772732 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3054/6162] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:24:45 2022] POST /identity/v3/projects => generated 387 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:24:45.787654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b1b38-21f9-4f26-906b-62480b882832 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:24:45.909519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c66278-487b-4eea-b80d-f46701062e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:24:45.910672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c66278-487b-4eea-b80d-f46701062e6e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:24:45.910672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c66278-487b-4eea-b80d-f46701062e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:24:45.910900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c66278-487b-4eea-b80d-f46701062e6e admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:24:45.914114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c66278-487b-4eea-b80d-f46701062e6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:24:45.920759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c66278-487b-4eea-b80d-f46701062e6e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:24:45.940904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:45.975048 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3109/6163] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:24:45 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:24:45.979244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca84ad-1ab9-4927-8798-48ffefc0a7ed admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:24:45.994821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca84ad-1ab9-4927-8798-48ffefc0a7ed admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:24:46.013904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c3090-303c-47ea-85a7-bcb1f52d051a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:24:46.015466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c3090-303c-47ea-85a7-bcb1f52d051a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:24:46.015574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c3090-303c-47ea-85a7-bcb1f52d051a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:24:46.015853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c3090-303c-47ea-85a7-bcb1f52d051a admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:24:46.016569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c3090-303c-47ea-85a7-bcb1f52d051a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:24:46.018514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c3090-303c-47ea-85a7-bcb1f52d051a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:24:46.020081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:46.068919 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3055/6164] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:24:46.073544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c66278-487b-4eea-b80d-f46701062e6e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:24:46.088087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c66278-487b-4eea-b80d-f46701062e6e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:24:46.100193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6c5ef-c10e-4a66-a4b4-e806651768f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:24:46.101007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6c5ef-c10e-4a66-a4b4-e806651768f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:24:46.101412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6c5ef-c10e-4a66-a4b4-e806651768f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:24:46.101833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6c5ef-c10e-4a66-a4b4-e806651768f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:24:46.102624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6c5ef-c10e-4a66-a4b4-e806651768f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:24:46.104609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6c5ef-c10e-4a66-a4b4-e806651768f2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:24:46.129614 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3110/6165] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:24:46.134554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c3090-303c-47ea-85a7-bcb1f52d051a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:24:46.183631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c3090-303c-47ea-85a7-bcb1f52d051a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:24:46.207856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302ed2f-f8b8-4d47-b2fd-e7aa28149616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:24:46.209935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302ed2f-f8b8-4d47-b2fd-e7aa28149616 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:24:46.210884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302ed2f-f8b8-4d47-b2fd-e7aa28149616 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:24:46.211182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302ed2f-f8b8-4d47-b2fd-e7aa28149616 admin admin] PATH_INFO: `/v3/projects/ce4d73e8180d4d08b9f5698ae767d325/users/1284634867a44f298cfc85cce91c5f58/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:24:46.267614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302ed2f-f8b8-4d47-b2fd-e7aa28149616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4d73e8180d4d08b9f5698ae767d325, user_id=1284634867a44f298cfc85cce91c5f58, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:24:46.282010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302ed2f-f8b8-4d47-b2fd-e7aa28149616 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:24:46.319096 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3056/6166] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:24:46 2022] PUT /identity/v3/projects/ce4d73e8180d4d08b9f5698ae767d325/users/1284634867a44f298cfc85cce91c5f58/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:24:46.337585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8532b-b3be-49f7-aede-3cd75a67c098 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:24:46.338119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8532b-b3be-49f7-aede-3cd75a67c098 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:24:46.338207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8532b-b3be-49f7-aede-3cd75a67c098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:24:46.394080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d4d8532b-b3be-49f7-aede-3cd75a67c098 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:24:46.399026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d4d8532b-b3be-49f7-aede-3cd75a67c098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:24:46.546802 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3111/6167] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:24:46.596440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302ed2f-f8b8-4d47-b2fd-e7aa28149616 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:24:46.605236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c302ed2f-f8b8-4d47-b2fd-e7aa28149616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:24:46.807603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302ed2f-f8b8-4d47-b2fd-e7aa28149616 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:24:46.816185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ff4b5-5e06-42c9-9f8f-51936f1fd6a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:24:46.817599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ff4b5-5e06-42c9-9f8f-51936f1fd6a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:24:46.818059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ff4b5-5e06-42c9-9f8f-51936f1fd6a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:24:46.818527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ff4b5-5e06-42c9-9f8f-51936f1fd6a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:24:46.841173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ff4b5-5e06-42c9-9f8f-51936f1fd6a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:24:46.857382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ff4b5-5e06-42c9-9f8f-51936f1fd6a3 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:24:46.882362 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3057/6168] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:24:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:24:48.890152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca536ee2-d1c8-4c43-b55d-ea90dca0aedb None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:24:48.891232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca536ee2-d1c8-4c43-b55d-ea90dca0aedb None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:24:48.891733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca536ee2-d1c8-4c43-b55d-ea90dca0aedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:24:48.956930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ca536ee2-d1c8-4c43-b55d-ea90dca0aedb None None] MFA Rules not processed for user `c025e35fd22a4895a5d0301c1d5b0e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:24:48.958221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ca536ee2-d1c8-4c43-b55d-ea90dca0aedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:24:49.096614 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3112/6169] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:24:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:24:50.244806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ff4b5-5e06-42c9-9f8f-51936f1fd6a3 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:24:50.279492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ff4b5-5e06-42c9-9f8f-51936f1fd6a3 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:24:50.290628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe1d31-a584-4cdb-b661-e4621d1709eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:24:50.291275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe1d31-a584-4cdb-b661-e4621d1709eb service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:24:50.291781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe1d31-a584-4cdb-b661-e4621d1709eb service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:24:50.293481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe1d31-a584-4cdb-b661-e4621d1709eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:24:50.295849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3ffe1d31-a584-4cdb-b661-e4621d1709eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:24:50.308665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe1d31-a584-4cdb-b661-e4621d1709eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:24:50.310391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe1d31-a584-4cdb-b661-e4621d1709eb service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:24:50.328847 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3058/6170] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:24:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:24:59.074618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=3,keystone:SELECT=63 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:00.326015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=46,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:07.276076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cc6cd-93b4-44aa-b76d-e5e92566a3be None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:07.276697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cc6cd-93b4-44aa-b76d-e5e92566a3be None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:07.276697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cc6cd-93b4-44aa-b76d-e5e92566a3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:07.332629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ac4cc6cd-93b4-44aa-b76d-e5e92566a3be None None] MFA Rules not processed for user `1284634867a44f298cfc85cce91c5f58`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:25:07.335907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ac4cc6cd-93b4-44aa-b76d-e5e92566a3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:07.574821 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3113/6171] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:25:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:25:07.575590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45002b-9920-4ae4-92f2-f3298ce0419e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:07.576082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45002b-9920-4ae4-92f2-f3298ce0419e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:07.576280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45002b-9920-4ae4-92f2-f3298ce0419e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:07.633723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6a45002b-9920-4ae4-92f2-f3298ce0419e None None] MFA Rules not processed for user `1284634867a44f298cfc85cce91c5f58`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:25:07.636389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6a45002b-9920-4ae4-92f2-f3298ce0419e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:07.647137 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3059/6172] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:25:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:25:07.658929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cc6cd-93b4-44aa-b76d-e5e92566a3be None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:07.660525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ac4cc6cd-93b4-44aa-b76d-e5e92566a3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:07.812724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cc6cd-93b4-44aa-b76d-e5e92566a3be None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:07.825512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43d4ce-692b-43eb-a88b-73101920304c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:07.826432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43d4ce-692b-43eb-a88b-73101920304c service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:07.826925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43d4ce-692b-43eb-a88b-73101920304c service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:07.827427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43d4ce-692b-43eb-a88b-73101920304c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:07.839503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43d4ce-692b-43eb-a88b-73101920304c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:07.842679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43d4ce-692b-43eb-a88b-73101920304c service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:07.859081 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3114/6173] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:25:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:25:17.611803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:17.861523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=82 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:26.654332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15000e-27ad-4e49-8042-9b5781b3975a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:26.655563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15000e-27ad-4e49-8042-9b5781b3975a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:26.656175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15000e-27ad-4e49-8042-9b5781b3975a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:26.699962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1d15000e-27ad-4e49-8042-9b5781b3975a None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:25:26.701553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1d15000e-27ad-4e49-8042-9b5781b3975a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:26.836737 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3060/6174] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:25:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:25:26.923098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43d4ce-692b-43eb-a88b-73101920304c service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:26.928546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8b43d4ce-692b-43eb-a88b-73101920304c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:27.063490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43d4ce-692b-43eb-a88b-73101920304c service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:27.077685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74064922-b00c-4119-b6f6-fa06517be9ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:27.078804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74064922-b00c-4119-b6f6-fa06517be9ac service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:27.079303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74064922-b00c-4119-b6f6-fa06517be9ac service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:27.079785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74064922-b00c-4119-b6f6-fa06517be9ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:27.093826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74064922-b00c-4119-b6f6-fa06517be9ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:27.095925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74064922-b00c-4119-b6f6-fa06517be9ac service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:27.111677 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3115/6175] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:25:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:25:33.267394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15000e-27ad-4e49-8042-9b5781b3975a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:33.270283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1d15000e-27ad-4e49-8042-9b5781b3975a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:33.365471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15000e-27ad-4e49-8042-9b5781b3975a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:33.383236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6c465-bd07-4545-93d7-5104a4c2e3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:33.388926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6c465-bd07-4545-93d7-5104a4c2e3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:33.392940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6c465-bd07-4545-93d7-5104a4c2e3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:33.393482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6c465-bd07-4545-93d7-5104a4c2e3cc admin admin] PATH_INFO: `/v3/users/ba0a1fec448d4372a76218d2309ca296` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:33.395109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6c465-bd07-4545-93d7-5104a4c2e3cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba0a1fec448d4372a76218d2309ca296)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:33.397879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6c465-bd07-4545-93d7-5104a4c2e3cc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:33.636307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e6b6c465-bd07-4545-93d7-5104a4c2e3cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba0a1fec448d4372a76218d2309ca296'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:33.639513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e6b6c465-bd07-4545-93d7-5104a4c2e3cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba0a1fec448d4372a76218d2309ca296'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:33.697456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e6b6c465-bd07-4545-93d7-5104a4c2e3cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba0a1fec448d4372a76218d2309ca296'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:33.698697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e6b6c465-bd07-4545-93d7-5104a4c2e3cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba0a1fec448d4372a76218d2309ca296'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:33.730323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e6b6c465-bd07-4545-93d7-5104a4c2e3cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba0a1fec448d4372a76218d2309ca296'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:33.781800 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3061/6176] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:25:33 2022] DELETE /identity/v3/users/ba0a1fec448d4372a76218d2309ca296 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:25:33.786532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105d1e1-1bed-4be2-865f-bba2eef194b7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:33.787155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105d1e1-1bed-4be2-865f-bba2eef194b7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:33.787155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105d1e1-1bed-4be2-865f-bba2eef194b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:33.871163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d105d1e1-1bed-4be2-865f-bba2eef194b7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:25:33.872778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d105d1e1-1bed-4be2-865f-bba2eef194b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:34.170184 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3116/6177] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:25:34.188291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6c465-bd07-4545-93d7-5104a4c2e3cc admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:34.190096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e6b6c465-bd07-4545-93d7-5104a4c2e3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:34.325746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:34.377252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6c465-bd07-4545-93d7-5104a4c2e3cc admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:34.382413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddee5f0-8c44-42e1-8e09-b09cd2482b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:34.383065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddee5f0-8c44-42e1-8e09-b09cd2482b91 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:34.383494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddee5f0-8c44-42e1-8e09-b09cd2482b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:34.383772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddee5f0-8c44-42e1-8e09-b09cd2482b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:34.403383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddee5f0-8c44-42e1-8e09-b09cd2482b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:34.404859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddee5f0-8c44-42e1-8e09-b09cd2482b91 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:34.445582 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3062/6178] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:25:36.357425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105d1e1-1bed-4be2-865f-bba2eef194b7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:36.360224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d105d1e1-1bed-4be2-865f-bba2eef194b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:36.408635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105d1e1-1bed-4be2-865f-bba2eef194b7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:36.416769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850832d3-72f5-4863-9b80-df0f18265d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:36.422252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850832d3-72f5-4863-9b80-df0f18265d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:36.423097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850832d3-72f5-4863-9b80-df0f18265d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:36.423511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850832d3-72f5-4863-9b80-df0f18265d45 admin admin] PATH_INFO: `/v3/projects/0f69a55f2c2c4c918666e6e778883b8e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:36.425702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850832d3-72f5-4863-9b80-df0f18265d45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f69a55f2c2c4c918666e6e778883b8e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:36.441980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850832d3-72f5-4863-9b80-df0f18265d45 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:36.571219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-850832d3-72f5-4863-9b80-df0f18265d45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f69a55f2c2c4c918666e6e778883b8e', 'request_id': 'req-850832d3-72f5-4863-9b80-df0f18265d45'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:36.581726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-850832d3-72f5-4863-9b80-df0f18265d45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f69a55f2c2c4c918666e6e778883b8e', 'request_id': 'req-850832d3-72f5-4863-9b80-df0f18265d45'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:36.606183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-850832d3-72f5-4863-9b80-df0f18265d45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f69a55f2c2c4c918666e6e778883b8e', 'request_id': 'req-850832d3-72f5-4863-9b80-df0f18265d45'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:36.625341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-850832d3-72f5-4863-9b80-df0f18265d45 admin admin] The token cache is being invalidate because project 0f69a55f2c2c4c918666e6e778883b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:25:36.625730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-850832d3-72f5-4863-9b80-df0f18265d45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:36.626599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-850832d3-72f5-4863-9b80-df0f18265d45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:36.632798 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3117/6179] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:25:36 2022] DELETE /identity/v3/projects/0f69a55f2c2c4c918666e6e778883b8e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:25:36.634292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc1afd-c1f5-47ac-91b2-2d4423182924 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:36.635265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc1afd-c1f5-47ac-91b2-2d4423182924 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:36.635766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc1afd-c1f5-47ac-91b2-2d4423182924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:36.738320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-acfc1afd-c1f5-47ac-91b2-2d4423182924 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:25:36.739743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-acfc1afd-c1f5-47ac-91b2-2d4423182924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:36.873180 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3063/6180] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:25:36.881252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd3c5f-491e-4885-9773-25a1ca674f94 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:36.881617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd3c5f-491e-4885-9773-25a1ca674f94 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:36.882025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd3c5f-491e-4885-9773-25a1ca674f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:36.922400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:36.930456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-afbd3c5f-491e-4885-9773-25a1ca674f94 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:25:36.942453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-afbd3c5f-491e-4885-9773-25a1ca674f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:36.957686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc1afd-c1f5-47ac-91b2-2d4423182924 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:36.961508 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3118/6181] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:25:36.977121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc1afd-c1f5-47ac-91b2-2d4423182924 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:36.998574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45e1f1-12b7-46df-aab1-f03d23c65f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:36.999849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45e1f1-12b7-46df-aab1-f03d23c65f0a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:37.000142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45e1f1-12b7-46df-aab1-f03d23c65f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:37.000424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45e1f1-12b7-46df-aab1-f03d23c65f0a admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:37.013329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45e1f1-12b7-46df-aab1-f03d23c65f0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:25:37.013329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45e1f1-12b7-46df-aab1-f03d23c65f0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:37.013329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45e1f1-12b7-46df-aab1-f03d23c65f0a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:37.061443 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3064/6182] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:25:37.070383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd3c5f-491e-4885-9773-25a1ca674f94 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:37.081047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd3c5f-491e-4885-9773-25a1ca674f94 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:37.097318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a2074-31c3-409a-9984-5893cbcf0cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:37.120930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a2074-31c3-409a-9984-5893cbcf0cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:37.123901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a2074-31c3-409a-9984-5893cbcf0cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:37.124611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a2074-31c3-409a-9984-5893cbcf0cf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:37.125755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a2074-31c3-409a-9984-5893cbcf0cf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:37.129222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a2074-31c3-409a-9984-5893cbcf0cf4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:37.247489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45e1f1-12b7-46df-aab1-f03d23c65f0a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:37.249143 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3119/6183] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:25:37 2022] POST /identity/v3/projects => generated 361 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:25:37.268472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45e1f1-12b7-46df-aab1-f03d23c65f0a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:37.474131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7ff3c-b984-46bf-a84b-a937181094ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:37.476377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7ff3c-b984-46bf-a84b-a937181094ff admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:37.485943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7ff3c-b984-46bf-a84b-a937181094ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:37.487015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7ff3c-b984-46bf-a84b-a937181094ff admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:37.488024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7ff3c-b984-46bf-a84b-a937181094ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:37.490356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7ff3c-b984-46bf-a84b-a937181094ff admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:37.537492 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3065/6184] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:25:37 2022] POST /identity/v3/users => generated 281 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:25:37.541616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a2074-31c3-409a-9984-5893cbcf0cf4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:37.555334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a2074-31c3-409a-9984-5893cbcf0cf4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:37.577758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c307d6-514f-4f5c-b290-8cf9b73ece4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:37.578964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c307d6-514f-4f5c-b290-8cf9b73ece4c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:37.579425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c307d6-514f-4f5c-b290-8cf9b73ece4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:37.579862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c307d6-514f-4f5c-b290-8cf9b73ece4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:37.580669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c307d6-514f-4f5c-b290-8cf9b73ece4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:37.582369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c307d6-514f-4f5c-b290-8cf9b73ece4c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:37.608255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7ff3c-b984-46bf-a84b-a937181094ff admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:37.611421 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3120/6185] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:25:37.632600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7ff3c-b984-46bf-a84b-a937181094ff admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:37.641917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629e5f2-ca28-432a-94d5-9724eca3a6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:37.645261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e5f2-ca28-432a-94d5-9724eca3a6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:37.647137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e5f2-ca28-432a-94d5-9724eca3a6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:37.647836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e5f2-ca28-432a-94d5-9724eca3a6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:37.649094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629e5f2-ca28-432a-94d5-9724eca3a6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:37.653381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629e5f2-ca28-432a-94d5-9724eca3a6d9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:37.696829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c307d6-514f-4f5c-b290-8cf9b73ece4c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:37.697067 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3066/6186] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:25:37.714365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c307d6-514f-4f5c-b290-8cf9b73ece4c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:37.742661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afcb20-d7f5-471b-b990-bcb31116da4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:37.743627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afcb20-d7f5-471b-b990-bcb31116da4e admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:37.744091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afcb20-d7f5-471b-b990-bcb31116da4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:37.744531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afcb20-d7f5-471b-b990-bcb31116da4e admin admin] PATH_INFO: `/v3/projects/11a4446efa9346d48f4021f8479015a3/users/6a168d02b2d1416190706cbce9635549/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:37.778525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afcb20-d7f5-471b-b990-bcb31116da4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a4446efa9346d48f4021f8479015a3, user_id=6a168d02b2d1416190706cbce9635549, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:37.781525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afcb20-d7f5-471b-b990-bcb31116da4e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:37.812208 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3121/6187] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:25:37 2022] PUT /identity/v3/projects/11a4446efa9346d48f4021f8479015a3/users/6a168d02b2d1416190706cbce9635549/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:25:37.824377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef624e-f857-466c-97fc-c5e10b47229c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:37.824668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef624e-f857-466c-97fc-c5e10b47229c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:37.824954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef624e-f857-466c-97fc-c5e10b47229c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:37.888446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-42ef624e-f857-466c-97fc-c5e10b47229c None None] MFA Rules not processed for user `6a168d02b2d1416190706cbce9635549`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:25:37.889963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-42ef624e-f857-466c-97fc-c5e10b47229c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:37.913603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:38.040944 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3067/6188] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:25:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:25:38.061857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afcb20-d7f5-471b-b990-bcb31116da4e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:38.063761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-88afcb20-d7f5-471b-b990-bcb31116da4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:38.203950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afcb20-d7f5-471b-b990-bcb31116da4e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:38.209883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a034b-0654-491b-a2f9-5725b241cba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:38.210530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a034b-0654-491b-a2f9-5725b241cba2 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:38.210813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a034b-0654-491b-a2f9-5725b241cba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:38.211086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a034b-0654-491b-a2f9-5725b241cba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:38.242133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a034b-0654-491b-a2f9-5725b241cba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:38.243931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a034b-0654-491b-a2f9-5725b241cba2 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:38.267046 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3122/6189] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:25:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:25:38.946867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef624e-f857-466c-97fc-c5e10b47229c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:38.948477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-42ef624e-f857-466c-97fc-c5e10b47229c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:38.976156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef624e-f857-466c-97fc-c5e10b47229c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:38.979778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e4c8a-363f-4407-8c24-9ff0efc67b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:38.980629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e4c8a-363f-4407-8c24-9ff0efc67b4c service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:38.981090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e4c8a-363f-4407-8c24-9ff0efc67b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:38.981539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e4c8a-363f-4407-8c24-9ff0efc67b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:38.992213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-388e4c8a-363f-4407-8c24-9ff0efc67b4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:39.154571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e4c8a-363f-4407-8c24-9ff0efc67b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:39.156351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e4c8a-363f-4407-8c24-9ff0efc67b4c service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:39.189381 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3068/6190] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:25:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:25:41.159150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a034b-0654-491b-a2f9-5725b241cba2 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:41.170070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a034b-0654-491b-a2f9-5725b241cba2 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:41.190350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d006ab8-ccd2-4171-9883-adacfb327b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:41.192097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d006ab8-ccd2-4171-9883-adacfb327b94 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:41.195951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d006ab8-ccd2-4171-9883-adacfb327b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:41.196245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d006ab8-ccd2-4171-9883-adacfb327b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:41.203269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7d006ab8-ccd2-4171-9883-adacfb327b94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:41.264650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d006ab8-ccd2-4171-9883-adacfb327b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:41.266137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d006ab8-ccd2-4171-9883-adacfb327b94 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:41.313690 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3123/6191] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:25:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:25:47.759572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e4c8a-363f-4407-8c24-9ff0efc67b4c service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:47.761318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-388e4c8a-363f-4407-8c24-9ff0efc67b4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:47.811804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e4c8a-363f-4407-8c24-9ff0efc67b4c service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:47.832195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775177e2-4158-4bc1-9499-e468710e21b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:47.834252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775177e2-4158-4bc1-9499-e468710e21b4 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:47.834543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775177e2-4158-4bc1-9499-e468710e21b4 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:47.834827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775177e2-4158-4bc1-9499-e468710e21b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:47.844573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-775177e2-4158-4bc1-9499-e468710e21b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:48.097416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775177e2-4158-4bc1-9499-e468710e21b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:48.110753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775177e2-4158-4bc1-9499-e468710e21b4 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:48.136072 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3069/6192] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:25:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:25:51.303007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=60,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:51.941260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d006ab8-ccd2-4171-9883-adacfb327b94 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:51.942861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7d006ab8-ccd2-4171-9883-adacfb327b94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:52.194445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d006ab8-ccd2-4171-9883-adacfb327b94 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:52.222446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c8ca4-3696-42e0-8d20-cbc93bf831bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:52.222446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c8ca4-3696-42e0-8d20-cbc93bf831bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:52.222446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c8ca4-3696-42e0-8d20-cbc93bf831bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:52.222446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c8ca4-3696-42e0-8d20-cbc93bf831bc admin admin] PATH_INFO: `/v3/users/1284634867a44f298cfc85cce91c5f58` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:52.223207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c8ca4-3696-42e0-8d20-cbc93bf831bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1284634867a44f298cfc85cce91c5f58)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:52.223207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c8ca4-3696-42e0-8d20-cbc93bf831bc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:52.346744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f37c8ca4-3696-42e0-8d20-cbc93bf831bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1284634867a44f298cfc85cce91c5f58'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:52.378184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f37c8ca4-3696-42e0-8d20-cbc93bf831bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1284634867a44f298cfc85cce91c5f58'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:52.380136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f37c8ca4-3696-42e0-8d20-cbc93bf831bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1284634867a44f298cfc85cce91c5f58'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:52.418832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f37c8ca4-3696-42e0-8d20-cbc93bf831bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1284634867a44f298cfc85cce91c5f58'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:52.421082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f37c8ca4-3696-42e0-8d20-cbc93bf831bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1284634867a44f298cfc85cce91c5f58'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:52.454055 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3124/6193] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:25:51 2022] DELETE /identity/v3/users/1284634867a44f298cfc85cce91c5f58 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:25:53.718607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775177e2-4158-4bc1-9499-e468710e21b4 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:53.734397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775177e2-4158-4bc1-9499-e468710e21b4 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:53.794588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:53.834059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd27607-fa4c-44c4-95bb-d7dac2f224c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:53.834776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27607-fa4c-44c4-95bb-d7dac2f224c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:53.835431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27607-fa4c-44c4-95bb-d7dac2f224c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:53.836528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27607-fa4c-44c4-95bb-d7dac2f224c1 admin admin] PATH_INFO: `/v3/projects/ce4d73e8180d4d08b9f5698ae767d325` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:53.838289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd27607-fa4c-44c4-95bb-d7dac2f224c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce4d73e8180d4d08b9f5698ae767d325)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:53.840515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd27607-fa4c-44c4-95bb-d7dac2f224c1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:53.914476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fcd27607-fa4c-44c4-95bb-d7dac2f224c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4d73e8180d4d08b9f5698ae767d325', 'request_id': 'req-fcd27607-fa4c-44c4-95bb-d7dac2f224c1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:53.926897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fcd27607-fa4c-44c4-95bb-d7dac2f224c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4d73e8180d4d08b9f5698ae767d325', 'request_id': 'req-fcd27607-fa4c-44c4-95bb-d7dac2f224c1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:53.938191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fcd27607-fa4c-44c4-95bb-d7dac2f224c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4d73e8180d4d08b9f5698ae767d325', 'request_id': 'req-fcd27607-fa4c-44c4-95bb-d7dac2f224c1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:53.956526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fcd27607-fa4c-44c4-95bb-d7dac2f224c1 admin admin] The token cache is being invalidate because project ce4d73e8180d4d08b9f5698ae767d325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:25:53.956880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fcd27607-fa4c-44c4-95bb-d7dac2f224c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:53.959219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fcd27607-fa4c-44c4-95bb-d7dac2f224c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:53.965926 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3070/6194] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:25:53 2022] DELETE /identity/v3/projects/ce4d73e8180d4d08b9f5698ae767d325 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:25:53.967451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb7152-5113-4ba9-87ec-036ac5331d3b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:53.967992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb7152-5113-4ba9-87ec-036ac5331d3b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:53.967992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb7152-5113-4ba9-87ec-036ac5331d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:54.030213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4cdb7152-5113-4ba9-87ec-036ac5331d3b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:25:54.044324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4cdb7152-5113-4ba9-87ec-036ac5331d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:54.184541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36a7bd-e27d-4e9b-b183-dacd960a072b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:54.186830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36a7bd-e27d-4e9b-b183-dacd960a072b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:54.188020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36a7bd-e27d-4e9b-b183-dacd960a072b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:54.198395 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3125/6195] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:25:54.275531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-af36a7bd-e27d-4e9b-b183-dacd960a072b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:25:54.279214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-af36a7bd-e27d-4e9b-b183-dacd960a072b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:54.304736 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3071/6196] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:25:54.305599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb7152-5113-4ba9-87ec-036ac5331d3b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:54.319723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb7152-5113-4ba9-87ec-036ac5331d3b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:54.328721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769d5ec-b914-42c5-9fb4-e64e0cf50674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:54.329671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769d5ec-b914-42c5-9fb4-e64e0cf50674 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:54.330503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769d5ec-b914-42c5-9fb4-e64e0cf50674 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:54.331153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769d5ec-b914-42c5-9fb4-e64e0cf50674 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:54.332122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769d5ec-b914-42c5-9fb4-e64e0cf50674 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:25:54.333300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769d5ec-b914-42c5-9fb4-e64e0cf50674 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:54.336389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769d5ec-b914-42c5-9fb4-e64e0cf50674 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:54.369774 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3126/6197] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:25:54.374256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36a7bd-e27d-4e9b-b183-dacd960a072b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:54.385938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36a7bd-e27d-4e9b-b183-dacd960a072b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:54.416197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d5307-0d4e-4840-92d2-8fd3c6aededc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:54.416859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d5307-0d4e-4840-92d2-8fd3c6aededc admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:54.417142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d5307-0d4e-4840-92d2-8fd3c6aededc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:54.417417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d5307-0d4e-4840-92d2-8fd3c6aededc admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:54.418100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d5307-0d4e-4840-92d2-8fd3c6aededc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:54.420760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d5307-0d4e-4840-92d2-8fd3c6aededc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:54.494954 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3072/6198] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:25:54 2022] POST /identity/v3/projects => generated 405 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:25:54.500685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769d5ec-b914-42c5-9fb4-e64e0cf50674 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:54.519786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769d5ec-b914-42c5-9fb4-e64e0cf50674 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:54.528198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:54.630769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d5307-0d4e-4840-92d2-8fd3c6aededc admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:54.632698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e39d5307-0d4e-4840-92d2-8fd3c6aededc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:54.675554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a229b-1e77-4742-88b1-89a6d29b1d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:54.679436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a229b-1e77-4742-88b1-89a6d29b1d15 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:54.680569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a229b-1e77-4742-88b1-89a6d29b1d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:54.681035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a229b-1e77-4742-88b1-89a6d29b1d15 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:54.682197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a229b-1e77-4742-88b1-89a6d29b1d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:54.684641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a229b-1e77-4742-88b1-89a6d29b1d15 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:54.753704 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3127/6199] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:25:54 2022] POST /identity/v3/users => generated 303 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:25:54.757220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a229b-1e77-4742-88b1-89a6d29b1d15 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:54.781757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a229b-1e77-4742-88b1-89a6d29b1d15 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:54.803501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b1b3c-c233-42c2-86ef-137793c9c836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:54.804158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b1b3c-c233-42c2-86ef-137793c9c836 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:54.804450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b1b3c-c233-42c2-86ef-137793c9c836 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:54.804730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b1b3c-c233-42c2-86ef-137793c9c836 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:54.805449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b1b3c-c233-42c2-86ef-137793c9c836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:54.807093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b1b3c-c233-42c2-86ef-137793c9c836 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:54.818560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d5307-0d4e-4840-92d2-8fd3c6aededc admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:54.822093 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3128/6200] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:25:54.826501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b1b3c-c233-42c2-86ef-137793c9c836 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:54.828576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30037beb-c7ee-4997-a083-6f47c0a06ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:54.829841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30037beb-c7ee-4997-a083-6f47c0a06ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:54.830436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30037beb-c7ee-4997-a083-6f47c0a06ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:54.831529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30037beb-c7ee-4997-a083-6f47c0a06ec8 admin admin] PATH_INFO: `/v3/users/a394a1c87bd54c63b6892615f144ac94` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:54.833600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30037beb-c7ee-4997-a083-6f47c0a06ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a394a1c87bd54c63b6892615f144ac94)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:54.838830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30037beb-c7ee-4997-a083-6f47c0a06ec8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:54.861272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b1b3c-c233-42c2-86ef-137793c9c836 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:54.879195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c49fe7-ec18-4bd2-a57f-02d83a19f442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:54.879917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c49fe7-ec18-4bd2-a57f-02d83a19f442 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:54.880334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c49fe7-ec18-4bd2-a57f-02d83a19f442 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:54.880521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c49fe7-ec18-4bd2-a57f-02d83a19f442 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:54.881174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c49fe7-ec18-4bd2-a57f-02d83a19f442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:54.884456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c49fe7-ec18-4bd2-a57f-02d83a19f442 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:54.907709 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3129/6201] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:25:54.917301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c49fe7-ec18-4bd2-a57f-02d83a19f442 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:54.929353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c49fe7-ec18-4bd2-a57f-02d83a19f442 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:54.935754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c293a-98c4-4dbd-ad9a-edbf36f01e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:54.936583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c293a-98c4-4dbd-ad9a-edbf36f01e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:54.936928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c293a-98c4-4dbd-ad9a-edbf36f01e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:54.937415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c293a-98c4-4dbd-ad9a-edbf36f01e92 admin admin] PATH_INFO: `/v3/projects/57f5d9b72de745f8a1371bbaa0230212/users/b0b7534856ad4817b1b15a2505a791dc/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:54.942860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:54.956805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c293a-98c4-4dbd-ad9a-edbf36f01e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f5d9b72de745f8a1371bbaa0230212, user_id=b0b7534856ad4817b1b15a2505a791dc, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:54.959846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c293a-98c4-4dbd-ad9a-edbf36f01e92 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:54.960015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-30037beb-c7ee-4997-a083-6f47c0a06ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a394a1c87bd54c63b6892615f144ac94'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:54.965642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-30037beb-c7ee-4997-a083-6f47c0a06ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a394a1c87bd54c63b6892615f144ac94'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:54.986205 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3130/6202] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:25:54 2022] PUT /identity/v3/projects/57f5d9b72de745f8a1371bbaa0230212/users/b0b7534856ad4817b1b15a2505a791dc/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:25:54.993738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c20c5-e773-409a-9b02-e496c424eb2b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:54.994608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c20c5-e773-409a-9b02-e496c424eb2b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:54.995279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c20c5-e773-409a-9b02-e496c424eb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:55.003341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-30037beb-c7ee-4997-a083-6f47c0a06ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a394a1c87bd54c63b6892615f144ac94'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:55.012942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-30037beb-c7ee-4997-a083-6f47c0a06ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a394a1c87bd54c63b6892615f144ac94'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:55.025615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-30037beb-c7ee-4997-a083-6f47c0a06ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a394a1c87bd54c63b6892615f144ac94'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:55.030905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-566c20c5-e773-409a-9b02-e496c424eb2b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:25:55.032423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-566c20c5-e773-409a-9b02-e496c424eb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:55.049910 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3073/6203] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:25:54 2022] DELETE /identity/v3/users/a394a1c87bd54c63b6892615f144ac94 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:25:55.052472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc4c23-597b-419d-b614-da7cec1d08fc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:55.053072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc4c23-597b-419d-b614-da7cec1d08fc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:55.054021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc4c23-597b-419d-b614-da7cec1d08fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:55.077446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1ddc4c23-597b-419d-b614-da7cec1d08fc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:25:55.079169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1ddc4c23-597b-419d-b614-da7cec1d08fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:55.127632 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3131/6204] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:25:55.134023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c20c5-e773-409a-9b02-e496c424eb2b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:55.135522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-566c20c5-e773-409a-9b02-e496c424eb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:55.155463 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3074/6205] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:25:55.162408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc4c23-597b-419d-b614-da7cec1d08fc None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:55.164039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1ddc4c23-597b-419d-b614-da7cec1d08fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:55.226039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c20c5-e773-409a-9b02-e496c424eb2b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:55.233538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:55.249614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc4c23-597b-419d-b614-da7cec1d08fc None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:55.256123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a1f59-db7b-440f-a5fc-d25a08f2b260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:55.256747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a1f59-db7b-440f-a5fc-d25a08f2b260 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:55.257138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a1f59-db7b-440f-a5fc-d25a08f2b260 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:55.257514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a1f59-db7b-440f-a5fc-d25a08f2b260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:55.272849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a1f59-db7b-440f-a5fc-d25a08f2b260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:55.275785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a1f59-db7b-440f-a5fc-d25a08f2b260 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:55.293855 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3075/6206] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:25:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:25:55.297931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c17c9-2fcf-4cc5-a2d6-e8305f0a9d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:55.298623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c17c9-2fcf-4cc5-a2d6-e8305f0a9d29 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:55.298916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c17c9-2fcf-4cc5-a2d6-e8305f0a9d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:55.299203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c17c9-2fcf-4cc5-a2d6-e8305f0a9d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:55.310598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c17c9-2fcf-4cc5-a2d6-e8305f0a9d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:55.312862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c17c9-2fcf-4cc5-a2d6-e8305f0a9d29 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:55.324321 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3132/6207] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:25:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:25:55.654871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a1f59-db7b-440f-a5fc-d25a08f2b260 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:55.656684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bf7a1f59-db7b-440f-a5fc-d25a08f2b260 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:55.681728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a1f59-db7b-440f-a5fc-d25a08f2b260 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:55.701053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a110145-62f4-4622-80cf-89cd0c984770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:55.702035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a110145-62f4-4622-80cf-89cd0c984770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:55.702035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a110145-62f4-4622-80cf-89cd0c984770 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:55.702435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a110145-62f4-4622-80cf-89cd0c984770 admin admin] PATH_INFO: `/v3/projects/3589473ceec1425693f28fa3684ba739` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:55.705293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a110145-62f4-4622-80cf-89cd0c984770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3589473ceec1425693f28fa3684ba739)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:55.710966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a110145-62f4-4622-80cf-89cd0c984770 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:55.870523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7a110145-62f4-4622-80cf-89cd0c984770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3589473ceec1425693f28fa3684ba739', 'request_id': 'req-7a110145-62f4-4622-80cf-89cd0c984770'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:55.875027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:55.885600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7a110145-62f4-4622-80cf-89cd0c984770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3589473ceec1425693f28fa3684ba739', 'request_id': 'req-7a110145-62f4-4622-80cf-89cd0c984770'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:55.905186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7a110145-62f4-4622-80cf-89cd0c984770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3589473ceec1425693f28fa3684ba739', 'request_id': 'req-7a110145-62f4-4622-80cf-89cd0c984770'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:55.923134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7a110145-62f4-4622-80cf-89cd0c984770 admin admin] The token cache is being invalidate because project 3589473ceec1425693f28fa3684ba739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:25:55.924060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7a110145-62f4-4622-80cf-89cd0c984770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:55.924957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7a110145-62f4-4622-80cf-89cd0c984770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:25:55.932118 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3076/6208] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:25:55 2022] DELETE /identity/v3/projects/3589473ceec1425693f28fa3684ba739 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:25:55.938873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cccb38-1bfd-400a-9148-a2dbf3f6da20 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:55.939655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cccb38-1bfd-400a-9148-a2dbf3f6da20 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:55.939960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cccb38-1bfd-400a-9148-a2dbf3f6da20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:55.987555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-84cccb38-1bfd-400a-9148-a2dbf3f6da20 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:25:55.989092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-84cccb38-1bfd-400a-9148-a2dbf3f6da20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:56.144413 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3133/6209] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:25:56.152188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f85d63-4cde-48a5-afa9-0b55b9663cfb None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:56.152465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f85d63-4cde-48a5-afa9-0b55b9663cfb None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:56.152747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f85d63-4cde-48a5-afa9-0b55b9663cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:56.218693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b5f85d63-4cde-48a5-afa9-0b55b9663cfb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:25:56.221936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b5f85d63-4cde-48a5-afa9-0b55b9663cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:56.248045 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3077/6210] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:25:56.251885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cccb38-1bfd-400a-9148-a2dbf3f6da20 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:56.266405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cccb38-1bfd-400a-9148-a2dbf3f6da20 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:56.290904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42eb45c-7ce9-46ed-a74c-1002dc9e0d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:56.291579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42eb45c-7ce9-46ed-a74c-1002dc9e0d5d admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:56.291868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42eb45c-7ce9-46ed-a74c-1002dc9e0d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:56.292175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42eb45c-7ce9-46ed-a74c-1002dc9e0d5d admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:56.293669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42eb45c-7ce9-46ed-a74c-1002dc9e0d5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:25:56.293983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42eb45c-7ce9-46ed-a74c-1002dc9e0d5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:56.295679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42eb45c-7ce9-46ed-a74c-1002dc9e0d5d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:56.328834 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3134/6211] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:25:56.330072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f85d63-4cde-48a5-afa9-0b55b9663cfb None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:56.343869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f85d63-4cde-48a5-afa9-0b55b9663cfb None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:56.350754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308b1d0-2346-488f-bbbe-2b1b3f6cbf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:56.351600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308b1d0-2346-488f-bbbe-2b1b3f6cbf1e admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:56.352013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308b1d0-2346-488f-bbbe-2b1b3f6cbf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:56.352432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308b1d0-2346-488f-bbbe-2b1b3f6cbf1e admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:56.354072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308b1d0-2346-488f-bbbe-2b1b3f6cbf1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:56.356445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308b1d0-2346-488f-bbbe-2b1b3f6cbf1e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:56.451697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42eb45c-7ce9-46ed-a74c-1002dc9e0d5d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:56.458427 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3078/6212] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:25:56 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:25:56.464227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42eb45c-7ce9-46ed-a74c-1002dc9e0d5d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:56.536634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ae352-9f3c-45b1-91f6-12c95eb7813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:56.537273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ae352-9f3c-45b1-91f6-12c95eb7813f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:56.537563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ae352-9f3c-45b1-91f6-12c95eb7813f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:56.537895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ae352-9f3c-45b1-91f6-12c95eb7813f admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:56.538823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ae352-9f3c-45b1-91f6-12c95eb7813f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:56.541855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ae352-9f3c-45b1-91f6-12c95eb7813f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:56.578864 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3135/6213] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:25:56 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:25:56.580315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308b1d0-2346-488f-bbbe-2b1b3f6cbf1e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:56.595281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308b1d0-2346-488f-bbbe-2b1b3f6cbf1e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:56.601696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec43eb-15e8-49c3-aaa4-0b474ec1f568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:56.602798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec43eb-15e8-49c3-aaa4-0b474ec1f568 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:56.602955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec43eb-15e8-49c3-aaa4-0b474ec1f568 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:56.603190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec43eb-15e8-49c3-aaa4-0b474ec1f568 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:56.603972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec43eb-15e8-49c3-aaa4-0b474ec1f568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:56.605988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec43eb-15e8-49c3-aaa4-0b474ec1f568 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:56.619340 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3079/6214] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:25:56.622339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ae352-9f3c-45b1-91f6-12c95eb7813f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:56.635231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ae352-9f3c-45b1-91f6-12c95eb7813f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:56.642131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f45f3-5c36-4cbc-9212-68c3f94ac1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:56.642971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f45f3-5c36-4cbc-9212-68c3f94ac1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:56.643258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f45f3-5c36-4cbc-9212-68c3f94ac1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:56.643626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f45f3-5c36-4cbc-9212-68c3f94ac1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:56.644326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f45f3-5c36-4cbc-9212-68c3f94ac1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:56.646602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f45f3-5c36-4cbc-9212-68c3f94ac1b1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:56.671333 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3136/6215] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:25:56.675013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec43eb-15e8-49c3-aaa4-0b474ec1f568 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:56.702807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec43eb-15e8-49c3-aaa4-0b474ec1f568 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:56.711663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28253610-f1c8-4ad2-9556-ab868e81a4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:56.712626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28253610-f1c8-4ad2-9556-ab868e81a4af admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:56.713095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28253610-f1c8-4ad2-9556-ab868e81a4af admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:56.713543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28253610-f1c8-4ad2-9556-ab868e81a4af admin admin] PATH_INFO: `/v3/projects/918cca16f8cf4c69906ba1a5b2ce5c59/users/34776492bc87429dab155c9102608137/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:56.736230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28253610-f1c8-4ad2-9556-ab868e81a4af admin admin] RBAC: Authorizing `identity:create_grant(project_id=918cca16f8cf4c69906ba1a5b2ce5c59, user_id=34776492bc87429dab155c9102608137, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:56.745639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28253610-f1c8-4ad2-9556-ab868e81a4af admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:56.769323 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3080/6216] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:25:56 2022] PUT /identity/v3/projects/918cca16f8cf4c69906ba1a5b2ce5c59/users/34776492bc87429dab155c9102608137/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:25:56.779553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fa32e-49aa-4050-94d2-4b8dcdf18c0e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:56.780565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fa32e-49aa-4050-94d2-4b8dcdf18c0e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:56.780862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fa32e-49aa-4050-94d2-4b8dcdf18c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:56.828114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-855fa32e-49aa-4050-94d2-4b8dcdf18c0e None None] MFA Rules not processed for user `34776492bc87429dab155c9102608137`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:25:56.829764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-855fa32e-49aa-4050-94d2-4b8dcdf18c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:56.860017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:57.069670 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3137/6217] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:25:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:25:57.103248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28253610-f1c8-4ad2-9556-ab868e81a4af admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:25:57.107436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-28253610-f1c8-4ad2-9556-ab868e81a4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:25:57.220371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28253610-f1c8-4ad2-9556-ab868e81a4af admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:25:57.233021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317202a4-0ec8-47d2-8ed6-cd7c0da45ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:25:57.233788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317202a4-0ec8-47d2-8ed6-cd7c0da45ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:25:57.234798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317202a4-0ec8-47d2-8ed6-cd7c0da45ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:25:57.234798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317202a4-0ec8-47d2-8ed6-cd7c0da45ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:25:57.248384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317202a4-0ec8-47d2-8ed6-cd7c0da45ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:25:57.250307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317202a4-0ec8-47d2-8ed6-cd7c0da45ce9 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:25:57.267113 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3081/6218] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:25:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:26:07.055584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=25 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:07.258325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=59,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:12.743221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855fa32e-49aa-4050-94d2-4b8dcdf18c0e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:12.744885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-855fa32e-49aa-4050-94d2-4b8dcdf18c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:12.781165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855fa32e-49aa-4050-94d2-4b8dcdf18c0e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:12.791648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66dc3d-5f18-4003-98b1-44cb2dd5c015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:12.792963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66dc3d-5f18-4003-98b1-44cb2dd5c015 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:12.793417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66dc3d-5f18-4003-98b1-44cb2dd5c015 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:12.793896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66dc3d-5f18-4003-98b1-44cb2dd5c015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:12.797393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4a66dc3d-5f18-4003-98b1-44cb2dd5c015 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:12.959222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66dc3d-5f18-4003-98b1-44cb2dd5c015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:12.962224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66dc3d-5f18-4003-98b1-44cb2dd5c015 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:12.982337 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3138/6219] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:26:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:26:13.221644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e761ef-6de5-45d3-814f-a82f8e18d40a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:13.222261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e761ef-6de5-45d3-814f-a82f8e18d40a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:13.222261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e761ef-6de5-45d3-814f-a82f8e18d40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:13.283975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-81e761ef-6de5-45d3-814f-a82f8e18d40a None None] MFA Rules not processed for user `b0b7534856ad4817b1b15a2505a791dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:13.285946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-81e761ef-6de5-45d3-814f-a82f8e18d40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:13.374949 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3082/6220] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:13 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:13.379039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66dc3d-5f18-4003-98b1-44cb2dd5c015 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:13.380633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4a66dc3d-5f18-4003-98b1-44cb2dd5c015 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:13.396398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66dc3d-5f18-4003-98b1-44cb2dd5c015 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:13.403695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4b38b-3090-472a-a442-1e54ad0fc272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:13.404626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4b38b-3090-472a-a442-1e54ad0fc272 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:13.405154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4b38b-3090-472a-a442-1e54ad0fc272 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:13.405662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4b38b-3090-472a-a442-1e54ad0fc272 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:13.406546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4b38b-3090-472a-a442-1e54ad0fc272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:13.409123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4b38b-3090-472a-a442-1e54ad0fc272 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:13.478731 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3139/6221] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:26:13 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:13.481768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e761ef-6de5-45d3-814f-a82f8e18d40a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:13.509757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e761ef-6de5-45d3-814f-a82f8e18d40a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:13.893837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fcadf-1a64-4c93-b153-c6eac896fae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:13.895473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fcadf-1a64-4c93-b153-c6eac896fae8 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:13.895473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fcadf-1a64-4c93-b153-c6eac896fae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:13.895473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fcadf-1a64-4c93-b153-c6eac896fae8 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:13.896724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fcadf-1a64-4c93-b153-c6eac896fae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:13.898810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fcadf-1a64-4c93-b153-c6eac896fae8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:13.943249 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3083/6222] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:26:13 2022] POST /identity/v3/users => generated 303 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:26:13.947556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4b38b-3090-472a-a442-1e54ad0fc272 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:13.962175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4b38b-3090-472a-a442-1e54ad0fc272 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:13.978053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05366666-035e-4aa6-8aea-be177b86693c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:13.978983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05366666-035e-4aa6-8aea-be177b86693c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:13.980146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05366666-035e-4aa6-8aea-be177b86693c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:13.980494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05366666-035e-4aa6-8aea-be177b86693c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:13.982483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05366666-035e-4aa6-8aea-be177b86693c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:14.000819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05366666-035e-4aa6-8aea-be177b86693c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:14.039030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fcadf-1a64-4c93-b153-c6eac896fae8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:14.039322 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3140/6223] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:26:14.069010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fcadf-1a64-4c93-b153-c6eac896fae8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:14.082527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a763fa-ec62-4385-a1ae-116ffa6114ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:14.083349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a763fa-ec62-4385-a1ae-116ffa6114ab admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:14.083804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a763fa-ec62-4385-a1ae-116ffa6114ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:14.084908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a763fa-ec62-4385-a1ae-116ffa6114ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:14.085743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a763fa-ec62-4385-a1ae-116ffa6114ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:14.090788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a763fa-ec62-4385-a1ae-116ffa6114ab admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:14.120758 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3084/6224] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:26:14.121975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05366666-035e-4aa6-8aea-be177b86693c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:14.135926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05366666-035e-4aa6-8aea-be177b86693c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:14.157102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98a2a7-2982-4bf7-8063-8101206c6d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:14.157411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98a2a7-2982-4bf7-8063-8101206c6d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:14.157704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98a2a7-2982-4bf7-8063-8101206c6d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:14.158150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98a2a7-2982-4bf7-8063-8101206c6d27 admin admin] PATH_INFO: `/v3/projects/6ef7b4a99dfd4b92a73c3dbc9f03cd91/users/a90fd14f0cf34e148935f79cf381f903/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:14.190769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98a2a7-2982-4bf7-8063-8101206c6d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef7b4a99dfd4b92a73c3dbc9f03cd91, user_id=a90fd14f0cf34e148935f79cf381f903, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:14.198801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98a2a7-2982-4bf7-8063-8101206c6d27 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:14.238853 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3141/6225] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:26:14 2022] PUT /identity/v3/projects/6ef7b4a99dfd4b92a73c3dbc9f03cd91/users/a90fd14f0cf34e148935f79cf381f903/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:17.131691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a763fa-ec62-4385-a1ae-116ffa6114ab admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:17.308876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a763fa-ec62-4385-a1ae-116ffa6114ab admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:17.364032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:17.443672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14810da7-63b9-4f32-95d7-5c222ae9fcac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:17.443954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14810da7-63b9-4f32-95d7-5c222ae9fcac service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:17.444207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14810da7-63b9-4f32-95d7-5c222ae9fcac service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:17.444481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14810da7-63b9-4f32-95d7-5c222ae9fcac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:17.446604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-14810da7-63b9-4f32-95d7-5c222ae9fcac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:17.474862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14810da7-63b9-4f32-95d7-5c222ae9fcac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:17.476319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14810da7-63b9-4f32-95d7-5c222ae9fcac service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:17.499999 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3085/6226] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:26:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:26:21.040076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98a2a7-2982-4bf7-8063-8101206c6d27 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:21.041871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0c98a2a7-2982-4bf7-8063-8101206c6d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:21.176010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98a2a7-2982-4bf7-8063-8101206c6d27 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:21.180953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650676e-802c-4d97-bb48-62d1a2e34827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:21.181615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650676e-802c-4d97-bb48-62d1a2e34827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:21.181902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650676e-802c-4d97-bb48-62d1a2e34827 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:21.182182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650676e-802c-4d97-bb48-62d1a2e34827 admin admin] PATH_INFO: `/v3/users/773947176f6a466496252a5c7139158d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:21.183583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650676e-802c-4d97-bb48-62d1a2e34827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=773947176f6a466496252a5c7139158d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:21.185515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650676e-802c-4d97-bb48-62d1a2e34827 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:21.257170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:21.262963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4650676e-802c-4d97-bb48-62d1a2e34827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '773947176f6a466496252a5c7139158d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:21.292320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4650676e-802c-4d97-bb48-62d1a2e34827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '773947176f6a466496252a5c7139158d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:21.293057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4650676e-802c-4d97-bb48-62d1a2e34827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '773947176f6a466496252a5c7139158d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:21.305539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4650676e-802c-4d97-bb48-62d1a2e34827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '773947176f6a466496252a5c7139158d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:21.307674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4650676e-802c-4d97-bb48-62d1a2e34827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '773947176f6a466496252a5c7139158d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:21.329223 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3142/6227] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:26:21 2022] DELETE /identity/v3/users/773947176f6a466496252a5c7139158d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:21.333887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73749f-6eac-4aef-8790-40dea061b962 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:21.335152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73749f-6eac-4aef-8790-40dea061b962 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:21.335658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73749f-6eac-4aef-8790-40dea061b962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:21.392380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3d73749f-6eac-4aef-8790-40dea061b962 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:21.394389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3d73749f-6eac-4aef-8790-40dea061b962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:21.578787 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3086/6228] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:21.587654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650676e-802c-4d97-bb48-62d1a2e34827 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:21.589414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4650676e-802c-4d97-bb48-62d1a2e34827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:21.663078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650676e-802c-4d97-bb48-62d1a2e34827 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:21.667648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29051bc9-e350-4d1f-bc8a-7f6a21ab7a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:21.668293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29051bc9-e350-4d1f-bc8a-7f6a21ab7a94 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:21.668582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29051bc9-e350-4d1f-bc8a-7f6a21ab7a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:21.668986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29051bc9-e350-4d1f-bc8a-7f6a21ab7a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:21.680386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29051bc9-e350-4d1f-bc8a-7f6a21ab7a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:21.681951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29051bc9-e350-4d1f-bc8a-7f6a21ab7a94 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:21.694170 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3143/6229] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:26:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:26:23.160954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73749f-6eac-4aef-8790-40dea061b962 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:23.162682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3d73749f-6eac-4aef-8790-40dea061b962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:23.188551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73749f-6eac-4aef-8790-40dea061b962 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:23.195486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef277d-ab85-4fa0-8695-18b5c129599a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:23.196456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef277d-ab85-4fa0-8695-18b5c129599a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:23.196965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef277d-ab85-4fa0-8695-18b5c129599a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:23.197584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef277d-ab85-4fa0-8695-18b5c129599a admin admin] PATH_INFO: `/v3/projects/fe582500bd714ee28a4fa6839c7e2a1a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:23.199214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef277d-ab85-4fa0-8695-18b5c129599a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe582500bd714ee28a4fa6839c7e2a1a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:23.201959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef277d-ab85-4fa0-8695-18b5c129599a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:23.339949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-adef277d-ab85-4fa0-8695-18b5c129599a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe582500bd714ee28a4fa6839c7e2a1a', 'request_id': 'req-adef277d-ab85-4fa0-8695-18b5c129599a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:23.355014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-adef277d-ab85-4fa0-8695-18b5c129599a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe582500bd714ee28a4fa6839c7e2a1a', 'request_id': 'req-adef277d-ab85-4fa0-8695-18b5c129599a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:23.388241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-adef277d-ab85-4fa0-8695-18b5c129599a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe582500bd714ee28a4fa6839c7e2a1a', 'request_id': 'req-adef277d-ab85-4fa0-8695-18b5c129599a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:23.414216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-adef277d-ab85-4fa0-8695-18b5c129599a admin admin] The token cache is being invalidate because project fe582500bd714ee28a4fa6839c7e2a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:26:23.414520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-adef277d-ab85-4fa0-8695-18b5c129599a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:23.415220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-adef277d-ab85-4fa0-8695-18b5c129599a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:23.417074 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3087/6230] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:26:23 2022] DELETE /identity/v3/projects/fe582500bd714ee28a4fa6839c7e2a1a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:23.421751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea247be9-b1ad-4371-972d-c3fc15b7d800 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:23.422313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea247be9-b1ad-4371-972d-c3fc15b7d800 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:23.422428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea247be9-b1ad-4371-972d-c3fc15b7d800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:23.467494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ea247be9-b1ad-4371-972d-c3fc15b7d800 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:23.469033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ea247be9-b1ad-4371-972d-c3fc15b7d800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:23.585321 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3144/6231] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:23.592937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd459a1-ed8d-43e0-b31c-998d5f49ebdf None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:23.593221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd459a1-ed8d-43e0-b31c-998d5f49ebdf None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:23.593704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd459a1-ed8d-43e0-b31c-998d5f49ebdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:23.640681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-edd459a1-ed8d-43e0-b31c-998d5f49ebdf None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:23.642300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-edd459a1-ed8d-43e0-b31c-998d5f49ebdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:23.660223 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3088/6232] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:23.664926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea247be9-b1ad-4371-972d-c3fc15b7d800 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:23.676509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea247be9-b1ad-4371-972d-c3fc15b7d800 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:23.681811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579855b-8058-4349-85d6-db1aa458e697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:23.682936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579855b-8058-4349-85d6-db1aa458e697 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:23.683447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579855b-8058-4349-85d6-db1aa458e697 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:23.683917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579855b-8058-4349-85d6-db1aa458e697 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:23.684856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579855b-8058-4349-85d6-db1aa458e697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:26:23.685332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579855b-8058-4349-85d6-db1aa458e697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:23.687779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579855b-8058-4349-85d6-db1aa458e697 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:23.714866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd459a1-ed8d-43e0-b31c-998d5f49ebdf None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:23.715524 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3145/6233] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:26:23.726233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd459a1-ed8d-43e0-b31c-998d5f49ebdf None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:23.731799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692148c-ca7a-4eba-bab1-2fab53877a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:23.732500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692148c-ca7a-4eba-bab1-2fab53877a36 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:23.732851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692148c-ca7a-4eba-bab1-2fab53877a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:23.733193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692148c-ca7a-4eba-bab1-2fab53877a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:23.733925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692148c-ca7a-4eba-bab1-2fab53877a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:23.735950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692148c-ca7a-4eba-bab1-2fab53877a36 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:23.778759 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3089/6234] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:26:23 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:26:23.784474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579855b-8058-4349-85d6-db1aa458e697 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:23.796125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579855b-8058-4349-85d6-db1aa458e697 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:23.853201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:23.873514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3bb8a-ade8-4b2e-9b6e-1614822fad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:23.874622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3bb8a-ade8-4b2e-9b6e-1614822fad62 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:23.875095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3bb8a-ade8-4b2e-9b6e-1614822fad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:23.875825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3bb8a-ade8-4b2e-9b6e-1614822fad62 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:23.876736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3bb8a-ade8-4b2e-9b6e-1614822fad62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:23.879945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3bb8a-ade8-4b2e-9b6e-1614822fad62 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:23.929492 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3146/6235] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:26:23 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:23.931304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692148c-ca7a-4eba-bab1-2fab53877a36 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:23.965116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692148c-ca7a-4eba-bab1-2fab53877a36 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:23.989646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39c453-b900-4b4b-a381-8e32218db0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:23.999930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39c453-b900-4b4b-a381-8e32218db0ae admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:24.000341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39c453-b900-4b4b-a381-8e32218db0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:24.000744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39c453-b900-4b4b-a381-8e32218db0ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:24.001708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39c453-b900-4b4b-a381-8e32218db0ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:24.005496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39c453-b900-4b4b-a381-8e32218db0ae admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:24.050652 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3090/6236] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:26:24.055646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3bb8a-ade8-4b2e-9b6e-1614822fad62 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:24.086742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3bb8a-ade8-4b2e-9b6e-1614822fad62 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:24.095022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61762095-d224-4489-af44-9218f549c8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:24.095869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61762095-d224-4489-af44-9218f549c8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:24.096729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61762095-d224-4489-af44-9218f549c8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:24.097330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61762095-d224-4489-af44-9218f549c8b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:24.102485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61762095-d224-4489-af44-9218f549c8b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:24.105208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61762095-d224-4489-af44-9218f549c8b6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:24.123572 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3147/6237] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:26:24.128876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39c453-b900-4b4b-a381-8e32218db0ae admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:24.147445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39c453-b900-4b4b-a381-8e32218db0ae admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:24.187691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9de1e-5d9c-4384-b769-582440e95aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:24.198070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9de1e-5d9c-4384-b769-582440e95aff admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:24.199513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9de1e-5d9c-4384-b769-582440e95aff admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:24.200329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9de1e-5d9c-4384-b769-582440e95aff admin admin] PATH_INFO: `/v3/projects/a7f12fd23bfc4cc68aeda388743c122b/users/6e97ddb6c8334b749dcabc8ad7fd39f3/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:24.215735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:24.263789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9de1e-5d9c-4384-b769-582440e95aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7f12fd23bfc4cc68aeda388743c122b, user_id=6e97ddb6c8334b749dcabc8ad7fd39f3, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:24.275447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9de1e-5d9c-4384-b769-582440e95aff admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:24.337497 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3091/6238] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:26:24 2022] PUT /identity/v3/projects/a7f12fd23bfc4cc68aeda388743c122b/users/6e97ddb6c8334b749dcabc8ad7fd39f3/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:24.349810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d072a-d316-4f0a-ba58-970eea4bef39 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:24.350591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d072a-d316-4f0a-ba58-970eea4bef39 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:24.350881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d072a-d316-4f0a-ba58-970eea4bef39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:24.455504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-cb6d072a-d316-4f0a-ba58-970eea4bef39 None None] MFA Rules not processed for user `6e97ddb6c8334b749dcabc8ad7fd39f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:24.458733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cb6d072a-d316-4f0a-ba58-970eea4bef39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:24.590759 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3148/6239] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:24.625516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9de1e-5d9c-4384-b769-582440e95aff admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:24.627556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-19e9de1e-5d9c-4384-b769-582440e95aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:24.764528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9de1e-5d9c-4384-b769-582440e95aff admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:24.768356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b339b35-642a-4033-81f4-0ff17952dad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:24.768692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b339b35-642a-4033-81f4-0ff17952dad2 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:24.769055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b339b35-642a-4033-81f4-0ff17952dad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:24.769831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b339b35-642a-4033-81f4-0ff17952dad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:24.779676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b339b35-642a-4033-81f4-0ff17952dad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:24.781232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b339b35-642a-4033-81f4-0ff17952dad2 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:24.794177 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3092/6240] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:26:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:26:24.868673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d072a-d316-4f0a-ba58-970eea4bef39 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:24.957310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b339b35-642a-4033-81f4-0ff17952dad2 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:24.959570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1b339b35-642a-4033-81f4-0ff17952dad2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:24.983258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b339b35-642a-4033-81f4-0ff17952dad2 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:24.998019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a19ad-e87b-4bdd-9e85-74c1e684b2cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:24.998986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a19ad-e87b-4bdd-9e85-74c1e684b2cd service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:24.999476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a19ad-e87b-4bdd-9e85-74c1e684b2cd service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:24.999919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a19ad-e87b-4bdd-9e85-74c1e684b2cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:25.002494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bd1a19ad-e87b-4bdd-9e85-74c1e684b2cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:25.004417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d072a-d316-4f0a-ba58-970eea4bef39 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:25.013739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b0453-d971-4155-844e-9bca84173cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:25.014433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b0453-d971-4155-844e-9bca84173cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:25.014748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b0453-d971-4155-844e-9bca84173cec admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:25.015042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b0453-d971-4155-844e-9bca84173cec admin admin] PATH_INFO: `/v3/users/6e97ddb6c8334b749dcabc8ad7fd39f3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:25.020256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b0453-d971-4155-844e-9bca84173cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e97ddb6c8334b749dcabc8ad7fd39f3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:25.022479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b0453-d971-4155-844e-9bca84173cec admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:25.031362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a19ad-e87b-4bdd-9e85-74c1e684b2cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:25.036789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a19ad-e87b-4bdd-9e85-74c1e684b2cd service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:25.052440 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3093/6241] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:26:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:26:25.113706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6a1b0453-d971-4155-844e-9bca84173cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e97ddb6c8334b749dcabc8ad7fd39f3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:25.126046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:25.138534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6a1b0453-d971-4155-844e-9bca84173cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e97ddb6c8334b749dcabc8ad7fd39f3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:25.142364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6a1b0453-d971-4155-844e-9bca84173cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e97ddb6c8334b749dcabc8ad7fd39f3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:25.180638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6a1b0453-d971-4155-844e-9bca84173cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e97ddb6c8334b749dcabc8ad7fd39f3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:25.181728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6a1b0453-d971-4155-844e-9bca84173cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e97ddb6c8334b749dcabc8ad7fd39f3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:25.207679 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3149/6242] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:26:24 2022] DELETE /identity/v3/users/6e97ddb6c8334b749dcabc8ad7fd39f3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:25.213342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a1c7d-e0ed-4a34-9732-1e39d70c5c64 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:25.214670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a1c7d-e0ed-4a34-9732-1e39d70c5c64 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:25.215129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a1c7d-e0ed-4a34-9732-1e39d70c5c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:25.293517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f63a1c7d-e0ed-4a34-9732-1e39d70c5c64 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:25.298753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f63a1c7d-e0ed-4a34-9732-1e39d70c5c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:25.441990 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3094/6243] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:25.499608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b0453-d971-4155-844e-9bca84173cec admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:25.505587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6a1b0453-d971-4155-844e-9bca84173cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:25.678718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b0453-d971-4155-844e-9bca84173cec admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:25.684663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf57d5e-cef6-4d90-9b52-4495832577dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:25.685702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf57d5e-cef6-4d90-9b52-4495832577dc service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:25.686186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf57d5e-cef6-4d90-9b52-4495832577dc service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:25.687092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf57d5e-cef6-4d90-9b52-4495832577dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:25.704156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf57d5e-cef6-4d90-9b52-4495832577dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:25.706029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf57d5e-cef6-4d90-9b52-4495832577dc service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:25.731052 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3150/6244] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:26:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:26:27.301143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a1c7d-e0ed-4a34-9732-1e39d70c5c64 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:27.303625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f63a1c7d-e0ed-4a34-9732-1e39d70c5c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:27.331262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a1c7d-e0ed-4a34-9732-1e39d70c5c64 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:27.346754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec12cbc-91bd-44fc-a494-33d9d057197f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:27.348219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec12cbc-91bd-44fc-a494-33d9d057197f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:27.348789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec12cbc-91bd-44fc-a494-33d9d057197f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:27.349624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec12cbc-91bd-44fc-a494-33d9d057197f admin admin] PATH_INFO: `/v3/projects/a7f12fd23bfc4cc68aeda388743c122b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:27.352017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec12cbc-91bd-44fc-a494-33d9d057197f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7f12fd23bfc4cc68aeda388743c122b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:27.353925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec12cbc-91bd-44fc-a494-33d9d057197f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:27.447205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1ec12cbc-91bd-44fc-a494-33d9d057197f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7f12fd23bfc4cc68aeda388743c122b', 'request_id': 'req-1ec12cbc-91bd-44fc-a494-33d9d057197f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:27.462865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1ec12cbc-91bd-44fc-a494-33d9d057197f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7f12fd23bfc4cc68aeda388743c122b', 'request_id': 'req-1ec12cbc-91bd-44fc-a494-33d9d057197f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:27.480465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1ec12cbc-91bd-44fc-a494-33d9d057197f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7f12fd23bfc4cc68aeda388743c122b', 'request_id': 'req-1ec12cbc-91bd-44fc-a494-33d9d057197f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:27.494741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:27.501264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1ec12cbc-91bd-44fc-a494-33d9d057197f admin admin] The token cache is being invalidate because project a7f12fd23bfc4cc68aeda388743c122b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:26:27.502849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1ec12cbc-91bd-44fc-a494-33d9d057197f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:27.504639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1ec12cbc-91bd-44fc-a494-33d9d057197f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:27.508121 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3095/6245] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:26:27 2022] DELETE /identity/v3/projects/a7f12fd23bfc4cc68aeda388743c122b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:27.513559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaf6ea-1082-4114-8448-b30fc12262ef None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:27.514388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaf6ea-1082-4114-8448-b30fc12262ef None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:27.514847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaf6ea-1082-4114-8448-b30fc12262ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:27.564646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5ffaf6ea-1082-4114-8448-b30fc12262ef None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:27.567609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5ffaf6ea-1082-4114-8448-b30fc12262ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:27.670425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec12cbc-91bd-44fc-a494-33d9d057197f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:27.671991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1ec12cbc-91bd-44fc-a494-33d9d057197f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:27.724162 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3151/6246] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:26:27.726412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d400e-777d-4488-8445-68908a7a4d16 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:27.726703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d400e-777d-4488-8445-68908a7a4d16 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:27.726984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d400e-777d-4488-8445-68908a7a4d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:27.775573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2e7d400e-777d-4488-8445-68908a7a4d16 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:27.777300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2e7d400e-777d-4488-8445-68908a7a4d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:27.797214 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3152/6247] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:27.802064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d400e-777d-4488-8445-68908a7a4d16 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:27.822521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d400e-777d-4488-8445-68908a7a4d16 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:27.833207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1989f-22a3-4a89-9bb0-9bb5afffc70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:27.834106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1989f-22a3-4a89-9bb0-9bb5afffc70d admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:27.834797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1989f-22a3-4a89-9bb0-9bb5afffc70d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:27.835254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1989f-22a3-4a89-9bb0-9bb5afffc70d admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:27.836158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1989f-22a3-4a89-9bb0-9bb5afffc70d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:26:27.836667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1989f-22a3-4a89-9bb0-9bb5afffc70d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:27.838817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1989f-22a3-4a89-9bb0-9bb5afffc70d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:27.852826 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3153/6248] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:26:27.857331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1989f-22a3-4a89-9bb0-9bb5afffc70d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:27.869892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1989f-22a3-4a89-9bb0-9bb5afffc70d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:27.876066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec12cbc-91bd-44fc-a494-33d9d057197f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:27.876813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bef6a-33a7-4d0b-a1bf-aba9646e4c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:27.877896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bef6a-33a7-4d0b-a1bf-aba9646e4c95 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:27.879058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bef6a-33a7-4d0b-a1bf-aba9646e4c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:27.880781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bef6a-33a7-4d0b-a1bf-aba9646e4c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:27.881592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bef6a-33a7-4d0b-a1bf-aba9646e4c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:27.883553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bef6a-33a7-4d0b-a1bf-aba9646e4c95 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:27.890537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d061214-037b-4280-bd8d-5fa73d19ac48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:27.891217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d061214-037b-4280-bd8d-5fa73d19ac48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:27.891532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d061214-037b-4280-bd8d-5fa73d19ac48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:27.891813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d061214-037b-4280-bd8d-5fa73d19ac48 admin admin] PATH_INFO: `/v3/users/6896ccb6369541d5a552f3373f39c64d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:27.893039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d061214-037b-4280-bd8d-5fa73d19ac48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6896ccb6369541d5a552f3373f39c64d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:27.895552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d061214-037b-4280-bd8d-5fa73d19ac48 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:27.945289 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3154/6249] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:26:27 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:27.950135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bef6a-33a7-4d0b-a1bf-aba9646e4c95 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:28.003028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7d061214-037b-4280-bd8d-5fa73d19ac48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6896ccb6369541d5a552f3373f39c64d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:28.004286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7d061214-037b-4280-bd8d-5fa73d19ac48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6896ccb6369541d5a552f3373f39c64d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:28.040769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7d061214-037b-4280-bd8d-5fa73d19ac48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6896ccb6369541d5a552f3373f39c64d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:28.041592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7d061214-037b-4280-bd8d-5fa73d19ac48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6896ccb6369541d5a552f3373f39c64d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:28.057406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7d061214-037b-4280-bd8d-5fa73d19ac48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6896ccb6369541d5a552f3373f39c64d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:28.076802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:28.083524 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3096/6250] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:26:27 2022] DELETE /identity/v3/users/6896ccb6369541d5a552f3373f39c64d => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:28.126572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bef6a-33a7-4d0b-a1bf-aba9646e4c95 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:28.196232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c7ac0-a17a-4731-83f9-d116d6b9ede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:28.197289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7ac0-a17a-4731-83f9-d116d6b9ede3 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:28.197997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7ac0-a17a-4731-83f9-d116d6b9ede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:28.198620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7ac0-a17a-4731-83f9-d116d6b9ede3 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:28.199516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c7ac0-a17a-4731-83f9-d116d6b9ede3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:28.201637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c7ac0-a17a-4731-83f9-d116d6b9ede3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:28.241429 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3155/6251] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:26:27 2022] POST /identity/v3/users => generated 287 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:28.244885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d061214-037b-4280-bd8d-5fa73d19ac48 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:28.246369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7d061214-037b-4280-bd8d-5fa73d19ac48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:28.271596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d061214-037b-4280-bd8d-5fa73d19ac48 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:28.286632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7065a61-6e1d-4974-96c4-061fbb961f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:28.287365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7065a61-6e1d-4974-96c4-061fbb961f93 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:28.287594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7065a61-6e1d-4974-96c4-061fbb961f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:28.287871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7065a61-6e1d-4974-96c4-061fbb961f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:28.288681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7065a61-6e1d-4974-96c4-061fbb961f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:28.290279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7065a61-6e1d-4974-96c4-061fbb961f93 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:28.331367 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3097/6252] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:26:28.332593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c7ac0-a17a-4731-83f9-d116d6b9ede3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:28.351397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c7ac0-a17a-4731-83f9-d116d6b9ede3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:28.363115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a70c06-16b2-4076-ab9e-743f08896aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:28.363984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a70c06-16b2-4076-ab9e-743f08896aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:28.364418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a70c06-16b2-4076-ab9e-743f08896aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:28.364794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a70c06-16b2-4076-ab9e-743f08896aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:28.366245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a70c06-16b2-4076-ab9e-743f08896aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:28.368203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a70c06-16b2-4076-ab9e-743f08896aa1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:28.394256 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3156/6253] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:26:28.398175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7065a61-6e1d-4974-96c4-061fbb961f93 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:28.410233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7065a61-6e1d-4974-96c4-061fbb961f93 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:28.415463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63ff7f-a1d9-4e23-b956-f8ae53cc2854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:28.416460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63ff7f-a1d9-4e23-b956-f8ae53cc2854 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:28.416902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63ff7f-a1d9-4e23-b956-f8ae53cc2854 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:28.417398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63ff7f-a1d9-4e23-b956-f8ae53cc2854 admin admin] PATH_INFO: `/v3/projects/911f87748f884c19bf25fd5c87bd0bde/users/19f630ee23a5461eb61c8128cc5267b8/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:28.452910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63ff7f-a1d9-4e23-b956-f8ae53cc2854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=911f87748f884c19bf25fd5c87bd0bde, user_id=19f630ee23a5461eb61c8128cc5267b8, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:28.455929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63ff7f-a1d9-4e23-b956-f8ae53cc2854 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:28.511324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0174f-d6db-44c3-a9f0-f300e160dc5a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:28.511683 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3098/6254] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:26:28 2022] PUT /identity/v3/projects/911f87748f884c19bf25fd5c87bd0bde/users/19f630ee23a5461eb61c8128cc5267b8/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:28.512051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0174f-d6db-44c3-a9f0-f300e160dc5a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:28.512434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0174f-d6db-44c3-a9f0-f300e160dc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:28.580911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c7a0174f-d6db-44c3-a9f0-f300e160dc5a None None] MFA Rules not processed for user `19f630ee23a5461eb61c8128cc5267b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:28.582388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c7a0174f-d6db-44c3-a9f0-f300e160dc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:28.749656 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3157/6255] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:28.766370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63ff7f-a1d9-4e23-b956-f8ae53cc2854 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:28.769801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-af63ff7f-a1d9-4e23-b956-f8ae53cc2854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:28.867246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:28.881269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63ff7f-a1d9-4e23-b956-f8ae53cc2854 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:28.889690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0174f-d6db-44c3-a9f0-f300e160dc5a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:28.891543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c7a0174f-d6db-44c3-a9f0-f300e160dc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:28.893287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78613b58-6f35-4a9e-82da-06312e891405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:28.894717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78613b58-6f35-4a9e-82da-06312e891405 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:28.895710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78613b58-6f35-4a9e-82da-06312e891405 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:28.896013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78613b58-6f35-4a9e-82da-06312e891405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:28.905953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78613b58-6f35-4a9e-82da-06312e891405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:28.908905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78613b58-6f35-4a9e-82da-06312e891405 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:28.922834 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3099/6256] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:26:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:26:28.992916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:29.014229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0174f-d6db-44c3-a9f0-f300e160dc5a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:29.023711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3aad79-51f5-4dd6-ad97-847ccbc51388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:29.024646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aad79-51f5-4dd6-ad97-847ccbc51388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:29.025040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aad79-51f5-4dd6-ad97-847ccbc51388 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:29.025411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aad79-51f5-4dd6-ad97-847ccbc51388 admin admin] PATH_INFO: `/v3/projects/5850a54af6204e2f83d8e61141a04013` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:29.027106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3aad79-51f5-4dd6-ad97-847ccbc51388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5850a54af6204e2f83d8e61141a04013)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:29.030170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3aad79-51f5-4dd6-ad97-847ccbc51388 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:29.098639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7e3aad79-51f5-4dd6-ad97-847ccbc51388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5850a54af6204e2f83d8e61141a04013', 'request_id': 'req-7e3aad79-51f5-4dd6-ad97-847ccbc51388'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:29.108865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7e3aad79-51f5-4dd6-ad97-847ccbc51388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5850a54af6204e2f83d8e61141a04013', 'request_id': 'req-7e3aad79-51f5-4dd6-ad97-847ccbc51388'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:29.121831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7e3aad79-51f5-4dd6-ad97-847ccbc51388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5850a54af6204e2f83d8e61141a04013', 'request_id': 'req-7e3aad79-51f5-4dd6-ad97-847ccbc51388'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:29.155256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7e3aad79-51f5-4dd6-ad97-847ccbc51388 admin admin] The token cache is being invalidate because project 5850a54af6204e2f83d8e61141a04013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:26:29.155903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7e3aad79-51f5-4dd6-ad97-847ccbc51388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:29.156787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7e3aad79-51f5-4dd6-ad97-847ccbc51388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:29.165884 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3158/6257] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:26:28 2022] DELETE /identity/v3/projects/5850a54af6204e2f83d8e61141a04013 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:26:29.169785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269af13e-f523-49db-bcf3-025a18fb3c8a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:29.170382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269af13e-f523-49db-bcf3-025a18fb3c8a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:29.170803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269af13e-f523-49db-bcf3-025a18fb3c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:29.223743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-269af13e-f523-49db-bcf3-025a18fb3c8a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:29.229918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-269af13e-f523-49db-bcf3-025a18fb3c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:29.370138 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3100/6258] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:29.372122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624589b-f5f9-4da5-b2aa-fc1bdd20fdfb None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:29.372414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624589b-f5f9-4da5-b2aa-fc1bdd20fdfb None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:29.372690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624589b-f5f9-4da5-b2aa-fc1bdd20fdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:29.407187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a624589b-f5f9-4da5-b2aa-fc1bdd20fdfb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:29.408609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a624589b-f5f9-4da5-b2aa-fc1bdd20fdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:29.439020 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3159/6259] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:29.443526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269af13e-f523-49db-bcf3-025a18fb3c8a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:29.466825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269af13e-f523-49db-bcf3-025a18fb3c8a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:29.473798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0ea32-1c8e-4992-8ce2-abf50a6b59ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:29.475008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0ea32-1c8e-4992-8ce2-abf50a6b59ba admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:29.475897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0ea32-1c8e-4992-8ce2-abf50a6b59ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:29.476357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0ea32-1c8e-4992-8ce2-abf50a6b59ba admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:29.477335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0ea32-1c8e-4992-8ce2-abf50a6b59ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:26:29.477851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0ea32-1c8e-4992-8ce2-abf50a6b59ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:29.481930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0ea32-1c8e-4992-8ce2-abf50a6b59ba admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:29.510474 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3101/6260] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:26:29.515498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624589b-f5f9-4da5-b2aa-fc1bdd20fdfb None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:29.528771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624589b-f5f9-4da5-b2aa-fc1bdd20fdfb None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:29.539824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e01df-1aec-4c20-af64-cf57df4e3149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:29.541594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e01df-1aec-4c20-af64-cf57df4e3149 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:29.542103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e01df-1aec-4c20-af64-cf57df4e3149 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:29.543540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e01df-1aec-4c20-af64-cf57df4e3149 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:29.544581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e01df-1aec-4c20-af64-cf57df4e3149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:29.547104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e01df-1aec-4c20-af64-cf57df4e3149 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:29.627074 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3160/6261] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:26:29 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:29.633010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0ea32-1c8e-4992-8ce2-abf50a6b59ba admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:29.646495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0ea32-1c8e-4992-8ce2-abf50a6b59ba admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:29.755469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96aa989-de45-4351-9ec7-aca9aab53ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:29.756517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96aa989-de45-4351-9ec7-aca9aab53ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:29.757005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96aa989-de45-4351-9ec7-aca9aab53ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:29.757272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96aa989-de45-4351-9ec7-aca9aab53ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:29.757946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96aa989-de45-4351-9ec7-aca9aab53ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:29.761389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96aa989-de45-4351-9ec7-aca9aab53ad5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:29.808254 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3102/6262] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:26:29 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:29.823022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e01df-1aec-4c20-af64-cf57df4e3149 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:29.858257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e01df-1aec-4c20-af64-cf57df4e3149 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:29.872070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af25d9c-1730-4701-90d4-49b2a1a5c7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:29.874443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af25d9c-1730-4701-90d4-49b2a1a5c7aa admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:29.874969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af25d9c-1730-4701-90d4-49b2a1a5c7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:29.875549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af25d9c-1730-4701-90d4-49b2a1a5c7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:29.876959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af25d9c-1730-4701-90d4-49b2a1a5c7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:29.880759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af25d9c-1730-4701-90d4-49b2a1a5c7aa admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:29.913116 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3161/6263] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:26:29.917220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96aa989-de45-4351-9ec7-aca9aab53ad5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:29.938166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96aa989-de45-4351-9ec7-aca9aab53ad5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:29.952302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49792d6b-ea6d-4ec2-b9a8-a60b7589d200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:29.952853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49792d6b-ea6d-4ec2-b9a8-a60b7589d200 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:29.953140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49792d6b-ea6d-4ec2-b9a8-a60b7589d200 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:29.953414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49792d6b-ea6d-4ec2-b9a8-a60b7589d200 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:29.954117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49792d6b-ea6d-4ec2-b9a8-a60b7589d200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:29.958567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49792d6b-ea6d-4ec2-b9a8-a60b7589d200 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:29.983627 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3103/6264] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:26:29.983882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af25d9c-1730-4701-90d4-49b2a1a5c7aa admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:30.000745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af25d9c-1730-4701-90d4-49b2a1a5c7aa admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:30.016050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05873d-1f3a-410a-a594-3d28eaecbe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:30.016758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05873d-1f3a-410a-a594-3d28eaecbe4b admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:30.017043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05873d-1f3a-410a-a594-3d28eaecbe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:30.017327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05873d-1f3a-410a-a594-3d28eaecbe4b admin admin] PATH_INFO: `/v3/projects/6cb1e3fca3be4ec3bf867995a659de27/users/d0586a8161374a1ca8fc44fc27fe8eff/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:30.036248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05873d-1f3a-410a-a594-3d28eaecbe4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb1e3fca3be4ec3bf867995a659de27, user_id=d0586a8161374a1ca8fc44fc27fe8eff, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:30.039430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05873d-1f3a-410a-a594-3d28eaecbe4b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:30.067446 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3162/6265] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:26:29 2022] PUT /identity/v3/projects/6cb1e3fca3be4ec3bf867995a659de27/users/d0586a8161374a1ca8fc44fc27fe8eff/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:30.077775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c896f84-5c2b-42e6-973c-3596a83b2a28 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:30.078248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c896f84-5c2b-42e6-973c-3596a83b2a28 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:30.078374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c896f84-5c2b-42e6-973c-3596a83b2a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:30.117156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6c896f84-5c2b-42e6-973c-3596a83b2a28 None None] MFA Rules not processed for user `d0586a8161374a1ca8fc44fc27fe8eff`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:30.118848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6c896f84-5c2b-42e6-973c-3596a83b2a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:30.187647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:30.236619 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3104/6266] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:30.241040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05873d-1f3a-410a-a594-3d28eaecbe4b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:30.353089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05873d-1f3a-410a-a594-3d28eaecbe4b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:30.359609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92814a9-c5da-489c-b756-f4056bcb20b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:30.360825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92814a9-c5da-489c-b756-f4056bcb20b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:30.361126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92814a9-c5da-489c-b756-f4056bcb20b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:30.361410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92814a9-c5da-489c-b756-f4056bcb20b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:30.363137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92814a9-c5da-489c-b756-f4056bcb20b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:30.370292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92814a9-c5da-489c-b756-f4056bcb20b6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:30.426499 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3163/6267] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:26:30 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:30.429666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c896f84-5c2b-42e6-973c-3596a83b2a28 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:30.447070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c896f84-5c2b-42e6-973c-3596a83b2a28 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:30.562139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be85a0d-6567-4206-82bd-343580f05c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:30.563964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be85a0d-6567-4206-82bd-343580f05c1e admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:30.564558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be85a0d-6567-4206-82bd-343580f05c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:30.566217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be85a0d-6567-4206-82bd-343580f05c1e admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:30.575385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be85a0d-6567-4206-82bd-343580f05c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:30.578817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be85a0d-6567-4206-82bd-343580f05c1e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:30.630398 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3105/6268] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:26:30 2022] POST /identity/v3/users => generated 295 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:30.636318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92814a9-c5da-489c-b756-f4056bcb20b6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:30.646423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:30.653538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92814a9-c5da-489c-b756-f4056bcb20b6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:30.670073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a841b29-e8b7-4541-a0d1-d7b60b73f338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:30.674517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a841b29-e8b7-4541-a0d1-d7b60b73f338 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:30.677893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a841b29-e8b7-4541-a0d1-d7b60b73f338 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:30.678484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a841b29-e8b7-4541-a0d1-d7b60b73f338 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:30.679574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a841b29-e8b7-4541-a0d1-d7b60b73f338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:30.682264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a841b29-e8b7-4541-a0d1-d7b60b73f338 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:30.706736 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3164/6269] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:26:30.707011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be85a0d-6567-4206-82bd-343580f05c1e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:30.721272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be85a0d-6567-4206-82bd-343580f05c1e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:30.730485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fba93-6318-4d46-80fc-77c4c9dbebe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:30.741740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fba93-6318-4d46-80fc-77c4c9dbebe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:30.742772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fba93-6318-4d46-80fc-77c4c9dbebe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:30.743449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fba93-6318-4d46-80fc-77c4c9dbebe6 admin admin] PATH_INFO: `/v3/projects/98d746dc758f486aafa7eebaf42d1c2b/users/10f6d83a050641839fc0b4f17f3e7eed/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:30.774630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fba93-6318-4d46-80fc-77c4c9dbebe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d746dc758f486aafa7eebaf42d1c2b, user_id=10f6d83a050641839fc0b4f17f3e7eed, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:30.778606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fba93-6318-4d46-80fc-77c4c9dbebe6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:30.819794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a841b29-e8b7-4541-a0d1-d7b60b73f338 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:30.821336 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3106/6270] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:26:30 2022] PUT /identity/v3/projects/98d746dc758f486aafa7eebaf42d1c2b/users/10f6d83a050641839fc0b4f17f3e7eed/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:26:30.837028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a841b29-e8b7-4541-a0d1-d7b60b73f338 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:30.964687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4173d20-0bac-417c-9e75-510da2fa646c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:30.969631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4173d20-0bac-417c-9e75-510da2fa646c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:30.970287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4173d20-0bac-417c-9e75-510da2fa646c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:30.970804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4173d20-0bac-417c-9e75-510da2fa646c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:30.971812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4173d20-0bac-417c-9e75-510da2fa646c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:30.975552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4173d20-0bac-417c-9e75-510da2fa646c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:31.019512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fba93-6318-4d46-80fc-77c4c9dbebe6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:31.032395 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3165/6271] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:26:31.037017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fba93-6318-4d46-80fc-77c4c9dbebe6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:31.049657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d53a30-f2c1-4b9c-96ef-fae0de3a28e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:31.051676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d53a30-f2c1-4b9c-96ef-fae0de3a28e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:31.053015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d53a30-f2c1-4b9c-96ef-fae0de3a28e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:31.053955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d53a30-f2c1-4b9c-96ef-fae0de3a28e6 admin admin] PATH_INFO: `/v3/projects/98d746dc758f486aafa7eebaf42d1c2b/users/10f6d83a050641839fc0b4f17f3e7eed/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:31.057959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d53a30-f2c1-4b9c-96ef-fae0de3a28e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d746dc758f486aafa7eebaf42d1c2b, user_id=10f6d83a050641839fc0b4f17f3e7eed, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:31.062286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d53a30-f2c1-4b9c-96ef-fae0de3a28e6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:31.095106 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3107/6272] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:26:31 2022] PUT /identity/v3/projects/98d746dc758f486aafa7eebaf42d1c2b/users/10f6d83a050641839fc0b4f17f3e7eed/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:26:31.102715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccc911-4937-43b0-9398-e9906d312266 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:31.103005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccc911-4937-43b0-9398-e9906d312266 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:31.103347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccc911-4937-43b0-9398-e9906d312266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:31.141313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-aaccc911-4937-43b0-9398-e9906d312266 None None] MFA Rules not processed for user `10f6d83a050641839fc0b4f17f3e7eed`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:31.142496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-aaccc911-4937-43b0-9398-e9906d312266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:31.318040 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3166/6273] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:31.322645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d53a30-f2c1-4b9c-96ef-fae0de3a28e6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:31.342020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d53a30-f2c1-4b9c-96ef-fae0de3a28e6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:31.357612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ea1b1-aa82-4cd5-87a7-fb9b10ac0e7e tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f6d83a050641839fc0b4f17f3e7eed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d746dc758f486aafa7eebaf42d1c2b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:31.358304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ea1b1-aa82-4cd5-87a7-fb9b10ac0e7e tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:31.358592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ea1b1-aa82-4cd5-87a7-fb9b10ac0e7e tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:31.358866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ea1b1-aa82-4cd5-87a7-fb9b10ac0e7e tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:31.359584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ea1b1-aa82-4cd5-87a7-fb9b10ac0e7e tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:31.360604 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-1c5ea1b1-aa82-4cd5-87a7-fb9b10ac0e7e tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:26:31.360604 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:26:31.360604 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:26:31.361491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ea1b1-aa82-4cd5-87a7-fb9b10ac0e7e tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:31.399656 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3108/6274] 10.222.0.17 () {60 vars in 1185 bytes} [Sat Jul 30 21:26:31 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:31.403269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccc911-4937-43b0-9398-e9906d312266 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:31.416892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccc911-4937-43b0-9398-e9906d312266 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:31.423420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf7c3a-53d9-4a97-8e91-3b9d1563ddce tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f6d83a050641839fc0b4f17f3e7eed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d746dc758f486aafa7eebaf42d1c2b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:31.424152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf7c3a-53d9-4a97-8e91-3b9d1563ddce tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:31.424444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf7c3a-53d9-4a97-8e91-3b9d1563ddce tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:31.424723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf7c3a-53d9-4a97-8e91-3b9d1563ddce tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/693c252a261642c9b9437b164f186a58` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:31.427264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf7c3a-53d9-4a97-8e91-3b9d1563ddce tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=693c252a261642c9b9437b164f186a58)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:31.429461 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-0fcf7c3a-53d9-4a97-8e91-3b9d1563ddce tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:26:31.429461 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:26:31.429461 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:26:31.430815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf7c3a-53d9-4a97-8e91-3b9d1563ddce tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:31.442061 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3167/6275] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:26:31 2022] GET /identity/v3/OS-OAUTH1/consumers/693c252a261642c9b9437b164f186a58 => generated 220 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:26:31.446561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ea1b1-aa82-4cd5-87a7-fb9b10ac0e7e tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:31.460278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ea1b1-aa82-4cd5-87a7-fb9b10ac0e7e tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:31.471613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee8f12-c3ba-436e-9263-3da2c3cd3279 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f6d83a050641839fc0b4f17f3e7eed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d746dc758f486aafa7eebaf42d1c2b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:31.473693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee8f12-c3ba-436e-9263-3da2c3cd3279 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:31.473991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee8f12-c3ba-436e-9263-3da2c3cd3279 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:31.475397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee8f12-c3ba-436e-9263-3da2c3cd3279 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/693c252a261642c9b9437b164f186a58` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:31.476063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee8f12-c3ba-436e-9263-3da2c3cd3279 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=693c252a261642c9b9437b164f186a58)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:31.488473 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-4aee8f12-c3ba-436e-9263-3da2c3cd3279 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:26:31.488473 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:26:31.488473 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:26:31.489051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee8f12-c3ba-436e-9263-3da2c3cd3279 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:31.489338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4aee8f12-c3ba-436e-9263-3da2c3cd3279 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invalidating token cache because consumer 693c252a261642c9b9437b164f186a58 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:26:31.489638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4aee8f12-c3ba-436e-9263-3da2c3cd3279 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:31.490429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4aee8f12-c3ba-436e-9263-3da2c3cd3279 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:31.537371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4aee8f12-c3ba-436e-9263-3da2c3cd3279 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '693c252a261642c9b9437b164f186a58', 'request_id': 'req-4aee8f12-c3ba-436e-9263-3da2c3cd3279'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:31.574685 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3109/6276] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Jul 30 21:26:31 2022] DELETE /identity/v3/OS-OAUTH1/consumers/693c252a261642c9b9437b164f186a58 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:31.585720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf7c3a-53d9-4a97-8e91-3b9d1563ddce tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:31.588170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0fcf7c3a-53d9-4a97-8e91-3b9d1563ddce tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:31.635660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf7c3a-53d9-4a97-8e91-3b9d1563ddce tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:31.649548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592d0e0-7335-4042-8f3c-ed9e4a4e8476 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f6d83a050641839fc0b4f17f3e7eed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d746dc758f486aafa7eebaf42d1c2b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:31.650547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592d0e0-7335-4042-8f3c-ed9e4a4e8476 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:31.650921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592d0e0-7335-4042-8f3c-ed9e4a4e8476 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:31.651280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592d0e0-7335-4042-8f3c-ed9e4a4e8476 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:31.652771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592d0e0-7335-4042-8f3c-ed9e4a4e8476 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:31.653895 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-d592d0e0-7335-4042-8f3c-ed9e4a4e8476 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:26:31.653895 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:26:31.653895 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:26:31.655170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592d0e0-7335-4042-8f3c-ed9e4a4e8476 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:31.698625 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3168/6277] 10.222.0.17 () {60 vars in 1185 bytes} [Sat Jul 30 21:26:31 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:31.702957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee8f12-c3ba-436e-9263-3da2c3cd3279 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:31.722350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee8f12-c3ba-436e-9263-3da2c3cd3279 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:31.757282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f250f7-c2fa-41bc-b99a-d488f6331379 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f6d83a050641839fc0b4f17f3e7eed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d746dc758f486aafa7eebaf42d1c2b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:31.759026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f250f7-c2fa-41bc-b99a-d488f6331379 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:31.760237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f250f7-c2fa-41bc-b99a-d488f6331379 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:31.760580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f250f7-c2fa-41bc-b99a-d488f6331379 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f007e19c9a5d41349b824b294aabbf02` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:31.763526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f250f7-c2fa-41bc-b99a-d488f6331379 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=f007e19c9a5d41349b824b294aabbf02)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:31.769874 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-c3f250f7-c2fa-41bc-b99a-d488f6331379 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:26:31.769874 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:26:31.769874 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:26:31.775909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f250f7-c2fa-41bc-b99a-d488f6331379 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:31.797231 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3110/6278] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:26:31 2022] GET /identity/v3/OS-OAUTH1/consumers/f007e19c9a5d41349b824b294aabbf02 => generated 221 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:26:31.801800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592d0e0-7335-4042-8f3c-ed9e4a4e8476 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:31.814769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592d0e0-7335-4042-8f3c-ed9e4a4e8476 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:31.821672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfde95-69da-498b-b18c-b6d954b25e0d tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f6d83a050641839fc0b4f17f3e7eed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d746dc758f486aafa7eebaf42d1c2b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:31.822817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfde95-69da-498b-b18c-b6d954b25e0d tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:31.823953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfde95-69da-498b-b18c-b6d954b25e0d tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:31.824446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfde95-69da-498b-b18c-b6d954b25e0d tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f007e19c9a5d41349b824b294aabbf02` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:31.825731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfde95-69da-498b-b18c-b6d954b25e0d tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=f007e19c9a5d41349b824b294aabbf02)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:31.827243 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-42dfde95-69da-498b-b18c-b6d954b25e0d tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:26:31.827243 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:26:31.827243 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:26:31.828965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfde95-69da-498b-b18c-b6d954b25e0d tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:31.829651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-42dfde95-69da-498b-b18c-b6d954b25e0d tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invalidating token cache because consumer f007e19c9a5d41349b824b294aabbf02 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:26:31.830220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-42dfde95-69da-498b-b18c-b6d954b25e0d tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:31.831486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-42dfde95-69da-498b-b18c-b6d954b25e0d tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:31.864647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-42dfde95-69da-498b-b18c-b6d954b25e0d tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'f007e19c9a5d41349b824b294aabbf02', 'request_id': 'req-42dfde95-69da-498b-b18c-b6d954b25e0d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:31.894896 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3169/6279] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Jul 30 21:26:31 2022] DELETE /identity/v3/OS-OAUTH1/consumers/f007e19c9a5d41349b824b294aabbf02 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:31.898815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f250f7-c2fa-41bc-b99a-d488f6331379 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:31.902625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c3f250f7-c2fa-41bc-b99a-d488f6331379 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:31.925545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f250f7-c2fa-41bc-b99a-d488f6331379 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:31.935466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d0160-9117-4dcc-bb34-febc7d5f6091 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f6d83a050641839fc0b4f17f3e7eed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d746dc758f486aafa7eebaf42d1c2b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:31.936444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d0160-9117-4dcc-bb34-febc7d5f6091 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:31.936849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d0160-9117-4dcc-bb34-febc7d5f6091 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:31.937245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d0160-9117-4dcc-bb34-febc7d5f6091 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f007e19c9a5d41349b824b294aabbf02` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:31.938113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d0160-9117-4dcc-bb34-febc7d5f6091 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=f007e19c9a5d41349b824b294aabbf02)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:31.941408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d0160-9117-4dcc-bb34-febc7d5f6091 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:31.979432 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-5f8d0160-9117-4dcc-bb34-febc7d5f6091 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jul 30 21:26:31.979432 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:26:31.979432 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:26:31.979432 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:26:31.979432 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:26:31.979432 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:26:31.979432 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:26:31.979432 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:26:31.979432 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:26:31.979432 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:26:31.979432 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:26:31.979432 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:26:31.979432 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Jul 30 21:26:31.979432 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Jul 30 21:26:31.979432 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Jul 30 21:26:31.980807 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Jul 30 21:26:31.980807 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Jul 30 21:26:31.980807 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Jul 30 21:26:31.980807 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Jul 30 21:26:31.980807 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jul 30 21:26:31.980807 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jul 30 21:26:31.980807 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jul 30 21:26:31.980807 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jul 30 21:26:31.980807 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:26:31.983506 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3111/6280] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:26:31 2022] GET /identity/v3/OS-OAUTH1/consumers/f007e19c9a5d41349b824b294aabbf02 => generated 74 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 21:26:31.988415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfde95-69da-498b-b18c-b6d954b25e0d tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:32.009983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfde95-69da-498b-b18c-b6d954b25e0d tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:32.041413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbba05-4660-46b9-9bba-29e27276fabd tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f6d83a050641839fc0b4f17f3e7eed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d746dc758f486aafa7eebaf42d1c2b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:32.042112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbba05-4660-46b9-9bba-29e27276fabd tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:32.042404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbba05-4660-46b9-9bba-29e27276fabd tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:32.042683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbba05-4660-46b9-9bba-29e27276fabd tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f007e19c9a5d41349b824b294aabbf02` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:32.043358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbba05-4660-46b9-9bba-29e27276fabd tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=f007e19c9a5d41349b824b294aabbf02)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:32.048364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbba05-4660-46b9-9bba-29e27276fabd tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:32.048650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a7cbba05-4660-46b9-9bba-29e27276fabd tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invalidating token cache because consumer f007e19c9a5d41349b824b294aabbf02 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:26:32.048945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a7cbba05-4660-46b9-9bba-29e27276fabd tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:32.049732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a7cbba05-4660-46b9-9bba-29e27276fabd tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:32.091875 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-a7cbba05-4660-46b9-9bba-29e27276fabd tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jul 30 21:26:32.091875 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:26:32.091875 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:26:32.091875 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:26:32.091875 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:26:32.091875 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:26:32.091875 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:26:32.091875 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:26:32.091875 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:26:32.091875 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:26:32.091875 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:26:32.091875 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:26:32.091875 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Jul 30 21:26:32.091875 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Jul 30 21:26:32.091875 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:26:32.093131 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:26:32.093131 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Jul 30 21:26:32.093131 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Jul 30 21:26:32.093131 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Jul 30 21:26:32.093131 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Jul 30 21:26:32.093131 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Jul 30 21:26:32.093131 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jul 30 21:26:32.093131 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jul 30 21:26:32.093131 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jul 30 21:26:32.093131 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jul 30 21:26:32.093131 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:26:32.093975 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3170/6281] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Jul 30 21:26:31 2022] DELETE /identity/v3/OS-OAUTH1/consumers/f007e19c9a5d41349b824b294aabbf02 => generated 74 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 21:26:32.100962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d0160-9117-4dcc-bb34-febc7d5f6091 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:32.103517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5f8d0160-9117-4dcc-bb34-febc7d5f6091 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:32.133436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d0160-9117-4dcc-bb34-febc7d5f6091 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:32.148377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc732f-5b36-4e3e-8cec-89bb9c7ef754 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f6d83a050641839fc0b4f17f3e7eed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d746dc758f486aafa7eebaf42d1c2b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:32.149155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc732f-5b36-4e3e-8cec-89bb9c7ef754 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:32.150603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc732f-5b36-4e3e-8cec-89bb9c7ef754 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:32.151011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc732f-5b36-4e3e-8cec-89bb9c7ef754 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:32.152575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc732f-5b36-4e3e-8cec-89bb9c7ef754 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:32.158083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc732f-5b36-4e3e-8cec-89bb9c7ef754 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:32.190467 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3112/6282] 10.222.0.17 () {60 vars in 1185 bytes} [Sat Jul 30 21:26:32 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:32.191991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbba05-4660-46b9-9bba-29e27276fabd tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:32.204754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbba05-4660-46b9-9bba-29e27276fabd tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:32.211191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf81171-498f-403b-b1f0-94c41a77f365 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f6d83a050641839fc0b4f17f3e7eed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d746dc758f486aafa7eebaf42d1c2b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:32.212375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf81171-498f-403b-b1f0-94c41a77f365 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:32.212907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf81171-498f-403b-b1f0-94c41a77f365 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:32.213305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf81171-498f-403b-b1f0-94c41a77f365 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:32.214227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf81171-498f-403b-b1f0-94c41a77f365 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:32.216612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf81171-498f-403b-b1f0-94c41a77f365 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:32.232389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:32.242069 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3171/6283] 10.222.0.17 () {60 vars in 1185 bytes} [Sat Jul 30 21:26:32 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:32.246684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc732f-5b36-4e3e-8cec-89bb9c7ef754 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:32.260543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc732f-5b36-4e3e-8cec-89bb9c7ef754 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:32.267682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c60c78-db22-452a-b0e1-4f884a646c68 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f6d83a050641839fc0b4f17f3e7eed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d746dc758f486aafa7eebaf42d1c2b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:32.268490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c60c78-db22-452a-b0e1-4f884a646c68 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:32.268965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c60c78-db22-452a-b0e1-4f884a646c68 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:32.269361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c60c78-db22-452a-b0e1-4f884a646c68 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:32.270198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c60c78-db22-452a-b0e1-4f884a646c68 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:32.271627 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-45c60c78-db22-452a-b0e1-4f884a646c68 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:26:32.271627 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:26:32.271627 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:26:32.272986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c60c78-db22-452a-b0e1-4f884a646c68 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:32.282541 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3113/6284] 10.222.0.17 () {58 vars in 1164 bytes} [Sat Jul 30 21:26:32 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 537 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:26:32.287779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf81171-498f-403b-b1f0-94c41a77f365 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:32.302371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf81171-498f-403b-b1f0-94c41a77f365 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:32.311997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b2eb7-c348-4087-8fac-e9efc8c41658 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f6d83a050641839fc0b4f17f3e7eed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d746dc758f486aafa7eebaf42d1c2b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:32.313231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b2eb7-c348-4087-8fac-e9efc8c41658 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:32.313904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b2eb7-c348-4087-8fac-e9efc8c41658 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:32.314866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b2eb7-c348-4087-8fac-e9efc8c41658 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/bd622617041044cdbe5962b836b11752` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:32.316389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b2eb7-c348-4087-8fac-e9efc8c41658 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=bd622617041044cdbe5962b836b11752)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:32.318266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b2eb7-c348-4087-8fac-e9efc8c41658 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:32.318677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0a6b2eb7-c348-4087-8fac-e9efc8c41658 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invalidating token cache because consumer bd622617041044cdbe5962b836b11752 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:26:32.319011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0a6b2eb7-c348-4087-8fac-e9efc8c41658 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:32.320447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0a6b2eb7-c348-4087-8fac-e9efc8c41658 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:32.341767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0a6b2eb7-c348-4087-8fac-e9efc8c41658 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'bd622617041044cdbe5962b836b11752', 'request_id': 'req-0a6b2eb7-c348-4087-8fac-e9efc8c41658'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:32.399094 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3172/6285] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Jul 30 21:26:32 2022] DELETE /identity/v3/OS-OAUTH1/consumers/bd622617041044cdbe5962b836b11752 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:26:32.403759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c60c78-db22-452a-b0e1-4f884a646c68 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:32.406068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-45c60c78-db22-452a-b0e1-4f884a646c68 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:32.433196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c60c78-db22-452a-b0e1-4f884a646c68 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:32.443404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb2de6-efc8-4fd2-b9ec-71c2e9d7201a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f6d83a050641839fc0b4f17f3e7eed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d746dc758f486aafa7eebaf42d1c2b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:32.444579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb2de6-efc8-4fd2-b9ec-71c2e9d7201a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:32.444881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb2de6-efc8-4fd2-b9ec-71c2e9d7201a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:32.445181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb2de6-efc8-4fd2-b9ec-71c2e9d7201a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/b341a1bdec274487b99b6f5ebe961550` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:32.448422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb2de6-efc8-4fd2-b9ec-71c2e9d7201a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=b341a1bdec274487b99b6f5ebe961550)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:32.453273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb2de6-efc8-4fd2-b9ec-71c2e9d7201a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:32.453621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9ecb2de6-efc8-4fd2-b9ec-71c2e9d7201a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invalidating token cache because consumer b341a1bdec274487b99b6f5ebe961550 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:26:32.453974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9ecb2de6-efc8-4fd2-b9ec-71c2e9d7201a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:32.454790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9ecb2de6-efc8-4fd2-b9ec-71c2e9d7201a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:32.466687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:INSERT=8,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:32.476598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9ecb2de6-efc8-4fd2-b9ec-71c2e9d7201a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'b341a1bdec274487b99b6f5ebe961550', 'request_id': 'req-9ecb2de6-efc8-4fd2-b9ec-71c2e9d7201a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:32.513314 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3114/6286] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Jul 30 21:26:32 2022] DELETE /identity/v3/OS-OAUTH1/consumers/b341a1bdec274487b99b6f5ebe961550 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:32.519773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b2eb7-c348-4087-8fac-e9efc8c41658 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:32.536856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b2eb7-c348-4087-8fac-e9efc8c41658 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:32.555780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e821a5-97f6-43f7-bdc1-65f4c65e4f00 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f6d83a050641839fc0b4f17f3e7eed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d746dc758f486aafa7eebaf42d1c2b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:32.556477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e821a5-97f6-43f7-bdc1-65f4c65e4f00 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:32.556772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e821a5-97f6-43f7-bdc1-65f4c65e4f00 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:32.557061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e821a5-97f6-43f7-bdc1-65f4c65e4f00 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:32.559969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e821a5-97f6-43f7-bdc1-65f4c65e4f00 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:32.562767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e821a5-97f6-43f7-bdc1-65f4c65e4f00 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:32.598076 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3173/6287] 10.222.0.17 () {60 vars in 1185 bytes} [Sat Jul 30 21:26:32 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:32.602038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb2de6-efc8-4fd2-b9ec-71c2e9d7201a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:32.604030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9ecb2de6-efc8-4fd2-b9ec-71c2e9d7201a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:32.644835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb2de6-efc8-4fd2-b9ec-71c2e9d7201a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:32.655432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871397f-fe94-43eb-bc73-017a111db129 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f6d83a050641839fc0b4f17f3e7eed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d746dc758f486aafa7eebaf42d1c2b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:32.656278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871397f-fe94-43eb-bc73-017a111db129 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:32.656811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871397f-fe94-43eb-bc73-017a111db129 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:32.657252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871397f-fe94-43eb-bc73-017a111db129 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4e53f5080d6a4f96b6e4f24ed8d993d8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:32.658731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871397f-fe94-43eb-bc73-017a111db129 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=4e53f5080d6a4f96b6e4f24ed8d993d8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:32.681976 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-b871397f-fe94-43eb-bc73-017a111db129 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:26:32.681976 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:26:32.681976 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:26:32.684284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871397f-fe94-43eb-bc73-017a111db129 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:32.747216 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3115/6288] 10.222.0.17 () {60 vars in 1285 bytes} [Sat Jul 30 21:26:32 2022] PATCH /identity/v3/OS-OAUTH1/consumers/4e53f5080d6a4f96b6e4f24ed8d993d8 => generated 221 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:26:32.751936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e821a5-97f6-43f7-bdc1-65f4c65e4f00 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:32.764780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e821a5-97f6-43f7-bdc1-65f4c65e4f00 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:32.773471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c7439-d045-4932-b9d4-f240730e2f1a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f6d83a050641839fc0b4f17f3e7eed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d746dc758f486aafa7eebaf42d1c2b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:32.774448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c7439-d045-4932-b9d4-f240730e2f1a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:32.775013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c7439-d045-4932-b9d4-f240730e2f1a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:32.788680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c7439-d045-4932-b9d4-f240730e2f1a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4e53f5080d6a4f96b6e4f24ed8d993d8` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:32.789658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c7439-d045-4932-b9d4-f240730e2f1a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=4e53f5080d6a4f96b6e4f24ed8d993d8)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:32.791601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c7439-d045-4932-b9d4-f240730e2f1a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:32.797865 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3174/6289] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:26:32 2022] GET /identity/v3/OS-OAUTH1/consumers/4e53f5080d6a4f96b6e4f24ed8d993d8 => generated 221 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:26:32.801971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871397f-fe94-43eb-bc73-017a111db129 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:32.820427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871397f-fe94-43eb-bc73-017a111db129 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:32.851083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2506562-2ebb-43ce-9980-32d31be9bac1 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f6d83a050641839fc0b4f17f3e7eed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d746dc758f486aafa7eebaf42d1c2b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:32.852188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2506562-2ebb-43ce-9980-32d31be9bac1 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:32.852617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2506562-2ebb-43ce-9980-32d31be9bac1 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:32.853020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2506562-2ebb-43ce-9980-32d31be9bac1 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4e53f5080d6a4f96b6e4f24ed8d993d8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:32.853799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2506562-2ebb-43ce-9980-32d31be9bac1 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=4e53f5080d6a4f96b6e4f24ed8d993d8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:32.857968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2506562-2ebb-43ce-9980-32d31be9bac1 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:32.866418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f2506562-2ebb-43ce-9980-32d31be9bac1 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invalidating token cache because consumer 4e53f5080d6a4f96b6e4f24ed8d993d8 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:26:32.867002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f2506562-2ebb-43ce-9980-32d31be9bac1 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:32.868054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f2506562-2ebb-43ce-9980-32d31be9bac1 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:32.906950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f2506562-2ebb-43ce-9980-32d31be9bac1 tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '4e53f5080d6a4f96b6e4f24ed8d993d8', 'request_id': 'req-f2506562-2ebb-43ce-9980-32d31be9bac1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:32.936646 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3116/6290] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Jul 30 21:26:32 2022] DELETE /identity/v3/OS-OAUTH1/consumers/4e53f5080d6a4f96b6e4f24ed8d993d8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:32.938091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c7439-d045-4932-b9d4-f240730e2f1a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:32.941473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2a9c7439-d045-4932-b9d4-f240730e2f1a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:33.110680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c7439-d045-4932-b9d4-f240730e2f1a tempest-OAUTHConsumersV3Test-1958141814 tempest-OAUTHConsumersV3Test-1958141814-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:33.123895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d862b-8cc0-45e7-9845-ba72faeafde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:33.125659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d862b-8cc0-45e7-9845-ba72faeafde3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:33.125945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d862b-8cc0-45e7-9845-ba72faeafde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:33.126692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d862b-8cc0-45e7-9845-ba72faeafde3 admin admin] PATH_INFO: `/v3/users/d0586a8161374a1ca8fc44fc27fe8eff` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:33.128823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d862b-8cc0-45e7-9845-ba72faeafde3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0586a8161374a1ca8fc44fc27fe8eff)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:33.131200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d862b-8cc0-45e7-9845-ba72faeafde3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:33.265122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-495d862b-8cc0-45e7-9845-ba72faeafde3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0586a8161374a1ca8fc44fc27fe8eff'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:33.310398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-495d862b-8cc0-45e7-9845-ba72faeafde3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0586a8161374a1ca8fc44fc27fe8eff'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:33.311255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-495d862b-8cc0-45e7-9845-ba72faeafde3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0586a8161374a1ca8fc44fc27fe8eff'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:33.335428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-495d862b-8cc0-45e7-9845-ba72faeafde3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0586a8161374a1ca8fc44fc27fe8eff'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:33.336222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-495d862b-8cc0-45e7-9845-ba72faeafde3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0586a8161374a1ca8fc44fc27fe8eff'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:33.372677 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3175/6291] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:26:32 2022] DELETE /identity/v3/users/d0586a8161374a1ca8fc44fc27fe8eff => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:33.378790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d0415-52f4-49dc-a907-49c30315e610 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:33.379197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d0415-52f4-49dc-a907-49c30315e610 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:33.379749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d0415-52f4-49dc-a907-49c30315e610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:33.424503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-178d0415-52f4-49dc-a907-49c30315e610 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:33.426928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-178d0415-52f4-49dc-a907-49c30315e610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:33.593096 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3117/6292] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:33.633786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d862b-8cc0-45e7-9845-ba72faeafde3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:33.636841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-495d862b-8cc0-45e7-9845-ba72faeafde3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:33.723800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:33.788149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d862b-8cc0-45e7-9845-ba72faeafde3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:33.795041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c68bb-7192-4087-80da-ec159d59f9f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:33.795861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c68bb-7192-4087-80da-ec159d59f9f6 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:33.797251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c68bb-7192-4087-80da-ec159d59f9f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:33.797805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c68bb-7192-4087-80da-ec159d59f9f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:33.830946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c68bb-7192-4087-80da-ec159d59f9f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:33.832615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c68bb-7192-4087-80da-ec159d59f9f6 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:33.859204 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3176/6293] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:26:35.155726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d0415-52f4-49dc-a907-49c30315e610 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:35.156494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-178d0415-52f4-49dc-a907-49c30315e610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:35.181677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d0415-52f4-49dc-a907-49c30315e610 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:35.205645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74125d43-cb94-48ef-b702-b92e521562e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:35.206332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74125d43-cb94-48ef-b702-b92e521562e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:35.206617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74125d43-cb94-48ef-b702-b92e521562e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:35.206893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74125d43-cb94-48ef-b702-b92e521562e7 admin admin] PATH_INFO: `/v3/projects/6cb1e3fca3be4ec3bf867995a659de27` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:35.216816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74125d43-cb94-48ef-b702-b92e521562e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cb1e3fca3be4ec3bf867995a659de27)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:35.218946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74125d43-cb94-48ef-b702-b92e521562e7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:35.335162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-74125d43-cb94-48ef-b702-b92e521562e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb1e3fca3be4ec3bf867995a659de27', 'request_id': 'req-74125d43-cb94-48ef-b702-b92e521562e7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:35.366865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-74125d43-cb94-48ef-b702-b92e521562e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb1e3fca3be4ec3bf867995a659de27', 'request_id': 'req-74125d43-cb94-48ef-b702-b92e521562e7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:35.375996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-74125d43-cb94-48ef-b702-b92e521562e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb1e3fca3be4ec3bf867995a659de27', 'request_id': 'req-74125d43-cb94-48ef-b702-b92e521562e7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:35.393868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-74125d43-cb94-48ef-b702-b92e521562e7 admin admin] The token cache is being invalidate because project 6cb1e3fca3be4ec3bf867995a659de27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:26:35.394475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-74125d43-cb94-48ef-b702-b92e521562e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:35.402862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-74125d43-cb94-48ef-b702-b92e521562e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:35.404636 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3118/6294] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:26:35 2022] DELETE /identity/v3/projects/6cb1e3fca3be4ec3bf867995a659de27 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:35.409050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c68bb-7192-4087-80da-ec159d59f9f6 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:35.438090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c68bb-7192-4087-80da-ec159d59f9f6 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:35.445671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba2544-25f2-43c1-9008-629df7a8f791 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:35.446290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba2544-25f2-43c1-9008-629df7a8f791 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:35.446751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba2544-25f2-43c1-9008-629df7a8f791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:35.489651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-99ba2544-25f2-43c1-9008-629df7a8f791 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:35.497622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-99ba2544-25f2-43c1-9008-629df7a8f791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:35.569854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=10,keystone:UPDATE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:35.629688 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3119/6295] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:26:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:35.659163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d7533-81e2-436e-9363-5d3a755ec10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:35.661077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d7533-81e2-436e-9363-5d3a755ec10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:35.661612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d7533-81e2-436e-9363-5d3a755ec10d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:35.665570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d7533-81e2-436e-9363-5d3a755ec10d admin admin] PATH_INFO: `/v3/users/10f6d83a050641839fc0b4f17f3e7eed` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:35.667239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d7533-81e2-436e-9363-5d3a755ec10d admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f6d83a050641839fc0b4f17f3e7eed)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:35.677098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d7533-81e2-436e-9363-5d3a755ec10d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:35.698517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba2544-25f2-43c1-9008-629df7a8f791 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:35.700691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-99ba2544-25f2-43c1-9008-629df7a8f791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:35.763264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1c4d7533-81e2-436e-9363-5d3a755ec10d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f6d83a050641839fc0b4f17f3e7eed'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:35.799389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1c4d7533-81e2-436e-9363-5d3a755ec10d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f6d83a050641839fc0b4f17f3e7eed'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:35.800902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1c4d7533-81e2-436e-9363-5d3a755ec10d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f6d83a050641839fc0b4f17f3e7eed'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:35.825442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1c4d7533-81e2-436e-9363-5d3a755ec10d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f6d83a050641839fc0b4f17f3e7eed'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:35.826694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1c4d7533-81e2-436e-9363-5d3a755ec10d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f6d83a050641839fc0b4f17f3e7eed'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:35.858057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba2544-25f2-43c1-9008-629df7a8f791 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:35.863479 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3177/6296] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:26:35 2022] DELETE /identity/v3/users/10f6d83a050641839fc0b4f17f3e7eed => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:35.883055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7ed45-2683-4129-99fa-06188448efc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:35.884813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7ed45-2683-4129-99fa-06188448efc4 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:35.885565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7ed45-2683-4129-99fa-06188448efc4 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:35.886067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7ed45-2683-4129-99fa-06188448efc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:35.891198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dde7ed45-2683-4129-99fa-06188448efc4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:35.919599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7ed45-2683-4129-99fa-06188448efc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:35.930949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7ed45-2683-4129-99fa-06188448efc4 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:35.961327 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3120/6297] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:26:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 30 21:26:36.650573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d7533-81e2-436e-9363-5d3a755ec10d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:36.652599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1c4d7533-81e2-436e-9363-5d3a755ec10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:36.770058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:36.797632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d7533-81e2-436e-9363-5d3a755ec10d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:36.818957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b7ab0-5c7f-4d5d-90b8-8fb0befa49f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:36.819941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b7ab0-5c7f-4d5d-90b8-8fb0befa49f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:36.820079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b7ab0-5c7f-4d5d-90b8-8fb0befa49f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:36.820355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b7ab0-5c7f-4d5d-90b8-8fb0befa49f8 admin admin] PATH_INFO: `/v3/projects/98d746dc758f486aafa7eebaf42d1c2b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:36.822701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b7ab0-5c7f-4d5d-90b8-8fb0befa49f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98d746dc758f486aafa7eebaf42d1c2b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:36.824678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b7ab0-5c7f-4d5d-90b8-8fb0befa49f8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:36.951693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d97b7ab0-5c7f-4d5d-90b8-8fb0befa49f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98d746dc758f486aafa7eebaf42d1c2b', 'request_id': 'req-d97b7ab0-5c7f-4d5d-90b8-8fb0befa49f8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:36.974838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d97b7ab0-5c7f-4d5d-90b8-8fb0befa49f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98d746dc758f486aafa7eebaf42d1c2b', 'request_id': 'req-d97b7ab0-5c7f-4d5d-90b8-8fb0befa49f8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:37.013696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d97b7ab0-5c7f-4d5d-90b8-8fb0befa49f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98d746dc758f486aafa7eebaf42d1c2b', 'request_id': 'req-d97b7ab0-5c7f-4d5d-90b8-8fb0befa49f8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:37.038038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d97b7ab0-5c7f-4d5d-90b8-8fb0befa49f8 admin admin] The token cache is being invalidate because project 98d746dc758f486aafa7eebaf42d1c2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:26:37.038241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716d7b5-f1ce-4e06-9f73-00279e2c9273 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:37.038695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716d7b5-f1ce-4e06-9f73-00279e2c9273 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:37.038695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716d7b5-f1ce-4e06-9f73-00279e2c9273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:37.039324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d97b7ab0-5c7f-4d5d-90b8-8fb0befa49f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:37.040937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d97b7ab0-5c7f-4d5d-90b8-8fb0befa49f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:37.047794 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3178/6298] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:26:36 2022] DELETE /identity/v3/projects/98d746dc758f486aafa7eebaf42d1c2b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:37.049209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7f788-034d-490d-893c-a67375231e1f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:37.049504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7f788-034d-490d-893c-a67375231e1f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:37.050317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7f788-034d-490d-893c-a67375231e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:37.101653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0716d7b5-f1ce-4e06-9f73-00279e2c9273 None None] MFA Rules not processed for user `a90fd14f0cf34e148935f79cf381f903`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:37.103378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0716d7b5-f1ce-4e06-9f73-00279e2c9273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:37.261774 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3121/6299] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:37 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:26:37.277070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f032e-dffb-443a-b015-79d1010ebef9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:37.278065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f032e-dffb-443a-b015-79d1010ebef9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:37.278885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f032e-dffb-443a-b015-79d1010ebef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:37.304054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-555f032e-dffb-443a-b015-79d1010ebef9 None None] MFA Rules not processed for user `b0b7534856ad4817b1b15a2505a791dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:37.306103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-555f032e-dffb-443a-b015-79d1010ebef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:37.366352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:37.386356 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3122/6300] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:37 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:37.394530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f032e-dffb-443a-b015-79d1010ebef9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:37.397039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-555f032e-dffb-443a-b015-79d1010ebef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:37.507138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-55a7f788-034d-490d-893c-a67375231e1f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:37.512137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-55a7f788-034d-490d-893c-a67375231e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:37.541360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f032e-dffb-443a-b015-79d1010ebef9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:37.550682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2530e1-2cd5-4f0b-bf55-1a9f3e5fa1c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:37.552010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2530e1-2cd5-4f0b-bf55-1a9f3e5fa1c5 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:37.552798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2530e1-2cd5-4f0b-bf55-1a9f3e5fa1c5 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:37.553998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2530e1-2cd5-4f0b-bf55-1a9f3e5fa1c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:37.558774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fe2530e1-2cd5-4f0b-bf55-1a9f3e5fa1c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:37.586009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2530e1-2cd5-4f0b-bf55-1a9f3e5fa1c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:37.588194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2530e1-2cd5-4f0b-bf55-1a9f3e5fa1c5 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:37.604323 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3123/6301] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:26:37 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:26:37.667534 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3179/6302] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 619 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:37.791771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78347c-00bd-4962-853e-626110c38d54 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:37.792044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78347c-00bd-4962-853e-626110c38d54 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:37.792333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78347c-00bd-4962-853e-626110c38d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:37.828369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8f78347c-00bd-4962-853e-626110c38d54 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:37.834130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8f78347c-00bd-4962-853e-626110c38d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:37.854266 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3124/6303] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:37.858461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7f788-034d-490d-893c-a67375231e1f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:37.880174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7f788-034d-490d-893c-a67375231e1f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:37.887910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cbe62-6c35-4d17-9542-cedbb0998541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:37.888808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cbe62-6c35-4d17-9542-cedbb0998541 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:37.889298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cbe62-6c35-4d17-9542-cedbb0998541 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:37.890043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cbe62-6c35-4d17-9542-cedbb0998541 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:37.891171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cbe62-6c35-4d17-9542-cedbb0998541 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:26:37.891746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cbe62-6c35-4d17-9542-cedbb0998541 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:37.894407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cbe62-6c35-4d17-9542-cedbb0998541 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:37.911156 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3180/6304] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:26:37.915211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78347c-00bd-4962-853e-626110c38d54 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:37.926041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78347c-00bd-4962-853e-626110c38d54 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:37.931206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd745e0-72b5-4387-af5a-80a863cfad2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:37.931921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd745e0-72b5-4387-af5a-80a863cfad2f admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:37.932209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd745e0-72b5-4387-af5a-80a863cfad2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:37.932490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd745e0-72b5-4387-af5a-80a863cfad2f admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:37.933167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd745e0-72b5-4387-af5a-80a863cfad2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:37.935118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd745e0-72b5-4387-af5a-80a863cfad2f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:38.007040 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3125/6305] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:26:37 2022] POST /identity/v3/projects => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:38.015260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cbe62-6c35-4d17-9542-cedbb0998541 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:38.027801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cbe62-6c35-4d17-9542-cedbb0998541 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:38.126493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784180d-5dfc-4a57-9ae3-1c0b07e2c1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:38.127683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784180d-5dfc-4a57-9ae3-1c0b07e2c1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:38.128385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784180d-5dfc-4a57-9ae3-1c0b07e2c1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:38.128889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784180d-5dfc-4a57-9ae3-1c0b07e2c1e6 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:38.130269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784180d-5dfc-4a57-9ae3-1c0b07e2c1e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:38.133662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784180d-5dfc-4a57-9ae3-1c0b07e2c1e6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:38.162860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:38.176500 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3181/6306] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:26:38 2022] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:38.178274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd745e0-72b5-4387-af5a-80a863cfad2f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:38.196822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd745e0-72b5-4387-af5a-80a863cfad2f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:38.216090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf632373-1e33-47c2-b094-0a274a308912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:38.216829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf632373-1e33-47c2-b094-0a274a308912 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:38.217177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf632373-1e33-47c2-b094-0a274a308912 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:38.217528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf632373-1e33-47c2-b094-0a274a308912 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:38.218318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf632373-1e33-47c2-b094-0a274a308912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:38.220333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf632373-1e33-47c2-b094-0a274a308912 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:38.243944 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3126/6307] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:26:38.247657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784180d-5dfc-4a57-9ae3-1c0b07e2c1e6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:38.261254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784180d-5dfc-4a57-9ae3-1c0b07e2c1e6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:38.273070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1ea0f-1c3c-44c0-bebc-e908579297f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:38.274090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1ea0f-1c3c-44c0-bebc-e908579297f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:38.274482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1ea0f-1c3c-44c0-bebc-e908579297f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:38.274854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1ea0f-1c3c-44c0-bebc-e908579297f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:38.277099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1ea0f-1c3c-44c0-bebc-e908579297f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:38.280178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1ea0f-1c3c-44c0-bebc-e908579297f4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:38.294890 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3182/6308] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:26:38.298829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf632373-1e33-47c2-b094-0a274a308912 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:38.312658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf632373-1e33-47c2-b094-0a274a308912 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:38.319561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f9019-a4ad-4126-adf3-a26e4ec3ba15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:38.320429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f9019-a4ad-4126-adf3-a26e4ec3ba15 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:38.320819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f9019-a4ad-4126-adf3-a26e4ec3ba15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:38.321258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f9019-a4ad-4126-adf3-a26e4ec3ba15 admin admin] PATH_INFO: `/v3/projects/ed694e2b1efb432ab1e51508f6326412/users/db4b179bdfd34c358b299035d6e1d076/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:38.367655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f9019-a4ad-4126-adf3-a26e4ec3ba15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed694e2b1efb432ab1e51508f6326412, user_id=db4b179bdfd34c358b299035d6e1d076, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:38.370678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f9019-a4ad-4126-adf3-a26e4ec3ba15 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:38.431430 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3127/6309] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:26:38 2022] PUT /identity/v3/projects/ed694e2b1efb432ab1e51508f6326412/users/db4b179bdfd34c358b299035d6e1d076/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:38.434289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d0808-b3b0-4000-b079-2e1e72ded22b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:38.434885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d0808-b3b0-4000-b079-2e1e72ded22b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:38.435272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d0808-b3b0-4000-b079-2e1e72ded22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:38.474617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4e5d0808-b3b0-4000-b079-2e1e72ded22b None None] MFA Rules not processed for user `db4b179bdfd34c358b299035d6e1d076`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:38.477353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4e5d0808-b3b0-4000-b079-2e1e72ded22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:38.507753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f9019-a4ad-4126-adf3-a26e4ec3ba15 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:38.509772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6b4f9019-a4ad-4126-adf3-a26e4ec3ba15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:38.665084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f9019-a4ad-4126-adf3-a26e4ec3ba15 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:38.671667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e4046-acb5-40fb-b36e-4381ed1f7c71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:38.672011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e4046-acb5-40fb-b36e-4381ed1f7c71 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:38.672282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e4046-acb5-40fb-b36e-4381ed1f7c71 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:38.672808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e4046-acb5-40fb-b36e-4381ed1f7c71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:38.673046 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3183/6310] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:38.675616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b20e4046-acb5-40fb-b36e-4381ed1f7c71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:38.676204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d0808-b3b0-4000-b079-2e1e72ded22b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:38.692311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e4046-acb5-40fb-b36e-4381ed1f7c71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:38.693954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e4046-acb5-40fb-b36e-4381ed1f7c71 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:38.732269 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3128/6311] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:26:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:26:38.839719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d0808-b3b0-4000-b079-2e1e72ded22b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:38.849852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815f054-f12d-4a9e-b76e-2da347bc5495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:38.851256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815f054-f12d-4a9e-b76e-2da347bc5495 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:38.852992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815f054-f12d-4a9e-b76e-2da347bc5495 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:38.853600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815f054-f12d-4a9e-b76e-2da347bc5495 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:38.858047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815f054-f12d-4a9e-b76e-2da347bc5495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:38.868444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815f054-f12d-4a9e-b76e-2da347bc5495 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:38.943819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e4046-acb5-40fb-b36e-4381ed1f7c71 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:38.945738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b20e4046-acb5-40fb-b36e-4381ed1f7c71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:38.950870 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3184/6312] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:26:38 2022] POST /identity/v3/projects => generated 369 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:38.955705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815f054-f12d-4a9e-b76e-2da347bc5495 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:38.972634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:39.069644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815f054-f12d-4a9e-b76e-2da347bc5495 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:39.080220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cabb9-26b3-4a1e-b6b2-d789b29566c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:39.082511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cabb9-26b3-4a1e-b6b2-d789b29566c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:39.083954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cabb9-26b3-4a1e-b6b2-d789b29566c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:39.084547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cabb9-26b3-4a1e-b6b2-d789b29566c9 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:39.086167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cabb9-26b3-4a1e-b6b2-d789b29566c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:39.089202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cabb9-26b3-4a1e-b6b2-d789b29566c9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:39.106720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e4046-acb5-40fb-b36e-4381ed1f7c71 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:39.123453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:39.159884 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3185/6313] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:26:38 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:39.165526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cabb9-26b3-4a1e-b6b2-d789b29566c9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:39.179944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cabb9-26b3-4a1e-b6b2-d789b29566c9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:39.186220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b1944-fbbe-4c22-8cc6-52ce961fff84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:39.186908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b1944-fbbe-4c22-8cc6-52ce961fff84 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:39.187245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b1944-fbbe-4c22-8cc6-52ce961fff84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:39.187527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b1944-fbbe-4c22-8cc6-52ce961fff84 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:39.188575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b1944-fbbe-4c22-8cc6-52ce961fff84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:39.190880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b1944-fbbe-4c22-8cc6-52ce961fff84 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:39.205484 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3186/6314] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:26:39.210278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b1944-fbbe-4c22-8cc6-52ce961fff84 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:39.222944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b1944-fbbe-4c22-8cc6-52ce961fff84 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:39.227917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea2a8e-15f5-4b15-bb3c-9c88c3cb0c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:39.228798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea2a8e-15f5-4b15-bb3c-9c88c3cb0c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:39.228942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea2a8e-15f5-4b15-bb3c-9c88c3cb0c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:39.229223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea2a8e-15f5-4b15-bb3c-9c88c3cb0c0c admin admin] PATH_INFO: `/v3/projects/bd58845d8aef4018a73c94ec1eae1525/users/8fb81ac61c1141c2856401d2ffd583b9/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:39.248471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea2a8e-15f5-4b15-bb3c-9c88c3cb0c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd58845d8aef4018a73c94ec1eae1525, user_id=8fb81ac61c1141c2856401d2ffd583b9, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:39.252567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea2a8e-15f5-4b15-bb3c-9c88c3cb0c0c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:39.262459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c47c40-a1ac-44b7-80c1-ab5c561e6981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:39.263717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c47c40-a1ac-44b7-80c1-ab5c561e6981 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:39.265915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c47c40-a1ac-44b7-80c1-ab5c561e6981 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:39.266814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c47c40-a1ac-44b7-80c1-ab5c561e6981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:39.276004 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3187/6315] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:26:39 2022] PUT /identity/v3/projects/bd58845d8aef4018a73c94ec1eae1525/users/8fb81ac61c1141c2856401d2ffd583b9/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:39.276722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-63c47c40-a1ac-44b7-80c1-ab5c561e6981 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:39.276934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea2a8e-15f5-4b15-bb3c-9c88c3cb0c0c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:39.310887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c47c40-a1ac-44b7-80c1-ab5c561e6981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:39.312998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c47c40-a1ac-44b7-80c1-ab5c561e6981 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:39.342878 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3129/6316] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:26:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:26:39.376457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea2a8e-15f5-4b15-bb3c-9c88c3cb0c0c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:39.402831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39a45d-a2e8-45d3-95d8-be706e6f31bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:39.403866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39a45d-a2e8-45d3-95d8-be706e6f31bb admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:39.405989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39a45d-a2e8-45d3-95d8-be706e6f31bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:39.406441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39a45d-a2e8-45d3-95d8-be706e6f31bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:39.407712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39a45d-a2e8-45d3-95d8-be706e6f31bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:39.411271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39a45d-a2e8-45d3-95d8-be706e6f31bb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:39.450703 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3188/6317] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:26:39.451776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c47c40-a1ac-44b7-80c1-ab5c561e6981 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:39.471017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c47c40-a1ac-44b7-80c1-ab5c561e6981 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:39.500083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8509b-0a4d-44b5-9d00-88c83238c73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:39.500083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8509b-0a4d-44b5-9d00-88c83238c73f admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:39.501704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8509b-0a4d-44b5-9d00-88c83238c73f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:39.502030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8509b-0a4d-44b5-9d00-88c83238c73f admin admin] PATH_INFO: `/v3/projects/bd58845d8aef4018a73c94ec1eae1525/users/8fb81ac61c1141c2856401d2ffd583b9/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:39.512873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8509b-0a4d-44b5-9d00-88c83238c73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd58845d8aef4018a73c94ec1eae1525, user_id=8fb81ac61c1141c2856401d2ffd583b9, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:39.518132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8509b-0a4d-44b5-9d00-88c83238c73f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:39.560719 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3130/6318] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:26:39 2022] PUT /identity/v3/projects/bd58845d8aef4018a73c94ec1eae1525/users/8fb81ac61c1141c2856401d2ffd583b9/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:39.563695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec9184-c7e8-4686-b32b-c8ccd53f511e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:39.564004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec9184-c7e8-4686-b32b-c8ccd53f511e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:39.564290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec9184-c7e8-4686-b32b-c8ccd53f511e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:39.673666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-15ec9184-c7e8-4686-b32b-c8ccd53f511e None None] MFA Rules not processed for user `8fb81ac61c1141c2856401d2ffd583b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:39.674736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-15ec9184-c7e8-4686-b32b-c8ccd53f511e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:39.850532 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3189/6319] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:39.855112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8509b-0a4d-44b5-9d00-88c83238c73f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:39.870547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8509b-0a4d-44b5-9d00-88c83238c73f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:39.878351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954362b0-7110-49ca-82b0-00ccf356284b tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fb81ac61c1141c2856401d2ffd583b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd58845d8aef4018a73c94ec1eae1525', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:39.879173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954362b0-7110-49ca-82b0-00ccf356284b tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:39.879327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954362b0-7110-49ca-82b0-00ccf356284b tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:39.879847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954362b0-7110-49ca-82b0-00ccf356284b tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] PATH_INFO: `/v3/policies` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:39.880995 ncdv-master-1 devstack@keystone.service[91086]: WARNING oslo_log.versionutils [None req-954362b0-7110-49ca-82b0-00ccf356284b tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 30 21:26:39.881668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954362b0-7110-49ca-82b0-00ccf356284b tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:39.883571 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-954362b0-7110-49ca-82b0-00ccf356284b tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:26:39.883571 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:26:39.883571 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:26:39.884481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954362b0-7110-49ca-82b0-00ccf356284b tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:39.916297 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3131/6320] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 30 21:26:39 2022] POST /identity/v3/policies => generated 229 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:39.925963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec9184-c7e8-4686-b32b-c8ccd53f511e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:39.939496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec9184-c7e8-4686-b32b-c8ccd53f511e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:39.948211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ee138-aada-42de-9933-5b5da5c56c14 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fb81ac61c1141c2856401d2ffd583b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd58845d8aef4018a73c94ec1eae1525', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:39.948880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ee138-aada-42de-9933-5b5da5c56c14 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:39.949163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ee138-aada-42de-9933-5b5da5c56c14 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:39.949439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ee138-aada-42de-9933-5b5da5c56c14 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] PATH_INFO: `/v3/policies/f5f2f20fb83949c4acaa9ea44a44fab6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:39.950434 ncdv-master-1 devstack@keystone.service[91085]: WARNING oslo_log.versionutils [None req-0d9ee138-aada-42de-9933-5b5da5c56c14 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 30 21:26:39.950980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ee138-aada-42de-9933-5b5da5c56c14 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=f5f2f20fb83949c4acaa9ea44a44fab6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:39.954684 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-0d9ee138-aada-42de-9933-5b5da5c56c14 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:26:39.954684 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:26:39.954684 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:26:39.955672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ee138-aada-42de-9933-5b5da5c56c14 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:40.012165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954362b0-7110-49ca-82b0-00ccf356284b tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:40.022499 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3190/6321] 10.222.0.17 () {60 vars in 1252 bytes} [Sat Jul 30 21:26:39 2022] PATCH /identity/v3/policies/f5f2f20fb83949c4acaa9ea44a44fab6 => generated 235 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:26:40.029067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954362b0-7110-49ca-82b0-00ccf356284b tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:40.035692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be0eb6-0bbc-43ec-88b1-27071e996877 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fb81ac61c1141c2856401d2ffd583b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd58845d8aef4018a73c94ec1eae1525', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:40.036364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be0eb6-0bbc-43ec-88b1-27071e996877 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:40.036815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be0eb6-0bbc-43ec-88b1-27071e996877 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:40.037101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be0eb6-0bbc-43ec-88b1-27071e996877 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] PATH_INFO: `/v3/policies/f5f2f20fb83949c4acaa9ea44a44fab6` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:40.038034 ncdv-master-1 devstack@keystone.service[91086]: WARNING oslo_log.versionutils [None req-45be0eb6-0bbc-43ec-88b1-27071e996877 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 30 21:26:40.038730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be0eb6-0bbc-43ec-88b1-27071e996877 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=f5f2f20fb83949c4acaa9ea44a44fab6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:40.040167 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-45be0eb6-0bbc-43ec-88b1-27071e996877 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:26:40.040167 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:26:40.040167 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:26:40.041407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be0eb6-0bbc-43ec-88b1-27071e996877 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:40.064860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ee138-aada-42de-9933-5b5da5c56c14 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:40.074498 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3132/6322] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:26:39 2022] GET /identity/v3/policies/f5f2f20fb83949c4acaa9ea44a44fab6 => generated 235 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:26:40.078267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ee138-aada-42de-9933-5b5da5c56c14 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:40.084022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81188e6c-e926-4453-97b2-4843634cf5b2 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fb81ac61c1141c2856401d2ffd583b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd58845d8aef4018a73c94ec1eae1525', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:40.084874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81188e6c-e926-4453-97b2-4843634cf5b2 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:40.085149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81188e6c-e926-4453-97b2-4843634cf5b2 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:40.085434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81188e6c-e926-4453-97b2-4843634cf5b2 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] PATH_INFO: `/v3/policies/f5f2f20fb83949c4acaa9ea44a44fab6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:40.086387 ncdv-master-1 devstack@keystone.service[91085]: WARNING oslo_log.versionutils [None req-81188e6c-e926-4453-97b2-4843634cf5b2 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 30 21:26:40.086991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81188e6c-e926-4453-97b2-4843634cf5b2 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=f5f2f20fb83949c4acaa9ea44a44fab6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:40.088323 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-81188e6c-e926-4453-97b2-4843634cf5b2 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:26:40.088323 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:26:40.088323 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:26:40.089191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81188e6c-e926-4453-97b2-4843634cf5b2 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:40.122425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be0eb6-0bbc-43ec-88b1-27071e996877 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:40.123550 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3191/6323] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:26:40 2022] DELETE /identity/v3/policies/f5f2f20fb83949c4acaa9ea44a44fab6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:40.140238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be0eb6-0bbc-43ec-88b1-27071e996877 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:40.146787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3738dd-25eb-481d-9a6c-39a3b5209588 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fb81ac61c1141c2856401d2ffd583b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd58845d8aef4018a73c94ec1eae1525', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:40.147722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3738dd-25eb-481d-9a6c-39a3b5209588 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:40.149821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3738dd-25eb-481d-9a6c-39a3b5209588 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:40.149821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3738dd-25eb-481d-9a6c-39a3b5209588 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] PATH_INFO: `/v3/policies` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:40.149821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3738dd-25eb-481d-9a6c-39a3b5209588 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:40.152398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3738dd-25eb-481d-9a6c-39a3b5209588 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:40.195049 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3133/6324] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 30 21:26:40 2022] POST /identity/v3/policies => generated 229 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:40.200558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81188e6c-e926-4453-97b2-4843634cf5b2 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:40.216294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81188e6c-e926-4453-97b2-4843634cf5b2 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:40.230157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5318bf2-1b1d-4709-bdab-4d2684c28c35 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fb81ac61c1141c2856401d2ffd583b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd58845d8aef4018a73c94ec1eae1525', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:40.230821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5318bf2-1b1d-4709-bdab-4d2684c28c35 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:40.231107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5318bf2-1b1d-4709-bdab-4d2684c28c35 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:40.231411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5318bf2-1b1d-4709-bdab-4d2684c28c35 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] PATH_INFO: `/v3/policies` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:40.233652 ncdv-master-1 devstack@keystone.service[91085]: WARNING oslo_log.versionutils [None req-e5318bf2-1b1d-4709-bdab-4d2684c28c35 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 30 21:26:40.234239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5318bf2-1b1d-4709-bdab-4d2684c28c35 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:40.235506 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-e5318bf2-1b1d-4709-bdab-4d2684c28c35 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:26:40.235506 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:26:40.235506 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:26:40.236406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5318bf2-1b1d-4709-bdab-4d2684c28c35 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:40.241416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=3,keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:40.274347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3738dd-25eb-481d-9a6c-39a3b5209588 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:40.286340 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3192/6325] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 30 21:26:40 2022] POST /identity/v3/policies => generated 225 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:40.291792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3738dd-25eb-481d-9a6c-39a3b5209588 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:40.300275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656f61a-0c1f-4314-8bb5-dc697b500118 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fb81ac61c1141c2856401d2ffd583b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd58845d8aef4018a73c94ec1eae1525', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:40.301852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656f61a-0c1f-4314-8bb5-dc697b500118 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:40.302564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656f61a-0c1f-4314-8bb5-dc697b500118 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:40.303516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656f61a-0c1f-4314-8bb5-dc697b500118 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] PATH_INFO: `/v3/policies` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:40.306018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656f61a-0c1f-4314-8bb5-dc697b500118 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:40.308689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656f61a-0c1f-4314-8bb5-dc697b500118 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:40.346895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5318bf2-1b1d-4709-bdab-4d2684c28c35 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:40.361363 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3134/6326] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 30 21:26:40 2022] POST /identity/v3/policies => generated 230 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:40.365624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5318bf2-1b1d-4709-bdab-4d2684c28c35 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:40.389581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0e7ad-df4b-44bd-8b31-406fe6f2852d tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fb81ac61c1141c2856401d2ffd583b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd58845d8aef4018a73c94ec1eae1525', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:40.390518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0e7ad-df4b-44bd-8b31-406fe6f2852d tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:40.391156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0e7ad-df4b-44bd-8b31-406fe6f2852d tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:40.391456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0e7ad-df4b-44bd-8b31-406fe6f2852d tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] PATH_INFO: `/v3/policies` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:40.392394 ncdv-master-1 devstack@keystone.service[91085]: WARNING oslo_log.versionutils [None req-6ec0e7ad-df4b-44bd-8b31-406fe6f2852d tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 30 21:26:40.393005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0e7ad-df4b-44bd-8b31-406fe6f2852d tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:40.395525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656f61a-0c1f-4314-8bb5-dc697b500118 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:40.401698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d656f61a-0c1f-4314-8bb5-dc697b500118 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:40.407851 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-6ec0e7ad-df4b-44bd-8b31-406fe6f2852d tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:26:40.407851 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:26:40.407851 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:26:40.408844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0e7ad-df4b-44bd-8b31-406fe6f2852d tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:40.435764 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3193/6327] 10.222.0.17 () {58 vars in 1131 bytes} [Sat Jul 30 21:26:40 2022] GET /identity/v3/policies => generated 760 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:26:40.437570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0e7ad-df4b-44bd-8b31-406fe6f2852d tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:40.458744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0e7ad-df4b-44bd-8b31-406fe6f2852d tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:40.472880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80d8b5-afba-481d-8e81-aa1f167690ed tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fb81ac61c1141c2856401d2ffd583b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd58845d8aef4018a73c94ec1eae1525', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:40.473558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80d8b5-afba-481d-8e81-aa1f167690ed tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:40.473847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80d8b5-afba-481d-8e81-aa1f167690ed tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:40.474124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80d8b5-afba-481d-8e81-aa1f167690ed tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] PATH_INFO: `/v3/policies/2651d000058a481395ca256038d732d7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:40.475270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80d8b5-afba-481d-8e81-aa1f167690ed tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=2651d000058a481395ca256038d732d7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:40.477147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80d8b5-afba-481d-8e81-aa1f167690ed tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:40.512834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:40.517288 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3194/6328] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:26:40 2022] DELETE /identity/v3/policies/2651d000058a481395ca256038d732d7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:26:40.520664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80d8b5-afba-481d-8e81-aa1f167690ed tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:40.535788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80d8b5-afba-481d-8e81-aa1f167690ed tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:40.549472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88255c-da03-4e57-89f9-15ac67cb3531 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fb81ac61c1141c2856401d2ffd583b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd58845d8aef4018a73c94ec1eae1525', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:40.553773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88255c-da03-4e57-89f9-15ac67cb3531 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:40.554349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88255c-da03-4e57-89f9-15ac67cb3531 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:40.555189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88255c-da03-4e57-89f9-15ac67cb3531 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] PATH_INFO: `/v3/policies/f75e4ef3fcbc4e4193b0a4de4d776d7a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:40.565265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88255c-da03-4e57-89f9-15ac67cb3531 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=f75e4ef3fcbc4e4193b0a4de4d776d7a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:40.569215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88255c-da03-4e57-89f9-15ac67cb3531 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:40.605908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656f61a-0c1f-4314-8bb5-dc697b500118 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:40.619636 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3195/6329] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:26:40 2022] DELETE /identity/v3/policies/f75e4ef3fcbc4e4193b0a4de4d776d7a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:26:40.619886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8ca9f-7992-4c5e-892e-87cc7032cd53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:40.620403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8ca9f-7992-4c5e-892e-87cc7032cd53 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:40.620749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8ca9f-7992-4c5e-892e-87cc7032cd53 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:40.621031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8ca9f-7992-4c5e-892e-87cc7032cd53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:40.626586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f0d8ca9f-7992-4c5e-892e-87cc7032cd53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:40.633345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88255c-da03-4e57-89f9-15ac67cb3531 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:40.665822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88255c-da03-4e57-89f9-15ac67cb3531 tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:40.667085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8ca9f-7992-4c5e-892e-87cc7032cd53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:40.668806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8ca9f-7992-4c5e-892e-87cc7032cd53 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:40.680738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea62915-fc8d-4030-9a2a-f51a4413f7be tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fb81ac61c1141c2856401d2ffd583b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd58845d8aef4018a73c94ec1eae1525', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:40.681177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea62915-fc8d-4030-9a2a-f51a4413f7be tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:40.681177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea62915-fc8d-4030-9a2a-f51a4413f7be tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:40.681372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea62915-fc8d-4030-9a2a-f51a4413f7be tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] PATH_INFO: `/v3/policies/a03d44c729da4149bf970871f6ade169` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:40.682466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea62915-fc8d-4030-9a2a-f51a4413f7be tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=a03d44c729da4149bf970871f6ade169)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:40.684846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea62915-fc8d-4030-9a2a-f51a4413f7be tempest-PoliciesTestJSON-1280066955 tempest-PoliciesTestJSON-1280066955-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:40.693543 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3135/6330] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:26:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:26:40.718207 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3196/6331] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:26:40 2022] DELETE /identity/v3/policies/a03d44c729da4149bf970871f6ade169 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:40.726926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8ca9f-7992-4c5e-892e-87cc7032cd53 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:40.927535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8ca9f-7992-4c5e-892e-87cc7032cd53 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:40.941786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a7805-cce9-41b7-8a1a-9970d6a4407d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:40.943648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a7805-cce9-41b7-8a1a-9970d6a4407d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:40.944734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a7805-cce9-41b7-8a1a-9970d6a4407d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:40.949532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a7805-cce9-41b7-8a1a-9970d6a4407d admin admin] PATH_INFO: `/v3/users/db4b179bdfd34c358b299035d6e1d076` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:40.955178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a7805-cce9-41b7-8a1a-9970d6a4407d admin admin] RBAC: Authorizing `identity:delete_user(user_id=db4b179bdfd34c358b299035d6e1d076)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:40.957998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a7805-cce9-41b7-8a1a-9970d6a4407d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:41.077186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e02a7805-cce9-41b7-8a1a-9970d6a4407d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db4b179bdfd34c358b299035d6e1d076'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:41.078161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e02a7805-cce9-41b7-8a1a-9970d6a4407d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db4b179bdfd34c358b299035d6e1d076'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:41.101230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e02a7805-cce9-41b7-8a1a-9970d6a4407d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db4b179bdfd34c358b299035d6e1d076'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:41.102398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e02a7805-cce9-41b7-8a1a-9970d6a4407d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db4b179bdfd34c358b299035d6e1d076'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:41.122217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e02a7805-cce9-41b7-8a1a-9970d6a4407d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db4b179bdfd34c358b299035d6e1d076'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:41.146044 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3136/6332] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:26:40 2022] DELETE /identity/v3/users/db4b179bdfd34c358b299035d6e1d076 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:41.163494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda1c70-3fa7-477a-b4cd-e7fd38037e79 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:41.163494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda1c70-3fa7-477a-b4cd-e7fd38037e79 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:41.163494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda1c70-3fa7-477a-b4cd-e7fd38037e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:41.218037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2bda1c70-3fa7-477a-b4cd-e7fd38037e79 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:41.241525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2bda1c70-3fa7-477a-b4cd-e7fd38037e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:41.364552 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3197/6333] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:41.399985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a7805-cce9-41b7-8a1a-9970d6a4407d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:41.401908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e02a7805-cce9-41b7-8a1a-9970d6a4407d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:41.500903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:41.530270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a7805-cce9-41b7-8a1a-9970d6a4407d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:41.541067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde908c-5040-47d2-9c2e-dcdc1c275a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:41.543727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde908c-5040-47d2-9c2e-dcdc1c275a20 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:41.544038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde908c-5040-47d2-9c2e-dcdc1c275a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:41.544954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde908c-5040-47d2-9c2e-dcdc1c275a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:41.575138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde908c-5040-47d2-9c2e-dcdc1c275a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:41.579777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde908c-5040-47d2-9c2e-dcdc1c275a20 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:41.597874 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3137/6334] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:26:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:26:43.450268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda1c70-3fa7-477a-b4cd-e7fd38037e79 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:43.451990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2bda1c70-3fa7-477a-b4cd-e7fd38037e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:43.469707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda1c70-3fa7-477a-b4cd-e7fd38037e79 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:43.479680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7b50d-f2e2-493d-b86e-d869d4839f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:43.480371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7b50d-f2e2-493d-b86e-d869d4839f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:43.480665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7b50d-f2e2-493d-b86e-d869d4839f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:43.481140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7b50d-f2e2-493d-b86e-d869d4839f41 admin admin] PATH_INFO: `/v3/projects/ed694e2b1efb432ab1e51508f6326412` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:43.482406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb7b50d-f2e2-493d-b86e-d869d4839f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed694e2b1efb432ab1e51508f6326412)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:43.484763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb7b50d-f2e2-493d-b86e-d869d4839f41 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:43.602490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3fb7b50d-f2e2-493d-b86e-d869d4839f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed694e2b1efb432ab1e51508f6326412', 'request_id': 'req-3fb7b50d-f2e2-493d-b86e-d869d4839f41'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:43.631963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3fb7b50d-f2e2-493d-b86e-d869d4839f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed694e2b1efb432ab1e51508f6326412', 'request_id': 'req-3fb7b50d-f2e2-493d-b86e-d869d4839f41'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:43.661382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3fb7b50d-f2e2-493d-b86e-d869d4839f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed694e2b1efb432ab1e51508f6326412', 'request_id': 'req-3fb7b50d-f2e2-493d-b86e-d869d4839f41'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:43.687137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3fb7b50d-f2e2-493d-b86e-d869d4839f41 admin admin] The token cache is being invalidate because project ed694e2b1efb432ab1e51508f6326412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:26:43.688553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3fb7b50d-f2e2-493d-b86e-d869d4839f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:43.689500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3fb7b50d-f2e2-493d-b86e-d869d4839f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:43.700047 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3198/6335] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:26:43 2022] DELETE /identity/v3/projects/ed694e2b1efb432ab1e51508f6326412 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:43.704168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde908c-5040-47d2-9c2e-dcdc1c275a20 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:43.717841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde908c-5040-47d2-9c2e-dcdc1c275a20 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:43.893369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38f274-e116-4ad8-9fa9-f85d2a3d17c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:43.894646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38f274-e116-4ad8-9fa9-f85d2a3d17c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:43.894963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38f274-e116-4ad8-9fa9-f85d2a3d17c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:43.895245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38f274-e116-4ad8-9fa9-f85d2a3d17c9 admin admin] PATH_INFO: `/v3/users/8fb81ac61c1141c2856401d2ffd583b9` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:43.898769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38f274-e116-4ad8-9fa9-f85d2a3d17c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fb81ac61c1141c2856401d2ffd583b9)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:43.900940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38f274-e116-4ad8-9fa9-f85d2a3d17c9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:44.045906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2b38f274-e116-4ad8-9fa9-f85d2a3d17c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fb81ac61c1141c2856401d2ffd583b9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:44.047121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2b38f274-e116-4ad8-9fa9-f85d2a3d17c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fb81ac61c1141c2856401d2ffd583b9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:44.077549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2b38f274-e116-4ad8-9fa9-f85d2a3d17c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fb81ac61c1141c2856401d2ffd583b9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:44.078633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2b38f274-e116-4ad8-9fa9-f85d2a3d17c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fb81ac61c1141c2856401d2ffd583b9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:44.092703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2b38f274-e116-4ad8-9fa9-f85d2a3d17c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fb81ac61c1141c2856401d2ffd583b9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:44.134413 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3138/6336] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:26:43 2022] DELETE /identity/v3/users/8fb81ac61c1141c2856401d2ffd583b9 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:45.724329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7b50d-f2e2-493d-b86e-d869d4839f41 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:45.726022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3fb7b50d-f2e2-493d-b86e-d869d4839f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:45.753884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7b50d-f2e2-493d-b86e-d869d4839f41 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:45.812100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:45.898442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa1ad0-57e5-4821-9deb-64c3b671c9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:45.899536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa1ad0-57e5-4821-9deb-64c3b671c9c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:45.899829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa1ad0-57e5-4821-9deb-64c3b671c9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:45.900113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa1ad0-57e5-4821-9deb-64c3b671c9c1 admin admin] PATH_INFO: `/v3/projects/bd58845d8aef4018a73c94ec1eae1525` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:45.901949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa1ad0-57e5-4821-9deb-64c3b671c9c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd58845d8aef4018a73c94ec1eae1525)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:45.904313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa1ad0-57e5-4821-9deb-64c3b671c9c1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:45.986256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-28fa1ad0-57e5-4821-9deb-64c3b671c9c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd58845d8aef4018a73c94ec1eae1525', 'request_id': 'req-28fa1ad0-57e5-4821-9deb-64c3b671c9c1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:46.004268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-28fa1ad0-57e5-4821-9deb-64c3b671c9c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd58845d8aef4018a73c94ec1eae1525', 'request_id': 'req-28fa1ad0-57e5-4821-9deb-64c3b671c9c1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:46.022839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-28fa1ad0-57e5-4821-9deb-64c3b671c9c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd58845d8aef4018a73c94ec1eae1525', 'request_id': 'req-28fa1ad0-57e5-4821-9deb-64c3b671c9c1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:46.046206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-28fa1ad0-57e5-4821-9deb-64c3b671c9c1 admin admin] The token cache is being invalidate because project bd58845d8aef4018a73c94ec1eae1525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:26:46.046680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-28fa1ad0-57e5-4821-9deb-64c3b671c9c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:46.050433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-28fa1ad0-57e5-4821-9deb-64c3b671c9c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:46.056933 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3199/6337] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:26:45 2022] DELETE /identity/v3/projects/bd58845d8aef4018a73c94ec1eae1525 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:46.059422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf84ff4-119c-484c-a386-5583fa8f3a9d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:46.059950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf84ff4-119c-484c-a386-5583fa8f3a9d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:46.060069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf84ff4-119c-484c-a386-5583fa8f3a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:46.132088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5bf84ff4-119c-484c-a386-5583fa8f3a9d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:46.133610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5bf84ff4-119c-484c-a386-5583fa8f3a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:46.263124 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3139/6338] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:46.273089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d31b4-0dc9-44d4-ab72-b0ab387fde58 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:46.273538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d31b4-0dc9-44d4-ab72-b0ab387fde58 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:46.273740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d31b4-0dc9-44d4-ab72-b0ab387fde58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:46.308681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1b8d31b4-0dc9-44d4-ab72-b0ab387fde58 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:46.310503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1b8d31b4-0dc9-44d4-ab72-b0ab387fde58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:46.334038 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3200/6339] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:46.334919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf84ff4-119c-484c-a386-5583fa8f3a9d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:46.343888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:46.351227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf84ff4-119c-484c-a386-5583fa8f3a9d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:46.367480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20f13b-3ad3-4150-a195-a2fa9e2cbea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:46.368133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20f13b-3ad3-4150-a195-a2fa9e2cbea7 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:46.368669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20f13b-3ad3-4150-a195-a2fa9e2cbea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:46.368774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20f13b-3ad3-4150-a195-a2fa9e2cbea7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:46.369615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20f13b-3ad3-4150-a195-a2fa9e2cbea7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:26:46.370218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20f13b-3ad3-4150-a195-a2fa9e2cbea7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:46.374359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20f13b-3ad3-4150-a195-a2fa9e2cbea7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:46.439197 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3140/6340] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:26:46.440753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d31b4-0dc9-44d4-ab72-b0ab387fde58 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:46.457604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d31b4-0dc9-44d4-ab72-b0ab387fde58 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:46.480358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c2dac-0adb-42ce-aa1d-6cd3f51b6916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:46.481015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c2dac-0adb-42ce-aa1d-6cd3f51b6916 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:46.481304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c2dac-0adb-42ce-aa1d-6cd3f51b6916 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:46.481577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c2dac-0adb-42ce-aa1d-6cd3f51b6916 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:46.482318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c2dac-0adb-42ce-aa1d-6cd3f51b6916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:46.485717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c2dac-0adb-42ce-aa1d-6cd3f51b6916 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:46.554513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20f13b-3ad3-4150-a195-a2fa9e2cbea7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:46.565801 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3201/6341] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:26:46 2022] POST /identity/v3/projects => generated 397 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:46.573969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20f13b-3ad3-4150-a195-a2fa9e2cbea7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:46.707148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55a7ad-1ed1-42b6-baaa-e0068715afde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:46.707833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55a7ad-1ed1-42b6-baaa-e0068715afde admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:46.708163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55a7ad-1ed1-42b6-baaa-e0068715afde admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:46.708392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55a7ad-1ed1-42b6-baaa-e0068715afde admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:46.709070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55a7ad-1ed1-42b6-baaa-e0068715afde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:46.711240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55a7ad-1ed1-42b6-baaa-e0068715afde admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:46.761261 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3141/6342] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:26:46 2022] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:46.766029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c2dac-0adb-42ce-aa1d-6cd3f51b6916 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:46.783117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c2dac-0adb-42ce-aa1d-6cd3f51b6916 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:46.804914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b91ad7-6490-4195-9ed7-a3fedcaade75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:46.809723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b91ad7-6490-4195-9ed7-a3fedcaade75 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:46.810734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b91ad7-6490-4195-9ed7-a3fedcaade75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:46.811784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b91ad7-6490-4195-9ed7-a3fedcaade75 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:46.817497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b91ad7-6490-4195-9ed7-a3fedcaade75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:46.821855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b91ad7-6490-4195-9ed7-a3fedcaade75 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:46.860822 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3202/6343] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:26:46.865488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55a7ad-1ed1-42b6-baaa-e0068715afde admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:46.885056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55a7ad-1ed1-42b6-baaa-e0068715afde admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:46.896141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c1ec3-fde3-4a49-8cfa-d4f4cb3da9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:46.896788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c1ec3-fde3-4a49-8cfa-d4f4cb3da9fd admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:46.897074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c1ec3-fde3-4a49-8cfa-d4f4cb3da9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:46.897354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c1ec3-fde3-4a49-8cfa-d4f4cb3da9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:46.898156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c1ec3-fde3-4a49-8cfa-d4f4cb3da9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:46.899710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c1ec3-fde3-4a49-8cfa-d4f4cb3da9fd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:46.945238 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3142/6344] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:26:46.949184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b91ad7-6490-4195-9ed7-a3fedcaade75 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:46.963948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b91ad7-6490-4195-9ed7-a3fedcaade75 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:46.976937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfe748-fc9e-4d0d-a558-313970229bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:46.977640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfe748-fc9e-4d0d-a558-313970229bff admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:46.977927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfe748-fc9e-4d0d-a558-313970229bff admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:46.978222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfe748-fc9e-4d0d-a558-313970229bff admin admin] PATH_INFO: `/v3/projects/766747d13a1f49f08dd692988193f235/users/77efb6d3d78d42cc931bd4153e15f179/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:47.057115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfe748-fc9e-4d0d-a558-313970229bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=766747d13a1f49f08dd692988193f235, user_id=77efb6d3d78d42cc931bd4153e15f179, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:47.076776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfe748-fc9e-4d0d-a558-313970229bff admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:47.112996 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3203/6345] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:26:46 2022] PUT /identity/v3/projects/766747d13a1f49f08dd692988193f235/users/77efb6d3d78d42cc931bd4153e15f179/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:47.123496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d14a7-d904-41de-9f9c-f46a4155175b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:47.124083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d14a7-d904-41de-9f9c-f46a4155175b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:47.124209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d14a7-d904-41de-9f9c-f46a4155175b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:47.171514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3d9d14a7-d904-41de-9f9c-f46a4155175b None None] MFA Rules not processed for user `77efb6d3d78d42cc931bd4153e15f179`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:47.173178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3d9d14a7-d904-41de-9f9c-f46a4155175b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:47.368045 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3143/6346] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:47.369585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfe748-fc9e-4d0d-a558-313970229bff admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:47.545801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:47.594080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfe748-fc9e-4d0d-a558-313970229bff admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:47.611393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff521c-6cb1-4cbb-b046-7e4e69727575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:47.611393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff521c-6cb1-4cbb-b046-7e4e69727575 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:47.611393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff521c-6cb1-4cbb-b046-7e4e69727575 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:47.611393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff521c-6cb1-4cbb-b046-7e4e69727575 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:47.612104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff521c-6cb1-4cbb-b046-7e4e69727575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:47.624512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff521c-6cb1-4cbb-b046-7e4e69727575 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:47.710192 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3204/6347] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:26:47 2022] POST /identity/v3/projects => generated 397 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:47.714579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d14a7-d904-41de-9f9c-f46a4155175b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:47.733893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d14a7-d904-41de-9f9c-f46a4155175b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:47.918468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8428c-3628-43b6-9447-1f69dbb74c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:47.919189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8428c-3628-43b6-9447-1f69dbb74c7d admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:47.919504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8428c-3628-43b6-9447-1f69dbb74c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:47.919810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8428c-3628-43b6-9447-1f69dbb74c7d admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:47.920562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8428c-3628-43b6-9447-1f69dbb74c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:47.925749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8428c-3628-43b6-9447-1f69dbb74c7d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:47.949324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:47.993679 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3144/6348] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:26:47 2022] POST /identity/v3/users => generated 305 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:47.998132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff521c-6cb1-4cbb-b046-7e4e69727575 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:48.018140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff521c-6cb1-4cbb-b046-7e4e69727575 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:48.042166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dee774-e1fb-476d-be0d-7fb67f1cc72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:48.043082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dee774-e1fb-476d-be0d-7fb67f1cc72b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:48.045231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dee774-e1fb-476d-be0d-7fb67f1cc72b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:48.050845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dee774-e1fb-476d-be0d-7fb67f1cc72b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:48.052002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dee774-e1fb-476d-be0d-7fb67f1cc72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:48.053914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dee774-e1fb-476d-be0d-7fb67f1cc72b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:48.086495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8428c-3628-43b6-9447-1f69dbb74c7d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:48.086831 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3205/6349] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:26:48.108303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8428c-3628-43b6-9447-1f69dbb74c7d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:48.124840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079131f-474c-4037-8ca0-7b9a46862373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:48.125579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079131f-474c-4037-8ca0-7b9a46862373 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:48.125982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079131f-474c-4037-8ca0-7b9a46862373 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:48.126266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079131f-474c-4037-8ca0-7b9a46862373 admin admin] PATH_INFO: `/v3/projects/6fc5bb88009e4e4a8211667b4f9907c5/users/0e634e26f22a48f8b27818d031963342/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:48.178927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079131f-474c-4037-8ca0-7b9a46862373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc5bb88009e4e4a8211667b4f9907c5, user_id=0e634e26f22a48f8b27818d031963342, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:48.183552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079131f-474c-4037-8ca0-7b9a46862373 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:48.223341 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3145/6350] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:26:48 2022] PUT /identity/v3/projects/6fc5bb88009e4e4a8211667b4f9907c5/users/0e634e26f22a48f8b27818d031963342/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:26:48.227473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dee774-e1fb-476d-be0d-7fb67f1cc72b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:48.238856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dee774-e1fb-476d-be0d-7fb67f1cc72b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:48.384680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d457c-555e-493c-8bae-967b00ce43f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:48.385453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d457c-555e-493c-8bae-967b00ce43f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:48.385594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d457c-555e-493c-8bae-967b00ce43f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:48.385927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d457c-555e-493c-8bae-967b00ce43f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:48.386640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d457c-555e-493c-8bae-967b00ce43f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:48.396345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d457c-555e-493c-8bae-967b00ce43f6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:48.427688 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3206/6351] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:26:48.431824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079131f-474c-4037-8ca0-7b9a46862373 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:48.448411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079131f-474c-4037-8ca0-7b9a46862373 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:48.464654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc69bd1-2ca8-45b0-bd93-491981a0daa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:48.465987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc69bd1-2ca8-45b0-bd93-491981a0daa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:48.466275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc69bd1-2ca8-45b0-bd93-491981a0daa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:48.466553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc69bd1-2ca8-45b0-bd93-491981a0daa0 admin admin] PATH_INFO: `/v3/projects/6fc5bb88009e4e4a8211667b4f9907c5/users/0e634e26f22a48f8b27818d031963342/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:48.469173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc69bd1-2ca8-45b0-bd93-491981a0daa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc5bb88009e4e4a8211667b4f9907c5, user_id=0e634e26f22a48f8b27818d031963342, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:48.480086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc69bd1-2ca8-45b0-bd93-491981a0daa0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:48.511400 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3146/6352] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:26:48 2022] PUT /identity/v3/projects/6fc5bb88009e4e4a8211667b4f9907c5/users/0e634e26f22a48f8b27818d031963342/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:48.519018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6134c84-c651-42fa-be4a-cd4759697787 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:48.519668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6134c84-c651-42fa-be4a-cd4759697787 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:48.520181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6134c84-c651-42fa-be4a-cd4759697787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:48.582134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c6134c84-c651-42fa-be4a-cd4759697787 None None] MFA Rules not processed for user `0e634e26f22a48f8b27818d031963342`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:48.583453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c6134c84-c651-42fa-be4a-cd4759697787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:48.826166 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3207/6353] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:48.826732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc69bd1-2ca8-45b0-bd93-491981a0daa0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:49.059510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc69bd1-2ca8-45b0-bd93-491981a0daa0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:49.068703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310a421-5777-48a9-b346-b274b8aedcf4 tempest-ProjectsNegativeStaticTestJSON-1467350079 tempest-ProjectsNegativeStaticTestJSON-1467350079-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb6d3d78d42cc931bd4153e15f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '766747d13a1f49f08dd692988193f235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:49.069698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310a421-5777-48a9-b346-b274b8aedcf4 tempest-ProjectsNegativeStaticTestJSON-1467350079 tempest-ProjectsNegativeStaticTestJSON-1467350079-project] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:49.070195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310a421-5777-48a9-b346-b274b8aedcf4 tempest-ProjectsNegativeStaticTestJSON-1467350079 tempest-ProjectsNegativeStaticTestJSON-1467350079-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:49.070677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310a421-5777-48a9-b346-b274b8aedcf4 tempest-ProjectsNegativeStaticTestJSON-1467350079 tempest-ProjectsNegativeStaticTestJSON-1467350079-project] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:49.071708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310a421-5777-48a9-b346-b274b8aedcf4 tempest-ProjectsNegativeStaticTestJSON-1467350079 tempest-ProjectsNegativeStaticTestJSON-1467350079-project] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:49.101261 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-a310a421-5777-48a9-b346-b274b8aedcf4 tempest-ProjectsNegativeStaticTestJSON-1467350079 tempest-ProjectsNegativeStaticTestJSON-1467350079-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jul 30 21:26:49.101261 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:26:49.101261 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:26:49.101261 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:26:49.101261 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:26:49.101261 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:26:49.101261 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:26:49.101261 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:26:49.101261 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:26:49.101261 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:26:49.101261 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:26:49.101261 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:26:49.101261 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Jul 30 21:26:49.101261 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 30 21:26:49.102566 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 30 21:26:49.102566 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 30 21:26:49.102566 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 30 21:26:49.102566 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 30 21:26:49.102566 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:26:49.102566 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 30 21:26:49.102566 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jul 30 21:26:49.102566 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:26:49.108109 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3147/6354] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 30 21:26:48 2022] POST /identity/v3/projects => generated 136 bytes in 282 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Jul 30 21:26:49.114468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6134c84-c651-42fa-be4a-cd4759697787 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:49.131146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6134c84-c651-42fa-be4a-cd4759697787 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:49.162428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54a12a-1d8c-4162-a5d6-329848c265f8 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e634e26f22a48f8b27818d031963342', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc5bb88009e4e4a8211667b4f9907c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:49.164015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54a12a-1d8c-4162-a5d6-329848c265f8 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:49.164583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54a12a-1d8c-4162-a5d6-329848c265f8 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:49.166204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54a12a-1d8c-4162-a5d6-329848c265f8 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:49.167010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54a12a-1d8c-4162-a5d6-329848c265f8 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:49.169255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54a12a-1d8c-4162-a5d6-329848c265f8 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-8b54a12a-1d8c-4162-a5d6-329848c265f8 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Invalid input for field 'name': '' is too short Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: Failed validating 'minLength' in schema['properties']['name']: Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: On instance['name']: Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: Failed validating 'minLength' in schema['properties']['name']: Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: On instance['name']: Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: '' Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise error Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application On instance['name']: Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application '' Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:26:49.181116 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:26:49.183437 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:26:49.183437 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:26:49.183437 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:26:49.183437 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:26:49.183437 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:26:49.183437 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:26:49.183437 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:26:49.183437 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:26:49.183437 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:26:49.183437 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:26:49.183437 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:26:49.183437 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:26:49.183437 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jul 30 21:26:49.183437 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jul 30 21:26:49.183437 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 30 21:26:49.183437 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 30 21:26:49.183437 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 30 21:26:49.184908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 30 21:26:49.184908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 30 21:26:49.184908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:26:49.184908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 30 21:26:49.184908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 30 21:26:49.184908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:26:49.184908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application On instance['name']: Jul 30 21:26:49.184908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application '' Jul 30 21:26:49.184908 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:26:49.188698 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3208/6355] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 30 21:26:49 2022] POST /identity/v3/projects => generated 283 bytes in 77 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 30 21:26:49.194815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310a421-5777-48a9-b346-b274b8aedcf4 tempest-ProjectsNegativeStaticTestJSON-1467350079 tempest-ProjectsNegativeStaticTestJSON-1467350079-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:49.213371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310a421-5777-48a9-b346-b274b8aedcf4 tempest-ProjectsNegativeStaticTestJSON-1467350079 tempest-ProjectsNegativeStaticTestJSON-1467350079-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:49.234379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ff757-65fe-491a-a5c6-ae6248920814 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e634e26f22a48f8b27818d031963342', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc5bb88009e4e4a8211667b4f9907c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:49.235775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ff757-65fe-491a-a5c6-ae6248920814 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:49.238176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ff757-65fe-491a-a5c6-ae6248920814 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:49.238583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ff757-65fe-491a-a5c6-ae6248920814 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:49.239972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ff757-65fe-491a-a5c6-ae6248920814 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:49.245847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ff757-65fe-491a-a5c6-ae6248920814 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:49.268744 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-f17ff757-65fe-491a-a5c6-ae6248920814 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:26:49.268744 ncdv-master-1 devstack@keystone.service[91086]: Failed validating 'maxLength' in schema['properties']['name']: Jul 30 21:26:49.268744 ncdv-master-1 devstack@keystone.service[91086]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 30 21:26:49.268744 ncdv-master-1 devstack@keystone.service[91086]: On instance['name']: Jul 30 21:26:49.268744 ncdv-master-1 devstack@keystone.service[91086]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:26:49.268744 ncdv-master-1 devstack@keystone.service[91086]: Failed validating 'maxLength' in schema['properties']['name']: Jul 30 21:26:49.268744 ncdv-master-1 devstack@keystone.service[91086]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 30 21:26:49.268744 ncdv-master-1 devstack@keystone.service[91086]: On instance['name']: Jul 30 21:26:49.268744 ncdv-master-1 devstack@keystone.service[91086]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 30 21:26:49.268744 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:26:49.268744 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 30 21:26:49.268744 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 30 21:26:49.268744 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:26:49.268744 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise error Jul 30 21:26:49.268744 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:26:49.268744 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:26:49.268744 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 30 21:26:49.268744 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 30 21:26:49.279830 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:26:49.279830 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application On instance['name']: Jul 30 21:26:49.279830 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 30 21:26:49.279830 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:26:49.279830 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:26:49.279830 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:26:49.279830 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:26:49.279830 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:26:49.279830 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:26:49.279830 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:26:49.279830 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:26:49.279830 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:26:49.279830 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:26:49.279830 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:26:49.279830 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:26:49.279830 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:26:49.279830 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:26:49.279830 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jul 30 21:26:49.282245 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jul 30 21:26:49.282245 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 30 21:26:49.282245 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 30 21:26:49.282245 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 30 21:26:49.282245 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 30 21:26:49.282245 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:26:49.282245 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:26:49.282245 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 30 21:26:49.282245 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 30 21:26:49.282245 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:26:49.282245 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application On instance['name']: Jul 30 21:26:49.282245 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 30 21:26:49.282245 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:26:49.282245 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3148/6356] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 30 21:26:49 2022] POST /identity/v3/projects => generated 412 bytes in 76 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 30 21:26:49.287012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54a12a-1d8c-4162-a5d6-329848c265f8 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:49.311524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54a12a-1d8c-4162-a5d6-329848c265f8 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:49.327433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96513882-2738-44bd-be78-e1b51d0856dd tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e634e26f22a48f8b27818d031963342', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc5bb88009e4e4a8211667b4f9907c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:49.328910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96513882-2738-44bd-be78-e1b51d0856dd tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:49.329921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96513882-2738-44bd-be78-e1b51d0856dd tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:49.332214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96513882-2738-44bd-be78-e1b51d0856dd tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] PATH_INFO: `/v3/projects/f3983113f7f24505b22ab754c4ee1902` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:49.357778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96513882-2738-44bd-be78-e1b51d0856dd tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f3983113f7f24505b22ab754c4ee1902)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:49.360515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96513882-2738-44bd-be78-e1b51d0856dd tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:49.378385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-96513882-2738-44bd-be78-e1b51d0856dd tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Could not find project: f3983113f7f24505b22ab754c4ee1902.: keystone.exception.ProjectNotFound: Could not find project: f3983113f7f24505b22ab754c4ee1902. Jul 30 21:26:49.378385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:26:49.378385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:26:49.378385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:26:49.378385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:26:49.378385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:26:49.378385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:26:49.378385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:26:49.378385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:26:49.378385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:26:49.378385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:26:49.378385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:26:49.378385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 30 21:26:49.378385 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 30 21:26:49.379863 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:26:49.379863 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:26:49.379863 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 30 21:26:49.379863 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 30 21:26:49.379863 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 21:26:49.379863 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 21:26:49.379863 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 21:26:49.379863 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 21:26:49.379863 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f3983113f7f24505b22ab754c4ee1902. Jul 30 21:26:49.379863 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:26:49.388384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ff757-65fe-491a-a5c6-ae6248920814 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:49.389024 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3209/6357] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:26:49 2022] DELETE /identity/v3/projects/f3983113f7f24505b22ab754c4ee1902 => generated 113 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:26:49.400873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ff757-65fe-491a-a5c6-ae6248920814 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:49.406457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8bc9c-6dfb-407f-948e-0acaea133290 tempest-ProjectsNegativeStaticTestJSON-1467350079 tempest-ProjectsNegativeStaticTestJSON-1467350079-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb6d3d78d42cc931bd4153e15f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '766747d13a1f49f08dd692988193f235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:49.407514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8bc9c-6dfb-407f-948e-0acaea133290 tempest-ProjectsNegativeStaticTestJSON-1467350079 tempest-ProjectsNegativeStaticTestJSON-1467350079-project] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:49.408020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8bc9c-6dfb-407f-948e-0acaea133290 tempest-ProjectsNegativeStaticTestJSON-1467350079 tempest-ProjectsNegativeStaticTestJSON-1467350079-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:49.408512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8bc9c-6dfb-407f-948e-0acaea133290 tempest-ProjectsNegativeStaticTestJSON-1467350079 tempest-ProjectsNegativeStaticTestJSON-1467350079-project] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:49.409968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8bc9c-6dfb-407f-948e-0acaea133290 tempest-ProjectsNegativeStaticTestJSON-1467350079 tempest-ProjectsNegativeStaticTestJSON-1467350079-project] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:49.419026 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-0ca8bc9c-6dfb-407f-948e-0acaea133290 tempest-ProjectsNegativeStaticTestJSON-1467350079 tempest-ProjectsNegativeStaticTestJSON-1467350079-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jul 30 21:26:49.419026 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:26:49.419026 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:26:49.419026 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:26:49.419026 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:26:49.419026 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:26:49.419026 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:26:49.419026 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:26:49.419026 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:26:49.419026 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:26:49.419026 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:26:49.419026 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:26:49.419026 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Jul 30 21:26:49.419026 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._list_projects() Jul 30 21:26:49.420302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Jul 30 21:26:49.420302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Jul 30 21:26:49.420302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 30 21:26:49.420302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 30 21:26:49.420302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 30 21:26:49.420302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 30 21:26:49.420302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:26:49.420302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 30 21:26:49.420302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jul 30 21:26:49.420302 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:26:49.429558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96513882-2738-44bd-be78-e1b51d0856dd tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:49.439394 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3149/6358] 10.222.0.17 () {58 vars in 1131 bytes} [Sat Jul 30 21:26:49 2022] GET /identity/v3/projects => generated 135 bytes in 52 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Jul 30 21:26:49.447478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96513882-2738-44bd-be78-e1b51d0856dd tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:49.454904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d14671-4590-4a3b-b3a9-4e5f379042cb tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e634e26f22a48f8b27818d031963342', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc5bb88009e4e4a8211667b4f9907c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:49.455972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d14671-4590-4a3b-b3a9-4e5f379042cb tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:49.456469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d14671-4590-4a3b-b3a9-4e5f379042cb tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:49.456927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d14671-4590-4a3b-b3a9-4e5f379042cb tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:49.457852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d14671-4590-4a3b-b3a9-4e5f379042cb tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:49.460218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d14671-4590-4a3b-b3a9-4e5f379042cb tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:49.521839 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3210/6359] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:26:49 2022] POST /identity/v3/projects => generated 358 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:49.525854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8bc9c-6dfb-407f-948e-0acaea133290 tempest-ProjectsNegativeStaticTestJSON-1467350079 tempest-ProjectsNegativeStaticTestJSON-1467350079-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:49.545692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8bc9c-6dfb-407f-948e-0acaea133290 tempest-ProjectsNegativeStaticTestJSON-1467350079 tempest-ProjectsNegativeStaticTestJSON-1467350079-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:49.699019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b34fcd-403f-4a11-877f-4a9689e5717a tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e634e26f22a48f8b27818d031963342', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc5bb88009e4e4a8211667b4f9907c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:49.699949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b34fcd-403f-4a11-877f-4a9689e5717a tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:49.700471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b34fcd-403f-4a11-877f-4a9689e5717a tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:49.700915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b34fcd-403f-4a11-877f-4a9689e5717a tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:49.701804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b34fcd-403f-4a11-877f-4a9689e5717a tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:49.704026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b34fcd-403f-4a11-877f-4a9689e5717a tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:49.732074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.sql.core [None req-a1b34fcd-403f-4a11-877f-4a9689e5717a tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-2000983496' for key 'project.ixu_project_name_domain_id'") Jul 30 21:26:49.732074 ncdv-master-1 devstack@keystone.service[91086]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 30 21:26:49.732074 ncdv-master-1 devstack@keystone.service[91086]: [parameters: {'id': '02e6885e0b884c4a9cb864f6637cf444', 'name': 'tempest-project-dup-2000983496', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 30 21:26:49.732074 ncdv-master-1 devstack@keystone.service[91086]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91086) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 30 21:26:49.746022 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-a1b34fcd-403f-4a11-877f-4a9689e5717a tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-2000983496, project id 02e6885e0b884c4a9cb864f6637cf444.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-2000983496, project id 02e6885e0b884c4a9cb864f6637cf444. Jul 30 21:26:49.746022 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:26:49.746022 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 30 21:26:49.746022 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 30 21:26:49.746022 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 30 21:26:49.746022 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 30 21:26:49.746022 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 30 21:26:49.746022 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application result = self._query(query) Jul 30 21:26:49.746022 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 30 21:26:49.746022 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application conn.query(q) Jul 30 21:26:49.746022 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 30 21:26:49.746022 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 30 21:26:49.747517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 30 21:26:49.747517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application result.read() Jul 30 21:26:49.747517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 30 21:26:49.747517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 30 21:26:49.747517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 30 21:26:49.747517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 30 21:26:49.747517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 30 21:26:49.747517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 30 21:26:49.747517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 30 21:26:49.747517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 30 21:26:49.747517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-2000983496' for key 'project.ixu_project_name_domain_id'") Jul 30 21:26:49.747517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:26:49.747517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 30 21:26:49.747517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:26:49.747517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:26:49.747517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 30 21:26:49.747517 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 30 21:26:49.749146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 30 21:26:49.749146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 30 21:26:49.749146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 30 21:26:49.749146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application next(self.gen) Jul 30 21:26:49.749146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 30 21:26:49.749146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application yield resource Jul 30 21:26:49.749146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 30 21:26:49.749146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application next(self.gen) Jul 30 21:26:49.749146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 30 21:26:49.749146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.session.rollback() Jul 30 21:26:49.749146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:26:49.749146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.force_reraise() Jul 30 21:26:49.749146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:26:49.749146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise self.value Jul 30 21:26:49.749146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 30 21:26:49.749146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 30 21:26:49.749146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 30 21:26:49.749146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application session.commit() Jul 30 21:26:49.751078 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 30 21:26:49.751078 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 30 21:26:49.751078 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 30 21:26:49.751078 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._prepare_impl() Jul 30 21:26:49.751078 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 30 21:26:49.751078 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.session.flush() Jul 30 21:26:49.751078 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 30 21:26:49.751078 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._flush(objects) Jul 30 21:26:49.751078 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 30 21:26:49.751078 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 30 21:26:49.751078 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 30 21:26:49.751078 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application compat.raise_( Jul 30 21:26:49.751078 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 30 21:26:49.751078 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception Jul 30 21:26:49.751078 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 30 21:26:49.751078 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application flush_context.execute() Jul 30 21:26:49.751078 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 30 21:26:49.753282 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rec.execute(self) Jul 30 21:26:49.753282 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 30 21:26:49.753282 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 30 21:26:49.753282 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 30 21:26:49.753282 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 30 21:26:49.753282 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 30 21:26:49.753282 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 30 21:26:49.753282 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 30 21:26:49.753282 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 30 21:26:49.753282 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 30 21:26:49.753282 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 30 21:26:49.753282 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 30 21:26:49.753282 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 30 21:26:49.753282 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 30 21:26:49.753282 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 30 21:26:49.753282 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 30 21:26:49.754730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 30 21:26:49.754730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 30 21:26:49.754730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception Jul 30 21:26:49.754730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 30 21:26:49.754730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 30 21:26:49.754730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 30 21:26:49.754730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 30 21:26:49.754730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 30 21:26:49.754730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application result = self._query(query) Jul 30 21:26:49.754730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 30 21:26:49.754730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application conn.query(q) Jul 30 21:26:49.754730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 30 21:26:49.754730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 30 21:26:49.754730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 30 21:26:49.754730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application result.read() Jul 30 21:26:49.754730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 30 21:26:49.754730 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 30 21:26:49.756146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 30 21:26:49.756146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 30 21:26:49.756146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 30 21:26:49.756146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 30 21:26:49.756146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 30 21:26:49.756146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 30 21:26:49.756146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-2000983496' for key 'project.ixu_project_name_domain_id'") Jul 30 21:26:49.756146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 30 21:26:49.756146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [parameters: {'id': '02e6885e0b884c4a9cb864f6637cf444', 'name': 'tempest-project-dup-2000983496', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 30 21:26:49.756146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 30 21:26:49.756146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:26:49.756146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:26:49.756146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:26:49.756146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:26:49.756146 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 30 21:26:49.757259 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 30 21:26:49.757259 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 30 21:26:49.757259 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 30 21:26:49.757259 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-2000983496 at domain ID default. Jul 30 21:26:49.757259 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:26:49.757259 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:26:49.757259 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:26:49.757259 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:26:49.757259 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:26:49.757259 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:26:49.757259 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:26:49.757259 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:26:49.757259 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:26:49.757259 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:26:49.757259 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:26:49.757259 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:26:49.757259 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:26:49.760266 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:26:49.760266 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 30 21:26:49.760266 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 30 21:26:49.760266 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:26:49.760266 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:26:49.760266 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 30 21:26:49.760266 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 30 21:26:49.760266 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-2000983496, project id 02e6885e0b884c4a9cb864f6637cf444. Jul 30 21:26:49.760266 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:26:49.760266 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3150/6360] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 30 21:26:49 2022] POST /identity/v3/projects => generated 285 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 30 21:26:49.762687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d14671-4590-4a3b-b3a9-4e5f379042cb tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:49.774305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:49.796858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d14671-4590-4a3b-b3a9-4e5f379042cb tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:49.812206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e6c2d-3409-41f1-b207-3cf9732dc7f6 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e634e26f22a48f8b27818d031963342', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc5bb88009e4e4a8211667b4f9907c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:49.813280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e6c2d-3409-41f1-b207-3cf9732dc7f6 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:49.814201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e6c2d-3409-41f1-b207-3cf9732dc7f6 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:49.814794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e6c2d-3409-41f1-b207-3cf9732dc7f6 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] PATH_INFO: `/v3/projects/b5a7b18ecc9f4768a787ba816ffff2a9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:49.818419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e6c2d-3409-41f1-b207-3cf9732dc7f6 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b5a7b18ecc9f4768a787ba816ffff2a9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:49.822960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e6c2d-3409-41f1-b207-3cf9732dc7f6 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:49.900045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-587e6c2d-3409-41f1-b207-3cf9732dc7f6 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a7b18ecc9f4768a787ba816ffff2a9', 'request_id': 'req-587e6c2d-3409-41f1-b207-3cf9732dc7f6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:49.910885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-587e6c2d-3409-41f1-b207-3cf9732dc7f6 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a7b18ecc9f4768a787ba816ffff2a9', 'request_id': 'req-587e6c2d-3409-41f1-b207-3cf9732dc7f6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:49.923351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-587e6c2d-3409-41f1-b207-3cf9732dc7f6 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a7b18ecc9f4768a787ba816ffff2a9', 'request_id': 'req-587e6c2d-3409-41f1-b207-3cf9732dc7f6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:49.945195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-587e6c2d-3409-41f1-b207-3cf9732dc7f6 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] The token cache is being invalidate because project b5a7b18ecc9f4768a787ba816ffff2a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:26:49.946511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-587e6c2d-3409-41f1-b207-3cf9732dc7f6 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:49.948651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-587e6c2d-3409-41f1-b207-3cf9732dc7f6 tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:49.953402 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3211/6361] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:26:49 2022] DELETE /identity/v3/projects/b5a7b18ecc9f4768a787ba816ffff2a9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:49.958963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b34fcd-403f-4a11-877f-4a9689e5717a tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:49.961122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a1b34fcd-403f-4a11-877f-4a9689e5717a tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:50.048406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:50.096974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b34fcd-403f-4a11-877f-4a9689e5717a tempest-ProjectsNegativeStaticTestJSON-1302234957 tempest-ProjectsNegativeStaticTestJSON-1302234957-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:50.211571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d305b84-de07-44e2-bc17-8d3f6eb25968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:50.214000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d305b84-de07-44e2-bc17-8d3f6eb25968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:50.214303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d305b84-de07-44e2-bc17-8d3f6eb25968 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:50.216322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d305b84-de07-44e2-bc17-8d3f6eb25968 admin admin] PATH_INFO: `/v3/users/77efb6d3d78d42cc931bd4153e15f179` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:50.219128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d305b84-de07-44e2-bc17-8d3f6eb25968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77efb6d3d78d42cc931bd4153e15f179)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:50.224918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d305b84-de07-44e2-bc17-8d3f6eb25968 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:50.348665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4d305b84-de07-44e2-bc17-8d3f6eb25968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77efb6d3d78d42cc931bd4153e15f179'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:50.350104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4d305b84-de07-44e2-bc17-8d3f6eb25968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77efb6d3d78d42cc931bd4153e15f179'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:50.371453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4d305b84-de07-44e2-bc17-8d3f6eb25968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77efb6d3d78d42cc931bd4153e15f179'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:50.372915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4d305b84-de07-44e2-bc17-8d3f6eb25968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77efb6d3d78d42cc931bd4153e15f179'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:50.388605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4d305b84-de07-44e2-bc17-8d3f6eb25968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77efb6d3d78d42cc931bd4153e15f179'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:50.416607 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3151/6362] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:26:49 2022] DELETE /identity/v3/users/77efb6d3d78d42cc931bd4153e15f179 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:50.418299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703b44d-487b-4c37-87ee-ebf0c00a091e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:50.419563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703b44d-487b-4c37-87ee-ebf0c00a091e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:50.420428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703b44d-487b-4c37-87ee-ebf0c00a091e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:50.460055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d703b44d-487b-4c37-87ee-ebf0c00a091e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:50.462399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d703b44d-487b-4c37-87ee-ebf0c00a091e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:50.623037 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3212/6363] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:50.676809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d305b84-de07-44e2-bc17-8d3f6eb25968 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:50.678388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4d305b84-de07-44e2-bc17-8d3f6eb25968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:50.799384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703b44d-487b-4c37-87ee-ebf0c00a091e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:50.801157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d703b44d-487b-4c37-87ee-ebf0c00a091e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:50.821672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d305b84-de07-44e2-bc17-8d3f6eb25968 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:50.848139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d41bef-5b94-40e0-b4c8-c53aab1b6878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:50.850416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d41bef-5b94-40e0-b4c8-c53aab1b6878 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:50.850706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d41bef-5b94-40e0-b4c8-c53aab1b6878 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:50.850987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d41bef-5b94-40e0-b4c8-c53aab1b6878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:50.873839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d41bef-5b94-40e0-b4c8-c53aab1b6878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:50.875316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d41bef-5b94-40e0-b4c8-c53aab1b6878 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:50.925401 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3152/6364] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:26:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:26:50.967706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703b44d-487b-4c37-87ee-ebf0c00a091e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:51.003844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5af542-198c-4e85-91a3-5c08031a097f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:51.017971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5af542-198c-4e85-91a3-5c08031a097f service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:51.019130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5af542-198c-4e85-91a3-5c08031a097f service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:51.019772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5af542-198c-4e85-91a3-5c08031a097f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:51.022388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2f5af542-198c-4e85-91a3-5c08031a097f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:51.056824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5af542-198c-4e85-91a3-5c08031a097f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:51.059129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5af542-198c-4e85-91a3-5c08031a097f service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:51.090350 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3213/6365] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:26:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:26:52.391432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d41bef-5b94-40e0-b4c8-c53aab1b6878 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:52.393447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-50d41bef-5b94-40e0-b4c8-c53aab1b6878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:52.441442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d41bef-5b94-40e0-b4c8-c53aab1b6878 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:52.457551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a94b9-aa76-4792-99a4-bdf76c0ba361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:52.458551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a94b9-aa76-4792-99a4-bdf76c0ba361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:52.460073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a94b9-aa76-4792-99a4-bdf76c0ba361 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:52.460736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a94b9-aa76-4792-99a4-bdf76c0ba361 admin admin] PATH_INFO: `/v3/projects/766747d13a1f49f08dd692988193f235` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:52.465992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a94b9-aa76-4792-99a4-bdf76c0ba361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=766747d13a1f49f08dd692988193f235)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:52.470189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a94b9-aa76-4792-99a4-bdf76c0ba361 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:52.478129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:52.612746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7c8a94b9-aa76-4792-99a4-bdf76c0ba361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '766747d13a1f49f08dd692988193f235', 'request_id': 'req-7c8a94b9-aa76-4792-99a4-bdf76c0ba361'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:52.625392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7c8a94b9-aa76-4792-99a4-bdf76c0ba361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '766747d13a1f49f08dd692988193f235', 'request_id': 'req-7c8a94b9-aa76-4792-99a4-bdf76c0ba361'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:52.637136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7c8a94b9-aa76-4792-99a4-bdf76c0ba361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '766747d13a1f49f08dd692988193f235', 'request_id': 'req-7c8a94b9-aa76-4792-99a4-bdf76c0ba361'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:52.660052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7c8a94b9-aa76-4792-99a4-bdf76c0ba361 admin admin] The token cache is being invalidate because project 766747d13a1f49f08dd692988193f235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:26:52.660613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7c8a94b9-aa76-4792-99a4-bdf76c0ba361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:52.661500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7c8a94b9-aa76-4792-99a4-bdf76c0ba361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:52.664156 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3153/6366] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:26:52 2022] DELETE /identity/v3/projects/766747d13a1f49f08dd692988193f235 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:52.667991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5af542-198c-4e85-91a3-5c08031a097f service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:52.689149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5af542-198c-4e85-91a3-5c08031a097f service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:52.708709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:52.817568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cd5f8-a778-4e2f-b9e5-928c44c2a89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:52.818270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cd5f8-a778-4e2f-b9e5-928c44c2a89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:52.818541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cd5f8-a778-4e2f-b9e5-928c44c2a89c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:52.818816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cd5f8-a778-4e2f-b9e5-928c44c2a89c admin admin] PATH_INFO: `/v3/users/0e634e26f22a48f8b27818d031963342` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:52.821141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cd5f8-a778-4e2f-b9e5-928c44c2a89c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e634e26f22a48f8b27818d031963342)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:52.823113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cd5f8-a778-4e2f-b9e5-928c44c2a89c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:52.946791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-074cd5f8-a778-4e2f-b9e5-928c44c2a89c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e634e26f22a48f8b27818d031963342'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:52.988475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-074cd5f8-a778-4e2f-b9e5-928c44c2a89c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e634e26f22a48f8b27818d031963342'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:52.990162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-074cd5f8-a778-4e2f-b9e5-928c44c2a89c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e634e26f22a48f8b27818d031963342'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:52.998977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-074cd5f8-a778-4e2f-b9e5-928c44c2a89c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e634e26f22a48f8b27818d031963342'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:53.000575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-074cd5f8-a778-4e2f-b9e5-928c44c2a89c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e634e26f22a48f8b27818d031963342'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:53.031171 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3214/6367] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:26:52 2022] DELETE /identity/v3/users/0e634e26f22a48f8b27818d031963342 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:54.052134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a94b9-aa76-4792-99a4-bdf76c0ba361 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:54.054023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7c8a94b9-aa76-4792-99a4-bdf76c0ba361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:54.078698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a94b9-aa76-4792-99a4-bdf76c0ba361 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:54.201319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a29ea1-f3f6-4611-8a14-bfc3c39fd86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:54.202241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a29ea1-f3f6-4611-8a14-bfc3c39fd86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:54.203536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a29ea1-f3f6-4611-8a14-bfc3c39fd86b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:54.204015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a29ea1-f3f6-4611-8a14-bfc3c39fd86b admin admin] PATH_INFO: `/v3/users/34776492bc87429dab155c9102608137` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:54.207978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a29ea1-f3f6-4611-8a14-bfc3c39fd86b admin admin] RBAC: Authorizing `identity:delete_user(user_id=34776492bc87429dab155c9102608137)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:54.210337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a29ea1-f3f6-4611-8a14-bfc3c39fd86b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:54.330177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-38a29ea1-f3f6-4611-8a14-bfc3c39fd86b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34776492bc87429dab155c9102608137'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:54.331389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-38a29ea1-f3f6-4611-8a14-bfc3c39fd86b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34776492bc87429dab155c9102608137'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:54.356700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-38a29ea1-f3f6-4611-8a14-bfc3c39fd86b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34776492bc87429dab155c9102608137'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:54.358664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-38a29ea1-f3f6-4611-8a14-bfc3c39fd86b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34776492bc87429dab155c9102608137'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:54.378838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-38a29ea1-f3f6-4611-8a14-bfc3c39fd86b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34776492bc87429dab155c9102608137'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:54.399262 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3154/6368] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:26:54 2022] DELETE /identity/v3/users/34776492bc87429dab155c9102608137 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:54.401100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c28b7-9a4d-477f-949b-17021630c1ca None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:54.401579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c28b7-9a4d-477f-949b-17021630c1ca None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:54.402030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c28b7-9a4d-477f-949b-17021630c1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:54.427887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-178c28b7-9a4d-477f-949b-17021630c1ca None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:54.429541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-178c28b7-9a4d-477f-949b-17021630c1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:54.538457 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3215/6369] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:54.556528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a29ea1-f3f6-4611-8a14-bfc3c39fd86b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:54.558119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-38a29ea1-f3f6-4611-8a14-bfc3c39fd86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:54.585188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:54.665157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a29ea1-f3f6-4611-8a14-bfc3c39fd86b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:54.670348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbf233-42bf-4d5f-bb07-d82438307364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:54.671280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbf233-42bf-4d5f-bb07-d82438307364 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:54.671736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbf233-42bf-4d5f-bb07-d82438307364 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:54.672435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbf233-42bf-4d5f-bb07-d82438307364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:54.692067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbf233-42bf-4d5f-bb07-d82438307364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:54.694934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbf233-42bf-4d5f-bb07-d82438307364 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:54.710105 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3155/6370] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:26:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:26:54.736352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c28b7-9a4d-477f-949b-17021630c1ca None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:54.740780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-178c28b7-9a4d-477f-949b-17021630c1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:54.767510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c28b7-9a4d-477f-949b-17021630c1ca None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:54.774165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78818d-a4f9-4252-b1c8-1d1f555664e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:54.775032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78818d-a4f9-4252-b1c8-1d1f555664e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:54.775433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78818d-a4f9-4252-b1c8-1d1f555664e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:54.775652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78818d-a4f9-4252-b1c8-1d1f555664e4 admin admin] PATH_INFO: `/v3/projects/6fc5bb88009e4e4a8211667b4f9907c5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:54.776864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78818d-a4f9-4252-b1c8-1d1f555664e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fc5bb88009e4e4a8211667b4f9907c5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:54.781269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78818d-a4f9-4252-b1c8-1d1f555664e4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:54.823434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:54.845024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ae78818d-a4f9-4252-b1c8-1d1f555664e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc5bb88009e4e4a8211667b4f9907c5', 'request_id': 'req-ae78818d-a4f9-4252-b1c8-1d1f555664e4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:54.858608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ae78818d-a4f9-4252-b1c8-1d1f555664e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc5bb88009e4e4a8211667b4f9907c5', 'request_id': 'req-ae78818d-a4f9-4252-b1c8-1d1f555664e4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:54.885031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ae78818d-a4f9-4252-b1c8-1d1f555664e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc5bb88009e4e4a8211667b4f9907c5', 'request_id': 'req-ae78818d-a4f9-4252-b1c8-1d1f555664e4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:54.958932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ae78818d-a4f9-4252-b1c8-1d1f555664e4 admin admin] The token cache is being invalidate because project 6fc5bb88009e4e4a8211667b4f9907c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:26:54.959851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ae78818d-a4f9-4252-b1c8-1d1f555664e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:54.967230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ae78818d-a4f9-4252-b1c8-1d1f555664e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:54.971855 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3216/6371] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:26:54 2022] DELETE /identity/v3/projects/6fc5bb88009e4e4a8211667b4f9907c5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:54.980013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728b360-90a2-4d5c-929f-6bff15fb3f44 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:54.980013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728b360-90a2-4d5c-929f-6bff15fb3f44 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:54.980013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728b360-90a2-4d5c-929f-6bff15fb3f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:55.036621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5728b360-90a2-4d5c-929f-6bff15fb3f44 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:55.037977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5728b360-90a2-4d5c-929f-6bff15fb3f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:55.295343 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3156/6372] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:55.300478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c9780-66a7-4465-a6fe-b14635a7561c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:55.301282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c9780-66a7-4465-a6fe-b14635a7561c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:55.301789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c9780-66a7-4465-a6fe-b14635a7561c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:55.360325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-774c9780-66a7-4465-a6fe-b14635a7561c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:55.361432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-774c9780-66a7-4465-a6fe-b14635a7561c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:55.384655 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3217/6373] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:55.388529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728b360-90a2-4d5c-929f-6bff15fb3f44 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:55.412160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728b360-90a2-4d5c-929f-6bff15fb3f44 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:55.424679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009b272-5f89-4c60-9630-bb324fc9dd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:55.425429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009b272-5f89-4c60-9630-bb324fc9dd8e admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:55.425785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009b272-5f89-4c60-9630-bb324fc9dd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:55.426128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009b272-5f89-4c60-9630-bb324fc9dd8e admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:55.426912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009b272-5f89-4c60-9630-bb324fc9dd8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:26:55.428403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009b272-5f89-4c60-9630-bb324fc9dd8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:55.440140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009b272-5f89-4c60-9630-bb324fc9dd8e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:55.472140 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3157/6374] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:26:55.476593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c9780-66a7-4465-a6fe-b14635a7561c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:55.490806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c9780-66a7-4465-a6fe-b14635a7561c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:55.496676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e02361-66db-4e29-939c-da6ac220d516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:55.497770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e02361-66db-4e29-939c-da6ac220d516 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:55.498297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e02361-66db-4e29-939c-da6ac220d516 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:55.498795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e02361-66db-4e29-939c-da6ac220d516 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:55.500034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e02361-66db-4e29-939c-da6ac220d516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:55.504854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e02361-66db-4e29-939c-da6ac220d516 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:55.525425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009b272-5f89-4c60-9630-bb324fc9dd8e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:55.527544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c009b272-5f89-4c60-9630-bb324fc9dd8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:55.609321 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3218/6375] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:26:55 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:55.611134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e02361-66db-4e29-939c-da6ac220d516 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:55.681902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009b272-5f89-4c60-9630-bb324fc9dd8e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:55.756273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:55.836541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e02361-66db-4e29-939c-da6ac220d516 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:55.847797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442ad48-e43d-4c7f-ac80-b42b1072c5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:55.848443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442ad48-e43d-4c7f-ac80-b42b1072c5d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:55.848726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442ad48-e43d-4c7f-ac80-b42b1072c5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:55.849000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442ad48-e43d-4c7f-ac80-b42b1072c5d8 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:55.849668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442ad48-e43d-4c7f-ac80-b42b1072c5d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:55.852897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3bc13-fd32-48a4-93c6-8185ee3a3b3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:55.853541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3bc13-fd32-48a4-93c6-8185ee3a3b3d service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:55.853820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3bc13-fd32-48a4-93c6-8185ee3a3b3d service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:55.854092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3bc13-fd32-48a4-93c6-8185ee3a3b3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:55.855559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442ad48-e43d-4c7f-ac80-b42b1072c5d8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:55.857032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3de3bc13-fd32-48a4-93c6-8185ee3a3b3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:55.880233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3bc13-fd32-48a4-93c6-8185ee3a3b3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:55.882523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3bc13-fd32-48a4-93c6-8185ee3a3b3d service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:55.912154 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3158/6376] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:26:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:26:55.915340 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3219/6377] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:26:55 2022] POST /identity/v3/users => generated 285 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:55.915518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3bc13-fd32-48a4-93c6-8185ee3a3b3d service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:55.938550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3bc13-fd32-48a4-93c6-8185ee3a3b3d service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:55.948590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2425d9-67f7-4df7-b7f1-14f178cab9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:55.949222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2425d9-67f7-4df7-b7f1-14f178cab9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:55.949507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2425d9-67f7-4df7-b7f1-14f178cab9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:55.949782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2425d9-67f7-4df7-b7f1-14f178cab9e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:55.950479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2425d9-67f7-4df7-b7f1-14f178cab9e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:55.952137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2425d9-67f7-4df7-b7f1-14f178cab9e2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:55.981027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442ad48-e43d-4c7f-ac80-b42b1072c5d8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:55.990081 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3159/6378] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:26:56.017152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2425d9-67f7-4df7-b7f1-14f178cab9e2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:56.018328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442ad48-e43d-4c7f-ac80-b42b1072c5d8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:56.019037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8c2425d9-67f7-4df7-b7f1-14f178cab9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:56.031106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd5f2d-10a5-4f34-b460-90cfc899dedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:56.034015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd5f2d-10a5-4f34-b460-90cfc899dedf admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:56.034393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd5f2d-10a5-4f34-b460-90cfc899dedf admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:56.035322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd5f2d-10a5-4f34-b460-90cfc899dedf admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:56.038448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd5f2d-10a5-4f34-b460-90cfc899dedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:56.040463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd5f2d-10a5-4f34-b460-90cfc899dedf admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:56.064167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2425d9-67f7-4df7-b7f1-14f178cab9e2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:56.074248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25d542-4a70-4f2f-be0c-f347c162f0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:56.074248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25d542-4a70-4f2f-be0c-f347c162f0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:56.074248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25d542-4a70-4f2f-be0c-f347c162f0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:56.074248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25d542-4a70-4f2f-be0c-f347c162f0a2 admin admin] PATH_INFO: `/v3/projects/918cca16f8cf4c69906ba1a5b2ce5c59` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:56.074846 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3220/6379] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:26:56.075502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd5f2d-10a5-4f34-b460-90cfc899dedf admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:56.075808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25d542-4a70-4f2f-be0c-f347c162f0a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=918cca16f8cf4c69906ba1a5b2ce5c59)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:56.078276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25d542-4a70-4f2f-be0c-f347c162f0a2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:56.099977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd5f2d-10a5-4f34-b460-90cfc899dedf admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:56.128106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b98676-b6f4-4d23-b792-aa97ee317cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:56.130395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b98676-b6f4-4d23-b792-aa97ee317cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:56.130690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b98676-b6f4-4d23-b792-aa97ee317cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:56.130978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b98676-b6f4-4d23-b792-aa97ee317cd5 admin admin] PATH_INFO: `/v3/projects/e2984ad6928b46d486e342b563d70e2c/users/54a3d900a1474ce193cb984f11c763cf/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:56.176283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b98676-b6f4-4d23-b792-aa97ee317cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2984ad6928b46d486e342b563d70e2c, user_id=54a3d900a1474ce193cb984f11c763cf, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:56.179157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b98676-b6f4-4d23-b792-aa97ee317cd5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:56.204343 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3221/6380] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:26:56 2022] PUT /identity/v3/projects/e2984ad6928b46d486e342b563d70e2c/users/54a3d900a1474ce193cb984f11c763cf/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:56.215823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8092188-28e7-4e9c-9cd5-a34d8c808062 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:56.216115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8092188-28e7-4e9c-9cd5-a34d8c808062 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:56.216427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8092188-28e7-4e9c-9cd5-a34d8c808062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:56.225390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7c25d542-4a70-4f2f-be0c-f347c162f0a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '918cca16f8cf4c69906ba1a5b2ce5c59', 'request_id': 'req-7c25d542-4a70-4f2f-be0c-f347c162f0a2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:56.238573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7c25d542-4a70-4f2f-be0c-f347c162f0a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '918cca16f8cf4c69906ba1a5b2ce5c59', 'request_id': 'req-7c25d542-4a70-4f2f-be0c-f347c162f0a2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:56.248969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7c25d542-4a70-4f2f-be0c-f347c162f0a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '918cca16f8cf4c69906ba1a5b2ce5c59', 'request_id': 'req-7c25d542-4a70-4f2f-be0c-f347c162f0a2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:56.264195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7c25d542-4a70-4f2f-be0c-f347c162f0a2 admin admin] The token cache is being invalidate because project 918cca16f8cf4c69906ba1a5b2ce5c59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:26:56.264532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7c25d542-4a70-4f2f-be0c-f347c162f0a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:56.265674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7c25d542-4a70-4f2f-be0c-f347c162f0a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:56.271384 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3160/6381] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:26:56 2022] DELETE /identity/v3/projects/918cca16f8cf4c69906ba1a5b2ce5c59 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:26:56.273271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51025f-98d0-4084-ad9c-077de7d64ebd None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:56.273633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51025f-98d0-4084-ad9c-077de7d64ebd None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:56.273982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51025f-98d0-4084-ad9c-077de7d64ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:56.279168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a8092188-28e7-4e9c-9cd5-a34d8c808062 None None] MFA Rules not processed for user `54a3d900a1474ce193cb984f11c763cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:56.281283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a8092188-28e7-4e9c-9cd5-a34d8c808062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:56.304520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ae51025f-98d0-4084-ad9c-077de7d64ebd None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:56.305413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ae51025f-98d0-4084-ad9c-077de7d64ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:56.342516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:56.423023 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3161/6382] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:56.433837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60d027-4991-4d11-9739-979b0991e2e2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:56.434207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60d027-4991-4d11-9739-979b0991e2e2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:56.434577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60d027-4991-4d11-9739-979b0991e2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:56.444028 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3222/6383] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:26:56.449124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8092188-28e7-4e9c-9cd5-a34d8c808062 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:56.470359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fc60d027-4991-4d11-9739-979b0991e2e2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:56.473182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fc60d027-4991-4d11-9739-979b0991e2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:56.473583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8092188-28e7-4e9c-9cd5-a34d8c808062 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:56.485966 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3162/6384] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:26:56.487776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60d027-4991-4d11-9739-979b0991e2e2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:56.489576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b744cf-9554-44e0-addc-eea2d1cfad60 tempest-TestApiDiscovery-1775647720 tempest-TestApiDiscovery-1775647720-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a3d900a1474ce193cb984f11c763cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2984ad6928b46d486e342b563d70e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:56.490755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b744cf-9554-44e0-addc-eea2d1cfad60 tempest-TestApiDiscovery-1775647720 tempest-TestApiDiscovery-1775647720-project] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:56.491210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b744cf-9554-44e0-addc-eea2d1cfad60 tempest-TestApiDiscovery-1775647720 tempest-TestApiDiscovery-1775647720-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:56.491711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b744cf-9554-44e0-addc-eea2d1cfad60 tempest-TestApiDiscovery-1775647720 tempest-TestApiDiscovery-1775647720-project] PATH_INFO: `/v3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:56.498929 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3223/6385] 10.222.0.17 () {58 vars in 1104 bytes} [Sat Jul 30 21:26:56 2022] GET /identity/v3 => generated 255 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:26:56.500161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b744cf-9554-44e0-addc-eea2d1cfad60 tempest-TestApiDiscovery-1775647720 tempest-TestApiDiscovery-1775647720-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:56.510511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60d027-4991-4d11-9739-979b0991e2e2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:56.513236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b744cf-9554-44e0-addc-eea2d1cfad60 tempest-TestApiDiscovery-1775647720 tempest-TestApiDiscovery-1775647720-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:56.526592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aec5c5-ca20-4d2a-92b2-40eff11fd99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:56.528959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83022a-0e5c-4020-bec4-b58c7ce9d3cc tempest-TestApiDiscovery-1775647720 tempest-TestApiDiscovery-1775647720-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a3d900a1474ce193cb984f11c763cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2984ad6928b46d486e342b563d70e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:56.530293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83022a-0e5c-4020-bec4-b58c7ce9d3cc tempest-TestApiDiscovery-1775647720 tempest-TestApiDiscovery-1775647720-project] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:56.530966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83022a-0e5c-4020-bec4-b58c7ce9d3cc tempest-TestApiDiscovery-1775647720 tempest-TestApiDiscovery-1775647720-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:56.531370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aec5c5-ca20-4d2a-92b2-40eff11fd99c admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:56.531751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83022a-0e5c-4020-bec4-b58c7ce9d3cc tempest-TestApiDiscovery-1775647720 tempest-TestApiDiscovery-1775647720-project] PATH_INFO: `/v3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:56.532404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aec5c5-ca20-4d2a-92b2-40eff11fd99c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:56.532841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aec5c5-ca20-4d2a-92b2-40eff11fd99c admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:56.539705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aec5c5-ca20-4d2a-92b2-40eff11fd99c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:26:56.539705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aec5c5-ca20-4d2a-92b2-40eff11fd99c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:56.540778 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3224/6386] 10.222.0.17 () {58 vars in 1104 bytes} [Sat Jul 30 21:26:56 2022] GET /identity/v3 => generated 255 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:26:56.541134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aec5c5-ca20-4d2a-92b2-40eff11fd99c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:56.542042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83022a-0e5c-4020-bec4-b58c7ce9d3cc tempest-TestApiDiscovery-1775647720 tempest-TestApiDiscovery-1775647720-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:56.552551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83022a-0e5c-4020-bec4-b58c7ce9d3cc tempest-TestApiDiscovery-1775647720 tempest-TestApiDiscovery-1775647720-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:56.557133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ad1c3-6d3e-43e7-9bb2-9376a33d1d28 tempest-TestApiDiscovery-1775647720 tempest-TestApiDiscovery-1775647720-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a3d900a1474ce193cb984f11c763cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2984ad6928b46d486e342b563d70e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:56.557828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ad1c3-6d3e-43e7-9bb2-9376a33d1d28 tempest-TestApiDiscovery-1775647720 tempest-TestApiDiscovery-1775647720-project] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:56.558185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ad1c3-6d3e-43e7-9bb2-9376a33d1d28 tempest-TestApiDiscovery-1775647720 tempest-TestApiDiscovery-1775647720-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:56.558529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ad1c3-6d3e-43e7-9bb2-9376a33d1d28 tempest-TestApiDiscovery-1775647720 tempest-TestApiDiscovery-1775647720-project] PATH_INFO: `/v3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:56.560242 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3163/6387] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:26:56.565392 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3225/6388] 10.222.0.17 () {58 vars in 1104 bytes} [Sat Jul 30 21:26:56 2022] GET /identity/v3 => generated 255 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:26:56.566799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8627ea-5c09-4afe-b066-95f12c94010f None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:56.567159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aec5c5-ca20-4d2a-92b2-40eff11fd99c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:56.567368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8627ea-5c09-4afe-b066-95f12c94010f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:56.567484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8627ea-5c09-4afe-b066-95f12c94010f None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:56.573466 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3226/6389] 10.222.0.17 () {56 vars in 895 bytes} [Sat Jul 30 21:26:56 2022] GET /identity/ => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:26:56.574746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc5c7f-e3ef-4ab7-b72b-8b36f2d76340 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:56.575044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc5c7f-e3ef-4ab7-b72b-8b36f2d76340 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:56.576151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc5c7f-e3ef-4ab7-b72b-8b36f2d76340 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:56.582108 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3227/6390] 10.222.0.17 () {56 vars in 895 bytes} [Sat Jul 30 21:26:56 2022] GET /identity/ => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:26:56.583682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc5c7f-e3ef-4ab7-b72b-8b36f2d76340 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:56.586185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e0cc5c7f-e3ef-4ab7-b72b-8b36f2d76340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:56.586991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aec5c5-ca20-4d2a-92b2-40eff11fd99c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:56.593423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb17b48-ddcb-4b9e-ae7c-3df46f2e8b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:56.594133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb17b48-ddcb-4b9e-ae7c-3df46f2e8b4e admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:56.594133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb17b48-ddcb-4b9e-ae7c-3df46f2e8b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:56.594336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb17b48-ddcb-4b9e-ae7c-3df46f2e8b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:56.594981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb17b48-ddcb-4b9e-ae7c-3df46f2e8b4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:56.598543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb17b48-ddcb-4b9e-ae7c-3df46f2e8b4e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:56.616934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:56.622257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc5c7f-e3ef-4ab7-b72b-8b36f2d76340 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:56.633455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9309e0-3b93-475e-a4a3-57d5bdbe8a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:56.635076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9309e0-3b93-475e-a4a3-57d5bdbe8a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:56.635642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9309e0-3b93-475e-a4a3-57d5bdbe8a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:56.636149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9309e0-3b93-475e-a4a3-57d5bdbe8a42 admin admin] PATH_INFO: `/v3/users/54a3d900a1474ce193cb984f11c763cf` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:56.637924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9309e0-3b93-475e-a4a3-57d5bdbe8a42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a3d900a1474ce193cb984f11c763cf)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:56.642592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9309e0-3b93-475e-a4a3-57d5bdbe8a42 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:56.662191 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3164/6391] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:26:56 2022] POST /identity/v3/projects => generated 353 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:56.667483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb17b48-ddcb-4b9e-ae7c-3df46f2e8b4e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:56.756490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eb9309e0-3b93-475e-a4a3-57d5bdbe8a42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a3d900a1474ce193cb984f11c763cf'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:56.774596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eb9309e0-3b93-475e-a4a3-57d5bdbe8a42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a3d900a1474ce193cb984f11c763cf'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:56.776087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eb9309e0-3b93-475e-a4a3-57d5bdbe8a42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a3d900a1474ce193cb984f11c763cf'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:56.790195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eb9309e0-3b93-475e-a4a3-57d5bdbe8a42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a3d900a1474ce193cb984f11c763cf'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:56.791383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eb9309e0-3b93-475e-a4a3-57d5bdbe8a42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a3d900a1474ce193cb984f11c763cf'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:56.814736 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3228/6392] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:26:56 2022] DELETE /identity/v3/users/54a3d900a1474ce193cb984f11c763cf => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:56.816982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e86e13-cfe9-40a2-b42c-ed84c80f257f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:56.817298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e86e13-cfe9-40a2-b42c-ed84c80f257f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:56.817589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e86e13-cfe9-40a2-b42c-ed84c80f257f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:56.867186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb17b48-ddcb-4b9e-ae7c-3df46f2e8b4e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:56.867992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-95e86e13-cfe9-40a2-b42c-ed84c80f257f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:56.869342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-95e86e13-cfe9-40a2-b42c-ed84c80f257f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:57.001661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e32a0-b311-4083-baf6-0103c72fc3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:57.002955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e32a0-b311-4083-baf6-0103c72fc3a7 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:57.003373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e32a0-b311-4083-baf6-0103c72fc3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:57.003741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e32a0-b311-4083-baf6-0103c72fc3a7 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:57.004507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e32a0-b311-4083-baf6-0103c72fc3a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:57.006551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e32a0-b311-4083-baf6-0103c72fc3a7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:57.048395 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3229/6393] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:26:57.061184 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3165/6394] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:26:56 2022] POST /identity/v3/users => generated 277 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:57.065640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e86e13-cfe9-40a2-b42c-ed84c80f257f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:57.067444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-95e86e13-cfe9-40a2-b42c-ed84c80f257f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:57.073715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e32a0-b311-4083-baf6-0103c72fc3a7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:57.075924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e76e32a0-b311-4083-baf6-0103c72fc3a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:57.093258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e86e13-cfe9-40a2-b42c-ed84c80f257f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:57.115529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4cf229-f41f-40f0-9adb-7b8e459f2558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:57.116275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cf229-f41f-40f0-9adb-7b8e459f2558 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:57.116476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cf229-f41f-40f0-9adb-7b8e459f2558 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:57.116741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cf229-f41f-40f0-9adb-7b8e459f2558 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:57.117454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4cf229-f41f-40f0-9adb-7b8e459f2558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:57.121771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4cf229-f41f-40f0-9adb-7b8e459f2558 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:57.143832 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3230/6395] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:26:57.155820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4cf229-f41f-40f0-9adb-7b8e459f2558 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:57.159930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e32a0-b311-4083-baf6-0103c72fc3a7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:57.167433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9e2b1-d829-4610-b14d-7cf1156563e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:57.168215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9e2b1-d829-4610-b14d-7cf1156563e8 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:57.168776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9e2b1-d829-4610-b14d-7cf1156563e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:57.168989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9e2b1-d829-4610-b14d-7cf1156563e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:57.175737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4cf229-f41f-40f0-9adb-7b8e459f2558 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:57.180491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9e2b1-d829-4610-b14d-7cf1156563e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:57.182113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9e2b1-d829-4610-b14d-7cf1156563e8 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:57.194835 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3166/6396] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:26:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:26:57.198437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcffe6-22cc-482f-967d-079b2de5b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:57.199113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcffe6-22cc-482f-967d-079b2de5b7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:57.199473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcffe6-22cc-482f-967d-079b2de5b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:57.199756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcffe6-22cc-482f-967d-079b2de5b7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:57.200492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcffe6-22cc-482f-967d-079b2de5b7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:57.202457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcffe6-22cc-482f-967d-079b2de5b7e4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:57.232186 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3231/6397] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:26:57.235270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9e2b1-d829-4610-b14d-7cf1156563e8 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:57.255085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9e2b1-d829-4610-b14d-7cf1156563e8 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:57.264734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbf493-d347-446b-b329-1d522787d929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:57.265952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbf493-d347-446b-b329-1d522787d929 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:57.266119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbf493-d347-446b-b329-1d522787d929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:57.266544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbf493-d347-446b-b329-1d522787d929 admin admin] PATH_INFO: `/v3/projects/8471307ea6374671aa04d45ebb282150/users/f257f96b67f44f46a8da587115b0352b/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:57.293077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbf493-d347-446b-b329-1d522787d929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8471307ea6374671aa04d45ebb282150, user_id=f257f96b67f44f46a8da587115b0352b, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:57.300819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbf493-d347-446b-b329-1d522787d929 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:57.337023 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3167/6398] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:26:57 2022] PUT /identity/v3/projects/8471307ea6374671aa04d45ebb282150/users/f257f96b67f44f46a8da587115b0352b/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:57.347871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a618ea-dfba-4677-8204-01c319f52eb0 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:57.348192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a618ea-dfba-4677-8204-01c319f52eb0 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:57.348507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a618ea-dfba-4677-8204-01c319f52eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:57.385299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:57.402863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f8a618ea-dfba-4677-8204-01c319f52eb0 None None] MFA Rules not processed for user `f257f96b67f44f46a8da587115b0352b`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:57.406920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f8a618ea-dfba-4677-8204-01c319f52eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:57.536286 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3232/6399] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:57 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:57.559778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbf493-d347-446b-b329-1d522787d929 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:57.581912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:57.683228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbf493-d347-446b-b329-1d522787d929 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:57.684911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a618ea-dfba-4677-8204-01c319f52eb0 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:57.687015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd8250-d8ad-483d-9ee5-38e57d5c21d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:57.687690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd8250-d8ad-483d-9ee5-38e57d5c21d2 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:57.687973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd8250-d8ad-483d-9ee5-38e57d5c21d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:57.688333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd8250-d8ad-483d-9ee5-38e57d5c21d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:57.689083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f8a618ea-dfba-4677-8204-01c319f52eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:57.702039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd8250-d8ad-483d-9ee5-38e57d5c21d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:57.703929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd8250-d8ad-483d-9ee5-38e57d5c21d2 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:57.716451 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3168/6400] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:26:57 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:26:57.821727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a618ea-dfba-4677-8204-01c319f52eb0 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:57.827961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0fe9d-9be7-445b-baec-4579042fb3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:57.829249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0fe9d-9be7-445b-baec-4579042fb3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:57.829904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0fe9d-9be7-445b-baec-4579042fb3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:57.830741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0fe9d-9be7-445b-baec-4579042fb3c2 admin admin] PATH_INFO: `/v3/projects/e2984ad6928b46d486e342b563d70e2c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:57.832726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0fe9d-9be7-445b-baec-4579042fb3c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2984ad6928b46d486e342b563d70e2c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:57.835361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0fe9d-9be7-445b-baec-4579042fb3c2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:57.924812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43e0fe9d-9be7-445b-baec-4579042fb3c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2984ad6928b46d486e342b563d70e2c', 'request_id': 'req-43e0fe9d-9be7-445b-baec-4579042fb3c2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:57.933775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43e0fe9d-9be7-445b-baec-4579042fb3c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2984ad6928b46d486e342b563d70e2c', 'request_id': 'req-43e0fe9d-9be7-445b-baec-4579042fb3c2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:57.964160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43e0fe9d-9be7-445b-baec-4579042fb3c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2984ad6928b46d486e342b563d70e2c', 'request_id': 'req-43e0fe9d-9be7-445b-baec-4579042fb3c2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:57.997498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43e0fe9d-9be7-445b-baec-4579042fb3c2 admin admin] The token cache is being invalidate because project e2984ad6928b46d486e342b563d70e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:26:57.997788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43e0fe9d-9be7-445b-baec-4579042fb3c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:57.998473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43e0fe9d-9be7-445b-baec-4579042fb3c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:58.000675 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3233/6401] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:26:57 2022] DELETE /identity/v3/projects/e2984ad6928b46d486e342b563d70e2c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:58.006070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c403cc-fa25-464a-ae12-aac342e3e73c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:58.006640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c403cc-fa25-464a-ae12-aac342e3e73c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:58.007085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c403cc-fa25-464a-ae12-aac342e3e73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:58.052028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f9c403cc-fa25-464a-ae12-aac342e3e73c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:58.054945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f9c403cc-fa25-464a-ae12-aac342e3e73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:58.146017 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3169/6402] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:26:58.155027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67319d-fb1e-48f0-8f28-b1a3d531fcd8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:58.155519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67319d-fb1e-48f0-8f28-b1a3d531fcd8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:58.156610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67319d-fb1e-48f0-8f28-b1a3d531fcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:58.190986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7e67319d-fb1e-48f0-8f28-b1a3d531fcd8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:58.194567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7e67319d-fb1e-48f0-8f28-b1a3d531fcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:58.226348 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3234/6403] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:58.227201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c403cc-fa25-464a-ae12-aac342e3e73c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:58.245995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c403cc-fa25-464a-ae12-aac342e3e73c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:58.256934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee21d5-f7b8-44c7-ad85-8aaa25542f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:58.259271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee21d5-f7b8-44c7-ad85-8aaa25542f9a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:58.259849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee21d5-f7b8-44c7-ad85-8aaa25542f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:58.261526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee21d5-f7b8-44c7-ad85-8aaa25542f9a admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:58.264769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee21d5-f7b8-44c7-ad85-8aaa25542f9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:26:58.264999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee21d5-f7b8-44c7-ad85-8aaa25542f9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:58.268519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee21d5-f7b8-44c7-ad85-8aaa25542f9a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:58.297468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67319d-fb1e-48f0-8f28-b1a3d531fcd8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:58.305541 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3170/6404] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:26:58.322431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67319d-fb1e-48f0-8f28-b1a3d531fcd8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:58.329782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5809e-519f-4e03-80bd-1b4c97a7dd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:58.331020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5809e-519f-4e03-80bd-1b4c97a7dd67 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:58.331379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5809e-519f-4e03-80bd-1b4c97a7dd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:58.331630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5809e-519f-4e03-80bd-1b4c97a7dd67 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:58.332306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5809e-519f-4e03-80bd-1b4c97a7dd67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:58.334652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5809e-519f-4e03-80bd-1b4c97a7dd67 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:58.377768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:58.398301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee21d5-f7b8-44c7-ad85-8aaa25542f9a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:58.408804 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3235/6405] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:26:58 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:58.414360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee21d5-f7b8-44c7-ad85-8aaa25542f9a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:58.581499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344708cc-54bc-434d-9767-5eb263e4dca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:58.582218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344708cc-54bc-434d-9767-5eb263e4dca6 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:58.582569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344708cc-54bc-434d-9767-5eb263e4dca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:58.582960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344708cc-54bc-434d-9767-5eb263e4dca6 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:58.583758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344708cc-54bc-434d-9767-5eb263e4dca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:58.585772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344708cc-54bc-434d-9767-5eb263e4dca6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:58.624140 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3171/6406] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:26:58 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:26:58.626786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5809e-519f-4e03-80bd-1b4c97a7dd67 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:58.645629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5809e-519f-4e03-80bd-1b4c97a7dd67 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:58.651838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a9835-3eab-43e4-bf6c-f09edfd63a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:58.653092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a9835-3eab-43e4-bf6c-f09edfd63a41 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:58.653772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a9835-3eab-43e4-bf6c-f09edfd63a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:58.654299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a9835-3eab-43e4-bf6c-f09edfd63a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:58.655949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a9835-3eab-43e4-bf6c-f09edfd63a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:58.657803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a9835-3eab-43e4-bf6c-f09edfd63a41 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:58.671845 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3236/6407] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:26:58.676202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344708cc-54bc-434d-9767-5eb263e4dca6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:58.693559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344708cc-54bc-434d-9767-5eb263e4dca6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:58.700838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960736de-5c5f-4adf-a4eb-baf0ef930654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:58.701852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960736de-5c5f-4adf-a4eb-baf0ef930654 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:58.702355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960736de-5c5f-4adf-a4eb-baf0ef930654 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:58.702885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960736de-5c5f-4adf-a4eb-baf0ef930654 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:58.704991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960736de-5c5f-4adf-a4eb-baf0ef930654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:58.707779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960736de-5c5f-4adf-a4eb-baf0ef930654 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:58.771337 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3172/6408] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:26:58.775805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a9835-3eab-43e4-bf6c-f09edfd63a41 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:58.791996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a9835-3eab-43e4-bf6c-f09edfd63a41 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:58.797981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb057c8-b105-4314-b888-85d7ed3554cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:58.799153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb057c8-b105-4314-b888-85d7ed3554cc admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:58.799948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb057c8-b105-4314-b888-85d7ed3554cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:58.800825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb057c8-b105-4314-b888-85d7ed3554cc admin admin] PATH_INFO: `/v3/projects/6a46d46057e04649893520c505814381/users/2494c88b5fab4ba0bc1fb20319d0b816/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:58.822878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb057c8-b105-4314-b888-85d7ed3554cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a46d46057e04649893520c505814381, user_id=2494c88b5fab4ba0bc1fb20319d0b816, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:58.827067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb057c8-b105-4314-b888-85d7ed3554cc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:58.858668 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3237/6409] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:26:58 2022] PUT /identity/v3/projects/6a46d46057e04649893520c505814381/users/2494c88b5fab4ba0bc1fb20319d0b816/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:58.869207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ff06c-d10b-4b3e-b15f-f3b66e6f2f28 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:58.870145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ff06c-d10b-4b3e-b15f-f3b66e6f2f28 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:58.870145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ff06c-d10b-4b3e-b15f-f3b66e6f2f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:58.907592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-549ff06c-d10b-4b3e-b15f-f3b66e6f2f28 None None] MFA Rules not processed for user `2494c88b5fab4ba0bc1fb20319d0b816`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:58.909588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-549ff06c-d10b-4b3e-b15f-f3b66e6f2f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:58.923009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:59.042181 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3173/6410] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:59.047119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb057c8-b105-4314-b888-85d7ed3554cc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:59.069749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb057c8-b105-4314-b888-85d7ed3554cc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:59.077706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81e688-d66b-42fb-8257-f3f1790053bd tempest-IdentityCatalogTest-887043070 tempest-IdentityCatalogTest-887043070-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2494c88b5fab4ba0bc1fb20319d0b816', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a46d46057e04649893520c505814381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:59.078411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e688-d66b-42fb-8257-f3f1790053bd tempest-IdentityCatalogTest-887043070 tempest-IdentityCatalogTest-887043070-project] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:59.078745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e688-d66b-42fb-8257-f3f1790053bd tempest-IdentityCatalogTest-887043070 tempest-IdentityCatalogTest-887043070-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:59.079030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e688-d66b-42fb-8257-f3f1790053bd tempest-IdentityCatalogTest-887043070 tempest-IdentityCatalogTest-887043070-project] PATH_INFO: `/v3/auth/catalog` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:59.079851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81e688-d66b-42fb-8257-f3f1790053bd tempest-IdentityCatalogTest-887043070 tempest-IdentityCatalogTest-887043070-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:59.081555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81e688-d66b-42fb-8257-f3f1790053bd tempest-IdentityCatalogTest-887043070 tempest-IdentityCatalogTest-887043070-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:59.085949 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3238/6411] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Jul 30 21:26:59 2022] GET /identity/v3/auth/catalog => generated 2648 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:26:59.093031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ff06c-d10b-4b3e-b15f-f3b66e6f2f28 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:59.257076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ff06c-d10b-4b3e-b15f-f3b66e6f2f28 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:59.264931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382722d2-ead0-45f5-97fc-e49dfca47742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:59.266057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382722d2-ead0-45f5-97fc-e49dfca47742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:59.266571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382722d2-ead0-45f5-97fc-e49dfca47742 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:59.268426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382722d2-ead0-45f5-97fc-e49dfca47742 admin admin] PATH_INFO: `/v3/users/2494c88b5fab4ba0bc1fb20319d0b816` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:59.270318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382722d2-ead0-45f5-97fc-e49dfca47742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2494c88b5fab4ba0bc1fb20319d0b816)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:59.273184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382722d2-ead0-45f5-97fc-e49dfca47742 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:59.402767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-382722d2-ead0-45f5-97fc-e49dfca47742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2494c88b5fab4ba0bc1fb20319d0b816'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:59.406337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-382722d2-ead0-45f5-97fc-e49dfca47742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2494c88b5fab4ba0bc1fb20319d0b816'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:59.451648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-382722d2-ead0-45f5-97fc-e49dfca47742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2494c88b5fab4ba0bc1fb20319d0b816'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:59.454976 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-382722d2-ead0-45f5-97fc-e49dfca47742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2494c88b5fab4ba0bc1fb20319d0b816'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:59.480099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-382722d2-ead0-45f5-97fc-e49dfca47742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2494c88b5fab4ba0bc1fb20319d0b816'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:26:59.509559 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3174/6412] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:26:59 2022] DELETE /identity/v3/users/2494c88b5fab4ba0bc1fb20319d0b816 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:26:59.511132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29970d70-3807-4c7e-8019-8b3fa3e027fc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:59.511672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29970d70-3807-4c7e-8019-8b3fa3e027fc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:59.512134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29970d70-3807-4c7e-8019-8b3fa3e027fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:59.562353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-29970d70-3807-4c7e-8019-8b3fa3e027fc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:26:59.566479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-29970d70-3807-4c7e-8019-8b3fa3e027fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:59.665925 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3239/6413] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:26:59.721515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382722d2-ead0-45f5-97fc-e49dfca47742 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:26:59.723162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-382722d2-ead0-45f5-97fc-e49dfca47742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:26:59.800129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:59.891871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382722d2-ead0-45f5-97fc-e49dfca47742 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:26:59.898387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df3d2d-4792-4784-a16e-f4dc2f9274a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:26:59.899367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df3d2d-4792-4784-a16e-f4dc2f9274a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:26:59.900524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df3d2d-4792-4784-a16e-f4dc2f9274a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:26:59.903996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df3d2d-4792-4784-a16e-f4dc2f9274a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:26:59.918716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df3d2d-4792-4784-a16e-f4dc2f9274a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:26:59.920257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df3d2d-4792-4784-a16e-f4dc2f9274a9 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:26:59.932715 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3175/6414] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:26:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:01.060209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29970d70-3807-4c7e-8019-8b3fa3e027fc None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:01.061776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-29970d70-3807-4c7e-8019-8b3fa3e027fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:01.218317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29970d70-3807-4c7e-8019-8b3fa3e027fc None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:01.237313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c289a8-514d-41a3-9ce4-e34ac5a42c0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:01.238599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c289a8-514d-41a3-9ce4-e34ac5a42c0d service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:01.239106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c289a8-514d-41a3-9ce4-e34ac5a42c0d service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:01.239744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c289a8-514d-41a3-9ce4-e34ac5a42c0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:01.243231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-96c289a8-514d-41a3-9ce4-e34ac5a42c0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:01.390056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c289a8-514d-41a3-9ce4-e34ac5a42c0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:01.391738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c289a8-514d-41a3-9ce4-e34ac5a42c0d service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:01.396690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:01.417603 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3240/6415] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:01 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:01.463743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df3d2d-4792-4784-a16e-f4dc2f9274a9 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:01.467018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-08df3d2d-4792-4784-a16e-f4dc2f9274a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:01.525281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df3d2d-4792-4784-a16e-f4dc2f9274a9 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:01.548349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375697aa-e5ae-4a68-9478-56be6c8ecb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:01.551662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375697aa-e5ae-4a68-9478-56be6c8ecb7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:01.552045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375697aa-e5ae-4a68-9478-56be6c8ecb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:01.552343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375697aa-e5ae-4a68-9478-56be6c8ecb7d admin admin] PATH_INFO: `/v3/projects/6a46d46057e04649893520c505814381` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:01.559203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375697aa-e5ae-4a68-9478-56be6c8ecb7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a46d46057e04649893520c505814381)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:01.581956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375697aa-e5ae-4a68-9478-56be6c8ecb7d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:01.704624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-375697aa-e5ae-4a68-9478-56be6c8ecb7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a46d46057e04649893520c505814381', 'request_id': 'req-375697aa-e5ae-4a68-9478-56be6c8ecb7d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:01.729798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-375697aa-e5ae-4a68-9478-56be6c8ecb7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a46d46057e04649893520c505814381', 'request_id': 'req-375697aa-e5ae-4a68-9478-56be6c8ecb7d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:01.753474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-375697aa-e5ae-4a68-9478-56be6c8ecb7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a46d46057e04649893520c505814381', 'request_id': 'req-375697aa-e5ae-4a68-9478-56be6c8ecb7d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:01.768500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-375697aa-e5ae-4a68-9478-56be6c8ecb7d admin admin] The token cache is being invalidate because project 6a46d46057e04649893520c505814381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:01.768859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-375697aa-e5ae-4a68-9478-56be6c8ecb7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:01.769871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-375697aa-e5ae-4a68-9478-56be6c8ecb7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:01.772011 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3176/6416] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:01 2022] DELETE /identity/v3/projects/6a46d46057e04649893520c505814381 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:01.777420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26212c-2570-4a96-ba13-1a55c6287a99 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:01.777726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26212c-2570-4a96-ba13-1a55c6287a99 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:01.778063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26212c-2570-4a96-ba13-1a55c6287a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:01.814681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-cb26212c-2570-4a96-ba13-1a55c6287a99 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:01.816518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cb26212c-2570-4a96-ba13-1a55c6287a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:01.995025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f52bbd-afc6-46f7-9b89-4a8f7f903df5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:01.995165 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3241/6417] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:01.995260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f52bbd-afc6-46f7-9b89-4a8f7f903df5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:01.995260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f52bbd-afc6-46f7-9b89-4a8f7f903df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:02.039416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c9f52bbd-afc6-46f7-9b89-4a8f7f903df5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:02.040696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c9f52bbd-afc6-46f7-9b89-4a8f7f903df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:02.056973 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3177/6418] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:02.061457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26212c-2570-4a96-ba13-1a55c6287a99 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:02.078984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26212c-2570-4a96-ba13-1a55c6287a99 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:02.087747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9dfe58-1cb2-4cb3-990f-8372eb5f22c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:02.089364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dfe58-1cb2-4cb3-990f-8372eb5f22c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:02.090017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dfe58-1cb2-4cb3-990f-8372eb5f22c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:02.090531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dfe58-1cb2-4cb3-990f-8372eb5f22c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:02.092108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9dfe58-1cb2-4cb3-990f-8372eb5f22c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:27:02.093024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9dfe58-1cb2-4cb3-990f-8372eb5f22c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:02.096932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9dfe58-1cb2-4cb3-990f-8372eb5f22c9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:02.138297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f52bbd-afc6-46f7-9b89-4a8f7f903df5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:02.138502 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3242/6419] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:27:02.149772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f52bbd-afc6-46f7-9b89-4a8f7f903df5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:02.155527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2759976-0686-44cf-97f3-71f788650f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:02.156340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2759976-0686-44cf-97f3-71f788650f07 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:02.156755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2759976-0686-44cf-97f3-71f788650f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:02.157310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2759976-0686-44cf-97f3-71f788650f07 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:02.157904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2759976-0686-44cf-97f3-71f788650f07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:02.160579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2759976-0686-44cf-97f3-71f788650f07 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:02.207411 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3178/6420] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:02 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:02.208779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9dfe58-1cb2-4cb3-990f-8372eb5f22c9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:02.230618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9dfe58-1cb2-4cb3-990f-8372eb5f22c9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:02.331443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffacae-bf3e-488f-b1ef-f66dc0169fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:02.332168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffacae-bf3e-488f-b1ef-f66dc0169fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:02.332493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffacae-bf3e-488f-b1ef-f66dc0169fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:02.332766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffacae-bf3e-488f-b1ef-f66dc0169fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:02.333681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffacae-bf3e-488f-b1ef-f66dc0169fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:02.337638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffacae-bf3e-488f-b1ef-f66dc0169fd5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:02.369008 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3243/6421] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:02 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:02.373404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2759976-0686-44cf-97f3-71f788650f07 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:02.385288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2759976-0686-44cf-97f3-71f788650f07 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:02.390385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb1524-cb7a-4373-92a6-26e50b627604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:02.391119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb1524-cb7a-4373-92a6-26e50b627604 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:02.391543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb1524-cb7a-4373-92a6-26e50b627604 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:02.392072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb1524-cb7a-4373-92a6-26e50b627604 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:02.393594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb1524-cb7a-4373-92a6-26e50b627604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:02.395333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb1524-cb7a-4373-92a6-26e50b627604 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:02.407431 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3179/6422] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:27:02.413221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffacae-bf3e-488f-b1ef-f66dc0169fd5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:02.438993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffacae-bf3e-488f-b1ef-f66dc0169fd5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:02.456385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14435b98-a21a-4ceb-a6af-8fe721c29073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:02.458284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14435b98-a21a-4ceb-a6af-8fe721c29073 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:02.458578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14435b98-a21a-4ceb-a6af-8fe721c29073 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:02.459777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14435b98-a21a-4ceb-a6af-8fe721c29073 admin admin] PATH_INFO: `/v3/projects/781787a2a10b414b8c2a1c4c0e9b9080/users/ea3ae08f8d20430e872f4173f73868ba/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:02.515244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14435b98-a21a-4ceb-a6af-8fe721c29073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=781787a2a10b414b8c2a1c4c0e9b9080, user_id=ea3ae08f8d20430e872f4173f73868ba, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:02.515898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14435b98-a21a-4ceb-a6af-8fe721c29073 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:02.555803 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3244/6423] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:02 2022] PUT /identity/v3/projects/781787a2a10b414b8c2a1c4c0e9b9080/users/ea3ae08f8d20430e872f4173f73868ba/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:02.557898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb1524-cb7a-4373-92a6-26e50b627604 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:02.573611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb1524-cb7a-4373-92a6-26e50b627604 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:02.648353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58eddd-0c0b-40f0-b250-3f25ece26ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:02.648982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58eddd-0c0b-40f0-b250-3f25ece26ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:02.649275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58eddd-0c0b-40f0-b250-3f25ece26ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:02.649558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58eddd-0c0b-40f0-b250-3f25ece26ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:02.650269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58eddd-0c0b-40f0-b250-3f25ece26ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:02.652177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58eddd-0c0b-40f0-b250-3f25ece26ff4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:02.667047 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3180/6424] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:02.668259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14435b98-a21a-4ceb-a6af-8fe721c29073 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:02.682322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14435b98-a21a-4ceb-a6af-8fe721c29073 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:02.690404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3d9c4-bcdf-4c6e-8421-aed5e9c671bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:02.691540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3d9c4-bcdf-4c6e-8421-aed5e9c671bf admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:02.691540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3d9c4-bcdf-4c6e-8421-aed5e9c671bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:02.691701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3d9c4-bcdf-4c6e-8421-aed5e9c671bf admin admin] PATH_INFO: `/v3/projects/781787a2a10b414b8c2a1c4c0e9b9080/users/ea3ae08f8d20430e872f4173f73868ba/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:02.695249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3d9c4-bcdf-4c6e-8421-aed5e9c671bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=781787a2a10b414b8c2a1c4c0e9b9080, user_id=ea3ae08f8d20430e872f4173f73868ba, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:02.698358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3d9c4-bcdf-4c6e-8421-aed5e9c671bf admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:02.719975 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3245/6425] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:02 2022] PUT /identity/v3/projects/781787a2a10b414b8c2a1c4c0e9b9080/users/ea3ae08f8d20430e872f4173f73868ba/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:27:02.736752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dd181-c942-4efd-8bb3-b830be06b02c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:02.737279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dd181-c942-4efd-8bb3-b830be06b02c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:02.737791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dd181-c942-4efd-8bb3-b830be06b02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:02.768195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:02.781094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-704dd181-c942-4efd-8bb3-b830be06b02c None None] MFA Rules not processed for user `ea3ae08f8d20430e872f4173f73868ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:02.783445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-704dd181-c942-4efd-8bb3-b830be06b02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:02.928218 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3181/6426] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:02.936217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3d9c4-bcdf-4c6e-8421-aed5e9c671bf admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:02.988730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:03.039446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3d9c4-bcdf-4c6e-8421-aed5e9c671bf admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:03.046333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36963613-0eac-4cad-adf2-dd485629de0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:03.047198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36963613-0eac-4cad-adf2-dd485629de0d admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:03.047612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36963613-0eac-4cad-adf2-dd485629de0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:03.047996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36963613-0eac-4cad-adf2-dd485629de0d admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:03.049390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36963613-0eac-4cad-adf2-dd485629de0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:03.051695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36963613-0eac-4cad-adf2-dd485629de0d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:03.091115 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3246/6427] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:02 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:03.096764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704dd181-c942-4efd-8bb3-b830be06b02c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:03.112234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704dd181-c942-4efd-8bb3-b830be06b02c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:03.277422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c350e81-3f07-4904-be2f-362709f0e68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:03.282296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c350e81-3f07-4904-be2f-362709f0e68c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:03.282719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c350e81-3f07-4904-be2f-362709f0e68c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:03.283725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c350e81-3f07-4904-be2f-362709f0e68c admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:03.285412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c350e81-3f07-4904-be2f-362709f0e68c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:03.290243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c350e81-3f07-4904-be2f-362709f0e68c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:03.325007 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3182/6428] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:03 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:03.328984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36963613-0eac-4cad-adf2-dd485629de0d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:03.350978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36963613-0eac-4cad-adf2-dd485629de0d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:03.359175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267a423-2f61-4a9f-842f-822309c767e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:03.360151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267a423-2f61-4a9f-842f-822309c767e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:03.360597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267a423-2f61-4a9f-842f-822309c767e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:03.361026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267a423-2f61-4a9f-842f-822309c767e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:03.363553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267a423-2f61-4a9f-842f-822309c767e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:03.365739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267a423-2f61-4a9f-842f-822309c767e6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:03.384915 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3247/6429] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:27:03.389142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c350e81-3f07-4904-be2f-362709f0e68c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:03.406179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c350e81-3f07-4904-be2f-362709f0e68c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:03.414020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b4713-dae8-4e2b-8b97-8ae3ee809d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:03.415035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b4713-dae8-4e2b-8b97-8ae3ee809d6f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:03.415652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b4713-dae8-4e2b-8b97-8ae3ee809d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:03.416136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b4713-dae8-4e2b-8b97-8ae3ee809d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:03.417330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b4713-dae8-4e2b-8b97-8ae3ee809d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:03.420098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b4713-dae8-4e2b-8b97-8ae3ee809d6f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:03.438468 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3183/6430] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:03.446266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267a423-2f61-4a9f-842f-822309c767e6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:03.463198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267a423-2f61-4a9f-842f-822309c767e6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:03.472649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2ee76-bb24-4ac0-bbf9-18da1834012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:03.473929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2ee76-bb24-4ac0-bbf9-18da1834012e admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:03.473929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2ee76-bb24-4ac0-bbf9-18da1834012e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:03.474346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2ee76-bb24-4ac0-bbf9-18da1834012e admin admin] PATH_INFO: `/v3/projects/abaf480a20b94662b9ec051b106b1bf3/users/ec1cc4aeec754afd8428ae5cbde0d6b9/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:03.506825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2ee76-bb24-4ac0-bbf9-18da1834012e admin admin] RBAC: Authorizing `identity:create_grant(project_id=abaf480a20b94662b9ec051b106b1bf3, user_id=ec1cc4aeec754afd8428ae5cbde0d6b9, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:03.513020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2ee76-bb24-4ac0-bbf9-18da1834012e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:03.540746 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3248/6431] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:03 2022] PUT /identity/v3/projects/abaf480a20b94662b9ec051b106b1bf3/users/ec1cc4aeec754afd8428ae5cbde0d6b9/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:03.551260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed21bf-32f0-4dff-ab8b-ed20aefe45ce None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:03.551763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed21bf-32f0-4dff-ab8b-ed20aefe45ce None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:03.552049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed21bf-32f0-4dff-ab8b-ed20aefe45ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:03.605835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d4ed21bf-32f0-4dff-ab8b-ed20aefe45ce None None] MFA Rules not processed for user `ec1cc4aeec754afd8428ae5cbde0d6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:03.607883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d4ed21bf-32f0-4dff-ab8b-ed20aefe45ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:03.751670 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3184/6432] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:03.776343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2ee76-bb24-4ac0-bbf9-18da1834012e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:03.778349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e1c2ee76-bb24-4ac0-bbf9-18da1834012e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:03.796123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed21bf-32f0-4dff-ab8b-ed20aefe45ce None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:03.797635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d4ed21bf-32f0-4dff-ab8b-ed20aefe45ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:03.806872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:03.946324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2ee76-bb24-4ac0-bbf9-18da1834012e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:03.952535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed21bf-32f0-4dff-ab8b-ed20aefe45ce None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:03.957403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84829d-b030-4f05-8e0c-2366b6c4d50b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:03.958198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84829d-b030-4f05-8e0c-2366b6c4d50b service glance] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:03.958610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3b5b8-3870-455b-9048-d6d93a90b6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:03.958718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84829d-b030-4f05-8e0c-2366b6c4d50b service glance] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:03.958956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84829d-b030-4f05-8e0c-2366b6c4d50b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:03.959850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3b5b8-3870-455b-9048-d6d93a90b6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:03.960252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3b5b8-3870-455b-9048-d6d93a90b6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:03.960629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3b5b8-3870-455b-9048-d6d93a90b6c1 admin admin] PATH_INFO: `/v3/users/f257f96b67f44f46a8da587115b0352b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:03.962551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3b5b8-3870-455b-9048-d6d93a90b6c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f257f96b67f44f46a8da587115b0352b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:03.964762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3b5b8-3870-455b-9048-d6d93a90b6c1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:04.114663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c9c3b5b8-3870-455b-9048-d6d93a90b6c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f257f96b67f44f46a8da587115b0352b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:04.115542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c9c3b5b8-3870-455b-9048-d6d93a90b6c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f257f96b67f44f46a8da587115b0352b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:04.122171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84829d-b030-4f05-8e0c-2366b6c4d50b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:04.126928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84829d-b030-4f05-8e0c-2366b6c4d50b service glance] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:04.154149 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3249/6433] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:04.167540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c9c3b5b8-3870-455b-9048-d6d93a90b6c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f257f96b67f44f46a8da587115b0352b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:04.168859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c9c3b5b8-3870-455b-9048-d6d93a90b6c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f257f96b67f44f46a8da587115b0352b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:04.217007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c9c3b5b8-3870-455b-9048-d6d93a90b6c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f257f96b67f44f46a8da587115b0352b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:04.284326 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3185/6434] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:03 2022] DELETE /identity/v3/users/f257f96b67f44f46a8da587115b0352b => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:04.287181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91793fa7-2f78-4072-be9c-9b48df57decc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:04.287644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91793fa7-2f78-4072-be9c-9b48df57decc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:04.288240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91793fa7-2f78-4072-be9c-9b48df57decc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:04.331987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-91793fa7-2f78-4072-be9c-9b48df57decc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:04.335817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-91793fa7-2f78-4072-be9c-9b48df57decc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:04.423383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:04.477549 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3250/6435] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:04.491447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3b5b8-3870-455b-9048-d6d93a90b6c1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:04.493581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c9c3b5b8-3870-455b-9048-d6d93a90b6c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:04.636037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3b5b8-3870-455b-9048-d6d93a90b6c1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:04.644449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209df0c9-39d4-4678-83f6-f35af35905f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:04.645514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209df0c9-39d4-4678-83f6-f35af35905f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:04.647325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209df0c9-39d4-4678-83f6-f35af35905f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:04.648263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209df0c9-39d4-4678-83f6-f35af35905f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:04.671326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209df0c9-39d4-4678-83f6-f35af35905f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:04.676328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209df0c9-39d4-4678-83f6-f35af35905f5 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:04.708577 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3186/6436] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:05.072038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91793fa7-2f78-4072-be9c-9b48df57decc None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:05.073890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-91793fa7-2f78-4072-be9c-9b48df57decc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:05.091027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91793fa7-2f78-4072-be9c-9b48df57decc None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:05.095697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a8699-2d38-4090-a498-ce88379f08ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:05.096621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a8699-2d38-4090-a498-ce88379f08ad service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:05.097229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a8699-2d38-4090-a498-ce88379f08ad service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:05.097652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a8699-2d38-4090-a498-ce88379f08ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:05.099680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-be3a8699-2d38-4090-a498-ce88379f08ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:05.118551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a8699-2d38-4090-a498-ce88379f08ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:05.121058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a8699-2d38-4090-a498-ce88379f08ad service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:05.135449 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3251/6437] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:27:05.366862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209df0c9-39d4-4678-83f6-f35af35905f5 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:05.369406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-209df0c9-39d4-4678-83f6-f35af35905f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:05.396096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209df0c9-39d4-4678-83f6-f35af35905f5 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:05.411267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116826be-a9ba-43e3-b5f2-07790570d3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:05.411267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116826be-a9ba-43e3-b5f2-07790570d3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:05.411267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116826be-a9ba-43e3-b5f2-07790570d3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:05.411626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116826be-a9ba-43e3-b5f2-07790570d3aa admin admin] PATH_INFO: `/v3/users/ea3ae08f8d20430e872f4173f73868ba` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:05.414127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116826be-a9ba-43e3-b5f2-07790570d3aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea3ae08f8d20430e872f4173f73868ba)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:05.415852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116826be-a9ba-43e3-b5f2-07790570d3aa admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:05.455361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:05.569585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-116826be-a9ba-43e3-b5f2-07790570d3aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea3ae08f8d20430e872f4173f73868ba'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:05.573170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-116826be-a9ba-43e3-b5f2-07790570d3aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea3ae08f8d20430e872f4173f73868ba'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:05.612293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-116826be-a9ba-43e3-b5f2-07790570d3aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea3ae08f8d20430e872f4173f73868ba'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:05.616629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-116826be-a9ba-43e3-b5f2-07790570d3aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea3ae08f8d20430e872f4173f73868ba'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:05.628833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-116826be-a9ba-43e3-b5f2-07790570d3aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea3ae08f8d20430e872f4173f73868ba'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:05.667103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc72ee-71ac-40b6-9468-1a240df3641b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:05.667317 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3187/6438] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:05 2022] DELETE /identity/v3/users/ea3ae08f8d20430e872f4173f73868ba => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:05.667866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc72ee-71ac-40b6-9468-1a240df3641b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:05.668247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc72ee-71ac-40b6-9468-1a240df3641b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:05.706573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-36fc72ee-71ac-40b6-9468-1a240df3641b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:05.708178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-36fc72ee-71ac-40b6-9468-1a240df3641b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:05.751782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116826be-a9ba-43e3-b5f2-07790570d3aa admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:05.753771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-116826be-a9ba-43e3-b5f2-07790570d3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:05.848407 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3252/6439] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:05.893470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116826be-a9ba-43e3-b5f2-07790570d3aa admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:05.910285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18702ee9-1668-4e09-9dad-d3e250459b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:05.911660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18702ee9-1668-4e09-9dad-d3e250459b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:05.912194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18702ee9-1668-4e09-9dad-d3e250459b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:05.913651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18702ee9-1668-4e09-9dad-d3e250459b0c admin admin] PATH_INFO: `/v3/projects/8471307ea6374671aa04d45ebb282150` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:05.916849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18702ee9-1668-4e09-9dad-d3e250459b0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8471307ea6374671aa04d45ebb282150)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:05.919652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18702ee9-1668-4e09-9dad-d3e250459b0c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:05.920519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc72ee-71ac-40b6-9468-1a240df3641b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:05.922234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-36fc72ee-71ac-40b6-9468-1a240df3641b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:06.025094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-18702ee9-1668-4e09-9dad-d3e250459b0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8471307ea6374671aa04d45ebb282150', 'request_id': 'req-18702ee9-1668-4e09-9dad-d3e250459b0c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:06.040902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-18702ee9-1668-4e09-9dad-d3e250459b0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8471307ea6374671aa04d45ebb282150', 'request_id': 'req-18702ee9-1668-4e09-9dad-d3e250459b0c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:06.051716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-18702ee9-1668-4e09-9dad-d3e250459b0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8471307ea6374671aa04d45ebb282150', 'request_id': 'req-18702ee9-1668-4e09-9dad-d3e250459b0c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:06.071682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc72ee-71ac-40b6-9468-1a240df3641b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:06.083003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-18702ee9-1668-4e09-9dad-d3e250459b0c admin admin] The token cache is being invalidate because project 8471307ea6374671aa04d45ebb282150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:06.083859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-18702ee9-1668-4e09-9dad-d3e250459b0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:06.086831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-18702ee9-1668-4e09-9dad-d3e250459b0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:06.094833 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3188/6440] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:05 2022] DELETE /identity/v3/projects/8471307ea6374671aa04d45ebb282150 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:06.096588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e54a13-6364-4f28-bd37-06800801ecb9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:06.097065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e54a13-6364-4f28-bd37-06800801ecb9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:06.097487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e54a13-6364-4f28-bd37-06800801ecb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:06.136154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f3e54a13-6364-4f28-bd37-06800801ecb9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:06.141066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f3e54a13-6364-4f28-bd37-06800801ecb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:06.195053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:06.196492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62f4e8-68d8-43f2-88ad-1504d37ba829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:06.197761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62f4e8-68d8-43f2-88ad-1504d37ba829 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:06.198254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62f4e8-68d8-43f2-88ad-1504d37ba829 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:06.198734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62f4e8-68d8-43f2-88ad-1504d37ba829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:06.203431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3e62f4e8-68d8-43f2-88ad-1504d37ba829 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:06.295960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:06.302220 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3189/6441] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:06.309923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50db4f1-62c0-44ef-ae9a-60f955180ccf None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:06.310230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50db4f1-62c0-44ef-ae9a-60f955180ccf None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:06.310525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50db4f1-62c0-44ef-ae9a-60f955180ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:06.354339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a50db4f1-62c0-44ef-ae9a-60f955180ccf None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:06.356264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a50db4f1-62c0-44ef-ae9a-60f955180ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:06.368355 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3190/6442] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:27:06.369175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62f4e8-68d8-43f2-88ad-1504d37ba829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:06.370780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62f4e8-68d8-43f2-88ad-1504d37ba829 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:06.372803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50db4f1-62c0-44ef-ae9a-60f955180ccf None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:06.399554 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3253/6443] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:06.412683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50db4f1-62c0-44ef-ae9a-60f955180ccf None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:06.419520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44dec2-dd93-4389-b617-3bb1a1170091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:06.420397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44dec2-dd93-4389-b617-3bb1a1170091 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:06.420858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44dec2-dd93-4389-b617-3bb1a1170091 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:06.421577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44dec2-dd93-4389-b617-3bb1a1170091 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:06.422461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44dec2-dd93-4389-b617-3bb1a1170091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:27:06.422920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44dec2-dd93-4389-b617-3bb1a1170091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:06.427523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44dec2-dd93-4389-b617-3bb1a1170091 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:06.450817 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3191/6444] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:27:06.455091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62f4e8-68d8-43f2-88ad-1504d37ba829 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:06.467459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62f4e8-68d8-43f2-88ad-1504d37ba829 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:06.486629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6875d-f2e5-4fcd-bba7-4f3522895946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:06.489803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6875d-f2e5-4fcd-bba7-4f3522895946 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:06.490134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6875d-f2e5-4fcd-bba7-4f3522895946 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:06.491313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6875d-f2e5-4fcd-bba7-4f3522895946 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:06.492088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6875d-f2e5-4fcd-bba7-4f3522895946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:06.494056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6875d-f2e5-4fcd-bba7-4f3522895946 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:06.541866 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3254/6445] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:06 2022] POST /identity/v3/projects => generated 365 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:27:06.545377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44dec2-dd93-4389-b617-3bb1a1170091 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:06.557331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44dec2-dd93-4389-b617-3bb1a1170091 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:06.671864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65708e88-a351-493b-82f5-cb666b27baca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:06.672620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65708e88-a351-493b-82f5-cb666b27baca admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:06.672980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65708e88-a351-493b-82f5-cb666b27baca admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:06.674169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65708e88-a351-493b-82f5-cb666b27baca admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:06.675013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65708e88-a351-493b-82f5-cb666b27baca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:06.678307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65708e88-a351-493b-82f5-cb666b27baca admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:06.711127 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3192/6446] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:06 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:06.712000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6875d-f2e5-4fcd-bba7-4f3522895946 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:06.725413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6875d-f2e5-4fcd-bba7-4f3522895946 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:06.732779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b289ef-1673-4d4b-a567-924d539b176b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:06.733547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b289ef-1673-4d4b-a567-924d539b176b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:06.733935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b289ef-1673-4d4b-a567-924d539b176b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:06.734280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b289ef-1673-4d4b-a567-924d539b176b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:06.735524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b289ef-1673-4d4b-a567-924d539b176b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:06.738024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b289ef-1673-4d4b-a567-924d539b176b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:06.753810 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3255/6447] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:27:06.758604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65708e88-a351-493b-82f5-cb666b27baca admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:06.775748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65708e88-a351-493b-82f5-cb666b27baca admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:06.782432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d817977-a204-48cc-9acd-94408915047c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:06.783879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d817977-a204-48cc-9acd-94408915047c admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:06.784314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d817977-a204-48cc-9acd-94408915047c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:06.784664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d817977-a204-48cc-9acd-94408915047c admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:06.785483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d817977-a204-48cc-9acd-94408915047c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:06.787397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d817977-a204-48cc-9acd-94408915047c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:06.807727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b289ef-1673-4d4b-a567-924d539b176b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:06.815966 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3193/6448] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:06.821625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b289ef-1673-4d4b-a567-924d539b176b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:06.830457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e91ee5-a992-49cb-a5fe-71b4f15ba4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:06.831306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e91ee5-a992-49cb-a5fe-71b4f15ba4f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:06.831699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e91ee5-a992-49cb-a5fe-71b4f15ba4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:06.832075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e91ee5-a992-49cb-a5fe-71b4f15ba4f7 admin admin] PATH_INFO: `/v3/projects/310f239e7cec4845bdab88f080f2b911/users/c0a8653297ad4958b12ae9f6ae77e275/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:06.862107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e91ee5-a992-49cb-a5fe-71b4f15ba4f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=310f239e7cec4845bdab88f080f2b911, user_id=c0a8653297ad4958b12ae9f6ae77e275, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:06.865117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e91ee5-a992-49cb-a5fe-71b4f15ba4f7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:06.906325 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3256/6449] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:06 2022] PUT /identity/v3/projects/310f239e7cec4845bdab88f080f2b911/users/c0a8653297ad4958b12ae9f6ae77e275/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:06.908748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ff8f5-7966-4af0-b273-0b551d9a12e4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:06.909035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ff8f5-7966-4af0-b273-0b551d9a12e4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:06.909313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ff8f5-7966-4af0-b273-0b551d9a12e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:06.971821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d89ff8f5-7966-4af0-b273-0b551d9a12e4 None None] MFA Rules not processed for user `c0a8653297ad4958b12ae9f6ae77e275`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:06.973239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d89ff8f5-7966-4af0-b273-0b551d9a12e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:07.150698 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3194/6450] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:07.154973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e91ee5-a992-49cb-a5fe-71b4f15ba4f7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:07.301733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e91ee5-a992-49cb-a5fe-71b4f15ba4f7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:07.308307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38b680-ced4-44c1-80b7-a2e247c538c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:07.308972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38b680-ced4-44c1-80b7-a2e247c538c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:07.309334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38b680-ced4-44c1-80b7-a2e247c538c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:07.309623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38b680-ced4-44c1-80b7-a2e247c538c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:07.310438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38b680-ced4-44c1-80b7-a2e247c538c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:07.314730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38b680-ced4-44c1-80b7-a2e247c538c9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:07.381187 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3257/6451] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:07 2022] POST /identity/v3/projects => generated 365 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:07.385327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ff8f5-7966-4af0-b273-0b551d9a12e4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:07.404256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ff8f5-7966-4af0-b273-0b551d9a12e4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:07.435235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:07.565406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f9118-c2bc-46b8-9560-0d2c01070ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:07.567229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f9118-c2bc-46b8-9560-0d2c01070ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:07.567545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f9118-c2bc-46b8-9560-0d2c01070ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:07.567830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f9118-c2bc-46b8-9560-0d2c01070ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:07.568639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f9118-c2bc-46b8-9560-0d2c01070ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:07.570689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f9118-c2bc-46b8-9560-0d2c01070ce7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:07.652444 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3195/6452] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:07 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:07.653762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38b680-ced4-44c1-80b7-a2e247c538c9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:07.671179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38b680-ced4-44c1-80b7-a2e247c538c9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:07.692245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfae0e3-31f0-4495-968e-1a49db686727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:07.693173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfae0e3-31f0-4495-968e-1a49db686727 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:07.693660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfae0e3-31f0-4495-968e-1a49db686727 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:07.693956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfae0e3-31f0-4495-968e-1a49db686727 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:07.694755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfae0e3-31f0-4495-968e-1a49db686727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:07.696523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfae0e3-31f0-4495-968e-1a49db686727 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:07.742157 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3258/6453] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:07.746501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f9118-c2bc-46b8-9560-0d2c01070ce7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:07.761853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f9118-c2bc-46b8-9560-0d2c01070ce7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:07.768265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282f4d7-2eec-4b32-9e91-2a7ebec6689b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:07.769096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282f4d7-2eec-4b32-9e91-2a7ebec6689b admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:07.769448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282f4d7-2eec-4b32-9e91-2a7ebec6689b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:07.769929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282f4d7-2eec-4b32-9e91-2a7ebec6689b admin admin] PATH_INFO: `/v3/projects/4353e2cf654b434ea52a9ea613d7aae2/users/d1b4bb991e4c423da2d3bb1119073050/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:07.805450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282f4d7-2eec-4b32-9e91-2a7ebec6689b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4353e2cf654b434ea52a9ea613d7aae2, user_id=d1b4bb991e4c423da2d3bb1119073050, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:07.808482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282f4d7-2eec-4b32-9e91-2a7ebec6689b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:07.836990 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3196/6454] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:07 2022] PUT /identity/v3/projects/4353e2cf654b434ea52a9ea613d7aae2/users/d1b4bb991e4c423da2d3bb1119073050/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:07.841202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfae0e3-31f0-4495-968e-1a49db686727 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:07.856253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfae0e3-31f0-4495-968e-1a49db686727 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:07.923780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:07.940732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e2b56-53f7-4e8c-b307-93e5822eb7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:07.941429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e2b56-53f7-4e8c-b307-93e5822eb7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:07.941716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e2b56-53f7-4e8c-b307-93e5822eb7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:07.941994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e2b56-53f7-4e8c-b307-93e5822eb7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:07.943090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e2b56-53f7-4e8c-b307-93e5822eb7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:07.945192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e2b56-53f7-4e8c-b307-93e5822eb7b6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:07.961554 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3259/6455] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:07.962573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282f4d7-2eec-4b32-9e91-2a7ebec6689b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:07.983302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282f4d7-2eec-4b32-9e91-2a7ebec6689b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:08.002509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ff47e-6032-4785-a434-da6743ff56d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:08.003610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ff47e-6032-4785-a434-da6743ff56d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:08.004101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ff47e-6032-4785-a434-da6743ff56d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:08.004553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ff47e-6032-4785-a434-da6743ff56d8 admin admin] PATH_INFO: `/v3/projects/4353e2cf654b434ea52a9ea613d7aae2/users/d1b4bb991e4c423da2d3bb1119073050/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:08.007165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ff47e-6032-4785-a434-da6743ff56d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4353e2cf654b434ea52a9ea613d7aae2, user_id=d1b4bb991e4c423da2d3bb1119073050, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:08.010283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ff47e-6032-4785-a434-da6743ff56d8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:08.037277 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3197/6456] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:07 2022] PUT /identity/v3/projects/4353e2cf654b434ea52a9ea613d7aae2/users/d1b4bb991e4c423da2d3bb1119073050/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:27:08.039397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024aea91-e63c-4642-bf4d-94ebb66d87d8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:08.039792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024aea91-e63c-4642-bf4d-94ebb66d87d8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:08.040237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024aea91-e63c-4642-bf4d-94ebb66d87d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:08.099008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-024aea91-e63c-4642-bf4d-94ebb66d87d8 None None] MFA Rules not processed for user `d1b4bb991e4c423da2d3bb1119073050`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:08.100567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-024aea91-e63c-4642-bf4d-94ebb66d87d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:08.233906 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3260/6457] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:08 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:08.242332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ff47e-6032-4785-a434-da6743ff56d8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:08.244580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d02ff47e-6032-4785-a434-da6743ff56d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:08.363991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024aea91-e63c-4642-bf4d-94ebb66d87d8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:08.365564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-024aea91-e63c-4642-bf4d-94ebb66d87d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:08.408684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ff47e-6032-4785-a434-da6743ff56d8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:08.412749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428ae5c-5a12-4eb7-92f0-2ef8bc4a38cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:08.413411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428ae5c-5a12-4eb7-92f0-2ef8bc4a38cf service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:08.413709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428ae5c-5a12-4eb7-92f0-2ef8bc4a38cf service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:08.414106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428ae5c-5a12-4eb7-92f0-2ef8bc4a38cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:08.443147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428ae5c-5a12-4eb7-92f0-2ef8bc4a38cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:08.445030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428ae5c-5a12-4eb7-92f0-2ef8bc4a38cf service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:08.489340 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3198/6458] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:08.507937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024aea91-e63c-4642-bf4d-94ebb66d87d8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:08.525845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c935c5-a0eb-4326-a616-31055480a9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:08.526539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c935c5-a0eb-4326-a616-31055480a9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:08.526861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c935c5-a0eb-4326-a616-31055480a9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:08.527150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c935c5-a0eb-4326-a616-31055480a9a6 admin admin] PATH_INFO: `/v3/projects/781787a2a10b414b8c2a1c4c0e9b9080` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:08.529348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c935c5-a0eb-4326-a616-31055480a9a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=781787a2a10b414b8c2a1c4c0e9b9080)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:08.533587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c935c5-a0eb-4326-a616-31055480a9a6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:08.640974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b1c935c5-a0eb-4326-a616-31055480a9a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '781787a2a10b414b8c2a1c4c0e9b9080', 'request_id': 'req-b1c935c5-a0eb-4326-a616-31055480a9a6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:08.647213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428ae5c-5a12-4eb7-92f0-2ef8bc4a38cf service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:08.648688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b1c935c5-a0eb-4326-a616-31055480a9a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '781787a2a10b414b8c2a1c4c0e9b9080', 'request_id': 'req-b1c935c5-a0eb-4326-a616-31055480a9a6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:08.662510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428ae5c-5a12-4eb7-92f0-2ef8bc4a38cf service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:08.663851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b1c935c5-a0eb-4326-a616-31055480a9a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '781787a2a10b414b8c2a1c4c0e9b9080', 'request_id': 'req-b1c935c5-a0eb-4326-a616-31055480a9a6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:08.685593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:08.698611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b1c935c5-a0eb-4326-a616-31055480a9a6 admin admin] The token cache is being invalidate because project 781787a2a10b414b8c2a1c4c0e9b9080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:08.700983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b1c935c5-a0eb-4326-a616-31055480a9a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:08.703873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b1c935c5-a0eb-4326-a616-31055480a9a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:08.707936 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3261/6459] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:08 2022] DELETE /identity/v3/projects/781787a2a10b414b8c2a1c4c0e9b9080 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:08.716980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c935c5-a0eb-4326-a616-31055480a9a6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:08.719952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b1c935c5-a0eb-4326-a616-31055480a9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:08.786462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428bf85-ef9b-4231-acbe-99446ff7789f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:08.788055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428bf85-ef9b-4231-acbe-99446ff7789f service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:08.788655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428bf85-ef9b-4231-acbe-99446ff7789f service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:08.789156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428bf85-ef9b-4231-acbe-99446ff7789f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:08.792962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a428bf85-ef9b-4231-acbe-99446ff7789f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:08.804130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:08.821432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c935c5-a0eb-4326-a616-31055480a9a6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:08.833210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72e6e9-93e7-42e4-9a2f-13ff0966a853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:08.834066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72e6e9-93e7-42e4-9a2f-13ff0966a853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:08.834357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72e6e9-93e7-42e4-9a2f-13ff0966a853 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:08.834637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72e6e9-93e7-42e4-9a2f-13ff0966a853 admin admin] PATH_INFO: `/v3/users/ec1cc4aeec754afd8428ae5cbde0d6b9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:08.836464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72e6e9-93e7-42e4-9a2f-13ff0966a853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec1cc4aeec754afd8428ae5cbde0d6b9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:08.838651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72e6e9-93e7-42e4-9a2f-13ff0966a853 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:08.903257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a428bf85-ef9b-4231-acbe-99446ff7789f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:08.905129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a428bf85-ef9b-4231-acbe-99446ff7789f service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:08.920242 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3199/6460] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:27:08.945213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb72e6e9-93e7-42e4-9a2f-13ff0966a853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec1cc4aeec754afd8428ae5cbde0d6b9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:08.965977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb72e6e9-93e7-42e4-9a2f-13ff0966a853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec1cc4aeec754afd8428ae5cbde0d6b9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:08.966751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb72e6e9-93e7-42e4-9a2f-13ff0966a853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec1cc4aeec754afd8428ae5cbde0d6b9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:08.976347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb72e6e9-93e7-42e4-9a2f-13ff0966a853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec1cc4aeec754afd8428ae5cbde0d6b9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:08.977181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb72e6e9-93e7-42e4-9a2f-13ff0966a853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec1cc4aeec754afd8428ae5cbde0d6b9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:09.026683 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3262/6461] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:08 2022] DELETE /identity/v3/users/ec1cc4aeec754afd8428ae5cbde0d6b9 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:10.158906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428bf85-ef9b-4231-acbe-99446ff7789f service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:10.170568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428bf85-ef9b-4231-acbe-99446ff7789f service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:10.243529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b796d0-fd61-40b4-9b3c-39ab4063b4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:10.244995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b796d0-fd61-40b4-9b3c-39ab4063b4b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:10.245671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b796d0-fd61-40b4-9b3c-39ab4063b4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:10.246133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b796d0-fd61-40b4-9b3c-39ab4063b4b4 admin admin] PATH_INFO: `/v3/projects/abaf480a20b94662b9ec051b106b1bf3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:10.247684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b796d0-fd61-40b4-9b3c-39ab4063b4b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abaf480a20b94662b9ec051b106b1bf3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:10.249868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b796d0-fd61-40b4-9b3c-39ab4063b4b4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:10.374415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-90b796d0-fd61-40b4-9b3c-39ab4063b4b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abaf480a20b94662b9ec051b106b1bf3', 'request_id': 'req-90b796d0-fd61-40b4-9b3c-39ab4063b4b4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:10.393257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-90b796d0-fd61-40b4-9b3c-39ab4063b4b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abaf480a20b94662b9ec051b106b1bf3', 'request_id': 'req-90b796d0-fd61-40b4-9b3c-39ab4063b4b4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:10.404139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-90b796d0-fd61-40b4-9b3c-39ab4063b4b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abaf480a20b94662b9ec051b106b1bf3', 'request_id': 'req-90b796d0-fd61-40b4-9b3c-39ab4063b4b4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:10.426549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-90b796d0-fd61-40b4-9b3c-39ab4063b4b4 admin admin] The token cache is being invalidate because project abaf480a20b94662b9ec051b106b1bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:10.426958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-90b796d0-fd61-40b4-9b3c-39ab4063b4b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:10.428088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-90b796d0-fd61-40b4-9b3c-39ab4063b4b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:10.429909 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3200/6462] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:10 2022] DELETE /identity/v3/projects/abaf480a20b94662b9ec051b106b1bf3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:10.434729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccea4fb-5fba-4e09-8fc7-36943b707b0d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:10.435722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccea4fb-5fba-4e09-8fc7-36943b707b0d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:10.436207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccea4fb-5fba-4e09-8fc7-36943b707b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:10.483938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bccea4fb-5fba-4e09-8fc7-36943b707b0d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:10.485654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bccea4fb-5fba-4e09-8fc7-36943b707b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:10.634008 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3263/6463] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:10.643323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6688e-e1f7-4bce-9a5b-8d341f818f3d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:10.644370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6688e-e1f7-4bce-9a5b-8d341f818f3d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:10.644704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6688e-e1f7-4bce-9a5b-8d341f818f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:10.734035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-dfd6688e-e1f7-4bce-9a5b-8d341f818f3d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:10.735033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dfd6688e-e1f7-4bce-9a5b-8d341f818f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:10.786453 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3201/6464] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:10.790773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccea4fb-5fba-4e09-8fc7-36943b707b0d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:10.807204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccea4fb-5fba-4e09-8fc7-36943b707b0d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:10.823563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e1d5d-d71c-44a1-818f-d856091c2e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:10.825019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e1d5d-d71c-44a1-818f-d856091c2e1e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:10.826423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e1d5d-d71c-44a1-818f-d856091c2e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:10.826910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e1d5d-d71c-44a1-818f-d856091c2e1e admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:10.828222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e1d5d-d71c-44a1-818f-d856091c2e1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:27:10.828769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e1d5d-d71c-44a1-818f-d856091c2e1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:10.832299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e1d5d-d71c-44a1-818f-d856091c2e1e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:10.868019 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3264/6465] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:27:10.869572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6688e-e1f7-4bce-9a5b-8d341f818f3d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:10.897980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6688e-e1f7-4bce-9a5b-8d341f818f3d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:10.927721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fc257-9516-4fa3-8bf2-173c6944f6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:10.931261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc257-9516-4fa3-8bf2-173c6944f6da admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:10.944005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc257-9516-4fa3-8bf2-173c6944f6da admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:10.950903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc257-9516-4fa3-8bf2-173c6944f6da admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:10.953195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fc257-9516-4fa3-8bf2-173c6944f6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:10.955444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fc257-9516-4fa3-8bf2-173c6944f6da admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:11.037906 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3202/6466] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:10 2022] POST /identity/v3/projects => generated 371 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:11.042042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e1d5d-d71c-44a1-818f-d856091c2e1e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:11.058931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e1d5d-d71c-44a1-818f-d856091c2e1e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:11.084026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:11.171765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19716b3e-4b77-4c92-aa61-5b35fe2b087b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:11.172959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19716b3e-4b77-4c92-aa61-5b35fe2b087b admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:11.173431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19716b3e-4b77-4c92-aa61-5b35fe2b087b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:11.173854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19716b3e-4b77-4c92-aa61-5b35fe2b087b admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:11.174694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19716b3e-4b77-4c92-aa61-5b35fe2b087b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:11.176803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19716b3e-4b77-4c92-aa61-5b35fe2b087b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:11.235251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fc257-9516-4fa3-8bf2-173c6944f6da admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:11.243240 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3265/6467] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:11 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:11.250608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fc257-9516-4fa3-8bf2-173c6944f6da admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:11.260969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416739d-90a1-4b6b-9dd6-bca607399e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:11.261614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416739d-90a1-4b6b-9dd6-bca607399e10 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:11.262104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416739d-90a1-4b6b-9dd6-bca607399e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:11.262559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416739d-90a1-4b6b-9dd6-bca607399e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:11.263500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416739d-90a1-4b6b-9dd6-bca607399e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:11.271703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416739d-90a1-4b6b-9dd6-bca607399e10 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:11.278274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:11.291495 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3203/6468] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:11.294942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19716b3e-4b77-4c92-aa61-5b35fe2b087b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:11.306630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19716b3e-4b77-4c92-aa61-5b35fe2b087b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:11.313681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1fa9e-a51f-4b03-a6a9-cd3116a0b961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:11.316264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1fa9e-a51f-4b03-a6a9-cd3116a0b961 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:11.316581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1fa9e-a51f-4b03-a6a9-cd3116a0b961 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:11.316878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1fa9e-a51f-4b03-a6a9-cd3116a0b961 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:11.317737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1fa9e-a51f-4b03-a6a9-cd3116a0b961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:11.320196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1fa9e-a51f-4b03-a6a9-cd3116a0b961 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:11.347891 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3266/6469] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:11.353103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416739d-90a1-4b6b-9dd6-bca607399e10 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:11.369939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416739d-90a1-4b6b-9dd6-bca607399e10 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:11.378854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa808c3-5daa-482d-83c7-1dfb79c8d16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:11.379764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa808c3-5daa-482d-83c7-1dfb79c8d16e admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:11.380366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa808c3-5daa-482d-83c7-1dfb79c8d16e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:11.380817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa808c3-5daa-482d-83c7-1dfb79c8d16e admin admin] PATH_INFO: `/v3/projects/cc0f39e8e9014ea3989db7d337592d3e/users/bdce3aa6c4774c6590dda35c753ac2b2/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:11.404140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa808c3-5daa-482d-83c7-1dfb79c8d16e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc0f39e8e9014ea3989db7d337592d3e, user_id=bdce3aa6c4774c6590dda35c753ac2b2, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:11.407807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa808c3-5daa-482d-83c7-1dfb79c8d16e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:11.429138 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3204/6470] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:11 2022] PUT /identity/v3/projects/cc0f39e8e9014ea3989db7d337592d3e/users/bdce3aa6c4774c6590dda35c753ac2b2/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:27:11.441752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ed16-161b-4b42-b898-2e7ef0824005 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:11.442264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ed16-161b-4b42-b898-2e7ef0824005 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:11.442456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ed16-161b-4b42-b898-2e7ef0824005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:11.486828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-56c7ed16-161b-4b42-b898-2e7ef0824005 None None] MFA Rules not processed for user `bdce3aa6c4774c6590dda35c753ac2b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:11.488848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-56c7ed16-161b-4b42-b898-2e7ef0824005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:11.595501 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3267/6471] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:11.602796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa808c3-5daa-482d-83c7-1dfb79c8d16e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:11.604763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7aa808c3-5daa-482d-83c7-1dfb79c8d16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:11.729470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa808c3-5daa-482d-83c7-1dfb79c8d16e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:11.734692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee8dd6-16ba-4226-a4ec-9446dacb904a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:11.736663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee8dd6-16ba-4226-a4ec-9446dacb904a service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:11.736961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee8dd6-16ba-4226-a4ec-9446dacb904a service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:11.737236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee8dd6-16ba-4226-a4ec-9446dacb904a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:11.752449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee8dd6-16ba-4226-a4ec-9446dacb904a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:11.754535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee8dd6-16ba-4226-a4ec-9446dacb904a service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:11.771768 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3205/6472] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:11.974224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae0d24-f870-41e1-ac44-438bd39f2de8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:11.974754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae0d24-f870-41e1-ac44-438bd39f2de8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:11.977680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae0d24-f870-41e1-ac44-438bd39f2de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:12.028787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c7ae0d24-f870-41e1-ac44-438bd39f2de8 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:12.034083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c7ae0d24-f870-41e1-ac44-438bd39f2de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:12.202836 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3268/6473] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:27:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:12.211384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee8dd6-16ba-4226-a4ec-9446dacb904a service glance] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:12.213175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b7ee8dd6-16ba-4226-a4ec-9446dacb904a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:12.387503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee8dd6-16ba-4226-a4ec-9446dacb904a service glance] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:12.395209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad94caf-113b-40a9-b56d-b7022e37444d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:12.396214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad94caf-113b-40a9-b56d-b7022e37444d service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:12.397135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad94caf-113b-40a9-b56d-b7022e37444d service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:12.397512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad94caf-113b-40a9-b56d-b7022e37444d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:12.418103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad94caf-113b-40a9-b56d-b7022e37444d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:12.420409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad94caf-113b-40a9-b56d-b7022e37444d service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:12.459711 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3206/6474] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:27:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 30 21:27:12.588067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae0d24-f870-41e1-ac44-438bd39f2de8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:12.590748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c7ae0d24-f870-41e1-ac44-438bd39f2de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:12.627223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:12.754241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae0d24-f870-41e1-ac44-438bd39f2de8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:12.771235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db524fc2-89a1-46b4-bb9d-c8a802575b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:12.772156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db524fc2-89a1-46b4-bb9d-c8a802575b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:12.772590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db524fc2-89a1-46b4-bb9d-c8a802575b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:12.773021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db524fc2-89a1-46b4-bb9d-c8a802575b94 admin admin] PATH_INFO: `/v3/users/c0a8653297ad4958b12ae9f6ae77e275` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:12.774703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db524fc2-89a1-46b4-bb9d-c8a802575b94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0a8653297ad4958b12ae9f6ae77e275)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:12.776839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db524fc2-89a1-46b4-bb9d-c8a802575b94 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:12.929670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-db524fc2-89a1-46b4-bb9d-c8a802575b94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0a8653297ad4958b12ae9f6ae77e275'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:12.960440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-db524fc2-89a1-46b4-bb9d-c8a802575b94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0a8653297ad4958b12ae9f6ae77e275'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:12.973003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-db524fc2-89a1-46b4-bb9d-c8a802575b94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0a8653297ad4958b12ae9f6ae77e275'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:12.988414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-db524fc2-89a1-46b4-bb9d-c8a802575b94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0a8653297ad4958b12ae9f6ae77e275'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:12.989372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-db524fc2-89a1-46b4-bb9d-c8a802575b94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0a8653297ad4958b12ae9f6ae77e275'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:13.015813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea48b2-d607-42bb-b35e-f74ad67a2a8a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:13.016105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea48b2-d607-42bb-b35e-f74ad67a2a8a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:13.016411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea48b2-d607-42bb-b35e-f74ad67a2a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:13.034108 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3269/6475] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:12 2022] DELETE /identity/v3/users/c0a8653297ad4958b12ae9f6ae77e275 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:13.036034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67d810-0068-42f4-bb16-23468f64dbbd None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:13.036367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67d810-0068-42f4-bb16-23468f64dbbd None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:13.036649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67d810-0068-42f4-bb16-23468f64dbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:13.062484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3b67d810-0068-42f4-bb16-23468f64dbbd None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:13.064267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3b67d810-0068-42f4-bb16-23468f64dbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:13.088325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-acea48b2-d607-42bb-b35e-f74ad67a2a8a None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:13.092119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-acea48b2-d607-42bb-b35e-f74ad67a2a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:13.249152 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3270/6476] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:13.262806 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3207/6477] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:27:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:13.278375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67d810-0068-42f4-bb16-23468f64dbbd None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:13.280171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3b67d810-0068-42f4-bb16-23468f64dbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:13.328664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea48b2-d607-42bb-b35e-f74ad67a2a8a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:13.330745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-acea48b2-d607-42bb-b35e-f74ad67a2a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:13.352640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:13.354367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:13.442151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67d810-0068-42f4-bb16-23468f64dbbd None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:13.456261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51959a4e-061b-44e5-9ef5-f8e5ba77fbff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:13.458351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51959a4e-061b-44e5-9ef5-f8e5ba77fbff service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:13.460029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51959a4e-061b-44e5-9ef5-f8e5ba77fbff service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:13.460792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51959a4e-061b-44e5-9ef5-f8e5ba77fbff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:13.486861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51959a4e-061b-44e5-9ef5-f8e5ba77fbff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:13.491884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51959a4e-061b-44e5-9ef5-f8e5ba77fbff service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:13.521755 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3271/6478] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:27:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:27:13.539625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea48b2-d607-42bb-b35e-f74ad67a2a8a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:13.548733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8751642-66e3-4ba4-ab5c-8ce447b50c24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:13.550680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8751642-66e3-4ba4-ab5c-8ce447b50c24 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:13.551219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8751642-66e3-4ba4-ab5c-8ce447b50c24 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:13.552152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8751642-66e3-4ba4-ab5c-8ce447b50c24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:13.582896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8751642-66e3-4ba4-ab5c-8ce447b50c24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:13.584714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8751642-66e3-4ba4-ab5c-8ce447b50c24 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:13.615115 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3208/6479] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:27:13.883443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b35c1d-40b5-4785-b3fb-d9a2ced3b836 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:13.883964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b35c1d-40b5-4785-b3fb-d9a2ced3b836 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:13.884036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b35c1d-40b5-4785-b3fb-d9a2ced3b836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:13.921733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-71b35c1d-40b5-4785-b3fb-d9a2ced3b836 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:13.923898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-71b35c1d-40b5-4785-b3fb-d9a2ced3b836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:13.940197 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3272/6480] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:27:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:27:13.953521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8751642-66e3-4ba4-ab5c-8ce447b50c24 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:13.976115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8751642-66e3-4ba4-ab5c-8ce447b50c24 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:13.992964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231dfce-2564-45ab-95a9-bb4a4039f8d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:13.992964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231dfce-2564-45ab-95a9-bb4a4039f8d0 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:13.993174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231dfce-2564-45ab-95a9-bb4a4039f8d0 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:13.993381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231dfce-2564-45ab-95a9-bb4a4039f8d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:14.028753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231dfce-2564-45ab-95a9-bb4a4039f8d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:14.030400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231dfce-2564-45ab-95a9-bb4a4039f8d0 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:14.041460 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3209/6481] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:27:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:27:14.332476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a12f1-5c24-4069-98ef-6917f570db99 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:14.332765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a12f1-5c24-4069-98ef-6917f570db99 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:14.333044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a12f1-5c24-4069-98ef-6917f570db99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:14.354210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-906a12f1-5c24-4069-98ef-6917f570db99 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:14.355532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-906a12f1-5c24-4069-98ef-6917f570db99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:14.363601 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3273/6482] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:27:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:14.376885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231dfce-2564-45ab-95a9-bb4a4039f8d0 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:14.390854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231dfce-2564-45ab-95a9-bb4a4039f8d0 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:14.397002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f25c9b-456d-4e79-8836-e23d2bd8d85c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:14.397779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f25c9b-456d-4e79-8836-e23d2bd8d85c service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:14.398175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f25c9b-456d-4e79-8836-e23d2bd8d85c service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:14.398565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f25c9b-456d-4e79-8836-e23d2bd8d85c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:14.408890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f25c9b-456d-4e79-8836-e23d2bd8d85c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:14.410616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f25c9b-456d-4e79-8836-e23d2bd8d85c service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:14.421083 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3210/6483] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:27:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 30 21:27:14.830547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559b71f-dca5-4f3d-9441-91de97e8a9e7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:14.830859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559b71f-dca5-4f3d-9441-91de97e8a9e7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:14.831215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559b71f-dca5-4f3d-9441-91de97e8a9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:14.865449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3559b71f-dca5-4f3d-9441-91de97e8a9e7 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:14.867813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3559b71f-dca5-4f3d-9441-91de97e8a9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:14.888814 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3274/6484] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:27:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:14.898532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f25c9b-456d-4e79-8836-e23d2bd8d85c service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:14.934060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f25c9b-456d-4e79-8836-e23d2bd8d85c service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:14.953961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16036fac-c365-4d36-af11-c607c17d11f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:14.954766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16036fac-c365-4d36-af11-c607c17d11f1 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:14.955463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16036fac-c365-4d36-af11-c607c17d11f1 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:14.955964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16036fac-c365-4d36-af11-c607c17d11f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:14.975357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16036fac-c365-4d36-af11-c607c17d11f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:14.977226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16036fac-c365-4d36-af11-c607c17d11f1 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:14.997096 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3211/6485] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:27:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:27:15.405496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4c67b-0622-4d84-91ff-1951fcbbc3c9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:15.406004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4c67b-0622-4d84-91ff-1951fcbbc3c9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:15.406291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4c67b-0622-4d84-91ff-1951fcbbc3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:15.447798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-16c4c67b-0622-4d84-91ff-1951fcbbc3c9 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:15.451433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-16c4c67b-0622-4d84-91ff-1951fcbbc3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:15.465513 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3275/6486] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:27:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:15.485419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16036fac-c365-4d36-af11-c607c17d11f1 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:15.507920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16036fac-c365-4d36-af11-c607c17d11f1 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:15.518617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7273dd-d879-4fb3-8aa5-3f533ac9c6f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:15.520946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7273dd-d879-4fb3-8aa5-3f533ac9c6f3 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:15.521377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7273dd-d879-4fb3-8aa5-3f533ac9c6f3 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:15.521757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7273dd-d879-4fb3-8aa5-3f533ac9c6f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:15.535958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7273dd-d879-4fb3-8aa5-3f533ac9c6f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:15.538939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7273dd-d879-4fb3-8aa5-3f533ac9c6f3 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:15.581231 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3212/6487] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:27:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:27:16.623516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4c67b-0622-4d84-91ff-1951fcbbc3c9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:16.624938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-16c4c67b-0622-4d84-91ff-1951fcbbc3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:16.668391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4c67b-0622-4d84-91ff-1951fcbbc3c9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:16.683073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a107e7-8bd5-4790-bb39-495b4236643b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:16.683825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a107e7-8bd5-4790-bb39-495b4236643b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:16.684113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a107e7-8bd5-4790-bb39-495b4236643b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:16.684486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a107e7-8bd5-4790-bb39-495b4236643b admin admin] PATH_INFO: `/v3/projects/310f239e7cec4845bdab88f080f2b911` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:16.687096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a107e7-8bd5-4790-bb39-495b4236643b admin admin] RBAC: Authorizing `identity:delete_project(project_id=310f239e7cec4845bdab88f080f2b911)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:16.690672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a107e7-8bd5-4790-bb39-495b4236643b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:16.836303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-73a107e7-8bd5-4790-bb39-495b4236643b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '310f239e7cec4845bdab88f080f2b911', 'request_id': 'req-73a107e7-8bd5-4790-bb39-495b4236643b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:16.852117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-73a107e7-8bd5-4790-bb39-495b4236643b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '310f239e7cec4845bdab88f080f2b911', 'request_id': 'req-73a107e7-8bd5-4790-bb39-495b4236643b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:16.871935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-73a107e7-8bd5-4790-bb39-495b4236643b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '310f239e7cec4845bdab88f080f2b911', 'request_id': 'req-73a107e7-8bd5-4790-bb39-495b4236643b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:16.907272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-73a107e7-8bd5-4790-bb39-495b4236643b admin admin] The token cache is being invalidate because project 310f239e7cec4845bdab88f080f2b911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:16.911049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-73a107e7-8bd5-4790-bb39-495b4236643b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:16.914325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-73a107e7-8bd5-4790-bb39-495b4236643b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:16.916511 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3276/6488] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:16 2022] DELETE /identity/v3/projects/310f239e7cec4845bdab88f080f2b911 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:16.922448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7273dd-d879-4fb3-8aa5-3f533ac9c6f3 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:16.946755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7273dd-d879-4fb3-8aa5-3f533ac9c6f3 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:17.109544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93282326-25bf-4e30-9a47-bc261cb5fe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:17.111229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93282326-25bf-4e30-9a47-bc261cb5fe7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:17.111980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93282326-25bf-4e30-9a47-bc261cb5fe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:17.112675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93282326-25bf-4e30-9a47-bc261cb5fe7e admin admin] PATH_INFO: `/v3/users/d1b4bb991e4c423da2d3bb1119073050` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:17.114584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93282326-25bf-4e30-9a47-bc261cb5fe7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1b4bb991e4c423da2d3bb1119073050)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:17.117468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93282326-25bf-4e30-9a47-bc261cb5fe7e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:17.247740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-93282326-25bf-4e30-9a47-bc261cb5fe7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1b4bb991e4c423da2d3bb1119073050'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:17.248593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-93282326-25bf-4e30-9a47-bc261cb5fe7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1b4bb991e4c423da2d3bb1119073050'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:17.275984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee21c3-83c6-42b0-8cc7-fa36080618e3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:17.276837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee21c3-83c6-42b0-8cc7-fa36080618e3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:17.276837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee21c3-83c6-42b0-8cc7-fa36080618e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:17.279052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:17.282237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-93282326-25bf-4e30-9a47-bc261cb5fe7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1b4bb991e4c423da2d3bb1119073050'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:17.284616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-93282326-25bf-4e30-9a47-bc261cb5fe7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1b4bb991e4c423da2d3bb1119073050'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:17.309411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-93282326-25bf-4e30-9a47-bc261cb5fe7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1b4bb991e4c423da2d3bb1119073050'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:17.319754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-57ee21c3-83c6-42b0-8cc7-fa36080618e3 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:17.321072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-57ee21c3-83c6-42b0-8cc7-fa36080618e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:17.333863 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3213/6489] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:16 2022] DELETE /identity/v3/users/d1b4bb991e4c423da2d3bb1119073050 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:17.463619 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3277/6490] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:27:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:17.479461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93282326-25bf-4e30-9a47-bc261cb5fe7e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:17.481761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-93282326-25bf-4e30-9a47-bc261cb5fe7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:17.602306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93282326-25bf-4e30-9a47-bc261cb5fe7e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:17.608563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ab567-908a-4bb0-8889-2a0a5918be7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:17.609279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ab567-908a-4bb0-8889-2a0a5918be7d service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:17.609632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ab567-908a-4bb0-8889-2a0a5918be7d service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:17.609979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ab567-908a-4bb0-8889-2a0a5918be7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:17.726946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ab567-908a-4bb0-8889-2a0a5918be7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:17.728942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ab567-908a-4bb0-8889-2a0a5918be7d service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:17.744869 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3214/6491] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:27:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:27:18.052353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12a89b-d3c1-4918-b0ae-049e3ca6f490 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:18.053156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12a89b-d3c1-4918-b0ae-049e3ca6f490 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:18.053866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12a89b-d3c1-4918-b0ae-049e3ca6f490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:18.122016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4b12a89b-d3c1-4918-b0ae-049e3ca6f490 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:18.123967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4b12a89b-d3c1-4918-b0ae-049e3ca6f490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:18.143854 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3278/6492] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:27:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:18.162006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ab567-908a-4bb0-8889-2a0a5918be7d service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:18.187612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ab567-908a-4bb0-8889-2a0a5918be7d service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:18.205888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6810cc-813e-44c0-8685-01e99be0caf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:18.207269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6810cc-813e-44c0-8685-01e99be0caf7 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:18.207731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6810cc-813e-44c0-8685-01e99be0caf7 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:18.208183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6810cc-813e-44c0-8685-01e99be0caf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:18.221998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6810cc-813e-44c0-8685-01e99be0caf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:18.224140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6810cc-813e-44c0-8685-01e99be0caf7 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:18.259891 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3215/6493] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:27:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:27:18.554742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9260f-002b-4298-99f1-10527c860fef None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:18.555221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9260f-002b-4298-99f1-10527c860fef None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:18.555826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9260f-002b-4298-99f1-10527c860fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:18.582957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-daa9260f-002b-4298-99f1-10527c860fef None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:18.593171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-daa9260f-002b-4298-99f1-10527c860fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:18.602671 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3279/6494] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:27:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:18.621901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6810cc-813e-44c0-8685-01e99be0caf7 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:18.649715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6810cc-813e-44c0-8685-01e99be0caf7 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:18.666323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca4c30-8d91-4e00-9dd6-c54f5cb04e60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:18.667327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca4c30-8d91-4e00-9dd6-c54f5cb04e60 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:18.667327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca4c30-8d91-4e00-9dd6-c54f5cb04e60 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:18.667613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca4c30-8d91-4e00-9dd6-c54f5cb04e60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:18.695769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca4c30-8d91-4e00-9dd6-c54f5cb04e60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:18.697954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca4c30-8d91-4e00-9dd6-c54f5cb04e60 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:18.730038 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3216/6495] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:27:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:27:19.022006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db48653-1832-4854-a243-c0ad166400b6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:19.022262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db48653-1832-4854-a243-c0ad166400b6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:19.022624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db48653-1832-4854-a243-c0ad166400b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:19.045167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0db48653-1832-4854-a243-c0ad166400b6 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:19.048689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0db48653-1832-4854-a243-c0ad166400b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:19.060073 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3280/6496] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:27:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:19.073639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca4c30-8d91-4e00-9dd6-c54f5cb04e60 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:19.090771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca4c30-8d91-4e00-9dd6-c54f5cb04e60 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:19.103583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9350de-6f62-4f94-9c34-ba806e9982e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:19.104469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9350de-6f62-4f94-9c34-ba806e9982e5 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:19.104904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9350de-6f62-4f94-9c34-ba806e9982e5 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:19.105357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9350de-6f62-4f94-9c34-ba806e9982e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:19.117240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9350de-6f62-4f94-9c34-ba806e9982e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:19.120008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9350de-6f62-4f94-9c34-ba806e9982e5 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:19.147851 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3217/6497] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:27:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:27:19.473194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8a36d-4f39-4061-b48d-7de7e3516133 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:19.474099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8a36d-4f39-4061-b48d-7de7e3516133 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:19.474581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8a36d-4f39-4061-b48d-7de7e3516133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:19.522157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-54d8a36d-4f39-4061-b48d-7de7e3516133 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:19.531356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-54d8a36d-4f39-4061-b48d-7de7e3516133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:19.567618 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3281/6498] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:27:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:19.590843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9350de-6f62-4f94-9c34-ba806e9982e5 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:19.612263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9350de-6f62-4f94-9c34-ba806e9982e5 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:19.625710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801f215-b26a-4202-b95e-f73483839ce9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:19.626704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801f215-b26a-4202-b95e-f73483839ce9 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:19.629000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801f215-b26a-4202-b95e-f73483839ce9 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:19.630853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801f215-b26a-4202-b95e-f73483839ce9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:19.655521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801f215-b26a-4202-b95e-f73483839ce9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:19.660007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801f215-b26a-4202-b95e-f73483839ce9 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:19.683857 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3218/6499] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:27:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:27:19.763795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8a36d-4f39-4061-b48d-7de7e3516133 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:19.765413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-54d8a36d-4f39-4061-b48d-7de7e3516133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:19.776592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:19.965514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8a36d-4f39-4061-b48d-7de7e3516133 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:19.975348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a29895-be0b-48eb-8f43-0905ef87f56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:19.976384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a29895-be0b-48eb-8f43-0905ef87f56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:19.976870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a29895-be0b-48eb-8f43-0905ef87f56e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:19.977286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a29895-be0b-48eb-8f43-0905ef87f56e admin admin] PATH_INFO: `/v3/projects/4353e2cf654b434ea52a9ea613d7aae2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:19.979628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a29895-be0b-48eb-8f43-0905ef87f56e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4353e2cf654b434ea52a9ea613d7aae2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:19.983056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be561306-0181-455e-80cd-da22123dd283 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:19.983571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be561306-0181-455e-80cd-da22123dd283 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:19.984040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be561306-0181-455e-80cd-da22123dd283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:19.995356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a29895-be0b-48eb-8f43-0905ef87f56e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:20.024163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-be561306-0181-455e-80cd-da22123dd283 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:20.029594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-be561306-0181-455e-80cd-da22123dd283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:20.051015 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3219/6500] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:27:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:27:20.067398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be561306-0181-455e-80cd-da22123dd283 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:20.092468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be561306-0181-455e-80cd-da22123dd283 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:20.111093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5a29895-be0b-48eb-8f43-0905ef87f56e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4353e2cf654b434ea52a9ea613d7aae2', 'request_id': 'req-b5a29895-be0b-48eb-8f43-0905ef87f56e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:20.135673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:20.138640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5a29895-be0b-48eb-8f43-0905ef87f56e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4353e2cf654b434ea52a9ea613d7aae2', 'request_id': 'req-b5a29895-be0b-48eb-8f43-0905ef87f56e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:20.181288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5a29895-be0b-48eb-8f43-0905ef87f56e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4353e2cf654b434ea52a9ea613d7aae2', 'request_id': 'req-b5a29895-be0b-48eb-8f43-0905ef87f56e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:20.206596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5a29895-be0b-48eb-8f43-0905ef87f56e admin admin] The token cache is being invalidate because project 4353e2cf654b434ea52a9ea613d7aae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:20.206891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5a29895-be0b-48eb-8f43-0905ef87f56e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:20.208236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5a29895-be0b-48eb-8f43-0905ef87f56e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:20.214535 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3282/6501] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:19 2022] DELETE /identity/v3/projects/4353e2cf654b434ea52a9ea613d7aae2 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:20.221742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ddea8-fe65-426d-8003-0d7538ee7c5d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:20.222267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ddea8-fe65-426d-8003-0d7538ee7c5d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:20.222675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ddea8-fe65-426d-8003-0d7538ee7c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:20.265421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c4045-0824-4a22-a001-5f7904e59b2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:20.266171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c4045-0824-4a22-a001-5f7904e59b2a service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:20.266534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c4045-0824-4a22-a001-5f7904e59b2a service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:20.267505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c4045-0824-4a22-a001-5f7904e59b2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:20.267661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-410ddea8-fe65-426d-8003-0d7538ee7c5d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:20.270764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-414c4045-0824-4a22-a001-5f7904e59b2a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:20.272090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-410ddea8-fe65-426d-8003-0d7538ee7c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:20.436621 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3283/6502] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:27:20.446326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09110a21-5e47-4f7a-a5b2-561527edc173 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:20.446829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09110a21-5e47-4f7a-a5b2-561527edc173 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:20.448401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09110a21-5e47-4f7a-a5b2-561527edc173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:20.468542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c4045-0824-4a22-a001-5f7904e59b2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:20.471903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c4045-0824-4a22-a001-5f7904e59b2a service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:20.493940 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3220/6503] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:27:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:27:20.519074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-09110a21-5e47-4f7a-a5b2-561527edc173 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:20.520896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-09110a21-5e47-4f7a-a5b2-561527edc173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:20.531059 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3284/6504] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:20.545449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c4045-0824-4a22-a001-5f7904e59b2a service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:20.574558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c4045-0824-4a22-a001-5f7904e59b2a service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:20.587320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1ce5f-043a-40b1-9a73-7327b7864753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:20.588084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1ce5f-043a-40b1-9a73-7327b7864753 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:20.589679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1ce5f-043a-40b1-9a73-7327b7864753 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:20.590079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1ce5f-043a-40b1-9a73-7327b7864753 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:20.591431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1ce5f-043a-40b1-9a73-7327b7864753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:27:20.592506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1ce5f-043a-40b1-9a73-7327b7864753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:20.595050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1ce5f-043a-40b1-9a73-7327b7864753 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:20.616065 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3221/6505] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:27:20.617612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09110a21-5e47-4f7a-a5b2-561527edc173 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:20.645586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09110a21-5e47-4f7a-a5b2-561527edc173 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:20.657133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9e417-ec06-4b20-8f07-29e78a155b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:20.658669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9e417-ec06-4b20-8f07-29e78a155b92 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:20.669815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9e417-ec06-4b20-8f07-29e78a155b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:20.670225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9e417-ec06-4b20-8f07-29e78a155b92 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:20.673638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9e417-ec06-4b20-8f07-29e78a155b92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:20.687354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9e417-ec06-4b20-8f07-29e78a155b92 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:20.757714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1ce5f-043a-40b1-9a73-7327b7864753 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:20.768820 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3285/6506] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:20 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:20.769977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9e417-ec06-4b20-8f07-29e78a155b92 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:20.774515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1ce5f-043a-40b1-9a73-7327b7864753 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:20.774979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b9f9e417-ec06-4b20-8f07-29e78a155b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:20.801145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:20.918482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49692166-6659-4407-92dd-090414bd7d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:20.923896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49692166-6659-4407-92dd-090414bd7d03 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:20.923896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49692166-6659-4407-92dd-090414bd7d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:20.923896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49692166-6659-4407-92dd-090414bd7d03 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:20.923896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49692166-6659-4407-92dd-090414bd7d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:20.930031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9e417-ec06-4b20-8f07-29e78a155b92 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:20.931788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49692166-6659-4407-92dd-090414bd7d03 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:20.947455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1ec9a-cf56-43ec-8323-f6e12c159356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:20.948274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1ec9a-cf56-43ec-8323-f6e12c159356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:20.948559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1ec9a-cf56-43ec-8323-f6e12c159356 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:20.949428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1ec9a-cf56-43ec-8323-f6e12c159356 admin admin] PATH_INFO: `/v3/users/bdce3aa6c4774c6590dda35c753ac2b2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:20.951510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1ec9a-cf56-43ec-8323-f6e12c159356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdce3aa6c4774c6590dda35c753ac2b2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:20.954022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1ec9a-cf56-43ec-8323-f6e12c159356 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:20.984088 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3222/6507] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:20 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:20.988497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49692166-6659-4407-92dd-090414bd7d03 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:20.997333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-49692166-6659-4407-92dd-090414bd7d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:21.045143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49692166-6659-4407-92dd-090414bd7d03 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:21.060370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef9ba1-5c4f-4b60-9131-f80886b94dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:21.065645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef9ba1-5c4f-4b60-9131-f80886b94dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:21.067372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef9ba1-5c4f-4b60-9131-f80886b94dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:21.067850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef9ba1-5c4f-4b60-9131-f80886b94dd3 admin admin] PATH_INFO: `/v3/users/c025e35fd22a4895a5d0301c1d5b0e8e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:21.071675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef9ba1-5c4f-4b60-9131-f80886b94dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c025e35fd22a4895a5d0301c1d5b0e8e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:21.073826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef9ba1-5c4f-4b60-9131-f80886b94dd3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:21.099993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-37a1ec9a-cf56-43ec-8323-f6e12c159356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdce3aa6c4774c6590dda35c753ac2b2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:21.121888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-37a1ec9a-cf56-43ec-8323-f6e12c159356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdce3aa6c4774c6590dda35c753ac2b2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:21.123489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-37a1ec9a-cf56-43ec-8323-f6e12c159356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdce3aa6c4774c6590dda35c753ac2b2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:21.134166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-37a1ec9a-cf56-43ec-8323-f6e12c159356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdce3aa6c4774c6590dda35c753ac2b2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:21.136006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-37a1ec9a-cf56-43ec-8323-f6e12c159356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdce3aa6c4774c6590dda35c753ac2b2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:21.164775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:21.165723 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3286/6508] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:20 2022] DELETE /identity/v3/users/bdce3aa6c4774c6590dda35c753ac2b2 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:21.167812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1ec9a-cf56-43ec-8323-f6e12c159356 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:21.169828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-37a1ec9a-cf56-43ec-8323-f6e12c159356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:21.184034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b9ef9ba1-5c4f-4b60-9131-f80886b94dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c025e35fd22a4895a5d0301c1d5b0e8e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:21.185263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b9ef9ba1-5c4f-4b60-9131-f80886b94dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c025e35fd22a4895a5d0301c1d5b0e8e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:21.220869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b9ef9ba1-5c4f-4b60-9131-f80886b94dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c025e35fd22a4895a5d0301c1d5b0e8e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:21.221680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b9ef9ba1-5c4f-4b60-9131-f80886b94dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c025e35fd22a4895a5d0301c1d5b0e8e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:21.240275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b9ef9ba1-5c4f-4b60-9131-f80886b94dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c025e35fd22a4895a5d0301c1d5b0e8e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:21.273190 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3223/6509] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:20 2022] DELETE /identity/v3/users/c025e35fd22a4895a5d0301c1d5b0e8e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:21.274787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710499d8-1cfa-4db9-aebf-173c7368a8c4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:21.275083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710499d8-1cfa-4db9-aebf-173c7368a8c4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:21.275388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710499d8-1cfa-4db9-aebf-173c7368a8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:21.296101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1ec9a-cf56-43ec-8323-f6e12c159356 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:21.323137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-710499d8-1cfa-4db9-aebf-173c7368a8c4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:21.325306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-710499d8-1cfa-4db9-aebf-173c7368a8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:21.335282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:21.402623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3f265-eb18-43c2-8948-0a76cf5239e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:21.403629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3f265-eb18-43c2-8948-0a76cf5239e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:21.403915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3f265-eb18-43c2-8948-0a76cf5239e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:21.404352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3f265-eb18-43c2-8948-0a76cf5239e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:21.405169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3f265-eb18-43c2-8948-0a76cf5239e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:21.406781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3f265-eb18-43c2-8948-0a76cf5239e4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:21.418531 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3287/6510] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:21.419022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3f265-eb18-43c2-8948-0a76cf5239e4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:21.421352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c5e3f265-eb18-43c2-8948-0a76cf5239e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:21.431572 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3224/6511] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:21.432951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710499d8-1cfa-4db9-aebf-173c7368a8c4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:21.434503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-710499d8-1cfa-4db9-aebf-173c7368a8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:21.439372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3f265-eb18-43c2-8948-0a76cf5239e4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:21.445468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107dba2-97cf-4106-8a37-fc6ad67fbf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:21.446795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107dba2-97cf-4106-8a37-fc6ad67fbf28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:21.447394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107dba2-97cf-4106-8a37-fc6ad67fbf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:21.447755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107dba2-97cf-4106-8a37-fc6ad67fbf28 admin admin] PATH_INFO: `/v3/users/19f630ee23a5461eb61c8128cc5267b8` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:21.449626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107dba2-97cf-4106-8a37-fc6ad67fbf28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19f630ee23a5461eb61c8128cc5267b8)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:21.451939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107dba2-97cf-4106-8a37-fc6ad67fbf28 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:21.455121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710499d8-1cfa-4db9-aebf-173c7368a8c4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:21.461268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e21ce6-7e86-4d52-8160-9e39151ad782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:21.462027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e21ce6-7e86-4d52-8160-9e39151ad782 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:21.462378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e21ce6-7e86-4d52-8160-9e39151ad782 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:21.462862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e21ce6-7e86-4d52-8160-9e39151ad782 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:21.466385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e21ce6-7e86-4d52-8160-9e39151ad782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:21.468582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e21ce6-7e86-4d52-8160-9e39151ad782 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:21.481522 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3225/6512] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:21.482734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e21ce6-7e86-4d52-8160-9e39151ad782 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:21.485250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-23e21ce6-7e86-4d52-8160-9e39151ad782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:21.542621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e107dba2-97cf-4106-8a37-fc6ad67fbf28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f630ee23a5461eb61c8128cc5267b8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:21.560184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e21ce6-7e86-4d52-8160-9e39151ad782 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:21.567155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cc106-e0ce-4135-95cb-4eb8d5dd9861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:21.567848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cc106-e0ce-4135-95cb-4eb8d5dd9861 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:21.568138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cc106-e0ce-4135-95cb-4eb8d5dd9861 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:21.568421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cc106-e0ce-4135-95cb-4eb8d5dd9861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:21.577740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e107dba2-97cf-4106-8a37-fc6ad67fbf28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f630ee23a5461eb61c8128cc5267b8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:21.578843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e107dba2-97cf-4106-8a37-fc6ad67fbf28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f630ee23a5461eb61c8128cc5267b8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:21.584082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cc106-e0ce-4135-95cb-4eb8d5dd9861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:21.585713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cc106-e0ce-4135-95cb-4eb8d5dd9861 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:21.596115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e107dba2-97cf-4106-8a37-fc6ad67fbf28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f630ee23a5461eb61c8128cc5267b8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:21.597419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e107dba2-97cf-4106-8a37-fc6ad67fbf28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f630ee23a5461eb61c8128cc5267b8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:21.600438 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3226/6513] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:21.601614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cc106-e0ce-4135-95cb-4eb8d5dd9861 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:21.614336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cc106-e0ce-4135-95cb-4eb8d5dd9861 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:21.622729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92109d-e91c-4220-a9a6-d5b343d09254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:21.623722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92109d-e91c-4220-a9a6-d5b343d09254 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:21.624321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92109d-e91c-4220-a9a6-d5b343d09254 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:21.624623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92109d-e91c-4220-a9a6-d5b343d09254 admin admin] PATH_INFO: `/v3/projects/1563fd64c2ca490e83c252cf741fd041/users/6ced663ff2fc4ba3b01b3c61f57aa576/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:21.630597 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3288/6514] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:21 2022] DELETE /identity/v3/users/19f630ee23a5461eb61c8128cc5267b8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:21.635086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4c935-7b92-4303-8e72-c0c3fb9ab2de None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:21.635409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4c935-7b92-4303-8e72-c0c3fb9ab2de None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:21.635689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4c935-7b92-4303-8e72-c0c3fb9ab2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:21.645762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92109d-e91c-4220-a9a6-d5b343d09254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1563fd64c2ca490e83c252cf741fd041, user_id=6ced663ff2fc4ba3b01b3c61f57aa576, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:21.648495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92109d-e91c-4220-a9a6-d5b343d09254 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:21.671065 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3227/6515] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:21 2022] PUT /identity/v3/projects/1563fd64c2ca490e83c252cf741fd041/users/6ced663ff2fc4ba3b01b3c61f57aa576/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:21.681031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176d024-6fc2-42e4-a051-5cee29d6dd9f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:21.681475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176d024-6fc2-42e4-a051-5cee29d6dd9f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:21.681859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176d024-6fc2-42e4-a051-5cee29d6dd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:21.686783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-66c4c935-7b92-4303-8e72-c0c3fb9ab2de None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:21.689101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-66c4c935-7b92-4303-8e72-c0c3fb9ab2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:21.752390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a176d024-6fc2-42e4-a051-5cee29d6dd9f None None] MFA Rules not processed for user `6ced663ff2fc4ba3b01b3c61f57aa576`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:21.762157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a176d024-6fc2-42e4-a051-5cee29d6dd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:21.785843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:21.810449 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3289/6516] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:27:21.831004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4c935-7b92-4303-8e72-c0c3fb9ab2de None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:21.832648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-66c4c935-7b92-4303-8e72-c0c3fb9ab2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:21.928644 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3228/6517] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:27:21.944340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176d024-6fc2-42e4-a051-5cee29d6dd9f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:21.952366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a176d024-6fc2-42e4-a051-5cee29d6dd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:21.963974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:21.993804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176d024-6fc2-42e4-a051-5cee29d6dd9f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:21.997802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4c935-7b92-4303-8e72-c0c3fb9ab2de None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:22.006541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4fb5d-f8ec-4e4f-8656-752eaa619486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:22.007568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3653cc-2ad5-46ed-a4d3-37b2e7bc9f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:22.008257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4fb5d-f8ec-4e4f-8656-752eaa619486 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:22.008986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3653cc-2ad5-46ed-a4d3-37b2e7bc9f5f admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:22.009436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4fb5d-f8ec-4e4f-8656-752eaa619486 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:22.010275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3653cc-2ad5-46ed-a4d3-37b2e7bc9f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:22.010275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3653cc-2ad5-46ed-a4d3-37b2e7bc9f5f admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:22.010775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4fb5d-f8ec-4e4f-8656-752eaa619486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:22.012400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3653cc-2ad5-46ed-a4d3-37b2e7bc9f5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:22.015360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3653cc-2ad5-46ed-a4d3-37b2e7bc9f5f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:22.035170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4fb5d-f8ec-4e4f-8656-752eaa619486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:22.041479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4fb5d-f8ec-4e4f-8656-752eaa619486 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:22.062683 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3290/6518] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:27:22.092241 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3229/6519] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:21 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:22.094485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4fb5d-f8ec-4e4f-8656-752eaa619486 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:22.149749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4fb5d-f8ec-4e4f-8656-752eaa619486 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:22.250131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeae4d8-cc9f-4399-a738-1178d6558ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:22.251686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeae4d8-cc9f-4399-a738-1178d6558ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:22.252600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeae4d8-cc9f-4399-a738-1178d6558ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:22.253062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeae4d8-cc9f-4399-a738-1178d6558ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:22.254741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeae4d8-cc9f-4399-a738-1178d6558ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:22.259079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeae4d8-cc9f-4399-a738-1178d6558ea6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:22.296823 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3291/6520] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:22 2022] POST /identity/v3/users => generated 300 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:22.303868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3653cc-2ad5-46ed-a4d3-37b2e7bc9f5f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:22.328952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3653cc-2ad5-46ed-a4d3-37b2e7bc9f5f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:22.336810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeae4d8-cc9f-4399-a738-1178d6558ea6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:22.340103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fbeae4d8-cc9f-4399-a738-1178d6558ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:22.348324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d4056-3b71-459c-9a73-311094962b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:22.349114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d4056-3b71-459c-9a73-311094962b67 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:22.349497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d4056-3b71-459c-9a73-311094962b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:22.349848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d4056-3b71-459c-9a73-311094962b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:22.352209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d4056-3b71-459c-9a73-311094962b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:22.357898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d4056-3b71-459c-9a73-311094962b67 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:22.367304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeae4d8-cc9f-4399-a738-1178d6558ea6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:22.374101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129ceb0-cf08-4f75-be52-d2f13aefa6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:22.375180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129ceb0-cf08-4f75-be52-d2f13aefa6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:22.376135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129ceb0-cf08-4f75-be52-d2f13aefa6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:22.376588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129ceb0-cf08-4f75-be52-d2f13aefa6f4 admin admin] PATH_INFO: `/v3/projects/116c26d6b98641bb8ed5ff5dcdd966c8` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:22.379407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129ceb0-cf08-4f75-be52-d2f13aefa6f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=116c26d6b98641bb8ed5ff5dcdd966c8)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:22.382220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129ceb0-cf08-4f75-be52-d2f13aefa6f4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:22.398164 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3230/6521] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:22.402497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d4056-3b71-459c-9a73-311094962b67 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:22.437389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d4056-3b71-459c-9a73-311094962b67 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:22.458416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab19e9-2a03-4593-a320-cab1cfd13fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:22.459775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab19e9-2a03-4593-a320-cab1cfd13fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:22.460358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab19e9-2a03-4593-a320-cab1cfd13fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:22.461274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab19e9-2a03-4593-a320-cab1cfd13fe7 admin admin] PATH_INFO: `/v3/projects/d45122f90af845ca91562033790b0012/users/441ca099272344d3845959d815bb867e/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:22.474529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7129ceb0-cf08-4f75-be52-d2f13aefa6f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '116c26d6b98641bb8ed5ff5dcdd966c8', 'request_id': 'req-7129ceb0-cf08-4f75-be52-d2f13aefa6f4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:22.489498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7129ceb0-cf08-4f75-be52-d2f13aefa6f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '116c26d6b98641bb8ed5ff5dcdd966c8', 'request_id': 'req-7129ceb0-cf08-4f75-be52-d2f13aefa6f4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:22.506616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7129ceb0-cf08-4f75-be52-d2f13aefa6f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '116c26d6b98641bb8ed5ff5dcdd966c8', 'request_id': 'req-7129ceb0-cf08-4f75-be52-d2f13aefa6f4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:22.507571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab19e9-2a03-4593-a320-cab1cfd13fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d45122f90af845ca91562033790b0012, user_id=441ca099272344d3845959d815bb867e, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:22.517966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab19e9-2a03-4593-a320-cab1cfd13fe7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:22.528250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7129ceb0-cf08-4f75-be52-d2f13aefa6f4 admin admin] The token cache is being invalidate because project 116c26d6b98641bb8ed5ff5dcdd966c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:22.528739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7129ceb0-cf08-4f75-be52-d2f13aefa6f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:22.535699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7129ceb0-cf08-4f75-be52-d2f13aefa6f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:22.545168 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3292/6522] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:22 2022] DELETE /identity/v3/projects/116c26d6b98641bb8ed5ff5dcdd966c8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:22.547349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266029c0-6564-4aca-bd37-67e42506d060 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:22.547743 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3231/6523] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:22 2022] PUT /identity/v3/projects/d45122f90af845ca91562033790b0012/users/441ca099272344d3845959d815bb867e/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:22.548259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266029c0-6564-4aca-bd37-67e42506d060 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:22.549075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266029c0-6564-4aca-bd37-67e42506d060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:22.556230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab19e9-2a03-4593-a320-cab1cfd13fe7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:22.559122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-85ab19e9-2a03-4593-a320-cab1cfd13fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:22.589247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-266029c0-6564-4aca-bd37-67e42506d060 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:22.591146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-266029c0-6564-4aca-bd37-67e42506d060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:22.745557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:22.755505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab19e9-2a03-4593-a320-cab1cfd13fe7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:22.774187 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3293/6524] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:22.775931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcabe5-a0e4-4a8d-852a-bd724a21e8db None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:22.776520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcabe5-a0e4-4a8d-852a-bd724a21e8db None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:22.776956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcabe5-a0e4-4a8d-852a-bd724a21e8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:22.782442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcd9c1-6583-44cc-afc4-84a8524c8b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:22.783227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcd9c1-6583-44cc-afc4-84a8524c8b17 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:22.783643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcd9c1-6583-44cc-afc4-84a8524c8b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:22.784028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcd9c1-6583-44cc-afc4-84a8524c8b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:22.784869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcd9c1-6583-44cc-afc4-84a8524c8b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:22.787006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcd9c1-6583-44cc-afc4-84a8524c8b17 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:22.810837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-efdcabe5-a0e4-4a8d-852a-bd724a21e8db None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:22.812389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-efdcabe5-a0e4-4a8d-852a-bd724a21e8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:22.817690 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3232/6525] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:22.821565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcd9c1-6583-44cc-afc4-84a8524c8b17 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:22.830742 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3294/6526] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:22.832396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcabe5-a0e4-4a8d-852a-bd724a21e8db None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:22.849880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcd9c1-6583-44cc-afc4-84a8524c8b17 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:22.851723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcabe5-a0e4-4a8d-852a-bd724a21e8db None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:22.868976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7caaf-d140-44f9-83c5-b3c96946bf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:22.869971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36591dc6-125a-4805-9ac5-2b2e424babc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:22.870892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7caaf-d140-44f9-83c5-b3c96946bf04 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:22.872058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7caaf-d140-44f9-83c5-b3c96946bf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:22.873510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36591dc6-125a-4805-9ac5-2b2e424babc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:22.878835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7caaf-d140-44f9-83c5-b3c96946bf04 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:22.880919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7caaf-d140-44f9-83c5-b3c96946bf04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:27:22.881271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36591dc6-125a-4805-9ac5-2b2e424babc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:22.881750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36591dc6-125a-4805-9ac5-2b2e424babc2 admin admin] PATH_INFO: `/v3/projects/d45122f90af845ca91562033790b0012/users/441ca099272344d3845959d815bb867e/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:22.884342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7caaf-d140-44f9-83c5-b3c96946bf04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:22.889874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7caaf-d140-44f9-83c5-b3c96946bf04 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:22.892322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36591dc6-125a-4805-9ac5-2b2e424babc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d45122f90af845ca91562033790b0012, user_id=441ca099272344d3845959d815bb867e, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:22.904835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36591dc6-125a-4805-9ac5-2b2e424babc2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:22.932460 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3295/6527] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:27:22.933722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7caaf-d140-44f9-83c5-b3c96946bf04 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:22.953580 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3233/6528] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:22 2022] PUT /identity/v3/projects/d45122f90af845ca91562033790b0012/users/441ca099272344d3845959d815bb867e/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:22.955259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36591dc6-125a-4805-9ac5-2b2e424babc2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:22.963392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-36591dc6-125a-4805-9ac5-2b2e424babc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:22.967023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7caaf-d140-44f9-83c5-b3c96946bf04 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:23.074882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:23.085586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdce5f3-75be-446a-9741-1ad897faa139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:23.086671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdce5f3-75be-446a-9741-1ad897faa139 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:23.086972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdce5f3-75be-446a-9741-1ad897faa139 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:23.087236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdce5f3-75be-446a-9741-1ad897faa139 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:23.088024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdce5f3-75be-446a-9741-1ad897faa139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:23.089994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdce5f3-75be-446a-9741-1ad897faa139 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:23.152847 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3296/6529] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:22 2022] POST /identity/v3/projects => generated 395 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:27:23.152847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bec3c-7a5e-43ce-b412-e254066ed42a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:23.152847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bec3c-7a5e-43ce-b412-e254066ed42a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:23.152847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bec3c-7a5e-43ce-b412-e254066ed42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:23.178062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36591dc6-125a-4805-9ac5-2b2e424babc2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:23.260349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8971479-016e-47b0-9f44-a6cef5fbe2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:23.261274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bc6bec3c-7a5e-43ce-b412-e254066ed42a None None] MFA Rules not processed for user `441ca099272344d3845959d815bb867e`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:23.261395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8971479-016e-47b0-9f44-a6cef5fbe2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:23.261559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8971479-016e-47b0-9f44-a6cef5fbe2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:23.261844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8971479-016e-47b0-9f44-a6cef5fbe2aa admin admin] PATH_INFO: `/v3/projects/cc0f39e8e9014ea3989db7d337592d3e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:23.263316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8971479-016e-47b0-9f44-a6cef5fbe2aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc0f39e8e9014ea3989db7d337592d3e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:23.265276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8971479-016e-47b0-9f44-a6cef5fbe2aa admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:23.265553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bc6bec3c-7a5e-43ce-b412-e254066ed42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:23.368167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d8971479-016e-47b0-9f44-a6cef5fbe2aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc0f39e8e9014ea3989db7d337592d3e', 'request_id': 'req-d8971479-016e-47b0-9f44-a6cef5fbe2aa'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:23.382945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d8971479-016e-47b0-9f44-a6cef5fbe2aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc0f39e8e9014ea3989db7d337592d3e', 'request_id': 'req-d8971479-016e-47b0-9f44-a6cef5fbe2aa'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:23.399845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d8971479-016e-47b0-9f44-a6cef5fbe2aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc0f39e8e9014ea3989db7d337592d3e', 'request_id': 'req-d8971479-016e-47b0-9f44-a6cef5fbe2aa'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:23.406814 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3297/6530] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:23.413545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d8971479-016e-47b0-9f44-a6cef5fbe2aa admin admin] The token cache is being invalidate because project cc0f39e8e9014ea3989db7d337592d3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:23.413856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d8971479-016e-47b0-9f44-a6cef5fbe2aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:23.414525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d8971479-016e-47b0-9f44-a6cef5fbe2aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:23.416479 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3234/6531] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:22 2022] DELETE /identity/v3/projects/cc0f39e8e9014ea3989db7d337592d3e => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:23.417449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8971479-016e-47b0-9f44-a6cef5fbe2aa admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:23.418913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d8971479-016e-47b0-9f44-a6cef5fbe2aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:23.422245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bec3c-7a5e-43ce-b412-e254066ed42a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:23.424897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bc6bec3c-7a5e-43ce-b412-e254066ed42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:23.465382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bec3c-7a5e-43ce-b412-e254066ed42a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:23.551894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:23.566841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8971479-016e-47b0-9f44-a6cef5fbe2aa admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:23.576024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751d946-8886-48a4-afc1-39a4ccc37b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:23.577010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751d946-8886-48a4-afc1-39a4ccc37b9c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:23.577299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751d946-8886-48a4-afc1-39a4ccc37b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:23.577692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751d946-8886-48a4-afc1-39a4ccc37b9c admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:23.578667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751d946-8886-48a4-afc1-39a4ccc37b9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:23.580509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512b2ca-5668-48a0-819f-da17d9bdae02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:23.581482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512b2ca-5668-48a0-819f-da17d9bdae02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:23.581914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512b2ca-5668-48a0-819f-da17d9bdae02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:23.582338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512b2ca-5668-48a0-819f-da17d9bdae02 admin admin] PATH_INFO: `/v3/projects/911f87748f884c19bf25fd5c87bd0bde` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:23.582663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751d946-8886-48a4-afc1-39a4ccc37b9c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:23.584714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512b2ca-5668-48a0-819f-da17d9bdae02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=911f87748f884c19bf25fd5c87bd0bde)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:23.587100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512b2ca-5668-48a0-819f-da17d9bdae02 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:23.620425 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3235/6532] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:23 2022] POST /identity/v3/users => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:23.621999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82206-918a-44b3-b2b2-bdff5d82bf55 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:23.622936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82206-918a-44b3-b2b2-bdff5d82bf55 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:23.623389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82206-918a-44b3-b2b2-bdff5d82bf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:23.636239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:23.666836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-41a82206-918a-44b3-b2b2-bdff5d82bf55 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:23.668177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-41a82206-918a-44b3-b2b2-bdff5d82bf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:23.684509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0512b2ca-5668-48a0-819f-da17d9bdae02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '911f87748f884c19bf25fd5c87bd0bde', 'request_id': 'req-0512b2ca-5668-48a0-819f-da17d9bdae02'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:23.695251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0512b2ca-5668-48a0-819f-da17d9bdae02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '911f87748f884c19bf25fd5c87bd0bde', 'request_id': 'req-0512b2ca-5668-48a0-819f-da17d9bdae02'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:23.714011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0512b2ca-5668-48a0-819f-da17d9bdae02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '911f87748f884c19bf25fd5c87bd0bde', 'request_id': 'req-0512b2ca-5668-48a0-819f-da17d9bdae02'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:23.755274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0512b2ca-5668-48a0-819f-da17d9bdae02 admin admin] The token cache is being invalidate because project 911f87748f884c19bf25fd5c87bd0bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:23.755978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0512b2ca-5668-48a0-819f-da17d9bdae02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:23.757670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0512b2ca-5668-48a0-819f-da17d9bdae02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:23.763188 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3298/6533] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:23 2022] DELETE /identity/v3/projects/911f87748f884c19bf25fd5c87bd0bde => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:23.768282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512b2ca-5668-48a0-819f-da17d9bdae02 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:23.771590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0512b2ca-5668-48a0-819f-da17d9bdae02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:23.822626 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3236/6534] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:23.824208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82206-918a-44b3-b2b2-bdff5d82bf55 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:23.826265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-41a82206-918a-44b3-b2b2-bdff5d82bf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:23.842851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82206-918a-44b3-b2b2-bdff5d82bf55 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:23.851864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f332731-1a07-4f7c-ba8d-c3ffdb7d95c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:23.853746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f332731-1a07-4f7c-ba8d-c3ffdb7d95c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:23.854193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f332731-1a07-4f7c-ba8d-c3ffdb7d95c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:23.854619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f332731-1a07-4f7c-ba8d-c3ffdb7d95c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:23.855537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f332731-1a07-4f7c-ba8d-c3ffdb7d95c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:23.858643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f332731-1a07-4f7c-ba8d-c3ffdb7d95c0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:23.871727 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3237/6535] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:23.873369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe886bf-f43a-4452-9540-ec8d2bb18b67 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:23.874903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe886bf-f43a-4452-9540-ec8d2bb18b67 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:23.875390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe886bf-f43a-4452-9540-ec8d2bb18b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:23.914111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512b2ca-5668-48a0-819f-da17d9bdae02 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:23.915814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3fe886bf-f43a-4452-9540-ec8d2bb18b67 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:23.917728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3fe886bf-f43a-4452-9540-ec8d2bb18b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:23.918624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e9266-ece6-46ca-9963-b0bcf318e635 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:23.919353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e9266-ece6-46ca-9963-b0bcf318e635 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:23.919642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e9266-ece6-46ca-9963-b0bcf318e635 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:23.919919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e9266-ece6-46ca-9963-b0bcf318e635 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:23.925282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a71e9266-ece6-46ca-9963-b0bcf318e635 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:23.941830 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3238/6536] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:23.944437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a58323-43cb-4837-8568-0b8a3710601f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:23.944867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a58323-43cb-4837-8568-0b8a3710601f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:23.945275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a58323-43cb-4837-8568-0b8a3710601f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:23.974120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-36a58323-43cb-4837-8568-0b8a3710601f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:23.976103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-36a58323-43cb-4837-8568-0b8a3710601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:23.987016 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3239/6537] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:24.003439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a58323-43cb-4837-8568-0b8a3710601f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:24.022674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a58323-43cb-4837-8568-0b8a3710601f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:24.028050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a7627-e55d-4d08-aa9e-9592ca209ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:24.028680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a7627-e55d-4d08-aa9e-9592ca209ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:24.028967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a7627-e55d-4d08-aa9e-9592ca209ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:24.029246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a7627-e55d-4d08-aa9e-9592ca209ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:24.029946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a7627-e55d-4d08-aa9e-9592ca209ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:24.032084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a7627-e55d-4d08-aa9e-9592ca209ca7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:24.043361 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3240/6538] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:24.044724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a1b68-5576-461c-8d82-d3df8247490b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:24.045018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a1b68-5576-461c-8d82-d3df8247490b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:24.045301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a1b68-5576-461c-8d82-d3df8247490b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:24.062910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e9266-ece6-46ca-9963-b0bcf318e635 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:24.065329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e9266-ece6-46ca-9963-b0bcf318e635 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:24.069480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a34a1b68-5576-461c-8d82-d3df8247490b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:24.070732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a34a1b68-5576-461c-8d82-d3df8247490b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:24.082040 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3241/6539] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:24.083735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a1b68-5576-461c-8d82-d3df8247490b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:24.086556 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3299/6540] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:24.087794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e9266-ece6-46ca-9963-b0bcf318e635 service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:24.102427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e9266-ece6-46ca-9963-b0bcf318e635 service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:24.109666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35f79a-f125-4e86-b2a6-ba5ccd0048c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:24.110531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35f79a-f125-4e86-b2a6-ba5ccd0048c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:24.111762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35f79a-f125-4e86-b2a6-ba5ccd0048c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:24.112171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35f79a-f125-4e86-b2a6-ba5ccd0048c9 admin admin] PATH_INFO: `/v3/projects/837cee2339bd4feb9a571b38c0577add/users/c5b99eba81444a7b9cc59e73898c65af/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:24.115806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a1b68-5576-461c-8d82-d3df8247490b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:24.135748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09e7ac-7425-49ef-9747-04e1c85d1d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:24.136693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09e7ac-7425-49ef-9747-04e1c85d1d56 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:24.137427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09e7ac-7425-49ef-9747-04e1c85d1d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:24.137989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09e7ac-7425-49ef-9747-04e1c85d1d56 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:24.138947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09e7ac-7425-49ef-9747-04e1c85d1d56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:27:24.139585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09e7ac-7425-49ef-9747-04e1c85d1d56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:24.142983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09e7ac-7425-49ef-9747-04e1c85d1d56 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:24.157593 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3242/6541] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:27:24.158618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09e7ac-7425-49ef-9747-04e1c85d1d56 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:24.171683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35f79a-f125-4e86-b2a6-ba5ccd0048c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=837cee2339bd4feb9a571b38c0577add, user_id=c5b99eba81444a7b9cc59e73898c65af, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:24.172251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09e7ac-7425-49ef-9747-04e1c85d1d56 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:24.177749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e8721-2530-4dfc-bac8-a93c90439323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:24.178544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e8721-2530-4dfc-bac8-a93c90439323 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:24.179524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e8721-2530-4dfc-bac8-a93c90439323 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:24.179861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35f79a-f125-4e86-b2a6-ba5ccd0048c9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:24.179969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e8721-2530-4dfc-bac8-a93c90439323 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:24.180788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e8721-2530-4dfc-bac8-a93c90439323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:27:24.181162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e8721-2530-4dfc-bac8-a93c90439323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:24.182825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e8721-2530-4dfc-bac8-a93c90439323 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:24.208006 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3300/6542] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:24 2022] PUT /identity/v3/projects/837cee2339bd4feb9a571b38c0577add/users/c5b99eba81444a7b9cc59e73898c65af/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:24.208954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35f79a-f125-4e86-b2a6-ba5ccd0048c9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:24.214708 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3243/6543] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:27:24.216285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341723c1-9a7b-4fca-a49d-9c0db31fc73d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:24.216703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341723c1-9a7b-4fca-a49d-9c0db31fc73d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:24.217135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341723c1-9a7b-4fca-a49d-9c0db31fc73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:24.225197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:24.238514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-341723c1-9a7b-4fca-a49d-9c0db31fc73d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:24.240064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-341723c1-9a7b-4fca-a49d-9c0db31fc73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:24.318644 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3244/6544] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:24.319970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341723c1-9a7b-4fca-a49d-9c0db31fc73d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:24.330527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341723c1-9a7b-4fca-a49d-9c0db31fc73d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:24.336427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aa200-a766-489a-9bd1-c636bb04ae00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:24.337844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aa200-a766-489a-9bd1-c636bb04ae00 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:24.338319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aa200-a766-489a-9bd1-c636bb04ae00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:24.339173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aa200-a766-489a-9bd1-c636bb04ae00 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:24.340079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4aa200-a766-489a-9bd1-c636bb04ae00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:24.343517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4aa200-a766-489a-9bd1-c636bb04ae00 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:24.371971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35f79a-f125-4e86-b2a6-ba5ccd0048c9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:24.383921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac136157-d5e4-4f38-8183-f9d71a76a568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:24.384581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac136157-d5e4-4f38-8183-f9d71a76a568 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:24.384999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac136157-d5e4-4f38-8183-f9d71a76a568 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:24.386218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac136157-d5e4-4f38-8183-f9d71a76a568 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:24.386883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac136157-d5e4-4f38-8183-f9d71a76a568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:24.389807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac136157-d5e4-4f38-8183-f9d71a76a568 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:24.403682 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3245/6545] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:24 2022] POST /identity/v3/projects => generated 405 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:24.404641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aa200-a766-489a-9bd1-c636bb04ae00 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:24.406343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4f4aa200-a766-489a-9bd1-c636bb04ae00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:24.421215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:24.473682 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3301/6546] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:24 2022] POST /identity/v3/projects => generated 385 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:24.475089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac136157-d5e4-4f38-8183-f9d71a76a568 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:24.477940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ac136157-d5e4-4f38-8183-f9d71a76a568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:24.500091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aa200-a766-489a-9bd1-c636bb04ae00 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:24.605592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91faf21-6fb5-43bf-b627-bee97c53903f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:24.608200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91faf21-6fb5-43bf-b627-bee97c53903f service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:24.608497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91faf21-6fb5-43bf-b627-bee97c53903f service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:24.608780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91faf21-6fb5-43bf-b627-bee97c53903f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:24.612931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac136157-d5e4-4f38-8183-f9d71a76a568 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:24.619078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098321d-1452-4f25-b593-bde4f38f903f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:24.620808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098321d-1452-4f25-b593-bde4f38f903f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:24.621320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098321d-1452-4f25-b593-bde4f38f903f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:24.621821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098321d-1452-4f25-b593-bde4f38f903f admin admin] PATH_INFO: `/v3/users/6ced663ff2fc4ba3b01b3c61f57aa576` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:24.623581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098321d-1452-4f25-b593-bde4f38f903f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ced663ff2fc4ba3b01b3c61f57aa576)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:24.624408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91faf21-6fb5-43bf-b627-bee97c53903f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:24.626847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098321d-1452-4f25-b593-bde4f38f903f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:24.627622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91faf21-6fb5-43bf-b627-bee97c53903f service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:24.647438 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3246/6547] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:24.648635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91faf21-6fb5-43bf-b627-bee97c53903f service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:24.663014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91faf21-6fb5-43bf-b627-bee97c53903f service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:24.671050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19cc60-b9d0-4897-8a0c-8a8b09f7a8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:24.671723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19cc60-b9d0-4897-8a0c-8a8b09f7a8e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:24.672069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19cc60-b9d0-4897-8a0c-8a8b09f7a8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:24.672382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19cc60-b9d0-4897-8a0c-8a8b09f7a8e5 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:24.674683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19cc60-b9d0-4897-8a0c-8a8b09f7a8e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:24.679594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19cc60-b9d0-4897-8a0c-8a8b09f7a8e5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:24.704265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a098321d-1452-4f25-b593-bde4f38f903f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ced663ff2fc4ba3b01b3c61f57aa576'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:24.723470 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3247/6548] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:24 2022] POST /identity/v3/users => generated 303 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:24.727116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19cc60-b9d0-4897-8a0c-8a8b09f7a8e5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:24.746898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a098321d-1452-4f25-b593-bde4f38f903f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ced663ff2fc4ba3b01b3c61f57aa576'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:24.748195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a098321d-1452-4f25-b593-bde4f38f903f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ced663ff2fc4ba3b01b3c61f57aa576'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:24.754889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19cc60-b9d0-4897-8a0c-8a8b09f7a8e5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:24.765102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a098321d-1452-4f25-b593-bde4f38f903f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ced663ff2fc4ba3b01b3c61f57aa576'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:24.766138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e86d9e-347d-4b20-9647-b8a538521081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:24.766866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a098321d-1452-4f25-b593-bde4f38f903f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ced663ff2fc4ba3b01b3c61f57aa576'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:24.768440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e86d9e-347d-4b20-9647-b8a538521081 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:24.770065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e86d9e-347d-4b20-9647-b8a538521081 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:24.777922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e86d9e-347d-4b20-9647-b8a538521081 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:24.780478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e86d9e-347d-4b20-9647-b8a538521081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:24.783131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e86d9e-347d-4b20-9647-b8a538521081 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:24.806583 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3302/6549] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:24 2022] DELETE /identity/v3/users/6ced663ff2fc4ba3b01b3c61f57aa576 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:24.807727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098321d-1452-4f25-b593-bde4f38f903f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:24.811514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a098321d-1452-4f25-b593-bde4f38f903f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:24.852174 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3248/6550] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:24 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:24.853339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ef1ee-6080-425c-981b-3698a53fb3cf None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:24.853630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ef1ee-6080-425c-981b-3698a53fb3cf None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:24.854606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ef1ee-6080-425c-981b-3698a53fb3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:24.857246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:24.886704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a20ef1ee-6080-425c-981b-3698a53fb3cf None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:24.888267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a20ef1ee-6080-425c-981b-3698a53fb3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:24.979152 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3249/6551] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:24.979152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ef1ee-6080-425c-981b-3698a53fb3cf None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:24.980121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098321d-1452-4f25-b593-bde4f38f903f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:24.980799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a20ef1ee-6080-425c-981b-3698a53fb3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:24.997140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ef1ee-6080-425c-981b-3698a53fb3cf None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:24.999830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ec5a5-0541-404e-a160-376d19f86100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:25.000499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ec5a5-0541-404e-a160-376d19f86100 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:25.000785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ec5a5-0541-404e-a160-376d19f86100 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:25.001100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ec5a5-0541-404e-a160-376d19f86100 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:25.001817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ec5a5-0541-404e-a160-376d19f86100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:25.003887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ec5a5-0541-404e-a160-376d19f86100 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:25.008152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98909b2c-28b7-452c-8579-ed76eab76c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:25.010544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98909b2c-28b7-452c-8579-ed76eab76c92 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:25.011254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98909b2c-28b7-452c-8579-ed76eab76c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:25.013325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98909b2c-28b7-452c-8579-ed76eab76c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:25.014145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98909b2c-28b7-452c-8579-ed76eab76c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:25.019136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98909b2c-28b7-452c-8579-ed76eab76c92 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:25.027900 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3303/6552] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:25.027900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ec5a5-0541-404e-a160-376d19f86100 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:25.034934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cd0ec5a5-0541-404e-a160-376d19f86100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:25.051451 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3250/6553] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:25.058038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98909b2c-28b7-452c-8579-ed76eab76c92 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:25.080785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98909b2c-28b7-452c-8579-ed76eab76c92 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:25.095859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a1edc-8258-44b6-bc58-d283c82d87d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:25.096490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a1edc-8258-44b6-bc58-d283c82d87d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:25.096774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a1edc-8258-44b6-bc58-d283c82d87d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:25.097122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a1edc-8258-44b6-bc58-d283c82d87d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:25.097826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a1edc-8258-44b6-bc58-d283c82d87d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:25.102161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a1edc-8258-44b6-bc58-d283c82d87d2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:25.129011 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3251/6554] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:25.129011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a1edc-8258-44b6-bc58-d283c82d87d2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:25.139669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a1edc-8258-44b6-bc58-d283c82d87d2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:25.145423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e317fa2-eb89-4830-a175-df841d04e0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:25.146317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e317fa2-eb89-4830-a175-df841d04e0ac admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:25.146610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e317fa2-eb89-4830-a175-df841d04e0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:25.147039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e317fa2-eb89-4830-a175-df841d04e0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:25.147936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e317fa2-eb89-4830-a175-df841d04e0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:25.149617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e317fa2-eb89-4830-a175-df841d04e0ac admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:25.154308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ec5a5-0541-404e-a160-376d19f86100 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:25.160546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21156608-1419-4e81-a83b-bf1c89b75ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:25.161519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21156608-1419-4e81-a83b-bf1c89b75ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:25.162057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21156608-1419-4e81-a83b-bf1c89b75ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:25.162535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21156608-1419-4e81-a83b-bf1c89b75ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:25.165695 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3252/6555] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:25.166863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e317fa2-eb89-4830-a175-df841d04e0ac admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:25.174146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:25.181710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21156608-1419-4e81-a83b-bf1c89b75ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:25.182628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e317fa2-eb89-4830-a175-df841d04e0ac admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:25.184065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21156608-1419-4e81-a83b-bf1c89b75ac4 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:25.194278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb76a5-34ab-404f-9471-a340c5f2b552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:25.195435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb76a5-34ab-404f-9471-a340c5f2b552 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:25.195910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb76a5-34ab-404f-9471-a340c5f2b552 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:25.196235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb76a5-34ab-404f-9471-a340c5f2b552 admin admin] PATH_INFO: `/v3/projects/b34dfc7a054c4ef6881e0c5e629d9c30/users/8fde6b308a09436390fc2807486f2c1a/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:25.218466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb76a5-34ab-404f-9471-a340c5f2b552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b34dfc7a054c4ef6881e0c5e629d9c30, user_id=8fde6b308a09436390fc2807486f2c1a, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:25.220281 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3304/6556] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:25.221080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21156608-1419-4e81-a83b-bf1c89b75ac4 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:25.223094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb76a5-34ab-404f-9471-a340c5f2b552 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:25.245698 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3253/6557] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:25 2022] PUT /identity/v3/projects/b34dfc7a054c4ef6881e0c5e629d9c30/users/8fde6b308a09436390fc2807486f2c1a/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:25.246136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21156608-1419-4e81-a83b-bf1c89b75ac4 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:25.251195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bc556-b7cb-48c4-887f-d329ef897e4f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:25.251600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bc556-b7cb-48c4-887f-d329ef897e4f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:25.252180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bc556-b7cb-48c4-887f-d329ef897e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:25.302615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-082bc556-b7cb-48c4-887f-d329ef897e4f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:25.306682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-082bc556-b7cb-48c4-887f-d329ef897e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:25.411116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e2b82-dfa2-48ef-a162-31078f9235c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:25.411834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e2b82-dfa2-48ef-a162-31078f9235c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:25.412171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e2b82-dfa2-48ef-a162-31078f9235c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:25.412456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e2b82-dfa2-48ef-a162-31078f9235c4 admin admin] PATH_INFO: `/v3/projects/a41d1e1f00ac471cb0d7ae5cfacba7b7/users/819b87213b9c473d91a59cafc10fa9af/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:25.447774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e2b82-dfa2-48ef-a162-31078f9235c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41d1e1f00ac471cb0d7ae5cfacba7b7, user_id=819b87213b9c473d91a59cafc10fa9af, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:25.453859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e2b82-dfa2-48ef-a162-31078f9235c4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:25.468350 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3254/6558] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:25.489803 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3305/6559] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:25 2022] PUT /identity/v3/projects/a41d1e1f00ac471cb0d7ae5cfacba7b7/users/819b87213b9c473d91a59cafc10fa9af/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:25.503922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c816d-107a-4bd5-8585-e342248de52f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:25.504236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c816d-107a-4bd5-8585-e342248de52f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:25.504521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c816d-107a-4bd5-8585-e342248de52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:25.537287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-741c816d-107a-4bd5-8585-e342248de52f None None] MFA Rules not processed for user `819b87213b9c473d91a59cafc10fa9af`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:25.538569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-741c816d-107a-4bd5-8585-e342248de52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:25.590432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e2b82-dfa2-48ef-a162-31078f9235c4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:25.658486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:25.695555 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3255/6560] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:25.696613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c816d-107a-4bd5-8585-e342248de52f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:25.715056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e2b82-dfa2-48ef-a162-31078f9235c4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:25.724241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca07e52-88d7-49fa-b4e8-6def5a22e681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:25.724885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca07e52-88d7-49fa-b4e8-6def5a22e681 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:25.725175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca07e52-88d7-49fa-b4e8-6def5a22e681 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:25.725454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca07e52-88d7-49fa-b4e8-6def5a22e681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:25.843593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c816d-107a-4bd5-8585-e342248de52f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:25.850354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cacdd6-fcfa-44d1-a7cf-5e011551ac29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:25.851164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cacdd6-fcfa-44d1-a7cf-5e011551ac29 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:25.851980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cacdd6-fcfa-44d1-a7cf-5e011551ac29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:25.852411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cacdd6-fcfa-44d1-a7cf-5e011551ac29 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:25.854287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cacdd6-fcfa-44d1-a7cf-5e011551ac29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:25.856783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cacdd6-fcfa-44d1-a7cf-5e011551ac29 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:25.891235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:25.909482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca07e52-88d7-49fa-b4e8-6def5a22e681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:25.913304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca07e52-88d7-49fa-b4e8-6def5a22e681 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:25.929283 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3256/6561] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:25 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:25.935641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cacdd6-fcfa-44d1-a7cf-5e011551ac29 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:25.938014 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3306/6562] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:26.087104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cacdd6-fcfa-44d1-a7cf-5e011551ac29 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:26.090998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfb845-3c00-4801-b03c-7cec35fb8003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:26.100228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfb845-3c00-4801-b03c-7cec35fb8003 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:26.100576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfb845-3c00-4801-b03c-7cec35fb8003 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:26.101361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfb845-3c00-4801-b03c-7cec35fb8003 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:26.101778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfb845-3c00-4801-b03c-7cec35fb8003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:26.106874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfb845-3c00-4801-b03c-7cec35fb8003 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:26.162745 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3257/6563] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:25 2022] POST /identity/v3/users => generated 298 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:26.168076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca07e52-88d7-49fa-b4e8-6def5a22e681 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:26.185091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca07e52-88d7-49fa-b4e8-6def5a22e681 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:26.194753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93905aa-e4fc-4264-b981-547d479010bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:26.195725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93905aa-e4fc-4264-b981-547d479010bd admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:26.196247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93905aa-e4fc-4264-b981-547d479010bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:26.196727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93905aa-e4fc-4264-b981-547d479010bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:26.197640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93905aa-e4fc-4264-b981-547d479010bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:26.200374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93905aa-e4fc-4264-b981-547d479010bd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:26.218687 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3307/6564] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:26.223987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfb845-3c00-4801-b03c-7cec35fb8003 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:26.238134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfb845-3c00-4801-b03c-7cec35fb8003 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:26.245545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3a697-87ea-422d-9b84-6640be052ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:26.246569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3a697-87ea-422d-9b84-6640be052ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:26.247187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3a697-87ea-422d-9b84-6640be052ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:26.247733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3a697-87ea-422d-9b84-6640be052ef1 admin admin] PATH_INFO: `/v3/projects/9fa195fbd45f43a3bb7f6b85b83d1a0a/users/2d277be1769749e9a54d6fc2998748a5/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:26.271469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3a697-87ea-422d-9b84-6640be052ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa195fbd45f43a3bb7f6b85b83d1a0a, user_id=2d277be1769749e9a54d6fc2998748a5, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:26.277618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3a697-87ea-422d-9b84-6640be052ef1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:26.313169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93905aa-e4fc-4264-b981-547d479010bd admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:26.314354 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3258/6565] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:26 2022] PUT /identity/v3/projects/9fa195fbd45f43a3bb7f6b85b83d1a0a/users/2d277be1769749e9a54d6fc2998748a5/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:26.328317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93905aa-e4fc-4264-b981-547d479010bd admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:26.401218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ef480-de95-4949-a547-ae8d7df5bebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:26.401869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ef480-de95-4949-a547-ae8d7df5bebc admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:26.406393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ef480-de95-4949-a547-ae8d7df5bebc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:26.406591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ef480-de95-4949-a547-ae8d7df5bebc admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:26.408200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ef480-de95-4949-a547-ae8d7df5bebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:26.410767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ef480-de95-4949-a547-ae8d7df5bebc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:26.437892 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3a697-87ea-422d-9b84-6640be052ef1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:26.441803 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3308/6566] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:26.451841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3a697-87ea-422d-9b84-6640be052ef1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:26.457864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc774c1-4e44-4658-a23e-a94bce488421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:26.459611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc774c1-4e44-4658-a23e-a94bce488421 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:26.459611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc774c1-4e44-4658-a23e-a94bce488421 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:26.460193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc774c1-4e44-4658-a23e-a94bce488421 admin admin] PATH_INFO: `/v3/projects/9fa195fbd45f43a3bb7f6b85b83d1a0a/users/2d277be1769749e9a54d6fc2998748a5/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:26.462495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc774c1-4e44-4658-a23e-a94bce488421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa195fbd45f43a3bb7f6b85b83d1a0a, user_id=2d277be1769749e9a54d6fc2998748a5, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:26.465602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc774c1-4e44-4658-a23e-a94bce488421 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:26.492494 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3259/6567] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:26 2022] PUT /identity/v3/projects/9fa195fbd45f43a3bb7f6b85b83d1a0a/users/2d277be1769749e9a54d6fc2998748a5/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:27:26.499865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3787693-9ba0-4e52-8644-dcfd467fa3fe None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:26.500165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3787693-9ba0-4e52-8644-dcfd467fa3fe None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:26.500454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3787693-9ba0-4e52-8644-dcfd467fa3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:26.544125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d3787693-9ba0-4e52-8644-dcfd467fa3fe None None] MFA Rules not processed for user `2d277be1769749e9a54d6fc2998748a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:26.545483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d3787693-9ba0-4e52-8644-dcfd467fa3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:26.653062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc774c1-4e44-4658-a23e-a94bce488421 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:26.655865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3fc774c1-4e44-4658-a23e-a94bce488421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:26.689679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:26.745220 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3309/6568] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:26.807649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc774c1-4e44-4658-a23e-a94bce488421 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:26.817486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3787693-9ba0-4e52-8644-dcfd467fa3fe None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:26.826791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e6eb6-527f-4489-b8da-3f6a5d24af2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:26.830443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e6eb6-527f-4489-b8da-3f6a5d24af2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:26.832147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e6eb6-527f-4489-b8da-3f6a5d24af2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:26.832279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e6eb6-527f-4489-b8da-3f6a5d24af2f admin admin] PATH_INFO: `/v3/projects/1563fd64c2ca490e83c252cf741fd041` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:26.836271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e6eb6-527f-4489-b8da-3f6a5d24af2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1563fd64c2ca490e83c252cf741fd041)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:26.841805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e6eb6-527f-4489-b8da-3f6a5d24af2f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:26.952670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3787693-9ba0-4e52-8644-dcfd467fa3fe None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:26.962299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-086e6eb6-527f-4489-b8da-3f6a5d24af2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1563fd64c2ca490e83c252cf741fd041', 'request_id': 'req-086e6eb6-527f-4489-b8da-3f6a5d24af2f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:26.971067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:26.984952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-086e6eb6-527f-4489-b8da-3f6a5d24af2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1563fd64c2ca490e83c252cf741fd041', 'request_id': 'req-086e6eb6-527f-4489-b8da-3f6a5d24af2f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:27.019612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-086e6eb6-527f-4489-b8da-3f6a5d24af2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1563fd64c2ca490e83c252cf741fd041', 'request_id': 'req-086e6eb6-527f-4489-b8da-3f6a5d24af2f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:27.048785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-086e6eb6-527f-4489-b8da-3f6a5d24af2f admin admin] The token cache is being invalidate because project 1563fd64c2ca490e83c252cf741fd041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:27.049144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-086e6eb6-527f-4489-b8da-3f6a5d24af2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:27.051032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-086e6eb6-527f-4489-b8da-3f6a5d24af2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:27.055356 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3260/6569] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:26 2022] DELETE /identity/v3/projects/1563fd64c2ca490e83c252cf741fd041 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:27:27.060313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e6eb6-527f-4489-b8da-3f6a5d24af2f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:27.061994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-086e6eb6-527f-4489-b8da-3f6a5d24af2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:27.106070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4e858-a70b-414d-967c-b1245c8e47cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:27.106714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4e858-a70b-414d-967c-b1245c8e47cc service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:27.107097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4e858-a70b-414d-967c-b1245c8e47cc service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:27.107352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4e858-a70b-414d-967c-b1245c8e47cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:27.112154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-19a4e858-a70b-414d-967c-b1245c8e47cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:27.250334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e6eb6-527f-4489-b8da-3f6a5d24af2f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:27.264439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4e858-a70b-414d-967c-b1245c8e47cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:27.269901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e7bc1-225b-45de-8589-b56401444343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:27.270215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e7bc1-225b-45de-8589-b56401444343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:27.270518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e7bc1-225b-45de-8589-b56401444343 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:27.271007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e7bc1-225b-45de-8589-b56401444343 admin admin] PATH_INFO: `/v3/users/441ca099272344d3845959d815bb867e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:27.271369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4e858-a70b-414d-967c-b1245c8e47cc service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:27.276093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e7bc1-225b-45de-8589-b56401444343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=441ca099272344d3845959d815bb867e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:27.284551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e7bc1-225b-45de-8589-b56401444343 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:27.302861 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3310/6570] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:27.386536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-973e7bc1-225b-45de-8589-b56401444343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '441ca099272344d3845959d815bb867e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:27.387322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-973e7bc1-225b-45de-8589-b56401444343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '441ca099272344d3845959d815bb867e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:27.415153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-973e7bc1-225b-45de-8589-b56401444343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '441ca099272344d3845959d815bb867e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:27.417302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-973e7bc1-225b-45de-8589-b56401444343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '441ca099272344d3845959d815bb867e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:27.444362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-973e7bc1-225b-45de-8589-b56401444343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '441ca099272344d3845959d815bb867e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:27.482239 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3261/6571] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:27 2022] DELETE /identity/v3/users/441ca099272344d3845959d815bb867e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:29.800341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4e858-a70b-414d-967c-b1245c8e47cc service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:29.802268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-19a4e858-a70b-414d-967c-b1245c8e47cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:29.822145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4e858-a70b-414d-967c-b1245c8e47cc service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:30.007075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffab00-7012-4fb4-b027-370e1827e9b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:30.009783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffab00-7012-4fb4-b027-370e1827e9b7 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:30.010900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffab00-7012-4fb4-b027-370e1827e9b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:30.012006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffab00-7012-4fb4-b027-370e1827e9b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:30.014587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ebffab00-7012-4fb4-b027-370e1827e9b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:30.039547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:30.136499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebffab00-7012-4fb4-b027-370e1827e9b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:30.138468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebffab00-7012-4fb4-b027-370e1827e9b7 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:30.163433 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3311/6572] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:30.365097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133118cd-8fbf-49f9-b390-833e228c2d92 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:30.365774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133118cd-8fbf-49f9-b390-833e228c2d92 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:30.365774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133118cd-8fbf-49f9-b390-833e228c2d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:30.383974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffab00-7012-4fb4-b027-370e1827e9b7 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:30.385389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ebffab00-7012-4fb4-b027-370e1827e9b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:30.475895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-133118cd-8fbf-49f9-b390-833e228c2d92 None None] MFA Rules not processed for user `8fde6b308a09436390fc2807486f2c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:30.480770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-133118cd-8fbf-49f9-b390-833e228c2d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:30.622568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:30.646238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffab00-7012-4fb4-b027-370e1827e9b7 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:30.668599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a885948-74e0-461d-b31e-c0a4824db209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:30.670398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a885948-74e0-461d-b31e-c0a4824db209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:30.670811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a885948-74e0-461d-b31e-c0a4824db209 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:30.672222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a885948-74e0-461d-b31e-c0a4824db209 admin admin] PATH_INFO: `/v3/projects/d45122f90af845ca91562033790b0012` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:30.674908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a885948-74e0-461d-b31e-c0a4824db209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d45122f90af845ca91562033790b0012)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:30.676891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a885948-74e0-461d-b31e-c0a4824db209 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:30.691724 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3262/6573] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:30 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:27:30.697911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133118cd-8fbf-49f9-b390-833e228c2d92 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:30.701111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-133118cd-8fbf-49f9-b390-833e228c2d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:30.750036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133118cd-8fbf-49f9-b390-833e228c2d92 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:30.765689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3aee65-0152-470d-9d3b-bf40d6cc3f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:30.767119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3aee65-0152-470d-9d3b-bf40d6cc3f1e admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:30.767435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3aee65-0152-470d-9d3b-bf40d6cc3f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:30.768768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3aee65-0152-470d-9d3b-bf40d6cc3f1e admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:30.771924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3aee65-0152-470d-9d3b-bf40d6cc3f1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:30.774981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3aee65-0152-470d-9d3b-bf40d6cc3f1e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:30.831550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2a885948-74e0-461d-b31e-c0a4824db209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd45122f90af845ca91562033790b0012', 'request_id': 'req-2a885948-74e0-461d-b31e-c0a4824db209'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:30.852209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2a885948-74e0-461d-b31e-c0a4824db209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd45122f90af845ca91562033790b0012', 'request_id': 'req-2a885948-74e0-461d-b31e-c0a4824db209'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:30.874139 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3263/6574] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:30 2022] POST /identity/v3/projects => generated 405 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:30.874799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2a885948-74e0-461d-b31e-c0a4824db209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd45122f90af845ca91562033790b0012', 'request_id': 'req-2a885948-74e0-461d-b31e-c0a4824db209'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:30.880067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3aee65-0152-470d-9d3b-bf40d6cc3f1e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:30.899975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2a885948-74e0-461d-b31e-c0a4824db209 admin admin] The token cache is being invalidate because project d45122f90af845ca91562033790b0012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:30.900270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2a885948-74e0-461d-b31e-c0a4824db209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:30.903857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2a885948-74e0-461d-b31e-c0a4824db209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:30.923451 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3312/6575] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:30 2022] DELETE /identity/v3/projects/d45122f90af845ca91562033790b0012 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:30.925128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e921f-3967-42ea-a051-24929f51267d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:30.925428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e921f-3967-42ea-a051-24929f51267d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:30.925700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e921f-3967-42ea-a051-24929f51267d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:30.967885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a92e921f-3967-42ea-a051-24929f51267d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:30.970759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a92e921f-3967-42ea-a051-24929f51267d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:31.073313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3aee65-0152-470d-9d3b-bf40d6cc3f1e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:31.081321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cb830-939d-4b2a-9d93-ffa7856f7f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:31.082256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cb830-939d-4b2a-9d93-ffa7856f7f77 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:31.082899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cb830-939d-4b2a-9d93-ffa7856f7f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:31.083474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cb830-939d-4b2a-9d93-ffa7856f7f77 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:31.084828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cb830-939d-4b2a-9d93-ffa7856f7f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:31.086982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cb830-939d-4b2a-9d93-ffa7856f7f77 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:31.107973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:31.142875 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3264/6576] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:30 2022] POST /identity/v3/users => generated 309 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:31.145058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cb830-939d-4b2a-9d93-ffa7856f7f77 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:31.147163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bb9cb830-939d-4b2a-9d93-ffa7856f7f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:31.181210 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3313/6577] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:31.183154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cb830-939d-4b2a-9d93-ffa7856f7f77 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:31.191052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1499c2f-c0cf-4ce8-b649-236ac6fe9ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:31.192410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1499c2f-c0cf-4ce8-b649-236ac6fe9ffe admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:31.193810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1499c2f-c0cf-4ce8-b649-236ac6fe9ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:31.194610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1499c2f-c0cf-4ce8-b649-236ac6fe9ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:31.196056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1499c2f-c0cf-4ce8-b649-236ac6fe9ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:31.196166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b81122-862d-4d81-931d-4e45885cc0c9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:31.196492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b81122-862d-4d81-931d-4e45885cc0c9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:31.198105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b81122-862d-4d81-931d-4e45885cc0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:31.198943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1499c2f-c0cf-4ce8-b649-236ac6fe9ffe admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:31.221571 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3265/6578] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:27:31.222787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1499c2f-c0cf-4ce8-b649-236ac6fe9ffe admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:31.237419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1499c2f-c0cf-4ce8-b649-236ac6fe9ffe admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:31.245368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eca41d-2290-4a16-be47-b28f9359d500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:31.247071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eca41d-2290-4a16-be47-b28f9359d500 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:31.248101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eca41d-2290-4a16-be47-b28f9359d500 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:31.248924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eca41d-2290-4a16-be47-b28f9359d500 admin admin] PATH_INFO: `/v3/projects/1c959d507e6a482a828fe588f81f8faf/users/7ac175a73f92491eb68cdd26470b34ce/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:31.271170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a3b81122-862d-4d81-931d-4e45885cc0c9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:31.282214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a3b81122-862d-4d81-931d-4e45885cc0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:31.287518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eca41d-2290-4a16-be47-b28f9359d500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c959d507e6a482a828fe588f81f8faf, user_id=7ac175a73f92491eb68cdd26470b34ce, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:31.292064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eca41d-2290-4a16-be47-b28f9359d500 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:31.320166 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3314/6579] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:31.326168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b81122-862d-4d81-931d-4e45885cc0c9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:31.327117 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3266/6580] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:31 2022] PUT /identity/v3/projects/1c959d507e6a482a828fe588f81f8faf/users/7ac175a73f92491eb68cdd26470b34ce/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:31.329527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eca41d-2290-4a16-be47-b28f9359d500 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:31.349917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b81122-862d-4d81-931d-4e45885cc0c9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:31.437142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eca41d-2290-4a16-be47-b28f9359d500 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:31.446848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbd7bb-6e9e-4db1-838b-5732665de79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:31.447992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbd7bb-6e9e-4db1-838b-5732665de79d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:31.448573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbd7bb-6e9e-4db1-838b-5732665de79d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:31.449057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbd7bb-6e9e-4db1-838b-5732665de79d admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:31.450058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbd7bb-6e9e-4db1-838b-5732665de79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:31.452768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbd7bb-6e9e-4db1-838b-5732665de79d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:31.474310 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3267/6581] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:31.476862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbd7bb-6e9e-4db1-838b-5732665de79d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:31.486210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d0157-ac66-4ccb-8f5f-2bdc711400c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:31.486806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d0157-ac66-4ccb-8f5f-2bdc711400c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:31.488245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d0157-ac66-4ccb-8f5f-2bdc711400c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:31.488534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d0157-ac66-4ccb-8f5f-2bdc711400c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:31.492030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d0157-ac66-4ccb-8f5f-2bdc711400c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:27:31.492638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbd7bb-6e9e-4db1-838b-5732665de79d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:31.493281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d0157-ac66-4ccb-8f5f-2bdc711400c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:31.500676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b34ff4-0896-44ab-b7bc-205de83addae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:31.501817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b34ff4-0896-44ab-b7bc-205de83addae admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:31.502609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b34ff4-0896-44ab-b7bc-205de83addae admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:31.503123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b34ff4-0896-44ab-b7bc-205de83addae admin admin] PATH_INFO: `/v3/projects/1c959d507e6a482a828fe588f81f8faf/users/7ac175a73f92491eb68cdd26470b34ce/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:31.504035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d0157-ac66-4ccb-8f5f-2bdc711400c1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:31.506249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b34ff4-0896-44ab-b7bc-205de83addae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c959d507e6a482a828fe588f81f8faf, user_id=7ac175a73f92491eb68cdd26470b34ce, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:31.511712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b34ff4-0896-44ab-b7bc-205de83addae admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:31.527650 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3268/6582] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:31 2022] PUT /identity/v3/projects/1c959d507e6a482a828fe588f81f8faf/users/7ac175a73f92491eb68cdd26470b34ce/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:31.562496 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3315/6583] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:27:31.564696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b34ff4-0896-44ab-b7bc-205de83addae admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:31.571119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:31.678141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b34ff4-0896-44ab-b7bc-205de83addae admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:31.686100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02b744-bb49-4519-b70d-515b9990f4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:31.686680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02b744-bb49-4519-b70d-515b9990f4aa admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:31.687806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02b744-bb49-4519-b70d-515b9990f4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:31.688135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02b744-bb49-4519-b70d-515b9990f4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:31.689447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02b744-bb49-4519-b70d-515b9990f4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:31.693278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02b744-bb49-4519-b70d-515b9990f4aa admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:31.741987 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3269/6584] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:31 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:27:31.744167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d0157-ac66-4ccb-8f5f-2bdc711400c1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:31.765693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d0157-ac66-4ccb-8f5f-2bdc711400c1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:31.926461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84f487-f0f9-4d5b-9fce-dc953d9ccced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:31.927791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84f487-f0f9-4d5b-9fce-dc953d9ccced admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:31.929108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84f487-f0f9-4d5b-9fce-dc953d9ccced admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:31.931257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84f487-f0f9-4d5b-9fce-dc953d9ccced admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:31.931997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84f487-f0f9-4d5b-9fce-dc953d9ccced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:31.937015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84f487-f0f9-4d5b-9fce-dc953d9ccced admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:32.012956 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3316/6585] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:31 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:27:32.014216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02b744-bb49-4519-b70d-515b9990f4aa admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:32.032657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02b744-bb49-4519-b70d-515b9990f4aa admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:32.045013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd220ac4-8a93-4141-8cdd-840af6748839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:32.045662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd220ac4-8a93-4141-8cdd-840af6748839 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:32.045950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd220ac4-8a93-4141-8cdd-840af6748839 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:32.046237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd220ac4-8a93-4141-8cdd-840af6748839 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:32.046949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd220ac4-8a93-4141-8cdd-840af6748839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:32.053843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd220ac4-8a93-4141-8cdd-840af6748839 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:32.075967 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3270/6586] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:32.080935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84f487-f0f9-4d5b-9fce-dc953d9ccced admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:32.101361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84f487-f0f9-4d5b-9fce-dc953d9ccced admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:32.106993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ddf32-620e-4c96-b06f-b589e71ec5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:32.107696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ddf32-620e-4c96-b06f-b589e71ec5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:32.108029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ddf32-620e-4c96-b06f-b589e71ec5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:32.108284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ddf32-620e-4c96-b06f-b589e71ec5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:32.108995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ddf32-620e-4c96-b06f-b589e71ec5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:32.113171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ddf32-620e-4c96-b06f-b589e71ec5a3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:32.151522 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3317/6587] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:32.156311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd220ac4-8a93-4141-8cdd-840af6748839 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:32.182287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd220ac4-8a93-4141-8cdd-840af6748839 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:32.193653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b040487-eaa5-49eb-a315-e52fef07d276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:32.196685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b040487-eaa5-49eb-a315-e52fef07d276 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:32.197185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b040487-eaa5-49eb-a315-e52fef07d276 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:32.198117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b040487-eaa5-49eb-a315-e52fef07d276 admin admin] PATH_INFO: `/v3/projects/f1bddb9b7a574ce8a2c9c81a33444580/users/58b8840764db4b65a8d401642944d7ab/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:32.224415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b040487-eaa5-49eb-a315-e52fef07d276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1bddb9b7a574ce8a2c9c81a33444580, user_id=58b8840764db4b65a8d401642944d7ab, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:32.229204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b040487-eaa5-49eb-a315-e52fef07d276 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:32.256525 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3271/6588] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:32 2022] PUT /identity/v3/projects/f1bddb9b7a574ce8a2c9c81a33444580/users/58b8840764db4b65a8d401642944d7ab/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:32.268329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09773abb-83f0-48c1-9785-52b32aaa4c8a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:32.268759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09773abb-83f0-48c1-9785-52b32aaa4c8a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:32.269045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09773abb-83f0-48c1-9785-52b32aaa4c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:32.317002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-09773abb-83f0-48c1-9785-52b32aaa4c8a None None] MFA Rules not processed for user `58b8840764db4b65a8d401642944d7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:32.318344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-09773abb-83f0-48c1-9785-52b32aaa4c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:32.381001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:32.428677 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3318/6589] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:32.429376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b040487-eaa5-49eb-a315-e52fef07d276 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:32.569230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b040487-eaa5-49eb-a315-e52fef07d276 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:32.575369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43af54-212e-479e-82da-a4dc6b00bc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:32.576567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43af54-212e-479e-82da-a4dc6b00bc6a admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:32.577070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43af54-212e-479e-82da-a4dc6b00bc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:32.577496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43af54-212e-479e-82da-a4dc6b00bc6a admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:32.578336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43af54-212e-479e-82da-a4dc6b00bc6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:32.582716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43af54-212e-479e-82da-a4dc6b00bc6a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:32.619661 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3272/6590] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:32 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:32.623656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09773abb-83f0-48c1-9785-52b32aaa4c8a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:32.639760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09773abb-83f0-48c1-9785-52b32aaa4c8a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:32.802969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c34009-d650-4645-87a3-4918b3d8c025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:32.804030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c34009-d650-4645-87a3-4918b3d8c025 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:32.804715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c34009-d650-4645-87a3-4918b3d8c025 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:32.805093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c34009-d650-4645-87a3-4918b3d8c025 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:32.805960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c34009-d650-4645-87a3-4918b3d8c025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:32.809321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c34009-d650-4645-87a3-4918b3d8c025 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:32.870484 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3319/6591] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:32 2022] POST /identity/v3/users => generated 300 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:27:32.874994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43af54-212e-479e-82da-a4dc6b00bc6a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:32.891669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43af54-212e-479e-82da-a4dc6b00bc6a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:32.898572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6da0e-0de6-4822-bee9-27e844d64083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:32.899229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6da0e-0de6-4822-bee9-27e844d64083 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:32.899561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6da0e-0de6-4822-bee9-27e844d64083 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:32.900094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6da0e-0de6-4822-bee9-27e844d64083 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:32.900828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6da0e-0de6-4822-bee9-27e844d64083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:32.903146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6da0e-0de6-4822-bee9-27e844d64083 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:32.921914 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3273/6592] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:27:32.924771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c34009-d650-4645-87a3-4918b3d8c025 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:32.940075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c34009-d650-4645-87a3-4918b3d8c025 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:32.947794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d38a2-4323-464a-910c-4e3fd59cef7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:32.949549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d38a2-4323-464a-910c-4e3fd59cef7d admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:32.950635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d38a2-4323-464a-910c-4e3fd59cef7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:32.951123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d38a2-4323-464a-910c-4e3fd59cef7d admin admin] PATH_INFO: `/v3/projects/fd1f43858dc54be2b93eae8ca90cea0e/users/c7b18cb282ff4c80b7dc3d0ce4e68f26/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:33.009177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d38a2-4323-464a-910c-4e3fd59cef7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1f43858dc54be2b93eae8ca90cea0e, user_id=c7b18cb282ff4c80b7dc3d0ce4e68f26, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:33.018211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d38a2-4323-464a-910c-4e3fd59cef7d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:33.052135 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3320/6593] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:32 2022] PUT /identity/v3/projects/fd1f43858dc54be2b93eae8ca90cea0e/users/c7b18cb282ff4c80b7dc3d0ce4e68f26/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:33.052318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6da0e-0de6-4822-bee9-27e844d64083 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:33.068891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6da0e-0de6-4822-bee9-27e844d64083 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:33.109289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:33.204728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7bedc4-438e-4be4-849f-a3c778f039d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:33.205382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bedc4-438e-4be4-849f-a3c778f039d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:33.205669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bedc4-438e-4be4-849f-a3c778f039d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:33.205950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bedc4-438e-4be4-849f-a3c778f039d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:33.206929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7bedc4-438e-4be4-849f-a3c778f039d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:33.212175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7bedc4-438e-4be4-849f-a3c778f039d0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:33.233560 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3274/6594] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:27:33.238699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d38a2-4323-464a-910c-4e3fd59cef7d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:33.253383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d38a2-4323-464a-910c-4e3fd59cef7d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:33.260900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e168d-2933-4c76-9e98-d9a108c4a1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:33.262664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e168d-2933-4c76-9e98-d9a108c4a1bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:33.263251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e168d-2933-4c76-9e98-d9a108c4a1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:33.263782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e168d-2933-4c76-9e98-d9a108c4a1bb admin admin] PATH_INFO: `/v3/projects/fd1f43858dc54be2b93eae8ca90cea0e/users/c7b18cb282ff4c80b7dc3d0ce4e68f26/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:33.267494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e168d-2933-4c76-9e98-d9a108c4a1bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1f43858dc54be2b93eae8ca90cea0e, user_id=c7b18cb282ff4c80b7dc3d0ce4e68f26, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:33.271178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e168d-2933-4c76-9e98-d9a108c4a1bb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:33.304142 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3321/6595] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:33 2022] PUT /identity/v3/projects/fd1f43858dc54be2b93eae8ca90cea0e/users/c7b18cb282ff4c80b7dc3d0ce4e68f26/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:33.304756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f6664-9dcf-4b2b-b2b9-0e43b52e53cc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:33.305055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f6664-9dcf-4b2b-b2b9-0e43b52e53cc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:33.305343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f6664-9dcf-4b2b-b2b9-0e43b52e53cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:33.364544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-142f6664-9dcf-4b2b-b2b9-0e43b52e53cc None None] MFA Rules not processed for user `c7b18cb282ff4c80b7dc3d0ce4e68f26`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:33.371146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-142f6664-9dcf-4b2b-b2b9-0e43b52e53cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:33.481165 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3275/6596] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:33.493033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e168d-2933-4c76-9e98-d9a108c4a1bb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:33.495688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-501e168d-2933-4c76-9e98-d9a108c4a1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:33.599950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e168d-2933-4c76-9e98-d9a108c4a1bb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:33.610199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3965e38-3fb9-4414-a508-576e1b430e1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:33.624402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3965e38-3fb9-4414-a508-576e1b430e1a service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:33.625071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3965e38-3fb9-4414-a508-576e1b430e1a service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:33.628375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3965e38-3fb9-4414-a508-576e1b430e1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:33.672663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3965e38-3fb9-4414-a508-576e1b430e1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:33.674388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3965e38-3fb9-4414-a508-576e1b430e1a service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:33.697248 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3322/6597] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:33.726270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960593ae-d779-423a-b2ac-2a171c7ee9b0 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:33.726818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960593ae-d779-423a-b2ac-2a171c7ee9b0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:33.727084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960593ae-d779-423a-b2ac-2a171c7ee9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:33.788989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-960593ae-d779-423a-b2ac-2a171c7ee9b0 None None] MFA Rules not processed for user `7ac175a73f92491eb68cdd26470b34ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:33.790576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-960593ae-d779-423a-b2ac-2a171c7ee9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:33.839655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3965e38-3fb9-4414-a508-576e1b430e1a service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:33.936129 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3276/6598] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:33 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:33.958332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:34.039191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3965e38-3fb9-4414-a508-576e1b430e1a service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:34.050425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f452143-23bb-40be-9714-e55163a12c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:34.051561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f452143-23bb-40be-9714-e55163a12c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:34.051561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f452143-23bb-40be-9714-e55163a12c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:34.051785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f452143-23bb-40be-9714-e55163a12c56 admin admin] PATH_INFO: `/v3/users/58b8840764db4b65a8d401642944d7ab` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:34.052894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f452143-23bb-40be-9714-e55163a12c56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b8840764db4b65a8d401642944d7ab)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:34.054885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f452143-23bb-40be-9714-e55163a12c56 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:34.142536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7f452143-23bb-40be-9714-e55163a12c56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b8840764db4b65a8d401642944d7ab'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:34.158074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7f452143-23bb-40be-9714-e55163a12c56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b8840764db4b65a8d401642944d7ab'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:34.159226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7f452143-23bb-40be-9714-e55163a12c56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b8840764db4b65a8d401642944d7ab'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:34.169740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7f452143-23bb-40be-9714-e55163a12c56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b8840764db4b65a8d401642944d7ab'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:34.171139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7f452143-23bb-40be-9714-e55163a12c56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b8840764db4b65a8d401642944d7ab'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:34.210938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee6356-7a71-4b78-8da2-d6ce357be620 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:34.211898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee6356-7a71-4b78-8da2-d6ce357be620 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:34.212576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee6356-7a71-4b78-8da2-d6ce357be620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:34.221763 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3323/6599] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:33 2022] DELETE /identity/v3/users/58b8840764db4b65a8d401642944d7ab => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:34.238602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e0ee6356-7a71-4b78-8da2-d6ce357be620 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:34.240667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e0ee6356-7a71-4b78-8da2-d6ce357be620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:34.304070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:34.352313 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3277/6600] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:34.424076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f452143-23bb-40be-9714-e55163a12c56 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:34.426984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7f452143-23bb-40be-9714-e55163a12c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:34.529068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f452143-23bb-40be-9714-e55163a12c56 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:34.544090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df9e42-b5b6-4952-9832-ab04768226cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:34.544873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df9e42-b5b6-4952-9832-ab04768226cb service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:34.545786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df9e42-b5b6-4952-9832-ab04768226cb service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:34.546184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df9e42-b5b6-4952-9832-ab04768226cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:34.560256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df9e42-b5b6-4952-9832-ab04768226cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:34.562521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df9e42-b5b6-4952-9832-ab04768226cb service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:34.589976 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3324/6601] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:35.706118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee6356-7a71-4b78-8da2-d6ce357be620 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:35.708444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e0ee6356-7a71-4b78-8da2-d6ce357be620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:35.728182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee6356-7a71-4b78-8da2-d6ce357be620 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:35.756793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b3a05-69ef-48a8-a4d4-e0d5fe26b38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:35.758159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b3a05-69ef-48a8-a4d4-e0d5fe26b38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:35.758635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b3a05-69ef-48a8-a4d4-e0d5fe26b38b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:35.763820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b3a05-69ef-48a8-a4d4-e0d5fe26b38b admin admin] PATH_INFO: `/v3/users/b0b7534856ad4817b1b15a2505a791dc` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:35.766220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b3a05-69ef-48a8-a4d4-e0d5fe26b38b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0b7534856ad4817b1b15a2505a791dc)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:35.767740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b3a05-69ef-48a8-a4d4-e0d5fe26b38b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:35.885400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9e3b3a05-69ef-48a8-a4d4-e0d5fe26b38b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0b7534856ad4817b1b15a2505a791dc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:35.886798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9e3b3a05-69ef-48a8-a4d4-e0d5fe26b38b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0b7534856ad4817b1b15a2505a791dc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:35.920076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9e3b3a05-69ef-48a8-a4d4-e0d5fe26b38b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0b7534856ad4817b1b15a2505a791dc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:35.921375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9e3b3a05-69ef-48a8-a4d4-e0d5fe26b38b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0b7534856ad4817b1b15a2505a791dc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:35.935034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9e3b3a05-69ef-48a8-a4d4-e0d5fe26b38b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0b7534856ad4817b1b15a2505a791dc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:35.960257 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3278/6602] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:35 2022] DELETE /identity/v3/users/b0b7534856ad4817b1b15a2505a791dc => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:36.146867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df9e42-b5b6-4952-9832-ab04768226cb service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:36.148486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-22df9e42-b5b6-4952-9832-ab04768226cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:36.169114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df9e42-b5b6-4952-9832-ab04768226cb service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:36.274395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:36.291008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea93f54-6e7f-467f-871c-e40df2196b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:36.292603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea93f54-6e7f-467f-871c-e40df2196b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:36.294161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea93f54-6e7f-467f-871c-e40df2196b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:36.294309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea93f54-6e7f-467f-871c-e40df2196b80 admin admin] PATH_INFO: `/v3/projects/f1bddb9b7a574ce8a2c9c81a33444580` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:36.297915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea93f54-6e7f-467f-871c-e40df2196b80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1bddb9b7a574ce8a2c9c81a33444580)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:36.301123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea93f54-6e7f-467f-871c-e40df2196b80 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:36.382488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6ea93f54-6e7f-467f-871c-e40df2196b80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1bddb9b7a574ce8a2c9c81a33444580', 'request_id': 'req-6ea93f54-6e7f-467f-871c-e40df2196b80'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:36.394223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6ea93f54-6e7f-467f-871c-e40df2196b80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1bddb9b7a574ce8a2c9c81a33444580', 'request_id': 'req-6ea93f54-6e7f-467f-871c-e40df2196b80'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:36.405805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6ea93f54-6e7f-467f-871c-e40df2196b80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1bddb9b7a574ce8a2c9c81a33444580', 'request_id': 'req-6ea93f54-6e7f-467f-871c-e40df2196b80'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:36.435460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6ea93f54-6e7f-467f-871c-e40df2196b80 admin admin] The token cache is being invalidate because project f1bddb9b7a574ce8a2c9c81a33444580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:36.435767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6ea93f54-6e7f-467f-871c-e40df2196b80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:36.439738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6ea93f54-6e7f-467f-871c-e40df2196b80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:36.447952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b3a05-69ef-48a8-a4d4-e0d5fe26b38b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:36.448491 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3325/6603] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:36 2022] DELETE /identity/v3/projects/f1bddb9b7a574ce8a2c9c81a33444580 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:36.449994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9e3b3a05-69ef-48a8-a4d4-e0d5fe26b38b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:36.478092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b3a05-69ef-48a8-a4d4-e0d5fe26b38b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:36.638062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb9dec-6a64-4a72-90e1-24c13e13c6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:36.639787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb9dec-6a64-4a72-90e1-24c13e13c6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:36.641545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb9dec-6a64-4a72-90e1-24c13e13c6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:36.642020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb9dec-6a64-4a72-90e1-24c13e13c6b0 admin admin] PATH_INFO: `/v3/users/c7b18cb282ff4c80b7dc3d0ce4e68f26` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:36.643824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb9dec-6a64-4a72-90e1-24c13e13c6b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7b18cb282ff4c80b7dc3d0ce4e68f26)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:36.654443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb9dec-6a64-4a72-90e1-24c13e13c6b0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:36.776710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-41eb9dec-6a64-4a72-90e1-24c13e13c6b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7b18cb282ff4c80b7dc3d0ce4e68f26'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:36.778058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-41eb9dec-6a64-4a72-90e1-24c13e13c6b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7b18cb282ff4c80b7dc3d0ce4e68f26'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:36.780749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:36.810630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-41eb9dec-6a64-4a72-90e1-24c13e13c6b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7b18cb282ff4c80b7dc3d0ce4e68f26'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:36.814437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-41eb9dec-6a64-4a72-90e1-24c13e13c6b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7b18cb282ff4c80b7dc3d0ce4e68f26'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:36.831668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-41eb9dec-6a64-4a72-90e1-24c13e13c6b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7b18cb282ff4c80b7dc3d0ce4e68f26'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:36.852215 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3279/6604] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:36 2022] DELETE /identity/v3/users/c7b18cb282ff4c80b7dc3d0ce4e68f26 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:37.219520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea93f54-6e7f-467f-871c-e40df2196b80 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:37.220998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6ea93f54-6e7f-467f-871c-e40df2196b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:37.241470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea93f54-6e7f-467f-871c-e40df2196b80 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:37.372397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ebe32-127c-4749-9cab-bc70e357b647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:37.373056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ebe32-127c-4749-9cab-bc70e357b647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:37.373342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ebe32-127c-4749-9cab-bc70e357b647 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:37.373766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ebe32-127c-4749-9cab-bc70e357b647 admin admin] PATH_INFO: `/v3/users/8fde6b308a09436390fc2807486f2c1a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:37.376711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ebe32-127c-4749-9cab-bc70e357b647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fde6b308a09436390fc2807486f2c1a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:37.379007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ebe32-127c-4749-9cab-bc70e357b647 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:37.467804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb9dec-6a64-4a72-90e1-24c13e13c6b0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:37.469953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-41eb9dec-6a64-4a72-90e1-24c13e13c6b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:37.494055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb9dec-6a64-4a72-90e1-24c13e13c6b0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:37.509237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01ad75-89a3-4253-875b-1f60a946f1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:37.510973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01ad75-89a3-4253-875b-1f60a946f1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:37.511495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01ad75-89a3-4253-875b-1f60a946f1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:37.511950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01ad75-89a3-4253-875b-1f60a946f1a8 admin admin] PATH_INFO: `/v3/projects/57f5d9b72de745f8a1371bbaa0230212` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:37.512158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-883ebe32-127c-4749-9cab-bc70e357b647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fde6b308a09436390fc2807486f2c1a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:37.514673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01ad75-89a3-4253-875b-1f60a946f1a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f5d9b72de745f8a1371bbaa0230212)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:37.517203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01ad75-89a3-4253-875b-1f60a946f1a8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:37.561239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-883ebe32-127c-4749-9cab-bc70e357b647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fde6b308a09436390fc2807486f2c1a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:37.564643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-883ebe32-127c-4749-9cab-bc70e357b647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fde6b308a09436390fc2807486f2c1a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:37.581795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-883ebe32-127c-4749-9cab-bc70e357b647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fde6b308a09436390fc2807486f2c1a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:37.586355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-883ebe32-127c-4749-9cab-bc70e357b647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fde6b308a09436390fc2807486f2c1a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:37.597687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8c01ad75-89a3-4253-875b-1f60a946f1a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f5d9b72de745f8a1371bbaa0230212', 'request_id': 'req-8c01ad75-89a3-4253-875b-1f60a946f1a8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:37.614843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8c01ad75-89a3-4253-875b-1f60a946f1a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f5d9b72de745f8a1371bbaa0230212', 'request_id': 'req-8c01ad75-89a3-4253-875b-1f60a946f1a8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:37.622500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8c01ad75-89a3-4253-875b-1f60a946f1a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f5d9b72de745f8a1371bbaa0230212', 'request_id': 'req-8c01ad75-89a3-4253-875b-1f60a946f1a8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:37.623325 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3326/6605] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:37 2022] DELETE /identity/v3/users/8fde6b308a09436390fc2807486f2c1a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:37.643689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8c01ad75-89a3-4253-875b-1f60a946f1a8 admin admin] The token cache is being invalidate because project 57f5d9b72de745f8a1371bbaa0230212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:37.643985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8c01ad75-89a3-4253-875b-1f60a946f1a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:37.644804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8c01ad75-89a3-4253-875b-1f60a946f1a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:37.649778 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3280/6606] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:37 2022] DELETE /identity/v3/projects/57f5d9b72de745f8a1371bbaa0230212 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:27:37.652926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ebe32-127c-4749-9cab-bc70e357b647 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:37.657107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-883ebe32-127c-4749-9cab-bc70e357b647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:37.678257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:37.846754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ebe32-127c-4749-9cab-bc70e357b647 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:37.860231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001231f-bba0-4675-af9c-f4325e955def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:37.860602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001231f-bba0-4675-af9c-f4325e955def admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:37.860847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001231f-bba0-4675-af9c-f4325e955def admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:37.861143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001231f-bba0-4675-af9c-f4325e955def admin admin] PATH_INFO: `/v3/users/a90fd14f0cf34e148935f79cf381f903` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:37.862506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001231f-bba0-4675-af9c-f4325e955def admin admin] RBAC: Authorizing `identity:delete_user(user_id=a90fd14f0cf34e148935f79cf381f903)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:37.864478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001231f-bba0-4675-af9c-f4325e955def admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:37.977885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5001231f-bba0-4675-af9c-f4325e955def admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90fd14f0cf34e148935f79cf381f903'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:38.011387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5001231f-bba0-4675-af9c-f4325e955def admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90fd14f0cf34e148935f79cf381f903'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:38.011387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5001231f-bba0-4675-af9c-f4325e955def admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90fd14f0cf34e148935f79cf381f903'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:38.021148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5001231f-bba0-4675-af9c-f4325e955def admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90fd14f0cf34e148935f79cf381f903'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:38.022690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5001231f-bba0-4675-af9c-f4325e955def admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90fd14f0cf34e148935f79cf381f903'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:38.054059 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3327/6607] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:37 2022] DELETE /identity/v3/users/a90fd14f0cf34e148935f79cf381f903 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:38.921111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01ad75-89a3-4253-875b-1f60a946f1a8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:38.922651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8c01ad75-89a3-4253-875b-1f60a946f1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:39.051548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01ad75-89a3-4253-875b-1f60a946f1a8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:39.143990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:39.150368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19a175-ba7b-42ed-93a0-b951b2abfd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:39.151150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19a175-ba7b-42ed-93a0-b951b2abfd27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:39.151564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19a175-ba7b-42ed-93a0-b951b2abfd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:39.152027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19a175-ba7b-42ed-93a0-b951b2abfd27 admin admin] PATH_INFO: `/v3/projects/fd1f43858dc54be2b93eae8ca90cea0e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:39.154723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19a175-ba7b-42ed-93a0-b951b2abfd27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd1f43858dc54be2b93eae8ca90cea0e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:39.158061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19a175-ba7b-42ed-93a0-b951b2abfd27 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:39.204955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001231f-bba0-4675-af9c-f4325e955def admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:39.207037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5001231f-bba0-4675-af9c-f4325e955def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:39.235247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001231f-bba0-4675-af9c-f4325e955def admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:39.256833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3d19a175-ba7b-42ed-93a0-b951b2abfd27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd1f43858dc54be2b93eae8ca90cea0e', 'request_id': 'req-3d19a175-ba7b-42ed-93a0-b951b2abfd27'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:39.278521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3d19a175-ba7b-42ed-93a0-b951b2abfd27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd1f43858dc54be2b93eae8ca90cea0e', 'request_id': 'req-3d19a175-ba7b-42ed-93a0-b951b2abfd27'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:39.291681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3d19a175-ba7b-42ed-93a0-b951b2abfd27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd1f43858dc54be2b93eae8ca90cea0e', 'request_id': 'req-3d19a175-ba7b-42ed-93a0-b951b2abfd27'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:39.315659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3d19a175-ba7b-42ed-93a0-b951b2abfd27 admin admin] The token cache is being invalidate because project fd1f43858dc54be2b93eae8ca90cea0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:39.316240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3d19a175-ba7b-42ed-93a0-b951b2abfd27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:39.318618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3d19a175-ba7b-42ed-93a0-b951b2abfd27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:39.321626 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3281/6608] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:38 2022] DELETE /identity/v3/projects/fd1f43858dc54be2b93eae8ca90cea0e => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:39.326447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f7e9d-3ad0-4b98-b5c9-4da7af8e8ee8 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:39.326888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f7e9d-3ad0-4b98-b5c9-4da7af8e8ee8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:39.327181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f7e9d-3ad0-4b98-b5c9-4da7af8e8ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:39.379107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b32f7e9d-3ad0-4b98-b5c9-4da7af8e8ee8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:39.385324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b594df-1add-42e1-8598-be0cf0116de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:39.386483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b594df-1add-42e1-8598-be0cf0116de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:39.387102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b594df-1add-42e1-8598-be0cf0116de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:39.388325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b594df-1add-42e1-8598-be0cf0116de6 admin admin] PATH_INFO: `/v3/projects/6ef7b4a99dfd4b92a73c3dbc9f03cd91` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:39.391377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b594df-1add-42e1-8598-be0cf0116de6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef7b4a99dfd4b92a73c3dbc9f03cd91)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:39.394910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b594df-1add-42e1-8598-be0cf0116de6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:39.405008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b32f7e9d-3ad0-4b98-b5c9-4da7af8e8ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:39.454482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:39.454921 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3282/6609] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:39.459041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f7e9d-3ad0-4b98-b5c9-4da7af8e8ee8 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:39.465913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b32f7e9d-3ad0-4b98-b5c9-4da7af8e8ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:39.505090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-29b594df-1add-42e1-8598-be0cf0116de6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef7b4a99dfd4b92a73c3dbc9f03cd91', 'request_id': 'req-29b594df-1add-42e1-8598-be0cf0116de6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:39.510326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f7e9d-3ad0-4b98-b5c9-4da7af8e8ee8 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:39.533549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-29b594df-1add-42e1-8598-be0cf0116de6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef7b4a99dfd4b92a73c3dbc9f03cd91', 'request_id': 'req-29b594df-1add-42e1-8598-be0cf0116de6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:39.556639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-29b594df-1add-42e1-8598-be0cf0116de6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef7b4a99dfd4b92a73c3dbc9f03cd91', 'request_id': 'req-29b594df-1add-42e1-8598-be0cf0116de6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:39.577412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-29b594df-1add-42e1-8598-be0cf0116de6 admin admin] The token cache is being invalidate because project 6ef7b4a99dfd4b92a73c3dbc9f03cd91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:39.579065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-29b594df-1add-42e1-8598-be0cf0116de6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:39.580677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-29b594df-1add-42e1-8598-be0cf0116de6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:39.583366 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3328/6610] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:39 2022] DELETE /identity/v3/projects/6ef7b4a99dfd4b92a73c3dbc9f03cd91 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:27:39.585195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634ad88-0e8e-4cb9-83a8-1fe7d26c0410 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:39.585725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634ad88-0e8e-4cb9-83a8-1fe7d26c0410 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:39.586260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634ad88-0e8e-4cb9-83a8-1fe7d26c0410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:39.615782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-6634ad88-0e8e-4cb9-83a8-1fe7d26c0410 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:39.618065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6634ad88-0e8e-4cb9-83a8-1fe7d26c0410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:39.642105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d0a7d-1d5b-4aad-b1f8-edb231eecb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:39.642769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d0a7d-1d5b-4aad-b1f8-edb231eecb0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:39.643061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d0a7d-1d5b-4aad-b1f8-edb231eecb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:39.643371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d0a7d-1d5b-4aad-b1f8-edb231eecb0d admin admin] PATH_INFO: `/v3/projects/b34dfc7a054c4ef6881e0c5e629d9c30` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:39.646729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d0a7d-1d5b-4aad-b1f8-edb231eecb0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b34dfc7a054c4ef6881e0c5e629d9c30)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:39.648643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d0a7d-1d5b-4aad-b1f8-edb231eecb0d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:39.784369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c61d0a7d-1d5b-4aad-b1f8-edb231eecb0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b34dfc7a054c4ef6881e0c5e629d9c30', 'request_id': 'req-c61d0a7d-1d5b-4aad-b1f8-edb231eecb0d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:39.802666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c61d0a7d-1d5b-4aad-b1f8-edb231eecb0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b34dfc7a054c4ef6881e0c5e629d9c30', 'request_id': 'req-c61d0a7d-1d5b-4aad-b1f8-edb231eecb0d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:39.813802 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3329/6611] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:39.816755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c61d0a7d-1d5b-4aad-b1f8-edb231eecb0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b34dfc7a054c4ef6881e0c5e629d9c30', 'request_id': 'req-c61d0a7d-1d5b-4aad-b1f8-edb231eecb0d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:39.820504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5916c-07af-4577-9c82-b716110750f5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:39.820838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5916c-07af-4577-9c82-b716110750f5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:39.821122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5916c-07af-4577-9c82-b716110750f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:39.857927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c61d0a7d-1d5b-4aad-b1f8-edb231eecb0d admin admin] The token cache is being invalidate because project b34dfc7a054c4ef6881e0c5e629d9c30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:39.858239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c61d0a7d-1d5b-4aad-b1f8-edb231eecb0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:39.860245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c61d0a7d-1d5b-4aad-b1f8-edb231eecb0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:39.864599 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3283/6612] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:39 2022] DELETE /identity/v3/projects/b34dfc7a054c4ef6881e0c5e629d9c30 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:39.865248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d0a7d-1d5b-4aad-b1f8-edb231eecb0d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:39.874205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c61d0a7d-1d5b-4aad-b1f8-edb231eecb0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:39.887111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-83a5916c-07af-4577-9c82-b716110750f5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:39.888389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-83a5916c-07af-4577-9c82-b716110750f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:39.924692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:40.079869 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3330/6613] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:40.081071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5916c-07af-4577-9c82-b716110750f5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:40.088759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-83a5916c-07af-4577-9c82-b716110750f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:40.093453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d0a7d-1d5b-4aad-b1f8-edb231eecb0d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:40.100320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a634704-de62-4cb1-b7f2-2a285cdd6b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:40.100973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a634704-de62-4cb1-b7f2-2a285cdd6b5a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:40.101264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a634704-de62-4cb1-b7f2-2a285cdd6b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:40.101548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a634704-de62-4cb1-b7f2-2a285cdd6b5a admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:40.103010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a634704-de62-4cb1-b7f2-2a285cdd6b5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:27:40.103836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a634704-de62-4cb1-b7f2-2a285cdd6b5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:40.106705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a634704-de62-4cb1-b7f2-2a285cdd6b5a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:40.116830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5916c-07af-4577-9c82-b716110750f5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:40.129189 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3284/6614] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:27:40.131383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb18100-342e-4577-b88d-2ef2979a89a8 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:40.131691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb18100-342e-4577-b88d-2ef2979a89a8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:40.131979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb18100-342e-4577-b88d-2ef2979a89a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:40.134727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ab65c-96b0-4cf9-bdb6-7b7e5c30a46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:40.135437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ab65c-96b0-4cf9-bdb6-7b7e5c30a46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:40.135719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ab65c-96b0-4cf9-bdb6-7b7e5c30a46f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:40.135990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ab65c-96b0-4cf9-bdb6-7b7e5c30a46f admin admin] PATH_INFO: `/v3/users/7ac175a73f92491eb68cdd26470b34ce` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:40.141960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ab65c-96b0-4cf9-bdb6-7b7e5c30a46f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac175a73f92491eb68cdd26470b34ce)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:40.143999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ab65c-96b0-4cf9-bdb6-7b7e5c30a46f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:40.156435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0eb18100-342e-4577-b88d-2ef2979a89a8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:40.158277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0eb18100-342e-4577-b88d-2ef2979a89a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:40.171156 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3285/6615] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:40.171156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb18100-342e-4577-b88d-2ef2979a89a8 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:40.182115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb18100-342e-4577-b88d-2ef2979a89a8 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:40.187103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790797f2-78dc-4e4e-a877-63b368fe1f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:40.187876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790797f2-78dc-4e4e-a877-63b368fe1f81 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:40.188224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790797f2-78dc-4e4e-a877-63b368fe1f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:40.188511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790797f2-78dc-4e4e-a877-63b368fe1f81 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:40.189190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790797f2-78dc-4e4e-a877-63b368fe1f81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:40.191134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790797f2-78dc-4e4e-a877-63b368fe1f81 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:40.238201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-337ab65c-96b0-4cf9-bdb6-7b7e5c30a46f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac175a73f92491eb68cdd26470b34ce'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:40.241451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:40.250888 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3286/6616] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:40 2022] POST /identity/v3/projects => generated 387 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:40.252596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790797f2-78dc-4e4e-a877-63b368fe1f81 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:40.270194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-337ab65c-96b0-4cf9-bdb6-7b7e5c30a46f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac175a73f92491eb68cdd26470b34ce'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:40.271741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-337ab65c-96b0-4cf9-bdb6-7b7e5c30a46f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac175a73f92491eb68cdd26470b34ce'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:40.289540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-337ab65c-96b0-4cf9-bdb6-7b7e5c30a46f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac175a73f92491eb68cdd26470b34ce'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:40.290430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-337ab65c-96b0-4cf9-bdb6-7b7e5c30a46f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac175a73f92491eb68cdd26470b34ce'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:40.323178 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3331/6617] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:40 2022] DELETE /identity/v3/users/7ac175a73f92491eb68cdd26470b34ce => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:40.323178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ab65c-96b0-4cf9-bdb6-7b7e5c30a46f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:40.324603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-337ab65c-96b0-4cf9-bdb6-7b7e5c30a46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:40.381780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790797f2-78dc-4e4e-a877-63b368fe1f81 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:40.458191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ab65c-96b0-4cf9-bdb6-7b7e5c30a46f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:40.470902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e8cb5-1aad-41e2-a3b5-7d69d2010a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:40.471702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e8cb5-1aad-41e2-a3b5-7d69d2010a22 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:40.472091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e8cb5-1aad-41e2-a3b5-7d69d2010a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:40.472472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e8cb5-1aad-41e2-a3b5-7d69d2010a22 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:40.473763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e8cb5-1aad-41e2-a3b5-7d69d2010a22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:40.476442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e8cb5-1aad-41e2-a3b5-7d69d2010a22 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:40.514706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9769ce5-0541-4e31-9862-1a34371d6c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:40.515383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9769ce5-0541-4e31-9862-1a34371d6c8d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:40.515676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9769ce5-0541-4e31-9862-1a34371d6c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:40.516582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9769ce5-0541-4e31-9862-1a34371d6c8d admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:40.517303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9769ce5-0541-4e31-9862-1a34371d6c8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:27:40.517613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9769ce5-0541-4e31-9862-1a34371d6c8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:40.519475 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3332/6618] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:40 2022] POST /identity/v3/users => generated 294 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:40.521609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9769ce5-0541-4e31-9862-1a34371d6c8d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:40.524727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e8cb5-1aad-41e2-a3b5-7d69d2010a22 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:40.542226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e8cb5-1aad-41e2-a3b5-7d69d2010a22 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:40.548100 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3287/6619] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:27:40.549271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9769ce5-0541-4e31-9862-1a34371d6c8d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:40.561083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f9769ce5-0541-4e31-9862-1a34371d6c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:40.564800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1723424-8580-4489-aebe-27f352cb2dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:40.566084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1723424-8580-4489-aebe-27f352cb2dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:40.566643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1723424-8580-4489-aebe-27f352cb2dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:40.567150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1723424-8580-4489-aebe-27f352cb2dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:40.568111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1723424-8580-4489-aebe-27f352cb2dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:40.570437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1723424-8580-4489-aebe-27f352cb2dd9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:40.595402 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3333/6620] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:40.600170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1723424-8580-4489-aebe-27f352cb2dd9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:40.601060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9769ce5-0541-4e31-9862-1a34371d6c8d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:40.611941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c34b2a-8c75-4ca6-bf42-0a4f880247be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:40.613814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c34b2a-8c75-4ca6-bf42-0a4f880247be admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:40.614342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c34b2a-8c75-4ca6-bf42-0a4f880247be admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:40.614968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c34b2a-8c75-4ca6-bf42-0a4f880247be admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:40.615537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1723424-8580-4489-aebe-27f352cb2dd9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:40.616152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c34b2a-8c75-4ca6-bf42-0a4f880247be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:40.621267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb5e9a-1776-4df8-a398-ff59c5c94575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:40.621853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c34b2a-8c75-4ca6-bf42-0a4f880247be admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:40.622631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb5e9a-1776-4df8-a398-ff59c5c94575 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:40.623757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb5e9a-1776-4df8-a398-ff59c5c94575 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:40.624070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb5e9a-1776-4df8-a398-ff59c5c94575 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:40.625951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb5e9a-1776-4df8-a398-ff59c5c94575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:40.628500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb5e9a-1776-4df8-a398-ff59c5c94575 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:40.648794 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3334/6621] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:40.649567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:40.650036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb5e9a-1776-4df8-a398-ff59c5c94575 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:40.672462 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3288/6622] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:40 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:40.675871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c34b2a-8c75-4ca6-bf42-0a4f880247be admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:40.716931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb5e9a-1776-4df8-a398-ff59c5c94575 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:40.828795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c34b2a-8c75-4ca6-bf42-0a4f880247be admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:40.845393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3238c8-b706-41de-83aa-c1ca3c6f895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:40.846686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3238c8-b706-41de-83aa-c1ca3c6f895d admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:40.847698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3238c8-b706-41de-83aa-c1ca3c6f895d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:40.847942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3238c8-b706-41de-83aa-c1ca3c6f895d admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:40.850519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3238c8-b706-41de-83aa-c1ca3c6f895d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:40.856569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3238c8-b706-41de-83aa-c1ca3c6f895d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:40.870276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f51cb-3342-49eb-9ee0-8343323e0ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:40.871000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f51cb-3342-49eb-9ee0-8343323e0ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:40.871373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f51cb-3342-49eb-9ee0-8343323e0ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:40.871671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f51cb-3342-49eb-9ee0-8343323e0ff3 admin admin] PATH_INFO: `/v3/projects/9d885957288749e1b4026f0f426f9588/users/5387c687bff74fc5a2ad0bd6e2badd51/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:40.892006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f51cb-3342-49eb-9ee0-8343323e0ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d885957288749e1b4026f0f426f9588, user_id=5387c687bff74fc5a2ad0bd6e2badd51, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:40.895171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f51cb-3342-49eb-9ee0-8343323e0ff3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:40.896329 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3289/6623] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:40 2022] POST /identity/v3/users => generated 283 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:40.897530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3238c8-b706-41de-83aa-c1ca3c6f895d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:40.909744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3238c8-b706-41de-83aa-c1ca3c6f895d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:40.915655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9b032-3edc-49e2-a8f5-cb373fe4092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:40.916641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9b032-3edc-49e2-a8f5-cb373fe4092a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:40.917075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9b032-3edc-49e2-a8f5-cb373fe4092a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:40.917661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9b032-3edc-49e2-a8f5-cb373fe4092a admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:40.918548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9b032-3edc-49e2-a8f5-cb373fe4092a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:40.920311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9b032-3edc-49e2-a8f5-cb373fe4092a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:40.944915 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3290/6624] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:40.948366 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3335/6625] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:40 2022] PUT /identity/v3/projects/9d885957288749e1b4026f0f426f9588/users/5387c687bff74fc5a2ad0bd6e2badd51/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:40.949601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9b032-3edc-49e2-a8f5-cb373fe4092a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:40.950124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f51cb-3342-49eb-9ee0-8343323e0ff3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:40.952825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f5c9b032-3edc-49e2-a8f5-cb373fe4092a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:40.967490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9b032-3edc-49e2-a8f5-cb373fe4092a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:41.006972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:41.084772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267161fb-e7b5-4eae-b5b7-6bce3812d3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:41.085481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267161fb-e7b5-4eae-b5b7-6bce3812d3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:41.085707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267161fb-e7b5-4eae-b5b7-6bce3812d3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:41.086071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267161fb-e7b5-4eae-b5b7-6bce3812d3b0 admin admin] PATH_INFO: `/v3/projects/1c959d507e6a482a828fe588f81f8faf` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:41.087539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267161fb-e7b5-4eae-b5b7-6bce3812d3b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c959d507e6a482a828fe588f81f8faf)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:41.089711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267161fb-e7b5-4eae-b5b7-6bce3812d3b0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:41.102190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f51cb-3342-49eb-9ee0-8343323e0ff3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:41.112743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289483c-6497-4b6d-9706-9cc910875d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:41.115710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289483c-6497-4b6d-9706-9cc910875d2a admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:41.116393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289483c-6497-4b6d-9706-9cc910875d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:41.116888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289483c-6497-4b6d-9706-9cc910875d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:41.117987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289483c-6497-4b6d-9706-9cc910875d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:41.119857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289483c-6497-4b6d-9706-9cc910875d2a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:41.136788 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3336/6626] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:41.138960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c25db-a911-48d6-990a-8d738c479be8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:41.139514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c25db-a911-48d6-990a-8d738c479be8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:41.140211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c25db-a911-48d6-990a-8d738c479be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:41.168954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-267161fb-e7b5-4eae-b5b7-6bce3812d3b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c959d507e6a482a828fe588f81f8faf', 'request_id': 'req-267161fb-e7b5-4eae-b5b7-6bce3812d3b0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:41.178112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4e3c25db-a911-48d6-990a-8d738c479be8 None None] MFA Rules not processed for user `5387c687bff74fc5a2ad0bd6e2badd51`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:41.179826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4e3c25db-a911-48d6-990a-8d738c479be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:41.180320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-267161fb-e7b5-4eae-b5b7-6bce3812d3b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c959d507e6a482a828fe588f81f8faf', 'request_id': 'req-267161fb-e7b5-4eae-b5b7-6bce3812d3b0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:41.195851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-267161fb-e7b5-4eae-b5b7-6bce3812d3b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c959d507e6a482a828fe588f81f8faf', 'request_id': 'req-267161fb-e7b5-4eae-b5b7-6bce3812d3b0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:41.220817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-267161fb-e7b5-4eae-b5b7-6bce3812d3b0 admin admin] The token cache is being invalidate because project 1c959d507e6a482a828fe588f81f8faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:41.223326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-267161fb-e7b5-4eae-b5b7-6bce3812d3b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:41.224096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-267161fb-e7b5-4eae-b5b7-6bce3812d3b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:41.226032 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3291/6627] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:40 2022] DELETE /identity/v3/projects/1c959d507e6a482a828fe588f81f8faf => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:41.226490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267161fb-e7b5-4eae-b5b7-6bce3812d3b0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:41.228077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-267161fb-e7b5-4eae-b5b7-6bce3812d3b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:41.239138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:41.303532 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3337/6628] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:41.310833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2391fe9-dc03-4653-9d2c-b751b53bba8d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:41.311174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2391fe9-dc03-4653-9d2c-b751b53bba8d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:41.311574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2391fe9-dc03-4653-9d2c-b751b53bba8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:41.348097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b2391fe9-dc03-4653-9d2c-b751b53bba8d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:41.351069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b2391fe9-dc03-4653-9d2c-b751b53bba8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:41.383421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267161fb-e7b5-4eae-b5b7-6bce3812d3b0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:41.403659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c17473-fb88-45df-89da-fb5bb556d862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:41.404471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c17473-fb88-45df-89da-fb5bb556d862 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:41.404828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c17473-fb88-45df-89da-fb5bb556d862 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:41.405183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c17473-fb88-45df-89da-fb5bb556d862 admin admin] PATH_INFO: `/v3/projects/69b803953acf4ad49e49823a021aff46/users/93361ffb454d4fb9bccfea7a0e6daf23/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:41.432877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c17473-fb88-45df-89da-fb5bb556d862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b803953acf4ad49e49823a021aff46, user_id=93361ffb454d4fb9bccfea7a0e6daf23, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:41.436772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c17473-fb88-45df-89da-fb5bb556d862 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:41.474066 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3292/6629] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:41 2022] PUT /identity/v3/projects/69b803953acf4ad49e49823a021aff46/users/93361ffb454d4fb9bccfea7a0e6daf23/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:41.475668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187111dc-984d-4649-ac56-0137dd6b7f7b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:41.475968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187111dc-984d-4649-ac56-0137dd6b7f7b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:41.476247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187111dc-984d-4649-ac56-0137dd6b7f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:41.477316 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3338/6630] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:41.478272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2391fe9-dc03-4653-9d2c-b751b53bba8d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:41.481986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b2391fe9-dc03-4653-9d2c-b751b53bba8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:41.506039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2391fe9-dc03-4653-9d2c-b751b53bba8d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:41.537286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-187111dc-984d-4649-ac56-0137dd6b7f7b None None] MFA Rules not processed for user `c5b99eba81444a7b9cc59e73898c65af`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:41.539895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-187111dc-984d-4649-ac56-0137dd6b7f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:41.561226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:41.581681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf4e30-518f-4f62-9b35-6e746be5ae5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:41.582979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf4e30-518f-4f62-9b35-6e746be5ae5c admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:41.583499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf4e30-518f-4f62-9b35-6e746be5ae5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:41.583858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf4e30-518f-4f62-9b35-6e746be5ae5c admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:41.585128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf4e30-518f-4f62-9b35-6e746be5ae5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:41.587665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf4e30-518f-4f62-9b35-6e746be5ae5c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:41.645304 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3339/6631] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:41 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:41.649515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b74f7-785a-4bfd-8c84-ad80eca43fc7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:41.650062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b74f7-785a-4bfd-8c84-ad80eca43fc7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:41.650817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b74f7-785a-4bfd-8c84-ad80eca43fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:41.681052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-289b74f7-785a-4bfd-8c84-ad80eca43fc7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:41.682302 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3293/6632] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:41.682505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-289b74f7-785a-4bfd-8c84-ad80eca43fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:41.684195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0949b-1e98-483e-9763-b9a7ea5c67be None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:41.684711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0949b-1e98-483e-9763-b9a7ea5c67be None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:41.685618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0949b-1e98-483e-9763-b9a7ea5c67be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:41.731172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3ad0949b-1e98-483e-9763-b9a7ea5c67be None None] MFA Rules not processed for user `93361ffb454d4fb9bccfea7a0e6daf23`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:41.732589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3ad0949b-1e98-483e-9763-b9a7ea5c67be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:41.822865 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3340/6633] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:41.823888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b74f7-785a-4bfd-8c84-ad80eca43fc7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:41.839052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b74f7-785a-4bfd-8c84-ad80eca43fc7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:41.845944 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3294/6634] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:41.850123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce785a-9635-4bc5-808a-a83138082763 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:41.850543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce785a-9635-4bc5-808a-a83138082763 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:41.850930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce785a-9635-4bc5-808a-a83138082763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:41.859320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccca991-08d6-4c29-89ef-b76868e4549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:41.860124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccca991-08d6-4c29-89ef-b76868e4549d admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:41.860425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccca991-08d6-4c29-89ef-b76868e4549d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:41.860858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccca991-08d6-4c29-89ef-b76868e4549d admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:41.861381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccca991-08d6-4c29-89ef-b76868e4549d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:41.863718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccca991-08d6-4c29-89ef-b76868e4549d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:41.873672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:41.894610 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3341/6635] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:41 2022] POST /identity/v3/users => generated 293 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:41.896064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccca991-08d6-4c29-89ef-b76868e4549d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:41.901503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-93ce785a-9635-4bc5-808a-a83138082763 None None] MFA Rules not processed for user `c5b99eba81444a7b9cc59e73898c65af`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:41.902762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-93ce785a-9635-4bc5-808a-a83138082763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:41.910203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccca991-08d6-4c29-89ef-b76868e4549d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:41.917018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0884fe5-b3e7-4395-9567-d19708543eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:41.918918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0884fe5-b3e7-4395-9567-d19708543eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:41.919468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0884fe5-b3e7-4395-9567-d19708543eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:41.919973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0884fe5-b3e7-4395-9567-d19708543eb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:41.921121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0884fe5-b3e7-4395-9567-d19708543eb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:27:41.921640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0884fe5-b3e7-4395-9567-d19708543eb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:41.923808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0884fe5-b3e7-4395-9567-d19708543eb1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:41.944708 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3342/6636] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:27:41.946007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0884fe5-b3e7-4395-9567-d19708543eb1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:41.948102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e0884fe5-b3e7-4395-9567-d19708543eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:42.004275 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3295/6637] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:42.008426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce785a-9635-4bc5-808a-a83138082763 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:42.031626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce785a-9635-4bc5-808a-a83138082763 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:42.047612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6a163-1433-4434-a600-7e241e4c0d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:42.048498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6a163-1433-4434-a600-7e241e4c0d03 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:42.048945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6a163-1433-4434-a600-7e241e4c0d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:42.049294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6a163-1433-4434-a600-7e241e4c0d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:42.051271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6a163-1433-4434-a600-7e241e4c0d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:42.054738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6a163-1433-4434-a600-7e241e4c0d03 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:42.080443 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3296/6638] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:42.081990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0884fe5-b3e7-4395-9567-d19708543eb1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:42.082901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6a163-1433-4434-a600-7e241e4c0d03 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:42.086530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7353c6b-89eb-43a7-a615-b11dab70565a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:42.087415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7353c6b-89eb-43a7-a615-b11dab70565a service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:42.087842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7353c6b-89eb-43a7-a615-b11dab70565a service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:42.088295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7353c6b-89eb-43a7-a615-b11dab70565a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:42.099700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7353c6b-89eb-43a7-a615-b11dab70565a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:42.101615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7353c6b-89eb-43a7-a615-b11dab70565a service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:42.106872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6a163-1433-4434-a600-7e241e4c0d03 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:42.136089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040e142-4878-4548-84ea-d18f1796ac58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:42.143033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040e142-4878-4548-84ea-d18f1796ac58 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:42.144206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040e142-4878-4548-84ea-d18f1796ac58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:42.145860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040e142-4878-4548-84ea-d18f1796ac58 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:42.146814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040e142-4878-4548-84ea-d18f1796ac58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:42.153757 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3343/6639] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:42.154675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040e142-4878-4548-84ea-d18f1796ac58 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:42.155353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7353c6b-89eb-43a7-a615-b11dab70565a service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:42.172777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f7353c6b-89eb-43a7-a615-b11dab70565a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:42.231698 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3297/6640] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:42 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:42.231698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040e142-4878-4548-84ea-d18f1796ac58 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:42.246756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:42.296702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7353c6b-89eb-43a7-a615-b11dab70565a service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:42.397380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040e142-4878-4548-84ea-d18f1796ac58 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:42.407651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a62ab-043b-4003-8ac1-2e92ff1ab4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:42.413888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a62ab-043b-4003-8ac1-2e92ff1ab4ae admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:42.414695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a62ab-043b-4003-8ac1-2e92ff1ab4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:42.415831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a62ab-043b-4003-8ac1-2e92ff1ab4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:42.417366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380cc60-fae3-4187-b75c-71f4b55a5775 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:42.418186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a62ab-043b-4003-8ac1-2e92ff1ab4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:42.419560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380cc60-fae3-4187-b75c-71f4b55a5775 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:42.419952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380cc60-fae3-4187-b75c-71f4b55a5775 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:42.421654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380cc60-fae3-4187-b75c-71f4b55a5775 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:42.423099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a62ab-043b-4003-8ac1-2e92ff1ab4ae admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:42.449068 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3298/6641] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:42.452608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a62ab-043b-4003-8ac1-2e92ff1ab4ae admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:42.483022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a62ab-043b-4003-8ac1-2e92ff1ab4ae admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:42.498335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fa4f0-c891-4549-b7bc-fee4069661d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:42.499555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fa4f0-c891-4549-b7bc-fee4069661d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:42.500211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fa4f0-c891-4549-b7bc-fee4069661d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:42.501383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fa4f0-c891-4549-b7bc-fee4069661d6 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:42.502523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fa4f0-c891-4549-b7bc-fee4069661d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:42.505616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fa4f0-c891-4549-b7bc-fee4069661d6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:42.541625 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3299/6642] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:42 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:42.542654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fa4f0-c891-4549-b7bc-fee4069661d6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:42.566352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fa4f0-c891-4549-b7bc-fee4069661d6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:42.587654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31684b3e-8977-484e-b4b5-58e8d330528c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:42.588486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31684b3e-8977-484e-b4b5-58e8d330528c admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:42.589054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31684b3e-8977-484e-b4b5-58e8d330528c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:42.589441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31684b3e-8977-484e-b4b5-58e8d330528c admin admin] PATH_INFO: `/v3/projects/a63757e09f1e42818f0642f9bdada709/users/32ddb963d74c4afe968cc4434bc96339/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:42.596630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380cc60-fae3-4187-b75c-71f4b55a5775 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:42.599253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380cc60-fae3-4187-b75c-71f4b55a5775 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:42.627634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31684b3e-8977-484e-b4b5-58e8d330528c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63757e09f1e42818f0642f9bdada709, user_id=32ddb963d74c4afe968cc4434bc96339, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:42.629848 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3344/6643] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:42.631306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380cc60-fae3-4187-b75c-71f4b55a5775 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:42.632425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31684b3e-8977-484e-b4b5-58e8d330528c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:42.657721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380cc60-fae3-4187-b75c-71f4b55a5775 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:42.677727 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3300/6644] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:42 2022] PUT /identity/v3/projects/a63757e09f1e42818f0642f9bdada709/users/32ddb963d74c4afe968cc4434bc96339/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:42.679271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4ddae-8ee9-486e-abf5-489a5d98df5a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:42.679592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4ddae-8ee9-486e-abf5-489a5d98df5a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:42.679881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4ddae-8ee9-486e-abf5-489a5d98df5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:42.812416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-56f4ddae-8ee9-486e-abf5-489a5d98df5a None None] MFA Rules not processed for user `32ddb963d74c4afe968cc4434bc96339`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:42.838118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-56f4ddae-8ee9-486e-abf5-489a5d98df5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:42.873294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552eaf91-b0d4-4940-9031-49bc3aefcfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:42.873982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eaf91-b0d4-4940-9031-49bc3aefcfb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:42.874272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eaf91-b0d4-4940-9031-49bc3aefcfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:42.874550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eaf91-b0d4-4940-9031-49bc3aefcfb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:42.875942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552eaf91-b0d4-4940-9031-49bc3aefcfb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:42.881481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552eaf91-b0d4-4940-9031-49bc3aefcfb8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:42.899665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:42.907767 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3345/6645] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:42.911505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552eaf91-b0d4-4940-9031-49bc3aefcfb8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:42.929389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552eaf91-b0d4-4940-9031-49bc3aefcfb8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:42.942905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70607934-92af-4212-96b7-4dbd75f8f2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:42.944296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70607934-92af-4212-96b7-4dbd75f8f2de admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:42.944296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70607934-92af-4212-96b7-4dbd75f8f2de admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:42.944296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70607934-92af-4212-96b7-4dbd75f8f2de admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:42.944825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70607934-92af-4212-96b7-4dbd75f8f2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:42.946598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70607934-92af-4212-96b7-4dbd75f8f2de admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:42.976398 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3346/6646] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:27:42.977588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70607934-92af-4212-96b7-4dbd75f8f2de admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:42.988576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:42.999629 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3301/6647] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:43.001386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4ddae-8ee9-486e-abf5-489a5d98df5a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:43.007693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70607934-92af-4212-96b7-4dbd75f8f2de admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:43.022764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86668374-e583-4161-ad90-a9cfe64a45c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:43.023493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86668374-e583-4161-ad90-a9cfe64a45c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:43.023798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86668374-e583-4161-ad90-a9cfe64a45c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:43.024059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86668374-e583-4161-ad90-a9cfe64a45c9 admin admin] PATH_INFO: `/v3/projects/ac185b2f86cb4c9aa7702b2bdbe8e0ac/users/55e28c2994fe438d91c033e1e92a3077/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:43.033461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4ddae-8ee9-486e-abf5-489a5d98df5a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:43.040928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f30ca-28fb-4957-93bf-fab6e07181d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:43.041778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f30ca-28fb-4957-93bf-fab6e07181d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:43.053383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f30ca-28fb-4957-93bf-fab6e07181d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:43.055358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f30ca-28fb-4957-93bf-fab6e07181d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:43.056268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f30ca-28fb-4957-93bf-fab6e07181d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:43.063322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86668374-e583-4161-ad90-a9cfe64a45c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac185b2f86cb4c9aa7702b2bdbe8e0ac, user_id=55e28c2994fe438d91c033e1e92a3077, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:43.065790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f30ca-28fb-4957-93bf-fab6e07181d4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:43.066289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86668374-e583-4161-ad90-a9cfe64a45c9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:43.113357 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3347/6648] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:42 2022] PUT /identity/v3/projects/ac185b2f86cb4c9aa7702b2bdbe8e0ac/users/55e28c2994fe438d91c033e1e92a3077/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:27:43.115773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4980853-2af7-4dd3-93a4-f8f8dc9c5d9a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:43.116227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4980853-2af7-4dd3-93a4-f8f8dc9c5d9a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:43.116664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4980853-2af7-4dd3-93a4-f8f8dc9c5d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:43.157522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d4980853-2af7-4dd3-93a4-f8f8dc9c5d9a None None] MFA Rules not processed for user `55e28c2994fe438d91c033e1e92a3077`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:43.159959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d4980853-2af7-4dd3-93a4-f8f8dc9c5d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:43.183222 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3302/6649] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:42 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:43.186106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f30ca-28fb-4957-93bf-fab6e07181d4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:43.299026 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3348/6650] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:43.300750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4980853-2af7-4dd3-93a4-f8f8dc9c5d9a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:43.373115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f30ca-28fb-4957-93bf-fab6e07181d4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:43.384744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ae899-a0ac-4d94-85bb-b36474ddce00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:43.385796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ae899-a0ac-4d94-85bb-b36474ddce00 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:43.385796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ae899-a0ac-4d94-85bb-b36474ddce00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:43.385998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ae899-a0ac-4d94-85bb-b36474ddce00 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:43.386585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ae899-a0ac-4d94-85bb-b36474ddce00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:43.388795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ae899-a0ac-4d94-85bb-b36474ddce00 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:43.441025 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3303/6651] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:43 2022] POST /identity/v3/users => generated 300 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:43.445417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ae899-a0ac-4d94-85bb-b36474ddce00 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:43.470354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ae899-a0ac-4d94-85bb-b36474ddce00 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:43.475694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbcd92-07a0-4a44-9072-da9756189ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:43.476337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbcd92-07a0-4a44-9072-da9756189ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:43.476623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbcd92-07a0-4a44-9072-da9756189ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:43.476900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbcd92-07a0-4a44-9072-da9756189ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:43.477606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbcd92-07a0-4a44-9072-da9756189ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:43.478463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4980853-2af7-4dd3-93a4-f8f8dc9c5d9a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:43.479511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbcd92-07a0-4a44-9072-da9756189ef6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:43.490105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6469b-2587-4647-9288-e4654e6c87de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:43.491681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6469b-2587-4647-9288-e4654e6c87de admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:43.492421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6469b-2587-4647-9288-e4654e6c87de admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:43.492421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6469b-2587-4647-9288-e4654e6c87de admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:43.494891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6469b-2587-4647-9288-e4654e6c87de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:43.499118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6469b-2587-4647-9288-e4654e6c87de admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:43.502303 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3304/6652] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:27:43.502979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbcd92-07a0-4a44-9072-da9756189ef6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:43.509611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2ccbcd92-07a0-4a44-9072-da9756189ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:43.576208 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3349/6653] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:43 2022] POST /identity/v3/projects => generated 381 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:43.581465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6469b-2587-4647-9288-e4654e6c87de admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:43.625989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbcd92-07a0-4a44-9072-da9756189ef6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:43.686938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:43.719632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:43.732370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191dcb2-e3e2-4165-98f9-423dac084556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:43.733603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191dcb2-e3e2-4165-98f9-423dac084556 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:43.733893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191dcb2-e3e2-4165-98f9-423dac084556 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:43.734292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191dcb2-e3e2-4165-98f9-423dac084556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:43.737431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6191dcb2-e3e2-4165-98f9-423dac084556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:43.749166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6469b-2587-4647-9288-e4654e6c87de admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:43.759880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191dcb2-e3e2-4165-98f9-423dac084556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:43.762392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191dcb2-e3e2-4165-98f9-423dac084556 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:43.763807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5c91a-2e71-48ea-a308-45fc884b987e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:43.764605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5c91a-2e71-48ea-a308-45fc884b987e admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:43.764896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5c91a-2e71-48ea-a308-45fc884b987e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:43.765228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5c91a-2e71-48ea-a308-45fc884b987e admin admin] PATH_INFO: `/v3/projects/0058630bad0b46a888a380a71085bd41/users/c498525520254d9ea65a13e5fd10ae9d/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:43.794143 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3305/6654] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:43.795136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191dcb2-e3e2-4165-98f9-423dac084556 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:43.803412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5c91a-2e71-48ea-a308-45fc884b987e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0058630bad0b46a888a380a71085bd41, user_id=c498525520254d9ea65a13e5fd10ae9d, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:43.806255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5c91a-2e71-48ea-a308-45fc884b987e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:43.815028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191dcb2-e3e2-4165-98f9-423dac084556 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:43.833018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ff587-c2b8-4f9b-8993-d1b8b87cf3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:43.833672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ff587-c2b8-4f9b-8993-d1b8b87cf3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:43.833939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ff587-c2b8-4f9b-8993-d1b8b87cf3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:43.834273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ff587-c2b8-4f9b-8993-d1b8b87cf3f1 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:43.834905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ff587-c2b8-4f9b-8993-d1b8b87cf3f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:43.837461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ff587-c2b8-4f9b-8993-d1b8b87cf3f1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:43.841942 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3350/6655] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:43 2022] PUT /identity/v3/projects/0058630bad0b46a888a380a71085bd41/users/c498525520254d9ea65a13e5fd10ae9d/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:43.842961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5c91a-2e71-48ea-a308-45fc884b987e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:43.887432 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3306/6656] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:43 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:43.895647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ff587-c2b8-4f9b-8993-d1b8b87cf3f1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:43.918391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ff587-c2b8-4f9b-8993-d1b8b87cf3f1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:44.002228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5c91a-2e71-48ea-a308-45fc884b987e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:44.014369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ada46-6e34-4db0-9c61-25009748928f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:44.016172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ada46-6e34-4db0-9c61-25009748928f admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:44.016172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ada46-6e34-4db0-9c61-25009748928f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:44.016471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ada46-6e34-4db0-9c61-25009748928f admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:44.017107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ada46-6e34-4db0-9c61-25009748928f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:44.025592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ada46-6e34-4db0-9c61-25009748928f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:44.042773 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3351/6657] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:44.057627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ada46-6e34-4db0-9c61-25009748928f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:44.089367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ada46-6e34-4db0-9c61-25009748928f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:44.096784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff82ab-0aca-4dfe-bcb9-8fe8d6340aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:44.097649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff82ab-0aca-4dfe-bcb9-8fe8d6340aad admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:44.098036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff82ab-0aca-4dfe-bcb9-8fe8d6340aad admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:44.098421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff82ab-0aca-4dfe-bcb9-8fe8d6340aad admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:44.099235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff82ab-0aca-4dfe-bcb9-8fe8d6340aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:44.101000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff82ab-0aca-4dfe-bcb9-8fe8d6340aad admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:44.109391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cf456-55d7-4f5a-af02-5b853574ff5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:44.110475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cf456-55d7-4f5a-af02-5b853574ff5e admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:44.113610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cf456-55d7-4f5a-af02-5b853574ff5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:44.114537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cf456-55d7-4f5a-af02-5b853574ff5e admin admin] PATH_INFO: `/v3/projects/0058630bad0b46a888a380a71085bd41/users/c498525520254d9ea65a13e5fd10ae9d/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:44.122766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cf456-55d7-4f5a-af02-5b853574ff5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0058630bad0b46a888a380a71085bd41, user_id=c498525520254d9ea65a13e5fd10ae9d, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:44.132085 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3307/6658] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:44.134196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff82ab-0aca-4dfe-bcb9-8fe8d6340aad admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:44.139506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cf456-55d7-4f5a-af02-5b853574ff5e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:44.155058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff82ab-0aca-4dfe-bcb9-8fe8d6340aad admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:44.162361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a9a35-99d0-482f-b78b-a656652bd491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:44.163272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a9a35-99d0-482f-b78b-a656652bd491 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:44.163692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a9a35-99d0-482f-b78b-a656652bd491 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:44.164096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a9a35-99d0-482f-b78b-a656652bd491 admin admin] PATH_INFO: `/v3/projects/2bcc50c0b5b84fe6917da003112d706a/users/b6f3338ad4324ffb95f9303054777214/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:44.202029 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3352/6659] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:44 2022] PUT /identity/v3/projects/0058630bad0b46a888a380a71085bd41/users/c498525520254d9ea65a13e5fd10ae9d/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:44.206013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a9a35-99d0-482f-b78b-a656652bd491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bcc50c0b5b84fe6917da003112d706a, user_id=b6f3338ad4324ffb95f9303054777214, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:44.209256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef640e1-a22d-47d2-99eb-a54276594b4e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:44.209579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef640e1-a22d-47d2-99eb-a54276594b4e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:44.209887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef640e1-a22d-47d2-99eb-a54276594b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:44.210281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a9a35-99d0-482f-b78b-a656652bd491 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:44.273317 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3308/6660] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:44 2022] PUT /identity/v3/projects/2bcc50c0b5b84fe6917da003112d706a/users/b6f3338ad4324ffb95f9303054777214/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:27:44.277671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a9a35-99d0-482f-b78b-a656652bd491 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:44.304721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4ef640e1-a22d-47d2-99eb-a54276594b4e None None] MFA Rules not processed for user `c498525520254d9ea65a13e5fd10ae9d`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:44.306026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4ef640e1-a22d-47d2-99eb-a54276594b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:44.458305 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3353/6661] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:27:44.463076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a9a35-99d0-482f-b78b-a656652bd491 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:44.469142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef640e1-a22d-47d2-99eb-a54276594b4e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:44.471207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4ef640e1-a22d-47d2-99eb-a54276594b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:44.478303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6808f2-6e03-4080-9b3b-150c68d02f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:44.479376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6808f2-6e03-4080-9b3b-150c68d02f48 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:44.480225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6808f2-6e03-4080-9b3b-150c68d02f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:44.480661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6808f2-6e03-4080-9b3b-150c68d02f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:44.481520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6808f2-6e03-4080-9b3b-150c68d02f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:44.484140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6808f2-6e03-4080-9b3b-150c68d02f48 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:44.504407 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3309/6662] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:27:44.507671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6808f2-6e03-4080-9b3b-150c68d02f48 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:44.523767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6808f2-6e03-4080-9b3b-150c68d02f48 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:44.533275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa934c33-8707-4e9d-9291-52f42180307d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:44.534318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa934c33-8707-4e9d-9291-52f42180307d admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:44.534750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa934c33-8707-4e9d-9291-52f42180307d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:44.537847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa934c33-8707-4e9d-9291-52f42180307d admin admin] PATH_INFO: `/v3/projects/2bcc50c0b5b84fe6917da003112d706a/users/b6f3338ad4324ffb95f9303054777214/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:44.540669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa934c33-8707-4e9d-9291-52f42180307d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bcc50c0b5b84fe6917da003112d706a, user_id=b6f3338ad4324ffb95f9303054777214, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:44.548728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa934c33-8707-4e9d-9291-52f42180307d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:44.571349 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3310/6663] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:27:44 2022] PUT /identity/v3/projects/2bcc50c0b5b84fe6917da003112d706a/users/b6f3338ad4324ffb95f9303054777214/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:27:44.605824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:44.637646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef640e1-a22d-47d2-99eb-a54276594b4e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:44.695798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef144de-0e11-4458-b99a-22fed1bb9a00 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:44.696414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef144de-0e11-4458-b99a-22fed1bb9a00 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:44.697269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef144de-0e11-4458-b99a-22fed1bb9a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:44.753383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:44.760185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-eef144de-0e11-4458-b99a-22fed1bb9a00 None None] MFA Rules not processed for user `b6f3338ad4324ffb95f9303054777214`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:44.765054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-eef144de-0e11-4458-b99a-22fed1bb9a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:44.800582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aaccc0-b746-44dd-a5e0-006685d8c3af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:44.801246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaccc0-b746-44dd-a5e0-006685d8c3af service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:44.801556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaccc0-b746-44dd-a5e0-006685d8c3af service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:44.801947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaccc0-b746-44dd-a5e0-006685d8c3af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:44.969506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aaccc0-b746-44dd-a5e0-006685d8c3af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:44.971562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aaccc0-b746-44dd-a5e0-006685d8c3af service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:44.995507 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3354/6664] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:45.062755 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3311/6665] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:27:45.077144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aaccc0-b746-44dd-a5e0-006685d8c3af service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:45.090987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aaccc0-b746-44dd-a5e0-006685d8c3af service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:45.109014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e07a0-bf32-4595-aa57-e592de161a9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:45.113033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e07a0-bf32-4595-aa57-e592de161a9e service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:45.113881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e07a0-bf32-4595-aa57-e592de161a9e service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:45.116991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e07a0-bf32-4595-aa57-e592de161a9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:45.162010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e07a0-bf32-4595-aa57-e592de161a9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:45.166512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e07a0-bf32-4595-aa57-e592de161a9e service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:45.189377 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3355/6666] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:27:45.423546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef144de-0e11-4458-b99a-22fed1bb9a00 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:45.442232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef144de-0e11-4458-b99a-22fed1bb9a00 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:45.451778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ac41d-85cb-428f-8720-d58bae9b57d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:45.457407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ac41d-85cb-428f-8720-d58bae9b57d8 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:45.458157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ac41d-85cb-428f-8720-d58bae9b57d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:45.459784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ac41d-85cb-428f-8720-d58bae9b57d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:45.609765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ac41d-85cb-428f-8720-d58bae9b57d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:45.613016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ac41d-85cb-428f-8720-d58bae9b57d8 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:45.646134 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3312/6667] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:46.410520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e07a0-bf32-4595-aa57-e592de161a9e service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:46.429009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e07a0-bf32-4595-aa57-e592de161a9e service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:46.441787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba799fd1-a8ec-43ba-a7b5-e949c7f15cb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:46.445001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba799fd1-a8ec-43ba-a7b5-e949c7f15cb2 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:46.446156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba799fd1-a8ec-43ba-a7b5-e949c7f15cb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:46.446972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba799fd1-a8ec-43ba-a7b5-e949c7f15cb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:46.732277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba799fd1-a8ec-43ba-a7b5-e949c7f15cb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:46.733747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba799fd1-a8ec-43ba-a7b5-e949c7f15cb2 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:46.773140 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3356/6668] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:52.214151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ac41d-85cb-428f-8720-d58bae9b57d8 service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:52.227593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ac41d-85cb-428f-8720-d58bae9b57d8 service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:52.231894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5c74b-3fc4-4db6-83ca-69dd2a9696f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:52.233354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5c74b-3fc4-4db6-83ca-69dd2a9696f8 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:52.233858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5c74b-3fc4-4db6-83ca-69dd2a9696f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:52.235135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5c74b-3fc4-4db6-83ca-69dd2a9696f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:52.377082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5c74b-3fc4-4db6-83ca-69dd2a9696f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:52.382105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5c74b-3fc4-4db6-83ca-69dd2a9696f8 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:52.419750 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3313/6669] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:55.853542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba799fd1-a8ec-43ba-a7b5-e949c7f15cb2 service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:55.934322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:56.035167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba799fd1-a8ec-43ba-a7b5-e949c7f15cb2 service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:56.055232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ca714-96d4-421d-bd5b-2b57c5c242c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:56.056197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ca714-96d4-421d-bd5b-2b57c5c242c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:56.058611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ca714-96d4-421d-bd5b-2b57c5c242c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:56.059117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ca714-96d4-421d-bd5b-2b57c5c242c4 admin admin] PATH_INFO: `/v3/users/5387c687bff74fc5a2ad0bd6e2badd51` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:56.060667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ca714-96d4-421d-bd5b-2b57c5c242c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5387c687bff74fc5a2ad0bd6e2badd51)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:56.064867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ca714-96d4-421d-bd5b-2b57c5c242c4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:56.068770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5c74b-3fc4-4db6-83ca-69dd2a9696f8 service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:56.070697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-49d5c74b-3fc4-4db6-83ca-69dd2a9696f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:56.092801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5c74b-3fc4-4db6-83ca-69dd2a9696f8 service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:56.110803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c6786-8129-4659-ad5e-602b2c7c38c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:56.112247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c6786-8129-4659-ad5e-602b2c7c38c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:56.112954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c6786-8129-4659-ad5e-602b2c7c38c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:56.113451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c6786-8129-4659-ad5e-602b2c7c38c8 admin admin] PATH_INFO: `/v3/users/819b87213b9c473d91a59cafc10fa9af` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:56.118942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c6786-8129-4659-ad5e-602b2c7c38c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=819b87213b9c473d91a59cafc10fa9af)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:56.121114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c6786-8129-4659-ad5e-602b2c7c38c8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:56.192416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3b4ca714-96d4-421d-bd5b-2b57c5c242c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5387c687bff74fc5a2ad0bd6e2badd51'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:56.223569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:56.229670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3b4ca714-96d4-421d-bd5b-2b57c5c242c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5387c687bff74fc5a2ad0bd6e2badd51'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:56.232644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3b4ca714-96d4-421d-bd5b-2b57c5c242c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5387c687bff74fc5a2ad0bd6e2badd51'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:56.254758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3b4ca714-96d4-421d-bd5b-2b57c5c242c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5387c687bff74fc5a2ad0bd6e2badd51'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:56.257357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3b4ca714-96d4-421d-bd5b-2b57c5c242c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5387c687bff74fc5a2ad0bd6e2badd51'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:56.259887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c72c6786-8129-4659-ad5e-602b2c7c38c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '819b87213b9c473d91a59cafc10fa9af'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:56.263802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c72c6786-8129-4659-ad5e-602b2c7c38c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '819b87213b9c473d91a59cafc10fa9af'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:56.298832 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3357/6670] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:55 2022] DELETE /identity/v3/users/5387c687bff74fc5a2ad0bd6e2badd51 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:56.302441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c72c6786-8129-4659-ad5e-602b2c7c38c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '819b87213b9c473d91a59cafc10fa9af'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:56.302638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70736c3e-53e5-4c34-907a-ae075f5ee31a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:56.303454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70736c3e-53e5-4c34-907a-ae075f5ee31a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:56.303889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c72c6786-8129-4659-ad5e-602b2c7c38c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '819b87213b9c473d91a59cafc10fa9af'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:56.304642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70736c3e-53e5-4c34-907a-ae075f5ee31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:56.326349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c72c6786-8129-4659-ad5e-602b2c7c38c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '819b87213b9c473d91a59cafc10fa9af'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:56.356721 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3314/6671] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:56 2022] DELETE /identity/v3/users/819b87213b9c473d91a59cafc10fa9af => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:56.358141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c6786-8129-4659-ad5e-602b2c7c38c8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:56.361696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-70736c3e-53e5-4c34-907a-ae075f5ee31a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:56.363817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c72c6786-8129-4659-ad5e-602b2c7c38c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:56.367629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-70736c3e-53e5-4c34-907a-ae075f5ee31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:56.542941 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3358/6672] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:56.549257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfde7c7-ab0e-4d1b-8e31-4d6bec323919 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:56.549257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfde7c7-ab0e-4d1b-8e31-4d6bec323919 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:56.549665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfde7c7-ab0e-4d1b-8e31-4d6bec323919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:56.556119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c6786-8129-4659-ad5e-602b2c7c38c8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:56.567615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca9605-9fa9-4171-a386-cc0d2fabef67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:56.570146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca9605-9fa9-4171-a386-cc0d2fabef67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:56.570146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca9605-9fa9-4171-a386-cc0d2fabef67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:56.570146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca9605-9fa9-4171-a386-cc0d2fabef67 admin admin] PATH_INFO: `/v3/users/93361ffb454d4fb9bccfea7a0e6daf23` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:56.575327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca9605-9fa9-4171-a386-cc0d2fabef67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93361ffb454d4fb9bccfea7a0e6daf23)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:56.577378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca9605-9fa9-4171-a386-cc0d2fabef67 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:56.590761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0dfde7c7-ab0e-4d1b-8e31-4d6bec323919 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:56.593817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0dfde7c7-ab0e-4d1b-8e31-4d6bec323919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:56.603876 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3359/6673] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:56.604774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfde7c7-ab0e-4d1b-8e31-4d6bec323919 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:56.606823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0dfde7c7-ab0e-4d1b-8e31-4d6bec323919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:56.716041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:56.716793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-61ca9605-9fa9-4171-a386-cc0d2fabef67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93361ffb454d4fb9bccfea7a0e6daf23'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:56.717829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-61ca9605-9fa9-4171-a386-cc0d2fabef67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93361ffb454d4fb9bccfea7a0e6daf23'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:56.724684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfde7c7-ab0e-4d1b-8e31-4d6bec323919 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:56.732735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc8c05-ff2a-46e1-a618-594214f32ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:56.733678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc8c05-ff2a-46e1-a618-594214f32ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:56.734917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc8c05-ff2a-46e1-a618-594214f32ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:56.735515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc8c05-ff2a-46e1-a618-594214f32ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:56.738883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0abc8c05-ff2a-46e1-a618-594214f32ed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:56.764334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-61ca9605-9fa9-4171-a386-cc0d2fabef67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93361ffb454d4fb9bccfea7a0e6daf23'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:56.765545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-61ca9605-9fa9-4171-a386-cc0d2fabef67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93361ffb454d4fb9bccfea7a0e6daf23'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:56.768559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc8c05-ff2a-46e1-a618-594214f32ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:56.770469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc8c05-ff2a-46e1-a618-594214f32ed3 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:56.786056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-61ca9605-9fa9-4171-a386-cc0d2fabef67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93361ffb454d4fb9bccfea7a0e6daf23'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:56.794266 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3360/6674] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:56.795616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc8c05-ff2a-46e1-a618-594214f32ed3 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:56.797857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0abc8c05-ff2a-46e1-a618-594214f32ed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:56.816754 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3315/6675] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:56 2022] DELETE /identity/v3/users/93361ffb454d4fb9bccfea7a0e6daf23 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:56.822929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d7ff7-42df-4597-aa15-389ec0740ab1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:56.823386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d7ff7-42df-4597-aa15-389ec0740ab1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:56.823697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d7ff7-42df-4597-aa15-389ec0740ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:56.837914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc8c05-ff2a-46e1-a618-594214f32ed3 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:56.900307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-906d7ff7-42df-4597-aa15-389ec0740ab1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:56.907208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-906d7ff7-42df-4597-aa15-389ec0740ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:56.950838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:57.001760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a2631-f79f-43fa-9a69-5ca0dbdfff3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:57.002669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a2631-f79f-43fa-9a69-5ca0dbdfff3f service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:57.002961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a2631-f79f-43fa-9a69-5ca0dbdfff3f service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:57.003240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a2631-f79f-43fa-9a69-5ca0dbdfff3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:57.015477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-458a2631-f79f-43fa-9a69-5ca0dbdfff3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:57.086920 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3316/6676] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:57.152244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d7ff7-42df-4597-aa15-389ec0740ab1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:57.182550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d7ff7-42df-4597-aa15-389ec0740ab1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:57.201172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3892229-61de-44d7-8458-585f3cef8a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:57.202142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3892229-61de-44d7-8458-585f3cef8a07 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:57.203934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3892229-61de-44d7-8458-585f3cef8a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:57.204835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3892229-61de-44d7-8458-585f3cef8a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:57.219926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a2631-f79f-43fa-9a69-5ca0dbdfff3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:57.221777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a2631-f79f-43fa-9a69-5ca0dbdfff3f service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:57.248583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3892229-61de-44d7-8458-585f3cef8a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:57.254204 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3361/6677] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:57.257048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3892229-61de-44d7-8458-585f3cef8a07 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:57.283362 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3317/6678] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:57.721666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a2631-f79f-43fa-9a69-5ca0dbdfff3f service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:57.725828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-458a2631-f79f-43fa-9a69-5ca0dbdfff3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:57.745947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a2631-f79f-43fa-9a69-5ca0dbdfff3f service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:57.754159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758eac84-5d26-4869-8c03-624e240d0c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:57.756468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758eac84-5d26-4869-8c03-624e240d0c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:57.756987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758eac84-5d26-4869-8c03-624e240d0c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:57.757891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758eac84-5d26-4869-8c03-624e240d0c2f admin admin] PATH_INFO: `/v3/users/55e28c2994fe438d91c033e1e92a3077` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:57.759455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758eac84-5d26-4869-8c03-624e240d0c2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e28c2994fe438d91c033e1e92a3077)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:57.762285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758eac84-5d26-4869-8c03-624e240d0c2f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:57.877760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3892229-61de-44d7-8458-585f3cef8a07 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:57.878846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b3892229-61de-44d7-8458-585f3cef8a07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:57.912271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3892229-61de-44d7-8458-585f3cef8a07 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:57.923836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97a386-1b26-44af-9d7c-61bd31c4709b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:57.925313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97a386-1b26-44af-9d7c-61bd31c4709b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:57.926376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97a386-1b26-44af-9d7c-61bd31c4709b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:57.927137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97a386-1b26-44af-9d7c-61bd31c4709b admin admin] PATH_INFO: `/v3/projects/a41d1e1f00ac471cb0d7ae5cfacba7b7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:57.928918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97a386-1b26-44af-9d7c-61bd31c4709b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41d1e1f00ac471cb0d7ae5cfacba7b7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:57.931414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97a386-1b26-44af-9d7c-61bd31c4709b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:57.934583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-758eac84-5d26-4869-8c03-624e240d0c2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e28c2994fe438d91c033e1e92a3077'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:57.960820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-758eac84-5d26-4869-8c03-624e240d0c2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e28c2994fe438d91c033e1e92a3077'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:57.962166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-758eac84-5d26-4869-8c03-624e240d0c2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e28c2994fe438d91c033e1e92a3077'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:57.986593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-758eac84-5d26-4869-8c03-624e240d0c2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e28c2994fe438d91c033e1e92a3077'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:57.988466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-758eac84-5d26-4869-8c03-624e240d0c2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e28c2994fe438d91c033e1e92a3077'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.031470 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3362/6679] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:57 2022] DELETE /identity/v3/users/55e28c2994fe438d91c033e1e92a3077 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:58.038160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758eac84-5d26-4869-8c03-624e240d0c2f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:58.048479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-758eac84-5d26-4869-8c03-624e240d0c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:58.074785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cc97a386-1b26-44af-9d7c-61bd31c4709b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41d1e1f00ac471cb0d7ae5cfacba7b7', 'request_id': 'req-cc97a386-1b26-44af-9d7c-61bd31c4709b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.085031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:58.090318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cc97a386-1b26-44af-9d7c-61bd31c4709b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41d1e1f00ac471cb0d7ae5cfacba7b7', 'request_id': 'req-cc97a386-1b26-44af-9d7c-61bd31c4709b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.100419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cc97a386-1b26-44af-9d7c-61bd31c4709b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41d1e1f00ac471cb0d7ae5cfacba7b7', 'request_id': 'req-cc97a386-1b26-44af-9d7c-61bd31c4709b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.123723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cc97a386-1b26-44af-9d7c-61bd31c4709b admin admin] The token cache is being invalidate because project a41d1e1f00ac471cb0d7ae5cfacba7b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:58.124782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cc97a386-1b26-44af-9d7c-61bd31c4709b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.125653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cc97a386-1b26-44af-9d7c-61bd31c4709b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.131337 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3318/6680] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:57 2022] DELETE /identity/v3/projects/a41d1e1f00ac471cb0d7ae5cfacba7b7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:58.135918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3a0f7-5205-4af9-b0b7-200855e5b946 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:58.137745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3a0f7-5205-4af9-b0b7-200855e5b946 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:58.138031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3a0f7-5205-4af9-b0b7-200855e5b946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:58.187554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-05e3a0f7-5205-4af9-b0b7-200855e5b946 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:58.188819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-05e3a0f7-5205-4af9-b0b7-200855e5b946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:58.206939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758eac84-5d26-4869-8c03-624e240d0c2f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:58.338244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6914d-e99c-4afb-9aa0-cbd41b728c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:58.338824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6914d-e99c-4afb-9aa0-cbd41b728c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:58.339324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6914d-e99c-4afb-9aa0-cbd41b728c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:58.339486 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3319/6681] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:58.339977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6914d-e99c-4afb-9aa0-cbd41b728c01 admin admin] PATH_INFO: `/v3/projects/9d885957288749e1b4026f0f426f9588` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:58.340848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3a0f7-5205-4af9-b0b7-200855e5b946 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:58.341593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6914d-e99c-4afb-9aa0-cbd41b728c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d885957288749e1b4026f0f426f9588)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:58.344665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6914d-e99c-4afb-9aa0-cbd41b728c01 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:58.355435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-05e3a0f7-5205-4af9-b0b7-200855e5b946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:58.396529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3a0f7-5205-4af9-b0b7-200855e5b946 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:58.417464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d9206-43f4-4f2d-8740-8e1fa65f0b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:58.418536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d9206-43f4-4f2d-8740-8e1fa65f0b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:58.419014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d9206-43f4-4f2d-8740-8e1fa65f0b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:58.419553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d9206-43f4-4f2d-8740-8e1fa65f0b11 admin admin] PATH_INFO: `/v3/users/2d277be1769749e9a54d6fc2998748a5` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:58.421115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d9206-43f4-4f2d-8740-8e1fa65f0b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d277be1769749e9a54d6fc2998748a5)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:58.425348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d9206-43f4-4f2d-8740-8e1fa65f0b11 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:58.435552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-25f6914d-e99c-4afb-9aa0-cbd41b728c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d885957288749e1b4026f0f426f9588', 'request_id': 'req-25f6914d-e99c-4afb-9aa0-cbd41b728c01'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.445224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-25f6914d-e99c-4afb-9aa0-cbd41b728c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d885957288749e1b4026f0f426f9588', 'request_id': 'req-25f6914d-e99c-4afb-9aa0-cbd41b728c01'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.458172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-25f6914d-e99c-4afb-9aa0-cbd41b728c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d885957288749e1b4026f0f426f9588', 'request_id': 'req-25f6914d-e99c-4afb-9aa0-cbd41b728c01'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.478471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-25f6914d-e99c-4afb-9aa0-cbd41b728c01 admin admin] The token cache is being invalidate because project 9d885957288749e1b4026f0f426f9588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:58.480059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-25f6914d-e99c-4afb-9aa0-cbd41b728c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.480963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-25f6914d-e99c-4afb-9aa0-cbd41b728c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.483129 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3363/6682] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:58 2022] DELETE /identity/v3/projects/9d885957288749e1b4026f0f426f9588 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:58.484788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6914d-e99c-4afb-9aa0-cbd41b728c01 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:58.491399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:58.494155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-25f6914d-e99c-4afb-9aa0-cbd41b728c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:58.513575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-115d9206-43f4-4f2d-8740-8e1fa65f0b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d277be1769749e9a54d6fc2998748a5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.514975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-115d9206-43f4-4f2d-8740-8e1fa65f0b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d277be1769749e9a54d6fc2998748a5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.535080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-115d9206-43f4-4f2d-8740-8e1fa65f0b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d277be1769749e9a54d6fc2998748a5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.536428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-115d9206-43f4-4f2d-8740-8e1fa65f0b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d277be1769749e9a54d6fc2998748a5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.548559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-115d9206-43f4-4f2d-8740-8e1fa65f0b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d277be1769749e9a54d6fc2998748a5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.584847 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3320/6683] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:58 2022] DELETE /identity/v3/users/2d277be1769749e9a54d6fc2998748a5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:58.591611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d9206-43f4-4f2d-8740-8e1fa65f0b11 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:58.594005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-115d9206-43f4-4f2d-8740-8e1fa65f0b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:58.612888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:58.666936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6914d-e99c-4afb-9aa0-cbd41b728c01 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:58.739001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15065c-c82e-4c81-94a1-af6243152888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:58.739697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15065c-c82e-4c81-94a1-af6243152888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:58.739983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15065c-c82e-4c81-94a1-af6243152888 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:58.740262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15065c-c82e-4c81-94a1-af6243152888 admin admin] PATH_INFO: `/v3/projects/69b803953acf4ad49e49823a021aff46` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:58.741655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15065c-c82e-4c81-94a1-af6243152888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b803953acf4ad49e49823a021aff46)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:58.743741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15065c-c82e-4c81-94a1-af6243152888 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:58.763610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d9206-43f4-4f2d-8740-8e1fa65f0b11 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:58.774585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65680e38-4c38-4756-8154-3023444e4e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:58.775237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65680e38-4c38-4756-8154-3023444e4e43 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:58.775811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65680e38-4c38-4756-8154-3023444e4e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:58.778015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65680e38-4c38-4756-8154-3023444e4e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:58.781087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-65680e38-4c38-4756-8154-3023444e4e43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:58.811360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65680e38-4c38-4756-8154-3023444e4e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:58.815965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65680e38-4c38-4756-8154-3023444e4e43 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:58.849841 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3321/6684] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:27:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:27:58.850733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65680e38-4c38-4756-8154-3023444e4e43 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:58.852923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-65680e38-4c38-4756-8154-3023444e4e43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:58.858363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1f15065c-c82e-4c81-94a1-af6243152888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b803953acf4ad49e49823a021aff46', 'request_id': 'req-1f15065c-c82e-4c81-94a1-af6243152888'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.871907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65680e38-4c38-4756-8154-3023444e4e43 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:58.872531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1f15065c-c82e-4c81-94a1-af6243152888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b803953acf4ad49e49823a021aff46', 'request_id': 'req-1f15065c-c82e-4c81-94a1-af6243152888'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.887677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1f15065c-c82e-4c81-94a1-af6243152888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b803953acf4ad49e49823a021aff46', 'request_id': 'req-1f15065c-c82e-4c81-94a1-af6243152888'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.915009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1f15065c-c82e-4c81-94a1-af6243152888 admin admin] The token cache is being invalidate because project 69b803953acf4ad49e49823a021aff46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:58.915340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1f15065c-c82e-4c81-94a1-af6243152888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.917581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1f15065c-c82e-4c81-94a1-af6243152888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:58.919794 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3364/6685] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:58 2022] DELETE /identity/v3/projects/69b803953acf4ad49e49823a021aff46 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:58.927115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5acd10-76ed-4f66-8e16-9bf8373b4b2b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:58.927433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5acd10-76ed-4f66-8e16-9bf8373b4b2b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:58.927717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5acd10-76ed-4f66-8e16-9bf8373b4b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:58.969049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ce5acd10-76ed-4f66-8e16-9bf8373b4b2b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:58.970442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ce5acd10-76ed-4f66-8e16-9bf8373b4b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:59.014290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111868c-58a6-4c6c-8799-0614dd919942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:59.015587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111868c-58a6-4c6c-8799-0614dd919942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:59.016085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111868c-58a6-4c6c-8799-0614dd919942 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:59.016602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111868c-58a6-4c6c-8799-0614dd919942 admin admin] PATH_INFO: `/v3/users/32ddb963d74c4afe968cc4434bc96339` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:59.020774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111868c-58a6-4c6c-8799-0614dd919942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32ddb963d74c4afe968cc4434bc96339)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:59.022989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111868c-58a6-4c6c-8799-0614dd919942 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:59.101843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7111868c-58a6-4c6c-8799-0614dd919942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32ddb963d74c4afe968cc4434bc96339'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:59.102751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7111868c-58a6-4c6c-8799-0614dd919942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32ddb963d74c4afe968cc4434bc96339'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:59.109845 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3365/6686] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:27:59.110734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:59.119444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145a870-ebd3-402f-b9f4-d2e577c3753f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:59.119747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145a870-ebd3-402f-b9f4-d2e577c3753f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:59.120174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145a870-ebd3-402f-b9f4-d2e577c3753f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:59.122820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7111868c-58a6-4c6c-8799-0614dd919942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32ddb963d74c4afe968cc4434bc96339'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:59.126046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7111868c-58a6-4c6c-8799-0614dd919942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32ddb963d74c4afe968cc4434bc96339'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:59.140850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7111868c-58a6-4c6c-8799-0614dd919942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32ddb963d74c4afe968cc4434bc96339'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:59.166924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e145a870-ebd3-402f-b9f4-d2e577c3753f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:59.169074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e145a870-ebd3-402f-b9f4-d2e577c3753f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:59.185155 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3322/6687] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:27:58 2022] DELETE /identity/v3/users/32ddb963d74c4afe968cc4434bc96339 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:59.185853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111868c-58a6-4c6c-8799-0614dd919942 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:59.187958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7111868c-58a6-4c6c-8799-0614dd919942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:59.202044 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3366/6688] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:59.202771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145a870-ebd3-402f-b9f4-d2e577c3753f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:59.226939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145a870-ebd3-402f-b9f4-d2e577c3753f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:59.266865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:59.355745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111868c-58a6-4c6c-8799-0614dd919942 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:59.357045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147d5a1-4082-4ba5-8711-0a3c5a9265e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:59.357800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147d5a1-4082-4ba5-8711-0a3c5a9265e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:59.358210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147d5a1-4082-4ba5-8711-0a3c5a9265e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:59.358604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147d5a1-4082-4ba5-8711-0a3c5a9265e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:59.360090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147d5a1-4082-4ba5-8711-0a3c5a9265e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:27:59.360474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147d5a1-4082-4ba5-8711-0a3c5a9265e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:59.362411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147d5a1-4082-4ba5-8711-0a3c5a9265e4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:59.369830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e9c7a-787e-42d9-926f-5a74396826a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:59.375744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e9c7a-787e-42d9-926f-5a74396826a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:59.376233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e9c7a-787e-42d9-926f-5a74396826a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:59.377033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e9c7a-787e-42d9-926f-5a74396826a1 admin admin] PATH_INFO: `/v3/projects/9fa195fbd45f43a3bb7f6b85b83d1a0a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:59.379272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e9c7a-787e-42d9-926f-5a74396826a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fa195fbd45f43a3bb7f6b85b83d1a0a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:59.381767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e9c7a-787e-42d9-926f-5a74396826a1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:59.398528 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3367/6689] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:27:59.399743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147d5a1-4082-4ba5-8711-0a3c5a9265e4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:59.421233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147d5a1-4082-4ba5-8711-0a3c5a9265e4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:59.444602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676b9b2-5e8b-498b-be79-4f291e18f858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:59.445424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676b9b2-5e8b-498b-be79-4f291e18f858 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:59.445828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676b9b2-5e8b-498b-be79-4f291e18f858 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:59.446282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676b9b2-5e8b-498b-be79-4f291e18f858 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:59.447099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676b9b2-5e8b-498b-be79-4f291e18f858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:59.449240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676b9b2-5e8b-498b-be79-4f291e18f858 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:59.483241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cc7e9c7a-787e-42d9-926f-5a74396826a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fa195fbd45f43a3bb7f6b85b83d1a0a', 'request_id': 'req-cc7e9c7a-787e-42d9-926f-5a74396826a1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:59.502091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cc7e9c7a-787e-42d9-926f-5a74396826a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fa195fbd45f43a3bb7f6b85b83d1a0a', 'request_id': 'req-cc7e9c7a-787e-42d9-926f-5a74396826a1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:59.509310 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3368/6690] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:27:59 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:59.513339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676b9b2-5e8b-498b-be79-4f291e18f858 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:59.515896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cc7e9c7a-787e-42d9-926f-5a74396826a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fa195fbd45f43a3bb7f6b85b83d1a0a', 'request_id': 'req-cc7e9c7a-787e-42d9-926f-5a74396826a1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:59.547396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cc7e9c7a-787e-42d9-926f-5a74396826a1 admin admin] The token cache is being invalidate because project 9fa195fbd45f43a3bb7f6b85b83d1a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:27:59.548859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cc7e9c7a-787e-42d9-926f-5a74396826a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:59.550740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cc7e9c7a-787e-42d9-926f-5a74396826a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:59.559181 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3323/6691] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:59 2022] DELETE /identity/v3/projects/9fa195fbd45f43a3bb7f6b85b83d1a0a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:27:59.560926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95888afd-3e74-4c9f-bd84-08b598d86b9a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:59.562312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95888afd-3e74-4c9f-bd84-08b598d86b9a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:59.562655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95888afd-3e74-4c9f-bd84-08b598d86b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:59.636366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-95888afd-3e74-4c9f-bd84-08b598d86b9a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:59.637631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-95888afd-3e74-4c9f-bd84-08b598d86b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:59.743667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676b9b2-5e8b-498b-be79-4f291e18f858 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:59.750046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748d264-747c-48f1-bbc3-160af1e55102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:59.751057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d264-747c-48f1-bbc3-160af1e55102 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:59.751453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d264-747c-48f1-bbc3-160af1e55102 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:59.753263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d264-747c-48f1-bbc3-160af1e55102 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:59.754033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748d264-747c-48f1-bbc3-160af1e55102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:59.757251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748d264-747c-48f1-bbc3-160af1e55102 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:59.787760 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3369/6692] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:27:59 2022] POST /identity/v3/users => generated 294 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:27:59.793022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748d264-747c-48f1-bbc3-160af1e55102 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:59.798053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6748d264-747c-48f1-bbc3-160af1e55102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:59.834807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748d264-747c-48f1-bbc3-160af1e55102 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:59.836583 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3324/6693] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:59.837633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95888afd-3e74-4c9f-bd84-08b598d86b9a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:59.839107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-95888afd-3e74-4c9f-bd84-08b598d86b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:59.852626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:59.855270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9854b-4053-4522-927e-92a8020c96b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:59.856092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9854b-4053-4522-927e-92a8020c96b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:59.856447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9854b-4053-4522-927e-92a8020c96b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:59.856799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9854b-4053-4522-927e-92a8020c96b2 admin admin] PATH_INFO: `/v3/projects/ac185b2f86cb4c9aa7702b2bdbe8e0ac` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:59.859183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9854b-4053-4522-927e-92a8020c96b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac185b2f86cb4c9aa7702b2bdbe8e0ac)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:59.861211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9854b-4053-4522-927e-92a8020c96b2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:59.861955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95888afd-3e74-4c9f-bd84-08b598d86b9a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:59.868640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb183f82-1515-4e84-ab18-8c350c465a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:27:59.868640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb183f82-1515-4e84-ab18-8c350c465a94 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:59.868897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb183f82-1515-4e84-ab18-8c350c465a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:59.869267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb183f82-1515-4e84-ab18-8c350c465a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:59.870417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb183f82-1515-4e84-ab18-8c350c465a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:27:59.873072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb183f82-1515-4e84-ab18-8c350c465a94 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:27:59.884809 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3325/6694] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:27:59.886338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf31f2-1f37-43a9-ae6e-746695daf2ec None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:27:59.886869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf31f2-1f37-43a9-ae6e-746695daf2ec None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:27:59.886869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf31f2-1f37-43a9-ae6e-746695daf2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:27:59.917155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f9bf31f2-1f37-43a9-ae6e-746695daf2ec None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:27:59.918883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f9bf31f2-1f37-43a9-ae6e-746695daf2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:27:59.934705 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3326/6695] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:27:59.934705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf31f2-1f37-43a9-ae6e-746695daf2ec None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:27:59.948322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf31f2-1f37-43a9-ae6e-746695daf2ec None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:27:59.975443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1cd9854b-4053-4522-927e-92a8020c96b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac185b2f86cb4c9aa7702b2bdbe8e0ac', 'request_id': 'req-1cd9854b-4053-4522-927e-92a8020c96b2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:27:59.988375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1cd9854b-4053-4522-927e-92a8020c96b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac185b2f86cb4c9aa7702b2bdbe8e0ac', 'request_id': 'req-1cd9854b-4053-4522-927e-92a8020c96b2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:00.020092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1cd9854b-4053-4522-927e-92a8020c96b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac185b2f86cb4c9aa7702b2bdbe8e0ac', 'request_id': 'req-1cd9854b-4053-4522-927e-92a8020c96b2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:00.037653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1cd9854b-4053-4522-927e-92a8020c96b2 admin admin] The token cache is being invalidate because project ac185b2f86cb4c9aa7702b2bdbe8e0ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:00.037951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1cd9854b-4053-4522-927e-92a8020c96b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:00.038632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1cd9854b-4053-4522-927e-92a8020c96b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:00.040904 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3370/6696] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:27:59 2022] DELETE /identity/v3/projects/ac185b2f86cb4c9aa7702b2bdbe8e0ac => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:00.043247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9854b-4053-4522-927e-92a8020c96b2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:00.045149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1cd9854b-4053-4522-927e-92a8020c96b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:00.072176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:00.077344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3f4a4-2b5b-4bfa-bd2f-d1450c24532b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:00.078678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3f4a4-2b5b-4bfa-bd2f-d1450c24532b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:00.079202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3f4a4-2b5b-4bfa-bd2f-d1450c24532b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:00.080950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3f4a4-2b5b-4bfa-bd2f-d1450c24532b admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:00.081952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3f4a4-2b5b-4bfa-bd2f-d1450c24532b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:00.083838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3f4a4-2b5b-4bfa-bd2f-d1450c24532b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:00.098415 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3327/6697] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:00.107277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3f4a4-2b5b-4bfa-bd2f-d1450c24532b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:00.111517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3df3f4a4-2b5b-4bfa-bd2f-d1450c24532b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:00.148674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3f4a4-2b5b-4bfa-bd2f-d1450c24532b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:00.168952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dc41e-b9cd-4525-8174-b1810e0f255e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:00.169844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dc41e-b9cd-4525-8174-b1810e0f255e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:00.170185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dc41e-b9cd-4525-8174-b1810e0f255e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:00.170472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dc41e-b9cd-4525-8174-b1810e0f255e admin admin] PATH_INFO: `/v3/projects/a63757e09f1e42818f0642f9bdada709` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:00.172866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7dc41e-b9cd-4525-8174-b1810e0f255e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a63757e09f1e42818f0642f9bdada709)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:00.175566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7dc41e-b9cd-4525-8174-b1810e0f255e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:00.229200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9854b-4053-4522-927e-92a8020c96b2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:00.252734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394deaba-75e9-444c-a572-987c1d6f93a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:00.254170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394deaba-75e9-444c-a572-987c1d6f93a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:00.254585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394deaba-75e9-444c-a572-987c1d6f93a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:00.254993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394deaba-75e9-444c-a572-987c1d6f93a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:00.255883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394deaba-75e9-444c-a572-987c1d6f93a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:00.256299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394deaba-75e9-444c-a572-987c1d6f93a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:00.258142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394deaba-75e9-444c-a572-987c1d6f93a1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:00.286625 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3371/6698] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:00.286625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394deaba-75e9-444c-a572-987c1d6f93a1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:00.289101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-394deaba-75e9-444c-a572-987c1d6f93a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:00.297152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8b7dc41e-b9cd-4525-8174-b1810e0f255e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a63757e09f1e42818f0642f9bdada709', 'request_id': 'req-8b7dc41e-b9cd-4525-8174-b1810e0f255e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:00.318428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8b7dc41e-b9cd-4525-8174-b1810e0f255e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a63757e09f1e42818f0642f9bdada709', 'request_id': 'req-8b7dc41e-b9cd-4525-8174-b1810e0f255e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:00.319195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394deaba-75e9-444c-a572-987c1d6f93a1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:00.328540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8b7dc41e-b9cd-4525-8174-b1810e0f255e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a63757e09f1e42818f0642f9bdada709', 'request_id': 'req-8b7dc41e-b9cd-4525-8174-b1810e0f255e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:00.348151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8b7dc41e-b9cd-4525-8174-b1810e0f255e admin admin] The token cache is being invalidate because project a63757e09f1e42818f0642f9bdada709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:00.348698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8b7dc41e-b9cd-4525-8174-b1810e0f255e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:00.349428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8b7dc41e-b9cd-4525-8174-b1810e0f255e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:00.351240 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3328/6699] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:00 2022] DELETE /identity/v3/projects/a63757e09f1e42818f0642f9bdada709 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:00.355203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dc41e-b9cd-4525-8174-b1810e0f255e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:00.356675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8b7dc41e-b9cd-4525-8174-b1810e0f255e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:00.408792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1079a1-f93b-48b5-b2b0-7cd64ee1f07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:00.409466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1079a1-f93b-48b5-b2b0-7cd64ee1f07f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:00.409764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1079a1-f93b-48b5-b2b0-7cd64ee1f07f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:00.410198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1079a1-f93b-48b5-b2b0-7cd64ee1f07f admin admin] PATH_INFO: `/v3/users/b6f3338ad4324ffb95f9303054777214` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:00.412128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1079a1-f93b-48b5-b2b0-7cd64ee1f07f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f3338ad4324ffb95f9303054777214)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:00.414264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1079a1-f93b-48b5-b2b0-7cd64ee1f07f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:00.497378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dc41e-b9cd-4525-8174-b1810e0f255e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:00.501551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8c1079a1-f93b-48b5-b2b0-7cd64ee1f07f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f3338ad4324ffb95f9303054777214'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:00.509805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583369e0-789e-4669-8190-a9cf01891acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:00.510515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583369e0-789e-4669-8190-a9cf01891acf admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:00.510796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583369e0-789e-4669-8190-a9cf01891acf admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:00.511073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583369e0-789e-4669-8190-a9cf01891acf admin admin] PATH_INFO: `/v3/projects/4340387ae1664fcea21aae0086f48eb7/users/1edf1bfbce3147c88264957a272fbea0/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:00.530095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:00.537745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8c1079a1-f93b-48b5-b2b0-7cd64ee1f07f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f3338ad4324ffb95f9303054777214'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:00.538782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8c1079a1-f93b-48b5-b2b0-7cd64ee1f07f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f3338ad4324ffb95f9303054777214'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:00.551968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8c1079a1-f93b-48b5-b2b0-7cd64ee1f07f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f3338ad4324ffb95f9303054777214'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:00.553302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583369e0-789e-4669-8190-a9cf01891acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4340387ae1664fcea21aae0086f48eb7, user_id=1edf1bfbce3147c88264957a272fbea0, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:00.556240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583369e0-789e-4669-8190-a9cf01891acf admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:00.558462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8c1079a1-f93b-48b5-b2b0-7cd64ee1f07f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f3338ad4324ffb95f9303054777214'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:00.583517 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3329/6700] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:00 2022] PUT /identity/v3/projects/4340387ae1664fcea21aae0086f48eb7/users/1edf1bfbce3147c88264957a272fbea0/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:00.583517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583369e0-789e-4669-8190-a9cf01891acf admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:00.588185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-583369e0-789e-4669-8190-a9cf01891acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:00.596896 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3372/6701] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:00 2022] DELETE /identity/v3/users/b6f3338ad4324ffb95f9303054777214 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:00.598745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1079a1-f93b-48b5-b2b0-7cd64ee1f07f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:00.600329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8c1079a1-f93b-48b5-b2b0-7cd64ee1f07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:00.641641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:00.713224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1079a1-f93b-48b5-b2b0-7cd64ee1f07f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:00.720990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a7a78-1205-4776-a416-c7fd0a971ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:00.721846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a7a78-1205-4776-a416-c7fd0a971ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:00.722286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a7a78-1205-4776-a416-c7fd0a971ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:00.722697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a7a78-1205-4776-a416-c7fd0a971ab2 admin admin] PATH_INFO: `/v3/users/c498525520254d9ea65a13e5fd10ae9d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:00.724275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a7a78-1205-4776-a416-c7fd0a971ab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c498525520254d9ea65a13e5fd10ae9d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:00.727052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a7a78-1205-4776-a416-c7fd0a971ab2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:00.736179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583369e0-789e-4669-8190-a9cf01891acf admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:00.747902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc6fab-eaac-431b-9dd2-786b9221ae89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:00.750064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc6fab-eaac-431b-9dd2-786b9221ae89 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:00.750588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc6fab-eaac-431b-9dd2-786b9221ae89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:00.752128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc6fab-eaac-431b-9dd2-786b9221ae89 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:00.753942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc6fab-eaac-431b-9dd2-786b9221ae89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:00.758633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc6fab-eaac-431b-9dd2-786b9221ae89 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:00.815462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-681a7a78-1205-4776-a416-c7fd0a971ab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c498525520254d9ea65a13e5fd10ae9d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:00.821206 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3330/6702] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:00 2022] POST /identity/v3/projects => generated 387 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:00.822211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc6fab-eaac-431b-9dd2-786b9221ae89 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:00.824178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-16dc6fab-eaac-431b-9dd2-786b9221ae89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:00.835105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-681a7a78-1205-4776-a416-c7fd0a971ab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c498525520254d9ea65a13e5fd10ae9d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:00.836423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-681a7a78-1205-4776-a416-c7fd0a971ab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c498525520254d9ea65a13e5fd10ae9d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:00.857951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-681a7a78-1205-4776-a416-c7fd0a971ab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c498525520254d9ea65a13e5fd10ae9d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:00.859459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-681a7a78-1205-4776-a416-c7fd0a971ab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c498525520254d9ea65a13e5fd10ae9d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:00.877574 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3373/6703] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:00 2022] DELETE /identity/v3/users/c498525520254d9ea65a13e5fd10ae9d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:00.879355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271e436-275f-43c5-bc62-9fec8281a588 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:00.879754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271e436-275f-43c5-bc62-9fec8281a588 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:00.880178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271e436-275f-43c5-bc62-9fec8281a588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:00.931345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b271e436-275f-43c5-bc62-9fec8281a588 None None] MFA Rules not processed for user `1edf1bfbce3147c88264957a272fbea0`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:00.932910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b271e436-275f-43c5-bc62-9fec8281a588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:00.955804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc6fab-eaac-431b-9dd2-786b9221ae89 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:01.056243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a2bd6-8d28-418d-a121-e7107e6fa221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:01.056913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a2bd6-8d28-418d-a121-e7107e6fa221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:01.057225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a2bd6-8d28-418d-a121-e7107e6fa221 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:01.057491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a2bd6-8d28-418d-a121-e7107e6fa221 admin admin] PATH_INFO: `/v3/users/60dc563f96ef4421b61ad5645e0e5476` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:01.059560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a2bd6-8d28-418d-a121-e7107e6fa221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60dc563f96ef4421b61ad5645e0e5476)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:01.061497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a2bd6-8d28-418d-a121-e7107e6fa221 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:01.087795 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3374/6704] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:01.090783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271e436-275f-43c5-bc62-9fec8281a588 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:01.092723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b271e436-275f-43c5-bc62-9fec8281a588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:01.094201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:01.114208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271e436-275f-43c5-bc62-9fec8281a588 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:01.131462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309f6f3-4d76-40cd-80e6-fc0f1ec4dbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:01.133664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309f6f3-4d76-40cd-80e6-fc0f1ec4dbbc admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:01.136921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309f6f3-4d76-40cd-80e6-fc0f1ec4dbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:01.138285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309f6f3-4d76-40cd-80e6-fc0f1ec4dbbc admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:01.142338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-748a2bd6-8d28-418d-a121-e7107e6fa221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60dc563f96ef4421b61ad5645e0e5476'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:01.143365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-748a2bd6-8d28-418d-a121-e7107e6fa221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60dc563f96ef4421b61ad5645e0e5476'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:01.144870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309f6f3-4d76-40cd-80e6-fc0f1ec4dbbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:01.146907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309f6f3-4d76-40cd-80e6-fc0f1ec4dbbc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:01.176855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-748a2bd6-8d28-418d-a121-e7107e6fa221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60dc563f96ef4421b61ad5645e0e5476'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:01.178282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-748a2bd6-8d28-418d-a121-e7107e6fa221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60dc563f96ef4421b61ad5645e0e5476'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:01.195174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-748a2bd6-8d28-418d-a121-e7107e6fa221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60dc563f96ef4421b61ad5645e0e5476'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:01.217647 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3375/6705] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:01 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:01.220696 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3331/6706] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:00 2022] DELETE /identity/v3/users/60dc563f96ef4421b61ad5645e0e5476 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:01.226733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309f6f3-4d76-40cd-80e6-fc0f1ec4dbbc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:01.229934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b309f6f3-4d76-40cd-80e6-fc0f1ec4dbbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:01.231320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a2bd6-8d28-418d-a121-e7107e6fa221 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:01.233873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-748a2bd6-8d28-418d-a121-e7107e6fa221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:01.276831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309f6f3-4d76-40cd-80e6-fc0f1ec4dbbc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:01.312052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:01.359908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a2bd6-8d28-418d-a121-e7107e6fa221 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:01.367256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e606322-8759-42c1-af1c-e240b400f870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:01.368459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e606322-8759-42c1-af1c-e240b400f870 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:01.369041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e606322-8759-42c1-af1c-e240b400f870 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:01.370069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e606322-8759-42c1-af1c-e240b400f870 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:01.372555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e606322-8759-42c1-af1c-e240b400f870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:01.375508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e606322-8759-42c1-af1c-e240b400f870 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:01.379054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf6d2c-b59c-451d-9a53-a42e3cc821b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:01.379739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf6d2c-b59c-451d-9a53-a42e3cc821b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:01.380028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf6d2c-b59c-451d-9a53-a42e3cc821b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:01.380307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf6d2c-b59c-451d-9a53-a42e3cc821b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:01.380988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf6d2c-b59c-451d-9a53-a42e3cc821b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:01.393068 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3332/6707] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:01.395802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf6d2c-b59c-451d-9a53-a42e3cc821b1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:01.398156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aee52-3bbf-4cd7-aa24-9535a9a6c939 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:01.401353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aee52-3bbf-4cd7-aa24-9535a9a6c939 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:01.401639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aee52-3bbf-4cd7-aa24-9535a9a6c939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:01.426640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f85aee52-3bbf-4cd7-aa24-9535a9a6c939 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:01.428045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f85aee52-3bbf-4cd7-aa24-9535a9a6c939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:01.445826 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3376/6708] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:01 2022] POST /identity/v3/projects => generated 387 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:01.445826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf6d2c-b59c-451d-9a53-a42e3cc821b1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:01.456517 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3333/6709] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:01.459821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85aee52-3bbf-4cd7-aa24-9535a9a6c939 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:01.480743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85aee52-3bbf-4cd7-aa24-9535a9a6c939 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:01.628245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf6d2c-b59c-451d-9a53-a42e3cc821b1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:01.635068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7001f-7f14-4d24-a6cf-a0960705a99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:01.635641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef27ebc-b3f0-45d6-9f99-1b049d54bce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:01.636509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7001f-7f14-4d24-a6cf-a0960705a99e admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:01.636683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef27ebc-b3f0-45d6-9f99-1b049d54bce3 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:01.637080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef27ebc-b3f0-45d6-9f99-1b049d54bce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:01.640734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef27ebc-b3f0-45d6-9f99-1b049d54bce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:01.640734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef27ebc-b3f0-45d6-9f99-1b049d54bce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:01.640734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef27ebc-b3f0-45d6-9f99-1b049d54bce3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:01.641683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7001f-7f14-4d24-a6cf-a0960705a99e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:01.642213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7001f-7f14-4d24-a6cf-a0960705a99e admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:01.643038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7001f-7f14-4d24-a6cf-a0960705a99e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:01.645251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7001f-7f14-4d24-a6cf-a0960705a99e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:01.653852 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3377/6710] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:01.655402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef27ebc-b3f0-45d6-9f99-1b049d54bce3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:01.658809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-aef27ebc-b3f0-45d6-9f99-1b049d54bce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:01.701607 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3334/6711] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:01 2022] POST /identity/v3/users => generated 300 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:01.709486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7001f-7f14-4d24-a6cf-a0960705a99e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:01.713231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-79a7001f-7f14-4d24-a6cf-a0960705a99e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:01.733714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7001f-7f14-4d24-a6cf-a0960705a99e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:01.742376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef27ebc-b3f0-45d6-9f99-1b049d54bce3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:01.743122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d579d9-f7e7-4331-8d26-7a041d5d8ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:01.743670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d579d9-f7e7-4331-8d26-7a041d5d8ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:01.743990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d579d9-f7e7-4331-8d26-7a041d5d8ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:01.744370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d579d9-f7e7-4331-8d26-7a041d5d8ad8 admin admin] PATH_INFO: `/v3/projects/2bcc50c0b5b84fe6917da003112d706a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:01.745707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d579d9-f7e7-4331-8d26-7a041d5d8ad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bcc50c0b5b84fe6917da003112d706a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:01.748125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d579d9-f7e7-4331-8d26-7a041d5d8ad8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:01.751187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31890082-2ab8-4655-a7dc-d1bbcd36a851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:01.752656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31890082-2ab8-4655-a7dc-d1bbcd36a851 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:01.753155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31890082-2ab8-4655-a7dc-d1bbcd36a851 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:01.753632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31890082-2ab8-4655-a7dc-d1bbcd36a851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:01.767652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31890082-2ab8-4655-a7dc-d1bbcd36a851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:01.769119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31890082-2ab8-4655-a7dc-d1bbcd36a851 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:01.773107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:01.783999 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3378/6712] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:01.785426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31890082-2ab8-4655-a7dc-d1bbcd36a851 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:01.787124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-31890082-2ab8-4655-a7dc-d1bbcd36a851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:01.806000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31890082-2ab8-4655-a7dc-d1bbcd36a851 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:01.811727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030fb5f-9322-46cd-9beb-0ba0085111ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:01.813075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030fb5f-9322-46cd-9beb-0ba0085111ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:01.813855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030fb5f-9322-46cd-9beb-0ba0085111ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:01.814240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030fb5f-9322-46cd-9beb-0ba0085111ae admin admin] PATH_INFO: `/v3/projects/0058630bad0b46a888a380a71085bd41` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:01.817124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030fb5f-9322-46cd-9beb-0ba0085111ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=0058630bad0b46a888a380a71085bd41)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:01.821791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030fb5f-9322-46cd-9beb-0ba0085111ae admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:01.855059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b3d579d9-f7e7-4331-8d26-7a041d5d8ad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bcc50c0b5b84fe6917da003112d706a', 'request_id': 'req-b3d579d9-f7e7-4331-8d26-7a041d5d8ad8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:01.867180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b3d579d9-f7e7-4331-8d26-7a041d5d8ad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bcc50c0b5b84fe6917da003112d706a', 'request_id': 'req-b3d579d9-f7e7-4331-8d26-7a041d5d8ad8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:01.876407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b3d579d9-f7e7-4331-8d26-7a041d5d8ad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bcc50c0b5b84fe6917da003112d706a', 'request_id': 'req-b3d579d9-f7e7-4331-8d26-7a041d5d8ad8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:01.894336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b3d579d9-f7e7-4331-8d26-7a041d5d8ad8 admin admin] The token cache is being invalidate because project 2bcc50c0b5b84fe6917da003112d706a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:01.894745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b3d579d9-f7e7-4331-8d26-7a041d5d8ad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:01.895527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b3d579d9-f7e7-4331-8d26-7a041d5d8ad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:01.900728 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3335/6713] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:01 2022] DELETE /identity/v3/projects/2bcc50c0b5b84fe6917da003112d706a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:01.902170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d579d9-f7e7-4331-8d26-7a041d5d8ad8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:01.904570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b3d579d9-f7e7-4331-8d26-7a041d5d8ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:01.906257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:01.939416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8030fb5f-9322-46cd-9beb-0ba0085111ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0058630bad0b46a888a380a71085bd41', 'request_id': 'req-8030fb5f-9322-46cd-9beb-0ba0085111ae'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:01.949160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8030fb5f-9322-46cd-9beb-0ba0085111ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0058630bad0b46a888a380a71085bd41', 'request_id': 'req-8030fb5f-9322-46cd-9beb-0ba0085111ae'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:01.962400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8030fb5f-9322-46cd-9beb-0ba0085111ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0058630bad0b46a888a380a71085bd41', 'request_id': 'req-8030fb5f-9322-46cd-9beb-0ba0085111ae'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:01.982055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8030fb5f-9322-46cd-9beb-0ba0085111ae admin admin] The token cache is being invalidate because project 0058630bad0b46a888a380a71085bd41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:01.982584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8030fb5f-9322-46cd-9beb-0ba0085111ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:01.983480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8030fb5f-9322-46cd-9beb-0ba0085111ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:01.985750 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3379/6714] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:01 2022] DELETE /identity/v3/projects/0058630bad0b46a888a380a71085bd41 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:01.987528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030fb5f-9322-46cd-9beb-0ba0085111ae admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:01.989474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8030fb5f-9322-46cd-9beb-0ba0085111ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:02.087071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d579d9-f7e7-4331-8d26-7a041d5d8ad8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:02.181383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030fb5f-9322-46cd-9beb-0ba0085111ae admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:02.187774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cfa27-7d96-4362-b87f-debc65f0a829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:02.190843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cfa27-7d96-4362-b87f-debc65f0a829 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:02.190843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cfa27-7d96-4362-b87f-debc65f0a829 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:02.190843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cfa27-7d96-4362-b87f-debc65f0a829 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:02.190843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cfa27-7d96-4362-b87f-debc65f0a829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:02.193070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cfa27-7d96-4362-b87f-debc65f0a829 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:02.209824 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3380/6715] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:02.209824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc432d33-ee70-4d18-b5b3-ae589bdabfe7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:02.209824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc432d33-ee70-4d18-b5b3-ae589bdabfe7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:02.209824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc432d33-ee70-4d18-b5b3-ae589bdabfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:02.236072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-dc432d33-ee70-4d18-b5b3-ae589bdabfe7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:02.237414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-dc432d33-ee70-4d18-b5b3-ae589bdabfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:02.247238 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3381/6716] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:02.256097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63fe4c-1773-4599-acd8-bfc3e6300df9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:02.256489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63fe4c-1773-4599-acd8-bfc3e6300df9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:02.256864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63fe4c-1773-4599-acd8-bfc3e6300df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:02.257474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a69783-cdb4-4049-8cc7-80e565f054ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:02.266504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a69783-cdb4-4049-8cc7-80e565f054ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:02.267095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a69783-cdb4-4049-8cc7-80e565f054ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:02.267933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a69783-cdb4-4049-8cc7-80e565f054ff admin admin] PATH_INFO: `/v3/projects/7b23665bdbc345a4822140a8738f0b05/users/e658e7338150409881a13dd1c81a8cc7/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:02.285458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ad63fe4c-1773-4599-acd8-bfc3e6300df9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:02.286958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ad63fe4c-1773-4599-acd8-bfc3e6300df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:02.288401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a69783-cdb4-4049-8cc7-80e565f054ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b23665bdbc345a4822140a8738f0b05, user_id=e658e7338150409881a13dd1c81a8cc7, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:02.291735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a69783-cdb4-4049-8cc7-80e565f054ff admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:02.297653 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3382/6717] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:02.299637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63fe4c-1773-4599-acd8-bfc3e6300df9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:02.301793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ad63fe4c-1773-4599-acd8-bfc3e6300df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:02.312121 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3336/6718] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:01 2022] PUT /identity/v3/projects/7b23665bdbc345a4822140a8738f0b05/users/e658e7338150409881a13dd1c81a8cc7/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:02.313515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a69783-cdb4-4049-8cc7-80e565f054ff admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:02.324855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63fe4c-1773-4599-acd8-bfc3e6300df9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:02.367944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:02.408676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d6030-4861-42ea-a48c-76d52c12d989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:02.409644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d6030-4861-42ea-a48c-76d52c12d989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:02.410146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d6030-4861-42ea-a48c-76d52c12d989 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:02.410601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d6030-4861-42ea-a48c-76d52c12d989 admin admin] PATH_INFO: `/v3/projects/16545b352e5949c8b1b79e7ec54c359f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:02.412224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d6030-4861-42ea-a48c-76d52c12d989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16545b352e5949c8b1b79e7ec54c359f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:02.414458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d6030-4861-42ea-a48c-76d52c12d989 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:02.418164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a69783-cdb4-4049-8cc7-80e565f054ff admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:02.424612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801a705-9870-4736-b109-3ec3576abcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:02.425965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801a705-9870-4736-b109-3ec3576abcb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:02.426265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801a705-9870-4736-b109-3ec3576abcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:02.426556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801a705-9870-4736-b109-3ec3576abcb0 admin admin] PATH_INFO: `/v3/projects/57520400ccaf48ecb940a70430535482/users/529c70a5ba704f0b97b11fdfe186f011/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:02.451194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801a705-9870-4736-b109-3ec3576abcb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57520400ccaf48ecb940a70430535482, user_id=529c70a5ba704f0b97b11fdfe186f011, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:02.455401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801a705-9870-4736-b109-3ec3576abcb0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:02.483040 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3337/6719] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:02 2022] PUT /identity/v3/projects/57520400ccaf48ecb940a70430535482/users/529c70a5ba704f0b97b11fdfe186f011/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:02.485735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12c13f-d825-49ce-b7b2-d43be5a8e50c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:02.486027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12c13f-d825-49ce-b7b2-d43be5a8e50c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:02.486298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12c13f-d825-49ce-b7b2-d43be5a8e50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:02.488927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:02.493657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8f9d6030-4861-42ea-a48c-76d52c12d989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16545b352e5949c8b1b79e7ec54c359f', 'request_id': 'req-8f9d6030-4861-42ea-a48c-76d52c12d989'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:02.504489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8f9d6030-4861-42ea-a48c-76d52c12d989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16545b352e5949c8b1b79e7ec54c359f', 'request_id': 'req-8f9d6030-4861-42ea-a48c-76d52c12d989'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:02.509921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3d12c13f-d825-49ce-b7b2-d43be5a8e50c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:02.511248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3d12c13f-d825-49ce-b7b2-d43be5a8e50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:02.518435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8f9d6030-4861-42ea-a48c-76d52c12d989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16545b352e5949c8b1b79e7ec54c359f', 'request_id': 'req-8f9d6030-4861-42ea-a48c-76d52c12d989'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:02.550261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8f9d6030-4861-42ea-a48c-76d52c12d989 admin admin] The token cache is being invalidate because project 16545b352e5949c8b1b79e7ec54c359f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:02.550590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8f9d6030-4861-42ea-a48c-76d52c12d989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:02.552011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8f9d6030-4861-42ea-a48c-76d52c12d989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:02.554273 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3383/6720] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:02 2022] DELETE /identity/v3/projects/16545b352e5949c8b1b79e7ec54c359f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:02.555817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9f688-a997-4dc5-a482-dfd2631782d4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:02.556248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9f688-a997-4dc5-a482-dfd2631782d4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:02.556575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9f688-a997-4dc5-a482-dfd2631782d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:02.586630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-63f9f688-a997-4dc5-a482-dfd2631782d4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:02.587982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-63f9f688-a997-4dc5-a482-dfd2631782d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:02.632603 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3338/6721] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:02.634454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7fc98-ce4d-4fda-8a46-a239a6f8d459 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:02.634941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7fc98-ce4d-4fda-8a46-a239a6f8d459 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:02.635444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7fc98-ce4d-4fda-8a46-a239a6f8d459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:02.674846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4be7fc98-ce4d-4fda-8a46-a239a6f8d459 None None] MFA Rules not processed for user `e658e7338150409881a13dd1c81a8cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:02.677196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4be7fc98-ce4d-4fda-8a46-a239a6f8d459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:02.717139 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3384/6722] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:02.723931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9f688-a997-4dc5-a482-dfd2631782d4 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:02.725513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-63f9f688-a997-4dc5-a482-dfd2631782d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:02.741624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9f688-a997-4dc5-a482-dfd2631782d4 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:02.748618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30dad8-f6ef-46c4-a598-e963d807030a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:02.749900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30dad8-f6ef-46c4-a598-e963d807030a admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:02.750197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30dad8-f6ef-46c4-a598-e963d807030a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:02.750475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30dad8-f6ef-46c4-a598-e963d807030a admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:02.751178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30dad8-f6ef-46c4-a598-e963d807030a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:02.753682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30dad8-f6ef-46c4-a598-e963d807030a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:02.762191 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3339/6723] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:02.764053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece1017-3d34-43ff-b487-37b5dfe99380 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:02.764559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece1017-3d34-43ff-b487-37b5dfe99380 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:02.765582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece1017-3d34-43ff-b487-37b5dfe99380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:02.770798 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3385/6724] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:02.770798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30dad8-f6ef-46c4-a598-e963d807030a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:02.787231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30dad8-f6ef-46c4-a598-e963d807030a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:02.797507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fece1017-3d34-43ff-b487-37b5dfe99380 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:02.798796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fece1017-3d34-43ff-b487-37b5dfe99380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:02.812006 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3340/6725] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:02.812285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92987c63-a874-42a0-9215-2b28bc0500cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:02.812411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece1017-3d34-43ff-b487-37b5dfe99380 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:02.812935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92987c63-a874-42a0-9215-2b28bc0500cb admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:02.813236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92987c63-a874-42a0-9215-2b28bc0500cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:02.817315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92987c63-a874-42a0-9215-2b28bc0500cb admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:02.818041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92987c63-a874-42a0-9215-2b28bc0500cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:02.818375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92987c63-a874-42a0-9215-2b28bc0500cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:02.829481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece1017-3d34-43ff-b487-37b5dfe99380 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:02.833144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92987c63-a874-42a0-9215-2b28bc0500cb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:02.837461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7de440-44c7-4bed-b395-5212ccc8962d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:02.838032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7de440-44c7-4bed-b395-5212ccc8962d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:02.838322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7de440-44c7-4bed-b395-5212ccc8962d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:02.838600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7de440-44c7-4bed-b395-5212ccc8962d admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:02.839501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7de440-44c7-4bed-b395-5212ccc8962d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:02.839813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7de440-44c7-4bed-b395-5212ccc8962d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:02.841513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7de440-44c7-4bed-b395-5212ccc8962d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:02.850922 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3386/6726] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:02.850922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92987c63-a874-42a0-9215-2b28bc0500cb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:02.859617 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3341/6727] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:02.859617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7de440-44c7-4bed-b395-5212ccc8962d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:02.859617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1c7de440-44c7-4bed-b395-5212ccc8962d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:02.859941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92987c63-a874-42a0-9215-2b28bc0500cb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:02.867816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e4bd4-643d-44b5-9775-654841ebe7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:02.869703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e4bd4-643d-44b5-9775-654841ebe7b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:02.869703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e4bd4-643d-44b5-9775-654841ebe7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:02.869703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e4bd4-643d-44b5-9775-654841ebe7b3 admin admin] PATH_INFO: `/v3/projects/57520400ccaf48ecb940a70430535482/users/529c70a5ba704f0b97b11fdfe186f011/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:02.872167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e4bd4-643d-44b5-9775-654841ebe7b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57520400ccaf48ecb940a70430535482, user_id=529c70a5ba704f0b97b11fdfe186f011, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:02.877361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e4bd4-643d-44b5-9775-654841ebe7b3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:02.892743 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3387/6728] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:02 2022] PUT /identity/v3/projects/57520400ccaf48ecb940a70430535482/users/529c70a5ba704f0b97b11fdfe186f011/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:02.894332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9333fdf-f0a2-4e74-b501-2f198f237ca0 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:02.894711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9333fdf-f0a2-4e74-b501-2f198f237ca0 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:02.895063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9333fdf-f0a2-4e74-b501-2f198f237ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:02.905172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:02.919737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f9333fdf-f0a2-4e74-b501-2f198f237ca0 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:02.920848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f9333fdf-f0a2-4e74-b501-2f198f237ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:02.969608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7de440-44c7-4bed-b395-5212ccc8962d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:03.039066 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3388/6729] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:03.040370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9333fdf-f0a2-4e74-b501-2f198f237ca0 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:03.054669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9333fdf-f0a2-4e74-b501-2f198f237ca0 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:03.062735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8bc56-28c9-4b08-8693-e23662520953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:03.064103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8bc56-28c9-4b08-8693-e23662520953 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:03.064385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8bc56-28c9-4b08-8693-e23662520953 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:03.064657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8bc56-28c9-4b08-8693-e23662520953 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:03.065323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8bc56-28c9-4b08-8693-e23662520953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:03.067274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8bc56-28c9-4b08-8693-e23662520953 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:03.068254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6995d-f770-41c8-9a46-98235652c403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:03.069179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6995d-f770-41c8-9a46-98235652c403 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:03.069461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6995d-f770-41c8-9a46-98235652c403 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:03.069737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6995d-f770-41c8-9a46-98235652c403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:03.125907 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3389/6730] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:03 2022] POST /identity/v3/projects => generated 365 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:03.127096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8bc56-28c9-4b08-8693-e23662520953 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:03.158022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:03.182339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6995d-f770-41c8-9a46-98235652c403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:03.184726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6995d-f770-41c8-9a46-98235652c403 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:03.196275 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3342/6731] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:03.197806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96619e-ee82-4362-95dc-4694ce0707ba None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:03.198104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96619e-ee82-4362-95dc-4694ce0707ba None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:03.198392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96619e-ee82-4362-95dc-4694ce0707ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:03.228579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8bc56-28c9-4b08-8693-e23662520953 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:03.231512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bd96619e-ee82-4362-95dc-4694ce0707ba None None] MFA Rules not processed for user `529c70a5ba704f0b97b11fdfe186f011`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:03.232760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bd96619e-ee82-4362-95dc-4694ce0707ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:03.237028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167e626-6656-4a0a-9447-125c1a34e803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:03.238713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167e626-6656-4a0a-9447-125c1a34e803 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:03.239258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167e626-6656-4a0a-9447-125c1a34e803 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:03.240006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167e626-6656-4a0a-9447-125c1a34e803 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:03.241090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167e626-6656-4a0a-9447-125c1a34e803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:03.244382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167e626-6656-4a0a-9447-125c1a34e803 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:03.308374 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3390/6732] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:03 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:03.308374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167e626-6656-4a0a-9447-125c1a34e803 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:03.317765 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3343/6733] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:03.319604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96619e-ee82-4362-95dc-4694ce0707ba None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:03.339081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96619e-ee82-4362-95dc-4694ce0707ba None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:03.380841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:03.435119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167e626-6656-4a0a-9447-125c1a34e803 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:03.451464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04a29b-85c6-45b0-bf5c-46db01c15206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:03.452107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04a29b-85c6-45b0-bf5c-46db01c15206 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:03.452412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04a29b-85c6-45b0-bf5c-46db01c15206 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:03.452687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04a29b-85c6-45b0-bf5c-46db01c15206 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:03.453402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04a29b-85c6-45b0-bf5c-46db01c15206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:03.453708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04a29b-85c6-45b0-bf5c-46db01c15206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:03.455390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04a29b-85c6-45b0-bf5c-46db01c15206 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:03.469103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f35dd-0017-44c5-8fff-993317e64f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:03.469323 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3391/6734] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:03.470155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04a29b-85c6-45b0-bf5c-46db01c15206 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:03.470713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f35dd-0017-44c5-8fff-993317e64f85 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:03.471098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f35dd-0017-44c5-8fff-993317e64f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:03.471619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f35dd-0017-44c5-8fff-993317e64f85 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:03.472396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f35dd-0017-44c5-8fff-993317e64f85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:03.475099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f35dd-0017-44c5-8fff-993317e64f85 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:03.489770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04a29b-85c6-45b0-bf5c-46db01c15206 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:03.497053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1592512-8a5e-41d5-804a-ef9ffe886ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:03.498151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1592512-8a5e-41d5-804a-ef9ffe886ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:03.498573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1592512-8a5e-41d5-804a-ef9ffe886ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:03.499011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1592512-8a5e-41d5-804a-ef9ffe886ca7 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:03.500454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1592512-8a5e-41d5-804a-ef9ffe886ca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:03.502812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1592512-8a5e-41d5-804a-ef9ffe886ca7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:03.508677 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3344/6735] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:03 2022] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:03.509880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f35dd-0017-44c5-8fff-993317e64f85 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:03.531240 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3392/6736] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:03 2022] POST /identity/v3/users => generated 294 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:03.533213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1592512-8a5e-41d5-804a-ef9ffe886ca7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:03.548724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1592512-8a5e-41d5-804a-ef9ffe886ca7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:03.555077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8c97f-938c-4889-81c4-f8b26f8bc5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:03.556491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8c97f-938c-4889-81c4-f8b26f8bc5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:03.557285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8c97f-938c-4889-81c4-f8b26f8bc5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:03.557889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8c97f-938c-4889-81c4-f8b26f8bc5c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:03.558685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8c97f-938c-4889-81c4-f8b26f8bc5c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:03.561664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8c97f-938c-4889-81c4-f8b26f8bc5c1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:03.606321 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3393/6737] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:03 2022] POST /identity/v3/projects => generated 359 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:03.607684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8c97f-938c-4889-81c4-f8b26f8bc5c1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:03.611020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f35dd-0017-44c5-8fff-993317e64f85 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:03.705696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844918f-eab8-4e17-9a36-82b99f3d7395 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529c70a5ba704f0b97b11fdfe186f011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57520400ccaf48ecb940a70430535482', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:03.706350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844918f-eab8-4e17-9a36-82b99f3d7395 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:03.706646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844918f-eab8-4e17-9a36-82b99f3d7395 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:03.706936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844918f-eab8-4e17-9a36-82b99f3d7395 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:03.707657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844918f-eab8-4e17-9a36-82b99f3d7395 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:03.709794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844918f-eab8-4e17-9a36-82b99f3d7395 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:03.722006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:03.739581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8c97f-938c-4889-81c4-f8b26f8bc5c1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:03.746614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb817c-5a7f-426d-b0f0-67e988d6b804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:03.747541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb817c-5a7f-426d-b0f0-67e988d6b804 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:03.747941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb817c-5a7f-426d-b0f0-67e988d6b804 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:03.748321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb817c-5a7f-426d-b0f0-67e988d6b804 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:03.750150 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3345/6738] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:03 2022] POST /identity/v3/projects => generated 358 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:03.750528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb817c-5a7f-426d-b0f0-67e988d6b804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:03.751158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844918f-eab8-4e17-9a36-82b99f3d7395 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:03.752782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb817c-5a7f-426d-b0f0-67e988d6b804 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:03.765853 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3394/6739] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:03.766849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb817c-5a7f-426d-b0f0-67e988d6b804 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:03.791640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb817c-5a7f-426d-b0f0-67e988d6b804 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:03.814588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:03.846166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844918f-eab8-4e17-9a36-82b99f3d7395 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:03.852091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42552eb-357f-4755-9de1-e0afefbc3497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:03.853081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42552eb-357f-4755-9de1-e0afefbc3497 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:03.853666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42552eb-357f-4755-9de1-e0afefbc3497 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:03.853956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42552eb-357f-4755-9de1-e0afefbc3497 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:03.856042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42552eb-357f-4755-9de1-e0afefbc3497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:03.858376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42552eb-357f-4755-9de1-e0afefbc3497 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:03.879602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152765ea-8ccd-4057-8f40-7842d54ffb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:03.880252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152765ea-8ccd-4057-8f40-7842d54ffb68 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:03.880540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152765ea-8ccd-4057-8f40-7842d54ffb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:03.880818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152765ea-8ccd-4057-8f40-7842d54ffb68 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:03.881666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152765ea-8ccd-4057-8f40-7842d54ffb68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:03.882917 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3346/6740] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:03.883686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152765ea-8ccd-4057-8f40-7842d54ffb68 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:03.884210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42552eb-357f-4755-9de1-e0afefbc3497 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:03.916064 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3395/6741] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:03 2022] POST /identity/v3/users => generated 280 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:03.920430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152765ea-8ccd-4057-8f40-7842d54ffb68 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:03.935613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152765ea-8ccd-4057-8f40-7842d54ffb68 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:03.940923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461aae4-2278-40c6-8779-00a9c8fcf86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:03.941582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461aae4-2278-40c6-8779-00a9c8fcf86a admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:03.941867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461aae4-2278-40c6-8779-00a9c8fcf86a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:03.942145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461aae4-2278-40c6-8779-00a9c8fcf86a admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:03.943271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461aae4-2278-40c6-8779-00a9c8fcf86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:03.945981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461aae4-2278-40c6-8779-00a9c8fcf86a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:03.972092 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3396/6742] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:03.974266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461aae4-2278-40c6-8779-00a9c8fcf86a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:03.986543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42552eb-357f-4755-9de1-e0afefbc3497 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:03.994243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45462bfb-e571-4412-a9b0-d5c2e17053b2 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529c70a5ba704f0b97b11fdfe186f011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57520400ccaf48ecb940a70430535482', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:03.995398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45462bfb-e571-4412-a9b0-d5c2e17053b2 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:03.995799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461aae4-2278-40c6-8779-00a9c8fcf86a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:03.996174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45462bfb-e571-4412-a9b0-d5c2e17053b2 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:03.996715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45462bfb-e571-4412-a9b0-d5c2e17053b2 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] PATH_INFO: `/v3/projects/3ca75df14b44477583405fd60973145e/tags/tempest-tag-1013837428` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:03.998654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45462bfb-e571-4412-a9b0-d5c2e17053b2 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=3ca75df14b44477583405fd60973145e, value=tempest-tag-1013837428)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:04.000983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bd91c-d5e5-4c40-b868-576784d1793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:04.001621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bd91c-d5e5-4c40-b868-576784d1793a admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:04.002208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bd91c-d5e5-4c40-b868-576784d1793a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:04.002354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45462bfb-e571-4412-a9b0-d5c2e17053b2 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:04.002480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bd91c-d5e5-4c40-b868-576784d1793a admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:04.003133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bd91c-d5e5-4c40-b868-576784d1793a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:04.011818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bd91c-d5e5-4c40-b868-576784d1793a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:04.021482 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3397/6743] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:04.021482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bd91c-d5e5-4c40-b868-576784d1793a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:04.034201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bd91c-d5e5-4c40-b868-576784d1793a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:04.047737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18823e54-01a0-4a0f-aa1e-62974c58de57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:04.048394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18823e54-01a0-4a0f-aa1e-62974c58de57 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:04.048681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18823e54-01a0-4a0f-aa1e-62974c58de57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:04.048961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18823e54-01a0-4a0f-aa1e-62974c58de57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:04.049734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18823e54-01a0-4a0f-aa1e-62974c58de57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:04.051430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18823e54-01a0-4a0f-aa1e-62974c58de57 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:04.063575 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3398/6744] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:04.064608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18823e54-01a0-4a0f-aa1e-62974c58de57 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:04.078927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18823e54-01a0-4a0f-aa1e-62974c58de57 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:04.086692 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-45462bfb-e571-4412-a9b0-d5c2e17053b2 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1013837428. To ensure interoperability, identifiers should be a valid uuid. Jul 30 21:28:04.086692 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 30 21:28:04.086692 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:28:04.088883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a81430-1b7e-40b3-b1b8-f9f649cf158f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:04.090129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a81430-1b7e-40b3-b1b8-f9f649cf158f admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:04.090544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a81430-1b7e-40b3-b1b8-f9f649cf158f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:04.091089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a81430-1b7e-40b3-b1b8-f9f649cf158f admin admin] PATH_INFO: `/v3/projects/60d48ba124cd4fa0b42cdaaa91ded769/users/b7aa09bea7b64b4aac2ca6576d210616/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:04.095132 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3347/6745] 10.222.0.17 () {60 vars in 1333 bytes} [Sat Jul 30 21:28:03 2022] PUT /identity/v3/projects/3ca75df14b44477583405fd60973145e/tags/tempest-tag-1013837428 => generated 0 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Jul 30 21:28:04.096116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45462bfb-e571-4412-a9b0-d5c2e17053b2 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:04.108467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45462bfb-e571-4412-a9b0-d5c2e17053b2 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:04.113576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a81430-1b7e-40b3-b1b8-f9f649cf158f admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d48ba124cd4fa0b42cdaaa91ded769, user_id=b7aa09bea7b64b4aac2ca6576d210616, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:04.116315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd8b9f-528e-419d-b790-7d32fbea165c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:04.118642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a81430-1b7e-40b3-b1b8-f9f649cf158f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:04.118896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd8b9f-528e-419d-b790-7d32fbea165c admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:04.119807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd8b9f-528e-419d-b790-7d32fbea165c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:04.120412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd8b9f-528e-419d-b790-7d32fbea165c admin admin] PATH_INFO: `/v3/projects/ef9817a9cdcb4afcba68c3691ab7c1b5/users/13fd72602cb94b47a15831489d7762d0/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:04.135806 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3399/6746] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:04 2022] PUT /identity/v3/projects/60d48ba124cd4fa0b42cdaaa91ded769/users/b7aa09bea7b64b4aac2ca6576d210616/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:04.137033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a81430-1b7e-40b3-b1b8-f9f649cf158f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:04.139094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd8b9f-528e-419d-b790-7d32fbea165c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef9817a9cdcb4afcba68c3691ab7c1b5, user_id=13fd72602cb94b47a15831489d7762d0, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:04.142381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd8b9f-528e-419d-b790-7d32fbea165c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:04.162394 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3348/6747] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:04 2022] PUT /identity/v3/projects/ef9817a9cdcb4afcba68c3691ab7c1b5/users/13fd72602cb94b47a15831489d7762d0/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:04.163733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd8b9f-528e-419d-b790-7d32fbea165c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:04.239229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a81430-1b7e-40b3-b1b8-f9f649cf158f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:04.271957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:04.291644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd8b9f-528e-419d-b790-7d32fbea165c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:04.298755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe7ea6-1953-4684-8f3d-1a5ea991d632 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529c70a5ba704f0b97b11fdfe186f011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57520400ccaf48ecb940a70430535482', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:04.299969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe7ea6-1953-4684-8f3d-1a5ea991d632 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:04.300453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe7ea6-1953-4684-8f3d-1a5ea991d632 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:04.300891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe7ea6-1953-4684-8f3d-1a5ea991d632 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] PATH_INFO: `/v3/projects/3ca75df14b44477583405fd60973145e/tags/tempest-tag-1013837428` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:04.318454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe7ea6-1953-4684-8f3d-1a5ea991d632 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=3ca75df14b44477583405fd60973145e, value=tempest-tag-1013837428)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:04.321861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe7ea6-1953-4684-8f3d-1a5ea991d632 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:04.326674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:04.331110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a14fe1-9501-4d44-ad78-e6ac943c9666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:04.331918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a14fe1-9501-4d44-ad78-e6ac943c9666 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:04.332209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a14fe1-9501-4d44-ad78-e6ac943c9666 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:04.335929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a14fe1-9501-4d44-ad78-e6ac943c9666 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:04.338383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a14fe1-9501-4d44-ad78-e6ac943c9666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:04.343815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a14fe1-9501-4d44-ad78-e6ac943c9666 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:04.345001 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3349/6748] 10.222.0.17 () {58 vars in 1314 bytes} [Sat Jul 30 21:28:04 2022] GET /identity/v3/projects/3ca75df14b44477583405fd60973145e/tags/tempest-tag-1013837428 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:04.346986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e559cfd-bd57-4fbc-ac1f-9276e9ed2f61 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:04.347591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e559cfd-bd57-4fbc-ac1f-9276e9ed2f61 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:04.348055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e559cfd-bd57-4fbc-ac1f-9276e9ed2f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:04.358820 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3400/6749] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:04.359918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5dc99-7c49-42e9-a4eb-2028d950cac7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:04.360221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5dc99-7c49-42e9-a4eb-2028d950cac7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:04.360693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5dc99-7c49-42e9-a4eb-2028d950cac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:04.411464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-44d5dc99-7c49-42e9-a4eb-2028d950cac7 None None] MFA Rules not processed for user `13fd72602cb94b47a15831489d7762d0`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:04.413193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-44d5dc99-7c49-42e9-a4eb-2028d950cac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:04.430017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2e559cfd-bd57-4fbc-ac1f-9276e9ed2f61 None None] MFA Rules not processed for user `b7aa09bea7b64b4aac2ca6576d210616`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:04.433355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2e559cfd-bd57-4fbc-ac1f-9276e9ed2f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:04.583306 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3401/6750] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:04.583306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5dc99-7c49-42e9-a4eb-2028d950cac7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:04.585406 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3350/6751] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:04.585406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e559cfd-bd57-4fbc-ac1f-9276e9ed2f61 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:04.607519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5dc99-7c49-42e9-a4eb-2028d950cac7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:04.613914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b27e17-c552-4206-af37-8630fa166379 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529c70a5ba704f0b97b11fdfe186f011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57520400ccaf48ecb940a70430535482', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:04.614744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b27e17-c552-4206-af37-8630fa166379 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:04.615128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b27e17-c552-4206-af37-8630fa166379 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:04.616198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b27e17-c552-4206-af37-8630fa166379 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] PATH_INFO: `/v3/projects/3ca75df14b44477583405fd60973145e/tags` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:04.617968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b27e17-c552-4206-af37-8630fa166379 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=3ca75df14b44477583405fd60973145e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:04.621959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b27e17-c552-4206-af37-8630fa166379 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:04.622157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e559cfd-bd57-4fbc-ac1f-9276e9ed2f61 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:04.632614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd063a-b600-44ca-823a-699af05eeab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:04.633527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd063a-b600-44ca-823a-699af05eeab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:04.633955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd063a-b600-44ca-823a-699af05eeab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:04.634347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd063a-b600-44ca-823a-699af05eeab0 admin admin] PATH_INFO: `/v3/projects/ddb9576c03ff4f3f9944b98fd169fe22/users/1afc5ea6aa2544699a3030807e3d4219/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:04.681689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd063a-b600-44ca-823a-699af05eeab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb9576c03ff4f3f9944b98fd169fe22, user_id=1afc5ea6aa2544699a3030807e3d4219, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:04.688165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd063a-b600-44ca-823a-699af05eeab0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:04.721498 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3351/6752] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:04 2022] PUT /identity/v3/projects/ddb9576c03ff4f3f9944b98fd169fe22/users/1afc5ea6aa2544699a3030807e3d4219/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:04.721498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd063a-b600-44ca-823a-699af05eeab0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:04.741847 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3402/6753] 10.222.0.17 () {60 vars in 1265 bytes} [Sat Jul 30 21:28:04 2022] PUT /identity/v3/projects/3ca75df14b44477583405fd60973145e/tags => generated 142 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:04.741847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b27e17-c552-4206-af37-8630fa166379 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:04.775441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b27e17-c552-4206-af37-8630fa166379 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:04.802346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd063a-b600-44ca-823a-699af05eeab0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:04.809773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93d714-f3c9-4d1d-8f69-1d0423e01bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:04.810472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93d714-f3c9-4d1d-8f69-1d0423e01bda admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:04.811200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93d714-f3c9-4d1d-8f69-1d0423e01bda admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:04.811520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93d714-f3c9-4d1d-8f69-1d0423e01bda admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:04.812787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93d714-f3c9-4d1d-8f69-1d0423e01bda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:04.814793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93d714-f3c9-4d1d-8f69-1d0423e01bda admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:04.873018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4b9ec-15f6-4698-ad99-3d22c96aa761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:04.875769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4b9ec-15f6-4698-ad99-3d22c96aa761 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:04.876539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4b9ec-15f6-4698-ad99-3d22c96aa761 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:04.877299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4b9ec-15f6-4698-ad99-3d22c96aa761 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:04.878338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4b9ec-15f6-4698-ad99-3d22c96aa761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:04.882098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4b9ec-15f6-4698-ad99-3d22c96aa761 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:04.885365 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3352/6754] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:04 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:04.886700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ea58d-337d-42e6-a033-ec6b7513b611 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:04.886999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ea58d-337d-42e6-a033-ec6b7513b611 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:04.887304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ea58d-337d-42e6-a033-ec6b7513b611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:04.932452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:04.938020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b81ea58d-337d-42e6-a033-ec6b7513b611 None None] MFA Rules not processed for user `1afc5ea6aa2544699a3030807e3d4219`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:04.941767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b81ea58d-337d-42e6-a033-ec6b7513b611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:04.947475 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3403/6755] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:04 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:04.947475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4b9ec-15f6-4698-ad99-3d22c96aa761 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:05.034341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:05.057239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4b9ec-15f6-4698-ad99-3d22c96aa761 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:05.071635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13731f55-21b5-4477-a0c0-46ddd2ea4b66 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529c70a5ba704f0b97b11fdfe186f011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57520400ccaf48ecb940a70430535482', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:05.073177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13731f55-21b5-4477-a0c0-46ddd2ea4b66 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:05.073811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13731f55-21b5-4477-a0c0-46ddd2ea4b66 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:05.074597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13731f55-21b5-4477-a0c0-46ddd2ea4b66 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] PATH_INFO: `/v3/projects/3ca75df14b44477583405fd60973145e/tags` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:05.101518 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3353/6756] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:04 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:05.101518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ea58d-337d-42e6-a033-ec6b7513b611 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:05.105743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13731f55-21b5-4477-a0c0-46ddd2ea4b66 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=3ca75df14b44477583405fd60973145e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:05.105743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13731f55-21b5-4477-a0c0-46ddd2ea4b66 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:05.133007 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3404/6757] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:28:04 2022] GET /identity/v3/projects/3ca75df14b44477583405fd60973145e/tags => generated 142 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:05.133007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13731f55-21b5-4477-a0c0-46ddd2ea4b66 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:05.191489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ea58d-337d-42e6-a033-ec6b7513b611 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:05.199721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b381f-6ead-4b91-b9a7-64aa1ab7ea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:05.200360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b381f-6ead-4b91-b9a7-64aa1ab7ea27 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:05.200644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b381f-6ead-4b91-b9a7-64aa1ab7ea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:05.200918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b381f-6ead-4b91-b9a7-64aa1ab7ea27 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:05.201587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b381f-6ead-4b91-b9a7-64aa1ab7ea27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:05.203732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b381f-6ead-4b91-b9a7-64aa1ab7ea27 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:05.232428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13731f55-21b5-4477-a0c0-46ddd2ea4b66 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:05.238348 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3354/6758] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:05 2022] POST /identity/v3/users => generated 300 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:05.239208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b381f-6ead-4b91-b9a7-64aa1ab7ea27 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:05.244681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6722aee-1266-4948-a695-baac09fe5b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:05.245600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6722aee-1266-4948-a695-baac09fe5b9f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:05.246463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6722aee-1266-4948-a695-baac09fe5b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:05.246756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6722aee-1266-4948-a695-baac09fe5b9f admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:05.249378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6722aee-1266-4948-a695-baac09fe5b9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:05.253030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6722aee-1266-4948-a695-baac09fe5b9f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:05.302594 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3405/6759] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:05 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:05.303536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6722aee-1266-4948-a695-baac09fe5b9f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:05.315832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6722aee-1266-4948-a695-baac09fe5b9f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:05.324780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec260a-09c8-41fa-8f6a-d6af5b09f467 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529c70a5ba704f0b97b11fdfe186f011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57520400ccaf48ecb940a70430535482', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:05.325472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec260a-09c8-41fa-8f6a-d6af5b09f467 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:05.325760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec260a-09c8-41fa-8f6a-d6af5b09f467 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:05.326520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec260a-09c8-41fa-8f6a-d6af5b09f467 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] PATH_INFO: `/v3/projects/3ca75df14b44477583405fd60973145e/tags/tempest-tag-1491810552` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:05.328217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec260a-09c8-41fa-8f6a-d6af5b09f467 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=3ca75df14b44477583405fd60973145e, value=tempest-tag-1491810552)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:05.330932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec260a-09c8-41fa-8f6a-d6af5b09f467 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:05.386233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b381f-6ead-4b91-b9a7-64aa1ab7ea27 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:05.393828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af581f43-ac10-4952-aa6a-025f748609e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:05.394459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af581f43-ac10-4952-aa6a-025f748609e0 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:05.394809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af581f43-ac10-4952-aa6a-025f748609e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:05.395008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af581f43-ac10-4952-aa6a-025f748609e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:05.404723 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-0cec260a-09c8-41fa-8f6a-d6af5b09f467 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1491810552. To ensure interoperability, identifiers should be a valid uuid. Jul 30 21:28:05.404723 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 30 21:28:05.404723 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:28:05.412929 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3406/6760] 10.222.0.17 () {58 vars in 1317 bytes} [Sat Jul 30 21:28:05 2022] DELETE /identity/v3/projects/3ca75df14b44477583405fd60973145e/tags/tempest-tag-1491810552 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:05.415305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec260a-09c8-41fa-8f6a-d6af5b09f467 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:05.417037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af581f43-ac10-4952-aa6a-025f748609e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:05.418530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af581f43-ac10-4952-aa6a-025f748609e0 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:05.437006 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3355/6761] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:05 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:05.438032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af581f43-ac10-4952-aa6a-025f748609e0 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:05.438168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec260a-09c8-41fa-8f6a-d6af5b09f467 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:05.445870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6f35b-0ed5-40b5-ad91-fb36aefd4cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:05.447217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6f35b-0ed5-40b5-ad91-fb36aefd4cfa admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:05.447760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6f35b-0ed5-40b5-ad91-fb36aefd4cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:05.449067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6f35b-0ed5-40b5-ad91-fb36aefd4cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:05.449976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6f35b-0ed5-40b5-ad91-fb36aefd4cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:05.454266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6f35b-0ed5-40b5-ad91-fb36aefd4cfa admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:05.465219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af581f43-ac10-4952-aa6a-025f748609e0 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:05.475956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5355504-cb8f-43b6-b90a-7e5d66a46d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:05.477715 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3407/6762] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:05.479115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6f35b-0ed5-40b5-ad91-fb36aefd4cfa admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:05.480151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5355504-cb8f-43b6-b90a-7e5d66a46d11 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:05.480481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5355504-cb8f-43b6-b90a-7e5d66a46d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:05.480743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5355504-cb8f-43b6-b90a-7e5d66a46d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:05.481576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5355504-cb8f-43b6-b90a-7e5d66a46d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:05.483319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5355504-cb8f-43b6-b90a-7e5d66a46d11 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:05.500087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6f35b-0ed5-40b5-ad91-fb36aefd4cfa admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:05.507960 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3356/6763] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:05.509656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be834afc-90ac-4ef3-aff3-01a8eaf068ea tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529c70a5ba704f0b97b11fdfe186f011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57520400ccaf48ecb940a70430535482', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:05.510568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be834afc-90ac-4ef3-aff3-01a8eaf068ea tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:05.511328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be834afc-90ac-4ef3-aff3-01a8eaf068ea tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:05.511977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be834afc-90ac-4ef3-aff3-01a8eaf068ea tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] PATH_INFO: `/v3/projects/3ca75df14b44477583405fd60973145e/tags/tempest-tag-1491810552` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:05.513986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5355504-cb8f-43b6-b90a-7e5d66a46d11 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:05.534666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be834afc-90ac-4ef3-aff3-01a8eaf068ea tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=3ca75df14b44477583405fd60973145e, value=tempest-tag-1491810552)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:05.537479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be834afc-90ac-4ef3-aff3-01a8eaf068ea tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:05.552508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:05.554136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5355504-cb8f-43b6-b90a-7e5d66a46d11 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:05.565278 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-be834afc-90ac-4ef3-aff3-01a8eaf068ea tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Could not find project tag: tempest-tag-1491810552.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1491810552. Jul 30 21:28:05.565278 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:28:05.565278 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:28:05.565278 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:28:05.565278 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:28:05.565278 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:28:05.565278 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:28:05.565278 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:28:05.565278 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:28:05.565278 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:28:05.565278 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:28:05.565278 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:28:05.565278 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Jul 30 21:28:05.565278 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Jul 30 21:28:05.566276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:28:05.566276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:28:05.566276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Jul 30 21:28:05.566276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Jul 30 21:28:05.566276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1491810552. Jul 30 21:28:05.566276 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:28:05.568556 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3408/6764] 10.222.0.17 () {58 vars in 1314 bytes} [Sat Jul 30 21:28:05 2022] GET /identity/v3/projects/3ca75df14b44477583405fd60973145e/tags/tempest-tag-1491810552 => generated 107 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:28:05.572485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be834afc-90ac-4ef3-aff3-01a8eaf068ea tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:05.574171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cfeec-a6fe-45a5-8131-89c4a17b169c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:05.575795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cfeec-a6fe-45a5-8131-89c4a17b169c admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:05.576728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cfeec-a6fe-45a5-8131-89c4a17b169c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:05.577198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cfeec-a6fe-45a5-8131-89c4a17b169c admin admin] PATH_INFO: `/v3/projects/66876ea7834a431c8e3bd3f21d3053e7/users/fa765e6fdd304838aef98313d7d863fa/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:05.592941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be834afc-90ac-4ef3-aff3-01a8eaf068ea tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:05.603163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ce237-d13e-4748-b93e-1caaed04a1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:05.604915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ce237-d13e-4748-b93e-1caaed04a1d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:05.605556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ce237-d13e-4748-b93e-1caaed04a1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:05.606099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ce237-d13e-4748-b93e-1caaed04a1d2 admin admin] PATH_INFO: `/v3/projects/ee734eb4c50c4e179e3c622db2e4e63a/users/0a28f1ac1cc14aaa8cf674c10df6ab0d/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:05.615144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5cfeec-a6fe-45a5-8131-89c4a17b169c admin admin] RBAC: Authorizing `identity:create_grant(project_id=66876ea7834a431c8e3bd3f21d3053e7, user_id=fa765e6fdd304838aef98313d7d863fa, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:05.618903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5cfeec-a6fe-45a5-8131-89c4a17b169c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:05.646222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ce237-d13e-4748-b93e-1caaed04a1d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee734eb4c50c4e179e3c622db2e4e63a, user_id=0a28f1ac1cc14aaa8cf674c10df6ab0d, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:05.646881 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3357/6765] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:05 2022] PUT /identity/v3/projects/66876ea7834a431c8e3bd3f21d3053e7/users/fa765e6fdd304838aef98313d7d863fa/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:05.647960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cfeec-a6fe-45a5-8131-89c4a17b169c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:05.650063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ce237-d13e-4748-b93e-1caaed04a1d2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:05.682208 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3409/6766] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:05 2022] PUT /identity/v3/projects/ee734eb4c50c4e179e3c622db2e4e63a/users/0a28f1ac1cc14aaa8cf674c10df6ab0d/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:05.683888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ce237-d13e-4748-b93e-1caaed04a1d2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:05.739300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:05.806411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cfeec-a6fe-45a5-8131-89c4a17b169c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:05.816081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ce237-d13e-4748-b93e-1caaed04a1d2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:05.823436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbd1eb-176f-498e-b709-a17b50531e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:05.824276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbd1eb-176f-498e-b709-a17b50531e50 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:05.824657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbd1eb-176f-498e-b709-a17b50531e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:05.825071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbd1eb-176f-498e-b709-a17b50531e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:05.825843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbd1eb-176f-498e-b709-a17b50531e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:05.828235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbd1eb-176f-498e-b709-a17b50531e50 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:05.844542 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3410/6767] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:05.844542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbd1eb-176f-498e-b709-a17b50531e50 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:05.858300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbd1eb-176f-498e-b709-a17b50531e50 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:05.865153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8fd68-1122-4516-9cb1-e4acb2dc2b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:05.866093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8fd68-1122-4516-9cb1-e4acb2dc2b42 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:05.867209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8fd68-1122-4516-9cb1-e4acb2dc2b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:05.867637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8fd68-1122-4516-9cb1-e4acb2dc2b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:05.868665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8fd68-1122-4516-9cb1-e4acb2dc2b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:05.871500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8fd68-1122-4516-9cb1-e4acb2dc2b42 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:05.891023 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3411/6768] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:05.892157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8fd68-1122-4516-9cb1-e4acb2dc2b42 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:05.910352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8fd68-1122-4516-9cb1-e4acb2dc2b42 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:05.918413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaacac-1514-485b-94f3-b19998c30c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:05.920627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaacac-1514-485b-94f3-b19998c30c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:05.921389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaacac-1514-485b-94f3-b19998c30c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:05.921755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaacac-1514-485b-94f3-b19998c30c4c admin admin] PATH_INFO: `/v3/projects/66876ea7834a431c8e3bd3f21d3053e7/users/fa765e6fdd304838aef98313d7d863fa/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:05.925385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baaacac-1514-485b-94f3-b19998c30c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=66876ea7834a431c8e3bd3f21d3053e7, user_id=fa765e6fdd304838aef98313d7d863fa, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:05.929350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baaacac-1514-485b-94f3-b19998c30c4c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:05.938379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7af1ce-c113-4ff7-926f-6a3b1b922307 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529c70a5ba704f0b97b11fdfe186f011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57520400ccaf48ecb940a70430535482', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:05.939188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7af1ce-c113-4ff7-926f-6a3b1b922307 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:05.939504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7af1ce-c113-4ff7-926f-6a3b1b922307 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:05.939904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7af1ce-c113-4ff7-926f-6a3b1b922307 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] PATH_INFO: `/v3/projects/3ca75df14b44477583405fd60973145e/tags` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:05.945070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7af1ce-c113-4ff7-926f-6a3b1b922307 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=3ca75df14b44477583405fd60973145e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:05.947449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7af1ce-c113-4ff7-926f-6a3b1b922307 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:05.948392 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3412/6769] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:05 2022] PUT /identity/v3/projects/66876ea7834a431c8e3bd3f21d3053e7/users/fa765e6fdd304838aef98313d7d863fa/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:05.949383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaacac-1514-485b-94f3-b19998c30c4c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:06.019510 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3358/6770] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:28:05 2022] DELETE /identity/v3/projects/3ca75df14b44477583405fd60973145e/tags => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:06.020944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caeceaf-d3e7-40e9-9a47-e1642dd400b0 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:06.021293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caeceaf-d3e7-40e9-9a47-e1642dd400b0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:06.021576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caeceaf-d3e7-40e9-9a47-e1642dd400b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:06.070418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7caeceaf-d3e7-40e9-9a47-e1642dd400b0 None None] MFA Rules not processed for user `fa765e6fdd304838aef98313d7d863fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:06.072293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7caeceaf-d3e7-40e9-9a47-e1642dd400b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:06.086500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaacac-1514-485b-94f3-b19998c30c4c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:06.092438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566c2fa-8df3-4454-be13-5c19e8bda4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:06.093169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566c2fa-8df3-4454-be13-5c19e8bda4f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:06.093546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566c2fa-8df3-4454-be13-5c19e8bda4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:06.093834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566c2fa-8df3-4454-be13-5c19e8bda4f7 admin admin] PATH_INFO: `/v3/projects/ee734eb4c50c4e179e3c622db2e4e63a/users/0a28f1ac1cc14aaa8cf674c10df6ab0d/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:06.095900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566c2fa-8df3-4454-be13-5c19e8bda4f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee734eb4c50c4e179e3c622db2e4e63a, user_id=0a28f1ac1cc14aaa8cf674c10df6ab0d, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:06.098818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566c2fa-8df3-4454-be13-5c19e8bda4f7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:06.121625 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3413/6771] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:05 2022] PUT /identity/v3/projects/ee734eb4c50c4e179e3c622db2e4e63a/users/0a28f1ac1cc14aaa8cf674c10df6ab0d/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:06.126080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566c2fa-8df3-4454-be13-5c19e8bda4f7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:06.176123 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3359/6772] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:06.177877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba4811-17b9-4ab8-94ff-2ecf75f938b0 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:06.178173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba4811-17b9-4ab8-94ff-2ecf75f938b0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:06.178453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba4811-17b9-4ab8-94ff-2ecf75f938b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:06.211157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8fba4811-17b9-4ab8-94ff-2ecf75f938b0 None None] MFA Rules not processed for user `0a28f1ac1cc14aaa8cf674c10df6ab0d`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:06.212523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8fba4811-17b9-4ab8-94ff-2ecf75f938b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:06.244883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:06.248828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:06.290893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566c2fa-8df3-4454-be13-5c19e8bda4f7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:06.304421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d84da-1d19-4157-a61f-5f25b4472767 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529c70a5ba704f0b97b11fdfe186f011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57520400ccaf48ecb940a70430535482', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:06.305279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d84da-1d19-4157-a61f-5f25b4472767 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:06.305747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d84da-1d19-4157-a61f-5f25b4472767 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:06.306257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d84da-1d19-4157-a61f-5f25b4472767 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] PATH_INFO: `/v3/projects/3ca75df14b44477583405fd60973145e/tags` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:06.318726 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3360/6773] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:06.321540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba4811-17b9-4ab8-94ff-2ecf75f938b0 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:06.323113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8fba4811-17b9-4ab8-94ff-2ecf75f938b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:06.337777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d84da-1d19-4157-a61f-5f25b4472767 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=3ca75df14b44477583405fd60973145e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:06.340082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d84da-1d19-4157-a61f-5f25b4472767 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:06.368254 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3414/6774] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:28:06 2022] GET /identity/v3/projects/3ca75df14b44477583405fd60973145e/tags => generated 66 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:28:06.369353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d84da-1d19-4157-a61f-5f25b4472767 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:06.373502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-561d84da-1d19-4157-a61f-5f25b4472767 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:06.437619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba4811-17b9-4ab8-94ff-2ecf75f938b0 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:06.442580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97310128-5f62-4f96-af9f-56774d0da693 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:06.443232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97310128-5f62-4f96-af9f-56774d0da693 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:06.443965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97310128-5f62-4f96-af9f-56774d0da693 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:06.443965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97310128-5f62-4f96-af9f-56774d0da693 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:06.537623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d84da-1d19-4157-a61f-5f25b4472767 tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:06.548270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716042b6-99e4-4760-a0ab-030f17c7780f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:06.548493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97310128-5f62-4f96-af9f-56774d0da693 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:06.548921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716042b6-99e4-4760-a0ab-030f17c7780f service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:06.549490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716042b6-99e4-4760-a0ab-030f17c7780f service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:06.549776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716042b6-99e4-4760-a0ab-030f17c7780f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:06.554313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97310128-5f62-4f96-af9f-56774d0da693 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:06.580822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716042b6-99e4-4760-a0ab-030f17c7780f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:06.582809 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3361/6775] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:06.583568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716042b6-99e4-4760-a0ab-030f17c7780f service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:06.585022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97310128-5f62-4f96-af9f-56774d0da693 service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:06.617918 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3415/6776] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:06.623657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97310128-5f62-4f96-af9f-56774d0da693 service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:06.644035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9414e1-b9af-4c4e-8f5b-63daf5fe0b6d tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529c70a5ba704f0b97b11fdfe186f011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57520400ccaf48ecb940a70430535482', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:06.644728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9414e1-b9af-4c4e-8f5b-63daf5fe0b6d tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:06.645079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9414e1-b9af-4c4e-8f5b-63daf5fe0b6d tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:06.645344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9414e1-b9af-4c4e-8f5b-63daf5fe0b6d tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] PATH_INFO: `/v3/projects/3ca75df14b44477583405fd60973145e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:06.648083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9414e1-b9af-4c4e-8f5b-63daf5fe0b6d tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3ca75df14b44477583405fd60973145e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:06.650815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9414e1-b9af-4c4e-8f5b-63daf5fe0b6d tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:06.785816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1a9414e1-b9af-4c4e-8f5b-63daf5fe0b6d tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ca75df14b44477583405fd60973145e', 'request_id': 'req-1a9414e1-b9af-4c4e-8f5b-63daf5fe0b6d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:06.793599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716042b6-99e4-4760-a0ab-030f17c7780f service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:06.810550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716042b6-99e4-4760-a0ab-030f17c7780f service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:06.851336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1a9414e1-b9af-4c4e-8f5b-63daf5fe0b6d tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ca75df14b44477583405fd60973145e', 'request_id': 'req-1a9414e1-b9af-4c4e-8f5b-63daf5fe0b6d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:06.882723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1a9414e1-b9af-4c4e-8f5b-63daf5fe0b6d tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ca75df14b44477583405fd60973145e', 'request_id': 'req-1a9414e1-b9af-4c4e-8f5b-63daf5fe0b6d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:06.884406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:06.909828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1a9414e1-b9af-4c4e-8f5b-63daf5fe0b6d tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] The token cache is being invalidate because project 3ca75df14b44477583405fd60973145e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:06.910625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1a9414e1-b9af-4c4e-8f5b-63daf5fe0b6d tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:06.942778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1a9414e1-b9af-4c4e-8f5b-63daf5fe0b6d tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:06.947576 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3362/6777] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:06 2022] DELETE /identity/v3/projects/3ca75df14b44477583405fd60973145e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:06.954714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9414e1-b9af-4c4e-8f5b-63daf5fe0b6d tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:06.967512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1a9414e1-b9af-4c4e-8f5b-63daf5fe0b6d tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:07.000997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ec3bd-f136-48b6-9972-ca54d56fa32f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:07.001653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ec3bd-f136-48b6-9972-ca54d56fa32f service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:07.004516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ec3bd-f136-48b6-9972-ca54d56fa32f service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:07.004806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ec3bd-f136-48b6-9972-ca54d56fa32f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:07.011968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ee4ec3bd-f136-48b6-9972-ca54d56fa32f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:07.172341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ec3bd-f136-48b6-9972-ca54d56fa32f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:07.173814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ec3bd-f136-48b6-9972-ca54d56fa32f service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:07.199204 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3416/6778] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:07.238610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9414e1-b9af-4c4e-8f5b-63daf5fe0b6d tempest-IdentityV3ProjectTagsTest-1720641730 tempest-IdentityV3ProjectTagsTest-1720641730-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:07.249105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6eb98-3f74-43a5-8c62-bbad90566c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:07.250099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6eb98-3f74-43a5-8c62-bbad90566c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:07.250553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6eb98-3f74-43a5-8c62-bbad90566c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:07.251147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6eb98-3f74-43a5-8c62-bbad90566c38 admin admin] PATH_INFO: `/v3/users/1edf1bfbce3147c88264957a272fbea0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:07.253027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6eb98-3f74-43a5-8c62-bbad90566c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1edf1bfbce3147c88264957a272fbea0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:07.258316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6eb98-3f74-43a5-8c62-bbad90566c38 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:07.406264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b1e6eb98-3f74-43a5-8c62-bbad90566c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1edf1bfbce3147c88264957a272fbea0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:07.408472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b1e6eb98-3f74-43a5-8c62-bbad90566c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1edf1bfbce3147c88264957a272fbea0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:07.462825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b1e6eb98-3f74-43a5-8c62-bbad90566c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1edf1bfbce3147c88264957a272fbea0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:07.464945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b1e6eb98-3f74-43a5-8c62-bbad90566c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1edf1bfbce3147c88264957a272fbea0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:07.498723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b1e6eb98-3f74-43a5-8c62-bbad90566c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1edf1bfbce3147c88264957a272fbea0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:07.555011 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3363/6779] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:06 2022] DELETE /identity/v3/users/1edf1bfbce3147c88264957a272fbea0 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:07.560027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b1cc8-9f5f-4f47-bd2a-9bbbddf651bc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:07.560531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b1cc8-9f5f-4f47-bd2a-9bbbddf651bc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:07.560610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b1cc8-9f5f-4f47-bd2a-9bbbddf651bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:07.606362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5a1b1cc8-9f5f-4f47-bd2a-9bbbddf651bc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:07.609532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5a1b1cc8-9f5f-4f47-bd2a-9bbbddf651bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:07.693497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:07.792969 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3417/6780] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:07.851113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6eb98-3f74-43a5-8c62-bbad90566c38 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:07.853065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b1e6eb98-3f74-43a5-8c62-bbad90566c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:07.968625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b1cc8-9f5f-4f47-bd2a-9bbbddf651bc None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:07.973103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5a1b1cc8-9f5f-4f47-bd2a-9bbbddf651bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:08.018181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6eb98-3f74-43a5-8c62-bbad90566c38 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:08.022962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc1522-a566-4c90-8e76-60e3f5118a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:08.023776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc1522-a566-4c90-8e76-60e3f5118a99 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:08.024237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc1522-a566-4c90-8e76-60e3f5118a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:08.024618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc1522-a566-4c90-8e76-60e3f5118a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:08.027633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b1cc8-9f5f-4f47-bd2a-9bbbddf651bc None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:08.039632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc1522-a566-4c90-8e76-60e3f5118a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:08.041371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc1522-a566-4c90-8e76-60e3f5118a99 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:08.048416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1cd91-45cb-4bb9-9803-72153901f814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:08.049634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1cd91-45cb-4bb9-9803-72153901f814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:08.049915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1cd91-45cb-4bb9-9803-72153901f814 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:08.050196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1cd91-45cb-4bb9-9803-72153901f814 admin admin] PATH_INFO: `/v3/users/13fd72602cb94b47a15831489d7762d0` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:08.054150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1cd91-45cb-4bb9-9803-72153901f814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13fd72602cb94b47a15831489d7762d0)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:08.056530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1cd91-45cb-4bb9-9803-72153901f814 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:08.067606 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3364/6781] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:08.181417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a9f1cd91-45cb-4bb9-9803-72153901f814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13fd72602cb94b47a15831489d7762d0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:08.201842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a9f1cd91-45cb-4bb9-9803-72153901f814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13fd72602cb94b47a15831489d7762d0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:08.204796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a9f1cd91-45cb-4bb9-9803-72153901f814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13fd72602cb94b47a15831489d7762d0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:08.220040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a9f1cd91-45cb-4bb9-9803-72153901f814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13fd72602cb94b47a15831489d7762d0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:08.221252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a9f1cd91-45cb-4bb9-9803-72153901f814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13fd72602cb94b47a15831489d7762d0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:08.251061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da723b63-e2f8-43a2-9e31-e391aa575364 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:08.254946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da723b63-e2f8-43a2-9e31-e391aa575364 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:08.255241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da723b63-e2f8-43a2-9e31-e391aa575364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:08.260017 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3418/6782] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:07 2022] DELETE /identity/v3/users/13fd72602cb94b47a15831489d7762d0 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:08.283268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-da723b63-e2f8-43a2-9e31-e391aa575364 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:08.284802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-da723b63-e2f8-43a2-9e31-e391aa575364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:08.301050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:08.409038 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3365/6783] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:08.464616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1cd91-45cb-4bb9-9803-72153901f814 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:08.466740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a9f1cd91-45cb-4bb9-9803-72153901f814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:08.706797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1cd91-45cb-4bb9-9803-72153901f814 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:08.732311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3aa2b-3d9f-4122-94ba-8668c5160a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:08.734094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3aa2b-3d9f-4122-94ba-8668c5160a54 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:08.737091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3aa2b-3d9f-4122-94ba-8668c5160a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:08.737429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3aa2b-3d9f-4122-94ba-8668c5160a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:08.767095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3aa2b-3d9f-4122-94ba-8668c5160a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:08.772161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3aa2b-3d9f-4122-94ba-8668c5160a54 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:08.818543 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3419/6784] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:09.174689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da723b63-e2f8-43a2-9e31-e391aa575364 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:09.178200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-da723b63-e2f8-43a2-9e31-e391aa575364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:09.208329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da723b63-e2f8-43a2-9e31-e391aa575364 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:09.240809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0153f-a886-4b45-b683-6772250272ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:09.241482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0153f-a886-4b45-b683-6772250272ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:09.241768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0153f-a886-4b45-b683-6772250272ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:09.242045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0153f-a886-4b45-b683-6772250272ab admin admin] PATH_INFO: `/v3/projects/4340387ae1664fcea21aae0086f48eb7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:09.250756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0153f-a886-4b45-b683-6772250272ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=4340387ae1664fcea21aae0086f48eb7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:09.260743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0153f-a886-4b45-b683-6772250272ab admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:09.433683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-44f0153f-a886-4b45-b683-6772250272ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4340387ae1664fcea21aae0086f48eb7', 'request_id': 'req-44f0153f-a886-4b45-b683-6772250272ab'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:09.454434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-44f0153f-a886-4b45-b683-6772250272ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4340387ae1664fcea21aae0086f48eb7', 'request_id': 'req-44f0153f-a886-4b45-b683-6772250272ab'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:09.469294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-44f0153f-a886-4b45-b683-6772250272ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4340387ae1664fcea21aae0086f48eb7', 'request_id': 'req-44f0153f-a886-4b45-b683-6772250272ab'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:09.503899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-44f0153f-a886-4b45-b683-6772250272ab admin admin] The token cache is being invalidate because project 4340387ae1664fcea21aae0086f48eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:09.505018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-44f0153f-a886-4b45-b683-6772250272ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:09.506961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-44f0153f-a886-4b45-b683-6772250272ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:09.511902 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3366/6785] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:09 2022] DELETE /identity/v3/projects/4340387ae1664fcea21aae0086f48eb7 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:09.517017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3aa2b-3d9f-4122-94ba-8668c5160a54 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:09.559117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3aa2b-3d9f-4122-94ba-8668c5160a54 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:09.670320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:09.730755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6840057-c1b4-4858-bf95-e243cf588511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:09.731546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6840057-c1b4-4858-bf95-e243cf588511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:09.732896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6840057-c1b4-4858-bf95-e243cf588511 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:09.732896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6840057-c1b4-4858-bf95-e243cf588511 admin admin] PATH_INFO: `/v3/users/529c70a5ba704f0b97b11fdfe186f011` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:09.746164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6840057-c1b4-4858-bf95-e243cf588511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=529c70a5ba704f0b97b11fdfe186f011)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:09.748237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6840057-c1b4-4858-bf95-e243cf588511 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:09.868698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e6840057-c1b4-4858-bf95-e243cf588511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '529c70a5ba704f0b97b11fdfe186f011'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:09.923575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e6840057-c1b4-4858-bf95-e243cf588511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '529c70a5ba704f0b97b11fdfe186f011'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:09.925611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e6840057-c1b4-4858-bf95-e243cf588511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '529c70a5ba704f0b97b11fdfe186f011'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:09.941642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e6840057-c1b4-4858-bf95-e243cf588511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '529c70a5ba704f0b97b11fdfe186f011'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:09.950645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e6840057-c1b4-4858-bf95-e243cf588511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '529c70a5ba704f0b97b11fdfe186f011'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:09.981507 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3420/6786] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:09 2022] DELETE /identity/v3/users/529c70a5ba704f0b97b11fdfe186f011 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:10.037317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0153f-a886-4b45-b683-6772250272ab admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:10.039783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-44f0153f-a886-4b45-b683-6772250272ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:10.068203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0153f-a886-4b45-b683-6772250272ab admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:10.204063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d2b5a-131b-4ac1-a74c-59d9a17de09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:10.204741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d2b5a-131b-4ac1-a74c-59d9a17de09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:10.204997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d2b5a-131b-4ac1-a74c-59d9a17de09f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:10.205362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d2b5a-131b-4ac1-a74c-59d9a17de09f admin admin] PATH_INFO: `/v3/projects/ef9817a9cdcb4afcba68c3691ab7c1b5` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:10.206880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d2b5a-131b-4ac1-a74c-59d9a17de09f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef9817a9cdcb4afcba68c3691ab7c1b5)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:10.211491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d2b5a-131b-4ac1-a74c-59d9a17de09f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:10.316494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:10.341727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0b6d2b5a-131b-4ac1-a74c-59d9a17de09f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef9817a9cdcb4afcba68c3691ab7c1b5', 'request_id': 'req-0b6d2b5a-131b-4ac1-a74c-59d9a17de09f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:10.378447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0b6d2b5a-131b-4ac1-a74c-59d9a17de09f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef9817a9cdcb4afcba68c3691ab7c1b5', 'request_id': 'req-0b6d2b5a-131b-4ac1-a74c-59d9a17de09f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:10.389079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0b6d2b5a-131b-4ac1-a74c-59d9a17de09f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef9817a9cdcb4afcba68c3691ab7c1b5', 'request_id': 'req-0b6d2b5a-131b-4ac1-a74c-59d9a17de09f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:10.404987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0b6d2b5a-131b-4ac1-a74c-59d9a17de09f admin admin] The token cache is being invalidate because project ef9817a9cdcb4afcba68c3691ab7c1b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:10.406204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0b6d2b5a-131b-4ac1-a74c-59d9a17de09f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:10.408647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0b6d2b5a-131b-4ac1-a74c-59d9a17de09f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:10.410738 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3367/6787] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:10 2022] DELETE /identity/v3/projects/ef9817a9cdcb4afcba68c3691ab7c1b5 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:10.414826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6840057-c1b4-4858-bf95-e243cf588511 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:10.416922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e6840057-c1b4-4858-bf95-e243cf588511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:10.439637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6840057-c1b4-4858-bf95-e243cf588511 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:10.527403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd036e5-f743-4d8d-bde1-2c5f730a7eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:10.528109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd036e5-f743-4d8d-bde1-2c5f730a7eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:10.528424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd036e5-f743-4d8d-bde1-2c5f730a7eac admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:10.528725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd036e5-f743-4d8d-bde1-2c5f730a7eac admin admin] PATH_INFO: `/v3/users/fa765e6fdd304838aef98313d7d863fa` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:10.530112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd036e5-f743-4d8d-bde1-2c5f730a7eac admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa765e6fdd304838aef98313d7d863fa)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:10.532769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd036e5-f743-4d8d-bde1-2c5f730a7eac admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:10.549036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d2b5a-131b-4ac1-a74c-59d9a17de09f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:10.551758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0b6d2b5a-131b-4ac1-a74c-59d9a17de09f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:10.576439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d2b5a-131b-4ac1-a74c-59d9a17de09f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:10.589237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b915d3-40ec-4b52-a850-5e0c4414c788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:10.589915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b915d3-40ec-4b52-a850-5e0c4414c788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:10.590207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b915d3-40ec-4b52-a850-5e0c4414c788 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:10.590490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b915d3-40ec-4b52-a850-5e0c4414c788 admin admin] PATH_INFO: `/v3/projects/57520400ccaf48ecb940a70430535482` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:10.593323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b915d3-40ec-4b52-a850-5e0c4414c788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57520400ccaf48ecb940a70430535482)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:10.610016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b915d3-40ec-4b52-a850-5e0c4414c788 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:10.680639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5bd036e5-f743-4d8d-bde1-2c5f730a7eac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa765e6fdd304838aef98313d7d863fa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:10.707726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:10.715872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5bd036e5-f743-4d8d-bde1-2c5f730a7eac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa765e6fdd304838aef98313d7d863fa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:10.716839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5bd036e5-f743-4d8d-bde1-2c5f730a7eac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa765e6fdd304838aef98313d7d863fa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:10.745643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5bd036e5-f743-4d8d-bde1-2c5f730a7eac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa765e6fdd304838aef98313d7d863fa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:10.746216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-43b915d3-40ec-4b52-a850-5e0c4414c788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57520400ccaf48ecb940a70430535482', 'request_id': 'req-43b915d3-40ec-4b52-a850-5e0c4414c788'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:10.748807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5bd036e5-f743-4d8d-bde1-2c5f730a7eac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa765e6fdd304838aef98313d7d863fa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:10.789431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-43b915d3-40ec-4b52-a850-5e0c4414c788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57520400ccaf48ecb940a70430535482', 'request_id': 'req-43b915d3-40ec-4b52-a850-5e0c4414c788'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:10.792829 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3421/6788] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:10 2022] DELETE /identity/v3/users/fa765e6fdd304838aef98313d7d863fa => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:10.807372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-43b915d3-40ec-4b52-a850-5e0c4414c788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57520400ccaf48ecb940a70430535482', 'request_id': 'req-43b915d3-40ec-4b52-a850-5e0c4414c788'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:10.816665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-43b915d3-40ec-4b52-a850-5e0c4414c788 admin admin] The token cache is being invalidate because project 57520400ccaf48ecb940a70430535482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:10.817084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-43b915d3-40ec-4b52-a850-5e0c4414c788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:10.817880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-43b915d3-40ec-4b52-a850-5e0c4414c788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:10.819658 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3368/6789] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:10 2022] DELETE /identity/v3/projects/57520400ccaf48ecb940a70430535482 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:10.826699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d03a3-0e5a-405f-9bce-e95286241dda None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:10.827609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d03a3-0e5a-405f-9bce-e95286241dda None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:10.828095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d03a3-0e5a-405f-9bce-e95286241dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:10.857653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c08d03a3-0e5a-405f-9bce-e95286241dda None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:10.859057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c08d03a3-0e5a-405f-9bce-e95286241dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:10.982593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ae2e8-4b7e-4412-bc2c-d2fd5363e633 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:10.983583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ae2e8-4b7e-4412-bc2c-d2fd5363e633 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:10.984051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ae2e8-4b7e-4412-bc2c-d2fd5363e633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:10.984288 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3422/6790] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:11.036209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ae6ae2e8-4b7e-4412-bc2c-d2fd5363e633 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:11.037462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ae6ae2e8-4b7e-4412-bc2c-d2fd5363e633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:11.059671 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3369/6791] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:28:11.065571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d03a3-0e5a-405f-9bce-e95286241dda None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:11.127336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d03a3-0e5a-405f-9bce-e95286241dda None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:11.156667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c44cbd-c7f1-46ba-a8a4-d51ebe5ab1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:11.157473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c44cbd-c7f1-46ba-a8a4-d51ebe5ab1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:11.158670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c44cbd-c7f1-46ba-a8a4-d51ebe5ab1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:11.159773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c44cbd-c7f1-46ba-a8a4-d51ebe5ab1f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:11.160616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c44cbd-c7f1-46ba-a8a4-d51ebe5ab1f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:11.177349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c44cbd-c7f1-46ba-a8a4-d51ebe5ab1f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:11.179275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c44cbd-c7f1-46ba-a8a4-d51ebe5ab1f2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:11.245449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ae2e8-4b7e-4412-bc2c-d2fd5363e633 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:11.246012 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3423/6792] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:11.263180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ae2e8-4b7e-4412-bc2c-d2fd5363e633 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:11.293579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6dd6a-c360-4ea5-92f8-8914ed70d173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:11.294185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6dd6a-c360-4ea5-92f8-8914ed70d173 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:11.294484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6dd6a-c360-4ea5-92f8-8914ed70d173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:11.294763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6dd6a-c360-4ea5-92f8-8914ed70d173 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:11.295501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6dd6a-c360-4ea5-92f8-8914ed70d173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:11.297534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6dd6a-c360-4ea5-92f8-8914ed70d173 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:11.366362 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3370/6793] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:11 2022] POST /identity/v3/projects => generated 393 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:11.370832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c44cbd-c7f1-46ba-a8a4-d51ebe5ab1f2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:11.392980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c44cbd-c7f1-46ba-a8a4-d51ebe5ab1f2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:11.542374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae5a37-c171-490c-8be0-a3bc30a60006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:11.544353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae5a37-c171-490c-8be0-a3bc30a60006 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:11.545036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae5a37-c171-490c-8be0-a3bc30a60006 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:11.546749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae5a37-c171-490c-8be0-a3bc30a60006 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:11.547733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae5a37-c171-490c-8be0-a3bc30a60006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:11.550271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae5a37-c171-490c-8be0-a3bc30a60006 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:11.603704 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3424/6794] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:11 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:11.610171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6dd6a-c360-4ea5-92f8-8914ed70d173 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:11.667016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6dd6a-c360-4ea5-92f8-8914ed70d173 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:11.685028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46779cdf-6940-4ff7-9b78-4ec23774c925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:11.685687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46779cdf-6940-4ff7-9b78-4ec23774c925 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:11.685979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46779cdf-6940-4ff7-9b78-4ec23774c925 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:11.686476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46779cdf-6940-4ff7-9b78-4ec23774c925 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:11.688114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46779cdf-6940-4ff7-9b78-4ec23774c925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:11.689758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46779cdf-6940-4ff7-9b78-4ec23774c925 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:11.720253 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3371/6795] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:11.725541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae5a37-c171-490c-8be0-a3bc30a60006 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:11.746475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae5a37-c171-490c-8be0-a3bc30a60006 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:11.760944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d9002-5cd9-430f-903a-001c5842d2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:11.761658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d9002-5cd9-430f-903a-001c5842d2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:11.772616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d9002-5cd9-430f-903a-001c5842d2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:11.773269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d9002-5cd9-430f-903a-001c5842d2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:11.774233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d9002-5cd9-430f-903a-001c5842d2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:11.778618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d9002-5cd9-430f-903a-001c5842d2c1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:11.820264 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3425/6796] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:11.827166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46779cdf-6940-4ff7-9b78-4ec23774c925 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:11.841578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46779cdf-6940-4ff7-9b78-4ec23774c925 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:11.858969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed230e4-a6ea-4ccb-b9ad-d05f54f6d202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:11.862184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed230e4-a6ea-4ccb-b9ad-d05f54f6d202 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:11.862510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed230e4-a6ea-4ccb-b9ad-d05f54f6d202 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:11.862808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed230e4-a6ea-4ccb-b9ad-d05f54f6d202 admin admin] PATH_INFO: `/v3/projects/f540680daf44480fa83db2f4db93a514/users/ffc6aa2232d248538b9de4643c5378a2/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:11.938476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed230e4-a6ea-4ccb-b9ad-d05f54f6d202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f540680daf44480fa83db2f4db93a514, user_id=ffc6aa2232d248538b9de4643c5378a2, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:11.945238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed230e4-a6ea-4ccb-b9ad-d05f54f6d202 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:12.011163 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3372/6797] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:11 2022] PUT /identity/v3/projects/f540680daf44480fa83db2f4db93a514/users/ffc6aa2232d248538b9de4643c5378a2/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:12.022156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599be01-646f-4d2e-80ee-c8f1be1fb609 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:12.022513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599be01-646f-4d2e-80ee-c8f1be1fb609 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:12.023020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599be01-646f-4d2e-80ee-c8f1be1fb609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:12.085860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e599be01-646f-4d2e-80ee-c8f1be1fb609 None None] MFA Rules not processed for user `ffc6aa2232d248538b9de4643c5378a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:12.087724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e599be01-646f-4d2e-80ee-c8f1be1fb609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:12.190040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:12.304959 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3426/6798] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:12.310259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed230e4-a6ea-4ccb-b9ad-d05f54f6d202 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:12.328331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed230e4-a6ea-4ccb-b9ad-d05f54f6d202 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:12.347218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefa4a3-0813-44d5-92f5-b006f9f17837 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc6aa2232d248538b9de4643c5378a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f540680daf44480fa83db2f4db93a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:12.348146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefa4a3-0813-44d5-92f5-b006f9f17837 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:12.348595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefa4a3-0813-44d5-92f5-b006f9f17837 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:12.349721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefa4a3-0813-44d5-92f5-b006f9f17837 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] PATH_INFO: `/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:12.350647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefa4a3-0813-44d5-92f5-b006f9f17837 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorizing `identity:create_application_credential(user_id=ffc6aa2232d248538b9de4643c5378a2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:12.353389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefa4a3-0813-44d5-92f5-b006f9f17837 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:12.442367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:12.495172 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3373/6799] 10.222.0.17 () {60 vars in 1314 bytes} [Sat Jul 30 21:28:12 2022] POST /identity/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials => generated 788 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:12.499365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599be01-646f-4d2e-80ee-c8f1be1fb609 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:12.517714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599be01-646f-4d2e-80ee-c8f1be1fb609 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:12.526679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb859070-c0fb-4be3-9728-fd4609004f0a tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc6aa2232d248538b9de4643c5378a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f540680daf44480fa83db2f4db93a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:12.528550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb859070-c0fb-4be3-9728-fd4609004f0a tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:12.528913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb859070-c0fb-4be3-9728-fd4609004f0a tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:12.529265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb859070-c0fb-4be3-9728-fd4609004f0a tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] PATH_INFO: `/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials/2115d8ffa30342a7b2af3f8d21b31aa5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:12.550094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb859070-c0fb-4be3-9728-fd4609004f0a tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorizing `identity:get_application_credential(user_id=ffc6aa2232d248538b9de4643c5378a2, application_credential_id=2115d8ffa30342a7b2af3f8d21b31aa5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:12.552170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb859070-c0fb-4be3-9728-fd4609004f0a tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:12.554651 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3427/6800] 10.222.0.17 () {58 vars in 1392 bytes} [Sat Jul 30 21:28:12 2022] GET /identity/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials/2115d8ffa30342a7b2af3f8d21b31aa5 => generated 688 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:12.559056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30b5fa-cfaf-4268-8ac9-d6889c2f5bf1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:12.559454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30b5fa-cfaf-4268-8ac9-d6889c2f5bf1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:12.559813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30b5fa-cfaf-4268-8ac9-d6889c2f5bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:12.588094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5a30b5fa-cfaf-4268-8ac9-d6889c2f5bf1 None None] MFA Rules not processed for user `ffc6aa2232d248538b9de4643c5378a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:12.590019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5a30b5fa-cfaf-4268-8ac9-d6889c2f5bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:12.845311 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3374/6801] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:12 2022] POST /identity/v3/auth/tokens => generated 3416 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 30 21:28:12.846427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb859070-c0fb-4be3-9728-fd4609004f0a tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:12.857829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb859070-c0fb-4be3-9728-fd4609004f0a tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:12.871980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07607a-2b03-4ccd-b57d-8378db16d655 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc6aa2232d248538b9de4643c5378a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f540680daf44480fa83db2f4db93a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:12.872676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07607a-2b03-4ccd-b57d-8378db16d655 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:12.872964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07607a-2b03-4ccd-b57d-8378db16d655 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:12.873236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07607a-2b03-4ccd-b57d-8378db16d655 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] PATH_INFO: `/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials/2115d8ffa30342a7b2af3f8d21b31aa5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:12.877110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07607a-2b03-4ccd-b57d-8378db16d655 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorizing `identity:delete_application_credential(user_id=ffc6aa2232d248538b9de4643c5378a2, application_credential_id=2115d8ffa30342a7b2af3f8d21b31aa5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:12.880806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07607a-2b03-4ccd-b57d-8378db16d655 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:12.922054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30b5fa-cfaf-4268-8ac9-d6889c2f5bf1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:12.924166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5a30b5fa-cfaf-4268-8ac9-d6889c2f5bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:12.968984 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3428/6802] 10.222.0.17 () {58 vars in 1395 bytes} [Sat Jul 30 21:28:12 2022] DELETE /identity/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials/2115d8ffa30342a7b2af3f8d21b31aa5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:12.972900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07607a-2b03-4ccd-b57d-8378db16d655 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:13.015258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07607a-2b03-4ccd-b57d-8378db16d655 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:13.032700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8a12d-e9c2-4b8f-aea7-e996372d7701 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc6aa2232d248538b9de4643c5378a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f540680daf44480fa83db2f4db93a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:13.033414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8a12d-e9c2-4b8f-aea7-e996372d7701 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:13.036340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8a12d-e9c2-4b8f-aea7-e996372d7701 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:13.038149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8a12d-e9c2-4b8f-aea7-e996372d7701 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] PATH_INFO: `/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:13.039073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8a12d-e9c2-4b8f-aea7-e996372d7701 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorizing `identity:create_application_credential(user_id=ffc6aa2232d248538b9de4643c5378a2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:13.042992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8a12d-e9c2-4b8f-aea7-e996372d7701 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:13.172862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30b5fa-cfaf-4268-8ac9-d6889c2f5bf1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:13.182997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4376d7-3017-4e75-8b71-c9fc3c9fb010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:13.184423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4376d7-3017-4e75-8b71-c9fc3c9fb010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:13.184725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4376d7-3017-4e75-8b71-c9fc3c9fb010 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:13.185247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4376d7-3017-4e75-8b71-c9fc3c9fb010 admin admin] PATH_INFO: `/v3/projects/66876ea7834a431c8e3bd3f21d3053e7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:13.188391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4376d7-3017-4e75-8b71-c9fc3c9fb010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66876ea7834a431c8e3bd3f21d3053e7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:13.191039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4376d7-3017-4e75-8b71-c9fc3c9fb010 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:13.225712 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3429/6803] 10.222.0.17 () {60 vars in 1315 bytes} [Sat Jul 30 21:28:12 2022] POST /identity/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials => generated 921 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:13.230279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8a12d-e9c2-4b8f-aea7-e996372d7701 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:13.265624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8a12d-e9c2-4b8f-aea7-e996372d7701 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:13.285494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34acb27-c695-46d7-9b78-ae55ef9bc687 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc6aa2232d248538b9de4643c5378a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f540680daf44480fa83db2f4db93a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:13.286063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34acb27-c695-46d7-9b78-ae55ef9bc687 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:13.286374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34acb27-c695-46d7-9b78-ae55ef9bc687 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:13.286754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34acb27-c695-46d7-9b78-ae55ef9bc687 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] PATH_INFO: `/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials/fc64f71214c948fe9fc9e0ab62c39ce2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:13.300335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:13.318935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ad4376d7-3017-4e75-8b71-c9fc3c9fb010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66876ea7834a431c8e3bd3f21d3053e7', 'request_id': 'req-ad4376d7-3017-4e75-8b71-c9fc3c9fb010'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:13.329876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34acb27-c695-46d7-9b78-ae55ef9bc687 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorizing `identity:delete_application_credential(user_id=ffc6aa2232d248538b9de4643c5378a2, application_credential_id=fc64f71214c948fe9fc9e0ab62c39ce2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:13.331425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34acb27-c695-46d7-9b78-ae55ef9bc687 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:13.336535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ad4376d7-3017-4e75-8b71-c9fc3c9fb010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66876ea7834a431c8e3bd3f21d3053e7', 'request_id': 'req-ad4376d7-3017-4e75-8b71-c9fc3c9fb010'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:13.346347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ad4376d7-3017-4e75-8b71-c9fc3c9fb010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66876ea7834a431c8e3bd3f21d3053e7', 'request_id': 'req-ad4376d7-3017-4e75-8b71-c9fc3c9fb010'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:13.382118 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3430/6804] 10.222.0.17 () {58 vars in 1395 bytes} [Sat Jul 30 21:28:13 2022] DELETE /identity/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials/fc64f71214c948fe9fc9e0ab62c39ce2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:13.392065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34acb27-c695-46d7-9b78-ae55ef9bc687 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:13.395102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ad4376d7-3017-4e75-8b71-c9fc3c9fb010 admin admin] The token cache is being invalidate because project 66876ea7834a431c8e3bd3f21d3053e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:13.397532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ad4376d7-3017-4e75-8b71-c9fc3c9fb010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:13.399337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ad4376d7-3017-4e75-8b71-c9fc3c9fb010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:13.403175 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3375/6805] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:12 2022] DELETE /identity/v3/projects/66876ea7834a431c8e3bd3f21d3053e7 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:28:13.409253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d4c96-ce9f-4830-ad74-6b964ce0b737 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:13.413881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34acb27-c695-46d7-9b78-ae55ef9bc687 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:13.414375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d4c96-ce9f-4830-ad74-6b964ce0b737 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:13.414790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d4c96-ce9f-4830-ad74-6b964ce0b737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:13.474394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c45d4c96-ce9f-4830-ad74-6b964ce0b737 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:13.480103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c45d4c96-ce9f-4830-ad74-6b964ce0b737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:13.510059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:13.523322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0213c-1c69-4f45-98fa-f6f7eb5015a1 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc6aa2232d248538b9de4643c5378a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f540680daf44480fa83db2f4db93a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:13.523322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0213c-1c69-4f45-98fa-f6f7eb5015a1 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:13.523322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0213c-1c69-4f45-98fa-f6f7eb5015a1 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:13.523677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0213c-1c69-4f45-98fa-f6f7eb5015a1 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] PATH_INFO: `/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:13.523677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0213c-1c69-4f45-98fa-f6f7eb5015a1 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorizing `identity:create_application_credential(user_id=ffc6aa2232d248538b9de4643c5378a2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:13.536601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0213c-1c69-4f45-98fa-f6f7eb5015a1 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:13.643725 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3431/6806] 10.222.0.17 () {60 vars in 1315 bytes} [Sat Jul 30 21:28:13 2022] POST /identity/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials => generated 812 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:13.647688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0213c-1c69-4f45-98fa-f6f7eb5015a1 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:13.649518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6af0213c-1c69-4f45-98fa-f6f7eb5015a1 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:13.664288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0213c-1c69-4f45-98fa-f6f7eb5015a1 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:13.669248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9030a-9938-4d0c-b52a-a0fcbf8c80dc tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc6aa2232d248538b9de4643c5378a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f540680daf44480fa83db2f4db93a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:13.669945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9030a-9938-4d0c-b52a-a0fcbf8c80dc tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:13.670239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9030a-9938-4d0c-b52a-a0fcbf8c80dc tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:13.670527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9030a-9938-4d0c-b52a-a0fcbf8c80dc tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] PATH_INFO: `/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials/18cb7afb18a0457e9688389275335822` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:13.684438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9030a-9938-4d0c-b52a-a0fcbf8c80dc tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorizing `identity:delete_application_credential(user_id=ffc6aa2232d248538b9de4643c5378a2, application_credential_id=18cb7afb18a0457e9688389275335822)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:13.686867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9030a-9938-4d0c-b52a-a0fcbf8c80dc tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:13.719880 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3432/6807] 10.222.0.17 () {58 vars in 1395 bytes} [Sat Jul 30 21:28:13 2022] DELETE /identity/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials/18cb7afb18a0457e9688389275335822 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:13.725738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9030a-9938-4d0c-b52a-a0fcbf8c80dc tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:13.726284 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3376/6808] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:13.740939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051f296-8eef-4c3b-84bb-6cf9e3f79a69 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:13.741247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051f296-8eef-4c3b-84bb-6cf9e3f79a69 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:13.741539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051f296-8eef-4c3b-84bb-6cf9e3f79a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:13.745646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9030a-9938-4d0c-b52a-a0fcbf8c80dc tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:13.750413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa1eda-afa1-4603-935a-86cea58b3ce4 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc6aa2232d248538b9de4643c5378a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f540680daf44480fa83db2f4db93a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:13.751080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa1eda-afa1-4603-935a-86cea58b3ce4 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:13.752439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa1eda-afa1-4603-935a-86cea58b3ce4 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:13.752439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa1eda-afa1-4603-935a-86cea58b3ce4 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] PATH_INFO: `/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:13.753099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa1eda-afa1-4603-935a-86cea58b3ce4 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorizing `identity:create_application_credential(user_id=ffc6aa2232d248538b9de4643c5378a2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:13.754713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa1eda-afa1-4603-935a-86cea58b3ce4 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:13.791187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6051f296-8eef-4c3b-84bb-6cf9e3f79a69 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:13.792508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6051f296-8eef-4c3b-84bb-6cf9e3f79a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:13.818131 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3377/6809] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:13.819266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051f296-8eef-4c3b-84bb-6cf9e3f79a69 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:13.841487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051f296-8eef-4c3b-84bb-6cf9e3f79a69 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:13.856857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13324fe-6169-4c17-a9f1-9a00f516bf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:13.857513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13324fe-6169-4c17-a9f1-9a00f516bf83 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:13.857803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13324fe-6169-4c17-a9f1-9a00f516bf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:13.858334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13324fe-6169-4c17-a9f1-9a00f516bf83 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:13.859397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13324fe-6169-4c17-a9f1-9a00f516bf83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:13.859713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13324fe-6169-4c17-a9f1-9a00f516bf83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:13.862681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13324fe-6169-4c17-a9f1-9a00f516bf83 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:13.893043 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3378/6810] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:13.897380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13324fe-6169-4c17-a9f1-9a00f516bf83 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:13.927656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13324fe-6169-4c17-a9f1-9a00f516bf83 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:13.927850 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3433/6811] 10.222.0.17 () {60 vars in 1314 bytes} [Sat Jul 30 21:28:13 2022] POST /identity/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials => generated 789 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:28:13.928721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa1eda-afa1-4603-935a-86cea58b3ce4 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:13.955261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa1eda-afa1-4603-935a-86cea58b3ce4 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:13.955506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60034d27-579f-488d-82dd-f061f35c25ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:13.956163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60034d27-579f-488d-82dd-f061f35c25ea admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:13.956626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60034d27-579f-488d-82dd-f061f35c25ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:13.956754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60034d27-579f-488d-82dd-f061f35c25ea admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:13.957394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60034d27-579f-488d-82dd-f061f35c25ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:13.959356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60034d27-579f-488d-82dd-f061f35c25ea admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:13.970795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b363e6-afb8-4d3d-a664-3676f2614546 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc6aa2232d248538b9de4643c5378a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f540680daf44480fa83db2f4db93a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:13.972811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b363e6-afb8-4d3d-a664-3676f2614546 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:13.973031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b363e6-afb8-4d3d-a664-3676f2614546 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:13.973318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b363e6-afb8-4d3d-a664-3676f2614546 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] PATH_INFO: `/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:13.977234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b363e6-afb8-4d3d-a664-3676f2614546 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorizing `identity:create_application_credential(user_id=ffc6aa2232d248538b9de4643c5378a2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:13.980217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b363e6-afb8-4d3d-a664-3676f2614546 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:14.064568 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3379/6812] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:13 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:14.068259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60034d27-579f-488d-82dd-f061f35c25ea admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:14.152318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:14.161497 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3434/6813] 10.222.0.17 () {60 vars in 1314 bytes} [Sat Jul 30 21:28:13 2022] POST /identity/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials => generated 789 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:14.167642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b363e6-afb8-4d3d-a664-3676f2614546 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:14.187477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b363e6-afb8-4d3d-a664-3676f2614546 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:14.235620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60034d27-579f-488d-82dd-f061f35c25ea admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:14.252891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90803b52-f492-4e6a-a9ec-58d8daf560ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:14.256018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90803b52-f492-4e6a-a9ec-58d8daf560ea admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:14.256400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90803b52-f492-4e6a-a9ec-58d8daf560ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:14.257598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90803b52-f492-4e6a-a9ec-58d8daf560ea admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:14.259694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90803b52-f492-4e6a-a9ec-58d8daf560ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:14.263894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90803b52-f492-4e6a-a9ec-58d8daf560ea admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:14.312846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52c7e6-1fd4-41f2-8d2c-797f04f02d38 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc6aa2232d248538b9de4643c5378a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f540680daf44480fa83db2f4db93a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:14.314425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52c7e6-1fd4-41f2-8d2c-797f04f02d38 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:14.314970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52c7e6-1fd4-41f2-8d2c-797f04f02d38 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:14.315549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52c7e6-1fd4-41f2-8d2c-797f04f02d38 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] PATH_INFO: `/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:14.317092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52c7e6-1fd4-41f2-8d2c-797f04f02d38 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorizing `identity:list_application_credentials(user_id=ffc6aa2232d248538b9de4643c5378a2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:14.319553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52c7e6-1fd4-41f2-8d2c-797f04f02d38 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:14.320507 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3380/6814] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:14 2022] POST /identity/v3/users => generated 287 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:14.322484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90803b52-f492-4e6a-a9ec-58d8daf560ea admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:14.337873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90803b52-f492-4e6a-a9ec-58d8daf560ea admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:14.346324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21773dae-9e55-44c5-9c48-c6ad6dbe9244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:14.347135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21773dae-9e55-44c5-9c48-c6ad6dbe9244 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:14.348403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21773dae-9e55-44c5-9c48-c6ad6dbe9244 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:14.350665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21773dae-9e55-44c5-9c48-c6ad6dbe9244 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:14.352510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21773dae-9e55-44c5-9c48-c6ad6dbe9244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:14.358152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21773dae-9e55-44c5-9c48-c6ad6dbe9244 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:14.364365 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3435/6815] 10.222.0.17 () {58 vars in 1293 bytes} [Sat Jul 30 21:28:14 2022] GET /identity/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials => generated 1502 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:28:14.370878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52c7e6-1fd4-41f2-8d2c-797f04f02d38 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:14.384754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52c7e6-1fd4-41f2-8d2c-797f04f02d38 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:14.387596 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3381/6816] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:14.393356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21773dae-9e55-44c5-9c48-c6ad6dbe9244 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:14.395044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00027650-c371-49f6-91fe-a28e2f318e43 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc6aa2232d248538b9de4643c5378a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f540680daf44480fa83db2f4db93a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:14.395968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00027650-c371-49f6-91fe-a28e2f318e43 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:14.398423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00027650-c371-49f6-91fe-a28e2f318e43 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:14.398881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00027650-c371-49f6-91fe-a28e2f318e43 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] PATH_INFO: `/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials/f510d88e9ca04f5b94f9c0973e7c183d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:14.412609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00027650-c371-49f6-91fe-a28e2f318e43 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorizing `identity:delete_application_credential(user_id=ffc6aa2232d248538b9de4643c5378a2, application_credential_id=f510d88e9ca04f5b94f9c0973e7c183d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:14.414501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00027650-c371-49f6-91fe-a28e2f318e43 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:14.419582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21773dae-9e55-44c5-9c48-c6ad6dbe9244 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:14.430753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf41e92-0906-4370-8b76-3494fb5349c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:14.433050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf41e92-0906-4370-8b76-3494fb5349c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:14.433414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf41e92-0906-4370-8b76-3494fb5349c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:14.433717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf41e92-0906-4370-8b76-3494fb5349c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:14.434530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf41e92-0906-4370-8b76-3494fb5349c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:14.447703 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3436/6817] 10.222.0.17 () {58 vars in 1395 bytes} [Sat Jul 30 21:28:14 2022] DELETE /identity/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials/f510d88e9ca04f5b94f9c0973e7c183d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:14.448262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf41e92-0906-4370-8b76-3494fb5349c6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:14.450081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:14.452957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00027650-c371-49f6-91fe-a28e2f318e43 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:14.481666 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3382/6818] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:14.494091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf41e92-0906-4370-8b76-3494fb5349c6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:14.495893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00027650-c371-49f6-91fe-a28e2f318e43 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:14.508378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba931578-292e-4cea-90d6-3b5740ea367f tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc6aa2232d248538b9de4643c5378a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f540680daf44480fa83db2f4db93a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:14.510784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba931578-292e-4cea-90d6-3b5740ea367f tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:14.511331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba931578-292e-4cea-90d6-3b5740ea367f tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:14.512249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba931578-292e-4cea-90d6-3b5740ea367f tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] PATH_INFO: `/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials/96e417f67fa3426eaffe55fa452b2a60` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:14.523965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf41e92-0906-4370-8b76-3494fb5349c6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:14.532260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98176048-37fe-48a5-9f43-636f32642767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:14.533109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98176048-37fe-48a5-9f43-636f32642767 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:14.533513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98176048-37fe-48a5-9f43-636f32642767 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:14.533905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98176048-37fe-48a5-9f43-636f32642767 admin admin] PATH_INFO: `/v3/projects/418ff359f7a747e58ae4fdf0c4b7072a/users/db01f9802e8147b8bdabfc9bbbbd7bb3/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:14.543668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba931578-292e-4cea-90d6-3b5740ea367f tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorizing `identity:delete_application_credential(user_id=ffc6aa2232d248538b9de4643c5378a2, application_credential_id=96e417f67fa3426eaffe55fa452b2a60)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:14.548400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba931578-292e-4cea-90d6-3b5740ea367f tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:14.568234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98176048-37fe-48a5-9f43-636f32642767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=418ff359f7a747e58ae4fdf0c4b7072a, user_id=db01f9802e8147b8bdabfc9bbbbd7bb3, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:14.572826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98176048-37fe-48a5-9f43-636f32642767 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:14.605172 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3383/6820] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:14 2022] PUT /identity/v3/projects/418ff359f7a747e58ae4fdf0c4b7072a/users/db01f9802e8147b8bdabfc9bbbbd7bb3/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:14.607609 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3437/6820] 10.222.0.17 () {58 vars in 1395 bytes} [Sat Jul 30 21:28:14 2022] DELETE /identity/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials/96e417f67fa3426eaffe55fa452b2a60 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:14.608926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98176048-37fe-48a5-9f43-636f32642767 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:14.610329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1fa10-2c94-4a51-b801-0b2f8fb21e6e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:14.610582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1fa10-2c94-4a51-b801-0b2f8fb21e6e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:14.610866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1fa10-2c94-4a51-b801-0b2f8fb21e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:14.635277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0ae1fa10-2c94-4a51-b801-0b2f8fb21e6e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:14.636903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0ae1fa10-2c94-4a51-b801-0b2f8fb21e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:14.739846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98176048-37fe-48a5-9f43-636f32642767 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:14.750708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02711449-a2e7-481f-b9f7-ab7d7ed2398e tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc6aa2232d248538b9de4643c5378a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f540680daf44480fa83db2f4db93a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:14.753870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02711449-a2e7-481f-b9f7-ab7d7ed2398e tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:14.754276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02711449-a2e7-481f-b9f7-ab7d7ed2398e tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:14.756110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02711449-a2e7-481f-b9f7-ab7d7ed2398e tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] PATH_INFO: `/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:14.759007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02711449-a2e7-481f-b9f7-ab7d7ed2398e tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorizing `identity:create_application_credential(user_id=ffc6aa2232d248538b9de4643c5378a2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:14.760779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02711449-a2e7-481f-b9f7-ab7d7ed2398e tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:14.785026 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3438/6821] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:28:14.795853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1fa10-2c94-4a51-b801-0b2f8fb21e6e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:14.798906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0ae1fa10-2c94-4a51-b801-0b2f8fb21e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:14.873928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:14.915258 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3384/6822] 10.222.0.17 () {60 vars in 1314 bytes} [Sat Jul 30 21:28:14 2022] POST /identity/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials => generated 789 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:14.916486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02711449-a2e7-481f-b9f7-ab7d7ed2398e tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:14.931634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02711449-a2e7-481f-b9f7-ab7d7ed2398e tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:14.934265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1fa10-2c94-4a51-b801-0b2f8fb21e6e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:14.943585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e7dd3-e118-4527-9e39-ca96920f7f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:14.944246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e7dd3-e118-4527-9e39-ca96920f7f41 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:14.944532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e7dd3-e118-4527-9e39-ca96920f7f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:14.944856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e7dd3-e118-4527-9e39-ca96920f7f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:14.962465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0be7b0-9e4d-4c05-a8a7-6ab7605cdd90 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc6aa2232d248538b9de4643c5378a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f540680daf44480fa83db2f4db93a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:14.963653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0be7b0-9e4d-4c05-a8a7-6ab7605cdd90 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:14.964057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0be7b0-9e4d-4c05-a8a7-6ab7605cdd90 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:14.964564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0be7b0-9e4d-4c05-a8a7-6ab7605cdd90 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] PATH_INFO: `/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:14.966113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0be7b0-9e4d-4c05-a8a7-6ab7605cdd90 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorizing `identity:create_application_credential(user_id=ffc6aa2232d248538b9de4643c5378a2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:14.967479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0be7b0-9e4d-4c05-a8a7-6ab7605cdd90 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:14.979658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e7dd3-e118-4527-9e39-ca96920f7f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:14.981400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e7dd3-e118-4527-9e39-ca96920f7f41 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:14.993357 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3439/6823] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:28:15.105080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e7dd3-e118-4527-9e39-ca96920f7f41 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:15.107329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-383e7dd3-e118-4527-9e39-ca96920f7f41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:15.168533 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3385/6824] 10.222.0.17 () {60 vars in 1314 bytes} [Sat Jul 30 21:28:14 2022] POST /identity/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials => generated 788 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:15.171327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0be7b0-9e4d-4c05-a8a7-6ab7605cdd90 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:15.191316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0be7b0-9e4d-4c05-a8a7-6ab7605cdd90 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:15.197407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8ed2d-46fc-4914-9b8c-68a069d44714 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc6aa2232d248538b9de4643c5378a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f540680daf44480fa83db2f4db93a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:15.198226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8ed2d-46fc-4914-9b8c-68a069d44714 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:15.198529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8ed2d-46fc-4914-9b8c-68a069d44714 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:15.198811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8ed2d-46fc-4914-9b8c-68a069d44714 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] PATH_INFO: `/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:15.199918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8ed2d-46fc-4914-9b8c-68a069d44714 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Adding query filter params (name=tempest-application_credential-428502935) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:15.200692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8ed2d-46fc-4914-9b8c-68a069d44714 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorizing `identity:list_application_credentials(user_id=ffc6aa2232d248538b9de4643c5378a2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:15.204945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8ed2d-46fc-4914-9b8c-68a069d44714 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:15.223505 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3386/6825] 10.222.0.17 () {58 vars in 1384 bytes} [Sat Jul 30 21:28:15 2022] GET /identity/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials?name=tempest-application_credential-428502935 => generated 885 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:28:15.229791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8ed2d-46fc-4914-9b8c-68a069d44714 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:15.239140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:15.251546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8ed2d-46fc-4914-9b8c-68a069d44714 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:15.261047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd28d4d-e720-4e27-8bfe-b343baebbb9f tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc6aa2232d248538b9de4643c5378a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f540680daf44480fa83db2f4db93a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:15.264163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd28d4d-e720-4e27-8bfe-b343baebbb9f tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:15.265267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd28d4d-e720-4e27-8bfe-b343baebbb9f tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:15.265627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd28d4d-e720-4e27-8bfe-b343baebbb9f tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] PATH_INFO: `/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials/89cc1476e31f436fa60f654315c4874e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:15.283188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd28d4d-e720-4e27-8bfe-b343baebbb9f tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorizing `identity:delete_application_credential(user_id=ffc6aa2232d248538b9de4643c5378a2, application_credential_id=89cc1476e31f436fa60f654315c4874e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:15.286197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd28d4d-e720-4e27-8bfe-b343baebbb9f tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:15.312046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e7dd3-e118-4527-9e39-ca96920f7f41 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:15.320783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e435eb-c157-4877-8dc4-ec7268e516b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:15.321483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e435eb-c157-4877-8dc4-ec7268e516b0 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:15.321847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e435eb-c157-4877-8dc4-ec7268e516b0 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:15.322537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e435eb-c157-4877-8dc4-ec7268e516b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:15.324789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-80e435eb-c157-4877-8dc4-ec7268e516b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:15.330647 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3387/6826] 10.222.0.17 () {58 vars in 1395 bytes} [Sat Jul 30 21:28:15 2022] DELETE /identity/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials/89cc1476e31f436fa60f654315c4874e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:28:15.334720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd28d4d-e720-4e27-8bfe-b343baebbb9f tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:15.342574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e435eb-c157-4877-8dc4-ec7268e516b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:15.344707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e435eb-c157-4877-8dc4-ec7268e516b0 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:15.350324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd28d4d-e720-4e27-8bfe-b343baebbb9f tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:15.360654 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3440/6827] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:15.367257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d1bbc-09c8-4c19-8290-8cd470313412 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc6aa2232d248538b9de4643c5378a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f540680daf44480fa83db2f4db93a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:15.367970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d1bbc-09c8-4c19-8290-8cd470313412 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:15.368385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d1bbc-09c8-4c19-8290-8cd470313412 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:15.368676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d1bbc-09c8-4c19-8290-8cd470313412 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] PATH_INFO: `/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials/b6f0ed2d946f4f3ab93ee9e4c35006d9` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:15.392316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d1bbc-09c8-4c19-8290-8cd470313412 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorizing `identity:delete_application_credential(user_id=ffc6aa2232d248538b9de4643c5378a2, application_credential_id=b6f0ed2d946f4f3ab93ee9e4c35006d9)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:15.393830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d1bbc-09c8-4c19-8290-8cd470313412 tempest-ApplicationCredentialsV3Test-1868785519 tempest-ApplicationCredentialsV3Test-1868785519-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:15.428167 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3388/6828] 10.222.0.17 () {58 vars in 1395 bytes} [Sat Jul 30 21:28:15 2022] DELETE /identity/v3/users/ffc6aa2232d248538b9de4643c5378a2/application_credentials/b6f0ed2d946f4f3ab93ee9e4c35006d9 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:15.432583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e435eb-c157-4877-8dc4-ec7268e516b0 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:15.434327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-80e435eb-c157-4877-8dc4-ec7268e516b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:15.453485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e435eb-c157-4877-8dc4-ec7268e516b0 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:15.461805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19ebfa-3b3c-4d50-bb73-99aeebee93b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:15.462485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19ebfa-3b3c-4d50-bb73-99aeebee93b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:15.462794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19ebfa-3b3c-4d50-bb73-99aeebee93b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:15.463128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19ebfa-3b3c-4d50-bb73-99aeebee93b9 admin admin] PATH_INFO: `/v3/users/ffc6aa2232d248538b9de4643c5378a2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:15.464500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19ebfa-3b3c-4d50-bb73-99aeebee93b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc6aa2232d248538b9de4643c5378a2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:15.466965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19ebfa-3b3c-4d50-bb73-99aeebee93b9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:15.588506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5d19ebfa-3b3c-4d50-bb73-99aeebee93b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc6aa2232d248538b9de4643c5378a2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:15.632925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5d19ebfa-3b3c-4d50-bb73-99aeebee93b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc6aa2232d248538b9de4643c5378a2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:15.634291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5d19ebfa-3b3c-4d50-bb73-99aeebee93b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc6aa2232d248538b9de4643c5378a2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:15.662378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5d19ebfa-3b3c-4d50-bb73-99aeebee93b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc6aa2232d248538b9de4643c5378a2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:15.664888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5d19ebfa-3b3c-4d50-bb73-99aeebee93b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc6aa2232d248538b9de4643c5378a2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:15.713020 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3441/6829] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:15 2022] DELETE /identity/v3/users/ffc6aa2232d248538b9de4643c5378a2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:15.719897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80158b-2265-41dd-8a89-8ae50793a54e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:15.720138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80158b-2265-41dd-8a89-8ae50793a54e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:15.720353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80158b-2265-41dd-8a89-8ae50793a54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:15.754239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9c80158b-2265-41dd-8a89-8ae50793a54e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:15.755662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9c80158b-2265-41dd-8a89-8ae50793a54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:15.872142 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3389/6830] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:15.908639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19ebfa-3b3c-4d50-bb73-99aeebee93b9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:15.910277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5d19ebfa-3b3c-4d50-bb73-99aeebee93b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:15.949848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:16.048646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19ebfa-3b3c-4d50-bb73-99aeebee93b9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:16.053939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ab23c-e8d7-4f5d-b97d-4735769260ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:16.055429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ab23c-e8d7-4f5d-b97d-4735769260ac service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:16.055956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ab23c-e8d7-4f5d-b97d-4735769260ac service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:16.057053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ab23c-e8d7-4f5d-b97d-4735769260ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:16.083942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ab23c-e8d7-4f5d-b97d-4735769260ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:16.086950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ab23c-e8d7-4f5d-b97d-4735769260ac service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:16.105356 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3442/6831] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:16.908146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80158b-2265-41dd-8a89-8ae50793a54e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:16.909870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9c80158b-2265-41dd-8a89-8ae50793a54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:16.925014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80158b-2265-41dd-8a89-8ae50793a54e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:16.931918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a524379-3779-41e6-b7e2-7a0534ce7d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:16.932741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a524379-3779-41e6-b7e2-7a0534ce7d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:16.933365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a524379-3779-41e6-b7e2-7a0534ce7d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:16.934092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a524379-3779-41e6-b7e2-7a0534ce7d53 admin admin] PATH_INFO: `/v3/users/b7aa09bea7b64b4aac2ca6576d210616` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:16.935699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a524379-3779-41e6-b7e2-7a0534ce7d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7aa09bea7b64b4aac2ca6576d210616)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:16.938875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a524379-3779-41e6-b7e2-7a0534ce7d53 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:17.001176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ab23c-e8d7-4f5d-b97d-4735769260ac service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:17.003022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-020ab23c-e8d7-4f5d-b97d-4735769260ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:17.022173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3a524379-3779-41e6-b7e2-7a0534ce7d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7aa09bea7b64b4aac2ca6576d210616'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:17.023307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3a524379-3779-41e6-b7e2-7a0534ce7d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7aa09bea7b64b4aac2ca6576d210616'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:17.025669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ab23c-e8d7-4f5d-b97d-4735769260ac service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:17.038890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3a524379-3779-41e6-b7e2-7a0534ce7d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7aa09bea7b64b4aac2ca6576d210616'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:17.039896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3a524379-3779-41e6-b7e2-7a0534ce7d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7aa09bea7b64b4aac2ca6576d210616'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:17.042202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003c61b-fd6a-4993-80f9-dbe178ef07cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:17.043686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003c61b-fd6a-4993-80f9-dbe178ef07cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:17.043972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003c61b-fd6a-4993-80f9-dbe178ef07cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:17.044251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003c61b-fd6a-4993-80f9-dbe178ef07cb admin admin] PATH_INFO: `/v3/projects/f540680daf44480fa83db2f4db93a514` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:17.046402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003c61b-fd6a-4993-80f9-dbe178ef07cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f540680daf44480fa83db2f4db93a514)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:17.049259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003c61b-fd6a-4993-80f9-dbe178ef07cb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:17.066111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3a524379-3779-41e6-b7e2-7a0534ce7d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7aa09bea7b64b4aac2ca6576d210616'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:17.092912 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3390/6832] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:16 2022] DELETE /identity/v3/users/b7aa09bea7b64b4aac2ca6576d210616 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:17.094780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711f42a-e638-4615-ad9a-9b5b379199e2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:17.095074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711f42a-e638-4615-ad9a-9b5b379199e2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:17.095405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711f42a-e638-4615-ad9a-9b5b379199e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:17.144489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a711f42a-e638-4615-ad9a-9b5b379199e2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:17.147076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a711f42a-e638-4615-ad9a-9b5b379199e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:17.157515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1003c61b-fd6a-4993-80f9-dbe178ef07cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f540680daf44480fa83db2f4db93a514', 'request_id': 'req-1003c61b-fd6a-4993-80f9-dbe178ef07cb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:17.168868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1003c61b-fd6a-4993-80f9-dbe178ef07cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f540680daf44480fa83db2f4db93a514', 'request_id': 'req-1003c61b-fd6a-4993-80f9-dbe178ef07cb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:17.173608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:17.191563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1003c61b-fd6a-4993-80f9-dbe178ef07cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f540680daf44480fa83db2f4db93a514', 'request_id': 'req-1003c61b-fd6a-4993-80f9-dbe178ef07cb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:17.211602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1003c61b-fd6a-4993-80f9-dbe178ef07cb admin admin] The token cache is being invalidate because project f540680daf44480fa83db2f4db93a514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:17.211979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1003c61b-fd6a-4993-80f9-dbe178ef07cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:17.213217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1003c61b-fd6a-4993-80f9-dbe178ef07cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:17.215177 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3443/6833] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:17 2022] DELETE /identity/v3/projects/f540680daf44480fa83db2f4db93a514 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:17.216632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115d130-ef0d-4cc5-b4d0-fbd6813ac9a1 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:17.217024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115d130-ef0d-4cc5-b4d0-fbd6813ac9a1 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:17.217965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115d130-ef0d-4cc5-b4d0-fbd6813ac9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:17.252902 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3391/6834] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:17.254582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad6ac-b674-4013-87c4-86eb31536ca7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:17.255029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad6ac-b674-4013-87c4-86eb31536ca7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:17.255575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad6ac-b674-4013-87c4-86eb31536ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:17.262180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0115d130-ef0d-4cc5-b4d0-fbd6813ac9a1 None None] MFA Rules not processed for user `db01f9802e8147b8bdabfc9bbbbd7bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:17.263657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0115d130-ef0d-4cc5-b4d0-fbd6813ac9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:17.281695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-39dad6ac-b674-4013-87c4-86eb31536ca7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:17.283280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-39dad6ac-b674-4013-87c4-86eb31536ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:17.293367 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3392/6835] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:17.294830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dad6ac-b674-4013-87c4-86eb31536ca7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:17.301704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-39dad6ac-b674-4013-87c4-86eb31536ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:17.354768 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3444/6836] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:17.356106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a3b07-3d47-4215-bc12-b277a0a6a8e0 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:17.356663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a3b07-3d47-4215-bc12-b277a0a6a8e0 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:17.356946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a3b07-3d47-4215-bc12-b277a0a6a8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:17.396667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ee5a3b07-3d47-4215-bc12-b277a0a6a8e0 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:17.399161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ee5a3b07-3d47-4215-bc12-b277a0a6a8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:17.415949 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3445/6837] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:17.417394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a3b07-3d47-4215-bc12-b277a0a6a8e0 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:17.420382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ee5a3b07-3d47-4215-bc12-b277a0a6a8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:17.443903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dad6ac-b674-4013-87c4-86eb31536ca7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:17.448447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1822129-6eb2-4306-a1f3-6aa08d731ac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:17.449282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a3b07-3d47-4215-bc12-b277a0a6a8e0 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:17.449626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1822129-6eb2-4306-a1f3-6aa08d731ac9 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:17.450114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1822129-6eb2-4306-a1f3-6aa08d731ac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:17.450592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1822129-6eb2-4306-a1f3-6aa08d731ac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:17.464244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1822129-6eb2-4306-a1f3-6aa08d731ac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:17.465946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc21f21-c806-4c33-a6af-d17d0f34a143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:17.466261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1822129-6eb2-4306-a1f3-6aa08d731ac9 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:17.467145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc21f21-c806-4c33-a6af-d17d0f34a143 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:17.468220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc21f21-c806-4c33-a6af-d17d0f34a143 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:17.468739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc21f21-c806-4c33-a6af-d17d0f34a143 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:17.470760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc21f21-c806-4c33-a6af-d17d0f34a143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:17.477488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc21f21-c806-4c33-a6af-d17d0f34a143 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:17.482175 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3393/6838] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:17.484509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1822129-6eb2-4306-a1f3-6aa08d731ac9 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:17.496075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1822129-6eb2-4306-a1f3-6aa08d731ac9 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:17.508065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedce29b-47f8-4f2d-bbd4-1466a46a7b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:17.509287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedce29b-47f8-4f2d-bbd4-1466a46a7b03 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:17.510278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedce29b-47f8-4f2d-bbd4-1466a46a7b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:17.511417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedce29b-47f8-4f2d-bbd4-1466a46a7b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:17.513607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedce29b-47f8-4f2d-bbd4-1466a46a7b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:17.515395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedce29b-47f8-4f2d-bbd4-1466a46a7b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:17.519607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedce29b-47f8-4f2d-bbd4-1466a46a7b03 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:17.531409 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3446/6839] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:17 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:17.535919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc21f21-c806-4c33-a6af-d17d0f34a143 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:17.543313 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3394/6840] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:17.547954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedce29b-47f8-4f2d-bbd4-1466a46a7b03 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:17.553646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:17.560736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedce29b-47f8-4f2d-bbd4-1466a46a7b03 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:17.648634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc21f21-c806-4c33-a6af-d17d0f34a143 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:17.657444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc697063-bd3f-4c0d-933c-67b378fb7022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:17.658189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc697063-bd3f-4c0d-933c-67b378fb7022 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:17.658667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc697063-bd3f-4c0d-933c-67b378fb7022 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:17.659014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc697063-bd3f-4c0d-933c-67b378fb7022 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:17.660633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc697063-bd3f-4c0d-933c-67b378fb7022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:17.663639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc697063-bd3f-4c0d-933c-67b378fb7022 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:17.695179 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3447/6841] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:17 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:17.699255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc697063-bd3f-4c0d-933c-67b378fb7022 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:17.714530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc697063-bd3f-4c0d-933c-67b378fb7022 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:17.720904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd73142-e8ea-4c91-8898-9dcf93562620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:17.722005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd73142-e8ea-4c91-8898-9dcf93562620 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:17.722536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd73142-e8ea-4c91-8898-9dcf93562620 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:17.723016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd73142-e8ea-4c91-8898-9dcf93562620 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:17.723307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6831b5-2cd8-4ced-b5c3-faee5a5e4ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:17.724322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6831b5-2cd8-4ced-b5c3-faee5a5e4ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:17.725447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd73142-e8ea-4c91-8898-9dcf93562620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:17.730381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd73142-e8ea-4c91-8898-9dcf93562620 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:17.731509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6831b5-2cd8-4ced-b5c3-faee5a5e4ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:17.732283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6831b5-2cd8-4ced-b5c3-faee5a5e4ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:17.734118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6831b5-2cd8-4ced-b5c3-faee5a5e4ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:17.738159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6831b5-2cd8-4ced-b5c3-faee5a5e4ad0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:17.752997 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3448/6842] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:17.758509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6831b5-2cd8-4ced-b5c3-faee5a5e4ad0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:17.773239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6831b5-2cd8-4ced-b5c3-faee5a5e4ad0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:17.774942 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3395/6843] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:17 2022] POST /identity/v3/projects => generated 379 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:28:17.778978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd73142-e8ea-4c91-8898-9dcf93562620 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:17.821836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:17.860615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bead793-abac-426c-87b9-1f7d561bc769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:17.862519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bead793-abac-426c-87b9-1f7d561bc769 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:17.863132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bead793-abac-426c-87b9-1f7d561bc769 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:17.863926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bead793-abac-426c-87b9-1f7d561bc769 admin admin] PATH_INFO: `/v3/projects/bc794687868347bbbe6dc0a2873c9ea3/users/758faa3952e342fb8ace9f4ead92f030/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:17.886788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bead793-abac-426c-87b9-1f7d561bc769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc794687868347bbbe6dc0a2873c9ea3, user_id=758faa3952e342fb8ace9f4ead92f030, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:17.892221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bead793-abac-426c-87b9-1f7d561bc769 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:17.903028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd73142-e8ea-4c91-8898-9dcf93562620 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:17.910919 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3449/6844] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:17 2022] PUT /identity/v3/projects/bc794687868347bbbe6dc0a2873c9ea3/users/758faa3952e342fb8ace9f4ead92f030/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:17.916326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bead793-abac-426c-87b9-1f7d561bc769 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:18.020485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3aa0d2-2e5e-4a20-bf8c-e5f3d2c93343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:18.021122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3aa0d2-2e5e-4a20-bf8c-e5f3d2c93343 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:18.021410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3aa0d2-2e5e-4a20-bf8c-e5f3d2c93343 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:18.021694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3aa0d2-2e5e-4a20-bf8c-e5f3d2c93343 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:18.022539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3aa0d2-2e5e-4a20-bf8c-e5f3d2c93343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:18.026022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3aa0d2-2e5e-4a20-bf8c-e5f3d2c93343 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:18.028494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bead793-abac-426c-87b9-1f7d561bc769 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:18.036461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85c87f-bbcb-4e3f-929a-be1f698f1656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:18.037462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85c87f-bbcb-4e3f-929a-be1f698f1656 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:18.038291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85c87f-bbcb-4e3f-929a-be1f698f1656 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:18.039186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85c87f-bbcb-4e3f-929a-be1f698f1656 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:18.042519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85c87f-bbcb-4e3f-929a-be1f698f1656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:18.045458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85c87f-bbcb-4e3f-929a-be1f698f1656 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:18.056003 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3396/6845] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:17 2022] POST /identity/v3/users => generated 290 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:18.062027 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3450/6846] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:28:18.063266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85c87f-bbcb-4e3f-929a-be1f698f1656 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:18.063737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3aa0d2-2e5e-4a20-bf8c-e5f3d2c93343 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:18.070883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:18.077665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3aa0d2-2e5e-4a20-bf8c-e5f3d2c93343 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:18.080042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85c87f-bbcb-4e3f-929a-be1f698f1656 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:18.084253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb344bdb-19ba-40e6-813a-743c8d87ecd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:18.085126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb344bdb-19ba-40e6-813a-743c8d87ecd6 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:18.085416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb344bdb-19ba-40e6-813a-743c8d87ecd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:18.085694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb344bdb-19ba-40e6-813a-743c8d87ecd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:18.086391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb344bdb-19ba-40e6-813a-743c8d87ecd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:18.088101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb344bdb-19ba-40e6-813a-743c8d87ecd6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:18.098743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40b4e5-fbd3-4614-93c2-85f78beeb1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:18.099801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40b4e5-fbd3-4614-93c2-85f78beeb1d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:18.100232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40b4e5-fbd3-4614-93c2-85f78beeb1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:18.103546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40b4e5-fbd3-4614-93c2-85f78beeb1d1 admin admin] PATH_INFO: `/v3/projects/bc794687868347bbbe6dc0a2873c9ea3/users/758faa3952e342fb8ace9f4ead92f030/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:18.103651 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3397/6847] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:18.103744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40b4e5-fbd3-4614-93c2-85f78beeb1d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc794687868347bbbe6dc0a2873c9ea3, user_id=758faa3952e342fb8ace9f4ead92f030, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:18.104579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb344bdb-19ba-40e6-813a-743c8d87ecd6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:18.109319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40b4e5-fbd3-4614-93c2-85f78beeb1d1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:18.127121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb344bdb-19ba-40e6-813a-743c8d87ecd6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:18.132558 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3451/6848] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:18 2022] PUT /identity/v3/projects/bc794687868347bbbe6dc0a2873c9ea3/users/758faa3952e342fb8ace9f4ead92f030/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:18.225860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d84c0-8cfc-4acc-8102-b914d9ed488d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:18.226913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d84c0-8cfc-4acc-8102-b914d9ed488d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:18.227221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d84c0-8cfc-4acc-8102-b914d9ed488d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:18.227669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d84c0-8cfc-4acc-8102-b914d9ed488d admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:18.229271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d84c0-8cfc-4acc-8102-b914d9ed488d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:18.232006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d84c0-8cfc-4acc-8102-b914d9ed488d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:18.252899 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3398/6849] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:18.256283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40b4e5-fbd3-4614-93c2-85f78beeb1d1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:18.268833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d84c0-8cfc-4acc-8102-b914d9ed488d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:18.274816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b58d84c0-8cfc-4acc-8102-b914d9ed488d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:18.275471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40b4e5-fbd3-4614-93c2-85f78beeb1d1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:18.281672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2ba52-a749-4d6d-9612-ff281ebfdf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:18.290095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2ba52-a749-4d6d-9612-ff281ebfdf22 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:18.290833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2ba52-a749-4d6d-9612-ff281ebfdf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:18.291336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2ba52-a749-4d6d-9612-ff281ebfdf22 admin admin] PATH_INFO: `/v3/projects/093062941f7349e6bd2b103b92606890/users/3895ac8132c84ca4af73419afd445d3c/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:18.318722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d84c0-8cfc-4acc-8102-b914d9ed488d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:18.326404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a745a-2084-48cf-aa4e-012ff85343c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:18.327095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a745a-2084-48cf-aa4e-012ff85343c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:18.327456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a745a-2084-48cf-aa4e-012ff85343c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:18.327810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a745a-2084-48cf-aa4e-012ff85343c2 admin admin] PATH_INFO: `/v3/projects/60d48ba124cd4fa0b42cdaaa91ded769` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:18.328947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a745a-2084-48cf-aa4e-012ff85343c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d48ba124cd4fa0b42cdaaa91ded769)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:18.331018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a745a-2084-48cf-aa4e-012ff85343c2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:18.343937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2ba52-a749-4d6d-9612-ff281ebfdf22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=093062941f7349e6bd2b103b92606890, user_id=3895ac8132c84ca4af73419afd445d3c, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:18.346959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2ba52-a749-4d6d-9612-ff281ebfdf22 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:18.385770 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3452/6850] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:18 2022] PUT /identity/v3/projects/093062941f7349e6bd2b103b92606890/users/3895ac8132c84ca4af73419afd445d3c/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:18.388269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58279d-9734-4d82-a51a-2644758e0c25 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:18.388585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58279d-9734-4d82-a51a-2644758e0c25 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:18.388829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58279d-9734-4d82-a51a-2644758e0c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:18.411697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:18.423964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b68a745a-2084-48cf-aa4e-012ff85343c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d48ba124cd4fa0b42cdaaa91ded769', 'request_id': 'req-b68a745a-2084-48cf-aa4e-012ff85343c2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:18.443713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b68a745a-2084-48cf-aa4e-012ff85343c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d48ba124cd4fa0b42cdaaa91ded769', 'request_id': 'req-b68a745a-2084-48cf-aa4e-012ff85343c2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:18.451597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b68a745a-2084-48cf-aa4e-012ff85343c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d48ba124cd4fa0b42cdaaa91ded769', 'request_id': 'req-b68a745a-2084-48cf-aa4e-012ff85343c2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:18.454077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-fa58279d-9734-4d82-a51a-2644758e0c25 None None] MFA Rules not processed for user `3895ac8132c84ca4af73419afd445d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:18.460970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fa58279d-9734-4d82-a51a-2644758e0c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:18.470164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b68a745a-2084-48cf-aa4e-012ff85343c2 admin admin] The token cache is being invalidate because project 60d48ba124cd4fa0b42cdaaa91ded769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:18.470539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b68a745a-2084-48cf-aa4e-012ff85343c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:18.472015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b68a745a-2084-48cf-aa4e-012ff85343c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:18.478719 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3399/6851] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:18 2022] DELETE /identity/v3/projects/60d48ba124cd4fa0b42cdaaa91ded769 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:18.479582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a745a-2084-48cf-aa4e-012ff85343c2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:18.482134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b68a745a-2084-48cf-aa4e-012ff85343c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:18.618163 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3453/6852] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:18.622617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58279d-9734-4d82-a51a-2644758e0c25 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:18.627104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a745a-2084-48cf-aa4e-012ff85343c2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:18.629091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fa58279d-9734-4d82-a51a-2644758e0c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:18.640855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f96140-232e-4f98-9435-2a28fdeab242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:18.641593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f96140-232e-4f98-9435-2a28fdeab242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:18.641757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f96140-232e-4f98-9435-2a28fdeab242 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:18.642031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f96140-232e-4f98-9435-2a28fdeab242 admin admin] PATH_INFO: `/v3/users/0a28f1ac1cc14aaa8cf674c10df6ab0d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:18.643397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f96140-232e-4f98-9435-2a28fdeab242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a28f1ac1cc14aaa8cf674c10df6ab0d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:18.646754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f96140-232e-4f98-9435-2a28fdeab242 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:18.657150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58279d-9734-4d82-a51a-2644758e0c25 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:18.667684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973ecb2-f45b-4811-84ed-0d79c23ed74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:18.668388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973ecb2-f45b-4811-84ed-0d79c23ed74f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:18.668673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973ecb2-f45b-4811-84ed-0d79c23ed74f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:18.668959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973ecb2-f45b-4811-84ed-0d79c23ed74f admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:18.669607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973ecb2-f45b-4811-84ed-0d79c23ed74f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:18.675541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973ecb2-f45b-4811-84ed-0d79c23ed74f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:18.721021 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3454/6853] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:18 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:18.726290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973ecb2-f45b-4811-84ed-0d79c23ed74f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:18.774264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c1f96140-232e-4f98-9435-2a28fdeab242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a28f1ac1cc14aaa8cf674c10df6ab0d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:18.775400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c1f96140-232e-4f98-9435-2a28fdeab242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a28f1ac1cc14aaa8cf674c10df6ab0d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:18.823021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c1f96140-232e-4f98-9435-2a28fdeab242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a28f1ac1cc14aaa8cf674c10df6ab0d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:18.824726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c1f96140-232e-4f98-9435-2a28fdeab242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a28f1ac1cc14aaa8cf674c10df6ab0d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:18.845608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c1f96140-232e-4f98-9435-2a28fdeab242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a28f1ac1cc14aaa8cf674c10df6ab0d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:18.869435 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3400/6854] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:18 2022] DELETE /identity/v3/users/0a28f1ac1cc14aaa8cf674c10df6ab0d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:18.899534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973ecb2-f45b-4811-84ed-0d79c23ed74f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:18.968393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:19.024589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216213d-898e-42ed-b464-3f183d9f1fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:19.029690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216213d-898e-42ed-b464-3f183d9f1fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:19.031382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216213d-898e-42ed-b464-3f183d9f1fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:19.031943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216213d-898e-42ed-b464-3f183d9f1fe4 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:19.032763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216213d-898e-42ed-b464-3f183d9f1fe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:19.035507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216213d-898e-42ed-b464-3f183d9f1fe4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:19.078294 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3455/6855] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:18 2022] POST /identity/v3/users => generated 290 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:19.079512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f96140-232e-4f98-9435-2a28fdeab242 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:19.081967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c1f96140-232e-4f98-9435-2a28fdeab242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:19.109896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f96140-232e-4f98-9435-2a28fdeab242 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:19.135000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a740bd-40a9-4505-ae65-759db944098b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:19.138195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a740bd-40a9-4505-ae65-759db944098b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:19.140668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a740bd-40a9-4505-ae65-759db944098b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:19.141252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a740bd-40a9-4505-ae65-759db944098b admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:19.143580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a740bd-40a9-4505-ae65-759db944098b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:19.146901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a740bd-40a9-4505-ae65-759db944098b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:19.164790 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3401/6856] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:19.165438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216213d-898e-42ed-b464-3f183d9f1fe4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:19.186255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216213d-898e-42ed-b464-3f183d9f1fe4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:19.192953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd7af4-6d08-4ff2-9af1-92226472ce5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:19.193763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7af4-6d08-4ff2-9af1-92226472ce5e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:19.194135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7af4-6d08-4ff2-9af1-92226472ce5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:19.194483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7af4-6d08-4ff2-9af1-92226472ce5e admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:19.195264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd7af4-6d08-4ff2-9af1-92226472ce5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:19.197496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd7af4-6d08-4ff2-9af1-92226472ce5e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:19.220051 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3456/6857] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:19.224254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a740bd-40a9-4505-ae65-759db944098b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:19.244578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a740bd-40a9-4505-ae65-759db944098b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:19.255142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bee53e-c5e8-491f-98a9-8e21299dbd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:19.256337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bee53e-c5e8-491f-98a9-8e21299dbd43 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:19.257158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bee53e-c5e8-491f-98a9-8e21299dbd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:19.257549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bee53e-c5e8-491f-98a9-8e21299dbd43 admin admin] PATH_INFO: `/v3/projects/0838b9fc3b33439f8ddab0774e43aeb4/users/612b26f2c8a54bb7a57018f876c5f17d/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:19.282809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bee53e-c5e8-491f-98a9-8e21299dbd43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0838b9fc3b33439f8ddab0774e43aeb4, user_id=612b26f2c8a54bb7a57018f876c5f17d, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:19.286138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bee53e-c5e8-491f-98a9-8e21299dbd43 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:19.308028 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3402/6858] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:19 2022] PUT /identity/v3/projects/0838b9fc3b33439f8ddab0774e43aeb4/users/612b26f2c8a54bb7a57018f876c5f17d/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:28:19.318532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2dd90-dfc8-413c-a4dd-604f886908b2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:19.318880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2dd90-dfc8-413c-a4dd-604f886908b2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:19.319136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2dd90-dfc8-413c-a4dd-604f886908b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:19.368950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-57f2dd90-dfc8-413c-a4dd-604f886908b2 None None] MFA Rules not processed for user `612b26f2c8a54bb7a57018f876c5f17d`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:19.370836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-57f2dd90-dfc8-413c-a4dd-604f886908b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:19.455063 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3457/6859] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:19.459819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bee53e-c5e8-491f-98a9-8e21299dbd43 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:19.461924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d4bee53e-c5e8-491f-98a9-8e21299dbd43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:19.477361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:19.555616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bee53e-c5e8-491f-98a9-8e21299dbd43 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:19.565778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0d8af-cc82-4f05-a39a-3984ba44e397 tempest-IdentityV3ProjectsTest-430706437 tempest-IdentityV3ProjectsTest-430706437-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3895ac8132c84ca4af73419afd445d3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '093062941f7349e6bd2b103b92606890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:19.568665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0d8af-cc82-4f05-a39a-3984ba44e397 tempest-IdentityV3ProjectsTest-430706437 tempest-IdentityV3ProjectsTest-430706437-project] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:19.569707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0d8af-cc82-4f05-a39a-3984ba44e397 tempest-IdentityV3ProjectsTest-430706437 tempest-IdentityV3ProjectsTest-430706437-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:19.570006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0d8af-cc82-4f05-a39a-3984ba44e397 tempest-IdentityV3ProjectsTest-430706437 tempest-IdentityV3ProjectsTest-430706437-project] PATH_INFO: `/v3/users/3895ac8132c84ca4af73419afd445d3c/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:19.573829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0d8af-cc82-4f05-a39a-3984ba44e397 tempest-IdentityV3ProjectsTest-430706437 tempest-IdentityV3ProjectsTest-430706437-project] RBAC: Authorizing `identity:list_user_projects(user_id=3895ac8132c84ca4af73419afd445d3c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:19.575746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0d8af-cc82-4f05-a39a-3984ba44e397 tempest-IdentityV3ProjectsTest-430706437 tempest-IdentityV3ProjectsTest-430706437-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:19.647058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b480cb-0a9f-4b34-ba4f-19b63eadd30c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:19.647389 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3403/6860] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:28:19 2022] GET /identity/v3/users/3895ac8132c84ca4af73419afd445d3c/projects => generated 515 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:19.647546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b480cb-0a9f-4b34-ba4f-19b63eadd30c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:19.647698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b480cb-0a9f-4b34-ba4f-19b63eadd30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:19.705517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-70b480cb-0a9f-4b34-ba4f-19b63eadd30c None None] MFA Rules not processed for user `3895ac8132c84ca4af73419afd445d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:19.707397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-70b480cb-0a9f-4b34-ba4f-19b63eadd30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:19.721820 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3458/6861] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:19.723874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914d8a0-5d84-4b2f-aa8e-3a6d751f43d3 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:19.724170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914d8a0-5d84-4b2f-aa8e-3a6d751f43d3 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:19.724448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914d8a0-5d84-4b2f-aa8e-3a6d751f43d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:19.758690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7914d8a0-5d84-4b2f-aa8e-3a6d751f43d3 None None] MFA Rules not processed for user `3895ac8132c84ca4af73419afd445d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:19.760547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7914d8a0-5d84-4b2f-aa8e-3a6d751f43d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:19.867358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.models.token_model [None req-7914d8a0-5d84-4b2f-aa8e-3a6d751f43d3 None None] User 3895ac8132c84ca4af73419afd445d3c has no access to project 0838b9fc3b33439f8ddab0774e43aeb4 {{(pid=91086) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Jul 30 21:28:19.871691 ncdv-master-1 devstack@keystone.service[91086]: WARNING keystone.server.flask.application [None req-7914d8a0-5d84-4b2f-aa8e-3a6d751f43d3 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.17: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 30 21:28:19.877769 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3404/6862] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:19 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 151 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 30 21:28:19.879072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b480cb-0a9f-4b34-ba4f-19b63eadd30c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:19.924144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e279af7-e9a9-477e-abf6-530a4a7efe2f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:19.924539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e279af7-e9a9-477e-abf6-530a4a7efe2f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:19.924765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e279af7-e9a9-477e-abf6-530a4a7efe2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:19.999201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8e279af7-e9a9-477e-abf6-530a4a7efe2f None None] MFA Rules not processed for user `758faa3952e342fb8ace9f4ead92f030`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:20.000619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8e279af7-e9a9-477e-abf6-530a4a7efe2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:20.009060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b480cb-0a9f-4b34-ba4f-19b63eadd30c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:20.018011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70ffc2-22f4-4fef-a815-a8782ed4ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:20.019214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70ffc2-22f4-4fef-a815-a8782ed4ce17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:20.020193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70ffc2-22f4-4fef-a815-a8782ed4ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:20.020616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70ffc2-22f4-4fef-a815-a8782ed4ce17 admin admin] PATH_INFO: `/v3/users/3895ac8132c84ca4af73419afd445d3c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:20.022336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70ffc2-22f4-4fef-a815-a8782ed4ce17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3895ac8132c84ca4af73419afd445d3c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:20.025287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70ffc2-22f4-4fef-a815-a8782ed4ce17 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:20.116264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:20.133336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6c70ffc2-22f4-4fef-a815-a8782ed4ce17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3895ac8132c84ca4af73419afd445d3c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:20.180436 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3405/6863] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:28:20.191781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cb831-3cbf-4612-9578-54cdcd6323eb None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:20.192096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cb831-3cbf-4612-9578-54cdcd6323eb None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:20.192422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cb831-3cbf-4612-9578-54cdcd6323eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:20.193005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6c70ffc2-22f4-4fef-a815-a8782ed4ce17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3895ac8132c84ca4af73419afd445d3c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:20.195013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6c70ffc2-22f4-4fef-a815-a8782ed4ce17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3895ac8132c84ca4af73419afd445d3c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:20.215508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6c70ffc2-22f4-4fef-a815-a8782ed4ce17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3895ac8132c84ca4af73419afd445d3c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:20.216280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6c70ffc2-22f4-4fef-a815-a8782ed4ce17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3895ac8132c84ca4af73419afd445d3c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:20.233993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-835cb831-3cbf-4612-9578-54cdcd6323eb None None] MFA Rules not processed for user `db01f9802e8147b8bdabfc9bbbbd7bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:20.235234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-835cb831-3cbf-4612-9578-54cdcd6323eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:20.238757 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3459/6864] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:19 2022] DELETE /identity/v3/users/3895ac8132c84ca4af73419afd445d3c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:28:20.239798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70ffc2-22f4-4fef-a815-a8782ed4ce17 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:20.243075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6c70ffc2-22f4-4fef-a815-a8782ed4ce17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:20.269556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:20.342844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70ffc2-22f4-4fef-a815-a8782ed4ce17 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:20.350952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79506c9-845f-4e87-9ebb-97824910123e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:20.351929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79506c9-845f-4e87-9ebb-97824910123e service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:20.352621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79506c9-845f-4e87-9ebb-97824910123e service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:20.353169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79506c9-845f-4e87-9ebb-97824910123e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:20.356636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e79506c9-845f-4e87-9ebb-97824910123e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:20.366500 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3406/6865] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:20.368259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725cb2f-7237-435b-9953-7944506c8bb0 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:20.368555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725cb2f-7237-435b-9953-7944506c8bb0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:20.368837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725cb2f-7237-435b-9953-7944506c8bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:20.382491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79506c9-845f-4e87-9ebb-97824910123e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:20.384554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79506c9-845f-4e87-9ebb-97824910123e service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:20.400987 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3460/6866] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:20.401939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79506c9-845f-4e87-9ebb-97824910123e service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:20.404149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e79506c9-845f-4e87-9ebb-97824910123e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:20.435851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2725cb2f-7237-435b-9953-7944506c8bb0 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:20.437637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2725cb2f-7237-435b-9953-7944506c8bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:20.523045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79506c9-845f-4e87-9ebb-97824910123e service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:20.529823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e774911-4981-4b57-9b28-e8991d806cda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:20.530509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e774911-4981-4b57-9b28-e8991d806cda service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:20.530751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e774911-4981-4b57-9b28-e8991d806cda service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:20.531069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e774911-4981-4b57-9b28-e8991d806cda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:20.535780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1e774911-4981-4b57-9b28-e8991d806cda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:20.557275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e774911-4981-4b57-9b28-e8991d806cda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:20.559665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e774911-4981-4b57-9b28-e8991d806cda service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:20.576200 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3461/6867] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:20.607713 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3407/6868] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:20.635658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e774911-4981-4b57-9b28-e8991d806cda service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:20.638994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1e774911-4981-4b57-9b28-e8991d806cda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:20.731281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:20.778331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e774911-4981-4b57-9b28-e8991d806cda service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:20.788252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a31bcf-7036-4b87-a9c2-55b5b8f345f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:20.791155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a31bcf-7036-4b87-a9c2-55b5b8f345f2 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:20.791611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a31bcf-7036-4b87-a9c2-55b5b8f345f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:20.791895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a31bcf-7036-4b87-a9c2-55b5b8f345f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:20.809042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a31bcf-7036-4b87-a9c2-55b5b8f345f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:20.810783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a31bcf-7036-4b87-a9c2-55b5b8f345f2 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:20.824025 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3462/6869] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:20.871520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725cb2f-7237-435b-9953-7944506c8bb0 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:20.875668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2725cb2f-7237-435b-9953-7944506c8bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:20.890270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725cb2f-7237-435b-9953-7944506c8bb0 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:20.897884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7985b-cd0f-4fad-9c6f-868dec63cd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:20.897884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7985b-cd0f-4fad-9c6f-868dec63cd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:20.897884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7985b-cd0f-4fad-9c6f-868dec63cd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:20.898427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7985b-cd0f-4fad-9c6f-868dec63cd36 admin admin] PATH_INFO: `/v3/projects/ee734eb4c50c4e179e3c622db2e4e63a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:20.900158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7985b-cd0f-4fad-9c6f-868dec63cd36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee734eb4c50c4e179e3c622db2e4e63a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:20.902809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7985b-cd0f-4fad-9c6f-868dec63cd36 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:21.050369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bcf7985b-cd0f-4fad-9c6f-868dec63cd36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee734eb4c50c4e179e3c622db2e4e63a', 'request_id': 'req-bcf7985b-cd0f-4fad-9c6f-868dec63cd36'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:21.076217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bcf7985b-cd0f-4fad-9c6f-868dec63cd36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee734eb4c50c4e179e3c622db2e4e63a', 'request_id': 'req-bcf7985b-cd0f-4fad-9c6f-868dec63cd36'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:21.085668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bcf7985b-cd0f-4fad-9c6f-868dec63cd36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee734eb4c50c4e179e3c622db2e4e63a', 'request_id': 'req-bcf7985b-cd0f-4fad-9c6f-868dec63cd36'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:21.112708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bcf7985b-cd0f-4fad-9c6f-868dec63cd36 admin admin] The token cache is being invalidate because project ee734eb4c50c4e179e3c622db2e4e63a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:21.113162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bcf7985b-cd0f-4fad-9c6f-868dec63cd36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:21.113980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bcf7985b-cd0f-4fad-9c6f-868dec63cd36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:21.116879 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3408/6870] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:20 2022] DELETE /identity/v3/projects/ee734eb4c50c4e179e3c622db2e4e63a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:21.121703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53126e04-dbee-4102-9d90-592532d4bbbc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:21.122547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53126e04-dbee-4102-9d90-592532d4bbbc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:21.123007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53126e04-dbee-4102-9d90-592532d4bbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:21.160843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-53126e04-dbee-4102-9d90-592532d4bbbc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:21.164490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-53126e04-dbee-4102-9d90-592532d4bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:21.257050 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3463/6871] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:21.258514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c3a64-0abb-479c-8786-01ac591548d5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:21.258978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c3a64-0abb-479c-8786-01ac591548d5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:21.259080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c3a64-0abb-479c-8786-01ac591548d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:21.283042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7a6c3a64-0abb-479c-8786-01ac591548d5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:21.284740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7a6c3a64-0abb-479c-8786-01ac591548d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:21.294016 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3409/6872] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:28:21.299307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53126e04-dbee-4102-9d90-592532d4bbbc None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:21.309741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53126e04-dbee-4102-9d90-592532d4bbbc None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:21.316784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40407e-5777-4d9d-baf0-0a500e09116c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:21.317918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40407e-5777-4d9d-baf0-0a500e09116c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:21.318505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40407e-5777-4d9d-baf0-0a500e09116c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:21.318871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40407e-5777-4d9d-baf0-0a500e09116c admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:21.319753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40407e-5777-4d9d-baf0-0a500e09116c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:21.320232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40407e-5777-4d9d-baf0-0a500e09116c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:21.322903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40407e-5777-4d9d-baf0-0a500e09116c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:21.341461 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3464/6873] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:21.342494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c3a64-0abb-479c-8786-01ac591548d5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:21.353915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c3a64-0abb-479c-8786-01ac591548d5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:21.361901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66088fbd-c088-4071-bdef-6678cd205537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:21.362791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66088fbd-c088-4071-bdef-6678cd205537 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:21.365996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66088fbd-c088-4071-bdef-6678cd205537 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:21.365996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66088fbd-c088-4071-bdef-6678cd205537 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:21.365996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66088fbd-c088-4071-bdef-6678cd205537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:21.367871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66088fbd-c088-4071-bdef-6678cd205537 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:21.417802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40407e-5777-4d9d-baf0-0a500e09116c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:21.427661 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3410/6874] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:21 2022] POST /identity/v3/projects => generated 397 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:21.439370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40407e-5777-4d9d-baf0-0a500e09116c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:21.553160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd542b40-ac0d-4387-b10b-3f4d0d4a2c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:21.554536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd542b40-ac0d-4387-b10b-3f4d0d4a2c1e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:21.554860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd542b40-ac0d-4387-b10b-3f4d0d4a2c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:21.555119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd542b40-ac0d-4387-b10b-3f4d0d4a2c1e admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:21.555820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd542b40-ac0d-4387-b10b-3f4d0d4a2c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:21.560524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd542b40-ac0d-4387-b10b-3f4d0d4a2c1e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:21.591983 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3465/6875] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:21 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:21.596683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66088fbd-c088-4071-bdef-6678cd205537 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:21.610745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66088fbd-c088-4071-bdef-6678cd205537 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:21.616337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026cd2ea-de90-4f72-9b05-fe26b7f3cf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:21.617108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cd2ea-de90-4f72-9b05-fe26b7f3cf00 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:21.617716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cd2ea-de90-4f72-9b05-fe26b7f3cf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:21.618002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cd2ea-de90-4f72-9b05-fe26b7f3cf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:21.619036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026cd2ea-de90-4f72-9b05-fe26b7f3cf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:21.621052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026cd2ea-de90-4f72-9b05-fe26b7f3cf00 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:21.639951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd542b40-ac0d-4387-b10b-3f4d0d4a2c1e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:21.651241 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3411/6876] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:21.652932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd542b40-ac0d-4387-b10b-3f4d0d4a2c1e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:21.659830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fa25b-31be-4c2b-ba3f-3dd9a4a1b401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:21.660586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fa25b-31be-4c2b-ba3f-3dd9a4a1b401 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:21.661421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fa25b-31be-4c2b-ba3f-3dd9a4a1b401 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:21.661806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fa25b-31be-4c2b-ba3f-3dd9a4a1b401 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:21.662612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6fa25b-31be-4c2b-ba3f-3dd9a4a1b401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:21.664338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6fa25b-31be-4c2b-ba3f-3dd9a4a1b401 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:21.684300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026cd2ea-de90-4f72-9b05-fe26b7f3cf00 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:21.696652 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3466/6877] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:21.697811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026cd2ea-de90-4f72-9b05-fe26b7f3cf00 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:21.704021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea192a-c68e-4bb5-b424-2abf25c0366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:21.704949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea192a-c68e-4bb5-b424-2abf25c0366f admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:21.705376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea192a-c68e-4bb5-b424-2abf25c0366f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:21.705752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea192a-c68e-4bb5-b424-2abf25c0366f admin admin] PATH_INFO: `/v3/projects/7b37395154b44e35a734b230f66b61cd/users/9934b91efbbe46da9ac86ecf5504e5e0/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:21.711052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:21.731333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea192a-c68e-4bb5-b424-2abf25c0366f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b37395154b44e35a734b230f66b61cd, user_id=9934b91efbbe46da9ac86ecf5504e5e0, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:21.737429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea192a-c68e-4bb5-b424-2abf25c0366f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:21.774334 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3412/6878] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:21 2022] PUT /identity/v3/projects/7b37395154b44e35a734b230f66b61cd/users/9934b91efbbe46da9ac86ecf5504e5e0/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:21.795330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854813d-8b21-45c8-83eb-1fcdc18ee6cd None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:21.796236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854813d-8b21-45c8-83eb-1fcdc18ee6cd None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:21.796525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854813d-8b21-45c8-83eb-1fcdc18ee6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:21.852096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b854813d-8b21-45c8-83eb-1fcdc18ee6cd None None] MFA Rules not processed for user `9934b91efbbe46da9ac86ecf5504e5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:21.853699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b854813d-8b21-45c8-83eb-1fcdc18ee6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:21.936397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:22.007811 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3467/6879] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:22.018187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea192a-c68e-4bb5-b424-2abf25c0366f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:22.124899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea192a-c68e-4bb5-b424-2abf25c0366f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:22.135219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63890334-2dc6-4942-9141-5af1898c6771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:22.135889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63890334-2dc6-4942-9141-5af1898c6771 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:22.136262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63890334-2dc6-4942-9141-5af1898c6771 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:22.136666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63890334-2dc6-4942-9141-5af1898c6771 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:22.137448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63890334-2dc6-4942-9141-5af1898c6771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:22.143630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63890334-2dc6-4942-9141-5af1898c6771 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:22.205187 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3413/6880] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:22 2022] POST /identity/v3/projects => generated 399 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:22.209627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854813d-8b21-45c8-83eb-1fcdc18ee6cd None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:22.225311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854813d-8b21-45c8-83eb-1fcdc18ee6cd None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:22.315447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620fca7-3b3d-435b-aee8-ae0b941b1e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:22.316389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620fca7-3b3d-435b-aee8-ae0b941b1e24 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:22.316852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620fca7-3b3d-435b-aee8-ae0b941b1e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:22.317303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620fca7-3b3d-435b-aee8-ae0b941b1e24 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:22.318129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620fca7-3b3d-435b-aee8-ae0b941b1e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:22.320708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620fca7-3b3d-435b-aee8-ae0b941b1e24 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:22.358238 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3468/6881] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:22 2022] POST /identity/v3/users => generated 306 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:22.362043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63890334-2dc6-4942-9141-5af1898c6771 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:22.379178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620fca7-3b3d-435b-aee8-ae0b941b1e24 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:22.381290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9620fca7-3b3d-435b-aee8-ae0b941b1e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:22.383592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63890334-2dc6-4942-9141-5af1898c6771 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:22.390450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923eef3-db64-4218-8f27-4f8f36cead6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:22.391535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923eef3-db64-4218-8f27-4f8f36cead6e admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:22.392176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923eef3-db64-4218-8f27-4f8f36cead6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:22.392848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923eef3-db64-4218-8f27-4f8f36cead6e admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:22.394084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923eef3-db64-4218-8f27-4f8f36cead6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:22.396076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923eef3-db64-4218-8f27-4f8f36cead6e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:22.403830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620fca7-3b3d-435b-aee8-ae0b941b1e24 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:22.412026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993df11e-65b0-428e-af7e-5bfa6912b35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:22.413201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993df11e-65b0-428e-af7e-5bfa6912b35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:22.413415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993df11e-65b0-428e-af7e-5bfa6912b35a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:22.413794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993df11e-65b0-428e-af7e-5bfa6912b35a admin admin] PATH_INFO: `/v3/projects/093062941f7349e6bd2b103b92606890` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:22.415410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993df11e-65b0-428e-af7e-5bfa6912b35a admin admin] RBAC: Authorizing `identity:delete_project(project_id=093062941f7349e6bd2b103b92606890)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:22.418443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993df11e-65b0-428e-af7e-5bfa6912b35a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:22.453261 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3414/6882] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:22.455007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923eef3-db64-4218-8f27-4f8f36cead6e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:22.476562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923eef3-db64-4218-8f27-4f8f36cead6e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:22.491143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61584d59-2871-446e-8988-04a4705f85a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:22.492218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61584d59-2871-446e-8988-04a4705f85a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:22.492687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61584d59-2871-446e-8988-04a4705f85a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:22.493114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61584d59-2871-446e-8988-04a4705f85a7 admin admin] PATH_INFO: `/v3/projects/baa4ebbda8ef40a4b503c67d939d960c/users/b8f52cc0616a4da4a03a945cfbe3619c/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:22.511688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-993df11e-65b0-428e-af7e-5bfa6912b35a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '093062941f7349e6bd2b103b92606890', 'request_id': 'req-993df11e-65b0-428e-af7e-5bfa6912b35a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:22.516151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61584d59-2871-446e-8988-04a4705f85a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa4ebbda8ef40a4b503c67d939d960c, user_id=b8f52cc0616a4da4a03a945cfbe3619c, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:22.519186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61584d59-2871-446e-8988-04a4705f85a7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:22.527472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-993df11e-65b0-428e-af7e-5bfa6912b35a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '093062941f7349e6bd2b103b92606890', 'request_id': 'req-993df11e-65b0-428e-af7e-5bfa6912b35a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:22.543165 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3415/6883] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:22 2022] PUT /identity/v3/projects/baa4ebbda8ef40a4b503c67d939d960c/users/b8f52cc0616a4da4a03a945cfbe3619c/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:22.548595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61584d59-2871-446e-8988-04a4705f85a7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:22.549842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-993df11e-65b0-428e-af7e-5bfa6912b35a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '093062941f7349e6bd2b103b92606890', 'request_id': 'req-993df11e-65b0-428e-af7e-5bfa6912b35a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:22.576659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-993df11e-65b0-428e-af7e-5bfa6912b35a admin admin] The token cache is being invalidate because project 093062941f7349e6bd2b103b92606890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:22.576659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-993df11e-65b0-428e-af7e-5bfa6912b35a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:22.577946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-993df11e-65b0-428e-af7e-5bfa6912b35a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:22.582667 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3469/6884] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:22 2022] DELETE /identity/v3/projects/093062941f7349e6bd2b103b92606890 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:28:22.587958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993df11e-65b0-428e-af7e-5bfa6912b35a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:22.589331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-993df11e-65b0-428e-af7e-5bfa6912b35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:22.679002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:22.716951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61584d59-2871-446e-8988-04a4705f85a7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:22.724506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea5e73-40f4-45f2-802c-f6ce7131e923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:22.729624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993df11e-65b0-428e-af7e-5bfa6912b35a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:22.738155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea5e73-40f4-45f2-802c-f6ce7131e923 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:22.738725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ff5a2-0c2f-4990-b19f-351cd1a9df64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:22.739447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ff5a2-0c2f-4990-b19f-351cd1a9df64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:22.739736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ff5a2-0c2f-4990-b19f-351cd1a9df64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:22.740014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ff5a2-0c2f-4990-b19f-351cd1a9df64 admin admin] PATH_INFO: `/v3/users/612b26f2c8a54bb7a57018f876c5f17d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:22.741513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ff5a2-0c2f-4990-b19f-351cd1a9df64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=612b26f2c8a54bb7a57018f876c5f17d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:22.743525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ff5a2-0c2f-4990-b19f-351cd1a9df64 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:22.743809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea5e73-40f4-45f2-802c-f6ce7131e923 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:22.744068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea5e73-40f4-45f2-802c-f6ce7131e923 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:22.744833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea5e73-40f4-45f2-802c-f6ce7131e923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:22.747423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea5e73-40f4-45f2-802c-f6ce7131e923 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:22.777304 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3416/6885] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:22.781439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea5e73-40f4-45f2-802c-f6ce7131e923 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:22.783228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2eea5e73-40f4-45f2-802c-f6ce7131e923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:22.854848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c75ff5a2-0c2f-4990-b19f-351cd1a9df64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '612b26f2c8a54bb7a57018f876c5f17d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:22.874976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c75ff5a2-0c2f-4990-b19f-351cd1a9df64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '612b26f2c8a54bb7a57018f876c5f17d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:22.875906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c75ff5a2-0c2f-4990-b19f-351cd1a9df64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '612b26f2c8a54bb7a57018f876c5f17d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:22.884896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:22.891051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c75ff5a2-0c2f-4990-b19f-351cd1a9df64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '612b26f2c8a54bb7a57018f876c5f17d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:22.892362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c75ff5a2-0c2f-4990-b19f-351cd1a9df64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '612b26f2c8a54bb7a57018f876c5f17d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:22.937791 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3470/6886] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:22 2022] DELETE /identity/v3/users/612b26f2c8a54bb7a57018f876c5f17d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:22.942515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ff5a2-0c2f-4990-b19f-351cd1a9df64 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:22.947148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c75ff5a2-0c2f-4990-b19f-351cd1a9df64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:23.010820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea5e73-40f4-45f2-802c-f6ce7131e923 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:23.167660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ff5a2-0c2f-4990-b19f-351cd1a9df64 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:23.184682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b564bbb-aab3-43c8-a535-fe6b8f1def78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:23.189193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291fe9c-173d-4180-8c3e-dd53398fbb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:23.189875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291fe9c-173d-4180-8c3e-dd53398fbb14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:23.190164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291fe9c-173d-4180-8c3e-dd53398fbb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:23.190444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291fe9c-173d-4180-8c3e-dd53398fbb14 admin admin] PATH_INFO: `/v3/users/6a168d02b2d1416190706cbce9635549` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:23.191962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291fe9c-173d-4180-8c3e-dd53398fbb14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a168d02b2d1416190706cbce9635549)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:23.194041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291fe9c-173d-4180-8c3e-dd53398fbb14 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:23.200355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b564bbb-aab3-43c8-a535-fe6b8f1def78 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:23.200658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b564bbb-aab3-43c8-a535-fe6b8f1def78 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:23.201462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b564bbb-aab3-43c8-a535-fe6b8f1def78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:23.204782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6b564bbb-aab3-43c8-a535-fe6b8f1def78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:23.287827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b564bbb-aab3-43c8-a535-fe6b8f1def78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:23.295818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b564bbb-aab3-43c8-a535-fe6b8f1def78 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:23.297090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3291fe9c-173d-4180-8c3e-dd53398fbb14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a168d02b2d1416190706cbce9635549'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:23.324401 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3417/6887] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:23.325944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:23.328303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b564bbb-aab3-43c8-a535-fe6b8f1def78 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:23.330528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3291fe9c-173d-4180-8c3e-dd53398fbb14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a168d02b2d1416190706cbce9635549'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:23.332154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6b564bbb-aab3-43c8-a535-fe6b8f1def78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:23.333373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3291fe9c-173d-4180-8c3e-dd53398fbb14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a168d02b2d1416190706cbce9635549'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:23.365396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b564bbb-aab3-43c8-a535-fe6b8f1def78 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:23.372699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3291fe9c-173d-4180-8c3e-dd53398fbb14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a168d02b2d1416190706cbce9635549'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:23.376600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3291fe9c-173d-4180-8c3e-dd53398fbb14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a168d02b2d1416190706cbce9635549'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:23.405372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2c75f-59e0-4502-9c32-cc5471ba5111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:23.406580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c75f-59e0-4502-9c32-cc5471ba5111 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:23.408134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c75f-59e0-4502-9c32-cc5471ba5111 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:23.408673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c75f-59e0-4502-9c32-cc5471ba5111 admin admin] PATH_INFO: `/v3/projects/baa4ebbda8ef40a4b503c67d939d960c/users/b8f52cc0616a4da4a03a945cfbe3619c/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:23.416890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2c75f-59e0-4502-9c32-cc5471ba5111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa4ebbda8ef40a4b503c67d939d960c, user_id=b8f52cc0616a4da4a03a945cfbe3619c, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:23.424774 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3471/6888] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:22 2022] DELETE /identity/v3/users/6a168d02b2d1416190706cbce9635549 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:23.425172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2c75f-59e0-4502-9c32-cc5471ba5111 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:23.431269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95832a39-97d6-4f04-b3bf-17c7cd4a9a5a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:23.432010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95832a39-97d6-4f04-b3bf-17c7cd4a9a5a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:23.432514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95832a39-97d6-4f04-b3bf-17c7cd4a9a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:23.465516 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3418/6889] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:23 2022] PUT /identity/v3/projects/baa4ebbda8ef40a4b503c67d939d960c/users/b8f52cc0616a4da4a03a945cfbe3619c/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:23.477753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972672f-b3c2-4917-881c-27191e0c632b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:23.478047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972672f-b3c2-4917-881c-27191e0c632b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:23.478330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972672f-b3c2-4917-881c-27191e0c632b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:23.507911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-95832a39-97d6-4f04-b3bf-17c7cd4a9a5a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:23.513881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-95832a39-97d6-4f04-b3bf-17c7cd4a9a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:23.560639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2972672f-b3c2-4917-881c-27191e0c632b None None] MFA Rules not processed for user `b8f52cc0616a4da4a03a945cfbe3619c`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:23.562860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2972672f-b3c2-4917-881c-27191e0c632b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:23.677382 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3472/6890] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:28:23.682268 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3419/6891] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:23 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:23.697426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95832a39-97d6-4f04-b3bf-17c7cd4a9a5a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:23.698945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-95832a39-97d6-4f04-b3bf-17c7cd4a9a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:23.703118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972672f-b3c2-4917-881c-27191e0c632b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:23.704996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2972672f-b3c2-4917-881c-27191e0c632b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:23.767053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95832a39-97d6-4f04-b3bf-17c7cd4a9a5a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:23.769111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:23.772245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7e8de-e0fd-4205-9dcc-fdd837498c23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:23.773189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7e8de-e0fd-4205-9dcc-fdd837498c23 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:23.773670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7e8de-e0fd-4205-9dcc-fdd837498c23 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:23.774298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7e8de-e0fd-4205-9dcc-fdd837498c23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:23.788376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7e8de-e0fd-4205-9dcc-fdd837498c23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:23.789972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7e8de-e0fd-4205-9dcc-fdd837498c23 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:23.802990 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3473/6892] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:23 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:23.812691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972672f-b3c2-4917-881c-27191e0c632b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:23.820647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27ddbe-980c-4957-9c37-cf3921779808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:23.821496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27ddbe-980c-4957-9c37-cf3921779808 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:23.821850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27ddbe-980c-4957-9c37-cf3921779808 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:23.822375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27ddbe-980c-4957-9c37-cf3921779808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:23.839314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27ddbe-980c-4957-9c37-cf3921779808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:23.839314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27ddbe-980c-4957-9c37-cf3921779808 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:23.850255 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3420/6893] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:28:23.923878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7e8de-e0fd-4205-9dcc-fdd837498c23 service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:23.934803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7e8de-e0fd-4205-9dcc-fdd837498c23 service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:23.939631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3c4c-1e62-4fd5-9c0a-7bcaa7c889eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:23.940465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3c4c-1e62-4fd5-9c0a-7bcaa7c889eb service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:23.940909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3c4c-1e62-4fd5-9c0a-7bcaa7c889eb service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:23.941186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3c4c-1e62-4fd5-9c0a-7bcaa7c889eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:23.944742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f4ab3c4c-1e62-4fd5-9c0a-7bcaa7c889eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:24.052230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab3c4c-1e62-4fd5-9c0a-7bcaa7c889eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:24.053689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab3c4c-1e62-4fd5-9c0a-7bcaa7c889eb service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:24.068000 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3474/6894] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:24.377526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27ddbe-980c-4957-9c37-cf3921779808 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:24.379263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0c27ddbe-980c-4957-9c37-cf3921779808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:24.415850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27ddbe-980c-4957-9c37-cf3921779808 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:24.442324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546be6c-5e30-4079-bb87-ffe5d28d4747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:24.443010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546be6c-5e30-4079-bb87-ffe5d28d4747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:24.443310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546be6c-5e30-4079-bb87-ffe5d28d4747 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:24.447084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546be6c-5e30-4079-bb87-ffe5d28d4747 admin admin] PATH_INFO: `/v3/projects/0838b9fc3b33439f8ddab0774e43aeb4` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:24.450371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546be6c-5e30-4079-bb87-ffe5d28d4747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0838b9fc3b33439f8ddab0774e43aeb4)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:24.456106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546be6c-5e30-4079-bb87-ffe5d28d4747 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:24.692658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4546be6c-5e30-4079-bb87-ffe5d28d4747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0838b9fc3b33439f8ddab0774e43aeb4', 'request_id': 'req-4546be6c-5e30-4079-bb87-ffe5d28d4747'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:24.726304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4546be6c-5e30-4079-bb87-ffe5d28d4747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0838b9fc3b33439f8ddab0774e43aeb4', 'request_id': 'req-4546be6c-5e30-4079-bb87-ffe5d28d4747'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:24.734233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3c4c-1e62-4fd5-9c0a-7bcaa7c889eb service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:24.737794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f4ab3c4c-1e62-4fd5-9c0a-7bcaa7c889eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:24.766783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4546be6c-5e30-4079-bb87-ffe5d28d4747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0838b9fc3b33439f8ddab0774e43aeb4', 'request_id': 'req-4546be6c-5e30-4079-bb87-ffe5d28d4747'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:24.776681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3c4c-1e62-4fd5-9c0a-7bcaa7c889eb service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:24.782870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4546be6c-5e30-4079-bb87-ffe5d28d4747 admin admin] The token cache is being invalidate because project 0838b9fc3b33439f8ddab0774e43aeb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:24.783168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4546be6c-5e30-4079-bb87-ffe5d28d4747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:24.785517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4546be6c-5e30-4079-bb87-ffe5d28d4747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:24.791621 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3421/6895] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:24 2022] DELETE /identity/v3/projects/0838b9fc3b33439f8ddab0774e43aeb4 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:24.793434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714e79-4fad-43ad-bd9b-e31d272d3475 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:24.793748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714e79-4fad-43ad-bd9b-e31d272d3475 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:24.793986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714e79-4fad-43ad-bd9b-e31d272d3475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:24.822200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:24.823484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0c714e79-4fad-43ad-bd9b-e31d272d3475 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:24.825138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0c714e79-4fad-43ad-bd9b-e31d272d3475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:24.918040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5849b-9c9e-4c57-9a86-a191579e11d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:24.918866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5849b-9c9e-4c57-9a86-a191579e11d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:24.919180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5849b-9c9e-4c57-9a86-a191579e11d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:24.919460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5849b-9c9e-4c57-9a86-a191579e11d9 admin admin] PATH_INFO: `/v3/projects/11a4446efa9346d48f4021f8479015a3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:24.921756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5849b-9c9e-4c57-9a86-a191579e11d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11a4446efa9346d48f4021f8479015a3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:24.921875 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3422/6896] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:24.923881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5849b-9c9e-4c57-9a86-a191579e11d9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:24.932640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebc15e-7ab4-406d-b124-819fe2eaebfa None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:24.932971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebc15e-7ab4-406d-b124-819fe2eaebfa None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:24.933252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebc15e-7ab4-406d-b124-819fe2eaebfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:24.988089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-faebc15e-7ab4-406d-b124-819fe2eaebfa None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:24.989443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-faebc15e-7ab4-406d-b124-819fe2eaebfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:25.032398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b2b5849b-9c9e-4c57-9a86-a191579e11d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a4446efa9346d48f4021f8479015a3', 'request_id': 'req-b2b5849b-9c9e-4c57-9a86-a191579e11d9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:25.040430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b2b5849b-9c9e-4c57-9a86-a191579e11d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a4446efa9346d48f4021f8479015a3', 'request_id': 'req-b2b5849b-9c9e-4c57-9a86-a191579e11d9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:25.053868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b2b5849b-9c9e-4c57-9a86-a191579e11d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a4446efa9346d48f4021f8479015a3', 'request_id': 'req-b2b5849b-9c9e-4c57-9a86-a191579e11d9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:25.072188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b2b5849b-9c9e-4c57-9a86-a191579e11d9 admin admin] The token cache is being invalidate because project 11a4446efa9346d48f4021f8479015a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:25.072770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b2b5849b-9c9e-4c57-9a86-a191579e11d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:25.073819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b2b5849b-9c9e-4c57-9a86-a191579e11d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:25.075633 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3475/6897] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:24 2022] DELETE /identity/v3/projects/11a4446efa9346d48f4021f8479015a3 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:25.077234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5849b-9c9e-4c57-9a86-a191579e11d9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:25.079039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b2b5849b-9c9e-4c57-9a86-a191579e11d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:25.126485 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3423/6898] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:25.126485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb180e-68f3-4fa9-a17d-107fe95a5d0e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:25.126485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb180e-68f3-4fa9-a17d-107fe95a5d0e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:25.126485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb180e-68f3-4fa9-a17d-107fe95a5d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:25.135693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:25.157215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8dbb180e-68f3-4fa9-a17d-107fe95a5d0e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:25.158442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8dbb180e-68f3-4fa9-a17d-107fe95a5d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:25.170132 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3424/6899] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:25.174176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb180e-68f3-4fa9-a17d-107fe95a5d0e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:25.177820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5849b-9c9e-4c57-9a86-a191579e11d9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:25.190841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8efd2d-4fc0-4e17-bb9b-537298fe86ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:25.191470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8efd2d-4fc0-4e17-bb9b-537298fe86ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:25.191779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8efd2d-4fc0-4e17-bb9b-537298fe86ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:25.192133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8efd2d-4fc0-4e17-bb9b-537298fe86ec admin admin] PATH_INFO: `/v3/users/1afc5ea6aa2544699a3030807e3d4219` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:25.193351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8efd2d-4fc0-4e17-bb9b-537298fe86ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=1afc5ea6aa2544699a3030807e3d4219)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:25.194091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb180e-68f3-4fa9-a17d-107fe95a5d0e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:25.195581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8efd2d-4fc0-4e17-bb9b-537298fe86ec admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:25.204175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964b37f-b8db-4850-be60-ca324db60851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:25.204829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964b37f-b8db-4850-be60-ca324db60851 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:25.205117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964b37f-b8db-4850-be60-ca324db60851 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:25.205394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964b37f-b8db-4850-be60-ca324db60851 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:25.206514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964b37f-b8db-4850-be60-ca324db60851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:25.206795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964b37f-b8db-4850-be60-ca324db60851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:25.208688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964b37f-b8db-4850-be60-ca324db60851 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:25.223389 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3425/6900] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:25.224468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49734b-f353-4e3e-9e56-9db80eb1a39f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:25.224755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49734b-f353-4e3e-9e56-9db80eb1a39f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:25.225030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49734b-f353-4e3e-9e56-9db80eb1a39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:25.248208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4a49734b-f353-4e3e-9e56-9db80eb1a39f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:25.249631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4a49734b-f353-4e3e-9e56-9db80eb1a39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:25.281930 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3426/6901] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:25.281930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49734b-f353-4e3e-9e56-9db80eb1a39f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:25.294290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49734b-f353-4e3e-9e56-9db80eb1a39f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:25.300065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407d4a3-32bd-4b4d-8ebb-b94dad3bc049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:25.301494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407d4a3-32bd-4b4d-8ebb-b94dad3bc049 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:25.301494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407d4a3-32bd-4b4d-8ebb-b94dad3bc049 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:25.301494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407d4a3-32bd-4b4d-8ebb-b94dad3bc049 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:25.301995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407d4a3-32bd-4b4d-8ebb-b94dad3bc049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:25.304120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407d4a3-32bd-4b4d-8ebb-b94dad3bc049 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:25.306805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3e8efd2d-4fc0-4e17-bb9b-537298fe86ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1afc5ea6aa2544699a3030807e3d4219'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:25.316764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:25.327732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3e8efd2d-4fc0-4e17-bb9b-537298fe86ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1afc5ea6aa2544699a3030807e3d4219'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:25.328943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3e8efd2d-4fc0-4e17-bb9b-537298fe86ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1afc5ea6aa2544699a3030807e3d4219'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:25.336686 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3427/6902] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:25 2022] POST /identity/v3/projects => generated 361 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:25.337419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407d4a3-32bd-4b4d-8ebb-b94dad3bc049 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:25.340540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3e8efd2d-4fc0-4e17-bb9b-537298fe86ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1afc5ea6aa2544699a3030807e3d4219'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:25.341271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3e8efd2d-4fc0-4e17-bb9b-537298fe86ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1afc5ea6aa2544699a3030807e3d4219'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:25.364717 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3476/6903] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:25 2022] DELETE /identity/v3/users/1afc5ea6aa2544699a3030807e3d4219 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:25.368128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8efd2d-4fc0-4e17-bb9b-537298fe86ec admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:25.369768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3e8efd2d-4fc0-4e17-bb9b-537298fe86ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:25.419875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407d4a3-32bd-4b4d-8ebb-b94dad3bc049 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:25.468900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8efd2d-4fc0-4e17-bb9b-537298fe86ec admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:25.473922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0c874-bb99-4eec-bd6e-24af89e5dbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:25.474552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0c874-bb99-4eec-bd6e-24af89e5dbf7 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:25.474844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0c874-bb99-4eec-bd6e-24af89e5dbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:25.475123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0c874-bb99-4eec-bd6e-24af89e5dbf7 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:25.475827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0c874-bb99-4eec-bd6e-24af89e5dbf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:25.478047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0c874-bb99-4eec-bd6e-24af89e5dbf7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:25.495102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880301db-594d-43a9-bd22-466867641949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:25.497253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880301db-594d-43a9-bd22-466867641949 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:25.497253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880301db-594d-43a9-bd22-466867641949 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:25.497253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880301db-594d-43a9-bd22-466867641949 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:25.499627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880301db-594d-43a9-bd22-466867641949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:25.500573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880301db-594d-43a9-bd22-466867641949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:25.504031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880301db-594d-43a9-bd22-466867641949 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:25.506674 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3477/6904] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:25 2022] POST /identity/v3/users => generated 281 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:25.508958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf789c9-4c57-4017-8c44-96926c80deba None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:25.509387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf789c9-4c57-4017-8c44-96926c80deba None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:25.509676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf789c9-4c57-4017-8c44-96926c80deba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:25.524185 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3428/6905] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:25.525570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880301db-594d-43a9-bd22-466867641949 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:25.538876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880301db-594d-43a9-bd22-466867641949 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:25.544180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781b7c4-eb0a-4090-8fb3-001fe4f661d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:25.544722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-faf789c9-4c57-4017-8c44-96926c80deba None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:25.544872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781b7c4-eb0a-4090-8fb3-001fe4f661d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:25.545128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781b7c4-eb0a-4090-8fb3-001fe4f661d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:25.545506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781b7c4-eb0a-4090-8fb3-001fe4f661d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:25.546226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781b7c4-eb0a-4090-8fb3-001fe4f661d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:25.547918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781b7c4-eb0a-4090-8fb3-001fe4f661d4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:25.548311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-faf789c9-4c57-4017-8c44-96926c80deba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:25.559822 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3478/6906] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:25.561336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf789c9-4c57-4017-8c44-96926c80deba None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:25.562688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-faf789c9-4c57-4017-8c44-96926c80deba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:25.564044 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3429/6907] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:25.567691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781b7c4-eb0a-4090-8fb3-001fe4f661d4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:25.583646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf789c9-4c57-4017-8c44-96926c80deba None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:25.583858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781b7c4-eb0a-4090-8fb3-001fe4f661d4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:25.589569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5537da-0b26-42f4-8bdd-5eb08a31975f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:25.590326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5537da-0b26-42f4-8bdd-5eb08a31975f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:25.590709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5537da-0b26-42f4-8bdd-5eb08a31975f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:25.591323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5537da-0b26-42f4-8bdd-5eb08a31975f admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:25.592257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5537da-0b26-42f4-8bdd-5eb08a31975f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:25.595514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afab015-e9a8-4d0f-a2a9-7fce3ca92444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:25.595885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5537da-0b26-42f4-8bdd-5eb08a31975f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:25.596228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afab015-e9a8-4d0f-a2a9-7fce3ca92444 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:25.596520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afab015-e9a8-4d0f-a2a9-7fce3ca92444 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:25.597014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afab015-e9a8-4d0f-a2a9-7fce3ca92444 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:25.597724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afab015-e9a8-4d0f-a2a9-7fce3ca92444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:25.599638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afab015-e9a8-4d0f-a2a9-7fce3ca92444 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:25.615198 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3430/6908] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:28:25.618815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afab015-e9a8-4d0f-a2a9-7fce3ca92444 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:25.620589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0afab015-e9a8-4d0f-a2a9-7fce3ca92444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:25.651445 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3479/6909] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:25 2022] POST /identity/v3/projects => generated 381 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:25.651445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5537da-0b26-42f4-8bdd-5eb08a31975f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:25.661826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:25.689149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afab015-e9a8-4d0f-a2a9-7fce3ca92444 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:25.727633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5537da-0b26-42f4-8bdd-5eb08a31975f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:25.732448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265a774-c0e7-4593-84f2-cb939ea19f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:25.733317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265a774-c0e7-4593-84f2-cb939ea19f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:25.733697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265a774-c0e7-4593-84f2-cb939ea19f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:25.734091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265a774-c0e7-4593-84f2-cb939ea19f21 admin admin] PATH_INFO: `/v3/projects/0e6eda57019447fd8f63b59b3fb02713/users/dfe0360f7f9b4f9881cf476f8e374ff7/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:25.745532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b05abf-7fac-4782-a225-d1eaf05f73ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:25.746292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b05abf-7fac-4782-a225-d1eaf05f73ca service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:25.746760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b05abf-7fac-4782-a225-d1eaf05f73ca service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:25.747115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b05abf-7fac-4782-a225-d1eaf05f73ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:25.752404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265a774-c0e7-4593-84f2-cb939ea19f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6eda57019447fd8f63b59b3fb02713, user_id=dfe0360f7f9b4f9881cf476f8e374ff7, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:25.755332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265a774-c0e7-4593-84f2-cb939ea19f21 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:25.759012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b05abf-7fac-4782-a225-d1eaf05f73ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:25.760571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b05abf-7fac-4782-a225-d1eaf05f73ca service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:25.774473 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3431/6910] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:25.775733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b05abf-7fac-4782-a225-d1eaf05f73ca service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:25.779328 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3480/6911] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:25 2022] PUT /identity/v3/projects/0e6eda57019447fd8f63b59b3fb02713/users/dfe0360f7f9b4f9881cf476f8e374ff7/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:25.787067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b05abf-7fac-4782-a225-d1eaf05f73ca service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:25.791005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81155ab-b13f-4b4e-a7f1-cfd2af3a7339 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:25.793632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81155ab-b13f-4b4e-a7f1-cfd2af3a7339 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:25.796257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81155ab-b13f-4b4e-a7f1-cfd2af3a7339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:25.880266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d81155ab-b13f-4b4e-a7f1-cfd2af3a7339 None None] MFA Rules not processed for user `dfe0360f7f9b4f9881cf476f8e374ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:25.881997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d81155ab-b13f-4b4e-a7f1-cfd2af3a7339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:25.894012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:25.955663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74367223-e80f-43b7-95f2-3be176900fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:25.956218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74367223-e80f-43b7-95f2-3be176900fbf admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:25.956501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74367223-e80f-43b7-95f2-3be176900fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:25.956775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74367223-e80f-43b7-95f2-3be176900fbf admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:25.957448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74367223-e80f-43b7-95f2-3be176900fbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:25.968013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74367223-e80f-43b7-95f2-3be176900fbf admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:26.019814 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3432/6912] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:25 2022] POST /identity/v3/users => generated 291 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:26.026897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74367223-e80f-43b7-95f2-3be176900fbf admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:26.048550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74367223-e80f-43b7-95f2-3be176900fbf admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:26.063481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249b656-31d5-4595-be68-14812451fc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:26.064572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249b656-31d5-4595-be68-14812451fc71 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:26.065091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249b656-31d5-4595-be68-14812451fc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:26.065616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249b656-31d5-4595-be68-14812451fc71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:26.067027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249b656-31d5-4595-be68-14812451fc71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:26.069199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249b656-31d5-4595-be68-14812451fc71 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:26.089283 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3481/6913] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:26.090705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e31cf-13ee-4af6-a7c0-9e1992e5ed23 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:26.092519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e31cf-13ee-4af6-a7c0-9e1992e5ed23 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:26.092803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e31cf-13ee-4af6-a7c0-9e1992e5ed23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:26.099027 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3433/6914] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:28:26.128557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249b656-31d5-4595-be68-14812451fc71 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:26.137887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-202e31cf-13ee-4af6-a7c0-9e1992e5ed23 None None] MFA Rules not processed for user `dfe0360f7f9b4f9881cf476f8e374ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:26.139623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-202e31cf-13ee-4af6-a7c0-9e1992e5ed23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:26.143419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d249b656-31d5-4595-be68-14812451fc71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:26.147744 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3482/6915] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:26 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 21:28:26.149118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e31cf-13ee-4af6-a7c0-9e1992e5ed23 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:26.169459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249b656-31d5-4595-be68-14812451fc71 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:26.177782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08b1e2-53c4-42e3-9e4b-376ec6f65b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:26.178592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08b1e2-53c4-42e3-9e4b-376ec6f65b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:26.178944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08b1e2-53c4-42e3-9e4b-376ec6f65b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:26.179320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08b1e2-53c4-42e3-9e4b-376ec6f65b7c admin admin] PATH_INFO: `/v3/projects/ddb9576c03ff4f3f9944b98fd169fe22` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:26.181409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08b1e2-53c4-42e3-9e4b-376ec6f65b7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb9576c03ff4f3f9944b98fd169fe22)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:26.183459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08b1e2-53c4-42e3-9e4b-376ec6f65b7c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:26.190169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e31cf-13ee-4af6-a7c0-9e1992e5ed23 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:26.201614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e4dff-eac9-4ac7-8189-fda1aac25d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:26.204334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e4dff-eac9-4ac7-8189-fda1aac25d70 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:26.204701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e4dff-eac9-4ac7-8189-fda1aac25d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:26.205997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e4dff-eac9-4ac7-8189-fda1aac25d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:26.206847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e4dff-eac9-4ac7-8189-fda1aac25d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:26.211023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e4dff-eac9-4ac7-8189-fda1aac25d70 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:26.244684 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3483/6916] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:26.246680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb594f4e-51f2-44b9-be61-72b9751e6418 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:26.246972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb594f4e-51f2-44b9-be61-72b9751e6418 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:26.247378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb594f4e-51f2-44b9-be61-72b9751e6418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:26.254372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dd08b1e2-53c4-42e3-9e4b-376ec6f65b7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb9576c03ff4f3f9944b98fd169fe22', 'request_id': 'req-dd08b1e2-53c4-42e3-9e4b-376ec6f65b7c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:26.264845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dd08b1e2-53c4-42e3-9e4b-376ec6f65b7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb9576c03ff4f3f9944b98fd169fe22', 'request_id': 'req-dd08b1e2-53c4-42e3-9e4b-376ec6f65b7c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:26.274743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dd08b1e2-53c4-42e3-9e4b-376ec6f65b7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb9576c03ff4f3f9944b98fd169fe22', 'request_id': 'req-dd08b1e2-53c4-42e3-9e4b-376ec6f65b7c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:26.276302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:26.284107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-eb594f4e-51f2-44b9-be61-72b9751e6418 None None] MFA Rules not processed for user `dfe0360f7f9b4f9881cf476f8e374ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:26.286649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-eb594f4e-51f2-44b9-be61-72b9751e6418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:26.292862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dd08b1e2-53c4-42e3-9e4b-376ec6f65b7c admin admin] The token cache is being invalidate because project ddb9576c03ff4f3f9944b98fd169fe22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:26.293202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dd08b1e2-53c4-42e3-9e4b-376ec6f65b7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:26.294024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dd08b1e2-53c4-42e3-9e4b-376ec6f65b7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:26.294530 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3484/6917] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:26 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 21:28:26.296487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb594f4e-51f2-44b9-be61-72b9751e6418 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:26.297035 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3434/6918] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:26 2022] DELETE /identity/v3/projects/ddb9576c03ff4f3f9944b98fd169fe22 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:26.303876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f65dd-d755-474d-bec6-6cf928de640a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:26.304184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f65dd-d755-474d-bec6-6cf928de640a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:26.306426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f65dd-d755-474d-bec6-6cf928de640a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:26.349188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b19f65dd-d755-474d-bec6-6cf928de640a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:26.350494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b19f65dd-d755-474d-bec6-6cf928de640a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:26.420090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb594f4e-51f2-44b9-be61-72b9751e6418 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:26.426298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeefe17-edf0-4c7f-be6a-143833b60980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:26.427139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeefe17-edf0-4c7f-be6a-143833b60980 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:26.427478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeefe17-edf0-4c7f-be6a-143833b60980 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:26.428008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeefe17-edf0-4c7f-be6a-143833b60980 admin admin] PATH_INFO: `/v3/projects/273cbb61fd794e99b77f7e2e3f70d5cf/users/6cd68fffccf34bffaee3aeb8dacab939/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:26.439555 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3435/6919] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:26.440601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f65dd-d755-474d-bec6-6cf928de640a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:26.442067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b19f65dd-d755-474d-bec6-6cf928de640a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:26.460643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeefe17-edf0-4c7f-be6a-143833b60980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=273cbb61fd794e99b77f7e2e3f70d5cf, user_id=6cd68fffccf34bffaee3aeb8dacab939, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:26.465742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeefe17-edf0-4c7f-be6a-143833b60980 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:26.483979 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3485/6920] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:26 2022] PUT /identity/v3/projects/273cbb61fd794e99b77f7e2e3f70d5cf/users/6cd68fffccf34bffaee3aeb8dacab939/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:26.485377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1829429-6409-4f0e-b4fb-c188f2cb5f7b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:26.486886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1829429-6409-4f0e-b4fb-c188f2cb5f7b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:26.487469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1829429-6409-4f0e-b4fb-c188f2cb5f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:26.514558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a1829429-6409-4f0e-b4fb-c188f2cb5f7b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:26.516046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a1829429-6409-4f0e-b4fb-c188f2cb5f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:26.524557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f65dd-d755-474d-bec6-6cf928de640a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:26.596202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2175ec9-0829-4ea4-921e-e7e7b6baeae3 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe0360f7f9b4f9881cf476f8e374ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e6eda57019447fd8f63b59b3fb02713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:26.596779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2175ec9-0829-4ea4-921e-e7e7b6baeae3 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] REQUEST_METHOD: `HEAD` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:26.597065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2175ec9-0829-4ea4-921e-e7e7b6baeae3 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:26.597348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2175ec9-0829-4ea4-921e-e7e7b6baeae3 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:26.602877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e2175ec9-0829-4ea4-921e-e7e7b6baeae3 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:26.603031 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3486/6921] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:26.603031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000a8b4-584f-4d3b-94d0-0b7ba03d7611 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:26.603031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000a8b4-584f-4d3b-94d0-0b7ba03d7611 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:26.603031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000a8b4-584f-4d3b-94d0-0b7ba03d7611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:26.611556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:26.613159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2175ec9-0829-4ea4-921e-e7e7b6baeae3 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] RBAC: Authorizing `identity:check_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:26.615689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2175ec9-0829-4ea4-921e-e7e7b6baeae3 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:26.625978 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3436/6922] 10.222.0.17 () {56 vars in 1264 bytes} [Sat Jul 30 21:28:26 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Jul 30 21:28:26.625978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2175ec9-0829-4ea4-921e-e7e7b6baeae3 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:26.638592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2175ec9-0829-4ea4-921e-e7e7b6baeae3 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:26.639608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d000a8b4-584f-4d3b-94d0-0b7ba03d7611 None None] MFA Rules not processed for user `6cd68fffccf34bffaee3aeb8dacab939`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:26.640977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d000a8b4-584f-4d3b-94d0-0b7ba03d7611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:26.644227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6f7ef-e008-4301-a524-26784a01fcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:26.645059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6f7ef-e008-4301-a524-26784a01fcda admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:26.645499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6f7ef-e008-4301-a524-26784a01fcda admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:26.646054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6f7ef-e008-4301-a524-26784a01fcda admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:26.647463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6f7ef-e008-4301-a524-26784a01fcda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:26.647951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6f7ef-e008-4301-a524-26784a01fcda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:26.649752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6f7ef-e008-4301-a524-26784a01fcda admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:26.665489 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3437/6923] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:26.666621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6f7ef-e008-4301-a524-26784a01fcda admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:26.679276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6f7ef-e008-4301-a524-26784a01fcda admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:26.683635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35929fa3-58f6-4ea1-a541-2bae50c33805 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe0360f7f9b4f9881cf476f8e374ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e6eda57019447fd8f63b59b3fb02713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:26.684345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35929fa3-58f6-4ea1-a541-2bae50c33805 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:26.684704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35929fa3-58f6-4ea1-a541-2bae50c33805 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:26.685120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35929fa3-58f6-4ea1-a541-2bae50c33805 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:26.692852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35929fa3-58f6-4ea1-a541-2bae50c33805 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:26.694934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35929fa3-58f6-4ea1-a541-2bae50c33805 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:26.706847 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3438/6924] 10.222.0.17 () {56 vars in 1263 bytes} [Sat Jul 30 21:28:26 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:26.708366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35929fa3-58f6-4ea1-a541-2bae50c33805 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:26.724284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35929fa3-58f6-4ea1-a541-2bae50c33805 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:26.735598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fd463-77ce-4486-8435-35505d23ffcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:26.736520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fd463-77ce-4486-8435-35505d23ffcb admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:26.736960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fd463-77ce-4486-8435-35505d23ffcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:26.737389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fd463-77ce-4486-8435-35505d23ffcb admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:26.740154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506fd463-77ce-4486-8435-35505d23ffcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:26.742068 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3487/6925] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:26.743116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000a8b4-584f-4d3b-94d0-0b7ba03d7611 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:26.746044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506fd463-77ce-4486-8435-35505d23ffcb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:26.759702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000a8b4-584f-4d3b-94d0-0b7ba03d7611 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:26.766398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e192e-4949-4e51-a64b-b99b70040428 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe0360f7f9b4f9881cf476f8e374ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e6eda57019447fd8f63b59b3fb02713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:26.767263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e192e-4949-4e51-a64b-b99b70040428 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:26.767973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:26.768469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e192e-4949-4e51-a64b-b99b70040428 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:26.768984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e192e-4949-4e51-a64b-b99b70040428 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:26.778409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e192e-4949-4e51-a64b-b99b70040428 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:26.780881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e192e-4949-4e51-a64b-b99b70040428 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:26.791750 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3439/6926] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:26 2022] POST /identity/v3/projects => generated 355 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:26.792853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fd463-77ce-4486-8435-35505d23ffcb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:26.795057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-506fd463-77ce-4486-8435-35505d23ffcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:26.809598 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3488/6927] 10.222.0.17 () {56 vars in 1266 bytes} [Sat Jul 30 21:28:26 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:26.810844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e192e-4949-4e51-a64b-b99b70040428 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:26.822523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e192e-4949-4e51-a64b-b99b70040428 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:26.890065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cb0b2-1933-4b1b-ba51-9b89b4ae057f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:26.890703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cb0b2-1933-4b1b-ba51-9b89b4ae057f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:26.890989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cb0b2-1933-4b1b-ba51-9b89b4ae057f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:26.891267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cb0b2-1933-4b1b-ba51-9b89b4ae057f admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:26.892112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cb0b2-1933-4b1b-ba51-9b89b4ae057f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:26.892481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fd463-77ce-4486-8435-35505d23ffcb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:26.894424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cb0b2-1933-4b1b-ba51-9b89b4ae057f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:26.897352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0473112-67d5-486e-ab32-e9ec05019aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:26.897988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0473112-67d5-486e-ab32-e9ec05019aaa admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:26.898273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0473112-67d5-486e-ab32-e9ec05019aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:26.898550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0473112-67d5-486e-ab32-e9ec05019aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:26.899215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0473112-67d5-486e-ab32-e9ec05019aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:26.901169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0473112-67d5-486e-ab32-e9ec05019aaa admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:26.924273 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3489/6928] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:26 2022] POST /identity/v3/users => generated 278 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:26.924273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cb0b2-1933-4b1b-ba51-9b89b4ae057f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:26.940341 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3440/6929] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:26 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:26.940341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0473112-67d5-486e-ab32-e9ec05019aaa admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:26.996319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cb0b2-1933-4b1b-ba51-9b89b4ae057f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:27.013098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:27.032831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0473112-67d5-486e-ab32-e9ec05019aaa admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:27.038786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf74754-4503-462c-a361-89c75247380b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:27.039829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf74754-4503-462c-a361-89c75247380b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:27.040123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf74754-4503-462c-a361-89c75247380b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:27.040413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf74754-4503-462c-a361-89c75247380b admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:27.041148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf74754-4503-462c-a361-89c75247380b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:27.043921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf74754-4503-462c-a361-89c75247380b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:27.057560 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3441/6930] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:27.058528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf74754-4503-462c-a361-89c75247380b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:27.070097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf74754-4503-462c-a361-89c75247380b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:27.074048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bda8c-1089-4c87-90de-4b5958f59da9 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe0360f7f9b4f9881cf476f8e374ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e6eda57019447fd8f63b59b3fb02713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:27.074681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bda8c-1089-4c87-90de-4b5958f59da9 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] REQUEST_METHOD: `HEAD` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:27.074969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bda8c-1089-4c87-90de-4b5958f59da9 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:27.075246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bda8c-1089-4c87-90de-4b5958f59da9 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:27.077534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14617c51-c368-41dd-9939-9c0f7fecbd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:27.077891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3c3bda8c-1089-4c87-90de-4b5958f59da9 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:27.078521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14617c51-c368-41dd-9939-9c0f7fecbd02 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:27.079068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14617c51-c368-41dd-9939-9c0f7fecbd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:27.079561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14617c51-c368-41dd-9939-9c0f7fecbd02 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:27.080261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14617c51-c368-41dd-9939-9c0f7fecbd02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:27.082377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14617c51-c368-41dd-9939-9c0f7fecbd02 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:27.089906 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-3c3bda8c-1089-4c87-90de-4b5958f59da9 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 30 21:28:27.089906 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:28:27.089906 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:28:27.089906 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:28:27.089906 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:28:27.089906 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:28:27.089906 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:28:27.089906 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:28:27.089906 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:28:27.089906 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:28:27.089906 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:28:27.089906 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:28:27.089906 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Jul 30 21:28:27.089906 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Jul 30 21:28:27.089906 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 30 21:28:27.090866 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 30 21:28:27.090866 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 30 21:28:27.090866 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 30 21:28:27.090866 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:28:27.090866 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:28:27.090866 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 30 21:28:27.090866 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 30 21:28:27.090866 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 30 21:28:27.090866 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 30 21:28:27.090866 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:28:27.090866 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:28:27.090866 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 30 21:28:27.090866 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 30 21:28:27.090866 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:28:27.090866 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:28:27.090866 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 30 21:28:27.090866 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 30 21:28:27.091933 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:28:27.091933 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:28:27.091933 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 30 21:28:27.091933 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 30 21:28:27.091933 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 30 21:28:27.091933 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:28:27.091933 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3490/6931] 10.222.0.17 () {56 vars in 1264 bytes} [Sat Jul 30 21:28:26 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Jul 30 21:28:27.092383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bda8c-1089-4c87-90de-4b5958f59da9 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:27.107146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bda8c-1089-4c87-90de-4b5958f59da9 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:27.112374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b1e8d-03f8-431d-b110-e439fa2f0807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:27.113317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b1e8d-03f8-431d-b110-e439fa2f0807 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:27.114167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b1e8d-03f8-431d-b110-e439fa2f0807 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:27.114167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b1e8d-03f8-431d-b110-e439fa2f0807 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:27.114714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b1e8d-03f8-431d-b110-e439fa2f0807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:27.116365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b1e8d-03f8-431d-b110-e439fa2f0807 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:27.125872 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3442/6932] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:27 2022] POST /identity/v3/users => generated 297 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:27.127899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc53e7-7142-4d66-8d22-c5dbd5aa19c4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:27.128199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc53e7-7142-4d66-8d22-c5dbd5aa19c4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:27.129212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc53e7-7142-4d66-8d22-c5dbd5aa19c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:27.148619 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3491/6933] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:27.149794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b1e8d-03f8-431d-b110-e439fa2f0807 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:27.163150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b1e8d-03f8-431d-b110-e439fa2f0807 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:27.171230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c901b5-39e5-40d3-b3b6-771a3e438dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:27.171965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c901b5-39e5-40d3-b3b6-771a3e438dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:27.172320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c901b5-39e5-40d3-b3b6-771a3e438dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:27.172665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c901b5-39e5-40d3-b3b6-771a3e438dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:27.173434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c901b5-39e5-40d3-b3b6-771a3e438dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:27.175115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c901b5-39e5-40d3-b3b6-771a3e438dc6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:27.200022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fccc53e7-7142-4d66-8d22-c5dbd5aa19c4 None None] MFA Rules not processed for user `dfe0360f7f9b4f9881cf476f8e374ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:27.202146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fccc53e7-7142-4d66-8d22-c5dbd5aa19c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:27.210963 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3492/6934] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:27.215335 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3443/6935] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:27 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 30 21:28:27.217727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c901b5-39e5-40d3-b3b6-771a3e438dc6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:27.219161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc53e7-7142-4d66-8d22-c5dbd5aa19c4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:27.232595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c901b5-39e5-40d3-b3b6-771a3e438dc6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:27.246111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa3d37-f1bd-460e-9b4b-75856533c51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:27.247421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa3d37-f1bd-460e-9b4b-75856533c51b admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:27.247842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc53e7-7142-4d66-8d22-c5dbd5aa19c4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:27.248032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa3d37-f1bd-460e-9b4b-75856533c51b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:27.249255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa3d37-f1bd-460e-9b4b-75856533c51b admin admin] PATH_INFO: `/v3/projects/c2dc8f7f209747caa4acb5ca89b4ed99/users/04891d42f10d43e9b95e14ad8b5c67c7/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:27.254672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f5f9a-6e6a-445e-8db1-ccfc58037c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:27.255608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f5f9a-6e6a-445e-8db1-ccfc58037c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:27.255966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f5f9a-6e6a-445e-8db1-ccfc58037c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:27.256322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f5f9a-6e6a-445e-8db1-ccfc58037c66 admin admin] PATH_INFO: `/v3/projects/0a8920ef507045c4b1c190a79996ddda/users/7a1787b445a44c3f8e9e1ed3f5e2e0d5/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:27.282902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa3d37-f1bd-460e-9b4b-75856533c51b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2dc8f7f209747caa4acb5ca89b4ed99, user_id=04891d42f10d43e9b95e14ad8b5c67c7, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:27.286010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa3d37-f1bd-460e-9b4b-75856533c51b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:27.288347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f5f9a-6e6a-445e-8db1-ccfc58037c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8920ef507045c4b1c190a79996ddda, user_id=7a1787b445a44c3f8e9e1ed3f5e2e0d5, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:27.290882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f5f9a-6e6a-445e-8db1-ccfc58037c66 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:27.306143 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3493/6936] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:27 2022] PUT /identity/v3/projects/c2dc8f7f209747caa4acb5ca89b4ed99/users/04891d42f10d43e9b95e14ad8b5c67c7/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:27.307359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa3d37-f1bd-460e-9b4b-75856533c51b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:27.308661 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3444/6937] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:27 2022] PUT /identity/v3/projects/0a8920ef507045c4b1c190a79996ddda/users/7a1787b445a44c3f8e9e1ed3f5e2e0d5/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:27.320481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75813fc3-723d-469d-a9ff-5a315a794ac5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:27.321328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75813fc3-723d-469d-a9ff-5a315a794ac5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:27.321800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75813fc3-723d-469d-a9ff-5a315a794ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:27.359222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-75813fc3-723d-469d-a9ff-5a315a794ac5 None None] MFA Rules not processed for user `04891d42f10d43e9b95e14ad8b5c67c7`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:27.360991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-75813fc3-723d-469d-a9ff-5a315a794ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:27.385774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:27.403674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa3d37-f1bd-460e-9b4b-75856533c51b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:27.455788 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3445/6938] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:27 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:27.456997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75813fc3-723d-469d-a9ff-5a315a794ac5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:27.489549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa937906-8318-4c55-9267-40120a3bb0c7 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe0360f7f9b4f9881cf476f8e374ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e6eda57019447fd8f63b59b3fb02713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:27.490230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa937906-8318-4c55-9267-40120a3bb0c7 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:27.490479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa937906-8318-4c55-9267-40120a3bb0c7 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:27.490760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa937906-8318-4c55-9267-40120a3bb0c7 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:27.501294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa937906-8318-4c55-9267-40120a3bb0c7 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:27.503966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa937906-8318-4c55-9267-40120a3bb0c7 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:27.512906 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3494/6939] 10.222.0.17 () {56 vars in 1263 bytes} [Sat Jul 30 21:28:27 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:27.513832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa937906-8318-4c55-9267-40120a3bb0c7 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:27.552369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:27.558467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75813fc3-723d-469d-a9ff-5a315a794ac5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:27.576437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73221c11-c0c5-4001-b043-0e9b46bd5f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:27.577662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73221c11-c0c5-4001-b043-0e9b46bd5f38 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:27.577951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73221c11-c0c5-4001-b043-0e9b46bd5f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:27.578241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73221c11-c0c5-4001-b043-0e9b46bd5f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:27.579086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73221c11-c0c5-4001-b043-0e9b46bd5f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:27.580839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73221c11-c0c5-4001-b043-0e9b46bd5f38 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:27.592368 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3446/6940] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:27.593440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73221c11-c0c5-4001-b043-0e9b46bd5f38 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:27.603961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73221c11-c0c5-4001-b043-0e9b46bd5f38 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:27.612420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d5a71-48a5-43ea-9e20-20adc9a3f078 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe0360f7f9b4f9881cf476f8e374ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e6eda57019447fd8f63b59b3fb02713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:27.613045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d5a71-48a5-43ea-9e20-20adc9a3f078 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:27.613322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d5a71-48a5-43ea-9e20-20adc9a3f078 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:27.613923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d5a71-48a5-43ea-9e20-20adc9a3f078 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:27.627490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d5a71-48a5-43ea-9e20-20adc9a3f078 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:27.629636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d5a71-48a5-43ea-9e20-20adc9a3f078 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:27.631392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa937906-8318-4c55-9267-40120a3bb0c7 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:27.637855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0660ca-1eff-4253-a59d-2e13c58fb5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:27.638498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0660ca-1eff-4253-a59d-2e13c58fb5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:27.638824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0660ca-1eff-4253-a59d-2e13c58fb5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:27.639077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0660ca-1eff-4253-a59d-2e13c58fb5f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:27.639774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0660ca-1eff-4253-a59d-2e13c58fb5f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:27.642150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0660ca-1eff-4253-a59d-2e13c58fb5f2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:27.661279 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3447/6941] 10.222.0.17 () {56 vars in 1266 bytes} [Sat Jul 30 21:28:27 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:27.666457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d5a71-48a5-43ea-9e20-20adc9a3f078 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:27.680631 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3495/6942] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:27 2022] POST /identity/v3/projects => generated 357 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:27.681790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d5a71-48a5-43ea-9e20-20adc9a3f078 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:27.682460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0660ca-1eff-4253-a59d-2e13c58fb5f2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:27.771709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0660ca-1eff-4253-a59d-2e13c58fb5f2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:27.776923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1279621-679e-4ce1-9975-12a77b0f0d74 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe0360f7f9b4f9881cf476f8e374ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e6eda57019447fd8f63b59b3fb02713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:27.777630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1279621-679e-4ce1-9975-12a77b0f0d74 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:27.778110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1279621-679e-4ce1-9975-12a77b0f0d74 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:27.778721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1279621-679e-4ce1-9975-12a77b0f0d74 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:27.780905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e1279621-679e-4ce1-9975-12a77b0f0d74 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:27.798506 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-e1279621-679e-4ce1-9975-12a77b0f0d74 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 30 21:28:27.798506 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:28:27.798506 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:28:27.798506 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:28:27.798506 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:28:27.798506 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:28:27.798506 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:28:27.798506 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:28:27.798506 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:28:27.798506 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:28:27.798506 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:28:27.798506 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:28:27.798506 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jul 30 21:28:27.798506 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jul 30 21:28:27.798506 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 30 21:28:27.801004 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 30 21:28:27.801004 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 30 21:28:27.801004 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 30 21:28:27.801004 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:28:27.801004 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:28:27.801004 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 30 21:28:27.801004 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 30 21:28:27.801004 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 30 21:28:27.801004 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 30 21:28:27.801004 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:28:27.801004 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:28:27.801004 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 30 21:28:27.801004 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 30 21:28:27.801004 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:28:27.801004 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:28:27.801004 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 30 21:28:27.801004 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 30 21:28:27.802603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:28:27.802603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:28:27.802603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 30 21:28:27.802603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 30 21:28:27.802603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 30 21:28:27.802603 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:28:27.802603 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3496/6943] 10.222.0.17 () {56 vars in 1263 bytes} [Sat Jul 30 21:28:27 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 21:28:27.802603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1279621-679e-4ce1-9975-12a77b0f0d74 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:27.819739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a33ba9-0cfd-4bde-8843-1bfe54d69376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:27.820865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a33ba9-0cfd-4bde-8843-1bfe54d69376 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:27.821689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a33ba9-0cfd-4bde-8843-1bfe54d69376 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:27.822468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a33ba9-0cfd-4bde-8843-1bfe54d69376 admin admin] PATH_INFO: `/v3/projects/0a8920ef507045c4b1c190a79996ddda/users/7a1787b445a44c3f8e9e1ed3f5e2e0d5/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:27.830304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a33ba9-0cfd-4bde-8843-1bfe54d69376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8920ef507045c4b1c190a79996ddda, user_id=7a1787b445a44c3f8e9e1ed3f5e2e0d5, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:27.836754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a33ba9-0cfd-4bde-8843-1bfe54d69376 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:27.862688 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3448/6944] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:27 2022] PUT /identity/v3/projects/0a8920ef507045c4b1c190a79996ddda/users/7a1787b445a44c3f8e9e1ed3f5e2e0d5/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:27.872295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a33ba9-0cfd-4bde-8843-1bfe54d69376 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:27.877484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d0a33ba9-0cfd-4bde-8843-1bfe54d69376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:27.891522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1279621-679e-4ce1-9975-12a77b0f0d74 tempest-TokensV3Test-1674658663 tempest-TokensV3Test-1674658663-project] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:27.953722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:27.971885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:27.981605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2d29d-451f-4284-a266-e472bb446e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:27.982386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2d29d-451f-4284-a266-e472bb446e04 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:27.983365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2d29d-451f-4284-a266-e472bb446e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:27.983744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2d29d-451f-4284-a266-e472bb446e04 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:27.984616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2d29d-451f-4284-a266-e472bb446e04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:27.987102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2d29d-451f-4284-a266-e472bb446e04 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:28.031676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a33ba9-0cfd-4bde-8843-1bfe54d69376 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:28.033086 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3497/6945] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:27 2022] POST /identity/v3/users => generated 285 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:28.036543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3f5f4-4c39-4017-825c-417447da3ee3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:28.037332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3f5f4-4c39-4017-825c-417447da3ee3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:28.038008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3f5f4-4c39-4017-825c-417447da3ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:28.049702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5b7a1-025a-4b26-85a2-da9531c6e76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:28.050371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5b7a1-025a-4b26-85a2-da9531c6e76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:28.050624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5b7a1-025a-4b26-85a2-da9531c6e76d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:28.050901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5b7a1-025a-4b26-85a2-da9531c6e76d admin admin] PATH_INFO: `/v3/users/dfe0360f7f9b4f9881cf476f8e374ff7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:28.053247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5b7a1-025a-4b26-85a2-da9531c6e76d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe0360f7f9b4f9881cf476f8e374ff7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:28.057617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5b7a1-025a-4b26-85a2-da9531c6e76d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:28.090421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7df3f5f4-4c39-4017-825c-417447da3ee3 None None] MFA Rules not processed for user `7a1787b445a44c3f8e9e1ed3f5e2e0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:28.094671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7df3f5f4-4c39-4017-825c-417447da3ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:28.134611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2dc5b7a1-025a-4b26-85a2-da9531c6e76d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe0360f7f9b4f9881cf476f8e374ff7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:28.136336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2dc5b7a1-025a-4b26-85a2-da9531c6e76d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe0360f7f9b4f9881cf476f8e374ff7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:28.175452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2dc5b7a1-025a-4b26-85a2-da9531c6e76d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe0360f7f9b4f9881cf476f8e374ff7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:28.176488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2dc5b7a1-025a-4b26-85a2-da9531c6e76d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe0360f7f9b4f9881cf476f8e374ff7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:28.193888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2dc5b7a1-025a-4b26-85a2-da9531c6e76d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe0360f7f9b4f9881cf476f8e374ff7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:28.225284 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3449/6946] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:27 2022] DELETE /identity/v3/users/dfe0360f7f9b4f9881cf476f8e374ff7 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:28.227662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5b7a1-025a-4b26-85a2-da9531c6e76d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:28.231744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2dc5b7a1-025a-4b26-85a2-da9531c6e76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:28.285933 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3498/6947] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:28.287996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee17599-9c97-4dfd-872e-e44d1fc3617c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:28.288269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee17599-9c97-4dfd-872e-e44d1fc3617c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:28.288554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee17599-9c97-4dfd-872e-e44d1fc3617c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:28.338247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-cee17599-9c97-4dfd-872e-e44d1fc3617c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:28.340669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cee17599-9c97-4dfd-872e-e44d1fc3617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:28.374685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5b7a1-025a-4b26-85a2-da9531c6e76d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:28.397028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921363d9-921d-4822-b5b1-c9d8cf2ca2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:28.397765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921363d9-921d-4822-b5b1-c9d8cf2ca2ba admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:28.398230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921363d9-921d-4822-b5b1-c9d8cf2ca2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:28.398527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921363d9-921d-4822-b5b1-c9d8cf2ca2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:28.407337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921363d9-921d-4822-b5b1-c9d8cf2ca2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:28.410609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921363d9-921d-4822-b5b1-c9d8cf2ca2ba admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:28.430037 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3450/6948] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:28.430906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921363d9-921d-4822-b5b1-c9d8cf2ca2ba admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:28.433237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-921363d9-921d-4822-b5b1-c9d8cf2ca2ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:28.500575 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3499/6949] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:28.504408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee17599-9c97-4dfd-872e-e44d1fc3617c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:28.511579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:28.519077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee17599-9c97-4dfd-872e-e44d1fc3617c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:28.526066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f017062-c886-4e75-9811-8e1fd25b3317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:28.527027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f017062-c886-4e75-9811-8e1fd25b3317 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:28.527896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f017062-c886-4e75-9811-8e1fd25b3317 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:28.528542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f017062-c886-4e75-9811-8e1fd25b3317 admin admin] PATH_INFO: `/v3/projects/dc0f30c4effc43d79938868d4f4c8163/users/e8b880d68e5742abb700c22726c6cc71/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:28.533109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921363d9-921d-4822-b5b1-c9d8cf2ca2ba admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:28.542543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90a767-c0c1-48ab-a563-081ef583a238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:28.543911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90a767-c0c1-48ab-a563-081ef583a238 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:28.544928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90a767-c0c1-48ab-a563-081ef583a238 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:28.548362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90a767-c0c1-48ab-a563-081ef583a238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:28.564220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f017062-c886-4e75-9811-8e1fd25b3317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc0f30c4effc43d79938868d4f4c8163, user_id=e8b880d68e5742abb700c22726c6cc71, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:28.568082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f017062-c886-4e75-9811-8e1fd25b3317 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:28.606350 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3500/6950] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:28 2022] PUT /identity/v3/projects/dc0f30c4effc43d79938868d4f4c8163/users/e8b880d68e5742abb700c22726c6cc71/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:28.608973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f017062-c886-4e75-9811-8e1fd25b3317 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:28.612400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5f017062-c886-4e75-9811-8e1fd25b3317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:28.702314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90a767-c0c1-48ab-a563-081ef583a238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:28.703819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90a767-c0c1-48ab-a563-081ef583a238 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:28.713893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:28.714902 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3451/6951] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:28.715856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90a767-c0c1-48ab-a563-081ef583a238 service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:28.732923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90a767-c0c1-48ab-a563-081ef583a238 service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:28.756779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f017062-c886-4e75-9811-8e1fd25b3317 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:28.768155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05904b83-5042-4247-b23d-114d3f630524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:28.770480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05904b83-5042-4247-b23d-114d3f630524 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:28.770780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05904b83-5042-4247-b23d-114d3f630524 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:28.771259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05904b83-5042-4247-b23d-114d3f630524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:28.830222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2b2eb-4b6a-4f46-adb0-96ae1b6e43e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:28.830919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2b2eb-4b6a-4f46-adb0-96ae1b6e43e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:28.831219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2b2eb-4b6a-4f46-adb0-96ae1b6e43e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:28.832025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2b2eb-4b6a-4f46-adb0-96ae1b6e43e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:28.832738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2b2eb-4b6a-4f46-adb0-96ae1b6e43e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:28.834564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2b2eb-4b6a-4f46-adb0-96ae1b6e43e9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:28.848985 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3452/6952] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:28.853513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2b2eb-4b6a-4f46-adb0-96ae1b6e43e9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:28.884683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2b2eb-4b6a-4f46-adb0-96ae1b6e43e9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:28.898220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e1b23-3049-41cc-b7e4-750547f661f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:28.898995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e1b23-3049-41cc-b7e4-750547f661f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:28.899320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e1b23-3049-41cc-b7e4-750547f661f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:28.900101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e1b23-3049-41cc-b7e4-750547f661f2 admin admin] PATH_INFO: `/v3/projects/dc0f30c4effc43d79938868d4f4c8163/users/e8b880d68e5742abb700c22726c6cc71/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:28.902994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e1b23-3049-41cc-b7e4-750547f661f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc0f30c4effc43d79938868d4f4c8163, user_id=e8b880d68e5742abb700c22726c6cc71, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:28.911056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e1b23-3049-41cc-b7e4-750547f661f2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:28.929351 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3453/6953] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:28 2022] PUT /identity/v3/projects/dc0f30c4effc43d79938868d4f4c8163/users/e8b880d68e5742abb700c22726c6cc71/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:28.955910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05904b83-5042-4247-b23d-114d3f630524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:28.957515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05904b83-5042-4247-b23d-114d3f630524 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:28.990587 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3501/6954] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:29.052472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b5be9-f685-474e-8aa0-6832f6760ce7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:29.053453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b5be9-f685-474e-8aa0-6832f6760ce7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:29.054080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b5be9-f685-474e-8aa0-6832f6760ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:29.103884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-282b5be9-f685-474e-8aa0-6832f6760ce7 None None] MFA Rules not processed for user `e8b880d68e5742abb700c22726c6cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:29.109174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-282b5be9-f685-474e-8aa0-6832f6760ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:29.268590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05904b83-5042-4247-b23d-114d3f630524 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:29.271677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-05904b83-5042-4247-b23d-114d3f630524 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:29.339933 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3454/6955] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:29 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:29.377236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b5be9-f685-474e-8aa0-6832f6760ce7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:29.378683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-282b5be9-f685-474e-8aa0-6832f6760ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:29.384931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:29.444279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05904b83-5042-4247-b23d-114d3f630524 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:29.524894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b5be9-f685-474e-8aa0-6832f6760ce7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:29.531891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60c7d8-1244-4936-8481-f819eddabce4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:29.533113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60c7d8-1244-4936-8481-f819eddabce4 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:29.533628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60c7d8-1244-4936-8481-f819eddabce4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:29.534190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60c7d8-1244-4936-8481-f819eddabce4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:29.545539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60c7d8-1244-4936-8481-f819eddabce4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:29.547749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60c7d8-1244-4936-8481-f819eddabce4 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:29.563432 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3455/6956] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:29 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:28:29.564764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60c7d8-1244-4936-8481-f819eddabce4 service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:29.566245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cb60c7d8-1244-4936-8481-f819eddabce4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:29.567430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dd2d7-630e-4350-b693-1a2e6dfd3b28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:29.568165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dd2d7-630e-4350-b693-1a2e6dfd3b28 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:29.568769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dd2d7-630e-4350-b693-1a2e6dfd3b28 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:29.568973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dd2d7-630e-4350-b693-1a2e6dfd3b28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:29.571188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-af5dd2d7-630e-4350-b693-1a2e6dfd3b28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:29.591475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5dd2d7-630e-4350-b693-1a2e6dfd3b28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:29.595914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5dd2d7-630e-4350-b693-1a2e6dfd3b28 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:29.636329 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3502/6957] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:28:29.637314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dd2d7-630e-4350-b693-1a2e6dfd3b28 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:29.643556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-af5dd2d7-630e-4350-b693-1a2e6dfd3b28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:29.696387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:29.727895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60c7d8-1244-4936-8481-f819eddabce4 service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:29.733244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c16f8d-51e3-4314-9e03-ce7090bcb10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:29.741789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16f8d-51e3-4314-9e03-ce7090bcb10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:29.742121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16f8d-51e3-4314-9e03-ce7090bcb10a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:29.742397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16f8d-51e3-4314-9e03-ce7090bcb10a admin admin] PATH_INFO: `/v3/users/e658e7338150409881a13dd1c81a8cc7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:29.744046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c16f8d-51e3-4314-9e03-ce7090bcb10a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e658e7338150409881a13dd1c81a8cc7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:29.753113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c16f8d-51e3-4314-9e03-ce7090bcb10a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:29.768174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dd2d7-630e-4350-b693-1a2e6dfd3b28 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:29.773529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16515b4b-d349-4a74-87a7-3c91f7576e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:29.774304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16515b4b-d349-4a74-87a7-3c91f7576e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:29.774704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16515b4b-d349-4a74-87a7-3c91f7576e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:29.775257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16515b4b-d349-4a74-87a7-3c91f7576e5d admin admin] PATH_INFO: `/v3/users/9934b91efbbe46da9ac86ecf5504e5e0` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:29.776624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16515b4b-d349-4a74-87a7-3c91f7576e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9934b91efbbe46da9ac86ecf5504e5e0)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:29.779116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16515b4b-d349-4a74-87a7-3c91f7576e5d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:29.858959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a6c16f8d-51e3-4314-9e03-ce7090bcb10a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e658e7338150409881a13dd1c81a8cc7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:29.860984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a6c16f8d-51e3-4314-9e03-ce7090bcb10a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e658e7338150409881a13dd1c81a8cc7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:29.873190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-16515b4b-d349-4a74-87a7-3c91f7576e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9934b91efbbe46da9ac86ecf5504e5e0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:29.878501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a6c16f8d-51e3-4314-9e03-ce7090bcb10a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e658e7338150409881a13dd1c81a8cc7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:29.879245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a6c16f8d-51e3-4314-9e03-ce7090bcb10a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e658e7338150409881a13dd1c81a8cc7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:29.891622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a6c16f8d-51e3-4314-9e03-ce7090bcb10a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e658e7338150409881a13dd1c81a8cc7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:29.893508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-16515b4b-d349-4a74-87a7-3c91f7576e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9934b91efbbe46da9ac86ecf5504e5e0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:29.895440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-16515b4b-d349-4a74-87a7-3c91f7576e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9934b91efbbe46da9ac86ecf5504e5e0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:29.903117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-16515b4b-d349-4a74-87a7-3c91f7576e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9934b91efbbe46da9ac86ecf5504e5e0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:29.903855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-16515b4b-d349-4a74-87a7-3c91f7576e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9934b91efbbe46da9ac86ecf5504e5e0'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:29.914621 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3456/6958] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:29 2022] DELETE /identity/v3/users/e658e7338150409881a13dd1c81a8cc7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:29.915801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c16f8d-51e3-4314-9e03-ce7090bcb10a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:29.918984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a6c16f8d-51e3-4314-9e03-ce7090bcb10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:29.939333 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3503/6959] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:29 2022] DELETE /identity/v3/users/9934b91efbbe46da9ac86ecf5504e5e0 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:29.940027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16515b4b-d349-4a74-87a7-3c91f7576e5d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:29.941481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-16515b4b-d349-4a74-87a7-3c91f7576e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:29.964860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:30.015257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c16f8d-51e3-4314-9e03-ce7090bcb10a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:30.030150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16515b4b-d349-4a74-87a7-3c91f7576e5d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:30.036006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1eba31-b83f-4877-9ba0-d70275840162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:30.036504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1eba31-b83f-4877-9ba0-d70275840162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:30.036804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1eba31-b83f-4877-9ba0-d70275840162 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:30.037280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1eba31-b83f-4877-9ba0-d70275840162 admin admin] PATH_INFO: `/v3/projects/0e6eda57019447fd8f63b59b3fb02713` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:30.038556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1eba31-b83f-4877-9ba0-d70275840162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e6eda57019447fd8f63b59b3fb02713)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:30.040523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1eba31-b83f-4877-9ba0-d70275840162 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:30.080329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cfb8c-4eee-4df0-be73-2e5bf398df6e tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a1787b445a44c3f8e9e1ed3f5e2e0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a8920ef507045c4b1c190a79996ddda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:30.081050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cfb8c-4eee-4df0-be73-2e5bf398df6e tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:30.081401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cfb8c-4eee-4df0-be73-2e5bf398df6e tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:30.081685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cfb8c-4eee-4df0-be73-2e5bf398df6e tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:30.082397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cfb8c-4eee-4df0-be73-2e5bf398df6e tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:30.082705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cfb8c-4eee-4df0-be73-2e5bf398df6e tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:30.084347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cfb8c-4eee-4df0-be73-2e5bf398df6e tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:30.097089 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3457/6960] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:30.098126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cfb8c-4eee-4df0-be73-2e5bf398df6e tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:30.100099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dc7cfb8c-4eee-4df0-be73-2e5bf398df6e tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:30.101971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e1eba31-b83f-4877-9ba0-d70275840162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e6eda57019447fd8f63b59b3fb02713', 'request_id': 'req-1e1eba31-b83f-4877-9ba0-d70275840162'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:30.104433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:30.111526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e1eba31-b83f-4877-9ba0-d70275840162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e6eda57019447fd8f63b59b3fb02713', 'request_id': 'req-1e1eba31-b83f-4877-9ba0-d70275840162'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:30.126312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e1eba31-b83f-4877-9ba0-d70275840162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e6eda57019447fd8f63b59b3fb02713', 'request_id': 'req-1e1eba31-b83f-4877-9ba0-d70275840162'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:30.140680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e1eba31-b83f-4877-9ba0-d70275840162 admin admin] The token cache is being invalidate because project 0e6eda57019447fd8f63b59b3fb02713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:30.140986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e1eba31-b83f-4877-9ba0-d70275840162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:30.141983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e1eba31-b83f-4877-9ba0-d70275840162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:30.144443 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3504/6961] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:29 2022] DELETE /identity/v3/projects/0e6eda57019447fd8f63b59b3fb02713 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:30.148944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7260192-097c-4f30-8d08-2fab2d5d0fb3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:30.149514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7260192-097c-4f30-8d08-2fab2d5d0fb3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:30.149989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7260192-097c-4f30-8d08-2fab2d5d0fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:30.174384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cfb8c-4eee-4df0-be73-2e5bf398df6e tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:30.182194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e7260192-097c-4f30-8d08-2fab2d5d0fb3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:30.183450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e7260192-097c-4f30-8d08-2fab2d5d0fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:30.234148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3a7da-0116-49ea-92a0-403d82c894ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:30.234783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3a7da-0116-49ea-92a0-403d82c894ac service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:30.235051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3a7da-0116-49ea-92a0-403d82c894ac service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:30.235422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3a7da-0116-49ea-92a0-403d82c894ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:30.237252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3db3a7da-0116-49ea-92a0-403d82c894ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:30.252584 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3505/6962] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:30.253880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a543b-be45-47a8-9ce9-90dcc587c8f2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:30.254178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a543b-be45-47a8-9ce9-90dcc587c8f2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:30.254468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a543b-be45-47a8-9ce9-90dcc587c8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:30.275846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:30.285818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-324a543b-be45-47a8-9ce9-90dcc587c8f2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:30.287207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-324a543b-be45-47a8-9ce9-90dcc587c8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:30.295649 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3506/6963] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:30.296550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a543b-be45-47a8-9ce9-90dcc587c8f2 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:30.297873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-324a543b-be45-47a8-9ce9-90dcc587c8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:30.308172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3a7da-0116-49ea-92a0-403d82c894ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:30.310319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3a7da-0116-49ea-92a0-403d82c894ac service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:30.319577 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3458/6964] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:30 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:30.320810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e34e6-87f7-4506-ba9d-7b028e57109a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:30.321104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e34e6-87f7-4506-ba9d-7b028e57109a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:30.321387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e34e6-87f7-4506-ba9d-7b028e57109a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:30.346042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3b2e34e6-87f7-4506-ba9d-7b028e57109a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:30.347275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3b2e34e6-87f7-4506-ba9d-7b028e57109a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:30.357863 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3459/6965] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:30.359092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e34e6-87f7-4506-ba9d-7b028e57109a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:30.360548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3b2e34e6-87f7-4506-ba9d-7b028e57109a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:30.375134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a543b-be45-47a8-9ce9-90dcc587c8f2 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:30.381257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690ada8-db4d-4f48-a21e-744d5e10258a tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a1787b445a44c3f8e9e1ed3f5e2e0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a8920ef507045c4b1c190a79996ddda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:30.381903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690ada8-db4d-4f48-a21e-744d5e10258a tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:30.382187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690ada8-db4d-4f48-a21e-744d5e10258a tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:30.382459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690ada8-db4d-4f48-a21e-744d5e10258a tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:30.383616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690ada8-db4d-4f48-a21e-744d5e10258a tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:30.385944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690ada8-db4d-4f48-a21e-744d5e10258a tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:30.418666 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3507/6966] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:30 2022] POST /identity/v3/projects => generated 354 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:30.419541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690ada8-db4d-4f48-a21e-744d5e10258a tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:30.424731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0690ada8-db4d-4f48-a21e-744d5e10258a tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:30.430184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e34e6-87f7-4506-ba9d-7b028e57109a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:30.500320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395629b-bde3-4725-8d62-a2e1c93aab0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:30.500978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395629b-bde3-4725-8d62-a2e1c93aab0c service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:30.501364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395629b-bde3-4725-8d62-a2e1c93aab0c service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:30.501905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395629b-bde3-4725-8d62-a2e1c93aab0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:30.524483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690ada8-db4d-4f48-a21e-744d5e10258a tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:30.529147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455a349-7d9f-44a7-89e4-18a36396499a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:30.530344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455a349-7d9f-44a7-89e4-18a36396499a service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:30.530631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455a349-7d9f-44a7-89e4-18a36396499a service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:30.530912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455a349-7d9f-44a7-89e4-18a36396499a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:30.548397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:30.582405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395629b-bde3-4725-8d62-a2e1c93aab0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:30.585350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395629b-bde3-4725-8d62-a2e1c93aab0c service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:30.608196 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3460/6967] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:30.609496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455a349-7d9f-44a7-89e4-18a36396499a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:30.610333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1968bc-322f-4acb-8489-a5e8a7f57d55 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:30.610627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1968bc-322f-4acb-8489-a5e8a7f57d55 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:30.610910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1968bc-322f-4acb-8489-a5e8a7f57d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:30.611026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455a349-7d9f-44a7-89e4-18a36396499a service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:30.625223 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3508/6968] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:30.636454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455a349-7d9f-44a7-89e4-18a36396499a service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:30.643877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7f1968bc-322f-4acb-8489-a5e8a7f57d55 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:30.645113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7f1968bc-322f-4acb-8489-a5e8a7f57d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:30.657838 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3461/6969] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:30.665312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1968bc-322f-4acb-8489-a5e8a7f57d55 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:30.679917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1968bc-322f-4acb-8489-a5e8a7f57d55 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:30.684807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829a0bc-45c9-4eea-acae-2eafb1809630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:30.685454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829a0bc-45c9-4eea-acae-2eafb1809630 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:30.686402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829a0bc-45c9-4eea-acae-2eafb1809630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:30.686684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829a0bc-45c9-4eea-acae-2eafb1809630 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:30.687443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829a0bc-45c9-4eea-acae-2eafb1809630 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:30.687754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829a0bc-45c9-4eea-acae-2eafb1809630 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:30.689549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829a0bc-45c9-4eea-acae-2eafb1809630 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:30.707353 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3462/6970] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:30.709981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829a0bc-45c9-4eea-acae-2eafb1809630 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:30.735347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829a0bc-45c9-4eea-acae-2eafb1809630 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:30.750221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11878d11-32ab-41a4-9a2c-1075585ebcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:30.752205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11878d11-32ab-41a4-9a2c-1075585ebcda admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:30.752614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11878d11-32ab-41a4-9a2c-1075585ebcda admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:30.752779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11878d11-32ab-41a4-9a2c-1075585ebcda admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:30.753465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11878d11-32ab-41a4-9a2c-1075585ebcda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:30.755457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11878d11-32ab-41a4-9a2c-1075585ebcda admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:30.761368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455a349-7d9f-44a7-89e4-18a36396499a service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:30.781477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455665f-07f7-45d8-81e2-42fa4285ce95 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a1787b445a44c3f8e9e1ed3f5e2e0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a8920ef507045c4b1c190a79996ddda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:30.782664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455665f-07f7-45d8-81e2-42fa4285ce95 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:30.783898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455665f-07f7-45d8-81e2-42fa4285ce95 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:30.784682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455665f-07f7-45d8-81e2-42fa4285ce95 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:30.786547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455665f-07f7-45d8-81e2-42fa4285ce95 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:30.787166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455665f-07f7-45d8-81e2-42fa4285ce95 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:30.791061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455665f-07f7-45d8-81e2-42fa4285ce95 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:30.798146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:30.812285 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3509/6971] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:30.823891 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3463/6972] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:30 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:30.829522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455665f-07f7-45d8-81e2-42fa4285ce95 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:30.849446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455665f-07f7-45d8-81e2-42fa4285ce95 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:30.872415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11878d11-32ab-41a4-9a2c-1075585ebcda admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:30.957345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c79431-cfd4-48ee-93ed-ad4ed5af9596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:30.958628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c79431-cfd4-48ee-93ed-ad4ed5af9596 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:30.958929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c79431-cfd4-48ee-93ed-ad4ed5af9596 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:30.959509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c79431-cfd4-48ee-93ed-ad4ed5af9596 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:30.960318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c79431-cfd4-48ee-93ed-ad4ed5af9596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:30.971033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c79431-cfd4-48ee-93ed-ad4ed5af9596 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:31.017603 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3510/6973] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:30 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:31.020387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c79431-cfd4-48ee-93ed-ad4ed5af9596 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:31.023881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f0c79431-cfd4-48ee-93ed-ad4ed5af9596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:31.052012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11878d11-32ab-41a4-9a2c-1075585ebcda admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:31.052928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c79431-cfd4-48ee-93ed-ad4ed5af9596 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:31.061584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2071c2c-4f2c-495c-b0e3-82ca1806e7a5 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a1787b445a44c3f8e9e1ed3f5e2e0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a8920ef507045c4b1c190a79996ddda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:31.062262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2071c2c-4f2c-495c-b0e3-82ca1806e7a5 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:31.062554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2071c2c-4f2c-495c-b0e3-82ca1806e7a5 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:31.063536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2071c2c-4f2c-495c-b0e3-82ca1806e7a5 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] PATH_INFO: `/v3/projects/437922effafe4c29b9c20a4ec79731cc` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:31.064009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cb19f-da0c-42af-af50-265973e08446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:31.064665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cb19f-da0c-42af-af50-265973e08446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:31.064949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cb19f-da0c-42af-af50-265973e08446 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:31.065296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cb19f-da0c-42af-af50-265973e08446 admin admin] PATH_INFO: `/v3/projects/7b23665bdbc345a4822140a8738f0b05` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:31.067301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2071c2c-4f2c-495c-b0e3-82ca1806e7a5 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] RBAC: Authorizing `identity:delete_project(project_id=437922effafe4c29b9c20a4ec79731cc)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:31.068517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cb19f-da0c-42af-af50-265973e08446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b23665bdbc345a4822140a8738f0b05)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:31.070468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cb19f-da0c-42af-af50-265973e08446 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:31.076041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2071c2c-4f2c-495c-b0e3-82ca1806e7a5 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:31.164624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:31.190812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3d6cb19f-da0c-42af-af50-265973e08446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b23665bdbc345a4822140a8738f0b05', 'request_id': 'req-3d6cb19f-da0c-42af-af50-265973e08446'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.200068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3d6cb19f-da0c-42af-af50-265973e08446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b23665bdbc345a4822140a8738f0b05', 'request_id': 'req-3d6cb19f-da0c-42af-af50-265973e08446'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.200440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e2071c2c-4f2c-495c-b0e3-82ca1806e7a5 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '437922effafe4c29b9c20a4ec79731cc', 'request_id': 'req-e2071c2c-4f2c-495c-b0e3-82ca1806e7a5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.212894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3d6cb19f-da0c-42af-af50-265973e08446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b23665bdbc345a4822140a8738f0b05', 'request_id': 'req-3d6cb19f-da0c-42af-af50-265973e08446'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.222756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e2071c2c-4f2c-495c-b0e3-82ca1806e7a5 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '437922effafe4c29b9c20a4ec79731cc', 'request_id': 'req-e2071c2c-4f2c-495c-b0e3-82ca1806e7a5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.231355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3d6cb19f-da0c-42af-af50-265973e08446 admin admin] The token cache is being invalidate because project 7b23665bdbc345a4822140a8738f0b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:31.232087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e2071c2c-4f2c-495c-b0e3-82ca1806e7a5 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '437922effafe4c29b9c20a4ec79731cc', 'request_id': 'req-e2071c2c-4f2c-495c-b0e3-82ca1806e7a5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.232419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3d6cb19f-da0c-42af-af50-265973e08446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.233364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3d6cb19f-da0c-42af-af50-265973e08446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.238767 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3511/6974] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:31 2022] DELETE /identity/v3/projects/7b23665bdbc345a4822140a8738f0b05 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:31.238767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cb19f-da0c-42af-af50-265973e08446 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:31.240602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3d6cb19f-da0c-42af-af50-265973e08446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:31.250913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e2071c2c-4f2c-495c-b0e3-82ca1806e7a5 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] The token cache is being invalidate because project 437922effafe4c29b9c20a4ec79731cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:31.251421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e2071c2c-4f2c-495c-b0e3-82ca1806e7a5 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.260522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e2071c2c-4f2c-495c-b0e3-82ca1806e7a5 tempest-VolumeQuotaClassesTest-1982102284 tempest-VolumeQuotaClassesTest-1982102284-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.267689 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3464/6975] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:30 2022] DELETE /identity/v3/projects/437922effafe4c29b9c20a4ec79731cc => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:28:31.271933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e168195-9592-4c84-ac3b-00fbe116a2c9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:31.273125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e168195-9592-4c84-ac3b-00fbe116a2c9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:31.274432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e168195-9592-4c84-ac3b-00fbe116a2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:31.307264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4e168195-9592-4c84-ac3b-00fbe116a2c9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:31.308766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4e168195-9592-4c84-ac3b-00fbe116a2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:31.404090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cb19f-da0c-42af-af50-265973e08446 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:31.414565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c60f1-1c94-4dac-9e9c-db24eadddeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:31.415481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c60f1-1c94-4dac-9e9c-db24eadddeec admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:31.415885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c60f1-1c94-4dac-9e9c-db24eadddeec admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:31.416254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c60f1-1c94-4dac-9e9c-db24eadddeec admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:31.417509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c60f1-1c94-4dac-9e9c-db24eadddeec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:31.418369 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3465/6976] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:31.419558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e168195-9592-4c84-ac3b-00fbe116a2c9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:31.421051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4e168195-9592-4c84-ac3b-00fbe116a2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:31.426593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c60f1-1c94-4dac-9e9c-db24eadddeec admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:31.442376 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3512/6977] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:31.442568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e168195-9592-4c84-ac3b-00fbe116a2c9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:31.442653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28da59-1633-4413-b4e8-e84c24d28fef None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:31.442653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28da59-1633-4413-b4e8-e84c24d28fef None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:31.442653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28da59-1633-4413-b4e8-e84c24d28fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:31.448620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc61a97-4623-48a1-bef4-8726b9fb917e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:31.449321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc61a97-4623-48a1-bef4-8726b9fb917e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:31.449785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc61a97-4623-48a1-bef4-8726b9fb917e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:31.450724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc61a97-4623-48a1-bef4-8726b9fb917e admin admin] PATH_INFO: `/v3/projects/7b37395154b44e35a734b230f66b61cd` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:31.452763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc61a97-4623-48a1-bef4-8726b9fb917e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b37395154b44e35a734b230f66b61cd)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:31.454973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc61a97-4623-48a1-bef4-8726b9fb917e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:31.469469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4e28da59-1633-4413-b4e8-e84c24d28fef None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:31.470854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4e28da59-1633-4413-b4e8-e84c24d28fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:31.483383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:31.499447 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3513/6978] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:31.503551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28da59-1633-4413-b4e8-e84c24d28fef None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:31.506662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4e28da59-1633-4413-b4e8-e84c24d28fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:31.521999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28da59-1633-4413-b4e8-e84c24d28fef None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:31.540560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8bc61a97-4623-48a1-bef4-8726b9fb917e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b37395154b44e35a734b230f66b61cd', 'request_id': 'req-8bc61a97-4623-48a1-bef4-8726b9fb917e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.549168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8bc61a97-4623-48a1-bef4-8726b9fb917e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b37395154b44e35a734b230f66b61cd', 'request_id': 'req-8bc61a97-4623-48a1-bef4-8726b9fb917e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.555981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8bc61a97-4623-48a1-bef4-8726b9fb917e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b37395154b44e35a734b230f66b61cd', 'request_id': 'req-8bc61a97-4623-48a1-bef4-8726b9fb917e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.570983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8bc61a97-4623-48a1-bef4-8726b9fb917e admin admin] The token cache is being invalidate because project 7b37395154b44e35a734b230f66b61cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:31.571138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8bc61a97-4623-48a1-bef4-8726b9fb917e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.572138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8bc61a97-4623-48a1-bef4-8726b9fb917e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.574620 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3466/6979] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:31 2022] DELETE /identity/v3/projects/7b37395154b44e35a734b230f66b61cd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:31.575614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc61a97-4623-48a1-bef4-8726b9fb917e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:31.578168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8bc61a97-4623-48a1-bef4-8726b9fb917e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:31.665158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc61a97-4623-48a1-bef4-8726b9fb917e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:31.672265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cfdbc-9270-4e91-911d-11f945d5f884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:31.673126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cfdbc-9270-4e91-911d-11f945d5f884 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:31.673698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cfdbc-9270-4e91-911d-11f945d5f884 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:31.674039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cfdbc-9270-4e91-911d-11f945d5f884 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:31.675361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cfdbc-9270-4e91-911d-11f945d5f884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:31.675579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cfdbc-9270-4e91-911d-11f945d5f884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:31.678162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cfdbc-9270-4e91-911d-11f945d5f884 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:31.692861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab7eb4-0f42-48c4-bd9f-ceda6881659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:31.694181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab7eb4-0f42-48c4-bd9f-ceda6881659c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:31.695049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab7eb4-0f42-48c4-bd9f-ceda6881659c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:31.695359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab7eb4-0f42-48c4-bd9f-ceda6881659c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:31.696114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab7eb4-0f42-48c4-bd9f-ceda6881659c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:31.698735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab7eb4-0f42-48c4-bd9f-ceda6881659c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:31.709959 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3467/6980] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:31.710763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cfdbc-9270-4e91-911d-11f945d5f884 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:31.717922 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3514/6981] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:31.717922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab7eb4-0f42-48c4-bd9f-ceda6881659c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:31.718201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c70cfdbc-9270-4e91-911d-11f945d5f884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:31.720554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3bab7eb4-0f42-48c4-bd9f-ceda6881659c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:31.734718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab7eb4-0f42-48c4-bd9f-ceda6881659c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:31.740719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6cd9e-5c05-4e52-8ba2-7eb5126a3abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:31.741412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6cd9e-5c05-4e52-8ba2-7eb5126a3abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:31.741699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6cd9e-5c05-4e52-8ba2-7eb5126a3abd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:31.741979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6cd9e-5c05-4e52-8ba2-7eb5126a3abd admin admin] PATH_INFO: `/v3/users/6cd68fffccf34bffaee3aeb8dacab939` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:31.743197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6cd9e-5c05-4e52-8ba2-7eb5126a3abd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cd68fffccf34bffaee3aeb8dacab939)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:31.745408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6cd9e-5c05-4e52-8ba2-7eb5126a3abd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:31.778116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cfdbc-9270-4e91-911d-11f945d5f884 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:31.794529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157b481-66cc-4397-84bb-990ad4fab9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:31.796015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157b481-66cc-4397-84bb-990ad4fab9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:31.797116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157b481-66cc-4397-84bb-990ad4fab9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:31.797628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157b481-66cc-4397-84bb-990ad4fab9d9 admin admin] PATH_INFO: `/v3/users/b8f52cc0616a4da4a03a945cfbe3619c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:31.800406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157b481-66cc-4397-84bb-990ad4fab9d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8f52cc0616a4da4a03a945cfbe3619c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:31.803359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:31.804398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157b481-66cc-4397-84bb-990ad4fab9d9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:31.827445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-74f6cd9e-5c05-4e52-8ba2-7eb5126a3abd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cd68fffccf34bffaee3aeb8dacab939'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.851079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-74f6cd9e-5c05-4e52-8ba2-7eb5126a3abd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cd68fffccf34bffaee3aeb8dacab939'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.851992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-74f6cd9e-5c05-4e52-8ba2-7eb5126a3abd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cd68fffccf34bffaee3aeb8dacab939'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.860785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-74f6cd9e-5c05-4e52-8ba2-7eb5126a3abd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cd68fffccf34bffaee3aeb8dacab939'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.862156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-74f6cd9e-5c05-4e52-8ba2-7eb5126a3abd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cd68fffccf34bffaee3aeb8dacab939'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.883347 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3515/6982] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:31 2022] DELETE /identity/v3/users/6cd68fffccf34bffaee3aeb8dacab939 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:31.884395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6cd9e-5c05-4e52-8ba2-7eb5126a3abd admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:31.887008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-74f6cd9e-5c05-4e52-8ba2-7eb5126a3abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:31.891068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6157b481-66cc-4397-84bb-990ad4fab9d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8f52cc0616a4da4a03a945cfbe3619c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.891988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6157b481-66cc-4397-84bb-990ad4fab9d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8f52cc0616a4da4a03a945cfbe3619c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.912454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6157b481-66cc-4397-84bb-990ad4fab9d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8f52cc0616a4da4a03a945cfbe3619c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.913243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6157b481-66cc-4397-84bb-990ad4fab9d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8f52cc0616a4da4a03a945cfbe3619c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.925214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6157b481-66cc-4397-84bb-990ad4fab9d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8f52cc0616a4da4a03a945cfbe3619c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:31.944017 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3468/6983] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:31 2022] DELETE /identity/v3/users/b8f52cc0616a4da4a03a945cfbe3619c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:31.944017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157b481-66cc-4397-84bb-990ad4fab9d9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:31.944017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6157b481-66cc-4397-84bb-990ad4fab9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:31.965633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:31.994843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6cd9e-5c05-4e52-8ba2-7eb5126a3abd admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:32.037534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157b481-66cc-4397-84bb-990ad4fab9d9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:32.048271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98d17a-9811-442b-ac8a-137fcdbf5e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:32.049067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98d17a-9811-442b-ac8a-137fcdbf5e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:32.049357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98d17a-9811-442b-ac8a-137fcdbf5e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:32.049657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98d17a-9811-442b-ac8a-137fcdbf5e91 admin admin] PATH_INFO: `/v3/projects/772b49892e8d4f0ba191b74c3b40d29f/users/9639114214674fcb9b65f5795312ac33/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:32.082803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98d17a-9811-442b-ac8a-137fcdbf5e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=772b49892e8d4f0ba191b74c3b40d29f, user_id=9639114214674fcb9b65f5795312ac33, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:32.083641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f33c5-4e03-485d-be24-c9940e3bb3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:32.084281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f33c5-4e03-485d-be24-c9940e3bb3de admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:32.084580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f33c5-4e03-485d-be24-c9940e3bb3de admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:32.084863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f33c5-4e03-485d-be24-c9940e3bb3de admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:32.085591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f33c5-4e03-485d-be24-c9940e3bb3de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:32.086373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98d17a-9811-442b-ac8a-137fcdbf5e91 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:32.087597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f33c5-4e03-485d-be24-c9940e3bb3de admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:32.109179 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3469/6984] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:31 2022] PUT /identity/v3/projects/772b49892e8d4f0ba191b74c3b40d29f/users/9639114214674fcb9b65f5795312ac33/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:32.112350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0142f-3b62-47c3-9858-703b4bb7d6aa None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:32.112654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0142f-3b62-47c3-9858-703b4bb7d6aa None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:32.112940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0142f-3b62-47c3-9858-703b4bb7d6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:32.136996 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3516/6985] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:31 2022] POST /identity/v3/projects => generated 361 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:32.140405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c3704-f432-4132-a382-27f68d75aec4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:32.141186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c3704-f432-4132-a382-27f68d75aec4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:32.141948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c3704-f432-4132-a382-27f68d75aec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:32.153582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-dbf0142f-3b62-47c3-9858-703b4bb7d6aa None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:32.155424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dbf0142f-3b62-47c3-9858-703b4bb7d6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:32.206671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-970c3704-f432-4132-a382-27f68d75aec4 None None] MFA Rules not processed for user `9639114214674fcb9b65f5795312ac33`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:32.208095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-970c3704-f432-4132-a382-27f68d75aec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:32.296935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:32.303725 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3470/6986] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:32.307682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0142f-3b62-47c3-9858-703b4bb7d6aa None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:32.310497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dbf0142f-3b62-47c3-9858-703b4bb7d6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:32.355674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0142f-3b62-47c3-9858-703b4bb7d6aa None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:32.366098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b57cc2-f210-4d77-9290-a01f282632b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:32.366978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b57cc2-f210-4d77-9290-a01f282632b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:32.367520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b57cc2-f210-4d77-9290-a01f282632b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:32.367978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b57cc2-f210-4d77-9290-a01f282632b3 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:32.368824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b57cc2-f210-4d77-9290-a01f282632b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:32.371505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b57cc2-f210-4d77-9290-a01f282632b3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:32.397076 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3517/6987] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:32.399172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c3704-f432-4132-a382-27f68d75aec4 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:32.403550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-970c3704-f432-4132-a382-27f68d75aec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:32.434364 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3471/6988] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:32 2022] POST /identity/v3/users => generated 281 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:32.439415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b57cc2-f210-4d77-9290-a01f282632b3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:32.445315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-86b57cc2-f210-4d77-9290-a01f282632b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:32.518641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c3704-f432-4132-a382-27f68d75aec4 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:32.523786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6e800-f326-4ede-9b05-660c9845fe8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:32.524528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6e800-f326-4ede-9b05-660c9845fe8d service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:32.524887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6e800-f326-4ede-9b05-660c9845fe8d service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:32.525308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6e800-f326-4ede-9b05-660c9845fe8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:32.541208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6e800-f326-4ede-9b05-660c9845fe8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:32.543930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6e800-f326-4ede-9b05-660c9845fe8d service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:32.562356 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3518/6989] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:32.565161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b57cc2-f210-4d77-9290-a01f282632b3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:32.566030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6e800-f326-4ede-9b05-660c9845fe8d service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:32.574412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898c46c-f5de-41ff-8c6e-3f455247bde1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:32.575391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898c46c-f5de-41ff-8c6e-3f455247bde1 service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:32.575859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898c46c-f5de-41ff-8c6e-3f455247bde1 service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:32.576337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898c46c-f5de-41ff-8c6e-3f455247bde1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:32.580289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6e800-f326-4ede-9b05-660c9845fe8d service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:32.586765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d8a8d-7b48-4a87-83d4-d1f2814c0e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:32.587152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d8a8d-7b48-4a87-83d4-d1f2814c0e38 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:32.587697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d8a8d-7b48-4a87-83d4-d1f2814c0e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:32.588609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d8a8d-7b48-4a87-83d4-d1f2814c0e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:32.588888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d8a8d-7b48-4a87-83d4-d1f2814c0e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:32.590819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d8a8d-7b48-4a87-83d4-d1f2814c0e38 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:32.591542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898c46c-f5de-41ff-8c6e-3f455247bde1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:32.593239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898c46c-f5de-41ff-8c6e-3f455247bde1 service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:32.612489 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3472/6990] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:32.613537 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3519/6991] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:32.613654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898c46c-f5de-41ff-8c6e-3f455247bde1 service glance] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:32.614818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d8a8d-7b48-4a87-83d4-d1f2814c0e38 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:32.615151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2898c46c-f5de-41ff-8c6e-3f455247bde1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:32.631995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d8a8d-7b48-4a87-83d4-d1f2814c0e38 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:32.632249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898c46c-f5de-41ff-8c6e-3f455247bde1 service glance] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:32.638073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926ed9b-7daa-4508-b9fa-6c1509943d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:32.638730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926ed9b-7daa-4508-b9fa-6c1509943d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:32.639013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926ed9b-7daa-4508-b9fa-6c1509943d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:32.639398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926ed9b-7daa-4508-b9fa-6c1509943d7a admin admin] PATH_INFO: `/v3/projects/baa4ebbda8ef40a4b503c67d939d960c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:32.640694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926ed9b-7daa-4508-b9fa-6c1509943d7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa4ebbda8ef40a4b503c67d939d960c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:32.644183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926ed9b-7daa-4508-b9fa-6c1509943d7a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:32.647244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e9364-2ab0-4283-ae5e-b3f46cd32d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:32.648396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e9364-2ab0-4283-ae5e-b3f46cd32d68 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:32.648893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e9364-2ab0-4283-ae5e-b3f46cd32d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:32.649546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e9364-2ab0-4283-ae5e-b3f46cd32d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:32.650460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e9364-2ab0-4283-ae5e-b3f46cd32d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:32.652553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e9364-2ab0-4283-ae5e-b3f46cd32d68 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:32.665011 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3520/6992] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:32.670710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:32.671338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e9364-2ab0-4283-ae5e-b3f46cd32d68 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:32.693355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e9364-2ab0-4283-ae5e-b3f46cd32d68 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:32.701283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203c3d3-d7ec-40c1-8d75-1d6b3b6bba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:32.702307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203c3d3-d7ec-40c1-8d75-1d6b3b6bba92 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:32.702613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203c3d3-d7ec-40c1-8d75-1d6b3b6bba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:32.702905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203c3d3-d7ec-40c1-8d75-1d6b3b6bba92 admin admin] PATH_INFO: `/v3/projects/7af2ab84796441338c5128a6eb386b83/users/f81693a6c503456bb266fc5bae3f6f70/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:32.736386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203c3d3-d7ec-40c1-8d75-1d6b3b6bba92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7af2ab84796441338c5128a6eb386b83, user_id=f81693a6c503456bb266fc5bae3f6f70, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:32.740371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203c3d3-d7ec-40c1-8d75-1d6b3b6bba92 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:32.750768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3926ed9b-7daa-4508-b9fa-6c1509943d7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa4ebbda8ef40a4b503c67d939d960c', 'request_id': 'req-3926ed9b-7daa-4508-b9fa-6c1509943d7a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:32.767356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3926ed9b-7daa-4508-b9fa-6c1509943d7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa4ebbda8ef40a4b503c67d939d960c', 'request_id': 'req-3926ed9b-7daa-4508-b9fa-6c1509943d7a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:32.776507 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3521/6993] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:32 2022] PUT /identity/v3/projects/7af2ab84796441338c5128a6eb386b83/users/f81693a6c503456bb266fc5bae3f6f70/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:32.778440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41935cdf-c37e-4db5-b126-9966ff072670 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:32.779028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41935cdf-c37e-4db5-b126-9966ff072670 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:32.779465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41935cdf-c37e-4db5-b126-9966ff072670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:32.780919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3926ed9b-7daa-4508-b9fa-6c1509943d7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa4ebbda8ef40a4b503c67d939d960c', 'request_id': 'req-3926ed9b-7daa-4508-b9fa-6c1509943d7a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:32.802020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3926ed9b-7daa-4508-b9fa-6c1509943d7a admin admin] The token cache is being invalidate because project baa4ebbda8ef40a4b503c67d939d960c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:32.802312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3926ed9b-7daa-4508-b9fa-6c1509943d7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:32.803778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3926ed9b-7daa-4508-b9fa-6c1509943d7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:32.814168 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3473/6994] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:32 2022] DELETE /identity/v3/projects/baa4ebbda8ef40a4b503c67d939d960c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:32.815755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3bd02-c48b-49ff-a13a-5ff73f9c20e4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:32.816828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3bd02-c48b-49ff-a13a-5ff73f9c20e4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:32.817133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3bd02-c48b-49ff-a13a-5ff73f9c20e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:32.823725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-41935cdf-c37e-4db5-b126-9966ff072670 None None] MFA Rules not processed for user `f81693a6c503456bb266fc5bae3f6f70`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:32.824983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-41935cdf-c37e-4db5-b126-9966ff072670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:32.857995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e4d3bd02-c48b-49ff-a13a-5ff73f9c20e4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:32.860332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e4d3bd02-c48b-49ff-a13a-5ff73f9c20e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:32.999828 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3522/6995] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:33.028029 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3474/6996] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:33.040396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6bcb4-8eeb-471f-8ef5-7ca365c184c1 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:33.040770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6bcb4-8eeb-471f-8ef5-7ca365c184c1 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:33.040961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6bcb4-8eeb-471f-8ef5-7ca365c184c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:33.062970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3bd02-c48b-49ff-a13a-5ff73f9c20e4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:33.064496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e4d3bd02-c48b-49ff-a13a-5ff73f9c20e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:33.115685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9aa6bcb4-8eeb-471f-8ef5-7ca365c184c1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:33.120181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9aa6bcb4-8eeb-471f-8ef5-7ca365c184c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:33.152733 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3523/6997] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:33.159649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6bcb4-8eeb-471f-8ef5-7ca365c184c1 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:33.187557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6bcb4-8eeb-471f-8ef5-7ca365c184c1 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:33.203250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc47970-d783-4c8e-9e71-e43c5dbb7052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:33.206060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc47970-d783-4c8e-9e71-e43c5dbb7052 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:33.207396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc47970-d783-4c8e-9e71-e43c5dbb7052 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:33.207899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc47970-d783-4c8e-9e71-e43c5dbb7052 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:33.210930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc47970-d783-4c8e-9e71-e43c5dbb7052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:33.213462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc47970-d783-4c8e-9e71-e43c5dbb7052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:33.215514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc47970-d783-4c8e-9e71-e43c5dbb7052 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:33.254784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3bd02-c48b-49ff-a13a-5ff73f9c20e4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:33.278382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505ae15-50fb-48da-b68e-615daeeb1eec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:33.280533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505ae15-50fb-48da-b68e-615daeeb1eec service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:33.281033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505ae15-50fb-48da-b68e-615daeeb1eec service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:33.281522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505ae15-50fb-48da-b68e-615daeeb1eec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:33.287003 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3524/6998] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:33.288357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc47970-d783-4c8e-9e71-e43c5dbb7052 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:33.305651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:33.315919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505ae15-50fb-48da-b68e-615daeeb1eec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:33.317854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505ae15-50fb-48da-b68e-615daeeb1eec service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:33.318581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc47970-d783-4c8e-9e71-e43c5dbb7052 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:33.332709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc69923-e136-4a58-979e-3cbd9d8ba5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:33.335602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc69923-e136-4a58-979e-3cbd9d8ba5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:33.336677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc69923-e136-4a58-979e-3cbd9d8ba5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:33.337620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc69923-e136-4a58-979e-3cbd9d8ba5b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:33.339322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc69923-e136-4a58-979e-3cbd9d8ba5b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:33.348422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc69923-e136-4a58-979e-3cbd9d8ba5b7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:33.377404 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3475/6999] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:28:33.383341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505ae15-50fb-48da-b68e-615daeeb1eec service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:33.390360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9505ae15-50fb-48da-b68e-615daeeb1eec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:33.414855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505ae15-50fb-48da-b68e-615daeeb1eec service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:33.421528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816eb013-5165-4904-9746-8ee8ff55f527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:33.422531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eb013-5165-4904-9746-8ee8ff55f527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:33.423051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eb013-5165-4904-9746-8ee8ff55f527 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:33.423545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eb013-5165-4904-9746-8ee8ff55f527 admin admin] PATH_INFO: `/v3/users/9639114214674fcb9b65f5795312ac33` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:33.425181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816eb013-5165-4904-9746-8ee8ff55f527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9639114214674fcb9b65f5795312ac33)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:33.427792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816eb013-5165-4904-9746-8ee8ff55f527 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:33.445485 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3525/7000] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:33 2022] POST /identity/v3/projects => generated 367 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:33.450135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc69923-e136-4a58-979e-3cbd9d8ba5b7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:33.554407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:33.564630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-816eb013-5165-4904-9746-8ee8ff55f527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9639114214674fcb9b65f5795312ac33'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:33.565483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-816eb013-5165-4904-9746-8ee8ff55f527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9639114214674fcb9b65f5795312ac33'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:33.603319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-816eb013-5165-4904-9746-8ee8ff55f527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9639114214674fcb9b65f5795312ac33'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:33.605461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-816eb013-5165-4904-9746-8ee8ff55f527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9639114214674fcb9b65f5795312ac33'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:33.622600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-816eb013-5165-4904-9746-8ee8ff55f527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9639114214674fcb9b65f5795312ac33'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:33.664449 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3476/7001] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:33 2022] DELETE /identity/v3/users/9639114214674fcb9b65f5795312ac33 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:33.671281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04273d32-8b03-4219-84a3-ce26125439d6 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:33.673134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04273d32-8b03-4219-84a3-ce26125439d6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:33.673711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04273d32-8b03-4219-84a3-ce26125439d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:33.679312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc69923-e136-4a58-979e-3cbd9d8ba5b7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:33.720787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-04273d32-8b03-4219-84a3-ce26125439d6 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:33.723140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-04273d32-8b03-4219-84a3-ce26125439d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:33.759847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbe918-3736-4457-adf4-97ffd708d764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:33.760661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbe918-3736-4457-adf4-97ffd708d764 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:33.760962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbe918-3736-4457-adf4-97ffd708d764 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:33.761395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbe918-3736-4457-adf4-97ffd708d764 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:33.762033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbe918-3736-4457-adf4-97ffd708d764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:33.764957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbe918-3736-4457-adf4-97ffd708d764 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:33.804940 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3526/7002] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:33 2022] POST /identity/v3/users => generated 284 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:33.809112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbe918-3736-4457-adf4-97ffd708d764 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:33.812186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e3bbe918-3736-4457-adf4-97ffd708d764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:33.839186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbe918-3736-4457-adf4-97ffd708d764 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:33.851373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc5bf5-47ab-4d5b-ab32-04894f509ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:33.852836 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3477/7003] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:33.854216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc5bf5-47ab-4d5b-ab32-04894f509ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:33.854512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc5bf5-47ab-4d5b-ab32-04894f509ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:33.854792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc5bf5-47ab-4d5b-ab32-04894f509ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:33.856084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc5bf5-47ab-4d5b-ab32-04894f509ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:33.858806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc5bf5-47ab-4d5b-ab32-04894f509ff8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:33.874771 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3527/7004] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:28:33.879076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04273d32-8b03-4219-84a3-ce26125439d6 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:33.896374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04273d32-8b03-4219-84a3-ce26125439d6 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:33.904474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78805b5-9762-49d8-b735-fdd2d3aaf557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:33.907327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78805b5-9762-49d8-b735-fdd2d3aaf557 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:33.907920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78805b5-9762-49d8-b735-fdd2d3aaf557 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:33.908453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78805b5-9762-49d8-b735-fdd2d3aaf557 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:33.910500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78805b5-9762-49d8-b735-fdd2d3aaf557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:33.913079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78805b5-9762-49d8-b735-fdd2d3aaf557 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:33.933184 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3478/7005] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:28:33.933535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc5bf5-47ab-4d5b-ab32-04894f509ff8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:33.948915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc5bf5-47ab-4d5b-ab32-04894f509ff8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:33.966104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02721db-c25f-4ef6-a725-2ba3a01344f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:33.966867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02721db-c25f-4ef6-a725-2ba3a01344f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:33.967154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02721db-c25f-4ef6-a725-2ba3a01344f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:33.967464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02721db-c25f-4ef6-a725-2ba3a01344f2 admin admin] PATH_INFO: `/v3/projects/89085b5a4bd54636966a2c9e1a2a4ca8/users/54a4d2bd69f449288b49186d9f06d75f/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:34.002372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02721db-c25f-4ef6-a725-2ba3a01344f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89085b5a4bd54636966a2c9e1a2a4ca8, user_id=54a4d2bd69f449288b49186d9f06d75f, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:34.005329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02721db-c25f-4ef6-a725-2ba3a01344f2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:34.021753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78805b5-9762-49d8-b735-fdd2d3aaf557 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:34.025725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c78805b5-9762-49d8-b735-fdd2d3aaf557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:34.044596 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3528/7006] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:33 2022] PUT /identity/v3/projects/89085b5a4bd54636966a2c9e1a2a4ca8/users/54a4d2bd69f449288b49186d9f06d75f/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:34.055580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb2b24-a5f4-4d86-bee7-0553b56a7a98 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:34.055872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb2b24-a5f4-4d86-bee7-0553b56a7a98 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:34.056155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb2b24-a5f4-4d86-bee7-0553b56a7a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:34.120350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-baeb2b24-a5f4-4d86-bee7-0553b56a7a98 None None] MFA Rules not processed for user `54a4d2bd69f449288b49186d9f06d75f`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:34.121070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78805b5-9762-49d8-b735-fdd2d3aaf557 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:34.121840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-baeb2b24-a5f4-4d86-bee7-0553b56a7a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:34.189481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:34.215356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f53506-2f52-4c3f-b7d9-bdef0ac23fa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:34.216190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f53506-2f52-4c3f-b7d9-bdef0ac23fa2 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:34.216488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f53506-2f52-4c3f-b7d9-bdef0ac23fa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:34.216840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f53506-2f52-4c3f-b7d9-bdef0ac23fa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:34.254308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:34.294405 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3529/7007] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:34.296858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb2b24-a5f4-4d86-bee7-0553b56a7a98 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:34.348146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f53506-2f52-4c3f-b7d9-bdef0ac23fa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:34.349635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f53506-2f52-4c3f-b7d9-bdef0ac23fa2 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:34.377295 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3479/7008] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:34.379204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f53506-2f52-4c3f-b7d9-bdef0ac23fa2 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:34.382740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-07f53506-2f52-4c3f-b7d9-bdef0ac23fa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:34.414783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f53506-2f52-4c3f-b7d9-bdef0ac23fa2 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:34.421082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb2b24-a5f4-4d86-bee7-0553b56a7a98 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:34.423404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5807aff-02e3-4993-9ccf-adccb56b7f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:34.423404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5807aff-02e3-4993-9ccf-adccb56b7f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:34.423404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5807aff-02e3-4993-9ccf-adccb56b7f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:34.423404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5807aff-02e3-4993-9ccf-adccb56b7f0e admin admin] PATH_INFO: `/v3/projects/273cbb61fd794e99b77f7e2e3f70d5cf` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:34.424375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5807aff-02e3-4993-9ccf-adccb56b7f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=273cbb61fd794e99b77f7e2e3f70d5cf)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:34.427671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5807aff-02e3-4993-9ccf-adccb56b7f0e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:34.433901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da837918-2dfa-4726-ae20-805187abca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:34.434862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da837918-2dfa-4726-ae20-805187abca3c admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:34.435423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da837918-2dfa-4726-ae20-805187abca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:34.436169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da837918-2dfa-4726-ae20-805187abca3c admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:34.437046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da837918-2dfa-4726-ae20-805187abca3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:34.440662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da837918-2dfa-4726-ae20-805187abca3c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:34.512000 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3530/7009] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:34 2022] POST /identity/v3/projects => generated 365 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:34.518009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da837918-2dfa-4726-ae20-805187abca3c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:34.521343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b5807aff-02e3-4993-9ccf-adccb56b7f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '273cbb61fd794e99b77f7e2e3f70d5cf', 'request_id': 'req-b5807aff-02e3-4993-9ccf-adccb56b7f0e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:34.533149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b5807aff-02e3-4993-9ccf-adccb56b7f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '273cbb61fd794e99b77f7e2e3f70d5cf', 'request_id': 'req-b5807aff-02e3-4993-9ccf-adccb56b7f0e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:34.543700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b5807aff-02e3-4993-9ccf-adccb56b7f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '273cbb61fd794e99b77f7e2e3f70d5cf', 'request_id': 'req-b5807aff-02e3-4993-9ccf-adccb56b7f0e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:34.560859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b5807aff-02e3-4993-9ccf-adccb56b7f0e admin admin] The token cache is being invalidate because project 273cbb61fd794e99b77f7e2e3f70d5cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:34.561322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b5807aff-02e3-4993-9ccf-adccb56b7f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:34.562572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b5807aff-02e3-4993-9ccf-adccb56b7f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:34.567133 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3480/7010] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:34 2022] DELETE /identity/v3/projects/273cbb61fd794e99b77f7e2e3f70d5cf => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:34.568466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5807aff-02e3-4993-9ccf-adccb56b7f0e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:34.570324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b5807aff-02e3-4993-9ccf-adccb56b7f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:34.615264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da837918-2dfa-4726-ae20-805187abca3c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:34.622228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cda44b-128f-45cc-a82b-4845e424a3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:34.623213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cda44b-128f-45cc-a82b-4845e424a3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:34.623819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cda44b-128f-45cc-a82b-4845e424a3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:34.624576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cda44b-128f-45cc-a82b-4845e424a3b5 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:34.625419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cda44b-128f-45cc-a82b-4845e424a3b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:34.627966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cda44b-128f-45cc-a82b-4845e424a3b5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:34.656457 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3531/7011] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:34 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:34.659602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cda44b-128f-45cc-a82b-4845e424a3b5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:34.662404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a2cda44b-128f-45cc-a82b-4845e424a3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:34.675420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5807aff-02e3-4993-9ccf-adccb56b7f0e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:34.682166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cda44b-128f-45cc-a82b-4845e424a3b5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:34.682649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b29853-3f70-452c-a212-9ba141187c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:34.683498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b29853-3f70-452c-a212-9ba141187c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:34.683939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b29853-3f70-452c-a212-9ba141187c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:34.684619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b29853-3f70-452c-a212-9ba141187c3c admin admin] PATH_INFO: `/v3/users/7a1787b445a44c3f8e9e1ed3f5e2e0d5` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:34.686261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b29853-3f70-452c-a212-9ba141187c3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a1787b445a44c3f8e9e1ed3f5e2e0d5)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:34.688550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b29853-3f70-452c-a212-9ba141187c3c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:34.689685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63523b1c-7c59-4f31-ade9-d2be1bfd9e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:34.690591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63523b1c-7c59-4f31-ade9-d2be1bfd9e1d admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:34.691030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63523b1c-7c59-4f31-ade9-d2be1bfd9e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:34.691576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63523b1c-7c59-4f31-ade9-d2be1bfd9e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:34.692609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63523b1c-7c59-4f31-ade9-d2be1bfd9e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:34.695246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63523b1c-7c59-4f31-ade9-d2be1bfd9e1d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:34.708809 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3532/7012] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:34.713249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63523b1c-7c59-4f31-ade9-d2be1bfd9e1d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:34.729410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63523b1c-7c59-4f31-ade9-d2be1bfd9e1d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:34.737169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bed6c4-ab1b-4e55-8a9d-4ce879867932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:34.738816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bed6c4-ab1b-4e55-8a9d-4ce879867932 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:34.739123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bed6c4-ab1b-4e55-8a9d-4ce879867932 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:34.739422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bed6c4-ab1b-4e55-8a9d-4ce879867932 admin admin] PATH_INFO: `/v3/projects/5e18e81392ab44d280e8c1a9c96244f5/users/a879bfedf5c34538a2716e8272b48ee6/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:34.765906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bed6c4-ab1b-4e55-8a9d-4ce879867932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e18e81392ab44d280e8c1a9c96244f5, user_id=a879bfedf5c34538a2716e8272b48ee6, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:34.771274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bed6c4-ab1b-4e55-8a9d-4ce879867932 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:34.792613 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3533/7013] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:34 2022] PUT /identity/v3/projects/5e18e81392ab44d280e8c1a9c96244f5/users/a879bfedf5c34538a2716e8272b48ee6/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:28:34.796797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bed6c4-ab1b-4e55-8a9d-4ce879867932 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:34.810785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:34.824920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c6b29853-3f70-452c-a212-9ba141187c3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a1787b445a44c3f8e9e1ed3f5e2e0d5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:34.827263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c6b29853-3f70-452c-a212-9ba141187c3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a1787b445a44c3f8e9e1ed3f5e2e0d5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:34.857204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:34.882947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c6b29853-3f70-452c-a212-9ba141187c3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a1787b445a44c3f8e9e1ed3f5e2e0d5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:34.883825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c6b29853-3f70-452c-a212-9ba141187c3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a1787b445a44c3f8e9e1ed3f5e2e0d5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:34.917183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c6b29853-3f70-452c-a212-9ba141187c3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a1787b445a44c3f8e9e1ed3f5e2e0d5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:34.944859 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3481/7014] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:34 2022] DELETE /identity/v3/users/7a1787b445a44c3f8e9e1ed3f5e2e0d5 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:34.983118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bed6c4-ab1b-4e55-8a9d-4ce879867932 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:35.098434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d584a7c-acc5-406b-ae01-25a535ea5ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:35.100510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d584a7c-acc5-406b-ae01-25a535ea5ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:35.101358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d584a7c-acc5-406b-ae01-25a535ea5ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:35.101806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d584a7c-acc5-406b-ae01-25a535ea5ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:35.103603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d584a7c-acc5-406b-ae01-25a535ea5ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:35.105537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d584a7c-acc5-406b-ae01-25a535ea5ac2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:35.121424 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3534/7015] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:35.124977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b29853-3f70-452c-a212-9ba141187c3c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:35.126914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c6b29853-3f70-452c-a212-9ba141187c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:35.159917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b29853-3f70-452c-a212-9ba141187c3c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:35.167026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec8598-ad52-4e14-b65e-ab99e48b800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:35.167960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec8598-ad52-4e14-b65e-ab99e48b800e admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:35.168418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec8598-ad52-4e14-b65e-ab99e48b800e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:35.169211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec8598-ad52-4e14-b65e-ab99e48b800e admin admin] PATH_INFO: `/v3/projects/5e18e81392ab44d280e8c1a9c96244f5/users/a879bfedf5c34538a2716e8272b48ee6/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:35.172896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec8598-ad52-4e14-b65e-ab99e48b800e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e18e81392ab44d280e8c1a9c96244f5, user_id=a879bfedf5c34538a2716e8272b48ee6, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:35.177041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec8598-ad52-4e14-b65e-ab99e48b800e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:35.203674 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3482/7016] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:35 2022] PUT /identity/v3/projects/5e18e81392ab44d280e8c1a9c96244f5/users/a879bfedf5c34538a2716e8272b48ee6/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:35.204859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c75f0e-a107-49a1-b84e-118030d73876 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:35.205158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c75f0e-a107-49a1-b84e-118030d73876 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:35.205439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c75f0e-a107-49a1-b84e-118030d73876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:35.274825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-92c75f0e-a107-49a1-b84e-118030d73876 None None] MFA Rules not processed for user `a879bfedf5c34538a2716e8272b48ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:35.277177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-92c75f0e-a107-49a1-b84e-118030d73876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:35.417804 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3535/7017] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:35.432170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec8598-ad52-4e14-b65e-ab99e48b800e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:35.434240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-75ec8598-ad52-4e14-b65e-ab99e48b800e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:35.534973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec8598-ad52-4e14-b65e-ab99e48b800e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:35.544636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83c701-acc9-4198-99f2-6bfe9fc91fc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:35.545862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83c701-acc9-4198-99f2-6bfe9fc91fc7 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:35.546270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83c701-acc9-4198-99f2-6bfe9fc91fc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:35.546656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83c701-acc9-4198-99f2-6bfe9fc91fc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:35.570076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83c701-acc9-4198-99f2-6bfe9fc91fc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:35.571957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83c701-acc9-4198-99f2-6bfe9fc91fc7 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:35.602049 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3483/7018] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:35.755704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c75f0e-a107-49a1-b84e-118030d73876 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:35.768779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83c701-acc9-4198-99f2-6bfe9fc91fc7 service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:35.776442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1d83c701-acc9-4198-99f2-6bfe9fc91fc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:35.785022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c75f0e-a107-49a1-b84e-118030d73876 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:35.796390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87830143-bd85-44c6-a78c-79bd93bec5a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:35.798623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87830143-bd85-44c6-a78c-79bd93bec5a3 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:35.799642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87830143-bd85-44c6-a78c-79bd93bec5a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:35.799934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87830143-bd85-44c6-a78c-79bd93bec5a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:35.805281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-87830143-bd85-44c6-a78c-79bd93bec5a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:35.923132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:35.985109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87830143-bd85-44c6-a78c-79bd93bec5a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:35.986729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87830143-bd85-44c6-a78c-79bd93bec5a3 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:35.995511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83c701-acc9-4198-99f2-6bfe9fc91fc7 service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:36.002877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa05eb-64ad-40a4-822e-316ca659bd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:36.003814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa05eb-64ad-40a4-822e-316ca659bd2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:36.004169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa05eb-64ad-40a4-822e-316ca659bd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:36.004639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa05eb-64ad-40a4-822e-316ca659bd2f admin admin] PATH_INFO: `/v3/projects/772b49892e8d4f0ba191b74c3b40d29f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:36.010217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa05eb-64ad-40a4-822e-316ca659bd2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=772b49892e8d4f0ba191b74c3b40d29f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:36.014685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa05eb-64ad-40a4-822e-316ca659bd2f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:36.018633 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3536/7019] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:36.022156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87830143-bd85-44c6-a78c-79bd93bec5a3 service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:36.025837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-87830143-bd85-44c6-a78c-79bd93bec5a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:36.062133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87830143-bd85-44c6-a78c-79bd93bec5a3 service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:36.076795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79e427-3e90-42ea-b2aa-21c0ad1213f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:36.077477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79e427-3e90-42ea-b2aa-21c0ad1213f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:36.077766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79e427-3e90-42ea-b2aa-21c0ad1213f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:36.078047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79e427-3e90-42ea-b2aa-21c0ad1213f8 admin admin] PATH_INFO: `/v3/projects/0a8920ef507045c4b1c190a79996ddda` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:36.082876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79e427-3e90-42ea-b2aa-21c0ad1213f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a8920ef507045c4b1c190a79996ddda)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:36.104842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79e427-3e90-42ea-b2aa-21c0ad1213f8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:36.169365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f4aa05eb-64ad-40a4-822e-316ca659bd2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772b49892e8d4f0ba191b74c3b40d29f', 'request_id': 'req-f4aa05eb-64ad-40a4-822e-316ca659bd2f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:36.174778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:36.195474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f4aa05eb-64ad-40a4-822e-316ca659bd2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772b49892e8d4f0ba191b74c3b40d29f', 'request_id': 'req-f4aa05eb-64ad-40a4-822e-316ca659bd2f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:36.211596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f4aa05eb-64ad-40a4-822e-316ca659bd2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772b49892e8d4f0ba191b74c3b40d29f', 'request_id': 'req-f4aa05eb-64ad-40a4-822e-316ca659bd2f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:36.246749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f4aa05eb-64ad-40a4-822e-316ca659bd2f admin admin] The token cache is being invalidate because project 772b49892e8d4f0ba191b74c3b40d29f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:36.249087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f4aa05eb-64ad-40a4-822e-316ca659bd2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:36.249835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f4aa05eb-64ad-40a4-822e-316ca659bd2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:36.255990 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3484/7020] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:35 2022] DELETE /identity/v3/projects/772b49892e8d4f0ba191b74c3b40d29f => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:36.264329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6466910-3e37-4036-a721-e9419ac203c0 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:36.265193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6466910-3e37-4036-a721-e9419ac203c0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:36.266965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6466910-3e37-4036-a721-e9419ac203c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:36.278761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4f79e427-3e90-42ea-b2aa-21c0ad1213f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a8920ef507045c4b1c190a79996ddda', 'request_id': 'req-4f79e427-3e90-42ea-b2aa-21c0ad1213f8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:36.291101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4f79e427-3e90-42ea-b2aa-21c0ad1213f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a8920ef507045c4b1c190a79996ddda', 'request_id': 'req-4f79e427-3e90-42ea-b2aa-21c0ad1213f8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:36.321125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4f79e427-3e90-42ea-b2aa-21c0ad1213f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a8920ef507045c4b1c190a79996ddda', 'request_id': 'req-4f79e427-3e90-42ea-b2aa-21c0ad1213f8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:36.339829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c6466910-3e37-4036-a721-e9419ac203c0 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:36.340900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4f79e427-3e90-42ea-b2aa-21c0ad1213f8 admin admin] The token cache is being invalidate because project 0a8920ef507045c4b1c190a79996ddda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:36.341124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4f79e427-3e90-42ea-b2aa-21c0ad1213f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:36.342352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4f79e427-3e90-42ea-b2aa-21c0ad1213f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:36.343949 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3537/7021] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:36 2022] DELETE /identity/v3/projects/0a8920ef507045c4b1c190a79996ddda => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:36.348892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada132c7-8528-4462-82f0-c638c9e15ce3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:36.349208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada132c7-8528-4462-82f0-c638c9e15ce3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:36.349503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada132c7-8528-4462-82f0-c638c9e15ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:36.351935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c6466910-3e37-4036-a721-e9419ac203c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:36.401350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ada132c7-8528-4462-82f0-c638c9e15ce3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:36.402619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ada132c7-8528-4462-82f0-c638c9e15ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:36.542361 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3538/7022] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:36.551418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f06151-1c9c-4921-9658-ab59dbbb0752 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:36.551770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f06151-1c9c-4921-9658-ab59dbbb0752 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:36.552020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f06151-1c9c-4921-9658-ab59dbbb0752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:36.567433 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3485/7023] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:36.575679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1acc51-0093-431b-8a73-0103409cdce5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:36.576817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1acc51-0093-431b-8a73-0103409cdce5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:36.577319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1acc51-0093-431b-8a73-0103409cdce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:36.618409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bf1acc51-0093-431b-8a73-0103409cdce5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:36.619994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bf1acc51-0093-431b-8a73-0103409cdce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:36.638352 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3486/7024] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:36.643452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1acc51-0093-431b-8a73-0103409cdce5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:36.647404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f1f06151-1c9c-4921-9658-ab59dbbb0752 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:36.651232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f1f06151-1c9c-4921-9658-ab59dbbb0752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:36.703922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1acc51-0093-431b-8a73-0103409cdce5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:36.712171 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3539/7025] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:28:36.713107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f06151-1c9c-4921-9658-ab59dbbb0752 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:36.729209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe0c7c-066b-43b1-9be3-f7036fa6a540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:36.729991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe0c7c-066b-43b1-9be3-f7036fa6a540 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:36.730317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe0c7c-066b-43b1-9be3-f7036fa6a540 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:36.732226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe0c7c-066b-43b1-9be3-f7036fa6a540 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:36.733790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe0c7c-066b-43b1-9be3-f7036fa6a540 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:36.738177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe0c7c-066b-43b1-9be3-f7036fa6a540 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:36.743787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe0c7c-066b-43b1-9be3-f7036fa6a540 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:36.746575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f06151-1c9c-4921-9658-ab59dbbb0752 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:36.768786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eafb4d-b9de-4a97-aa87-8b02b8607a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:36.769895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eafb4d-b9de-4a97-aa87-8b02b8607a5f admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:36.774829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eafb4d-b9de-4a97-aa87-8b02b8607a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:36.777557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eafb4d-b9de-4a97-aa87-8b02b8607a5f admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:36.778541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eafb4d-b9de-4a97-aa87-8b02b8607a5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:36.780282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eafb4d-b9de-4a97-aa87-8b02b8607a5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:36.782261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eafb4d-b9de-4a97-aa87-8b02b8607a5f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:36.791906 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3487/7026] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:36.799527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe0c7c-066b-43b1-9be3-f7036fa6a540 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:36.840063 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3540/7027] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:36.840158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe0c7c-066b-43b1-9be3-f7036fa6a540 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:36.859153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eafb4d-b9de-4a97-aa87-8b02b8607a5f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:36.862865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58d2be-c4a0-4d70-a396-99119f5e66b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:36.866727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58d2be-c4a0-4d70-a396-99119f5e66b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:36.867030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58d2be-c4a0-4d70-a396-99119f5e66b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:36.869169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58d2be-c4a0-4d70-a396-99119f5e66b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:36.869888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58d2be-c4a0-4d70-a396-99119f5e66b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:36.871847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58d2be-c4a0-4d70-a396-99119f5e66b3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:36.887280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eafb4d-b9de-4a97-aa87-8b02b8607a5f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:36.900719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a024e9-b19e-4454-a1a5-204dd04c0b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:36.901363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a024e9-b19e-4454-a1a5-204dd04c0b1f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:36.901666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a024e9-b19e-4454-a1a5-204dd04c0b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:36.901932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a024e9-b19e-4454-a1a5-204dd04c0b1f admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:36.902607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a024e9-b19e-4454-a1a5-204dd04c0b1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:36.905163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a024e9-b19e-4454-a1a5-204dd04c0b1f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:36.977427 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3541/7028] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:36 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:36.981431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a024e9-b19e-4454-a1a5-204dd04c0b1f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:37.001207 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3488/7029] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:36 2022] POST /identity/v3/projects => generated 361 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:37.004964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58d2be-c4a0-4d70-a396-99119f5e66b3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:37.038583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:37.121371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a024e9-b19e-4454-a1a5-204dd04c0b1f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:37.199271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58d2be-c4a0-4d70-a396-99119f5e66b3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:37.212968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c9ecb-b005-48ab-8fa8-4b684179fa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:37.213615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c9ecb-b005-48ab-8fa8-4b684179fa15 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:37.213896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c9ecb-b005-48ab-8fa8-4b684179fa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:37.214171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c9ecb-b005-48ab-8fa8-4b684179fa15 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:37.214843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c9ecb-b005-48ab-8fa8-4b684179fa15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:37.217423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c9ecb-b005-48ab-8fa8-4b684179fa15 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:37.282257 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3489/7030] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:37 2022] POST /identity/v3/users => generated 281 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:37.286689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c9ecb-b005-48ab-8fa8-4b684179fa15 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:37.297046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e053d5-e6ae-4eb8-b892-4db82c4f8a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:37.297816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e053d5-e6ae-4eb8-b892-4db82c4f8a1d admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:37.298040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e053d5-e6ae-4eb8-b892-4db82c4f8a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:37.298330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e053d5-e6ae-4eb8-b892-4db82c4f8a1d admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:37.299004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e053d5-e6ae-4eb8-b892-4db82c4f8a1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:37.303207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e053d5-e6ae-4eb8-b892-4db82c4f8a1d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:37.312505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c9ecb-b005-48ab-8fa8-4b684179fa15 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:37.336042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b92bb-81cb-43e3-9aff-bb3e0a61c339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:37.336685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b92bb-81cb-43e3-9aff-bb3e0a61c339 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:37.337044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b92bb-81cb-43e3-9aff-bb3e0a61c339 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:37.337243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b92bb-81cb-43e3-9aff-bb3e0a61c339 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:37.337945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b92bb-81cb-43e3-9aff-bb3e0a61c339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:37.339620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b92bb-81cb-43e3-9aff-bb3e0a61c339 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:37.340855 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3542/7031] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:36 2022] POST /identity/v3/users => generated 292 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:37.346436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e053d5-e6ae-4eb8-b892-4db82c4f8a1d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:37.367826 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3490/7032] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:37.370663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b92bb-81cb-43e3-9aff-bb3e0a61c339 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:37.386036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e053d5-e6ae-4eb8-b892-4db82c4f8a1d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:37.394333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b92bb-81cb-43e3-9aff-bb3e0a61c339 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:37.396513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc974f41-775b-4ba0-bb2c-10f12a1a576c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:37.397466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc974f41-775b-4ba0-bb2c-10f12a1a576c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:37.397754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc974f41-775b-4ba0-bb2c-10f12a1a576c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:37.398070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc974f41-775b-4ba0-bb2c-10f12a1a576c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:37.399660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc974f41-775b-4ba0-bb2c-10f12a1a576c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:37.401510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc974f41-775b-4ba0-bb2c-10f12a1a576c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:37.417878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1a2f6-8dcc-4d08-a1da-e9af35ee00d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:37.417878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1a2f6-8dcc-4d08-a1da-e9af35ee00d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:37.417878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1a2f6-8dcc-4d08-a1da-e9af35ee00d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:37.419382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1a2f6-8dcc-4d08-a1da-e9af35ee00d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:37.420155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1a2f6-8dcc-4d08-a1da-e9af35ee00d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:37.421811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1a2f6-8dcc-4d08-a1da-e9af35ee00d9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:37.427939 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3543/7033] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:37.432267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc974f41-775b-4ba0-bb2c-10f12a1a576c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:37.458283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc974f41-775b-4ba0-bb2c-10f12a1a576c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:37.458695 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3491/7034] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:37.461612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1a2f6-8dcc-4d08-a1da-e9af35ee00d9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:37.473410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09613d16-ddd9-4a72-90eb-d11b42394e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:37.474677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09613d16-ddd9-4a72-90eb-d11b42394e1b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:37.476204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09613d16-ddd9-4a72-90eb-d11b42394e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:37.476503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09613d16-ddd9-4a72-90eb-d11b42394e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:37.477556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09613d16-ddd9-4a72-90eb-d11b42394e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:37.479535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:37.482099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09613d16-ddd9-4a72-90eb-d11b42394e1b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:37.488901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1a2f6-8dcc-4d08-a1da-e9af35ee00d9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:37.502405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3aa587-cd34-4f03-9e2e-dda14cfd5fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:37.503728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3aa587-cd34-4f03-9e2e-dda14cfd5fba admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:37.504877 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3544/7035] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:28:37.509796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3aa587-cd34-4f03-9e2e-dda14cfd5fba admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:37.509796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3aa587-cd34-4f03-9e2e-dda14cfd5fba admin admin] PATH_INFO: `/v3/projects/990138e948294d348e4c376fcf15b9ce/users/afec276c506d467c8adb1a30b6aadd8b/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:37.510917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09613d16-ddd9-4a72-90eb-d11b42394e1b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:37.542288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09613d16-ddd9-4a72-90eb-d11b42394e1b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:37.554860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3aa587-cd34-4f03-9e2e-dda14cfd5fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=990138e948294d348e4c376fcf15b9ce, user_id=afec276c506d467c8adb1a30b6aadd8b, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:37.555238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a704468-78be-4636-baff-52395c8c873a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:37.556073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a704468-78be-4636-baff-52395c8c873a admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:37.556359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a704468-78be-4636-baff-52395c8c873a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:37.556641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a704468-78be-4636-baff-52395c8c873a admin admin] PATH_INFO: `/v3/projects/3528a137035e49bb8a9035b651e95df3/users/31cb93aa81eb499ab4266d215851ed2e/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:37.563281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3aa587-cd34-4f03-9e2e-dda14cfd5fba admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:37.590211 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3492/7036] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:37 2022] PUT /identity/v3/projects/990138e948294d348e4c376fcf15b9ce/users/afec276c506d467c8adb1a30b6aadd8b/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:37.600272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a704468-78be-4636-baff-52395c8c873a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3528a137035e49bb8a9035b651e95df3, user_id=31cb93aa81eb499ab4266d215851ed2e, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:37.603604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a704468-78be-4636-baff-52395c8c873a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:37.605797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0e802-982a-48e9-a032-e5c906dec309 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:37.606497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0e802-982a-48e9-a032-e5c906dec309 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:37.606881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0e802-982a-48e9-a032-e5c906dec309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:37.647385 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3545/7037] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:37 2022] PUT /identity/v3/projects/3528a137035e49bb8a9035b651e95df3/users/31cb93aa81eb499ab4266d215851ed2e/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:37.660629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d7ef6-355d-4422-b604-881f1819b4f2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:37.661042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d7ef6-355d-4422-b604-881f1819b4f2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:37.662624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d7ef6-355d-4422-b604-881f1819b4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:37.670899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-33b0e802-982a-48e9-a032-e5c906dec309 None None] MFA Rules not processed for user `afec276c506d467c8adb1a30b6aadd8b`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:37.672267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-33b0e802-982a-48e9-a032-e5c906dec309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:37.697146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d24d7ef6-355d-4422-b604-881f1819b4f2 None None] MFA Rules not processed for user `31cb93aa81eb499ab4266d215851ed2e`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:37.698385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d24d7ef6-355d-4422-b604-881f1819b4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:37.776536 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3493/7038] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:37.789511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0e802-982a-48e9-a032-e5c906dec309 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:37.809087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:37.818395 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3546/7039] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:28:37.825200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d7ef6-355d-4422-b604-881f1819b4f2 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:37.826687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d24d7ef6-355d-4422-b604-881f1819b4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:37.964586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0e802-982a-48e9-a032-e5c906dec309 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:37.970240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26be4c-f819-4df4-b317-2014b69a1a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:37.970998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26be4c-f819-4df4-b317-2014b69a1a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:37.971417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26be4c-f819-4df4-b317-2014b69a1a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:37.971768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26be4c-f819-4df4-b317-2014b69a1a43 admin admin] PATH_INFO: `/v3/users/afec276c506d467c8adb1a30b6aadd8b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:37.973073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26be4c-f819-4df4-b317-2014b69a1a43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afec276c506d467c8adb1a30b6aadd8b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:37.975897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26be4c-f819-4df4-b317-2014b69a1a43 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:37.985287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d7ef6-355d-4422-b604-881f1819b4f2 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:37.992357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398fed0-4199-492a-a1e2-d1063565175b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:37.993560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398fed0-4199-492a-a1e2-d1063565175b service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:37.994053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398fed0-4199-492a-a1e2-d1063565175b service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:37.994556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398fed0-4199-492a-a1e2-d1063565175b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:38.007465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398fed0-4199-492a-a1e2-d1063565175b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:38.009232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398fed0-4199-492a-a1e2-d1063565175b service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:38.037482 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3547/7040] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:28:38.058193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398fed0-4199-492a-a1e2-d1063565175b service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:38.083430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398fed0-4199-492a-a1e2-d1063565175b service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:38.108488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c22c5-c80e-4206-9167-7a11a5768f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:38.109624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c22c5-c80e-4206-9167-7a11a5768f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:38.109913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8c26be4c-f819-4df4-b317-2014b69a1a43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afec276c506d467c8adb1a30b6aadd8b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:38.110831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8c26be4c-f819-4df4-b317-2014b69a1a43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afec276c506d467c8adb1a30b6aadd8b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:38.111642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c22c5-c80e-4206-9167-7a11a5768f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:38.112470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c22c5-c80e-4206-9167-7a11a5768f63 admin admin] PATH_INFO: `/v3/users/31cb93aa81eb499ab4266d215851ed2e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:38.114340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c22c5-c80e-4206-9167-7a11a5768f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31cb93aa81eb499ab4266d215851ed2e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:38.132522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c22c5-c80e-4206-9167-7a11a5768f63 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:38.137865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8c26be4c-f819-4df4-b317-2014b69a1a43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afec276c506d467c8adb1a30b6aadd8b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:38.139890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8c26be4c-f819-4df4-b317-2014b69a1a43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afec276c506d467c8adb1a30b6aadd8b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:38.157562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8c26be4c-f819-4df4-b317-2014b69a1a43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afec276c506d467c8adb1a30b6aadd8b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:38.159415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:38.195822 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3494/7041] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:37 2022] DELETE /identity/v3/users/afec276c506d467c8adb1a30b6aadd8b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:38.201938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7b384-927e-40da-a83e-baab8381df3f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:38.202362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7b384-927e-40da-a83e-baab8381df3f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:38.202646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7b384-927e-40da-a83e-baab8381df3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:38.235910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d4d7b384-927e-40da-a83e-baab8381df3f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:38.238080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d4d7b384-927e-40da-a83e-baab8381df3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:38.277773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3f5c22c5-c80e-4206-9167-7a11a5768f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31cb93aa81eb499ab4266d215851ed2e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:38.303644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3f5c22c5-c80e-4206-9167-7a11a5768f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31cb93aa81eb499ab4266d215851ed2e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:38.305259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3f5c22c5-c80e-4206-9167-7a11a5768f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31cb93aa81eb499ab4266d215851ed2e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:38.320807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3f5c22c5-c80e-4206-9167-7a11a5768f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31cb93aa81eb499ab4266d215851ed2e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:38.324381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3f5c22c5-c80e-4206-9167-7a11a5768f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31cb93aa81eb499ab4266d215851ed2e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:38.370241 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3548/7042] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:38 2022] DELETE /identity/v3/users/31cb93aa81eb499ab4266d215851ed2e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:38.379559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c75e3-f3bb-4c1e-882c-ab76e998626c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:38.380116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c75e3-f3bb-4c1e-882c-ab76e998626c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:38.381063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c75e3-f3bb-4c1e-882c-ab76e998626c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:38.417439 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3495/7043] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:38.433521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-252c75e3-f3bb-4c1e-882c-ab76e998626c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:38.435168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-252c75e3-f3bb-4c1e-882c-ab76e998626c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:38.475927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7b384-927e-40da-a83e-baab8381df3f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:38.478206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d4d7b384-927e-40da-a83e-baab8381df3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:38.533252 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3549/7044] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:28:38.578615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c75e3-f3bb-4c1e-882c-ab76e998626c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:38.580516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-252c75e3-f3bb-4c1e-882c-ab76e998626c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:38.624176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:38.696473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7b384-927e-40da-a83e-baab8381df3f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:38.800374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c75e3-f3bb-4c1e-882c-ab76e998626c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:38.814368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde57a6a-8d47-4cf3-a15b-093d7dde8e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:38.815378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde57a6a-8d47-4cf3-a15b-093d7dde8e0f service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:38.817168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde57a6a-8d47-4cf3-a15b-093d7dde8e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:38.817507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde57a6a-8d47-4cf3-a15b-093d7dde8e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:38.863334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde57a6a-8d47-4cf3-a15b-093d7dde8e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:38.864343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219823d9-a8bd-4c6e-8235-9de1f86a2c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:38.864985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219823d9-a8bd-4c6e-8235-9de1f86a2c2d service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:38.865473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219823d9-a8bd-4c6e-8235-9de1f86a2c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:38.865604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219823d9-a8bd-4c6e-8235-9de1f86a2c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:38.865703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde57a6a-8d47-4cf3-a15b-093d7dde8e0f service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:38.889419 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3550/7045] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:38.895509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219823d9-a8bd-4c6e-8235-9de1f86a2c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:38.899786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219823d9-a8bd-4c6e-8235-9de1f86a2c2d service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:38.939071 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3496/7046] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:28:39.244110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde57a6a-8d47-4cf3-a15b-093d7dde8e0f service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:39.246646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fde57a6a-8d47-4cf3-a15b-093d7dde8e0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:39.362988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde57a6a-8d47-4cf3-a15b-093d7dde8e0f service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:39.367881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26380c-a634-4549-9b0e-22e2cc17d131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:39.368531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26380c-a634-4549-9b0e-22e2cc17d131 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:39.368819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26380c-a634-4549-9b0e-22e2cc17d131 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:39.369902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26380c-a634-4549-9b0e-22e2cc17d131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:39.371418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2c26380c-a634-4549-9b0e-22e2cc17d131 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:39.463185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26380c-a634-4549-9b0e-22e2cc17d131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:39.466550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26380c-a634-4549-9b0e-22e2cc17d131 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:39.480066 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3551/7047] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:40.461821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219823d9-a8bd-4c6e-8235-9de1f86a2c2d service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:40.465224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-219823d9-a8bd-4c6e-8235-9de1f86a2c2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:40.503802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219823d9-a8bd-4c6e-8235-9de1f86a2c2d service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:40.529832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486627a1-9cbf-4bef-ade4-d8643b61a4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:40.530384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26380c-a634-4549-9b0e-22e2cc17d131 service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:40.532106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2c26380c-a634-4549-9b0e-22e2cc17d131 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:40.536632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486627a1-9cbf-4bef-ade4-d8643b61a4c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:40.537703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486627a1-9cbf-4bef-ade4-d8643b61a4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:40.539701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486627a1-9cbf-4bef-ade4-d8643b61a4c3 admin admin] PATH_INFO: `/v3/projects/3528a137035e49bb8a9035b651e95df3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:40.552003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486627a1-9cbf-4bef-ade4-d8643b61a4c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3528a137035e49bb8a9035b651e95df3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:40.567879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26380c-a634-4549-9b0e-22e2cc17d131 service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:40.577455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486627a1-9cbf-4bef-ade4-d8643b61a4c3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:40.588742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace536e2-3ffb-41fb-a316-406f82f96e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:40.590622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace536e2-3ffb-41fb-a316-406f82f96e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:40.591160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace536e2-3ffb-41fb-a316-406f82f96e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:40.592544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace536e2-3ffb-41fb-a316-406f82f96e3e admin admin] PATH_INFO: `/v3/projects/990138e948294d348e4c376fcf15b9ce` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:40.594680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace536e2-3ffb-41fb-a316-406f82f96e3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=990138e948294d348e4c376fcf15b9ce)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:40.600413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace536e2-3ffb-41fb-a316-406f82f96e3e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:40.744086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ace536e2-3ffb-41fb-a316-406f82f96e3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '990138e948294d348e4c376fcf15b9ce', 'request_id': 'req-ace536e2-3ffb-41fb-a316-406f82f96e3e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:40.780722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:40.784153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ace536e2-3ffb-41fb-a316-406f82f96e3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '990138e948294d348e4c376fcf15b9ce', 'request_id': 'req-ace536e2-3ffb-41fb-a316-406f82f96e3e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:40.797860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-486627a1-9cbf-4bef-ade4-d8643b61a4c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3528a137035e49bb8a9035b651e95df3', 'request_id': 'req-486627a1-9cbf-4bef-ade4-d8643b61a4c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:40.809217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ace536e2-3ffb-41fb-a316-406f82f96e3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '990138e948294d348e4c376fcf15b9ce', 'request_id': 'req-ace536e2-3ffb-41fb-a316-406f82f96e3e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:40.813458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:40.828542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-486627a1-9cbf-4bef-ade4-d8643b61a4c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3528a137035e49bb8a9035b651e95df3', 'request_id': 'req-486627a1-9cbf-4bef-ade4-d8643b61a4c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:40.830250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ace536e2-3ffb-41fb-a316-406f82f96e3e admin admin] The token cache is being invalidate because project 990138e948294d348e4c376fcf15b9ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:40.832121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ace536e2-3ffb-41fb-a316-406f82f96e3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:40.834079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ace536e2-3ffb-41fb-a316-406f82f96e3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:40.842653 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3552/7048] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:40 2022] DELETE /identity/v3/projects/990138e948294d348e4c376fcf15b9ce => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:28:40.844048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-486627a1-9cbf-4bef-ade4-d8643b61a4c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3528a137035e49bb8a9035b651e95df3', 'request_id': 'req-486627a1-9cbf-4bef-ade4-d8643b61a4c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:40.860970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ada65-0b1a-45d9-8080-04fa8eba7f4b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:40.861842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ada65-0b1a-45d9-8080-04fa8eba7f4b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:40.866667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ada65-0b1a-45d9-8080-04fa8eba7f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:40.910981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-486627a1-9cbf-4bef-ade4-d8643b61a4c3 admin admin] The token cache is being invalidate because project 3528a137035e49bb8a9035b651e95df3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:40.911261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-486627a1-9cbf-4bef-ade4-d8643b61a4c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:40.913315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-486627a1-9cbf-4bef-ade4-d8643b61a4c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:40.921953 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3497/7049] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:40 2022] DELETE /identity/v3/projects/3528a137035e49bb8a9035b651e95df3 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:40.928371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-922ada65-0b1a-45d9-8080-04fa8eba7f4b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:40.930465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-922ada65-0b1a-45d9-8080-04fa8eba7f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:40.933415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea107a88-5ca4-4fb0-a6fb-e4c2269c4aa5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:40.934721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea107a88-5ca4-4fb0-a6fb-e4c2269c4aa5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:40.934937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea107a88-5ca4-4fb0-a6fb-e4c2269c4aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:41.026627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ea107a88-5ca4-4fb0-a6fb-e4c2269c4aa5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:41.027884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ea107a88-5ca4-4fb0-a6fb-e4c2269c4aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:41.084690 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3553/7050] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:41.095060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80d481-cee9-4d6b-9cbf-9c04051d8583 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:41.095060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80d481-cee9-4d6b-9cbf-9c04051d8583 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:41.095378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80d481-cee9-4d6b-9cbf-9c04051d8583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:41.121910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4e80d481-cee9-4d6b-9cbf-9c04051d8583 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:41.123980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4e80d481-cee9-4d6b-9cbf-9c04051d8583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:41.138539 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3554/7051] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:41.140342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80d481-cee9-4d6b-9cbf-9c04051d8583 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:41.161905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80d481-cee9-4d6b-9cbf-9c04051d8583 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:41.174019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc097799-a8c0-4fe2-8c4f-291bfe543b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:41.174672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc097799-a8c0-4fe2-8c4f-291bfe543b10 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:41.175990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc097799-a8c0-4fe2-8c4f-291bfe543b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:41.176665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc097799-a8c0-4fe2-8c4f-291bfe543b10 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:41.181457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc097799-a8c0-4fe2-8c4f-291bfe543b10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:41.181457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc097799-a8c0-4fe2-8c4f-291bfe543b10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:41.184133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc097799-a8c0-4fe2-8c4f-291bfe543b10 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:41.226751 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3555/7052] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:41.228161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc097799-a8c0-4fe2-8c4f-291bfe543b10 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:41.262328 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3498/7053] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:41.263930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af408a7c-4158-4ba5-9cdf-739a405d6b70 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:41.264223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af408a7c-4158-4ba5-9cdf-739a405d6b70 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:41.264496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af408a7c-4158-4ba5-9cdf-739a405d6b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:41.266454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc097799-a8c0-4fe2-8c4f-291bfe543b10 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:41.285910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a0aed-766b-4412-b45b-5e0e480e137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:41.286560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a0aed-766b-4412-b45b-5e0e480e137f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:41.286848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a0aed-766b-4412-b45b-5e0e480e137f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:41.287128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a0aed-766b-4412-b45b-5e0e480e137f admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:41.293862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a0aed-766b-4412-b45b-5e0e480e137f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:41.305242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a0aed-766b-4412-b45b-5e0e480e137f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:41.314353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-af408a7c-4158-4ba5-9cdf-739a405d6b70 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:41.321859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-af408a7c-4158-4ba5-9cdf-739a405d6b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:41.349276 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3499/7054] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:28:41.350417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af408a7c-4158-4ba5-9cdf-739a405d6b70 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:41.367373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af408a7c-4158-4ba5-9cdf-739a405d6b70 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:41.375266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23dc3a-6ded-417c-b709-7ad2970caf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:41.377145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23dc3a-6ded-417c-b709-7ad2970caf9f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:41.377504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23dc3a-6ded-417c-b709-7ad2970caf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:41.377787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23dc3a-6ded-417c-b709-7ad2970caf9f admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:41.378615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23dc3a-6ded-417c-b709-7ad2970caf9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:41.378907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23dc3a-6ded-417c-b709-7ad2970caf9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:41.381299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23dc3a-6ded-417c-b709-7ad2970caf9f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:41.401086 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3556/7055] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:41 2022] POST /identity/v3/projects => generated 357 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:41.407057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a0aed-766b-4412-b45b-5e0e480e137f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:41.407596 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3500/7056] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:41.408569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23dc3a-6ded-417c-b709-7ad2970caf9f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:41.423038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23dc3a-6ded-417c-b709-7ad2970caf9f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:41.605174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc482e-1d6b-4a38-9c8a-3882d4af1d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:41.608506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc482e-1d6b-4a38-9c8a-3882d4af1d6b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:41.609223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc482e-1d6b-4a38-9c8a-3882d4af1d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:41.609881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc482e-1d6b-4a38-9c8a-3882d4af1d6b admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:41.615644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc482e-1d6b-4a38-9c8a-3882d4af1d6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:41.618485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc482e-1d6b-4a38-9c8a-3882d4af1d6b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:41.629790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a0aed-766b-4412-b45b-5e0e480e137f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:41.646255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37cc282-bcbf-4543-b6ff-e2de17dcfe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:41.647401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cc282-bcbf-4543-b6ff-e2de17dcfe67 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:41.647698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cc282-bcbf-4543-b6ff-e2de17dcfe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:41.647982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cc282-bcbf-4543-b6ff-e2de17dcfe67 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:41.648669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37cc282-bcbf-4543-b6ff-e2de17dcfe67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:41.650645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37cc282-bcbf-4543-b6ff-e2de17dcfe67 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:41.705347 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3501/7057] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:41 2022] POST /identity/v3/projects => generated 375 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:41.706273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc482e-1d6b-4a38-9c8a-3882d4af1d6b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:41.706607 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3557/7058] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:41 2022] POST /identity/v3/users => generated 279 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:41.712106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37cc282-bcbf-4543-b6ff-e2de17dcfe67 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:41.762821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37cc282-bcbf-4543-b6ff-e2de17dcfe67 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:41.813726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:41.894861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:41.899605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc482e-1d6b-4a38-9c8a-3882d4af1d6b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:41.912010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d378e02-8ff8-4d6c-95dd-8fe505ebf53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:41.912977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d378e02-8ff8-4d6c-95dd-8fe505ebf53b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:41.913523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d378e02-8ff8-4d6c-95dd-8fe505ebf53b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:41.915651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d378e02-8ff8-4d6c-95dd-8fe505ebf53b admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:41.917192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d378e02-8ff8-4d6c-95dd-8fe505ebf53b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:41.921378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d378e02-8ff8-4d6c-95dd-8fe505ebf53b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:41.953086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8eb90a-9e12-4583-b479-93a0a0714b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:41.954658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eb90a-9e12-4583-b479-93a0a0714b03 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:41.956710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eb90a-9e12-4583-b479-93a0a0714b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:41.958547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eb90a-9e12-4583-b479-93a0a0714b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:41.962102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8eb90a-9e12-4583-b479-93a0a0714b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:41.967118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8eb90a-9e12-4583-b479-93a0a0714b03 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:41.978308 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3502/7059] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:41 2022] POST /identity/v3/users => generated 288 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:41.986019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d378e02-8ff8-4d6c-95dd-8fe505ebf53b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:41.994079 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3558/7060] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:41.998823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8eb90a-9e12-4583-b479-93a0a0714b03 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:42.017485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8eb90a-9e12-4583-b479-93a0a0714b03 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:42.024298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d378e02-8ff8-4d6c-95dd-8fe505ebf53b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:42.025701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4e4f3-1589-4275-908d-8d917420aa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:42.027365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4e4f3-1589-4275-908d-8d917420aa57 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:42.027913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4e4f3-1589-4275-908d-8d917420aa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:42.028427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4e4f3-1589-4275-908d-8d917420aa57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:42.029623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4e4f3-1589-4275-908d-8d917420aa57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:42.031544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4e4f3-1589-4275-908d-8d917420aa57 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:42.039495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c804f-2e3e-49b1-8cbd-b69c3124e43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:42.040290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c804f-2e3e-49b1-8cbd-b69c3124e43d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:42.040584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c804f-2e3e-49b1-8cbd-b69c3124e43d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:42.040864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c804f-2e3e-49b1-8cbd-b69c3124e43d admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:42.042305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c804f-2e3e-49b1-8cbd-b69c3124e43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:42.047250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c804f-2e3e-49b1-8cbd-b69c3124e43d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:42.066051 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3559/7061] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:42.070590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4e4f3-1589-4275-908d-8d917420aa57 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:42.091744 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3503/7062] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:42.093617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c804f-2e3e-49b1-8cbd-b69c3124e43d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:42.094049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4e4f3-1589-4275-908d-8d917420aa57 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:42.110343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c651e-0d9e-4d13-8b09-1efae41ebf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:42.113568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c651e-0d9e-4d13-8b09-1efae41ebf6e admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:42.113977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c651e-0d9e-4d13-8b09-1efae41ebf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:42.115222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c651e-0d9e-4d13-8b09-1efae41ebf6e admin admin] PATH_INFO: `/v3/projects/de6ac419377e4867a45a586cae6cdce1/users/93c0ec1f3629465294c385253f70caed/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:42.117303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c804f-2e3e-49b1-8cbd-b69c3124e43d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:42.124770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a9a87-24f1-48da-9bbd-e7aca07ceb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:42.125882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a9a87-24f1-48da-9bbd-e7aca07ceb05 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:42.126356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a9a87-24f1-48da-9bbd-e7aca07ceb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:42.127552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a9a87-24f1-48da-9bbd-e7aca07ceb05 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:42.128531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a9a87-24f1-48da-9bbd-e7aca07ceb05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:42.152178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a9a87-24f1-48da-9bbd-e7aca07ceb05 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:42.162885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c651e-0d9e-4d13-8b09-1efae41ebf6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de6ac419377e4867a45a586cae6cdce1, user_id=93c0ec1f3629465294c385253f70caed, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:42.172756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c651e-0d9e-4d13-8b09-1efae41ebf6e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:42.186188 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3504/7063] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:42.194216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a9a87-24f1-48da-9bbd-e7aca07ceb05 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:42.213553 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3560/7064] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:42 2022] PUT /identity/v3/projects/de6ac419377e4867a45a586cae6cdce1/users/93c0ec1f3629465294c385253f70caed/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:42.224959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d87e61-3eff-474e-adfe-868c2d7ee900 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:42.225328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d87e61-3eff-474e-adfe-868c2d7ee900 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:42.225531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d87e61-3eff-474e-adfe-868c2d7ee900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:42.225635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a9a87-24f1-48da-9bbd-e7aca07ceb05 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:42.265644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-63d87e61-3eff-474e-adfe-868c2d7ee900 None None] MFA Rules not processed for user `93c0ec1f3629465294c385253f70caed`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:42.268699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-63d87e61-3eff-474e-adfe-868c2d7ee900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:42.382592 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3561/7065] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:42 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:42.388959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d87e61-3eff-474e-adfe-868c2d7ee900 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:42.395602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52953c4-f17f-43d9-8caf-ffed68a8edc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:42.396391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52953c4-f17f-43d9-8caf-ffed68a8edc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:42.396746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52953c4-f17f-43d9-8caf-ffed68a8edc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:42.397043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52953c4-f17f-43d9-8caf-ffed68a8edc5 admin admin] PATH_INFO: `/v3/projects/a1833a6aa44b4d72bc3c3bd2cc061645/users/028bc898819246e481a3f7fb20195f99/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:42.432694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52953c4-f17f-43d9-8caf-ffed68a8edc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1833a6aa44b4d72bc3c3bd2cc061645, user_id=028bc898819246e481a3f7fb20195f99, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:42.436347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52953c4-f17f-43d9-8caf-ffed68a8edc5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:42.472178 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3505/7066] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:42 2022] PUT /identity/v3/projects/a1833a6aa44b4d72bc3c3bd2cc061645/users/028bc898819246e481a3f7fb20195f99/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:42.483238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4bc0c-8ae6-4a5c-95df-e3cc61e3adbd None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:42.483592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4bc0c-8ae6-4a5c-95df-e3cc61e3adbd None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:42.483866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4bc0c-8ae6-4a5c-95df-e3cc61e3adbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:42.558478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d87e61-3eff-474e-adfe-868c2d7ee900 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:42.566357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c4c4bc0c-8ae6-4a5c-95df-e3cc61e3adbd None None] MFA Rules not processed for user `028bc898819246e481a3f7fb20195f99`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:42.568502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c4c4bc0c-8ae6-4a5c-95df-e3cc61e3adbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:42.689210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:42.700018 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3506/7067] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:28:42.713013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4bc0c-8ae6-4a5c-95df-e3cc61e3adbd None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:42.715324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c4c4bc0c-8ae6-4a5c-95df-e3cc61e3adbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:42.727417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012823be-0d0f-47c8-a255-3b72afa47631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:42.728917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012823be-0d0f-47c8-a255-3b72afa47631 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:42.729090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012823be-0d0f-47c8-a255-3b72afa47631 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:42.729371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012823be-0d0f-47c8-a255-3b72afa47631 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:42.730048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012823be-0d0f-47c8-a255-3b72afa47631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:42.735877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012823be-0d0f-47c8-a255-3b72afa47631 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:42.755438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:42.806273 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3562/7068] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:42 2022] POST /identity/v3/projects => generated 355 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:42.809560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012823be-0d0f-47c8-a255-3b72afa47631 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:42.927383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4bc0c-8ae6-4a5c-95df-e3cc61e3adbd None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:42.987081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012823be-0d0f-47c8-a255-3b72afa47631 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:43.021466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e10ff-2259-41da-afae-7718dfc929f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:43.022673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e10ff-2259-41da-afae-7718dfc929f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:43.023150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e10ff-2259-41da-afae-7718dfc929f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:43.023765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e10ff-2259-41da-afae-7718dfc929f1 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:43.024662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e10ff-2259-41da-afae-7718dfc929f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:43.026700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e10ff-2259-41da-afae-7718dfc929f1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:43.074051 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3563/7069] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:42 2022] POST /identity/v3/users => generated 284 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:43.089754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e10ff-2259-41da-afae-7718dfc929f1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:43.121928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e10ff-2259-41da-afae-7718dfc929f1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:43.132889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c0e3e-69e3-4169-86b1-91e4f4b72d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:43.133556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c0e3e-69e3-4169-86b1-91e4f4b72d74 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:43.134240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c0e3e-69e3-4169-86b1-91e4f4b72d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:43.134532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c0e3e-69e3-4169-86b1-91e4f4b72d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:43.135447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c0e3e-69e3-4169-86b1-91e4f4b72d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:43.137126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c0e3e-69e3-4169-86b1-91e4f4b72d74 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:43.157641 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3564/7070] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:43.160142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c0e3e-69e3-4169-86b1-91e4f4b72d74 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:43.172025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302b2d8-ecdc-4af3-8c4f-4ced873ad5ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:43.173096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302b2d8-ecdc-4af3-8c4f-4ced873ad5ef service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:43.173624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302b2d8-ecdc-4af3-8c4f-4ced873ad5ef service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:43.174690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302b2d8-ecdc-4af3-8c4f-4ced873ad5ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:43.181939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c0e3e-69e3-4169-86b1-91e4f4b72d74 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:43.200498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012fcd7-9117-4f42-9cd8-c61f9af2208c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:43.201996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012fcd7-9117-4f42-9cd8-c61f9af2208c admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:43.202294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012fcd7-9117-4f42-9cd8-c61f9af2208c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:43.202575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012fcd7-9117-4f42-9cd8-c61f9af2208c admin admin] PATH_INFO: `/v3/projects/2bbf0b54b9be410f9df524561376ecb9/users/0c9791bc8eff4430aaa8edbe49d7eb0f/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:43.241343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012fcd7-9117-4f42-9cd8-c61f9af2208c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bbf0b54b9be410f9df524561376ecb9, user_id=0c9791bc8eff4430aaa8edbe49d7eb0f, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:43.244510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012fcd7-9117-4f42-9cd8-c61f9af2208c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:43.280084 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3565/7071] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:43 2022] PUT /identity/v3/projects/2bbf0b54b9be410f9df524561376ecb9/users/0c9791bc8eff4430aaa8edbe49d7eb0f/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:43.286594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012fcd7-9117-4f42-9cd8-c61f9af2208c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:43.303372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302b2d8-ecdc-4af3-8c4f-4ced873ad5ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:43.306815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302b2d8-ecdc-4af3-8c4f-4ced873ad5ef service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:43.329620 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3507/7072] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:28:43.390016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302b2d8-ecdc-4af3-8c4f-4ced873ad5ef service glance] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:43.392137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d302b2d8-ecdc-4af3-8c4f-4ced873ad5ef service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:43.467207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302b2d8-ecdc-4af3-8c4f-4ced873ad5ef service glance] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:43.521427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012fcd7-9117-4f42-9cd8-c61f9af2208c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:43.545644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f5cf4-e4e4-4d20-85d8-981ff5432914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:43.550030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f5cf4-e4e4-4d20-85d8-981ff5432914 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:43.551238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f5cf4-e4e4-4d20-85d8-981ff5432914 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:43.566617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f5cf4-e4e4-4d20-85d8-981ff5432914 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:43.567476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f5cf4-e4e4-4d20-85d8-981ff5432914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:43.569132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f5cf4-e4e4-4d20-85d8-981ff5432914 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:43.600661 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3566/7073] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:43.602735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f5cf4-e4e4-4d20-85d8-981ff5432914 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:43.633705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f5cf4-e4e4-4d20-85d8-981ff5432914 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:43.646253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490b73e-73bc-4417-8639-8a575b1c0497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:43.647181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490b73e-73bc-4417-8639-8a575b1c0497 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:43.647493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490b73e-73bc-4417-8639-8a575b1c0497 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:43.647932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490b73e-73bc-4417-8639-8a575b1c0497 admin admin] PATH_INFO: `/v3/projects/2bbf0b54b9be410f9df524561376ecb9/users/0c9791bc8eff4430aaa8edbe49d7eb0f/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:43.655834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490b73e-73bc-4417-8639-8a575b1c0497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bbf0b54b9be410f9df524561376ecb9, user_id=0c9791bc8eff4430aaa8edbe49d7eb0f, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:43.665898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490b73e-73bc-4417-8639-8a575b1c0497 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:43.679473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:43.691023 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3567/7074] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:43 2022] PUT /identity/v3/projects/2bbf0b54b9be410f9df524561376ecb9/users/0c9791bc8eff4430aaa8edbe49d7eb0f/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:43.705190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486180e-1965-4aa0-92c4-cf2e27cf55d7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:43.705484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486180e-1965-4aa0-92c4-cf2e27cf55d7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:43.705761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486180e-1965-4aa0-92c4-cf2e27cf55d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:43.711096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817fdaf-3dfc-4f77-85ce-89718501115c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:43.715857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817fdaf-3dfc-4f77-85ce-89718501115c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:43.716157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817fdaf-3dfc-4f77-85ce-89718501115c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:43.716482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817fdaf-3dfc-4f77-85ce-89718501115c admin admin] PATH_INFO: `/v3/users/54a4d2bd69f449288b49186d9f06d75f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:43.718867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817fdaf-3dfc-4f77-85ce-89718501115c admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a4d2bd69f449288b49186d9f06d75f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:43.720846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817fdaf-3dfc-4f77-85ce-89718501115c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:43.746003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c486180e-1965-4aa0-92c4-cf2e27cf55d7 None None] MFA Rules not processed for user `0c9791bc8eff4430aaa8edbe49d7eb0f`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:43.747511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c486180e-1965-4aa0-92c4-cf2e27cf55d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:43.817669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:43.841751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9817fdaf-3dfc-4f77-85ce-89718501115c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a4d2bd69f449288b49186d9f06d75f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:43.843383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9817fdaf-3dfc-4f77-85ce-89718501115c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a4d2bd69f449288b49186d9f06d75f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:43.874227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9817fdaf-3dfc-4f77-85ce-89718501115c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a4d2bd69f449288b49186d9f06d75f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:43.875797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9817fdaf-3dfc-4f77-85ce-89718501115c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a4d2bd69f449288b49186d9f06d75f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:43.886120 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3568/7075] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:43 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:43.891412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486180e-1965-4aa0-92c4-cf2e27cf55d7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:43.891644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9817fdaf-3dfc-4f77-85ce-89718501115c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a4d2bd69f449288b49186d9f06d75f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:43.913674 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3508/7076] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:43 2022] DELETE /identity/v3/users/54a4d2bd69f449288b49186d9f06d75f => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:43.915832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486180e-1965-4aa0-92c4-cf2e27cf55d7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:43.916289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc8c1e-e767-41c8-afd4-582d59831c21 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:43.917074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc8c1e-e767-41c8-afd4-582d59831c21 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:43.917074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc8c1e-e767-41c8-afd4-582d59831c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:43.946127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e5fc8c1e-e767-41c8-afd4-582d59831c21 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:43.947979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e5fc8c1e-e767-41c8-afd4-582d59831c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:44.071225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967c6c2-0b96-417e-979d-92cf6de8f17d tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c9791bc8eff4430aaa8edbe49d7eb0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bbf0b54b9be410f9df524561376ecb9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:44.072309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967c6c2-0b96-417e-979d-92cf6de8f17d tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:44.072773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967c6c2-0b96-417e-979d-92cf6de8f17d tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:44.073192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967c6c2-0b96-417e-979d-92cf6de8f17d tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:44.074222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967c6c2-0b96-417e-979d-92cf6de8f17d tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:44.074628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967c6c2-0b96-417e-979d-92cf6de8f17d tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:44.077140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967c6c2-0b96-417e-979d-92cf6de8f17d tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:44.094710 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3569/7077] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:44.098880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967c6c2-0b96-417e-979d-92cf6de8f17d tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:44.104336 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3509/7078] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:44.105344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc8c1e-e767-41c8-afd4-582d59831c21 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:44.108433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e5fc8c1e-e767-41c8-afd4-582d59831c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:44.113718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967c6c2-0b96-417e-979d-92cf6de8f17d tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:44.133319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506de6c-394a-4db0-82d8-0845b5b3c4a3 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c9791bc8eff4430aaa8edbe49d7eb0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bbf0b54b9be410f9df524561376ecb9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:44.134576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506de6c-394a-4db0-82d8-0845b5b3c4a3 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:44.135051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506de6c-394a-4db0-82d8-0845b5b3c4a3 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:44.135661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506de6c-394a-4db0-82d8-0845b5b3c4a3 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:44.136590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506de6c-394a-4db0-82d8-0845b5b3c4a3 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:44.144518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506de6c-394a-4db0-82d8-0845b5b3c4a3 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:44.227980 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3570/7079] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:44 2022] POST /identity/v3/projects => generated 349 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:44.231152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506de6c-394a-4db0-82d8-0845b5b3c4a3 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:44.296815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc8c1e-e767-41c8-afd4-582d59831c21 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:44.321352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:44.324591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506de6c-394a-4db0-82d8-0845b5b3c4a3 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:44.332275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05232d-ae5a-4b6e-80a1-8c6b6e2cf391 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c9791bc8eff4430aaa8edbe49d7eb0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bbf0b54b9be410f9df524561376ecb9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:44.333162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05232d-ae5a-4b6e-80a1-8c6b6e2cf391 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:44.333454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05232d-ae5a-4b6e-80a1-8c6b6e2cf391 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:44.333829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05232d-ae5a-4b6e-80a1-8c6b6e2cf391 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:44.335072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05232d-ae5a-4b6e-80a1-8c6b6e2cf391 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:44.335717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05232d-ae5a-4b6e-80a1-8c6b6e2cf391 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:44.338104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05232d-ae5a-4b6e-80a1-8c6b6e2cf391 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:44.358779 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3571/7080] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:44.367141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05232d-ae5a-4b6e-80a1-8c6b6e2cf391 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:44.369128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0f05232d-ae5a-4b6e-80a1-8c6b6e2cf391 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:44.397194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9ed07-b1a1-4139-85be-64a8d26a982d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:44.397786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9ed07-b1a1-4139-85be-64a8d26a982d service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:44.398078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9ed07-b1a1-4139-85be-64a8d26a982d service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:44.398358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9ed07-b1a1-4139-85be-64a8d26a982d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:44.419527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:44.469279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05232d-ae5a-4b6e-80a1-8c6b6e2cf391 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:44.474136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18663e-e7ad-4f20-8a7d-5d761099b393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:44.474946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18663e-e7ad-4f20-8a7d-5d761099b393 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:44.475372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18663e-e7ad-4f20-8a7d-5d761099b393 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:44.475670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18663e-e7ad-4f20-8a7d-5d761099b393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:44.490898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18663e-e7ad-4f20-8a7d-5d761099b393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:44.490898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18663e-e7ad-4f20-8a7d-5d761099b393 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:44.500213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9ed07-b1a1-4139-85be-64a8d26a982d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:44.502505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9ed07-b1a1-4139-85be-64a8d26a982d service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:44.503318 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3572/7081] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:44 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:28:44.519762 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3510/7082] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:45.049879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18663e-e7ad-4f20-8a7d-5d761099b393 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:45.061251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18663e-e7ad-4f20-8a7d-5d761099b393 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:45.067083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa2017-3b40-44ba-a4fc-ffc32fcda480 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c9791bc8eff4430aaa8edbe49d7eb0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bbf0b54b9be410f9df524561376ecb9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:45.069079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa2017-3b40-44ba-a4fc-ffc32fcda480 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:45.070172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa2017-3b40-44ba-a4fc-ffc32fcda480 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:45.070674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa2017-3b40-44ba-a4fc-ffc32fcda480 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] PATH_INFO: `/v3/projects/94c28e6be655498399446306875a18d6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:45.072299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa2017-3b40-44ba-a4fc-ffc32fcda480 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] RBAC: Authorizing `identity:delete_project(project_id=94c28e6be655498399446306875a18d6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:45.074648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa2017-3b40-44ba-a4fc-ffc32fcda480 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:45.145994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9cfa2017-3b40-44ba-a4fc-ffc32fcda480 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94c28e6be655498399446306875a18d6', 'request_id': 'req-9cfa2017-3b40-44ba-a4fc-ffc32fcda480'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:45.148309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9cfa2017-3b40-44ba-a4fc-ffc32fcda480 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94c28e6be655498399446306875a18d6', 'request_id': 'req-9cfa2017-3b40-44ba-a4fc-ffc32fcda480'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:45.161771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9cfa2017-3b40-44ba-a4fc-ffc32fcda480 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94c28e6be655498399446306875a18d6', 'request_id': 'req-9cfa2017-3b40-44ba-a4fc-ffc32fcda480'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:45.176790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9cfa2017-3b40-44ba-a4fc-ffc32fcda480 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] The token cache is being invalidate because project 94c28e6be655498399446306875a18d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:45.177091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9cfa2017-3b40-44ba-a4fc-ffc32fcda480 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:45.179456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9cfa2017-3b40-44ba-a4fc-ffc32fcda480 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:45.184662 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3573/7083] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:45 2022] DELETE /identity/v3/projects/94c28e6be655498399446306875a18d6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:45.534329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9ed07-b1a1-4139-85be-64a8d26a982d service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:45.535848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-75d9ed07-b1a1-4139-85be-64a8d26a982d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:45.557050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9ed07-b1a1-4139-85be-64a8d26a982d service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:45.652952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b89b9-dc57-4411-a259-b117d1517e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:45.653628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b89b9-dc57-4411-a259-b117d1517e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:45.654448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b89b9-dc57-4411-a259-b117d1517e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:45.654727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b89b9-dc57-4411-a259-b117d1517e08 admin admin] PATH_INFO: `/v3/projects/89085b5a4bd54636966a2c9e1a2a4ca8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:45.655961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b89b9-dc57-4411-a259-b117d1517e08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89085b5a4bd54636966a2c9e1a2a4ca8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:45.669395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b89b9-dc57-4411-a259-b117d1517e08 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:45.747374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-567b89b9-dc57-4411-a259-b117d1517e08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89085b5a4bd54636966a2c9e1a2a4ca8', 'request_id': 'req-567b89b9-dc57-4411-a259-b117d1517e08'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:45.759098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-567b89b9-dc57-4411-a259-b117d1517e08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89085b5a4bd54636966a2c9e1a2a4ca8', 'request_id': 'req-567b89b9-dc57-4411-a259-b117d1517e08'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:45.768646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-567b89b9-dc57-4411-a259-b117d1517e08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89085b5a4bd54636966a2c9e1a2a4ca8', 'request_id': 'req-567b89b9-dc57-4411-a259-b117d1517e08'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:45.784306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-567b89b9-dc57-4411-a259-b117d1517e08 admin admin] The token cache is being invalidate because project 89085b5a4bd54636966a2c9e1a2a4ca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:45.784762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-567b89b9-dc57-4411-a259-b117d1517e08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:45.785562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-567b89b9-dc57-4411-a259-b117d1517e08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:45.791754 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3511/7084] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:45 2022] DELETE /identity/v3/projects/89085b5a4bd54636966a2c9e1a2a4ca8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:45.792242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa2017-3b40-44ba-a4fc-ffc32fcda480 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:45.793704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9cfa2017-3b40-44ba-a4fc-ffc32fcda480 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:45.816867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa2017-3b40-44ba-a4fc-ffc32fcda480 tempest-QuotasTest-338994132 tempest-QuotasTest-338994132-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:45.952843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45ae57-3c24-463d-aa34-d8abb8b4ec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:45.953791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45ae57-3c24-463d-aa34-d8abb8b4ec7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:45.954399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45ae57-3c24-463d-aa34-d8abb8b4ec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:45.954684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45ae57-3c24-463d-aa34-d8abb8b4ec7d admin admin] PATH_INFO: `/v3/users/a879bfedf5c34538a2716e8272b48ee6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:45.956054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45ae57-3c24-463d-aa34-d8abb8b4ec7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a879bfedf5c34538a2716e8272b48ee6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:45.960738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45ae57-3c24-463d-aa34-d8abb8b4ec7d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:46.035262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:46.100065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9b45ae57-3c24-463d-aa34-d8abb8b4ec7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a879bfedf5c34538a2716e8272b48ee6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:46.120364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9b45ae57-3c24-463d-aa34-d8abb8b4ec7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a879bfedf5c34538a2716e8272b48ee6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:46.121176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9b45ae57-3c24-463d-aa34-d8abb8b4ec7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a879bfedf5c34538a2716e8272b48ee6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:46.145643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9b45ae57-3c24-463d-aa34-d8abb8b4ec7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a879bfedf5c34538a2716e8272b48ee6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:46.146541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9b45ae57-3c24-463d-aa34-d8abb8b4ec7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a879bfedf5c34538a2716e8272b48ee6'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:46.162018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b89b9-dc57-4411-a259-b117d1517e08 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:46.165990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-567b89b9-dc57-4411-a259-b117d1517e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:46.182581 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3574/7085] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:45 2022] DELETE /identity/v3/users/a879bfedf5c34538a2716e8272b48ee6 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:46.196658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b89b9-dc57-4411-a259-b117d1517e08 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:46.312561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:46.357591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5c6cb-f2bb-46e2-80d5-8a6bce70405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:46.358388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5c6cb-f2bb-46e2-80d5-8a6bce70405e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:46.358674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5c6cb-f2bb-46e2-80d5-8a6bce70405e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:46.360637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5c6cb-f2bb-46e2-80d5-8a6bce70405e admin admin] PATH_INFO: `/v3/users/93c0ec1f3629465294c385253f70caed` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:46.366902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5c6cb-f2bb-46e2-80d5-8a6bce70405e admin admin] RBAC: Authorizing `identity:delete_user(user_id=93c0ec1f3629465294c385253f70caed)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:46.368972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5c6cb-f2bb-46e2-80d5-8a6bce70405e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:46.484757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-32a5c6cb-f2bb-46e2-80d5-8a6bce70405e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93c0ec1f3629465294c385253f70caed'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:46.485297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-32a5c6cb-f2bb-46e2-80d5-8a6bce70405e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93c0ec1f3629465294c385253f70caed'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:46.516595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-32a5c6cb-f2bb-46e2-80d5-8a6bce70405e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93c0ec1f3629465294c385253f70caed'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:46.519262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-32a5c6cb-f2bb-46e2-80d5-8a6bce70405e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93c0ec1f3629465294c385253f70caed'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:46.548104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-32a5c6cb-f2bb-46e2-80d5-8a6bce70405e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93c0ec1f3629465294c385253f70caed'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:46.576380 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3512/7086] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:46 2022] DELETE /identity/v3/users/93c0ec1f3629465294c385253f70caed => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:28:46.580883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd94bc-01f6-4889-bfd6-81b0d74202a3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:46.581195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd94bc-01f6-4889-bfd6-81b0d74202a3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:46.581482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd94bc-01f6-4889-bfd6-81b0d74202a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:46.621604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a6bd94bc-01f6-4889-bfd6-81b0d74202a3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:46.623584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a6bd94bc-01f6-4889-bfd6-81b0d74202a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:46.758013 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3575/7087] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:46.789945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5c6cb-f2bb-46e2-80d5-8a6bce70405e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:46.799082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-32a5c6cb-f2bb-46e2-80d5-8a6bce70405e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:46.927328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5c6cb-f2bb-46e2-80d5-8a6bce70405e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:46.932074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8bad8-27f7-4c4a-a432-020eaecce0ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:46.933033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8bad8-27f7-4c4a-a432-020eaecce0ce service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:46.933645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8bad8-27f7-4c4a-a432-020eaecce0ce service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:46.934917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8bad8-27f7-4c4a-a432-020eaecce0ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:46.950123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8bad8-27f7-4c4a-a432-020eaecce0ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:46.952287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8bad8-27f7-4c4a-a432-020eaecce0ce service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:46.975664 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3513/7088] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:47.384046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd94bc-01f6-4889-bfd6-81b0d74202a3 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:47.386174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a6bd94bc-01f6-4889-bfd6-81b0d74202a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:47.395105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8bad8-27f7-4c4a-a432-020eaecce0ce service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:47.396719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-84e8bad8-27f7-4c4a-a432-020eaecce0ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:47.435775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8bad8-27f7-4c4a-a432-020eaecce0ce service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:47.435900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd94bc-01f6-4889-bfd6-81b0d74202a3 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:47.442605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d88a9c-6f3b-4eff-bb4b-f25248c64bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:47.443151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d88a9c-6f3b-4eff-bb4b-f25248c64bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:47.443474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d88a9c-6f3b-4eff-bb4b-f25248c64bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:47.443762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d88a9c-6f3b-4eff-bb4b-f25248c64bcc admin admin] PATH_INFO: `/v3/projects/de6ac419377e4867a45a586cae6cdce1` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:47.444988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d88a9c-6f3b-4eff-bb4b-f25248c64bcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=de6ac419377e4867a45a586cae6cdce1)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:47.447644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d88a9c-6f3b-4eff-bb4b-f25248c64bcc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:47.449476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4c139-5274-4f4f-ac92-c31aa0fec3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:47.460563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4c139-5274-4f4f-ac92-c31aa0fec3e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:47.461740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4c139-5274-4f4f-ac92-c31aa0fec3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:47.462042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4c139-5274-4f4f-ac92-c31aa0fec3e2 admin admin] PATH_INFO: `/v3/projects/5e18e81392ab44d280e8c1a9c96244f5` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:47.464046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4c139-5274-4f4f-ac92-c31aa0fec3e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e18e81392ab44d280e8c1a9c96244f5)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:47.472009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4c139-5274-4f4f-ac92-c31aa0fec3e2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:47.526614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b3d88a9c-6f3b-4eff-bb4b-f25248c64bcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de6ac419377e4867a45a586cae6cdce1', 'request_id': 'req-b3d88a9c-6f3b-4eff-bb4b-f25248c64bcc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:47.536599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b3d88a9c-6f3b-4eff-bb4b-f25248c64bcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de6ac419377e4867a45a586cae6cdce1', 'request_id': 'req-b3d88a9c-6f3b-4eff-bb4b-f25248c64bcc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:47.551244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b3d88a9c-6f3b-4eff-bb4b-f25248c64bcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de6ac419377e4867a45a586cae6cdce1', 'request_id': 'req-b3d88a9c-6f3b-4eff-bb4b-f25248c64bcc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:47.577959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b3d88a9c-6f3b-4eff-bb4b-f25248c64bcc admin admin] The token cache is being invalidate because project de6ac419377e4867a45a586cae6cdce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:47.578261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b3d88a9c-6f3b-4eff-bb4b-f25248c64bcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:47.582011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b3d88a9c-6f3b-4eff-bb4b-f25248c64bcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:47.589341 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3576/7089] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:47 2022] DELETE /identity/v3/projects/de6ac419377e4867a45a586cae6cdce1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:47.590845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d88a9c-6f3b-4eff-bb4b-f25248c64bcc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:47.592409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b3d88a9c-6f3b-4eff-bb4b-f25248c64bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:47.605591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-99c4c139-5274-4f4f-ac92-c31aa0fec3e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e18e81392ab44d280e8c1a9c96244f5', 'request_id': 'req-99c4c139-5274-4f4f-ac92-c31aa0fec3e2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:47.641297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-99c4c139-5274-4f4f-ac92-c31aa0fec3e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e18e81392ab44d280e8c1a9c96244f5', 'request_id': 'req-99c4c139-5274-4f4f-ac92-c31aa0fec3e2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:47.647232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:47.654282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-99c4c139-5274-4f4f-ac92-c31aa0fec3e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e18e81392ab44d280e8c1a9c96244f5', 'request_id': 'req-99c4c139-5274-4f4f-ac92-c31aa0fec3e2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:47.656389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:47.686571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-99c4c139-5274-4f4f-ac92-c31aa0fec3e2 admin admin] The token cache is being invalidate because project 5e18e81392ab44d280e8c1a9c96244f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:47.687013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-99c4c139-5274-4f4f-ac92-c31aa0fec3e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:47.689516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-99c4c139-5274-4f4f-ac92-c31aa0fec3e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:47.692711 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3514/7090] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:47 2022] DELETE /identity/v3/projects/5e18e81392ab44d280e8c1a9c96244f5 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:47.698857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7cf45-8e27-4ae9-a5d3-10114a68f6bd None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:47.699254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7cf45-8e27-4ae9-a5d3-10114a68f6bd None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:47.699654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7cf45-8e27-4ae9-a5d3-10114a68f6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:47.736420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-70a7cf45-8e27-4ae9-a5d3-10114a68f6bd None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:47.737962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-70a7cf45-8e27-4ae9-a5d3-10114a68f6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:47.738866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d88a9c-6f3b-4eff-bb4b-f25248c64bcc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:47.841766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ce06b-1a26-4c9f-8bd5-909a574a0ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:47.843700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ce06b-1a26-4c9f-8bd5-909a574a0ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:47.844166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ce06b-1a26-4c9f-8bd5-909a574a0ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:47.844621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ce06b-1a26-4c9f-8bd5-909a574a0ba4 admin admin] PATH_INFO: `/v3/users/0c9791bc8eff4430aaa8edbe49d7eb0f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:47.848985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ce06b-1a26-4c9f-8bd5-909a574a0ba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c9791bc8eff4430aaa8edbe49d7eb0f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:47.852634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ce06b-1a26-4c9f-8bd5-909a574a0ba4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:47.893358 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3515/7091] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:28:47.901209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e556e62-3e44-422f-a864-8caab4ee8537 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:47.901796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e556e62-3e44-422f-a864-8caab4ee8537 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:47.902094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e556e62-3e44-422f-a864-8caab4ee8537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:47.992042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1e556e62-3e44-422f-a864-8caab4ee8537 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:47.993482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1e556e62-3e44-422f-a864-8caab4ee8537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:48.002335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-242ce06b-1a26-4c9f-8bd5-909a574a0ba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c9791bc8eff4430aaa8edbe49d7eb0f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:48.013842 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3516/7092] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:48.018333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e556e62-3e44-422f-a864-8caab4ee8537 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:48.038030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e556e62-3e44-422f-a864-8caab4ee8537 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:48.042351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-242ce06b-1a26-4c9f-8bd5-909a574a0ba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c9791bc8eff4430aaa8edbe49d7eb0f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:48.043828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-242ce06b-1a26-4c9f-8bd5-909a574a0ba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c9791bc8eff4430aaa8edbe49d7eb0f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:48.048365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f546856-dd7c-49df-a526-c48c7bbf54fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:48.049220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f546856-dd7c-49df-a526-c48c7bbf54fe admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:48.049885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f546856-dd7c-49df-a526-c48c7bbf54fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:48.050497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f546856-dd7c-49df-a526-c48c7bbf54fe admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:48.051403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f546856-dd7c-49df-a526-c48c7bbf54fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:48.052667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f546856-dd7c-49df-a526-c48c7bbf54fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:48.054574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-242ce06b-1a26-4c9f-8bd5-909a574a0ba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c9791bc8eff4430aaa8edbe49d7eb0f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:48.055506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-242ce06b-1a26-4c9f-8bd5-909a574a0ba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c9791bc8eff4430aaa8edbe49d7eb0f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:48.057732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f546856-dd7c-49df-a526-c48c7bbf54fe admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:48.084573 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3577/7093] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:47 2022] DELETE /identity/v3/users/0c9791bc8eff4430aaa8edbe49d7eb0f => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:48.111257 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3517/7094] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:48.116210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ce06b-1a26-4c9f-8bd5-909a574a0ba4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:48.119378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-242ce06b-1a26-4c9f-8bd5-909a574a0ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:48.208566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:48.235867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ce06b-1a26-4c9f-8bd5-909a574a0ba4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:48.246338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1f649-ba51-4e6a-9bca-fa880b33f93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:48.247225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1f649-ba51-4e6a-9bca-fa880b33f93f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:48.247894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1f649-ba51-4e6a-9bca-fa880b33f93f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:48.248226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1f649-ba51-4e6a-9bca-fa880b33f93f admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:48.249299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1f649-ba51-4e6a-9bca-fa880b33f93f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:48.259550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1f649-ba51-4e6a-9bca-fa880b33f93f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:48.319356 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3578/7095] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:48 2022] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:48.320814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f546856-dd7c-49df-a526-c48c7bbf54fe admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:48.342001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f546856-dd7c-49df-a526-c48c7bbf54fe admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:48.502746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9d17c-428a-49a3-bf9a-ca2375c0250d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:48.504958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9d17c-428a-49a3-bf9a-ca2375c0250d admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:48.507571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9d17c-428a-49a3-bf9a-ca2375c0250d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:48.507959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9d17c-428a-49a3-bf9a-ca2375c0250d admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:48.509749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9d17c-428a-49a3-bf9a-ca2375c0250d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:48.516328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9d17c-428a-49a3-bf9a-ca2375c0250d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:48.564408 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3518/7096] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:48 2022] POST /identity/v3/users => generated 291 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:48.568243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1f649-ba51-4e6a-9bca-fa880b33f93f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:48.583962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1f649-ba51-4e6a-9bca-fa880b33f93f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:48.594005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145eb83-adcf-425c-87c8-03d58ea984f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:48.594940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145eb83-adcf-425c-87c8-03d58ea984f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:48.595623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145eb83-adcf-425c-87c8-03d58ea984f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:48.596361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145eb83-adcf-425c-87c8-03d58ea984f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:48.599349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145eb83-adcf-425c-87c8-03d58ea984f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:48.603235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145eb83-adcf-425c-87c8-03d58ea984f5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:48.618889 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3579/7097] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:48.623213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9d17c-428a-49a3-bf9a-ca2375c0250d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:48.667095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9d17c-428a-49a3-bf9a-ca2375c0250d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:48.673484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145eb83-adcf-425c-87c8-03d58ea984f5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:48.676595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c145eb83-adcf-425c-87c8-03d58ea984f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:48.707591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145eb83-adcf-425c-87c8-03d58ea984f5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:48.711818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5a387-9cc5-4194-b542-94f8508639be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:48.712473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5a387-9cc5-4194-b542-94f8508639be admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:48.712765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5a387-9cc5-4194-b542-94f8508639be admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:48.713069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5a387-9cc5-4194-b542-94f8508639be admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:48.713845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5a387-9cc5-4194-b542-94f8508639be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:48.720768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945371f2-a2dc-4cf2-9ffb-9dee9a7ad117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:48.721449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945371f2-a2dc-4cf2-9ffb-9dee9a7ad117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:48.721733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945371f2-a2dc-4cf2-9ffb-9dee9a7ad117 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:48.722014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945371f2-a2dc-4cf2-9ffb-9dee9a7ad117 admin admin] PATH_INFO: `/v3/projects/2bbf0b54b9be410f9df524561376ecb9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:48.723303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945371f2-a2dc-4cf2-9ffb-9dee9a7ad117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bbf0b54b9be410f9df524561376ecb9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:48.725507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945371f2-a2dc-4cf2-9ffb-9dee9a7ad117 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:48.727750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5a387-9cc5-4194-b542-94f8508639be admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:48.795715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-945371f2-a2dc-4cf2-9ffb-9dee9a7ad117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bbf0b54b9be410f9df524561376ecb9', 'request_id': 'req-945371f2-a2dc-4cf2-9ffb-9dee9a7ad117'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:48.805441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-945371f2-a2dc-4cf2-9ffb-9dee9a7ad117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bbf0b54b9be410f9df524561376ecb9', 'request_id': 'req-945371f2-a2dc-4cf2-9ffb-9dee9a7ad117'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:48.806876 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3519/7098] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:48.812135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5a387-9cc5-4194-b542-94f8508639be admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:48.828123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-945371f2-a2dc-4cf2-9ffb-9dee9a7ad117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bbf0b54b9be410f9df524561376ecb9', 'request_id': 'req-945371f2-a2dc-4cf2-9ffb-9dee9a7ad117'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:48.828696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5a387-9cc5-4194-b542-94f8508639be admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:48.847472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-945371f2-a2dc-4cf2-9ffb-9dee9a7ad117 admin admin] The token cache is being invalidate because project 2bbf0b54b9be410f9df524561376ecb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:48.847959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-945371f2-a2dc-4cf2-9ffb-9dee9a7ad117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:48.848878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-945371f2-a2dc-4cf2-9ffb-9dee9a7ad117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:48.851928 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3580/7099] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:48 2022] DELETE /identity/v3/projects/2bbf0b54b9be410f9df524561376ecb9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:28:48.860559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bcb85-5ab6-4e99-9149-7ab2541ca2a4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:48.861216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bcb85-5ab6-4e99-9149-7ab2541ca2a4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:48.861698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bcb85-5ab6-4e99-9149-7ab2541ca2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:48.913697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c86bcb85-5ab6-4e99-9149-7ab2541ca2a4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:48.915430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c86bcb85-5ab6-4e99-9149-7ab2541ca2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:48.942894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:48.960657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c42de6-6e86-42a7-90f5-ad73511251bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:48.961500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c42de6-6e86-42a7-90f5-ad73511251bd admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:48.961788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c42de6-6e86-42a7-90f5-ad73511251bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:48.962071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c42de6-6e86-42a7-90f5-ad73511251bd admin admin] PATH_INFO: `/v3/projects/c913d686f4bb4e968a757bef17ddb707/users/3912ff33d4e14b50a774bb46d09c6e80/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:48.986059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c42de6-6e86-42a7-90f5-ad73511251bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c913d686f4bb4e968a757bef17ddb707, user_id=3912ff33d4e14b50a774bb46d09c6e80, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:48.988885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c42de6-6e86-42a7-90f5-ad73511251bd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:49.039836 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3520/7100] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:48 2022] PUT /identity/v3/projects/c913d686f4bb4e968a757bef17ddb707/users/3912ff33d4e14b50a774bb46d09c6e80/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:28:49.052159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decabab5-a7f5-4589-80c1-c28d4eede114 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:49.052722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decabab5-a7f5-4589-80c1-c28d4eede114 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:49.052722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decabab5-a7f5-4589-80c1-c28d4eede114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:49.074033 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3581/7101] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:28:49.149896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-decabab5-a7f5-4589-80c1-c28d4eede114 None None] MFA Rules not processed for user `3912ff33d4e14b50a774bb46d09c6e80`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:49.152074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-decabab5-a7f5-4589-80c1-c28d4eede114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:49.197521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9354a6-4e63-411a-a3d7-7670ecba7f23 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:49.197820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9354a6-4e63-411a-a3d7-7670ecba7f23 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:49.198105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9354a6-4e63-411a-a3d7-7670ecba7f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:49.233727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-af9354a6-4e63-411a-a3d7-7670ecba7f23 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:49.234993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-af9354a6-4e63-411a-a3d7-7670ecba7f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:49.306553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:49.313399 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3521/7102] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:49.314588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decabab5-a7f5-4589-80c1-c28d4eede114 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:49.318582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-decabab5-a7f5-4589-80c1-c28d4eede114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:49.339183 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3582/7103] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:28:49.343763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9354a6-4e63-411a-a3d7-7670ecba7f23 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:49.360649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9354a6-4e63-411a-a3d7-7670ecba7f23 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:49.368917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3daec9-311c-4f95-af11-e4a34ba31bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:49.369587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3daec9-311c-4f95-af11-e4a34ba31bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:49.369881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3daec9-311c-4f95-af11-e4a34ba31bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:49.370165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3daec9-311c-4f95-af11-e4a34ba31bd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:49.370888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3daec9-311c-4f95-af11-e4a34ba31bd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:49.371598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3daec9-311c-4f95-af11-e4a34ba31bd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:49.373977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3daec9-311c-4f95-af11-e4a34ba31bd8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:49.394494 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3583/7104] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:49.398917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3daec9-311c-4f95-af11-e4a34ba31bd8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:49.428316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3daec9-311c-4f95-af11-e4a34ba31bd8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:49.455975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d8f6f-528b-4d9a-b7b4-3f28a644982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:49.457307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d8f6f-528b-4d9a-b7b4-3f28a644982c admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:49.457816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d8f6f-528b-4d9a-b7b4-3f28a644982c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:49.458106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d8f6f-528b-4d9a-b7b4-3f28a644982c admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:49.459051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d8f6f-528b-4d9a-b7b4-3f28a644982c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:49.462765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d8f6f-528b-4d9a-b7b4-3f28a644982c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:49.480201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decabab5-a7f5-4589-80c1-c28d4eede114 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:49.492563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953ba33-ebb5-448d-ae00-ec78952dde70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:49.493207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953ba33-ebb5-448d-ae00-ec78952dde70 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:49.493492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953ba33-ebb5-448d-ae00-ec78952dde70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:49.493767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953ba33-ebb5-448d-ae00-ec78952dde70 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:49.494598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953ba33-ebb5-448d-ae00-ec78952dde70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:49.497986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953ba33-ebb5-448d-ae00-ec78952dde70 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:49.550538 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3584/7105] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:49 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:49.554053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d8f6f-528b-4d9a-b7b4-3f28a644982c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:49.565674 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3522/7106] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:49 2022] POST /identity/v3/projects => generated 381 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:49.566995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953ba33-ebb5-448d-ae00-ec78952dde70 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:49.722321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d8f6f-528b-4d9a-b7b4-3f28a644982c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:49.728559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:49.764705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953ba33-ebb5-448d-ae00-ec78952dde70 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:49.782569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a133a2-f45d-4648-a55a-c3ae5a681ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:49.783665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a133a2-f45d-4648-a55a-c3ae5a681ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:49.784035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a133a2-f45d-4648-a55a-c3ae5a681ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:49.784502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a133a2-f45d-4648-a55a-c3ae5a681ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:49.785294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a133a2-f45d-4648-a55a-c3ae5a681ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:49.788033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a133a2-f45d-4648-a55a-c3ae5a681ce1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:49.830060 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3523/7107] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:49 2022] POST /identity/v3/users => generated 297 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:28:49.831440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a133a2-f45d-4648-a55a-c3ae5a681ce1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:49.856932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a133a2-f45d-4648-a55a-c3ae5a681ce1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:49.864176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a458d31-2822-4f94-86d9-501e6295b60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:49.865042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a458d31-2822-4f94-86d9-501e6295b60e admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:49.865042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a458d31-2822-4f94-86d9-501e6295b60e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:49.865220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a458d31-2822-4f94-86d9-501e6295b60e admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:49.866013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a458d31-2822-4f94-86d9-501e6295b60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:49.868237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a458d31-2822-4f94-86d9-501e6295b60e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:49.878286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c717e-bf77-4d06-b071-e58ed92afb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:49.879912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c717e-bf77-4d06-b071-e58ed92afb21 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:49.880546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c717e-bf77-4d06-b071-e58ed92afb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:49.881037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c717e-bf77-4d06-b071-e58ed92afb21 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:49.884265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c717e-bf77-4d06-b071-e58ed92afb21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:49.889144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c717e-bf77-4d06-b071-e58ed92afb21 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:49.910007 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3524/7108] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:28:49.910996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a458d31-2822-4f94-86d9-501e6295b60e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:49.937710 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3585/7109] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:49 2022] POST /identity/v3/users => generated 293 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:49.942467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c717e-bf77-4d06-b071-e58ed92afb21 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:49.943978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a458d31-2822-4f94-86d9-501e6295b60e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:49.951370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18062ed-59f7-4dbe-8486-bf6f0c70a51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:49.951791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18062ed-59f7-4dbe-8486-bf6f0c70a51d admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:49.951918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18062ed-59f7-4dbe-8486-bf6f0c70a51d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:49.952202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18062ed-59f7-4dbe-8486-bf6f0c70a51d admin admin] PATH_INFO: `/v3/projects/0412874ce4e0449399bf346f0f8ac4e5/users/846b4ed531b14a338ded23e479cef7ec/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:49.979379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c717e-bf77-4d06-b071-e58ed92afb21 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:49.999648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18062ed-59f7-4dbe-8486-bf6f0c70a51d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0412874ce4e0449399bf346f0f8ac4e5, user_id=846b4ed531b14a338ded23e479cef7ec, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:50.003782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18062ed-59f7-4dbe-8486-bf6f0c70a51d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:50.014023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb2203-0995-4741-a686-1b6807738ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:50.014678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb2203-0995-4741-a686-1b6807738ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:50.014963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb2203-0995-4741-a686-1b6807738ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:50.015236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb2203-0995-4741-a686-1b6807738ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:50.015990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb2203-0995-4741-a686-1b6807738ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:50.017605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb2203-0995-4741-a686-1b6807738ce6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:50.044258 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3586/7110] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:50.048343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb2203-0995-4741-a686-1b6807738ce6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:50.063342 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3525/7111] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:49 2022] PUT /identity/v3/projects/0412874ce4e0449399bf346f0f8ac4e5/users/846b4ed531b14a338ded23e479cef7ec/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:50.067225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18062ed-59f7-4dbe-8486-bf6f0c70a51d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:50.079151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb2203-0995-4741-a686-1b6807738ce6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:50.129609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:50.189401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62ee6a-f38c-4be2-a649-988839e9e26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:50.190241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62ee6a-f38c-4be2-a649-988839e9e26a admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:50.191891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62ee6a-f38c-4be2-a649-988839e9e26a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:50.192185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62ee6a-f38c-4be2-a649-988839e9e26a admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:50.193610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62ee6a-f38c-4be2-a649-988839e9e26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:50.199703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62ee6a-f38c-4be2-a649-988839e9e26a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:50.201277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18062ed-59f7-4dbe-8486-bf6f0c70a51d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:50.214256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a861c-43ed-4bea-8bc8-55600f5f9b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:50.214927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a861c-43ed-4bea-8bc8-55600f5f9b7a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:50.215262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a861c-43ed-4bea-8bc8-55600f5f9b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:50.215701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a861c-43ed-4bea-8bc8-55600f5f9b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:50.216468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a861c-43ed-4bea-8bc8-55600f5f9b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:50.219003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a861c-43ed-4bea-8bc8-55600f5f9b7a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:50.236720 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3526/7112] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:28:50.241110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a861c-43ed-4bea-8bc8-55600f5f9b7a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:50.248305 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3587/7113] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:50.259988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a861c-43ed-4bea-8bc8-55600f5f9b7a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:50.266051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0c681-88e8-4edc-869e-8e76a8cf852d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:50.266807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c681-88e8-4edc-869e-8e76a8cf852d admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:50.267377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c681-88e8-4edc-869e-8e76a8cf852d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:50.267792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c681-88e8-4edc-869e-8e76a8cf852d admin admin] PATH_INFO: `/v3/projects/0412874ce4e0449399bf346f0f8ac4e5/users/846b4ed531b14a338ded23e479cef7ec/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:50.268059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62ee6a-f38c-4be2-a649-988839e9e26a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:50.269853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0c681-88e8-4edc-869e-8e76a8cf852d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0412874ce4e0449399bf346f0f8ac4e5, user_id=846b4ed531b14a338ded23e479cef7ec, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:50.276896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0c681-88e8-4edc-869e-8e76a8cf852d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:50.285388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62ee6a-f38c-4be2-a649-988839e9e26a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:50.308078 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3527/7114] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:50 2022] PUT /identity/v3/projects/0412874ce4e0449399bf346f0f8ac4e5/users/846b4ed531b14a338ded23e479cef7ec/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:28:50.310890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec97db8-ab02-4f50-b8e7-2d27f05ccdd7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:50.311415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec97db8-ab02-4f50-b8e7-2d27f05ccdd7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:50.311850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec97db8-ab02-4f50-b8e7-2d27f05ccdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:50.370324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fec97db8-ab02-4f50-b8e7-2d27f05ccdd7 None None] MFA Rules not processed for user `846b4ed531b14a338ded23e479cef7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:50.370973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fec97db8-ab02-4f50-b8e7-2d27f05ccdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:50.392168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1cd1a-0c2a-4bc3-b604-c2390f7858ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:50.393344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1cd1a-0c2a-4bc3-b604-c2390f7858ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:50.393690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1cd1a-0c2a-4bc3-b604-c2390f7858ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:50.394557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1cd1a-0c2a-4bc3-b604-c2390f7858ff admin admin] PATH_INFO: `/v3/projects/73cd25ed83c3432e94d8045621225ad4/users/4d6c306250894218beb6237484e73365/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:50.423182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1cd1a-0c2a-4bc3-b604-c2390f7858ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=73cd25ed83c3432e94d8045621225ad4, user_id=4d6c306250894218beb6237484e73365, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:50.432805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1cd1a-0c2a-4bc3-b604-c2390f7858ff admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:50.457682 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3588/7115] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:50 2022] PUT /identity/v3/projects/73cd25ed83c3432e94d8045621225ad4/users/4d6c306250894218beb6237484e73365/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:50.478895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b41c-49cb-4f48-a07d-f3604fda4b0f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:50.479980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b41c-49cb-4f48-a07d-f3604fda4b0f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:50.480602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b41c-49cb-4f48-a07d-f3604fda4b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:50.510230 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3528/7116] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:50.521376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3b96b41c-49cb-4f48-a07d-f3604fda4b0f None None] MFA Rules not processed for user `4d6c306250894218beb6237484e73365`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:50.523125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3b96b41c-49cb-4f48-a07d-f3604fda4b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:50.529304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec97db8-ab02-4f50-b8e7-2d27f05ccdd7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:50.530785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fec97db8-ab02-4f50-b8e7-2d27f05ccdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:50.547220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:50.621442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec97db8-ab02-4f50-b8e7-2d27f05ccdd7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:50.633814 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3589/7117] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:50.634714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96b41c-49cb-4f48-a07d-f3604fda4b0f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:50.636158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3b96b41c-49cb-4f48-a07d-f3604fda4b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:50.737643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:50.760437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd65a2d-d225-4a8e-baab-209f484932d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:50.761658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd65a2d-d225-4a8e-baab-209f484932d7 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:50.762479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd65a2d-d225-4a8e-baab-209f484932d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:50.763697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd65a2d-d225-4a8e-baab-209f484932d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:50.780988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96b41c-49cb-4f48-a07d-f3604fda4b0f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:50.787734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7a7f6-13b3-45fe-9fea-9cb6b88bcac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:50.788591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7a7f6-13b3-45fe-9fea-9cb6b88bcac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:50.789000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7a7f6-13b3-45fe-9fea-9cb6b88bcac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:50.789330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7a7f6-13b3-45fe-9fea-9cb6b88bcac9 admin admin] PATH_INFO: `/v3/users/028bc898819246e481a3f7fb20195f99` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:50.791727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7a7f6-13b3-45fe-9fea-9cb6b88bcac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=028bc898819246e481a3f7fb20195f99)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:50.794677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7a7f6-13b3-45fe-9fea-9cb6b88bcac9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:50.836152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd65a2d-d225-4a8e-baab-209f484932d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:50.837754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd65a2d-d225-4a8e-baab-209f484932d7 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:50.849667 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3529/7118] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:28:50.850571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd65a2d-d225-4a8e-baab-209f484932d7 service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:50.852561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3cd65a2d-d225-4a8e-baab-209f484932d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:50.858104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-18c7a7f6-13b3-45fe-9fea-9cb6b88bcac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '028bc898819246e481a3f7fb20195f99'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:50.878196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-18c7a7f6-13b3-45fe-9fea-9cb6b88bcac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '028bc898819246e481a3f7fb20195f99'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:50.879860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-18c7a7f6-13b3-45fe-9fea-9cb6b88bcac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '028bc898819246e481a3f7fb20195f99'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:50.892185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-18c7a7f6-13b3-45fe-9fea-9cb6b88bcac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '028bc898819246e481a3f7fb20195f99'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:50.892934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-18c7a7f6-13b3-45fe-9fea-9cb6b88bcac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '028bc898819246e481a3f7fb20195f99'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:50.923385 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3590/7119] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:50 2022] DELETE /identity/v3/users/028bc898819246e481a3f7fb20195f99 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:50.929764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46943ece-37c2-4ba1-9a39-ca360160a557 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:50.930276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46943ece-37c2-4ba1-9a39-ca360160a557 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:50.931853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46943ece-37c2-4ba1-9a39-ca360160a557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:50.961227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd65a2d-d225-4a8e-baab-209f484932d7 service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:50.964812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-46943ece-37c2-4ba1-9a39-ca360160a557 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:50.966485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-46943ece-37c2-4ba1-9a39-ca360160a557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:51.055564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:51.128480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cdc1e-f70f-472e-a6cc-30ad105f3843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:51.131860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cdc1e-f70f-472e-a6cc-30ad105f3843 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:51.133242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cdc1e-f70f-472e-a6cc-30ad105f3843 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:51.135983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cdc1e-f70f-472e-a6cc-30ad105f3843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:51.141164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-388cdc1e-f70f-472e-a6cc-30ad105f3843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:51.192391 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3591/7120] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:51.203128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46943ece-37c2-4ba1-9a39-ca360160a557 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:51.204836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-46943ece-37c2-4ba1-9a39-ca360160a557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:51.252835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46943ece-37c2-4ba1-9a39-ca360160a557 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:51.266440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88bc48-1c88-4abe-b48d-42b1d4a3a9e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:51.267124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88bc48-1c88-4abe-b48d-42b1d4a3a9e1 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:51.267480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88bc48-1c88-4abe-b48d-42b1d4a3a9e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:51.267786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88bc48-1c88-4abe-b48d-42b1d4a3a9e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:51.290082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88bc48-1c88-4abe-b48d-42b1d4a3a9e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:51.291699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88bc48-1c88-4abe-b48d-42b1d4a3a9e1 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:51.327856 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3592/7121] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:51.333952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cdc1e-f70f-472e-a6cc-30ad105f3843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:51.336497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cdc1e-f70f-472e-a6cc-30ad105f3843 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:51.348282 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3530/7122] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:52.257238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88bc48-1c88-4abe-b48d-42b1d4a3a9e1 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:52.258870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6b88bc48-1c88-4abe-b48d-42b1d4a3a9e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:52.275157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88bc48-1c88-4abe-b48d-42b1d4a3a9e1 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:52.284937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728729f-67f1-4d11-b726-9f17a866fba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:52.285677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728729f-67f1-4d11-b726-9f17a866fba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:52.285995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728729f-67f1-4d11-b726-9f17a866fba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:52.286255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728729f-67f1-4d11-b726-9f17a866fba6 admin admin] PATH_INFO: `/v3/users/04891d42f10d43e9b95e14ad8b5c67c7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:52.287849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728729f-67f1-4d11-b726-9f17a866fba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04891d42f10d43e9b95e14ad8b5c67c7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:52.296169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728729f-67f1-4d11-b726-9f17a866fba6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:52.370269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cdc1e-f70f-472e-a6cc-30ad105f3843 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:52.372530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-388cdc1e-f70f-472e-a6cc-30ad105f3843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:52.390923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cdc1e-f70f-472e-a6cc-30ad105f3843 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:52.398055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eca3c-a524-4eff-a601-529dcc0911ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:52.398444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2728729f-67f1-4d11-b726-9f17a866fba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04891d42f10d43e9b95e14ad8b5c67c7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:52.399138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eca3c-a524-4eff-a601-529dcc0911ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:52.399658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eca3c-a524-4eff-a601-529dcc0911ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:52.400028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:52.400388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eca3c-a524-4eff-a601-529dcc0911ec admin admin] PATH_INFO: `/v3/projects/a1833a6aa44b4d72bc3c3bd2cc061645` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:52.402285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63eca3c-a524-4eff-a601-529dcc0911ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1833a6aa44b4d72bc3c3bd2cc061645)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:52.405146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63eca3c-a524-4eff-a601-529dcc0911ec admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:52.417294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2728729f-67f1-4d11-b726-9f17a866fba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04891d42f10d43e9b95e14ad8b5c67c7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:52.418163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2728729f-67f1-4d11-b726-9f17a866fba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04891d42f10d43e9b95e14ad8b5c67c7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:52.426084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2728729f-67f1-4d11-b726-9f17a866fba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04891d42f10d43e9b95e14ad8b5c67c7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:52.427143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2728729f-67f1-4d11-b726-9f17a866fba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04891d42f10d43e9b95e14ad8b5c67c7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:52.454420 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3593/7123] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:52 2022] DELETE /identity/v3/users/04891d42f10d43e9b95e14ad8b5c67c7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:52.458739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1dece-0c0f-46a1-96fb-0ba752142e35 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:52.459138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1dece-0c0f-46a1-96fb-0ba752142e35 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:52.459555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1dece-0c0f-46a1-96fb-0ba752142e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:52.498134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d8f1dece-0c0f-46a1-96fb-0ba752142e35 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:52.502269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d8f1dece-0c0f-46a1-96fb-0ba752142e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:52.528090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e63eca3c-a524-4eff-a601-529dcc0911ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1833a6aa44b4d72bc3c3bd2cc061645', 'request_id': 'req-e63eca3c-a524-4eff-a601-529dcc0911ec'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:52.539958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e63eca3c-a524-4eff-a601-529dcc0911ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1833a6aa44b4d72bc3c3bd2cc061645', 'request_id': 'req-e63eca3c-a524-4eff-a601-529dcc0911ec'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:52.553488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e63eca3c-a524-4eff-a601-529dcc0911ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1833a6aa44b4d72bc3c3bd2cc061645', 'request_id': 'req-e63eca3c-a524-4eff-a601-529dcc0911ec'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:52.576577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e63eca3c-a524-4eff-a601-529dcc0911ec admin admin] The token cache is being invalidate because project a1833a6aa44b4d72bc3c3bd2cc061645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:52.577608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e63eca3c-a524-4eff-a601-529dcc0911ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:52.579691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e63eca3c-a524-4eff-a601-529dcc0911ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:52.587466 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3531/7124] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:52 2022] DELETE /identity/v3/projects/a1833a6aa44b4d72bc3c3bd2cc061645 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:52.600012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25465848-1746-4b9c-9e59-f73f57091205 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:52.600548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25465848-1746-4b9c-9e59-f73f57091205 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:52.601037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25465848-1746-4b9c-9e59-f73f57091205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:52.603389 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3594/7125] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:28:52.620006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1dece-0c0f-46a1-96fb-0ba752142e35 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:52.622136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d8f1dece-0c0f-46a1-96fb-0ba752142e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:52.649085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-25465848-1746-4b9c-9e59-f73f57091205 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:52.650294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-25465848-1746-4b9c-9e59-f73f57091205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:52.661146 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3532/7126] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:28:52.677223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f097e0-b422-460a-8df8-d95e029e3272 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:52.677737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f097e0-b422-460a-8df8-d95e029e3272 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:52.684135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f097e0-b422-460a-8df8-d95e029e3272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:52.715212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-96f097e0-b422-460a-8df8-d95e029e3272 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:52.716541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-96f097e0-b422-460a-8df8-d95e029e3272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:52.739634 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3533/7127] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:52.740583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f097e0-b422-460a-8df8-d95e029e3272 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:52.754393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f097e0-b422-460a-8df8-d95e029e3272 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:52.761909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026cfe1e-9091-4909-938b-6004acaa46f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:52.762408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cfe1e-9091-4909-938b-6004acaa46f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:52.762573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1dece-0c0f-46a1-96fb-0ba752142e35 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:52.764888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cfe1e-9091-4909-938b-6004acaa46f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:52.765230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cfe1e-9091-4909-938b-6004acaa46f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:52.766150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026cfe1e-9091-4909-938b-6004acaa46f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:52.766626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026cfe1e-9091-4909-938b-6004acaa46f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:52.769610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026cfe1e-9091-4909-938b-6004acaa46f8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:52.773621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10020a59-5504-48f6-9eaa-5fb6234699ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:52.774459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10020a59-5504-48f6-9eaa-5fb6234699ba service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:52.774675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10020a59-5504-48f6-9eaa-5fb6234699ba service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:52.775417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10020a59-5504-48f6-9eaa-5fb6234699ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:52.800691 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3534/7128] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:52.801763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10020a59-5504-48f6-9eaa-5fb6234699ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:52.803218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10020a59-5504-48f6-9eaa-5fb6234699ba service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:52.805242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026cfe1e-9091-4909-938b-6004acaa46f8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:52.822086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026cfe1e-9091-4909-938b-6004acaa46f8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:52.829082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad09e9-2989-4928-b126-052079c48ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:52.829940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad09e9-2989-4928-b126-052079c48ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:52.830299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad09e9-2989-4928-b126-052079c48ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:52.830665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad09e9-2989-4928-b126-052079c48ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:52.831545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad09e9-2989-4928-b126-052079c48ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:52.833940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad09e9-2989-4928-b126-052079c48ff6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:52.835697 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3595/7129] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:52.887620 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3535/7130] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:52 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:52.892029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10020a59-5504-48f6-9eaa-5fb6234699ba service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:52.905851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10020a59-5504-48f6-9eaa-5fb6234699ba service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:53.045476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47d694-63d4-48b3-a42c-63a54accf904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:53.046521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47d694-63d4-48b3-a42c-63a54accf904 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:53.046919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47d694-63d4-48b3-a42c-63a54accf904 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:53.047703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47d694-63d4-48b3-a42c-63a54accf904 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:53.048102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47d694-63d4-48b3-a42c-63a54accf904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:53.051189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47d694-63d4-48b3-a42c-63a54accf904 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:53.069644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:53.091965 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3596/7131] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:52 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:53.092940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad09e9-2989-4928-b126-052079c48ff6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:53.118746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad09e9-2989-4928-b126-052079c48ff6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:53.133743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084cd12-2e4a-4c22-ab82-e204e9fe6340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:53.135598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084cd12-2e4a-4c22-ab82-e204e9fe6340 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:53.136019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084cd12-2e4a-4c22-ab82-e204e9fe6340 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:53.136929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084cd12-2e4a-4c22-ab82-e204e9fe6340 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:53.140811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084cd12-2e4a-4c22-ab82-e204e9fe6340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:53.146255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084cd12-2e4a-4c22-ab82-e204e9fe6340 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:53.173763 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3536/7132] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:53.177742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47d694-63d4-48b3-a42c-63a54accf904 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:53.203342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47d694-63d4-48b3-a42c-63a54accf904 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:53.209004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffbc9a-405b-4573-be40-eabda7353fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:53.209646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffbc9a-405b-4573-be40-eabda7353fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:53.209929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffbc9a-405b-4573-be40-eabda7353fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:53.210207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffbc9a-405b-4573-be40-eabda7353fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:53.210911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffbc9a-405b-4573-be40-eabda7353fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:53.212622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffbc9a-405b-4573-be40-eabda7353fb1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:53.238360 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3597/7133] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:53.242054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084cd12-2e4a-4c22-ab82-e204e9fe6340 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:53.258160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084cd12-2e4a-4c22-ab82-e204e9fe6340 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:53.264922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548da813-bf88-43b2-bcd5-d1a1fc63e1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:53.265817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548da813-bf88-43b2-bcd5-d1a1fc63e1fa admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:53.266152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548da813-bf88-43b2-bcd5-d1a1fc63e1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:53.266485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548da813-bf88-43b2-bcd5-d1a1fc63e1fa admin admin] PATH_INFO: `/v3/projects/faf1fb0c4cac401f925e3522776dbdf7/users/a4136d1c05b649f1be0ae0219d7b6b18/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:53.282614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:53.289289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548da813-bf88-43b2-bcd5-d1a1fc63e1fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf1fb0c4cac401f925e3522776dbdf7, user_id=a4136d1c05b649f1be0ae0219d7b6b18, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:53.293479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548da813-bf88-43b2-bcd5-d1a1fc63e1fa admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:53.327627 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3537/7134] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:53 2022] PUT /identity/v3/projects/faf1fb0c4cac401f925e3522776dbdf7/users/a4136d1c05b649f1be0ae0219d7b6b18/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:53.331203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd22c6-994a-493e-9f5a-ad5a617ad19f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:53.331758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd22c6-994a-493e-9f5a-ad5a617ad19f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:53.331852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd22c6-994a-493e-9f5a-ad5a617ad19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:53.388426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-36fd22c6-994a-493e-9f5a-ad5a617ad19f None None] MFA Rules not processed for user `a4136d1c05b649f1be0ae0219d7b6b18`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:53.389713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-36fd22c6-994a-493e-9f5a-ad5a617ad19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:53.415612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548da813-bf88-43b2-bcd5-d1a1fc63e1fa admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:53.417882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-548da813-bf88-43b2-bcd5-d1a1fc63e1fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:53.537650 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3598/7135] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:53.548576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd22c6-994a-493e-9f5a-ad5a617ad19f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:53.550134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-36fd22c6-994a-493e-9f5a-ad5a617ad19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:53.560966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548da813-bf88-43b2-bcd5-d1a1fc63e1fa admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:53.576809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fdb24-19db-441a-b68f-beba57fbdbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:53.577649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fdb24-19db-441a-b68f-beba57fbdbf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:53.578057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fdb24-19db-441a-b68f-beba57fbdbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:53.578436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fdb24-19db-441a-b68f-beba57fbdbf1 admin admin] PATH_INFO: `/v3/projects/c2dc8f7f209747caa4acb5ca89b4ed99` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:53.581339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fdb24-19db-441a-b68f-beba57fbdbf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2dc8f7f209747caa4acb5ca89b4ed99)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:53.585722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fdb24-19db-441a-b68f-beba57fbdbf1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:53.657262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd22c6-994a-493e-9f5a-ad5a617ad19f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:53.662896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f31fdb24-19db-441a-b68f-beba57fbdbf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2dc8f7f209747caa4acb5ca89b4ed99', 'request_id': 'req-f31fdb24-19db-441a-b68f-beba57fbdbf1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:53.674252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f31fdb24-19db-441a-b68f-beba57fbdbf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2dc8f7f209747caa4acb5ca89b4ed99', 'request_id': 'req-f31fdb24-19db-441a-b68f-beba57fbdbf1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:53.683357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f31fdb24-19db-441a-b68f-beba57fbdbf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2dc8f7f209747caa4acb5ca89b4ed99', 'request_id': 'req-f31fdb24-19db-441a-b68f-beba57fbdbf1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:53.699388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f31fdb24-19db-441a-b68f-beba57fbdbf1 admin admin] The token cache is being invalidate because project c2dc8f7f209747caa4acb5ca89b4ed99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:53.701453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f31fdb24-19db-441a-b68f-beba57fbdbf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:53.702636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f31fdb24-19db-441a-b68f-beba57fbdbf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:53.706070 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3538/7136] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:53 2022] DELETE /identity/v3/projects/c2dc8f7f209747caa4acb5ca89b4ed99 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:28:53.710146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fdb24-19db-441a-b68f-beba57fbdbf1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:53.711915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f31fdb24-19db-441a-b68f-beba57fbdbf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:53.726369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6fc2a-a7c0-46a3-81b0-351515012508 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:53.727013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6fc2a-a7c0-46a3-81b0-351515012508 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:53.727338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6fc2a-a7c0-46a3-81b0-351515012508 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:53.727633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6fc2a-a7c0-46a3-81b0-351515012508 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:53.729932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-18c6fc2a-a7c0-46a3-81b0-351515012508 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:53.800854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:53.809546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fdb24-19db-441a-b68f-beba57fbdbf1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:53.815058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd990851-10df-4239-b410-66991cb2d8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:53.815782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd990851-10df-4239-b410-66991cb2d8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:53.816344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd990851-10df-4239-b410-66991cb2d8db admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:53.816818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd990851-10df-4239-b410-66991cb2d8db admin admin] PATH_INFO: `/v3/users/e8b880d68e5742abb700c22726c6cc71` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:53.818089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd990851-10df-4239-b410-66991cb2d8db admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8b880d68e5742abb700c22726c6cc71)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:53.820577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd990851-10df-4239-b410-66991cb2d8db admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:53.823757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6fc2a-a7c0-46a3-81b0-351515012508 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:53.829140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6fc2a-a7c0-46a3-81b0-351515012508 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:53.843752 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3599/7137] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:53.860275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:53.906727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fd990851-10df-4239-b410-66991cb2d8db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b880d68e5742abb700c22726c6cc71'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:53.907601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fd990851-10df-4239-b410-66991cb2d8db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b880d68e5742abb700c22726c6cc71'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:53.925026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fd990851-10df-4239-b410-66991cb2d8db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b880d68e5742abb700c22726c6cc71'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:53.926644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fd990851-10df-4239-b410-66991cb2d8db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b880d68e5742abb700c22726c6cc71'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:53.939690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fd990851-10df-4239-b410-66991cb2d8db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b880d68e5742abb700c22726c6cc71'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:53.972761 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3539/7138] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:28:53 2022] DELETE /identity/v3/users/e8b880d68e5742abb700c22726c6cc71 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:54.388302 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6fc2a-a7c0-46a3-81b0-351515012508 service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:54.406594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6fc2a-a7c0-46a3-81b0-351515012508 service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:54.521734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1644ae3-b6a3-4c35-87c9-f0020599be7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:54.522412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1644ae3-b6a3-4c35-87c9-f0020599be7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:54.522756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1644ae3-b6a3-4c35-87c9-f0020599be7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:54.523042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1644ae3-b6a3-4c35-87c9-f0020599be7b admin admin] PATH_INFO: `/v3/projects/dc0f30c4effc43d79938868d4f4c8163` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:54.524402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1644ae3-b6a3-4c35-87c9-f0020599be7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc0f30c4effc43d79938868d4f4c8163)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:54.526946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1644ae3-b6a3-4c35-87c9-f0020599be7b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:54.624975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d1644ae3-b6a3-4c35-87c9-f0020599be7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc0f30c4effc43d79938868d4f4c8163', 'request_id': 'req-d1644ae3-b6a3-4c35-87c9-f0020599be7b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:54.649160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d1644ae3-b6a3-4c35-87c9-f0020599be7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc0f30c4effc43d79938868d4f4c8163', 'request_id': 'req-d1644ae3-b6a3-4c35-87c9-f0020599be7b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:54.677124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d1644ae3-b6a3-4c35-87c9-f0020599be7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc0f30c4effc43d79938868d4f4c8163', 'request_id': 'req-d1644ae3-b6a3-4c35-87c9-f0020599be7b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:54.700095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d1644ae3-b6a3-4c35-87c9-f0020599be7b admin admin] The token cache is being invalidate because project dc0f30c4effc43d79938868d4f4c8163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:28:54.701479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d1644ae3-b6a3-4c35-87c9-f0020599be7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:54.702445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d1644ae3-b6a3-4c35-87c9-f0020599be7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:28:54.714427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8228c-1f70-4fcf-8369-4c218048845c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:54.715127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8228c-1f70-4fcf-8369-4c218048845c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:54.715225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8228c-1f70-4fcf-8369-4c218048845c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:54.718800 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3600/7139] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:28:54 2022] DELETE /identity/v3/projects/dc0f30c4effc43d79938868d4f4c8163 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:54.749455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5bd8228c-1f70-4fcf-8369-4c218048845c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:54.750798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5bd8228c-1f70-4fcf-8369-4c218048845c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:54.828112 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3540/7140] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:54.836449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa9a7b-57d8-4dfb-9412-bd5158171c4f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:54.836665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa9a7b-57d8-4dfb-9412-bd5158171c4f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:54.836861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa9a7b-57d8-4dfb-9412-bd5158171c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:54.875578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f8fa9a7b-57d8-4dfb-9412-bd5158171c4f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:54.879282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f8fa9a7b-57d8-4dfb-9412-bd5158171c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:54.901345 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3601/7141] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:54.904643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8228c-1f70-4fcf-8369-4c218048845c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:54.942604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8228c-1f70-4fcf-8369-4c218048845c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:54.955058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211a4dd-22fc-49f2-b685-7e5af65fceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:54.956135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211a4dd-22fc-49f2-b685-7e5af65fceb4 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:54.956758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211a4dd-22fc-49f2-b685-7e5af65fceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:54.957113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211a4dd-22fc-49f2-b685-7e5af65fceb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:54.958197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211a4dd-22fc-49f2-b685-7e5af65fceb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:28:54.958579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211a4dd-22fc-49f2-b685-7e5af65fceb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:54.960510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211a4dd-22fc-49f2-b685-7e5af65fceb4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:54.984357 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3541/7142] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:28:54.986075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa9a7b-57d8-4dfb-9412-bd5158171c4f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:55.009597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa9a7b-57d8-4dfb-9412-bd5158171c4f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:55.021233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12fe6e-7e64-429f-a8ff-770854195ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:55.021884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12fe6e-7e64-429f-a8ff-770854195ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:55.022260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12fe6e-7e64-429f-a8ff-770854195ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:55.022547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12fe6e-7e64-429f-a8ff-770854195ee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:55.023825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12fe6e-7e64-429f-a8ff-770854195ee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:55.026484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12fe6e-7e64-429f-a8ff-770854195ee4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:55.136249 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3602/7143] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:28:54 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:55.141527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211a4dd-22fc-49f2-b685-7e5af65fceb4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:55.181189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211a4dd-22fc-49f2-b685-7e5af65fceb4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:55.329463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07316f-4f39-4e28-badd-d9688f9681b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:55.330759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07316f-4f39-4e28-badd-d9688f9681b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:55.331215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07316f-4f39-4e28-badd-d9688f9681b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:55.332164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07316f-4f39-4e28-badd-d9688f9681b1 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:55.332938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07316f-4f39-4e28-badd-d9688f9681b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:55.335581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07316f-4f39-4e28-badd-d9688f9681b1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:55.365389 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3542/7144] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:28:55 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:28:55.369948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12fe6e-7e64-429f-a8ff-770854195ee4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:55.384354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12fe6e-7e64-429f-a8ff-770854195ee4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:55.391308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c376c54-6715-407d-8062-8c43293914f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:55.392222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c376c54-6715-407d-8062-8c43293914f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:55.392577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c376c54-6715-407d-8062-8c43293914f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:55.393000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c376c54-6715-407d-8062-8c43293914f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:55.393896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c376c54-6715-407d-8062-8c43293914f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:55.396397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c376c54-6715-407d-8062-8c43293914f7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:55.411145 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3603/7145] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:55.415754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07316f-4f39-4e28-badd-d9688f9681b1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:55.428544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07316f-4f39-4e28-badd-d9688f9681b1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:55.435631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05b160-ee17-48a0-835a-5eb4669cfaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:55.437008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05b160-ee17-48a0-835a-5eb4669cfaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:55.437008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05b160-ee17-48a0-835a-5eb4669cfaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:55.437284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05b160-ee17-48a0-835a-5eb4669cfaa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:55.437936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05b160-ee17-48a0-835a-5eb4669cfaa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:55.440003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05b160-ee17-48a0-835a-5eb4669cfaa3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:55.458042 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3543/7146] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:28:55.484146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c376c54-6715-407d-8062-8c43293914f7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:55.517704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c376c54-6715-407d-8062-8c43293914f7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:55.540143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc20198-fd68-44c6-a6fa-8634a33480a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:55.540856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc20198-fd68-44c6-a6fa-8634a33480a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:55.543503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc20198-fd68-44c6-a6fa-8634a33480a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:55.543829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc20198-fd68-44c6-a6fa-8634a33480a5 admin admin] PATH_INFO: `/v3/projects/feefda34901f4756a13758920c53a1e6/users/e0d7d5bc71154c04a2966aafc81d80c5/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:55.617512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc20198-fd68-44c6-a6fa-8634a33480a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feefda34901f4756a13758920c53a1e6, user_id=e0d7d5bc71154c04a2966aafc81d80c5, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:55.628020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc20198-fd68-44c6-a6fa-8634a33480a5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:55.664137 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3604/7147] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:28:55 2022] PUT /identity/v3/projects/feefda34901f4756a13758920c53a1e6/users/e0d7d5bc71154c04a2966aafc81d80c5/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:28:55.671235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78979695-529c-4246-8084-1ff70af9d049 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:55.671593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78979695-529c-4246-8084-1ff70af9d049 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:55.671878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78979695-529c-4246-8084-1ff70af9d049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:55.684073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:55.734988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-78979695-529c-4246-8084-1ff70af9d049 None None] MFA Rules not processed for user `e0d7d5bc71154c04a2966aafc81d80c5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:28:55.737216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-78979695-529c-4246-8084-1ff70af9d049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:55.952165 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3544/7148] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:28:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:28:55.979553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc20198-fd68-44c6-a6fa-8634a33480a5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:55.982221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-abc20198-fd68-44c6-a6fa-8634a33480a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:56.003631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:56.104240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc20198-fd68-44c6-a6fa-8634a33480a5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:56.108474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ad924-41a3-44a5-8ef4-c39160d52469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:56.109144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ad924-41a3-44a5-8ef4-c39160d52469 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:56.109460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ad924-41a3-44a5-8ef4-c39160d52469 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:56.109761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ad924-41a3-44a5-8ef4-c39160d52469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:56.133841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ad924-41a3-44a5-8ef4-c39160d52469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:56.135728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ad924-41a3-44a5-8ef4-c39160d52469 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:56.152370 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3605/7149] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:28:58.688902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78979695-529c-4246-8084-1ff70af9d049 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:28:58.692132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-78979695-529c-4246-8084-1ff70af9d049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:58.727896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78979695-529c-4246-8084-1ff70af9d049 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:28:58.745957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d7a7d-2353-4675-84b7-9c6478e67ab2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:28:58.748287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d7a7d-2353-4675-84b7-9c6478e67ab2 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:28:58.750400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d7a7d-2353-4675-84b7-9c6478e67ab2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:28:58.753625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d7a7d-2353-4675-84b7-9c6478e67ab2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:28:58.760188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-819d7a7d-2353-4675-84b7-9c6478e67ab2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:28:59.017163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d7a7d-2353-4675-84b7-9c6478e67ab2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:28:59.019561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d7a7d-2353-4675-84b7-9c6478e67ab2 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:28:59.041336 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3545/7150] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:28:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:02.193895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ad924-41a3-44a5-8ef4-c39160d52469 service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:02.195776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-055ad924-41a3-44a5-8ef4-c39160d52469 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:02.447518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ad924-41a3-44a5-8ef4-c39160d52469 service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:02.477316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a8ab1-53de-430f-b27b-cef47576d016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:02.478011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a8ab1-53de-430f-b27b-cef47576d016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:02.478309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a8ab1-53de-430f-b27b-cef47576d016 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:02.478582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a8ab1-53de-430f-b27b-cef47576d016 admin admin] PATH_INFO: `/v3/users/a4136d1c05b649f1be0ae0219d7b6b18` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:02.485688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a8ab1-53de-430f-b27b-cef47576d016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4136d1c05b649f1be0ae0219d7b6b18)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:02.490377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a8ab1-53de-430f-b27b-cef47576d016 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:02.617534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5e6a8ab1-53de-430f-b27b-cef47576d016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4136d1c05b649f1be0ae0219d7b6b18'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:02.636481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5e6a8ab1-53de-430f-b27b-cef47576d016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4136d1c05b649f1be0ae0219d7b6b18'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:02.639679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5e6a8ab1-53de-430f-b27b-cef47576d016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4136d1c05b649f1be0ae0219d7b6b18'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:02.661151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5e6a8ab1-53de-430f-b27b-cef47576d016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4136d1c05b649f1be0ae0219d7b6b18'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:02.662257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5e6a8ab1-53de-430f-b27b-cef47576d016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4136d1c05b649f1be0ae0219d7b6b18'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:02.706175 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3606/7151] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:02 2022] DELETE /identity/v3/users/a4136d1c05b649f1be0ae0219d7b6b18 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:02.712015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bdc66-9628-4931-b62f-6c5a407159b6 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:02.713415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bdc66-9628-4931-b62f-6c5a407159b6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:02.715318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bdc66-9628-4931-b62f-6c5a407159b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:02.767606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b33bdc66-9628-4931-b62f-6c5a407159b6 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:02.769650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b33bdc66-9628-4931-b62f-6c5a407159b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:02.918410 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3546/7152] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:02.946467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a8ab1-53de-430f-b27b-cef47576d016 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:02.948296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5e6a8ab1-53de-430f-b27b-cef47576d016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:03.076880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:03.139366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a8ab1-53de-430f-b27b-cef47576d016 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:03.158755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e19e7-c982-452d-957a-db569c251539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:03.159563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e19e7-c982-452d-957a-db569c251539 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:03.159854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e19e7-c982-452d-957a-db569c251539 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:03.160198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e19e7-c982-452d-957a-db569c251539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:03.174985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e19e7-c982-452d-957a-db569c251539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:03.182375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e19e7-c982-452d-957a-db569c251539 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:03.252361 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3607/7153] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:05.150222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bdc66-9628-4931-b62f-6c5a407159b6 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:05.153987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b33bdc66-9628-4931-b62f-6c5a407159b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:05.193565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bdc66-9628-4931-b62f-6c5a407159b6 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:05.209551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7e464-0eaf-4edb-a5ed-d069681dffdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:05.210496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7e464-0eaf-4edb-a5ed-d069681dffdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:05.216543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7e464-0eaf-4edb-a5ed-d069681dffdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:05.216941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7e464-0eaf-4edb-a5ed-d069681dffdf admin admin] PATH_INFO: `/v3/projects/faf1fb0c4cac401f925e3522776dbdf7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:05.218738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7e464-0eaf-4edb-a5ed-d069681dffdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf1fb0c4cac401f925e3522776dbdf7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:05.221726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7e464-0eaf-4edb-a5ed-d069681dffdf admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:05.322956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:05.383599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-50d7e464-0eaf-4edb-a5ed-d069681dffdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf1fb0c4cac401f925e3522776dbdf7', 'request_id': 'req-50d7e464-0eaf-4edb-a5ed-d069681dffdf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:05.402736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-50d7e464-0eaf-4edb-a5ed-d069681dffdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf1fb0c4cac401f925e3522776dbdf7', 'request_id': 'req-50d7e464-0eaf-4edb-a5ed-d069681dffdf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:05.413166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-50d7e464-0eaf-4edb-a5ed-d069681dffdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf1fb0c4cac401f925e3522776dbdf7', 'request_id': 'req-50d7e464-0eaf-4edb-a5ed-d069681dffdf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:05.428937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-50d7e464-0eaf-4edb-a5ed-d069681dffdf admin admin] The token cache is being invalidate because project faf1fb0c4cac401f925e3522776dbdf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:05.429624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-50d7e464-0eaf-4edb-a5ed-d069681dffdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:05.430453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-50d7e464-0eaf-4edb-a5ed-d069681dffdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:05.432650 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3547/7154] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:05 2022] DELETE /identity/v3/projects/faf1fb0c4cac401f925e3522776dbdf7 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:05.437169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f0c39-5d7b-47f0-8401-0ecaa226b018 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:05.437683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f0c39-5d7b-47f0-8401-0ecaa226b018 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:05.438016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f0c39-5d7b-47f0-8401-0ecaa226b018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:05.472650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7a0f0c39-5d7b-47f0-8401-0ecaa226b018 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:05.474094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7a0f0c39-5d7b-47f0-8401-0ecaa226b018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:05.573867 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3608/7155] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:05.575692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442835b5-a7ea-4818-b5ac-612bb808ecbe None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:05.576095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442835b5-a7ea-4818-b5ac-612bb808ecbe None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:05.576564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442835b5-a7ea-4818-b5ac-612bb808ecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:05.632188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-442835b5-a7ea-4818-b5ac-612bb808ecbe None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:05.635976 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-442835b5-a7ea-4818-b5ac-612bb808ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:05.664148 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3548/7156] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:29:05.669332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f0c39-5d7b-47f0-8401-0ecaa226b018 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:05.696293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f0c39-5d7b-47f0-8401-0ecaa226b018 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:05.711840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c83527-287c-4324-afb0-c1082d034918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:05.716597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c83527-287c-4324-afb0-c1082d034918 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:05.717165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c83527-287c-4324-afb0-c1082d034918 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:05.717607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c83527-287c-4324-afb0-c1082d034918 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:05.719842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c83527-287c-4324-afb0-c1082d034918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:29:05.722784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c83527-287c-4324-afb0-c1082d034918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:05.725508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c83527-287c-4324-afb0-c1082d034918 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:05.763035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442835b5-a7ea-4818-b5ac-612bb808ecbe None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:05.763773 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3609/7157] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:29:05.779812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442835b5-a7ea-4818-b5ac-612bb808ecbe None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:05.796808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b74afc-ea89-4043-9add-593f01479c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:05.797986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b74afc-ea89-4043-9add-593f01479c73 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:05.798777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b74afc-ea89-4043-9add-593f01479c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:05.799517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b74afc-ea89-4043-9add-593f01479c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:05.800909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b74afc-ea89-4043-9add-593f01479c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:05.807265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b74afc-ea89-4043-9add-593f01479c73 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:05.833058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c83527-287c-4324-afb0-c1082d034918 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:05.834320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-83c83527-287c-4324-afb0-c1082d034918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:05.857177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c83527-287c-4324-afb0-c1082d034918 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:05.859353 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3549/7158] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:05 2022] POST /identity/v3/projects => generated 361 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:05.862912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b74afc-ea89-4043-9add-593f01479c73 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:05.989286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baada05-a1b9-4ac9-874d-f4f9425bbc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:05.992355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baada05-a1b9-4ac9-874d-f4f9425bbc2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:05.993809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baada05-a1b9-4ac9-874d-f4f9425bbc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:05.994313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baada05-a1b9-4ac9-874d-f4f9425bbc2b admin admin] PATH_INFO: `/v3/users/4d6c306250894218beb6237484e73365` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:05.997431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baada05-a1b9-4ac9-874d-f4f9425bbc2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6c306250894218beb6237484e73365)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:06.007969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baada05-a1b9-4ac9-874d-f4f9425bbc2b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:06.038157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b74afc-ea89-4043-9add-593f01479c73 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:06.052905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4d9a1-61bf-46bd-abdc-8efd159670af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:06.054048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4d9a1-61bf-46bd-abdc-8efd159670af admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:06.054601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4d9a1-61bf-46bd-abdc-8efd159670af admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:06.055238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4d9a1-61bf-46bd-abdc-8efd159670af admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:06.056521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4d9a1-61bf-46bd-abdc-8efd159670af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:06.062085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4d9a1-61bf-46bd-abdc-8efd159670af admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:06.122824 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3550/7159] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:05 2022] POST /identity/v3/users => generated 281 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:06.125101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4d9a1-61bf-46bd-abdc-8efd159670af admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:06.146336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0baada05-a1b9-4ac9-874d-f4f9425bbc2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6c306250894218beb6237484e73365'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:06.149244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4d9a1-61bf-46bd-abdc-8efd159670af admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:06.160176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c2b25-43ce-4bbb-aa7f-301546f6a847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:06.160937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c2b25-43ce-4bbb-aa7f-301546f6a847 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:06.161077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c2b25-43ce-4bbb-aa7f-301546f6a847 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:06.162421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c2b25-43ce-4bbb-aa7f-301546f6a847 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:06.164634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c2b25-43ce-4bbb-aa7f-301546f6a847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:06.166684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c2b25-43ce-4bbb-aa7f-301546f6a847 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:06.171846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0baada05-a1b9-4ac9-874d-f4f9425bbc2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6c306250894218beb6237484e73365'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:06.173009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0baada05-a1b9-4ac9-874d-f4f9425bbc2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6c306250894218beb6237484e73365'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:06.174854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:06.190277 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3551/7160] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:06.193346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0baada05-a1b9-4ac9-874d-f4f9425bbc2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6c306250894218beb6237484e73365'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:06.194596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0baada05-a1b9-4ac9-874d-f4f9425bbc2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6c306250894218beb6237484e73365'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:06.197567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c2b25-43ce-4bbb-aa7f-301546f6a847 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:06.209067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4a3c2b25-43ce-4bbb-aa7f-301546f6a847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:06.225288 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3610/7161] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:05 2022] DELETE /identity/v3/users/4d6c306250894218beb6237484e73365 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:29:06.226268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baada05-a1b9-4ac9-874d-f4f9425bbc2b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:06.227813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0baada05-a1b9-4ac9-874d-f4f9425bbc2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:06.238780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c2b25-43ce-4bbb-aa7f-301546f6a847 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:06.335062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baada05-a1b9-4ac9-874d-f4f9425bbc2b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:06.339597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c73b2-d290-4064-9b49-567436d005d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:06.340632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c73b2-d290-4064-9b49-567436d005d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:06.341379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c73b2-d290-4064-9b49-567436d005d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:06.342431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c73b2-d290-4064-9b49-567436d005d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:06.343503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c73b2-d290-4064-9b49-567436d005d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:06.346089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c73b2-d290-4064-9b49-567436d005d6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:06.352284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464c3d1-adac-4c07-868d-f34b6ef76546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:06.352968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464c3d1-adac-4c07-868d-f34b6ef76546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:06.353252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464c3d1-adac-4c07-868d-f34b6ef76546 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:06.353532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464c3d1-adac-4c07-868d-f34b6ef76546 admin admin] PATH_INFO: `/v3/users/c5b99eba81444a7b9cc59e73898c65af` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:06.355008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:06.355441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464c3d1-adac-4c07-868d-f34b6ef76546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5b99eba81444a7b9cc59e73898c65af)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:06.357940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464c3d1-adac-4c07-868d-f34b6ef76546 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:06.362295 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3552/7162] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:06.367899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fb73b-b36b-4b2e-b561-2b2be2cc1422 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:06.368860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fb73b-b36b-4b2e-b561-2b2be2cc1422 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:06.369352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fb73b-b36b-4b2e-b561-2b2be2cc1422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:06.426045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0f7fb73b-b36b-4b2e-b561-2b2be2cc1422 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:06.429476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0f7fb73b-b36b-4b2e-b561-2b2be2cc1422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:06.457258 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3553/7163] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:06.458325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fb73b-b36b-4b2e-b561-2b2be2cc1422 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:06.463848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4464c3d1-adac-4c07-868d-f34b6ef76546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5b99eba81444a7b9cc59e73898c65af'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:06.490212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fb73b-b36b-4b2e-b561-2b2be2cc1422 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:06.500217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4464c3d1-adac-4c07-868d-f34b6ef76546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5b99eba81444a7b9cc59e73898c65af'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:06.502473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4464c3d1-adac-4c07-868d-f34b6ef76546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5b99eba81444a7b9cc59e73898c65af'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:06.508216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc076e4-e46f-4b27-8e99-b17d78213373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:06.512108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc076e4-e46f-4b27-8e99-b17d78213373 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:06.512825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc076e4-e46f-4b27-8e99-b17d78213373 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:06.514441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc076e4-e46f-4b27-8e99-b17d78213373 admin admin] PATH_INFO: `/v3/projects/b7c4a2cde15e4fdb879e3a19edbe0ac6/users/4d514558cbc74e1fa8ec1420a39bcf05/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:06.517720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4464c3d1-adac-4c07-868d-f34b6ef76546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5b99eba81444a7b9cc59e73898c65af'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:06.522143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4464c3d1-adac-4c07-868d-f34b6ef76546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5b99eba81444a7b9cc59e73898c65af'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:06.547182 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3611/7164] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:06 2022] DELETE /identity/v3/users/c5b99eba81444a7b9cc59e73898c65af => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:06.548430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464c3d1-adac-4c07-868d-f34b6ef76546 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:06.550398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4464c3d1-adac-4c07-868d-f34b6ef76546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:06.569390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc076e4-e46f-4b27-8e99-b17d78213373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c4a2cde15e4fdb879e3a19edbe0ac6, user_id=4d514558cbc74e1fa8ec1420a39bcf05, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:06.572843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc076e4-e46f-4b27-8e99-b17d78213373 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:06.609818 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3554/7165] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:06 2022] PUT /identity/v3/projects/b7c4a2cde15e4fdb879e3a19edbe0ac6/users/4d514558cbc74e1fa8ec1420a39bcf05/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:06.620862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a46b51-63d8-406b-8312-85dc6faa3187 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:06.621587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a46b51-63d8-406b-8312-85dc6faa3187 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:06.622804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a46b51-63d8-406b-8312-85dc6faa3187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:06.677338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464c3d1-adac-4c07-868d-f34b6ef76546 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:06.695222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-49a46b51-63d8-406b-8312-85dc6faa3187 None None] MFA Rules not processed for user `4d514558cbc74e1fa8ec1420a39bcf05`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:06.698210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-49a46b51-63d8-406b-8312-85dc6faa3187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:06.712049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:06.804781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86544cc1-0230-457f-8b1b-e0d974388150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:06.805901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86544cc1-0230-457f-8b1b-e0d974388150 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:06.806046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86544cc1-0230-457f-8b1b-e0d974388150 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:06.806335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86544cc1-0230-457f-8b1b-e0d974388150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:06.811279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-86544cc1-0230-457f-8b1b-e0d974388150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:06.886024 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3555/7166] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:29:06.933303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a46b51-63d8-406b-8312-85dc6faa3187 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:06.940428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-49a46b51-63d8-406b-8312-85dc6faa3187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:07.080533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86544cc1-0230-457f-8b1b-e0d974388150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:07.082195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86544cc1-0230-457f-8b1b-e0d974388150 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:07.102333 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3612/7167] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:07.138022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86544cc1-0230-457f-8b1b-e0d974388150 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:07.140553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a46b51-63d8-406b-8312-85dc6faa3187 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:07.143519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-86544cc1-0230-457f-8b1b-e0d974388150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:07.154430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9c717-270e-4379-8969-513833b7be1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:07.155688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c717-270e-4379-8969-513833b7be1b service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:07.156218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c717-270e-4379-8969-513833b7be1b service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:07.156791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c717-270e-4379-8969-513833b7be1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:07.174929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9c717-270e-4379-8969-513833b7be1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:07.178201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9c717-270e-4379-8969-513833b7be1b service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:07.194411 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3556/7168] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:07.226328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86544cc1-0230-457f-8b1b-e0d974388150 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:07.232183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9c717-270e-4379-8969-513833b7be1b service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:07.235102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-21f9c717-270e-4379-8969-513833b7be1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:07.248046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26a26b-e484-427e-9ec6-8ed9002ae9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:07.249949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26a26b-e484-427e-9ec6-8ed9002ae9e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:07.250092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26a26b-e484-427e-9ec6-8ed9002ae9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:07.252297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26a26b-e484-427e-9ec6-8ed9002ae9e5 admin admin] PATH_INFO: `/v3/projects/837cee2339bd4feb9a571b38c0577add` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:07.255572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26a26b-e484-427e-9ec6-8ed9002ae9e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=837cee2339bd4feb9a571b38c0577add)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:07.258739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26a26b-e484-427e-9ec6-8ed9002ae9e5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:07.282675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9c717-270e-4379-8969-513833b7be1b service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:07.301140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b0ba9-e6a8-4d64-9524-1e8b573f58a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:07.301863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b0ba9-e6a8-4d64-9524-1e8b573f58a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:07.302299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b0ba9-e6a8-4d64-9524-1e8b573f58a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:07.303700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b0ba9-e6a8-4d64-9524-1e8b573f58a0 admin admin] PATH_INFO: `/v3/users/4d514558cbc74e1fa8ec1420a39bcf05` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:07.308473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b0ba9-e6a8-4d64-9524-1e8b573f58a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d514558cbc74e1fa8ec1420a39bcf05)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:07.315514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b0ba9-e6a8-4d64-9524-1e8b573f58a0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:07.358077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-aa26a26b-e484-427e-9ec6-8ed9002ae9e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '837cee2339bd4feb9a571b38c0577add', 'request_id': 'req-aa26a26b-e484-427e-9ec6-8ed9002ae9e5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:07.383379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-aa26a26b-e484-427e-9ec6-8ed9002ae9e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '837cee2339bd4feb9a571b38c0577add', 'request_id': 'req-aa26a26b-e484-427e-9ec6-8ed9002ae9e5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:07.406975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-aa26a26b-e484-427e-9ec6-8ed9002ae9e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '837cee2339bd4feb9a571b38c0577add', 'request_id': 'req-aa26a26b-e484-427e-9ec6-8ed9002ae9e5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:07.443528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dc9b0ba9-e6a8-4d64-9524-1e8b573f58a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d514558cbc74e1fa8ec1420a39bcf05'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:07.445200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-aa26a26b-e484-427e-9ec6-8ed9002ae9e5 admin admin] The token cache is being invalidate because project 837cee2339bd4feb9a571b38c0577add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:07.445554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-aa26a26b-e484-427e-9ec6-8ed9002ae9e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:07.447731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-aa26a26b-e484-427e-9ec6-8ed9002ae9e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:07.448311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dc9b0ba9-e6a8-4d64-9524-1e8b573f58a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d514558cbc74e1fa8ec1420a39bcf05'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:07.453101 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3613/7169] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:07 2022] DELETE /identity/v3/projects/837cee2339bd4feb9a571b38c0577add => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:07.459120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd63b60-9c2f-498f-bbf5-4577cab2aee5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:07.459593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd63b60-9c2f-498f-bbf5-4577cab2aee5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:07.459883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd63b60-9c2f-498f-bbf5-4577cab2aee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:07.464304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:07.478026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dc9b0ba9-e6a8-4d64-9524-1e8b573f58a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d514558cbc74e1fa8ec1420a39bcf05'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:07.480703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dc9b0ba9-e6a8-4d64-9524-1e8b573f58a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d514558cbc74e1fa8ec1420a39bcf05'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:07.491103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dc9b0ba9-e6a8-4d64-9524-1e8b573f58a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d514558cbc74e1fa8ec1420a39bcf05'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:07.493964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9dd63b60-9c2f-498f-bbf5-4577cab2aee5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:07.496375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9dd63b60-9c2f-498f-bbf5-4577cab2aee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:07.534035 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3557/7170] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:07 2022] DELETE /identity/v3/users/4d514558cbc74e1fa8ec1420a39bcf05 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:07.539970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a5df1-121f-4a80-bbcb-d81249325922 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:07.540328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a5df1-121f-4a80-bbcb-d81249325922 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:07.540870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a5df1-121f-4a80-bbcb-d81249325922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:07.565372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:07.568388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d14a5df1-121f-4a80-bbcb-d81249325922 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:07.569957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d14a5df1-121f-4a80-bbcb-d81249325922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:07.593099 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3614/7171] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:07.595650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d81259-652b-477a-8519-2430c534740e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:07.596126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d81259-652b-477a-8519-2430c534740e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:07.596636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d81259-652b-477a-8519-2430c534740e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:07.625172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-54d81259-652b-477a-8519-2430c534740e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:07.626780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-54d81259-652b-477a-8519-2430c534740e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:07.698967 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3558/7172] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:07.700675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a5df1-121f-4a80-bbcb-d81249325922 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:07.702051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d14a5df1-121f-4a80-bbcb-d81249325922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:07.728602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a5df1-121f-4a80-bbcb-d81249325922 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:07.730885 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3615/7173] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:07.731845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d81259-652b-477a-8519-2430c534740e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:07.733367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-54d81259-652b-477a-8519-2430c534740e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:07.739396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766351d-33e9-437e-9a3b-fe73b9b83ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:07.740855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766351d-33e9-437e-9a3b-fe73b9b83ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:07.741249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766351d-33e9-437e-9a3b-fe73b9b83ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:07.741857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766351d-33e9-437e-9a3b-fe73b9b83ce3 admin admin] PATH_INFO: `/v3/projects/73cd25ed83c3432e94d8045621225ad4` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:07.743134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766351d-33e9-437e-9a3b-fe73b9b83ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73cd25ed83c3432e94d8045621225ad4)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:07.747385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766351d-33e9-437e-9a3b-fe73b9b83ce3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:07.805817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d81259-652b-477a-8519-2430c534740e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:07.806064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1766351d-33e9-437e-9a3b-fe73b9b83ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73cd25ed83c3432e94d8045621225ad4', 'request_id': 'req-1766351d-33e9-437e-9a3b-fe73b9b83ce3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:07.815600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1766351d-33e9-437e-9a3b-fe73b9b83ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73cd25ed83c3432e94d8045621225ad4', 'request_id': 'req-1766351d-33e9-437e-9a3b-fe73b9b83ce3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:07.823028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1766351d-33e9-437e-9a3b-fe73b9b83ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73cd25ed83c3432e94d8045621225ad4', 'request_id': 'req-1766351d-33e9-437e-9a3b-fe73b9b83ce3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:07.835709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1766351d-33e9-437e-9a3b-fe73b9b83ce3 admin admin] The token cache is being invalidate because project 73cd25ed83c3432e94d8045621225ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:07.836473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1766351d-33e9-437e-9a3b-fe73b9b83ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:07.836836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1766351d-33e9-437e-9a3b-fe73b9b83ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:07.842181 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3559/7174] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:07 2022] DELETE /identity/v3/projects/73cd25ed83c3432e94d8045621225ad4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:07.843051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766351d-33e9-437e-9a3b-fe73b9b83ce3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:07.844604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1766351d-33e9-437e-9a3b-fe73b9b83ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:07.870945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b12bb-ecef-4a7f-9fe5-26f7e06d9afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:07.872343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b12bb-ecef-4a7f-9fe5-26f7e06d9afb service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:07.873401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b12bb-ecef-4a7f-9fe5-26f7e06d9afb service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:07.873401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b12bb-ecef-4a7f-9fe5-26f7e06d9afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:07.875441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-034b12bb-ecef-4a7f-9fe5-26f7e06d9afb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:07.926947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:07.936012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766351d-33e9-437e-9a3b-fe73b9b83ce3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:07.943985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf578a2a-69bb-4a2e-9b00-cd70a435569a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:07.944730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf578a2a-69bb-4a2e-9b00-cd70a435569a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:07.946125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf578a2a-69bb-4a2e-9b00-cd70a435569a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:07.946811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf578a2a-69bb-4a2e-9b00-cd70a435569a admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:07.948084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf578a2a-69bb-4a2e-9b00-cd70a435569a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:29:07.949568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf578a2a-69bb-4a2e-9b00-cd70a435569a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:07.951338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf578a2a-69bb-4a2e-9b00-cd70a435569a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:07.970188 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3560/7175] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:29:07.973155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5068d54-46b3-4439-a0a7-5831470eb5f1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:07.973532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5068d54-46b3-4439-a0a7-5831470eb5f1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:07.973657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5068d54-46b3-4439-a0a7-5831470eb5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:08.009751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e5068d54-46b3-4439-a0a7-5831470eb5f1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:08.011500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e5068d54-46b3-4439-a0a7-5831470eb5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:08.020638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b12bb-ecef-4a7f-9fe5-26f7e06d9afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:08.022078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b12bb-ecef-4a7f-9fe5-26f7e06d9afb service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:08.029901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:08.031472 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3561/7176] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:08.032592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5068d54-46b3-4439-a0a7-5831470eb5f1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:08.037275 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3616/7177] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:08.039238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a6001-b588-4c2d-89d5-df270bb95238 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:08.039553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a6001-b588-4c2d-89d5-df270bb95238 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:08.039806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a6001-b588-4c2d-89d5-df270bb95238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:08.047626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5068d54-46b3-4439-a0a7-5831470eb5f1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:08.054804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fbeab-a98a-4893-8835-9ea8fcdd0a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:08.055841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fbeab-a98a-4893-8835-9ea8fcdd0a6e admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:08.056226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fbeab-a98a-4893-8835-9ea8fcdd0a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:08.056984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fbeab-a98a-4893-8835-9ea8fcdd0a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:08.057557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fbeab-a98a-4893-8835-9ea8fcdd0a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:08.061614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fbeab-a98a-4893-8835-9ea8fcdd0a6e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:08.105306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8d4a6001-b588-4c2d-89d5-df270bb95238 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:08.110017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8d4a6001-b588-4c2d-89d5-df270bb95238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:08.130725 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3562/7178] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:08 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:08.136351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fbeab-a98a-4893-8835-9ea8fcdd0a6e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:08.145243 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3617/7179] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:08.153477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a6001-b588-4c2d-89d5-df270bb95238 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:08.170492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a6001-b588-4c2d-89d5-df270bb95238 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:08.257486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fbeab-a98a-4893-8835-9ea8fcdd0a6e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:08.277468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b24ac7-671f-433c-ace0-2ac5349754b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:08.281908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b24ac7-671f-433c-ace0-2ac5349754b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:08.282971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b24ac7-671f-433c-ace0-2ac5349754b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:08.283270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b24ac7-671f-433c-ace0-2ac5349754b3 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:08.285006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b24ac7-671f-433c-ace0-2ac5349754b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:08.289031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b24ac7-671f-433c-ace0-2ac5349754b3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:08.329234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9779a-5247-4b57-95fd-d9a6c13535a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:08.330426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9779a-5247-4b57-95fd-d9a6c13535a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:08.330865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9779a-5247-4b57-95fd-d9a6c13535a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:08.331395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9779a-5247-4b57-95fd-d9a6c13535a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:08.332373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9779a-5247-4b57-95fd-d9a6c13535a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:29:08.333461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9779a-5247-4b57-95fd-d9a6c13535a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:08.338353 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3563/7180] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:08 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:08.339132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9779a-5247-4b57-95fd-d9a6c13535a1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:08.340135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b24ac7-671f-433c-ace0-2ac5349754b3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:08.356918 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3618/7181] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:29:08.361380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9779a-5247-4b57-95fd-d9a6c13535a1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:08.374965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b24ac7-671f-433c-ace0-2ac5349754b3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:08.375583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9779a-5247-4b57-95fd-d9a6c13535a1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:08.382207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71625a-4a4e-4648-8ad6-69c53f5950d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:08.383465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71625a-4a4e-4648-8ad6-69c53f5950d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:08.383600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee3630-1a72-43b3-be42-76cde482b9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:08.384121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71625a-4a4e-4648-8ad6-69c53f5950d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:08.384386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee3630-1a72-43b3-be42-76cde482b9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:08.384791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71625a-4a4e-4648-8ad6-69c53f5950d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:08.385536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee3630-1a72-43b3-be42-76cde482b9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:08.386008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee3630-1a72-43b3-be42-76cde482b9a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:08.386362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71625a-4a4e-4648-8ad6-69c53f5950d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:08.386846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee3630-1a72-43b3-be42-76cde482b9a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:08.388765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71625a-4a4e-4648-8ad6-69c53f5950d1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:08.389976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee3630-1a72-43b3-be42-76cde482b9a3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:08.406757 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3564/7182] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:08.408534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71625a-4a4e-4648-8ad6-69c53f5950d1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:08.439069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71625a-4a4e-4648-8ad6-69c53f5950d1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:08.448813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79effaf-109e-4d11-aa37-44b86c45adce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:08.451146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79effaf-109e-4d11-aa37-44b86c45adce admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:08.451851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79effaf-109e-4d11-aa37-44b86c45adce admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:08.453663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79effaf-109e-4d11-aa37-44b86c45adce admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:08.455846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79effaf-109e-4d11-aa37-44b86c45adce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:08.458759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79effaf-109e-4d11-aa37-44b86c45adce admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:08.466081 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3619/7183] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:08 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:08.467381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee3630-1a72-43b3-be42-76cde482b9a3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:08.468996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b6ee3630-1a72-43b3-be42-76cde482b9a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:08.487727 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3565/7184] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:08.488863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79effaf-109e-4d11-aa37-44b86c45adce admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:08.507381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79effaf-109e-4d11-aa37-44b86c45adce admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:08.583021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bc8e0-9412-46ab-a0c7-ae5db008b9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:08.585524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bc8e0-9412-46ab-a0c7-ae5db008b9d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:08.585822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bc8e0-9412-46ab-a0c7-ae5db008b9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:08.586834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bc8e0-9412-46ab-a0c7-ae5db008b9d8 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:08.587584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7bc8e0-9412-46ab-a0c7-ae5db008b9d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:08.590028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7bc8e0-9412-46ab-a0c7-ae5db008b9d8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:08.595413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee3630-1a72-43b3-be42-76cde482b9a3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:08.610278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237d0f2-1bc3-4f87-9a77-a6d0a07d4eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:08.610958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237d0f2-1bc3-4f87-9a77-a6d0a07d4eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:08.611329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237d0f2-1bc3-4f87-9a77-a6d0a07d4eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:08.611842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237d0f2-1bc3-4f87-9a77-a6d0a07d4eb1 admin admin] PATH_INFO: `/v3/users/db01f9802e8147b8bdabfc9bbbbd7bb3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:08.613427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237d0f2-1bc3-4f87-9a77-a6d0a07d4eb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db01f9802e8147b8bdabfc9bbbbd7bb3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:08.615913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237d0f2-1bc3-4f87-9a77-a6d0a07d4eb1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:08.616397 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3566/7185] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:08 2022] POST /identity/v3/users => generated 285 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:08.617434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bc8e0-9412-46ab-a0c7-ae5db008b9d8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:08.640779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bc8e0-9412-46ab-a0c7-ae5db008b9d8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:08.647595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fb881-0b5e-43d9-ad75-6a2ed3520e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:08.648400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fb881-0b5e-43d9-ad75-6a2ed3520e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:08.649035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fb881-0b5e-43d9-ad75-6a2ed3520e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:08.649267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fb881-0b5e-43d9-ad75-6a2ed3520e5a admin admin] PATH_INFO: `/v3/projects/d54b597e808b4b8594adb5db00e45030/users/f1b1a5390fd6434f86e89125cd4b324c/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:08.676552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fb881-0b5e-43d9-ad75-6a2ed3520e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54b597e808b4b8594adb5db00e45030, user_id=f1b1a5390fd6434f86e89125cd4b324c, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:08.679651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fb881-0b5e-43d9-ad75-6a2ed3520e5a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:08.688585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:08.706144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8237d0f2-1bc3-4f87-9a77-a6d0a07d4eb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db01f9802e8147b8bdabfc9bbbbd7bb3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:08.715026 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3567/7186] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:08 2022] PUT /identity/v3/projects/d54b597e808b4b8594adb5db00e45030/users/f1b1a5390fd6434f86e89125cd4b324c/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:08.721029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fb881-0b5e-43d9-ad75-6a2ed3520e5a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:08.721665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8237d0f2-1bc3-4f87-9a77-a6d0a07d4eb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db01f9802e8147b8bdabfc9bbbbd7bb3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:08.722725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8237d0f2-1bc3-4f87-9a77-a6d0a07d4eb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db01f9802e8147b8bdabfc9bbbbd7bb3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:08.724437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:08.734799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8237d0f2-1bc3-4f87-9a77-a6d0a07d4eb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db01f9802e8147b8bdabfc9bbbbd7bb3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:08.736234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8237d0f2-1bc3-4f87-9a77-a6d0a07d4eb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db01f9802e8147b8bdabfc9bbbbd7bb3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:08.752998 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3620/7187] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:08 2022] DELETE /identity/v3/users/db01f9802e8147b8bdabfc9bbbbd7bb3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:08.755418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237d0f2-1bc3-4f87-9a77-a6d0a07d4eb1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:08.755418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8237d0f2-1bc3-4f87-9a77-a6d0a07d4eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:08.810796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fb881-0b5e-43d9-ad75-6a2ed3520e5a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:08.853189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237d0f2-1bc3-4f87-9a77-a6d0a07d4eb1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:08.859434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ceee32-9add-4c06-a9d5-e2757f567007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:08.860120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceee32-9add-4c06-a9d5-e2757f567007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:08.860410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceee32-9add-4c06-a9d5-e2757f567007 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:08.860876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceee32-9add-4c06-a9d5-e2757f567007 admin admin] PATH_INFO: `/v3/projects/b7c4a2cde15e4fdb879e3a19edbe0ac6` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:08.862101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ceee32-9add-4c06-a9d5-e2757f567007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c4a2cde15e4fdb879e3a19edbe0ac6)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:08.864773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ceee32-9add-4c06-a9d5-e2757f567007 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:08.884840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad8fbc-7f7d-48af-9d48-f4cecd777c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:08.885499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad8fbc-7f7d-48af-9d48-f4cecd777c76 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:08.885788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad8fbc-7f7d-48af-9d48-f4cecd777c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:08.886590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad8fbc-7f7d-48af-9d48-f4cecd777c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:08.887865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad8fbc-7f7d-48af-9d48-f4cecd777c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:08.889611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad8fbc-7f7d-48af-9d48-f4cecd777c76 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:08.905829 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3568/7188] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:08.907236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad8fbc-7f7d-48af-9d48-f4cecd777c76 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:08.917297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9aad8fbc-7f7d-48af-9d48-f4cecd777c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:08.938592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad8fbc-7f7d-48af-9d48-f4cecd777c76 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:08.949623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-71ceee32-9add-4c06-a9d5-e2757f567007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c4a2cde15e4fdb879e3a19edbe0ac6', 'request_id': 'req-71ceee32-9add-4c06-a9d5-e2757f567007'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:08.958410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-71ceee32-9add-4c06-a9d5-e2757f567007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c4a2cde15e4fdb879e3a19edbe0ac6', 'request_id': 'req-71ceee32-9add-4c06-a9d5-e2757f567007'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:08.970980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-71ceee32-9add-4c06-a9d5-e2757f567007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c4a2cde15e4fdb879e3a19edbe0ac6', 'request_id': 'req-71ceee32-9add-4c06-a9d5-e2757f567007'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:08.986097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-71ceee32-9add-4c06-a9d5-e2757f567007 admin admin] The token cache is being invalidate because project b7c4a2cde15e4fdb879e3a19edbe0ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:08.986522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-71ceee32-9add-4c06-a9d5-e2757f567007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:08.988273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-71ceee32-9add-4c06-a9d5-e2757f567007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:08.989935 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3621/7189] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:08 2022] DELETE /identity/v3/projects/b7c4a2cde15e4fdb879e3a19edbe0ac6 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:08.991364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2e634-a465-45a5-96d0-9d7b056eb7b2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:08.991666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2e634-a465-45a5-96d0-9d7b056eb7b2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:08.991948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2e634-a465-45a5-96d0-9d7b056eb7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:09.016650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-85e2e634-a465-45a5-96d0-9d7b056eb7b2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:09.018087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-85e2e634-a465-45a5-96d0-9d7b056eb7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:09.025432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c7274-1e88-4382-971e-5042d8638d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:09.026182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c7274-1e88-4382-971e-5042d8638d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:09.026478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c7274-1e88-4382-971e-5042d8638d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:09.027110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c7274-1e88-4382-971e-5042d8638d5b admin admin] PATH_INFO: `/v3/users/e0d7d5bc71154c04a2966aafc81d80c5` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:09.029703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c7274-1e88-4382-971e-5042d8638d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d7d5bc71154c04a2966aafc81d80c5)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:09.031994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c7274-1e88-4382-971e-5042d8638d5b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:09.096004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=1,keystone:SELECT=94,keystone:DELETE=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:09.123462 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3622/7190] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:09.125217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c05c7274-1e88-4382-971e-5042d8638d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d7d5bc71154c04a2966aafc81d80c5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:09.126067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c05c7274-1e88-4382-971e-5042d8638d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d7d5bc71154c04a2966aafc81d80c5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:09.127556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2e634-a465-45a5-96d0-9d7b056eb7b2 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:09.132806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-85e2e634-a465-45a5-96d0-9d7b056eb7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:09.159048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2e634-a465-45a5-96d0-9d7b056eb7b2 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:09.169179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fe4a8-560c-4d97-9c3e-f8e75c376638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:09.170158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fe4a8-560c-4d97-9c3e-f8e75c376638 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:09.170623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fe4a8-560c-4d97-9c3e-f8e75c376638 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:09.170911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fe4a8-560c-4d97-9c3e-f8e75c376638 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:09.171927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fe4a8-560c-4d97-9c3e-f8e75c376638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:09.173835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fe4a8-560c-4d97-9c3e-f8e75c376638 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:09.183878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c05c7274-1e88-4382-971e-5042d8638d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d7d5bc71154c04a2966aafc81d80c5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:09.185422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c05c7274-1e88-4382-971e-5042d8638d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d7d5bc71154c04a2966aafc81d80c5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:09.192963 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3623/7191] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:09.192963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb4f1a-e99e-414b-841a-56d62031d476 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:09.192963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb4f1a-e99e-414b-841a-56d62031d476 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:09.192963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb4f1a-e99e-414b-841a-56d62031d476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:09.198365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c05c7274-1e88-4382-971e-5042d8638d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d7d5bc71154c04a2966aafc81d80c5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:09.201793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:09.215960 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3569/7192] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:08 2022] DELETE /identity/v3/users/e0d7d5bc71154c04a2966aafc81d80c5 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:09.217580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c7274-1e88-4382-971e-5042d8638d5b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:09.220699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c05c7274-1e88-4382-971e-5042d8638d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:09.226247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-cfeb4f1a-e99e-414b-841a-56d62031d476 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:09.230047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cfeb4f1a-e99e-414b-841a-56d62031d476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:09.322207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c7274-1e88-4382-971e-5042d8638d5b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:09.329501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605fb71-9b2b-4a45-9ecf-92630b67cee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:09.330572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605fb71-9b2b-4a45-9ecf-92630b67cee9 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:09.330979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605fb71-9b2b-4a45-9ecf-92630b67cee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:09.331510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605fb71-9b2b-4a45-9ecf-92630b67cee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:09.334382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1605fb71-9b2b-4a45-9ecf-92630b67cee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:09.370368 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3624/7193] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:09.371345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb4f1a-e99e-414b-841a-56d62031d476 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:09.373681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cfeb4f1a-e99e-414b-841a-56d62031d476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:09.395868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb4f1a-e99e-414b-841a-56d62031d476 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:09.404107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5610d-9363-4d2c-86ce-601b12c7acbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:09.404922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5610d-9363-4d2c-86ce-601b12c7acbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:09.405222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5610d-9363-4d2c-86ce-601b12c7acbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:09.405486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5610d-9363-4d2c-86ce-601b12c7acbb admin admin] PATH_INFO: `/v3/projects/418ff359f7a747e58ae4fdf0c4b7072a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:09.407533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5610d-9363-4d2c-86ce-601b12c7acbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=418ff359f7a747e58ae4fdf0c4b7072a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:09.408865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5610d-9363-4d2c-86ce-601b12c7acbb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:09.459001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605fb71-9b2b-4a45-9ecf-92630b67cee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:09.460835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605fb71-9b2b-4a45-9ecf-92630b67cee9 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:09.473435 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3570/7194] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:09.474732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605fb71-9b2b-4a45-9ecf-92630b67cee9 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:09.476362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1605fb71-9b2b-4a45-9ecf-92630b67cee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:09.477922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4fd5610d-9363-4d2c-86ce-601b12c7acbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '418ff359f7a747e58ae4fdf0c4b7072a', 'request_id': 'req-4fd5610d-9363-4d2c-86ce-601b12c7acbb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:09.485925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4fd5610d-9363-4d2c-86ce-601b12c7acbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '418ff359f7a747e58ae4fdf0c4b7072a', 'request_id': 'req-4fd5610d-9363-4d2c-86ce-601b12c7acbb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:09.490404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605fb71-9b2b-4a45-9ecf-92630b67cee9 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:09.499151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4fd5610d-9363-4d2c-86ce-601b12c7acbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '418ff359f7a747e58ae4fdf0c4b7072a', 'request_id': 'req-4fd5610d-9363-4d2c-86ce-601b12c7acbb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:09.520773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4fd5610d-9363-4d2c-86ce-601b12c7acbb admin admin] The token cache is being invalidate because project 418ff359f7a747e58ae4fdf0c4b7072a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:09.522221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4fd5610d-9363-4d2c-86ce-601b12c7acbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:09.523971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4fd5610d-9363-4d2c-86ce-601b12c7acbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:09.529449 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3625/7195] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:09 2022] DELETE /identity/v3/projects/418ff359f7a747e58ae4fdf0c4b7072a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:09.530766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b611ac-565d-48b6-9f68-0cb720f1a19e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:09.534356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b611ac-565d-48b6-9f68-0cb720f1a19e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:09.534356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b611ac-565d-48b6-9f68-0cb720f1a19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:09.557578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e1b611ac-565d-48b6-9f68-0cb720f1a19e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:09.559642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e1b611ac-565d-48b6-9f68-0cb720f1a19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:09.607681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d342c60-cf85-45a1-98cf-e10bfed3b630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:09.608523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d342c60-cf85-45a1-98cf-e10bfed3b630 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:09.608812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d342c60-cf85-45a1-98cf-e10bfed3b630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:09.609438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d342c60-cf85-45a1-98cf-e10bfed3b630 admin admin] PATH_INFO: `/v3/projects/f071f5eb3ec3467087821e72dbc5df6c/users/912871ba807e4fe1a6f59395cb37c98b/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:09.638021 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3626/7196] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:09.638021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fd097-da2b-4b4a-a3b1-55af91a516bb None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:09.638021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fd097-da2b-4b4a-a3b1-55af91a516bb None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:09.638021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fd097-da2b-4b4a-a3b1-55af91a516bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:09.645423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:09.649713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d342c60-cf85-45a1-98cf-e10bfed3b630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f071f5eb3ec3467087821e72dbc5df6c, user_id=912871ba807e4fe1a6f59395cb37c98b, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:09.652599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d342c60-cf85-45a1-98cf-e10bfed3b630 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:09.659398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-077fd097-da2b-4b4a-a3b1-55af91a516bb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:09.660633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-077fd097-da2b-4b4a-a3b1-55af91a516bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:09.679737 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3571/7197] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:09 2022] PUT /identity/v3/projects/f071f5eb3ec3467087821e72dbc5df6c/users/912871ba807e4fe1a6f59395cb37c98b/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:09.680639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d342c60-cf85-45a1-98cf-e10bfed3b630 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:09.681756 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3627/7198] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:09.682963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fd097-da2b-4b4a-a3b1-55af91a516bb None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:09.684272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6d342c60-cf85-45a1-98cf-e10bfed3b630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:09.687711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-077fd097-da2b-4b4a-a3b1-55af91a516bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:09.729535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:09.800128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fd097-da2b-4b4a-a3b1-55af91a516bb None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:09.842682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d342c60-cf85-45a1-98cf-e10bfed3b630 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:09.860738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517fefe-81d5-497d-94f0-8e51ac5e71e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:09.862538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517fefe-81d5-497d-94f0-8e51ac5e71e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:09.865591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517fefe-81d5-497d-94f0-8e51ac5e71e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:09.865591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517fefe-81d5-497d-94f0-8e51ac5e71e2 admin admin] PATH_INFO: `/v3/users/758faa3952e342fb8ace9f4ead92f030` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:09.865933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517fefe-81d5-497d-94f0-8e51ac5e71e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=758faa3952e342fb8ace9f4ead92f030)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:09.873747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517fefe-81d5-497d-94f0-8e51ac5e71e2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:09.916366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8bd8f-3971-483d-800f-351023582572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:09.917056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8bd8f-3971-483d-800f-351023582572 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:09.917349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8bd8f-3971-483d-800f-351023582572 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:09.917635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8bd8f-3971-483d-800f-351023582572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:09.942769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8bd8f-3971-483d-800f-351023582572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:09.945309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8bd8f-3971-483d-800f-351023582572 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:09.963731 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3628/7199] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:09.965185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8bd8f-3971-483d-800f-351023582572 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:09.979525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8bd8f-3971-483d-800f-351023582572 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:09.987848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b8b7c-37b0-4c1b-94e1-5a7872c39e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:09.988532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b8b7c-37b0-4c1b-94e1-5a7872c39e65 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:09.988776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b8b7c-37b0-4c1b-94e1-5a7872c39e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:09.989016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b8b7c-37b0-4c1b-94e1-5a7872c39e65 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:09.989986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b8b7c-37b0-4c1b-94e1-5a7872c39e65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:29:09.990501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b8b7c-37b0-4c1b-94e1-5a7872c39e65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:09.993592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b8b7c-37b0-4c1b-94e1-5a7872c39e65 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:09.995527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d517fefe-81d5-497d-94f0-8e51ac5e71e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '758faa3952e342fb8ace9f4ead92f030'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:09.997651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d517fefe-81d5-497d-94f0-8e51ac5e71e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '758faa3952e342fb8ace9f4ead92f030'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:10.013530 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3629/7200] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:29:10.013530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100835ad-2543-423f-80f5-be9d9775739c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:10.013530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100835ad-2543-423f-80f5-be9d9775739c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:10.013530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100835ad-2543-423f-80f5-be9d9775739c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:10.031745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d517fefe-81d5-497d-94f0-8e51ac5e71e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '758faa3952e342fb8ace9f4ead92f030'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:10.032717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d517fefe-81d5-497d-94f0-8e51ac5e71e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '758faa3952e342fb8ace9f4ead92f030'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:10.046002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d517fefe-81d5-497d-94f0-8e51ac5e71e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '758faa3952e342fb8ace9f4ead92f030'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:10.060727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-100835ad-2543-423f-80f5-be9d9775739c None None] MFA Rules not processed for user `912871ba807e4fe1a6f59395cb37c98b`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:10.063459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-100835ad-2543-423f-80f5-be9d9775739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:10.064189 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3572/7201] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:09 2022] DELETE /identity/v3/users/758faa3952e342fb8ace9f4ead92f030 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:10.065809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517fefe-81d5-497d-94f0-8e51ac5e71e2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:10.067721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d517fefe-81d5-497d-94f0-8e51ac5e71e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:10.209141 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3630/7202] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:10.230328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517fefe-81d5-497d-94f0-8e51ac5e71e2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:10.237731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a2a9f-4efb-49cf-b76f-0598032dc9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:10.238482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a2a9f-4efb-49cf-b76f-0598032dc9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:10.238781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a2a9f-4efb-49cf-b76f-0598032dc9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:10.239115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a2a9f-4efb-49cf-b76f-0598032dc9b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:10.240050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a2a9f-4efb-49cf-b76f-0598032dc9b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:10.242143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a2a9f-4efb-49cf-b76f-0598032dc9b0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:10.246009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100835ad-2543-423f-80f5-be9d9775739c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:10.247723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-100835ad-2543-423f-80f5-be9d9775739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:10.291971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:10.320632 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3573/7203] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:10 2022] POST /identity/v3/projects => generated 377 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:10.325749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a2a9f-4efb-49cf-b76f-0598032dc9b0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:10.389944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100835ad-2543-423f-80f5-be9d9775739c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:10.415384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:10.424206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a2a9f-4efb-49cf-b76f-0598032dc9b0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:10.436570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b7c25-0ce3-432c-ad26-78c28f5a3cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:10.437640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b7c25-0ce3-432c-ad26-78c28f5a3cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:10.438122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b7c25-0ce3-432c-ad26-78c28f5a3cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:10.438470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b7c25-0ce3-432c-ad26-78c28f5a3cf6 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:10.439314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b7c25-0ce3-432c-ad26-78c28f5a3cf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:10.441784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b7c25-0ce3-432c-ad26-78c28f5a3cf6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:10.495589 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3574/7204] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:10 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:10.499804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b7c25-0ce3-432c-ad26-78c28f5a3cf6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:10.522969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b7c25-0ce3-432c-ad26-78c28f5a3cf6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:10.523501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9dc70-da1d-4a26-9b34-4a2ba5ca67f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:10.524153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9dc70-da1d-4a26-9b34-4a2ba5ca67f6 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:10.524443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9dc70-da1d-4a26-9b34-4a2ba5ca67f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:10.524721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9dc70-da1d-4a26-9b34-4a2ba5ca67f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:10.533233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d27fa-c8ee-46ab-8715-bd69d7e10203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:10.535908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d27fa-c8ee-46ab-8715-bd69d7e10203 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:10.536488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d27fa-c8ee-46ab-8715-bd69d7e10203 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:10.537408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d27fa-c8ee-46ab-8715-bd69d7e10203 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:10.540223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d27fa-c8ee-46ab-8715-bd69d7e10203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:10.544216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d27fa-c8ee-46ab-8715-bd69d7e10203 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:10.575970 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3575/7205] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:29:10.575970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d27fa-c8ee-46ab-8715-bd69d7e10203 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:10.603784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d27fa-c8ee-46ab-8715-bd69d7e10203 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:10.610847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56afe0c-d589-460e-9378-b133725a9d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:10.612778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56afe0c-d589-460e-9378-b133725a9d96 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:10.613067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56afe0c-d589-460e-9378-b133725a9d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:10.613352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56afe0c-d589-460e-9378-b133725a9d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:10.614063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56afe0c-d589-460e-9378-b133725a9d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:10.616275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56afe0c-d589-460e-9378-b133725a9d96 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:10.630561 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3576/7206] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:10.636277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56afe0c-d589-460e-9378-b133725a9d96 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:10.655594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56afe0c-d589-460e-9378-b133725a9d96 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:10.657493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9dc70-da1d-4a26-9b34-4a2ba5ca67f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:10.659748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9dc70-da1d-4a26-9b34-4a2ba5ca67f6 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:10.673293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39822d-8ef4-4fb8-9e55-2e79bcd30145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:10.676566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39822d-8ef4-4fb8-9e55-2e79bcd30145 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:10.677065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39822d-8ef4-4fb8-9e55-2e79bcd30145 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:10.677871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39822d-8ef4-4fb8-9e55-2e79bcd30145 admin admin] PATH_INFO: `/v3/projects/375ed5fbd34c45e6898a93b2c96f1872/users/91df9f57cf2c4a579856c911e4d370d1/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:10.679216 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3631/7207] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:10.701423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39822d-8ef4-4fb8-9e55-2e79bcd30145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=375ed5fbd34c45e6898a93b2c96f1872, user_id=91df9f57cf2c4a579856c911e4d370d1, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:10.704630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39822d-8ef4-4fb8-9e55-2e79bcd30145 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:10.735337 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3577/7208] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:10 2022] PUT /identity/v3/projects/375ed5fbd34c45e6898a93b2c96f1872/users/91df9f57cf2c4a579856c911e4d370d1/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:10.740030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117e5db-5484-4b5e-a459-efb40d734bfe None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:10.740325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117e5db-5484-4b5e-a459-efb40d734bfe None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:10.740614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117e5db-5484-4b5e-a459-efb40d734bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:10.778943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c117e5db-5484-4b5e-a459-efb40d734bfe None None] MFA Rules not processed for user `91df9f57cf2c4a579856c911e4d370d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:10.780555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c117e5db-5484-4b5e-a459-efb40d734bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:10.872189 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3632/7209] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:10.884714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39822d-8ef4-4fb8-9e55-2e79bcd30145 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:10.894718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8c39822d-8ef4-4fb8-9e55-2e79bcd30145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:10.922284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117e5db-5484-4b5e-a459-efb40d734bfe None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:10.932570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c117e5db-5484-4b5e-a459-efb40d734bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:11.118124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39822d-8ef4-4fb8-9e55-2e79bcd30145 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:11.129847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae37630-3782-49f1-86b2-dc52c6981242 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:11.136771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae37630-3782-49f1-86b2-dc52c6981242 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:11.137485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae37630-3782-49f1-86b2-dc52c6981242 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:11.140613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae37630-3782-49f1-86b2-dc52c6981242 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:11.142081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:11.150831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117e5db-5484-4b5e-a459-efb40d734bfe None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:11.154001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae37630-3782-49f1-86b2-dc52c6981242 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:11.156424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae37630-3782-49f1-86b2-dc52c6981242 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:11.162809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f327cd-6635-47d4-98ac-8294f4a642e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:11.164852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f327cd-6635-47d4-98ac-8294f4a642e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:11.165343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f327cd-6635-47d4-98ac-8294f4a642e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:11.165875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f327cd-6635-47d4-98ac-8294f4a642e3 admin admin] PATH_INFO: `/v3/projects/bc794687868347bbbe6dc0a2873c9ea3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:11.167766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f327cd-6635-47d4-98ac-8294f4a642e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc794687868347bbbe6dc0a2873c9ea3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:11.177396 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3578/7210] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:11.185143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f327cd-6635-47d4-98ac-8294f4a642e3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:11.192084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae37630-3782-49f1-86b2-dc52c6981242 service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:11.194988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3ae37630-3782-49f1-86b2-dc52c6981242 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:11.259574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae37630-3782-49f1-86b2-dc52c6981242 service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:11.299964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-75f327cd-6635-47d4-98ac-8294f4a642e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc794687868347bbbe6dc0a2873c9ea3', 'request_id': 'req-75f327cd-6635-47d4-98ac-8294f4a642e3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:11.316595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-75f327cd-6635-47d4-98ac-8294f4a642e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc794687868347bbbe6dc0a2873c9ea3', 'request_id': 'req-75f327cd-6635-47d4-98ac-8294f4a642e3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:11.339904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-75f327cd-6635-47d4-98ac-8294f4a642e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc794687868347bbbe6dc0a2873c9ea3', 'request_id': 'req-75f327cd-6635-47d4-98ac-8294f4a642e3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:11.358530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-75f327cd-6635-47d4-98ac-8294f4a642e3 admin admin] The token cache is being invalidate because project bc794687868347bbbe6dc0a2873c9ea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:11.361967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-75f327cd-6635-47d4-98ac-8294f4a642e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:11.364212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:11.364859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-75f327cd-6635-47d4-98ac-8294f4a642e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:11.371087 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3633/7211] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:10 2022] DELETE /identity/v3/projects/bc794687868347bbbe6dc0a2873c9ea3 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:11.372713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cd9c8-f7a8-49f6-9a68-933e04afca5f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:11.373014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cd9c8-f7a8-49f6-9a68-933e04afca5f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:11.373314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cd9c8-f7a8-49f6-9a68-933e04afca5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:11.423883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0a0cd9c8-f7a8-49f6-9a68-933e04afca5f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:11.425142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0a0cd9c8-f7a8-49f6-9a68-933e04afca5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:11.427556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483a856-e152-4797-a938-ee6dac4a6adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:11.428301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483a856-e152-4797-a938-ee6dac4a6adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:11.428593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483a856-e152-4797-a938-ee6dac4a6adb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:11.428873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483a856-e152-4797-a938-ee6dac4a6adb admin admin] PATH_INFO: `/v3/projects/feefda34901f4756a13758920c53a1e6` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:11.431111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483a856-e152-4797-a938-ee6dac4a6adb admin admin] RBAC: Authorizing `identity:delete_project(project_id=feefda34901f4756a13758920c53a1e6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:11.433436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483a856-e152-4797-a938-ee6dac4a6adb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:11.459651 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3634/7212] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:11.461152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13137ca1-05e9-4a8f-ada1-d23677601865 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:11.461446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13137ca1-05e9-4a8f-ada1-d23677601865 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:11.461725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13137ca1-05e9-4a8f-ada1-d23677601865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:11.487025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-13137ca1-05e9-4a8f-ada1-d23677601865 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:11.488962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-13137ca1-05e9-4a8f-ada1-d23677601865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:11.504401 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3635/7213] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:11.505531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13137ca1-05e9-4a8f-ada1-d23677601865 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:11.520913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13137ca1-05e9-4a8f-ada1-d23677601865 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:11.529769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a1afe-c18f-45cc-8e22-252f82bd8ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:11.530808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a1afe-c18f-45cc-8e22-252f82bd8ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:11.531112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a1afe-c18f-45cc-8e22-252f82bd8ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:11.531429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a1afe-c18f-45cc-8e22-252f82bd8ef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:11.532677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a1afe-c18f-45cc-8e22-252f82bd8ef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:29:11.533109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a1afe-c18f-45cc-8e22-252f82bd8ef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:11.535272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a1afe-c18f-45cc-8e22-252f82bd8ef3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:11.560881 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3636/7214] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:29:11.562496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a1afe-c18f-45cc-8e22-252f82bd8ef3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:11.566449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f483a856-e152-4797-a938-ee6dac4a6adb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feefda34901f4756a13758920c53a1e6', 'request_id': 'req-f483a856-e152-4797-a938-ee6dac4a6adb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:11.580136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a1afe-c18f-45cc-8e22-252f82bd8ef3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:11.585720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f483a856-e152-4797-a938-ee6dac4a6adb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feefda34901f4756a13758920c53a1e6', 'request_id': 'req-f483a856-e152-4797-a938-ee6dac4a6adb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:11.595137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f483a856-e152-4797-a938-ee6dac4a6adb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feefda34901f4756a13758920c53a1e6', 'request_id': 'req-f483a856-e152-4797-a938-ee6dac4a6adb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:11.618109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f483a856-e152-4797-a938-ee6dac4a6adb admin admin] The token cache is being invalidate because project feefda34901f4756a13758920c53a1e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:11.618688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f483a856-e152-4797-a938-ee6dac4a6adb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:11.619466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f483a856-e152-4797-a938-ee6dac4a6adb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:11.621943 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3579/7215] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:11 2022] DELETE /identity/v3/projects/feefda34901f4756a13758920c53a1e6 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:11.630938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d78e34-ba73-4c99-9e42-a567c903159e None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:11.631337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d78e34-ba73-4c99-9e42-a567c903159e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:11.632075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d78e34-ba73-4c99-9e42-a567c903159e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:11.674326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-59d78e34-ba73-4c99-9e42-a567c903159e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:11.678569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-59d78e34-ba73-4c99-9e42-a567c903159e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:11.750017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ec4c2-126d-44d6-b578-1e7165b585d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:11.750746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ec4c2-126d-44d6-b578-1e7165b585d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:11.750949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ec4c2-126d-44d6-b578-1e7165b585d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:11.751226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ec4c2-126d-44d6-b578-1e7165b585d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:11.752799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ec4c2-126d-44d6-b578-1e7165b585d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:11.754755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ec4c2-126d-44d6-b578-1e7165b585d4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:11.818030 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3637/7216] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:11 2022] POST /identity/v3/projects => generated 375 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:11.820230 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3580/7217] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:11.828258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ec4c2-126d-44d6-b578-1e7165b585d4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:11.828807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99ad3e-f365-40b7-80b0-9d8a1cb9c88c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:11.830300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99ad3e-f365-40b7-80b0-9d8a1cb9c88c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:11.830674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99ad3e-f365-40b7-80b0-9d8a1cb9c88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:11.833854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3f7ec4c2-126d-44d6-b578-1e7165b585d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:11.873591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7f99ad3e-f365-40b7-80b0-9d8a1cb9c88c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:11.874894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7f99ad3e-f365-40b7-80b0-9d8a1cb9c88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:11.972279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:12.032334 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3581/7218] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:12.036329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99ad3e-f365-40b7-80b0-9d8a1cb9c88c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:12.046517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ec4c2-126d-44d6-b578-1e7165b585d4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:12.058201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653aedd-8d6a-4cb0-81b0-27d2a3ffe227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:12.061219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653aedd-8d6a-4cb0-81b0-27d2a3ffe227 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:12.061219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653aedd-8d6a-4cb0-81b0-27d2a3ffe227 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:12.061408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653aedd-8d6a-4cb0-81b0-27d2a3ffe227 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:12.062098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653aedd-8d6a-4cb0-81b0-27d2a3ffe227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:12.071255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653aedd-8d6a-4cb0-81b0-27d2a3ffe227 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:12.075993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99ad3e-f365-40b7-80b0-9d8a1cb9c88c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:12.098488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee3fcf-5dc7-49bb-8b00-7d398f0accb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:12.099507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee3fcf-5dc7-49bb-8b00-7d398f0accb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:12.100000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee3fcf-5dc7-49bb-8b00-7d398f0accb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:12.100433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee3fcf-5dc7-49bb-8b00-7d398f0accb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:12.101314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee3fcf-5dc7-49bb-8b00-7d398f0accb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:29:12.101780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee3fcf-5dc7-49bb-8b00-7d398f0accb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:12.106586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee3fcf-5dc7-49bb-8b00-7d398f0accb3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:12.124798 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3638/7219] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:11 2022] POST /identity/v3/users => generated 288 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:12.128635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:12.129946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653aedd-8d6a-4cb0-81b0-27d2a3ffe227 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:12.142651 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3582/7220] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:29:12.155268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee3fcf-5dc7-49bb-8b00-7d398f0accb3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:12.155833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653aedd-8d6a-4cb0-81b0-27d2a3ffe227 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:12.162406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925019a3-3122-4ee8-aa70-ecf8d5db2fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:12.162648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925019a3-3122-4ee8-aa70-ecf8d5db2fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:12.162947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925019a3-3122-4ee8-aa70-ecf8d5db2fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:12.163614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925019a3-3122-4ee8-aa70-ecf8d5db2fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:12.164393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925019a3-3122-4ee8-aa70-ecf8d5db2fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:12.166738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925019a3-3122-4ee8-aa70-ecf8d5db2fd3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:12.168703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee3fcf-5dc7-49bb-8b00-7d398f0accb3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:12.181197 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3639/7221] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:29:12.181952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701cbce-fb00-4d16-b799-7a93c7275cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:12.182602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701cbce-fb00-4d16-b799-7a93c7275cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:12.182889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701cbce-fb00-4d16-b799-7a93c7275cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:12.183168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701cbce-fb00-4d16-b799-7a93c7275cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:12.184847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701cbce-fb00-4d16-b799-7a93c7275cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:12.186607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925019a3-3122-4ee8-aa70-ecf8d5db2fd3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:12.191251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701cbce-fb00-4d16-b799-7a93c7275cb6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:12.199487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925019a3-3122-4ee8-aa70-ecf8d5db2fd3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:12.206339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692760d1-fedd-45cf-accb-080e3bb92fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:12.207498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692760d1-fedd-45cf-accb-080e3bb92fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:12.208006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692760d1-fedd-45cf-accb-080e3bb92fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:12.208511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692760d1-fedd-45cf-accb-080e3bb92fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:12.209692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692760d1-fedd-45cf-accb-080e3bb92fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:12.212224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692760d1-fedd-45cf-accb-080e3bb92fa3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:12.226820 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3640/7222] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:12.233652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692760d1-fedd-45cf-accb-080e3bb92fa3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:12.251167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692760d1-fedd-45cf-accb-080e3bb92fa3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:12.259946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c41d4b-3906-4ff8-a8fa-eb58c551486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:12.260740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c41d4b-3906-4ff8-a8fa-eb58c551486d admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:12.261069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c41d4b-3906-4ff8-a8fa-eb58c551486d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:12.261442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c41d4b-3906-4ff8-a8fa-eb58c551486d admin admin] PATH_INFO: `/v3/projects/03d117513ef948e5ae94772b550f3fea/users/306267864abe48ad971bbb6956cc7639/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:12.262054 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3583/7223] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:12 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:29:12.263646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701cbce-fb00-4d16-b799-7a93c7275cb6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:12.303333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c41d4b-3906-4ff8-a8fa-eb58c551486d admin admin] RBAC: Authorizing `identity:create_grant(project_id=03d117513ef948e5ae94772b550f3fea, user_id=306267864abe48ad971bbb6956cc7639, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:12.307169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c41d4b-3906-4ff8-a8fa-eb58c551486d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:12.353166 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3641/7224] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:12 2022] PUT /identity/v3/projects/03d117513ef948e5ae94772b550f3fea/users/306267864abe48ad971bbb6956cc7639/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:12.383856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6339d-9f0f-4116-b3c4-3560e89b8f7d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:12.397542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6339d-9f0f-4116-b3c4-3560e89b8f7d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:12.399375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6339d-9f0f-4116-b3c4-3560e89b8f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:12.467484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e0e6339d-9f0f-4116-b3c4-3560e89b8f7d None None] MFA Rules not processed for user `306267864abe48ad971bbb6956cc7639`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:12.468821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e0e6339d-9f0f-4116-b3c4-3560e89b8f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:12.475508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701cbce-fb00-4d16-b799-7a93c7275cb6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:12.584445 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3642/7225] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:12.601465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6339d-9f0f-4116-b3c4-3560e89b8f7d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:12.603803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e0e6339d-9f0f-4116-b3c4-3560e89b8f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:12.630009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca4fbe-b929-45e9-95ee-89f028a10afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:12.630704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca4fbe-b929-45e9-95ee-89f028a10afb admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:12.631056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca4fbe-b929-45e9-95ee-89f028a10afb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:12.631439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca4fbe-b929-45e9-95ee-89f028a10afb admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:12.632205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca4fbe-b929-45e9-95ee-89f028a10afb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:12.635187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca4fbe-b929-45e9-95ee-89f028a10afb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:12.687861 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3584/7226] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:12 2022] POST /identity/v3/users => generated 297 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:12.689059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca4fbe-b929-45e9-95ee-89f028a10afb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:12.700122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca4fbe-b929-45e9-95ee-89f028a10afb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:12.706294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b6222-fe77-42ce-8a81-a50f428262e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:12.707166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b6222-fe77-42ce-8a81-a50f428262e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:12.707657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b6222-fe77-42ce-8a81-a50f428262e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:12.708158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b6222-fe77-42ce-8a81-a50f428262e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:12.709079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b6222-fe77-42ce-8a81-a50f428262e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:12.711370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b6222-fe77-42ce-8a81-a50f428262e0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:12.728582 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3585/7227] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:12.730238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b6222-fe77-42ce-8a81-a50f428262e0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:12.741479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b6222-fe77-42ce-8a81-a50f428262e0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:12.742941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6339d-9f0f-4116-b3c4-3560e89b8f7d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:12.747128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf44cdb-5323-4c25-989d-586aafef44e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:12.747965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf44cdb-5323-4c25-989d-586aafef44e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:12.748356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf44cdb-5323-4c25-989d-586aafef44e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:12.748751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf44cdb-5323-4c25-989d-586aafef44e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:12.749582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf44cdb-5323-4c25-989d-586aafef44e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:12.750450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e2fe8-bcf0-41d0-a6c4-e2f65d0fc3c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:12.751931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf44cdb-5323-4c25-989d-586aafef44e7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:12.753187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e2fe8-bcf0-41d0-a6c4-e2f65d0fc3c2 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:12.753901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e2fe8-bcf0-41d0-a6c4-e2f65d0fc3c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:12.754947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e2fe8-bcf0-41d0-a6c4-e2f65d0fc3c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:12.763845 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3586/7228] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:12.767981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf44cdb-5323-4c25-989d-586aafef44e7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:12.771049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e2fe8-bcf0-41d0-a6c4-e2f65d0fc3c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:12.773454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e2fe8-bcf0-41d0-a6c4-e2f65d0fc3c2 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:12.779235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf44cdb-5323-4c25-989d-586aafef44e7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:12.786874 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3643/7229] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:12.791274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c7d2a-f00a-4d17-b0a0-f29eb45a1246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:12.792146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c7d2a-f00a-4d17-b0a0-f29eb45a1246 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:12.793011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c7d2a-f00a-4d17-b0a0-f29eb45a1246 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:12.793011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c7d2a-f00a-4d17-b0a0-f29eb45a1246 admin admin] PATH_INFO: `/v3/projects/4a16baf2cd6043c79dbe21fafc13eb28/users/9f113fc80feb42148c3dad0c33417dfe/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:12.828232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c7d2a-f00a-4d17-b0a0-f29eb45a1246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a16baf2cd6043c79dbe21fafc13eb28, user_id=9f113fc80feb42148c3dad0c33417dfe, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:12.835449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c7d2a-f00a-4d17-b0a0-f29eb45a1246 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:12.869076 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3587/7230] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:12 2022] PUT /identity/v3/projects/4a16baf2cd6043c79dbe21fafc13eb28/users/9f113fc80feb42148c3dad0c33417dfe/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:29:12.883847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46c814-a7bb-45f3-b9ea-40ae4e362de5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:12.884316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46c814-a7bb-45f3-b9ea-40ae4e362de5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:12.884715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46c814-a7bb-45f3-b9ea-40ae4e362de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:12.999477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ef46c814-a7bb-45f3-b9ea-40ae4e362de5 None None] MFA Rules not processed for user `9f113fc80feb42148c3dad0c33417dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:13.002997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ef46c814-a7bb-45f3-b9ea-40ae4e362de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:13.036278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:13.228112 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3644/7231] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:13.229275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c7d2a-f00a-4d17-b0a0-f29eb45a1246 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:13.412410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:13.501717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c7d2a-f00a-4d17-b0a0-f29eb45a1246 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:13.529883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f4798-3214-4d01-85a1-d981d518de9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:13.531445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f4798-3214-4d01-85a1-d981d518de9b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:13.532637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f4798-3214-4d01-85a1-d981d518de9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:13.535080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f4798-3214-4d01-85a1-d981d518de9b admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:13.536040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f4798-3214-4d01-85a1-d981d518de9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:13.540515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f4798-3214-4d01-85a1-d981d518de9b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:13.628105 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3588/7232] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:13 2022] POST /identity/v3/projects => generated 393 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:29:13.633218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46c814-a7bb-45f3-b9ea-40ae4e362de5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:13.655457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46c814-a7bb-45f3-b9ea-40ae4e362de5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:13.864406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c6b03-755c-4dac-ac17-04788835fa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:13.865075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c6b03-755c-4dac-ac17-04788835fa79 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:13.865370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c6b03-755c-4dac-ac17-04788835fa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:13.865776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c6b03-755c-4dac-ac17-04788835fa79 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:13.866462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c6b03-755c-4dac-ac17-04788835fa79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:13.868451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c6b03-755c-4dac-ac17-04788835fa79 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:13.916593 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3645/7233] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:13 2022] POST /identity/v3/users => generated 303 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:13.920907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f4798-3214-4d01-85a1-d981d518de9b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:13.944366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f4798-3214-4d01-85a1-d981d518de9b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:13.962760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c917c-5598-4538-abb8-9ec4a1940772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:13.963629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c917c-5598-4538-abb8-9ec4a1940772 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:13.963954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c917c-5598-4538-abb8-9ec4a1940772 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:13.964411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c917c-5598-4538-abb8-9ec4a1940772 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:13.965292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c917c-5598-4538-abb8-9ec4a1940772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:13.968727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c917c-5598-4538-abb8-9ec4a1940772 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:14.030142 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3589/7234] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:14.030829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c6b03-755c-4dac-ac17-04788835fa79 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:14.051677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c6b03-755c-4dac-ac17-04788835fa79 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:14.069350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c234ef-f5c3-4749-8ec8-c8470717de7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:14.074750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c234ef-f5c3-4749-8ec8-c8470717de7d admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:14.078275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c234ef-f5c3-4749-8ec8-c8470717de7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:14.080499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c234ef-f5c3-4749-8ec8-c8470717de7d admin admin] PATH_INFO: `/v3/projects/152c660df7e349ad86665647d6b3bbcd/users/1fa0bf58ed064372805f230f0b35e42b/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:14.146771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c234ef-f5c3-4749-8ec8-c8470717de7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=152c660df7e349ad86665647d6b3bbcd, user_id=1fa0bf58ed064372805f230f0b35e42b, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:14.151698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c234ef-f5c3-4749-8ec8-c8470717de7d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:14.179817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c917c-5598-4538-abb8-9ec4a1940772 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:14.180995 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3646/7235] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:14 2022] PUT /identity/v3/projects/152c660df7e349ad86665647d6b3bbcd/users/1fa0bf58ed064372805f230f0b35e42b/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:29:14.206934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c917c-5598-4538-abb8-9ec4a1940772 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:14.347036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86974da0-33ae-4272-a171-1a1e5b5303b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:14.350172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86974da0-33ae-4272-a171-1a1e5b5303b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:14.350709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86974da0-33ae-4272-a171-1a1e5b5303b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:14.351156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86974da0-33ae-4272-a171-1a1e5b5303b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:14.352093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86974da0-33ae-4272-a171-1a1e5b5303b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:14.353948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86974da0-33ae-4272-a171-1a1e5b5303b7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:14.384016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c234ef-f5c3-4749-8ec8-c8470717de7d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:14.412019 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3590/7236] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:14.421861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c234ef-f5c3-4749-8ec8-c8470717de7d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:14.433655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53732b3-ed76-4b2f-ab5f-15f3aa8a4003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:14.434716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53732b3-ed76-4b2f-ab5f-15f3aa8a4003 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:14.435734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53732b3-ed76-4b2f-ab5f-15f3aa8a4003 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:14.436393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53732b3-ed76-4b2f-ab5f-15f3aa8a4003 admin admin] PATH_INFO: `/v3/projects/152c660df7e349ad86665647d6b3bbcd/users/1fa0bf58ed064372805f230f0b35e42b/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:14.439930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53732b3-ed76-4b2f-ab5f-15f3aa8a4003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=152c660df7e349ad86665647d6b3bbcd, user_id=1fa0bf58ed064372805f230f0b35e42b, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:14.443084 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53732b3-ed76-4b2f-ab5f-15f3aa8a4003 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:14.462380 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3647/7237] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:14 2022] PUT /identity/v3/projects/152c660df7e349ad86665647d6b3bbcd/users/1fa0bf58ed064372805f230f0b35e42b/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:14.475749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c796a9-7b05-4e98-8b91-0493517455d1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:14.476042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c796a9-7b05-4e98-8b91-0493517455d1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:14.476576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c796a9-7b05-4e98-8b91-0493517455d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:14.553907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e6c796a9-7b05-4e98-8b91-0493517455d1 None None] MFA Rules not processed for user `1fa0bf58ed064372805f230f0b35e42b`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:14.556054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e6c796a9-7b05-4e98-8b91-0493517455d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:14.720119 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3591/7238] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:14.734022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53732b3-ed76-4b2f-ab5f-15f3aa8a4003 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:14.736460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f53732b3-ed76-4b2f-ab5f-15f3aa8a4003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:14.893817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:14.952928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53732b3-ed76-4b2f-ab5f-15f3aa8a4003 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:14.958925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523c7b2-2646-48cf-bd14-de64a8504d67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:14.959614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523c7b2-2646-48cf-bd14-de64a8504d67 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:14.959913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523c7b2-2646-48cf-bd14-de64a8504d67 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:14.960296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523c7b2-2646-48cf-bd14-de64a8504d67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:15.072436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523c7b2-2646-48cf-bd14-de64a8504d67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:15.075647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523c7b2-2646-48cf-bd14-de64a8504d67 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:15.096186 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3648/7239] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:17.238200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c796a9-7b05-4e98-8b91-0493517455d1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:17.297508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:17.418008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c796a9-7b05-4e98-8b91-0493517455d1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:17.442799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df35c3-7e6f-4b86-8022-ac38ba6cb1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:17.443604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df35c3-7e6f-4b86-8022-ac38ba6cb1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:17.444051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df35c3-7e6f-4b86-8022-ac38ba6cb1be admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:17.444563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df35c3-7e6f-4b86-8022-ac38ba6cb1be admin admin] PATH_INFO: `/v3/users/306267864abe48ad971bbb6956cc7639` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:17.445990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df35c3-7e6f-4b86-8022-ac38ba6cb1be admin admin] RBAC: Authorizing `identity:delete_user(user_id=306267864abe48ad971bbb6956cc7639)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:17.449247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df35c3-7e6f-4b86-8022-ac38ba6cb1be admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:17.538202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5df35c3-7e6f-4b86-8022-ac38ba6cb1be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '306267864abe48ad971bbb6956cc7639'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:17.539914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5df35c3-7e6f-4b86-8022-ac38ba6cb1be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '306267864abe48ad971bbb6956cc7639'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:17.559122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5df35c3-7e6f-4b86-8022-ac38ba6cb1be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '306267864abe48ad971bbb6956cc7639'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:17.560837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5df35c3-7e6f-4b86-8022-ac38ba6cb1be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '306267864abe48ad971bbb6956cc7639'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:17.575864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5df35c3-7e6f-4b86-8022-ac38ba6cb1be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '306267864abe48ad971bbb6956cc7639'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:17.612298 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3592/7240] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:17 2022] DELETE /identity/v3/users/306267864abe48ad971bbb6956cc7639 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:17.618278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c162932-899e-408a-b542-d680860a1179 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:17.620330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c162932-899e-408a-b542-d680860a1179 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:17.621039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c162932-899e-408a-b542-d680860a1179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:17.656775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2c162932-899e-408a-b542-d680860a1179 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:17.659396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2c162932-899e-408a-b542-d680860a1179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:17.796800 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3649/7241] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:17.833343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df35c3-7e6f-4b86-8022-ac38ba6cb1be admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:17.835803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a5df35c3-7e6f-4b86-8022-ac38ba6cb1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:17.979256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df35c3-7e6f-4b86-8022-ac38ba6cb1be admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:17.990488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944708b-f4cf-4acc-82f7-1b757b06405b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:18.000367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944708b-f4cf-4acc-82f7-1b757b06405b service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:18.000668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944708b-f4cf-4acc-82f7-1b757b06405b service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:18.000953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944708b-f4cf-4acc-82f7-1b757b06405b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:18.039456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944708b-f4cf-4acc-82f7-1b757b06405b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:18.040623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944708b-f4cf-4acc-82f7-1b757b06405b service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:18.063720 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3593/7242] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:29:19.290821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c162932-899e-408a-b542-d680860a1179 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:19.292614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2c162932-899e-408a-b542-d680860a1179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:19.316431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c162932-899e-408a-b542-d680860a1179 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:19.329851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ad78c-9fc0-470f-a4c9-953062cfae26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:19.331109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ad78c-9fc0-470f-a4c9-953062cfae26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:19.331605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ad78c-9fc0-470f-a4c9-953062cfae26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:19.332083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ad78c-9fc0-470f-a4c9-953062cfae26 admin admin] PATH_INFO: `/v3/projects/03d117513ef948e5ae94772b550f3fea` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:19.334602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ad78c-9fc0-470f-a4c9-953062cfae26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03d117513ef948e5ae94772b550f3fea)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:19.338252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ad78c-9fc0-470f-a4c9-953062cfae26 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:19.481362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a04ad78c-9fc0-470f-a4c9-953062cfae26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03d117513ef948e5ae94772b550f3fea', 'request_id': 'req-a04ad78c-9fc0-470f-a4c9-953062cfae26'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:19.497414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a04ad78c-9fc0-470f-a4c9-953062cfae26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03d117513ef948e5ae94772b550f3fea', 'request_id': 'req-a04ad78c-9fc0-470f-a4c9-953062cfae26'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:19.522547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a04ad78c-9fc0-470f-a4c9-953062cfae26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03d117513ef948e5ae94772b550f3fea', 'request_id': 'req-a04ad78c-9fc0-470f-a4c9-953062cfae26'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:19.539356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a04ad78c-9fc0-470f-a4c9-953062cfae26 admin admin] The token cache is being invalidate because project 03d117513ef948e5ae94772b550f3fea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:19.539658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a04ad78c-9fc0-470f-a4c9-953062cfae26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:19.542179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a04ad78c-9fc0-470f-a4c9-953062cfae26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:19.550769 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3650/7243] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:19 2022] DELETE /identity/v3/projects/03d117513ef948e5ae94772b550f3fea => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:19.550905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b1e9c-6804-4352-8808-9a7e77aed3e5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:19.551520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b1e9c-6804-4352-8808-9a7e77aed3e5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:19.551520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b1e9c-6804-4352-8808-9a7e77aed3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:19.625454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-497b1e9c-6804-4352-8808-9a7e77aed3e5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:19.628253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-497b1e9c-6804-4352-8808-9a7e77aed3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:19.708430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:19.739610 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3594/7244] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:19.749028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce628d-0a2d-4cb9-98bb-eba46fbe4c9a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:19.749639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce628d-0a2d-4cb9-98bb-eba46fbe4c9a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:19.751086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce628d-0a2d-4cb9-98bb-eba46fbe4c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:19.765616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:19.797432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b7ce628d-0a2d-4cb9-98bb-eba46fbe4c9a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:19.799232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b7ce628d-0a2d-4cb9-98bb-eba46fbe4c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:19.821864 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3651/7245] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:19.827065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b1e9c-6804-4352-8808-9a7e77aed3e5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:19.840668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b1e9c-6804-4352-8808-9a7e77aed3e5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:19.853717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0eb8f6-fcf2-4296-9c1c-ed00b578233a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:19.854639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0eb8f6-fcf2-4296-9c1c-ed00b578233a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:19.855088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0eb8f6-fcf2-4296-9c1c-ed00b578233a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:19.855612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0eb8f6-fcf2-4296-9c1c-ed00b578233a admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:19.856534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0eb8f6-fcf2-4296-9c1c-ed00b578233a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:29:19.857029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0eb8f6-fcf2-4296-9c1c-ed00b578233a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:19.858830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0eb8f6-fcf2-4296-9c1c-ed00b578233a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:19.897169 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3595/7246] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:29:19.901618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce628d-0a2d-4cb9-98bb-eba46fbe4c9a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:19.916706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce628d-0a2d-4cb9-98bb-eba46fbe4c9a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:19.931200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d58fd-f1d6-4770-b442-8d9fdb274236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:19.931938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d58fd-f1d6-4770-b442-8d9fdb274236 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:19.932241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d58fd-f1d6-4770-b442-8d9fdb274236 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:19.932505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d58fd-f1d6-4770-b442-8d9fdb274236 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:19.933249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d58fd-f1d6-4770-b442-8d9fdb274236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:19.935547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d58fd-f1d6-4770-b442-8d9fdb274236 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:20.000966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0eb8f6-fcf2-4296-9c1c-ed00b578233a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:20.002829 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3652/7247] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:19 2022] POST /identity/v3/projects => generated 399 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:20.028341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0eb8f6-fcf2-4296-9c1c-ed00b578233a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:20.166463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d82122-fe9d-41cd-82a4-31a3aad7c60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:20.168243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d82122-fe9d-41cd-82a4-31a3aad7c60c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:20.168484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d82122-fe9d-41cd-82a4-31a3aad7c60c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:20.169200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d82122-fe9d-41cd-82a4-31a3aad7c60c admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:20.169988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d82122-fe9d-41cd-82a4-31a3aad7c60c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:20.177169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d82122-fe9d-41cd-82a4-31a3aad7c60c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:20.242484 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3596/7248] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:19 2022] POST /identity/v3/users => generated 300 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:20.247749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d58fd-f1d6-4770-b442-8d9fdb274236 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:20.280663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d58fd-f1d6-4770-b442-8d9fdb274236 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:20.300122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42103b1-a2f8-429b-92b0-3e8b5abe6535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:20.300955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42103b1-a2f8-429b-92b0-3e8b5abe6535 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:20.301739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42103b1-a2f8-429b-92b0-3e8b5abe6535 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:20.302664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42103b1-a2f8-429b-92b0-3e8b5abe6535 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:20.304365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42103b1-a2f8-429b-92b0-3e8b5abe6535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:20.306255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42103b1-a2f8-429b-92b0-3e8b5abe6535 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:20.359420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d82122-fe9d-41cd-82a4-31a3aad7c60c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:20.364997 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3653/7249] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:20.376181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d82122-fe9d-41cd-82a4-31a3aad7c60c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:20.395578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f80578-c73f-4440-baa6-df152d59ffe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:20.395578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f80578-c73f-4440-baa6-df152d59ffe8 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:20.395578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f80578-c73f-4440-baa6-df152d59ffe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:20.395578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f80578-c73f-4440-baa6-df152d59ffe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:20.396078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f80578-c73f-4440-baa6-df152d59ffe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:20.408091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f80578-c73f-4440-baa6-df152d59ffe8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:20.439418 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3597/7250] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:20.440707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42103b1-a2f8-429b-92b0-3e8b5abe6535 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:20.457226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42103b1-a2f8-429b-92b0-3e8b5abe6535 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:20.463379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1cfdc-e5e7-4021-880b-52390e2ff1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:20.474397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1cfdc-e5e7-4021-880b-52390e2ff1fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:20.474717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1cfdc-e5e7-4021-880b-52390e2ff1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:20.475011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1cfdc-e5e7-4021-880b-52390e2ff1fb admin admin] PATH_INFO: `/v3/projects/4d48c99044864b23a7ed248d345ce668/users/03f373601d75447ab5c3a3ce308d1f58/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:20.499765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1cfdc-e5e7-4021-880b-52390e2ff1fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d48c99044864b23a7ed248d345ce668, user_id=03f373601d75447ab5c3a3ce308d1f58, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:20.503397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1cfdc-e5e7-4021-880b-52390e2ff1fb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:20.534231 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3654/7251] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:20 2022] PUT /identity/v3/projects/4d48c99044864b23a7ed248d345ce668/users/03f373601d75447ab5c3a3ce308d1f58/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:20.681931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f788a-879b-4835-a851-078b6a99fa98 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:20.682807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f788a-879b-4835-a851-078b6a99fa98 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:20.683654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f788a-879b-4835-a851-078b6a99fa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:20.716729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-843f788a-879b-4835-a851-078b6a99fa98 None None] MFA Rules not processed for user `03f373601d75447ab5c3a3ce308d1f58`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:20.718444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-843f788a-879b-4835-a851-078b6a99fa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:20.854292 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3598/7252] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:29:20.867550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1cfdc-e5e7-4021-880b-52390e2ff1fb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:20.869694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-89f1cfdc-e5e7-4021-880b-52390e2ff1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:20.986859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1cfdc-e5e7-4021-880b-52390e2ff1fb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:20.997755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97f6d2-402d-4c9f-ab23-7f91a37363b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:20.998577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97f6d2-402d-4c9f-ab23-7f91a37363b1 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:20.998961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97f6d2-402d-4c9f-ab23-7f91a37363b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:20.999362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97f6d2-402d-4c9f-ab23-7f91a37363b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:21.011563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97f6d2-402d-4c9f-ab23-7f91a37363b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:21.013603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97f6d2-402d-4c9f-ab23-7f91a37363b1 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:21.024086 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3655/7253] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:22.110398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f788a-879b-4835-a851-078b6a99fa98 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:22.112599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-843f788a-879b-4835-a851-078b6a99fa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:22.209464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:22.265331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f788a-879b-4835-a851-078b6a99fa98 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:22.292395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1002f-ae69-479f-a33b-68d8737534b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:22.293396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1002f-ae69-479f-a33b-68d8737534b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:22.293866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1002f-ae69-479f-a33b-68d8737534b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:22.294554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1002f-ae69-479f-a33b-68d8737534b8 admin admin] PATH_INFO: `/v3/users/91df9f57cf2c4a579856c911e4d370d1` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:22.296501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1002f-ae69-479f-a33b-68d8737534b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91df9f57cf2c4a579856c911e4d370d1)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:22.298727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1002f-ae69-479f-a33b-68d8737534b8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:22.387938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-38a1002f-ae69-479f-a33b-68d8737534b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91df9f57cf2c4a579856c911e4d370d1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:22.388994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-38a1002f-ae69-479f-a33b-68d8737534b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91df9f57cf2c4a579856c911e4d370d1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:22.412981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-38a1002f-ae69-479f-a33b-68d8737534b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91df9f57cf2c4a579856c911e4d370d1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:22.413811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-38a1002f-ae69-479f-a33b-68d8737534b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91df9f57cf2c4a579856c911e4d370d1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:22.436698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-38a1002f-ae69-479f-a33b-68d8737534b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91df9f57cf2c4a579856c911e4d370d1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:22.459929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6feac-6eac-483e-84fe-602d775e11be None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:22.461784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6feac-6eac-483e-84fe-602d775e11be None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:22.462469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6feac-6eac-483e-84fe-602d775e11be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:22.482297 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3599/7254] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:22 2022] DELETE /identity/v3/users/91df9f57cf2c4a579856c911e4d370d1 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:22.492842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172138d9-b271-4d1c-bec2-c511f052b4b3 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:22.493134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172138d9-b271-4d1c-bec2-c511f052b4b3 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:22.493625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172138d9-b271-4d1c-bec2-c511f052b4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:22.510058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a1b6feac-6eac-483e-84fe-602d775e11be None None] MFA Rules not processed for user `f1b1a5390fd6434f86e89125cd4b324c`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:22.512799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a1b6feac-6eac-483e-84fe-602d775e11be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:22.542995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-172138d9-b271-4d1c-bec2-c511f052b4b3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:22.544293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-172138d9-b271-4d1c-bec2-c511f052b4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:22.691065 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3600/7255] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:22.757191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172138d9-b271-4d1c-bec2-c511f052b4b3 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:22.758606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-172138d9-b271-4d1c-bec2-c511f052b4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:22.781707 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3656/7256] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:22.784332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cf929-391f-4e7c-90ad-bc8f0721c506 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:22.784833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cf929-391f-4e7c-90ad-bc8f0721c506 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:22.785316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cf929-391f-4e7c-90ad-bc8f0721c506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:22.832408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-da0cf929-391f-4e7c-90ad-bc8f0721c506 None None] MFA Rules not processed for user `f1b1a5390fd6434f86e89125cd4b324c`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:22.833993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-da0cf929-391f-4e7c-90ad-bc8f0721c506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:22.848162 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3657/7257] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:22.860861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cf929-391f-4e7c-90ad-bc8f0721c506 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:22.862858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-da0cf929-391f-4e7c-90ad-bc8f0721c506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:22.888786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172138d9-b271-4d1c-bec2-c511f052b4b3 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:22.907957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83e75a-de89-476f-9c7c-fe9ae1f8b29b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:22.908917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83e75a-de89-476f-9c7c-fe9ae1f8b29b service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:22.909122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83e75a-de89-476f-9c7c-fe9ae1f8b29b service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:22.909525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83e75a-de89-476f-9c7c-fe9ae1f8b29b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:22.931911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83e75a-de89-476f-9c7c-fe9ae1f8b29b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:22.933518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83e75a-de89-476f-9c7c-fe9ae1f8b29b service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:22.953142 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3601/7258] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:22.969343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:23.056046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cf929-391f-4e7c-90ad-bc8f0721c506 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:23.062990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e09b8f-21ec-4f5b-be81-29b31aaf7ed8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:23.064475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e09b8f-21ec-4f5b-be81-29b31aaf7ed8 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:23.064878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e09b8f-21ec-4f5b-be81-29b31aaf7ed8 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:23.065250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e09b8f-21ec-4f5b-be81-29b31aaf7ed8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:23.076971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e09b8f-21ec-4f5b-be81-29b31aaf7ed8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:23.080394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e09b8f-21ec-4f5b-be81-29b31aaf7ed8 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:23.096565 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3658/7259] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:24.089119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83e75a-de89-476f-9c7c-fe9ae1f8b29b service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:24.090635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ea83e75a-de89-476f-9c7c-fe9ae1f8b29b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:24.109902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:24.124059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83e75a-de89-476f-9c7c-fe9ae1f8b29b service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:24.140333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3238a-5db7-4455-815c-218292038b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:24.141105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3238a-5db7-4455-815c-218292038b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:24.141395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3238a-5db7-4455-815c-218292038b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:24.141728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3238a-5db7-4455-815c-218292038b27 admin admin] PATH_INFO: `/v3/projects/375ed5fbd34c45e6898a93b2c96f1872` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:24.142989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3238a-5db7-4455-815c-218292038b27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=375ed5fbd34c45e6898a93b2c96f1872)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:24.146493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3238a-5db7-4455-815c-218292038b27 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:24.231712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e5f3238a-5db7-4455-815c-218292038b27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '375ed5fbd34c45e6898a93b2c96f1872', 'request_id': 'req-e5f3238a-5db7-4455-815c-218292038b27'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:24.243463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e5f3238a-5db7-4455-815c-218292038b27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '375ed5fbd34c45e6898a93b2c96f1872', 'request_id': 'req-e5f3238a-5db7-4455-815c-218292038b27'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:24.252271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e5f3238a-5db7-4455-815c-218292038b27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '375ed5fbd34c45e6898a93b2c96f1872', 'request_id': 'req-e5f3238a-5db7-4455-815c-218292038b27'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:24.276492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e5f3238a-5db7-4455-815c-218292038b27 admin admin] The token cache is being invalidate because project 375ed5fbd34c45e6898a93b2c96f1872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:24.276628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e5f3238a-5db7-4455-815c-218292038b27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:24.277385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e5f3238a-5db7-4455-815c-218292038b27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:24.284306 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3602/7260] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:24 2022] DELETE /identity/v3/projects/375ed5fbd34c45e6898a93b2c96f1872 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:24.286312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88b713-0ba8-40b4-bb78-04b5d8350c04 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:24.286774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88b713-0ba8-40b4-bb78-04b5d8350c04 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:24.287044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88b713-0ba8-40b4-bb78-04b5d8350c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:24.310018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bb88b713-0ba8-40b4-bb78-04b5d8350c04 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:24.312645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bb88b713-0ba8-40b4-bb78-04b5d8350c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:24.394074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3238a-5db7-4455-815c-218292038b27 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:24.395741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e5f3238a-5db7-4455-815c-218292038b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:24.409479 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3659/7261] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:24.411326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4530ed-1bdd-480b-84d4-b2db43b74406 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:24.414516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4530ed-1bdd-480b-84d4-b2db43b74406 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:24.415129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4530ed-1bdd-480b-84d4-b2db43b74406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:24.451482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-db4530ed-1bdd-480b-84d4-b2db43b74406 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:24.453904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-db4530ed-1bdd-480b-84d4-b2db43b74406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:24.474904 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3660/7262] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:24.479682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4530ed-1bdd-480b-84d4-b2db43b74406 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:24.505427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4530ed-1bdd-480b-84d4-b2db43b74406 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:24.516075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573cf67-d8f4-475c-8f72-ae67ac96379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:24.517146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573cf67-d8f4-475c-8f72-ae67ac96379d admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:24.517607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573cf67-d8f4-475c-8f72-ae67ac96379d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:24.518063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573cf67-d8f4-475c-8f72-ae67ac96379d admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:24.519313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573cf67-d8f4-475c-8f72-ae67ac96379d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:29:24.519774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573cf67-d8f4-475c-8f72-ae67ac96379d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:24.522995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573cf67-d8f4-475c-8f72-ae67ac96379d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:24.557441 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3661/7263] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:29:24.563100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573cf67-d8f4-475c-8f72-ae67ac96379d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:24.587500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3238a-5db7-4455-815c-218292038b27 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:24.594167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2239047-c76f-41db-8373-2380ffa2912f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:24.594965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2239047-c76f-41db-8373-2380ffa2912f service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:24.595092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573cf67-d8f4-475c-8f72-ae67ac96379d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:24.595419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2239047-c76f-41db-8373-2380ffa2912f service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:24.595635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2239047-c76f-41db-8373-2380ffa2912f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:24.598060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f2239047-c76f-41db-8373-2380ffa2912f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:24.612247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645358f-2336-4b0c-9996-95611898b5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:24.613027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645358f-2336-4b0c-9996-95611898b5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:24.613326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645358f-2336-4b0c-9996-95611898b5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:24.613601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645358f-2336-4b0c-9996-95611898b5a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:24.614275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645358f-2336-4b0c-9996-95611898b5a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:24.619530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645358f-2336-4b0c-9996-95611898b5a9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:24.711794 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3662/7264] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:24 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:24.712905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645358f-2336-4b0c-9996-95611898b5a9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:24.721801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2239047-c76f-41db-8373-2380ffa2912f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:24.733917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2239047-c76f-41db-8373-2380ffa2912f service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:24.757100 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3603/7265] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:24.843826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645358f-2336-4b0c-9996-95611898b5a9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:24.850180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4492f-6629-4b4a-a217-55646457b444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:24.850896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4492f-6629-4b4a-a217-55646457b444 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:24.851354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4492f-6629-4b4a-a217-55646457b444 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:24.851645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4492f-6629-4b4a-a217-55646457b444 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:24.852321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4492f-6629-4b4a-a217-55646457b444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:24.854357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4492f-6629-4b4a-a217-55646457b444 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:24.884421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:24.907141 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3663/7266] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:24 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:24.911016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2239047-c76f-41db-8373-2380ffa2912f service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:24.929646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2239047-c76f-41db-8373-2380ffa2912f service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:24.944600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1554213-a26e-49b0-96ea-5c6f53ddb521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:24.945260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1554213-a26e-49b0-96ea-5c6f53ddb521 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:24.945549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1554213-a26e-49b0-96ea-5c6f53ddb521 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:24.945831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1554213-a26e-49b0-96ea-5c6f53ddb521 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:24.946536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1554213-a26e-49b0-96ea-5c6f53ddb521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:24.948207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1554213-a26e-49b0-96ea-5c6f53ddb521 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:24.961954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4492f-6629-4b4a-a217-55646457b444 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:24.963786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3de4492f-6629-4b4a-a217-55646457b444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:24.987504 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3604/7267] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:24.990638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1554213-a26e-49b0-96ea-5c6f53ddb521 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:25.020362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4492f-6629-4b4a-a217-55646457b444 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:25.020675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1554213-a26e-49b0-96ea-5c6f53ddb521 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:25.040017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d93c60-0b09-47bb-80ca-cf86b321c30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:25.040829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d93c60-0b09-47bb-80ca-cf86b321c30f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:25.041687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d93c60-0b09-47bb-80ca-cf86b321c30f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:25.041977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33983d0b-ee3a-480a-a07f-5a77b353930a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:25.042108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d93c60-0b09-47bb-80ca-cf86b321c30f admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:25.043133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d93c60-0b09-47bb-80ca-cf86b321c30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:25.045591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33983d0b-ee3a-480a-a07f-5a77b353930a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:25.045912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33983d0b-ee3a-480a-a07f-5a77b353930a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:25.046199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33983d0b-ee3a-480a-a07f-5a77b353930a admin admin] PATH_INFO: `/v3/users/3912ff33d4e14b50a774bb46d09c6e80` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:25.049304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d93c60-0b09-47bb-80ca-cf86b321c30f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:25.059854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33983d0b-ee3a-480a-a07f-5a77b353930a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3912ff33d4e14b50a774bb46d09c6e80)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:25.063330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33983d0b-ee3a-480a-a07f-5a77b353930a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:25.083623 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3605/7268] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:25.085173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d93c60-0b09-47bb-80ca-cf86b321c30f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:25.106719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d93c60-0b09-47bb-80ca-cf86b321c30f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:25.131774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc286970-4762-48b8-86fb-227b94277faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:25.132568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc286970-4762-48b8-86fb-227b94277faf admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:25.132747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc286970-4762-48b8-86fb-227b94277faf admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:25.133186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc286970-4762-48b8-86fb-227b94277faf admin admin] PATH_INFO: `/v3/projects/1a7b5de3c9834471a1ff40d046bb102e/users/800c2fc6e5114172a6994ca3d1ae0362/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:25.169962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:25.189329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33983d0b-ee3a-480a-a07f-5a77b353930a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3912ff33d4e14b50a774bb46d09c6e80'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:25.209955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc286970-4762-48b8-86fb-227b94277faf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a7b5de3c9834471a1ff40d046bb102e, user_id=800c2fc6e5114172a6994ca3d1ae0362, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:25.217546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc286970-4762-48b8-86fb-227b94277faf admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:25.237608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33983d0b-ee3a-480a-a07f-5a77b353930a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3912ff33d4e14b50a774bb46d09c6e80'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:25.239966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33983d0b-ee3a-480a-a07f-5a77b353930a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3912ff33d4e14b50a774bb46d09c6e80'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:25.260595 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3606/7269] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:25 2022] PUT /identity/v3/projects/1a7b5de3c9834471a1ff40d046bb102e/users/800c2fc6e5114172a6994ca3d1ae0362/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:25.272150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e22769-e75d-4f99-ba34-eeea35b532ac None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:25.274636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e22769-e75d-4f99-ba34-eeea35b532ac None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:25.276972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e22769-e75d-4f99-ba34-eeea35b532ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:25.278196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33983d0b-ee3a-480a-a07f-5a77b353930a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3912ff33d4e14b50a774bb46d09c6e80'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:25.281674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33983d0b-ee3a-480a-a07f-5a77b353930a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3912ff33d4e14b50a774bb46d09c6e80'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:25.355601 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3664/7270] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:24 2022] DELETE /identity/v3/users/3912ff33d4e14b50a774bb46d09c6e80 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:29:25.360091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdc3f2-6732-403f-8647-6ee8d92f9fbb None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:25.360389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdc3f2-6732-403f-8647-6ee8d92f9fbb None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:25.363852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdc3f2-6732-403f-8647-6ee8d92f9fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:25.401612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-92e22769-e75d-4f99-ba34-eeea35b532ac None None] MFA Rules not processed for user `800c2fc6e5114172a6994ca3d1ae0362`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:25.405261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-92e22769-e75d-4f99-ba34-eeea35b532ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:25.429455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-36bdc3f2-6732-403f-8647-6ee8d92f9fbb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:25.442937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-36bdc3f2-6732-403f-8647-6ee8d92f9fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:25.563173 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3607/7271] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:25.564804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e22769-e75d-4f99-ba34-eeea35b532ac None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:25.567138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-92e22769-e75d-4f99-ba34-eeea35b532ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:25.602184 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3665/7272] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:25.610057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdc3f2-6732-403f-8647-6ee8d92f9fbb None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:25.611665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-36bdc3f2-6732-403f-8647-6ee8d92f9fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:25.680290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e22769-e75d-4f99-ba34-eeea35b532ac None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:25.688518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ff35d-43ad-4ade-a232-6d5ffe04b631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:25.689428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ff35d-43ad-4ade-a232-6d5ffe04b631 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:25.689839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ff35d-43ad-4ade-a232-6d5ffe04b631 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:25.690397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ff35d-43ad-4ade-a232-6d5ffe04b631 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:25.691748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ff35d-43ad-4ade-a232-6d5ffe04b631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:25.693722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ff35d-43ad-4ade-a232-6d5ffe04b631 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:25.749192 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3608/7273] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:25 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:25.751050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ff35d-43ad-4ade-a232-6d5ffe04b631 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:25.760879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdc3f2-6732-403f-8647-6ee8d92f9fbb None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:25.840621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:25.894483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ff35d-43ad-4ade-a232-6d5ffe04b631 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:25.922239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36072a6a-89b4-4fcf-af59-07ae8dd76480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:25.922919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36072a6a-89b4-4fcf-af59-07ae8dd76480 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:25.923208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36072a6a-89b4-4fcf-af59-07ae8dd76480 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:25.923528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36072a6a-89b4-4fcf-af59-07ae8dd76480 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:25.926638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36072a6a-89b4-4fcf-af59-07ae8dd76480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:25.928697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36072a6a-89b4-4fcf-af59-07ae8dd76480 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:25.934721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe29b55-a401-4272-9921-be869ee55410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:25.935186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe29b55-a401-4272-9921-be869ee55410 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:25.935459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe29b55-a401-4272-9921-be869ee55410 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:25.936420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe29b55-a401-4272-9921-be869ee55410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:25.955336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe29b55-a401-4272-9921-be869ee55410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:25.957461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:25.975536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe29b55-a401-4272-9921-be869ee55410 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:26.009150 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3609/7274] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:25 2022] POST /identity/v3/users => generated 288 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:26.010883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36072a6a-89b4-4fcf-af59-07ae8dd76480 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:26.017049 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3666/7275] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:29:26.040269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36072a6a-89b4-4fcf-af59-07ae8dd76480 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:26.050757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c05ad-0de8-45a8-bcf8-ea4da5be4980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:26.051556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c05ad-0de8-45a8-bcf8-ea4da5be4980 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:26.051967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c05ad-0de8-45a8-bcf8-ea4da5be4980 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:26.052328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c05ad-0de8-45a8-bcf8-ea4da5be4980 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:26.053107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c05ad-0de8-45a8-bcf8-ea4da5be4980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:26.060115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c05ad-0de8-45a8-bcf8-ea4da5be4980 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:26.093392 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3610/7276] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:26.094600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe29b55-a401-4272-9921-be869ee55410 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:26.108140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe29b55-a401-4272-9921-be869ee55410 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:26.123192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f78ee5-eb5e-47a6-a87c-f6412888a924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:26.123864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f78ee5-eb5e-47a6-a87c-f6412888a924 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:26.124150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f78ee5-eb5e-47a6-a87c-f6412888a924 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:26.124443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f78ee5-eb5e-47a6-a87c-f6412888a924 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:26.125151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f78ee5-eb5e-47a6-a87c-f6412888a924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:26.127317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f78ee5-eb5e-47a6-a87c-f6412888a924 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:26.172565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c05ad-0de8-45a8-bcf8-ea4da5be4980 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:26.173092 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3667/7277] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:26.197906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c05ad-0de8-45a8-bcf8-ea4da5be4980 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:26.209418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caee66c-0f54-4139-9a42-471ec50eed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:26.210215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caee66c-0f54-4139-9a42-471ec50eed7a admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:26.210505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caee66c-0f54-4139-9a42-471ec50eed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:26.211089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caee66c-0f54-4139-9a42-471ec50eed7a admin admin] PATH_INFO: `/v3/projects/81a85f6873a04d9092d31b93d0d4404a/users/1a9273041d7a4c8aba534f8b30fc51d4/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:26.263232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caee66c-0f54-4139-9a42-471ec50eed7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a85f6873a04d9092d31b93d0d4404a, user_id=1a9273041d7a4c8aba534f8b30fc51d4, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:26.266081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caee66c-0f54-4139-9a42-471ec50eed7a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:26.349838 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3611/7278] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:26 2022] PUT /identity/v3/projects/81a85f6873a04d9092d31b93d0d4404a/users/1a9273041d7a4c8aba534f8b30fc51d4/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:26.362789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e8680-8a32-48ac-be30-f50a2fd629a6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:26.363747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e8680-8a32-48ac-be30-f50a2fd629a6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:26.364184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e8680-8a32-48ac-be30-f50a2fd629a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:26.448350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-612e8680-8a32-48ac-be30-f50a2fd629a6 None None] MFA Rules not processed for user `1a9273041d7a4c8aba534f8b30fc51d4`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:26.450429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-612e8680-8a32-48ac-be30-f50a2fd629a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:26.546605 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3668/7279] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:26.550789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caee66c-0f54-4139-9a42-471ec50eed7a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:26.720464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caee66c-0f54-4139-9a42-471ec50eed7a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:26.732249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64ea3c-72c1-4756-8e7c-6ab07b99fbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:26.732954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64ea3c-72c1-4756-8e7c-6ab07b99fbb6 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:26.733241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64ea3c-72c1-4756-8e7c-6ab07b99fbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:26.734190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64ea3c-72c1-4756-8e7c-6ab07b99fbb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:26.734190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64ea3c-72c1-4756-8e7c-6ab07b99fbb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:26.736418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64ea3c-72c1-4756-8e7c-6ab07b99fbb6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:26.829085 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3612/7280] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:26 2022] POST /identity/v3/projects => generated 375 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:26.833175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e8680-8a32-48ac-be30-f50a2fd629a6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:26.848096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e8680-8a32-48ac-be30-f50a2fd629a6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:26.850565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64ea3c-72c1-4756-8e7c-6ab07b99fbb6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:26.857670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-de64ea3c-72c1-4756-8e7c-6ab07b99fbb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:26.986291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cea51-a766-4e35-9402-f1f01ee4b293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:26.987568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cea51-a766-4e35-9402-f1f01ee4b293 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:26.988161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cea51-a766-4e35-9402-f1f01ee4b293 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:26.989033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cea51-a766-4e35-9402-f1f01ee4b293 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:26.989950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cea51-a766-4e35-9402-f1f01ee4b293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:26.992715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cea51-a766-4e35-9402-f1f01ee4b293 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:27.043037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64ea3c-72c1-4756-8e7c-6ab07b99fbb6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:27.045555 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3669/7281] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:26 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:29:27.049621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cea51-a766-4e35-9402-f1f01ee4b293 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:27.052256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646da9ea-cacb-43b5-b7d7-1d0c6333f448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:27.052937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646da9ea-cacb-43b5-b7d7-1d0c6333f448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:27.053231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646da9ea-cacb-43b5-b7d7-1d0c6333f448 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:27.053514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646da9ea-cacb-43b5-b7d7-1d0c6333f448 admin admin] PATH_INFO: `/v3/projects/c913d686f4bb4e968a757bef17ddb707` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:27.054865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646da9ea-cacb-43b5-b7d7-1d0c6333f448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c913d686f4bb4e968a757bef17ddb707)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:27.057531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646da9ea-cacb-43b5-b7d7-1d0c6333f448 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:27.065513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cea51-a766-4e35-9402-f1f01ee4b293 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:27.081474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c58e45-32b5-4fb4-8ef3-89d28a5dbcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:27.082307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c58e45-32b5-4fb4-8ef3-89d28a5dbcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:27.082757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c58e45-32b5-4fb4-8ef3-89d28a5dbcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:27.083662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c58e45-32b5-4fb4-8ef3-89d28a5dbcf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:27.084650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c58e45-32b5-4fb4-8ef3-89d28a5dbcf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:27.086659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c58e45-32b5-4fb4-8ef3-89d28a5dbcf7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:27.113180 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3670/7282] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:29:27.114616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c58e45-32b5-4fb4-8ef3-89d28a5dbcf7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:27.130742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=3,keystone:SELECT=94,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:27.134991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c58e45-32b5-4fb4-8ef3-89d28a5dbcf7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:27.142098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-646da9ea-cacb-43b5-b7d7-1d0c6333f448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c913d686f4bb4e968a757bef17ddb707', 'request_id': 'req-646da9ea-cacb-43b5-b7d7-1d0c6333f448'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:27.160345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-646da9ea-cacb-43b5-b7d7-1d0c6333f448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c913d686f4bb4e968a757bef17ddb707', 'request_id': 'req-646da9ea-cacb-43b5-b7d7-1d0c6333f448'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:27.170917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-646da9ea-cacb-43b5-b7d7-1d0c6333f448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c913d686f4bb4e968a757bef17ddb707', 'request_id': 'req-646da9ea-cacb-43b5-b7d7-1d0c6333f448'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:27.210313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:27.242088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-646da9ea-cacb-43b5-b7d7-1d0c6333f448 admin admin] The token cache is being invalidate because project c913d686f4bb4e968a757bef17ddb707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:27.243006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-646da9ea-cacb-43b5-b7d7-1d0c6333f448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:27.261081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-646da9ea-cacb-43b5-b7d7-1d0c6333f448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:27.267700 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3613/7283] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:26 2022] DELETE /identity/v3/projects/c913d686f4bb4e968a757bef17ddb707 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:27.273420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646da9ea-cacb-43b5-b7d7-1d0c6333f448 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:27.274975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-646da9ea-cacb-43b5-b7d7-1d0c6333f448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:27.315381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce2fc0-b618-40e7-8106-0b4f807470cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:27.316398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce2fc0-b618-40e7-8106-0b4f807470cc admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:27.317316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce2fc0-b618-40e7-8106-0b4f807470cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:27.317838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce2fc0-b618-40e7-8106-0b4f807470cc admin admin] PATH_INFO: `/v3/projects/2a2be82aa60041c58d80231e9ebd6ed6/users/f3cad833530d49e3bddeabaa370baa47/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:27.423333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce2fc0-b618-40e7-8106-0b4f807470cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2be82aa60041c58d80231e9ebd6ed6, user_id=f3cad833530d49e3bddeabaa370baa47, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:27.438876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce2fc0-b618-40e7-8106-0b4f807470cc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:27.482600 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3671/7284] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:27 2022] PUT /identity/v3/projects/2a2be82aa60041c58d80231e9ebd6ed6/users/f3cad833530d49e3bddeabaa370baa47/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:29:27.486893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce2fc0-b618-40e7-8106-0b4f807470cc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:27.494287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-77ce2fc0-b618-40e7-8106-0b4f807470cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:27.533222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646da9ea-cacb-43b5-b7d7-1d0c6333f448 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:27.637869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce2fc0-b618-40e7-8106-0b4f807470cc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:27.654134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5efdf0-3719-4312-94ea-9aa235276dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:27.655957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5efdf0-3719-4312-94ea-9aa235276dda admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:27.656434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5efdf0-3719-4312-94ea-9aa235276dda admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:27.656875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5efdf0-3719-4312-94ea-9aa235276dda admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:27.658075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5efdf0-3719-4312-94ea-9aa235276dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:27.660853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5efdf0-3719-4312-94ea-9aa235276dda admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:27.694414 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3672/7285] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:27.698938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5efdf0-3719-4312-94ea-9aa235276dda admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:27.718317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5efdf0-3719-4312-94ea-9aa235276dda admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:27.727280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbbf87-b142-451c-a80a-b89c17687240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:27.728851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbbf87-b142-451c-a80a-b89c17687240 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:27.729236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbbf87-b142-451c-a80a-b89c17687240 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:27.733297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbbf87-b142-451c-a80a-b89c17687240 admin admin] PATH_INFO: `/v3/projects/2a2be82aa60041c58d80231e9ebd6ed6/users/f3cad833530d49e3bddeabaa370baa47/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:27.744410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbbf87-b142-451c-a80a-b89c17687240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2be82aa60041c58d80231e9ebd6ed6, user_id=f3cad833530d49e3bddeabaa370baa47, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:27.748791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbbf87-b142-451c-a80a-b89c17687240 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:27.779047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025b42e-d1ec-45e8-8d86-17d3b6093126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:27.779960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025b42e-d1ec-45e8-8d86-17d3b6093126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:27.788531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025b42e-d1ec-45e8-8d86-17d3b6093126 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:27.788863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025b42e-d1ec-45e8-8d86-17d3b6093126 admin admin] PATH_INFO: `/v3/users/846b4ed531b14a338ded23e479cef7ec` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:27.791991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025b42e-d1ec-45e8-8d86-17d3b6093126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=846b4ed531b14a338ded23e479cef7ec)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:27.794574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025b42e-d1ec-45e8-8d86-17d3b6093126 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:27.804829 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3673/7286] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:27 2022] PUT /identity/v3/projects/2a2be82aa60041c58d80231e9ebd6ed6/users/f3cad833530d49e3bddeabaa370baa47/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:27.822344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe683e-ca1a-4f50-a1d0-a533162591cd None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:27.822831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe683e-ca1a-4f50-a1d0-a533162591cd None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:27.823251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe683e-ca1a-4f50-a1d0-a533162591cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:27.943725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0bfe683e-ca1a-4f50-a1d0-a533162591cd None None] MFA Rules not processed for user `f3cad833530d49e3bddeabaa370baa47`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:27.947630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0bfe683e-ca1a-4f50-a1d0-a533162591cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:28.011227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7025b42e-d1ec-45e8-8d86-17d3b6093126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '846b4ed531b14a338ded23e479cef7ec'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:28.014239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7025b42e-d1ec-45e8-8d86-17d3b6093126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '846b4ed531b14a338ded23e479cef7ec'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:28.075210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7025b42e-d1ec-45e8-8d86-17d3b6093126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '846b4ed531b14a338ded23e479cef7ec'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:28.079612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7025b42e-d1ec-45e8-8d86-17d3b6093126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '846b4ed531b14a338ded23e479cef7ec'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:28.097529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7025b42e-d1ec-45e8-8d86-17d3b6093126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '846b4ed531b14a338ded23e479cef7ec'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:28.116338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:28.135411 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3614/7287] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:27 2022] DELETE /identity/v3/users/846b4ed531b14a338ded23e479cef7ec => generated 0 bytes in 860 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:28.171518 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3674/7288] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:28.184179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025b42e-d1ec-45e8-8d86-17d3b6093126 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:28.186600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7025b42e-d1ec-45e8-8d86-17d3b6093126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:28.340439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025b42e-d1ec-45e8-8d86-17d3b6093126 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:28.353272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c051b8-b1b9-4e9e-8497-877a789b7e80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:28.354360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c051b8-b1b9-4e9e-8497-877a789b7e80 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:28.354911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c051b8-b1b9-4e9e-8497-877a789b7e80 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:28.355523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c051b8-b1b9-4e9e-8497-877a789b7e80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:28.357880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f0c051b8-b1b9-4e9e-8497-877a789b7e80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:28.464372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c051b8-b1b9-4e9e-8497-877a789b7e80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:28.466902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c051b8-b1b9-4e9e-8497-877a789b7e80 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:28.485987 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3615/7289] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:28.563460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe683e-ca1a-4f50-a1d0-a533162591cd None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:28.564904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0bfe683e-ca1a-4f50-a1d0-a533162591cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:28.656061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:28.781348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe683e-ca1a-4f50-a1d0-a533162591cd None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:28.960000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff637f16-65c1-4c94-aecd-5223c9524d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:28.962071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff637f16-65c1-4c94-aecd-5223c9524d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:28.963749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff637f16-65c1-4c94-aecd-5223c9524d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:28.965911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff637f16-65c1-4c94-aecd-5223c9524d0a admin admin] PATH_INFO: `/v3/users/03f373601d75447ab5c3a3ce308d1f58` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:28.970565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff637f16-65c1-4c94-aecd-5223c9524d0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=03f373601d75447ab5c3a3ce308d1f58)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:28.976558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff637f16-65c1-4c94-aecd-5223c9524d0a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:29.180538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ff637f16-65c1-4c94-aecd-5223c9524d0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03f373601d75447ab5c3a3ce308d1f58'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:29.246464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ff637f16-65c1-4c94-aecd-5223c9524d0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03f373601d75447ab5c3a3ce308d1f58'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:29.248328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ff637f16-65c1-4c94-aecd-5223c9524d0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03f373601d75447ab5c3a3ce308d1f58'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:29.268372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ff637f16-65c1-4c94-aecd-5223c9524d0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03f373601d75447ab5c3a3ce308d1f58'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:29.270823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ff637f16-65c1-4c94-aecd-5223c9524d0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03f373601d75447ab5c3a3ce308d1f58'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:29.302485 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3675/7290] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:28 2022] DELETE /identity/v3/users/03f373601d75447ab5c3a3ce308d1f58 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:29.307166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66874bd3-903a-4167-bbe7-4c591318b4e2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:29.307597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66874bd3-903a-4167-bbe7-4c591318b4e2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:29.307886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66874bd3-903a-4167-bbe7-4c591318b4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:29.335964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff637f16-65c1-4c94-aecd-5223c9524d0a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:29.337677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ff637f16-65c1-4c94-aecd-5223c9524d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:29.378945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-66874bd3-903a-4167-bbe7-4c591318b4e2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:29.381649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-66874bd3-903a-4167-bbe7-4c591318b4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:29.473870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:29.494673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff637f16-65c1-4c94-aecd-5223c9524d0a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:29.503517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b799f0-63c3-4552-b38c-f2f41438c9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:29.504613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b799f0-63c3-4552-b38c-f2f41438c9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:29.505111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b799f0-63c3-4552-b38c-f2f41438c9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:29.509866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b799f0-63c3-4552-b38c-f2f41438c9b4 admin admin] PATH_INFO: `/v3/projects/0412874ce4e0449399bf346f0f8ac4e5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:29.511129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b799f0-63c3-4552-b38c-f2f41438c9b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0412874ce4e0449399bf346f0f8ac4e5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:29.513756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b799f0-63c3-4552-b38c-f2f41438c9b4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:29.534871 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3616/7291] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:29.571962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66874bd3-903a-4167-bbe7-4c591318b4e2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:29.573951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-66874bd3-903a-4167-bbe7-4c591318b4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:29.624265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-92b799f0-63c3-4552-b38c-f2f41438c9b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0412874ce4e0449399bf346f0f8ac4e5', 'request_id': 'req-92b799f0-63c3-4552-b38c-f2f41438c9b4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:29.639120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-92b799f0-63c3-4552-b38c-f2f41438c9b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0412874ce4e0449399bf346f0f8ac4e5', 'request_id': 'req-92b799f0-63c3-4552-b38c-f2f41438c9b4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:29.654978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-92b799f0-63c3-4552-b38c-f2f41438c9b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0412874ce4e0449399bf346f0f8ac4e5', 'request_id': 'req-92b799f0-63c3-4552-b38c-f2f41438c9b4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:29.684551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-92b799f0-63c3-4552-b38c-f2f41438c9b4 admin admin] The token cache is being invalidate because project 0412874ce4e0449399bf346f0f8ac4e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:29.685143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-92b799f0-63c3-4552-b38c-f2f41438c9b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:29.686749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-92b799f0-63c3-4552-b38c-f2f41438c9b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:29.691743 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3676/7292] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:29 2022] DELETE /identity/v3/projects/0412874ce4e0449399bf346f0f8ac4e5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:29.696336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb3a78-ad20-47cb-a8cc-cb26340cf1ae None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:29.696821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb3a78-ad20-47cb-a8cc-cb26340cf1ae None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:29.697449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb3a78-ad20-47cb-a8cc-cb26340cf1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:29.735577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-68eb3a78-ad20-47cb-a8cc-cb26340cf1ae None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:29.739624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-68eb3a78-ad20-47cb-a8cc-cb26340cf1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:29.751261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66874bd3-903a-4167-bbe7-4c591318b4e2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:29.774194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:29.856395 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3677/7293] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:29.864391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5f270-491f-438d-962c-95d438035c48 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:29.864918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5f270-491f-438d-962c-95d438035c48 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:29.865369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5f270-491f-438d-962c-95d438035c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:29.889368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc6673-7f67-4ce6-a758-b877b71ca0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:29.890016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc6673-7f67-4ce6-a758-b877b71ca0aa service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:29.890502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc6673-7f67-4ce6-a758-b877b71ca0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:29.890788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc6673-7f67-4ce6-a758-b877b71ca0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:29.894756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dccc6673-7f67-4ce6-a758-b877b71ca0aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:29.906481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2be5f270-491f-438d-962c-95d438035c48 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:29.908077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2be5f270-491f-438d-962c-95d438035c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:29.921009 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3678/7294] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:29:29.925628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5f270-491f-438d-962c-95d438035c48 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:29.933773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc6673-7f67-4ce6-a758-b877b71ca0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:29.935730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc6673-7f67-4ce6-a758-b877b71ca0aa service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:29.945000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5f270-491f-438d-962c-95d438035c48 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:29.951436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978a20c-307d-4153-ac3a-0b28ab9eafb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:29.952158 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3617/7295] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:29:29.952279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978a20c-307d-4153-ac3a-0b28ab9eafb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:29.952709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978a20c-307d-4153-ac3a-0b28ab9eafb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:29.952999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978a20c-307d-4153-ac3a-0b28ab9eafb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:29.953708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978a20c-307d-4153-ac3a-0b28ab9eafb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:29:29.954063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978a20c-307d-4153-ac3a-0b28ab9eafb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:29.955883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978a20c-307d-4153-ac3a-0b28ab9eafb1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:29.978969 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3679/7296] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:29:29.981146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc6673-7f67-4ce6-a758-b877b71ca0aa service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:30.016286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc6673-7f67-4ce6-a758-b877b71ca0aa service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:30.030543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68acb6-5dfd-4014-af33-00e0f46ff0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:30.032582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68acb6-5dfd-4014-af33-00e0f46ff0b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:30.033768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68acb6-5dfd-4014-af33-00e0f46ff0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:30.034214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68acb6-5dfd-4014-af33-00e0f46ff0b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:30.038572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68acb6-5dfd-4014-af33-00e0f46ff0b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:30.041393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68acb6-5dfd-4014-af33-00e0f46ff0b3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:30.111185 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3618/7297] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:29 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:30.116297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978a20c-307d-4153-ac3a-0b28ab9eafb1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:30.135982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978a20c-307d-4153-ac3a-0b28ab9eafb1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:30.271478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:30.282238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93a93f-9347-43d8-aae7-a202c6a72e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:30.283379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93a93f-9347-43d8-aae7-a202c6a72e57 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:30.283968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93a93f-9347-43d8-aae7-a202c6a72e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:30.284779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93a93f-9347-43d8-aae7-a202c6a72e57 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:30.287622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93a93f-9347-43d8-aae7-a202c6a72e57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:30.291470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93a93f-9347-43d8-aae7-a202c6a72e57 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:30.373983 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3680/7298] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:30 2022] POST /identity/v3/users => generated 287 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:30.380223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68acb6-5dfd-4014-af33-00e0f46ff0b3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:30.403091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68acb6-5dfd-4014-af33-00e0f46ff0b3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:30.415318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd5d07-2d51-4725-858e-8064a3e83fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:30.416144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd5d07-2d51-4725-858e-8064a3e83fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:30.416144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd5d07-2d51-4725-858e-8064a3e83fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:30.417080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd5d07-2d51-4725-858e-8064a3e83fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:30.418438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd5d07-2d51-4725-858e-8064a3e83fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:30.422904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd5d07-2d51-4725-858e-8064a3e83fe2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:30.452246 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3619/7299] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:30.456654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93a93f-9347-43d8-aae7-a202c6a72e57 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:30.483670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93a93f-9347-43d8-aae7-a202c6a72e57 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:30.491588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb40eb-1396-4d12-953e-eba9a988f443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:30.492744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb40eb-1396-4d12-953e-eba9a988f443 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:30.493133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb40eb-1396-4d12-953e-eba9a988f443 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:30.493547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb40eb-1396-4d12-953e-eba9a988f443 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:30.494393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb40eb-1396-4d12-953e-eba9a988f443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:30.497115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb40eb-1396-4d12-953e-eba9a988f443 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:30.533037 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3681/7300] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:30.533908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd5d07-2d51-4725-858e-8064a3e83fe2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:30.549267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd5d07-2d51-4725-858e-8064a3e83fe2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:30.565252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb40eb-1396-4d12-953e-eba9a988f443 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:30.567130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1fcb40eb-1396-4d12-953e-eba9a988f443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:30.571105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29b808-a016-4f2e-bf2a-d5dbfb66f9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:30.571906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29b808-a016-4f2e-bf2a-d5dbfb66f9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:30.572306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29b808-a016-4f2e-bf2a-d5dbfb66f9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:30.572719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29b808-a016-4f2e-bf2a-d5dbfb66f9e9 admin admin] PATH_INFO: `/v3/projects/5f775b36924d4be3b70b97ee36258290/users/1493dda08c1c46f693568b9d2cbb6548/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:30.593708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29b808-a016-4f2e-bf2a-d5dbfb66f9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f775b36924d4be3b70b97ee36258290, user_id=1493dda08c1c46f693568b9d2cbb6548, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:30.596424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29b808-a016-4f2e-bf2a-d5dbfb66f9e9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:30.617180 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3620/7301] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:30 2022] PUT /identity/v3/projects/5f775b36924d4be3b70b97ee36258290/users/1493dda08c1c46f693568b9d2cbb6548/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:30.632739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103ef2a-60d6-4641-b667-ef6a5b85bd7f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:30.633365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103ef2a-60d6-4641-b667-ef6a5b85bd7f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:30.633500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103ef2a-60d6-4641-b667-ef6a5b85bd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:30.659433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb40eb-1396-4d12-953e-eba9a988f443 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:30.668393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c103ef2a-60d6-4641-b667-ef6a5b85bd7f None None] MFA Rules not processed for user `1493dda08c1c46f693568b9d2cbb6548`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:30.670061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c103ef2a-60d6-4641-b667-ef6a5b85bd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:30.739880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7f06a-acdd-41fe-9914-e785ce91b495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:30.740993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7f06a-acdd-41fe-9914-e785ce91b495 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:30.741863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7f06a-acdd-41fe-9914-e785ce91b495 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:30.742471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7f06a-acdd-41fe-9914-e785ce91b495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:30.744791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0bc7f06a-acdd-41fe-9914-e785ce91b495 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:30.784738 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3621/7302] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:29:30.805648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103ef2a-60d6-4641-b667-ef6a5b85bd7f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:30.865285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7f06a-acdd-41fe-9914-e785ce91b495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:30.869416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7f06a-acdd-41fe-9914-e785ce91b495 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:30.899669 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3682/7303] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:29:30.933583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:30.966579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103ef2a-60d6-4641-b667-ef6a5b85bd7f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:30.983172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3980c1-6e59-4cac-b3c4-49fe5d2e78a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:30.985147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3980c1-6e59-4cac-b3c4-49fe5d2e78a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:30.985453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3980c1-6e59-4cac-b3c4-49fe5d2e78a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:30.985737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3980c1-6e59-4cac-b3c4-49fe5d2e78a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:30.986425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3980c1-6e59-4cac-b3c4-49fe5d2e78a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:30.994333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3980c1-6e59-4cac-b3c4-49fe5d2e78a5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:31.088315 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3622/7304] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:30 2022] POST /identity/v3/projects => generated 373 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:31.090638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7f06a-acdd-41fe-9914-e785ce91b495 service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:31.125335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7f06a-acdd-41fe-9914-e785ce91b495 service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:31.259797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:31.297330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e5750-055c-470e-8a88-ec064ec99783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:31.315731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e5750-055c-470e-8a88-ec064ec99783 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:31.318895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e5750-055c-470e-8a88-ec064ec99783 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:31.320826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e5750-055c-470e-8a88-ec064ec99783 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:31.325856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e5750-055c-470e-8a88-ec064ec99783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:31.332030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e5750-055c-470e-8a88-ec064ec99783 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:31.413118 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3683/7305] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:31 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:31.416800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3980c1-6e59-4cac-b3c4-49fe5d2e78a5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:31.437298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3980c1-6e59-4cac-b3c4-49fe5d2e78a5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:31.447472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509101d-af50-44ec-b32c-c057b6e82463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:31.449612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509101d-af50-44ec-b32c-c057b6e82463 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:31.450169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509101d-af50-44ec-b32c-c057b6e82463 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:31.450685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509101d-af50-44ec-b32c-c057b6e82463 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:31.451972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509101d-af50-44ec-b32c-c057b6e82463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:31.454373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509101d-af50-44ec-b32c-c057b6e82463 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:31.501260 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3623/7306] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:31.502514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e5750-055c-470e-8a88-ec064ec99783 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:31.520116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e5750-055c-470e-8a88-ec064ec99783 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:31.536157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa7c34-83c3-4657-9f78-c6b2c139b262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:31.537413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa7c34-83c3-4657-9f78-c6b2c139b262 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:31.537413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa7c34-83c3-4657-9f78-c6b2c139b262 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:31.539575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa7c34-83c3-4657-9f78-c6b2c139b262 admin admin] PATH_INFO: `/v3/projects/029bbe40080848b8a861fd39bf73e6cd/users/39748171646e4271a40e20dee7006fe2/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:31.586792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa7c34-83c3-4657-9f78-c6b2c139b262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=029bbe40080848b8a861fd39bf73e6cd, user_id=39748171646e4271a40e20dee7006fe2, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:31.592631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa7c34-83c3-4657-9f78-c6b2c139b262 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:31.632999 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3684/7307] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:31 2022] PUT /identity/v3/projects/029bbe40080848b8a861fd39bf73e6cd/users/39748171646e4271a40e20dee7006fe2/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:31.637511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509101d-af50-44ec-b32c-c057b6e82463 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:31.661023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509101d-af50-44ec-b32c-c057b6e82463 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:31.786277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa7c34-83c3-4657-9f78-c6b2c139b262 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:31.788326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-83fa7c34-83c3-4657-9f78-c6b2c139b262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:31.866935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d5643-17ce-461c-ab4e-975824d3c99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:31.867957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d5643-17ce-461c-ab4e-975824d3c99e admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:31.868300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d5643-17ce-461c-ab4e-975824d3c99e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:31.868584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d5643-17ce-461c-ab4e-975824d3c99e admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:31.869602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d5643-17ce-461c-ab4e-975824d3c99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:31.872761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d5643-17ce-461c-ab4e-975824d3c99e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:31.936784 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3624/7308] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:31.937980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d5643-17ce-461c-ab4e-975824d3c99e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:31.962029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d5643-17ce-461c-ab4e-975824d3c99e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:31.971934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fc0ca-358f-43ab-a3c1-2a56bd2f61a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:31.972849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fc0ca-358f-43ab-a3c1-2a56bd2f61a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:31.974181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fc0ca-358f-43ab-a3c1-2a56bd2f61a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:31.975256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fc0ca-358f-43ab-a3c1-2a56bd2f61a0 admin admin] PATH_INFO: `/v3/projects/029bbe40080848b8a861fd39bf73e6cd/users/39748171646e4271a40e20dee7006fe2/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:31.979099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fc0ca-358f-43ab-a3c1-2a56bd2f61a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=029bbe40080848b8a861fd39bf73e6cd, user_id=39748171646e4271a40e20dee7006fe2, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:31.984508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fc0ca-358f-43ab-a3c1-2a56bd2f61a0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:31.991113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa7c34-83c3-4657-9f78-c6b2c139b262 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:32.012529 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3625/7309] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:31 2022] PUT /identity/v3/projects/029bbe40080848b8a861fd39bf73e6cd/users/39748171646e4271a40e20dee7006fe2/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:32.031149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bd94a-96cc-4b46-b6c4-938895dd022a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:32.031491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bd94a-96cc-4b46-b6c4-938895dd022a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:32.031783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bd94a-96cc-4b46-b6c4-938895dd022a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:32.144407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-394bd94a-96cc-4b46-b6c4-938895dd022a None None] MFA Rules not processed for user `39748171646e4271a40e20dee7006fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:32.145836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-394bd94a-96cc-4b46-b6c4-938895dd022a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:32.170993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267d902-fd82-4f5c-9d63-cd4887060dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:32.172889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267d902-fd82-4f5c-9d63-cd4887060dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:32.175832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267d902-fd82-4f5c-9d63-cd4887060dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:32.175969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267d902-fd82-4f5c-9d63-cd4887060dfe admin admin] PATH_INFO: `/v3/projects/4d48c99044864b23a7ed248d345ce668` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:32.183038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267d902-fd82-4f5c-9d63-cd4887060dfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d48c99044864b23a7ed248d345ce668)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:32.186817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267d902-fd82-4f5c-9d63-cd4887060dfe admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:32.299396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c267d902-fd82-4f5c-9d63-cd4887060dfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d48c99044864b23a7ed248d345ce668', 'request_id': 'req-c267d902-fd82-4f5c-9d63-cd4887060dfe'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:32.312412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c267d902-fd82-4f5c-9d63-cd4887060dfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d48c99044864b23a7ed248d345ce668', 'request_id': 'req-c267d902-fd82-4f5c-9d63-cd4887060dfe'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:32.329626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c267d902-fd82-4f5c-9d63-cd4887060dfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d48c99044864b23a7ed248d345ce668', 'request_id': 'req-c267d902-fd82-4f5c-9d63-cd4887060dfe'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:32.330166 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3626/7310] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:32.331345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bd94a-96cc-4b46-b6c4-938895dd022a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:32.331659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:32.361382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c267d902-fd82-4f5c-9d63-cd4887060dfe admin admin] The token cache is being invalidate because project 4d48c99044864b23a7ed248d345ce668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:32.362417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c267d902-fd82-4f5c-9d63-cd4887060dfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:32.363705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c267d902-fd82-4f5c-9d63-cd4887060dfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:32.367626 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3685/7311] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:31 2022] DELETE /identity/v3/projects/4d48c99044864b23a7ed248d345ce668 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:29:32.369016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267d902-fd82-4f5c-9d63-cd4887060dfe admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:32.370901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c267d902-fd82-4f5c-9d63-cd4887060dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:32.433579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:32.504067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bd94a-96cc-4b46-b6c4-938895dd022a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:32.561878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267d902-fd82-4f5c-9d63-cd4887060dfe admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:32.572342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6731c-d932-43bc-a906-662a5c3b9a78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:32.577378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6731c-d932-43bc-a906-662a5c3b9a78 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:32.577860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6731c-d932-43bc-a906-662a5c3b9a78 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:32.578212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6731c-d932-43bc-a906-662a5c3b9a78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:32.582704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-81a6731c-d932-43bc-a906-662a5c3b9a78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:32.635618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f8138-5874-4df4-a0ad-b737f481c794 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:32.635918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f8138-5874-4df4-a0ad-b737f481c794 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:32.636140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f8138-5874-4df4-a0ad-b737f481c794 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:32.637262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f8138-5874-4df4-a0ad-b737f481c794 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:32.639258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8c8f8138-5874-4df4-a0ad-b737f481c794 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:32.816009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6731c-d932-43bc-a906-662a5c3b9a78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:32.818285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6731c-d932-43bc-a906-662a5c3b9a78 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:32.850892 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3686/7312] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:32.858828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f8138-5874-4df4-a0ad-b737f481c794 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:32.860528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f8138-5874-4df4-a0ad-b737f481c794 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:32.916765 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3627/7313] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:32 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:36.146685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6731c-d932-43bc-a906-662a5c3b9a78 service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:36.149023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-81a6731c-d932-43bc-a906-662a5c3b9a78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:36.295574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09fe58-87ff-4db0-9ae3-ed1ad4f074c5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:36.295574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09fe58-87ff-4db0-9ae3-ed1ad4f074c5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:36.295574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09fe58-87ff-4db0-9ae3-ed1ad4f074c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:36.327403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6731c-d932-43bc-a906-662a5c3b9a78 service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:36.338261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df9cf8-2fbf-488a-b8af-2e6b8c2f0b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:36.340164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df9cf8-2fbf-488a-b8af-2e6b8c2f0b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:36.340679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df9cf8-2fbf-488a-b8af-2e6b8c2f0b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:36.341269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df9cf8-2fbf-488a-b8af-2e6b8c2f0b83 admin admin] PATH_INFO: `/v3/users/1493dda08c1c46f693568b9d2cbb6548` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:36.343088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df9cf8-2fbf-488a-b8af-2e6b8c2f0b83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1493dda08c1c46f693568b9d2cbb6548)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:36.345797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df9cf8-2fbf-488a-b8af-2e6b8c2f0b83 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:36.362143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bf09fe58-87ff-4db0-9ae3-ed1ad4f074c5 None None] MFA Rules not processed for user `9f113fc80feb42148c3dad0c33417dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:36.363412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bf09fe58-87ff-4db0-9ae3-ed1ad4f074c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:36.432137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=9,keystone:SELECT=91 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:36.434894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-10df9cf8-2fbf-488a-b8af-2e6b8c2f0b83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1493dda08c1c46f693568b9d2cbb6548'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:36.452086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-10df9cf8-2fbf-488a-b8af-2e6b8c2f0b83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1493dda08c1c46f693568b9d2cbb6548'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:36.453153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-10df9cf8-2fbf-488a-b8af-2e6b8c2f0b83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1493dda08c1c46f693568b9d2cbb6548'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:36.469456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-10df9cf8-2fbf-488a-b8af-2e6b8c2f0b83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1493dda08c1c46f693568b9d2cbb6548'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:36.470469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-10df9cf8-2fbf-488a-b8af-2e6b8c2f0b83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1493dda08c1c46f693568b9d2cbb6548'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:36.515248 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3687/7314] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:36 2022] DELETE /identity/v3/users/1493dda08c1c46f693568b9d2cbb6548 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:36.521040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c4591-425a-4aca-9aeb-8116aecd7d03 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:36.521324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c4591-425a-4aca-9aeb-8116aecd7d03 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:36.521603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c4591-425a-4aca-9aeb-8116aecd7d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:36.590290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-402c4591-425a-4aca-9aeb-8116aecd7d03 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:36.591557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-402c4591-425a-4aca-9aeb-8116aecd7d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:36.599469 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3628/7315] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:36.723359 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3688/7316] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:36.746966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09fe58-87ff-4db0-9ae3-ed1ad4f074c5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:36.755339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bf09fe58-87ff-4db0-9ae3-ed1ad4f074c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:36.765580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c4591-425a-4aca-9aeb-8116aecd7d03 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:36.775196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-402c4591-425a-4aca-9aeb-8116aecd7d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:36.812246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c4591-425a-4aca-9aeb-8116aecd7d03 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:36.830492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332efcf-1ea0-4c6b-8817-43ae112d9c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:36.831200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332efcf-1ea0-4c6b-8817-43ae112d9c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:36.832421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332efcf-1ea0-4c6b-8817-43ae112d9c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:36.832421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332efcf-1ea0-4c6b-8817-43ae112d9c66 admin admin] PATH_INFO: `/v3/users/912871ba807e4fe1a6f59395cb37c98b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:36.839059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332efcf-1ea0-4c6b-8817-43ae112d9c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=912871ba807e4fe1a6f59395cb37c98b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:36.848883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332efcf-1ea0-4c6b-8817-43ae112d9c66 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:36.894447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:36.929710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09fe58-87ff-4db0-9ae3-ed1ad4f074c5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:36.956026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4332efcf-1ea0-4c6b-8817-43ae112d9c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '912871ba807e4fe1a6f59395cb37c98b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:36.974234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4332efcf-1ea0-4c6b-8817-43ae112d9c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '912871ba807e4fe1a6f59395cb37c98b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:36.977061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4332efcf-1ea0-4c6b-8817-43ae112d9c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '912871ba807e4fe1a6f59395cb37c98b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:37.004848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4332efcf-1ea0-4c6b-8817-43ae112d9c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '912871ba807e4fe1a6f59395cb37c98b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:37.007137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4332efcf-1ea0-4c6b-8817-43ae112d9c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '912871ba807e4fe1a6f59395cb37c98b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:37.032476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3e4b5-0ce1-4515-8480-0e510d2cd2ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:37.033965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3e4b5-0ce1-4515-8480-0e510d2cd2ea service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:37.034530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3e4b5-0ce1-4515-8480-0e510d2cd2ea service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:37.035065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3e4b5-0ce1-4515-8480-0e510d2cd2ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:37.037033 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3689/7317] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:36 2022] DELETE /identity/v3/users/912871ba807e4fe1a6f59395cb37c98b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:37.037948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4ff3e4b5-0ce1-4515-8480-0e510d2cd2ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:37.042763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc57ba-c5bc-47a6-adc1-76e2812cf7b8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:37.043029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc57ba-c5bc-47a6-adc1-76e2812cf7b8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:37.043692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc57ba-c5bc-47a6-adc1-76e2812cf7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:37.074669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3e4b5-0ce1-4515-8480-0e510d2cd2ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:37.080388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3e4b5-0ce1-4515-8480-0e510d2cd2ea service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:37.107172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1bcc57ba-c5bc-47a6-adc1-76e2812cf7b8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:37.108874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1bcc57ba-c5bc-47a6-adc1-76e2812cf7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:37.132010 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3629/7318] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:37.177747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:37.220705 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3690/7319] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:37.227576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3e4b5-0ce1-4515-8480-0e510d2cd2ea service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:37.229286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4ff3e4b5-0ce1-4515-8480-0e510d2cd2ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:37.250676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3e4b5-0ce1-4515-8480-0e510d2cd2ea service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:37.393263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab122cf-ef73-4473-957e-e21ffeadfccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:37.399054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab122cf-ef73-4473-957e-e21ffeadfccc service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:37.400297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab122cf-ef73-4473-957e-e21ffeadfccc service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:37.400707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab122cf-ef73-4473-957e-e21ffeadfccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:37.428688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab122cf-ef73-4473-957e-e21ffeadfccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:37.430782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab122cf-ef73-4473-957e-e21ffeadfccc service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:37.450250 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3630/7320] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:37.687519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc57ba-c5bc-47a6-adc1-76e2812cf7b8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:37.689164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1bcc57ba-c5bc-47a6-adc1-76e2812cf7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:37.705946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc57ba-c5bc-47a6-adc1-76e2812cf7b8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:37.711860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518bb76-f99b-455f-825b-e7558c13f924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:37.712466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518bb76-f99b-455f-825b-e7558c13f924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:37.712809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518bb76-f99b-455f-825b-e7558c13f924 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:37.713095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518bb76-f99b-455f-825b-e7558c13f924 admin admin] PATH_INFO: `/v3/users/800c2fc6e5114172a6994ca3d1ae0362` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:37.714891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518bb76-f99b-455f-825b-e7558c13f924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=800c2fc6e5114172a6994ca3d1ae0362)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:37.717053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518bb76-f99b-455f-825b-e7558c13f924 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:37.803416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a518bb76-f99b-455f-825b-e7558c13f924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800c2fc6e5114172a6994ca3d1ae0362'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:37.821171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a518bb76-f99b-455f-825b-e7558c13f924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800c2fc6e5114172a6994ca3d1ae0362'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:37.822996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a518bb76-f99b-455f-825b-e7558c13f924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800c2fc6e5114172a6994ca3d1ae0362'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:37.836358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a518bb76-f99b-455f-825b-e7558c13f924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800c2fc6e5114172a6994ca3d1ae0362'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:37.837968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a518bb76-f99b-455f-825b-e7558c13f924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800c2fc6e5114172a6994ca3d1ae0362'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:37.867096 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3691/7321] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:37 2022] DELETE /identity/v3/users/800c2fc6e5114172a6994ca3d1ae0362 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:37.872793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560473ea-1625-4e01-bf07-b706abca3a24 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:37.873419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560473ea-1625-4e01-bf07-b706abca3a24 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:37.874243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560473ea-1625-4e01-bf07-b706abca3a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:37.932799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-560473ea-1625-4e01-bf07-b706abca3a24 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:37.938711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-560473ea-1625-4e01-bf07-b706abca3a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:38.082725 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3631/7322] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:29:38.093857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518bb76-f99b-455f-825b-e7558c13f924 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:38.095380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a518bb76-f99b-455f-825b-e7558c13f924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:38.145522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560473ea-1625-4e01-bf07-b706abca3a24 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:38.148062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-560473ea-1625-4e01-bf07-b706abca3a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:38.167262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560473ea-1625-4e01-bf07-b706abca3a24 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:38.178116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02f5ac-a0e0-4e85-a9f6-7c516d0f222e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:38.194170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02f5ac-a0e0-4e85-a9f6-7c516d0f222e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:38.194705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02f5ac-a0e0-4e85-a9f6-7c516d0f222e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:38.196483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02f5ac-a0e0-4e85-a9f6-7c516d0f222e admin admin] PATH_INFO: `/v3/projects/f071f5eb3ec3467087821e72dbc5df6c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:38.203887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02f5ac-a0e0-4e85-a9f6-7c516d0f222e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f071f5eb3ec3467087821e72dbc5df6c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:38.208061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02f5ac-a0e0-4e85-a9f6-7c516d0f222e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:38.253028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518bb76-f99b-455f-825b-e7558c13f924 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:38.268635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58a71f-47d0-45d6-a777-d03224a9c8f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:38.269274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58a71f-47d0-45d6-a777-d03224a9c8f9 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:38.269555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58a71f-47d0-45d6-a777-d03224a9c8f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:38.269833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58a71f-47d0-45d6-a777-d03224a9c8f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:38.308998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58a71f-47d0-45d6-a777-d03224a9c8f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:38.312397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58a71f-47d0-45d6-a777-d03224a9c8f9 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:38.321957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:38.365094 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3692/7323] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:38.376870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9a02f5ac-a0e0-4e85-a9f6-7c516d0f222e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f071f5eb3ec3467087821e72dbc5df6c', 'request_id': 'req-9a02f5ac-a0e0-4e85-a9f6-7c516d0f222e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:38.399048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9a02f5ac-a0e0-4e85-a9f6-7c516d0f222e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f071f5eb3ec3467087821e72dbc5df6c', 'request_id': 'req-9a02f5ac-a0e0-4e85-a9f6-7c516d0f222e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:38.423403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9a02f5ac-a0e0-4e85-a9f6-7c516d0f222e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f071f5eb3ec3467087821e72dbc5df6c', 'request_id': 'req-9a02f5ac-a0e0-4e85-a9f6-7c516d0f222e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:38.457746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9a02f5ac-a0e0-4e85-a9f6-7c516d0f222e admin admin] The token cache is being invalidate because project f071f5eb3ec3467087821e72dbc5df6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:38.458620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9a02f5ac-a0e0-4e85-a9f6-7c516d0f222e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:38.461163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9a02f5ac-a0e0-4e85-a9f6-7c516d0f222e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:38.463077 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3632/7324] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:38 2022] DELETE /identity/v3/projects/f071f5eb3ec3467087821e72dbc5df6c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:38.469087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feec19f-457a-4a1b-bac6-45164599bcc7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:38.469784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feec19f-457a-4a1b-bac6-45164599bcc7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:38.470744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feec19f-457a-4a1b-bac6-45164599bcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:38.491052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02f5ac-a0e0-4e85-a9f6-7c516d0f222e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:38.492694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9a02f5ac-a0e0-4e85-a9f6-7c516d0f222e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:38.519812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9feec19f-457a-4a1b-bac6-45164599bcc7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:38.524327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9feec19f-457a-4a1b-bac6-45164599bcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:38.696968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:38.728468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02f5ac-a0e0-4e85-a9f6-7c516d0f222e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:38.737303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb56f3-f29d-4f2e-9e98-e40ee0432e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:38.738117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb56f3-f29d-4f2e-9e98-e40ee0432e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:38.738443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb56f3-f29d-4f2e-9e98-e40ee0432e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:38.739217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb56f3-f29d-4f2e-9e98-e40ee0432e70 admin admin] PATH_INFO: `/v3/projects/5f775b36924d4be3b70b97ee36258290` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:38.762373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb56f3-f29d-4f2e-9e98-e40ee0432e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f775b36924d4be3b70b97ee36258290)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:38.767674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb56f3-f29d-4f2e-9e98-e40ee0432e70 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:38.768778 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3693/7325] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:38.772884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22da517-519a-4b76-9080-bf388b2471fa None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:38.773578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22da517-519a-4b76-9080-bf388b2471fa None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:38.774027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22da517-519a-4b76-9080-bf388b2471fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:38.834401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f22da517-519a-4b76-9080-bf388b2471fa None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:38.848590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f22da517-519a-4b76-9080-bf388b2471fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:38.875959 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3694/7326] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:38.880823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22da517-519a-4b76-9080-bf388b2471fa None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:38.894497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22da517-519a-4b76-9080-bf388b2471fa None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:38.912128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96968585-0d70-483f-b3c6-ba63dca02bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:38.912869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96968585-0d70-483f-b3c6-ba63dca02bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:38.913218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96968585-0d70-483f-b3c6-ba63dca02bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:38.913588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96968585-0d70-483f-b3c6-ba63dca02bf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:38.914568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96968585-0d70-483f-b3c6-ba63dca02bf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:29:38.914776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96968585-0d70-483f-b3c6-ba63dca02bf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:38.916859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96968585-0d70-483f-b3c6-ba63dca02bf9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:38.935722 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3695/7327] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:29:38.936929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96968585-0d70-483f-b3c6-ba63dca02bf9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:38.957226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96968585-0d70-483f-b3c6-ba63dca02bf9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:38.974375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c6eb56f3-f29d-4f2e-9e98-e40ee0432e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f775b36924d4be3b70b97ee36258290', 'request_id': 'req-c6eb56f3-f29d-4f2e-9e98-e40ee0432e70'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:38.995982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c6eb56f3-f29d-4f2e-9e98-e40ee0432e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f775b36924d4be3b70b97ee36258290', 'request_id': 'req-c6eb56f3-f29d-4f2e-9e98-e40ee0432e70'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:39.005135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c6eb56f3-f29d-4f2e-9e98-e40ee0432e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f775b36924d4be3b70b97ee36258290', 'request_id': 'req-c6eb56f3-f29d-4f2e-9e98-e40ee0432e70'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:39.039473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c6eb56f3-f29d-4f2e-9e98-e40ee0432e70 admin admin] The token cache is being invalidate because project 5f775b36924d4be3b70b97ee36258290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:39.040875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c6eb56f3-f29d-4f2e-9e98-e40ee0432e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:39.042129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c6eb56f3-f29d-4f2e-9e98-e40ee0432e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:39.049266 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3633/7328] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:38 2022] DELETE /identity/v3/projects/5f775b36924d4be3b70b97ee36258290 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:29:39.053551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb56f3-f29d-4f2e-9e98-e40ee0432e70 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:39.060052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c6eb56f3-f29d-4f2e-9e98-e40ee0432e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:39.078326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33398b1a-8e8b-431c-9aa6-1448bbd346af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:39.079107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33398b1a-8e8b-431c-9aa6-1448bbd346af admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:39.079252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33398b1a-8e8b-431c-9aa6-1448bbd346af admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:39.079586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33398b1a-8e8b-431c-9aa6-1448bbd346af admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:39.080246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33398b1a-8e8b-431c-9aa6-1448bbd346af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:39.082170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33398b1a-8e8b-431c-9aa6-1448bbd346af admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:39.101175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb56f3-f29d-4f2e-9e98-e40ee0432e70 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:39.118052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9a018-04e5-491c-acd4-556a4d42a6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:39.118649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9a018-04e5-491c-acd4-556a4d42a6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:39.119411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9a018-04e5-491c-acd4-556a4d42a6af admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:39.119411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9a018-04e5-491c-acd4-556a4d42a6af admin admin] PATH_INFO: `/v3/users/39748171646e4271a40e20dee7006fe2` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:39.123803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9a018-04e5-491c-acd4-556a4d42a6af admin admin] RBAC: Authorizing `identity:delete_user(user_id=39748171646e4271a40e20dee7006fe2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:39.130047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9a018-04e5-491c-acd4-556a4d42a6af admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:39.158745 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3696/7329] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:38 2022] POST /identity/v3/projects => generated 359 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:39.161648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33398b1a-8e8b-431c-9aa6-1448bbd346af admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:39.165140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-33398b1a-8e8b-431c-9aa6-1448bbd346af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:39.246723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7a9a018-04e5-491c-acd4-556a4d42a6af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39748171646e4271a40e20dee7006fe2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:39.248107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7a9a018-04e5-491c-acd4-556a4d42a6af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39748171646e4271a40e20dee7006fe2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:39.254857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:39.283601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7a9a018-04e5-491c-acd4-556a4d42a6af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39748171646e4271a40e20dee7006fe2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:39.284809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7a9a018-04e5-491c-acd4-556a4d42a6af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39748171646e4271a40e20dee7006fe2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:39.311119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7a9a018-04e5-491c-acd4-556a4d42a6af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39748171646e4271a40e20dee7006fe2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:39.356323 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3634/7330] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:39 2022] DELETE /identity/v3/users/39748171646e4271a40e20dee7006fe2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:39.405242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33398b1a-8e8b-431c-9aa6-1448bbd346af admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:39.539972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacfe2a-d41f-4fe5-aa1a-fb8d72bbbc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:39.540961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacfe2a-d41f-4fe5-aa1a-fb8d72bbbc8c admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:39.541326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacfe2a-d41f-4fe5-aa1a-fb8d72bbbc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:39.541680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacfe2a-d41f-4fe5-aa1a-fb8d72bbbc8c admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:39.542533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacfe2a-d41f-4fe5-aa1a-fb8d72bbbc8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:39.545372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacfe2a-d41f-4fe5-aa1a-fb8d72bbbc8c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:39.559747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:39.582860 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3697/7331] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:39 2022] POST /identity/v3/users => generated 280 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:29:39.586707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9a018-04e5-491c-acd4-556a4d42a6af admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:39.588891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a7a9a018-04e5-491c-acd4-556a4d42a6af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:39.606633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacfe2a-d41f-4fe5-aa1a-fb8d72bbbc8c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:39.610948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-eeacfe2a-d41f-4fe5-aa1a-fb8d72bbbc8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:39.616410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9a018-04e5-491c-acd4-556a4d42a6af admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:39.632694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacfe2a-d41f-4fe5-aa1a-fb8d72bbbc8c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:39.633095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71557a-5a97-463f-b9d5-4c80c697f1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:39.634052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71557a-5a97-463f-b9d5-4c80c697f1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:39.634726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71557a-5a97-463f-b9d5-4c80c697f1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:39.635167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71557a-5a97-463f-b9d5-4c80c697f1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:39.636587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71557a-5a97-463f-b9d5-4c80c697f1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:39.640713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71557a-5a97-463f-b9d5-4c80c697f1d7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:39.646559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205c634-21b2-481f-82d6-dc50505cab79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:39.647569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205c634-21b2-481f-82d6-dc50505cab79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:39.647569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205c634-21b2-481f-82d6-dc50505cab79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:39.647845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205c634-21b2-481f-82d6-dc50505cab79 admin admin] PATH_INFO: `/v3/projects/1a7b5de3c9834471a1ff40d046bb102e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:39.651222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205c634-21b2-481f-82d6-dc50505cab79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a7b5de3c9834471a1ff40d046bb102e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:39.653800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205c634-21b2-481f-82d6-dc50505cab79 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:39.669635 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3635/7332] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:39.673589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71557a-5a97-463f-b9d5-4c80c697f1d7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:39.708697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71557a-5a97-463f-b9d5-4c80c697f1d7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:39.726194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07053e8e-0065-4654-94a6-0617b2a3f55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:39.727430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07053e8e-0065-4654-94a6-0617b2a3f55c admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:39.727885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07053e8e-0065-4654-94a6-0617b2a3f55c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:39.729429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07053e8e-0065-4654-94a6-0617b2a3f55c admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:39.731804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07053e8e-0065-4654-94a6-0617b2a3f55c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:39.743680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07053e8e-0065-4654-94a6-0617b2a3f55c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:39.777574 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3636/7333] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:39.781330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07053e8e-0065-4654-94a6-0617b2a3f55c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:39.791028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4205c634-21b2-481f-82d6-dc50505cab79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a7b5de3c9834471a1ff40d046bb102e', 'request_id': 'req-4205c634-21b2-481f-82d6-dc50505cab79'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:39.805628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07053e8e-0065-4654-94a6-0617b2a3f55c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:39.813731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4205c634-21b2-481f-82d6-dc50505cab79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a7b5de3c9834471a1ff40d046bb102e', 'request_id': 'req-4205c634-21b2-481f-82d6-dc50505cab79'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:39.834840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4205c634-21b2-481f-82d6-dc50505cab79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a7b5de3c9834471a1ff40d046bb102e', 'request_id': 'req-4205c634-21b2-481f-82d6-dc50505cab79'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:39.848062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4205c634-21b2-481f-82d6-dc50505cab79 admin admin] The token cache is being invalidate because project 1a7b5de3c9834471a1ff40d046bb102e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:39.848450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4205c634-21b2-481f-82d6-dc50505cab79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:39.849252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4205c634-21b2-481f-82d6-dc50505cab79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:39.851049 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3698/7334] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:39 2022] DELETE /identity/v3/projects/1a7b5de3c9834471a1ff40d046bb102e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:39.855184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205c634-21b2-481f-82d6-dc50505cab79 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:39.858863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4205c634-21b2-481f-82d6-dc50505cab79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:39.938782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14d23b-3f88-4e8f-ad18-9fea151d8028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:39.938782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14d23b-3f88-4e8f-ad18-9fea151d8028 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:39.938782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14d23b-3f88-4e8f-ad18-9fea151d8028 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:39.938782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14d23b-3f88-4e8f-ad18-9fea151d8028 admin admin] PATH_INFO: `/v3/projects/d33ec5ea91e14fb9942929e0cee49fe3/users/d19ca91e192b4579a186004318cb4828/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:39.957332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14d23b-3f88-4e8f-ad18-9fea151d8028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d33ec5ea91e14fb9942929e0cee49fe3, user_id=d19ca91e192b4579a186004318cb4828, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:39.963181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14d23b-3f88-4e8f-ad18-9fea151d8028 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:40.019786 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3637/7335] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:39 2022] PUT /identity/v3/projects/d33ec5ea91e14fb9942929e0cee49fe3/users/d19ca91e192b4579a186004318cb4828/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:40.030512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844ae28-a40e-4f36-99de-3484668e962f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:40.031057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844ae28-a40e-4f36-99de-3484668e962f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:40.031821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844ae28-a40e-4f36-99de-3484668e962f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:40.048865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205c634-21b2-481f-82d6-dc50505cab79 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:40.147276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9844ae28-a40e-4f36-99de-3484668e962f None None] MFA Rules not processed for user `d19ca91e192b4579a186004318cb4828`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:40.150189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9844ae28-a40e-4f36-99de-3484668e962f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:40.191862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d068a-feb8-4c8b-a372-f85ec7995fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:40.192542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d068a-feb8-4c8b-a372-f85ec7995fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:40.192833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d068a-feb8-4c8b-a372-f85ec7995fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:40.193105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d068a-feb8-4c8b-a372-f85ec7995fc5 admin admin] PATH_INFO: `/v3/users/1a9273041d7a4c8aba534f8b30fc51d4` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:40.198624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d068a-feb8-4c8b-a372-f85ec7995fc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a9273041d7a4c8aba534f8b30fc51d4)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:40.200753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d068a-feb8-4c8b-a372-f85ec7995fc5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:40.281837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:40.332681 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3638/7336] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:40 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:40.346008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b04d068a-feb8-4c8b-a372-f85ec7995fc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a9273041d7a4c8aba534f8b30fc51d4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:40.383787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b04d068a-feb8-4c8b-a372-f85ec7995fc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a9273041d7a4c8aba534f8b30fc51d4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:40.386127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b04d068a-feb8-4c8b-a372-f85ec7995fc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a9273041d7a4c8aba534f8b30fc51d4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:40.391555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844ae28-a40e-4f36-99de-3484668e962f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:40.392687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9844ae28-a40e-4f36-99de-3484668e962f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:40.416140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b04d068a-feb8-4c8b-a372-f85ec7995fc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a9273041d7a4c8aba534f8b30fc51d4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:40.418101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b04d068a-feb8-4c8b-a372-f85ec7995fc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a9273041d7a4c8aba534f8b30fc51d4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:40.451019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:40.456167 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3699/7337] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:39 2022] DELETE /identity/v3/users/1a9273041d7a4c8aba534f8b30fc51d4 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:40.536096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d068a-feb8-4c8b-a372-f85ec7995fc5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:40.538189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b04d068a-feb8-4c8b-a372-f85ec7995fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:40.590489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844ae28-a40e-4f36-99de-3484668e962f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:40.680771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683fc4b-5268-4b5c-8bd1-6038013c2c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:40.688538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683fc4b-5268-4b5c-8bd1-6038013c2c7c service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:40.689397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683fc4b-5268-4b5c-8bd1-6038013c2c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:40.690106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683fc4b-5268-4b5c-8bd1-6038013c2c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:40.692860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3683fc4b-5268-4b5c-8bd1-6038013c2c7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:40.727685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d068a-feb8-4c8b-a372-f85ec7995fc5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:40.744060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b3080-7bdc-4648-b4f3-f3d43e642a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:40.747597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b3080-7bdc-4648-b4f3-f3d43e642a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:40.747964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b3080-7bdc-4648-b4f3-f3d43e642a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:40.748450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b3080-7bdc-4648-b4f3-f3d43e642a97 admin admin] PATH_INFO: `/v3/projects/029bbe40080848b8a861fd39bf73e6cd` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:40.750738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b3080-7bdc-4648-b4f3-f3d43e642a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=029bbe40080848b8a861fd39bf73e6cd)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:40.754371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b3080-7bdc-4648-b4f3-f3d43e642a97 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:40.817853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683fc4b-5268-4b5c-8bd1-6038013c2c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:40.819952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683fc4b-5268-4b5c-8bd1-6038013c2c7c service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:40.833190 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3639/7338] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:40 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:40.854440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5f1b3080-7bdc-4648-b4f3-f3d43e642a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '029bbe40080848b8a861fd39bf73e6cd', 'request_id': 'req-5f1b3080-7bdc-4648-b4f3-f3d43e642a97'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:40.867872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5f1b3080-7bdc-4648-b4f3-f3d43e642a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '029bbe40080848b8a861fd39bf73e6cd', 'request_id': 'req-5f1b3080-7bdc-4648-b4f3-f3d43e642a97'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:40.879223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5f1b3080-7bdc-4648-b4f3-f3d43e642a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '029bbe40080848b8a861fd39bf73e6cd', 'request_id': 'req-5f1b3080-7bdc-4648-b4f3-f3d43e642a97'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:40.893208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5f1b3080-7bdc-4648-b4f3-f3d43e642a97 admin admin] The token cache is being invalidate because project 029bbe40080848b8a861fd39bf73e6cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:40.893422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5f1b3080-7bdc-4648-b4f3-f3d43e642a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:40.894229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5f1b3080-7bdc-4648-b4f3-f3d43e642a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:40.896266 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3700/7339] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:40 2022] DELETE /identity/v3/projects/029bbe40080848b8a861fd39bf73e6cd => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:40.900983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bb9d3-5db8-459e-9cc8-cd87cc69f2bd None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:40.901407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bb9d3-5db8-459e-9cc8-cd87cc69f2bd None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:40.902472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bb9d3-5db8-459e-9cc8-cd87cc69f2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:40.936311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-073bb9d3-5db8-459e-9cc8-cd87cc69f2bd None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:40.937676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-073bb9d3-5db8-459e-9cc8-cd87cc69f2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:41.086583 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3640/7340] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:29:41.095101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87c336-f829-4867-9d68-8c9ac11628e4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:41.095428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87c336-f829-4867-9d68-8c9ac11628e4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:41.095710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87c336-f829-4867-9d68-8c9ac11628e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:41.117333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0e87c336-f829-4867-9d68-8c9ac11628e4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:41.118619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0e87c336-f829-4867-9d68-8c9ac11628e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:41.136468 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3701/7341] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:41.137347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bb9d3-5db8-459e-9cc8-cd87cc69f2bd None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:41.150351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bb9d3-5db8-459e-9cc8-cd87cc69f2bd None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:41.163772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b5a24-69d6-4660-95c0-5cb3afdf0ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:41.164753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b5a24-69d6-4660-95c0-5cb3afdf0ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:41.164753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b5a24-69d6-4660-95c0-5cb3afdf0ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:41.165023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b5a24-69d6-4660-95c0-5cb3afdf0ce4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:41.165684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b5a24-69d6-4660-95c0-5cb3afdf0ce4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:29:41.166061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b5a24-69d6-4660-95c0-5cb3afdf0ce4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:41.167790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b5a24-69d6-4660-95c0-5cb3afdf0ce4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:41.193494 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3641/7342] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:29:41.194307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87c336-f829-4867-9d68-8c9ac11628e4 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:41.210894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87c336-f829-4867-9d68-8c9ac11628e4 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:41.217373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04666728-d99e-46d1-bcd9-5503957a2774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:41.218507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04666728-d99e-46d1-bcd9-5503957a2774 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:41.218507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04666728-d99e-46d1-bcd9-5503957a2774 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:41.218718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04666728-d99e-46d1-bcd9-5503957a2774 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:41.219452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04666728-d99e-46d1-bcd9-5503957a2774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:41.221370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04666728-d99e-46d1-bcd9-5503957a2774 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:41.281807 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3702/7343] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:41 2022] POST /identity/v3/projects => generated 381 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:41.283155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b5a24-69d6-4660-95c0-5cb3afdf0ce4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:41.300366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b5a24-69d6-4660-95c0-5cb3afdf0ce4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:41.320856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:41.392777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689fb72-9c46-4fa7-8a33-8d5943d23fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:41.393188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689fb72-9c46-4fa7-8a33-8d5943d23fad admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:41.393476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689fb72-9c46-4fa7-8a33-8d5943d23fad admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:41.393760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689fb72-9c46-4fa7-8a33-8d5943d23fad admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:41.394536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689fb72-9c46-4fa7-8a33-8d5943d23fad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:41.397218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689fb72-9c46-4fa7-8a33-8d5943d23fad admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:41.430205 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3642/7344] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:41 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:29:41.434666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04666728-d99e-46d1-bcd9-5503957a2774 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:41.448430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:41.471664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04666728-d99e-46d1-bcd9-5503957a2774 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:41.484445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f600e-6dec-404e-97a8-99e9265a2066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:41.487405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f600e-6dec-404e-97a8-99e9265a2066 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:41.487700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f600e-6dec-404e-97a8-99e9265a2066 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:41.490823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f600e-6dec-404e-97a8-99e9265a2066 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:41.491715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f600e-6dec-404e-97a8-99e9265a2066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:41.505569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f600e-6dec-404e-97a8-99e9265a2066 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:41.536240 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3703/7345] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:41.538229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689fb72-9c46-4fa7-8a33-8d5943d23fad admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:41.552556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689fb72-9c46-4fa7-8a33-8d5943d23fad admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:41.567000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cd2a4-0d14-433e-9fd5-f106ee188536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:41.568159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cd2a4-0d14-433e-9fd5-f106ee188536 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:41.568614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cd2a4-0d14-433e-9fd5-f106ee188536 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:41.569066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cd2a4-0d14-433e-9fd5-f106ee188536 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:41.570071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cd2a4-0d14-433e-9fd5-f106ee188536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:41.571901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cd2a4-0d14-433e-9fd5-f106ee188536 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:41.595642 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3643/7346] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:41.596782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f600e-6dec-404e-97a8-99e9265a2066 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:41.617672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f600e-6dec-404e-97a8-99e9265a2066 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:41.632110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20457078-6c68-4e11-bf60-4aa7e95e3fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:41.632735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20457078-6c68-4e11-bf60-4aa7e95e3fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:41.634278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20457078-6c68-4e11-bf60-4aa7e95e3fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:41.634582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20457078-6c68-4e11-bf60-4aa7e95e3fa0 admin admin] PATH_INFO: `/v3/projects/f3cc8f1d43494d49bdf77a5bdb852f19/users/c9bb480dc5a14b018f6aab37206aefd0/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:41.664620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20457078-6c68-4e11-bf60-4aa7e95e3fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3cc8f1d43494d49bdf77a5bdb852f19, user_id=c9bb480dc5a14b018f6aab37206aefd0, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:41.668642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20457078-6c68-4e11-bf60-4aa7e95e3fa0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:41.701409 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3704/7347] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:41 2022] PUT /identity/v3/projects/f3cc8f1d43494d49bdf77a5bdb852f19/users/c9bb480dc5a14b018f6aab37206aefd0/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:41.704757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05130-4b93-4175-a103-d54e6aa2b643 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:41.707574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05130-4b93-4175-a103-d54e6aa2b643 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:41.707885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05130-4b93-4175-a103-d54e6aa2b643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:41.726229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20457078-6c68-4e11-bf60-4aa7e95e3fa0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:41.731650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-20457078-6c68-4e11-bf60-4aa7e95e3fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:41.764269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a1a05130-4b93-4175-a103-d54e6aa2b643 None None] MFA Rules not processed for user `c9bb480dc5a14b018f6aab37206aefd0`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:41.766119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a1a05130-4b93-4175-a103-d54e6aa2b643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:41.906129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20457078-6c68-4e11-bf60-4aa7e95e3fa0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:41.914940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcfb21-ac2d-4f36-82b6-c6c6915658d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:41.915777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcfb21-ac2d-4f36-82b6-c6c6915658d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:41.916156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcfb21-ac2d-4f36-82b6-c6c6915658d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:41.916454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcfb21-ac2d-4f36-82b6-c6c6915658d3 admin admin] PATH_INFO: `/v3/projects/81a85f6873a04d9092d31b93d0d4404a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:41.918524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcfb21-ac2d-4f36-82b6-c6c6915658d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a85f6873a04d9092d31b93d0d4404a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:41.923502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcfb21-ac2d-4f36-82b6-c6c6915658d3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:41.924486 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3644/7348] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:41.932542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a05130-4b93-4175-a103-d54e6aa2b643 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:41.937951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a1a05130-4b93-4175-a103-d54e6aa2b643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:42.010071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eefcfb21-ac2d-4f36-82b6-c6c6915658d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a85f6873a04d9092d31b93d0d4404a', 'request_id': 'req-eefcfb21-ac2d-4f36-82b6-c6c6915658d3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:42.040236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eefcfb21-ac2d-4f36-82b6-c6c6915658d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a85f6873a04d9092d31b93d0d4404a', 'request_id': 'req-eefcfb21-ac2d-4f36-82b6-c6c6915658d3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:42.059955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eefcfb21-ac2d-4f36-82b6-c6c6915658d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a85f6873a04d9092d31b93d0d4404a', 'request_id': 'req-eefcfb21-ac2d-4f36-82b6-c6c6915658d3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:42.073656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a05130-4b93-4175-a103-d54e6aa2b643 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:42.082995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eefcfb21-ac2d-4f36-82b6-c6c6915658d3 admin admin] The token cache is being invalidate because project 81a85f6873a04d9092d31b93d0d4404a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:42.083595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eefcfb21-ac2d-4f36-82b6-c6c6915658d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:42.084465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-eefcfb21-ac2d-4f36-82b6-c6c6915658d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:42.090289 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3705/7349] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:41 2022] DELETE /identity/v3/projects/81a85f6873a04d9092d31b93d0d4404a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:42.091409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcfb21-ac2d-4f36-82b6-c6c6915658d3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:42.093079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-eefcfb21-ac2d-4f36-82b6-c6c6915658d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:42.125514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:42.148862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a763f-4bb2-41f8-b50c-2b86d4f3fc54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:42.149724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a763f-4bb2-41f8-b50c-2b86d4f3fc54 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:42.150032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a763f-4bb2-41f8-b50c-2b86d4f3fc54 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:42.150666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a763f-4bb2-41f8-b50c-2b86d4f3fc54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:42.153698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c38a763f-4bb2-41f8-b50c-2b86d4f3fc54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:42.197228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcfb21-ac2d-4f36-82b6-c6c6915658d3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:42.202691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54718df8-43f6-49f5-a3ca-970aff43738c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:42.203500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54718df8-43f6-49f5-a3ca-970aff43738c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:42.204019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54718df8-43f6-49f5-a3ca-970aff43738c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:42.204466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54718df8-43f6-49f5-a3ca-970aff43738c admin admin] PATH_INFO: `/v3/users/f3cad833530d49e3bddeabaa370baa47` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:42.207053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54718df8-43f6-49f5-a3ca-970aff43738c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3cad833530d49e3bddeabaa370baa47)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:42.210888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54718df8-43f6-49f5-a3ca-970aff43738c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:42.216875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:42.342080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a763f-4bb2-41f8-b50c-2b86d4f3fc54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:42.343590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a763f-4bb2-41f8-b50c-2b86d4f3fc54 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:42.344969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-54718df8-43f6-49f5-a3ca-970aff43738c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3cad833530d49e3bddeabaa370baa47'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:42.365925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-54718df8-43f6-49f5-a3ca-970aff43738c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3cad833530d49e3bddeabaa370baa47'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:42.367080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-54718df8-43f6-49f5-a3ca-970aff43738c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3cad833530d49e3bddeabaa370baa47'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:42.378128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-54718df8-43f6-49f5-a3ca-970aff43738c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3cad833530d49e3bddeabaa370baa47'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:42.379194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-54718df8-43f6-49f5-a3ca-970aff43738c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3cad833530d49e3bddeabaa370baa47'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:42.394922 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3645/7350] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:42.413074 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3706/7351] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:42 2022] DELETE /identity/v3/users/f3cad833530d49e3bddeabaa370baa47 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:43.780465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a763f-4bb2-41f8-b50c-2b86d4f3fc54 service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:43.798059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a763f-4bb2-41f8-b50c-2b86d4f3fc54 service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:43.925390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28363658-0bd7-4a94-8818-cacd2be841d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:43.926371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28363658-0bd7-4a94-8818-cacd2be841d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:43.926666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28363658-0bd7-4a94-8818-cacd2be841d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:43.926940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28363658-0bd7-4a94-8818-cacd2be841d1 admin admin] PATH_INFO: `/v3/projects/2a2be82aa60041c58d80231e9ebd6ed6` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:43.928682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28363658-0bd7-4a94-8818-cacd2be841d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a2be82aa60041c58d80231e9ebd6ed6)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:43.930910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28363658-0bd7-4a94-8818-cacd2be841d1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:44.064264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-28363658-0bd7-4a94-8818-cacd2be841d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a2be82aa60041c58d80231e9ebd6ed6', 'request_id': 'req-28363658-0bd7-4a94-8818-cacd2be841d1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:44.086932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-28363658-0bd7-4a94-8818-cacd2be841d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a2be82aa60041c58d80231e9ebd6ed6', 'request_id': 'req-28363658-0bd7-4a94-8818-cacd2be841d1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:44.105649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-28363658-0bd7-4a94-8818-cacd2be841d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a2be82aa60041c58d80231e9ebd6ed6', 'request_id': 'req-28363658-0bd7-4a94-8818-cacd2be841d1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:44.157555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-28363658-0bd7-4a94-8818-cacd2be841d1 admin admin] The token cache is being invalidate because project 2a2be82aa60041c58d80231e9ebd6ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:44.157852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-28363658-0bd7-4a94-8818-cacd2be841d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:44.169110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-28363658-0bd7-4a94-8818-cacd2be841d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:44.170050 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3646/7352] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:43 2022] DELETE /identity/v3/projects/2a2be82aa60041c58d80231e9ebd6ed6 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:44.174774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48183653-de50-4efd-9444-25f0db2fed74 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:44.175309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48183653-de50-4efd-9444-25f0db2fed74 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:44.175459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48183653-de50-4efd-9444-25f0db2fed74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:44.199250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-48183653-de50-4efd-9444-25f0db2fed74 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:44.201732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-48183653-de50-4efd-9444-25f0db2fed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:44.298600 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3707/7353] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:29:44.306263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd85479-4025-4392-ab90-ea5958794a7c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:44.306555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd85479-4025-4392-ab90-ea5958794a7c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:44.306839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd85479-4025-4392-ab90-ea5958794a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:44.332936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ebd85479-4025-4392-ab90-ea5958794a7c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:44.334218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ebd85479-4025-4392-ab90-ea5958794a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:44.348108 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3647/7354] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:29:44.349091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48183653-de50-4efd-9444-25f0db2fed74 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:44.363085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48183653-de50-4efd-9444-25f0db2fed74 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:44.371769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e96c8-eaed-4bf9-84f2-88179ff35f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:44.372927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e96c8-eaed-4bf9-84f2-88179ff35f95 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:44.373456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e96c8-eaed-4bf9-84f2-88179ff35f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:44.373997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e96c8-eaed-4bf9-84f2-88179ff35f95 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:44.376990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e96c8-eaed-4bf9-84f2-88179ff35f95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:29:44.377558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e96c8-eaed-4bf9-84f2-88179ff35f95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:44.380147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e96c8-eaed-4bf9-84f2-88179ff35f95 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:44.396224 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3708/7355] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:29:44.401877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd85479-4025-4392-ab90-ea5958794a7c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:44.432346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd85479-4025-4392-ab90-ea5958794a7c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:44.446980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946e128-0caa-47a9-8c34-7ae255bfaf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:44.448174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946e128-0caa-47a9-8c34-7ae255bfaf95 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:44.448174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946e128-0caa-47a9-8c34-7ae255bfaf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:44.448174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946e128-0caa-47a9-8c34-7ae255bfaf95 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:44.448901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946e128-0caa-47a9-8c34-7ae255bfaf95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:44.450955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946e128-0caa-47a9-8c34-7ae255bfaf95 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:44.501299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:44.537668 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3648/7356] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:44 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:44.538928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e96c8-eaed-4bf9-84f2-88179ff35f95 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:44.556256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e96c8-eaed-4bf9-84f2-88179ff35f95 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:44.687967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863bd3d-ee59-47fa-aa3d-47031d5827b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:44.689144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863bd3d-ee59-47fa-aa3d-47031d5827b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:44.689631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863bd3d-ee59-47fa-aa3d-47031d5827b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:44.689917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863bd3d-ee59-47fa-aa3d-47031d5827b4 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:44.690895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863bd3d-ee59-47fa-aa3d-47031d5827b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:44.693220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863bd3d-ee59-47fa-aa3d-47031d5827b4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:44.708631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:44.727730 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3709/7357] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:44 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:44.731061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946e128-0caa-47a9-8c34-7ae255bfaf95 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:44.763445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946e128-0caa-47a9-8c34-7ae255bfaf95 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:44.773482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029a709-584e-4edf-836f-91691069636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:44.774326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029a709-584e-4edf-836f-91691069636f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:44.774882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029a709-584e-4edf-836f-91691069636f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:44.775267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029a709-584e-4edf-836f-91691069636f admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:44.777059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029a709-584e-4edf-836f-91691069636f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:44.781359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029a709-584e-4edf-836f-91691069636f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:44.796511 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3649/7358] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:29:44.800461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863bd3d-ee59-47fa-aa3d-47031d5827b4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:44.815092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863bd3d-ee59-47fa-aa3d-47031d5827b4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:44.824014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66f288-9c56-4d94-a70f-46ccc84dde66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:44.825244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66f288-9c56-4d94-a70f-46ccc84dde66 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:44.825803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66f288-9c56-4d94-a70f-46ccc84dde66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:44.826148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66f288-9c56-4d94-a70f-46ccc84dde66 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:44.827403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66f288-9c56-4d94-a70f-46ccc84dde66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:44.829042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66f288-9c56-4d94-a70f-46ccc84dde66 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:44.843864 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3710/7359] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:44.848352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029a709-584e-4edf-836f-91691069636f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:44.861577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029a709-584e-4edf-836f-91691069636f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:44.869068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bad040-83e8-4d54-b754-5a4263a2d22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:44.870859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bad040-83e8-4d54-b754-5a4263a2d22b admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:44.872121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bad040-83e8-4d54-b754-5a4263a2d22b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:44.873026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bad040-83e8-4d54-b754-5a4263a2d22b admin admin] PATH_INFO: `/v3/projects/f54de09964564ece97be30b205cf8b76/users/e8caeeaec0d048aca516702d0e7ac0ce/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:44.903628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bad040-83e8-4d54-b754-5a4263a2d22b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54de09964564ece97be30b205cf8b76, user_id=e8caeeaec0d048aca516702d0e7ac0ce, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:44.908030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bad040-83e8-4d54-b754-5a4263a2d22b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:44.940782 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3650/7360] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:44 2022] PUT /identity/v3/projects/f54de09964564ece97be30b205cf8b76/users/e8caeeaec0d048aca516702d0e7ac0ce/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:44.952002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe37ce0-8dba-44a8-9c49-43e58c52f86a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:44.952697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe37ce0-8dba-44a8-9c49-43e58c52f86a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:44.953014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe37ce0-8dba-44a8-9c49-43e58c52f86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:44.998878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9fe37ce0-8dba-44a8-9c49-43e58c52f86a None None] MFA Rules not processed for user `e8caeeaec0d048aca516702d0e7ac0ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:45.000561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9fe37ce0-8dba-44a8-9c49-43e58c52f86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:45.123397 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3711/7361] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:45.129955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bad040-83e8-4d54-b754-5a4263a2d22b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:45.209516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bad040-83e8-4d54-b754-5a4263a2d22b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:45.215126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df06791-2c8e-46f2-9e4f-3a4a5110feb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:45.215807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df06791-2c8e-46f2-9e4f-3a4a5110feb2 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:45.216093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df06791-2c8e-46f2-9e4f-3a4a5110feb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:45.216372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df06791-2c8e-46f2-9e4f-3a4a5110feb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:45.217047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df06791-2c8e-46f2-9e4f-3a4a5110feb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:45.218968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df06791-2c8e-46f2-9e4f-3a4a5110feb2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:45.260245 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3651/7362] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:45 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:45.264587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe37ce0-8dba-44a8-9c49-43e58c52f86a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:45.277861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe37ce0-8dba-44a8-9c49-43e58c52f86a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:45.363273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac4daf-9e73-44e1-9b52-ed22774d5452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:45.364232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac4daf-9e73-44e1-9b52-ed22774d5452 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:45.364540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac4daf-9e73-44e1-9b52-ed22774d5452 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:45.364820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac4daf-9e73-44e1-9b52-ed22774d5452 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:45.365559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac4daf-9e73-44e1-9b52-ed22774d5452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:45.368259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac4daf-9e73-44e1-9b52-ed22774d5452 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:45.412099 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3712/7363] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:45 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:45.416024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df06791-2c8e-46f2-9e4f-3a4a5110feb2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:45.456594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df06791-2c8e-46f2-9e4f-3a4a5110feb2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:45.462983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89a704-5646-458a-b46a-0a9982f51c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:45.464369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89a704-5646-458a-b46a-0a9982f51c68 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:45.465061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89a704-5646-458a-b46a-0a9982f51c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:45.465527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89a704-5646-458a-b46a-0a9982f51c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:45.466452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89a704-5646-458a-b46a-0a9982f51c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:45.469393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89a704-5646-458a-b46a-0a9982f51c68 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:45.490446 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3652/7364] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:45.494263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac4daf-9e73-44e1-9b52-ed22774d5452 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:45.506634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac4daf-9e73-44e1-9b52-ed22774d5452 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:45.512431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca9373-ebce-4455-bd78-13bca660fb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:45.513155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca9373-ebce-4455-bd78-13bca660fb6c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:45.513581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca9373-ebce-4455-bd78-13bca660fb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:45.513862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca9373-ebce-4455-bd78-13bca660fb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:45.514695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca9373-ebce-4455-bd78-13bca660fb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:45.516590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca9373-ebce-4455-bd78-13bca660fb6c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:45.546229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89a704-5646-458a-b46a-0a9982f51c68 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:45.546617 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3713/7365] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:45.548585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89a704-5646-458a-b46a-0a9982f51c68 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:45.553761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6e948-77d0-45c2-9582-a227bbd00426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:45.554451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6e948-77d0-45c2-9582-a227bbd00426 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:45.554740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6e948-77d0-45c2-9582-a227bbd00426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:45.555022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6e948-77d0-45c2-9582-a227bbd00426 admin admin] PATH_INFO: `/v3/projects/95c976daac9b463e834203d2c08e58d2/users/3ebdf1bb74cc444b9d84cb3fc77c3340/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:45.576618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6e948-77d0-45c2-9582-a227bbd00426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c976daac9b463e834203d2c08e58d2, user_id=3ebdf1bb74cc444b9d84cb3fc77c3340, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:45.579757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6e948-77d0-45c2-9582-a227bbd00426 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:45.604117 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3653/7366] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:45 2022] PUT /identity/v3/projects/95c976daac9b463e834203d2c08e58d2/users/3ebdf1bb74cc444b9d84cb3fc77c3340/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:29:45.613031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3fd13-aaa9-4e68-8378-c4f832a06b42 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:45.613331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3fd13-aaa9-4e68-8378-c4f832a06b42 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:45.613677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3fd13-aaa9-4e68-8378-c4f832a06b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:45.647782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6e948-77d0-45c2-9582-a227bbd00426 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:45.651910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8df6e948-77d0-45c2-9582-a227bbd00426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:45.662876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-55b3fd13-aaa9-4e68-8378-c4f832a06b42 None None] MFA Rules not processed for user `3ebdf1bb74cc444b9d84cb3fc77c3340`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:45.666316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-55b3fd13-aaa9-4e68-8378-c4f832a06b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:45.745157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6e948-77d0-45c2-9582-a227bbd00426 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:45.750939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981ecef-2dec-4475-a67a-3fb27c7f8ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:45.752135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981ecef-2dec-4475-a67a-3fb27c7f8ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:45.752427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981ecef-2dec-4475-a67a-3fb27c7f8ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:45.752706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981ecef-2dec-4475-a67a-3fb27c7f8ba4 admin admin] PATH_INFO: `/v3/users/c9bb480dc5a14b018f6aab37206aefd0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:45.753927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981ecef-2dec-4475-a67a-3fb27c7f8ba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9bb480dc5a14b018f6aab37206aefd0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:45.755903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981ecef-2dec-4475-a67a-3fb27c7f8ba4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:45.771121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:45.784587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:45.838203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9981ecef-2dec-4475-a67a-3fb27c7f8ba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9bb480dc5a14b018f6aab37206aefd0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:45.840547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9981ecef-2dec-4475-a67a-3fb27c7f8ba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9bb480dc5a14b018f6aab37206aefd0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:45.850664 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3714/7367] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:45.851858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3fd13-aaa9-4e68-8378-c4f832a06b42 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:45.865499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9981ecef-2dec-4475-a67a-3fb27c7f8ba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9bb480dc5a14b018f6aab37206aefd0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:45.866719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9981ecef-2dec-4475-a67a-3fb27c7f8ba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9bb480dc5a14b018f6aab37206aefd0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:45.883883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3fd13-aaa9-4e68-8378-c4f832a06b42 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:45.893340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9981ecef-2dec-4475-a67a-3fb27c7f8ba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9bb480dc5a14b018f6aab37206aefd0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:45.896737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5aa5e-e575-4bc5-b3d8-599b1f38f1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:45.897979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5aa5e-e575-4bc5-b3d8-599b1f38f1cf admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:45.898274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5aa5e-e575-4bc5-b3d8-599b1f38f1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:45.898553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5aa5e-e575-4bc5-b3d8-599b1f38f1cf admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:45.899250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5aa5e-e575-4bc5-b3d8-599b1f38f1cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:45.901236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5aa5e-e575-4bc5-b3d8-599b1f38f1cf admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:45.925725 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3654/7368] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:45 2022] DELETE /identity/v3/users/c9bb480dc5a14b018f6aab37206aefd0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:29:45.930521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75b477-8d35-40c6-b1e2-ddfbe1467b17 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:45.930819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75b477-8d35-40c6-b1e2-ddfbe1467b17 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:45.931185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75b477-8d35-40c6-b1e2-ddfbe1467b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:45.954697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-db75b477-8d35-40c6-b1e2-ddfbe1467b17 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:45.956001 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3715/7369] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:45 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:29:45.957896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-db75b477-8d35-40c6-b1e2-ddfbe1467b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:45.961423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5aa5e-e575-4bc5-b3d8-599b1f38f1cf admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:45.963364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-47d5aa5e-e575-4bc5-b3d8-599b1f38f1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:46.065222 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3655/7370] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:46.066733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75b477-8d35-40c6-b1e2-ddfbe1467b17 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:46.069105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-db75b477-8d35-40c6-b1e2-ddfbe1467b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:46.075380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5aa5e-e575-4bc5-b3d8-599b1f38f1cf admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:46.091747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a76fe-2cd0-4450-83f2-961af0d49b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:46.092769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a76fe-2cd0-4450-83f2-961af0d49b19 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:46.093395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a76fe-2cd0-4450-83f2-961af0d49b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:46.093900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a76fe-2cd0-4450-83f2-961af0d49b19 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:46.094916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a76fe-2cd0-4450-83f2-961af0d49b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:46.096192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75b477-8d35-40c6-b1e2-ddfbe1467b17 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:46.097378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a76fe-2cd0-4450-83f2-961af0d49b19 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:46.110092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c6967-011a-4d55-a603-fec36cc80c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:46.110764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c6967-011a-4d55-a603-fec36cc80c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:46.111048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c6967-011a-4d55-a603-fec36cc80c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:46.111379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c6967-011a-4d55-a603-fec36cc80c1e admin admin] PATH_INFO: `/v3/users/f81693a6c503456bb266fc5bae3f6f70` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:46.113564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c6967-011a-4d55-a603-fec36cc80c1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f81693a6c503456bb266fc5bae3f6f70)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:46.115736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c6967-011a-4d55-a603-fec36cc80c1e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:46.145070 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3716/7371] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:45 2022] POST /identity/v3/users => generated 299 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:46.145070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a76fe-2cd0-4450-83f2-961af0d49b19 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:46.149421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ac8a76fe-2cd0-4450-83f2-961af0d49b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:46.185073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9b2c6967-011a-4d55-a603-fec36cc80c1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f81693a6c503456bb266fc5bae3f6f70'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:46.186421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9b2c6967-011a-4d55-a603-fec36cc80c1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f81693a6c503456bb266fc5bae3f6f70'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:46.207006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9b2c6967-011a-4d55-a603-fec36cc80c1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f81693a6c503456bb266fc5bae3f6f70'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:46.207927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9b2c6967-011a-4d55-a603-fec36cc80c1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f81693a6c503456bb266fc5bae3f6f70'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:46.218748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9b2c6967-011a-4d55-a603-fec36cc80c1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f81693a6c503456bb266fc5bae3f6f70'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:46.232775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a76fe-2cd0-4450-83f2-961af0d49b19 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:46.234068 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3656/7372] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:46 2022] DELETE /identity/v3/users/f81693a6c503456bb266fc5bae3f6f70 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:46.237581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c6967-011a-4d55-a603-fec36cc80c1e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:46.240980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9b2c6967-011a-4d55-a603-fec36cc80c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:46.246664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:46.298093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedf7e0-f8a2-4b94-8814-03d2fc5bdc48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:46.298800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedf7e0-f8a2-4b94-8814-03d2fc5bdc48 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:46.299250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedf7e0-f8a2-4b94-8814-03d2fc5bdc48 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:46.299562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedf7e0-f8a2-4b94-8814-03d2fc5bdc48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:46.305482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8fedf7e0-f8a2-4b94-8814-03d2fc5bdc48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:46.341168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:46.358233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c6967-011a-4d55-a603-fec36cc80c1e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:46.364983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8b1b6-99f7-447e-9b79-822902ffc548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:46.365861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8b1b6-99f7-447e-9b79-822902ffc548 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:46.366334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8b1b6-99f7-447e-9b79-822902ffc548 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:46.366793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8b1b6-99f7-447e-9b79-822902ffc548 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:46.367706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8b1b6-99f7-447e-9b79-822902ffc548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:46.370234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8b1b6-99f7-447e-9b79-822902ffc548 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:46.386564 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3657/7373] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:46.387726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd89166-af1a-4734-a6df-91ff19372140 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:46.388024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd89166-af1a-4734-a6df-91ff19372140 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:46.388307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd89166-af1a-4734-a6df-91ff19372140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:46.398074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fedf7e0-f8a2-4b94-8814-03d2fc5bdc48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:46.400144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fedf7e0-f8a2-4b94-8814-03d2fc5bdc48 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:46.415381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ebd89166-af1a-4734-a6df-91ff19372140 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:46.416640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ebd89166-af1a-4734-a6df-91ff19372140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:46.417598 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3717/7374] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:46.419156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedf7e0-f8a2-4b94-8814-03d2fc5bdc48 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:46.425850 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3658/7375] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:46.431994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedf7e0-f8a2-4b94-8814-03d2fc5bdc48 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:46.440643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495c776-ab51-4845-944c-cdbb40720e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:46.440643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495c776-ab51-4845-944c-cdbb40720e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:46.440643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495c776-ab51-4845-944c-cdbb40720e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:46.440643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495c776-ab51-4845-944c-cdbb40720e1b admin admin] PATH_INFO: `/v3/projects/0c7dc87ba90d4924826f3d998005c989/users/d9a09d238b91440ba6cf99d9fcde69e8/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:46.461860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495c776-ab51-4845-944c-cdbb40720e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c7dc87ba90d4924826f3d998005c989, user_id=d9a09d238b91440ba6cf99d9fcde69e8, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:46.464960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495c776-ab51-4845-944c-cdbb40720e1b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:46.471838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd89166-af1a-4734-a6df-91ff19372140 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:46.474254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ebd89166-af1a-4734-a6df-91ff19372140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:46.485913 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3718/7376] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:46 2022] PUT /identity/v3/projects/0c7dc87ba90d4924826f3d998005c989/users/d9a09d238b91440ba6cf99d9fcde69e8/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:46.490719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495c776-ab51-4845-944c-cdbb40720e1b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:46.501680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd89166-af1a-4734-a6df-91ff19372140 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:46.586945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e7bf3-ac87-4d1a-8fd7-7626724edb44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:46.587790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e7bf3-ac87-4d1a-8fd7-7626724edb44 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:46.588148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e7bf3-ac87-4d1a-8fd7-7626724edb44 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:46.588505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e7bf3-ac87-4d1a-8fd7-7626724edb44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:46.593753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495c776-ab51-4845-944c-cdbb40720e1b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:46.600636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e7bf3-ac87-4d1a-8fd7-7626724edb44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:46.603389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabe136-fa7f-4597-aabe-1034abef1b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:46.604971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabe136-fa7f-4597-aabe-1034abef1b63 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:46.605371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e7bf3-ac87-4d1a-8fd7-7626724edb44 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:46.606330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabe136-fa7f-4597-aabe-1034abef1b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:46.607743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabe136-fa7f-4597-aabe-1034abef1b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:46.610203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabe136-fa7f-4597-aabe-1034abef1b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:46.613123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabe136-fa7f-4597-aabe-1034abef1b63 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:46.627694 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3659/7377] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:46.645549 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3719/7378] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:46.650397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e7bf3-ac87-4d1a-8fd7-7626724edb44 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:46.667131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e7bf3-ac87-4d1a-8fd7-7626724edb44 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:46.675110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc686239-8699-4a68-994c-dc17cab265fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:46.676804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc686239-8699-4a68-994c-dc17cab265fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:46.676804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc686239-8699-4a68-994c-dc17cab265fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:46.676804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc686239-8699-4a68-994c-dc17cab265fb admin admin] PATH_INFO: `/v3/projects/0c7dc87ba90d4924826f3d998005c989/users/d9a09d238b91440ba6cf99d9fcde69e8/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:46.679558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc686239-8699-4a68-994c-dc17cab265fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c7dc87ba90d4924826f3d998005c989, user_id=d9a09d238b91440ba6cf99d9fcde69e8, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:46.682399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc686239-8699-4a68-994c-dc17cab265fb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:46.699119 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3660/7379] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:46 2022] PUT /identity/v3/projects/0c7dc87ba90d4924826f3d998005c989/users/d9a09d238b91440ba6cf99d9fcde69e8/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:46.711112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9ab16-60dc-4b63-9123-f2e99a1f9a07 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:46.711631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9ab16-60dc-4b63-9123-f2e99a1f9a07 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:46.712018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9ab16-60dc-4b63-9123-f2e99a1f9a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:46.748596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f2b9ab16-60dc-4b63-9123-f2e99a1f9a07 None None] MFA Rules not processed for user `d9a09d238b91440ba6cf99d9fcde69e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:46.750372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f2b9ab16-60dc-4b63-9123-f2e99a1f9a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:46.835345 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3720/7380] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:46.849210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc686239-8699-4a68-994c-dc17cab265fb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:46.851972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dc686239-8699-4a68-994c-dc17cab265fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:46.933736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc686239-8699-4a68-994c-dc17cab265fb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:46.938022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311cf44-b10d-44f8-83dd-c4d84d17308a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:46.938701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311cf44-b10d-44f8-83dd-c4d84d17308a service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:46.939120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311cf44-b10d-44f8-83dd-c4d84d17308a service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:46.939513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311cf44-b10d-44f8-83dd-c4d84d17308a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:46.941357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c311cf44-b10d-44f8-83dd-c4d84d17308a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:46.986994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:47.024728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311cf44-b10d-44f8-83dd-c4d84d17308a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:47.026185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311cf44-b10d-44f8-83dd-c4d84d17308a service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:47.036825 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3661/7381] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:47.298796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9ab16-60dc-4b63-9123-f2e99a1f9a07 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:47.304645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f2b9ab16-60dc-4b63-9123-f2e99a1f9a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:47.379450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:47.390651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311cf44-b10d-44f8-83dd-c4d84d17308a service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:47.392438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c311cf44-b10d-44f8-83dd-c4d84d17308a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:47.550398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9ab16-60dc-4b63-9123-f2e99a1f9a07 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:47.575419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2724138-281a-4a1c-84f8-263a3559dab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:47.576382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2724138-281a-4a1c-84f8-263a3559dab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:47.576853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2724138-281a-4a1c-84f8-263a3559dab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:47.577371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2724138-281a-4a1c-84f8-263a3559dab7 admin admin] PATH_INFO: `/v3/projects/7af2ab84796441338c5128a6eb386b83` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:47.579137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2724138-281a-4a1c-84f8-263a3559dab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7af2ab84796441338c5128a6eb386b83)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:47.582423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2724138-281a-4a1c-84f8-263a3559dab7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:47.597899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311cf44-b10d-44f8-83dd-c4d84d17308a service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:47.608304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b351e-e966-4fd0-a290-3e2bb8de1bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:47.609093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b351e-e966-4fd0-a290-3e2bb8de1bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:47.609478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b351e-e966-4fd0-a290-3e2bb8de1bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:47.609857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b351e-e966-4fd0-a290-3e2bb8de1bf7 admin admin] PATH_INFO: `/v3/projects/f3cc8f1d43494d49bdf77a5bdb852f19` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:47.611797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b351e-e966-4fd0-a290-3e2bb8de1bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3cc8f1d43494d49bdf77a5bdb852f19)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:47.623022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b351e-e966-4fd0-a290-3e2bb8de1bf7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:47.755447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a2724138-281a-4a1c-84f8-263a3559dab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7af2ab84796441338c5128a6eb386b83', 'request_id': 'req-a2724138-281a-4a1c-84f8-263a3559dab7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:47.792596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d57b351e-e966-4fd0-a290-3e2bb8de1bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3cc8f1d43494d49bdf77a5bdb852f19', 'request_id': 'req-d57b351e-e966-4fd0-a290-3e2bb8de1bf7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:47.793866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a2724138-281a-4a1c-84f8-263a3559dab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7af2ab84796441338c5128a6eb386b83', 'request_id': 'req-a2724138-281a-4a1c-84f8-263a3559dab7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:47.808180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d57b351e-e966-4fd0-a290-3e2bb8de1bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3cc8f1d43494d49bdf77a5bdb852f19', 'request_id': 'req-d57b351e-e966-4fd0-a290-3e2bb8de1bf7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:47.812814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a2724138-281a-4a1c-84f8-263a3559dab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7af2ab84796441338c5128a6eb386b83', 'request_id': 'req-a2724138-281a-4a1c-84f8-263a3559dab7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:47.820086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d57b351e-e966-4fd0-a290-3e2bb8de1bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3cc8f1d43494d49bdf77a5bdb852f19', 'request_id': 'req-d57b351e-e966-4fd0-a290-3e2bb8de1bf7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:47.836427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d57b351e-e966-4fd0-a290-3e2bb8de1bf7 admin admin] The token cache is being invalidate because project f3cc8f1d43494d49bdf77a5bdb852f19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:47.836857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d57b351e-e966-4fd0-a290-3e2bb8de1bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:47.837772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d57b351e-e966-4fd0-a290-3e2bb8de1bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:47.841173 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3662/7382] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:47 2022] DELETE /identity/v3/projects/f3cc8f1d43494d49bdf77a5bdb852f19 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:47.843695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a2724138-281a-4a1c-84f8-263a3559dab7 admin admin] The token cache is being invalidate because project 7af2ab84796441338c5128a6eb386b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:47.844014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a2724138-281a-4a1c-84f8-263a3559dab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:47.846453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a2724138-281a-4a1c-84f8-263a3559dab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:47.848371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fd2df-5c5b-4f82-b374-43c081cc5753 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:47.848775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fd2df-5c5b-4f82-b374-43c081cc5753 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:47.849156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fd2df-5c5b-4f82-b374-43c081cc5753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:47.856325 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3721/7383] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:47 2022] DELETE /identity/v3/projects/7af2ab84796441338c5128a6eb386b83 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:47.857716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890730d7-afb3-4e37-83db-ef96ccb432ef None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:47.858015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890730d7-afb3-4e37-83db-ef96ccb432ef None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:47.858710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890730d7-afb3-4e37-83db-ef96ccb432ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:47.876190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fc1fd2df-5c5b-4f82-b374-43c081cc5753 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:47.878162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fc1fd2df-5c5b-4f82-b374-43c081cc5753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:47.910278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-890730d7-afb3-4e37-83db-ef96ccb432ef None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:47.911622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-890730d7-afb3-4e37-83db-ef96ccb432ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:47.967787 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3663/7384] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:47.978535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c7a74-9b94-439d-83a6-eee9e249e7ff None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:47.978535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c7a74-9b94-439d-83a6-eee9e249e7ff None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:47.978971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c7a74-9b94-439d-83a6-eee9e249e7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:48.004479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:48.023349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-601c7a74-9b94-439d-83a6-eee9e249e7ff None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:48.025101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-601c7a74-9b94-439d-83a6-eee9e249e7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:48.035081 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3664/7385] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:48.039191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c7a74-9b94-439d-83a6-eee9e249e7ff None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:48.053153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c7a74-9b94-439d-83a6-eee9e249e7ff None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:48.059105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02b1ce-c64b-4551-8173-93ddb4dec970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:48.060664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02b1ce-c64b-4551-8173-93ddb4dec970 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:48.061193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02b1ce-c64b-4551-8173-93ddb4dec970 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:48.061668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02b1ce-c64b-4551-8173-93ddb4dec970 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:48.062441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02b1ce-c64b-4551-8173-93ddb4dec970 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:29:48.063007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02b1ce-c64b-4551-8173-93ddb4dec970 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:48.064895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02b1ce-c64b-4551-8173-93ddb4dec970 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:48.097727 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3665/7386] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:29:48.098990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02b1ce-c64b-4551-8173-93ddb4dec970 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:48.105533 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3722/7387] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:48.107542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445f9bd-6a39-48e4-b9ae-11ec3558f90d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:48.107892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445f9bd-6a39-48e4-b9ae-11ec3558f90d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:48.108147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445f9bd-6a39-48e4-b9ae-11ec3558f90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:48.121667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02b1ce-c64b-4551-8173-93ddb4dec970 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:48.143608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbbf5c-0206-4fb4-8ba8-f9963c08761f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:48.144263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbbf5c-0206-4fb4-8ba8-f9963c08761f admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:48.144562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbbf5c-0206-4fb4-8ba8-f9963c08761f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:48.144840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbbf5c-0206-4fb4-8ba8-f9963c08761f admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:48.145520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbbf5c-0206-4fb4-8ba8-f9963c08761f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:48.147478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbbf5c-0206-4fb4-8ba8-f9963c08761f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:48.156042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9445f9bd-6a39-48e4-b9ae-11ec3558f90d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:48.157388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9445f9bd-6a39-48e4-b9ae-11ec3558f90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:48.194345 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3723/7388] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:48.195516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445f9bd-6a39-48e4-b9ae-11ec3558f90d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:48.209600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445f9bd-6a39-48e4-b9ae-11ec3558f90d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:48.216591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc86403-cf1f-48e1-89c3-d630666c0db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:48.217338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc86403-cf1f-48e1-89c3-d630666c0db0 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:48.217840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc86403-cf1f-48e1-89c3-d630666c0db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:48.218133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc86403-cf1f-48e1-89c3-d630666c0db0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:48.219033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc86403-cf1f-48e1-89c3-d630666c0db0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:29:48.219672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc86403-cf1f-48e1-89c3-d630666c0db0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:48.221490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc86403-cf1f-48e1-89c3-d630666c0db0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:48.240548 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3666/7389] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:48 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:48.246297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbbf5c-0206-4fb4-8ba8-f9963c08761f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:48.262892 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3724/7390] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:29:48.264909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc86403-cf1f-48e1-89c3-d630666c0db0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:48.284623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc86403-cf1f-48e1-89c3-d630666c0db0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:48.321829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:48.377042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbbf5c-0206-4fb4-8ba8-f9963c08761f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:48.386795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd783d73-9e85-4816-a79d-d5a4b81da5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:48.387494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd783d73-9e85-4816-a79d-d5a4b81da5dd admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:48.387786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd783d73-9e85-4816-a79d-d5a4b81da5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:48.388092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd783d73-9e85-4816-a79d-d5a4b81da5dd admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:48.388964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd783d73-9e85-4816-a79d-d5a4b81da5dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:48.391659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34417f09-3828-48be-98e0-b758cb4b14b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:48.391829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd783d73-9e85-4816-a79d-d5a4b81da5dd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:48.392457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34417f09-3828-48be-98e0-b758cb4b14b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:48.392755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34417f09-3828-48be-98e0-b758cb4b14b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:48.393052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34417f09-3828-48be-98e0-b758cb4b14b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:48.393725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34417f09-3828-48be-98e0-b758cb4b14b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:48.395797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34417f09-3828-48be-98e0-b758cb4b14b6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:48.419385 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3667/7391] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:48 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:48.422425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd783d73-9e85-4816-a79d-d5a4b81da5dd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:48.435011 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3725/7392] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:48 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:48.435980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34417f09-3828-48be-98e0-b758cb4b14b6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:48.454211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd783d73-9e85-4816-a79d-d5a4b81da5dd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:48.536748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34417f09-3828-48be-98e0-b758cb4b14b6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:48.537152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbe108-a447-43e7-911e-eac41b985c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:48.538088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbe108-a447-43e7-911e-eac41b985c4b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:48.538402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbe108-a447-43e7-911e-eac41b985c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:48.538683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbe108-a447-43e7-911e-eac41b985c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:48.540739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbe108-a447-43e7-911e-eac41b985c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:48.543171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73615e-040c-489d-8b4c-52c2a4cb24ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:48.543997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbe108-a447-43e7-911e-eac41b985c4b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:48.544143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73615e-040c-489d-8b4c-52c2a4cb24ec admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:48.544410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73615e-040c-489d-8b4c-52c2a4cb24ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:48.544876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73615e-040c-489d-8b4c-52c2a4cb24ec admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:48.545590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73615e-040c-489d-8b4c-52c2a4cb24ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:48.548256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73615e-040c-489d-8b4c-52c2a4cb24ec admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:48.559262 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3668/7393] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:29:48.563948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbe108-a447-43e7-911e-eac41b985c4b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:48.581896 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3726/7394] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:48 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:48.582105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbe108-a447-43e7-911e-eac41b985c4b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:48.585125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73615e-040c-489d-8b4c-52c2a4cb24ec admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:48.588844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e202e-df99-41d4-90c1-d08935e1418a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:48.589580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e202e-df99-41d4-90c1-d08935e1418a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:48.590325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e202e-df99-41d4-90c1-d08935e1418a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:48.590720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e202e-df99-41d4-90c1-d08935e1418a admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:48.591624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e202e-df99-41d4-90c1-d08935e1418a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:48.594061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e202e-df99-41d4-90c1-d08935e1418a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:48.603895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73615e-040c-489d-8b4c-52c2a4cb24ec admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:48.610751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d941996-b3a6-4784-bdd8-54b3c079e5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:48.614345 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3669/7395] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:29:48.615513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d941996-b3a6-4784-bdd8-54b3c079e5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:48.616000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d941996-b3a6-4784-bdd8-54b3c079e5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:48.616909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d941996-b3a6-4784-bdd8-54b3c079e5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:48.617845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d941996-b3a6-4784-bdd8-54b3c079e5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:48.619684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d941996-b3a6-4784-bdd8-54b3c079e5c9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:48.622694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e202e-df99-41d4-90c1-d08935e1418a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:48.633537 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3727/7396] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:29:48.637708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d941996-b3a6-4784-bdd8-54b3c079e5c9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:48.640965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e202e-df99-41d4-90c1-d08935e1418a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:48.657315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718857b1-fda2-4648-9727-cf596595fd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:48.658280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718857b1-fda2-4648-9727-cf596595fd6c admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:48.658826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718857b1-fda2-4648-9727-cf596595fd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:48.659031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d941996-b3a6-4784-bdd8-54b3c079e5c9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:48.660395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718857b1-fda2-4648-9727-cf596595fd6c admin admin] PATH_INFO: `/v3/projects/2430c3036ed74cea9b3d1a20b61f780e/users/87902729a01b4918a07d61589f9c84da/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:48.663981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f5653-0eac-4792-bcfd-a2ad762f4b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:48.665368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f5653-0eac-4792-bcfd-a2ad762f4b5d admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:48.665663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f5653-0eac-4792-bcfd-a2ad762f4b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:48.665943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f5653-0eac-4792-bcfd-a2ad762f4b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:48.666650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f5653-0eac-4792-bcfd-a2ad762f4b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:48.668954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f5653-0eac-4792-bcfd-a2ad762f4b5d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:48.680096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718857b1-fda2-4648-9727-cf596595fd6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2430c3036ed74cea9b3d1a20b61f780e, user_id=87902729a01b4918a07d61589f9c84da, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:48.680812 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3728/7397] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:29:48.685537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f5653-0eac-4792-bcfd-a2ad762f4b5d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:48.686257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718857b1-fda2-4648-9727-cf596595fd6c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:48.699492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f5653-0eac-4792-bcfd-a2ad762f4b5d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:48.716356 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3670/7398] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:48 2022] PUT /identity/v3/projects/2430c3036ed74cea9b3d1a20b61f780e/users/87902729a01b4918a07d61589f9c84da/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:29:48.718617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa300926-68c7-47e9-9409-073cd921ea52 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:48.719490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa300926-68c7-47e9-9409-073cd921ea52 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:48.719889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa300926-68c7-47e9-9409-073cd921ea52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:48.755231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fa300926-68c7-47e9-9409-073cd921ea52 None None] MFA Rules not processed for user `87902729a01b4918a07d61589f9c84da`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:48.756603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fa300926-68c7-47e9-9409-073cd921ea52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:48.761664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:48.814543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4db4b-d869-48b6-9f00-3bb516df9cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:48.815367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4db4b-d869-48b6-9f00-3bb516df9cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:48.816628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4db4b-d869-48b6-9f00-3bb516df9cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:48.816976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4db4b-d869-48b6-9f00-3bb516df9cf1 admin admin] PATH_INFO: `/v3/projects/8c466e91078e4aa8b5c065dce8759e1a/users/28d6569515e6458b96e9399d5288408f/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:48.856898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4db4b-d869-48b6-9f00-3bb516df9cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c466e91078e4aa8b5c065dce8759e1a, user_id=28d6569515e6458b96e9399d5288408f, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:48.861187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4db4b-d869-48b6-9f00-3bb516df9cf1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:48.875593 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3671/7399] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:48.885635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:48.891608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa300926-68c7-47e9-9409-073cd921ea52 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:48.893744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fa300926-68c7-47e9-9409-073cd921ea52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:48.902485 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3729/7400] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:48 2022] PUT /identity/v3/projects/8c466e91078e4aa8b5c065dce8759e1a/users/28d6569515e6458b96e9399d5288408f/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:29:48.913672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842354a-a590-4a21-99be-aaaf4953f24b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:48.913966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842354a-a590-4a21-99be-aaaf4953f24b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:48.914248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842354a-a590-4a21-99be-aaaf4953f24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:48.961832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8842354a-a590-4a21-99be-aaaf4953f24b None None] MFA Rules not processed for user `28d6569515e6458b96e9399d5288408f`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:48.963215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8842354a-a590-4a21-99be-aaaf4953f24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:48.978605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa300926-68c7-47e9-9409-073cd921ea52 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:49.113780 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3730/7401] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:29:49.123734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e787791-5b2e-4e3f-b091-9965979ca779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:49.124463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e787791-5b2e-4e3f-b091-9965979ca779 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:49.124849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e787791-5b2e-4e3f-b091-9965979ca779 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:49.125754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e787791-5b2e-4e3f-b091-9965979ca779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:49.130030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842354a-a590-4a21-99be-aaaf4953f24b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:49.132127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8842354a-a590-4a21-99be-aaaf4953f24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:49.221742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e787791-5b2e-4e3f-b091-9965979ca779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:49.223513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e787791-5b2e-4e3f-b091-9965979ca779 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:49.225435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842354a-a590-4a21-99be-aaaf4953f24b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:49.230742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ad69e-2bb1-4325-8179-fdc2d3fce8c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:49.231646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ad69e-2bb1-4325-8179-fdc2d3fce8c1 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:49.232032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ad69e-2bb1-4325-8179-fdc2d3fce8c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:49.232474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ad69e-2bb1-4325-8179-fdc2d3fce8c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:49.236672 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3672/7402] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:49.237832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e787791-5b2e-4e3f-b091-9965979ca779 service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:49.239957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7e787791-5b2e-4e3f-b091-9965979ca779 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:49.245527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ad69e-2bb1-4325-8179-fdc2d3fce8c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:49.247359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ad69e-2bb1-4325-8179-fdc2d3fce8c1 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:49.257016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e787791-5b2e-4e3f-b091-9965979ca779 service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:49.260375 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3731/7403] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:29:49.264533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707ce03-0690-4388-905e-b7cff8a4d3e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:49.266671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707ce03-0690-4388-905e-b7cff8a4d3e1 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:49.267010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707ce03-0690-4388-905e-b7cff8a4d3e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:49.267358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707ce03-0690-4388-905e-b7cff8a4d3e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:49.269323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3707ce03-0690-4388-905e-b7cff8a4d3e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:49.294232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:49.333377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ad69e-2bb1-4325-8179-fdc2d3fce8c1 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:49.402186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707ce03-0690-4388-905e-b7cff8a4d3e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:49.407516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707ce03-0690-4388-905e-b7cff8a4d3e1 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:49.429318 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3673/7404] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:49.481453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ad69e-2bb1-4325-8179-fdc2d3fce8c1 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:49.497066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48828b-be75-4d0f-a092-a4d6df690940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:49.497749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48828b-be75-4d0f-a092-a4d6df690940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:49.498040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48828b-be75-4d0f-a092-a4d6df690940 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:49.498320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48828b-be75-4d0f-a092-a4d6df690940 admin admin] PATH_INFO: `/v3/users/28d6569515e6458b96e9399d5288408f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:49.500149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48828b-be75-4d0f-a092-a4d6df690940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d6569515e6458b96e9399d5288408f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:49.504245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48828b-be75-4d0f-a092-a4d6df690940 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:49.586559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:49.612627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6b48828b-be75-4d0f-a092-a4d6df690940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d6569515e6458b96e9399d5288408f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:49.644021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6b48828b-be75-4d0f-a092-a4d6df690940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d6569515e6458b96e9399d5288408f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:49.645329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6b48828b-be75-4d0f-a092-a4d6df690940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d6569515e6458b96e9399d5288408f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:49.663664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6b48828b-be75-4d0f-a092-a4d6df690940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d6569515e6458b96e9399d5288408f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:49.668515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6b48828b-be75-4d0f-a092-a4d6df690940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d6569515e6458b96e9399d5288408f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:49.703439 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3732/7405] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:49 2022] DELETE /identity/v3/users/28d6569515e6458b96e9399d5288408f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:29:49.708528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d1fdb-3113-481c-83e1-57ed045b37d3 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:49.709000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d1fdb-3113-481c-83e1-57ed045b37d3 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:49.709382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d1fdb-3113-481c-83e1-57ed045b37d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:49.734626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-318d1fdb-3113-481c-83e1-57ed045b37d3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:49.738061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-318d1fdb-3113-481c-83e1-57ed045b37d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:49.871890 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3674/7406] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:49.887739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48828b-be75-4d0f-a092-a4d6df690940 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:49.890024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6b48828b-be75-4d0f-a092-a4d6df690940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:50.036424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48828b-be75-4d0f-a092-a4d6df690940 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:50.040607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244790e4-ee2d-4da3-ae07-b6f140c252e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:50.041501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244790e4-ee2d-4da3-ae07-b6f140c252e2 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:50.043022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244790e4-ee2d-4da3-ae07-b6f140c252e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:50.043206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244790e4-ee2d-4da3-ae07-b6f140c252e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:50.055863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244790e4-ee2d-4da3-ae07-b6f140c252e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:50.057251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244790e4-ee2d-4da3-ae07-b6f140c252e2 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:50.079591 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3733/7407] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:50.534692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d1fdb-3113-481c-83e1-57ed045b37d3 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:50.536226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-318d1fdb-3113-481c-83e1-57ed045b37d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:50.599466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d1fdb-3113-481c-83e1-57ed045b37d3 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:50.602997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f3d86-8b5d-4422-8f06-5807847149d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:50.603848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f3d86-8b5d-4422-8f06-5807847149d3 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:50.604134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f3d86-8b5d-4422-8f06-5807847149d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:50.604444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f3d86-8b5d-4422-8f06-5807847149d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:50.606346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e85f3d86-8b5d-4422-8f06-5807847149d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:50.677361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244790e4-ee2d-4da3-ae07-b6f140c252e2 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:50.680168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-244790e4-ee2d-4da3-ae07-b6f140c252e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:50.713282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f3d86-8b5d-4422-8f06-5807847149d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:50.717986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f3d86-8b5d-4422-8f06-5807847149d3 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:50.718565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244790e4-ee2d-4da3-ae07-b6f140c252e2 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:50.738168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82c9d9-84c8-48e4-922f-38c195aeffcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:50.739214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82c9d9-84c8-48e4-922f-38c195aeffcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:50.746877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82c9d9-84c8-48e4-922f-38c195aeffcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:50.747979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82c9d9-84c8-48e4-922f-38c195aeffcb admin admin] PATH_INFO: `/v3/projects/8c466e91078e4aa8b5c065dce8759e1a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:50.749936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82c9d9-84c8-48e4-922f-38c195aeffcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c466e91078e4aa8b5c065dce8759e1a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:50.755809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82c9d9-84c8-48e4-922f-38c195aeffcb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:50.763693 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3675/7408] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:50.843029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b82c9d9-84c8-48e4-922f-38c195aeffcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c466e91078e4aa8b5c065dce8759e1a', 'request_id': 'req-8b82c9d9-84c8-48e4-922f-38c195aeffcb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:50.853488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b82c9d9-84c8-48e4-922f-38c195aeffcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c466e91078e4aa8b5c065dce8759e1a', 'request_id': 'req-8b82c9d9-84c8-48e4-922f-38c195aeffcb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:50.871011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b82c9d9-84c8-48e4-922f-38c195aeffcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c466e91078e4aa8b5c065dce8759e1a', 'request_id': 'req-8b82c9d9-84c8-48e4-922f-38c195aeffcb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:50.888358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b82c9d9-84c8-48e4-922f-38c195aeffcb admin admin] The token cache is being invalidate because project 8c466e91078e4aa8b5c065dce8759e1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:50.888660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b82c9d9-84c8-48e4-922f-38c195aeffcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:50.889329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b82c9d9-84c8-48e4-922f-38c195aeffcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:50.898449 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3734/7409] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:50 2022] DELETE /identity/v3/projects/8c466e91078e4aa8b5c065dce8759e1a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:29:50.900973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cac60-3599-436a-9a06-b215f9244211 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:50.913681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cac60-3599-436a-9a06-b215f9244211 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:50.913681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cac60-3599-436a-9a06-b215f9244211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:50.913681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:50.931319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-406cac60-3599-436a-9a06-b215f9244211 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:50.933405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-406cac60-3599-436a-9a06-b215f9244211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:51.017974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2c8a2-ba68-4a35-a206-a318982f29e6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:51.018981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2c8a2-ba68-4a35-a206-a318982f29e6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:51.019511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2c8a2-ba68-4a35-a206-a318982f29e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:51.058326 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3676/7410] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:29:51.073870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5920b-aa77-4559-ba58-e2a5bdd66475 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:51.074832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5920b-aa77-4559-ba58-e2a5bdd66475 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:51.075579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5920b-aa77-4559-ba58-e2a5bdd66475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:51.079704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-99c2c8a2-ba68-4a35-a206-a318982f29e6 None None] MFA Rules not processed for user `87902729a01b4918a07d61589f9c84da`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:51.081328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-99c2c8a2-ba68-4a35-a206-a318982f29e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:51.122396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b5a5920b-aa77-4559-ba58-e2a5bdd66475 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:51.129359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b5a5920b-aa77-4559-ba58-e2a5bdd66475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:51.152927 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3677/7411] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:51.156286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:51.175656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5920b-aa77-4559-ba58-e2a5bdd66475 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:51.192313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5920b-aa77-4559-ba58-e2a5bdd66475 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:51.202819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2685c58-b8d0-4753-b2c3-c9aa209ef39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:51.202819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2685c58-b8d0-4753-b2c3-c9aa209ef39e admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:51.202819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2685c58-b8d0-4753-b2c3-c9aa209ef39e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:51.202819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2685c58-b8d0-4753-b2c3-c9aa209ef39e admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:51.203310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2685c58-b8d0-4753-b2c3-c9aa209ef39e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:29:51.203310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2685c58-b8d0-4753-b2c3-c9aa209ef39e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:51.204273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2685c58-b8d0-4753-b2c3-c9aa209ef39e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:51.205386 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3735/7412] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:29:51.220025 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3678/7413] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:29:51.224242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2c8a2-ba68-4a35-a206-a318982f29e6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:51.244081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2c8a2-ba68-4a35-a206-a318982f29e6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:51.252370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1cf03-9827-45b9-948c-3042d288a9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:51.253104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1cf03-9827-45b9-948c-3042d288a9c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:51.253463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1cf03-9827-45b9-948c-3042d288a9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:51.253844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1cf03-9827-45b9-948c-3042d288a9c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:51.254789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1cf03-9827-45b9-948c-3042d288a9c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:51.257518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1cf03-9827-45b9-948c-3042d288a9c3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:51.363647 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3736/7414] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:51 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:29:51.364506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2685c58-b8d0-4753-b2c3-c9aa209ef39e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:51.387744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2685c58-b8d0-4753-b2c3-c9aa209ef39e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:51.525674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110951d-e9f4-4de0-a14f-3c5c19d68a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:51.526296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110951d-e9f4-4de0-a14f-3c5c19d68a22 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:51.526672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110951d-e9f4-4de0-a14f-3c5c19d68a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:51.526957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110951d-e9f4-4de0-a14f-3c5c19d68a22 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:51.527704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110951d-e9f4-4de0-a14f-3c5c19d68a22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:51.530047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110951d-e9f4-4de0-a14f-3c5c19d68a22 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:51.572783 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3679/7415] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:51 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:29:51.574884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1cf03-9827-45b9-948c-3042d288a9c3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:51.588161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1cf03-9827-45b9-948c-3042d288a9c3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:51.593727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e251d-27a6-4417-9abd-cd693d55230b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:51.594759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e251d-27a6-4417-9abd-cd693d55230b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:51.595329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e251d-27a6-4417-9abd-cd693d55230b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:51.596317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e251d-27a6-4417-9abd-cd693d55230b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:51.597479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e251d-27a6-4417-9abd-cd693d55230b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:51.599518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e251d-27a6-4417-9abd-cd693d55230b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:51.613265 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3737/7416] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:51.619228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110951d-e9f4-4de0-a14f-3c5c19d68a22 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:51.633235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110951d-e9f4-4de0-a14f-3c5c19d68a22 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:51.640520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a685d-6ab9-4333-9aac-00b602fce48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:51.641070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a685d-6ab9-4333-9aac-00b602fce48d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:51.641352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a685d-6ab9-4333-9aac-00b602fce48d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:51.641625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a685d-6ab9-4333-9aac-00b602fce48d admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:51.642325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a685d-6ab9-4333-9aac-00b602fce48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:51.644092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a685d-6ab9-4333-9aac-00b602fce48d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:51.669588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e251d-27a6-4417-9abd-cd693d55230b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:51.675624 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3680/7417] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:51.682306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e251d-27a6-4417-9abd-cd693d55230b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:51.689997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6136003-9b7d-4927-8e02-ac5e85ed531e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:51.691503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6136003-9b7d-4927-8e02-ac5e85ed531e admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:51.691793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6136003-9b7d-4927-8e02-ac5e85ed531e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:51.692093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6136003-9b7d-4927-8e02-ac5e85ed531e admin admin] PATH_INFO: `/v3/projects/731aa42af92641eda7aaaa616934340c/users/460cd95715b64cbcad0c598b646fc549/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:51.709295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6136003-9b7d-4927-8e02-ac5e85ed531e admin admin] RBAC: Authorizing `identity:create_grant(project_id=731aa42af92641eda7aaaa616934340c, user_id=460cd95715b64cbcad0c598b646fc549, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:51.712359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6136003-9b7d-4927-8e02-ac5e85ed531e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:51.728930 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3738/7418] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:51 2022] PUT /identity/v3/projects/731aa42af92641eda7aaaa616934340c/users/460cd95715b64cbcad0c598b646fc549/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:51.740206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1c637-223b-47e8-9bdf-2ffdd61ed73d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:51.740500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1c637-223b-47e8-9bdf-2ffdd61ed73d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:51.740784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1c637-223b-47e8-9bdf-2ffdd61ed73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:51.771643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bbf1c637-223b-47e8-9bdf-2ffdd61ed73d None None] MFA Rules not processed for user `460cd95715b64cbcad0c598b646fc549`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:51.773183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bbf1c637-223b-47e8-9bdf-2ffdd61ed73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:51.849152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:51.865255 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3681/7419] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:51.869689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6136003-9b7d-4927-8e02-ac5e85ed531e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:51.958499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6136003-9b7d-4927-8e02-ac5e85ed531e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:51.972712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e959e14-41d0-4e2b-9c5c-01b5c0033037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:51.973823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e959e14-41d0-4e2b-9c5c-01b5c0033037 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:51.974165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e959e14-41d0-4e2b-9c5c-01b5c0033037 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:51.974654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e959e14-41d0-4e2b-9c5c-01b5c0033037 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:51.975762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e959e14-41d0-4e2b-9c5c-01b5c0033037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:51.978173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e959e14-41d0-4e2b-9c5c-01b5c0033037 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:52.046354 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3739/7420] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:51 2022] POST /identity/v3/projects => generated 369 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:52.050740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1c637-223b-47e8-9bdf-2ffdd61ed73d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:52.065541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1c637-223b-47e8-9bdf-2ffdd61ed73d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:52.151684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b42adb-5d19-4694-8111-2ed3c67957b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:52.152657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b42adb-5d19-4694-8111-2ed3c67957b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:52.153241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b42adb-5d19-4694-8111-2ed3c67957b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:52.153678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b42adb-5d19-4694-8111-2ed3c67957b1 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:52.155054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b42adb-5d19-4694-8111-2ed3c67957b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:52.157990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b42adb-5d19-4694-8111-2ed3c67957b1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:52.188966 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3682/7421] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:52 2022] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:52.192397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e959e14-41d0-4e2b-9c5c-01b5c0033037 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:52.204545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e959e14-41d0-4e2b-9c5c-01b5c0033037 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:52.220615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d858c14-70f9-4efd-8bab-0ac7abbf9303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:52.221268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d858c14-70f9-4efd-8bab-0ac7abbf9303 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:52.221558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d858c14-70f9-4efd-8bab-0ac7abbf9303 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:52.221832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d858c14-70f9-4efd-8bab-0ac7abbf9303 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:52.222534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d858c14-70f9-4efd-8bab-0ac7abbf9303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:52.225559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d858c14-70f9-4efd-8bab-0ac7abbf9303 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:52.261205 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3740/7422] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:52.265471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b42adb-5d19-4694-8111-2ed3c67957b1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:52.283840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b42adb-5d19-4694-8111-2ed3c67957b1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:52.290893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe242be-2ccf-4f97-aa27-84baad1c7d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:52.292247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe242be-2ccf-4f97-aa27-84baad1c7d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:52.292774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe242be-2ccf-4f97-aa27-84baad1c7d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:52.293077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe242be-2ccf-4f97-aa27-84baad1c7d4e admin admin] PATH_INFO: `/v3/projects/756231f7befc4f59ada122be45e9d0c5/users/43181f1b536e4054a680717df2b19c85/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:52.313951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe242be-2ccf-4f97-aa27-84baad1c7d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=756231f7befc4f59ada122be45e9d0c5, user_id=43181f1b536e4054a680717df2b19c85, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:52.316771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe242be-2ccf-4f97-aa27-84baad1c7d4e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:52.341111 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3683/7423] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:52 2022] PUT /identity/v3/projects/756231f7befc4f59ada122be45e9d0c5/users/43181f1b536e4054a680717df2b19c85/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:52.342632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d858c14-70f9-4efd-8bab-0ac7abbf9303 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:52.357903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d858c14-70f9-4efd-8bab-0ac7abbf9303 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:52.566579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38204912-b205-46fc-bbbe-29c6f531cbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:52.567703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38204912-b205-46fc-bbbe-29c6f531cbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:52.569445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38204912-b205-46fc-bbbe-29c6f531cbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:52.570443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38204912-b205-46fc-bbbe-29c6f531cbf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:52.574257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38204912-b205-46fc-bbbe-29c6f531cbf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:52.576131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38204912-b205-46fc-bbbe-29c6f531cbf0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:52.581193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:52.608528 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3741/7424] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:52.611895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe242be-2ccf-4f97-aa27-84baad1c7d4e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:52.629830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe242be-2ccf-4f97-aa27-84baad1c7d4e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:52.638847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac1e65-e06c-4f2c-b7c3-00ad06c16ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:52.640291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac1e65-e06c-4f2c-b7c3-00ad06c16ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:52.640961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac1e65-e06c-4f2c-b7c3-00ad06c16ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:52.641915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac1e65-e06c-4f2c-b7c3-00ad06c16ca9 admin admin] PATH_INFO: `/v3/projects/756231f7befc4f59ada122be45e9d0c5/users/43181f1b536e4054a680717df2b19c85/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:52.644537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac1e65-e06c-4f2c-b7c3-00ad06c16ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=756231f7befc4f59ada122be45e9d0c5, user_id=43181f1b536e4054a680717df2b19c85, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:52.655854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac1e65-e06c-4f2c-b7c3-00ad06c16ca9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:52.671387 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3684/7425] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:52 2022] PUT /identity/v3/projects/756231f7befc4f59ada122be45e9d0c5/users/43181f1b536e4054a680717df2b19c85/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:52.684041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a432a-ee06-4782-bc5d-8c36ca8bfcc3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:52.684583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a432a-ee06-4782-bc5d-8c36ca8bfcc3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:52.684809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a432a-ee06-4782-bc5d-8c36ca8bfcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:52.758098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-cf9a432a-ee06-4782-bc5d-8c36ca8bfcc3 None None] MFA Rules not processed for user `43181f1b536e4054a680717df2b19c85`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:52.762953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cf9a432a-ee06-4782-bc5d-8c36ca8bfcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:52.997160 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3742/7426] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:52 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:53.012671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac1e65-e06c-4f2c-b7c3-00ad06c16ca9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:53.014504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3dac1e65-e06c-4f2c-b7c3-00ad06c16ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:53.173152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac1e65-e06c-4f2c-b7c3-00ad06c16ca9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:53.182870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc3d5d-8459-41b3-a4b3-cf2e8eac1751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:53.184214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc3d5d-8459-41b3-a4b3-cf2e8eac1751 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:53.184526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc3d5d-8459-41b3-a4b3-cf2e8eac1751 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:53.184886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc3d5d-8459-41b3-a4b3-cf2e8eac1751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:53.200199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc3d5d-8459-41b3-a4b3-cf2e8eac1751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:53.202218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc3d5d-8459-41b3-a4b3-cf2e8eac1751 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:53.216736 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3685/7427] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:53 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:55.431054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a432a-ee06-4782-bc5d-8c36ca8bfcc3 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:55.432955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cf9a432a-ee06-4782-bc5d-8c36ca8bfcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:55.552783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc3d5d-8459-41b3-a4b3-cf2e8eac1751 service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:55.618984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a432a-ee06-4782-bc5d-8c36ca8bfcc3 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:55.622311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:55.633852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd1859-93ad-4b1b-a5b1-a272136f7248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:55.634558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd1859-93ad-4b1b-a5b1-a272136f7248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:55.634850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd1859-93ad-4b1b-a5b1-a272136f7248 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:55.635137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd1859-93ad-4b1b-a5b1-a272136f7248 admin admin] PATH_INFO: `/v3/users/e8caeeaec0d048aca516702d0e7ac0ce` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:55.642390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd1859-93ad-4b1b-a5b1-a272136f7248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8caeeaec0d048aca516702d0e7ac0ce)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:55.644530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd1859-93ad-4b1b-a5b1-a272136f7248 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:55.655140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc3d5d-8459-41b3-a4b3-cf2e8eac1751 service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:55.662674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efc1d7-c864-47a5-9484-782bec2500b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:55.664126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efc1d7-c864-47a5-9484-782bec2500b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:55.664685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efc1d7-c864-47a5-9484-782bec2500b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:55.665189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efc1d7-c864-47a5-9484-782bec2500b8 admin admin] PATH_INFO: `/v3/users/460cd95715b64cbcad0c598b646fc549` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:55.670736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efc1d7-c864-47a5-9484-782bec2500b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=460cd95715b64cbcad0c598b646fc549)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:55.680134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efc1d7-c864-47a5-9484-782bec2500b8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:55.739585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-25cd1859-93ad-4b1b-a5b1-a272136f7248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8caeeaec0d048aca516702d0e7ac0ce'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:55.756950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-25cd1859-93ad-4b1b-a5b1-a272136f7248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8caeeaec0d048aca516702d0e7ac0ce'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:55.758261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-25cd1859-93ad-4b1b-a5b1-a272136f7248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8caeeaec0d048aca516702d0e7ac0ce'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:55.768276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-25cd1859-93ad-4b1b-a5b1-a272136f7248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8caeeaec0d048aca516702d0e7ac0ce'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:55.769263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-25cd1859-93ad-4b1b-a5b1-a272136f7248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8caeeaec0d048aca516702d0e7ac0ce'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:55.776282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d4efc1d7-c864-47a5-9484-782bec2500b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460cd95715b64cbcad0c598b646fc549'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:55.777101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d4efc1d7-c864-47a5-9484-782bec2500b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460cd95715b64cbcad0c598b646fc549'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:55.784232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:55.790669 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3743/7428] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:55 2022] DELETE /identity/v3/users/e8caeeaec0d048aca516702d0e7ac0ce => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:29:55.798402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca480895-3ebd-41fa-b4d2-7c4507e36e4c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:55.798901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca480895-3ebd-41fa-b4d2-7c4507e36e4c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:55.800227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca480895-3ebd-41fa-b4d2-7c4507e36e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:55.813255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d4efc1d7-c864-47a5-9484-782bec2500b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460cd95715b64cbcad0c598b646fc549'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:55.814392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d4efc1d7-c864-47a5-9484-782bec2500b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460cd95715b64cbcad0c598b646fc549'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:55.834362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ca480895-3ebd-41fa-b4d2-7c4507e36e4c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:55.836245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ca480895-3ebd-41fa-b4d2-7c4507e36e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:55.837428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d4efc1d7-c864-47a5-9484-782bec2500b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460cd95715b64cbcad0c598b646fc549'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:55.862029 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3686/7429] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:55 2022] DELETE /identity/v3/users/460cd95715b64cbcad0c598b646fc549 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:29:55.870979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312cee1-bc4e-434a-9a52-721fd65e6794 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:55.871628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312cee1-bc4e-434a-9a52-721fd65e6794 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:55.872144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312cee1-bc4e-434a-9a52-721fd65e6794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:55.922878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c312cee1-bc4e-434a-9a52-721fd65e6794 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:55.926260 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3744/7430] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:55.926934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c312cee1-bc4e-434a-9a52-721fd65e6794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:56.026255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca480895-3ebd-41fa-b4d2-7c4507e36e4c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:56.028101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ca480895-3ebd-41fa-b4d2-7c4507e36e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:56.056588 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3687/7431] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:56.089961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312cee1-bc4e-434a-9a52-721fd65e6794 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:56.091915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c312cee1-bc4e-434a-9a52-721fd65e6794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:56.199212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca480895-3ebd-41fa-b4d2-7c4507e36e4c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:56.257299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312cee1-bc4e-434a-9a52-721fd65e6794 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:56.266941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9d98f-e9bb-49a7-9bee-6cec90050c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:56.268883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9d98f-e9bb-49a7-9bee-6cec90050c7d service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:56.269222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9d98f-e9bb-49a7-9bee-6cec90050c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:56.269502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9d98f-e9bb-49a7-9bee-6cec90050c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:56.295523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9d98f-e9bb-49a7-9bee-6cec90050c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:56.297216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9d98f-e9bb-49a7-9bee-6cec90050c7d service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:56.324187 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3688/7432] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:56.386139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6a3ca-ef3c-431c-9b46-db884d444787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:56.386805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6a3ca-ef3c-431c-9b46-db884d444787 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:56.387092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6a3ca-ef3c-431c-9b46-db884d444787 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:56.387397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6a3ca-ef3c-431c-9b46-db884d444787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:56.403561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6a3ca-ef3c-431c-9b46-db884d444787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:56.404971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6a3ca-ef3c-431c-9b46-db884d444787 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:56.424909 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3745/7433] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:57.162791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9d98f-e9bb-49a7-9bee-6cec90050c7d service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:57.164455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fad9d98f-e9bb-49a7-9bee-6cec90050c7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:57.192087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9d98f-e9bb-49a7-9bee-6cec90050c7d service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:57.206665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7048fe3-a375-4eb3-9f2e-b909bdcf30c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:57.209275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7048fe3-a375-4eb3-9f2e-b909bdcf30c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:57.209798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7048fe3-a375-4eb3-9f2e-b909bdcf30c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:57.210310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7048fe3-a375-4eb3-9f2e-b909bdcf30c8 admin admin] PATH_INFO: `/v3/users/f1b1a5390fd6434f86e89125cd4b324c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:57.213472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7048fe3-a375-4eb3-9f2e-b909bdcf30c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1b1a5390fd6434f86e89125cd4b324c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:57.216065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7048fe3-a375-4eb3-9f2e-b909bdcf30c8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:57.228632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:57.294143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6a3ca-ef3c-431c-9b46-db884d444787 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:57.295956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-87b6a3ca-ef3c-431c-9b46-db884d444787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:57.321431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6a3ca-ef3c-431c-9b46-db884d444787 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:57.333674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b557f-e36a-4a4c-90c3-8bde6fb8c38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:57.334511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b557f-e36a-4a4c-90c3-8bde6fb8c38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:57.334662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b557f-e36a-4a4c-90c3-8bde6fb8c38f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:57.334948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b557f-e36a-4a4c-90c3-8bde6fb8c38f admin admin] PATH_INFO: `/v3/projects/731aa42af92641eda7aaaa616934340c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:57.336990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b557f-e36a-4a4c-90c3-8bde6fb8c38f admin admin] RBAC: Authorizing `identity:delete_project(project_id=731aa42af92641eda7aaaa616934340c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:57.348485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b557f-e36a-4a4c-90c3-8bde6fb8c38f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:57.382741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f7048fe3-a375-4eb3-9f2e-b909bdcf30c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1b1a5390fd6434f86e89125cd4b324c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:57.383519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f7048fe3-a375-4eb3-9f2e-b909bdcf30c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1b1a5390fd6434f86e89125cd4b324c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:57.417868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f7048fe3-a375-4eb3-9f2e-b909bdcf30c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1b1a5390fd6434f86e89125cd4b324c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:57.418647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f7048fe3-a375-4eb3-9f2e-b909bdcf30c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1b1a5390fd6434f86e89125cd4b324c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:57.440066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f7048fe3-a375-4eb3-9f2e-b909bdcf30c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1b1a5390fd6434f86e89125cd4b324c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:57.456878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b81b557f-e36a-4a4c-90c3-8bde6fb8c38f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '731aa42af92641eda7aaaa616934340c', 'request_id': 'req-b81b557f-e36a-4a4c-90c3-8bde6fb8c38f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:57.472393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b81b557f-e36a-4a4c-90c3-8bde6fb8c38f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '731aa42af92641eda7aaaa616934340c', 'request_id': 'req-b81b557f-e36a-4a4c-90c3-8bde6fb8c38f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:57.473112 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3689/7434] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:57 2022] DELETE /identity/v3/users/f1b1a5390fd6434f86e89125cd4b324c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:57.477996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:57.491118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b81b557f-e36a-4a4c-90c3-8bde6fb8c38f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '731aa42af92641eda7aaaa616934340c', 'request_id': 'req-b81b557f-e36a-4a4c-90c3-8bde6fb8c38f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:57.508802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b81b557f-e36a-4a4c-90c3-8bde6fb8c38f admin admin] The token cache is being invalidate because project 731aa42af92641eda7aaaa616934340c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:57.509795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b81b557f-e36a-4a4c-90c3-8bde6fb8c38f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:57.512752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b81b557f-e36a-4a4c-90c3-8bde6fb8c38f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:57.517390 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3746/7435] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:57 2022] DELETE /identity/v3/projects/731aa42af92641eda7aaaa616934340c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:29:57.518895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7048fe3-a375-4eb3-9f2e-b909bdcf30c8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:57.521009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f7048fe3-a375-4eb3-9f2e-b909bdcf30c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:57.622767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7048fe3-a375-4eb3-9f2e-b909bdcf30c8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:57.629696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61747785-4141-461b-b050-d20043ff9139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:57.631484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61747785-4141-461b-b050-d20043ff9139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:57.631484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61747785-4141-461b-b050-d20043ff9139 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:57.631484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61747785-4141-461b-b050-d20043ff9139 admin admin] PATH_INFO: `/v3/users/43181f1b536e4054a680717df2b19c85` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:57.633835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61747785-4141-461b-b050-d20043ff9139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43181f1b536e4054a680717df2b19c85)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:57.636914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61747785-4141-461b-b050-d20043ff9139 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:57.721255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-61747785-4141-461b-b050-d20043ff9139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43181f1b536e4054a680717df2b19c85'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:57.722682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-61747785-4141-461b-b050-d20043ff9139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43181f1b536e4054a680717df2b19c85'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:57.744094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-61747785-4141-461b-b050-d20043ff9139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43181f1b536e4054a680717df2b19c85'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:57.745548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-61747785-4141-461b-b050-d20043ff9139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43181f1b536e4054a680717df2b19c85'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:57.759655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-61747785-4141-461b-b050-d20043ff9139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43181f1b536e4054a680717df2b19c85'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:57.778841 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3690/7436] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:57 2022] DELETE /identity/v3/users/43181f1b536e4054a680717df2b19c85 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:58.205907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b557f-e36a-4a4c-90c3-8bde6fb8c38f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:58.207796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b81b557f-e36a-4a4c-90c3-8bde6fb8c38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:58.340606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b557f-e36a-4a4c-90c3-8bde6fb8c38f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:58.432910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61747785-4141-461b-b050-d20043ff9139 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:58.436721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-61747785-4141-461b-b050-d20043ff9139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:58.441964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:58.465281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89e3b0-f800-4620-b649-33e08bf3b82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:58.492193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89e3b0-f800-4620-b649-33e08bf3b82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:58.496787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89e3b0-f800-4620-b649-33e08bf3b82c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:58.497093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89e3b0-f800-4620-b649-33e08bf3b82c admin admin] PATH_INFO: `/v3/projects/f54de09964564ece97be30b205cf8b76` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:58.502158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89e3b0-f800-4620-b649-33e08bf3b82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f54de09964564ece97be30b205cf8b76)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:58.506120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89e3b0-f800-4620-b649-33e08bf3b82c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:58.581350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61747785-4141-461b-b050-d20043ff9139 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:58.591755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcbe59-2e09-477b-9e09-774ec41690b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:58.594619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcbe59-2e09-477b-9e09-774ec41690b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:58.594944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcbe59-2e09-477b-9e09-774ec41690b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:58.595195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcbe59-2e09-477b-9e09-774ec41690b2 admin admin] PATH_INFO: `/v3/projects/d54b597e808b4b8594adb5db00e45030` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:58.597468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcbe59-2e09-477b-9e09-774ec41690b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d54b597e808b4b8594adb5db00e45030)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:58.601641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcbe59-2e09-477b-9e09-774ec41690b2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:58.624824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2d89e3b0-f800-4620-b649-33e08bf3b82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f54de09964564ece97be30b205cf8b76', 'request_id': 'req-2d89e3b0-f800-4620-b649-33e08bf3b82c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:58.637802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2d89e3b0-f800-4620-b649-33e08bf3b82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f54de09964564ece97be30b205cf8b76', 'request_id': 'req-2d89e3b0-f800-4620-b649-33e08bf3b82c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:58.650287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2d89e3b0-f800-4620-b649-33e08bf3b82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f54de09964564ece97be30b205cf8b76', 'request_id': 'req-2d89e3b0-f800-4620-b649-33e08bf3b82c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:58.666903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2d89e3b0-f800-4620-b649-33e08bf3b82c admin admin] The token cache is being invalidate because project f54de09964564ece97be30b205cf8b76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:58.667375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2d89e3b0-f800-4620-b649-33e08bf3b82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:58.668471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2d89e3b0-f800-4620-b649-33e08bf3b82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:58.670904 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3747/7437] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:58 2022] DELETE /identity/v3/projects/f54de09964564ece97be30b205cf8b76 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:58.671552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89e3b0-f800-4620-b649-33e08bf3b82c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:58.673855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2d89e3b0-f800-4620-b649-33e08bf3b82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:58.705049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f2bcbe59-2e09-477b-9e09-774ec41690b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd54b597e808b4b8594adb5db00e45030', 'request_id': 'req-f2bcbe59-2e09-477b-9e09-774ec41690b2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:58.717331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f2bcbe59-2e09-477b-9e09-774ec41690b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd54b597e808b4b8594adb5db00e45030', 'request_id': 'req-f2bcbe59-2e09-477b-9e09-774ec41690b2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:58.719749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:58.725168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f2bcbe59-2e09-477b-9e09-774ec41690b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd54b597e808b4b8594adb5db00e45030', 'request_id': 'req-f2bcbe59-2e09-477b-9e09-774ec41690b2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:58.742036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f2bcbe59-2e09-477b-9e09-774ec41690b2 admin admin] The token cache is being invalidate because project d54b597e808b4b8594adb5db00e45030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:58.742339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f2bcbe59-2e09-477b-9e09-774ec41690b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:58.743054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f2bcbe59-2e09-477b-9e09-774ec41690b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:58.745534 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3691/7438] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:58 2022] DELETE /identity/v3/projects/d54b597e808b4b8594adb5db00e45030 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:58.746120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcbe59-2e09-477b-9e09-774ec41690b2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:58.747652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f2bcbe59-2e09-477b-9e09-774ec41690b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:58.799555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89e3b0-f800-4620-b649-33e08bf3b82c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:58.850592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcbe59-2e09-477b-9e09-774ec41690b2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:58.859143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ef78c-ef9c-4655-a261-1dea36895a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:58.860476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ef78c-ef9c-4655-a261-1dea36895a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:58.860966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ef78c-ef9c-4655-a261-1dea36895a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:58.861774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ef78c-ef9c-4655-a261-1dea36895a87 admin admin] PATH_INFO: `/v3/users/3ebdf1bb74cc444b9d84cb3fc77c3340` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:58.864273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ef78c-ef9c-4655-a261-1dea36895a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ebdf1bb74cc444b9d84cb3fc77c3340)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:58.866955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ef78c-ef9c-4655-a261-1dea36895a87 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:58.881155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db0b1a-f0a8-420c-be46-e9d516b40b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:58.882097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db0b1a-f0a8-420c-be46-e9d516b40b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:58.882844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db0b1a-f0a8-420c-be46-e9d516b40b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:58.883309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db0b1a-f0a8-420c-be46-e9d516b40b0c admin admin] PATH_INFO: `/v3/projects/756231f7befc4f59ada122be45e9d0c5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:58.885521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db0b1a-f0a8-420c-be46-e9d516b40b0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=756231f7befc4f59ada122be45e9d0c5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:58.889189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db0b1a-f0a8-420c-be46-e9d516b40b0c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:58.922709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:58.937574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ab3ef78c-ef9c-4655-a261-1dea36895a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ebdf1bb74cc444b9d84cb3fc77c3340'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:58.939055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ab3ef78c-ef9c-4655-a261-1dea36895a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ebdf1bb74cc444b9d84cb3fc77c3340'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:58.958792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ab3ef78c-ef9c-4655-a261-1dea36895a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ebdf1bb74cc444b9d84cb3fc77c3340'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:58.959556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ab3ef78c-ef9c-4655-a261-1dea36895a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ebdf1bb74cc444b9d84cb3fc77c3340'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:58.959727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-32db0b1a-f0a8-420c-be46-e9d516b40b0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '756231f7befc4f59ada122be45e9d0c5', 'request_id': 'req-32db0b1a-f0a8-420c-be46-e9d516b40b0c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:58.966702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-32db0b1a-f0a8-420c-be46-e9d516b40b0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '756231f7befc4f59ada122be45e9d0c5', 'request_id': 'req-32db0b1a-f0a8-420c-be46-e9d516b40b0c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:58.969683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ab3ef78c-ef9c-4655-a261-1dea36895a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ebdf1bb74cc444b9d84cb3fc77c3340'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:58.975587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-32db0b1a-f0a8-420c-be46-e9d516b40b0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '756231f7befc4f59ada122be45e9d0c5', 'request_id': 'req-32db0b1a-f0a8-420c-be46-e9d516b40b0c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:58.984556 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3692/7439] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:58 2022] DELETE /identity/v3/users/3ebdf1bb74cc444b9d84cb3fc77c3340 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:58.985833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f78f7-e87f-4cbf-ad3a-ce928b32480c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:58.986318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f78f7-e87f-4cbf-ad3a-ce928b32480c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:58.986539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f78f7-e87f-4cbf-ad3a-ce928b32480c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:58.990426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-32db0b1a-f0a8-420c-be46-e9d516b40b0c admin admin] The token cache is being invalidate because project 756231f7befc4f59ada122be45e9d0c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:58.990899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-32db0b1a-f0a8-420c-be46-e9d516b40b0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:58.991868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-32db0b1a-f0a8-420c-be46-e9d516b40b0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:58.996325 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3748/7440] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:58 2022] DELETE /identity/v3/projects/756231f7befc4f59ada122be45e9d0c5 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:58.997378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db0b1a-f0a8-420c-be46-e9d516b40b0c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:59.000349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-32db0b1a-f0a8-420c-be46-e9d516b40b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:59.033963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d04f78f7-e87f-4cbf-ad3a-ce928b32480c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:59.034825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d04f78f7-e87f-4cbf-ad3a-ce928b32480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:59.087684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:59.093702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db0b1a-f0a8-420c-be46-e9d516b40b0c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:59.110739 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3693/7441] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:59.112531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc334e99-fe9d-4ee6-b280-53b28a5e501c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:59.112829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc334e99-fe9d-4ee6-b280-53b28a5e501c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:59.113411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc334e99-fe9d-4ee6-b280-53b28a5e501c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:59.141920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fc334e99-fe9d-4ee6-b280-53b28a5e501c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:59.143587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fc334e99-fe9d-4ee6-b280-53b28a5e501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:59.152631 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3694/7442] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:59.157020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f05211-980e-4506-a60b-e44ee11f9efc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:59.157620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f05211-980e-4506-a60b-e44ee11f9efc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:59.159178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f05211-980e-4506-a60b-e44ee11f9efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:59.179428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72312553-a0b3-4e09-a7fc-0163bf914608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:59.180116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72312553-a0b3-4e09-a7fc-0163bf914608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:59.180395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72312553-a0b3-4e09-a7fc-0163bf914608 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:59.180680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72312553-a0b3-4e09-a7fc-0163bf914608 admin admin] PATH_INFO: `/v3/users/d19ca91e192b4579a186004318cb4828` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:59.180978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d0f05211-980e-4506-a60b-e44ee11f9efc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:59.181912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72312553-a0b3-4e09-a7fc-0163bf914608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d19ca91e192b4579a186004318cb4828)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:59.182385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d0f05211-980e-4506-a60b-e44ee11f9efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:59.183971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72312553-a0b3-4e09-a7fc-0163bf914608 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:59.192884 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3695/7443] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:59.194230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a651dd-4b2e-4261-a41b-7c75c9d23bb5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:59.194619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a651dd-4b2e-4261-a41b-7c75c9d23bb5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:59.194905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a651dd-4b2e-4261-a41b-7c75c9d23bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:59.215646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d3a651dd-4b2e-4261-a41b-7c75c9d23bb5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:59.216897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d3a651dd-4b2e-4261-a41b-7c75c9d23bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:59.230336 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3696/7444] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:59.230336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a651dd-4b2e-4261-a41b-7c75c9d23bb5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:59.240870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a651dd-4b2e-4261-a41b-7c75c9d23bb5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:59.246641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb4ddd-5e7e-4f69-a2b1-88e89ce9c831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:59.247429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb4ddd-5e7e-4f69-a2b1-88e89ce9c831 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:59.248015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb4ddd-5e7e-4f69-a2b1-88e89ce9c831 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:59.248130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb4ddd-5e7e-4f69-a2b1-88e89ce9c831 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:59.248806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb4ddd-5e7e-4f69-a2b1-88e89ce9c831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:29:59.249166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb4ddd-5e7e-4f69-a2b1-88e89ce9c831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:59.252178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb4ddd-5e7e-4f69-a2b1-88e89ce9c831 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:59.253572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72312553-a0b3-4e09-a7fc-0163bf914608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd19ca91e192b4579a186004318cb4828'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:59.269797 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3697/7445] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:29:59.269797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb4ddd-5e7e-4f69-a2b1-88e89ce9c831 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:59.282755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb4ddd-5e7e-4f69-a2b1-88e89ce9c831 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:59.284636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72312553-a0b3-4e09-a7fc-0163bf914608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd19ca91e192b4579a186004318cb4828'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:59.285537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72312553-a0b3-4e09-a7fc-0163bf914608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd19ca91e192b4579a186004318cb4828'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:59.288753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9ba61-7fc0-43b5-856a-1388a35346a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:59.289477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9ba61-7fc0-43b5-856a-1388a35346a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:59.289862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9ba61-7fc0-43b5-856a-1388a35346a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:59.290222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9ba61-7fc0-43b5-856a-1388a35346a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:59.291176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9ba61-7fc0-43b5-856a-1388a35346a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:29:59.292309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9ba61-7fc0-43b5-856a-1388a35346a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:59.294364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9ba61-7fc0-43b5-856a-1388a35346a6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:59.298429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72312553-a0b3-4e09-a7fc-0163bf914608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd19ca91e192b4579a186004318cb4828'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:59.299269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72312553-a0b3-4e09-a7fc-0163bf914608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd19ca91e192b4579a186004318cb4828'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:59.314405 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3698/7446] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:29:59.314405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9ba61-7fc0-43b5-856a-1388a35346a6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:59.314405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-38b9ba61-7fc0-43b5-856a-1388a35346a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:59.334506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9ba61-7fc0-43b5-856a-1388a35346a6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:59.341161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba80db-2d9c-430d-820a-fb22dd1c9ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:59.341809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba80db-2d9c-430d-820a-fb22dd1c9ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:59.342099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba80db-2d9c-430d-820a-fb22dd1c9ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:59.342860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba80db-2d9c-430d-820a-fb22dd1c9ce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:59.343084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba80db-2d9c-430d-820a-fb22dd1c9ce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:59.345532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba80db-2d9c-430d-820a-fb22dd1c9ce6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:59.354763 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3749/7447] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:58 2022] DELETE /identity/v3/users/d19ca91e192b4579a186004318cb4828 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:59.358786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72312553-a0b3-4e09-a7fc-0163bf914608 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:59.363885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-72312553-a0b3-4e09-a7fc-0163bf914608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:59.399806 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3699/7448] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:59 2022] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:59.399806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836c363-9216-4a46-abe3-896064949407 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:59.399806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836c363-9216-4a46-abe3-896064949407 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:59.399806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836c363-9216-4a46-abe3-896064949407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:59.422790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a836c363-9216-4a46-abe3-896064949407 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:29:59.424070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a836c363-9216-4a46-abe3-896064949407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:59.490085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:59.498311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72312553-a0b3-4e09-a7fc-0163bf914608 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:59.516956 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3700/7449] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:29:59.518042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836c363-9216-4a46-abe3-896064949407 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:59.534326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836c363-9216-4a46-abe3-896064949407 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:59.535638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:59.542247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe120114-c3d6-4134-b2ff-75f4751508a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:59.542661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe120114-c3d6-4134-b2ff-75f4751508a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:59.542990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe120114-c3d6-4134-b2ff-75f4751508a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:59.543445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe120114-c3d6-4134-b2ff-75f4751508a9 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:59.544136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe120114-c3d6-4134-b2ff-75f4751508a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:59.546432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe120114-c3d6-4134-b2ff-75f4751508a9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:59.573323 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3701/7450] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:59 2022] POST /identity/v3/users => generated 289 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:59.573323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe120114-c3d6-4134-b2ff-75f4751508a9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:59.574628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36302327-a49c-41c0-9eb3-4df13120d613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:59.575327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36302327-a49c-41c0-9eb3-4df13120d613 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:59.575638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36302327-a49c-41c0-9eb3-4df13120d613 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:59.575920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36302327-a49c-41c0-9eb3-4df13120d613 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:59.576091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fe120114-c3d6-4134-b2ff-75f4751508a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:59.576604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36302327-a49c-41c0-9eb3-4df13120d613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:59.578681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36302327-a49c-41c0-9eb3-4df13120d613 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:59.613279 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3750/7451] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:29:59 2022] POST /identity/v3/projects => generated 369 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:59.614961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36302327-a49c-41c0-9eb3-4df13120d613 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:59.652231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe120114-c3d6-4134-b2ff-75f4751508a9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:59.692090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36302327-a49c-41c0-9eb3-4df13120d613 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:59.696952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ba7e3-7496-42b7-8927-c27ffd5ac599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:59.698102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ba7e3-7496-42b7-8927-c27ffd5ac599 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:59.698398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ba7e3-7496-42b7-8927-c27ffd5ac599 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:59.698685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ba7e3-7496-42b7-8927-c27ffd5ac599 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:59.699445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ba7e3-7496-42b7-8927-c27ffd5ac599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:59.701091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ba7e3-7496-42b7-8927-c27ffd5ac599 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:59.710284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a41b9-8916-42a1-baab-66c19801ee2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:59.710939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a41b9-8916-42a1-baab-66c19801ee2c service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:59.711223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a41b9-8916-42a1-baab-66c19801ee2c service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:59.711378 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3751/7452] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:59.711559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a41b9-8916-42a1-baab-66c19801ee2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:59.712107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ba7e3-7496-42b7-8927-c27ffd5ac599 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:59.722500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a41b9-8916-42a1-baab-66c19801ee2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:59.723006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ba7e3-7496-42b7-8927-c27ffd5ac599 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:59.724069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a41b9-8916-42a1-baab-66c19801ee2c service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:59.728115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05443551-b7ea-4614-b0e6-93300d7c54eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:59.728713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05443551-b7ea-4614-b0e6-93300d7c54eb admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:59.729048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05443551-b7ea-4614-b0e6-93300d7c54eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:59.729343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05443551-b7ea-4614-b0e6-93300d7c54eb admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:59.729982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05443551-b7ea-4614-b0e6-93300d7c54eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:59.732041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05443551-b7ea-4614-b0e6-93300d7c54eb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:59.734661 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3702/7453] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:29:59.740418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a41b9-8916-42a1-baab-66c19801ee2c service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:59.742772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5d7a41b9-8916-42a1-baab-66c19801ee2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:59.757869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a41b9-8916-42a1-baab-66c19801ee2c service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:59.758756 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3752/7454] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:29:59 2022] POST /identity/v3/users => generated 285 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:29:59.759503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05443551-b7ea-4614-b0e6-93300d7c54eb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:59.763397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f0216-b3f2-4e06-8fc2-fb8f4bc0885d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:59.764172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f0216-b3f2-4e06-8fc2-fb8f4bc0885d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:59.764292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f0216-b3f2-4e06-8fc2-fb8f4bc0885d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:59.764577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f0216-b3f2-4e06-8fc2-fb8f4bc0885d admin admin] PATH_INFO: `/v3/projects/95c976daac9b463e834203d2c08e58d2` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:59.765742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f0216-b3f2-4e06-8fc2-fb8f4bc0885d admin admin] RBAC: Authorizing `identity:delete_project(project_id=95c976daac9b463e834203d2c08e58d2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:59.767709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f0216-b3f2-4e06-8fc2-fb8f4bc0885d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:59.770099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05443551-b7ea-4614-b0e6-93300d7c54eb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:59.775430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe62cc6-f900-4c69-9d99-bdb7e62793c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:59.776691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe62cc6-f900-4c69-9d99-bdb7e62793c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:59.776981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe62cc6-f900-4c69-9d99-bdb7e62793c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:59.777264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe62cc6-f900-4c69-9d99-bdb7e62793c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:59.777964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe62cc6-f900-4c69-9d99-bdb7e62793c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:59.780156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe62cc6-f900-4c69-9d99-bdb7e62793c1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:59.799256 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3753/7455] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:59.800578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe62cc6-f900-4c69-9d99-bdb7e62793c1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:59.815963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe62cc6-f900-4c69-9d99-bdb7e62793c1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:59.830964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c03f0216-b3f2-4e06-8fc2-fb8f4bc0885d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95c976daac9b463e834203d2c08e58d2', 'request_id': 'req-c03f0216-b3f2-4e06-8fc2-fb8f4bc0885d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:59.842552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c03f0216-b3f2-4e06-8fc2-fb8f4bc0885d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95c976daac9b463e834203d2c08e58d2', 'request_id': 'req-c03f0216-b3f2-4e06-8fc2-fb8f4bc0885d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:59.852151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c03f0216-b3f2-4e06-8fc2-fb8f4bc0885d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95c976daac9b463e834203d2c08e58d2', 'request_id': 'req-c03f0216-b3f2-4e06-8fc2-fb8f4bc0885d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:59.872004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c03f0216-b3f2-4e06-8fc2-fb8f4bc0885d admin admin] The token cache is being invalidate because project 95c976daac9b463e834203d2c08e58d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:29:59.872877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c03f0216-b3f2-4e06-8fc2-fb8f4bc0885d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:59.873647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c03f0216-b3f2-4e06-8fc2-fb8f4bc0885d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:29:59.875235 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3703/7456] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:29:59 2022] DELETE /identity/v3/projects/95c976daac9b463e834203d2c08e58d2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:29:59.878485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f0216-b3f2-4e06-8fc2-fb8f4bc0885d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:59.879688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c03f0216-b3f2-4e06-8fc2-fb8f4bc0885d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:59.889933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6cf70-03ec-4127-a50b-35c6c4fba5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:59.890916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6cf70-03ec-4127-a50b-35c6c4fba5fa admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:59.891523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6cf70-03ec-4127-a50b-35c6c4fba5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:59.892000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6cf70-03ec-4127-a50b-35c6c4fba5fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:59.893307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6cf70-03ec-4127-a50b-35c6c4fba5fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:59.895440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6cf70-03ec-4127-a50b-35c6c4fba5fa admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:29:59.896473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:59.912951 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3754/7457] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:29:59.914419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6cf70-03ec-4127-a50b-35c6c4fba5fa admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:29:59.920682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-77f6cf70-03ec-4127-a50b-35c6c4fba5fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:29:59.955995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6cf70-03ec-4127-a50b-35c6c4fba5fa admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:29:59.973241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9263ed9-21b7-49b1-9322-703eac0ee803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:29:59.973940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9263ed9-21b7-49b1-9322-703eac0ee803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:29:59.974317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9263ed9-21b7-49b1-9322-703eac0ee803 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:29:59.974581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9263ed9-21b7-49b1-9322-703eac0ee803 admin admin] PATH_INFO: `/v3/users/d9a09d238b91440ba6cf99d9fcde69e8` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:29:59.979447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9263ed9-21b7-49b1-9322-703eac0ee803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9a09d238b91440ba6cf99d9fcde69e8)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:29:59.979447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9263ed9-21b7-49b1-9322-703eac0ee803 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:00.004130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:00.039753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f0216-b3f2-4e06-8fc2-fb8f4bc0885d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:00.058982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e9263ed9-21b7-49b1-9322-703eac0ee803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9a09d238b91440ba6cf99d9fcde69e8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:00.062354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c66285-45b1-49f9-bee4-7381d8dc5779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:00.063075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c66285-45b1-49f9-bee4-7381d8dc5779 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:00.063449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c66285-45b1-49f9-bee4-7381d8dc5779 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:00.064248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c66285-45b1-49f9-bee4-7381d8dc5779 admin admin] PATH_INFO: `/v3/projects/1c7b4209e06447d5abdff867f9a7adce/users/5a6da0171fac41fb934ed2b294081531/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:00.075658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e9263ed9-21b7-49b1-9322-703eac0ee803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9a09d238b91440ba6cf99d9fcde69e8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:00.076617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e9263ed9-21b7-49b1-9322-703eac0ee803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9a09d238b91440ba6cf99d9fcde69e8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:00.089356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e9263ed9-21b7-49b1-9322-703eac0ee803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9a09d238b91440ba6cf99d9fcde69e8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:00.090561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e9263ed9-21b7-49b1-9322-703eac0ee803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9a09d238b91440ba6cf99d9fcde69e8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:00.092176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c66285-45b1-49f9-bee4-7381d8dc5779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c7b4209e06447d5abdff867f9a7adce, user_id=5a6da0171fac41fb934ed2b294081531, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:00.094861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c66285-45b1-49f9-bee4-7381d8dc5779 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:00.113273 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3755/7458] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:29:59 2022] DELETE /identity/v3/users/d9a09d238b91440ba6cf99d9fcde69e8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:00.119264 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3704/7459] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:29:59 2022] PUT /identity/v3/projects/1c7b4209e06447d5abdff867f9a7adce/users/5a6da0171fac41fb934ed2b294081531/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:00.119264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c66285-45b1-49f9-bee4-7381d8dc5779 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:00.120930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9263ed9-21b7-49b1-9322-703eac0ee803 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:00.122288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a5c66285-45b1-49f9-bee4-7381d8dc5779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:00.122849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e9263ed9-21b7-49b1-9322-703eac0ee803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:00.227356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c66285-45b1-49f9-bee4-7381d8dc5779 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:00.236042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645266dd-d767-400c-aa10-03997bed4240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:00.236826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645266dd-d767-400c-aa10-03997bed4240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:00.237116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645266dd-d767-400c-aa10-03997bed4240 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:00.237485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645266dd-d767-400c-aa10-03997bed4240 admin admin] PATH_INFO: `/v3/projects/d33ec5ea91e14fb9942929e0cee49fe3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:00.239396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645266dd-d767-400c-aa10-03997bed4240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d33ec5ea91e14fb9942929e0cee49fe3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:00.243724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645266dd-d767-400c-aa10-03997bed4240 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:00.253547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9263ed9-21b7-49b1-9322-703eac0ee803 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:00.265410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf61eca-df15-442b-97bc-4f079a966068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:00.266387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf61eca-df15-442b-97bc-4f079a966068 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:00.267154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf61eca-df15-442b-97bc-4f079a966068 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:00.268559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf61eca-df15-442b-97bc-4f079a966068 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:00.269991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf61eca-df15-442b-97bc-4f079a966068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:00.277304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf61eca-df15-442b-97bc-4f079a966068 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:00.302363 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3756/7460] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:00.304916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b76c7-8d6a-4406-8f16-27c0f6c1a3e3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:00.305211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b76c7-8d6a-4406-8f16-27c0f6c1a3e3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:00.305490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b76c7-8d6a-4406-8f16-27c0f6c1a3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:00.328175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-645266dd-d767-400c-aa10-03997bed4240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd33ec5ea91e14fb9942929e0cee49fe3', 'request_id': 'req-645266dd-d767-400c-aa10-03997bed4240'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:00.337443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c18b76c7-8d6a-4406-8f16-27c0f6c1a3e3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:00.339070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c18b76c7-8d6a-4406-8f16-27c0f6c1a3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:00.342159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-645266dd-d767-400c-aa10-03997bed4240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd33ec5ea91e14fb9942929e0cee49fe3', 'request_id': 'req-645266dd-d767-400c-aa10-03997bed4240'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:00.353411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-645266dd-d767-400c-aa10-03997bed4240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd33ec5ea91e14fb9942929e0cee49fe3', 'request_id': 'req-645266dd-d767-400c-aa10-03997bed4240'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:00.366950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-645266dd-d767-400c-aa10-03997bed4240 admin admin] The token cache is being invalidate because project d33ec5ea91e14fb9942929e0cee49fe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:30:00.367365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-645266dd-d767-400c-aa10-03997bed4240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:00.368110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-645266dd-d767-400c-aa10-03997bed4240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:00.373698 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3705/7461] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:30:00 2022] DELETE /identity/v3/projects/d33ec5ea91e14fb9942929e0cee49fe3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:00.373698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645266dd-d767-400c-aa10-03997bed4240 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:00.373698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-645266dd-d767-400c-aa10-03997bed4240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:00.402235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:00.441914 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3757/7462] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:00.449264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa6dcb-0464-4adc-8bee-dda454f4d244 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:00.449592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa6dcb-0464-4adc-8bee-dda454f4d244 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:00.449943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa6dcb-0464-4adc-8bee-dda454f4d244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:00.473436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-91fa6dcb-0464-4adc-8bee-dda454f4d244 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:00.474944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-91fa6dcb-0464-4adc-8bee-dda454f4d244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:00.481735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645266dd-d767-400c-aa10-03997bed4240 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:00.493066 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3758/7463] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:00.493066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa6dcb-0464-4adc-8bee-dda454f4d244 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:00.493066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-91fa6dcb-0464-4adc-8bee-dda454f4d244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:00.496191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e8e4c-6c45-4cd0-bb21-5fd07bdda933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:00.497586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e8e4c-6c45-4cd0-bb21-5fd07bdda933 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:00.498127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e8e4c-6c45-4cd0-bb21-5fd07bdda933 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:00.498564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e8e4c-6c45-4cd0-bb21-5fd07bdda933 admin admin] PATH_INFO: `/v3/projects/353adee88db0479e8f8204a4fcfa2c95/users/4cadff9a09c244f2a5983599f891c7ae/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:00.526501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e8e4c-6c45-4cd0-bb21-5fd07bdda933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=353adee88db0479e8f8204a4fcfa2c95, user_id=4cadff9a09c244f2a5983599f891c7ae, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:00.529748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e8e4c-6c45-4cd0-bb21-5fd07bdda933 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:00.534137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:00.557924 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3706/7464] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:00 2022] PUT /identity/v3/projects/353adee88db0479e8f8204a4fcfa2c95/users/4cadff9a09c244f2a5983599f891c7ae/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:00.568232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da8aa2-3526-4333-a5ce-5759111f510c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:00.568520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da8aa2-3526-4333-a5ce-5759111f510c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:00.568953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da8aa2-3526-4333-a5ce-5759111f510c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:00.593058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f8da8aa2-3526-4333-a5ce-5759111f510c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:00.593839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa6dcb-0464-4adc-8bee-dda454f4d244 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:00.594431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f8da8aa2-3526-4333-a5ce-5759111f510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:00.671992 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3707/7465] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:00.673771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402ddf8-3ebc-44a6-860a-069aa7fe6acd None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:00.674072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402ddf8-3ebc-44a6-860a-069aa7fe6acd None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:00.674356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402ddf8-3ebc-44a6-860a-069aa7fe6acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:00.685555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3a3f4-1a3e-4b9e-a621-4abdc32e2651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:00.686648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3a3f4-1a3e-4b9e-a621-4abdc32e2651 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:00.687134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3a3f4-1a3e-4b9e-a621-4abdc32e2651 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:00.687702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3a3f4-1a3e-4b9e-a621-4abdc32e2651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:00.705551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3a3f4-1a3e-4b9e-a621-4abdc32e2651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:00.707335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3a3f4-1a3e-4b9e-a621-4abdc32e2651 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:00.721440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1402ddf8-3ebc-44a6-860a-069aa7fe6acd None None] MFA Rules not processed for user `4cadff9a09c244f2a5983599f891c7ae`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:00.723517 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3759/7466] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:00.724540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3a3f4-1a3e-4b9e-a621-4abdc32e2651 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:00.725175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1402ddf8-3ebc-44a6-860a-069aa7fe6acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:00.737002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3a3f4-1a3e-4b9e-a621-4abdc32e2651 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:00.742699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b7a27-e02c-4f35-8f2c-f2e5b68a131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:00.743360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b7a27-e02c-4f35-8f2c-f2e5b68a131a admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:00.743885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b7a27-e02c-4f35-8f2c-f2e5b68a131a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:00.744169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b7a27-e02c-4f35-8f2c-f2e5b68a131a admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:00.744904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b7a27-e02c-4f35-8f2c-f2e5b68a131a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:30:00.745210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b7a27-e02c-4f35-8f2c-f2e5b68a131a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:00.747793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b7a27-e02c-4f35-8f2c-f2e5b68a131a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:00.778986 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3760/7467] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:30:00.782404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b7a27-e02c-4f35-8f2c-f2e5b68a131a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:00.784159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4a9b7a27-e02c-4f35-8f2c-f2e5b68a131a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:00.799280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b7a27-e02c-4f35-8f2c-f2e5b68a131a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:00.805220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c5a91-1e5a-421a-9299-5fad26326e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:00.805943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c5a91-1e5a-421a-9299-5fad26326e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:00.806244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c5a91-1e5a-421a-9299-5fad26326e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:00.806523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c5a91-1e5a-421a-9299-5fad26326e47 admin admin] PATH_INFO: `/v3/projects/0c7dc87ba90d4924826f3d998005c989` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:00.807252 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3708/7468] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:00.807859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402ddf8-3ebc-44a6-860a-069aa7fe6acd None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:00.808056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c5a91-1e5a-421a-9299-5fad26326e47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c7dc87ba90d4924826f3d998005c989)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:00.810593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c5a91-1e5a-421a-9299-5fad26326e47 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:00.819797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402ddf8-3ebc-44a6-860a-069aa7fe6acd None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:00.828340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6c228-680c-4f86-8fbb-f408435001b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:00.828615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6c228-680c-4f86-8fbb-f408435001b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:00.828783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6c228-680c-4f86-8fbb-f408435001b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:00.828944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6c228-680c-4f86-8fbb-f408435001b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:00.829771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6c228-680c-4f86-8fbb-f408435001b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:00.831853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6c228-680c-4f86-8fbb-f408435001b0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:00.864587 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3709/7469] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:00 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:00.865415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6c228-680c-4f86-8fbb-f408435001b0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:00.869446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5a2c5a91-1e5a-421a-9299-5fad26326e47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c7dc87ba90d4924826f3d998005c989', 'request_id': 'req-5a2c5a91-1e5a-421a-9299-5fad26326e47'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:00.877651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5a2c5a91-1e5a-421a-9299-5fad26326e47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c7dc87ba90d4924826f3d998005c989', 'request_id': 'req-5a2c5a91-1e5a-421a-9299-5fad26326e47'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:00.882826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:00.886054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5a2c5a91-1e5a-421a-9299-5fad26326e47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c7dc87ba90d4924826f3d998005c989', 'request_id': 'req-5a2c5a91-1e5a-421a-9299-5fad26326e47'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:00.899828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5a2c5a91-1e5a-421a-9299-5fad26326e47 admin admin] The token cache is being invalidate because project 0c7dc87ba90d4924826f3d998005c989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:30:00.900179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5a2c5a91-1e5a-421a-9299-5fad26326e47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:00.902387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5a2c5a91-1e5a-421a-9299-5fad26326e47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:00.904385 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3761/7470] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:30:00 2022] DELETE /identity/v3/projects/0c7dc87ba90d4924826f3d998005c989 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:00.905024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c5a91-1e5a-421a-9299-5fad26326e47 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:00.906427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5a2c5a91-1e5a-421a-9299-5fad26326e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:00.946832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6c228-680c-4f86-8fbb-f408435001b0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:00.952137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4ac8f-cee7-4e62-9cd0-45b8d807cda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:00.952974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4ac8f-cee7-4e62-9cd0-45b8d807cda6 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:00.953335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4ac8f-cee7-4e62-9cd0-45b8d807cda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:00.953683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4ac8f-cee7-4e62-9cd0-45b8d807cda6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:00.954410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4ac8f-cee7-4e62-9cd0-45b8d807cda6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:00.956475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4ac8f-cee7-4e62-9cd0-45b8d807cda6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:00.976038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:00.994910 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3710/7471] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:00 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:00.994910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8149849-0212-4e1b-9b3b-cf7fb00bad92 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:00.994910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8149849-0212-4e1b-9b3b-cf7fb00bad92 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:00.994910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8149849-0212-4e1b-9b3b-cf7fb00bad92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:00.997079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c5a91-1e5a-421a-9299-5fad26326e47 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:01.023807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f8149849-0212-4e1b-9b3b-cf7fb00bad92 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:01.025065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f8149849-0212-4e1b-9b3b-cf7fb00bad92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:01.076828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca92572-0741-44a0-b958-e0fe05637759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:01.077498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca92572-0741-44a0-b958-e0fe05637759 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:01.077783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca92572-0741-44a0-b958-e0fe05637759 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:01.078054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca92572-0741-44a0-b958-e0fe05637759 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:01.078719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca92572-0741-44a0-b958-e0fe05637759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:01.082964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca92572-0741-44a0-b958-e0fe05637759 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:01.101694 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3711/7472] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:01.102875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8149849-0212-4e1b-9b3b-cf7fb00bad92 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:01.105151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f8149849-0212-4e1b-9b3b-cf7fb00bad92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:01.110413 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3762/7473] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:00 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:01.112725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a57810-aaf9-4a5e-977e-1c9e68ccd8fd None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:01.113218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a57810-aaf9-4a5e-977e-1c9e68ccd8fd None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:01.113333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a57810-aaf9-4a5e-977e-1c9e68ccd8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:01.124290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8149849-0212-4e1b-9b3b-cf7fb00bad92 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:01.131661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4046e9-c73e-4874-a5f2-292464e6689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:01.132363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4046e9-c73e-4874-a5f2-292464e6689c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:01.132648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4046e9-c73e-4874-a5f2-292464e6689c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:01.132921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4046e9-c73e-4874-a5f2-292464e6689c admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:01.133733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4046e9-c73e-4874-a5f2-292464e6689c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:01.137488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4046e9-c73e-4874-a5f2-292464e6689c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:01.144467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e5a57810-aaf9-4a5e-977e-1c9e68ccd8fd None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:01.146099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e5a57810-aaf9-4a5e-977e-1c9e68ccd8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:01.160567 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3763/7474] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:01.161350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a57810-aaf9-4a5e-977e-1c9e68ccd8fd None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:01.170345 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3712/7475] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:01 2022] POST /identity/v3/users => generated 291 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:01.172094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4046e9-c73e-4874-a5f2-292464e6689c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:01.172481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a57810-aaf9-4a5e-977e-1c9e68ccd8fd None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:01.178926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f128b3-02b1-46dd-a831-e5829e02f176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:01.180216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f128b3-02b1-46dd-a831-e5829e02f176 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:01.180538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f128b3-02b1-46dd-a831-e5829e02f176 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:01.180900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f128b3-02b1-46dd-a831-e5829e02f176 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:01.181682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f128b3-02b1-46dd-a831-e5829e02f176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:01.184532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f128b3-02b1-46dd-a831-e5829e02f176 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:01.187734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4046e9-c73e-4874-a5f2-292464e6689c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:01.193702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c3965-1b0f-4361-af8f-d66dbf01ae46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:01.194581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c3965-1b0f-4361-af8f-d66dbf01ae46 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:01.195142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c3965-1b0f-4361-af8f-d66dbf01ae46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:01.195870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c3965-1b0f-4361-af8f-d66dbf01ae46 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:01.196894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c3965-1b0f-4361-af8f-d66dbf01ae46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:30:01.197384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c3965-1b0f-4361-af8f-d66dbf01ae46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:01.200668 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3764/7476] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:01.202203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c3965-1b0f-4361-af8f-d66dbf01ae46 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:01.206350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f128b3-02b1-46dd-a831-e5829e02f176 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:01.219337 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3713/7477] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:30:01.219534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f128b3-02b1-46dd-a831-e5829e02f176 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:01.219624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c3965-1b0f-4361-af8f-d66dbf01ae46 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:01.224496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe05ca7-454a-4fa7-b1df-967305317690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:01.225311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe05ca7-454a-4fa7-b1df-967305317690 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:01.225812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe05ca7-454a-4fa7-b1df-967305317690 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:01.226106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe05ca7-454a-4fa7-b1df-967305317690 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:01.226812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe05ca7-454a-4fa7-b1df-967305317690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:01.228569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe05ca7-454a-4fa7-b1df-967305317690 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:01.231590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c3965-1b0f-4361-af8f-d66dbf01ae46 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:01.238601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781769ab-53ab-47b5-ba0e-4c37e415948e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:01.239220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781769ab-53ab-47b5-ba0e-4c37e415948e admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:01.239541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781769ab-53ab-47b5-ba0e-4c37e415948e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:01.239818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781769ab-53ab-47b5-ba0e-4c37e415948e admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:01.240514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781769ab-53ab-47b5-ba0e-4c37e415948e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:01.240645 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3765/7478] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:01.241318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe05ca7-454a-4fa7-b1df-967305317690 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:01.247890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781769ab-53ab-47b5-ba0e-4c37e415948e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:01.254630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe05ca7-454a-4fa7-b1df-967305317690 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:01.261029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a4cf5-9dfd-43d9-9b5e-9829b6b52d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:01.261681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a4cf5-9dfd-43d9-9b5e-9829b6b52d9d admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:01.261965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a4cf5-9dfd-43d9-9b5e-9829b6b52d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:01.262400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a4cf5-9dfd-43d9-9b5e-9829b6b52d9d admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:01.263138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a4cf5-9dfd-43d9-9b5e-9829b6b52d9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:01.264146 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3714/7479] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:01.265088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781769ab-53ab-47b5-ba0e-4c37e415948e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:01.268770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a4cf5-9dfd-43d9-9b5e-9829b6b52d9d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:01.279947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781769ab-53ab-47b5-ba0e-4c37e415948e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:01.287171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318c3b5-248e-4782-87e6-2162df1189b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:01.288118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318c3b5-248e-4782-87e6-2162df1189b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:01.288819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318c3b5-248e-4782-87e6-2162df1189b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:01.289114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318c3b5-248e-4782-87e6-2162df1189b6 admin admin] PATH_INFO: `/v3/projects/035ceba31ec1448caad89bab6d6e21a0/users/9cf87c508ba04ca4bffcdb1e4189d67b/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:01.303721 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3766/7480] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:01 2022] POST /identity/v3/projects => generated 363 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:01.303721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a4cf5-9dfd-43d9-9b5e-9829b6b52d9d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:01.310605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5318c3b5-248e-4782-87e6-2162df1189b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=035ceba31ec1448caad89bab6d6e21a0, user_id=9cf87c508ba04ca4bffcdb1e4189d67b, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:01.313493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5318c3b5-248e-4782-87e6-2162df1189b6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:01.329412 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3715/7481] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:01 2022] PUT /identity/v3/projects/035ceba31ec1448caad89bab6d6e21a0/users/9cf87c508ba04ca4bffcdb1e4189d67b/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:01.329994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318c3b5-248e-4782-87e6-2162df1189b6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:01.369316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:01.380730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a4cf5-9dfd-43d9-9b5e-9829b6b52d9d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:01.403104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318c3b5-248e-4782-87e6-2162df1189b6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:01.408349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764af5bc-7e5d-4cdf-ae45-ab6dba5e2e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:01.408986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764af5bc-7e5d-4cdf-ae45-ab6dba5e2e99 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:01.409274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764af5bc-7e5d-4cdf-ae45-ab6dba5e2e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:01.409557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764af5bc-7e5d-4cdf-ae45-ab6dba5e2e99 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:01.410222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764af5bc-7e5d-4cdf-ae45-ab6dba5e2e99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:01.412400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764af5bc-7e5d-4cdf-ae45-ab6dba5e2e99 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:01.435346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:01.445498 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3716/7482] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:01 2022] POST /identity/v3/users => generated 282 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:01.446555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764af5bc-7e5d-4cdf-ae45-ab6dba5e2e99 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:01.458618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764af5bc-7e5d-4cdf-ae45-ab6dba5e2e99 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:01.460796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbfec4-8bf9-40c5-bbba-5e639bc3c04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:01.462043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbfec4-8bf9-40c5-bbba-5e639bc3c04b admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:01.462335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbfec4-8bf9-40c5-bbba-5e639bc3c04b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:01.462619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbfec4-8bf9-40c5-bbba-5e639bc3c04b admin admin] PATH_INFO: `/v3/projects/ccdff03d409943719d617d0fb1a5c00a/users/97de326d459d40248a85e300e448076e/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:01.475575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfac341-75e7-41b1-b400-b9db3abe2011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:01.476418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfac341-75e7-41b1-b400-b9db3abe2011 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:01.478047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfac341-75e7-41b1-b400-b9db3abe2011 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:01.478329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfac341-75e7-41b1-b400-b9db3abe2011 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:01.479184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfac341-75e7-41b1-b400-b9db3abe2011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:01.482605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfac341-75e7-41b1-b400-b9db3abe2011 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:01.495141 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3717/7483] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:01.495978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfac341-75e7-41b1-b400-b9db3abe2011 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:01.504004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbfec4-8bf9-40c5-bbba-5e639bc3c04b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccdff03d409943719d617d0fb1a5c00a, user_id=97de326d459d40248a85e300e448076e, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:01.506869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfac341-75e7-41b1-b400-b9db3abe2011 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:01.508719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbfec4-8bf9-40c5-bbba-5e639bc3c04b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:01.514011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dca7ff-bb17-4fa0-a935-6cb059c9bd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:01.514560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dca7ff-bb17-4fa0-a935-6cb059c9bd08 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:01.514847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dca7ff-bb17-4fa0-a935-6cb059c9bd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:01.515122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dca7ff-bb17-4fa0-a935-6cb059c9bd08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:01.516144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dca7ff-bb17-4fa0-a935-6cb059c9bd08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:01.517927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dca7ff-bb17-4fa0-a935-6cb059c9bd08 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:01.531724 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3767/7484] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:01 2022] PUT /identity/v3/projects/ccdff03d409943719d617d0fb1a5c00a/users/97de326d459d40248a85e300e448076e/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:01.532441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbfec4-8bf9-40c5-bbba-5e639bc3c04b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:01.547567 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3718/7485] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:01.549366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6543d2e-b397-49a2-a508-299b11bf0ab0 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:01.549366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6543d2e-b397-49a2-a508-299b11bf0ab0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:01.549627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6543d2e-b397-49a2-a508-299b11bf0ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:01.593226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b6543d2e-b397-49a2-a508-299b11bf0ab0 None None] MFA Rules not processed for user `97de326d459d40248a85e300e448076e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:01.594762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b6543d2e-b397-49a2-a508-299b11bf0ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:01.624787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbfec4-8bf9-40c5-bbba-5e639bc3c04b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:01.631092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f85a7-3b4d-4970-af55-e7daa31992e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:01.632014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f85a7-3b4d-4970-af55-e7daa31992e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:01.632427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f85a7-3b4d-4970-af55-e7daa31992e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:01.632807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f85a7-3b4d-4970-af55-e7daa31992e6 admin admin] PATH_INFO: `/v3/projects/035ceba31ec1448caad89bab6d6e21a0/users/9cf87c508ba04ca4bffcdb1e4189d67b/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:01.638919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f85a7-3b4d-4970-af55-e7daa31992e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=035ceba31ec1448caad89bab6d6e21a0, user_id=9cf87c508ba04ca4bffcdb1e4189d67b, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:01.642914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f85a7-3b4d-4970-af55-e7daa31992e6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:01.659666 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3768/7486] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:01 2022] PUT /identity/v3/projects/035ceba31ec1448caad89bab6d6e21a0/users/9cf87c508ba04ca4bffcdb1e4189d67b/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:01.660684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f85a7-3b4d-4970-af55-e7daa31992e6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:01.703135 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3719/7487] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:01.714670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6543d2e-b397-49a2-a508-299b11bf0ab0 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:01.717928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b6543d2e-b397-49a2-a508-299b11bf0ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:01.773993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f85a7-3b4d-4970-af55-e7daa31992e6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:01.780566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3e9e1-944b-4410-8c88-43337d9555e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:01.780566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3e9e1-944b-4410-8c88-43337d9555e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:01.780566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3e9e1-944b-4410-8c88-43337d9555e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:01.780942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3e9e1-944b-4410-8c88-43337d9555e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:01.794421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca3e9e1-944b-4410-8c88-43337d9555e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:01.799169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca3e9e1-944b-4410-8c88-43337d9555e2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:01.801224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6543d2e-b397-49a2-a508-299b11bf0ab0 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:01.829017 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3769/7488] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:01.830687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda04237-7554-452b-98b2-5c9d72137d90 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:01.830986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda04237-7554-452b-98b2-5c9d72137d90 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:01.831266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda04237-7554-452b-98b2-5c9d72137d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:01.860140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:01.871247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0aef9-0b26-47bb-b4eb-eefd1bbd348c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:01.872051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0aef9-0b26-47bb-b4eb-eefd1bbd348c service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:01.872405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0aef9-0b26-47bb-b4eb-eefd1bbd348c service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:01.872760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0aef9-0b26-47bb-b4eb-eefd1bbd348c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:01.877097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-eda04237-7554-452b-98b2-5c9d72137d90 None None] MFA Rules not processed for user `9cf87c508ba04ca4bffcdb1e4189d67b`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:01.878421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-eda04237-7554-452b-98b2-5c9d72137d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:01.949867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:01.962846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0aef9-0b26-47bb-b4eb-eefd1bbd348c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:01.965171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0aef9-0b26-47bb-b4eb-eefd1bbd348c service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:01.976558 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3720/7489] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:01.977405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0aef9-0b26-47bb-b4eb-eefd1bbd348c service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:01.990350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0aef9-0b26-47bb-b4eb-eefd1bbd348c service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:02.014847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939eb98-ea90-4fcb-bdb6-fba3be2673b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:02.015618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939eb98-ea90-4fcb-bdb6-fba3be2673b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:02.015909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939eb98-ea90-4fcb-bdb6-fba3be2673b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:02.016189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939eb98-ea90-4fcb-bdb6-fba3be2673b2 admin admin] PATH_INFO: `/v3/projects/d68db0e8ec2249f198f3d6c01663919d/users/7d169e8119cf4c6f877fd2900e941c96/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:02.028202 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3770/7490] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:01 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:02.042067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda04237-7554-452b-98b2-5c9d72137d90 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:02.043842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-eda04237-7554-452b-98b2-5c9d72137d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:02.046906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939eb98-ea90-4fcb-bdb6-fba3be2673b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d68db0e8ec2249f198f3d6c01663919d, user_id=7d169e8119cf4c6f877fd2900e941c96, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:02.049738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939eb98-ea90-4fcb-bdb6-fba3be2673b2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:02.069885 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3721/7491] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:01 2022] PUT /identity/v3/projects/d68db0e8ec2249f198f3d6c01663919d/users/7d169e8119cf4c6f877fd2900e941c96/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:02.082967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2b7db-c4dc-4ac2-a374-899418930752 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:02.083264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2b7db-c4dc-4ac2-a374-899418930752 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:02.083882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2b7db-c4dc-4ac2-a374-899418930752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:02.145647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-cbf2b7db-c4dc-4ac2-a374-899418930752 None None] MFA Rules not processed for user `7d169e8119cf4c6f877fd2900e941c96`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:02.148267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cbf2b7db-c4dc-4ac2-a374-899418930752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:02.187884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda04237-7554-452b-98b2-5c9d72137d90 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:02.287337 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3722/7492] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:02.293660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5f761-fb0c-44eb-8c6c-a3cc60924965 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:02.294411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5f761-fb0c-44eb-8c6c-a3cc60924965 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:02.294819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5f761-fb0c-44eb-8c6c-a3cc60924965 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:02.295201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5f761-fb0c-44eb-8c6c-a3cc60924965 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:02.300762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2b7db-c4dc-4ac2-a374-899418930752 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:02.303021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cbf2b7db-c4dc-4ac2-a374-899418930752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:02.333811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2b7db-c4dc-4ac2-a374-899418930752 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:02.343774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b3f7c-776d-438e-a7f6-c586079cb917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:02.344419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b3f7c-776d-438e-a7f6-c586079cb917 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:02.344704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b3f7c-776d-438e-a7f6-c586079cb917 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:02.344982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b3f7c-776d-438e-a7f6-c586079cb917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:02.366866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b3f7c-776d-438e-a7f6-c586079cb917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:02.369915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b3f7c-776d-438e-a7f6-c586079cb917 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:02.383592 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3723/7493] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:30:02.395305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5f761-fb0c-44eb-8c6c-a3cc60924965 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:02.397928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5f761-fb0c-44eb-8c6c-a3cc60924965 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:02.408538 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3771/7494] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:02 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:30:02.472251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b3f7c-776d-438e-a7f6-c586079cb917 service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:02.500265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b3f7c-776d-438e-a7f6-c586079cb917 service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:02.513297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4095ce1-1ea6-4171-b58c-9819612a6973 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:02.513928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4095ce1-1ea6-4171-b58c-9819612a6973 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:02.514260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4095ce1-1ea6-4171-b58c-9819612a6973 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:02.515795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4095ce1-1ea6-4171-b58c-9819612a6973 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:02.519599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c4095ce1-1ea6-4171-b58c-9819612a6973 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:02.674405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:02.700462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4095ce1-1ea6-4171-b58c-9819612a6973 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:02.702093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4095ce1-1ea6-4171-b58c-9819612a6973 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:02.750064 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3724/7495] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:02.853906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5f761-fb0c-44eb-8c6c-a3cc60924965 service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:02.978096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:03.079044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5f761-fb0c-44eb-8c6c-a3cc60924965 service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:03.088803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a0d72-77aa-42a7-9203-1512dd23c00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:03.089736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a0d72-77aa-42a7-9203-1512dd23c00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:03.090030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a0d72-77aa-42a7-9203-1512dd23c00d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:03.090340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a0d72-77aa-42a7-9203-1512dd23c00d admin admin] PATH_INFO: `/v3/users/97de326d459d40248a85e300e448076e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:03.091848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a0d72-77aa-42a7-9203-1512dd23c00d admin admin] RBAC: Authorizing `identity:delete_user(user_id=97de326d459d40248a85e300e448076e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:03.098269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a0d72-77aa-42a7-9203-1512dd23c00d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:03.269175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-943a0d72-77aa-42a7-9203-1512dd23c00d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97de326d459d40248a85e300e448076e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:03.318940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-943a0d72-77aa-42a7-9203-1512dd23c00d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97de326d459d40248a85e300e448076e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:03.322555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-943a0d72-77aa-42a7-9203-1512dd23c00d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97de326d459d40248a85e300e448076e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:03.334585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-943a0d72-77aa-42a7-9203-1512dd23c00d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97de326d459d40248a85e300e448076e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:03.335505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-943a0d72-77aa-42a7-9203-1512dd23c00d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97de326d459d40248a85e300e448076e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:03.368838 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3772/7496] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:30:02 2022] DELETE /identity/v3/users/97de326d459d40248a85e300e448076e => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:03.371396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6383798-0b9c-4764-b95b-b93c2739717b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:03.372316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6383798-0b9c-4764-b95b-b93c2739717b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:03.374320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6383798-0b9c-4764-b95b-b93c2739717b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:03.417804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d6383798-0b9c-4764-b95b-b93c2739717b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:03.419459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d6383798-0b9c-4764-b95b-b93c2739717b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:03.587507 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3725/7497] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:03.602792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a0d72-77aa-42a7-9203-1512dd23c00d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:03.605497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-943a0d72-77aa-42a7-9203-1512dd23c00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:03.724755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a0d72-77aa-42a7-9203-1512dd23c00d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:03.730924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42de6e-a9de-43cb-abc9-2745c298bf05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:03.732491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42de6e-a9de-43cb-abc9-2745c298bf05 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:03.732786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42de6e-a9de-43cb-abc9-2745c298bf05 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:03.733180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42de6e-a9de-43cb-abc9-2745c298bf05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:03.746789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42de6e-a9de-43cb-abc9-2745c298bf05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:03.748305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42de6e-a9de-43cb-abc9-2745c298bf05 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:03.761862 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3773/7498] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:04.224725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6383798-0b9c-4764-b95b-b93c2739717b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:04.226678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d6383798-0b9c-4764-b95b-b93c2739717b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:04.263452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6383798-0b9c-4764-b95b-b93c2739717b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:04.285853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f0c35-e646-4be4-86e8-d227c4b57181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:04.286846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f0c35-e646-4be4-86e8-d227c4b57181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:04.287274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f0c35-e646-4be4-86e8-d227c4b57181 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:04.287681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f0c35-e646-4be4-86e8-d227c4b57181 admin admin] PATH_INFO: `/v3/projects/ccdff03d409943719d617d0fb1a5c00a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:04.289191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f0c35-e646-4be4-86e8-d227c4b57181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccdff03d409943719d617d0fb1a5c00a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:04.291403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f0c35-e646-4be4-86e8-d227c4b57181 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:04.387999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-285f0c35-e646-4be4-86e8-d227c4b57181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccdff03d409943719d617d0fb1a5c00a', 'request_id': 'req-285f0c35-e646-4be4-86e8-d227c4b57181'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:04.402371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-285f0c35-e646-4be4-86e8-d227c4b57181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccdff03d409943719d617d0fb1a5c00a', 'request_id': 'req-285f0c35-e646-4be4-86e8-d227c4b57181'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:04.413217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-285f0c35-e646-4be4-86e8-d227c4b57181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccdff03d409943719d617d0fb1a5c00a', 'request_id': 'req-285f0c35-e646-4be4-86e8-d227c4b57181'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:04.456137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-285f0c35-e646-4be4-86e8-d227c4b57181 admin admin] The token cache is being invalidate because project ccdff03d409943719d617d0fb1a5c00a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:30:04.456670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-285f0c35-e646-4be4-86e8-d227c4b57181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:04.458567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-285f0c35-e646-4be4-86e8-d227c4b57181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:04.462644 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3726/7499] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:30:04 2022] DELETE /identity/v3/projects/ccdff03d409943719d617d0fb1a5c00a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:04.468032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aced779-f1bb-40d5-ba40-d19ae6035b34 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:04.468531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aced779-f1bb-40d5-ba40-d19ae6035b34 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:04.468651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aced779-f1bb-40d5-ba40-d19ae6035b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:04.526037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2aced779-f1bb-40d5-ba40-d19ae6035b34 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:04.527200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2aced779-f1bb-40d5-ba40-d19ae6035b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:04.647082 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3774/7500] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:04.660448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a63f85-bae3-450a-86fc-721fded8b44f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:04.660448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a63f85-bae3-450a-86fc-721fded8b44f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:04.660448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a63f85-bae3-450a-86fc-721fded8b44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:04.718620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c9a63f85-bae3-450a-86fc-721fded8b44f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:04.719917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c9a63f85-bae3-450a-86fc-721fded8b44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:04.756827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aced779-f1bb-40d5-ba40-d19ae6035b34 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:04.757417 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3727/7501] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:30:04.777700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aced779-f1bb-40d5-ba40-d19ae6035b34 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:04.796213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1b5a4-d107-47d7-b566-b544b362fee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:04.797383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1b5a4-d107-47d7-b566-b544b362fee7 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:04.800058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1b5a4-d107-47d7-b566-b544b362fee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:04.800311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1b5a4-d107-47d7-b566-b544b362fee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:04.802291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1b5a4-d107-47d7-b566-b544b362fee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:30:04.802632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1b5a4-d107-47d7-b566-b544b362fee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:04.804306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1b5a4-d107-47d7-b566-b544b362fee7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:04.828283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:04.858297 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3775/7502] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:30:04.862594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a63f85-bae3-450a-86fc-721fded8b44f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:04.877503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a63f85-bae3-450a-86fc-721fded8b44f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:04.883308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f05e7e-7743-4285-92c5-f038e5c7f16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:04.884127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f05e7e-7743-4285-92c5-f038e5c7f16b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:04.884422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f05e7e-7743-4285-92c5-f038e5c7f16b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:04.884703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f05e7e-7743-4285-92c5-f038e5c7f16b admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:04.885667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f05e7e-7743-4285-92c5-f038e5c7f16b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:04.889452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f05e7e-7743-4285-92c5-f038e5c7f16b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:04.947762 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3728/7503] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:04 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:04.952780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1b5a4-d107-47d7-b566-b544b362fee7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:04.966863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1b5a4-d107-47d7-b566-b544b362fee7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:05.120336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f386f4-b416-4839-acc7-ea74ccc57e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:05.122618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f386f4-b416-4839-acc7-ea74ccc57e2b admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:05.123495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f386f4-b416-4839-acc7-ea74ccc57e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:05.124128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f386f4-b416-4839-acc7-ea74ccc57e2b admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:05.127973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f386f4-b416-4839-acc7-ea74ccc57e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:05.133121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f386f4-b416-4839-acc7-ea74ccc57e2b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:05.189078 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3776/7504] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:04 2022] POST /identity/v3/users => generated 294 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:05.193005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f05e7e-7743-4285-92c5-f038e5c7f16b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:05.211472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f05e7e-7743-4285-92c5-f038e5c7f16b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:05.224589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce41c8e-a811-4cc2-983d-db64895360e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:05.225245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce41c8e-a811-4cc2-983d-db64895360e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:05.225540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce41c8e-a811-4cc2-983d-db64895360e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:05.228674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce41c8e-a811-4cc2-983d-db64895360e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:05.230156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce41c8e-a811-4cc2-983d-db64895360e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:05.233662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce41c8e-a811-4cc2-983d-db64895360e2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:05.264361 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3729/7505] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:05.265481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f386f4-b416-4839-acc7-ea74ccc57e2b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:05.284467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f386f4-b416-4839-acc7-ea74ccc57e2b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:05.293443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82882f-dcff-43a8-a498-ce9d89a5f06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:05.294093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82882f-dcff-43a8-a498-ce9d89a5f06f admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:05.294386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82882f-dcff-43a8-a498-ce9d89a5f06f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:05.294667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82882f-dcff-43a8-a498-ce9d89a5f06f admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:05.297735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82882f-dcff-43a8-a498-ce9d89a5f06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:05.299939 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82882f-dcff-43a8-a498-ce9d89a5f06f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:05.335777 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3777/7506] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:05.337017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce41c8e-a811-4cc2-983d-db64895360e2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:05.354966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce41c8e-a811-4cc2-983d-db64895360e2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:05.372050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec1abe-8ff8-4d98-ab15-b9ff7491a5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:05.372942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec1abe-8ff8-4d98-ab15-b9ff7491a5be admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:05.375555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec1abe-8ff8-4d98-ab15-b9ff7491a5be admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:05.376025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec1abe-8ff8-4d98-ab15-b9ff7491a5be admin admin] PATH_INFO: `/v3/projects/3f3bfc0134354bb782a148dc881274da/users/6287a3d9ee874c4e9d154144fb49d924/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:05.413096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec1abe-8ff8-4d98-ab15-b9ff7491a5be admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3bfc0134354bb782a148dc881274da, user_id=6287a3d9ee874c4e9d154144fb49d924, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:05.418123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec1abe-8ff8-4d98-ab15-b9ff7491a5be admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:05.470792 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3730/7507] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:05 2022] PUT /identity/v3/projects/3f3bfc0134354bb782a148dc881274da/users/6287a3d9ee874c4e9d154144fb49d924/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:05.484219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122e069-8a67-4fa4-9b71-225586100f07 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:05.484934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122e069-8a67-4fa4-9b71-225586100f07 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:05.485296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122e069-8a67-4fa4-9b71-225586100f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:05.527800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d122e069-8a67-4fa4-9b71-225586100f07 None None] MFA Rules not processed for user `6287a3d9ee874c4e9d154144fb49d924`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:05.528923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d122e069-8a67-4fa4-9b71-225586100f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:05.616557 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3778/7508] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:30:05.624051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec1abe-8ff8-4d98-ab15-b9ff7491a5be admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:05.638103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:05.738434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec1abe-8ff8-4d98-ab15-b9ff7491a5be admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:05.746036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af5ca2-652c-4e12-990e-82bb87195884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:05.747579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af5ca2-652c-4e12-990e-82bb87195884 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:05.748043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af5ca2-652c-4e12-990e-82bb87195884 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:05.748555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af5ca2-652c-4e12-990e-82bb87195884 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:05.750492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af5ca2-652c-4e12-990e-82bb87195884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:05.754290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af5ca2-652c-4e12-990e-82bb87195884 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:05.798545 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3731/7509] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:05 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:30:05.800120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122e069-8a67-4fa4-9b71-225586100f07 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:05.815948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122e069-8a67-4fa4-9b71-225586100f07 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:05.886553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d244b-2033-4509-955c-606937cf14d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:05.887170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d244b-2033-4509-955c-606937cf14d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:05.887493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d244b-2033-4509-955c-606937cf14d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:05.887782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d244b-2033-4509-955c-606937cf14d7 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:05.888468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d244b-2033-4509-955c-606937cf14d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:05.890573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d244b-2033-4509-955c-606937cf14d7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:05.913187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:05.939360 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3779/7510] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:05 2022] POST /identity/v3/users => generated 300 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:30:05.943328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af5ca2-652c-4e12-990e-82bb87195884 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:05.965080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af5ca2-652c-4e12-990e-82bb87195884 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:05.975683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbcc31-7fe3-45a6-99a3-5995f8494ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:05.976328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbcc31-7fe3-45a6-99a3-5995f8494ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:05.976616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbcc31-7fe3-45a6-99a3-5995f8494ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:05.976897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbcc31-7fe3-45a6-99a3-5995f8494ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:05.977602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbcc31-7fe3-45a6-99a3-5995f8494ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:05.980344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbcc31-7fe3-45a6-99a3-5995f8494ad9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:06.028415 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3732/7511] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:06.033061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d244b-2033-4509-955c-606937cf14d7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:06.052089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d244b-2033-4509-955c-606937cf14d7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:06.064321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359239b-754f-4a1c-942f-7f04b6836598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:06.065828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359239b-754f-4a1c-942f-7f04b6836598 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:06.066111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359239b-754f-4a1c-942f-7f04b6836598 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:06.066389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359239b-754f-4a1c-942f-7f04b6836598 admin admin] PATH_INFO: `/v3/projects/267297c52b794d8f90b7786747905190/users/d136b376c5c44d3f9972b8990bd7fbce/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:06.105681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359239b-754f-4a1c-942f-7f04b6836598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=267297c52b794d8f90b7786747905190, user_id=d136b376c5c44d3f9972b8990bd7fbce, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:06.112176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359239b-754f-4a1c-942f-7f04b6836598 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:06.146629 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3780/7512] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:06 2022] PUT /identity/v3/projects/267297c52b794d8f90b7786747905190/users/d136b376c5c44d3f9972b8990bd7fbce/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:06.151526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbcc31-7fe3-45a6-99a3-5995f8494ad9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:06.188462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbcc31-7fe3-45a6-99a3-5995f8494ad9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:06.305482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434d409-2e3b-4e1f-b9dd-e072b6e7eb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:06.306228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434d409-2e3b-4e1f-b9dd-e072b6e7eb16 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:06.306609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434d409-2e3b-4e1f-b9dd-e072b6e7eb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:06.307615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434d409-2e3b-4e1f-b9dd-e072b6e7eb16 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:06.308432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434d409-2e3b-4e1f-b9dd-e072b6e7eb16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:06.310169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434d409-2e3b-4e1f-b9dd-e072b6e7eb16 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:06.323782 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3733/7513] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:06.327654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359239b-754f-4a1c-942f-7f04b6836598 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:06.338825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359239b-754f-4a1c-942f-7f04b6836598 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:06.344572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f89836-f10a-49f4-8141-3849e9854fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:06.345419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f89836-f10a-49f4-8141-3849e9854fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:06.345717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f89836-f10a-49f4-8141-3849e9854fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:06.346000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f89836-f10a-49f4-8141-3849e9854fd9 admin admin] PATH_INFO: `/v3/projects/267297c52b794d8f90b7786747905190/users/d136b376c5c44d3f9972b8990bd7fbce/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:06.348919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f89836-f10a-49f4-8141-3849e9854fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=267297c52b794d8f90b7786747905190, user_id=d136b376c5c44d3f9972b8990bd7fbce, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:06.351838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f89836-f10a-49f4-8141-3849e9854fd9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:06.371713 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3781/7514] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:06 2022] PUT /identity/v3/projects/267297c52b794d8f90b7786747905190/users/d136b376c5c44d3f9972b8990bd7fbce/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:06.382326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e5e9d-ede2-46a6-a5cc-a7c1e45acba0 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:06.382612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e5e9d-ede2-46a6-a5cc-a7c1e45acba0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:06.382891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e5e9d-ede2-46a6-a5cc-a7c1e45acba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:06.430073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9a5e5e9d-ede2-46a6-a5cc-a7c1e45acba0 None None] MFA Rules not processed for user `d136b376c5c44d3f9972b8990bd7fbce`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:06.432893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9a5e5e9d-ede2-46a6-a5cc-a7c1e45acba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:06.587502 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3734/7515] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:06.608904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f89836-f10a-49f4-8141-3849e9854fd9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:06.612550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-62f89836-f10a-49f4-8141-3849e9854fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:06.745343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f89836-f10a-49f4-8141-3849e9854fd9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:06.758113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d94cf-93f7-4ae1-b001-6758fab8af97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:06.758773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d94cf-93f7-4ae1-b001-6758fab8af97 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:06.758935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d94cf-93f7-4ae1-b001-6758fab8af97 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:06.759211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d94cf-93f7-4ae1-b001-6758fab8af97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:06.787728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d94cf-93f7-4ae1-b001-6758fab8af97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:06.789194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d94cf-93f7-4ae1-b001-6758fab8af97 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:06.823810 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3782/7516] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:07.090484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e5e9d-ede2-46a6-a5cc-a7c1e45acba0 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:07.105176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:07.230260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1de0d-f1de-4701-a26c-e5a3bf7e1992 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:07.231377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1de0d-f1de-4701-a26c-e5a3bf7e1992 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:07.231927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1de0d-f1de-4701-a26c-e5a3bf7e1992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:07.292382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e5e9d-ede2-46a6-a5cc-a7c1e45acba0 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:07.298561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-eeb1de0d-f1de-4701-a26c-e5a3bf7e1992 None None] MFA Rules not processed for user `5a6da0171fac41fb934ed2b294081531`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:07.299856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-eeb1de0d-f1de-4701-a26c-e5a3bf7e1992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:07.308973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52001b-894a-4509-a146-13527c988aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:07.309660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52001b-894a-4509-a146-13527c988aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:07.309945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52001b-894a-4509-a146-13527c988aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:07.310223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52001b-894a-4509-a146-13527c988aa0 admin admin] PATH_INFO: `/v3/users/6287a3d9ee874c4e9d154144fb49d924` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:07.315345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52001b-894a-4509-a146-13527c988aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6287a3d9ee874c4e9d154144fb49d924)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:07.317441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52001b-894a-4509-a146-13527c988aa0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:07.457068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6d52001b-894a-4509-a146-13527c988aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6287a3d9ee874c4e9d154144fb49d924'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:07.463939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6d52001b-894a-4509-a146-13527c988aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6287a3d9ee874c4e9d154144fb49d924'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:07.508735 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3783/7517] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:07.509844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6d52001b-894a-4509-a146-13527c988aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6287a3d9ee874c4e9d154144fb49d924'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:07.512112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6d52001b-894a-4509-a146-13527c988aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6287a3d9ee874c4e9d154144fb49d924'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:07.524689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1de0d-f1de-4701-a26c-e5a3bf7e1992 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:07.526866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-eeb1de0d-f1de-4701-a26c-e5a3bf7e1992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:07.534266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6d52001b-894a-4509-a146-13527c988aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6287a3d9ee874c4e9d154144fb49d924'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:07.575228 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3735/7518] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:30:07 2022] DELETE /identity/v3/users/6287a3d9ee874c4e9d154144fb49d924 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:07.580583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58fe07-903d-4ad2-9153-f6a22d78e15a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:07.581201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58fe07-903d-4ad2-9153-f6a22d78e15a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:07.581726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58fe07-903d-4ad2-9153-f6a22d78e15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:07.610179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5a58fe07-903d-4ad2-9153-f6a22d78e15a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:07.612252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5a58fe07-903d-4ad2-9153-f6a22d78e15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:07.647706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:07.732117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1de0d-f1de-4701-a26c-e5a3bf7e1992 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:07.776588 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3736/7519] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:07.778813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58fe07-903d-4ad2-9153-f6a22d78e15a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:07.780724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5a58fe07-903d-4ad2-9153-f6a22d78e15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:07.797531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58fe07-903d-4ad2-9153-f6a22d78e15a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:07.808654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c04a00-30a3-4f2e-b430-8ee266316b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:07.812793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c04a00-30a3-4f2e-b430-8ee266316b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:07.812981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c04a00-30a3-4f2e-b430-8ee266316b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:07.813189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c04a00-30a3-4f2e-b430-8ee266316b97 admin admin] PATH_INFO: `/v3/users/4cadff9a09c244f2a5983599f891c7ae` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:07.815587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c04a00-30a3-4f2e-b430-8ee266316b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cadff9a09c244f2a5983599f891c7ae)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:07.819182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c04a00-30a3-4f2e-b430-8ee266316b97 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:07.868508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:07.888802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b704d9-0b75-46f4-a4f6-41cae4acbaac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:07.890613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b704d9-0b75-46f4-a4f6-41cae4acbaac service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:07.890613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b704d9-0b75-46f4-a4f6-41cae4acbaac service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:07.891023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b704d9-0b75-46f4-a4f6-41cae4acbaac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:07.947426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-37c04a00-30a3-4f2e-b430-8ee266316b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cadff9a09c244f2a5983599f891c7ae'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:07.950820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-37c04a00-30a3-4f2e-b430-8ee266316b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cadff9a09c244f2a5983599f891c7ae'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:08.011662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-37c04a00-30a3-4f2e-b430-8ee266316b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cadff9a09c244f2a5983599f891c7ae'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:08.013175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-37c04a00-30a3-4f2e-b430-8ee266316b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cadff9a09c244f2a5983599f891c7ae'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:08.035076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-37c04a00-30a3-4f2e-b430-8ee266316b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cadff9a09c244f2a5983599f891c7ae'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:08.067248 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3737/7520] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:30:07 2022] DELETE /identity/v3/users/4cadff9a09c244f2a5983599f891c7ae => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:08.067248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c04a00-30a3-4f2e-b430-8ee266316b97 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:08.067248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-37c04a00-30a3-4f2e-b430-8ee266316b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:08.096522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b704d9-0b75-46f4-a4f6-41cae4acbaac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:08.098470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b704d9-0b75-46f4-a4f6-41cae4acbaac service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:08.120625 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3784/7521] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:08.132278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d1ecd-7460-481d-9fd3-fae30aebc58c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:08.132278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d1ecd-7460-481d-9fd3-fae30aebc58c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:08.132542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d1ecd-7460-481d-9fd3-fae30aebc58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:08.158513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-754d1ecd-7460-481d-9fd3-fae30aebc58c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:08.159777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-754d1ecd-7460-481d-9fd3-fae30aebc58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:08.208637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c04a00-30a3-4f2e-b430-8ee266316b97 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:08.214785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0ca30-a546-4a2d-b0cf-4a4e18929a02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:08.215851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0ca30-a546-4a2d-b0cf-4a4e18929a02 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:08.216144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0ca30-a546-4a2d-b0cf-4a4e18929a02 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:08.216425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0ca30-a546-4a2d-b0cf-4a4e18929a02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:08.218356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e2c0ca30-a546-4a2d-b0cf-4a4e18929a02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:08.283991 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3785/7522] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:08.296958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d1ecd-7460-481d-9fd3-fae30aebc58c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:08.299367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-754d1ecd-7460-481d-9fd3-fae30aebc58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:08.315140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0ca30-a546-4a2d-b0cf-4a4e18929a02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:08.316840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0ca30-a546-4a2d-b0cf-4a4e18929a02 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:08.332154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d1ecd-7460-481d-9fd3-fae30aebc58c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:08.334999 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3738/7523] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:08.336929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf3fee-42f9-4fd6-a8f4-cb60b8ca6529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:08.337478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf3fee-42f9-4fd6-a8f4-cb60b8ca6529 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:08.337767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf3fee-42f9-4fd6-a8f4-cb60b8ca6529 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:08.338678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf3fee-42f9-4fd6-a8f4-cb60b8ca6529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:08.350763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf3fee-42f9-4fd6-a8f4-cb60b8ca6529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:08.352243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf3fee-42f9-4fd6-a8f4-cb60b8ca6529 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:08.365216 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3786/7524] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:09.112473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0ca30-a546-4a2d-b0cf-4a4e18929a02 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:09.118008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e2c0ca30-a546-4a2d-b0cf-4a4e18929a02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:09.167125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0ca30-a546-4a2d-b0cf-4a4e18929a02 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:09.181778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14cb84-1464-4364-882b-b05cd0ece744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:09.182994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14cb84-1464-4364-882b-b05cd0ece744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:09.184931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14cb84-1464-4364-882b-b05cd0ece744 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:09.185423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14cb84-1464-4364-882b-b05cd0ece744 admin admin] PATH_INFO: `/v3/projects/3f3bfc0134354bb782a148dc881274da` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:09.188052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14cb84-1464-4364-882b-b05cd0ece744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f3bfc0134354bb782a148dc881274da)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:09.191348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14cb84-1464-4364-882b-b05cd0ece744 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:09.307584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:09.314171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf3fee-42f9-4fd6-a8f4-cb60b8ca6529 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:09.316668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cbbf3fee-42f9-4fd6-a8f4-cb60b8ca6529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:09.338693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8f14cb84-1464-4364-882b-b05cd0ece744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f3bfc0134354bb782a148dc881274da', 'request_id': 'req-8f14cb84-1464-4364-882b-b05cd0ece744'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:09.358965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf3fee-42f9-4fd6-a8f4-cb60b8ca6529 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:09.378430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8f14cb84-1464-4364-882b-b05cd0ece744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f3bfc0134354bb782a148dc881274da', 'request_id': 'req-8f14cb84-1464-4364-882b-b05cd0ece744'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:09.381890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:09.401789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8f14cb84-1464-4364-882b-b05cd0ece744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f3bfc0134354bb782a148dc881274da', 'request_id': 'req-8f14cb84-1464-4364-882b-b05cd0ece744'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:09.429170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8f14cb84-1464-4364-882b-b05cd0ece744 admin admin] The token cache is being invalidate because project 3f3bfc0134354bb782a148dc881274da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:30:09.432277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8f14cb84-1464-4364-882b-b05cd0ece744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:09.441239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8f14cb84-1464-4364-882b-b05cd0ece744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:09.446993 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3739/7525] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:30:09 2022] DELETE /identity/v3/projects/3f3bfc0134354bb782a148dc881274da => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:09.452774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14cb84-1464-4364-882b-b05cd0ece744 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:09.456141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144785ca-0efd-46e5-bc2c-c3205ed9810b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:09.456327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8f14cb84-1464-4364-882b-b05cd0ece744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:09.457321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144785ca-0efd-46e5-bc2c-c3205ed9810b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:09.457689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144785ca-0efd-46e5-bc2c-c3205ed9810b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:09.458035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144785ca-0efd-46e5-bc2c-c3205ed9810b admin admin] PATH_INFO: `/v3/projects/353adee88db0479e8f8204a4fcfa2c95` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:09.464936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144785ca-0efd-46e5-bc2c-c3205ed9810b admin admin] RBAC: Authorizing `identity:delete_project(project_id=353adee88db0479e8f8204a4fcfa2c95)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:09.476176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144785ca-0efd-46e5-bc2c-c3205ed9810b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:09.510819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14cb84-1464-4364-882b-b05cd0ece744 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:09.532467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dc6c3-04b7-4387-a39e-a64f4004ca03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:09.532467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dc6c3-04b7-4387-a39e-a64f4004ca03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:09.532467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dc6c3-04b7-4387-a39e-a64f4004ca03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:09.532467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dc6c3-04b7-4387-a39e-a64f4004ca03 admin admin] PATH_INFO: `/v3/users/d136b376c5c44d3f9972b8990bd7fbce` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:09.536114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dc6c3-04b7-4387-a39e-a64f4004ca03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d136b376c5c44d3f9972b8990bd7fbce)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:09.538099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dc6c3-04b7-4387-a39e-a64f4004ca03 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:09.605820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-144785ca-0efd-46e5-bc2c-c3205ed9810b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '353adee88db0479e8f8204a4fcfa2c95', 'request_id': 'req-144785ca-0efd-46e5-bc2c-c3205ed9810b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:09.615934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-144785ca-0efd-46e5-bc2c-c3205ed9810b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '353adee88db0479e8f8204a4fcfa2c95', 'request_id': 'req-144785ca-0efd-46e5-bc2c-c3205ed9810b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:09.623220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4b6dc6c3-04b7-4387-a39e-a64f4004ca03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd136b376c5c44d3f9972b8990bd7fbce'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:09.624212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4b6dc6c3-04b7-4387-a39e-a64f4004ca03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd136b376c5c44d3f9972b8990bd7fbce'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:09.635166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-144785ca-0efd-46e5-bc2c-c3205ed9810b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '353adee88db0479e8f8204a4fcfa2c95', 'request_id': 'req-144785ca-0efd-46e5-bc2c-c3205ed9810b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:09.649767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4b6dc6c3-04b7-4387-a39e-a64f4004ca03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd136b376c5c44d3f9972b8990bd7fbce'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:09.652733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4b6dc6c3-04b7-4387-a39e-a64f4004ca03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd136b376c5c44d3f9972b8990bd7fbce'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:09.668092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4b6dc6c3-04b7-4387-a39e-a64f4004ca03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd136b376c5c44d3f9972b8990bd7fbce'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:09.680568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-144785ca-0efd-46e5-bc2c-c3205ed9810b admin admin] The token cache is being invalidate because project 353adee88db0479e8f8204a4fcfa2c95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:30:09.684328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-144785ca-0efd-46e5-bc2c-c3205ed9810b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:09.688042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-144785ca-0efd-46e5-bc2c-c3205ed9810b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:09.693351 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3787/7526] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:30:09 2022] DELETE /identity/v3/projects/353adee88db0479e8f8204a4fcfa2c95 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:09.694815 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3740/7527] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:30:09 2022] DELETE /identity/v3/users/d136b376c5c44d3f9972b8990bd7fbce => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:09.698218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144785ca-0efd-46e5-bc2c-c3205ed9810b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:09.699993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-144785ca-0efd-46e5-bc2c-c3205ed9810b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:09.784130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144785ca-0efd-46e5-bc2c-c3205ed9810b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:09.839249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f39cca-d160-4595-a9a8-a6926f8cf77c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:09.839900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f39cca-d160-4595-a9a8-a6926f8cf77c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:09.840376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f39cca-d160-4595-a9a8-a6926f8cf77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:09.850350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:09.865991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca62f1-a89b-474e-8d80-101c851c9ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:09.866798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca62f1-a89b-474e-8d80-101c851c9ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:09.867112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca62f1-a89b-474e-8d80-101c851c9ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:09.867494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca62f1-a89b-474e-8d80-101c851c9ae4 admin admin] PATH_INFO: `/v3/users/9cf87c508ba04ca4bffcdb1e4189d67b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:09.869950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca62f1-a89b-474e-8d80-101c851c9ae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cf87c508ba04ca4bffcdb1e4189d67b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:09.872105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca62f1-a89b-474e-8d80-101c851c9ae4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:09.886143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-69f39cca-d160-4595-a9a8-a6926f8cf77c None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:09.887426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-69f39cca-d160-4595-a9a8-a6926f8cf77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:09.944855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ecca62f1-a89b-474e-8d80-101c851c9ae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cf87c508ba04ca4bffcdb1e4189d67b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:09.963173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ecca62f1-a89b-474e-8d80-101c851c9ae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cf87c508ba04ca4bffcdb1e4189d67b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:09.964421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ecca62f1-a89b-474e-8d80-101c851c9ae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cf87c508ba04ca4bffcdb1e4189d67b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:09.973986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ecca62f1-a89b-474e-8d80-101c851c9ae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cf87c508ba04ca4bffcdb1e4189d67b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:09.974719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ecca62f1-a89b-474e-8d80-101c851c9ae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cf87c508ba04ca4bffcdb1e4189d67b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:09.981293 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3741/7528] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:30:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:30:09.997572 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3788/7529] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:30:09 2022] DELETE /identity/v3/users/9cf87c508ba04ca4bffcdb1e4189d67b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:30:10.089122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f39cca-d160-4595-a9a8-a6926f8cf77c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:10.090615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-69f39cca-d160-4595-a9a8-a6926f8cf77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:10.199909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca62f1-a89b-474e-8d80-101c851c9ae4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:10.201502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ecca62f1-a89b-474e-8d80-101c851c9ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:10.231464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:10.274243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f39cca-d160-4595-a9a8-a6926f8cf77c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:10.347093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca62f1-a89b-474e-8d80-101c851c9ae4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:10.358103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77b30e-5a55-436e-a0dd-b7c1c090ec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:10.359192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77b30e-5a55-436e-a0dd-b7c1c090ec96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:10.359700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77b30e-5a55-436e-a0dd-b7c1c090ec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:10.360138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77b30e-5a55-436e-a0dd-b7c1c090ec96 admin admin] PATH_INFO: `/v3/projects/267297c52b794d8f90b7786747905190` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:10.362499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77b30e-5a55-436e-a0dd-b7c1c090ec96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=267297c52b794d8f90b7786747905190)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:10.365418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77b30e-5a55-436e-a0dd-b7c1c090ec96 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:10.391839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c39dc-e24d-4282-ba10-4b7f620a3d75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:10.393605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c39dc-e24d-4282-ba10-4b7f620a3d75 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:10.394043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c39dc-e24d-4282-ba10-4b7f620a3d75 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:10.394547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c39dc-e24d-4282-ba10-4b7f620a3d75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:10.461890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6e77b30e-5a55-436e-a0dd-b7c1c090ec96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '267297c52b794d8f90b7786747905190', 'request_id': 'req-6e77b30e-5a55-436e-a0dd-b7c1c090ec96'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:10.476786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6e77b30e-5a55-436e-a0dd-b7c1c090ec96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '267297c52b794d8f90b7786747905190', 'request_id': 'req-6e77b30e-5a55-436e-a0dd-b7c1c090ec96'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:10.502943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6e77b30e-5a55-436e-a0dd-b7c1c090ec96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '267297c52b794d8f90b7786747905190', 'request_id': 'req-6e77b30e-5a55-436e-a0dd-b7c1c090ec96'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:10.518105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:10.524158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6e77b30e-5a55-436e-a0dd-b7c1c090ec96 admin admin] The token cache is being invalidate because project 267297c52b794d8f90b7786747905190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:30:10.524658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6e77b30e-5a55-436e-a0dd-b7c1c090ec96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:10.527307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6e77b30e-5a55-436e-a0dd-b7c1c090ec96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:10.533320 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3789/7530] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:30:10 2022] DELETE /identity/v3/projects/267297c52b794d8f90b7786747905190 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:10.534908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e58f0a-9e74-439c-b785-721d5cab39c2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:10.535446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e58f0a-9e74-439c-b785-721d5cab39c2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:10.536520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c39dc-e24d-4282-ba10-4b7f620a3d75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:10.537542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e58f0a-9e74-439c-b785-721d5cab39c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:10.541796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c39dc-e24d-4282-ba10-4b7f620a3d75 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:10.562570 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3742/7531] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:30:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:30:10.599692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-93e58f0a-9e74-439c-b785-721d5cab39c2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:10.606262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-93e58f0a-9e74-439c-b785-721d5cab39c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:10.725059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0bec9-9e8a-4b14-811e-0d7bcaf199f1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:10.725645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0bec9-9e8a-4b14-811e-0d7bcaf199f1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:10.725645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0bec9-9e8a-4b14-811e-0d7bcaf199f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:10.781135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b2f0bec9-9e8a-4b14-811e-0d7bcaf199f1 None None] MFA Rules not processed for user `5a6da0171fac41fb934ed2b294081531`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:10.783607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b2f0bec9-9e8a-4b14-811e-0d7bcaf199f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:10.786616 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3790/7532] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:30:10.795730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52bfcb-9786-479b-83d8-eda1d81dd336 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:10.796091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52bfcb-9786-479b-83d8-eda1d81dd336 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:10.796395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52bfcb-9786-479b-83d8-eda1d81dd336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:10.846372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3f52bfcb-9786-479b-83d8-eda1d81dd336 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:10.850639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3f52bfcb-9786-479b-83d8-eda1d81dd336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:10.874690 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3791/7533] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:30:10.875990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52bfcb-9786-479b-83d8-eda1d81dd336 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:10.901628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52bfcb-9786-479b-83d8-eda1d81dd336 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:10.907833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c476a5c-b76b-4f74-8eed-7e1802786fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:10.910536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c476a5c-b76b-4f74-8eed-7e1802786fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:10.911175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c476a5c-b76b-4f74-8eed-7e1802786fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:10.911760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c476a5c-b76b-4f74-8eed-7e1802786fd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:10.913166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c476a5c-b76b-4f74-8eed-7e1802786fd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:30:10.914104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c476a5c-b76b-4f74-8eed-7e1802786fd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:10.916484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c476a5c-b76b-4f74-8eed-7e1802786fd1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:10.959975 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3792/7534] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:30:10.962829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c476a5c-b76b-4f74-8eed-7e1802786fd1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:10.964423 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3743/7535] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:10.965366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0bec9-9e8a-4b14-811e-0d7bcaf199f1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:10.969767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6c476a5c-b76b-4f74-8eed-7e1802786fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:11.013860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0bec9-9e8a-4b14-811e-0d7bcaf199f1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:11.022400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c476a5c-b76b-4f74-8eed-7e1802786fd1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:11.031830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcd237-6f6f-4193-8385-fec579f372a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:11.034042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcd237-6f6f-4193-8385-fec579f372a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:11.034695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811e009-365c-48f7-a3de-eaa5e0ed0ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:11.035554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811e009-365c-48f7-a3de-eaa5e0ed0ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:11.035865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcd237-6f6f-4193-8385-fec579f372a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:11.035865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcd237-6f6f-4193-8385-fec579f372a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:11.036050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811e009-365c-48f7-a3de-eaa5e0ed0ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:11.036311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811e009-365c-48f7-a3de-eaa5e0ed0ef3 admin admin] PATH_INFO: `/v3/projects/035ceba31ec1448caad89bab6d6e21a0` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:11.036596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcd237-6f6f-4193-8385-fec579f372a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:11.037763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811e009-365c-48f7-a3de-eaa5e0ed0ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=035ceba31ec1448caad89bab6d6e21a0)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:11.042251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811e009-365c-48f7-a3de-eaa5e0ed0ef3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:11.045009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcd237-6f6f-4193-8385-fec579f372a6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:11.104258 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3744/7536] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:10 2022] POST /identity/v3/projects => generated 409 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:11.108372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcd237-6f6f-4193-8385-fec579f372a6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:11.161782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:11.181093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d811e009-365c-48f7-a3de-eaa5e0ed0ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '035ceba31ec1448caad89bab6d6e21a0', 'request_id': 'req-d811e009-365c-48f7-a3de-eaa5e0ed0ef3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:11.198398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d811e009-365c-48f7-a3de-eaa5e0ed0ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '035ceba31ec1448caad89bab6d6e21a0', 'request_id': 'req-d811e009-365c-48f7-a3de-eaa5e0ed0ef3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:11.215882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d811e009-365c-48f7-a3de-eaa5e0ed0ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '035ceba31ec1448caad89bab6d6e21a0', 'request_id': 'req-d811e009-365c-48f7-a3de-eaa5e0ed0ef3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:11.250301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d811e009-365c-48f7-a3de-eaa5e0ed0ef3 admin admin] The token cache is being invalidate because project 035ceba31ec1448caad89bab6d6e21a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:30:11.250616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d811e009-365c-48f7-a3de-eaa5e0ed0ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:11.252250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d811e009-365c-48f7-a3de-eaa5e0ed0ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:11.263935 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3793/7537] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:30:10 2022] DELETE /identity/v3/projects/035ceba31ec1448caad89bab6d6e21a0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:11.272213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d0709-ecb3-4543-8bf2-0c6681aefe54 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:11.272710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d0709-ecb3-4543-8bf2-0c6681aefe54 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:11.273178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d0709-ecb3-4543-8bf2-0c6681aefe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:11.275101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcd237-6f6f-4193-8385-fec579f372a6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:11.323887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e77d0709-ecb3-4543-8bf2-0c6681aefe54 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:11.326738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e77d0709-ecb3-4543-8bf2-0c6681aefe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:11.426557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc747f1e-8443-4316-8773-78ff0f711925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:11.427279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc747f1e-8443-4316-8773-78ff0f711925 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:11.427796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc747f1e-8443-4316-8773-78ff0f711925 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:11.428207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc747f1e-8443-4316-8773-78ff0f711925 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:11.435768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc747f1e-8443-4316-8773-78ff0f711925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:11.436011 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3794/7538] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:30:11.436448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc747f1e-8443-4316-8773-78ff0f711925 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:11.439431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c25e9a-75d5-47aa-91d0-0f9109bdbe87 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:11.439723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c25e9a-75d5-47aa-91d0-0f9109bdbe87 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:11.440009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c25e9a-75d5-47aa-91d0-0f9109bdbe87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:11.463015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:11.467703 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3745/7539] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:11 2022] POST /identity/v3/users => generated 305 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:11.468896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc747f1e-8443-4316-8773-78ff0f711925 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:11.475459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cc747f1e-8443-4316-8773-78ff0f711925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:11.485602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-99c25e9a-75d5-47aa-91d0-0f9109bdbe87 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:11.487118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-99c25e9a-75d5-47aa-91d0-0f9109bdbe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:11.502645 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3795/7540] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:11.504035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c25e9a-75d5-47aa-91d0-0f9109bdbe87 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:11.506523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-99c25e9a-75d5-47aa-91d0-0f9109bdbe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:11.525559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c25e9a-75d5-47aa-91d0-0f9109bdbe87 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:11.531324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b5be1-c3f4-48fc-854e-76f0b4dacf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:11.532177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b5be1-c3f4-48fc-854e-76f0b4dacf51 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:11.532631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b5be1-c3f4-48fc-854e-76f0b4dacf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:11.533749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b5be1-c3f4-48fc-854e-76f0b4dacf51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:11.533749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b5be1-c3f4-48fc-854e-76f0b4dacf51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:11.535320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b5be1-c3f4-48fc-854e-76f0b4dacf51 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:11.554870 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3796/7541] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:11.554870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9317309-0b10-4765-8867-3c6ef1f7ab18 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:11.554870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9317309-0b10-4765-8867-3c6ef1f7ab18 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:11.554870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9317309-0b10-4765-8867-3c6ef1f7ab18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:11.567015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc747f1e-8443-4316-8773-78ff0f711925 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:11.572284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf715d2-5d23-4fec-914c-14a0b62c5ef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:11.573204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf715d2-5d23-4fec-914c-14a0b62c5ef5 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:11.573968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf715d2-5d23-4fec-914c-14a0b62c5ef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:11.574360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf715d2-5d23-4fec-914c-14a0b62c5ef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:11.576587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ccf715d2-5d23-4fec-914c-14a0b62c5ef5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:11.584321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d9317309-0b10-4765-8867-3c6ef1f7ab18 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:11.585793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d9317309-0b10-4765-8867-3c6ef1f7ab18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:11.596616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf715d2-5d23-4fec-914c-14a0b62c5ef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:11.598984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf715d2-5d23-4fec-914c-14a0b62c5ef5 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:11.612993 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3746/7542] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:11.614376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf715d2-5d23-4fec-914c-14a0b62c5ef5 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:11.627135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf715d2-5d23-4fec-914c-14a0b62c5ef5 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:11.634771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2a870-fee1-47a5-b8ea-379d1cfddfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:11.635866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2a870-fee1-47a5-b8ea-379d1cfddfef admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:11.636336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2a870-fee1-47a5-b8ea-379d1cfddfef admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:11.636836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2a870-fee1-47a5-b8ea-379d1cfddfef admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:11.637772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2a870-fee1-47a5-b8ea-379d1cfddfef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:30:11.638407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2a870-fee1-47a5-b8ea-379d1cfddfef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:11.640299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2a870-fee1-47a5-b8ea-379d1cfddfef admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:11.657987 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3747/7543] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:30:11.659268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2a870-fee1-47a5-b8ea-379d1cfddfef admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:11.672840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2a870-fee1-47a5-b8ea-379d1cfddfef admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:11.679795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a96352-0d59-4eef-932d-44c31c516709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:11.680982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a96352-0d59-4eef-932d-44c31c516709 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:11.682127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a96352-0d59-4eef-932d-44c31c516709 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:11.682614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a96352-0d59-4eef-932d-44c31c516709 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:11.683587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a96352-0d59-4eef-932d-44c31c516709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:11.685763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a96352-0d59-4eef-932d-44c31c516709 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:11.696906 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3797/7544] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:30:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:11.698101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9317309-0b10-4765-8867-3c6ef1f7ab18 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:11.703389 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3748/7545] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:11.705380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a96352-0d59-4eef-932d-44c31c516709 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:11.723722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9317309-0b10-4765-8867-3c6ef1f7ab18 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:11.731205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff0fec-9198-4eef-b877-3f57cfc7a697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:11.733015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff0fec-9198-4eef-b877-3f57cfc7a697 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:11.733015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff0fec-9198-4eef-b877-3f57cfc7a697 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:11.733015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff0fec-9198-4eef-b877-3f57cfc7a697 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:11.733767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff0fec-9198-4eef-b877-3f57cfc7a697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:11.735858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff0fec-9198-4eef-b877-3f57cfc7a697 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:11.736219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a96352-0d59-4eef-932d-44c31c516709 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:11.746463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90ed72-a4f1-4d2a-9760-33d16b6b357b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:11.747165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90ed72-a4f1-4d2a-9760-33d16b6b357b admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:11.747487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90ed72-a4f1-4d2a-9760-33d16b6b357b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:11.747838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90ed72-a4f1-4d2a-9760-33d16b6b357b admin admin] PATH_INFO: `/v3/projects/6fa55292536246a38655d3f6fb016d40/users/1be151c3a6eb414dbac1203bb0544c6f/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:11.773942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90ed72-a4f1-4d2a-9760-33d16b6b357b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa55292536246a38655d3f6fb016d40, user_id=1be151c3a6eb414dbac1203bb0544c6f, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:11.778403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90ed72-a4f1-4d2a-9760-33d16b6b357b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:11.781474 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3798/7546] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:11 2022] POST /identity/v3/projects => generated 369 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:11.782568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff0fec-9198-4eef-b877-3f57cfc7a697 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:11.785012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f1ff0fec-9198-4eef-b877-3f57cfc7a697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:11.808815 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3749/7547] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:11 2022] PUT /identity/v3/projects/6fa55292536246a38655d3f6fb016d40/users/1be151c3a6eb414dbac1203bb0544c6f/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:11.811885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90ed72-a4f1-4d2a-9760-33d16b6b357b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:11.848316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:11.916999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff0fec-9198-4eef-b877-3f57cfc7a697 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:11.957748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90ed72-a4f1-4d2a-9760-33d16b6b357b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:11.966912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76fb43-c76d-4d6c-bc49-c97eea6df3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:11.967640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76fb43-c76d-4d6c-bc49-c97eea6df3df admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:11.968039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76fb43-c76d-4d6c-bc49-c97eea6df3df admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:11.968447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76fb43-c76d-4d6c-bc49-c97eea6df3df admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:11.969225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76fb43-c76d-4d6c-bc49-c97eea6df3df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:11.971610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76fb43-c76d-4d6c-bc49-c97eea6df3df admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:12.019544 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3750/7548] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:11 2022] POST /identity/v3/users => generated 285 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:12.021266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ba342-a451-4922-a31c-a2d163ebfe57 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:12.021789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ba342-a451-4922-a31c-a2d163ebfe57 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:12.023720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ba342-a451-4922-a31c-a2d163ebfe57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:12.061579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb763ca-5ebe-495f-8f71-678f64d0d110 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:12.062227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb763ca-5ebe-495f-8f71-678f64d0d110 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:12.062513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb763ca-5ebe-495f-8f71-678f64d0d110 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:12.062792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb763ca-5ebe-495f-8f71-678f64d0d110 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:12.072650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-311ba342-a451-4922-a31c-a2d163ebfe57 None None] MFA Rules not processed for user `1be151c3a6eb414dbac1203bb0544c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:12.073905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-311ba342-a451-4922-a31c-a2d163ebfe57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:12.077715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:12.178544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb763ca-5ebe-495f-8f71-678f64d0d110 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:12.180560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb763ca-5ebe-495f-8f71-678f64d0d110 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:12.191500 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3799/7549] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:30:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:30:12.192864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb763ca-5ebe-495f-8f71-678f64d0d110 service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:12.211111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb763ca-5ebe-495f-8f71-678f64d0d110 service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:12.222443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5b913-d895-40ab-b0ba-2cea836cae84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:12.223138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5b913-d895-40ab-b0ba-2cea836cae84 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:12.223577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5b913-d895-40ab-b0ba-2cea836cae84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:12.223877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5b913-d895-40ab-b0ba-2cea836cae84 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:12.224595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5b913-d895-40ab-b0ba-2cea836cae84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:12.229303 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3751/7550] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:12 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:12.229463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5b913-d895-40ab-b0ba-2cea836cae84 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:12.230774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ba342-a451-4922-a31c-a2d163ebfe57 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:12.249630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ba342-a451-4922-a31c-a2d163ebfe57 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:12.272135 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3800/7551] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:12.276009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5b913-d895-40ab-b0ba-2cea836cae84 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:12.283926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d679ef9-04e9-4590-bd05-84bf4d5e364c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:12.285082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d679ef9-04e9-4590-bd05-84bf4d5e364c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:12.285615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d679ef9-04e9-4590-bd05-84bf4d5e364c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:12.286133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d679ef9-04e9-4590-bd05-84bf4d5e364c admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:12.287202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d679ef9-04e9-4590-bd05-84bf4d5e364c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:12.290061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d679ef9-04e9-4590-bd05-84bf4d5e364c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:12.299733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5b913-d895-40ab-b0ba-2cea836cae84 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:12.311414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6074e1-c3b5-4c63-a2d5-bf2cd1879292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:12.312143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6074e1-c3b5-4c63-a2d5-bf2cd1879292 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:12.312458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6074e1-c3b5-4c63-a2d5-bf2cd1879292 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:12.312744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6074e1-c3b5-4c63-a2d5-bf2cd1879292 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:12.313564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6074e1-c3b5-4c63-a2d5-bf2cd1879292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:12.315306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6074e1-c3b5-4c63-a2d5-bf2cd1879292 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:12.329767 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3801/7552] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:12.334940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6074e1-c3b5-4c63-a2d5-bf2cd1879292 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:12.353948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6074e1-c3b5-4c63-a2d5-bf2cd1879292 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:12.355370 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3752/7553] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:12 2022] POST /identity/v3/projects => generated 409 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:30:12.359630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d679ef9-04e9-4590-bd05-84bf4d5e364c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:12.482585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b19c63-ffee-4fbc-b8f7-d7b325d319d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:12.483361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b19c63-ffee-4fbc-b8f7-d7b325d319d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:12.483661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b19c63-ffee-4fbc-b8f7-d7b325d319d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:12.483950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b19c63-ffee-4fbc-b8f7-d7b325d319d4 admin admin] PATH_INFO: `/v3/projects/bb9506d774214db0b17e156ddb712435/users/62a906ba21fb4dd9804bcb4c85b44da9/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:12.499044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d679ef9-04e9-4590-bd05-84bf4d5e364c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:12.511631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2b197-d9d4-415c-bd30-781ced19873c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:12.512293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2b197-d9d4-415c-bd30-781ced19873c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:12.512700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2b197-d9d4-415c-bd30-781ced19873c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:12.512989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2b197-d9d4-415c-bd30-781ced19873c admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:12.513991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2b197-d9d4-415c-bd30-781ced19873c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:12.516866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2b197-d9d4-415c-bd30-781ced19873c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:12.526478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b19c63-ffee-4fbc-b8f7-d7b325d319d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb9506d774214db0b17e156ddb712435, user_id=62a906ba21fb4dd9804bcb4c85b44da9, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:12.529750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:12.531169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b19c63-ffee-4fbc-b8f7-d7b325d319d4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:12.560244 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3802/7554] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:12 2022] PUT /identity/v3/projects/bb9506d774214db0b17e156ddb712435/users/62a906ba21fb4dd9804bcb4c85b44da9/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:12.572863 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3753/7555] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:12 2022] POST /identity/v3/users => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:30:12.576842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c08ab-2fb9-40cc-8b7f-f68d04ad74c2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:12.577147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c08ab-2fb9-40cc-8b7f-f68d04ad74c2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:12.577555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c08ab-2fb9-40cc-8b7f-f68d04ad74c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:12.577927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2b197-d9d4-415c-bd30-781ced19873c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:12.590919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2b197-d9d4-415c-bd30-781ced19873c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:12.655416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-426c08ab-2fb9-40cc-8b7f-f68d04ad74c2 None None] MFA Rules not processed for user `62a906ba21fb4dd9804bcb4c85b44da9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:12.658596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-426c08ab-2fb9-40cc-8b7f-f68d04ad74c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:12.684972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a83d6-7892-43e7-82ca-8950636d8a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:12.686135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a83d6-7892-43e7-82ca-8950636d8a32 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:12.687486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a83d6-7892-43e7-82ca-8950636d8a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:12.688124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a83d6-7892-43e7-82ca-8950636d8a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:12.689041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a83d6-7892-43e7-82ca-8950636d8a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:12.691376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a83d6-7892-43e7-82ca-8950636d8a32 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:12.708235 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3754/7556] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:12.713080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a29e7-78a6-4d86-aa64-e191ee4600fd None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:12.713424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a29e7-78a6-4d86-aa64-e191ee4600fd None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:12.715461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a29e7-78a6-4d86-aa64-e191ee4600fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:12.743439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-309a29e7-78a6-4d86-aa64-e191ee4600fd None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:12.745224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-309a29e7-78a6-4d86-aa64-e191ee4600fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:12.762019 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3803/7557] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:12.762583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c08ab-2fb9-40cc-8b7f-f68d04ad74c2 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:12.772867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:12.781757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c08ab-2fb9-40cc-8b7f-f68d04ad74c2 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:12.815351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8747613-00d3-4c3f-97af-2227ae417742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:12.815948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8747613-00d3-4c3f-97af-2227ae417742 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:12.816740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8747613-00d3-4c3f-97af-2227ae417742 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:12.817190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8747613-00d3-4c3f-97af-2227ae417742 admin admin] PATH_INFO: `/v3/projects/7c4cd9533d1d4fd597ccbd6d7daf8c68/users/bd433098f1984491869fd4a1423180fe/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:12.838612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8747613-00d3-4c3f-97af-2227ae417742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c4cd9533d1d4fd597ccbd6d7daf8c68, user_id=bd433098f1984491869fd4a1423180fe, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:12.842304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8747613-00d3-4c3f-97af-2227ae417742 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:12.860899 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3755/7558] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:30:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:12.872295 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3804/7559] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:12 2022] PUT /identity/v3/projects/7c4cd9533d1d4fd597ccbd6d7daf8c68/users/bd433098f1984491869fd4a1423180fe/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:12.876816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a29e7-78a6-4d86-aa64-e191ee4600fd None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:12.877065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8747613-00d3-4c3f-97af-2227ae417742 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:12.880046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-309a29e7-78a6-4d86-aa64-e191ee4600fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:12.994870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a29e7-78a6-4d86-aa64-e191ee4600fd None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:13.025251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8747613-00d3-4c3f-97af-2227ae417742 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:13.031825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717b38-804d-4d4f-b2aa-51eaa66c6858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:13.032777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717b38-804d-4d4f-b2aa-51eaa66c6858 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:13.033225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717b38-804d-4d4f-b2aa-51eaa66c6858 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:13.033843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717b38-804d-4d4f-b2aa-51eaa66c6858 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:13.034812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717b38-804d-4d4f-b2aa-51eaa66c6858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:13.037207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717b38-804d-4d4f-b2aa-51eaa66c6858 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:13.050810 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3805/7560] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:13.052077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717b38-804d-4d4f-b2aa-51eaa66c6858 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:13.085734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ff99d-22aa-4c88-a2c2-a6ac7eefdc6c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:13.087754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ff99d-22aa-4c88-a2c2-a6ac7eefdc6c service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:13.088047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ff99d-22aa-4c88-a2c2-a6ac7eefdc6c service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:13.091701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ff99d-22aa-4c88-a2c2-a6ac7eefdc6c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:13.097463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:13.176873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ff99d-22aa-4c88-a2c2-a6ac7eefdc6c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:13.183628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ff99d-22aa-4c88-a2c2-a6ac7eefdc6c service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:13.193517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717b38-804d-4d4f-b2aa-51eaa66c6858 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:13.201037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602558a-c92e-4fb8-a1b3-2885b73c63f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:13.201723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602558a-c92e-4fb8-a1b3-2885b73c63f8 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:13.202005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602558a-c92e-4fb8-a1b3-2885b73c63f8 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:13.202350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602558a-c92e-4fb8-a1b3-2885b73c63f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:13.209057 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3756/7561] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:13.211240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ff99d-22aa-4c88-a2c2-a6ac7eefdc6c service glance] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:13.238382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ff99d-22aa-4c88-a2c2-a6ac7eefdc6c service glance] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:13.245726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04535991-970d-4495-be6f-e61e12b2c4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:13.246445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04535991-970d-4495-be6f-e61e12b2c4b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:13.246957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04535991-970d-4495-be6f-e61e12b2c4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:13.247548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04535991-970d-4495-be6f-e61e12b2c4b4 admin admin] PATH_INFO: `/v3/projects/7c4cd9533d1d4fd597ccbd6d7daf8c68/users/bd433098f1984491869fd4a1423180fe/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:13.249944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04535991-970d-4495-be6f-e61e12b2c4b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c4cd9533d1d4fd597ccbd6d7daf8c68, user_id=bd433098f1984491869fd4a1423180fe, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:13.253794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04535991-970d-4495-be6f-e61e12b2c4b4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:13.280819 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3757/7562] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:13 2022] PUT /identity/v3/projects/7c4cd9533d1d4fd597ccbd6d7daf8c68/users/bd433098f1984491869fd4a1423180fe/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:13.289102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e632339-5f3f-4db4-a6b9-a6b7e9f73254 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:13.289399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e632339-5f3f-4db4-a6b9-a6b7e9f73254 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:13.289670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e632339-5f3f-4db4-a6b9-a6b7e9f73254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:13.341137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4e632339-5f3f-4db4-a6b9-a6b7e9f73254 None None] MFA Rules not processed for user `bd433098f1984491869fd4a1423180fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:13.342614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4e632339-5f3f-4db4-a6b9-a6b7e9f73254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:13.389728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602558a-c92e-4fb8-a1b3-2885b73c63f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:13.392847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602558a-c92e-4fb8-a1b3-2885b73c63f8 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:13.414520 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3806/7563] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:30:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:30:13.510683 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3758/7564] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:13 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:13.519551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602558a-c92e-4fb8-a1b3-2885b73c63f8 service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:13.522156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9602558a-c92e-4fb8-a1b3-2885b73c63f8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:13.558967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:13.643209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602558a-c92e-4fb8-a1b3-2885b73c63f8 service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:13.716687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239466a-d598-4bd3-aa19-0ecc18c6a51d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:13.717407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239466a-d598-4bd3-aa19-0ecc18c6a51d service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:13.717763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239466a-d598-4bd3-aa19-0ecc18c6a51d service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:13.718201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239466a-d598-4bd3-aa19-0ecc18c6a51d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:13.732217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239466a-d598-4bd3-aa19-0ecc18c6a51d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:13.736411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239466a-d598-4bd3-aa19-0ecc18c6a51d service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:13.755783 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3807/7565] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:13 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:14.323861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0f883-2eb8-40e2-aac4-ea4fbce02a3a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:14.324152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0f883-2eb8-40e2-aac4-ea4fbce02a3a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:14.325248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239466a-d598-4bd3-aa19-0ecc18c6a51d service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:14.326032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0f883-2eb8-40e2-aac4-ea4fbce02a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:14.330651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e239466a-d598-4bd3-aa19-0ecc18c6a51d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:14.354062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239466a-d598-4bd3-aa19-0ecc18c6a51d service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:14.361929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1a1e9-cd5c-4836-bbe9-ff691515ad07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:14.363473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1a1e9-cd5c-4836-bbe9-ff691515ad07 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:14.363473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1a1e9-cd5c-4836-bbe9-ff691515ad07 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:14.364272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1a1e9-cd5c-4836-bbe9-ff691515ad07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:14.401242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-14b0f883-2eb8-40e2-aac4-ea4fbce02a3a None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:14.402646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-14b0f883-2eb8-40e2-aac4-ea4fbce02a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:14.555117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1a1e9-cd5c-4836-bbe9-ff691515ad07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:14.558567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1a1e9-cd5c-4836-bbe9-ff691515ad07 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:14.614019 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3808/7566] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:14 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:14.621250 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3759/7567] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:30:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:14.655696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1a1e9-cd5c-4836-bbe9-ff691515ad07 service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:14.844354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1a1e9-cd5c-4836-bbe9-ff691515ad07 service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:14.852574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc521b98-950b-4c83-b65c-49cac5700e65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:14.853510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc521b98-950b-4c83-b65c-49cac5700e65 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:14.854001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc521b98-950b-4c83-b65c-49cac5700e65 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:14.854478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc521b98-950b-4c83-b65c-49cac5700e65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:14.868371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc521b98-950b-4c83-b65c-49cac5700e65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:14.871102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc521b98-950b-4c83-b65c-49cac5700e65 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:14.883666 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3809/7568] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:30:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:30:17.798175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0f883-2eb8-40e2-aac4-ea4fbce02a3a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:17.799895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-14b0f883-2eb8-40e2-aac4-ea4fbce02a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:17.828660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:17.892268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0f883-2eb8-40e2-aac4-ea4fbce02a3a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:17.899824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429514d-3be3-4c33-a418-da77b94397ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:17.901114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429514d-3be3-4c33-a418-da77b94397ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:17.901399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429514d-3be3-4c33-a418-da77b94397ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:17.901677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429514d-3be3-4c33-a418-da77b94397ad admin admin] PATH_INFO: `/v3/users/87902729a01b4918a07d61589f9c84da` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:17.903531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429514d-3be3-4c33-a418-da77b94397ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=87902729a01b4918a07d61589f9c84da)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:17.905935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429514d-3be3-4c33-a418-da77b94397ad admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:17.984875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f429514d-3be3-4c33-a418-da77b94397ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87902729a01b4918a07d61589f9c84da'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:17.985698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f429514d-3be3-4c33-a418-da77b94397ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87902729a01b4918a07d61589f9c84da'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:18.027696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f429514d-3be3-4c33-a418-da77b94397ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87902729a01b4918a07d61589f9c84da'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:18.028468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f429514d-3be3-4c33-a418-da77b94397ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87902729a01b4918a07d61589f9c84da'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:18.038515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f429514d-3be3-4c33-a418-da77b94397ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87902729a01b4918a07d61589f9c84da'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:18.056061 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3760/7569] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:30:17 2022] DELETE /identity/v3/users/87902729a01b4918a07d61589f9c84da => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:18.060949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42356d90-39ad-49d5-a4c5-1d529de9e49e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:18.061421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42356d90-39ad-49d5-a4c5-1d529de9e49e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:18.061635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42356d90-39ad-49d5-a4c5-1d529de9e49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:18.070660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:18.084212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-42356d90-39ad-49d5-a4c5-1d529de9e49e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:18.085422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-42356d90-39ad-49d5-a4c5-1d529de9e49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:18.171432 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3810/7570] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:18.179081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429514d-3be3-4c33-a418-da77b94397ad admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:18.180632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f429514d-3be3-4c33-a418-da77b94397ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:18.252696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429514d-3be3-4c33-a418-da77b94397ad admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:18.258373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434990ff-f489-4d7b-b14d-37cb32170a6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:18.260181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434990ff-f489-4d7b-b14d-37cb32170a6b service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:18.260661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434990ff-f489-4d7b-b14d-37cb32170a6b service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:18.260941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434990ff-f489-4d7b-b14d-37cb32170a6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:18.275617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434990ff-f489-4d7b-b14d-37cb32170a6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:18.277102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434990ff-f489-4d7b-b14d-37cb32170a6b service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:18.293876 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3761/7571] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:18.518270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42356d90-39ad-49d5-a4c5-1d529de9e49e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:18.519764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-42356d90-39ad-49d5-a4c5-1d529de9e49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:18.537100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42356d90-39ad-49d5-a4c5-1d529de9e49e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:18.542404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc975850-972c-4a10-abd9-5da71ff984ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:18.543071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc975850-972c-4a10-abd9-5da71ff984ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:18.543643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc975850-972c-4a10-abd9-5da71ff984ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:18.543932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc975850-972c-4a10-abd9-5da71ff984ca admin admin] PATH_INFO: `/v3/projects/2430c3036ed74cea9b3d1a20b61f780e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:18.545192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc975850-972c-4a10-abd9-5da71ff984ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=2430c3036ed74cea9b3d1a20b61f780e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:18.547105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc975850-972c-4a10-abd9-5da71ff984ca admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:18.682108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dc975850-972c-4a10-abd9-5da71ff984ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2430c3036ed74cea9b3d1a20b61f780e', 'request_id': 'req-dc975850-972c-4a10-abd9-5da71ff984ca'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:18.695025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dc975850-972c-4a10-abd9-5da71ff984ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2430c3036ed74cea9b3d1a20b61f780e', 'request_id': 'req-dc975850-972c-4a10-abd9-5da71ff984ca'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:18.710367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dc975850-972c-4a10-abd9-5da71ff984ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2430c3036ed74cea9b3d1a20b61f780e', 'request_id': 'req-dc975850-972c-4a10-abd9-5da71ff984ca'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:18.727281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dc975850-972c-4a10-abd9-5da71ff984ca admin admin] The token cache is being invalidate because project 2430c3036ed74cea9b3d1a20b61f780e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:30:18.729720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dc975850-972c-4a10-abd9-5da71ff984ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:18.730747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dc975850-972c-4a10-abd9-5da71ff984ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:18.732766 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3811/7572] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:30:18 2022] DELETE /identity/v3/projects/2430c3036ed74cea9b3d1a20b61f780e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:30:18.738348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a0493-2e77-438f-858c-733087fd8902 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:18.738799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a0493-2e77-438f-858c-733087fd8902 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:18.740028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a0493-2e77-438f-858c-733087fd8902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:18.764636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-777a0493-2e77-438f-858c-733087fd8902 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:18.766482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-777a0493-2e77-438f-858c-733087fd8902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:18.826774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:18.857791 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3762/7573] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:18.865899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e562025-8ab9-4ebc-a087-6d5229f75864 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:18.866207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e562025-8ab9-4ebc-a087-6d5229f75864 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:18.866496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e562025-8ab9-4ebc-a087-6d5229f75864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:18.886752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5e562025-8ab9-4ebc-a087-6d5229f75864 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:18.888019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5e562025-8ab9-4ebc-a087-6d5229f75864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:18.896654 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3812/7574] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:18.901546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a0493-2e77-438f-858c-733087fd8902 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:18.926138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a0493-2e77-438f-858c-733087fd8902 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:18.930808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49176b48-1e7e-4b2c-97d7-0480ff2f4553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:18.931542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49176b48-1e7e-4b2c-97d7-0480ff2f4553 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:18.931847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49176b48-1e7e-4b2c-97d7-0480ff2f4553 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:18.932145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49176b48-1e7e-4b2c-97d7-0480ff2f4553 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:18.932847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49176b48-1e7e-4b2c-97d7-0480ff2f4553 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:30:18.933274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49176b48-1e7e-4b2c-97d7-0480ff2f4553 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:18.934875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49176b48-1e7e-4b2c-97d7-0480ff2f4553 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:18.947781 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3763/7575] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:30:18.952401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e562025-8ab9-4ebc-a087-6d5229f75864 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:18.964514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e562025-8ab9-4ebc-a087-6d5229f75864 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:18.979167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cafdee-1a76-4ef3-becb-2a55a0df914a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:18.980706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cafdee-1a76-4ef3-becb-2a55a0df914a admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:18.981228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cafdee-1a76-4ef3-becb-2a55a0df914a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:18.981745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cafdee-1a76-4ef3-becb-2a55a0df914a admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:18.982496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cafdee-1a76-4ef3-becb-2a55a0df914a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:18.985732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cafdee-1a76-4ef3-becb-2a55a0df914a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:19.051553 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3813/7576] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:18 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:19.053501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49176b48-1e7e-4b2c-97d7-0480ff2f4553 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:19.065371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49176b48-1e7e-4b2c-97d7-0480ff2f4553 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:19.135115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f2366-98c7-4603-b049-7d5a5855110d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:19.136014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f2366-98c7-4603-b049-7d5a5855110d admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:19.136427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f2366-98c7-4603-b049-7d5a5855110d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:19.136820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f2366-98c7-4603-b049-7d5a5855110d admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:19.137690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f2366-98c7-4603-b049-7d5a5855110d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:19.141456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f2366-98c7-4603-b049-7d5a5855110d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:19.166794 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3764/7577] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:19 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:19.170975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cafdee-1a76-4ef3-becb-2a55a0df914a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:19.182559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cafdee-1a76-4ef3-becb-2a55a0df914a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:19.187479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b8eea-53e6-44cc-9b64-95839b2e9e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:19.188132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b8eea-53e6-44cc-9b64-95839b2e9e3a admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:19.188427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b8eea-53e6-44cc-9b64-95839b2e9e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:19.188771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b8eea-53e6-44cc-9b64-95839b2e9e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:19.189521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b8eea-53e6-44cc-9b64-95839b2e9e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:19.191331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b8eea-53e6-44cc-9b64-95839b2e9e3a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:19.202320 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3814/7578] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:19.206365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f2366-98c7-4603-b049-7d5a5855110d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:19.217419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f2366-98c7-4603-b049-7d5a5855110d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:19.222098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb567c1-64ca-46e5-9869-966a35f1e31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:19.222712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb567c1-64ca-46e5-9869-966a35f1e31f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:19.222996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb567c1-64ca-46e5-9869-966a35f1e31f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:19.223279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb567c1-64ca-46e5-9869-966a35f1e31f admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:19.224019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb567c1-64ca-46e5-9869-966a35f1e31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:19.225625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb567c1-64ca-46e5-9869-966a35f1e31f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:19.236625 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3765/7579] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:30:19.240897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b8eea-53e6-44cc-9b64-95839b2e9e3a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:19.251014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b8eea-53e6-44cc-9b64-95839b2e9e3a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:19.256157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7c8bc-ec7f-4d6c-bf13-8d6e7d940f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:19.256821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7c8bc-ec7f-4d6c-bf13-8d6e7d940f01 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:19.257106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7c8bc-ec7f-4d6c-bf13-8d6e7d940f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:19.257390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7c8bc-ec7f-4d6c-bf13-8d6e7d940f01 admin admin] PATH_INFO: `/v3/projects/434fef0893984988a8acc8b251efdddc/users/67db2c00c71f469f9a7a871ed28e97e4/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:19.272358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7c8bc-ec7f-4d6c-bf13-8d6e7d940f01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=434fef0893984988a8acc8b251efdddc, user_id=67db2c00c71f469f9a7a871ed28e97e4, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:19.275677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7c8bc-ec7f-4d6c-bf13-8d6e7d940f01 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:19.288087 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3815/7580] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:19 2022] PUT /identity/v3/projects/434fef0893984988a8acc8b251efdddc/users/67db2c00c71f469f9a7a871ed28e97e4/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:19.299252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7bd86-decf-4285-98be-0c74641565ec None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:19.299577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7bd86-decf-4285-98be-0c74641565ec None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:19.299852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7bd86-decf-4285-98be-0c74641565ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:19.329272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-52b7bd86-decf-4285-98be-0c74641565ec None None] MFA Rules not processed for user `67db2c00c71f469f9a7a871ed28e97e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:19.330472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-52b7bd86-decf-4285-98be-0c74641565ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:19.395928 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3766/7581] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:19.400957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7c8bc-ec7f-4d6c-bf13-8d6e7d940f01 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:19.427265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:19.463334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7c8bc-ec7f-4d6c-bf13-8d6e7d940f01 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:19.468076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61147547-69fc-433b-92b8-b0aa0f71d0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:19.468691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61147547-69fc-433b-92b8-b0aa0f71d0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:19.468981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61147547-69fc-433b-92b8-b0aa0f71d0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:19.469255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61147547-69fc-433b-92b8-b0aa0f71d0d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:19.469922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61147547-69fc-433b-92b8-b0aa0f71d0d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:19.471843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61147547-69fc-433b-92b8-b0aa0f71d0d0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:19.498261 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3816/7582] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:19 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:19.502544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7bd86-decf-4285-98be-0c74641565ec None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:19.513889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7bd86-decf-4285-98be-0c74641565ec None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:19.563026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:19.582406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0f32b-c6ac-4eac-97db-404e919d1e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:19.583033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0f32b-c6ac-4eac-97db-404e919d1e75 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:19.583342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0f32b-c6ac-4eac-97db-404e919d1e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:19.583627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0f32b-c6ac-4eac-97db-404e919d1e75 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:19.584319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0f32b-c6ac-4eac-97db-404e919d1e75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:19.586232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0f32b-c6ac-4eac-97db-404e919d1e75 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:19.610660 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3767/7583] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:19 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:19.611926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61147547-69fc-433b-92b8-b0aa0f71d0d0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:19.624162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61147547-69fc-433b-92b8-b0aa0f71d0d0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:19.629129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236ff65-5ad2-4c12-a42f-ccba402e105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:19.629862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236ff65-5ad2-4c12-a42f-ccba402e105c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:19.630065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236ff65-5ad2-4c12-a42f-ccba402e105c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:19.630370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236ff65-5ad2-4c12-a42f-ccba402e105c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:19.631072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236ff65-5ad2-4c12-a42f-ccba402e105c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:19.632710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236ff65-5ad2-4c12-a42f-ccba402e105c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:19.644774 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3817/7584] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:19.648910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0f32b-c6ac-4eac-97db-404e919d1e75 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:19.663409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0f32b-c6ac-4eac-97db-404e919d1e75 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:19.679080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19daea18-7731-4767-9484-cbe089014d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:19.679717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daea18-7731-4767-9484-cbe089014d20 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:19.680068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daea18-7731-4767-9484-cbe089014d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:19.680326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daea18-7731-4767-9484-cbe089014d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:19.681592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19daea18-7731-4767-9484-cbe089014d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:19.683869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19daea18-7731-4767-9484-cbe089014d20 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:19.703226 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3768/7585] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:30:19.705044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236ff65-5ad2-4c12-a42f-ccba402e105c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:19.719211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236ff65-5ad2-4c12-a42f-ccba402e105c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:19.728744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1bb75-9dd3-4213-8ce3-3edfad311924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:19.728744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1bb75-9dd3-4213-8ce3-3edfad311924 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:19.729019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1bb75-9dd3-4213-8ce3-3edfad311924 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:19.729462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1bb75-9dd3-4213-8ce3-3edfad311924 admin admin] PATH_INFO: `/v3/projects/85381edb39e54fc9977cee9aeeaa729a/users/9fcfa607bc8e45a483a4099f2e48160d/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:19.755425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1bb75-9dd3-4213-8ce3-3edfad311924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85381edb39e54fc9977cee9aeeaa729a, user_id=9fcfa607bc8e45a483a4099f2e48160d, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:19.759970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1bb75-9dd3-4213-8ce3-3edfad311924 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:19.779457 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3818/7586] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:19 2022] PUT /identity/v3/projects/85381edb39e54fc9977cee9aeeaa729a/users/9fcfa607bc8e45a483a4099f2e48160d/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:19.792299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1f7b2-609f-4c6f-9a30-54368badcd53 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:19.792712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1f7b2-609f-4c6f-9a30-54368badcd53 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:19.793075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1f7b2-609f-4c6f-9a30-54368badcd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:19.835810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-81e1f7b2-609f-4c6f-9a30-54368badcd53 None None] MFA Rules not processed for user `9fcfa607bc8e45a483a4099f2e48160d`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:19.837221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-81e1f7b2-609f-4c6f-9a30-54368badcd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:19.935171 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3769/7587] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:30:19.940061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1bb75-9dd3-4213-8ce3-3edfad311924 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:20.024500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1bb75-9dd3-4213-8ce3-3edfad311924 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:20.029549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdc6ef-34c0-4701-9de5-ee0ef4e3ab5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:20.030172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdc6ef-34c0-4701-9de5-ee0ef4e3ab5a admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:20.030556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdc6ef-34c0-4701-9de5-ee0ef4e3ab5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:20.030832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdc6ef-34c0-4701-9de5-ee0ef4e3ab5a admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:20.031527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdc6ef-34c0-4701-9de5-ee0ef4e3ab5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:20.033535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdc6ef-34c0-4701-9de5-ee0ef4e3ab5a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:20.083476 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3819/7588] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:19 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:20.087408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1f7b2-609f-4c6f-9a30-54368badcd53 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:20.105995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1f7b2-609f-4c6f-9a30-54368badcd53 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:20.225093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb7373-f7c2-4f8a-b157-561ef319b341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:20.225948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb7373-f7c2-4f8a-b157-561ef319b341 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:20.226241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb7373-f7c2-4f8a-b157-561ef319b341 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:20.226615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb7373-f7c2-4f8a-b157-561ef319b341 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:20.227772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb7373-f7c2-4f8a-b157-561ef319b341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:20.230670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb7373-f7c2-4f8a-b157-561ef319b341 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:20.257756 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3770/7589] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:20 2022] POST /identity/v3/users => generated 300 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:20.261731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdc6ef-34c0-4701-9de5-ee0ef4e3ab5a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:20.273389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdc6ef-34c0-4701-9de5-ee0ef4e3ab5a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:20.279227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a0182-1477-4c79-a5ac-aa78ef040f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:20.280089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a0182-1477-4c79-a5ac-aa78ef040f9a admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:20.280374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a0182-1477-4c79-a5ac-aa78ef040f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:20.280835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a0182-1477-4c79-a5ac-aa78ef040f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:20.281699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a0182-1477-4c79-a5ac-aa78ef040f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:20.283317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a0182-1477-4c79-a5ac-aa78ef040f9a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:20.300111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb7373-f7c2-4f8a-b157-561ef319b341 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:20.300619 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3820/7590] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:20.313180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb7373-f7c2-4f8a-b157-561ef319b341 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:20.318064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22af7ee-0b50-4496-823c-f34e60611e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:20.318736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22af7ee-0b50-4496-823c-f34e60611e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:20.319021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22af7ee-0b50-4496-823c-f34e60611e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:20.319349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22af7ee-0b50-4496-823c-f34e60611e52 admin admin] PATH_INFO: `/v3/projects/e57eb754cf0946b7a7da09e866b696ca/users/19f50b9cc06f4bb690cbc51420c17529/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:20.335996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22af7ee-0b50-4496-823c-f34e60611e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e57eb754cf0946b7a7da09e866b696ca, user_id=19f50b9cc06f4bb690cbc51420c17529, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:20.339249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22af7ee-0b50-4496-823c-f34e60611e52 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:20.353782 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3771/7591] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:20 2022] PUT /identity/v3/projects/e57eb754cf0946b7a7da09e866b696ca/users/19f50b9cc06f4bb690cbc51420c17529/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:20.358086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a0182-1477-4c79-a5ac-aa78ef040f9a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:20.369022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a0182-1477-4c79-a5ac-aa78ef040f9a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:20.419111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:20.435754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e37b8-59ad-45c1-b456-7094edc289f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:20.436316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e37b8-59ad-45c1-b456-7094edc289f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:20.436607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e37b8-59ad-45c1-b456-7094edc289f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:20.436889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e37b8-59ad-45c1-b456-7094edc289f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:20.437596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e37b8-59ad-45c1-b456-7094edc289f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:20.439338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e37b8-59ad-45c1-b456-7094edc289f1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:20.459825 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3821/7592] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:30:20.464609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22af7ee-0b50-4496-823c-f34e60611e52 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:20.480206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22af7ee-0b50-4496-823c-f34e60611e52 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:20.499649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcee453-e894-4c7e-b829-3b0ce1b597f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:20.500461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcee453-e894-4c7e-b829-3b0ce1b597f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:20.500861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcee453-e894-4c7e-b829-3b0ce1b597f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:20.503652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcee453-e894-4c7e-b829-3b0ce1b597f6 admin admin] PATH_INFO: `/v3/projects/e57eb754cf0946b7a7da09e866b696ca/users/19f50b9cc06f4bb690cbc51420c17529/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:20.505779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcee453-e894-4c7e-b829-3b0ce1b597f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e57eb754cf0946b7a7da09e866b696ca, user_id=19f50b9cc06f4bb690cbc51420c17529, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:20.508609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcee453-e894-4c7e-b829-3b0ce1b597f6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:20.517539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:20.527357 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3772/7593] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:20 2022] PUT /identity/v3/projects/e57eb754cf0946b7a7da09e866b696ca/users/19f50b9cc06f4bb690cbc51420c17529/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:20.537657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389ab43-dc62-4d9a-8798-3b0daa9bcc9b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:20.538079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389ab43-dc62-4d9a-8798-3b0daa9bcc9b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:20.538462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389ab43-dc62-4d9a-8798-3b0daa9bcc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:20.571568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c389ab43-dc62-4d9a-8798-3b0daa9bcc9b None None] MFA Rules not processed for user `19f50b9cc06f4bb690cbc51420c17529`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:20.573616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c389ab43-dc62-4d9a-8798-3b0daa9bcc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:20.652536 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3822/7594] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:20.669086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcee453-e894-4c7e-b829-3b0ce1b597f6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:20.671091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bdcee453-e894-4c7e-b829-3b0ce1b597f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:20.797182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcee453-e894-4c7e-b829-3b0ce1b597f6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:20.807218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa2135-17d7-4807-8f47-e2ecb0f18e06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:20.808110 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa2135-17d7-4807-8f47-e2ecb0f18e06 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:20.808725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa2135-17d7-4807-8f47-e2ecb0f18e06 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:20.809183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa2135-17d7-4807-8f47-e2ecb0f18e06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:20.885184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa2135-17d7-4807-8f47-e2ecb0f18e06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:20.887372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa2135-17d7-4807-8f47-e2ecb0f18e06 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:20.896389 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3773/7595] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:30:22.482403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389ab43-dc62-4d9a-8798-3b0daa9bcc9b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:22.484489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c389ab43-dc62-4d9a-8798-3b0daa9bcc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:22.581896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389ab43-dc62-4d9a-8798-3b0daa9bcc9b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:22.588113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f32be1-dd37-4d81-abba-dc343f148f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:22.588771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f32be1-dd37-4d81-abba-dc343f148f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:22.589059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f32be1-dd37-4d81-abba-dc343f148f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:22.589340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f32be1-dd37-4d81-abba-dc343f148f90 admin admin] PATH_INFO: `/v3/users/1be151c3a6eb414dbac1203bb0544c6f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:22.590526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f32be1-dd37-4d81-abba-dc343f148f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be151c3a6eb414dbac1203bb0544c6f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:22.593029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f32be1-dd37-4d81-abba-dc343f148f90 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:22.654999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-89f32be1-dd37-4d81-abba-dc343f148f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be151c3a6eb414dbac1203bb0544c6f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:22.672526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:22.677159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-89f32be1-dd37-4d81-abba-dc343f148f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be151c3a6eb414dbac1203bb0544c6f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:22.678161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-89f32be1-dd37-4d81-abba-dc343f148f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be151c3a6eb414dbac1203bb0544c6f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:22.688337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-89f32be1-dd37-4d81-abba-dc343f148f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be151c3a6eb414dbac1203bb0544c6f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:22.689226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-89f32be1-dd37-4d81-abba-dc343f148f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be151c3a6eb414dbac1203bb0544c6f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:22.713317 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3823/7596] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:30:22 2022] DELETE /identity/v3/users/1be151c3a6eb414dbac1203bb0544c6f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:22.717189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f9f60-9049-45f1-bf8e-bd60db149212 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:22.717695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f9f60-9049-45f1-bf8e-bd60db149212 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:22.717989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f9f60-9049-45f1-bf8e-bd60db149212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:22.738151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-678f9f60-9049-45f1-bf8e-bd60db149212 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:22.739753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-678f9f60-9049-45f1-bf8e-bd60db149212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:22.830258 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3774/7597] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:22.842281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f32be1-dd37-4d81-abba-dc343f148f90 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:22.844488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-89f32be1-dd37-4d81-abba-dc343f148f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:22.924524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f32be1-dd37-4d81-abba-dc343f148f90 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:22.928468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc219e82-e9d0-4b3f-bf88-c2cc8bd18d04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:22.929102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc219e82-e9d0-4b3f-bf88-c2cc8bd18d04 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:22.929559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc219e82-e9d0-4b3f-bf88-c2cc8bd18d04 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:22.929709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc219e82-e9d0-4b3f-bf88-c2cc8bd18d04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:22.942042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc219e82-e9d0-4b3f-bf88-c2cc8bd18d04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:22.943496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc219e82-e9d0-4b3f-bf88-c2cc8bd18d04 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:22.956257 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3824/7598] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:23.483756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f9f60-9049-45f1-bf8e-bd60db149212 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:23.487224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-678f9f60-9049-45f1-bf8e-bd60db149212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:23.503844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f9f60-9049-45f1-bf8e-bd60db149212 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:23.511821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eeb89f-149d-44cb-9b55-621b561933b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:23.512673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eeb89f-149d-44cb-9b55-621b561933b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:23.513066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eeb89f-149d-44cb-9b55-621b561933b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:23.513450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eeb89f-149d-44cb-9b55-621b561933b7 admin admin] PATH_INFO: `/v3/projects/6fa55292536246a38655d3f6fb016d40` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:23.515604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eeb89f-149d-44cb-9b55-621b561933b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa55292536246a38655d3f6fb016d40)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:23.519146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eeb89f-149d-44cb-9b55-621b561933b7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:23.615813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:23.638510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-40eeb89f-149d-44cb-9b55-621b561933b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa55292536246a38655d3f6fb016d40', 'request_id': 'req-40eeb89f-149d-44cb-9b55-621b561933b7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:23.656315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-40eeb89f-149d-44cb-9b55-621b561933b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa55292536246a38655d3f6fb016d40', 'request_id': 'req-40eeb89f-149d-44cb-9b55-621b561933b7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:23.691483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-40eeb89f-149d-44cb-9b55-621b561933b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa55292536246a38655d3f6fb016d40', 'request_id': 'req-40eeb89f-149d-44cb-9b55-621b561933b7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:23.722837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-40eeb89f-149d-44cb-9b55-621b561933b7 admin admin] The token cache is being invalidate because project 6fa55292536246a38655d3f6fb016d40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:30:23.723829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-40eeb89f-149d-44cb-9b55-621b561933b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:23.724928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-40eeb89f-149d-44cb-9b55-621b561933b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:23.726482 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3775/7599] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:30:23 2022] DELETE /identity/v3/projects/6fa55292536246a38655d3f6fb016d40 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:23.731116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc219e82-e9d0-4b3f-bf88-c2cc8bd18d04 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:23.742472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc219e82-e9d0-4b3f-bf88-c2cc8bd18d04 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:23.814914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f901b-21ef-456b-8df3-5c134993dc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:23.815943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f901b-21ef-456b-8df3-5c134993dc21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:23.816333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f901b-21ef-456b-8df3-5c134993dc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:23.816714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f901b-21ef-456b-8df3-5c134993dc21 admin admin] PATH_INFO: `/v3/users/bd433098f1984491869fd4a1423180fe` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:23.820128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f901b-21ef-456b-8df3-5c134993dc21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd433098f1984491869fd4a1423180fe)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:23.824499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f901b-21ef-456b-8df3-5c134993dc21 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:23.916550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eeb89f-149d-44cb-9b55-621b561933b7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:23.924978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-40eeb89f-149d-44cb-9b55-621b561933b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:23.939572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b53f901b-21ef-456b-8df3-5c134993dc21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd433098f1984491869fd4a1423180fe'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:23.975487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b53f901b-21ef-456b-8df3-5c134993dc21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd433098f1984491869fd4a1423180fe'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:23.975487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b53f901b-21ef-456b-8df3-5c134993dc21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd433098f1984491869fd4a1423180fe'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:23.993740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b53f901b-21ef-456b-8df3-5c134993dc21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd433098f1984491869fd4a1423180fe'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:23.995360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b53f901b-21ef-456b-8df3-5c134993dc21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd433098f1984491869fd4a1423180fe'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:24.027617 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3825/7600] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:30:23 2022] DELETE /identity/v3/users/bd433098f1984491869fd4a1423180fe => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:30:24.038925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eeb89f-149d-44cb-9b55-621b561933b7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:24.161841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9236ec-4336-4440-a634-2a80f19dafd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:24.162856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9236ec-4336-4440-a634-2a80f19dafd1 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:24.162856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9236ec-4336-4440-a634-2a80f19dafd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:24.163082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9236ec-4336-4440-a634-2a80f19dafd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:24.165411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ca9236ec-4336-4440-a634-2a80f19dafd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:24.321153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9236ec-4336-4440-a634-2a80f19dafd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:24.324398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9236ec-4336-4440-a634-2a80f19dafd1 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:24.343627 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3776/7601] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:24.405461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f901b-21ef-456b-8df3-5c134993dc21 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:24.406934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b53f901b-21ef-456b-8df3-5c134993dc21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:24.414222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:24.553686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f901b-21ef-456b-8df3-5c134993dc21 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:24.561248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b475a-77d4-422f-857c-9a010999e501 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:24.561906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b475a-77d4-422f-857c-9a010999e501 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:24.562189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b475a-77d4-422f-857c-9a010999e501 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:24.562485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b475a-77d4-422f-857c-9a010999e501 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:24.569597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c62b475a-77d4-422f-857c-9a010999e501 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:24.594874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b475a-77d4-422f-857c-9a010999e501 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:24.597856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b475a-77d4-422f-857c-9a010999e501 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:24.625747 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3826/7602] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:24.649622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9236ec-4336-4440-a634-2a80f19dafd1 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:24.652173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ca9236ec-4336-4440-a634-2a80f19dafd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:24.709619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:24.842758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9236ec-4336-4440-a634-2a80f19dafd1 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:24.860666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21c699-11a1-4504-8d8a-3803d5472ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:24.861355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21c699-11a1-4504-8d8a-3803d5472ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:24.861658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21c699-11a1-4504-8d8a-3803d5472ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:24.861926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21c699-11a1-4504-8d8a-3803d5472ec4 admin admin] PATH_INFO: `/v3/projects/7c4cd9533d1d4fd597ccbd6d7daf8c68` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:24.863153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21c699-11a1-4504-8d8a-3803d5472ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c4cd9533d1d4fd597ccbd6d7daf8c68)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:24.870006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21c699-11a1-4504-8d8a-3803d5472ec4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:24.973592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0a21c699-11a1-4504-8d8a-3803d5472ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c4cd9533d1d4fd597ccbd6d7daf8c68', 'request_id': 'req-0a21c699-11a1-4504-8d8a-3803d5472ec4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:24.997501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0a21c699-11a1-4504-8d8a-3803d5472ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c4cd9533d1d4fd597ccbd6d7daf8c68', 'request_id': 'req-0a21c699-11a1-4504-8d8a-3803d5472ec4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:25.006392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0a21c699-11a1-4504-8d8a-3803d5472ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c4cd9533d1d4fd597ccbd6d7daf8c68', 'request_id': 'req-0a21c699-11a1-4504-8d8a-3803d5472ec4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:25.028597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b475a-77d4-422f-857c-9a010999e501 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:25.030119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c62b475a-77d4-422f-857c-9a010999e501 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:25.033194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0a21c699-11a1-4504-8d8a-3803d5472ec4 admin admin] The token cache is being invalidate because project 7c4cd9533d1d4fd597ccbd6d7daf8c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:30:25.034708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0a21c699-11a1-4504-8d8a-3803d5472ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:25.036619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0a21c699-11a1-4504-8d8a-3803d5472ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:25.048682 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3777/7603] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:30:24 2022] DELETE /identity/v3/projects/7c4cd9533d1d4fd597ccbd6d7daf8c68 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:25.049083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b475a-77d4-422f-857c-9a010999e501 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:25.050450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6784d-def2-430e-b517-77cb4e72d9b2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:25.050854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6784d-def2-430e-b517-77cb4e72d9b2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:25.051244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6784d-def2-430e-b517-77cb4e72d9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:25.113611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fcb6784d-def2-430e-b517-77cb4e72d9b2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:25.119690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fcb6784d-def2-430e-b517-77cb4e72d9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:25.214624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdff7a5-237f-46c0-aec8-bd47b80b60b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:25.215269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdff7a5-237f-46c0-aec8-bd47b80b60b9 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:25.215581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdff7a5-237f-46c0-aec8-bd47b80b60b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:25.215956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdff7a5-237f-46c0-aec8-bd47b80b60b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:25.233791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0cdff7a5-237f-46c0-aec8-bd47b80b60b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:25.265921 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3778/7604] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:25.270913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdff7a5-237f-46c0-aec8-bd47b80b60b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:25.272924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdff7a5-237f-46c0-aec8-bd47b80b60b9 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:25.275123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61385235-18db-4c20-b7ad-302e3153fdfc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:25.275994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61385235-18db-4c20-b7ad-302e3153fdfc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:25.276175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61385235-18db-4c20-b7ad-302e3153fdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:25.301887 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3827/7605] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:30:25.318495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-61385235-18db-4c20-b7ad-302e3153fdfc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:25.321021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-61385235-18db-4c20-b7ad-302e3153fdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:25.341423 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3779/7606] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:25.345435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdff7a5-237f-46c0-aec8-bd47b80b60b9 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:25.374582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdff7a5-237f-46c0-aec8-bd47b80b60b9 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:25.381075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc7c6c-7197-423a-bc4a-856dc437926c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:25.381957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc7c6c-7197-423a-bc4a-856dc437926c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:25.382410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc7c6c-7197-423a-bc4a-856dc437926c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:25.383644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc7c6c-7197-423a-bc4a-856dc437926c admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:25.385037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc7c6c-7197-423a-bc4a-856dc437926c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:30:25.385796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc7c6c-7197-423a-bc4a-856dc437926c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:25.387614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc7c6c-7197-423a-bc4a-856dc437926c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:25.406496 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3828/7607] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:30:25.410888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61385235-18db-4c20-b7ad-302e3153fdfc None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:25.421668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61385235-18db-4c20-b7ad-302e3153fdfc None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:25.430011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47414c-244c-43ba-afed-c88270e2ce37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:25.430830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47414c-244c-43ba-afed-c88270e2ce37 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:25.431814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47414c-244c-43ba-afed-c88270e2ce37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:25.432197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47414c-244c-43ba-afed-c88270e2ce37 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:25.432990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47414c-244c-43ba-afed-c88270e2ce37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:25.435404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47414c-244c-43ba-afed-c88270e2ce37 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:25.503658 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3780/7608] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:25 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:25.512057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc7c6c-7197-423a-bc4a-856dc437926c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:25.528889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc7c6c-7197-423a-bc4a-856dc437926c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:25.603694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb962b4c-9630-44ea-a887-d3c141a86361 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:25.604239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb962b4c-9630-44ea-a887-d3c141a86361 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:25.604753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb962b4c-9630-44ea-a887-d3c141a86361 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:25.606871 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3781/7609] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:30:25.613748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11011745-b73a-4e1e-bdea-abd8953b420d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:25.615668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11011745-b73a-4e1e-bdea-abd8953b420d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:25.616133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11011745-b73a-4e1e-bdea-abd8953b420d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:25.667333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a2c00-ba14-483a-8443-aaf1bb90469b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:25.668194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a2c00-ba14-483a-8443-aaf1bb90469b admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:25.671027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a2c00-ba14-483a-8443-aaf1bb90469b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:25.671451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a2c00-ba14-483a-8443-aaf1bb90469b admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:25.672410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a2c00-ba14-483a-8443-aaf1bb90469b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:25.677253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a2c00-ba14-483a-8443-aaf1bb90469b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:25.701665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:25.711108 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3829/7610] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:25 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:25.712761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a2c00-ba14-483a-8443-aaf1bb90469b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:25.713022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-11011745-b73a-4e1e-bdea-abd8953b420d None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:25.714817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-11011745-b73a-4e1e-bdea-abd8953b420d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:25.727135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a2c00-ba14-483a-8443-aaf1bb90469b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:25.738917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41319bb0-a5e4-4769-a3b3-b5fec8ea1031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:25.740439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41319bb0-a5e4-4769-a3b3-b5fec8ea1031 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:25.740876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41319bb0-a5e4-4769-a3b3-b5fec8ea1031 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:25.741305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41319bb0-a5e4-4769-a3b3-b5fec8ea1031 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:25.742307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41319bb0-a5e4-4769-a3b3-b5fec8ea1031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:25.745131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41319bb0-a5e4-4769-a3b3-b5fec8ea1031 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:25.753343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:25.765596 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3830/7611] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:25.767006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41319bb0-a5e4-4769-a3b3-b5fec8ea1031 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:25.785452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41319bb0-a5e4-4769-a3b3-b5fec8ea1031 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:25.791909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4cc3a-b6c7-486f-850c-a048d025080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:25.792690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4cc3a-b6c7-486f-850c-a048d025080a admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:25.793282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4cc3a-b6c7-486f-850c-a048d025080a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:25.794973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4cc3a-b6c7-486f-850c-a048d025080a admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:25.795845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4cc3a-b6c7-486f-850c-a048d025080a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:25.797834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4cc3a-b6c7-486f-850c-a048d025080a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:25.812952 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3831/7612] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:25.814337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4cc3a-b6c7-486f-850c-a048d025080a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:25.845930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4cc3a-b6c7-486f-850c-a048d025080a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:25.858983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8d995-4c9b-49c9-8260-bff71966652b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:25.859796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8d995-4c9b-49c9-8260-bff71966652b admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:25.860095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8d995-4c9b-49c9-8260-bff71966652b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:25.860381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8d995-4c9b-49c9-8260-bff71966652b admin admin] PATH_INFO: `/v3/projects/3bc0690c1f03443baec18ff0fdff5065/users/5a86308d657245d59368660e48d8a4ed/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:25.868255 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3782/7613] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:30:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:30:25.881072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8d995-4c9b-49c9-8260-bff71966652b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bc0690c1f03443baec18ff0fdff5065, user_id=5a86308d657245d59368660e48d8a4ed, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:25.883974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8d995-4c9b-49c9-8260-bff71966652b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:25.899943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11011745-b73a-4e1e-bdea-abd8953b420d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:25.901750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-11011745-b73a-4e1e-bdea-abd8953b420d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:25.909420 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3832/7614] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:25 2022] PUT /identity/v3/projects/3bc0690c1f03443baec18ff0fdff5065/users/5a86308d657245d59368660e48d8a4ed/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:25.920207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3735f1-a88c-4f52-959a-272c8398200b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:25.920504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3735f1-a88c-4f52-959a-272c8398200b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:25.921011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3735f1-a88c-4f52-959a-272c8398200b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:25.923475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11011745-b73a-4e1e-bdea-abd8953b420d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:25.988768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-da3735f1-a88c-4f52-959a-272c8398200b None None] MFA Rules not processed for user `5a86308d657245d59368660e48d8a4ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:25.992788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-da3735f1-a88c-4f52-959a-272c8398200b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:26.064444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17d033-d511-4a0c-8b92-660230be27cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:26.065122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17d033-d511-4a0c-8b92-660230be27cb service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:26.066441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17d033-d511-4a0c-8b92-660230be27cb service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:26.066733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17d033-d511-4a0c-8b92-660230be27cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:26.088359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17d033-d511-4a0c-8b92-660230be27cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:26.092926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17d033-d511-4a0c-8b92-660230be27cb service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:26.110374 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3783/7615] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:26.126863 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3833/7616] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:26.131461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17d033-d511-4a0c-8b92-660230be27cb service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:26.364234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17d033-d511-4a0c-8b92-660230be27cb service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:26.375795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73808c0f-06d2-4a4f-ba63-4f9d6098e3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:26.376790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73808c0f-06d2-4a4f-ba63-4f9d6098e3b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:26.377081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73808c0f-06d2-4a4f-ba63-4f9d6098e3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:26.378931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73808c0f-06d2-4a4f-ba63-4f9d6098e3b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:26.380724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73808c0f-06d2-4a4f-ba63-4f9d6098e3b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:26.384205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73808c0f-06d2-4a4f-ba63-4f9d6098e3b3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:26.459821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3735f1-a88c-4f52-959a-272c8398200b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:26.460146 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3784/7617] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:26 2022] POST /identity/v3/projects => generated 383 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:26.496473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3735f1-a88c-4f52-959a-272c8398200b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:26.709271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73808c0f-06d2-4a4f-ba63-4f9d6098e3b3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:26.711946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-73808c0f-06d2-4a4f-ba63-4f9d6098e3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:26.766470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d04e19-ed36-4a7c-9827-db654273de69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:26.767115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d04e19-ed36-4a7c-9827-db654273de69 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:26.772178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d04e19-ed36-4a7c-9827-db654273de69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:26.772484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d04e19-ed36-4a7c-9827-db654273de69 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:26.777519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d04e19-ed36-4a7c-9827-db654273de69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:26.783018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d04e19-ed36-4a7c-9827-db654273de69 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:26.844369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:26.902571 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3834/7618] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:26 2022] POST /identity/v3/users => generated 298 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:26.906554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d04e19-ed36-4a7c-9827-db654273de69 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:26.913479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73808c0f-06d2-4a4f-ba63-4f9d6098e3b3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:26.917555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e111a-28c8-433b-baca-8c7ae241e2fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:26.918195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e111a-28c8-433b-baca-8c7ae241e2fc service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:26.918599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e111a-28c8-433b-baca-8c7ae241e2fc service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:26.918883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e111a-28c8-433b-baca-8c7ae241e2fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:26.928593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-290e111a-28c8-433b-baca-8c7ae241e2fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:26.937708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d04e19-ed36-4a7c-9827-db654273de69 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:26.954104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca05766-ba68-492b-b0e3-0aeda553d138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:26.954618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca05766-ba68-492b-b0e3-0aeda553d138 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:26.954914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca05766-ba68-492b-b0e3-0aeda553d138 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:26.955233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca05766-ba68-492b-b0e3-0aeda553d138 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:26.955938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca05766-ba68-492b-b0e3-0aeda553d138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:26.957870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca05766-ba68-492b-b0e3-0aeda553d138 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:26.983523 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3835/7619] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:26.985119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca05766-ba68-492b-b0e3-0aeda553d138 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:27.001540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca05766-ba68-492b-b0e3-0aeda553d138 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:27.007987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c15483-4393-431e-a26b-87715500e0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:27.008693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c15483-4393-431e-a26b-87715500e0a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:27.009668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c15483-4393-431e-a26b-87715500e0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:27.009955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c15483-4393-431e-a26b-87715500e0a7 admin admin] PATH_INFO: `/v3/projects/61c428a72c7b4933a957980090ec8e92/users/9d3fa39fb1804004abf6f7315bf65313/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:27.054855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c15483-4393-431e-a26b-87715500e0a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c428a72c7b4933a957980090ec8e92, user_id=9d3fa39fb1804004abf6f7315bf65313, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:27.062714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c15483-4393-431e-a26b-87715500e0a7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:27.098746 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3836/7620] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:26 2022] PUT /identity/v3/projects/61c428a72c7b4933a957980090ec8e92/users/9d3fa39fb1804004abf6f7315bf65313/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:27.102436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c15483-4393-431e-a26b-87715500e0a7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:27.129597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:27.182304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e111a-28c8-433b-baca-8c7ae241e2fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:27.190447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e111a-28c8-433b-baca-8c7ae241e2fc service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:27.220845 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3785/7621] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:27.286295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c15483-4393-431e-a26b-87715500e0a7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:27.297560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4596010-dd01-42bc-a1ea-f65d59b1790b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:27.298346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4596010-dd01-42bc-a1ea-f65d59b1790b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:27.298769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4596010-dd01-42bc-a1ea-f65d59b1790b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:27.299166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4596010-dd01-42bc-a1ea-f65d59b1790b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:27.300164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4596010-dd01-42bc-a1ea-f65d59b1790b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:27.302117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4596010-dd01-42bc-a1ea-f65d59b1790b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:27.327342 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3837/7622] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:30:27.332329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e111a-28c8-433b-baca-8c7ae241e2fc service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:27.361035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e111a-28c8-433b-baca-8c7ae241e2fc service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:27.381377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f391a-88c1-4e5d-b337-f7daa89480e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:27.382088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f391a-88c1-4e5d-b337-f7daa89480e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:27.382377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f391a-88c1-4e5d-b337-f7daa89480e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:27.382846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f391a-88c1-4e5d-b337-f7daa89480e1 admin admin] PATH_INFO: `/v3/projects/61c428a72c7b4933a957980090ec8e92/users/9d3fa39fb1804004abf6f7315bf65313/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:27.388259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f391a-88c1-4e5d-b337-f7daa89480e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c428a72c7b4933a957980090ec8e92, user_id=9d3fa39fb1804004abf6f7315bf65313, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:27.394404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f391a-88c1-4e5d-b337-f7daa89480e1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:27.457337 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3786/7623] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:27 2022] PUT /identity/v3/projects/61c428a72c7b4933a957980090ec8e92/users/9d3fa39fb1804004abf6f7315bf65313/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:27.469108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ab6c2-7ba3-4977-80aa-6cc11f39b52e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:27.469418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ab6c2-7ba3-4977-80aa-6cc11f39b52e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:27.469749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ab6c2-7ba3-4977-80aa-6cc11f39b52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:27.512150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f391a-88c1-4e5d-b337-f7daa89480e1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:27.515607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-780f391a-88c1-4e5d-b337-f7daa89480e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:27.536320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-959ab6c2-7ba3-4977-80aa-6cc11f39b52e None None] MFA Rules not processed for user `9d3fa39fb1804004abf6f7315bf65313`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:27.539450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-959ab6c2-7ba3-4977-80aa-6cc11f39b52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:27.704753 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3838/7624] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:27.714790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f391a-88c1-4e5d-b337-f7daa89480e1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:27.719828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ab6c2-7ba3-4977-80aa-6cc11f39b52e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:27.722511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-959ab6c2-7ba3-4977-80aa-6cc11f39b52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:27.731178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a63c45-990c-4610-ab13-df307fcfe3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:27.732474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a63c45-990c-4610-ab13-df307fcfe3e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:27.732939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a63c45-990c-4610-ab13-df307fcfe3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:27.733629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a63c45-990c-4610-ab13-df307fcfe3e5 admin admin] PATH_INFO: `/v3/users/7d169e8119cf4c6f877fd2900e941c96` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:27.736084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a63c45-990c-4610-ab13-df307fcfe3e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d169e8119cf4c6f877fd2900e941c96)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:27.738419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a63c45-990c-4610-ab13-df307fcfe3e5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:27.808829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-84a63c45-990c-4610-ab13-df307fcfe3e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d169e8119cf4c6f877fd2900e941c96'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:27.809591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-84a63c45-990c-4610-ab13-df307fcfe3e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d169e8119cf4c6f877fd2900e941c96'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:27.810830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:27.828090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-84a63c45-990c-4610-ab13-df307fcfe3e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d169e8119cf4c6f877fd2900e941c96'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:27.848582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-84a63c45-990c-4610-ab13-df307fcfe3e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d169e8119cf4c6f877fd2900e941c96'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:27.877608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-84a63c45-990c-4610-ab13-df307fcfe3e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d169e8119cf4c6f877fd2900e941c96'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:27.938140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ab6c2-7ba3-4977-80aa-6cc11f39b52e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:27.947713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273c735-2afc-474e-b617-d1ecb659eaed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:27.948666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273c735-2afc-474e-b617-d1ecb659eaed service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:27.948965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273c735-2afc-474e-b617-d1ecb659eaed service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:27.949251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273c735-2afc-474e-b617-d1ecb659eaed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:27.958086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d273c735-2afc-474e-b617-d1ecb659eaed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:27.971132 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3787/7625] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:30:27 2022] DELETE /identity/v3/users/7d169e8119cf4c6f877fd2900e941c96 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:27.984292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358d252-4758-42af-b961-54db94e1a34c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:27.985439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358d252-4758-42af-b961-54db94e1a34c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:27.986688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358d252-4758-42af-b961-54db94e1a34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:28.035753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273c735-2afc-474e-b617-d1ecb659eaed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:28.037226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273c735-2afc-474e-b617-d1ecb659eaed service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:28.052225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1358d252-4758-42af-b961-54db94e1a34c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:28.056684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1358d252-4758-42af-b961-54db94e1a34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:28.106571 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3839/7626] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:30:28.277863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273c735-2afc-474e-b617-d1ecb659eaed service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:28.279339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d273c735-2afc-474e-b617-d1ecb659eaed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:28.291592 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3788/7627] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:28.308521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273c735-2afc-474e-b617-d1ecb659eaed service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:28.340309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358d252-4758-42af-b961-54db94e1a34c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:28.343192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1358d252-4758-42af-b961-54db94e1a34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:28.380531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:28.435582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01efde-a01d-4395-b3e4-ebc2962289b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:28.439159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01efde-a01d-4395-b3e4-ebc2962289b4 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:28.439584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01efde-a01d-4395-b3e4-ebc2962289b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:28.439951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01efde-a01d-4395-b3e4-ebc2962289b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:28.447764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7a01efde-a01d-4395-b3e4-ebc2962289b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:28.564599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358d252-4758-42af-b961-54db94e1a34c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:28.572622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69406428-d228-42f0-8d5d-e37456000062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:28.573277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406428-d228-42f0-8d5d-e37456000062 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:28.573582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406428-d228-42f0-8d5d-e37456000062 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:28.573932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406428-d228-42f0-8d5d-e37456000062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:28.596192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69406428-d228-42f0-8d5d-e37456000062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:28.603207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69406428-d228-42f0-8d5d-e37456000062 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:28.627192 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3789/7628] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:28.673649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01efde-a01d-4395-b3e4-ebc2962289b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:28.676723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01efde-a01d-4395-b3e4-ebc2962289b4 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:28.709482 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3840/7629] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:29.235384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69406428-d228-42f0-8d5d-e37456000062 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:29.236954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-69406428-d228-42f0-8d5d-e37456000062 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:29.264836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69406428-d228-42f0-8d5d-e37456000062 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:29.278599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712e1d8-d90c-47b7-8491-ede2e1f9795a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:29.279271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712e1d8-d90c-47b7-8491-ede2e1f9795a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:29.279606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712e1d8-d90c-47b7-8491-ede2e1f9795a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:29.279888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712e1d8-d90c-47b7-8491-ede2e1f9795a admin admin] PATH_INFO: `/v3/users/5a86308d657245d59368660e48d8a4ed` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:29.284120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712e1d8-d90c-47b7-8491-ede2e1f9795a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a86308d657245d59368660e48d8a4ed)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:29.286329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712e1d8-d90c-47b7-8491-ede2e1f9795a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:29.372650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8712e1d8-d90c-47b7-8491-ede2e1f9795a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a86308d657245d59368660e48d8a4ed'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:29.373896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8712e1d8-d90c-47b7-8491-ede2e1f9795a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a86308d657245d59368660e48d8a4ed'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:29.390802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:29.392448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8712e1d8-d90c-47b7-8491-ede2e1f9795a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a86308d657245d59368660e48d8a4ed'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:29.394603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8712e1d8-d90c-47b7-8491-ede2e1f9795a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a86308d657245d59368660e48d8a4ed'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:29.408396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8712e1d8-d90c-47b7-8491-ede2e1f9795a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a86308d657245d59368660e48d8a4ed'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:29.434444 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3790/7630] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:30:29 2022] DELETE /identity/v3/users/5a86308d657245d59368660e48d8a4ed => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:29.439317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203383fb-825f-4906-bc8d-1a1868ec5754 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:29.439839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203383fb-825f-4906-bc8d-1a1868ec5754 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:29.439948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203383fb-825f-4906-bc8d-1a1868ec5754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:29.512018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712e1d8-d90c-47b7-8491-ede2e1f9795a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:29.513801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8712e1d8-d90c-47b7-8491-ede2e1f9795a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:29.519929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-203383fb-825f-4906-bc8d-1a1868ec5754 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:29.521200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-203383fb-825f-4906-bc8d-1a1868ec5754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:29.635789 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3841/7631] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:29.648289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203383fb-825f-4906-bc8d-1a1868ec5754 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:29.653104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-203383fb-825f-4906-bc8d-1a1868ec5754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:29.654837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712e1d8-d90c-47b7-8491-ede2e1f9795a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:29.665813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def58aa-20ef-4573-b9ac-3a84890ba512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:29.666486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def58aa-20ef-4573-b9ac-3a84890ba512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:29.666771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def58aa-20ef-4573-b9ac-3a84890ba512 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:29.667051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def58aa-20ef-4573-b9ac-3a84890ba512 admin admin] PATH_INFO: `/v3/projects/d68db0e8ec2249f198f3d6c01663919d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:29.668440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def58aa-20ef-4573-b9ac-3a84890ba512 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d68db0e8ec2249f198f3d6c01663919d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:29.670375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def58aa-20ef-4573-b9ac-3a84890ba512 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:29.749835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6def58aa-20ef-4573-b9ac-3a84890ba512 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd68db0e8ec2249f198f3d6c01663919d', 'request_id': 'req-6def58aa-20ef-4573-b9ac-3a84890ba512'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:29.774160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6def58aa-20ef-4573-b9ac-3a84890ba512 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd68db0e8ec2249f198f3d6c01663919d', 'request_id': 'req-6def58aa-20ef-4573-b9ac-3a84890ba512'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:29.787603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203383fb-825f-4906-bc8d-1a1868ec5754 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:29.799683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6def58aa-20ef-4573-b9ac-3a84890ba512 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd68db0e8ec2249f198f3d6c01663919d', 'request_id': 'req-6def58aa-20ef-4573-b9ac-3a84890ba512'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:29.827094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6def58aa-20ef-4573-b9ac-3a84890ba512 admin admin] The token cache is being invalidate because project d68db0e8ec2249f198f3d6c01663919d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:30:29.827707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6def58aa-20ef-4573-b9ac-3a84890ba512 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:29.829352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6def58aa-20ef-4573-b9ac-3a84890ba512 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:29.834338 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3791/7632] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:30:29 2022] DELETE /identity/v3/projects/d68db0e8ec2249f198f3d6c01663919d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:29.840112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a22cb-bc8f-4b6f-a7ae-8d5c0cafea35 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:29.840630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a22cb-bc8f-4b6f-a7ae-8d5c0cafea35 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:29.841078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a22cb-bc8f-4b6f-a7ae-8d5c0cafea35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:29.855367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:29.897991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de977df-38b2-4cf4-92de-32879d5ace08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:29.898643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de977df-38b2-4cf4-92de-32879d5ace08 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:29.898932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de977df-38b2-4cf4-92de-32879d5ace08 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:29.900985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de977df-38b2-4cf4-92de-32879d5ace08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:29.907935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4de977df-38b2-4cf4-92de-32879d5ace08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:29.919937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b90a22cb-bc8f-4b6f-a7ae-8d5c0cafea35 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:29.923233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b90a22cb-bc8f-4b6f-a7ae-8d5c0cafea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:30.239242 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3792/7633] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:30:30.242441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea9d9d-77f3-42e5-a3d1-6ed5e2c3c0ad None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:30.242584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea9d9d-77f3-42e5-a3d1-6ed5e2c3c0ad None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:30.252249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de977df-38b2-4cf4-92de-32879d5ace08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:30.253889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de977df-38b2-4cf4-92de-32879d5ace08 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:30.255433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea9d9d-77f3-42e5-a3d1-6ed5e2c3c0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:30.290986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-91ea9d9d-77f3-42e5-a3d1-6ed5e2c3c0ad None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:30.292603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-91ea9d9d-77f3-42e5-a3d1-6ed5e2c3c0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:30.304766 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3842/7634] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:30:30.317130 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3793/7635] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:30.360291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de977df-38b2-4cf4-92de-32879d5ace08 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:30.429091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de977df-38b2-4cf4-92de-32879d5ace08 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:30.449880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4823dd-de8d-4d22-9e80-2eec54ff10cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:30.450564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4823dd-de8d-4d22-9e80-2eec54ff10cc admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:30.452286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4823dd-de8d-4d22-9e80-2eec54ff10cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:30.452770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4823dd-de8d-4d22-9e80-2eec54ff10cc admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:30.454974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4823dd-de8d-4d22-9e80-2eec54ff10cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:30:30.455338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4823dd-de8d-4d22-9e80-2eec54ff10cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:30.460548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4823dd-de8d-4d22-9e80-2eec54ff10cc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:30.524545 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3843/7636] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:30:30.531569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea9d9d-77f3-42e5-a3d1-6ed5e2c3c0ad None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:30.540530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:30.544063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea9d9d-77f3-42e5-a3d1-6ed5e2c3c0ad None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:30.569383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfb570-6ced-4ce3-8120-50bd552b970c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:30.570035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfb570-6ced-4ce3-8120-50bd552b970c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:30.570317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfb570-6ced-4ce3-8120-50bd552b970c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:30.570591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfb570-6ced-4ce3-8120-50bd552b970c admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:30.571343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfb570-6ced-4ce3-8120-50bd552b970c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:30.579552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfb570-6ced-4ce3-8120-50bd552b970c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:30.687606 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3794/7637] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:30 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:30.692491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4823dd-de8d-4d22-9e80-2eec54ff10cc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:30.706588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4823dd-de8d-4d22-9e80-2eec54ff10cc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:30.935479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b2148-48a0-41d9-b3c3-dacae976844b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:30.941834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b2148-48a0-41d9-b3c3-dacae976844b admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:30.941834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b2148-48a0-41d9-b3c3-dacae976844b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:30.941834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b2148-48a0-41d9-b3c3-dacae976844b admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:30.941834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b2148-48a0-41d9-b3c3-dacae976844b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:30.941834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b2148-48a0-41d9-b3c3-dacae976844b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:31.018724 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3844/7638] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:30 2022] POST /identity/v3/users => generated 287 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:31.022932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfb570-6ced-4ce3-8120-50bd552b970c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:31.047810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfb570-6ced-4ce3-8120-50bd552b970c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:31.060400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912b9ee-91c6-4fad-8489-73b81dedc644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:31.061205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912b9ee-91c6-4fad-8489-73b81dedc644 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:31.061494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912b9ee-91c6-4fad-8489-73b81dedc644 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:31.061774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912b9ee-91c6-4fad-8489-73b81dedc644 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:31.063418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912b9ee-91c6-4fad-8489-73b81dedc644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:31.066641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912b9ee-91c6-4fad-8489-73b81dedc644 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:31.098824 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3795/7639] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:31.107947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b2148-48a0-41d9-b3c3-dacae976844b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:31.127044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b2148-48a0-41d9-b3c3-dacae976844b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:31.151812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1cb8f8-9dde-4cfc-8b0f-ddce37a1c648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:31.153708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cb8f8-9dde-4cfc-8b0f-ddce37a1c648 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:31.154384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cb8f8-9dde-4cfc-8b0f-ddce37a1c648 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:31.154706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cb8f8-9dde-4cfc-8b0f-ddce37a1c648 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:31.155534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1cb8f8-9dde-4cfc-8b0f-ddce37a1c648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:31.158494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1cb8f8-9dde-4cfc-8b0f-ddce37a1c648 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:31.177431 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3845/7640] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:31.183383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912b9ee-91c6-4fad-8489-73b81dedc644 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:31.215323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912b9ee-91c6-4fad-8489-73b81dedc644 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:31.226726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b336af-82a7-4681-8012-a7513a36f804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:31.227706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b336af-82a7-4681-8012-a7513a36f804 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:31.228369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b336af-82a7-4681-8012-a7513a36f804 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:31.229262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b336af-82a7-4681-8012-a7513a36f804 admin admin] PATH_INFO: `/v3/projects/99b0fabfdba54248a228c83664134a91/users/b7182a1b3a90498392d083c7c9a21fba/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:31.256102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b336af-82a7-4681-8012-a7513a36f804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b0fabfdba54248a228c83664134a91, user_id=b7182a1b3a90498392d083c7c9a21fba, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:31.259478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b336af-82a7-4681-8012-a7513a36f804 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:31.306084 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3796/7641] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:31 2022] PUT /identity/v3/projects/99b0fabfdba54248a228c83664134a91/users/b7182a1b3a90498392d083c7c9a21fba/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:31.317600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de775e40-058a-4fb4-88e2-afb03db0400d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:31.318216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de775e40-058a-4fb4-88e2-afb03db0400d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:31.318729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de775e40-058a-4fb4-88e2-afb03db0400d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:31.405800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b336af-82a7-4681-8012-a7513a36f804 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:31.408904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e5b336af-82a7-4681-8012-a7513a36f804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:31.416787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-de775e40-058a-4fb4-88e2-afb03db0400d None None] MFA Rules not processed for user `b7182a1b3a90498392d083c7c9a21fba`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:31.419462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-de775e40-058a-4fb4-88e2-afb03db0400d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:31.531102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:31.566275 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3846/7642] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:31.576697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de775e40-058a-4fb4-88e2-afb03db0400d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:31.580477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-de775e40-058a-4fb4-88e2-afb03db0400d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:31.606350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b336af-82a7-4681-8012-a7513a36f804 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:31.620461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fe330-ba22-42af-abe1-ab59f3fb202c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:31.621139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fe330-ba22-42af-abe1-ab59f3fb202c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:31.621423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fe330-ba22-42af-abe1-ab59f3fb202c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:31.621704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fe330-ba22-42af-abe1-ab59f3fb202c admin admin] PATH_INFO: `/v3/projects/3bc0690c1f03443baec18ff0fdff5065` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:31.623233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fe330-ba22-42af-abe1-ab59f3fb202c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bc0690c1f03443baec18ff0fdff5065)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:31.625125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fe330-ba22-42af-abe1-ab59f3fb202c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:31.750702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f17fe330-ba22-42af-abe1-ab59f3fb202c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bc0690c1f03443baec18ff0fdff5065', 'request_id': 'req-f17fe330-ba22-42af-abe1-ab59f3fb202c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:31.760559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de775e40-058a-4fb4-88e2-afb03db0400d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:31.777741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f17fe330-ba22-42af-abe1-ab59f3fb202c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bc0690c1f03443baec18ff0fdff5065', 'request_id': 'req-f17fe330-ba22-42af-abe1-ab59f3fb202c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:31.800505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f17fe330-ba22-42af-abe1-ab59f3fb202c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bc0690c1f03443baec18ff0fdff5065', 'request_id': 'req-f17fe330-ba22-42af-abe1-ab59f3fb202c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:31.835045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f17fe330-ba22-42af-abe1-ab59f3fb202c admin admin] The token cache is being invalidate because project 3bc0690c1f03443baec18ff0fdff5065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:30:31.835387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f17fe330-ba22-42af-abe1-ab59f3fb202c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:31.837987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f17fe330-ba22-42af-abe1-ab59f3fb202c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:31.845404 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3797/7643] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:30:31 2022] DELETE /identity/v3/projects/3bc0690c1f03443baec18ff0fdff5065 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:30:31.847765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fe330-ba22-42af-abe1-ab59f3fb202c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:31.849407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f17fe330-ba22-42af-abe1-ab59f3fb202c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:31.942034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066ef00-91d4-44d8-a1ba-255db623a97a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:31.942932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066ef00-91d4-44d8-a1ba-255db623a97a service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:31.943122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066ef00-91d4-44d8-a1ba-255db623a97a service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:31.943506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066ef00-91d4-44d8-a1ba-255db623a97a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:31.947837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c066ef00-91d4-44d8-a1ba-255db623a97a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:31.954934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:32.031090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fe330-ba22-42af-abe1-ab59f3fb202c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:32.051659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e782a-ed62-4dd5-97d1-d55bdfee126b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:32.057462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e782a-ed62-4dd5-97d1-d55bdfee126b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:32.057752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e782a-ed62-4dd5-97d1-d55bdfee126b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:32.058583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e782a-ed62-4dd5-97d1-d55bdfee126b admin admin] PATH_INFO: `/v3/users/9d3fa39fb1804004abf6f7315bf65313` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:32.061886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e782a-ed62-4dd5-97d1-d55bdfee126b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d3fa39fb1804004abf6f7315bf65313)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:32.067732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e782a-ed62-4dd5-97d1-d55bdfee126b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:32.108194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066ef00-91d4-44d8-a1ba-255db623a97a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:32.113445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066ef00-91d4-44d8-a1ba-255db623a97a service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:32.130482 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3847/7644] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:32.175226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066ef00-91d4-44d8-a1ba-255db623a97a service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:32.184110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c066ef00-91d4-44d8-a1ba-255db623a97a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:32.204417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-843e782a-ed62-4dd5-97d1-d55bdfee126b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d3fa39fb1804004abf6f7315bf65313'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:32.208149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-843e782a-ed62-4dd5-97d1-d55bdfee126b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d3fa39fb1804004abf6f7315bf65313'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:32.211622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066ef00-91d4-44d8-a1ba-255db623a97a service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:32.221748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e9c5e-4440-4a62-9d89-01b2347aa538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:32.225478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e9c5e-4440-4a62-9d89-01b2347aa538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:32.226176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e9c5e-4440-4a62-9d89-01b2347aa538 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:32.226672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e9c5e-4440-4a62-9d89-01b2347aa538 admin admin] PATH_INFO: `/v3/users/b7182a1b3a90498392d083c7c9a21fba` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:32.229800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e9c5e-4440-4a62-9d89-01b2347aa538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7182a1b3a90498392d083c7c9a21fba)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:32.234295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e9c5e-4440-4a62-9d89-01b2347aa538 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:32.248290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-843e782a-ed62-4dd5-97d1-d55bdfee126b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d3fa39fb1804004abf6f7315bf65313'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:32.254843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-843e782a-ed62-4dd5-97d1-d55bdfee126b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d3fa39fb1804004abf6f7315bf65313'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:32.270433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-843e782a-ed62-4dd5-97d1-d55bdfee126b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d3fa39fb1804004abf6f7315bf65313'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:32.306187 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3798/7645] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:30:31 2022] DELETE /identity/v3/users/9d3fa39fb1804004abf6f7315bf65313 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:32.368237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-aa4e9c5e-4440-4a62-9d89-01b2347aa538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7182a1b3a90498392d083c7c9a21fba'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:32.379728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:32.422845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-aa4e9c5e-4440-4a62-9d89-01b2347aa538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7182a1b3a90498392d083c7c9a21fba'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:32.426856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-aa4e9c5e-4440-4a62-9d89-01b2347aa538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7182a1b3a90498392d083c7c9a21fba'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:32.444757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-aa4e9c5e-4440-4a62-9d89-01b2347aa538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7182a1b3a90498392d083c7c9a21fba'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:32.446450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-aa4e9c5e-4440-4a62-9d89-01b2347aa538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7182a1b3a90498392d083c7c9a21fba'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:32.468255 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3848/7646] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:30:32 2022] DELETE /identity/v3/users/b7182a1b3a90498392d083c7c9a21fba => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:32.474538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f9782-2057-4f06-b3f9-e1d85ea8c7b3 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:32.474921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f9782-2057-4f06-b3f9-e1d85ea8c7b3 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:32.479130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f9782-2057-4f06-b3f9-e1d85ea8c7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:32.515343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-889f9782-2057-4f06-b3f9-e1d85ea8c7b3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:32.518682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-889f9782-2057-4f06-b3f9-e1d85ea8c7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:32.730465 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3799/7647] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:32.748161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e9c5e-4440-4a62-9d89-01b2347aa538 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:32.751432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-aa4e9c5e-4440-4a62-9d89-01b2347aa538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:32.870174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f9782-2057-4f06-b3f9-e1d85ea8c7b3 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:32.871690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-889f9782-2057-4f06-b3f9-e1d85ea8c7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:32.896553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f9782-2057-4f06-b3f9-e1d85ea8c7b3 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:32.920901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e9c5e-4440-4a62-9d89-01b2347aa538 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:32.922491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194de58-ccd0-4531-b479-508a716df0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:32.923332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194de58-ccd0-4531-b479-508a716df0de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:32.923619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194de58-ccd0-4531-b479-508a716df0de admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:32.923889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194de58-ccd0-4531-b479-508a716df0de admin admin] PATH_INFO: `/v3/projects/61c428a72c7b4933a957980090ec8e92` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:32.927642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6204c-01af-4d6b-a92a-7f65386a2dca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:32.928460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194de58-ccd0-4531-b479-508a716df0de admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c428a72c7b4933a957980090ec8e92)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:32.929064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6204c-01af-4d6b-a92a-7f65386a2dca service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:32.929555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6204c-01af-4d6b-a92a-7f65386a2dca service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:32.930448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194de58-ccd0-4531-b479-508a716df0de admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:32.931628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6204c-01af-4d6b-a92a-7f65386a2dca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:32.956773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6204c-01af-4d6b-a92a-7f65386a2dca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:32.962098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6204c-01af-4d6b-a92a-7f65386a2dca service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:33.014480 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3849/7648] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:33.016905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6204c-01af-4d6b-a92a-7f65386a2dca service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:33.019450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fce6204c-01af-4d6b-a92a-7f65386a2dca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:33.041815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6204c-01af-4d6b-a92a-7f65386a2dca service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:33.086428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8194de58-ccd0-4531-b479-508a716df0de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c428a72c7b4933a957980090ec8e92', 'request_id': 'req-8194de58-ccd0-4531-b479-508a716df0de'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:33.095123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:33.121031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8194de58-ccd0-4531-b479-508a716df0de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c428a72c7b4933a957980090ec8e92', 'request_id': 'req-8194de58-ccd0-4531-b479-508a716df0de'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:33.156021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8194de58-ccd0-4531-b479-508a716df0de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c428a72c7b4933a957980090ec8e92', 'request_id': 'req-8194de58-ccd0-4531-b479-508a716df0de'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:33.189405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8194de58-ccd0-4531-b479-508a716df0de admin admin] The token cache is being invalidate because project 61c428a72c7b4933a957980090ec8e92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:30:33.189757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8194de58-ccd0-4531-b479-508a716df0de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:33.194541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8194de58-ccd0-4531-b479-508a716df0de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:33.200574 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3800/7649] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:30:32 2022] DELETE /identity/v3/projects/61c428a72c7b4933a957980090ec8e92 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:33.206235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf1b35-02ca-4dcd-8cc0-04ad626ad270 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:33.206789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf1b35-02ca-4dcd-8cc0-04ad626ad270 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:33.209389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf1b35-02ca-4dcd-8cc0-04ad626ad270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:33.262519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfd14c-951d-4b34-9344-77fda79213a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:33.263235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfd14c-951d-4b34-9344-77fda79213a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:33.263619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfd14c-951d-4b34-9344-77fda79213a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:33.269217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfd14c-951d-4b34-9344-77fda79213a0 admin admin] PATH_INFO: `/v3/users/62a906ba21fb4dd9804bcb4c85b44da9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:33.275816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfd14c-951d-4b34-9344-77fda79213a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a906ba21fb4dd9804bcb4c85b44da9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:33.288078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2edf1b35-02ca-4dcd-8cc0-04ad626ad270 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:33.289316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2edf1b35-02ca-4dcd-8cc0-04ad626ad270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:33.289470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfd14c-951d-4b34-9344-77fda79213a0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:33.318783 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3801/7650] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:33.326517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb60f62-93fd-4a2a-8d3e-3731a44d0434 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:33.326720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb60f62-93fd-4a2a-8d3e-3731a44d0434 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:33.326989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb60f62-93fd-4a2a-8d3e-3731a44d0434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:33.372659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9cb60f62-93fd-4a2a-8d3e-3731a44d0434 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:33.375015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9cb60f62-93fd-4a2a-8d3e-3731a44d0434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:33.398455 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3802/7651] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:30:33.402071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb60f62-93fd-4a2a-8d3e-3731a44d0434 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:33.425628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb60f62-93fd-4a2a-8d3e-3731a44d0434 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:33.439381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d8e80-b13a-469d-9387-49ea58881145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:33.440013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d8e80-b13a-469d-9387-49ea58881145 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:33.440302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d8e80-b13a-469d-9387-49ea58881145 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:33.440578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d8e80-b13a-469d-9387-49ea58881145 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:33.443396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d8e80-b13a-469d-9387-49ea58881145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:30:33.443778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d8e80-b13a-469d-9387-49ea58881145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:33.444406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d4cfd14c-951d-4b34-9344-77fda79213a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a906ba21fb4dd9804bcb4c85b44da9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:33.449242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d8e80-b13a-469d-9387-49ea58881145 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:33.498027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d4cfd14c-951d-4b34-9344-77fda79213a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a906ba21fb4dd9804bcb4c85b44da9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:33.500594 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3803/7652] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:30:33.505360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d8e80-b13a-469d-9387-49ea58881145 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:33.509890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d4cfd14c-951d-4b34-9344-77fda79213a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a906ba21fb4dd9804bcb4c85b44da9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:33.528319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d4cfd14c-951d-4b34-9344-77fda79213a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a906ba21fb4dd9804bcb4c85b44da9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:33.535852 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d4cfd14c-951d-4b34-9344-77fda79213a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a906ba21fb4dd9804bcb4c85b44da9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:33.539340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d8e80-b13a-469d-9387-49ea58881145 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:33.548990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:33.561699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72403869-53ad-44ac-8e1b-219bdd3e1acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:33.562628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72403869-53ad-44ac-8e1b-219bdd3e1acc admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:33.562875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72403869-53ad-44ac-8e1b-219bdd3e1acc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:33.563236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72403869-53ad-44ac-8e1b-219bdd3e1acc admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:33.569223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72403869-53ad-44ac-8e1b-219bdd3e1acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:33.574728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72403869-53ad-44ac-8e1b-219bdd3e1acc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:33.578777 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3850/7653] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:30:33 2022] DELETE /identity/v3/users/62a906ba21fb4dd9804bcb4c85b44da9 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:33.583561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb796d1e-ed16-4e1d-a052-fba5ccfe429c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:33.583970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb796d1e-ed16-4e1d-a052-fba5ccfe429c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:33.584278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb796d1e-ed16-4e1d-a052-fba5ccfe429c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:33.625707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bb796d1e-ed16-4e1d-a052-fba5ccfe429c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:33.627953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bb796d1e-ed16-4e1d-a052-fba5ccfe429c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:33.658751 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3804/7654] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:33 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:33.668373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72403869-53ad-44ac-8e1b-219bdd3e1acc admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:33.671513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-72403869-53ad-44ac-8e1b-219bdd3e1acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:33.805444 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3851/7655] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:30:33.829544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72403869-53ad-44ac-8e1b-219bdd3e1acc admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:33.842077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f719ec-ab26-4b86-a84d-93640980175c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:33.842877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f719ec-ab26-4b86-a84d-93640980175c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:33.848099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f719ec-ab26-4b86-a84d-93640980175c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:33.850405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f719ec-ab26-4b86-a84d-93640980175c admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:33.854773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb796d1e-ed16-4e1d-a052-fba5ccfe429c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:33.855314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f719ec-ab26-4b86-a84d-93640980175c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:33.857185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bb796d1e-ed16-4e1d-a052-fba5ccfe429c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:33.879497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f719ec-ab26-4b86-a84d-93640980175c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:33.940865 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3805/7656] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:33 2022] POST /identity/v3/users => generated 292 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:30:33.941820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f719ec-ab26-4b86-a84d-93640980175c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:33.943809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-78f719ec-ab26-4b86-a84d-93640980175c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:33.959770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f719ec-ab26-4b86-a84d-93640980175c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:33.966218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75880f68-2e45-4e4a-ae51-6cf50c519f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:33.966978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75880f68-2e45-4e4a-ae51-6cf50c519f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:33.967269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75880f68-2e45-4e4a-ae51-6cf50c519f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:33.967753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75880f68-2e45-4e4a-ae51-6cf50c519f62 admin admin] PATH_INFO: `/v3/projects/99b0fabfdba54248a228c83664134a91` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:33.969692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75880f68-2e45-4e4a-ae51-6cf50c519f62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b0fabfdba54248a228c83664134a91)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:33.971509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75880f68-2e45-4e4a-ae51-6cf50c519f62 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:34.017867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb796d1e-ed16-4e1d-a052-fba5ccfe429c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:34.090480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75880f68-2e45-4e4a-ae51-6cf50c519f62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b0fabfdba54248a228c83664134a91', 'request_id': 'req-75880f68-2e45-4e4a-ae51-6cf50c519f62'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:34.110702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75880f68-2e45-4e4a-ae51-6cf50c519f62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b0fabfdba54248a228c83664134a91', 'request_id': 'req-75880f68-2e45-4e4a-ae51-6cf50c519f62'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:34.119190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75880f68-2e45-4e4a-ae51-6cf50c519f62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b0fabfdba54248a228c83664134a91', 'request_id': 'req-75880f68-2e45-4e4a-ae51-6cf50c519f62'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:34.120564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd8f90-b069-46b4-b34a-8ff286df550d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:34.123702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd8f90-b069-46b4-b34a-8ff286df550d service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:34.123853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd8f90-b069-46b4-b34a-8ff286df550d service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:34.125587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd8f90-b069-46b4-b34a-8ff286df550d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:34.139236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75880f68-2e45-4e4a-ae51-6cf50c519f62 admin admin] The token cache is being invalidate because project 99b0fabfdba54248a228c83664134a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:30:34.140881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75880f68-2e45-4e4a-ae51-6cf50c519f62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:34.141687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75880f68-2e45-4e4a-ae51-6cf50c519f62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:34.147541 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3806/7657] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:30:33 2022] DELETE /identity/v3/projects/99b0fabfdba54248a228c83664134a91 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:34.148942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75880f68-2e45-4e4a-ae51-6cf50c519f62 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:34.154263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-75880f68-2e45-4e4a-ae51-6cf50c519f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:34.162556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=10,keystone:SELECT=85,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:34.172138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd8f90-b069-46b4-b34a-8ff286df550d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:34.173923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd8f90-b069-46b4-b34a-8ff286df550d service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:34.194295 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3852/7658] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:34.199232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2d7fd-23e1-4319-a10e-cea3f73838fd None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:34.199747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2d7fd-23e1-4319-a10e-cea3f73838fd None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:34.200185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2d7fd-23e1-4319-a10e-cea3f73838fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:34.246673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-10b2d7fd-23e1-4319-a10e-cea3f73838fd None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:34.248914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-10b2d7fd-23e1-4319-a10e-cea3f73838fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:34.316065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75880f68-2e45-4e4a-ae51-6cf50c519f62 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:34.323593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a9454-0254-46fa-91d7-a69ed96fe758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:34.324294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a9454-0254-46fa-91d7-a69ed96fe758 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:34.324644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a9454-0254-46fa-91d7-a69ed96fe758 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:34.325203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a9454-0254-46fa-91d7-a69ed96fe758 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:34.325921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a9454-0254-46fa-91d7-a69ed96fe758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:34.328147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a9454-0254-46fa-91d7-a69ed96fe758 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:34.329192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:34.346408 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3807/7659] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:34.347314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a9454-0254-46fa-91d7-a69ed96fe758 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:34.360715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a9454-0254-46fa-91d7-a69ed96fe758 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:34.360941 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3853/7660] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:34.370370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eed2d-9b5e-4188-853f-a5cd48252218 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:34.370797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eed2d-9b5e-4188-853f-a5cd48252218 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:34.371818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eed2d-9b5e-4188-853f-a5cd48252218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:34.394276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca8360-9ad1-4703-8876-d6db81c9a545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:34.396646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca8360-9ad1-4703-8876-d6db81c9a545 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:34.397242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca8360-9ad1-4703-8876-d6db81c9a545 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:34.397686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca8360-9ad1-4703-8876-d6db81c9a545 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:34.398882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca8360-9ad1-4703-8876-d6db81c9a545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:34.402809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca8360-9ad1-4703-8876-d6db81c9a545 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:34.417294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0d2eed2d-9b5e-4188-853f-a5cd48252218 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:34.418591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0d2eed2d-9b5e-4188-853f-a5cd48252218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:34.420574 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3808/7661] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:34.424741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca8360-9ad1-4703-8876-d6db81c9a545 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:34.438029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca8360-9ad1-4703-8876-d6db81c9a545 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:34.438263 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3854/7662] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:30:34.439780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100588f-3d1e-42b7-b947-f2101f1ed25e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:34.440072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100588f-3d1e-42b7-b947-f2101f1ed25e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:34.440352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100588f-3d1e-42b7-b947-f2101f1ed25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:34.450765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972ad74-d663-47f8-883b-48a518f65f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:34.452318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972ad74-d663-47f8-883b-48a518f65f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:34.452613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972ad74-d663-47f8-883b-48a518f65f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:34.452902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972ad74-d663-47f8-883b-48a518f65f2a admin admin] PATH_INFO: `/v3/projects/782c0622189b4280954eb7b23d276505/users/fb3c692ee32d4e61aa6fc5a6c08af4d5/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:34.481430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0100588f-3d1e-42b7-b947-f2101f1ed25e None None] MFA Rules not processed for user `67db2c00c71f469f9a7a871ed28e97e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:34.482853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0100588f-3d1e-42b7-b947-f2101f1ed25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:34.494015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972ad74-d663-47f8-883b-48a518f65f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=782c0622189b4280954eb7b23d276505, user_id=fb3c692ee32d4e61aa6fc5a6c08af4d5, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:34.504354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972ad74-d663-47f8-883b-48a518f65f2a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:34.540569 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3809/7663] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:34 2022] PUT /identity/v3/projects/782c0622189b4280954eb7b23d276505/users/fb3c692ee32d4e61aa6fc5a6c08af4d5/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:34.543625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972ad74-d663-47f8-883b-48a518f65f2a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:34.639522 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3855/7664] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:34.641361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b3cba-65be-4882-ae61-a4c383eee946 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:34.642088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b3cba-65be-4882-ae61-a4c383eee946 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:34.642528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b3cba-65be-4882-ae61-a4c383eee946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:34.707877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972ad74-d663-47f8-883b-48a518f65f2a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:34.716285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c8899-35ae-42e6-a498-68b4054409da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:34.717682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c8899-35ae-42e6-a498-68b4054409da admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:34.718148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c8899-35ae-42e6-a498-68b4054409da admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:34.719193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c8899-35ae-42e6-a498-68b4054409da admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:34.720807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c8899-35ae-42e6-a498-68b4054409da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:30:34.721134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c8899-35ae-42e6-a498-68b4054409da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:34.727132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c8899-35ae-42e6-a498-68b4054409da admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:34.746149 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3810/7665] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:30:34.754365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c8899-35ae-42e6-a498-68b4054409da admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:34.754851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a69b3cba-65be-4882-ae61-a4c383eee946 None None] MFA Rules not processed for user `fb3c692ee32d4e61aa6fc5a6c08af4d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:34.756350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a69b3cba-65be-4882-ae61-a4c383eee946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:34.780266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c8899-35ae-42e6-a498-68b4054409da admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:34.795774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a02d28-6c80-4e00-9331-97ac961cacf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:34.800435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a02d28-6c80-4e00-9331-97ac961cacf0 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:34.802008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a02d28-6c80-4e00-9331-97ac961cacf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:34.802008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a02d28-6c80-4e00-9331-97ac961cacf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:34.802879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a02d28-6c80-4e00-9331-97ac961cacf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:34.815466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a02d28-6c80-4e00-9331-97ac961cacf0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:34.902334 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3811/7666] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:34 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:34.907500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a02d28-6c80-4e00-9331-97ac961cacf0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:34.910029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-19a02d28-6c80-4e00-9331-97ac961cacf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:34.928533 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3856/7667] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:34.929723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b3cba-65be-4882-ae61-a4c383eee946 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:34.949810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b3cba-65be-4882-ae61-a4c383eee946 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:35.023174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:35.055716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fae06f-6935-478f-bf30-e22c2c728e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:35.056725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fae06f-6935-478f-bf30-e22c2c728e49 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:35.057114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fae06f-6935-478f-bf30-e22c2c728e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:35.057490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fae06f-6935-478f-bf30-e22c2c728e49 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:35.058271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fae06f-6935-478f-bf30-e22c2c728e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:35.059433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a02d28-6c80-4e00-9331-97ac961cacf0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:35.061028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fae06f-6935-478f-bf30-e22c2c728e49 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:35.066967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0b235-95d0-42e2-8138-83b77822f077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:35.067896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0b235-95d0-42e2-8138-83b77822f077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:35.068181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0b235-95d0-42e2-8138-83b77822f077 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:35.069914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0b235-95d0-42e2-8138-83b77822f077 admin admin] PATH_INFO: `/v3/projects/bb9506d774214db0b17e156ddb712435` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:35.071870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0b235-95d0-42e2-8138-83b77822f077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb9506d774214db0b17e156ddb712435)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:35.076242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0b235-95d0-42e2-8138-83b77822f077 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:35.107637 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3857/7668] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:34 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:35.109335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fae06f-6935-478f-bf30-e22c2c728e49 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:35.124030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fae06f-6935-478f-bf30-e22c2c728e49 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:35.129855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58558b-f67c-4689-88e3-d75287df8de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:35.130332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58558b-f67c-4689-88e3-d75287df8de3 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:35.130785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58558b-f67c-4689-88e3-d75287df8de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:35.131186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58558b-f67c-4689-88e3-d75287df8de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:35.132670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58558b-f67c-4689-88e3-d75287df8de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:35.136611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58558b-f67c-4689-88e3-d75287df8de3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:35.158902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:35.177301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d6b0b235-95d0-42e2-8138-83b77822f077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb9506d774214db0b17e156ddb712435', 'request_id': 'req-d6b0b235-95d0-42e2-8138-83b77822f077'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:35.192129 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3858/7669] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:35 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:35.193827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d6b0b235-95d0-42e2-8138-83b77822f077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb9506d774214db0b17e156ddb712435', 'request_id': 'req-d6b0b235-95d0-42e2-8138-83b77822f077'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:35.198473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58558b-f67c-4689-88e3-d75287df8de3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:35.203076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d6b0b235-95d0-42e2-8138-83b77822f077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb9506d774214db0b17e156ddb712435', 'request_id': 'req-d6b0b235-95d0-42e2-8138-83b77822f077'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:35.234361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d6b0b235-95d0-42e2-8138-83b77822f077 admin admin] The token cache is being invalidate because project bb9506d774214db0b17e156ddb712435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:30:35.235872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d6b0b235-95d0-42e2-8138-83b77822f077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:35.237295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d6b0b235-95d0-42e2-8138-83b77822f077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:35.241454 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3812/7670] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:30:34 2022] DELETE /identity/v3/projects/bb9506d774214db0b17e156ddb712435 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:35.250472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0b235-95d0-42e2-8138-83b77822f077 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:35.255941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d6b0b235-95d0-42e2-8138-83b77822f077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:35.341943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58558b-f67c-4689-88e3-d75287df8de3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:35.350293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dab32-e2d4-4257-92bc-89fd2de1ad31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:35.351043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dab32-e2d4-4257-92bc-89fd2de1ad31 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:35.351577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dab32-e2d4-4257-92bc-89fd2de1ad31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:35.351946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dab32-e2d4-4257-92bc-89fd2de1ad31 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:35.352913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dab32-e2d4-4257-92bc-89fd2de1ad31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:35.356698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dab32-e2d4-4257-92bc-89fd2de1ad31 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:35.372814 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3859/7671] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:35.373809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6c955-5f0d-4ef9-bef1-04a32bc88dee None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:35.374407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6c955-5f0d-4ef9-bef1-04a32bc88dee None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:35.374681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6c955-5f0d-4ef9-bef1-04a32bc88dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:35.400615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0b235-95d0-42e2-8138-83b77822f077 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:35.413171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47df26-8c23-4896-a18f-6f31259153ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:35.414162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47df26-8c23-4896-a18f-6f31259153ac admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:35.414466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47df26-8c23-4896-a18f-6f31259153ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:35.414852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47df26-8c23-4896-a18f-6f31259153ac admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:35.415503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47df26-8c23-4896-a18f-6f31259153ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:35.417839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47df26-8c23-4896-a18f-6f31259153ac admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:35.420967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-26b6c955-5f0d-4ef9-bef1-04a32bc88dee None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:35.422294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-26b6c955-5f0d-4ef9-bef1-04a32bc88dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:35.440580 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3860/7672] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:35.441428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6c955-5f0d-4ef9-bef1-04a32bc88dee None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:35.443917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-26b6c955-5f0d-4ef9-bef1-04a32bc88dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:35.466987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6c955-5f0d-4ef9-bef1-04a32bc88dee None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:35.475068 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3813/7673] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:35 2022] POST /identity/v3/users => generated 298 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:35.478856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43287f-0c8f-4f28-81ba-00fe14f8f750 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:35.479435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43287f-0c8f-4f28-81ba-00fe14f8f750 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:35.479955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43287f-0c8f-4f28-81ba-00fe14f8f750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:35.488928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b12f2-4d8f-43a2-b314-16f56471da58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:35.491178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b12f2-4d8f-43a2-b314-16f56471da58 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:35.491178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b12f2-4d8f-43a2-b314-16f56471da58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:35.491178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b12f2-4d8f-43a2-b314-16f56471da58 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:35.491616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b12f2-4d8f-43a2-b314-16f56471da58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:35.499866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b12f2-4d8f-43a2-b314-16f56471da58 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:35.515537 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3861/7674] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:35.516561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b12f2-4d8f-43a2-b314-16f56471da58 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:35.531783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b12f2-4d8f-43a2-b314-16f56471da58 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:35.536636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0b43287f-0c8f-4f28-81ba-00fe14f8f750 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:35.538912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0b43287f-0c8f-4f28-81ba-00fe14f8f750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:35.547549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58230f0d-ef1f-4c36-821c-c0c5680c5e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:35.548198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58230f0d-ef1f-4c36-821c-c0c5680c5e70 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:35.548832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58230f0d-ef1f-4c36-821c-c0c5680c5e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:35.548832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58230f0d-ef1f-4c36-821c-c0c5680c5e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:35.549500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58230f0d-ef1f-4c36-821c-c0c5680c5e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:35.551191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58230f0d-ef1f-4c36-821c-c0c5680c5e70 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:35.565719 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3814/7675] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:35.566665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43287f-0c8f-4f28-81ba-00fe14f8f750 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:35.583552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43287f-0c8f-4f28-81ba-00fe14f8f750 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:35.597330 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3862/7676] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:35.603796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58230f0d-ef1f-4c36-821c-c0c5680c5e70 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:35.608285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78536e2-daaf-405c-9d71-9a8d56f67eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:35.608986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78536e2-daaf-405c-9d71-9a8d56f67eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:35.609298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78536e2-daaf-405c-9d71-9a8d56f67eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:35.609528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78536e2-daaf-405c-9d71-9a8d56f67eaf admin admin] PATH_INFO: `/v3/projects/86550d66e9144788967e5b514cda82d7/users/937935818cda4a6e8b9104d38aa3a8b1/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:35.625604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58230f0d-ef1f-4c36-821c-c0c5680c5e70 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:35.635772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78536e2-daaf-405c-9d71-9a8d56f67eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=86550d66e9144788967e5b514cda82d7, user_id=937935818cda4a6e8b9104d38aa3a8b1, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:35.640930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d87482-599b-45ec-8cda-da0e1a02869e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:35.641813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d87482-599b-45ec-8cda-da0e1a02869e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:35.642227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d87482-599b-45ec-8cda-da0e1a02869e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:35.642614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d87482-599b-45ec-8cda-da0e1a02869e admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:35.643426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78536e2-daaf-405c-9d71-9a8d56f67eaf admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:35.643580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d87482-599b-45ec-8cda-da0e1a02869e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:30:35.643953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d87482-599b-45ec-8cda-da0e1a02869e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:35.645897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d87482-599b-45ec-8cda-da0e1a02869e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:35.674494 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3815/7677] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:35 2022] PUT /identity/v3/projects/86550d66e9144788967e5b514cda82d7/users/937935818cda4a6e8b9104d38aa3a8b1/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:35.675659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78536e2-daaf-405c-9d71-9a8d56f67eaf admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:35.676195 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3863/7678] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:30:35.679400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f938aa4-7f67-4b91-86d8-795806e54043 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:35.680372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f938aa4-7f67-4b91-86d8-795806e54043 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:35.681252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f938aa4-7f67-4b91-86d8-795806e54043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:35.722913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2f938aa4-7f67-4b91-86d8-795806e54043 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:35.724434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2f938aa4-7f67-4b91-86d8-795806e54043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:35.742033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:35.796851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78536e2-daaf-405c-9d71-9a8d56f67eaf admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:35.803792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d08c1f-dd22-42e1-8b5c-7300c59b2393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:35.808213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d08c1f-dd22-42e1-8b5c-7300c59b2393 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:35.808515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d08c1f-dd22-42e1-8b5c-7300c59b2393 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:35.808859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d08c1f-dd22-42e1-8b5c-7300c59b2393 admin admin] PATH_INFO: `/v3/projects/3066688ad2bf4c4c85e3819bb21cd70f/users/687e04d9904a45bf8b8597d51094aacc/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:35.840619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d08c1f-dd22-42e1-8b5c-7300c59b2393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3066688ad2bf4c4c85e3819bb21cd70f, user_id=687e04d9904a45bf8b8597d51094aacc, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:35.843865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d08c1f-dd22-42e1-8b5c-7300c59b2393 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:35.853483 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3864/7679] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:30:35.855643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f938aa4-7f67-4b91-86d8-795806e54043 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:35.872152 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3816/7680] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:35 2022] PUT /identity/v3/projects/3066688ad2bf4c4c85e3819bb21cd70f/users/687e04d9904a45bf8b8597d51094aacc/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:35.875691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d08c1f-dd22-42e1-8b5c-7300c59b2393 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:35.876473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f938aa4-7f67-4b91-86d8-795806e54043 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:35.887331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d1d08c1f-dd22-42e1-8b5c-7300c59b2393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:35.933339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:35.972460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e721f92-ebc3-44b2-b74e-215dda9581b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:35.974872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e721f92-ebc3-44b2-b74e-215dda9581b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:35.974872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e721f92-ebc3-44b2-b74e-215dda9581b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:35.974872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e721f92-ebc3-44b2-b74e-215dda9581b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:35.976465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e721f92-ebc3-44b2-b74e-215dda9581b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:35.979613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e721f92-ebc3-44b2-b74e-215dda9581b9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:36.038823 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3865/7681] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:35 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:36.039768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e721f92-ebc3-44b2-b74e-215dda9581b9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:36.078806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d08c1f-dd22-42e1-8b5c-7300c59b2393 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:36.188773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bb226-b4d6-403a-81de-75b8f9e4909d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:36.189497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bb226-b4d6-403a-81de-75b8f9e4909d service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:36.207743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bb226-b4d6-403a-81de-75b8f9e4909d service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:36.208001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bb226-b4d6-403a-81de-75b8f9e4909d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:36.223059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e721f92-ebc3-44b2-b74e-215dda9581b9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:36.234613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33268b10-4969-4288-8885-ccb1481066e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:36.235890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33268b10-4969-4288-8885-ccb1481066e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:36.236187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33268b10-4969-4288-8885-ccb1481066e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:36.236472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33268b10-4969-4288-8885-ccb1481066e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:36.237191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33268b10-4969-4288-8885-ccb1481066e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:36.237926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bb226-b4d6-403a-81de-75b8f9e4909d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:36.239174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33268b10-4969-4288-8885-ccb1481066e5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:36.239792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bb226-b4d6-403a-81de-75b8f9e4909d service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:36.264679 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3817/7682] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:36.265578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bb226-b4d6-403a-81de-75b8f9e4909d service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:36.270760 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3866/7683] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:36.271891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33268b10-4969-4288-8885-ccb1481066e5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:36.302270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bb226-b4d6-403a-81de-75b8f9e4909d service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:36.304934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33268b10-4969-4288-8885-ccb1481066e5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:36.324708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48d5d6-2361-4971-a68e-a75f22bb579b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:36.325368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48d5d6-2361-4971-a68e-a75f22bb579b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:36.325686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48d5d6-2361-4971-a68e-a75f22bb579b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:36.325977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48d5d6-2361-4971-a68e-a75f22bb579b admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:36.326608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48d5d6-2361-4971-a68e-a75f22bb579b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:36.330321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111acaf-f72c-456d-9098-fd8b2614da9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:36.331244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111acaf-f72c-456d-9098-fd8b2614da9d admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:36.331742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111acaf-f72c-456d-9098-fd8b2614da9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:36.331930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111acaf-f72c-456d-9098-fd8b2614da9d admin admin] PATH_INFO: `/v3/projects/3066688ad2bf4c4c85e3819bb21cd70f/users/687e04d9904a45bf8b8597d51094aacc/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:36.332862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48d5d6-2361-4971-a68e-a75f22bb579b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:36.339453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111acaf-f72c-456d-9098-fd8b2614da9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3066688ad2bf4c4c85e3819bb21cd70f, user_id=687e04d9904a45bf8b8597d51094aacc, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:36.344825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111acaf-f72c-456d-9098-fd8b2614da9d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:36.371152 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3867/7684] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:36 2022] PUT /identity/v3/projects/3066688ad2bf4c4c85e3819bb21cd70f/users/687e04d9904a45bf8b8597d51094aacc/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:30:36.390429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02238463-3d1b-49cf-8924-cf3026c9f8c4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:36.390728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02238463-3d1b-49cf-8924-cf3026c9f8c4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:36.391217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02238463-3d1b-49cf-8924-cf3026c9f8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:36.400324 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3818/7685] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:36 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:36.404364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48d5d6-2361-4971-a68e-a75f22bb579b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:36.420980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48d5d6-2361-4971-a68e-a75f22bb579b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:36.433611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-02238463-3d1b-49cf-8924-cf3026c9f8c4 None None] MFA Rules not processed for user `687e04d9904a45bf8b8597d51094aacc`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:36.435078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-02238463-3d1b-49cf-8924-cf3026c9f8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:36.571118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:36.600706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b0d50-17b8-4dc2-aa3c-d2ff101b22fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:36.603100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b0d50-17b8-4dc2-aa3c-d2ff101b22fe admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:36.607209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b0d50-17b8-4dc2-aa3c-d2ff101b22fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:36.607209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b0d50-17b8-4dc2-aa3c-d2ff101b22fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:36.607209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b0d50-17b8-4dc2-aa3c-d2ff101b22fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:36.609227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b0d50-17b8-4dc2-aa3c-d2ff101b22fe admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:36.614160 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3868/7686] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:36.639069 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3819/7687] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:30:36.639866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b0d50-17b8-4dc2-aa3c-d2ff101b22fe admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:36.640755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02238463-3d1b-49cf-8924-cf3026c9f8c4 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:36.642731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-02238463-3d1b-49cf-8924-cf3026c9f8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:36.652633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b0d50-17b8-4dc2-aa3c-d2ff101b22fe admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:36.675474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab7a08-ce2d-433c-ac5c-2b0d795d960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:36.677279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab7a08-ce2d-433c-ac5c-2b0d795d960a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:36.677505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab7a08-ce2d-433c-ac5c-2b0d795d960a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:36.677768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab7a08-ce2d-433c-ac5c-2b0d795d960a admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:36.679063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab7a08-ce2d-433c-ac5c-2b0d795d960a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:36.681721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab7a08-ce2d-433c-ac5c-2b0d795d960a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:36.723223 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3820/7688] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:36.724550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab7a08-ce2d-433c-ac5c-2b0d795d960a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:36.724671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:36.761329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab7a08-ce2d-433c-ac5c-2b0d795d960a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:36.771401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02238463-3d1b-49cf-8924-cf3026c9f8c4 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:36.772639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224ea11-7c99-4a03-ae20-097bd5886779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:36.773383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224ea11-7c99-4a03-ae20-097bd5886779 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:36.773678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224ea11-7c99-4a03-ae20-097bd5886779 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:36.773967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224ea11-7c99-4a03-ae20-097bd5886779 admin admin] PATH_INFO: `/v3/projects/be195e90c98548f8a352aa37f02acd63/users/58883712558f43d08eae47f7c84f447c/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:36.786741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efceb90a-a3be-4fba-9a3e-b48a00067623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:36.788188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceb90a-a3be-4fba-9a3e-b48a00067623 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:36.788562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceb90a-a3be-4fba-9a3e-b48a00067623 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:36.788925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceb90a-a3be-4fba-9a3e-b48a00067623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:36.792109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-efceb90a-a3be-4fba-9a3e-b48a00067623 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:36.804837 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224ea11-7c99-4a03-ae20-097bd5886779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be195e90c98548f8a352aa37f02acd63, user_id=58883712558f43d08eae47f7c84f447c, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:36.810145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224ea11-7c99-4a03-ae20-097bd5886779 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:36.836386 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3821/7689] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:36 2022] PUT /identity/v3/projects/be195e90c98548f8a352aa37f02acd63/users/58883712558f43d08eae47f7c84f447c/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:36.848509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4828-995a-4317-b1a5-f8e22fbf5274 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:36.849471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4828-995a-4317-b1a5-f8e22fbf5274 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:36.850062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4828-995a-4317-b1a5-f8e22fbf5274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:36.904163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6d4d4828-995a-4317-b1a5-f8e22fbf5274 None None] MFA Rules not processed for user `58883712558f43d08eae47f7c84f447c`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:36.906413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6d4d4828-995a-4317-b1a5-f8e22fbf5274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:36.944943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efceb90a-a3be-4fba-9a3e-b48a00067623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:36.950828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efceb90a-a3be-4fba-9a3e-b48a00067623 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:36.976148 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3869/7690] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:37.114060 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3822/7691] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:37.127531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efceb90a-a3be-4fba-9a3e-b48a00067623 service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:37.130175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-efceb90a-a3be-4fba-9a3e-b48a00067623 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:37.153944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efceb90a-a3be-4fba-9a3e-b48a00067623 service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:37.258432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89f9a4-0225-49f5-858e-781c1bced71f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:37.260255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89f9a4-0225-49f5-858e-781c1bced71f service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:37.260822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89f9a4-0225-49f5-858e-781c1bced71f service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:37.261726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89f9a4-0225-49f5-858e-781c1bced71f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:37.275523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89f9a4-0225-49f5-858e-781c1bced71f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:37.277908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89f9a4-0225-49f5-858e-781c1bced71f service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:37.300218 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3870/7692] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:38.433343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca28f8-99e3-4d4e-9fd1-f90c10edb3f6 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:38.434436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca28f8-99e3-4d4e-9fd1-f90c10edb3f6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:38.435373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca28f8-99e3-4d4e-9fd1-f90c10edb3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:38.495085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c8ca28f8-99e3-4d4e-9fd1-f90c10edb3f6 None None] MFA Rules not processed for user `937935818cda4a6e8b9104d38aa3a8b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:38.500859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c8ca28f8-99e3-4d4e-9fd1-f90c10edb3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:38.672825 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3823/7693] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:38.685235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89f9a4-0225-49f5-858e-781c1bced71f service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:38.699810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89f9a4-0225-49f5-858e-781c1bced71f service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:38.710191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d384d7-09e0-4821-b570-1aa663741426 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:38.710849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d384d7-09e0-4821-b570-1aa663741426 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:38.711142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d384d7-09e0-4821-b570-1aa663741426 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:38.711499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d384d7-09e0-4821-b570-1aa663741426 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:38.733967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d384d7-09e0-4821-b570-1aa663741426 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:38.737682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d384d7-09e0-4821-b570-1aa663741426 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:38.764758 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3871/7694] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:30:38.964289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca28f8-99e3-4d4e-9fd1-f90c10edb3f6 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:38.971171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c8ca28f8-99e3-4d4e-9fd1-f90c10edb3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:39.057827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:39.118000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca28f8-99e3-4d4e-9fd1-f90c10edb3f6 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:39.118000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801f091-c033-49b8-9491-2ba1f39eb15a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:39.118496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801f091-c033-49b8-9491-2ba1f39eb15a service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:39.118810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801f091-c033-49b8-9491-2ba1f39eb15a service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:39.119090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801f091-c033-49b8-9491-2ba1f39eb15a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:39.123667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f801f091-c033-49b8-9491-2ba1f39eb15a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:39.269579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801f091-c033-49b8-9491-2ba1f39eb15a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:39.275482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801f091-c033-49b8-9491-2ba1f39eb15a service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:39.347811 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3824/7695] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:41.996049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d384d7-09e0-4821-b570-1aa663741426 service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:42.017331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d384d7-09e0-4821-b570-1aa663741426 service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:42.027161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146cbd7-2e37-4b31-96b0-fd3f43e4996a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:42.028003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146cbd7-2e37-4b31-96b0-fd3f43e4996a service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:42.028298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146cbd7-2e37-4b31-96b0-fd3f43e4996a service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:42.028621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146cbd7-2e37-4b31-96b0-fd3f43e4996a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:42.033267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d146cbd7-2e37-4b31-96b0-fd3f43e4996a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:42.068463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146cbd7-2e37-4b31-96b0-fd3f43e4996a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:42.069946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146cbd7-2e37-4b31-96b0-fd3f43e4996a service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:42.110697 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3872/7696] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:42.712490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801f091-c033-49b8-9491-2ba1f39eb15a service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:42.725115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801f091-c033-49b8-9491-2ba1f39eb15a service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:42.729865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67b65f-5b36-4e16-a20c-7d5debec6452 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:42.730827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67b65f-5b36-4e16-a20c-7d5debec6452 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:42.731213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67b65f-5b36-4e16-a20c-7d5debec6452 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:42.731643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67b65f-5b36-4e16-a20c-7d5debec6452 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:42.802944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67b65f-5b36-4e16-a20c-7d5debec6452 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:42.804921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67b65f-5b36-4e16-a20c-7d5debec6452 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:42.816516 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3825/7697] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:48.283672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146cbd7-2e37-4b31-96b0-fd3f43e4996a service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:48.376897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146cbd7-2e37-4b31-96b0-fd3f43e4996a service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:48.396424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae732e-1923-4031-9077-c51dce71e7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:48.400392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae732e-1923-4031-9077-c51dce71e7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:48.400684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae732e-1923-4031-9077-c51dce71e7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:48.401607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae732e-1923-4031-9077-c51dce71e7e2 admin admin] PATH_INFO: `/v3/users/fb3c692ee32d4e61aa6fc5a6c08af4d5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:48.410701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae732e-1923-4031-9077-c51dce71e7e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb3c692ee32d4e61aa6fc5a6c08af4d5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:48.419647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae732e-1923-4031-9077-c51dce71e7e2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:48.444748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:48.538941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d1ae732e-1923-4031-9077-c51dce71e7e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb3c692ee32d4e61aa6fc5a6c08af4d5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:48.576983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d1ae732e-1923-4031-9077-c51dce71e7e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb3c692ee32d4e61aa6fc5a6c08af4d5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:48.580285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d1ae732e-1923-4031-9077-c51dce71e7e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb3c692ee32d4e61aa6fc5a6c08af4d5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:48.597217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d1ae732e-1923-4031-9077-c51dce71e7e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb3c692ee32d4e61aa6fc5a6c08af4d5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:48.599740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d1ae732e-1923-4031-9077-c51dce71e7e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb3c692ee32d4e61aa6fc5a6c08af4d5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:48.637867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40053eca-636e-4044-94fc-4c7dc9f4c6c0 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:48.638501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40053eca-636e-4044-94fc-4c7dc9f4c6c0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:48.638600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40053eca-636e-4044-94fc-4c7dc9f4c6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:48.657776 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3873/7698] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:30:48 2022] DELETE /identity/v3/users/fb3c692ee32d4e61aa6fc5a6c08af4d5 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:48.689568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-40053eca-636e-4044-94fc-4c7dc9f4c6c0 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:48.690975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-40053eca-636e-4044-94fc-4c7dc9f4c6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:48.780950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:48.795189 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3826/7699] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:48.858651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae732e-1923-4031-9077-c51dce71e7e2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:48.859673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d1ae732e-1923-4031-9077-c51dce71e7e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:49.012461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae732e-1923-4031-9077-c51dce71e7e2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:49.018869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd147a3-279e-40a9-b226-d1c9dbe630db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:49.027620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd147a3-279e-40a9-b226-d1c9dbe630db service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:49.027620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd147a3-279e-40a9-b226-d1c9dbe630db service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:49.027620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd147a3-279e-40a9-b226-d1c9dbe630db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:49.077693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd147a3-279e-40a9-b226-d1c9dbe630db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:49.080707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd147a3-279e-40a9-b226-d1c9dbe630db service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:49.114707 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3874/7700] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:49.686233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40053eca-636e-4044-94fc-4c7dc9f4c6c0 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:49.688344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-40053eca-636e-4044-94fc-4c7dc9f4c6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:49.708125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40053eca-636e-4044-94fc-4c7dc9f4c6c0 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:49.731676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede23e6a-ce09-4a97-84bd-8813a9d3b0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:49.733099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede23e6a-ce09-4a97-84bd-8813a9d3b0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:49.733099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede23e6a-ce09-4a97-84bd-8813a9d3b0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:49.733464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede23e6a-ce09-4a97-84bd-8813a9d3b0d6 admin admin] PATH_INFO: `/v3/projects/782c0622189b4280954eb7b23d276505` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:49.735130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede23e6a-ce09-4a97-84bd-8813a9d3b0d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=782c0622189b4280954eb7b23d276505)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:49.740642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede23e6a-ce09-4a97-84bd-8813a9d3b0d6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:49.869273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ede23e6a-ce09-4a97-84bd-8813a9d3b0d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '782c0622189b4280954eb7b23d276505', 'request_id': 'req-ede23e6a-ce09-4a97-84bd-8813a9d3b0d6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:49.885630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ede23e6a-ce09-4a97-84bd-8813a9d3b0d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '782c0622189b4280954eb7b23d276505', 'request_id': 'req-ede23e6a-ce09-4a97-84bd-8813a9d3b0d6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:49.908904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ede23e6a-ce09-4a97-84bd-8813a9d3b0d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '782c0622189b4280954eb7b23d276505', 'request_id': 'req-ede23e6a-ce09-4a97-84bd-8813a9d3b0d6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:49.948172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ede23e6a-ce09-4a97-84bd-8813a9d3b0d6 admin admin] The token cache is being invalidate because project 782c0622189b4280954eb7b23d276505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:30:49.948172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ede23e6a-ce09-4a97-84bd-8813a9d3b0d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:49.948954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ede23e6a-ce09-4a97-84bd-8813a9d3b0d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:49.952369 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3827/7701] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:30:49 2022] DELETE /identity/v3/projects/782c0622189b4280954eb7b23d276505 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:49.957302 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd147a3-279e-40a9-b226-d1c9dbe630db service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:49.972974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd147a3-279e-40a9-b226-d1c9dbe630db service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:50.207110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2975281-d24e-495a-9109-6ac80a391f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:50.209886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2975281-d24e-495a-9109-6ac80a391f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:50.209886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2975281-d24e-495a-9109-6ac80a391f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:50.210269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2975281-d24e-495a-9109-6ac80a391f03 admin admin] PATH_INFO: `/v3/users/687e04d9904a45bf8b8597d51094aacc` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:50.217238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2975281-d24e-495a-9109-6ac80a391f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=687e04d9904a45bf8b8597d51094aacc)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:50.224163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2975281-d24e-495a-9109-6ac80a391f03 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:50.309191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede23e6a-ce09-4a97-84bd-8813a9d3b0d6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:50.312120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ede23e6a-ce09-4a97-84bd-8813a9d3b0d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:50.323144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:50.338481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede23e6a-ce09-4a97-84bd-8813a9d3b0d6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:50.345758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c2975281-d24e-495a-9109-6ac80a391f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '687e04d9904a45bf8b8597d51094aacc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:50.357201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11901f2-1538-4bdc-b951-4fafcd1e7152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:50.357872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11901f2-1538-4bdc-b951-4fafcd1e7152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:50.358155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11901f2-1538-4bdc-b951-4fafcd1e7152 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:50.358584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11901f2-1538-4bdc-b951-4fafcd1e7152 admin admin] PATH_INFO: `/v3/users/58883712558f43d08eae47f7c84f447c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:50.361374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11901f2-1538-4bdc-b951-4fafcd1e7152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58883712558f43d08eae47f7c84f447c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:50.363329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11901f2-1538-4bdc-b951-4fafcd1e7152 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:50.378849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c2975281-d24e-495a-9109-6ac80a391f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '687e04d9904a45bf8b8597d51094aacc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:50.378849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c2975281-d24e-495a-9109-6ac80a391f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '687e04d9904a45bf8b8597d51094aacc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:50.394633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c2975281-d24e-495a-9109-6ac80a391f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '687e04d9904a45bf8b8597d51094aacc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:50.395614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c2975281-d24e-495a-9109-6ac80a391f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '687e04d9904a45bf8b8597d51094aacc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:50.443055 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3875/7702] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:30:49 2022] DELETE /identity/v3/users/687e04d9904a45bf8b8597d51094aacc => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:50.518623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e11901f2-1538-4bdc-b951-4fafcd1e7152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58883712558f43d08eae47f7c84f447c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:50.521614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e11901f2-1538-4bdc-b951-4fafcd1e7152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58883712558f43d08eae47f7c84f447c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:50.604188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e11901f2-1538-4bdc-b951-4fafcd1e7152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58883712558f43d08eae47f7c84f447c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:50.605140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e11901f2-1538-4bdc-b951-4fafcd1e7152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58883712558f43d08eae47f7c84f447c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:50.619584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e11901f2-1538-4bdc-b951-4fafcd1e7152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58883712558f43d08eae47f7c84f447c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:50.648172 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3828/7703] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:30:50 2022] DELETE /identity/v3/users/58883712558f43d08eae47f7c84f447c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:50.653270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54285a-30f6-44a4-85b4-3f6db1b13ce5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:50.653902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54285a-30f6-44a4-85b4-3f6db1b13ce5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:50.654997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54285a-30f6-44a4-85b4-3f6db1b13ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:50.680771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-be54285a-30f6-44a4-85b4-3f6db1b13ce5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:50.682114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-be54285a-30f6-44a4-85b4-3f6db1b13ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:50.879639 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3876/7704] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:50.898321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11901f2-1538-4bdc-b951-4fafcd1e7152 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:50.898321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e11901f2-1538-4bdc-b951-4fafcd1e7152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:50.982729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11901f2-1538-4bdc-b951-4fafcd1e7152 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:50.987882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a4972-743e-4606-a10b-012f0f1dc53b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:50.988525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a4972-743e-4606-a10b-012f0f1dc53b service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:50.988807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a4972-743e-4606-a10b-012f0f1dc53b service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:50.989082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a4972-743e-4606-a10b-012f0f1dc53b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:51.022243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:51.026263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a4972-743e-4606-a10b-012f0f1dc53b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:51.027928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a4972-743e-4606-a10b-012f0f1dc53b service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:51.046551 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3829/7705] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:51.218948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54285a-30f6-44a4-85b4-3f6db1b13ce5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:51.226507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-be54285a-30f6-44a4-85b4-3f6db1b13ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:51.253862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54285a-30f6-44a4-85b4-3f6db1b13ce5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:51.271926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98dcd9-58a9-40df-8888-58612cb28335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:51.272154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98dcd9-58a9-40df-8888-58612cb28335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:51.272457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98dcd9-58a9-40df-8888-58612cb28335 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:51.272598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98dcd9-58a9-40df-8888-58612cb28335 admin admin] PATH_INFO: `/v3/projects/3066688ad2bf4c4c85e3819bb21cd70f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:51.273993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98dcd9-58a9-40df-8888-58612cb28335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3066688ad2bf4c4c85e3819bb21cd70f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:51.276055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98dcd9-58a9-40df-8888-58612cb28335 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:51.412269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5b98dcd9-58a9-40df-8888-58612cb28335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3066688ad2bf4c4c85e3819bb21cd70f', 'request_id': 'req-5b98dcd9-58a9-40df-8888-58612cb28335'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:51.428942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5b98dcd9-58a9-40df-8888-58612cb28335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3066688ad2bf4c4c85e3819bb21cd70f', 'request_id': 'req-5b98dcd9-58a9-40df-8888-58612cb28335'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:51.454809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5b98dcd9-58a9-40df-8888-58612cb28335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3066688ad2bf4c4c85e3819bb21cd70f', 'request_id': 'req-5b98dcd9-58a9-40df-8888-58612cb28335'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:51.494343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5b98dcd9-58a9-40df-8888-58612cb28335 admin admin] The token cache is being invalidate because project 3066688ad2bf4c4c85e3819bb21cd70f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:30:51.494922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5b98dcd9-58a9-40df-8888-58612cb28335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:51.496325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5b98dcd9-58a9-40df-8888-58612cb28335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:51.498681 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3877/7706] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:30:51 2022] DELETE /identity/v3/projects/3066688ad2bf4c4c85e3819bb21cd70f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:51.505314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11017667-4fc8-4d7f-afe4-45be97f86cb7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:51.505730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11017667-4fc8-4d7f-afe4-45be97f86cb7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:51.511000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11017667-4fc8-4d7f-afe4-45be97f86cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:51.545199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-11017667-4fc8-4d7f-afe4-45be97f86cb7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:51.546801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-11017667-4fc8-4d7f-afe4-45be97f86cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:51.584185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98dcd9-58a9-40df-8888-58612cb28335 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:51.590352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5b98dcd9-58a9-40df-8888-58612cb28335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:51.645300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:51.703718 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3830/7707] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:51.720919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2dca4-c4b1-4aad-8bb5-05a7e3ac5014 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:51.721379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2dca4-c4b1-4aad-8bb5-05a7e3ac5014 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:51.721770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2dca4-c4b1-4aad-8bb5-05a7e3ac5014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:51.722002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98dcd9-58a9-40df-8888-58612cb28335 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:51.737741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88651da4-22eb-4928-b7c6-0f3489547704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:51.738705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88651da4-22eb-4928-b7c6-0f3489547704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:51.738998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88651da4-22eb-4928-b7c6-0f3489547704 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:51.739277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88651da4-22eb-4928-b7c6-0f3489547704 admin admin] PATH_INFO: `/v3/projects/be195e90c98548f8a352aa37f02acd63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:51.746900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88651da4-22eb-4928-b7c6-0f3489547704 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be195e90c98548f8a352aa37f02acd63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:51.749583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88651da4-22eb-4928-b7c6-0f3489547704 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:51.760717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4ee2dca4-c4b1-4aad-8bb5-05a7e3ac5014 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:51.762318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4ee2dca4-c4b1-4aad-8bb5-05a7e3ac5014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:51.788906 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3831/7708] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:51.794319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2dca4-c4b1-4aad-8bb5-05a7e3ac5014 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:51.805994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2dca4-c4b1-4aad-8bb5-05a7e3ac5014 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:51.816090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-88651da4-22eb-4928-b7c6-0f3489547704 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be195e90c98548f8a352aa37f02acd63', 'request_id': 'req-88651da4-22eb-4928-b7c6-0f3489547704'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:51.824923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-88651da4-22eb-4928-b7c6-0f3489547704 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be195e90c98548f8a352aa37f02acd63', 'request_id': 'req-88651da4-22eb-4928-b7c6-0f3489547704'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:51.835736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-88651da4-22eb-4928-b7c6-0f3489547704 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be195e90c98548f8a352aa37f02acd63', 'request_id': 'req-88651da4-22eb-4928-b7c6-0f3489547704'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:51.854649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-88651da4-22eb-4928-b7c6-0f3489547704 admin admin] The token cache is being invalidate because project be195e90c98548f8a352aa37f02acd63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:30:51.855261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-88651da4-22eb-4928-b7c6-0f3489547704 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:51.857125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-88651da4-22eb-4928-b7c6-0f3489547704 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:51.859315 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3878/7709] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:30:51 2022] DELETE /identity/v3/projects/be195e90c98548f8a352aa37f02acd63 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:51.866195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86c13c-95a4-4ddd-8c3d-c59c9f9ea245 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:51.866840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86c13c-95a4-4ddd-8c3d-c59c9f9ea245 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:51.867502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86c13c-95a4-4ddd-8c3d-c59c9f9ea245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:51.887876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2a994-750e-4a2e-9107-dd8d30daebbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:51.890034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2a994-750e-4a2e-9107-dd8d30daebbd admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:51.890440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2a994-750e-4a2e-9107-dd8d30daebbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:51.890726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2a994-750e-4a2e-9107-dd8d30daebbd admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:51.891218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-de86c13c-95a4-4ddd-8c3d-c59c9f9ea245 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:51.891491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2a994-750e-4a2e-9107-dd8d30daebbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:30:51.891803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2a994-750e-4a2e-9107-dd8d30daebbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:51.892494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-de86c13c-95a4-4ddd-8c3d-c59c9f9ea245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:51.893716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2a994-750e-4a2e-9107-dd8d30daebbd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:51.915621 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3832/7710] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:30:51.922091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2a994-750e-4a2e-9107-dd8d30daebbd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:51.926750 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3879/7711] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:51.932390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fff2a994-750e-4a2e-9107-dd8d30daebbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:51.934921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc427e40-c0f2-4f59-bb36-02bf76904e13 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:51.936039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc427e40-c0f2-4f59-bb36-02bf76904e13 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:51.936039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc427e40-c0f2-4f59-bb36-02bf76904e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:51.959582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2a994-750e-4a2e-9107-dd8d30daebbd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:51.980457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49b147-7642-413b-8a38-f29de94c0b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:51.983123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49b147-7642-413b-8a38-f29de94c0b53 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:51.983435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49b147-7642-413b-8a38-f29de94c0b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:51.983724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49b147-7642-413b-8a38-f29de94c0b53 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:51.984439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49b147-7642-413b-8a38-f29de94c0b53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:51.986860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-dc427e40-c0f2-4f59-bb36-02bf76904e13 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:51.988077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-dc427e40-c0f2-4f59-bb36-02bf76904e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:51.990225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49b147-7642-413b-8a38-f29de94c0b53 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:52.021504 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3880/7712] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:30:52.022907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc427e40-c0f2-4f59-bb36-02bf76904e13 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:52.039036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc427e40-c0f2-4f59-bb36-02bf76904e13 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:52.051589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc7a23-2c46-4baf-87be-53bb1c4327ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:52.051589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc7a23-2c46-4baf-87be-53bb1c4327ee admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:52.051589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc7a23-2c46-4baf-87be-53bb1c4327ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:52.057136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc7a23-2c46-4baf-87be-53bb1c4327ee admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:52.061180 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3833/7713] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:51 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:52.061481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc7a23-2c46-4baf-87be-53bb1c4327ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:30:52.061481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc7a23-2c46-4baf-87be-53bb1c4327ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:52.062342 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc7a23-2c46-4baf-87be-53bb1c4327ee admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:52.063179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49b147-7642-413b-8a38-f29de94c0b53 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:52.090903 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3881/7714] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:30:52.096648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc7a23-2c46-4baf-87be-53bb1c4327ee admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:52.118312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc7a23-2c46-4baf-87be-53bb1c4327ee admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:52.171366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49b147-7642-413b-8a38-f29de94c0b53 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:52.182860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb57a1-250d-4222-9449-935495925e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:52.184416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb57a1-250d-4222-9449-935495925e1f admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:52.184728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb57a1-250d-4222-9449-935495925e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:52.185214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb57a1-250d-4222-9449-935495925e1f admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:52.185699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb57a1-250d-4222-9449-935495925e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:52.191917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb57a1-250d-4222-9449-935495925e1f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:52.215848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:52.243014 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3834/7715] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:52 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:30:52.249089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb57a1-250d-4222-9449-935495925e1f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:52.272342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb57a1-250d-4222-9449-935495925e1f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:52.273338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490018cb-b217-428f-96bc-277dc7ba864b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:52.274664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490018cb-b217-428f-96bc-277dc7ba864b admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:52.276286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490018cb-b217-428f-96bc-277dc7ba864b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:52.277767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490018cb-b217-428f-96bc-277dc7ba864b admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:52.280120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490018cb-b217-428f-96bc-277dc7ba864b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:52.282649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490018cb-b217-428f-96bc-277dc7ba864b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:52.294409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3ca7a-1047-42f8-b580-6caf9f13b75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:52.308451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3ca7a-1047-42f8-b580-6caf9f13b75e admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:52.308451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3ca7a-1047-42f8-b580-6caf9f13b75e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:52.308451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3ca7a-1047-42f8-b580-6caf9f13b75e admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:52.311343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3ca7a-1047-42f8-b580-6caf9f13b75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:52.313228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3ca7a-1047-42f8-b580-6caf9f13b75e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:52.338248 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3882/7716] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:52 2022] POST /identity/v3/projects => generated 379 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:52.344316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490018cb-b217-428f-96bc-277dc7ba864b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:52.371216 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3835/7717] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:30:52.378806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3ca7a-1047-42f8-b580-6caf9f13b75e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:52.409779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3ca7a-1047-42f8-b580-6caf9f13b75e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:52.418943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:52.541324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490018cb-b217-428f-96bc-277dc7ba864b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:52.545424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32804f2c-1ce8-41d5-87a6-e591ab498ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:52.549107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32804f2c-1ce8-41d5-87a6-e591ab498ebc admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:52.549428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32804f2c-1ce8-41d5-87a6-e591ab498ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:52.550130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32804f2c-1ce8-41d5-87a6-e591ab498ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:52.559168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32804f2c-1ce8-41d5-87a6-e591ab498ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:52.560154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c05d9d-bccb-4a64-9d9a-20fd7a2d9832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:52.560913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c05d9d-bccb-4a64-9d9a-20fd7a2d9832 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:52.561784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c05d9d-bccb-4a64-9d9a-20fd7a2d9832 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:52.562384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c05d9d-bccb-4a64-9d9a-20fd7a2d9832 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:52.563485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c05d9d-bccb-4a64-9d9a-20fd7a2d9832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:52.568485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c05d9d-bccb-4a64-9d9a-20fd7a2d9832 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:52.572613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32804f2c-1ce8-41d5-87a6-e591ab498ebc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:52.590308 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3836/7718] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:52.593296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32804f2c-1ce8-41d5-87a6-e591ab498ebc admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:52.611753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32804f2c-1ce8-41d5-87a6-e591ab498ebc admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:52.620821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a104e-7a15-4133-b453-b824e3c20e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:52.621647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a104e-7a15-4133-b453-b824e3c20e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:52.622472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a104e-7a15-4133-b453-b824e3c20e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:52.636209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a104e-7a15-4133-b453-b824e3c20e99 admin admin] PATH_INFO: `/v3/projects/0b1f9260542343d6a6d2956ec2ed7518/users/45bced0f04884bc1a63caa01f02e1be9/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:52.636658 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3883/7719] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:52 2022] POST /identity/v3/users => generated 290 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:52.641092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c05d9d-bccb-4a64-9d9a-20fd7a2d9832 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:52.663616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c05d9d-bccb-4a64-9d9a-20fd7a2d9832 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:52.692956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df514a8d-63f7-43bd-bbe2-dd17e219730c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:52.693741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df514a8d-63f7-43bd-bbe2-dd17e219730c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:52.694033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df514a8d-63f7-43bd-bbe2-dd17e219730c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:52.694303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df514a8d-63f7-43bd-bbe2-dd17e219730c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:52.695096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df514a8d-63f7-43bd-bbe2-dd17e219730c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:52.699026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df514a8d-63f7-43bd-bbe2-dd17e219730c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:52.715678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a104e-7a15-4133-b453-b824e3c20e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1f9260542343d6a6d2956ec2ed7518, user_id=45bced0f04884bc1a63caa01f02e1be9, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:52.718559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a104e-7a15-4133-b453-b824e3c20e99 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:52.720150 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3884/7720] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:52.728666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df514a8d-63f7-43bd-bbe2-dd17e219730c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:52.761737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df514a8d-63f7-43bd-bbe2-dd17e219730c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:52.765783 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3837/7721] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:52 2022] PUT /identity/v3/projects/0b1f9260542343d6a6d2956ec2ed7518/users/45bced0f04884bc1a63caa01f02e1be9/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:52.779789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d60afb-1012-46f8-9062-d48bd311e91b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:52.780924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d60afb-1012-46f8-9062-d48bd311e91b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:52.780924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d60afb-1012-46f8-9062-d48bd311e91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:52.828021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-82d60afb-1012-46f8-9062-d48bd311e91b None None] MFA Rules not processed for user `45bced0f04884bc1a63caa01f02e1be9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:52.829414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-82d60afb-1012-46f8-9062-d48bd311e91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:52.894995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20bb5f-2ab6-40cf-aea6-7561695507f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:52.896202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20bb5f-2ab6-40cf-aea6-7561695507f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:52.896604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20bb5f-2ab6-40cf-aea6-7561695507f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:52.896888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20bb5f-2ab6-40cf-aea6-7561695507f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:52.897654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20bb5f-2ab6-40cf-aea6-7561695507f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:52.899687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20bb5f-2ab6-40cf-aea6-7561695507f7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:52.916190 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3885/7722] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:52.921280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20bb5f-2ab6-40cf-aea6-7561695507f7 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:52.934785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20bb5f-2ab6-40cf-aea6-7561695507f7 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:52.942656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde27410-9dc9-42a9-9370-b4e0ac86fd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:52.943362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde27410-9dc9-42a9-9370-b4e0ac86fd87 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:52.943650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde27410-9dc9-42a9-9370-b4e0ac86fd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:52.944001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde27410-9dc9-42a9-9370-b4e0ac86fd87 admin admin] PATH_INFO: `/v3/projects/3a86a9e8f1d44b73adb7bb33147dea9f/users/5f44ac2dea0b425189757ec7991e60c2/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:52.956965 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3838/7723] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:52.968663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde27410-9dc9-42a9-9370-b4e0ac86fd87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a86a9e8f1d44b73adb7bb33147dea9f, user_id=5f44ac2dea0b425189757ec7991e60c2, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:52.972076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde27410-9dc9-42a9-9370-b4e0ac86fd87 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:52.980281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d60afb-1012-46f8-9062-d48bd311e91b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:52.981859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-82d60afb-1012-46f8-9062-d48bd311e91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:53.019477 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3886/7724] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:52 2022] PUT /identity/v3/projects/3a86a9e8f1d44b73adb7bb33147dea9f/users/5f44ac2dea0b425189757ec7991e60c2/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:53.026154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09924dbe-903b-4b80-90c4-7a84bd6539f4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:53.026590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09924dbe-903b-4b80-90c4-7a84bd6539f4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:53.026970 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09924dbe-903b-4b80-90c4-7a84bd6539f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:53.060842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:53.083069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-09924dbe-903b-4b80-90c4-7a84bd6539f4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:53.084502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-09924dbe-903b-4b80-90c4-7a84bd6539f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:53.084640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d60afb-1012-46f8-9062-d48bd311e91b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:53.184370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61d516-c29d-47ec-b5e8-ca3c7687e7d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:53.188116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61d516-c29d-47ec-b5e8-ca3c7687e7d9 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:53.188116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61d516-c29d-47ec-b5e8-ca3c7687e7d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:53.188116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61d516-c29d-47ec-b5e8-ca3c7687e7d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:53.208771 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3887/7725] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:53.221391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09924dbe-903b-4b80-90c4-7a84bd6539f4 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:53.223315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-09924dbe-903b-4b80-90c4-7a84bd6539f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:53.243329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:53.324422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61d516-c29d-47ec-b5e8-ca3c7687e7d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:53.324422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61d516-c29d-47ec-b5e8-ca3c7687e7d9 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:53.324656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09924dbe-903b-4b80-90c4-7a84bd6539f4 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:53.339198 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3839/7726] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:53.345436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9896673-03f0-44fa-9cec-1c16228d51b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:53.346173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9896673-03f0-44fa-9cec-1c16228d51b5 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:53.346818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9896673-03f0-44fa-9cec-1c16228d51b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:53.347407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9896673-03f0-44fa-9cec-1c16228d51b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:53.362865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61d516-c29d-47ec-b5e8-ca3c7687e7d9 service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:53.369773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9896673-03f0-44fa-9cec-1c16228d51b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:53.371557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9896673-03f0-44fa-9cec-1c16228d51b5 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:53.384318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61d516-c29d-47ec-b5e8-ca3c7687e7d9 service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:53.392357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda50dd-096a-4d6c-8202-2bed7e6cad4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:53.393201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda50dd-096a-4d6c-8202-2bed7e6cad4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:53.393597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda50dd-096a-4d6c-8202-2bed7e6cad4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:53.393969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda50dd-096a-4d6c-8202-2bed7e6cad4d admin admin] PATH_INFO: `/v3/users/45bced0f04884bc1a63caa01f02e1be9` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:53.395484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda50dd-096a-4d6c-8202-2bed7e6cad4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=45bced0f04884bc1a63caa01f02e1be9)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:53.398949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda50dd-096a-4d6c-8202-2bed7e6cad4d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:53.401670 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3888/7727] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:53.509744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8eda50dd-096a-4d6c-8202-2bed7e6cad4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45bced0f04884bc1a63caa01f02e1be9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:53.511597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8eda50dd-096a-4d6c-8202-2bed7e6cad4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45bced0f04884bc1a63caa01f02e1be9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:53.549584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8eda50dd-096a-4d6c-8202-2bed7e6cad4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45bced0f04884bc1a63caa01f02e1be9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:53.550499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8eda50dd-096a-4d6c-8202-2bed7e6cad4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45bced0f04884bc1a63caa01f02e1be9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:53.570789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8eda50dd-096a-4d6c-8202-2bed7e6cad4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45bced0f04884bc1a63caa01f02e1be9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:53.592693 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3840/7728] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:30:53 2022] DELETE /identity/v3/users/45bced0f04884bc1a63caa01f02e1be9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:30:53.596350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7cad9-39e9-40d6-97b9-3754d47cbb34 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:53.597536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7cad9-39e9-40d6-97b9-3754d47cbb34 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:53.598514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7cad9-39e9-40d6-97b9-3754d47cbb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:53.658302 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5cc7cad9-39e9-40d6-97b9-3754d47cbb34 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:53.661065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5cc7cad9-39e9-40d6-97b9-3754d47cbb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:53.778252 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3889/7729] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:53.808015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda50dd-096a-4d6c-8202-2bed7e6cad4d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:53.810399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8eda50dd-096a-4d6c-8202-2bed7e6cad4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:53.892380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:53.976789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda50dd-096a-4d6c-8202-2bed7e6cad4d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:53.983819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53021fa5-052c-434c-a720-1c8a7bf59529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:53.984612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53021fa5-052c-434c-a720-1c8a7bf59529 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:53.985068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53021fa5-052c-434c-a720-1c8a7bf59529 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:53.985909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53021fa5-052c-434c-a720-1c8a7bf59529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:54.006271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53021fa5-052c-434c-a720-1c8a7bf59529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:54.009984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53021fa5-052c-434c-a720-1c8a7bf59529 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:54.035544 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3841/7730] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:30:54.520576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7cad9-39e9-40d6-97b9-3754d47cbb34 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:54.531152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5cc7cad9-39e9-40d6-97b9-3754d47cbb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:54.556358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7cad9-39e9-40d6-97b9-3754d47cbb34 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:54.565803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33959a8c-3df8-4822-b86d-e1965ac92392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:54.566522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33959a8c-3df8-4822-b86d-e1965ac92392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:54.566810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33959a8c-3df8-4822-b86d-e1965ac92392 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:54.567130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33959a8c-3df8-4822-b86d-e1965ac92392 admin admin] PATH_INFO: `/v3/projects/0b1f9260542343d6a6d2956ec2ed7518` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:54.568734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33959a8c-3df8-4822-b86d-e1965ac92392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1f9260542343d6a6d2956ec2ed7518)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:54.572925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33959a8c-3df8-4822-b86d-e1965ac92392 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:54.667053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33959a8c-3df8-4822-b86d-e1965ac92392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1f9260542343d6a6d2956ec2ed7518', 'request_id': 'req-33959a8c-3df8-4822-b86d-e1965ac92392'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:54.674976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33959a8c-3df8-4822-b86d-e1965ac92392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1f9260542343d6a6d2956ec2ed7518', 'request_id': 'req-33959a8c-3df8-4822-b86d-e1965ac92392'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:54.691076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33959a8c-3df8-4822-b86d-e1965ac92392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1f9260542343d6a6d2956ec2ed7518', 'request_id': 'req-33959a8c-3df8-4822-b86d-e1965ac92392'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:54.720537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33959a8c-3df8-4822-b86d-e1965ac92392 admin admin] The token cache is being invalidate because project 0b1f9260542343d6a6d2956ec2ed7518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:30:54.720892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33959a8c-3df8-4822-b86d-e1965ac92392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:54.722873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-33959a8c-3df8-4822-b86d-e1965ac92392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:30:54.732934 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3890/7731] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:30:54 2022] DELETE /identity/v3/projects/0b1f9260542343d6a6d2956ec2ed7518 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:54.734279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3d269-25fe-4614-814c-92f78a086c2b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:54.734645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3d269-25fe-4614-814c-92f78a086c2b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:54.735156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3d269-25fe-4614-814c-92f78a086c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:54.783998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0ee3d269-25fe-4614-814c-92f78a086c2b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:54.785008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0ee3d269-25fe-4614-814c-92f78a086c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:54.896264 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3842/7732] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:54.904613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789dd03-ad88-4fc5-9182-1cb4a3724503 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:54.904909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789dd03-ad88-4fc5-9182-1cb4a3724503 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:54.905191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789dd03-ad88-4fc5-9182-1cb4a3724503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:54.943053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8789dd03-ad88-4fc5-9182-1cb4a3724503 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:54.944623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8789dd03-ad88-4fc5-9182-1cb4a3724503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:54.959953 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3891/7733] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:54.963346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3d269-25fe-4614-814c-92f78a086c2b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:54.982659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3d269-25fe-4614-814c-92f78a086c2b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:54.988971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0d8cb-f7a6-4a81-95ab-fae5db408099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:54.990376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0d8cb-f7a6-4a81-95ab-fae5db408099 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:54.990969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0d8cb-f7a6-4a81-95ab-fae5db408099 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:54.992153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0d8cb-f7a6-4a81-95ab-fae5db408099 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:54.993593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0d8cb-f7a6-4a81-95ab-fae5db408099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:30:54.993909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0d8cb-f7a6-4a81-95ab-fae5db408099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:54.995678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0d8cb-f7a6-4a81-95ab-fae5db408099 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:55.010477 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3843/7734] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:30:55.014577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789dd03-ad88-4fc5-9182-1cb4a3724503 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:55.025822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789dd03-ad88-4fc5-9182-1cb4a3724503 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:55.031390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3e546-b35b-4830-8eee-4f056e324ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:55.032260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3e546-b35b-4830-8eee-4f056e324ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:55.033314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3e546-b35b-4830-8eee-4f056e324ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:55.033314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3e546-b35b-4830-8eee-4f056e324ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:55.034631 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3e546-b35b-4830-8eee-4f056e324ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:55.036824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3e546-b35b-4830-8eee-4f056e324ff8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:55.093520 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3892/7735] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:30:55 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:55.094056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0d8cb-f7a6-4a81-95ab-fae5db408099 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:55.106423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0d8cb-f7a6-4a81-95ab-fae5db408099 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:55.223381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6822a3f-e6c9-4bc0-b1c9-dc12ee7483ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:55.224369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6822a3f-e6c9-4bc0-b1c9-dc12ee7483ac admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:55.224823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6822a3f-e6c9-4bc0-b1c9-dc12ee7483ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:55.225277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6822a3f-e6c9-4bc0-b1c9-dc12ee7483ac admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:55.226167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6822a3f-e6c9-4bc0-b1c9-dc12ee7483ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:55.229155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6822a3f-e6c9-4bc0-b1c9-dc12ee7483ac admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:55.268413 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3844/7736] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:30:55 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:30:55.268656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3e546-b35b-4830-8eee-4f056e324ff8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:55.284858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3e546-b35b-4830-8eee-4f056e324ff8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:55.296840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c6b9c-2843-4780-ae52-f7b89587915e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:55.297636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c6b9c-2843-4780-ae52-f7b89587915e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:55.297932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c6b9c-2843-4780-ae52-f7b89587915e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:55.298211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c6b9c-2843-4780-ae52-f7b89587915e admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:55.298921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c6b9c-2843-4780-ae52-f7b89587915e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:55.300611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c6b9c-2843-4780-ae52-f7b89587915e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:55.306459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:55.315812 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3893/7737] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:30:55.317025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6822a3f-e6c9-4bc0-b1c9-dc12ee7483ac admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:55.337970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6822a3f-e6c9-4bc0-b1c9-dc12ee7483ac admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:55.352704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3449b-7261-4f6b-9dc7-ea913c6996af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:55.357483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3449b-7261-4f6b-9dc7-ea913c6996af admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:55.357643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3449b-7261-4f6b-9dc7-ea913c6996af admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:55.357859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3449b-7261-4f6b-9dc7-ea913c6996af admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:55.359326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3449b-7261-4f6b-9dc7-ea913c6996af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:55.361986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3449b-7261-4f6b-9dc7-ea913c6996af admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:55.393997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c6b9c-2843-4780-ae52-f7b89587915e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:55.402727 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3845/7738] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:30:55.407731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c6b9c-2843-4780-ae52-f7b89587915e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:55.415012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefba576-5d89-43a7-8b4a-a80393133045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:55.415989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefba576-5d89-43a7-8b4a-a80393133045 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:55.416283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefba576-5d89-43a7-8b4a-a80393133045 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:55.416564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefba576-5d89-43a7-8b4a-a80393133045 admin admin] PATH_INFO: `/v3/projects/d3d6725c617b4a29a437ea385e84a684/users/0114359ded1f4ac588c8b1f0f31737ff/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:55.437750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefba576-5d89-43a7-8b4a-a80393133045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d6725c617b4a29a437ea385e84a684, user_id=0114359ded1f4ac588c8b1f0f31737ff, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:55.441216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefba576-5d89-43a7-8b4a-a80393133045 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:55.490923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1b397-faeb-486a-a4b8-975de574a828 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:55.491311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1b397-faeb-486a-a4b8-975de574a828 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:55.491488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1b397-faeb-486a-a4b8-975de574a828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:55.495363 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3894/7739] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:30:55 2022] PUT /identity/v3/projects/d3d6725c617b4a29a437ea385e84a684/users/0114359ded1f4ac588c8b1f0f31737ff/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:30:55.520670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-57a1b397-faeb-486a-a4b8-975de574a828 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:55.522014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-57a1b397-faeb-486a-a4b8-975de574a828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:55.568308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:55.618499 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3846/7740] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:55.634639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefba576-5d89-43a7-8b4a-a80393133045 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:55.642070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fefba576-5d89-43a7-8b4a-a80393133045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:55.766330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefba576-5d89-43a7-8b4a-a80393133045 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:55.772014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d683e5-b507-4191-8741-144ceda05899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:55.772757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d683e5-b507-4191-8741-144ceda05899 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:55.773379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d683e5-b507-4191-8741-144ceda05899 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:55.774048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d683e5-b507-4191-8741-144ceda05899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:55.794167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d683e5-b507-4191-8741-144ceda05899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:55.796845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d683e5-b507-4191-8741-144ceda05899 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:55.827395 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3895/7741] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:30:58.272419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab1a4e-a496-4397-afd7-491e2db70469 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:58.272941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab1a4e-a496-4397-afd7-491e2db70469 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:58.273053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab1a4e-a496-4397-afd7-491e2db70469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:58.300189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-61ab1a4e-a496-4397-afd7-491e2db70469 None None] MFA Rules not processed for user `937935818cda4a6e8b9104d38aa3a8b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:58.301486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-61ab1a4e-a496-4397-afd7-491e2db70469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:58.383231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d080cd-19ea-444f-a62d-a1b6d2191542 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:58.383826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d080cd-19ea-444f-a62d-a1b6d2191542 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:58.383944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d080cd-19ea-444f-a62d-a1b6d2191542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:58.389464 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3847/7742] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:58.430298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d8d080cd-19ea-444f-a62d-a1b6d2191542 None None] MFA Rules not processed for user `0114359ded1f4ac588c8b1f0f31737ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:30:58.431762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d8d080cd-19ea-444f-a62d-a1b6d2191542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:58.530757 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3896/7743] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:30:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:30:58.548464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab1a4e-a496-4397-afd7-491e2db70469 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:30:58.549936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-61ab1a4e-a496-4397-afd7-491e2db70469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:30:58.634890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab1a4e-a496-4397-afd7-491e2db70469 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:30:58.640904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c717a9-d94e-47af-82c3-2376e336e4cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:30:58.641734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c717a9-d94e-47af-82c3-2376e336e4cf service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:30:58.642128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c717a9-d94e-47af-82c3-2376e336e4cf service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:30:58.642535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c717a9-d94e-47af-82c3-2376e336e4cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:30:58.658716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c717a9-d94e-47af-82c3-2376e336e4cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:30:58.660543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c717a9-d94e-47af-82c3-2376e336e4cf service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:30:58.673013 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3848/7744] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:30:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:31:00.179281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc2828-8cff-46d9-b014-9c67739a4c0d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:00.179893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc2828-8cff-46d9-b014-9c67739a4c0d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:00.179995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc2828-8cff-46d9-b014-9c67739a4c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:00.205630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-65cc2828-8cff-46d9-b014-9c67739a4c0d None None] MFA Rules not processed for user `0114359ded1f4ac588c8b1f0f31737ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:31:00.207510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-65cc2828-8cff-46d9-b014-9c67739a4c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:00.243828 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3897/7745] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:31:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:31:00.360126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb691fc-76f9-4f99-9fba-7cf542b32648 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:00.360659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb691fc-76f9-4f99-9fba-7cf542b32648 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:00.360659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb691fc-76f9-4f99-9fba-7cf542b32648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:00.421979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fdb691fc-76f9-4f99-9fba-7cf542b32648 None None] MFA Rules not processed for user `5f44ac2dea0b425189757ec7991e60c2`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:31:00.424209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fdb691fc-76f9-4f99-9fba-7cf542b32648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:00.558543 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3849/7746] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:31:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:31:00.563318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc2828-8cff-46d9-b014-9c67739a4c0d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:00.564949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-65cc2828-8cff-46d9-b014-9c67739a4c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:00.587281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc2828-8cff-46d9-b014-9c67739a4c0d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:00.602536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff8add-75af-44c2-a44d-69b08017cb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:00.603770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff8add-75af-44c2-a44d-69b08017cb0f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:00.604374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff8add-75af-44c2-a44d-69b08017cb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:00.604866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff8add-75af-44c2-a44d-69b08017cb0f admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:00.605787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff8add-75af-44c2-a44d-69b08017cb0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:00.608431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff8add-75af-44c2-a44d-69b08017cb0f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:00.663740 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3898/7747] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:31:00 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:31:00.664935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb691fc-76f9-4f99-9fba-7cf542b32648 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:00.678590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb691fc-76f9-4f99-9fba-7cf542b32648 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:00.687765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:00.748787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407327b-1ea6-47da-8c64-10539891f628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:00.749740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407327b-1ea6-47da-8c64-10539891f628 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:00.749740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407327b-1ea6-47da-8c64-10539891f628 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:00.749963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407327b-1ea6-47da-8c64-10539891f628 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:00.750616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407327b-1ea6-47da-8c64-10539891f628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:00.752838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407327b-1ea6-47da-8c64-10539891f628 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:00.778936 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3850/7748] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:31:00 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:31:00.782897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff8add-75af-44c2-a44d-69b08017cb0f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:00.796043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff8add-75af-44c2-a44d-69b08017cb0f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:00.801909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b12d5-7e91-4c02-85a5-f8043a60841b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:00.802649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b12d5-7e91-4c02-85a5-f8043a60841b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:00.803038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b12d5-7e91-4c02-85a5-f8043a60841b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:00.803623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b12d5-7e91-4c02-85a5-f8043a60841b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:00.804756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b12d5-7e91-4c02-85a5-f8043a60841b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:00.806910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b12d5-7e91-4c02-85a5-f8043a60841b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:00.820529 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3899/7749] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:31:00.824985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407327b-1ea6-47da-8c64-10539891f628 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:00.837711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407327b-1ea6-47da-8c64-10539891f628 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:00.843119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d081b3-30cc-4eed-842a-809a309fd9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:00.843855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d081b3-30cc-4eed-842a-809a309fd9ad admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:00.844145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d081b3-30cc-4eed-842a-809a309fd9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:00.844426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d081b3-30cc-4eed-842a-809a309fd9ad admin admin] PATH_INFO: `/v3/projects/64cdc6c9eb7846959d6500d2a924839d/users/e536ee0cc07e4d69a47060a96d3a0593/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:00.862858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d081b3-30cc-4eed-842a-809a309fd9ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=64cdc6c9eb7846959d6500d2a924839d, user_id=e536ee0cc07e4d69a47060a96d3a0593, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:00.865980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d081b3-30cc-4eed-842a-809a309fd9ad admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:00.882775 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3851/7750] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:31:00 2022] PUT /identity/v3/projects/64cdc6c9eb7846959d6500d2a924839d/users/e536ee0cc07e4d69a47060a96d3a0593/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:31:00.886892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b12d5-7e91-4c02-85a5-f8043a60841b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:00.898734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b12d5-7e91-4c02-85a5-f8043a60841b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:00.936017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:00.977652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329c885-3ca1-4121-8494-cbdec5dd54c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:00.978392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329c885-3ca1-4121-8494-cbdec5dd54c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:00.978786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329c885-3ca1-4121-8494-cbdec5dd54c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:00.979139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329c885-3ca1-4121-8494-cbdec5dd54c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:00.979964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329c885-3ca1-4121-8494-cbdec5dd54c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:00.981680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329c885-3ca1-4121-8494-cbdec5dd54c5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:00.995335 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3900/7751] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:31:00.997735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d081b3-30cc-4eed-842a-809a309fd9ad admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:01.010773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d081b3-30cc-4eed-842a-809a309fd9ad admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:01.021186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c2f10-7656-448d-ab32-c42df07e857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:01.021678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c2f10-7656-448d-ab32-c42df07e857c admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:01.021964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c2f10-7656-448d-ab32-c42df07e857c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:01.022599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c2f10-7656-448d-ab32-c42df07e857c admin admin] PATH_INFO: `/v3/projects/64cdc6c9eb7846959d6500d2a924839d/users/e536ee0cc07e4d69a47060a96d3a0593/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:01.024885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c2f10-7656-448d-ab32-c42df07e857c admin admin] RBAC: Authorizing `identity:create_grant(project_id=64cdc6c9eb7846959d6500d2a924839d, user_id=e536ee0cc07e4d69a47060a96d3a0593, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:01.027630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c2f10-7656-448d-ab32-c42df07e857c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:01.044454 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3852/7752] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:31:00 2022] PUT /identity/v3/projects/64cdc6c9eb7846959d6500d2a924839d/users/e536ee0cc07e4d69a47060a96d3a0593/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:31:08.223188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9eb71-fe4a-4fef-9da8-6489a35be0ec None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:08.223687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9eb71-fe4a-4fef-9da8-6489a35be0ec None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:08.223866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9eb71-fe4a-4fef-9da8-6489a35be0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:08.258028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2cf9eb71-fe4a-4fef-9da8-6489a35be0ec None None] MFA Rules not processed for user `e536ee0cc07e4d69a47060a96d3a0593`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:31:08.259323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2cf9eb71-fe4a-4fef-9da8-6489a35be0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:08.344768 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3901/7753] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:31:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:31:08.356429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c2f10-7656-448d-ab32-c42df07e857c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:08.358806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-573c2f10-7656-448d-ab32-c42df07e857c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:08.461202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c2f10-7656-448d-ab32-c42df07e857c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:08.467383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10984cdc-7bf5-418e-85a4-f26d45e2c7b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:08.468106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10984cdc-7bf5-418e-85a4-f26d45e2c7b3 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:08.468395 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10984cdc-7bf5-418e-85a4-f26d45e2c7b3 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:08.468721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10984cdc-7bf5-418e-85a4-f26d45e2c7b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:08.490438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10984cdc-7bf5-418e-85a4-f26d45e2c7b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:08.492659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10984cdc-7bf5-418e-85a4-f26d45e2c7b3 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:08.513214 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3853/7754] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:31:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:31:08.776516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9eb71-fe4a-4fef-9da8-6489a35be0ec None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:08.780199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2cf9eb71-fe4a-4fef-9da8-6489a35be0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:08.878124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9eb71-fe4a-4fef-9da8-6489a35be0ec None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:08.883495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a4994-b273-482e-802f-d34a7b082cd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:08.883927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a4994-b273-482e-802f-d34a7b082cd1 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:08.884213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a4994-b273-482e-802f-d34a7b082cd1 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:08.884485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a4994-b273-482e-802f-d34a7b082cd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:08.886354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-071a4994-b273-482e-802f-d34a7b082cd1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:08.901583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a4994-b273-482e-802f-d34a7b082cd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:08.903205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a4994-b273-482e-802f-d34a7b082cd1 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:08.916803 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3902/7755] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:31:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:31:09.318954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10984cdc-7bf5-418e-85a4-f26d45e2c7b3 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:09.320436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-10984cdc-7bf5-418e-85a4-f26d45e2c7b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:09.337626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10984cdc-7bf5-418e-85a4-f26d45e2c7b3 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:09.342950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1eeb0-832f-4b57-b179-a880b7bd0e1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:09.343680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1eeb0-832f-4b57-b179-a880b7bd0e1c service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:09.343970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1eeb0-832f-4b57-b179-a880b7bd0e1c service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:09.344274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1eeb0-832f-4b57-b179-a880b7bd0e1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:09.346074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-07a1eeb0-832f-4b57-b179-a880b7bd0e1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:09.360511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1eeb0-832f-4b57-b179-a880b7bd0e1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:09.362085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1eeb0-832f-4b57-b179-a880b7bd0e1c service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:09.376202 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3854/7756] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:31:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:31:18.909877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=86 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:19.198842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a4994-b273-482e-802f-d34a7b082cd1 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:19.270697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a4994-b273-482e-802f-d34a7b082cd1 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:19.275175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2a606-468b-4279-98df-0a60c3a96b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:19.275859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2a606-468b-4279-98df-0a60c3a96b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:19.276143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2a606-468b-4279-98df-0a60c3a96b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:19.276422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2a606-468b-4279-98df-0a60c3a96b88 admin admin] PATH_INFO: `/v3/users/5f44ac2dea0b425189757ec7991e60c2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:19.277576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2a606-468b-4279-98df-0a60c3a96b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f44ac2dea0b425189757ec7991e60c2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:19.279518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2a606-468b-4279-98df-0a60c3a96b88 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:19.326285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a8f2a606-468b-4279-98df-0a60c3a96b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f44ac2dea0b425189757ec7991e60c2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:31:19.338068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a8f2a606-468b-4279-98df-0a60c3a96b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f44ac2dea0b425189757ec7991e60c2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:31:19.338741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a8f2a606-468b-4279-98df-0a60c3a96b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f44ac2dea0b425189757ec7991e60c2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:31:19.345638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a8f2a606-468b-4279-98df-0a60c3a96b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f44ac2dea0b425189757ec7991e60c2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:31:19.346286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a8f2a606-468b-4279-98df-0a60c3a96b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f44ac2dea0b425189757ec7991e60c2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:31:19.360005 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3903/7757] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:31:19 2022] DELETE /identity/v3/users/5f44ac2dea0b425189757ec7991e60c2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:31:19.368595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=79,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:19.566085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1eeb0-832f-4b57-b179-a880b7bd0e1c service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:19.587268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1eeb0-832f-4b57-b179-a880b7bd0e1c service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:19.678525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11296732-28d5-4af2-b746-6a4139691757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:19.679261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11296732-28d5-4af2-b746-6a4139691757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:19.679637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11296732-28d5-4af2-b746-6a4139691757 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:19.679886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11296732-28d5-4af2-b746-6a4139691757 admin admin] PATH_INFO: `/v3/projects/3a86a9e8f1d44b73adb7bb33147dea9f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:19.681292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11296732-28d5-4af2-b746-6a4139691757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a86a9e8f1d44b73adb7bb33147dea9f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:19.683473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11296732-28d5-4af2-b746-6a4139691757 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:19.746675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-11296732-28d5-4af2-b746-6a4139691757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a86a9e8f1d44b73adb7bb33147dea9f', 'request_id': 'req-11296732-28d5-4af2-b746-6a4139691757'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:31:19.754236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-11296732-28d5-4af2-b746-6a4139691757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a86a9e8f1d44b73adb7bb33147dea9f', 'request_id': 'req-11296732-28d5-4af2-b746-6a4139691757'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:31:19.761282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-11296732-28d5-4af2-b746-6a4139691757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a86a9e8f1d44b73adb7bb33147dea9f', 'request_id': 'req-11296732-28d5-4af2-b746-6a4139691757'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:31:19.774677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-11296732-28d5-4af2-b746-6a4139691757 admin admin] The token cache is being invalidate because project 3a86a9e8f1d44b73adb7bb33147dea9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:31:19.775085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-11296732-28d5-4af2-b746-6a4139691757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:31:19.775783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-11296732-28d5-4af2-b746-6a4139691757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:31:19.777284 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3855/7758] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:31:19 2022] DELETE /identity/v3/projects/3a86a9e8f1d44b73adb7bb33147dea9f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:31:19.781374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2a606-468b-4279-98df-0a60c3a96b88 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:19.782804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a8f2a606-468b-4279-98df-0a60c3a96b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:19.795828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2a606-468b-4279-98df-0a60c3a96b88 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:19.851577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae401a-5cd1-480d-93ea-beecd221ad5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:19.852219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae401a-5cd1-480d-93ea-beecd221ad5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:19.852503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae401a-5cd1-480d-93ea-beecd221ad5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:19.852778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae401a-5cd1-480d-93ea-beecd221ad5f admin admin] PATH_INFO: `/v3/users/e536ee0cc07e4d69a47060a96d3a0593` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:19.853932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae401a-5cd1-480d-93ea-beecd221ad5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e536ee0cc07e4d69a47060a96d3a0593)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:19.855879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae401a-5cd1-480d-93ea-beecd221ad5f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:19.879903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:19.907676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2fae401a-5cd1-480d-93ea-beecd221ad5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e536ee0cc07e4d69a47060a96d3a0593'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:31:19.919575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2fae401a-5cd1-480d-93ea-beecd221ad5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e536ee0cc07e4d69a47060a96d3a0593'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:31:19.920250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2fae401a-5cd1-480d-93ea-beecd221ad5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e536ee0cc07e4d69a47060a96d3a0593'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:31:19.927469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2fae401a-5cd1-480d-93ea-beecd221ad5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e536ee0cc07e4d69a47060a96d3a0593'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:31:19.928133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-2fae401a-5cd1-480d-93ea-beecd221ad5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e536ee0cc07e4d69a47060a96d3a0593'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:31:19.942220 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3904/7759] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:31:19 2022] DELETE /identity/v3/users/e536ee0cc07e4d69a47060a96d3a0593 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:31:20.151517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11296732-28d5-4af2-b746-6a4139691757 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:20.153210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-11296732-28d5-4af2-b746-6a4139691757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:20.179984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11296732-28d5-4af2-b746-6a4139691757 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:20.244011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93ffa2-b404-4f7c-a280-a11975c8915d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:20.244873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93ffa2-b404-4f7c-a280-a11975c8915d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:20.245126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93ffa2-b404-4f7c-a280-a11975c8915d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:20.245417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93ffa2-b404-4f7c-a280-a11975c8915d admin admin] PATH_INFO: `/v3/projects/64cdc6c9eb7846959d6500d2a924839d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:20.246597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93ffa2-b404-4f7c-a280-a11975c8915d admin admin] RBAC: Authorizing `identity:delete_project(project_id=64cdc6c9eb7846959d6500d2a924839d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:20.248541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93ffa2-b404-4f7c-a280-a11975c8915d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:20.290461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:20.307056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0a93ffa2-b404-4f7c-a280-a11975c8915d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64cdc6c9eb7846959d6500d2a924839d', 'request_id': 'req-0a93ffa2-b404-4f7c-a280-a11975c8915d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:31:20.316302 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fd197-2b45-4b70-a2a8-c6bd81c927c0 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:20.316598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fd197-2b45-4b70-a2a8-c6bd81c927c0 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:20.317466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fd197-2b45-4b70-a2a8-c6bd81c927c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:20.319983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0a93ffa2-b404-4f7c-a280-a11975c8915d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64cdc6c9eb7846959d6500d2a924839d', 'request_id': 'req-0a93ffa2-b404-4f7c-a280-a11975c8915d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:31:20.325853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0a93ffa2-b404-4f7c-a280-a11975c8915d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64cdc6c9eb7846959d6500d2a924839d', 'request_id': 'req-0a93ffa2-b404-4f7c-a280-a11975c8915d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:31:20.337131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0a93ffa2-b404-4f7c-a280-a11975c8915d admin admin] The token cache is being invalidate because project 64cdc6c9eb7846959d6500d2a924839d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:31:20.337287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a15fd197-2b45-4b70-a2a8-c6bd81c927c0 None None] MFA Rules not processed for user `0114359ded1f4ac588c8b1f0f31737ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:31:20.337579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0a93ffa2-b404-4f7c-a280-a11975c8915d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:31:20.338290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0a93ffa2-b404-4f7c-a280-a11975c8915d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:31:20.338472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a15fd197-2b45-4b70-a2a8-c6bd81c927c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:20.340158 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3856/7760] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:31:20 2022] DELETE /identity/v3/projects/64cdc6c9eb7846959d6500d2a924839d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:31:20.345956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426679a-9d5f-4916-9212-17d10abebfdc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:20.346398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426679a-9d5f-4916-9212-17d10abebfdc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:20.347209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426679a-9d5f-4916-9212-17d10abebfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:20.368792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d426679a-9d5f-4916-9212-17d10abebfdc None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:31:20.369996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d426679a-9d5f-4916-9212-17d10abebfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:20.396440 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3905/7761] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:31:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:31:20.434427 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3857/7762] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:31:20.443192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14ce4c-6bbe-4f4a-85b4-a06535d6d79d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:20.443694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14ce4c-6bbe-4f4a-85b4-a06535d6d79d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:20.444127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14ce4c-6bbe-4f4a-85b4-a06535d6d79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:20.470461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5a14ce4c-6bbe-4f4a-85b4-a06535d6d79d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:31:20.471806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5a14ce4c-6bbe-4f4a-85b4-a06535d6d79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:20.483331 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3906/7763] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:31:20.484536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426679a-9d5f-4916-9212-17d10abebfdc None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:20.494898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426679a-9d5f-4916-9212-17d10abebfdc None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:20.499577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1d04d-ca85-47da-a185-0515260ed60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:20.500195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1d04d-ca85-47da-a185-0515260ed60c admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:20.500483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1d04d-ca85-47da-a185-0515260ed60c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:20.500761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1d04d-ca85-47da-a185-0515260ed60c admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:20.501714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1d04d-ca85-47da-a185-0515260ed60c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:31:20.502027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1d04d-ca85-47da-a185-0515260ed60c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:20.503682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1d04d-ca85-47da-a185-0515260ed60c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:20.515990 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3858/7764] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:31:20.520303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14ce4c-6bbe-4f4a-85b4-a06535d6d79d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:20.534470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14ce4c-6bbe-4f4a-85b4-a06535d6d79d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:20.539921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e204d72-62ae-4292-807f-8ac30312fdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:20.540542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e204d72-62ae-4292-807f-8ac30312fdc4 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:20.540829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e204d72-62ae-4292-807f-8ac30312fdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:20.541106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e204d72-62ae-4292-807f-8ac30312fdc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:20.541785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e204d72-62ae-4292-807f-8ac30312fdc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:20.543731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e204d72-62ae-4292-807f-8ac30312fdc4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:20.574163 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3907/7765] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:31:20 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:31:20.578601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1d04d-ca85-47da-a185-0515260ed60c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:20.593132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1d04d-ca85-47da-a185-0515260ed60c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:20.664629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38b9d7-552f-47fd-b012-57760c4878b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:20.665675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38b9d7-552f-47fd-b012-57760c4878b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:20.666021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38b9d7-552f-47fd-b012-57760c4878b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:20.666476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38b9d7-552f-47fd-b012-57760c4878b6 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:20.667356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38b9d7-552f-47fd-b012-57760c4878b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:20.669835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38b9d7-552f-47fd-b012-57760c4878b6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:20.699530 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3859/7766] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:31:20 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:31:20.701153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e204d72-62ae-4292-807f-8ac30312fdc4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:20.712630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e204d72-62ae-4292-807f-8ac30312fdc4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:20.717894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc8a55-e4a4-4c2a-929f-420248b6510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:20.718528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc8a55-e4a4-4c2a-929f-420248b6510d admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:20.718818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc8a55-e4a4-4c2a-929f-420248b6510d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:20.719098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc8a55-e4a4-4c2a-929f-420248b6510d admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:20.719834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc8a55-e4a4-4c2a-929f-420248b6510d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:20.721538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc8a55-e4a4-4c2a-929f-420248b6510d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:20.739336 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3908/7767] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:31:20.741004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38b9d7-552f-47fd-b012-57760c4878b6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:20.753851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38b9d7-552f-47fd-b012-57760c4878b6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:20.758982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3b094-352a-4b25-b203-b9687396f985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:20.759648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3b094-352a-4b25-b203-b9687396f985 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:20.760031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3b094-352a-4b25-b203-b9687396f985 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:20.760406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3b094-352a-4b25-b203-b9687396f985 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:20.761045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3b094-352a-4b25-b203-b9687396f985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:20.762866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3b094-352a-4b25-b203-b9687396f985 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:20.921668 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3860/7768] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:31:20.926030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc8a55-e4a4-4c2a-929f-420248b6510d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:20.937012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc8a55-e4a4-4c2a-929f-420248b6510d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:20.942144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282ba3f-fcb4-497d-bd93-74fbdb037811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:20.943072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282ba3f-fcb4-497d-bd93-74fbdb037811 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:20.943474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282ba3f-fcb4-497d-bd93-74fbdb037811 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:20.944238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282ba3f-fcb4-497d-bd93-74fbdb037811 admin admin] PATH_INFO: `/v3/projects/a7d4e94f74394e9bb5479101cbef31a5/users/63adb611da12496b91e533c6ec93f415/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:20.962349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282ba3f-fcb4-497d-bd93-74fbdb037811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7d4e94f74394e9bb5479101cbef31a5, user_id=63adb611da12496b91e533c6ec93f415, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:20.965317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282ba3f-fcb4-497d-bd93-74fbdb037811 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:20.982787 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3909/7769] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:31:20 2022] PUT /identity/v3/projects/a7d4e94f74394e9bb5479101cbef31a5/users/63adb611da12496b91e533c6ec93f415/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:31:20.988785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1231718-748f-4bf0-a345-208ab48d74d1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:20.989324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1231718-748f-4bf0-a345-208ab48d74d1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:20.990075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1231718-748f-4bf0-a345-208ab48d74d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:21.020847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c1231718-748f-4bf0-a345-208ab48d74d1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:31:21.022796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c1231718-748f-4bf0-a345-208ab48d74d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:21.050934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:21.124274 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3861/7770] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:31:21.137399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282ba3f-fcb4-497d-bd93-74fbdb037811 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:21.141218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a282ba3f-fcb4-497d-bd93-74fbdb037811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:21.202838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:21.230430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282ba3f-fcb4-497d-bd93-74fbdb037811 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:21.236027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54484c-4bb7-41bf-b87d-c19932af3bfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:21.236867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54484c-4bb7-41bf-b87d-c19932af3bfc service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:21.237255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54484c-4bb7-41bf-b87d-c19932af3bfc service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:21.237711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54484c-4bb7-41bf-b87d-c19932af3bfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:21.251388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54484c-4bb7-41bf-b87d-c19932af3bfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:21.253137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54484c-4bb7-41bf-b87d-c19932af3bfc service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:21.266726 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3910/7771] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:31:21.343679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1231718-748f-4bf0-a345-208ab48d74d1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:21.364024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1231718-748f-4bf0-a345-208ab48d74d1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:21.373174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7320d-f12e-4a00-aaf0-06d60b0ed54f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:21.373865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7320d-f12e-4a00-aaf0-06d60b0ed54f service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:21.374117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7320d-f12e-4a00-aaf0-06d60b0ed54f service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:21.374400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7320d-f12e-4a00-aaf0-06d60b0ed54f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:21.383624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-59c7320d-f12e-4a00-aaf0-06d60b0ed54f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:21.406139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7320d-f12e-4a00-aaf0-06d60b0ed54f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:21.408651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7320d-f12e-4a00-aaf0-06d60b0ed54f service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:21.423229 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3862/7772] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:31:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:31:25.036887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54484c-4bb7-41bf-b87d-c19932af3bfc service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:25.055913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54484c-4bb7-41bf-b87d-c19932af3bfc service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:25.061767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e5733-2b55-4c7d-9db3-43a3427faf57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:25.064105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e5733-2b55-4c7d-9db3-43a3427faf57 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:25.064600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e5733-2b55-4c7d-9db3-43a3427faf57 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:25.064925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e5733-2b55-4c7d-9db3-43a3427faf57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:25.066984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d20e5733-2b55-4c7d-9db3-43a3427faf57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:25.079636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e5733-2b55-4c7d-9db3-43a3427faf57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:25.081010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e5733-2b55-4c7d-9db3-43a3427faf57 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:25.094904 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3911/7773] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:31:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:31:28.222898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91ce2d-1660-4e0b-8d83-87b8e0d97b30 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:28.223374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91ce2d-1660-4e0b-8d83-87b8e0d97b30 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:28.223493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91ce2d-1660-4e0b-8d83-87b8e0d97b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:28.252474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fb91ce2d-1660-4e0b-8d83-87b8e0d97b30 None None] MFA Rules not processed for user `63adb611da12496b91e533c6ec93f415`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:31:28.253955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fb91ce2d-1660-4e0b-8d83-87b8e0d97b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:28.349957 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3863/7774] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:31:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:31:28.353440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e5733-2b55-4c7d-9db3-43a3427faf57 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:28.368275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e5733-2b55-4c7d-9db3-43a3427faf57 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:28.373452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975a187-ab0f-48e9-8a9c-1027d81baa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:28.374389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975a187-ab0f-48e9-8a9c-1027d81baa42 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:28.374770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975a187-ab0f-48e9-8a9c-1027d81baa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:28.375359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975a187-ab0f-48e9-8a9c-1027d81baa42 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:28.376231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975a187-ab0f-48e9-8a9c-1027d81baa42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:28.378613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975a187-ab0f-48e9-8a9c-1027d81baa42 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:28.447396 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3912/7775] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:31:28 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:31:28.449872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91ce2d-1660-4e0b-8d83-87b8e0d97b30 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:28.465433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91ce2d-1660-4e0b-8d83-87b8e0d97b30 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:28.537682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7f67f-6f79-40af-83cf-ee09c8335263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:28.538326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7f67f-6f79-40af-83cf-ee09c8335263 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:28.538617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7f67f-6f79-40af-83cf-ee09c8335263 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:28.538896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7f67f-6f79-40af-83cf-ee09c8335263 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:28.539610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7f67f-6f79-40af-83cf-ee09c8335263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:28.541563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7f67f-6f79-40af-83cf-ee09c8335263 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:28.569938 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3864/7776] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:31:28 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:31:28.574262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975a187-ab0f-48e9-8a9c-1027d81baa42 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:28.591908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975a187-ab0f-48e9-8a9c-1027d81baa42 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:28.598636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad57de4-64fb-4186-bf99-a085dc03cec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:28.599256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad57de4-64fb-4186-bf99-a085dc03cec5 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:28.599702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad57de4-64fb-4186-bf99-a085dc03cec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:28.599898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad57de4-64fb-4186-bf99-a085dc03cec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:28.600644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad57de4-64fb-4186-bf99-a085dc03cec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:28.602329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad57de4-64fb-4186-bf99-a085dc03cec5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:28.627910 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3913/7777] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:31:28.635440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7f67f-6f79-40af-83cf-ee09c8335263 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:28.651559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7f67f-6f79-40af-83cf-ee09c8335263 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:28.658641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906d688-5b5d-47fc-b822-688c2169756e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:28.660244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906d688-5b5d-47fc-b822-688c2169756e admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:28.661062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906d688-5b5d-47fc-b822-688c2169756e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:28.661275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906d688-5b5d-47fc-b822-688c2169756e admin admin] PATH_INFO: `/v3/projects/ff13fa2ab2ea4813adf39c4c4c3ece12/users/9512e7df6b054f1f98e4293ad1247741/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:28.689695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906d688-5b5d-47fc-b822-688c2169756e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff13fa2ab2ea4813adf39c4c4c3ece12, user_id=9512e7df6b054f1f98e4293ad1247741, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:28.692400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906d688-5b5d-47fc-b822-688c2169756e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:28.710159 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3865/7778] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:31:28 2022] PUT /identity/v3/projects/ff13fa2ab2ea4813adf39c4c4c3ece12/users/9512e7df6b054f1f98e4293ad1247741/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:31:28.713971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad57de4-64fb-4186-bf99-a085dc03cec5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:28.724416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad57de4-64fb-4186-bf99-a085dc03cec5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:28.832022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d76d65-c266-48ba-b6ab-7157cba1c208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:28.832675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d76d65-c266-48ba-b6ab-7157cba1c208 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:28.832966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d76d65-c266-48ba-b6ab-7157cba1c208 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:28.834001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d76d65-c266-48ba-b6ab-7157cba1c208 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:28.835193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d76d65-c266-48ba-b6ab-7157cba1c208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:28.836928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d76d65-c266-48ba-b6ab-7157cba1c208 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:28.852606 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3914/7779] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:31:28.856828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906d688-5b5d-47fc-b822-688c2169756e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:28.868631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906d688-5b5d-47fc-b822-688c2169756e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:28.873626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0026aa6-4ebb-4462-a709-14b50f1896ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:28.874310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0026aa6-4ebb-4462-a709-14b50f1896ac admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:28.874589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0026aa6-4ebb-4462-a709-14b50f1896ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:28.874864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0026aa6-4ebb-4462-a709-14b50f1896ac admin admin] PATH_INFO: `/v3/projects/ff13fa2ab2ea4813adf39c4c4c3ece12/users/9512e7df6b054f1f98e4293ad1247741/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:28.877227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0026aa6-4ebb-4462-a709-14b50f1896ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff13fa2ab2ea4813adf39c4c4c3ece12, user_id=9512e7df6b054f1f98e4293ad1247741, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:28.879921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0026aa6-4ebb-4462-a709-14b50f1896ac admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:28.885386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:28.895848 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3866/7780] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:31:28 2022] PUT /identity/v3/projects/ff13fa2ab2ea4813adf39c4c4c3ece12/users/9512e7df6b054f1f98e4293ad1247741/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:31:38.844842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=57,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:38.893331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:39.346341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d76d65-c266-48ba-b6ab-7157cba1c208 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:39.349277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-03d76d65-c266-48ba-b6ab-7157cba1c208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:39.595272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d76d65-c266-48ba-b6ab-7157cba1c208 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:39.709657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807ff87-17bc-4c4e-bc59-d5d5a15dddc9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:39.710072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807ff87-17bc-4c4e-bc59-d5d5a15dddc9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:39.710447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807ff87-17bc-4c4e-bc59-d5d5a15dddc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:39.818102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e807ff87-17bc-4c4e-bc59-d5d5a15dddc9 None None] MFA Rules not processed for user `9512e7df6b054f1f98e4293ad1247741`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:31:39.819714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e807ff87-17bc-4c4e-bc59-d5d5a15dddc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:39.887895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76cf79-80b5-442f-9a64-f77109ee27aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:39.888803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76cf79-80b5-442f-9a64-f77109ee27aa service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:39.889196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76cf79-80b5-442f-9a64-f77109ee27aa service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:39.891100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76cf79-80b5-442f-9a64-f77109ee27aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:39.893600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2f76cf79-80b5-442f-9a64-f77109ee27aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:39.920323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76cf79-80b5-442f-9a64-f77109ee27aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:39.922087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76cf79-80b5-442f-9a64-f77109ee27aa service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:39.953640 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3915/7781] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:31:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:31:40.033164 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3867/7782] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:31:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:31:40.050517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76cf79-80b5-442f-9a64-f77109ee27aa service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:40.052037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2f76cf79-80b5-442f-9a64-f77109ee27aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:40.084706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76cf79-80b5-442f-9a64-f77109ee27aa service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:40.097596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aaf83-eb37-4722-8430-8097b1770606 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:40.098265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aaf83-eb37-4722-8430-8097b1770606 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:40.098555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aaf83-eb37-4722-8430-8097b1770606 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:40.098834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aaf83-eb37-4722-8430-8097b1770606 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:40.109178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4aaf83-eb37-4722-8430-8097b1770606 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:40.111133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4aaf83-eb37-4722-8430-8097b1770606 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:40.147832 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3916/7783] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:31:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:31:40.205494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8910d-07c0-49a1-98b8-b8e4014f10d6 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:40.205784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8910d-07c0-49a1-98b8-b8e4014f10d6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:40.206138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8910d-07c0-49a1-98b8-b8e4014f10d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:40.248140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-07d8910d-07c0-49a1-98b8-b8e4014f10d6 None None] MFA Rules not processed for user `63adb611da12496b91e533c6ec93f415`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:31:40.249861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-07d8910d-07c0-49a1-98b8-b8e4014f10d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:40.358593 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3868/7784] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:31:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:31:40.405552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5975e-7967-4f76-b2a1-349b3a95d851 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:40.405839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5975e-7967-4f76-b2a1-349b3a95d851 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:40.406118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5975e-7967-4f76-b2a1-349b3a95d851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:40.430198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-62b5975e-7967-4f76-b2a1-349b3a95d851 None None] MFA Rules not processed for user `67db2c00c71f469f9a7a871ed28e97e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:31:40.431923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-62b5975e-7967-4f76-b2a1-349b3a95d851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:40.535097 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3917/7785] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:31:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:31:41.346454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8910d-07c0-49a1-98b8-b8e4014f10d6 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:41.347903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-07d8910d-07c0-49a1-98b8-b8e4014f10d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:41.532200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8910d-07c0-49a1-98b8-b8e4014f10d6 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:41.539566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8380c1-f2d1-46ef-8bec-874f13fa599c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:41.540381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8380c1-f2d1-46ef-8bec-874f13fa599c service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:41.540767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8380c1-f2d1-46ef-8bec-874f13fa599c service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:41.541141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8380c1-f2d1-46ef-8bec-874f13fa599c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:41.544346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cb8380c1-f2d1-46ef-8bec-874f13fa599c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:41.563493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8380c1-f2d1-46ef-8bec-874f13fa599c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:41.566490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8380c1-f2d1-46ef-8bec-874f13fa599c service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:41.636161 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3869/7786] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:31:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:31:44.543621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06732e1-03d3-48b0-ba59-b9723ee9ce21 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:44.544181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06732e1-03d3-48b0-ba59-b9723ee9ce21 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:44.544418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06732e1-03d3-48b0-ba59-b9723ee9ce21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:44.593954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:44.628171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d06732e1-03d3-48b0-ba59-b9723ee9ce21 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:31:44.630493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d06732e1-03d3-48b0-ba59-b9723ee9ce21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:44.775237 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3918/7787] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:31:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:31:44.843566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8380c1-f2d1-46ef-8bec-874f13fa599c service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:44.846152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cb8380c1-f2d1-46ef-8bec-874f13fa599c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:44.876719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:44.974306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8380c1-f2d1-46ef-8bec-874f13fa599c service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:44.996066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7749ee8-2e64-4083-8733-7e2607ddd94b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:44.996652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7749ee8-2e64-4083-8733-7e2607ddd94b service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:44.996935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7749ee8-2e64-4083-8733-7e2607ddd94b service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:44.997208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7749ee8-2e64-4083-8733-7e2607ddd94b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:45.014016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7749ee8-2e64-4083-8733-7e2607ddd94b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:45.015709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7749ee8-2e64-4083-8733-7e2607ddd94b service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:45.031212 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3870/7788] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:31:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:31:54.766248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=33 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:55.024043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=32 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:55.382290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9080e-e6ff-44c1-ad48-73a6ffe2d806 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:55.383500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9080e-e6ff-44c1-ad48-73a6ffe2d806 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:55.384028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9080e-e6ff-44c1-ad48-73a6ffe2d806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:55.481575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-40d9080e-e6ff-44c1-ad48-73a6ffe2d806 None None] MFA Rules not processed for user `9f113fc80feb42148c3dad0c33417dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:31:55.489103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-40d9080e-e6ff-44c1-ad48-73a6ffe2d806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:55.614279 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3919/7789] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:31:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:31:57.249558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7749ee8-2e64-4083-8733-7e2607ddd94b service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:31:57.270716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7749ee8-2e64-4083-8733-7e2607ddd94b service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:31:57.297181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36396c12-56e2-4603-b47f-dac1e6f6342a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:31:57.298080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36396c12-56e2-4603-b47f-dac1e6f6342a service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:31:57.298539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36396c12-56e2-4603-b47f-dac1e6f6342a service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:31:57.310141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36396c12-56e2-4603-b47f-dac1e6f6342a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:31:57.319516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-36396c12-56e2-4603-b47f-dac1e6f6342a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:31:57.388649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36396c12-56e2-4603-b47f-dac1e6f6342a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:31:57.394453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36396c12-56e2-4603-b47f-dac1e6f6342a service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:31:57.452888 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3871/7790] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:31:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:32:01.130716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9aed-1456-4e80-bab5-0b9a7fea94e0 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:01.131908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9aed-1456-4e80-bab5-0b9a7fea94e0 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:01.132392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9aed-1456-4e80-bab5-0b9a7fea94e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:01.160352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-574b9aed-1456-4e80-bab5-0b9a7fea94e0 None None] MFA Rules not processed for user `63adb611da12496b91e533c6ec93f415`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:32:01.162968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-574b9aed-1456-4e80-bab5-0b9a7fea94e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:01.178047 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3920/7791] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:32:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:32:07.008105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36396c12-56e2-4603-b47f-dac1e6f6342a service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:07.027151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36396c12-56e2-4603-b47f-dac1e6f6342a service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:07.034134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e4093-5cc4-4dc4-808f-f7c28a4e68cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:07.035336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e4093-5cc4-4dc4-808f-f7c28a4e68cf service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:07.035800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e4093-5cc4-4dc4-808f-f7c28a4e68cf service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:07.037566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e4093-5cc4-4dc4-808f-f7c28a4e68cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:07.039884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-611e4093-5cc4-4dc4-808f-f7c28a4e68cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:07.059881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e4093-5cc4-4dc4-808f-f7c28a4e68cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:07.061852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e4093-5cc4-4dc4-808f-f7c28a4e68cf service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:07.081654 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3872/7792] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:32:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:32:11.150032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=28 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:14.358144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc7d9e-35f6-477a-bdbc-38d17579ca67 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:14.358762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc7d9e-35f6-477a-bdbc-38d17579ca67 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:14.358762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc7d9e-35f6-477a-bdbc-38d17579ca67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:14.378573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-96dc7d9e-35f6-477a-bdbc-38d17579ca67 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:32:14.385803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-96dc7d9e-35f6-477a-bdbc-38d17579ca67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:14.393096 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3921/7793] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:32:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:32:14.405732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e4093-5cc4-4dc4-808f-f7c28a4e68cf service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:14.419130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e4093-5cc4-4dc4-808f-f7c28a4e68cf service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:14.424263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd74fc1-3717-4007-8495-1bfc2cada921 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:14.424982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd74fc1-3717-4007-8495-1bfc2cada921 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:14.425349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd74fc1-3717-4007-8495-1bfc2cada921 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:14.425633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd74fc1-3717-4007-8495-1bfc2cada921 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:14.434570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd74fc1-3717-4007-8495-1bfc2cada921 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:14.436186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd74fc1-3717-4007-8495-1bfc2cada921 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:14.445281 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3873/7794] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:32:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:32:17.015024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc7d9e-35f6-477a-bdbc-38d17579ca67 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:17.016668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-96dc7d9e-35f6-477a-bdbc-38d17579ca67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:17.094581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc7d9e-35f6-477a-bdbc-38d17579ca67 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:17.099647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8263b1-7933-41b6-b6d1-dd1dbb3615a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:17.100312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8263b1-7933-41b6-b6d1-dd1dbb3615a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:17.100603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8263b1-7933-41b6-b6d1-dd1dbb3615a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:17.100890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8263b1-7933-41b6-b6d1-dd1dbb3615a4 admin admin] PATH_INFO: `/v3/users/0114359ded1f4ac588c8b1f0f31737ff` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:17.102101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8263b1-7933-41b6-b6d1-dd1dbb3615a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0114359ded1f4ac588c8b1f0f31737ff)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:17.104082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8263b1-7933-41b6-b6d1-dd1dbb3615a4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:17.154468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9b8263b1-7933-41b6-b6d1-dd1dbb3615a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0114359ded1f4ac588c8b1f0f31737ff'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:17.168253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9b8263b1-7933-41b6-b6d1-dd1dbb3615a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0114359ded1f4ac588c8b1f0f31737ff'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:17.169105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9b8263b1-7933-41b6-b6d1-dd1dbb3615a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0114359ded1f4ac588c8b1f0f31737ff'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:17.178524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9b8263b1-7933-41b6-b6d1-dd1dbb3615a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0114359ded1f4ac588c8b1f0f31737ff'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:17.181230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9b8263b1-7933-41b6-b6d1-dd1dbb3615a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0114359ded1f4ac588c8b1f0f31737ff'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:17.198867 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3922/7795] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:32:17 2022] DELETE /identity/v3/users/0114359ded1f4ac588c8b1f0f31737ff => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:32:17.395608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd74fc1-3717-4007-8495-1bfc2cada921 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:17.411523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd74fc1-3717-4007-8495-1bfc2cada921 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:17.489374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c722c-f274-4bbb-bbf1-fd83ca792f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:17.489984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c722c-f274-4bbb-bbf1-fd83ca792f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:17.490378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c722c-f274-4bbb-bbf1-fd83ca792f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:17.490667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c722c-f274-4bbb-bbf1-fd83ca792f94 admin admin] PATH_INFO: `/v3/projects/d3d6725c617b4a29a437ea385e84a684` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:17.491953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c722c-f274-4bbb-bbf1-fd83ca792f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3d6725c617b4a29a437ea385e84a684)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:17.493923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c722c-f274-4bbb-bbf1-fd83ca792f94 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:17.552291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0e1c722c-f274-4bbb-bbf1-fd83ca792f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3d6725c617b4a29a437ea385e84a684', 'request_id': 'req-0e1c722c-f274-4bbb-bbf1-fd83ca792f94'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:17.562124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0e1c722c-f274-4bbb-bbf1-fd83ca792f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3d6725c617b4a29a437ea385e84a684', 'request_id': 'req-0e1c722c-f274-4bbb-bbf1-fd83ca792f94'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:17.569396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0e1c722c-f274-4bbb-bbf1-fd83ca792f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3d6725c617b4a29a437ea385e84a684', 'request_id': 'req-0e1c722c-f274-4bbb-bbf1-fd83ca792f94'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:17.581777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0e1c722c-f274-4bbb-bbf1-fd83ca792f94 admin admin] The token cache is being invalidate because project d3d6725c617b4a29a437ea385e84a684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:32:17.582072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0e1c722c-f274-4bbb-bbf1-fd83ca792f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:17.582803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0e1c722c-f274-4bbb-bbf1-fd83ca792f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:17.587630 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3874/7796] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:32:17 2022] DELETE /identity/v3/projects/d3d6725c617b4a29a437ea385e84a684 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:32:17.589304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5410f-eeeb-4c49-8042-dce400b50213 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:17.589649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5410f-eeeb-4c49-8042-dce400b50213 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:17.589937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5410f-eeeb-4c49-8042-dce400b50213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:17.613174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1ac5410f-eeeb-4c49-8042-dce400b50213 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:32:17.615001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1ac5410f-eeeb-4c49-8042-dce400b50213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:17.719525 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3923/7797] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:32:17.734509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a921b9a-ecf0-47b3-95d1-ef2439b539c8 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:17.735082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a921b9a-ecf0-47b3-95d1-ef2439b539c8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:17.735547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a921b9a-ecf0-47b3-95d1-ef2439b539c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:17.771481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9a921b9a-ecf0-47b3-95d1-ef2439b539c8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:32:17.773626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9a921b9a-ecf0-47b3-95d1-ef2439b539c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:17.786243 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3875/7798] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:32:17.790336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5410f-eeeb-4c49-8042-dce400b50213 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:17.804186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5410f-eeeb-4c49-8042-dce400b50213 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:17.812080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99976c-1580-44c3-b32a-caaf9f5633db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:17.812808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99976c-1580-44c3-b32a-caaf9f5633db admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:17.813175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99976c-1580-44c3-b32a-caaf9f5633db admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:17.813457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99976c-1580-44c3-b32a-caaf9f5633db admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:17.814484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99976c-1580-44c3-b32a-caaf9f5633db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:32:17.814796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99976c-1580-44c3-b32a-caaf9f5633db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:17.816521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99976c-1580-44c3-b32a-caaf9f5633db admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:17.826999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:17.834496 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3924/7799] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:32:17.835704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a921b9a-ecf0-47b3-95d1-ef2439b539c8 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:17.851114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a921b9a-ecf0-47b3-95d1-ef2439b539c8 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:17.860359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b8dde-331d-43fe-97f6-2efed3f64515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:17.865854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b8dde-331d-43fe-97f6-2efed3f64515 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:17.866261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b8dde-331d-43fe-97f6-2efed3f64515 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:17.866607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b8dde-331d-43fe-97f6-2efed3f64515 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:17.871556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b8dde-331d-43fe-97f6-2efed3f64515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:17.874651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b8dde-331d-43fe-97f6-2efed3f64515 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:17.910477 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3876/7800] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:32:17 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:32:17.912399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99976c-1580-44c3-b32a-caaf9f5633db admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:17.925222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99976c-1580-44c3-b32a-caaf9f5633db admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:17.989268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309a2ea-fcf8-449c-b28f-e361664c1d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:17.989906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309a2ea-fcf8-449c-b28f-e361664c1d11 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:17.990198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309a2ea-fcf8-449c-b28f-e361664c1d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:17.990481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309a2ea-fcf8-449c-b28f-e361664c1d11 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:17.991165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309a2ea-fcf8-449c-b28f-e361664c1d11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:17.994124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309a2ea-fcf8-449c-b28f-e361664c1d11 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:18.024814 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3925/7801] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:32:17 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:32:18.026809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b8dde-331d-43fe-97f6-2efed3f64515 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:18.041196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b8dde-331d-43fe-97f6-2efed3f64515 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:18.047208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989b828-3379-4181-964e-5e9bc522ee11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:18.048013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989b828-3379-4181-964e-5e9bc522ee11 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:18.048400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989b828-3379-4181-964e-5e9bc522ee11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:18.048780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989b828-3379-4181-964e-5e9bc522ee11 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:18.049676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989b828-3379-4181-964e-5e9bc522ee11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:18.051526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989b828-3379-4181-964e-5e9bc522ee11 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:18.064702 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3877/7802] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:32:18.068738 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309a2ea-fcf8-449c-b28f-e361664c1d11 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:18.084555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309a2ea-fcf8-449c-b28f-e361664c1d11 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:18.095364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87134b-afbf-4c70-aedf-f0e943638ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:18.096277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87134b-afbf-4c70-aedf-f0e943638ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:18.096771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87134b-afbf-4c70-aedf-f0e943638ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:18.097410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87134b-afbf-4c70-aedf-f0e943638ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:18.098944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87134b-afbf-4c70-aedf-f0e943638ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:18.100729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87134b-afbf-4c70-aedf-f0e943638ed6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:18.116525 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3926/7803] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:32:18.117676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989b828-3379-4181-964e-5e9bc522ee11 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:18.131466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989b828-3379-4181-964e-5e9bc522ee11 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:18.138525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed6ce1-3987-4cd6-9021-55e9a131efc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:18.139437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed6ce1-3987-4cd6-9021-55e9a131efc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:18.139632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed6ce1-3987-4cd6-9021-55e9a131efc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:18.140468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed6ce1-3987-4cd6-9021-55e9a131efc6 admin admin] PATH_INFO: `/v3/projects/d4b1716d1241449ea378b184fcd95729/users/a2645fa8ca13490bb0c23aad8c73de3f/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:18.152993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:18.163753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed6ce1-3987-4cd6-9021-55e9a131efc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b1716d1241449ea378b184fcd95729, user_id=a2645fa8ca13490bb0c23aad8c73de3f, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:18.166973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed6ce1-3987-4cd6-9021-55e9a131efc6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:18.187205 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3878/7804] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:32:18 2022] PUT /identity/v3/projects/d4b1716d1241449ea378b184fcd95729/users/a2645fa8ca13490bb0c23aad8c73de3f/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:32:18.197959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079569b7-10f8-48f7-8042-a977ca7d63d7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:18.198525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079569b7-10f8-48f7-8042-a977ca7d63d7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:18.199572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079569b7-10f8-48f7-8042-a977ca7d63d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:18.244753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-079569b7-10f8-48f7-8042-a977ca7d63d7 None None] MFA Rules not processed for user `a2645fa8ca13490bb0c23aad8c73de3f`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:32:18.246156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-079569b7-10f8-48f7-8042-a977ca7d63d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:18.351165 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3927/7805] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:32:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:32:18.358883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed6ce1-3987-4cd6-9021-55e9a131efc6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:18.360739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-03ed6ce1-3987-4cd6-9021-55e9a131efc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:18.459888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed6ce1-3987-4cd6-9021-55e9a131efc6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:18.463918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062fcac-3d24-4469-8cdf-1464361c3977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:18.464653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062fcac-3d24-4469-8cdf-1464361c3977 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:18.465069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062fcac-3d24-4469-8cdf-1464361c3977 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:18.465444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062fcac-3d24-4469-8cdf-1464361c3977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:18.476495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062fcac-3d24-4469-8cdf-1464361c3977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:18.478793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062fcac-3d24-4469-8cdf-1464361c3977 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:18.489564 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3879/7806] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:32:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:32:19.927183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d66ac-8b4f-4257-8c8e-c09e868a626e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:19.928022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d66ac-8b4f-4257-8c8e-c09e868a626e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:19.928022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d66ac-8b4f-4257-8c8e-c09e868a626e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:19.958291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b72d66ac-8b4f-4257-8c8e-c09e868a626e None None] MFA Rules not processed for user `a2645fa8ca13490bb0c23aad8c73de3f`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:32:19.965828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b72d66ac-8b4f-4257-8c8e-c09e868a626e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:19.978032 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3928/7807] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:32:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:32:23.915070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062fcac-3d24-4469-8cdf-1464361c3977 service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:23.919305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9062fcac-3d24-4469-8cdf-1464361c3977 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:24.017690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062fcac-3d24-4469-8cdf-1464361c3977 service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:24.038317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664530f-16e5-4263-b564-39707bf1000c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:24.039976 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664530f-16e5-4263-b564-39707bf1000c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:24.040516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664530f-16e5-4263-b564-39707bf1000c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:24.041035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664530f-16e5-4263-b564-39707bf1000c admin admin] PATH_INFO: `/v3/users/67db2c00c71f469f9a7a871ed28e97e4` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:24.042782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664530f-16e5-4263-b564-39707bf1000c admin admin] RBAC: Authorizing `identity:delete_user(user_id=67db2c00c71f469f9a7a871ed28e97e4)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:24.053154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664530f-16e5-4263-b564-39707bf1000c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:24.128383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c664530f-16e5-4263-b564-39707bf1000c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67db2c00c71f469f9a7a871ed28e97e4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:24.129685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c664530f-16e5-4263-b564-39707bf1000c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67db2c00c71f469f9a7a871ed28e97e4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:24.150068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c664530f-16e5-4263-b564-39707bf1000c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67db2c00c71f469f9a7a871ed28e97e4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:24.150980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c664530f-16e5-4263-b564-39707bf1000c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67db2c00c71f469f9a7a871ed28e97e4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:24.161300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c664530f-16e5-4263-b564-39707bf1000c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67db2c00c71f469f9a7a871ed28e97e4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:24.179267 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3880/7808] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:32:23 2022] DELETE /identity/v3/users/67db2c00c71f469f9a7a871ed28e97e4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:32:24.183833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debe4a0-7c89-41ae-9e66-86277c841c78 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:24.184350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debe4a0-7c89-41ae-9e66-86277c841c78 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:24.184464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debe4a0-7c89-41ae-9e66-86277c841c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:24.205307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2debe4a0-7c89-41ae-9e66-86277c841c78 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:32:24.206914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2debe4a0-7c89-41ae-9e66-86277c841c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:24.292156 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3929/7809] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:32:24.307173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664530f-16e5-4263-b564-39707bf1000c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:24.308635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c664530f-16e5-4263-b564-39707bf1000c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:24.320247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:24.395021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664530f-16e5-4263-b564-39707bf1000c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:24.400492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13add59-5c64-47c1-9db5-72114f310b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:24.401321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13add59-5c64-47c1-9db5-72114f310b3b service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:24.401610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13add59-5c64-47c1-9db5-72114f310b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:24.401885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13add59-5c64-47c1-9db5-72114f310b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:24.415362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13add59-5c64-47c1-9db5-72114f310b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:24.416942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13add59-5c64-47c1-9db5-72114f310b3b service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:24.440784 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3881/7810] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:32:24.895632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debe4a0-7c89-41ae-9e66-86277c841c78 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:24.897553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2debe4a0-7c89-41ae-9e66-86277c841c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:24.912892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:24.920982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debe4a0-7c89-41ae-9e66-86277c841c78 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:24.929613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662caf8-fd1b-4c53-b3a1-4c3a166a0230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:24.932436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662caf8-fd1b-4c53-b3a1-4c3a166a0230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:24.932820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662caf8-fd1b-4c53-b3a1-4c3a166a0230 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:24.933332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662caf8-fd1b-4c53-b3a1-4c3a166a0230 admin admin] PATH_INFO: `/v3/projects/434fef0893984988a8acc8b251efdddc` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:24.934691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662caf8-fd1b-4c53-b3a1-4c3a166a0230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=434fef0893984988a8acc8b251efdddc)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:24.937397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662caf8-fd1b-4c53-b3a1-4c3a166a0230 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:24.992363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9662caf8-fd1b-4c53-b3a1-4c3a166a0230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '434fef0893984988a8acc8b251efdddc', 'request_id': 'req-9662caf8-fd1b-4c53-b3a1-4c3a166a0230'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:24.999964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9662caf8-fd1b-4c53-b3a1-4c3a166a0230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '434fef0893984988a8acc8b251efdddc', 'request_id': 'req-9662caf8-fd1b-4c53-b3a1-4c3a166a0230'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:25.009968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9662caf8-fd1b-4c53-b3a1-4c3a166a0230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '434fef0893984988a8acc8b251efdddc', 'request_id': 'req-9662caf8-fd1b-4c53-b3a1-4c3a166a0230'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:25.022871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9662caf8-fd1b-4c53-b3a1-4c3a166a0230 admin admin] The token cache is being invalidate because project 434fef0893984988a8acc8b251efdddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:32:25.023172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9662caf8-fd1b-4c53-b3a1-4c3a166a0230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:25.023887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9662caf8-fd1b-4c53-b3a1-4c3a166a0230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:25.025444 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3930/7811] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:32:24 2022] DELETE /identity/v3/projects/434fef0893984988a8acc8b251efdddc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:32:25.029749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13add59-5c64-47c1-9db5-72114f310b3b service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:25.040360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13add59-5c64-47c1-9db5-72114f310b3b service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:25.105579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb67afd-159b-4eb9-b040-7f8c0a940425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:25.106246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb67afd-159b-4eb9-b040-7f8c0a940425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:25.106535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb67afd-159b-4eb9-b040-7f8c0a940425 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:25.106843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb67afd-159b-4eb9-b040-7f8c0a940425 admin admin] PATH_INFO: `/v3/users/9fcfa607bc8e45a483a4099f2e48160d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:25.108046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb67afd-159b-4eb9-b040-7f8c0a940425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fcfa607bc8e45a483a4099f2e48160d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:25.110067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb67afd-159b-4eb9-b040-7f8c0a940425 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:25.178177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-afb67afd-159b-4eb9-b040-7f8c0a940425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fcfa607bc8e45a483a4099f2e48160d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:25.178916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-afb67afd-159b-4eb9-b040-7f8c0a940425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fcfa607bc8e45a483a4099f2e48160d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:25.193096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-afb67afd-159b-4eb9-b040-7f8c0a940425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fcfa607bc8e45a483a4099f2e48160d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:25.193845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-afb67afd-159b-4eb9-b040-7f8c0a940425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fcfa607bc8e45a483a4099f2e48160d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:25.203775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-afb67afd-159b-4eb9-b040-7f8c0a940425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fcfa607bc8e45a483a4099f2e48160d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:25.217991 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3882/7812] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:32:25 2022] DELETE /identity/v3/users/9fcfa607bc8e45a483a4099f2e48160d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:32:25.525976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662caf8-fd1b-4c53-b3a1-4c3a166a0230 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:25.527567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9662caf8-fd1b-4c53-b3a1-4c3a166a0230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:25.546311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662caf8-fd1b-4c53-b3a1-4c3a166a0230 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:25.612478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de694b3-cfbc-4ed4-9058-43f8c9ab0531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:25.613137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de694b3-cfbc-4ed4-9058-43f8c9ab0531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:25.614082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de694b3-cfbc-4ed4-9058-43f8c9ab0531 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:25.614367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de694b3-cfbc-4ed4-9058-43f8c9ab0531 admin admin] PATH_INFO: `/v3/projects/85381edb39e54fc9977cee9aeeaa729a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:25.615629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de694b3-cfbc-4ed4-9058-43f8c9ab0531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85381edb39e54fc9977cee9aeeaa729a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:25.617578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de694b3-cfbc-4ed4-9058-43f8c9ab0531 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:25.668588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7de694b3-cfbc-4ed4-9058-43f8c9ab0531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85381edb39e54fc9977cee9aeeaa729a', 'request_id': 'req-7de694b3-cfbc-4ed4-9058-43f8c9ab0531'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:25.674937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7de694b3-cfbc-4ed4-9058-43f8c9ab0531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85381edb39e54fc9977cee9aeeaa729a', 'request_id': 'req-7de694b3-cfbc-4ed4-9058-43f8c9ab0531'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:25.684004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7de694b3-cfbc-4ed4-9058-43f8c9ab0531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85381edb39e54fc9977cee9aeeaa729a', 'request_id': 'req-7de694b3-cfbc-4ed4-9058-43f8c9ab0531'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:25.696999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7de694b3-cfbc-4ed4-9058-43f8c9ab0531 admin admin] The token cache is being invalidate because project 85381edb39e54fc9977cee9aeeaa729a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:32:25.697263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7de694b3-cfbc-4ed4-9058-43f8c9ab0531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:25.697931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7de694b3-cfbc-4ed4-9058-43f8c9ab0531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:25.699697 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3931/7813] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:32:25 2022] DELETE /identity/v3/projects/85381edb39e54fc9977cee9aeeaa729a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:32:25.704120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb67afd-159b-4eb9-b040-7f8c0a940425 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:25.705535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-afb67afd-159b-4eb9-b040-7f8c0a940425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:25.718607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb67afd-159b-4eb9-b040-7f8c0a940425 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:25.749066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:25.780328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e1018-36c8-41d5-b079-642d0d4b0e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:25.780978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e1018-36c8-41d5-b079-642d0d4b0e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:25.781266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e1018-36c8-41d5-b079-642d0d4b0e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:25.781542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e1018-36c8-41d5-b079-642d0d4b0e0b admin admin] PATH_INFO: `/v3/users/19f50b9cc06f4bb690cbc51420c17529` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:25.782718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e1018-36c8-41d5-b079-642d0d4b0e0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=19f50b9cc06f4bb690cbc51420c17529)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:25.784675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e1018-36c8-41d5-b079-642d0d4b0e0b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:25.839565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-be3e1018-36c8-41d5-b079-642d0d4b0e0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f50b9cc06f4bb690cbc51420c17529'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:25.840390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-be3e1018-36c8-41d5-b079-642d0d4b0e0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f50b9cc06f4bb690cbc51420c17529'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:25.855070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-be3e1018-36c8-41d5-b079-642d0d4b0e0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f50b9cc06f4bb690cbc51420c17529'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:25.855829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-be3e1018-36c8-41d5-b079-642d0d4b0e0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f50b9cc06f4bb690cbc51420c17529'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:25.869293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-be3e1018-36c8-41d5-b079-642d0d4b0e0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f50b9cc06f4bb690cbc51420c17529'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:25.886993 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3883/7814] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:32:25 2022] DELETE /identity/v3/users/19f50b9cc06f4bb690cbc51420c17529 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:32:26.379891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de694b3-cfbc-4ed4-9058-43f8c9ab0531 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:26.381513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7de694b3-cfbc-4ed4-9058-43f8c9ab0531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:26.403162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de694b3-cfbc-4ed4-9058-43f8c9ab0531 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:26.428030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:26.492104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5d5ca-123e-4085-944c-d6c142c61703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:26.492767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5d5ca-123e-4085-944c-d6c142c61703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:26.493063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5d5ca-123e-4085-944c-d6c142c61703 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:26.493347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5d5ca-123e-4085-944c-d6c142c61703 admin admin] PATH_INFO: `/v3/projects/e57eb754cf0946b7a7da09e866b696ca` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:26.494533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5d5ca-123e-4085-944c-d6c142c61703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e57eb754cf0946b7a7da09e866b696ca)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:26.496494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5d5ca-123e-4085-944c-d6c142c61703 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:26.560381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-68f5d5ca-123e-4085-944c-d6c142c61703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e57eb754cf0946b7a7da09e866b696ca', 'request_id': 'req-68f5d5ca-123e-4085-944c-d6c142c61703'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:26.570133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-68f5d5ca-123e-4085-944c-d6c142c61703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e57eb754cf0946b7a7da09e866b696ca', 'request_id': 'req-68f5d5ca-123e-4085-944c-d6c142c61703'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:26.584197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-68f5d5ca-123e-4085-944c-d6c142c61703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e57eb754cf0946b7a7da09e866b696ca', 'request_id': 'req-68f5d5ca-123e-4085-944c-d6c142c61703'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:26.596481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-68f5d5ca-123e-4085-944c-d6c142c61703 admin admin] The token cache is being invalidate because project e57eb754cf0946b7a7da09e866b696ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:32:26.596798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-68f5d5ca-123e-4085-944c-d6c142c61703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:26.597557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-68f5d5ca-123e-4085-944c-d6c142c61703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:26.607599 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3932/7815] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:32:26 2022] DELETE /identity/v3/projects/e57eb754cf0946b7a7da09e866b696ca => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:32:26.607691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc3cb1-7bca-4e35-9303-34337aba5db5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:26.607691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc3cb1-7bca-4e35-9303-34337aba5db5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:26.607691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc3cb1-7bca-4e35-9303-34337aba5db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:26.632186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bbfc3cb1-7bca-4e35-9303-34337aba5db5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:32:26.633691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bbfc3cb1-7bca-4e35-9303-34337aba5db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:26.701257 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3884/7816] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:32:26.709676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11e290-3b2d-4307-b4bc-aa2913c18b02 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:26.710054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11e290-3b2d-4307-b4bc-aa2913c18b02 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:26.710419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11e290-3b2d-4307-b4bc-aa2913c18b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:26.730487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7d11e290-3b2d-4307-b4bc-aa2913c18b02 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:32:26.731867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7d11e290-3b2d-4307-b4bc-aa2913c18b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:26.740340 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3933/7817] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:32:26.744750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc3cb1-7bca-4e35-9303-34337aba5db5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:26.755630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc3cb1-7bca-4e35-9303-34337aba5db5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:26.760752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecaec92-d876-4adb-bd27-2820f7517074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:26.761404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecaec92-d876-4adb-bd27-2820f7517074 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:26.761691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecaec92-d876-4adb-bd27-2820f7517074 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:26.761976 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecaec92-d876-4adb-bd27-2820f7517074 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:26.762681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecaec92-d876-4adb-bd27-2820f7517074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:32:26.762989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecaec92-d876-4adb-bd27-2820f7517074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:26.764635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecaec92-d876-4adb-bd27-2820f7517074 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:26.777576 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3885/7818] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:32:26.782092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11e290-3b2d-4307-b4bc-aa2913c18b02 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:26.791460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11e290-3b2d-4307-b4bc-aa2913c18b02 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:26.796268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cf607-e0b0-45e4-bfdf-e6c73d9bddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:26.796818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cf607-e0b0-45e4-bfdf-e6c73d9bddf3 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:26.797110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cf607-e0b0-45e4-bfdf-e6c73d9bddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:26.797386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cf607-e0b0-45e4-bfdf-e6c73d9bddf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:26.798047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cf607-e0b0-45e4-bfdf-e6c73d9bddf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:26.799998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cf607-e0b0-45e4-bfdf-e6c73d9bddf3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:26.827947 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3934/7819] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:32:26 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:32:26.832995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecaec92-d876-4adb-bd27-2820f7517074 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:26.843903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecaec92-d876-4adb-bd27-2820f7517074 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:26.879963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:26.905396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf436aca-36f9-4a2e-a295-707ffcbe0864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:26.906023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf436aca-36f9-4a2e-a295-707ffcbe0864 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:26.906306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf436aca-36f9-4a2e-a295-707ffcbe0864 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:26.906584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf436aca-36f9-4a2e-a295-707ffcbe0864 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:26.907256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf436aca-36f9-4a2e-a295-707ffcbe0864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:26.909262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf436aca-36f9-4a2e-a295-707ffcbe0864 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:26.935144 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3886/7820] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:32:26 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:32:26.936361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cf607-e0b0-45e4-bfdf-e6c73d9bddf3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:26.947505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cf607-e0b0-45e4-bfdf-e6c73d9bddf3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:26.952161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ab17a-0061-4512-992b-072bf03c910d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:26.952778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ab17a-0061-4512-992b-072bf03c910d admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:26.953071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ab17a-0061-4512-992b-072bf03c910d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:26.953350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ab17a-0061-4512-992b-072bf03c910d admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:26.954043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ab17a-0061-4512-992b-072bf03c910d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:26.955705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ab17a-0061-4512-992b-072bf03c910d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:26.966053 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3935/7821] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:32:26.970332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf436aca-36f9-4a2e-a295-707ffcbe0864 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:26.980801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf436aca-36f9-4a2e-a295-707ffcbe0864 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:26.985483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779fe2d-c549-4e7a-9ccf-7c2caa91b504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:26.986092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779fe2d-c549-4e7a-9ccf-7c2caa91b504 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:26.986376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779fe2d-c549-4e7a-9ccf-7c2caa91b504 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:26.986651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779fe2d-c549-4e7a-9ccf-7c2caa91b504 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:26.987391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779fe2d-c549-4e7a-9ccf-7c2caa91b504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:26.989510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779fe2d-c549-4e7a-9ccf-7c2caa91b504 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:27.001357 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3887/7822] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:32:27.006214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ab17a-0061-4512-992b-072bf03c910d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:27.017178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ab17a-0061-4512-992b-072bf03c910d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:27.022014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afeb29-cdb0-4948-aa53-d647a7ad3f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:27.022690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afeb29-cdb0-4948-aa53-d647a7ad3f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:27.022991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afeb29-cdb0-4948-aa53-d647a7ad3f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:27.023276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afeb29-cdb0-4948-aa53-d647a7ad3f4c admin admin] PATH_INFO: `/v3/projects/5105e54fdfa345c4891676afaf2dcd5e/users/8b1ec28438dc45a48433b159e5f04d6b/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:27.038051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afeb29-cdb0-4948-aa53-d647a7ad3f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5105e54fdfa345c4891676afaf2dcd5e, user_id=8b1ec28438dc45a48433b159e5f04d6b, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:27.040773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afeb29-cdb0-4948-aa53-d647a7ad3f4c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:27.055121 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3936/7823] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:32:27 2022] PUT /identity/v3/projects/5105e54fdfa345c4891676afaf2dcd5e/users/8b1ec28438dc45a48433b159e5f04d6b/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:32:27.060215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401b079-7bb8-4543-81f1-c2dea8efaf96 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:27.060634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401b079-7bb8-4543-81f1-c2dea8efaf96 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:27.060946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401b079-7bb8-4543-81f1-c2dea8efaf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:27.080458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a401b079-7bb8-4543-81f1-c2dea8efaf96 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:32:27.081686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a401b079-7bb8-4543-81f1-c2dea8efaf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:27.142081 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3888/7824] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:32:27.152979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afeb29-cdb0-4948-aa53-d647a7ad3f4c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:27.154756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-88afeb29-cdb0-4948-aa53-d647a7ad3f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:27.208172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:27.224126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afeb29-cdb0-4948-aa53-d647a7ad3f4c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:27.229998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b6476-ce94-4d3d-bf45-f7a7067b26a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:27.230514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b6476-ce94-4d3d-bf45-f7a7067b26a7 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:27.230827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b6476-ce94-4d3d-bf45-f7a7067b26a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:27.231109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b6476-ce94-4d3d-bf45-f7a7067b26a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:27.242849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b6476-ce94-4d3d-bf45-f7a7067b26a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:27.244356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b6476-ce94-4d3d-bf45-f7a7067b26a7 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:27.258044 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3937/7825] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:32:34.096739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50e437-98f1-46d7-b654-0943b6a2a46d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:34.097387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50e437-98f1-46d7-b654-0943b6a2a46d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:34.097387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50e437-98f1-46d7-b654-0943b6a2a46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:34.149857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-cd50e437-98f1-46d7-b654-0943b6a2a46d None None] MFA Rules not processed for user `8b1ec28438dc45a48433b159e5f04d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:32:34.151043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cd50e437-98f1-46d7-b654-0943b6a2a46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:34.237483 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3889/7826] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:32:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:32:34.241877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b6476-ce94-4d3d-bf45-f7a7067b26a7 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:34.253552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b6476-ce94-4d3d-bf45-f7a7067b26a7 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:34.259694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf53a5-43eb-49ce-b319-3c88eea06126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:34.260400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf53a5-43eb-49ce-b319-3c88eea06126 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:34.260756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf53a5-43eb-49ce-b319-3c88eea06126 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:34.261138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf53a5-43eb-49ce-b319-3c88eea06126 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:34.261838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf53a5-43eb-49ce-b319-3c88eea06126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:34.264139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf53a5-43eb-49ce-b319-3c88eea06126 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:34.301024 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3938/7827] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:32:34 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:32:34.305111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50e437-98f1-46d7-b654-0943b6a2a46d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:34.317911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50e437-98f1-46d7-b654-0943b6a2a46d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:34.406305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:34.424956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2880b-a74c-46f8-b1e7-12dc02a3cb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:34.426441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2880b-a74c-46f8-b1e7-12dc02a3cb37 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:34.426934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2880b-a74c-46f8-b1e7-12dc02a3cb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:34.427507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2880b-a74c-46f8-b1e7-12dc02a3cb37 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:34.428493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2880b-a74c-46f8-b1e7-12dc02a3cb37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:34.430738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2880b-a74c-46f8-b1e7-12dc02a3cb37 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:34.467566 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3890/7828] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:32:34 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:32:34.469825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf53a5-43eb-49ce-b319-3c88eea06126 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:34.485692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf53a5-43eb-49ce-b319-3c88eea06126 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:34.492778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcbb55-2416-480a-8f6f-b78d48756ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:34.493419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcbb55-2416-480a-8f6f-b78d48756ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:34.493705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcbb55-2416-480a-8f6f-b78d48756ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:34.493984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcbb55-2416-480a-8f6f-b78d48756ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:34.494697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcbb55-2416-480a-8f6f-b78d48756ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:34.496362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcbb55-2416-480a-8f6f-b78d48756ac6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:34.515417 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3939/7829] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:32:34.516898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2880b-a74c-46f8-b1e7-12dc02a3cb37 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:34.528679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2880b-a74c-46f8-b1e7-12dc02a3cb37 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:34.534326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0c221-20bd-43e5-815d-0091454a800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:34.535054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0c221-20bd-43e5-815d-0091454a800a admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:34.535385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0c221-20bd-43e5-815d-0091454a800a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:34.535674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0c221-20bd-43e5-815d-0091454a800a admin admin] PATH_INFO: `/v3/projects/da052081754c4f55a216da6f9c25eab3/users/0b3af0781e8242b5a2d1676f712a839d/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:34.563118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0c221-20bd-43e5-815d-0091454a800a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da052081754c4f55a216da6f9c25eab3, user_id=0b3af0781e8242b5a2d1676f712a839d, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:34.565975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0c221-20bd-43e5-815d-0091454a800a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:34.593524 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3891/7830] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:32:34 2022] PUT /identity/v3/projects/da052081754c4f55a216da6f9c25eab3/users/0b3af0781e8242b5a2d1676f712a839d/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:32:34.598434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcbb55-2416-480a-8f6f-b78d48756ac6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:34.610446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcbb55-2416-480a-8f6f-b78d48756ac6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:34.697928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277ff0d-b1eb-4ee5-bfb3-305b797c65d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:34.698844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277ff0d-b1eb-4ee5-bfb3-305b797c65d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:34.699144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277ff0d-b1eb-4ee5-bfb3-305b797c65d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:34.699599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277ff0d-b1eb-4ee5-bfb3-305b797c65d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:34.700837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277ff0d-b1eb-4ee5-bfb3-305b797c65d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:34.703019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277ff0d-b1eb-4ee5-bfb3-305b797c65d2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:34.741939 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3940/7831] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:32:34.747390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0c221-20bd-43e5-815d-0091454a800a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:34.771378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0c221-20bd-43e5-815d-0091454a800a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:34.795675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ac3c6-8967-4f51-b1c0-fd8d2658f064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:34.796474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ac3c6-8967-4f51-b1c0-fd8d2658f064 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:34.799963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ac3c6-8967-4f51-b1c0-fd8d2658f064 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:34.800349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ac3c6-8967-4f51-b1c0-fd8d2658f064 admin admin] PATH_INFO: `/v3/projects/da052081754c4f55a216da6f9c25eab3/users/0b3af0781e8242b5a2d1676f712a839d/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:34.807070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ac3c6-8967-4f51-b1c0-fd8d2658f064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da052081754c4f55a216da6f9c25eab3, user_id=0b3af0781e8242b5a2d1676f712a839d, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:34.813552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ac3c6-8967-4f51-b1c0-fd8d2658f064 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:34.843485 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3892/7832] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:32:34 2022] PUT /identity/v3/projects/da052081754c4f55a216da6f9c25eab3/users/0b3af0781e8242b5a2d1676f712a839d/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:32:36.162580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277ff0d-b1eb-4ee5-bfb3-305b797c65d2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:36.165192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4277ff0d-b1eb-4ee5-bfb3-305b797c65d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:36.195619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277ff0d-b1eb-4ee5-bfb3-305b797c65d2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:36.289066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c5a7b-8208-4906-b56b-608b36d3765c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:36.292639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c5a7b-8208-4906-b56b-608b36d3765c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:36.293144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c5a7b-8208-4906-b56b-608b36d3765c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:36.293976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c5a7b-8208-4906-b56b-608b36d3765c admin admin] PATH_INFO: `/v3/users/63adb611da12496b91e533c6ec93f415` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:36.295597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c5a7b-8208-4906-b56b-608b36d3765c admin admin] RBAC: Authorizing `identity:delete_user(user_id=63adb611da12496b91e533c6ec93f415)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:36.297819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c5a7b-8208-4906-b56b-608b36d3765c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:36.388174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c51c5a7b-8208-4906-b56b-608b36d3765c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63adb611da12496b91e533c6ec93f415'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:36.395439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:36.433740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c51c5a7b-8208-4906-b56b-608b36d3765c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63adb611da12496b91e533c6ec93f415'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:36.434766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c51c5a7b-8208-4906-b56b-608b36d3765c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63adb611da12496b91e533c6ec93f415'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:36.447028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c51c5a7b-8208-4906-b56b-608b36d3765c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63adb611da12496b91e533c6ec93f415'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:36.448505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c51c5a7b-8208-4906-b56b-608b36d3765c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63adb611da12496b91e533c6ec93f415'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:36.471759 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3941/7833] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:32:36 2022] DELETE /identity/v3/users/63adb611da12496b91e533c6ec93f415 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:32:36.725533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ac3c6-8967-4f51-b1c0-fd8d2658f064 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:36.727339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cf9ac3c6-8967-4f51-b1c0-fd8d2658f064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:36.748351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ac3c6-8967-4f51-b1c0-fd8d2658f064 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:36.873819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4a61c-b999-4439-bdb7-9d9781ccc67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:36.875402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4a61c-b999-4439-bdb7-9d9781ccc67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:36.875974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4a61c-b999-4439-bdb7-9d9781ccc67f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:36.876753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4a61c-b999-4439-bdb7-9d9781ccc67f admin admin] PATH_INFO: `/v3/projects/a7d4e94f74394e9bb5479101cbef31a5` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:36.878092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4a61c-b999-4439-bdb7-9d9781ccc67f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7d4e94f74394e9bb5479101cbef31a5)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:36.882484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4a61c-b999-4439-bdb7-9d9781ccc67f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:36.980193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-47d4a61c-b999-4439-bdb7-9d9781ccc67f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7d4e94f74394e9bb5479101cbef31a5', 'request_id': 'req-47d4a61c-b999-4439-bdb7-9d9781ccc67f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:37.011250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-47d4a61c-b999-4439-bdb7-9d9781ccc67f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7d4e94f74394e9bb5479101cbef31a5', 'request_id': 'req-47d4a61c-b999-4439-bdb7-9d9781ccc67f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:37.025537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-47d4a61c-b999-4439-bdb7-9d9781ccc67f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7d4e94f74394e9bb5479101cbef31a5', 'request_id': 'req-47d4a61c-b999-4439-bdb7-9d9781ccc67f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:37.040376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-47d4a61c-b999-4439-bdb7-9d9781ccc67f admin admin] The token cache is being invalidate because project a7d4e94f74394e9bb5479101cbef31a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:32:37.041087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-47d4a61c-b999-4439-bdb7-9d9781ccc67f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:37.048825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-47d4a61c-b999-4439-bdb7-9d9781ccc67f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:37.051126 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3893/7834] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:32:36 2022] DELETE /identity/v3/projects/a7d4e94f74394e9bb5479101cbef31a5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:32:37.054955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c5a7b-8208-4906-b56b-608b36d3765c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:37.074977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c5a7b-8208-4906-b56b-608b36d3765c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:37.168926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d153ee-3894-45d4-8fd8-6c9cfcefdba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:37.169600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d153ee-3894-45d4-8fd8-6c9cfcefdba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:37.174759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d153ee-3894-45d4-8fd8-6c9cfcefdba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:37.175210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d153ee-3894-45d4-8fd8-6c9cfcefdba3 admin admin] PATH_INFO: `/v3/users/9512e7df6b054f1f98e4293ad1247741` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:37.177207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d153ee-3894-45d4-8fd8-6c9cfcefdba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9512e7df6b054f1f98e4293ad1247741)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:37.179549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d153ee-3894-45d4-8fd8-6c9cfcefdba3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:37.266740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b7d153ee-3894-45d4-8fd8-6c9cfcefdba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9512e7df6b054f1f98e4293ad1247741'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:37.287610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b7d153ee-3894-45d4-8fd8-6c9cfcefdba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9512e7df6b054f1f98e4293ad1247741'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:37.288569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b7d153ee-3894-45d4-8fd8-6c9cfcefdba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9512e7df6b054f1f98e4293ad1247741'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:37.297462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b7d153ee-3894-45d4-8fd8-6c9cfcefdba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9512e7df6b054f1f98e4293ad1247741'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:37.298319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b7d153ee-3894-45d4-8fd8-6c9cfcefdba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9512e7df6b054f1f98e4293ad1247741'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:37.329489 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3942/7835] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:32:37 2022] DELETE /identity/v3/users/9512e7df6b054f1f98e4293ad1247741 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:32:37.692024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4a61c-b999-4439-bdb7-9d9781ccc67f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:37.693710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-47d4a61c-b999-4439-bdb7-9d9781ccc67f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:37.724807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4a61c-b999-4439-bdb7-9d9781ccc67f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:37.774024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:37.854791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e521d7-beb3-414a-90b7-f279cf046b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:37.855686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e521d7-beb3-414a-90b7-f279cf046b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:37.856225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e521d7-beb3-414a-90b7-f279cf046b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:37.857268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e521d7-beb3-414a-90b7-f279cf046b2f admin admin] PATH_INFO: `/v3/projects/ff13fa2ab2ea4813adf39c4c4c3ece12` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:37.860377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e521d7-beb3-414a-90b7-f279cf046b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff13fa2ab2ea4813adf39c4c4c3ece12)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:37.864985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e521d7-beb3-414a-90b7-f279cf046b2f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:37.984827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-50e521d7-beb3-414a-90b7-f279cf046b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff13fa2ab2ea4813adf39c4c4c3ece12', 'request_id': 'req-50e521d7-beb3-414a-90b7-f279cf046b2f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:37.996410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-50e521d7-beb3-414a-90b7-f279cf046b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff13fa2ab2ea4813adf39c4c4c3ece12', 'request_id': 'req-50e521d7-beb3-414a-90b7-f279cf046b2f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:38.010661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-50e521d7-beb3-414a-90b7-f279cf046b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff13fa2ab2ea4813adf39c4c4c3ece12', 'request_id': 'req-50e521d7-beb3-414a-90b7-f279cf046b2f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:38.029090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-50e521d7-beb3-414a-90b7-f279cf046b2f admin admin] The token cache is being invalidate because project ff13fa2ab2ea4813adf39c4c4c3ece12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:32:38.029375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-50e521d7-beb3-414a-90b7-f279cf046b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:38.030209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-50e521d7-beb3-414a-90b7-f279cf046b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:32:38.032449 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3894/7836] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:32:37 2022] DELETE /identity/v3/projects/ff13fa2ab2ea4813adf39c4c4c3ece12 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:32:40.504811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a9a6b-1d4b-436c-85ed-6a4c6a2096a4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:40.505384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a9a6b-1d4b-436c-85ed-6a4c6a2096a4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:40.505384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a9a6b-1d4b-436c-85ed-6a4c6a2096a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:40.534313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-862a9a6b-1d4b-436c-85ed-6a4c6a2096a4 None None] MFA Rules not processed for user `0b3af0781e8242b5a2d1676f712a839d`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:32:40.535736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-862a9a6b-1d4b-436c-85ed-6a4c6a2096a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:40.574018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:40.611416 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3943/7837] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:32:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:32:40.629362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e521d7-beb3-414a-90b7-f279cf046b2f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:40.630791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-50e521d7-beb3-414a-90b7-f279cf046b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:40.710845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e521d7-beb3-414a-90b7-f279cf046b2f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:40.716516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d56b5a-f75f-4aa5-a606-300c88896ac4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:40.717158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d56b5a-f75f-4aa5-a606-300c88896ac4 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:40.717442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d56b5a-f75f-4aa5-a606-300c88896ac4 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:40.717722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d56b5a-f75f-4aa5-a606-300c88896ac4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:40.719540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f7d56b5a-f75f-4aa5-a606-300c88896ac4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:40.779891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:40.782392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d56b5a-f75f-4aa5-a606-300c88896ac4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:40.784240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d56b5a-f75f-4aa5-a606-300c88896ac4 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:40.803244 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3895/7838] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:32:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:32:41.970785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34f79d-c827-43f1-bd22-b6ab0a2618a3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:41.971330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34f79d-c827-43f1-bd22-b6ab0a2618a3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:41.971571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34f79d-c827-43f1-bd22-b6ab0a2618a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:41.993985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-be34f79d-c827-43f1-bd22-b6ab0a2618a3 None None] MFA Rules not processed for user `8b1ec28438dc45a48433b159e5f04d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:32:41.995237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-be34f79d-c827-43f1-bd22-b6ab0a2618a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:42.004722 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3944/7839] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:32:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:32:50.798013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:51.988273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=16 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:54.571513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d56b5a-f75f-4aa5-a606-300c88896ac4 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:54.573016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f7d56b5a-f75f-4aa5-a606-300c88896ac4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:54.694805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d56b5a-f75f-4aa5-a606-300c88896ac4 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:54.702566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5e976-4b12-4702-891a-e49ebb3a3a45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:54.704447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5e976-4b12-4702-891a-e49ebb3a3a45 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:54.704904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5e976-4b12-4702-891a-e49ebb3a3a45 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:54.705299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5e976-4b12-4702-891a-e49ebb3a3a45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:54.707658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c8e5e976-4b12-4702-891a-e49ebb3a3a45 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:54.738822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5e976-4b12-4702-891a-e49ebb3a3a45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:54.741259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5e976-4b12-4702-891a-e49ebb3a3a45 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:54.763044 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3896/7840] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:32:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:32:54.987579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34f79d-c827-43f1-bd22-b6ab0a2618a3 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:54.989516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-be34f79d-c827-43f1-bd22-b6ab0a2618a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:55.140471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34f79d-c827-43f1-bd22-b6ab0a2618a3 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:55.146953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385b746-aab9-4bbe-a1b1-01806c9aae11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:55.148114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385b746-aab9-4bbe-a1b1-01806c9aae11 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:55.156553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385b746-aab9-4bbe-a1b1-01806c9aae11 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:55.156917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385b746-aab9-4bbe-a1b1-01806c9aae11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:55.160125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5385b746-aab9-4bbe-a1b1-01806c9aae11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:55.177390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385b746-aab9-4bbe-a1b1-01806c9aae11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:55.179351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385b746-aab9-4bbe-a1b1-01806c9aae11 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:55.193505 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3945/7841] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:32:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:32:55.322028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25253f49-4451-4cd3-9857-2da1cd918419 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:55.322028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25253f49-4451-4cd3-9857-2da1cd918419 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:55.322028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25253f49-4451-4cd3-9857-2da1cd918419 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:55.324100 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3897/7842] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:32:55.333596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb4a49-2fa6-456c-8b79-016b16f5dfdc None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:55.334039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb4a49-2fa6-456c-8b79-016b16f5dfdc None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:55.334444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb4a49-2fa6-456c-8b79-016b16f5dfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:55.354933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9ddb4a49-2fa6-456c-8b79-016b16f5dfdc None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:32:55.356338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9ddb4a49-2fa6-456c-8b79-016b16f5dfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:55.374155 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3946/7843] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:32:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:32:55.398243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25253f49-4451-4cd3-9857-2da1cd918419 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:55.419540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25253f49-4451-4cd3-9857-2da1cd918419 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:55.425261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c4a77-4234-40bb-96d7-93cce03ae29f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:55.425888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4a77-4234-40bb-96d7-93cce03ae29f service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:55.426709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4a77-4234-40bb-96d7-93cce03ae29f service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:55.426709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4a77-4234-40bb-96d7-93cce03ae29f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:55.435842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c4a77-4234-40bb-96d7-93cce03ae29f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:55.437727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c4a77-4234-40bb-96d7-93cce03ae29f service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:55.453759 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3898/7844] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:32:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:32:55.639573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffa806-9b27-4129-998f-06d02ae82b8a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:55.640295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffa806-9b27-4129-998f-06d02ae82b8a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:55.641003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffa806-9b27-4129-998f-06d02ae82b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:55.684855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-eeffa806-9b27-4129-998f-06d02ae82b8a None None] MFA Rules not processed for user `5a6da0171fac41fb934ed2b294081531`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:32:55.686565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-eeffa806-9b27-4129-998f-06d02ae82b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:55.773006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c4a77-4234-40bb-96d7-93cce03ae29f service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:55.776265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-661c4a77-4234-40bb-96d7-93cce03ae29f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:55.798357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c4a77-4234-40bb-96d7-93cce03ae29f service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:55.805411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac82131-2dd9-4a2d-bf29-458067574324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:55.806214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac82131-2dd9-4a2d-bf29-458067574324 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:55.806514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac82131-2dd9-4a2d-bf29-458067574324 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:55.806757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac82131-2dd9-4a2d-bf29-458067574324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:55.809198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3ac82131-2dd9-4a2d-bf29-458067574324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:55.830370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac82131-2dd9-4a2d-bf29-458067574324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:55.832264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac82131-2dd9-4a2d-bf29-458067574324 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:55.851915 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3899/7845] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:32:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:32:55.881288 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3947/7846] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:32:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:32:56.048434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac82131-2dd9-4a2d-bf29-458067574324 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:56.084729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac82131-2dd9-4a2d-bf29-458067574324 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:56.102151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2bd22-8235-47bb-9945-097581ff271b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:56.102780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2bd22-8235-47bb-9945-097581ff271b service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:56.105438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2bd22-8235-47bb-9945-097581ff271b service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:56.105873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2bd22-8235-47bb-9945-097581ff271b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:56.123022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2bd22-8235-47bb-9945-097581ff271b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:56.125199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2bd22-8235-47bb-9945-097581ff271b service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:56.151847 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3900/7847] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:32:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:32:56.384615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffa806-9b27-4129-998f-06d02ae82b8a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:32:56.405322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffa806-9b27-4129-998f-06d02ae82b8a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:32:56.432835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafd665-05c1-43d2-8b35-5b32141a2d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:32:56.433693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafd665-05c1-43d2-8b35-5b32141a2d21 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:32:56.434596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafd665-05c1-43d2-8b35-5b32141a2d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:32:56.434878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafd665-05c1-43d2-8b35-5b32141a2d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:32:56.436882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bbafd665-05c1-43d2-8b35-5b32141a2d21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:32:56.458202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafd665-05c1-43d2-8b35-5b32141a2d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:32:56.462679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafd665-05c1-43d2-8b35-5b32141a2d21 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:32:56.482878 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3948/7848] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:32:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:33:06.137438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=50 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:06.192240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22731e91-aac4-4843-a768-95279644e9a6 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:06.196059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22731e91-aac4-4843-a768-95279644e9a6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:06.196352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22731e91-aac4-4843-a768-95279644e9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:06.224057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-22731e91-aac4-4843-a768-95279644e9a6 None None] MFA Rules not processed for user `937935818cda4a6e8b9104d38aa3a8b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:33:06.225453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-22731e91-aac4-4843-a768-95279644e9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:06.318807 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3901/7849] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:33:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:33:06.470748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=60 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:15.695446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafd665-05c1-43d2-8b35-5b32141a2d21 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:15.696893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bbafd665-05c1-43d2-8b35-5b32141a2d21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:15.772620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafd665-05c1-43d2-8b35-5b32141a2d21 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:15.777127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdb189-f8fd-4f92-950b-5999989076e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:15.777776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdb189-f8fd-4f92-950b-5999989076e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:15.778060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdb189-f8fd-4f92-950b-5999989076e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:15.778339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdb189-f8fd-4f92-950b-5999989076e9 admin admin] PATH_INFO: `/v3/users/a2645fa8ca13490bb0c23aad8c73de3f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:15.779550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdb189-f8fd-4f92-950b-5999989076e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2645fa8ca13490bb0c23aad8c73de3f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:15.781473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdb189-f8fd-4f92-950b-5999989076e9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:15.828077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-15bdb189-f8fd-4f92-950b-5999989076e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2645fa8ca13490bb0c23aad8c73de3f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:15.839732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-15bdb189-f8fd-4f92-950b-5999989076e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2645fa8ca13490bb0c23aad8c73de3f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:15.840395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-15bdb189-f8fd-4f92-950b-5999989076e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2645fa8ca13490bb0c23aad8c73de3f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:15.847641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-15bdb189-f8fd-4f92-950b-5999989076e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2645fa8ca13490bb0c23aad8c73de3f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:15.848314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-15bdb189-f8fd-4f92-950b-5999989076e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2645fa8ca13490bb0c23aad8c73de3f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:15.860751 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3949/7850] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:33:15 2022] DELETE /identity/v3/users/a2645fa8ca13490bb0c23aad8c73de3f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:33:15.865905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e581b33-a888-4715-a09f-8ae0e03727ef None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:15.866470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e581b33-a888-4715-a09f-8ae0e03727ef None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:15.866470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e581b33-a888-4715-a09f-8ae0e03727ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:15.885893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0e581b33-a888-4715-a09f-8ae0e03727ef None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:33:15.887094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0e581b33-a888-4715-a09f-8ae0e03727ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:15.946296 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3902/7851] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:33:15.957099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdb189-f8fd-4f92-950b-5999989076e9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:15.958517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-15bdb189-f8fd-4f92-950b-5999989076e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:16.195635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdb189-f8fd-4f92-950b-5999989076e9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:16.199317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626010a4-3c4a-4b47-89fd-745e9e5532b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:16.200016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626010a4-3c4a-4b47-89fd-745e9e5532b1 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:16.200364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626010a4-3c4a-4b47-89fd-745e9e5532b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:16.200713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626010a4-3c4a-4b47-89fd-745e9e5532b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:16.210111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626010a4-3c4a-4b47-89fd-745e9e5532b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:16.211655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626010a4-3c4a-4b47-89fd-745e9e5532b1 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:16.221892 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3950/7852] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:33:16.408999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e581b33-a888-4715-a09f-8ae0e03727ef None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:16.410438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0e581b33-a888-4715-a09f-8ae0e03727ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:16.433390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e581b33-a888-4715-a09f-8ae0e03727ef None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:16.439989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed3e00-3830-4c56-b9a6-3f7de66e123f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:16.442496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed3e00-3830-4c56-b9a6-3f7de66e123f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:16.442496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed3e00-3830-4c56-b9a6-3f7de66e123f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:16.442682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed3e00-3830-4c56-b9a6-3f7de66e123f admin admin] PATH_INFO: `/v3/projects/d4b1716d1241449ea378b184fcd95729` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:16.443866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed3e00-3830-4c56-b9a6-3f7de66e123f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b1716d1241449ea378b184fcd95729)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:16.445767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed3e00-3830-4c56-b9a6-3f7de66e123f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:16.504929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-34ed3e00-3830-4c56-b9a6-3f7de66e123f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b1716d1241449ea378b184fcd95729', 'request_id': 'req-34ed3e00-3830-4c56-b9a6-3f7de66e123f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:16.512604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-34ed3e00-3830-4c56-b9a6-3f7de66e123f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b1716d1241449ea378b184fcd95729', 'request_id': 'req-34ed3e00-3830-4c56-b9a6-3f7de66e123f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:16.519367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-34ed3e00-3830-4c56-b9a6-3f7de66e123f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b1716d1241449ea378b184fcd95729', 'request_id': 'req-34ed3e00-3830-4c56-b9a6-3f7de66e123f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:16.531103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-34ed3e00-3830-4c56-b9a6-3f7de66e123f admin admin] The token cache is being invalidate because project d4b1716d1241449ea378b184fcd95729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:33:16.531416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-34ed3e00-3830-4c56-b9a6-3f7de66e123f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:16.532073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-34ed3e00-3830-4c56-b9a6-3f7de66e123f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:16.534245 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3903/7853] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:33:16 2022] DELETE /identity/v3/projects/d4b1716d1241449ea378b184fcd95729 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:33:16.539092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11516104-968e-4417-824e-aa5d142e9067 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:16.539477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11516104-968e-4417-824e-aa5d142e9067 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:16.539754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11516104-968e-4417-824e-aa5d142e9067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:16.559689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-11516104-968e-4417-824e-aa5d142e9067 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:33:16.561467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-11516104-968e-4417-824e-aa5d142e9067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:16.579705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:16.625848 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3951/7854] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:33:16.633422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c6b48-a1d2-4ed8-8b92-c4dc08f21ab0 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:16.633709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c6b48-a1d2-4ed8-8b92-c4dc08f21ab0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:16.633992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c6b48-a1d2-4ed8-8b92-c4dc08f21ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:16.653936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bf4c6b48-a1d2-4ed8-8b92-c4dc08f21ab0 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:33:16.655156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bf4c6b48-a1d2-4ed8-8b92-c4dc08f21ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:16.663736 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3904/7855] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:33:16.668016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11516104-968e-4417-824e-aa5d142e9067 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:16.679088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11516104-968e-4417-824e-aa5d142e9067 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:16.684030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0a394-f925-4ea4-9018-913a42d180ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:16.684612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0a394-f925-4ea4-9018-913a42d180ff admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:16.684886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0a394-f925-4ea4-9018-913a42d180ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:16.685161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0a394-f925-4ea4-9018-913a42d180ff admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:16.686935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0a394-f925-4ea4-9018-913a42d180ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:33:16.686935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0a394-f925-4ea4-9018-913a42d180ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:16.687843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0a394-f925-4ea4-9018-913a42d180ff admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:16.700903 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3952/7856] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:33:16.712989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c6b48-a1d2-4ed8-8b92-c4dc08f21ab0 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:16.723782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c6b48-a1d2-4ed8-8b92-c4dc08f21ab0 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:16.729286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df890f26-6fda-4e84-a6e6-575900efba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:16.729921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df890f26-6fda-4e84-a6e6-575900efba47 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:16.730071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df890f26-6fda-4e84-a6e6-575900efba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:16.730465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df890f26-6fda-4e84-a6e6-575900efba47 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:16.731270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df890f26-6fda-4e84-a6e6-575900efba47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:16.733256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df890f26-6fda-4e84-a6e6-575900efba47 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:16.791355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:16.802030 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3905/7857] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:33:16 2022] POST /identity/v3/projects => generated 371 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:33:16.806271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0a394-f925-4ea4-9018-913a42d180ff admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:16.817168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0a394-f925-4ea4-9018-913a42d180ff admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:16.893770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cee062-5ac7-4aad-b28f-5f5de22bc616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:16.894530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee062-5ac7-4aad-b28f-5f5de22bc616 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:16.894880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee062-5ac7-4aad-b28f-5f5de22bc616 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:16.895225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee062-5ac7-4aad-b28f-5f5de22bc616 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:16.895991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cee062-5ac7-4aad-b28f-5f5de22bc616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:16.898007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cee062-5ac7-4aad-b28f-5f5de22bc616 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:16.919573 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3953/7858] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:33:16 2022] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:33:16.923978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df890f26-6fda-4e84-a6e6-575900efba47 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:16.934413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df890f26-6fda-4e84-a6e6-575900efba47 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:16.939167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491275f-7886-4048-a2fe-f7c0bc229b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:16.940375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491275f-7886-4048-a2fe-f7c0bc229b9f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:16.940726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491275f-7886-4048-a2fe-f7c0bc229b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:16.941065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491275f-7886-4048-a2fe-f7c0bc229b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:16.941826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491275f-7886-4048-a2fe-f7c0bc229b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:16.943523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491275f-7886-4048-a2fe-f7c0bc229b9f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:16.954332 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3906/7859] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:33:16.958674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cee062-5ac7-4aad-b28f-5f5de22bc616 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:16.969430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cee062-5ac7-4aad-b28f-5f5de22bc616 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:16.974146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5eae5f-4ace-4a4c-a459-a33746d1aae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:16.974752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5eae5f-4ace-4a4c-a459-a33746d1aae1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:16.975040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5eae5f-4ace-4a4c-a459-a33746d1aae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:16.975363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5eae5f-4ace-4a4c-a459-a33746d1aae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:16.976057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5eae5f-4ace-4a4c-a459-a33746d1aae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:16.977638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5eae5f-4ace-4a4c-a459-a33746d1aae1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:16.987932 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3954/7860] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:33:16.992219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491275f-7886-4048-a2fe-f7c0bc229b9f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:17.004228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491275f-7886-4048-a2fe-f7c0bc229b9f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:17.015211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36dd583-fdc5-45a9-833e-99a2760e514b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:17.015930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dd583-fdc5-45a9-833e-99a2760e514b admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:17.016213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dd583-fdc5-45a9-833e-99a2760e514b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:17.016491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dd583-fdc5-45a9-833e-99a2760e514b admin admin] PATH_INFO: `/v3/projects/22ba35de01ed47319a705e24dba68004/users/d063b0dbdbec45298341b79d47981a11/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:17.032295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36dd583-fdc5-45a9-833e-99a2760e514b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ba35de01ed47319a705e24dba68004, user_id=d063b0dbdbec45298341b79d47981a11, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:17.035133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36dd583-fdc5-45a9-833e-99a2760e514b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:17.048603 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3907/7861] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:33:16 2022] PUT /identity/v3/projects/22ba35de01ed47319a705e24dba68004/users/d063b0dbdbec45298341b79d47981a11/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:33:17.059142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ac124-f199-4f9d-a272-654d0bdf524c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:17.059541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ac124-f199-4f9d-a272-654d0bdf524c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:17.059899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ac124-f199-4f9d-a272-654d0bdf524c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:17.089931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0f6ac124-f199-4f9d-a272-654d0bdf524c None None] MFA Rules not processed for user `d063b0dbdbec45298341b79d47981a11`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:33:17.091158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0f6ac124-f199-4f9d-a272-654d0bdf524c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:17.169588 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3955/7862] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:33:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:33:17.182120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36dd583-fdc5-45a9-833e-99a2760e514b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:17.183764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c36dd583-fdc5-45a9-833e-99a2760e514b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:17.293224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36dd583-fdc5-45a9-833e-99a2760e514b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:17.297662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7809c-1ff1-4ee9-8a0f-d40c3ab236b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:17.298336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7809c-1ff1-4ee9-8a0f-d40c3ab236b1 service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:17.298625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7809c-1ff1-4ee9-8a0f-d40c3ab236b1 service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:17.303519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7809c-1ff1-4ee9-8a0f-d40c3ab236b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:17.317389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7809c-1ff1-4ee9-8a0f-d40c3ab236b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:17.318854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7809c-1ff1-4ee9-8a0f-d40c3ab236b1 service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:17.337994 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3908/7863] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:33:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:33:18.063224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ac124-f199-4f9d-a272-654d0bdf524c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:18.064726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0f6ac124-f199-4f9d-a272-654d0bdf524c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:18.089469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:18.147403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7809c-1ff1-4ee9-8a0f-d40c3ab236b1 service glance] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:18.148231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ac124-f199-4f9d-a272-654d0bdf524c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:18.149102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-96e7809c-1ff1-4ee9-8a0f-d40c3ab236b1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:18.154372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8742134-97a1-4692-9239-2a1496d774fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:18.155532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8742134-97a1-4692-9239-2a1496d774fa service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:18.155904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8742134-97a1-4692-9239-2a1496d774fa service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:18.156271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8742134-97a1-4692-9239-2a1496d774fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:18.159548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a8742134-97a1-4692-9239-2a1496d774fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:18.170232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7809c-1ff1-4ee9-8a0f-d40c3ab236b1 service glance] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:18.175937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8742134-97a1-4692-9239-2a1496d774fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:18.176080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470d4b1-cecb-48d5-9591-ca31c0fc03c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:18.176573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470d4b1-cecb-48d5-9591-ca31c0fc03c9 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:18.177086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470d4b1-cecb-48d5-9591-ca31c0fc03c9 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:18.177620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470d4b1-cecb-48d5-9591-ca31c0fc03c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:18.178339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8742134-97a1-4692-9239-2a1496d774fa service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:18.191758 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3956/7864] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:33:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:33:18.191930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470d4b1-cecb-48d5-9591-ca31c0fc03c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:18.194330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470d4b1-cecb-48d5-9591-ca31c0fc03c9 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:18.211157 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3909/7865] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:33:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:33:23.222778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8742134-97a1-4692-9239-2a1496d774fa service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:23.235916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8742134-97a1-4692-9239-2a1496d774fa service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:23.241876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca89929-0f50-41b5-bf73-eaf4fb750636 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:23.242700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca89929-0f50-41b5-bf73-eaf4fb750636 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:23.243113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca89929-0f50-41b5-bf73-eaf4fb750636 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:23.243247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca89929-0f50-41b5-bf73-eaf4fb750636 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:23.245066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bca89929-0f50-41b5-bf73-eaf4fb750636 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:23.259770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca89929-0f50-41b5-bf73-eaf4fb750636 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:23.261679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca89929-0f50-41b5-bf73-eaf4fb750636 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:23.275872 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3957/7866] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:33:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:33:28.203915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=56,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:28.540448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470d4b1-cecb-48d5-9591-ca31c0fc03c9 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:28.601811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470d4b1-cecb-48d5-9591-ca31c0fc03c9 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:28.606358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552de10f-6288-4fb8-b0af-07880ed09d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:28.606987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de10f-6288-4fb8-b0af-07880ed09d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:28.607269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de10f-6288-4fb8-b0af-07880ed09d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:28.607573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de10f-6288-4fb8-b0af-07880ed09d53 admin admin] PATH_INFO: `/v3/users/d063b0dbdbec45298341b79d47981a11` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:28.608707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552de10f-6288-4fb8-b0af-07880ed09d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d063b0dbdbec45298341b79d47981a11)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:28.610605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552de10f-6288-4fb8-b0af-07880ed09d53 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:28.658114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-552de10f-6288-4fb8-b0af-07880ed09d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd063b0dbdbec45298341b79d47981a11'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:28.659389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-552de10f-6288-4fb8-b0af-07880ed09d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd063b0dbdbec45298341b79d47981a11'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:28.672185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-552de10f-6288-4fb8-b0af-07880ed09d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd063b0dbdbec45298341b79d47981a11'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:28.672846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-552de10f-6288-4fb8-b0af-07880ed09d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd063b0dbdbec45298341b79d47981a11'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:28.679325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-552de10f-6288-4fb8-b0af-07880ed09d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd063b0dbdbec45298341b79d47981a11'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:28.691299 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3910/7867] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:33:28 2022] DELETE /identity/v3/users/d063b0dbdbec45298341b79d47981a11 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:33:28.695843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ada004-77e4-48a3-a10c-3275b00ed843 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:28.696311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ada004-77e4-48a3-a10c-3275b00ed843 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:28.696413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ada004-77e4-48a3-a10c-3275b00ed843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:28.715066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-78ada004-77e4-48a3-a10c-3275b00ed843 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:33:28.716301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-78ada004-77e4-48a3-a10c-3275b00ed843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:28.775092 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3958/7868] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:33:28.784629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552de10f-6288-4fb8-b0af-07880ed09d53 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:28.786113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-552de10f-6288-4fb8-b0af-07880ed09d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:28.845211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552de10f-6288-4fb8-b0af-07880ed09d53 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:28.848901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3798f1d-18ba-4ac3-bd34-594baa27c34c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:28.849519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3798f1d-18ba-4ac3-bd34-594baa27c34c service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:28.849805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3798f1d-18ba-4ac3-bd34-594baa27c34c service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:28.850085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3798f1d-18ba-4ac3-bd34-594baa27c34c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:28.859076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3798f1d-18ba-4ac3-bd34-594baa27c34c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:28.860533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3798f1d-18ba-4ac3-bd34-594baa27c34c service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:28.869931 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3911/7869] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:33:29.466854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ada004-77e4-48a3-a10c-3275b00ed843 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:29.468441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-78ada004-77e4-48a3-a10c-3275b00ed843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:29.481758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ada004-77e4-48a3-a10c-3275b00ed843 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:29.487148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64df7c-c6ad-428c-9138-8410a7089030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:29.487845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64df7c-c6ad-428c-9138-8410a7089030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:29.488127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64df7c-c6ad-428c-9138-8410a7089030 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:29.488402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64df7c-c6ad-428c-9138-8410a7089030 admin admin] PATH_INFO: `/v3/projects/22ba35de01ed47319a705e24dba68004` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:29.489568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64df7c-c6ad-428c-9138-8410a7089030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ba35de01ed47319a705e24dba68004)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:29.491577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64df7c-c6ad-428c-9138-8410a7089030 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:29.539194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9b64df7c-c6ad-428c-9138-8410a7089030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ba35de01ed47319a705e24dba68004', 'request_id': 'req-9b64df7c-c6ad-428c-9138-8410a7089030'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:29.545451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9b64df7c-c6ad-428c-9138-8410a7089030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ba35de01ed47319a705e24dba68004', 'request_id': 'req-9b64df7c-c6ad-428c-9138-8410a7089030'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:29.553491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9b64df7c-c6ad-428c-9138-8410a7089030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ba35de01ed47319a705e24dba68004', 'request_id': 'req-9b64df7c-c6ad-428c-9138-8410a7089030'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:29.565491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9b64df7c-c6ad-428c-9138-8410a7089030 admin admin] The token cache is being invalidate because project 22ba35de01ed47319a705e24dba68004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:33:29.565788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9b64df7c-c6ad-428c-9138-8410a7089030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:29.566437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9b64df7c-c6ad-428c-9138-8410a7089030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:29.567994 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3959/7870] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:33:29 2022] DELETE /identity/v3/projects/22ba35de01ed47319a705e24dba68004 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:33:29.574541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b170bf-6fe2-4cd2-ae1c-f38a0b7c4798 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:29.575032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b170bf-6fe2-4cd2-ae1c-f38a0b7c4798 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:29.575153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b170bf-6fe2-4cd2-ae1c-f38a0b7c4798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:29.594655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-01b170bf-6fe2-4cd2-ae1c-f38a0b7c4798 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:33:29.596375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-01b170bf-6fe2-4cd2-ae1c-f38a0b7c4798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:29.613754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:29.659972 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3912/7871] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:33:29.668154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb33dc7-282e-4e90-a44d-6cd758a1cc6e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:29.668536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb33dc7-282e-4e90-a44d-6cd758a1cc6e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:29.668894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb33dc7-282e-4e90-a44d-6cd758a1cc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:29.689903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0bb33dc7-282e-4e90-a44d-6cd758a1cc6e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:33:29.691220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0bb33dc7-282e-4e90-a44d-6cd758a1cc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:29.699792 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3960/7872] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:33:29.704232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b170bf-6fe2-4cd2-ae1c-f38a0b7c4798 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:29.714638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b170bf-6fe2-4cd2-ae1c-f38a0b7c4798 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:29.719715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca32771-c888-4564-802f-69959dc3b8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:29.720339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca32771-c888-4564-802f-69959dc3b8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:29.720633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca32771-c888-4564-802f-69959dc3b8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:29.721420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca32771-c888-4564-802f-69959dc3b8a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:29.722129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca32771-c888-4564-802f-69959dc3b8a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:33:29.722439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca32771-c888-4564-802f-69959dc3b8a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:29.724162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca32771-c888-4564-802f-69959dc3b8a9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:29.736594 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3913/7873] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:33:29.741398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb33dc7-282e-4e90-a44d-6cd758a1cc6e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:29.751111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb33dc7-282e-4e90-a44d-6cd758a1cc6e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:29.756207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4bad7-c69e-446a-a742-9fbb8c9ab208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:29.756964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4bad7-c69e-446a-a742-9fbb8c9ab208 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:29.757257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4bad7-c69e-446a-a742-9fbb8c9ab208 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:29.757536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4bad7-c69e-446a-a742-9fbb8c9ab208 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:29.758391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4bad7-c69e-446a-a742-9fbb8c9ab208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:29.760397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4bad7-c69e-446a-a742-9fbb8c9ab208 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:29.770268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:29.793918 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3961/7874] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:33:29 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:33:29.795158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca32771-c888-4564-802f-69959dc3b8a9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:29.806127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca32771-c888-4564-802f-69959dc3b8a9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:29.880072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39217df-12e8-40d9-9992-6ce3dffa9c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:29.880668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39217df-12e8-40d9-9992-6ce3dffa9c4b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:29.880963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39217df-12e8-40d9-9992-6ce3dffa9c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:29.881237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39217df-12e8-40d9-9992-6ce3dffa9c4b admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:29.882468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39217df-12e8-40d9-9992-6ce3dffa9c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:29.884324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39217df-12e8-40d9-9992-6ce3dffa9c4b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:29.908396 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3914/7875] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:33:29 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:33:29.913102 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4bad7-c69e-446a-a742-9fbb8c9ab208 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:29.924475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4bad7-c69e-446a-a742-9fbb8c9ab208 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:29.929686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bbdd6-efe0-47ea-9ada-28187e8b1fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:29.930345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bbdd6-efe0-47ea-9ada-28187e8b1fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:29.930633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bbdd6-efe0-47ea-9ada-28187e8b1fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:29.930933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bbdd6-efe0-47ea-9ada-28187e8b1fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:29.935880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bbdd6-efe0-47ea-9ada-28187e8b1fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:29.937551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bbdd6-efe0-47ea-9ada-28187e8b1fc9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:29.948372 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3962/7876] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:33:29.952367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39217df-12e8-40d9-9992-6ce3dffa9c4b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:29.964029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39217df-12e8-40d9-9992-6ce3dffa9c4b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:29.969870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf5046-1dc0-4147-abab-70cbce8b3a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:29.970559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf5046-1dc0-4147-abab-70cbce8b3a7b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:29.970853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf5046-1dc0-4147-abab-70cbce8b3a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:29.971721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf5046-1dc0-4147-abab-70cbce8b3a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:29.972469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf5046-1dc0-4147-abab-70cbce8b3a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:29.974263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf5046-1dc0-4147-abab-70cbce8b3a7b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:29.987736 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3915/7877] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:33:29.991817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bbdd6-efe0-47ea-9ada-28187e8b1fc9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:30.007626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bbdd6-efe0-47ea-9ada-28187e8b1fc9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:30.012009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be4018-0737-4b45-a89b-66b6b5f57eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:30.012892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be4018-0737-4b45-a89b-66b6b5f57eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:30.013186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be4018-0737-4b45-a89b-66b6b5f57eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:30.014122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be4018-0737-4b45-a89b-66b6b5f57eb3 admin admin] PATH_INFO: `/v3/projects/31cd519c52624cafbad2cdfebe8d03c4/users/929a74be31674ae2a22c47709cfa6955/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:30.032567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be4018-0737-4b45-a89b-66b6b5f57eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31cd519c52624cafbad2cdfebe8d03c4, user_id=929a74be31674ae2a22c47709cfa6955, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:30.035886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be4018-0737-4b45-a89b-66b6b5f57eb3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:30.049916 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3963/7878] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:33:29 2022] PUT /identity/v3/projects/31cd519c52624cafbad2cdfebe8d03c4/users/929a74be31674ae2a22c47709cfa6955/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:33:30.055847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff1c47-0a85-4f6c-996d-b313ec1633b3 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:30.056242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff1c47-0a85-4f6c-996d-b313ec1633b3 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:30.056588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff1c47-0a85-4f6c-996d-b313ec1633b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:30.080097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-53ff1c47-0a85-4f6c-996d-b313ec1633b3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:33:30.081757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-53ff1c47-0a85-4f6c-996d-b313ec1633b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:30.142685 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3916/7879] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:33:30.152982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be4018-0737-4b45-a89b-66b6b5f57eb3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:30.155178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-61be4018-0737-4b45-a89b-66b6b5f57eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:30.214291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be4018-0737-4b45-a89b-66b6b5f57eb3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:30.217925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57a416-0b90-4d2f-a58f-83d0354fb3ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:30.218536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57a416-0b90-4d2f-a58f-83d0354fb3ce service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:30.218819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57a416-0b90-4d2f-a58f-83d0354fb3ce service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:30.219092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57a416-0b90-4d2f-a58f-83d0354fb3ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:30.228504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57a416-0b90-4d2f-a58f-83d0354fb3ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:30.229912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57a416-0b90-4d2f-a58f-83d0354fb3ce service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:30.239156 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3964/7880] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:33:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:33:30.869333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af6777-191a-4565-9224-fd7287489666 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:30.869852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af6777-191a-4565-9224-fd7287489666 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:30.869957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af6777-191a-4565-9224-fd7287489666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:30.898305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-53af6777-191a-4565-9224-fd7287489666 None None] MFA Rules not processed for user `929a74be31674ae2a22c47709cfa6955`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:33:30.899543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-53af6777-191a-4565-9224-fd7287489666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:30.926388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:30.976354 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3917/7881] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:33:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:33:30.980725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57a416-0b90-4d2f-a58f-83d0354fb3ce service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:30.991743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57a416-0b90-4d2f-a58f-83d0354fb3ce service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:30.996961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cfca3-336c-4a0d-b2b8-20313ca9b424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:30.997503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cfca3-336c-4a0d-b2b8-20313ca9b424 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:30.997845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cfca3-336c-4a0d-b2b8-20313ca9b424 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:30.998130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cfca3-336c-4a0d-b2b8-20313ca9b424 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:30.998815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168cfca3-336c-4a0d-b2b8-20313ca9b424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:31.001035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168cfca3-336c-4a0d-b2b8-20313ca9b424 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:31.034748 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3965/7882] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:33:30 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:33:31.039813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af6777-191a-4565-9224-fd7287489666 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:31.053131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af6777-191a-4565-9224-fd7287489666 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:31.117851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b571eb-cd34-4c68-b960-2ed8ddcf8d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:31.118832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b571eb-cd34-4c68-b960-2ed8ddcf8d5b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:31.119119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b571eb-cd34-4c68-b960-2ed8ddcf8d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:31.119448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b571eb-cd34-4c68-b960-2ed8ddcf8d5b admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:31.120133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b571eb-cd34-4c68-b960-2ed8ddcf8d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:31.122100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b571eb-cd34-4c68-b960-2ed8ddcf8d5b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:31.149790 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3918/7883] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:33:31 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:33:31.153897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cfca3-336c-4a0d-b2b8-20313ca9b424 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:31.167794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cfca3-336c-4a0d-b2b8-20313ca9b424 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:31.173847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d209b69-2e59-484e-bf85-0f450f44a8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:31.175019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d209b69-2e59-484e-bf85-0f450f44a8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:31.175324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d209b69-2e59-484e-bf85-0f450f44a8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:31.175620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d209b69-2e59-484e-bf85-0f450f44a8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:31.176320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d209b69-2e59-484e-bf85-0f450f44a8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:31.178012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d209b69-2e59-484e-bf85-0f450f44a8d9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:31.192718 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3966/7884] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:33:31.193967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b571eb-cd34-4c68-b960-2ed8ddcf8d5b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:31.209713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b571eb-cd34-4c68-b960-2ed8ddcf8d5b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:31.216715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca3139-dbaa-47a1-b27e-23b0224aa792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:31.217532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca3139-dbaa-47a1-b27e-23b0224aa792 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:31.217819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca3139-dbaa-47a1-b27e-23b0224aa792 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:31.218098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca3139-dbaa-47a1-b27e-23b0224aa792 admin admin] PATH_INFO: `/v3/projects/d9e029fc61014cd88f3d097845a52460/users/0f3d617db2c64093b429973c51b96d83/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:31.240121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca3139-dbaa-47a1-b27e-23b0224aa792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e029fc61014cd88f3d097845a52460, user_id=0f3d617db2c64093b429973c51b96d83, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:31.242780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca3139-dbaa-47a1-b27e-23b0224aa792 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:31.262793 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3919/7885] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:33:31 2022] PUT /identity/v3/projects/d9e029fc61014cd88f3d097845a52460/users/0f3d617db2c64093b429973c51b96d83/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:33:31.264223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d209b69-2e59-484e-bf85-0f450f44a8d9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:31.277919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d209b69-2e59-484e-bf85-0f450f44a8d9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:31.354129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de791e8a-4e31-4206-837d-479ea457797e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:31.354789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de791e8a-4e31-4206-837d-479ea457797e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:31.355520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de791e8a-4e31-4206-837d-479ea457797e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:31.355803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de791e8a-4e31-4206-837d-479ea457797e admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:31.356498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de791e8a-4e31-4206-837d-479ea457797e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:31.358657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de791e8a-4e31-4206-837d-479ea457797e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:31.371545 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3967/7886] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:33:31.375976 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca3139-dbaa-47a1-b27e-23b0224aa792 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:31.388788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca3139-dbaa-47a1-b27e-23b0224aa792 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:31.394271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acafbd-8447-46bb-b5aa-0fd4fde531f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:31.394959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acafbd-8447-46bb-b5aa-0fd4fde531f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:31.395246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acafbd-8447-46bb-b5aa-0fd4fde531f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:31.395548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acafbd-8447-46bb-b5aa-0fd4fde531f3 admin admin] PATH_INFO: `/v3/projects/d9e029fc61014cd88f3d097845a52460/users/0f3d617db2c64093b429973c51b96d83/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:31.400687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acafbd-8447-46bb-b5aa-0fd4fde531f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e029fc61014cd88f3d097845a52460, user_id=0f3d617db2c64093b429973c51b96d83, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:31.406853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acafbd-8447-46bb-b5aa-0fd4fde531f3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:31.438592 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3920/7887] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:33:31 2022] PUT /identity/v3/projects/d9e029fc61014cd88f3d097845a52460/users/0f3d617db2c64093b429973c51b96d83/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:33:32.086370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6df209-4100-4447-bd38-14baf11970bd None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:32.086886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6df209-4100-4447-bd38-14baf11970bd None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:32.086995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6df209-4100-4447-bd38-14baf11970bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:32.115652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ca6df209-4100-4447-bd38-14baf11970bd None None] MFA Rules not processed for user `0f3d617db2c64093b429973c51b96d83`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:33:32.117141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ca6df209-4100-4447-bd38-14baf11970bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:32.126100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:32.198303 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3968/7888] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:33:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:33:32.209080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe9af0-7278-4511-8112-24b2806d75dc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:32.209600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe9af0-7278-4511-8112-24b2806d75dc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:32.209699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe9af0-7278-4511-8112-24b2806d75dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:32.228779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-88fe9af0-7278-4511-8112-24b2806d75dc None None] MFA Rules not processed for user `929a74be31674ae2a22c47709cfa6955`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:33:32.230036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-88fe9af0-7278-4511-8112-24b2806d75dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:32.289352 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3921/7889] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:33:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:33:32.301761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6df209-4100-4447-bd38-14baf11970bd None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:32.303171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ca6df209-4100-4447-bd38-14baf11970bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:32.379202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6df209-4100-4447-bd38-14baf11970bd None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:32.384962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c63c7-f5f0-494a-9992-72fbede665ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:32.385581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c63c7-f5f0-494a-9992-72fbede665ef service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:32.385886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c63c7-f5f0-494a-9992-72fbede665ef service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:32.386161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c63c7-f5f0-494a-9992-72fbede665ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:32.393901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c63c7-f5f0-494a-9992-72fbede665ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:32.395494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c63c7-f5f0-494a-9992-72fbede665ef service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:32.404180 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3969/7890] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:33:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:33:34.880031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe9af0-7278-4511-8112-24b2806d75dc None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:34.898013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:34.940476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe9af0-7278-4511-8112-24b2806d75dc None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:34.944420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d98238-b486-4a13-92bd-339d37f8dda1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:34.945046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d98238-b486-4a13-92bd-339d37f8dda1 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:34.945335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d98238-b486-4a13-92bd-339d37f8dda1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:34.945650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d98238-b486-4a13-92bd-339d37f8dda1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:34.947453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d2d98238-b486-4a13-92bd-339d37f8dda1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:34.959745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d98238-b486-4a13-92bd-339d37f8dda1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:34.961194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d98238-b486-4a13-92bd-339d37f8dda1 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:34.971571 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3922/7891] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:33:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:33:42.400244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=59 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:44.965991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=19 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:52.574336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c63c7-f5f0-494a-9992-72fbede665ef service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:52.575947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f02c63c7-f5f0-494a-9992-72fbede665ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:52.662358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c63c7-f5f0-494a-9992-72fbede665ef service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:52.669150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd08d3-6c3f-4132-a927-276db282036b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:52.669150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd08d3-6c3f-4132-a927-276db282036b service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:52.669150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd08d3-6c3f-4132-a927-276db282036b service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:52.669150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd08d3-6c3f-4132-a927-276db282036b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:52.670714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6abd08d3-6c3f-4132-a927-276db282036b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:52.684828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd08d3-6c3f-4132-a927-276db282036b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:52.686413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd08d3-6c3f-4132-a927-276db282036b service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:52.699036 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3970/7892] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:33:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:33:53.094129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d98238-b486-4a13-92bd-339d37f8dda1 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:53.128177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d98238-b486-4a13-92bd-339d37f8dda1 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:53.141910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d99647-3f70-4bc4-921d-7382d2ceadae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:53.143337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d99647-3f70-4bc4-921d-7382d2ceadae service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:53.144019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d99647-3f70-4bc4-921d-7382d2ceadae service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:53.144433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d99647-3f70-4bc4-921d-7382d2ceadae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:53.147421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-47d99647-3f70-4bc4-921d-7382d2ceadae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:53.169322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd08d3-6c3f-4132-a927-276db282036b service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:53.189376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d99647-3f70-4bc4-921d-7382d2ceadae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:53.193004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d99647-3f70-4bc4-921d-7382d2ceadae service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:53.207491 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3923/7893] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:33:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:33:53.253602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd08d3-6c3f-4132-a927-276db282036b service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:53.259345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e117a-8dfe-492b-b5e8-91d09e6d76ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:53.259936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e117a-8dfe-492b-b5e8-91d09e6d76ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:53.260235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e117a-8dfe-492b-b5e8-91d09e6d76ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:53.260493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e117a-8dfe-492b-b5e8-91d09e6d76ba admin admin] PATH_INFO: `/v3/users/929a74be31674ae2a22c47709cfa6955` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:53.261669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e117a-8dfe-492b-b5e8-91d09e6d76ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=929a74be31674ae2a22c47709cfa6955)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:53.263663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e117a-8dfe-492b-b5e8-91d09e6d76ba admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:53.320287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-230e117a-8dfe-492b-b5e8-91d09e6d76ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '929a74be31674ae2a22c47709cfa6955'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:53.333527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-230e117a-8dfe-492b-b5e8-91d09e6d76ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '929a74be31674ae2a22c47709cfa6955'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:53.334641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-230e117a-8dfe-492b-b5e8-91d09e6d76ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '929a74be31674ae2a22c47709cfa6955'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:53.348445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-230e117a-8dfe-492b-b5e8-91d09e6d76ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '929a74be31674ae2a22c47709cfa6955'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:53.348445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-230e117a-8dfe-492b-b5e8-91d09e6d76ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '929a74be31674ae2a22c47709cfa6955'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:53.357837 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3971/7894] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:33:53 2022] DELETE /identity/v3/users/929a74be31674ae2a22c47709cfa6955 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:33:53.564366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d99647-3f70-4bc4-921d-7382d2ceadae service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:53.584156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d99647-3f70-4bc4-921d-7382d2ceadae service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:53.647387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6e198-9cba-404b-8a2f-a8acd160477a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:53.647966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6e198-9cba-404b-8a2f-a8acd160477a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:53.648256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6e198-9cba-404b-8a2f-a8acd160477a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:53.648538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6e198-9cba-404b-8a2f-a8acd160477a admin admin] PATH_INFO: `/v3/projects/31cd519c52624cafbad2cdfebe8d03c4` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:53.649705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6e198-9cba-404b-8a2f-a8acd160477a admin admin] RBAC: Authorizing `identity:delete_project(project_id=31cd519c52624cafbad2cdfebe8d03c4)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:53.651665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6e198-9cba-404b-8a2f-a8acd160477a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:53.700992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-35b6e198-9cba-404b-8a2f-a8acd160477a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31cd519c52624cafbad2cdfebe8d03c4', 'request_id': 'req-35b6e198-9cba-404b-8a2f-a8acd160477a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:53.711873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-35b6e198-9cba-404b-8a2f-a8acd160477a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31cd519c52624cafbad2cdfebe8d03c4', 'request_id': 'req-35b6e198-9cba-404b-8a2f-a8acd160477a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:53.720871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-35b6e198-9cba-404b-8a2f-a8acd160477a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31cd519c52624cafbad2cdfebe8d03c4', 'request_id': 'req-35b6e198-9cba-404b-8a2f-a8acd160477a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:53.732357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-35b6e198-9cba-404b-8a2f-a8acd160477a admin admin] The token cache is being invalidate because project 31cd519c52624cafbad2cdfebe8d03c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:33:53.732656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-35b6e198-9cba-404b-8a2f-a8acd160477a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:53.733345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-35b6e198-9cba-404b-8a2f-a8acd160477a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:53.734872 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3924/7895] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:33:53 2022] DELETE /identity/v3/projects/31cd519c52624cafbad2cdfebe8d03c4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:33:53.739501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e117a-8dfe-492b-b5e8-91d09e6d76ba admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:53.740927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-230e117a-8dfe-492b-b5e8-91d09e6d76ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:53.754965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e117a-8dfe-492b-b5e8-91d09e6d76ba admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:53.760085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:53.819224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7b89e-8259-4ac6-b016-56c9ed2114f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:53.820266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7b89e-8259-4ac6-b016-56c9ed2114f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:53.820555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7b89e-8259-4ac6-b016-56c9ed2114f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:53.820832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7b89e-8259-4ac6-b016-56c9ed2114f1 admin admin] PATH_INFO: `/v3/users/0f3d617db2c64093b429973c51b96d83` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:53.822037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7b89e-8259-4ac6-b016-56c9ed2114f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f3d617db2c64093b429973c51b96d83)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:53.824005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7b89e-8259-4ac6-b016-56c9ed2114f1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:53.874719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1dd7b89e-8259-4ac6-b016-56c9ed2114f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f3d617db2c64093b429973c51b96d83'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:53.887377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1dd7b89e-8259-4ac6-b016-56c9ed2114f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f3d617db2c64093b429973c51b96d83'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:53.888054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1dd7b89e-8259-4ac6-b016-56c9ed2114f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f3d617db2c64093b429973c51b96d83'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:53.895971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1dd7b89e-8259-4ac6-b016-56c9ed2114f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f3d617db2c64093b429973c51b96d83'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:53.896788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1dd7b89e-8259-4ac6-b016-56c9ed2114f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f3d617db2c64093b429973c51b96d83'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:53.910553 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3972/7896] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:33:53 2022] DELETE /identity/v3/users/0f3d617db2c64093b429973c51b96d83 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:33:54.101742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6e198-9cba-404b-8a2f-a8acd160477a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:33:54.104169 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-35b6e198-9cba-404b-8a2f-a8acd160477a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:33:54.131577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6e198-9cba-404b-8a2f-a8acd160477a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:33:54.192205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125759e-47a4-4e19-91db-4d36c83f2e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:33:54.192850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125759e-47a4-4e19-91db-4d36c83f2e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:33:54.193136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125759e-47a4-4e19-91db-4d36c83f2e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:33:54.193415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125759e-47a4-4e19-91db-4d36c83f2e8c admin admin] PATH_INFO: `/v3/projects/d9e029fc61014cd88f3d097845a52460` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:33:54.194564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125759e-47a4-4e19-91db-4d36c83f2e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9e029fc61014cd88f3d097845a52460)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:33:54.196511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125759e-47a4-4e19-91db-4d36c83f2e8c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:33:54.219697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:54.248614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4125759e-47a4-4e19-91db-4d36c83f2e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e029fc61014cd88f3d097845a52460', 'request_id': 'req-4125759e-47a4-4e19-91db-4d36c83f2e8c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:54.258147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4125759e-47a4-4e19-91db-4d36c83f2e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e029fc61014cd88f3d097845a52460', 'request_id': 'req-4125759e-47a4-4e19-91db-4d36c83f2e8c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:54.268176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4125759e-47a4-4e19-91db-4d36c83f2e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e029fc61014cd88f3d097845a52460', 'request_id': 'req-4125759e-47a4-4e19-91db-4d36c83f2e8c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:54.280156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4125759e-47a4-4e19-91db-4d36c83f2e8c admin admin] The token cache is being invalidate because project d9e029fc61014cd88f3d097845a52460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:33:54.280453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4125759e-47a4-4e19-91db-4d36c83f2e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:54.281191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4125759e-47a4-4e19-91db-4d36c83f2e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:33:54.283100 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3925/7897] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:33:54 2022] DELETE /identity/v3/projects/d9e029fc61014cd88f3d097845a52460 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:03.909090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:04.276996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:11.688572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7b89e-8259-4ac6-b016-56c9ed2114f1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:11.688572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1dd7b89e-8259-4ac6-b016-56c9ed2114f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:11.695741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7b89e-8259-4ac6-b016-56c9ed2114f1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:11.755326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16143dc-1410-49be-8e79-b413a0dabff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:11.756026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16143dc-1410-49be-8e79-b413a0dabff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:11.756321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16143dc-1410-49be-8e79-b413a0dabff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:11.756610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16143dc-1410-49be-8e79-b413a0dabff2 admin admin] PATH_INFO: `/v3/users/5a6da0171fac41fb934ed2b294081531` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:11.757844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16143dc-1410-49be-8e79-b413a0dabff2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a6da0171fac41fb934ed2b294081531)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:11.759803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16143dc-1410-49be-8e79-b413a0dabff2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:11.828598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a16143dc-1410-49be-8e79-b413a0dabff2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a6da0171fac41fb934ed2b294081531'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:11.842628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a16143dc-1410-49be-8e79-b413a0dabff2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a6da0171fac41fb934ed2b294081531'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:11.843395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a16143dc-1410-49be-8e79-b413a0dabff2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a6da0171fac41fb934ed2b294081531'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:11.852055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a16143dc-1410-49be-8e79-b413a0dabff2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a6da0171fac41fb934ed2b294081531'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:11.852903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a16143dc-1410-49be-8e79-b413a0dabff2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a6da0171fac41fb934ed2b294081531'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:11.872611 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3973/7898] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:11 2022] DELETE /identity/v3/users/5a6da0171fac41fb934ed2b294081531 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:12.072758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125759e-47a4-4e19-91db-4d36c83f2e8c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:12.074370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4125759e-47a4-4e19-91db-4d36c83f2e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:12.089419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125759e-47a4-4e19-91db-4d36c83f2e8c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:12.160940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200b417-0d38-4f0c-b6c9-143b6d7cfa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:12.161749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b417-0d38-4f0c-b6c9-143b6d7cfa54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:12.162629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b417-0d38-4f0c-b6c9-143b6d7cfa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:12.162859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b417-0d38-4f0c-b6c9-143b6d7cfa54 admin admin] PATH_INFO: `/v3/projects/1c7b4209e06447d5abdff867f9a7adce` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:12.164471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200b417-0d38-4f0c-b6c9-143b6d7cfa54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c7b4209e06447d5abdff867f9a7adce)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:12.166800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200b417-0d38-4f0c-b6c9-143b6d7cfa54 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:12.237778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8200b417-0d38-4f0c-b6c9-143b6d7cfa54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c7b4209e06447d5abdff867f9a7adce', 'request_id': 'req-8200b417-0d38-4f0c-b6c9-143b6d7cfa54'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:12.248389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8200b417-0d38-4f0c-b6c9-143b6d7cfa54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c7b4209e06447d5abdff867f9a7adce', 'request_id': 'req-8200b417-0d38-4f0c-b6c9-143b6d7cfa54'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:12.256937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8200b417-0d38-4f0c-b6c9-143b6d7cfa54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c7b4209e06447d5abdff867f9a7adce', 'request_id': 'req-8200b417-0d38-4f0c-b6c9-143b6d7cfa54'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:12.269867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8200b417-0d38-4f0c-b6c9-143b6d7cfa54 admin admin] The token cache is being invalidate because project 1c7b4209e06447d5abdff867f9a7adce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:12.270235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8200b417-0d38-4f0c-b6c9-143b6d7cfa54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:12.270994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8200b417-0d38-4f0c-b6c9-143b6d7cfa54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:12.272829 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3926/7899] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:12 2022] DELETE /identity/v3/projects/1c7b4209e06447d5abdff867f9a7adce => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:12.282814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72284c9f-5056-4049-9c03-f6b238ece8f9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:12.283198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72284c9f-5056-4049-9c03-f6b238ece8f9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:12.283586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72284c9f-5056-4049-9c03-f6b238ece8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:12.306516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-72284c9f-5056-4049-9c03-f6b238ece8f9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:12.307778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-72284c9f-5056-4049-9c03-f6b238ece8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:12.373399 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3974/7900] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:12.382142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23df20-6da5-4134-a6ab-45cc70010222 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:12.382364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23df20-6da5-4134-a6ab-45cc70010222 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:12.382616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23df20-6da5-4134-a6ab-45cc70010222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:12.422894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7c23df20-6da5-4134-a6ab-45cc70010222 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:12.425779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7c23df20-6da5-4134-a6ab-45cc70010222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:12.440928 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3927/7901] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:12.441957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72284c9f-5056-4049-9c03-f6b238ece8f9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:12.453222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72284c9f-5056-4049-9c03-f6b238ece8f9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:12.459475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2d541-4594-445d-a549-52c74bf13c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:12.460126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2d541-4594-445d-a549-52c74bf13c07 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:12.460414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2d541-4594-445d-a549-52c74bf13c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:12.460689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2d541-4594-445d-a549-52c74bf13c07 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:12.461402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2d541-4594-445d-a549-52c74bf13c07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:34:12.461709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2d541-4594-445d-a549-52c74bf13c07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:12.463401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2d541-4594-445d-a549-52c74bf13c07 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:12.476842 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3975/7902] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:12.481053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23df20-6da5-4134-a6ab-45cc70010222 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:12.491745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23df20-6da5-4134-a6ab-45cc70010222 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:12.500299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18557312-fe14-409f-b8ee-a6475b2fc817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:12.501460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18557312-fe14-409f-b8ee-a6475b2fc817 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:12.501817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18557312-fe14-409f-b8ee-a6475b2fc817 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:12.502102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18557312-fe14-409f-b8ee-a6475b2fc817 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:12.502774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18557312-fe14-409f-b8ee-a6475b2fc817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:12.504744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18557312-fe14-409f-b8ee-a6475b2fc817 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:12.539358 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3928/7903] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:12 2022] POST /identity/v3/projects => generated 389 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:12.541780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2d541-4594-445d-a549-52c74bf13c07 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:12.554200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2d541-4594-445d-a549-52c74bf13c07 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:12.561226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:12.626280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3461c-7777-413c-b7f1-0204fd55b686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:12.627324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3461c-7777-413c-b7f1-0204fd55b686 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:12.627840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3461c-7777-413c-b7f1-0204fd55b686 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:12.627840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3461c-7777-413c-b7f1-0204fd55b686 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:12.628687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3461c-7777-413c-b7f1-0204fd55b686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:12.630733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3461c-7777-413c-b7f1-0204fd55b686 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:12.659963 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3976/7904] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:12 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:12.663627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18557312-fe14-409f-b8ee-a6475b2fc817 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:12.683741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18557312-fe14-409f-b8ee-a6475b2fc817 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:12.690336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9efbb-d9e6-44ee-8659-f84bcfdc6fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:12.691154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9efbb-d9e6-44ee-8659-f84bcfdc6fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:12.691343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9efbb-d9e6-44ee-8659-f84bcfdc6fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:12.691549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9efbb-d9e6-44ee-8659-f84bcfdc6fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:12.692240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9efbb-d9e6-44ee-8659-f84bcfdc6fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:12.693846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9efbb-d9e6-44ee-8659-f84bcfdc6fa8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:12.708636 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3929/7905] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:12.710178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3461c-7777-413c-b7f1-0204fd55b686 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:12.721711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3461c-7777-413c-b7f1-0204fd55b686 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:12.726474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee8bd2-1613-4961-b75c-7be7b3fb309b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:12.727207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee8bd2-1613-4961-b75c-7be7b3fb309b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:12.727655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee8bd2-1613-4961-b75c-7be7b3fb309b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:12.728027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee8bd2-1613-4961-b75c-7be7b3fb309b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:12.729092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee8bd2-1613-4961-b75c-7be7b3fb309b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:12.730959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee8bd2-1613-4961-b75c-7be7b3fb309b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:12.743248 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3977/7906] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:12.747321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9efbb-d9e6-44ee-8659-f84bcfdc6fa8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:12.759922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9efbb-d9e6-44ee-8659-f84bcfdc6fa8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:12.764911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b018d2-2b9a-45fd-9a70-2e663bac31fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:12.765588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b018d2-2b9a-45fd-9a70-2e663bac31fc admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:12.766081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b018d2-2b9a-45fd-9a70-2e663bac31fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:12.766380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b018d2-2b9a-45fd-9a70-2e663bac31fc admin admin] PATH_INFO: `/v3/projects/1b5a90b02ac44cc09b126ded6064668b/users/adf51a715dab4e8699cd1597a0d4445f/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:12.784708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b018d2-2b9a-45fd-9a70-2e663bac31fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5a90b02ac44cc09b126ded6064668b, user_id=adf51a715dab4e8699cd1597a0d4445f, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:12.787420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b018d2-2b9a-45fd-9a70-2e663bac31fc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:12.803370 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3930/7907] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:12 2022] PUT /identity/v3/projects/1b5a90b02ac44cc09b126ded6064668b/users/adf51a715dab4e8699cd1597a0d4445f/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:34:12.814578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e0fb1-8c65-46ac-8045-c3f99d8e7d36 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:12.814872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e0fb1-8c65-46ac-8045-c3f99d8e7d36 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:12.815147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e0fb1-8c65-46ac-8045-c3f99d8e7d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:12.849916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-956e0fb1-8c65-46ac-8045-c3f99d8e7d36 None None] MFA Rules not processed for user `adf51a715dab4e8699cd1597a0d4445f`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:12.851199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-956e0fb1-8c65-46ac-8045-c3f99d8e7d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:12.932433 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3978/7908] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:12.936915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b018d2-2b9a-45fd-9a70-2e663bac31fc admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:12.973059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:13.020756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b018d2-2b9a-45fd-9a70-2e663bac31fc admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:13.026565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289625c2-520c-4441-ab3b-82f986d3c7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:13.027680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289625c2-520c-4441-ab3b-82f986d3c7fe admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:13.028277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289625c2-520c-4441-ab3b-82f986d3c7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:13.028800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289625c2-520c-4441-ab3b-82f986d3c7fe admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:13.029663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289625c2-520c-4441-ab3b-82f986d3c7fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:13.032587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289625c2-520c-4441-ab3b-82f986d3c7fe admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:13.067634 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3931/7909] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:12 2022] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:13.071960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e0fb1-8c65-46ac-8045-c3f99d8e7d36 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:13.083725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e0fb1-8c65-46ac-8045-c3f99d8e7d36 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:13.158947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ae9dc-1191-4ac3-8be1-7ade2c61ec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:13.159692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ae9dc-1191-4ac3-8be1-7ade2c61ec46 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:13.160143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ae9dc-1191-4ac3-8be1-7ade2c61ec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:13.160431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ae9dc-1191-4ac3-8be1-7ade2c61ec46 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:13.161155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ae9dc-1191-4ac3-8be1-7ade2c61ec46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:13.163916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ae9dc-1191-4ac3-8be1-7ade2c61ec46 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:13.193670 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3979/7910] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:13 2022] POST /identity/v3/users => generated 302 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:13.197623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289625c2-520c-4441-ab3b-82f986d3c7fe admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:13.210598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289625c2-520c-4441-ab3b-82f986d3c7fe admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:13.216771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1874c0a-2838-4357-9b45-4b9acc908d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:13.217527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1874c0a-2838-4357-9b45-4b9acc908d86 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:13.218088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1874c0a-2838-4357-9b45-4b9acc908d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:13.218459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1874c0a-2838-4357-9b45-4b9acc908d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:13.219937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1874c0a-2838-4357-9b45-4b9acc908d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:13.221621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1874c0a-2838-4357-9b45-4b9acc908d86 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:13.236667 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3932/7911] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:34:13.241513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ae9dc-1191-4ac3-8be1-7ade2c61ec46 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:13.247781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:13.256520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ae9dc-1191-4ac3-8be1-7ade2c61ec46 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:13.261906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fcdcd-c60d-4d13-bb51-1c4edc247c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:13.262796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fcdcd-c60d-4d13-bb51-1c4edc247c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:13.263178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fcdcd-c60d-4d13-bb51-1c4edc247c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:13.263585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fcdcd-c60d-4d13-bb51-1c4edc247c92 admin admin] PATH_INFO: `/v3/projects/f93bb9ea220c4ad78ad6c55e4ace55bb/users/630f291b45b2414a94443a813f3c8c7c/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:13.282346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fcdcd-c60d-4d13-bb51-1c4edc247c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93bb9ea220c4ad78ad6c55e4ace55bb, user_id=630f291b45b2414a94443a813f3c8c7c, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:13.286591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fcdcd-c60d-4d13-bb51-1c4edc247c92 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:13.307772 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3980/7912] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:13 2022] PUT /identity/v3/projects/f93bb9ea220c4ad78ad6c55e4ace55bb/users/630f291b45b2414a94443a813f3c8c7c/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:34:13.311539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1874c0a-2838-4357-9b45-4b9acc908d86 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:13.326032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1874c0a-2838-4357-9b45-4b9acc908d86 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:13.400182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94832aed-4064-4d1a-8aab-6fc5b171aeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:13.400733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94832aed-4064-4d1a-8aab-6fc5b171aeee admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:13.400979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94832aed-4064-4d1a-8aab-6fc5b171aeee admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:13.401271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94832aed-4064-4d1a-8aab-6fc5b171aeee admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:13.402006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94832aed-4064-4d1a-8aab-6fc5b171aeee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:13.403732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94832aed-4064-4d1a-8aab-6fc5b171aeee admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:13.416210 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3933/7913] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:13.420462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fcdcd-c60d-4d13-bb51-1c4edc247c92 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:13.433274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fcdcd-c60d-4d13-bb51-1c4edc247c92 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:13.438224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738b2fc-8861-495a-91d3-42661305ceb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:13.439044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738b2fc-8861-495a-91d3-42661305ceb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:13.439484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738b2fc-8861-495a-91d3-42661305ceb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:13.439922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738b2fc-8861-495a-91d3-42661305ceb1 admin admin] PATH_INFO: `/v3/projects/f93bb9ea220c4ad78ad6c55e4ace55bb/users/630f291b45b2414a94443a813f3c8c7c/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:13.442272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738b2fc-8861-495a-91d3-42661305ceb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93bb9ea220c4ad78ad6c55e4ace55bb, user_id=630f291b45b2414a94443a813f3c8c7c, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:13.445391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738b2fc-8861-495a-91d3-42661305ceb1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:13.460601 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3981/7914] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:13 2022] PUT /identity/v3/projects/f93bb9ea220c4ad78ad6c55e4ace55bb/users/630f291b45b2414a94443a813f3c8c7c/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:13.471118 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73488e4-f1cc-4ab8-80b6-377a01ecb106 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:13.471456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73488e4-f1cc-4ab8-80b6-377a01ecb106 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:13.471737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73488e4-f1cc-4ab8-80b6-377a01ecb106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:13.502442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b73488e4-f1cc-4ab8-80b6-377a01ecb106 None None] MFA Rules not processed for user `630f291b45b2414a94443a813f3c8c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:13.503735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b73488e4-f1cc-4ab8-80b6-377a01ecb106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:13.592726 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3934/7915] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:13.598347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738b2fc-8861-495a-91d3-42661305ceb1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:13.609685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738b2fc-8861-495a-91d3-42661305ceb1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:13.616359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cda333-73c6-41b0-aa99-46572d081fac tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:13.616991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cda333-73c6-41b0-aa99-46572d081fac tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:13.617321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cda333-73c6-41b0-aa99-46572d081fac tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:13.617637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cda333-73c6-41b0-aa99-46572d081fac tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:13.618363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cda333-73c6-41b0-aa99-46572d081fac tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:13.620024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cda333-73c6-41b0-aa99-46572d081fac tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:13.648015 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3982/7916] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:34:13 2022] POST /identity/v3/domains => generated 275 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:13.650009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73488e4-f1cc-4ab8-80b6-377a01ecb106 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:13.662237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73488e4-f1cc-4ab8-80b6-377a01ecb106 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:13.688456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:13.739911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b8878-2f99-43ce-8fdf-51818a3c444e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:13.741574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b8878-2f99-43ce-8fdf-51818a3c444e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:13.742234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b8878-2f99-43ce-8fdf-51818a3c444e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:13.742701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b8878-2f99-43ce-8fdf-51818a3c444e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/665f4b123eb24ae1bbfd1d1c3ed27cfc/config` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:13.743544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b8878-2f99-43ce-8fdf-51818a3c444e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=665f4b123eb24ae1bbfd1d1c3ed27cfc)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:13.744595 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-8f2b8878-2f99-43ce-8fdf-51818a3c444e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:34:13.744595 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:34:13.744595 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:34:13.745574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b8878-2f99-43ce-8fdf-51818a3c444e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:13.843080 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3935/7917] 10.222.0.17 () {60 vars in 1269 bytes} [Sat Jul 30 21:34:13 2022] PUT /identity/v3/domains/665f4b123eb24ae1bbfd1d1c3ed27cfc/config => generated 138 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:13.847747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cda333-73c6-41b0-aa99-46572d081fac tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:13.865160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cda333-73c6-41b0-aa99-46572d081fac tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:13.873675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff675d0-5609-49e0-bc06-9269cb9c94b4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:13.874394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff675d0-5609-49e0-bc06-9269cb9c94b4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:13.874850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff675d0-5609-49e0-bc06-9269cb9c94b4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:13.875958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff675d0-5609-49e0-bc06-9269cb9c94b4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/665f4b123eb24ae1bbfd1d1c3ed27cfc/config/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:13.877248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff675d0-5609-49e0-bc06-9269cb9c94b4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=665f4b123eb24ae1bbfd1d1c3ed27cfc, group=identity)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:13.878294 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-cff675d0-5609-49e0-bc06-9269cb9c94b4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:34:13.878294 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:34:13.878294 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:34:13.879208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff675d0-5609-49e0-bc06-9269cb9c94b4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:13.887654 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3983/7918] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:34:13 2022] GET /identity/v3/domains/665f4b123eb24ae1bbfd1d1c3ed27cfc/config/identity => generated 45 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:13.892265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b8878-2f99-43ce-8fdf-51818a3c444e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:13.903909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b8878-2f99-43ce-8fdf-51818a3c444e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:13.911160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2df05-de76-43a1-87dc-3194341099df tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:13.912485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2df05-de76-43a1-87dc-3194341099df tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:13.912849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2df05-de76-43a1-87dc-3194341099df tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:13.913136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2df05-de76-43a1-87dc-3194341099df tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/665f4b123eb24ae1bbfd1d1c3ed27cfc/config/identity/driver` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:13.915066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2df05-de76-43a1-87dc-3194341099df tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=665f4b123eb24ae1bbfd1d1c3ed27cfc, group=identity, option=driver)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:13.918024 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-19b2df05-de76-43a1-87dc-3194341099df tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:34:13.918024 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:34:13.918024 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:34:13.921484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2df05-de76-43a1-87dc-3194341099df tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:13.929305 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3936/7919] 10.222.0.17 () {58 vars in 1296 bytes} [Sat Jul 30 21:34:13 2022] GET /identity/v3/domains/665f4b123eb24ae1bbfd1d1c3ed27cfc/config/identity/driver => generated 31 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:13.933518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff675d0-5609-49e0-bc06-9269cb9c94b4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:13.946862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff675d0-5609-49e0-bc06-9269cb9c94b4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:13.952571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1005f00-64ef-40ad-8e21-f446259478aa tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:13.954195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1005f00-64ef-40ad-8e21-f446259478aa tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:13.954691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1005f00-64ef-40ad-8e21-f446259478aa tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:13.955194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1005f00-64ef-40ad-8e21-f446259478aa tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/665f4b123eb24ae1bbfd1d1c3ed27cfc/config/ldap` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:13.956885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1005f00-64ef-40ad-8e21-f446259478aa tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=665f4b123eb24ae1bbfd1d1c3ed27cfc, group=ldap)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:13.958729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1005f00-64ef-40ad-8e21-f446259478aa tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:13.964795 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3984/7920] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:34:13 2022] GET /identity/v3/domains/665f4b123eb24ae1bbfd1d1c3ed27cfc/config/ldap => generated 106 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:13.968983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2df05-de76-43a1-87dc-3194341099df tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:13.981095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2df05-de76-43a1-87dc-3194341099df tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:13.991490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacecc44-ddb4-4db6-9a94-b49d5b2dacd6 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:13.992541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacecc44-ddb4-4db6-9a94-b49d5b2dacd6 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:13.992687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacecc44-ddb4-4db6-9a94-b49d5b2dacd6 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:13.993095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacecc44-ddb4-4db6-9a94-b49d5b2dacd6 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/665f4b123eb24ae1bbfd1d1c3ed27cfc/config/ldap/url` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:13.994848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacecc44-ddb4-4db6-9a94-b49d5b2dacd6 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=665f4b123eb24ae1bbfd1d1c3ed27cfc, group=ldap, option=url)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:13.996664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacecc44-ddb4-4db6-9a94-b49d5b2dacd6 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:14.007726 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3937/7921] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:34:13 2022] GET /identity/v3/domains/665f4b123eb24ae1bbfd1d1c3ed27cfc/config/ldap/url => generated 46 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:14.010194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1005f00-64ef-40ad-8e21-f446259478aa tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:14.035875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1005f00-64ef-40ad-8e21-f446259478aa tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:14.043235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82682b5c-77aa-4ad7-bb88-968c1203d2dd tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:14.044538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82682b5c-77aa-4ad7-bb88-968c1203d2dd tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:14.056348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82682b5c-77aa-4ad7-bb88-968c1203d2dd tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:14.057023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82682b5c-77aa-4ad7-bb88-968c1203d2dd tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/665f4b123eb24ae1bbfd1d1c3ed27cfc/config/ldap/user_tree_dn` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:14.064294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82682b5c-77aa-4ad7-bb88-968c1203d2dd tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=665f4b123eb24ae1bbfd1d1c3ed27cfc, group=ldap, option=user_tree_dn)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:14.066329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82682b5c-77aa-4ad7-bb88-968c1203d2dd tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:14.077647 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3985/7922] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:34:14 2022] GET /identity/v3/domains/665f4b123eb24ae1bbfd1d1c3ed27cfc/config/ldap/user_tree_dn => generated 63 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:14.082713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacecc44-ddb4-4db6-9a94-b49d5b2dacd6 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:14.094710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacecc44-ddb4-4db6-9a94-b49d5b2dacd6 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:14.100252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0110d-4fe4-4eda-9cce-7b36e4ef286d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:14.101010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0110d-4fe4-4eda-9cce-7b36e4ef286d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:14.101371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0110d-4fe4-4eda-9cce-7b36e4ef286d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:14.101721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0110d-4fe4-4eda-9cce-7b36e4ef286d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/665f4b123eb24ae1bbfd1d1c3ed27cfc/config` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:14.102429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0110d-4fe4-4eda-9cce-7b36e4ef286d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=665f4b123eb24ae1bbfd1d1c3ed27cfc)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:14.103778 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-78b0110d-4fe4-4eda-9cce-7b36e4ef286d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:34:14.103778 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:34:14.103778 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:34:14.104677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0110d-4fe4-4eda-9cce-7b36e4ef286d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:14.121862 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3938/7923] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:34:14 2022] DELETE /identity/v3/domains/665f4b123eb24ae1bbfd1d1c3ed27cfc/config => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:34:14.127276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82682b5c-77aa-4ad7-bb88-968c1203d2dd tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:14.142681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82682b5c-77aa-4ad7-bb88-968c1203d2dd tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:14.157389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d87b87-69c9-45d8-b42c-260ac5242846 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:14.158139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d87b87-69c9-45d8-b42c-260ac5242846 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:14.158432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d87b87-69c9-45d8-b42c-260ac5242846 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:14.158718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d87b87-69c9-45d8-b42c-260ac5242846 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/665f4b123eb24ae1bbfd1d1c3ed27cfc` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:14.163943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d87b87-69c9-45d8-b42c-260ac5242846 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=665f4b123eb24ae1bbfd1d1c3ed27cfc)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:14.166747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d87b87-69c9-45d8-b42c-260ac5242846 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:14.202385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-01d87b87-69c9-45d8-b42c-260ac5242846 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '665f4b123eb24ae1bbfd1d1c3ed27cfc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:14.203523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-01d87b87-69c9-45d8-b42c-260ac5242846 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '665f4b123eb24ae1bbfd1d1c3ed27cfc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:14.244200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-01d87b87-69c9-45d8-b42c-260ac5242846 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '665f4b123eb24ae1bbfd1d1c3ed27cfc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:14.244981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-01d87b87-69c9-45d8-b42c-260ac5242846 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '665f4b123eb24ae1bbfd1d1c3ed27cfc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:14.248209 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3986/7924] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:34:14 2022] PATCH /identity/v3/domains/665f4b123eb24ae1bbfd1d1c3ed27cfc => generated 276 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:34:14.253197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0110d-4fe4-4eda-9cce-7b36e4ef286d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:14.255845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-78b0110d-4fe4-4eda-9cce-7b36e4ef286d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:14.270219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0110d-4fe4-4eda-9cce-7b36e4ef286d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:14.338496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a74615-8dc5-4479-b9b0-c71c423c73c0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:14.339216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a74615-8dc5-4479-b9b0-c71c423c73c0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:14.339535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a74615-8dc5-4479-b9b0-c71c423c73c0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:14.339811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a74615-8dc5-4479-b9b0-c71c423c73c0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/665f4b123eb24ae1bbfd1d1c3ed27cfc` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:14.354681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a74615-8dc5-4479-b9b0-c71c423c73c0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=665f4b123eb24ae1bbfd1d1c3ed27cfc)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:14.356370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a74615-8dc5-4479-b9b0-c71c423c73c0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:14.383216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5a74615-8dc5-4479-b9b0-c71c423c73c0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '665f4b123eb24ae1bbfd1d1c3ed27cfc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:14.387046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5a74615-8dc5-4479-b9b0-c71c423c73c0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '665f4b123eb24ae1bbfd1d1c3ed27cfc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:14.439630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:14.458981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5a74615-8dc5-4479-b9b0-c71c423c73c0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '665f4b123eb24ae1bbfd1d1c3ed27cfc', 'request_id': 'req-a5a74615-8dc5-4479-b9b0-c71c423c73c0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:14.469711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5a74615-8dc5-4479-b9b0-c71c423c73c0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '665f4b123eb24ae1bbfd1d1c3ed27cfc', 'request_id': 'req-a5a74615-8dc5-4479-b9b0-c71c423c73c0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:14.487958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5a74615-8dc5-4479-b9b0-c71c423c73c0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '665f4b123eb24ae1bbfd1d1c3ed27cfc', 'request_id': 'req-a5a74615-8dc5-4479-b9b0-c71c423c73c0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:14.516985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5a74615-8dc5-4479-b9b0-c71c423c73c0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] The token cache is being invalidate because project 665f4b123eb24ae1bbfd1d1c3ed27cfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:14.517289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5a74615-8dc5-4479-b9b0-c71c423c73c0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:14.518112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5a74615-8dc5-4479-b9b0-c71c423c73c0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:14.528480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5a74615-8dc5-4479-b9b0-c71c423c73c0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '665f4b123eb24ae1bbfd1d1c3ed27cfc', 'request_id': 'req-a5a74615-8dc5-4479-b9b0-c71c423c73c0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:14.532880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5a74615-8dc5-4479-b9b0-c71c423c73c0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '665f4b123eb24ae1bbfd1d1c3ed27cfc', 'request_id': 'req-a5a74615-8dc5-4479-b9b0-c71c423c73c0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:14.533961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a5a74615-8dc5-4479-b9b0-c71c423c73c0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '665f4b123eb24ae1bbfd1d1c3ed27cfc', 'request_id': 'req-a5a74615-8dc5-4479-b9b0-c71c423c73c0'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:14.545838 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3939/7925] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:34:14 2022] DELETE /identity/v3/domains/665f4b123eb24ae1bbfd1d1c3ed27cfc => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:14.547183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d87b87-69c9-45d8-b42c-260ac5242846 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:14.558567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d87b87-69c9-45d8-b42c-260ac5242846 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:14.632694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13ea50-318b-487e-81df-9ce77bc3e591 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:14.633415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13ea50-318b-487e-81df-9ce77bc3e591 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:14.633778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13ea50-318b-487e-81df-9ce77bc3e591 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:14.634128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13ea50-318b-487e-81df-9ce77bc3e591 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:14.634915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13ea50-318b-487e-81df-9ce77bc3e591 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:14.637479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13ea50-318b-487e-81df-9ce77bc3e591 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:14.671682 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3987/7926] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:34:14 2022] POST /identity/v3/domains => generated 277 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:14.673408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a74615-8dc5-4479-b9b0-c71c423c73c0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:14.674918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a5a74615-8dc5-4479-b9b0-c71c423c73c0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:14.692833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a74615-8dc5-4479-b9b0-c71c423c73c0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:14.767829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f4f36-ff0a-4e95-9fb6-116f2a8509af tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:14.768517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f4f36-ff0a-4e95-9fb6-116f2a8509af tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:14.768964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f4f36-ff0a-4e95-9fb6-116f2a8509af tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:14.769258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f4f36-ff0a-4e95-9fb6-116f2a8509af tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/1832a1af200546deb95d4f2872043536/config` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:14.770011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f4f36-ff0a-4e95-9fb6-116f2a8509af tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=1832a1af200546deb95d4f2872043536)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:14.771687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f4f36-ff0a-4e95-9fb6-116f2a8509af tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:14.820123 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3940/7927] 10.222.0.17 () {60 vars in 1269 bytes} [Sat Jul 30 21:34:14 2022] PUT /identity/v3/domains/1832a1af200546deb95d4f2872043536/config => generated 138 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:14.824087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13ea50-318b-487e-81df-9ce77bc3e591 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:14.838901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13ea50-318b-487e-81df-9ce77bc3e591 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:14.843944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ad432-1419-414d-9bc2-80b446512da7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:14.845144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ad432-1419-414d-9bc2-80b446512da7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:14.845432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ad432-1419-414d-9bc2-80b446512da7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:14.845714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ad432-1419-414d-9bc2-80b446512da7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/1832a1af200546deb95d4f2872043536/config` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:14.846457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ad432-1419-414d-9bc2-80b446512da7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=1832a1af200546deb95d4f2872043536)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:14.849726 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-c58ad432-1419-414d-9bc2-80b446512da7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:34:14.849726 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:34:14.849726 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:34:14.849726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ad432-1419-414d-9bc2-80b446512da7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:14.890069 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3988/7928] 10.222.0.17 () {60 vars in 1271 bytes} [Sat Jul 30 21:34:14 2022] PATCH /identity/v3/domains/1832a1af200546deb95d4f2872043536/config => generated 142 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:34:14.894476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f4f36-ff0a-4e95-9fb6-116f2a8509af tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:14.910042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f4f36-ff0a-4e95-9fb6-116f2a8509af tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:14.915065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672004f4-2e51-4771-a225-1b2f73e28fba tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:14.916689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672004f4-2e51-4771-a225-1b2f73e28fba tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:14.916897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672004f4-2e51-4771-a225-1b2f73e28fba tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:14.917304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672004f4-2e51-4771-a225-1b2f73e28fba tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/1832a1af200546deb95d4f2872043536/config` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:14.918546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672004f4-2e51-4771-a225-1b2f73e28fba tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1832a1af200546deb95d4f2872043536)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:14.920264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672004f4-2e51-4771-a225-1b2f73e28fba tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:14.930290 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3941/7929] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:34:14 2022] GET /identity/v3/domains/1832a1af200546deb95d4f2872043536/config => generated 142 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:14.934085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ad432-1419-414d-9bc2-80b446512da7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:14.949032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ad432-1419-414d-9bc2-80b446512da7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:14.954821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc073c-946a-44a4-81f8-e55e7efa4e66 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:14.955864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc073c-946a-44a4-81f8-e55e7efa4e66 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:14.956351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc073c-946a-44a4-81f8-e55e7efa4e66 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:14.956818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc073c-946a-44a4-81f8-e55e7efa4e66 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/1832a1af200546deb95d4f2872043536/config` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:14.957757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc073c-946a-44a4-81f8-e55e7efa4e66 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=1832a1af200546deb95d4f2872043536)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:14.959017 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-4cfc073c-946a-44a4-81f8-e55e7efa4e66 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:34:14.959017 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:34:14.959017 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:34:14.960355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc073c-946a-44a4-81f8-e55e7efa4e66 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:14.964855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=85,keystone:INSERT=7,keystone:UPDATE=1,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:14.974849 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3989/7930] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:34:14 2022] DELETE /identity/v3/domains/1832a1af200546deb95d4f2872043536/config => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:14.978889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672004f4-2e51-4771-a225-1b2f73e28fba tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:14.989445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672004f4-2e51-4771-a225-1b2f73e28fba tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:14.996002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0a84a-ad1e-4329-862b-9706b958e970 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:14.997687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0a84a-ad1e-4329-862b-9706b958e970 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:14.999647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0a84a-ad1e-4329-862b-9706b958e970 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:14.999949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0a84a-ad1e-4329-862b-9706b958e970 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/1832a1af200546deb95d4f2872043536/config` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:15.001591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0a84a-ad1e-4329-862b-9706b958e970 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1832a1af200546deb95d4f2872043536)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:15.003235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0a84a-ad1e-4329-862b-9706b958e970 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:15.012768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-98f0a84a-ad1e-4329-862b-9706b958e970 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Could not find any options in domain configuration for domain 1832a1af200546deb95d4f2872043536.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 1832a1af200546deb95d4f2872043536. Jul 30 21:34:15.012768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:15.012768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:34:15.012768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:34:15.012768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:34:15.012768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:34:15.012768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:34:15.012768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:34:15.012768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:34:15.012768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:34:15.012768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:34:15.012768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:34:15.012768 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 30 21:34:15.014039 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 30 21:34:15.014039 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 30 21:34:15.014039 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 30 21:34:15.014039 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:34:15.014039 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:34:15.014039 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 30 21:34:15.014039 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 30 21:34:15.014039 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 1832a1af200546deb95d4f2872043536. Jul 30 21:34:15.014039 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:34:15.014811 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3942/7931] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:34:14 2022] GET /identity/v3/domains/1832a1af200546deb95d4f2872043536/config => generated 151 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:34:15.018744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc073c-946a-44a4-81f8-e55e7efa4e66 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:15.030514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc073c-946a-44a4-81f8-e55e7efa4e66 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:15.037097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db80e4-b665-4890-afdf-ca691f4584e2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:15.037775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db80e4-b665-4890-afdf-ca691f4584e2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:15.038057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db80e4-b665-4890-afdf-ca691f4584e2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:15.038368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db80e4-b665-4890-afdf-ca691f4584e2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/1832a1af200546deb95d4f2872043536/config` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:15.039016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db80e4-b665-4890-afdf-ca691f4584e2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=1832a1af200546deb95d4f2872043536)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:15.040670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db80e4-b665-4890-afdf-ca691f4584e2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:15.047778 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3990/7932] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:34:15 2022] DELETE /identity/v3/domains/1832a1af200546deb95d4f2872043536/config => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:34:15.052556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0a84a-ad1e-4329-862b-9706b958e970 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:15.063510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0a84a-ad1e-4329-862b-9706b958e970 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:15.069564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f04e20-52c9-49df-ae34-d917c3f13b14 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:15.070459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f04e20-52c9-49df-ae34-d917c3f13b14 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:15.070747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f04e20-52c9-49df-ae34-d917c3f13b14 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:15.071024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f04e20-52c9-49df-ae34-d917c3f13b14 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/1832a1af200546deb95d4f2872043536` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:15.072726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f04e20-52c9-49df-ae34-d917c3f13b14 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1832a1af200546deb95d4f2872043536)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:15.074747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f04e20-52c9-49df-ae34-d917c3f13b14 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:15.099562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c3f04e20-52c9-49df-ae34-d917c3f13b14 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1832a1af200546deb95d4f2872043536'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:15.100418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c3f04e20-52c9-49df-ae34-d917c3f13b14 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1832a1af200546deb95d4f2872043536'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:15.107071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4c420-5b15-4810-aa3d-0cbc0195b99b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:15.107504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4c420-5b15-4810-aa3d-0cbc0195b99b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:15.107689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4c420-5b15-4810-aa3d-0cbc0195b99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:15.130324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-fac4c420-5b15-4810-aa3d-0cbc0195b99b None None] MFA Rules not processed for user `9f113fc80feb42148c3dad0c33417dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:15.131266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c3f04e20-52c9-49df-ae34-d917c3f13b14 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1832a1af200546deb95d4f2872043536'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:15.131812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fac4c420-5b15-4810-aa3d-0cbc0195b99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:15.132073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c3f04e20-52c9-49df-ae34-d917c3f13b14 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1832a1af200546deb95d4f2872043536'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:15.135089 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3943/7933] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:34:15 2022] PATCH /identity/v3/domains/1832a1af200546deb95d4f2872043536 => generated 278 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:15.139241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f04e20-52c9-49df-ae34-d917c3f13b14 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:15.140298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c3f04e20-52c9-49df-ae34-d917c3f13b14 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:15.162380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:15.201476 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3991/7934] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:15.231280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f04e20-52c9-49df-ae34-d917c3f13b14 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:15.237981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844e575-110b-4a23-8f1c-f66dbec4fe95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:15.238386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844e575-110b-4a23-8f1c-f66dbec4fe95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:15.238756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844e575-110b-4a23-8f1c-f66dbec4fe95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:15.239044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844e575-110b-4a23-8f1c-f66dbec4fe95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/1832a1af200546deb95d4f2872043536` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:15.251876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844e575-110b-4a23-8f1c-f66dbec4fe95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1832a1af200546deb95d4f2872043536)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:15.253642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844e575-110b-4a23-8f1c-f66dbec4fe95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:15.268892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4c420-5b15-4810-aa3d-0cbc0195b99b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:15.270269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fac4c420-5b15-4810-aa3d-0cbc0195b99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:15.283877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9844e575-110b-4a23-8f1c-f66dbec4fe95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1832a1af200546deb95d4f2872043536'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:15.287523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9844e575-110b-4a23-8f1c-f66dbec4fe95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1832a1af200546deb95d4f2872043536'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:15.347140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9844e575-110b-4a23-8f1c-f66dbec4fe95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1832a1af200546deb95d4f2872043536', 'request_id': 'req-9844e575-110b-4a23-8f1c-f66dbec4fe95'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:15.352897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4c420-5b15-4810-aa3d-0cbc0195b99b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:15.361342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9844e575-110b-4a23-8f1c-f66dbec4fe95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1832a1af200546deb95d4f2872043536', 'request_id': 'req-9844e575-110b-4a23-8f1c-f66dbec4fe95'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:15.372421 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9844e575-110b-4a23-8f1c-f66dbec4fe95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1832a1af200546deb95d4f2872043536', 'request_id': 'req-9844e575-110b-4a23-8f1c-f66dbec4fe95'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:15.394166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9844e575-110b-4a23-8f1c-f66dbec4fe95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] The token cache is being invalidate because project 1832a1af200546deb95d4f2872043536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:15.394452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9844e575-110b-4a23-8f1c-f66dbec4fe95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:15.395324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9844e575-110b-4a23-8f1c-f66dbec4fe95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:15.405640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9844e575-110b-4a23-8f1c-f66dbec4fe95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1832a1af200546deb95d4f2872043536', 'request_id': 'req-9844e575-110b-4a23-8f1c-f66dbec4fe95'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:15.409864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9844e575-110b-4a23-8f1c-f66dbec4fe95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1832a1af200546deb95d4f2872043536', 'request_id': 'req-9844e575-110b-4a23-8f1c-f66dbec4fe95'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:15.410716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-9844e575-110b-4a23-8f1c-f66dbec4fe95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1832a1af200546deb95d4f2872043536', 'request_id': 'req-9844e575-110b-4a23-8f1c-f66dbec4fe95'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:15.419352 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3944/7935] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:34:15 2022] DELETE /identity/v3/domains/1832a1af200546deb95d4f2872043536 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:34:15.431555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844e575-110b-4a23-8f1c-f66dbec4fe95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:15.434031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9844e575-110b-4a23-8f1c-f66dbec4fe95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:15.438661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14911d-4b6b-4c49-a4fc-d782f53017e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:15.439333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14911d-4b6b-4c49-a4fc-d782f53017e9 service glance] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:15.439821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14911d-4b6b-4c49-a4fc-d782f53017e9 service glance] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:15.440112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14911d-4b6b-4c49-a4fc-d782f53017e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:15.443490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0e14911d-4b6b-4c49-a4fc-d782f53017e9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:15.550857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:15.567525 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844e575-110b-4a23-8f1c-f66dbec4fe95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:15.575942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14911d-4b6b-4c49-a4fc-d782f53017e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:15.577393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14911d-4b6b-4c49-a4fc-d782f53017e9 service glance] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:15.581131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c0572-395e-4b66-9946-b45b2546bfa8 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:15.581990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c0572-395e-4b66-9946-b45b2546bfa8 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:15.582344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c0572-395e-4b66-9946-b45b2546bfa8 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:15.582822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c0572-395e-4b66-9946-b45b2546bfa8 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:15.583638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c0572-395e-4b66-9946-b45b2546bfa8 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:15.585698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c0572-395e-4b66-9946-b45b2546bfa8 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:15.591725 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3992/7936] 10.222.0.17 () {60 vars in 1396 bytes} [Sat Jul 30 21:34:15 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3260 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:34:15.607190 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3945/7937] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:34:15 2022] POST /identity/v3/domains => generated 276 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:15.608725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14911d-4b6b-4c49-a4fc-d782f53017e9 service glance] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:15.616487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:15.623547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14911d-4b6b-4c49-a4fc-d782f53017e9 service glance] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:15.702650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88fcf1-7415-419a-9cdf-92f86c9e39c9 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:15.703745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88fcf1-7415-419a-9cdf-92f86c9e39c9 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:15.704273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88fcf1-7415-419a-9cdf-92f86c9e39c9 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:15.704778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88fcf1-7415-419a-9cdf-92f86c9e39c9 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601/config` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:15.711918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88fcf1-7415-419a-9cdf-92f86c9e39c9 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=c502b7bcc98a4bec9a5c3cb03feb1601)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:15.714403 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-5c88fcf1-7415-419a-9cdf-92f86c9e39c9 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:34:15.714403 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:34:15.714403 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:34:15.716427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88fcf1-7415-419a-9cdf-92f86c9e39c9 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:15.776257 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3993/7938] 10.222.0.17 () {60 vars in 1269 bytes} [Sat Jul 30 21:34:15 2022] PUT /identity/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601/config => generated 138 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:15.777637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c0572-395e-4b66-9946-b45b2546bfa8 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:15.796876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c0572-395e-4b66-9946-b45b2546bfa8 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:15.812034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d5ba1-bb0a-44a7-a105-ff1cf24032c3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:15.813580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d5ba1-bb0a-44a7-a105-ff1cf24032c3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:15.813985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d5ba1-bb0a-44a7-a105-ff1cf24032c3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:15.814316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d5ba1-bb0a-44a7-a105-ff1cf24032c3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601/config/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:15.815440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d5ba1-bb0a-44a7-a105-ff1cf24032c3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=c502b7bcc98a4bec9a5c3cb03feb1601, group=identity)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:15.816607 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-2d4d5ba1-bb0a-44a7-a105-ff1cf24032c3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:34:15.816607 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:34:15.816607 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:34:15.817625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d5ba1-bb0a-44a7-a105-ff1cf24032c3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:15.859094 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3946/7939] 10.222.0.17 () {60 vars in 1297 bytes} [Sat Jul 30 21:34:15 2022] PATCH /identity/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601/config/identity => generated 177 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:15.860503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88fcf1-7415-419a-9cdf-92f86c9e39c9 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:15.874859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88fcf1-7415-419a-9cdf-92f86c9e39c9 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:15.881403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24643b-be37-422d-a55a-12eb18bfec7e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:15.882347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24643b-be37-422d-a55a-12eb18bfec7e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:15.882855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24643b-be37-422d-a55a-12eb18bfec7e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:15.883137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24643b-be37-422d-a55a-12eb18bfec7e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601/config/identity/driver` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:15.883889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24643b-be37-422d-a55a-12eb18bfec7e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=c502b7bcc98a4bec9a5c3cb03feb1601, group=identity, option=driver)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:15.885524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24643b-be37-422d-a55a-12eb18bfec7e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:15.917084 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3994/7940] 10.222.0.17 () {60 vars in 1318 bytes} [Sat Jul 30 21:34:15 2022] PATCH /identity/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601/config/identity/driver => generated 177 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:34:15.921794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d5ba1-bb0a-44a7-a105-ff1cf24032c3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:15.942706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d5ba1-bb0a-44a7-a105-ff1cf24032c3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:15.949152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25770b52-2076-4fb7-b814-5a191c188905 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:15.949868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25770b52-2076-4fb7-b814-5a191c188905 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:15.950143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25770b52-2076-4fb7-b814-5a191c188905 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:15.950430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25770b52-2076-4fb7-b814-5a191c188905 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601/config/identity/driver` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:15.951087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25770b52-2076-4fb7-b814-5a191c188905 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=c502b7bcc98a4bec9a5c3cb03feb1601, group=identity, option=driver)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:15.957074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25770b52-2076-4fb7-b814-5a191c188905 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:16.001942 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3947/7941] 10.222.0.17 () {58 vars in 1299 bytes} [Sat Jul 30 21:34:15 2022] DELETE /identity/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601/config/identity/driver => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:16.008269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24643b-be37-422d-a55a-12eb18bfec7e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:16.024640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24643b-be37-422d-a55a-12eb18bfec7e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:16.032049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbb7a0-3f85-4cfb-a1f6-423bdc27967b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:16.032667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbb7a0-3f85-4cfb-a1f6-423bdc27967b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:16.033041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbb7a0-3f85-4cfb-a1f6-423bdc27967b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:16.033329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbb7a0-3f85-4cfb-a1f6-423bdc27967b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601/config/identity/driver` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:16.034613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbb7a0-3f85-4cfb-a1f6-423bdc27967b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=c502b7bcc98a4bec9a5c3cb03feb1601, group=identity, option=driver)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:16.042782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbb7a0-3f85-4cfb-a1f6-423bdc27967b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:16.049155 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-fabbb7a0-3f85-4cfb-a1f6-423bdc27967b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Could not find option driver in group identity in domain configuration for domain c502b7bcc98a4bec9a5c3cb03feb1601.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain c502b7bcc98a4bec9a5c3cb03feb1601. Jul 30 21:34:16.049155 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:16.049155 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:34:16.049155 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:34:16.049155 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:34:16.049155 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:34:16.049155 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:34:16.049155 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:34:16.049155 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:34:16.049155 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:34:16.049155 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:34:16.049155 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:34:16.049155 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 30 21:34:16.050308 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 30 21:34:16.050308 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 30 21:34:16.050308 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 30 21:34:16.050308 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:34:16.050308 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:34:16.050308 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 30 21:34:16.050308 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 30 21:34:16.050308 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain c502b7bcc98a4bec9a5c3cb03feb1601. Jul 30 21:34:16.050308 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:34:16.053477 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3995/7942] 10.222.0.17 () {58 vars in 1296 bytes} [Sat Jul 30 21:34:16 2022] GET /identity/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601/config/identity/driver => generated 171 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:34:16.054533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25770b52-2076-4fb7-b814-5a191c188905 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:16.070588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25770b52-2076-4fb7-b814-5a191c188905 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:16.076586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226d283-17b4-48e0-8f95-f0c5cfe4207a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:16.078259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226d283-17b4-48e0-8f95-f0c5cfe4207a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:16.078755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226d283-17b4-48e0-8f95-f0c5cfe4207a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:16.079225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226d283-17b4-48e0-8f95-f0c5cfe4207a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601/config/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:16.080259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226d283-17b4-48e0-8f95-f0c5cfe4207a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=c502b7bcc98a4bec9a5c3cb03feb1601, group=identity)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:16.082086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226d283-17b4-48e0-8f95-f0c5cfe4207a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:16.121343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbb7a0-3f85-4cfb-a1f6-423bdc27967b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:16.127404 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3948/7943] 10.222.0.17 () {58 vars in 1278 bytes} [Sat Jul 30 21:34:16 2022] DELETE /identity/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601/config/identity => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:34:16.139729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbb7a0-3f85-4cfb-a1f6-423bdc27967b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:16.147209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3314a32-d37d-4df6-8482-3e3196b78981 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:16.148337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3314a32-d37d-4df6-8482-3e3196b78981 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:16.148837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3314a32-d37d-4df6-8482-3e3196b78981 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:16.149443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3314a32-d37d-4df6-8482-3e3196b78981 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601/config/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:16.152086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3314a32-d37d-4df6-8482-3e3196b78981 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=c502b7bcc98a4bec9a5c3cb03feb1601, group=identity)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:16.154572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3314a32-d37d-4df6-8482-3e3196b78981 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:16.175315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-b3314a32-d37d-4df6-8482-3e3196b78981 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Could not find group identity in domain configuration for domain c502b7bcc98a4bec9a5c3cb03feb1601.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain c502b7bcc98a4bec9a5c3cb03feb1601. Jul 30 21:34:16.175315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:16.175315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:34:16.175315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:34:16.175315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:34:16.175315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:34:16.175315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:34:16.175315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:34:16.175315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:34:16.175315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:34:16.175315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:34:16.175315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:34:16.175315 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 30 21:34:16.176420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 30 21:34:16.176420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 30 21:34:16.176420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 30 21:34:16.176420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:34:16.176420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:34:16.176420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 30 21:34:16.176420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 30 21:34:16.176420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain c502b7bcc98a4bec9a5c3cb03feb1601. Jul 30 21:34:16.176420 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:34:16.183510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226d283-17b4-48e0-8f95-f0c5cfe4207a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:16.190511 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3996/7944] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:34:16 2022] GET /identity/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601/config/identity => generated 154 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:34:16.196890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226d283-17b4-48e0-8f95-f0c5cfe4207a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:16.202639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08d024-a569-465f-81f8-9ff23c34a4af tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:16.203746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08d024-a569-465f-81f8-9ff23c34a4af tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:16.204262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08d024-a569-465f-81f8-9ff23c34a4af tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:16.205620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08d024-a569-465f-81f8-9ff23c34a4af tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601/config` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:16.206511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf08d024-a569-465f-81f8-9ff23c34a4af tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=c502b7bcc98a4bec9a5c3cb03feb1601)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:16.208701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf08d024-a569-465f-81f8-9ff23c34a4af tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:16.230741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3314a32-d37d-4df6-8482-3e3196b78981 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:16.238392 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3949/7945] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:34:16 2022] DELETE /identity/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601/config => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:34:16.243725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3314a32-d37d-4df6-8482-3e3196b78981 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:16.253459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e0c34-3dfa-4b1d-84c1-769c9db7f2f4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:16.254261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e0c34-3dfa-4b1d-84c1-769c9db7f2f4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:16.254653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e0c34-3dfa-4b1d-84c1-769c9db7f2f4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:16.255119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e0c34-3dfa-4b1d-84c1-769c9db7f2f4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:16.263406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e0c34-3dfa-4b1d-84c1-769c9db7f2f4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c502b7bcc98a4bec9a5c3cb03feb1601)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:16.265393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e0c34-3dfa-4b1d-84c1-769c9db7f2f4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:16.296305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0e6e0c34-3dfa-4b1d-84c1-769c9db7f2f4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c502b7bcc98a4bec9a5c3cb03feb1601'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:16.297818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0e6e0c34-3dfa-4b1d-84c1-769c9db7f2f4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c502b7bcc98a4bec9a5c3cb03feb1601'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:16.342597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0e6e0c34-3dfa-4b1d-84c1-769c9db7f2f4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c502b7bcc98a4bec9a5c3cb03feb1601'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:16.345811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0e6e0c34-3dfa-4b1d-84c1-769c9db7f2f4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c502b7bcc98a4bec9a5c3cb03feb1601'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:16.353534 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3997/7946] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:34:16 2022] PATCH /identity/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601 => generated 277 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:16.354805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08d024-a569-465f-81f8-9ff23c34a4af tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:16.356896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bf08d024-a569-465f-81f8-9ff23c34a4af tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:16.379308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08d024-a569-465f-81f8-9ff23c34a4af tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:16.447681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffa012-cc33-47d6-ab66-046a1993b6bf tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:16.448443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffa012-cc33-47d6-ab66-046a1993b6bf tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:16.448815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffa012-cc33-47d6-ab66-046a1993b6bf tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:16.449178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffa012-cc33-47d6-ab66-046a1993b6bf tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:16.464855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffa012-cc33-47d6-ab66-046a1993b6bf tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c502b7bcc98a4bec9a5c3cb03feb1601)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:16.466630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffa012-cc33-47d6-ab66-046a1993b6bf tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:16.498866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-baffa012-cc33-47d6-ab66-046a1993b6bf tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c502b7bcc98a4bec9a5c3cb03feb1601'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:16.504010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-baffa012-cc33-47d6-ab66-046a1993b6bf tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c502b7bcc98a4bec9a5c3cb03feb1601'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:16.561518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:16.584540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-baffa012-cc33-47d6-ab66-046a1993b6bf tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c502b7bcc98a4bec9a5c3cb03feb1601', 'request_id': 'req-baffa012-cc33-47d6-ab66-046a1993b6bf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:16.599128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-baffa012-cc33-47d6-ab66-046a1993b6bf tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c502b7bcc98a4bec9a5c3cb03feb1601', 'request_id': 'req-baffa012-cc33-47d6-ab66-046a1993b6bf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:16.619969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-baffa012-cc33-47d6-ab66-046a1993b6bf tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c502b7bcc98a4bec9a5c3cb03feb1601', 'request_id': 'req-baffa012-cc33-47d6-ab66-046a1993b6bf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:16.639010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-baffa012-cc33-47d6-ab66-046a1993b6bf tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] The token cache is being invalidate because project c502b7bcc98a4bec9a5c3cb03feb1601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:16.639433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-baffa012-cc33-47d6-ab66-046a1993b6bf tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:16.642554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-baffa012-cc33-47d6-ab66-046a1993b6bf tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:16.657913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-baffa012-cc33-47d6-ab66-046a1993b6bf tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c502b7bcc98a4bec9a5c3cb03feb1601', 'request_id': 'req-baffa012-cc33-47d6-ab66-046a1993b6bf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:16.663495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-baffa012-cc33-47d6-ab66-046a1993b6bf tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c502b7bcc98a4bec9a5c3cb03feb1601', 'request_id': 'req-baffa012-cc33-47d6-ab66-046a1993b6bf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:16.664553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-baffa012-cc33-47d6-ab66-046a1993b6bf tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c502b7bcc98a4bec9a5c3cb03feb1601', 'request_id': 'req-baffa012-cc33-47d6-ab66-046a1993b6bf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:16.673156 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3950/7947] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:34:16 2022] DELETE /identity/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:34:16.679007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e0c34-3dfa-4b1d-84c1-769c9db7f2f4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:16.689393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e0c34-3dfa-4b1d-84c1-769c9db7f2f4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:16.752334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:16.775531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081287fe-01f6-4d1b-826b-467ebb4f5d47 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:16.776250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081287fe-01f6-4d1b-826b-467ebb4f5d47 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:16.776553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081287fe-01f6-4d1b-826b-467ebb4f5d47 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:16.776844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081287fe-01f6-4d1b-826b-467ebb4f5d47 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:16.777464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081287fe-01f6-4d1b-826b-467ebb4f5d47 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:16.778494 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-081287fe-01f6-4d1b-826b-467ebb4f5d47 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:34:16.778494 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:34:16.778494 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:34:16.779430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081287fe-01f6-4d1b-826b-467ebb4f5d47 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:16.786758 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3998/7948] 10.222.0.17 () {58 vars in 1173 bytes} [Sat Jul 30 21:34:16 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:16.788176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffa012-cc33-47d6-ab66-046a1993b6bf tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:16.789616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-baffa012-cc33-47d6-ab66-046a1993b6bf tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:16.804315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffa012-cc33-47d6-ab66-046a1993b6bf tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:16.809746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d6e1e-b0ea-4092-8af1-81d4a65c0509 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:16.810587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d6e1e-b0ea-4092-8af1-81d4a65c0509 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:16.810790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d6e1e-b0ea-4092-8af1-81d4a65c0509 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:16.811183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d6e1e-b0ea-4092-8af1-81d4a65c0509 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:16.812062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d6e1e-b0ea-4092-8af1-81d4a65c0509 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:16.814031 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-a85d6e1e-b0ea-4092-8af1-81d4a65c0509 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:34:16.814031 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:34:16.814031 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:34:16.815178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d6e1e-b0ea-4092-8af1-81d4a65c0509 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:16.820207 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3951/7949] 10.222.0.17 () {58 vars in 1200 bytes} [Sat Jul 30 21:34:16 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:16.821018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081287fe-01f6-4d1b-826b-467ebb4f5d47 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:16.833414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081287fe-01f6-4d1b-826b-467ebb4f5d47 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:16.843278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fce37-5b26-46a7-a6a2-ec2696ab38e2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:16.844186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fce37-5b26-46a7-a6a2-ec2696ab38e2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:16.844585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fce37-5b26-46a7-a6a2-ec2696ab38e2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:16.844973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fce37-5b26-46a7-a6a2-ec2696ab38e2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:16.845725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fce37-5b26-46a7-a6a2-ec2696ab38e2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:16.847478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fce37-5b26-46a7-a6a2-ec2696ab38e2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:16.849098 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 3999/7950] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:34:16 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:16.853057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d6e1e-b0ea-4092-8af1-81d4a65c0509 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:16.865948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d6e1e-b0ea-4092-8af1-81d4a65c0509 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:16.873080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb19250-7ccb-4bb2-b0b9-df77148d3c5b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:16.874075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb19250-7ccb-4bb2-b0b9-df77148d3c5b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:16.874371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb19250-7ccb-4bb2-b0b9-df77148d3c5b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:16.874661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb19250-7ccb-4bb2-b0b9-df77148d3c5b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:16.876208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb19250-7ccb-4bb2-b0b9-df77148d3c5b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:16.877850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb19250-7ccb-4bb2-b0b9-df77148d3c5b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:16.879135 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3952/7951] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:16 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:16.883328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fce37-5b26-46a7-a6a2-ec2696ab38e2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:16.902247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fce37-5b26-46a7-a6a2-ec2696ab38e2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:16.907592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3eebe6-c7a5-4e44-a0fe-f2b103747023 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:16.908445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3eebe6-c7a5-4e44-a0fe-f2b103747023 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:16.908737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3eebe6-c7a5-4e44-a0fe-f2b103747023 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:16.909017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3eebe6-c7a5-4e44-a0fe-f2b103747023 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:16.909645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3eebe6-c7a5-4e44-a0fe-f2b103747023 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:16.911257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3eebe6-c7a5-4e44-a0fe-f2b103747023 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:16.912818 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4000/7952] 10.222.0.17 () {58 vars in 1188 bytes} [Sat Jul 30 21:34:16 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:16.917233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb19250-7ccb-4bb2-b0b9-df77148d3c5b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:16.928130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb19250-7ccb-4bb2-b0b9-df77148d3c5b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:16.933439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20776c8-ed5c-4056-86cf-d8f0acab5ca5 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:16.934080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20776c8-ed5c-4056-86cf-d8f0acab5ca5 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:16.934374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20776c8-ed5c-4056-86cf-d8f0acab5ca5 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:16.934632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20776c8-ed5c-4056-86cf-d8f0acab5ca5 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:16.936051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20776c8-ed5c-4056-86cf-d8f0acab5ca5 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:16.937251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20776c8-ed5c-4056-86cf-d8f0acab5ca5 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:16.939416 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3953/7953] 10.222.0.17 () {58 vars in 1200 bytes} [Sat Jul 30 21:34:16 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:16.943354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3eebe6-c7a5-4e44-a0fe-f2b103747023 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:16.959742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3eebe6-c7a5-4e44-a0fe-f2b103747023 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:16.965250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9b19a-e41b-4164-8188-72c28a33b524 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:16.966162 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9b19a-e41b-4164-8188-72c28a33b524 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:16.966615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9b19a-e41b-4164-8188-72c28a33b524 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:16.967053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9b19a-e41b-4164-8188-72c28a33b524 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:16.968032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9b19a-e41b-4164-8188-72c28a33b524 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:16.969886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9b19a-e41b-4164-8188-72c28a33b524 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:16.971241 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4001/7954] 10.222.0.17 () {58 vars in 1203 bytes} [Sat Jul 30 21:34:16 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:16.975774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20776c8-ed5c-4056-86cf-d8f0acab5ca5 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:16.987785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20776c8-ed5c-4056-86cf-d8f0acab5ca5 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:16.994360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f5c1e-02db-4072-af0b-14174f788962 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:16.995135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f5c1e-02db-4072-af0b-14174f788962 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:16.995508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f5c1e-02db-4072-af0b-14174f788962 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:16.995829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f5c1e-02db-4072-af0b-14174f788962 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:16.996508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f5c1e-02db-4072-af0b-14174f788962 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:16.998686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f5c1e-02db-4072-af0b-14174f788962 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.000833 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3954/7955] 10.222.0.17 () {58 vars in 1209 bytes} [Sat Jul 30 21:34:16 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.004832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9b19a-e41b-4164-8188-72c28a33b524 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.020273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9b19a-e41b-4164-8188-72c28a33b524 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.030173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed10156-c79a-49dd-aade-9045b5a8f454 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.030988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed10156-c79a-49dd-aade-9045b5a8f454 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.031607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed10156-c79a-49dd-aade-9045b5a8f454 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.032018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed10156-c79a-49dd-aade-9045b5a8f454 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.032514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed10156-c79a-49dd-aade-9045b5a8f454 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.034616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed10156-c79a-49dd-aade-9045b5a8f454 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.035795 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4002/7956] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.040159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f5c1e-02db-4072-af0b-14174f788962 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.054530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f5c1e-02db-4072-af0b-14174f788962 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.059849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71911d20-7615-4833-b092-4065b558954d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.060711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71911d20-7615-4833-b092-4065b558954d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.061062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71911d20-7615-4833-b092-4065b558954d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.061514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71911d20-7615-4833-b092-4065b558954d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.062252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71911d20-7615-4833-b092-4065b558954d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.064463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71911d20-7615-4833-b092-4065b558954d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.065796 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3955/7957] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.071895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed10156-c79a-49dd-aade-9045b5a8f454 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.083166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed10156-c79a-49dd-aade-9045b5a8f454 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.088377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8546bb-061a-4cd0-9304-c6c11f3552e7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.089132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8546bb-061a-4cd0-9304-c6c11f3552e7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.089489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8546bb-061a-4cd0-9304-c6c11f3552e7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.089949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8546bb-061a-4cd0-9304-c6c11f3552e7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.090652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8546bb-061a-4cd0-9304-c6c11f3552e7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.093054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8546bb-061a-4cd0-9304-c6c11f3552e7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.093689 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4003/7958] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.098078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71911d20-7615-4833-b092-4065b558954d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.108573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71911d20-7615-4833-b092-4065b558954d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.114056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664470b-97bf-4e30-9ad3-8343e95a8f95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.115050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664470b-97bf-4e30-9ad3-8343e95a8f95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.115452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664470b-97bf-4e30-9ad3-8343e95a8f95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.115792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664470b-97bf-4e30-9ad3-8343e95a8f95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.116617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664470b-97bf-4e30-9ad3-8343e95a8f95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.118287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664470b-97bf-4e30-9ad3-8343e95a8f95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.119909 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3956/7959] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.124388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8546bb-061a-4cd0-9304-c6c11f3552e7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.136945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8546bb-061a-4cd0-9304-c6c11f3552e7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.141849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520a715-33bf-41ba-a42a-b5741259502a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.142578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520a715-33bf-41ba-a42a-b5741259502a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.142943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520a715-33bf-41ba-a42a-b5741259502a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.143251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520a715-33bf-41ba-a42a-b5741259502a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.143923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520a715-33bf-41ba-a42a-b5741259502a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.145652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520a715-33bf-41ba-a42a-b5741259502a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.146663 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4004/7960] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.151799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664470b-97bf-4e30-9ad3-8343e95a8f95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.165515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664470b-97bf-4e30-9ad3-8343e95a8f95 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.173255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd8570-b82a-422c-8bfa-52a64e5f09df tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.174291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd8570-b82a-422c-8bfa-52a64e5f09df tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.174582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd8570-b82a-422c-8bfa-52a64e5f09df tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.174862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd8570-b82a-422c-8bfa-52a64e5f09df tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.175581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd8570-b82a-422c-8bfa-52a64e5f09df tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.177266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd8570-b82a-422c-8bfa-52a64e5f09df tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.178537 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3957/7961] 10.222.0.17 () {58 vars in 1227 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.183165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520a715-33bf-41ba-a42a-b5741259502a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.194228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520a715-33bf-41ba-a42a-b5741259502a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.200104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f3852-3166-402b-9512-a7dff12f7f37 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.201289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f3852-3166-402b-9512-a7dff12f7f37 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.201806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f3852-3166-402b-9512-a7dff12f7f37 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.202148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f3852-3166-402b-9512-a7dff12f7f37 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.202932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f3852-3166-402b-9512-a7dff12f7f37 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.204870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f3852-3166-402b-9512-a7dff12f7f37 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.206092 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4005/7962] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.210332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd8570-b82a-422c-8bfa-52a64e5f09df tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.222062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd8570-b82a-422c-8bfa-52a64e5f09df tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.227879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361b180-045c-4554-8a66-913036e0f107 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.228560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361b180-045c-4554-8a66-913036e0f107 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.228841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361b180-045c-4554-8a66-913036e0f107 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.229132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361b180-045c-4554-8a66-913036e0f107 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.229759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361b180-045c-4554-8a66-913036e0f107 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.231458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361b180-045c-4554-8a66-913036e0f107 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.232871 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3958/7963] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.237340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f3852-3166-402b-9512-a7dff12f7f37 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.248135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f3852-3166-402b-9512-a7dff12f7f37 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.255786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d1979-d51d-494c-b78f-058cee010cd3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.256471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d1979-d51d-494c-b78f-058cee010cd3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.257034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d1979-d51d-494c-b78f-058cee010cd3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.257330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d1979-d51d-494c-b78f-058cee010cd3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.258149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d1979-d51d-494c-b78f-058cee010cd3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.260371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d1979-d51d-494c-b78f-058cee010cd3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.260957 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4006/7964] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.265178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361b180-045c-4554-8a66-913036e0f107 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.277709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361b180-045c-4554-8a66-913036e0f107 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.282833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e121b35-7109-4b72-9653-737d1b3f2dab tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.283559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e121b35-7109-4b72-9653-737d1b3f2dab tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.283853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e121b35-7109-4b72-9653-737d1b3f2dab tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.284142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e121b35-7109-4b72-9653-737d1b3f2dab tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.284777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e121b35-7109-4b72-9653-737d1b3f2dab tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.286401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e121b35-7109-4b72-9653-737d1b3f2dab tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.287971 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3959/7965] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 30 21:34:17.291816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d1979-d51d-494c-b78f-058cee010cd3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.302931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d1979-d51d-494c-b78f-058cee010cd3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.308210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7be06-f756-4678-a710-afe9c65e3c25 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.308950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7be06-f756-4678-a710-afe9c65e3c25 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.308950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7be06-f756-4678-a710-afe9c65e3c25 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.309233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7be06-f756-4678-a710-afe9c65e3c25 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.309751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7be06-f756-4678-a710-afe9c65e3c25 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.311423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7be06-f756-4678-a710-afe9c65e3c25 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.316323 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4007/7966] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.317603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e121b35-7109-4b72-9653-737d1b3f2dab tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.332642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e121b35-7109-4b72-9653-737d1b3f2dab tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.337520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38992c-f0fa-4814-b926-3da931f78687 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.338190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38992c-f0fa-4814-b926-3da931f78687 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.338481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38992c-f0fa-4814-b926-3da931f78687 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.338768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38992c-f0fa-4814-b926-3da931f78687 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.339518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38992c-f0fa-4814-b926-3da931f78687 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.341854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38992c-f0fa-4814-b926-3da931f78687 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.343329 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3960/7967] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.347081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7be06-f756-4678-a710-afe9c65e3c25 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.357551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7be06-f756-4678-a710-afe9c65e3c25 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.363433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382c1bd-dea3-4f71-bd8c-ec29a6ebf862 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.364199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382c1bd-dea3-4f71-bd8c-ec29a6ebf862 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.364562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382c1bd-dea3-4f71-bd8c-ec29a6ebf862 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.364918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382c1bd-dea3-4f71-bd8c-ec29a6ebf862 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.365623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382c1bd-dea3-4f71-bd8c-ec29a6ebf862 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.367308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382c1bd-dea3-4f71-bd8c-ec29a6ebf862 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.368657 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4008/7968] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 30 21:34:17.372476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38992c-f0fa-4814-b926-3da931f78687 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.384263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38992c-f0fa-4814-b926-3da931f78687 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.389098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a44a0-bd2f-4b56-bf43-2d866adc5271 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.389755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a44a0-bd2f-4b56-bf43-2d866adc5271 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.390041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a44a0-bd2f-4b56-bf43-2d866adc5271 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.390320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a44a0-bd2f-4b56-bf43-2d866adc5271 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.391151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a44a0-bd2f-4b56-bf43-2d866adc5271 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.392840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a44a0-bd2f-4b56-bf43-2d866adc5271 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.394055 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3961/7969] 10.222.0.17 () {58 vars in 1257 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.397950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382c1bd-dea3-4f71-bd8c-ec29a6ebf862 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.408242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382c1bd-dea3-4f71-bd8c-ec29a6ebf862 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.412934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbd89d-c9a9-4338-9bbe-c016ac8aa741 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.413591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbd89d-c9a9-4338-9bbe-c016ac8aa741 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.413881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbd89d-c9a9-4338-9bbe-c016ac8aa741 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.414159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbd89d-c9a9-4338-9bbe-c016ac8aa741 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.414792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbd89d-c9a9-4338-9bbe-c016ac8aa741 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.416409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbd89d-c9a9-4338-9bbe-c016ac8aa741 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.417513 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4009/7970] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.421403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a44a0-bd2f-4b56-bf43-2d866adc5271 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.432573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a44a0-bd2f-4b56-bf43-2d866adc5271 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.437540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b397b3-2923-4305-b37b-19db8cf8e05f tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.438904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b397b3-2923-4305-b37b-19db8cf8e05f tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.439518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b397b3-2923-4305-b37b-19db8cf8e05f tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.439879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b397b3-2923-4305-b37b-19db8cf8e05f tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.440551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b397b3-2923-4305-b37b-19db8cf8e05f tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.442155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b397b3-2923-4305-b37b-19db8cf8e05f tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.443395 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3962/7971] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.447234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbd89d-c9a9-4338-9bbe-c016ac8aa741 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.457749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbd89d-c9a9-4338-9bbe-c016ac8aa741 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.463558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792183a-36a5-418b-8195-ea41700c6b8b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.464352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792183a-36a5-418b-8195-ea41700c6b8b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.464680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792183a-36a5-418b-8195-ea41700c6b8b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.464919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792183a-36a5-418b-8195-ea41700c6b8b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.465555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792183a-36a5-418b-8195-ea41700c6b8b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.468064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792183a-36a5-418b-8195-ea41700c6b8b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.469298 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4010/7972] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 30 21:34:17.473740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b397b3-2923-4305-b37b-19db8cf8e05f tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.486742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b397b3-2923-4305-b37b-19db8cf8e05f tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.492348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa284aa-47d6-4e6f-934c-8907e8d79113 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.493038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa284aa-47d6-4e6f-934c-8907e8d79113 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.493314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa284aa-47d6-4e6f-934c-8907e8d79113 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.493599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa284aa-47d6-4e6f-934c-8907e8d79113 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.494710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa284aa-47d6-4e6f-934c-8907e8d79113 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.495870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa284aa-47d6-4e6f-934c-8907e8d79113 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.497277 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3963/7973] 10.222.0.17 () {58 vars in 1254 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.502136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792183a-36a5-418b-8195-ea41700c6b8b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.512502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792183a-36a5-418b-8195-ea41700c6b8b tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.517664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1bdf6-4d87-4ed4-ad14-782f030877c4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.518697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1bdf6-4d87-4ed4-ad14-782f030877c4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.518697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1bdf6-4d87-4ed4-ad14-782f030877c4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.518926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1bdf6-4d87-4ed4-ad14-782f030877c4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.519535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1bdf6-4d87-4ed4-ad14-782f030877c4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.521132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1bdf6-4d87-4ed4-ad14-782f030877c4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.522233 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4011/7974] 10.222.0.17 () {58 vars in 1290 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.526493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa284aa-47d6-4e6f-934c-8907e8d79113 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.542838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa284aa-47d6-4e6f-934c-8907e8d79113 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.548512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90ee7b-05d9-42f9-b519-e2bbfb4d6f32 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.549181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90ee7b-05d9-42f9-b519-e2bbfb4d6f32 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.549467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90ee7b-05d9-42f9-b519-e2bbfb4d6f32 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.549753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90ee7b-05d9-42f9-b519-e2bbfb4d6f32 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.550511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90ee7b-05d9-42f9-b519-e2bbfb4d6f32 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.552270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90ee7b-05d9-42f9-b519-e2bbfb4d6f32 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.556850 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3964/7975] 10.222.0.17 () {58 vars in 1257 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.557824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1bdf6-4d87-4ed4-ad14-782f030877c4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.568541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1bdf6-4d87-4ed4-ad14-782f030877c4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.574661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e727396-3ac4-4cc4-8bdf-0709a621d45f tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.575413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e727396-3ac4-4cc4-8bdf-0709a621d45f tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.575701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e727396-3ac4-4cc4-8bdf-0709a621d45f tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.575980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e727396-3ac4-4cc4-8bdf-0709a621d45f tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.576616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e727396-3ac4-4cc4-8bdf-0709a621d45f tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.578347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e727396-3ac4-4cc4-8bdf-0709a621d45f tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.579817 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4012/7976] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.583923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90ee7b-05d9-42f9-b519-e2bbfb4d6f32 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.605624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90ee7b-05d9-42f9-b519-e2bbfb4d6f32 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.621327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf86699-c458-4d29-a0d0-bda4c526971d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.622320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf86699-c458-4d29-a0d0-bda4c526971d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.622778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf86699-c458-4d29-a0d0-bda4c526971d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.623224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf86699-c458-4d29-a0d0-bda4c526971d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.624120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf86699-c458-4d29-a0d0-bda4c526971d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.627086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf86699-c458-4d29-a0d0-bda4c526971d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.630866 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3965/7977] 10.222.0.17 () {58 vars in 1308 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.634741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e727396-3ac4-4cc4-8bdf-0709a621d45f tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.657613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e727396-3ac4-4cc4-8bdf-0709a621d45f tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.682701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14309831-1b1f-4312-9e8a-d4b49b6b37db tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.683435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14309831-1b1f-4312-9e8a-d4b49b6b37db tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.683729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14309831-1b1f-4312-9e8a-d4b49b6b37db tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.684012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14309831-1b1f-4312-9e8a-d4b49b6b37db tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.684659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14309831-1b1f-4312-9e8a-d4b49b6b37db tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.686268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14309831-1b1f-4312-9e8a-d4b49b6b37db tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.705926 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4013/7978] 10.222.0.17 () {58 vars in 1290 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.710527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf86699-c458-4d29-a0d0-bda4c526971d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.736523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf86699-c458-4d29-a0d0-bda4c526971d tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.743273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61af6b-5463-4039-a56e-ce60c26c4759 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.744189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61af6b-5463-4039-a56e-ce60c26c4759 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.744582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61af6b-5463-4039-a56e-ce60c26c4759 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.744965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61af6b-5463-4039-a56e-ce60c26c4759 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.745751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61af6b-5463-4039-a56e-ce60c26c4759 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.747575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61af6b-5463-4039-a56e-ce60c26c4759 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.749312 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3966/7979] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.753435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14309831-1b1f-4312-9e8a-d4b49b6b37db tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.774379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14309831-1b1f-4312-9e8a-d4b49b6b37db tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.780522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb54c7-a0c5-4a90-a524-3123ed48018a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.781951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb54c7-a0c5-4a90-a524-3123ed48018a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.782346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb54c7-a0c5-4a90-a524-3123ed48018a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.782739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb54c7-a0c5-4a90-a524-3123ed48018a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.783467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb54c7-a0c5-4a90-a524-3123ed48018a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.785409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb54c7-a0c5-4a90-a524-3123ed48018a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.786621 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4014/7980] 10.222.0.17 () {58 vars in 1227 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.792013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61af6b-5463-4039-a56e-ce60c26c4759 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.804907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61af6b-5463-4039-a56e-ce60c26c4759 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.809894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2b80f-53b7-4a6b-a39b-f5786f5c0d48 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.810640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2b80f-53b7-4a6b-a39b-f5786f5c0d48 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.811270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2b80f-53b7-4a6b-a39b-f5786f5c0d48 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.811599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2b80f-53b7-4a6b-a39b-f5786f5c0d48 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.812423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2b80f-53b7-4a6b-a39b-f5786f5c0d48 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.814449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2b80f-53b7-4a6b-a39b-f5786f5c0d48 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.815599 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3967/7981] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.820956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb54c7-a0c5-4a90-a524-3123ed48018a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.834470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb54c7-a0c5-4a90-a524-3123ed48018a tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.840035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c963ac4-0162-4f77-87c2-b08c8a511deb tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.842317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c963ac4-0162-4f77-87c2-b08c8a511deb tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.842616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c963ac4-0162-4f77-87c2-b08c8a511deb tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.842899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c963ac4-0162-4f77-87c2-b08c8a511deb tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.843732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c963ac4-0162-4f77-87c2-b08c8a511deb tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.848000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c963ac4-0162-4f77-87c2-b08c8a511deb tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.849204 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4015/7982] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.854553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2b80f-53b7-4a6b-a39b-f5786f5c0d48 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.870942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2b80f-53b7-4a6b-a39b-f5786f5c0d48 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.886358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972aeaa-2333-4263-a2a9-f7c15e6c141e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.887790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972aeaa-2333-4263-a2a9-f7c15e6c141e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.887790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972aeaa-2333-4263-a2a9-f7c15e6c141e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.887790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972aeaa-2333-4263-a2a9-f7c15e6c141e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.889228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972aeaa-2333-4263-a2a9-f7c15e6c141e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.896585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972aeaa-2333-4263-a2a9-f7c15e6c141e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.899687 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3968/7983] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.902262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c963ac4-0162-4f77-87c2-b08c8a511deb tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.914264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c963ac4-0162-4f77-87c2-b08c8a511deb tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.920760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08331367-ef7b-4ea6-98f3-448ddaef738e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.921718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08331367-ef7b-4ea6-98f3-448ddaef738e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.922235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08331367-ef7b-4ea6-98f3-448ddaef738e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.922699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08331367-ef7b-4ea6-98f3-448ddaef738e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.923564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08331367-ef7b-4ea6-98f3-448ddaef738e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.926609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08331367-ef7b-4ea6-98f3-448ddaef738e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.931538 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4016/7984] 10.222.0.17 () {58 vars in 1254 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.932788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972aeaa-2333-4263-a2a9-f7c15e6c141e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.947655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972aeaa-2333-4263-a2a9-f7c15e6c141e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.956790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834c734-d75f-4234-9f5b-84c6661c79da tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.957699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834c734-d75f-4234-9f5b-84c6661c79da tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.958180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834c734-d75f-4234-9f5b-84c6661c79da tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.958724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834c734-d75f-4234-9f5b-84c6661c79da tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.959457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834c734-d75f-4234-9f5b-84c6661c79da tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:17.962101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834c734-d75f-4234-9f5b-84c6661c79da tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:17.965907 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3969/7985] 10.222.0.17 () {58 vars in 1257 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:17.969591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08331367-ef7b-4ea6-98f3-448ddaef738e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:17.988520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08331367-ef7b-4ea6-98f3-448ddaef738e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:17.995569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263d4c5-aecf-4b08-94b4-8fc1edda93a4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:17.997301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263d4c5-aecf-4b08-94b4-8fc1edda93a4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:17.997922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263d4c5-aecf-4b08-94b4-8fc1edda93a4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:17.998456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263d4c5-aecf-4b08-94b4-8fc1edda93a4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:17.999203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263d4c5-aecf-4b08-94b4-8fc1edda93a4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:18.002663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263d4c5-aecf-4b08-94b4-8fc1edda93a4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:18.004353 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4017/7986] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:34:17 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:18.009204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834c734-d75f-4234-9f5b-84c6661c79da tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:18.022488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834c734-d75f-4234-9f5b-84c6661c79da tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:18.028739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e813fb-5f90-49e7-8b5a-34dfbdb6d224 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:18.029629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e813fb-5f90-49e7-8b5a-34dfbdb6d224 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:18.029921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e813fb-5f90-49e7-8b5a-34dfbdb6d224 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:18.030208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e813fb-5f90-49e7-8b5a-34dfbdb6d224 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:18.030851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e813fb-5f90-49e7-8b5a-34dfbdb6d224 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:18.033254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e813fb-5f90-49e7-8b5a-34dfbdb6d224 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:18.034704 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3970/7987] 10.222.0.17 () {58 vars in 1257 bytes} [Sat Jul 30 21:34:18 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:18.038513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263d4c5-aecf-4b08-94b4-8fc1edda93a4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:18.049368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263d4c5-aecf-4b08-94b4-8fc1edda93a4 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:18.054974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fe8d2-10b3-46fe-b1fc-bfc55513b94e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:18.055714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fe8d2-10b3-46fe-b1fc-bfc55513b94e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:18.056002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fe8d2-10b3-46fe-b1fc-bfc55513b94e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:18.056283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fe8d2-10b3-46fe-b1fc-bfc55513b94e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:18.056927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fe8d2-10b3-46fe-b1fc-bfc55513b94e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:18.058530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fe8d2-10b3-46fe-b1fc-bfc55513b94e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:18.059697 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4018/7988] 10.222.0.17 () {58 vars in 1293 bytes} [Sat Jul 30 21:34:18 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:18.063877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e813fb-5f90-49e7-8b5a-34dfbdb6d224 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:18.074711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e813fb-5f90-49e7-8b5a-34dfbdb6d224 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:18.080175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492aea5-24cf-4dff-9393-e9f652024653 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:18.081039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492aea5-24cf-4dff-9393-e9f652024653 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:18.083129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492aea5-24cf-4dff-9393-e9f652024653 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:18.083542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492aea5-24cf-4dff-9393-e9f652024653 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:18.084263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492aea5-24cf-4dff-9393-e9f652024653 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:18.086981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492aea5-24cf-4dff-9393-e9f652024653 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:18.088362 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3971/7989] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:18 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:18.092575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fe8d2-10b3-46fe-b1fc-bfc55513b94e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:18.105485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fe8d2-10b3-46fe-b1fc-bfc55513b94e tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:18.118053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be694bb3-4f39-4482-9485-bec039d0ffe3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:18.118833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be694bb3-4f39-4482-9485-bec039d0ffe3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:18.119188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be694bb3-4f39-4482-9485-bec039d0ffe3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:18.119572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be694bb3-4f39-4482-9485-bec039d0ffe3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:18.120285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be694bb3-4f39-4482-9485-bec039d0ffe3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:18.122074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be694bb3-4f39-4482-9485-bec039d0ffe3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:18.123272 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4019/7990] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:34:18 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 30 21:34:18.127884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492aea5-24cf-4dff-9393-e9f652024653 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:18.138312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492aea5-24cf-4dff-9393-e9f652024653 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:18.144043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd955867-dd3d-41e7-81cb-59484ee46ed5 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:18.144879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd955867-dd3d-41e7-81cb-59484ee46ed5 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:18.145172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd955867-dd3d-41e7-81cb-59484ee46ed5 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:18.145870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd955867-dd3d-41e7-81cb-59484ee46ed5 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:18.146083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd955867-dd3d-41e7-81cb-59484ee46ed5 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:18.147811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd955867-dd3d-41e7-81cb-59484ee46ed5 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:18.151345 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3972/7991] 10.222.0.17 () {58 vars in 1212 bytes} [Sat Jul 30 21:34:18 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:18.152985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be694bb3-4f39-4482-9485-bec039d0ffe3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:18.163974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be694bb3-4f39-4482-9485-bec039d0ffe3 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:18.171464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45437f-8cb4-4215-8afe-2d7a1f31a1e7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:18.172185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45437f-8cb4-4215-8afe-2d7a1f31a1e7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:18.172462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45437f-8cb4-4215-8afe-2d7a1f31a1e7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:18.172770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45437f-8cb4-4215-8afe-2d7a1f31a1e7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:18.173552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45437f-8cb4-4215-8afe-2d7a1f31a1e7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:18.175703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45437f-8cb4-4215-8afe-2d7a1f31a1e7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:18.179930 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4020/7992] 10.222.0.17 () {58 vars in 1227 bytes} [Sat Jul 30 21:34:18 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 30 21:34:18.180948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd955867-dd3d-41e7-81cb-59484ee46ed5 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:18.191456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd955867-dd3d-41e7-81cb-59484ee46ed5 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:18.196739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad4720-cb18-4c16-9d83-b5fcd450c373 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:18.197406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad4720-cb18-4c16-9d83-b5fcd450c373 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:18.197691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad4720-cb18-4c16-9d83-b5fcd450c373 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:18.197969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad4720-cb18-4c16-9d83-b5fcd450c373 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:18.198598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad4720-cb18-4c16-9d83-b5fcd450c373 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:18.200427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad4720-cb18-4c16-9d83-b5fcd450c373 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:18.202315 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3973/7993] 10.222.0.17 () {58 vars in 1215 bytes} [Sat Jul 30 21:34:18 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 30 21:34:18.206923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45437f-8cb4-4215-8afe-2d7a1f31a1e7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:18.217710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45437f-8cb4-4215-8afe-2d7a1f31a1e7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:18.224237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42bfd0-816a-42b7-aeda-1364ed634a98 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:18.225000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42bfd0-816a-42b7-aeda-1364ed634a98 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:18.225359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42bfd0-816a-42b7-aeda-1364ed634a98 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:18.225712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42bfd0-816a-42b7-aeda-1364ed634a98 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:18.226415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42bfd0-816a-42b7-aeda-1364ed634a98 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:18.228205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42bfd0-816a-42b7-aeda-1364ed634a98 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:18.229593 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4021/7994] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Jul 30 21:34:18 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 30 21:34:18.233903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad4720-cb18-4c16-9d83-b5fcd450c373 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:18.245111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad4720-cb18-4c16-9d83-b5fcd450c373 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:18.251021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec76de-4a76-4947-8010-98c385233f35 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:18.251799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec76de-4a76-4947-8010-98c385233f35 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:18.252146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec76de-4a76-4947-8010-98c385233f35 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:18.252380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec76de-4a76-4947-8010-98c385233f35 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:18.253055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec76de-4a76-4947-8010-98c385233f35 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:18.254685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec76de-4a76-4947-8010-98c385233f35 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:18.258967 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3974/7995] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:18 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 30 21:34:18.261199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42bfd0-816a-42b7-aeda-1364ed634a98 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:18.274789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42bfd0-816a-42b7-aeda-1364ed634a98 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:18.280872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f1ec1-fcf7-4d80-a0d5-1c558d2aa7bb tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:18.281689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f1ec1-fcf7-4d80-a0d5-1c558d2aa7bb tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:18.281985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f1ec1-fcf7-4d80-a0d5-1c558d2aa7bb tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:18.282269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f1ec1-fcf7-4d80-a0d5-1c558d2aa7bb tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:18.283129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f1ec1-fcf7-4d80-a0d5-1c558d2aa7bb tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:18.285624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f1ec1-fcf7-4d80-a0d5-1c558d2aa7bb tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:18.287552 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4022/7996] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:34:18 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:18.291950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec76de-4a76-4947-8010-98c385233f35 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:18.307175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec76de-4a76-4947-8010-98c385233f35 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:18.312146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55923ea6-cc31-47cb-a078-5f0de7628a75 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:18.313345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55923ea6-cc31-47cb-a078-5f0de7628a75 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:18.313636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55923ea6-cc31-47cb-a078-5f0de7628a75 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:18.313920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55923ea6-cc31-47cb-a078-5f0de7628a75 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:18.314809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55923ea6-cc31-47cb-a078-5f0de7628a75 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:18.316495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55923ea6-cc31-47cb-a078-5f0de7628a75 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:18.318054 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3975/7997] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Jul 30 21:34:18 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:18.322118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f1ec1-fcf7-4d80-a0d5-1c558d2aa7bb tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:18.334067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f1ec1-fcf7-4d80-a0d5-1c558d2aa7bb tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:18.339312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb24cf-3083-48cc-b64a-c970f38d15c2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:18.340360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb24cf-3083-48cc-b64a-c970f38d15c2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:18.340652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb24cf-3083-48cc-b64a-c970f38d15c2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:18.340932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb24cf-3083-48cc-b64a-c970f38d15c2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:18.341569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb24cf-3083-48cc-b64a-c970f38d15c2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:18.343171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb24cf-3083-48cc-b64a-c970f38d15c2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:18.344538 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4023/7998] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:34:18 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:18.348517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55923ea6-cc31-47cb-a078-5f0de7628a75 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:18.359944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55923ea6-cc31-47cb-a078-5f0de7628a75 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:18.365002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56756acf-2e4d-4456-8e8e-8645ac76f378 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:18.365671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56756acf-2e4d-4456-8e8e-8645ac76f378 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:18.365994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56756acf-2e4d-4456-8e8e-8645ac76f378 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:18.366472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56756acf-2e4d-4456-8e8e-8645ac76f378 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:18.366893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56756acf-2e4d-4456-8e8e-8645ac76f378 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:18.368710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56756acf-2e4d-4456-8e8e-8645ac76f378 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:18.369918 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3976/7999] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:34:18 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:18.377208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb24cf-3083-48cc-b64a-c970f38d15c2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:18.388026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb24cf-3083-48cc-b64a-c970f38d15c2 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:18.393989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f29bf-f581-45b5-8ccd-3cf3cf3332a7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:18.394672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f29bf-f581-45b5-8ccd-3cf3cf3332a7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:18.394962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f29bf-f581-45b5-8ccd-3cf3cf3332a7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:18.395253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f29bf-f581-45b5-8ccd-3cf3cf3332a7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:18.396051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f29bf-f581-45b5-8ccd-3cf3cf3332a7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:18.398306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f29bf-f581-45b5-8ccd-3cf3cf3332a7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:18.400345 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4024/8000] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:18 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:18.403634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56756acf-2e4d-4456-8e8e-8645ac76f378 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:18.414502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56756acf-2e4d-4456-8e8e-8645ac76f378 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:18.419644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80d2bf-0d20-40d6-b91c-799d89ebbc47 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:18.420460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80d2bf-0d20-40d6-b91c-799d89ebbc47 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:18.420881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80d2bf-0d20-40d6-b91c-799d89ebbc47 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:18.421330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80d2bf-0d20-40d6-b91c-799d89ebbc47 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:18.422470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80d2bf-0d20-40d6-b91c-799d89ebbc47 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:18.424611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80d2bf-0d20-40d6-b91c-799d89ebbc47 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:18.427350 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3977/8001] 10.222.0.17 () {58 vars in 1278 bytes} [Sat Jul 30 21:34:18 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 30 21:34:18.432697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f29bf-f581-45b5-8ccd-3cf3cf3332a7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:18.450318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f29bf-f581-45b5-8ccd-3cf3cf3332a7 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:18.457048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934a529-83d2-45f5-afe6-2d47ab2732d6 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:18.457814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934a529-83d2-45f5-afe6-2d47ab2732d6 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:18.458177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934a529-83d2-45f5-afe6-2d47ab2732d6 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:18.458528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934a529-83d2-45f5-afe6-2d47ab2732d6 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:18.469047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934a529-83d2-45f5-afe6-2d47ab2732d6 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 21:34:18.474893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-a934a529-83d2-45f5-afe6-2d47ab2732d6 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Could not find domain: c502b7bcc98a4bec9a5c3cb03feb1601.: keystone.exception.DomainNotFound: Could not find domain: c502b7bcc98a4bec9a5c3cb03feb1601. Jul 30 21:34:18.474893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:18.474893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 30 21:34:18.474893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 30 21:34:18.474893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 21:34:18.474893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 21:34:18.474893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 21:34:18.474893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 21:34:18.474893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c502b7bcc98a4bec9a5c3cb03feb1601. Jul 30 21:34:18.474893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:34:18.474893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:34:18.474893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:34:18.474893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:18.474893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:34:18.474893 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:34:18.476421 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:34:18.476421 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:34:18.476421 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:34:18.476421 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:34:18.476421 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:34:18.476421 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:34:18.476421 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:34:18.476421 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:34:18.476421 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 30 21:34:18.476421 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 30 21:34:18.476421 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 21:34:18.476421 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 21:34:18.476421 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 21:34:18.476421 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 21:34:18.476421 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:34:18.476421 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:34:18.477759 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:34:18.477759 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:34:18.477759 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:34:18.477759 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:34:18.477759 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:34:18.477759 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 21:34:18.477759 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:34:18.477759 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:34:18.477759 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:34:18.477759 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:34:18.477759 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:34:18.477759 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:34:18.477759 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:34:18.477759 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:34:18.477759 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 30 21:34:18.477759 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 21:34:18.477759 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c502b7bcc98a4bec9a5c3cb03feb1601. Jul 30 21:34:18.479025 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:34:18.479025 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4025/8002] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:34:18 2022] PATCH /identity/v3/domains/c502b7bcc98a4bec9a5c3cb03feb1601 => generated 112 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:34:18.480854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80d2bf-0d20-40d6-b91c-799d89ebbc47 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:18.492457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80d2bf-0d20-40d6-b91c-799d89ebbc47 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:18.498009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe90de-05f3-4bb7-b618-5e78e581d613 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:18.498799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe90de-05f3-4bb7-b618-5e78e581d613 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:18.499192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe90de-05f3-4bb7-b618-5e78e581d613 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:18.500980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe90de-05f3-4bb7-b618-5e78e581d613 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/1832a1af200546deb95d4f2872043536` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:18.508980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe90de-05f3-4bb7-b618-5e78e581d613 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 21:34:18.514235 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-7fbe90de-05f3-4bb7-b618-5e78e581d613 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Could not find domain: 1832a1af200546deb95d4f2872043536.: keystone.exception.DomainNotFound: Could not find domain: 1832a1af200546deb95d4f2872043536. Jul 30 21:34:18.514235 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:18.514235 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 30 21:34:18.514235 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 30 21:34:18.514235 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 21:34:18.514235 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 21:34:18.514235 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 21:34:18.514235 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 21:34:18.514235 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1832a1af200546deb95d4f2872043536. Jul 30 21:34:18.514235 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:34:18.514235 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:34:18.514235 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:34:18.514235 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:18.514235 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:34:18.514235 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:34:18.515643 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:34:18.515643 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:34:18.515643 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:34:18.515643 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:34:18.515643 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:34:18.515643 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:34:18.515643 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:34:18.515643 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:34:18.515643 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 30 21:34:18.515643 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 30 21:34:18.515643 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 21:34:18.515643 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 21:34:18.515643 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 21:34:18.515643 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 21:34:18.515643 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:34:18.515643 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:34:18.517719 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:34:18.517719 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:34:18.517719 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:34:18.517719 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:34:18.517719 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:34:18.517719 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 21:34:18.517719 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:34:18.517719 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:34:18.517719 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:34:18.517719 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:34:18.517719 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:34:18.517719 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:34:18.517719 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:34:18.517719 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:34:18.517719 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 30 21:34:18.517719 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 21:34:18.517719 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1832a1af200546deb95d4f2872043536. Jul 30 21:34:18.518995 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:34:18.518995 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3978/8003] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:34:18 2022] PATCH /identity/v3/domains/1832a1af200546deb95d4f2872043536 => generated 112 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:34:18.521281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934a529-83d2-45f5-afe6-2d47ab2732d6 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:18.533696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934a529-83d2-45f5-afe6-2d47ab2732d6 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:18.539879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e2f42-1045-417e-a1a0-dc3f1f8e48f0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630f291b45b2414a94443a813f3c8c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:18.540780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e2f42-1045-417e-a1a0-dc3f1f8e48f0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:18.541177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e2f42-1045-417e-a1a0-dc3f1f8e48f0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:18.541561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e2f42-1045-417e-a1a0-dc3f1f8e48f0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] PATH_INFO: `/v3/domains/665f4b123eb24ae1bbfd1d1c3ed27cfc` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:18.549628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e2f42-1045-417e-a1a0-dc3f1f8e48f0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 30 21:34:18.555142 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-139e2f42-1045-417e-a1a0-dc3f1f8e48f0 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Could not find domain: 665f4b123eb24ae1bbfd1d1c3ed27cfc.: keystone.exception.DomainNotFound: Could not find domain: 665f4b123eb24ae1bbfd1d1c3ed27cfc. Jul 30 21:34:18.555142 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:18.555142 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 30 21:34:18.555142 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 30 21:34:18.555142 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 21:34:18.555142 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 21:34:18.555142 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 21:34:18.555142 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 21:34:18.555142 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 665f4b123eb24ae1bbfd1d1c3ed27cfc. Jul 30 21:34:18.555142 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:34:18.555142 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:34:18.555142 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:34:18.555142 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:18.555142 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:34:18.555142 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:34:18.556585 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:34:18.556585 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:34:18.556585 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:34:18.556585 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:34:18.556585 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:34:18.556585 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:34:18.556585 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:34:18.556585 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:34:18.556585 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 30 21:34:18.556585 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 30 21:34:18.556585 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 30 21:34:18.556585 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 30 21:34:18.556585 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 30 21:34:18.556585 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 30 21:34:18.556585 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:34:18.556585 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:34:18.557934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:34:18.557934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:34:18.557934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:34:18.557934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:34:18.557934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:34:18.557934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application with Lock( Jul 30 21:34:18.557934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:34:18.557934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:34:18.557934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:34:18.557934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:34:18.557934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:34:18.557934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:34:18.557934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:34:18.557934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:34:18.557934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 30 21:34:18.557934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 30 21:34:18.557934 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 665f4b123eb24ae1bbfd1d1c3ed27cfc. Jul 30 21:34:18.559342 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:34:18.560947 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4026/8004] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:34:18 2022] PATCH /identity/v3/domains/665f4b123eb24ae1bbfd1d1c3ed27cfc => generated 112 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:34:18.564568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe90de-05f3-4bb7-b618-5e78e581d613 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:18.566679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7fbe90de-05f3-4bb7-b618-5e78e581d613 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:18.608182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:18.654052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe90de-05f3-4bb7-b618-5e78e581d613 tempest-DomainConfigurationTestJSON-1734348335 tempest-DomainConfigurationTestJSON-1734348335-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:18.659724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb586cfc-258d-4031-a5e4-f4816749cbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:18.660397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb586cfc-258d-4031-a5e4-f4816749cbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:18.660681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb586cfc-258d-4031-a5e4-f4816749cbda admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:18.660960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb586cfc-258d-4031-a5e4-f4816749cbda admin admin] PATH_INFO: `/v3/users/adf51a715dab4e8699cd1597a0d4445f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:18.662236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb586cfc-258d-4031-a5e4-f4816749cbda admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf51a715dab4e8699cd1597a0d4445f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:18.665817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb586cfc-258d-4031-a5e4-f4816749cbda admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:18.764910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bb586cfc-258d-4031-a5e4-f4816749cbda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf51a715dab4e8699cd1597a0d4445f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:18.765648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bb586cfc-258d-4031-a5e4-f4816749cbda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf51a715dab4e8699cd1597a0d4445f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:18.789322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bb586cfc-258d-4031-a5e4-f4816749cbda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf51a715dab4e8699cd1597a0d4445f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:18.790249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bb586cfc-258d-4031-a5e4-f4816749cbda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf51a715dab4e8699cd1597a0d4445f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:18.813619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-bb586cfc-258d-4031-a5e4-f4816749cbda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf51a715dab4e8699cd1597a0d4445f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:18.843196 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3979/8005] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:18 2022] DELETE /identity/v3/users/adf51a715dab4e8699cd1597a0d4445f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:18.846415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f2405-abbc-4c73-b4f6-eaf8b6d571c5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:18.846646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f2405-abbc-4c73-b4f6-eaf8b6d571c5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:18.847070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f2405-abbc-4c73-b4f6-eaf8b6d571c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:18.869552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-771f2405-abbc-4c73-b4f6-eaf8b6d571c5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:18.870931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-771f2405-abbc-4c73-b4f6-eaf8b6d571c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:18.957246 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4027/8006] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:18.966812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb586cfc-258d-4031-a5e4-f4816749cbda admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:18.968219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bb586cfc-258d-4031-a5e4-f4816749cbda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:19.084366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb586cfc-258d-4031-a5e4-f4816749cbda admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:19.101899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daece890-9156-4758-a38f-f9a31c7e7753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:19.103443 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daece890-9156-4758-a38f-f9a31c7e7753 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:19.103743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daece890-9156-4758-a38f-f9a31c7e7753 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:19.104028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daece890-9156-4758-a38f-f9a31c7e7753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:19.117931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daece890-9156-4758-a38f-f9a31c7e7753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:19.121254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daece890-9156-4758-a38f-f9a31c7e7753 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:19.136138 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3980/8007] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:34:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:34:19.603717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f2405-abbc-4c73-b4f6-eaf8b6d571c5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:19.605427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-771f2405-abbc-4c73-b4f6-eaf8b6d571c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:19.622961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f2405-abbc-4c73-b4f6-eaf8b6d571c5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:19.631136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b23b09-c9ec-461d-8016-de3a9416d26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:19.631861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b23b09-c9ec-461d-8016-de3a9416d26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:19.632185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b23b09-c9ec-461d-8016-de3a9416d26c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:19.632740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b23b09-c9ec-461d-8016-de3a9416d26c admin admin] PATH_INFO: `/v3/projects/1b5a90b02ac44cc09b126ded6064668b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:19.633984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b23b09-c9ec-461d-8016-de3a9416d26c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b5a90b02ac44cc09b126ded6064668b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:19.636599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b23b09-c9ec-461d-8016-de3a9416d26c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:19.658259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:19.723442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46b23b09-c9ec-461d-8016-de3a9416d26c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b5a90b02ac44cc09b126ded6064668b', 'request_id': 'req-46b23b09-c9ec-461d-8016-de3a9416d26c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:19.731189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46b23b09-c9ec-461d-8016-de3a9416d26c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b5a90b02ac44cc09b126ded6064668b', 'request_id': 'req-46b23b09-c9ec-461d-8016-de3a9416d26c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:19.749514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46b23b09-c9ec-461d-8016-de3a9416d26c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b5a90b02ac44cc09b126ded6064668b', 'request_id': 'req-46b23b09-c9ec-461d-8016-de3a9416d26c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:19.774803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46b23b09-c9ec-461d-8016-de3a9416d26c admin admin] The token cache is being invalidate because project 1b5a90b02ac44cc09b126ded6064668b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:19.775361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46b23b09-c9ec-461d-8016-de3a9416d26c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:19.776454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-46b23b09-c9ec-461d-8016-de3a9416d26c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:19.779036 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4028/8008] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:19 2022] DELETE /identity/v3/projects/1b5a90b02ac44cc09b126ded6064668b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:19.783418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daece890-9156-4758-a38f-f9a31c7e7753 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:19.799268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daece890-9156-4758-a38f-f9a31c7e7753 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:19.860347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:19.868897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd0074-596a-4462-bac8-c8e9e64fadfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:19.869554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd0074-596a-4462-bac8-c8e9e64fadfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:19.869841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd0074-596a-4462-bac8-c8e9e64fadfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:19.870124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd0074-596a-4462-bac8-c8e9e64fadfa admin admin] PATH_INFO: `/v3/users/630f291b45b2414a94443a813f3c8c7c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:19.871417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd0074-596a-4462-bac8-c8e9e64fadfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=630f291b45b2414a94443a813f3c8c7c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:19.873739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd0074-596a-4462-bac8-c8e9e64fadfa admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:19.924874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-41cd0074-596a-4462-bac8-c8e9e64fadfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630f291b45b2414a94443a813f3c8c7c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:19.925549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-41cd0074-596a-4462-bac8-c8e9e64fadfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630f291b45b2414a94443a813f3c8c7c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:19.938523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-41cd0074-596a-4462-bac8-c8e9e64fadfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630f291b45b2414a94443a813f3c8c7c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:19.939131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-41cd0074-596a-4462-bac8-c8e9e64fadfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630f291b45b2414a94443a813f3c8c7c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:19.946704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-41cd0074-596a-4462-bac8-c8e9e64fadfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630f291b45b2414a94443a813f3c8c7c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:19.961231 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3981/8009] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:19 2022] DELETE /identity/v3/users/630f291b45b2414a94443a813f3c8c7c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:20.236117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b23b09-c9ec-461d-8016-de3a9416d26c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:20.237365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-46b23b09-c9ec-461d-8016-de3a9416d26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:20.252391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b23b09-c9ec-461d-8016-de3a9416d26c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:20.314822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d4ad5-e41f-480a-86c5-98ebaf6daae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:20.315492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d4ad5-e41f-480a-86c5-98ebaf6daae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:20.315774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d4ad5-e41f-480a-86c5-98ebaf6daae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:20.316055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d4ad5-e41f-480a-86c5-98ebaf6daae5 admin admin] PATH_INFO: `/v3/projects/f93bb9ea220c4ad78ad6c55e4ace55bb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:20.317201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d4ad5-e41f-480a-86c5-98ebaf6daae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f93bb9ea220c4ad78ad6c55e4ace55bb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:20.319096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d4ad5-e41f-480a-86c5-98ebaf6daae5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:20.368378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ee4d4ad5-e41f-480a-86c5-98ebaf6daae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'request_id': 'req-ee4d4ad5-e41f-480a-86c5-98ebaf6daae5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:20.374812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ee4d4ad5-e41f-480a-86c5-98ebaf6daae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'request_id': 'req-ee4d4ad5-e41f-480a-86c5-98ebaf6daae5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:20.383478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ee4d4ad5-e41f-480a-86c5-98ebaf6daae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f93bb9ea220c4ad78ad6c55e4ace55bb', 'request_id': 'req-ee4d4ad5-e41f-480a-86c5-98ebaf6daae5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:20.395824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ee4d4ad5-e41f-480a-86c5-98ebaf6daae5 admin admin] The token cache is being invalidate because project f93bb9ea220c4ad78ad6c55e4ace55bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:20.396228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ee4d4ad5-e41f-480a-86c5-98ebaf6daae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:20.397100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ee4d4ad5-e41f-480a-86c5-98ebaf6daae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:20.398701 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4029/8010] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:20 2022] DELETE /identity/v3/projects/f93bb9ea220c4ad78ad6c55e4ace55bb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:20.403553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17b121-07ed-4aa9-b833-e772c6b07a18 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:20.403874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17b121-07ed-4aa9-b833-e772c6b07a18 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:20.404158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17b121-07ed-4aa9-b833-e772c6b07a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:20.424602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-cc17b121-07ed-4aa9-b833-e772c6b07a18 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:20.425816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cc17b121-07ed-4aa9-b833-e772c6b07a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:20.485387 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3982/8011] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:20.493052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cde58-992e-451f-a3f6-66d769992c3f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:20.493349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cde58-992e-451f-a3f6-66d769992c3f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:20.493635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cde58-992e-451f-a3f6-66d769992c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:20.513456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-569cde58-992e-451f-a3f6-66d769992c3f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:20.514883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-569cde58-992e-451f-a3f6-66d769992c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:20.524015 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4030/8012] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:20.528023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17b121-07ed-4aa9-b833-e772c6b07a18 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:20.537799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17b121-07ed-4aa9-b833-e772c6b07a18 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:20.542378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395685f-04b5-4e98-835d-4f36ad2e34e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:20.542986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395685f-04b5-4e98-835d-4f36ad2e34e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:20.543271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395685f-04b5-4e98-835d-4f36ad2e34e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:20.543588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395685f-04b5-4e98-835d-4f36ad2e34e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:20.544281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395685f-04b5-4e98-835d-4f36ad2e34e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:34:20.544587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395685f-04b5-4e98-835d-4f36ad2e34e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:20.546183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395685f-04b5-4e98-835d-4f36ad2e34e5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:20.557608 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3983/8013] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:20.561772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cde58-992e-451f-a3f6-66d769992c3f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:20.571511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cde58-992e-451f-a3f6-66d769992c3f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:20.576237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46726f-0c9c-4ef4-b110-28db4ea01013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:20.576841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46726f-0c9c-4ef4-b110-28db4ea01013 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:20.577125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46726f-0c9c-4ef4-b110-28db4ea01013 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:20.577402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46726f-0c9c-4ef4-b110-28db4ea01013 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:20.578090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46726f-0c9c-4ef4-b110-28db4ea01013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:20.580632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46726f-0c9c-4ef4-b110-28db4ea01013 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:20.607276 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4031/8014] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:20 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:20.611275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395685f-04b5-4e98-835d-4f36ad2e34e5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:20.621389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395685f-04b5-4e98-835d-4f36ad2e34e5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:20.678207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef1794-f4a6-4bea-88a9-8b35619ebba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:20.678825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef1794-f4a6-4bea-88a9-8b35619ebba7 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:20.679109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef1794-f4a6-4bea-88a9-8b35619ebba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:20.679424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef1794-f4a6-4bea-88a9-8b35619ebba7 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:20.680185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef1794-f4a6-4bea-88a9-8b35619ebba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:20.682032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef1794-f4a6-4bea-88a9-8b35619ebba7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:20.691184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:20.704721 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3984/8015] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:20 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:20.708891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46726f-0c9c-4ef4-b110-28db4ea01013 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:20.715725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:20.722767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46726f-0c9c-4ef4-b110-28db4ea01013 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:20.730439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8a656-b752-464f-b96e-5b77346f6b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:20.731129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8a656-b752-464f-b96e-5b77346f6b05 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:20.731489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8a656-b752-464f-b96e-5b77346f6b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:20.731845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8a656-b752-464f-b96e-5b77346f6b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:20.732788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8a656-b752-464f-b96e-5b77346f6b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:20.734585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8a656-b752-464f-b96e-5b77346f6b05 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:20.745102 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4032/8016] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:20.749062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef1794-f4a6-4bea-88a9-8b35619ebba7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:20.759954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef1794-f4a6-4bea-88a9-8b35619ebba7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:20.764634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f611b0-7e7c-4333-93e6-2a8e312cd0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:20.765246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f611b0-7e7c-4333-93e6-2a8e312cd0ad admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:20.765533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f611b0-7e7c-4333-93e6-2a8e312cd0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:20.766368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f611b0-7e7c-4333-93e6-2a8e312cd0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:20.767061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f611b0-7e7c-4333-93e6-2a8e312cd0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:20.768703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f611b0-7e7c-4333-93e6-2a8e312cd0ad admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:20.785950 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3985/8017] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:20.789794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8a656-b752-464f-b96e-5b77346f6b05 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:20.804923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8a656-b752-464f-b96e-5b77346f6b05 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:20.810719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cad0cb-c5b3-4ac9-aae6-81516c42c623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:20.811213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cad0cb-c5b3-4ac9-aae6-81516c42c623 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:20.811638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cad0cb-c5b3-4ac9-aae6-81516c42c623 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:20.811913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cad0cb-c5b3-4ac9-aae6-81516c42c623 admin admin] PATH_INFO: `/v3/projects/12e3e197ddcf4a9ab91b64f56cf8c403/users/bfad5d6030364d6ea38fa2ce25a11fbf/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:20.828958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cad0cb-c5b3-4ac9-aae6-81516c42c623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e3e197ddcf4a9ab91b64f56cf8c403, user_id=bfad5d6030364d6ea38fa2ce25a11fbf, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:20.831935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cad0cb-c5b3-4ac9-aae6-81516c42c623 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:20.844917 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4033/8018] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:20 2022] PUT /identity/v3/projects/12e3e197ddcf4a9ab91b64f56cf8c403/users/bfad5d6030364d6ea38fa2ce25a11fbf/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:20.943084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1a872-9378-42e3-94eb-329e55048eec None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:20.943404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1a872-9378-42e3-94eb-329e55048eec None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:20.943683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1a872-9378-42e3-94eb-329e55048eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:20.971467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f3c1a872-9378-42e3-94eb-329e55048eec None None] MFA Rules not processed for user `bfad5d6030364d6ea38fa2ce25a11fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:20.972685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f3c1a872-9378-42e3-94eb-329e55048eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:21.044527 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3986/8019] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:21.049169 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cad0cb-c5b3-4ac9-aae6-81516c42c623 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:21.112449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cad0cb-c5b3-4ac9-aae6-81516c42c623 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:21.117072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e05130-28fa-4be8-a22e-df38f80f09cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:21.117685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e05130-28fa-4be8-a22e-df38f80f09cb admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:21.117971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e05130-28fa-4be8-a22e-df38f80f09cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:21.118249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e05130-28fa-4be8-a22e-df38f80f09cb admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:21.118901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e05130-28fa-4be8-a22e-df38f80f09cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:21.120892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e05130-28fa-4be8-a22e-df38f80f09cb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:21.152705 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4034/8020] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:21 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:21.153946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1a872-9378-42e3-94eb-329e55048eec None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:21.166347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1a872-9378-42e3-94eb-329e55048eec None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:21.230973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8509d-26de-4f37-8821-01ae3f2bcbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:21.231640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8509d-26de-4f37-8821-01ae3f2bcbb4 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:21.231926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8509d-26de-4f37-8821-01ae3f2bcbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:21.232230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8509d-26de-4f37-8821-01ae3f2bcbb4 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:21.232908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8509d-26de-4f37-8821-01ae3f2bcbb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:21.235535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8509d-26de-4f37-8821-01ae3f2bcbb4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:21.260769 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3987/8021] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:21 2022] POST /identity/v3/users => generated 301 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:21.261907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e05130-28fa-4be8-a22e-df38f80f09cb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:21.272592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e05130-28fa-4be8-a22e-df38f80f09cb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:21.277539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203154b-faa4-4d55-b428-bbc69fc14f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:21.278227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203154b-faa4-4d55-b428-bbc69fc14f11 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:21.278516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203154b-faa4-4d55-b428-bbc69fc14f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:21.278799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203154b-faa4-4d55-b428-bbc69fc14f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:21.279523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203154b-faa4-4d55-b428-bbc69fc14f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:21.281119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203154b-faa4-4d55-b428-bbc69fc14f11 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:21.292868 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4035/8022] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:21.298277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8509d-26de-4f37-8821-01ae3f2bcbb4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:21.309192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8509d-26de-4f37-8821-01ae3f2bcbb4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:21.314121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f2f68-0b42-4b2c-87cd-980d94153319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:21.314795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f2f68-0b42-4b2c-87cd-980d94153319 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:21.315083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f2f68-0b42-4b2c-87cd-980d94153319 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:21.315392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f2f68-0b42-4b2c-87cd-980d94153319 admin admin] PATH_INFO: `/v3/projects/db636b6b7dcc495f8c1ea45a43fa9a74/users/4d71d70bc8f6412cb5d3ed8e3b60770a/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:21.331184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f2f68-0b42-4b2c-87cd-980d94153319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db636b6b7dcc495f8c1ea45a43fa9a74, user_id=4d71d70bc8f6412cb5d3ed8e3b60770a, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:21.333876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f2f68-0b42-4b2c-87cd-980d94153319 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:21.348350 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3988/8023] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:21 2022] PUT /identity/v3/projects/db636b6b7dcc495f8c1ea45a43fa9a74/users/4d71d70bc8f6412cb5d3ed8e3b60770a/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:21.352330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203154b-faa4-4d55-b428-bbc69fc14f11 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:21.363234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203154b-faa4-4d55-b428-bbc69fc14f11 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:21.424851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f4402-4165-490f-887c-ccf4500a972c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:21.425484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f4402-4165-490f-887c-ccf4500a972c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:21.425774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f4402-4165-490f-887c-ccf4500a972c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:21.426059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f4402-4165-490f-887c-ccf4500a972c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:21.426758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f4402-4165-490f-887c-ccf4500a972c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:21.428418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f4402-4165-490f-887c-ccf4500a972c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:21.439323 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4036/8024] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:21.443868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f2f68-0b42-4b2c-87cd-980d94153319 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:21.454808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f2f68-0b42-4b2c-87cd-980d94153319 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:21.460556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa7fa9-ddab-469d-8ded-da37bb5bf0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:21.461434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa7fa9-ddab-469d-8ded-da37bb5bf0e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:21.461556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa7fa9-ddab-469d-8ded-da37bb5bf0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:21.461763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa7fa9-ddab-469d-8ded-da37bb5bf0e2 admin admin] PATH_INFO: `/v3/projects/db636b6b7dcc495f8c1ea45a43fa9a74/users/4d71d70bc8f6412cb5d3ed8e3b60770a/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:21.463804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa7fa9-ddab-469d-8ded-da37bb5bf0e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db636b6b7dcc495f8c1ea45a43fa9a74, user_id=4d71d70bc8f6412cb5d3ed8e3b60770a, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:21.466710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa7fa9-ddab-469d-8ded-da37bb5bf0e2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:21.479038 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3989/8025] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:21 2022] PUT /identity/v3/projects/db636b6b7dcc495f8c1ea45a43fa9a74/users/4d71d70bc8f6412cb5d3ed8e3b60770a/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:21.489959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8d378-02b9-4e2c-8aad-13597cf9009f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:21.490268 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8d378-02b9-4e2c-8aad-13597cf9009f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:21.490542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8d378-02b9-4e2c-8aad-13597cf9009f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:21.523617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-58c8d378-02b9-4e2c-8aad-13597cf9009f None None] MFA Rules not processed for user `4d71d70bc8f6412cb5d3ed8e3b60770a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:21.524861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-58c8d378-02b9-4e2c-8aad-13597cf9009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:21.558789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:21.623832 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4037/8026] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:21.630831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa7fa9-ddab-469d-8ded-da37bb5bf0e2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:21.642125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa7fa9-ddab-469d-8ded-da37bb5bf0e2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:21.646911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734e0e0-e6ce-407f-87e3-2d0b25352734 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d71d70bc8f6412cb5d3ed8e3b60770a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db636b6b7dcc495f8c1ea45a43fa9a74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:21.647582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734e0e0-e6ce-407f-87e3-2d0b25352734 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:21.647869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734e0e0-e6ce-407f-87e3-2d0b25352734 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:21.648145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734e0e0-e6ce-407f-87e3-2d0b25352734 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] PATH_INFO: `/v3/projects/12e3e197ddcf4a9ab91b64f56cf8c403` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:21.649346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734e0e0-e6ce-407f-87e3-2d0b25352734 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorizing `identity:get_project(project_id=12e3e197ddcf4a9ab91b64f56cf8c403)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:21.651417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734e0e0-e6ce-407f-87e3-2d0b25352734 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:21.653074 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3990/8027] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:34:21 2022] GET /identity/v3/projects/12e3e197ddcf4a9ab91b64f56cf8c403 => generated 389 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:21.658271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8d378-02b9-4e2c-8aad-13597cf9009f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:21.668980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8d378-02b9-4e2c-8aad-13597cf9009f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:21.673897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68914d5-2f46-4c2c-bb17-141fd01a2013 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d71d70bc8f6412cb5d3ed8e3b60770a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db636b6b7dcc495f8c1ea45a43fa9a74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:21.674591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68914d5-2f46-4c2c-bb17-141fd01a2013 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:21.674943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68914d5-2f46-4c2c-bb17-141fd01a2013 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:21.675334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68914d5-2f46-4c2c-bb17-141fd01a2013 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:21.676235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68914d5-2f46-4c2c-bb17-141fd01a2013 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:21.679543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68914d5-2f46-4c2c-bb17-141fd01a2013 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:21.707420 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4038/8028] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 30 21:34:21 2022] POST /identity/v3/projects => generated 339 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:21.712029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734e0e0-e6ce-407f-87e3-2d0b25352734 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:21.722742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734e0e0-e6ce-407f-87e3-2d0b25352734 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:21.735814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:21.781168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40082c75-5ff5-4699-bb9c-665d9dd98ad0 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d71d70bc8f6412cb5d3ed8e3b60770a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db636b6b7dcc495f8c1ea45a43fa9a74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:21.782397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40082c75-5ff5-4699-bb9c-665d9dd98ad0 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:21.782686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40082c75-5ff5-4699-bb9c-665d9dd98ad0 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:21.782965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40082c75-5ff5-4699-bb9c-665d9dd98ad0 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:21.783699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40082c75-5ff5-4699-bb9c-665d9dd98ad0 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:21.785562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40082c75-5ff5-4699-bb9c-665d9dd98ad0 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:21.803979 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3991/8029] 10.222.0.17 () {58 vars in 1131 bytes} [Sat Jul 30 21:34:21 2022] GET /identity/v3/projects => generated 5489 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:21.808328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68914d5-2f46-4c2c-bb17-141fd01a2013 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:21.819837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68914d5-2f46-4c2c-bb17-141fd01a2013 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:21.824887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfa651-382b-41e7-8da2-438804c9ad6f tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d71d70bc8f6412cb5d3ed8e3b60770a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db636b6b7dcc495f8c1ea45a43fa9a74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:21.825572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfa651-382b-41e7-8da2-438804c9ad6f tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:21.825859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfa651-382b-41e7-8da2-438804c9ad6f tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:21.826139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfa651-382b-41e7-8da2-438804c9ad6f tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] PATH_INFO: `/v3/projects/12e3e197ddcf4a9ab91b64f56cf8c403` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:21.827345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfa651-382b-41e7-8da2-438804c9ad6f tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorizing `identity:get_project(project_id=12e3e197ddcf4a9ab91b64f56cf8c403)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:21.830042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfa651-382b-41e7-8da2-438804c9ad6f tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:21.831768 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4039/8030] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:34:21 2022] GET /identity/v3/projects/12e3e197ddcf4a9ab91b64f56cf8c403 => generated 389 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:21.835850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40082c75-5ff5-4699-bb9c-665d9dd98ad0 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:21.846706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40082c75-5ff5-4699-bb9c-665d9dd98ad0 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:21.851369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa21bee-10dd-401f-921c-165966fc7f84 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d71d70bc8f6412cb5d3ed8e3b60770a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db636b6b7dcc495f8c1ea45a43fa9a74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:21.852000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa21bee-10dd-401f-921c-165966fc7f84 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:21.852284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa21bee-10dd-401f-921c-165966fc7f84 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:21.852559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa21bee-10dd-401f-921c-165966fc7f84 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] PATH_INFO: `/v3/projects/0d454b4840984eb4b45f3963872bb6fc` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:21.853738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa21bee-10dd-401f-921c-165966fc7f84 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorizing `identity:get_project(project_id=0d454b4840984eb4b45f3963872bb6fc)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:21.855812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa21bee-10dd-401f-921c-165966fc7f84 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:21.857429 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3992/8031] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:34:21 2022] GET /identity/v3/projects/0d454b4840984eb4b45f3963872bb6fc => generated 339 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:21.862173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfa651-382b-41e7-8da2-438804c9ad6f tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:21.872543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfa651-382b-41e7-8da2-438804c9ad6f tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:21.877641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e36c7a-bc35-4747-96c7-6cf43db104fb tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d71d70bc8f6412cb5d3ed8e3b60770a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db636b6b7dcc495f8c1ea45a43fa9a74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:21.878244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e36c7a-bc35-4747-96c7-6cf43db104fb tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:21.878537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e36c7a-bc35-4747-96c7-6cf43db104fb tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:21.878821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e36c7a-bc35-4747-96c7-6cf43db104fb tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:21.879551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e36c7a-bc35-4747-96c7-6cf43db104fb tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:21.881383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e36c7a-bc35-4747-96c7-6cf43db104fb tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:21.898736 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4040/8032] 10.222.0.17 () {58 vars in 1131 bytes} [Sat Jul 30 21:34:21 2022] GET /identity/v3/projects => generated 5489 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:34:21.903341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa21bee-10dd-401f-921c-165966fc7f84 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:21.913926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa21bee-10dd-401f-921c-165966fc7f84 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:21.918839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a4c69-373d-4734-9615-2eb55f854fad tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d71d70bc8f6412cb5d3ed8e3b60770a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db636b6b7dcc495f8c1ea45a43fa9a74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:21.919512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a4c69-373d-4734-9615-2eb55f854fad tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:21.919801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a4c69-373d-4734-9615-2eb55f854fad tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:21.920080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a4c69-373d-4734-9615-2eb55f854fad tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:21.920798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a4c69-373d-4734-9615-2eb55f854fad tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:34:21.921109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a4c69-373d-4734-9615-2eb55f854fad tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:21.923398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a4c69-373d-4734-9615-2eb55f854fad tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:21.948784 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3993/8033] 10.222.0.17 () {58 vars in 1166 bytes} [Sat Jul 30 21:34:21 2022] GET /identity/v3/projects?domain_id=default => generated 5158 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:21.954554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e36c7a-bc35-4747-96c7-6cf43db104fb tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:21.964784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e36c7a-bc35-4747-96c7-6cf43db104fb tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:21.970140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65110e2e-b165-42d2-af3e-a8dd72d26860 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d71d70bc8f6412cb5d3ed8e3b60770a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db636b6b7dcc495f8c1ea45a43fa9a74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:21.970752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65110e2e-b165-42d2-af3e-a8dd72d26860 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:21.971047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65110e2e-b165-42d2-af3e-a8dd72d26860 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:21.971367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65110e2e-b165-42d2-af3e-a8dd72d26860 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:21.972068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65110e2e-b165-42d2-af3e-a8dd72d26860 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:21.973909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65110e2e-b165-42d2-af3e-a8dd72d26860 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:21.990658 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4041/8034] 10.222.0.17 () {58 vars in 1131 bytes} [Sat Jul 30 21:34:21 2022] GET /identity/v3/projects => generated 5489 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:21.995364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a4c69-373d-4734-9615-2eb55f854fad tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:22.005982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a4c69-373d-4734-9615-2eb55f854fad tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:22.010579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc38fb2-609e-44dd-88a1-8675836dfe9d tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d71d70bc8f6412cb5d3ed8e3b60770a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db636b6b7dcc495f8c1ea45a43fa9a74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:22.011190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc38fb2-609e-44dd-88a1-8675836dfe9d tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:22.011530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc38fb2-609e-44dd-88a1-8675836dfe9d tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:22.011809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc38fb2-609e-44dd-88a1-8675836dfe9d tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:22.012524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc38fb2-609e-44dd-88a1-8675836dfe9d tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:34:22.012829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc38fb2-609e-44dd-88a1-8675836dfe9d tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:22.014663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc38fb2-609e-44dd-88a1-8675836dfe9d tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:22.032600 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3994/8035] 10.222.0.17 () {58 vars in 1166 bytes} [Sat Jul 30 21:34:21 2022] GET /identity/v3/projects?domain_id=default => generated 5158 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:34:22.038003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65110e2e-b165-42d2-af3e-a8dd72d26860 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:22.048037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65110e2e-b165-42d2-af3e-a8dd72d26860 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:22.052643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f5018-fba1-4302-83a2-dddc4061a291 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d71d70bc8f6412cb5d3ed8e3b60770a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db636b6b7dcc495f8c1ea45a43fa9a74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:22.053248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f5018-fba1-4302-83a2-dddc4061a291 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:22.053535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f5018-fba1-4302-83a2-dddc4061a291 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:22.053825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f5018-fba1-4302-83a2-dddc4061a291 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:22.054513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f5018-fba1-4302-83a2-dddc4061a291 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:22.056391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f5018-fba1-4302-83a2-dddc4061a291 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:22.073521 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4042/8036] 10.222.0.17 () {58 vars in 1131 bytes} [Sat Jul 30 21:34:22 2022] GET /identity/v3/projects => generated 5489 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:34:22.078911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc38fb2-609e-44dd-88a1-8675836dfe9d tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:22.089126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc38fb2-609e-44dd-88a1-8675836dfe9d tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:22.093696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7d459-7332-4bc8-84e8-41d79403a138 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d71d70bc8f6412cb5d3ed8e3b60770a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db636b6b7dcc495f8c1ea45a43fa9a74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:22.094298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7d459-7332-4bc8-84e8-41d79403a138 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:22.094584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7d459-7332-4bc8-84e8-41d79403a138 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:22.094861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7d459-7332-4bc8-84e8-41d79403a138 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:22.095616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7d459-7332-4bc8-84e8-41d79403a138 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1598573999) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:34:22.095925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7d459-7332-4bc8-84e8-41d79403a138 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:22.097779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7d459-7332-4bc8-84e8-41d79403a138 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:22.114860 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3995/8037] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 30 21:34:22 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1598573999 => generated 537 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:22.119787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f5018-fba1-4302-83a2-dddc4061a291 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:22.130583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f5018-fba1-4302-83a2-dddc4061a291 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:22.135336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310fafc-8ece-40ca-b367-9cf2186d637e tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d71d70bc8f6412cb5d3ed8e3b60770a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db636b6b7dcc495f8c1ea45a43fa9a74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:22.135997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310fafc-8ece-40ca-b367-9cf2186d637e tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:22.136289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310fafc-8ece-40ca-b367-9cf2186d637e tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:22.136574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310fafc-8ece-40ca-b367-9cf2186d637e tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] PATH_INFO: `/v3/projects/0d454b4840984eb4b45f3963872bb6fc` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:22.137739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310fafc-8ece-40ca-b367-9cf2186d637e tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0d454b4840984eb4b45f3963872bb6fc)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:22.140026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310fafc-8ece-40ca-b367-9cf2186d637e tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:22.191564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a310fafc-8ece-40ca-b367-9cf2186d637e tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d454b4840984eb4b45f3963872bb6fc', 'request_id': 'req-a310fafc-8ece-40ca-b367-9cf2186d637e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:22.197757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a310fafc-8ece-40ca-b367-9cf2186d637e tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d454b4840984eb4b45f3963872bb6fc', 'request_id': 'req-a310fafc-8ece-40ca-b367-9cf2186d637e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:22.205954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a310fafc-8ece-40ca-b367-9cf2186d637e tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d454b4840984eb4b45f3963872bb6fc', 'request_id': 'req-a310fafc-8ece-40ca-b367-9cf2186d637e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:22.216198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a310fafc-8ece-40ca-b367-9cf2186d637e tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] The token cache is being invalidate because project 0d454b4840984eb4b45f3963872bb6fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:22.216490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a310fafc-8ece-40ca-b367-9cf2186d637e tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:22.217123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a310fafc-8ece-40ca-b367-9cf2186d637e tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:22.218643 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4043/8038] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:22 2022] DELETE /identity/v3/projects/0d454b4840984eb4b45f3963872bb6fc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:22.222664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7d459-7332-4bc8-84e8-41d79403a138 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:22.224382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c2d7d459-7332-4bc8-84e8-41d79403a138 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:22.289430 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7d459-7332-4bc8-84e8-41d79403a138 tempest-ListProjectsStaticTestJSON-1387928267 tempest-ListProjectsStaticTestJSON-1387928267-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:22.345924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bbcec-a1b5-4875-9601-abc1f1afb463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:22.346563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bbcec-a1b5-4875-9601-abc1f1afb463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:22.346847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bbcec-a1b5-4875-9601-abc1f1afb463 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:22.347123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bbcec-a1b5-4875-9601-abc1f1afb463 admin admin] PATH_INFO: `/v3/users/bfad5d6030364d6ea38fa2ce25a11fbf` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:22.348317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bbcec-a1b5-4875-9601-abc1f1afb463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfad5d6030364d6ea38fa2ce25a11fbf)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:22.350224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bbcec-a1b5-4875-9601-abc1f1afb463 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:22.365947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:22.396877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-464bbcec-a1b5-4875-9601-abc1f1afb463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfad5d6030364d6ea38fa2ce25a11fbf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:22.397616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-464bbcec-a1b5-4875-9601-abc1f1afb463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfad5d6030364d6ea38fa2ce25a11fbf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:22.409722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-464bbcec-a1b5-4875-9601-abc1f1afb463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfad5d6030364d6ea38fa2ce25a11fbf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:22.410420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-464bbcec-a1b5-4875-9601-abc1f1afb463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfad5d6030364d6ea38fa2ce25a11fbf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:22.417777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-464bbcec-a1b5-4875-9601-abc1f1afb463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfad5d6030364d6ea38fa2ce25a11fbf'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:22.432302 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3996/8039] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:22 2022] DELETE /identity/v3/users/bfad5d6030364d6ea38fa2ce25a11fbf => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:22.437041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175731d0-0027-4659-b0cf-6414fea03924 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:22.437593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175731d0-0027-4659-b0cf-6414fea03924 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:22.438198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175731d0-0027-4659-b0cf-6414fea03924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:22.457558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-175731d0-0027-4659-b0cf-6414fea03924 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:22.458765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-175731d0-0027-4659-b0cf-6414fea03924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:22.495687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:22.519022 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4044/8040] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:22.528826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bbcec-a1b5-4875-9601-abc1f1afb463 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:22.530263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-464bbcec-a1b5-4875-9601-abc1f1afb463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:22.589631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bbcec-a1b5-4875-9601-abc1f1afb463 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:22.593334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a5dcc-7170-438c-bec6-ce08f121b657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:22.593952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a5dcc-7170-438c-bec6-ce08f121b657 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:22.594236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a5dcc-7170-438c-bec6-ce08f121b657 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:22.594514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a5dcc-7170-438c-bec6-ce08f121b657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:22.603635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a5dcc-7170-438c-bec6-ce08f121b657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:22.605100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a5dcc-7170-438c-bec6-ce08f121b657 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:22.615151 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3997/8041] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:34:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:34:22.996666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175731d0-0027-4659-b0cf-6414fea03924 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:22.998145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-175731d0-0027-4659-b0cf-6414fea03924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:23.018252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175731d0-0027-4659-b0cf-6414fea03924 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:23.023195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b0a0c-efd6-4eab-b190-6a0d7a7b60b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:23.023921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b0a0c-efd6-4eab-b190-6a0d7a7b60b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:23.024209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b0a0c-efd6-4eab-b190-6a0d7a7b60b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:23.024514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b0a0c-efd6-4eab-b190-6a0d7a7b60b4 admin admin] PATH_INFO: `/v3/projects/12e3e197ddcf4a9ab91b64f56cf8c403` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:23.025739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b0a0c-efd6-4eab-b190-6a0d7a7b60b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12e3e197ddcf4a9ab91b64f56cf8c403)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:23.027734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b0a0c-efd6-4eab-b190-6a0d7a7b60b4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:23.080083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-828b0a0c-efd6-4eab-b190-6a0d7a7b60b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12e3e197ddcf4a9ab91b64f56cf8c403', 'request_id': 'req-828b0a0c-efd6-4eab-b190-6a0d7a7b60b4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:23.086488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-828b0a0c-efd6-4eab-b190-6a0d7a7b60b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12e3e197ddcf4a9ab91b64f56cf8c403', 'request_id': 'req-828b0a0c-efd6-4eab-b190-6a0d7a7b60b4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:23.096877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-828b0a0c-efd6-4eab-b190-6a0d7a7b60b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12e3e197ddcf4a9ab91b64f56cf8c403', 'request_id': 'req-828b0a0c-efd6-4eab-b190-6a0d7a7b60b4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:23.108573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-828b0a0c-efd6-4eab-b190-6a0d7a7b60b4 admin admin] The token cache is being invalidate because project 12e3e197ddcf4a9ab91b64f56cf8c403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:23.108878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-828b0a0c-efd6-4eab-b190-6a0d7a7b60b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:23.110087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-828b0a0c-efd6-4eab-b190-6a0d7a7b60b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:23.111767 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4045/8042] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:22 2022] DELETE /identity/v3/projects/12e3e197ddcf4a9ab91b64f56cf8c403 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:23.115933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a5dcc-7170-438c-bec6-ce08f121b657 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:23.126367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a5dcc-7170-438c-bec6-ce08f121b657 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:23.185808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3feb045-9ce7-4a4e-96b7-8fe02076c34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:23.186456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3feb045-9ce7-4a4e-96b7-8fe02076c34d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:23.186743 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3feb045-9ce7-4a4e-96b7-8fe02076c34d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:23.187025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3feb045-9ce7-4a4e-96b7-8fe02076c34d admin admin] PATH_INFO: `/v3/users/4d71d70bc8f6412cb5d3ed8e3b60770a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:23.188258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3feb045-9ce7-4a4e-96b7-8fe02076c34d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d71d70bc8f6412cb5d3ed8e3b60770a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:23.190183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3feb045-9ce7-4a4e-96b7-8fe02076c34d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:23.237009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:23.245731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a3feb045-9ce7-4a4e-96b7-8fe02076c34d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d71d70bc8f6412cb5d3ed8e3b60770a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:23.246765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a3feb045-9ce7-4a4e-96b7-8fe02076c34d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d71d70bc8f6412cb5d3ed8e3b60770a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:23.260666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a3feb045-9ce7-4a4e-96b7-8fe02076c34d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d71d70bc8f6412cb5d3ed8e3b60770a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:23.261353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a3feb045-9ce7-4a4e-96b7-8fe02076c34d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d71d70bc8f6412cb5d3ed8e3b60770a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:23.269724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a3feb045-9ce7-4a4e-96b7-8fe02076c34d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d71d70bc8f6412cb5d3ed8e3b60770a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:23.283634 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3998/8043] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:23 2022] DELETE /identity/v3/users/4d71d70bc8f6412cb5d3ed8e3b60770a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:23.575896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b0a0c-efd6-4eab-b190-6a0d7a7b60b4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:23.577501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-828b0a0c-efd6-4eab-b190-6a0d7a7b60b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:23.592139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b0a0c-efd6-4eab-b190-6a0d7a7b60b4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:23.649975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f4f9e-db1c-4a09-9103-257895cd7636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:23.650552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f4f9e-db1c-4a09-9103-257895cd7636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:23.650839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f4f9e-db1c-4a09-9103-257895cd7636 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:23.651121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f4f9e-db1c-4a09-9103-257895cd7636 admin admin] PATH_INFO: `/v3/projects/db636b6b7dcc495f8c1ea45a43fa9a74` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:23.652325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f4f9e-db1c-4a09-9103-257895cd7636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db636b6b7dcc495f8c1ea45a43fa9a74)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:23.654229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f4f9e-db1c-4a09-9103-257895cd7636 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:23.699761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a22f4f9e-db1c-4a09-9103-257895cd7636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db636b6b7dcc495f8c1ea45a43fa9a74', 'request_id': 'req-a22f4f9e-db1c-4a09-9103-257895cd7636'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:23.706431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a22f4f9e-db1c-4a09-9103-257895cd7636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db636b6b7dcc495f8c1ea45a43fa9a74', 'request_id': 'req-a22f4f9e-db1c-4a09-9103-257895cd7636'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:23.714689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a22f4f9e-db1c-4a09-9103-257895cd7636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db636b6b7dcc495f8c1ea45a43fa9a74', 'request_id': 'req-a22f4f9e-db1c-4a09-9103-257895cd7636'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:23.719527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:23.726721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a22f4f9e-db1c-4a09-9103-257895cd7636 admin admin] The token cache is being invalidate because project db636b6b7dcc495f8c1ea45a43fa9a74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:23.727229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a22f4f9e-db1c-4a09-9103-257895cd7636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:23.728204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a22f4f9e-db1c-4a09-9103-257895cd7636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:23.729761 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4046/8044] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:23 2022] DELETE /identity/v3/projects/db636b6b7dcc495f8c1ea45a43fa9a74 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:23.735067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b32c2-727d-4d3f-8857-83bc9c5b4bad None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:23.735390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b32c2-727d-4d3f-8857-83bc9c5b4bad None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:23.735699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b32c2-727d-4d3f-8857-83bc9c5b4bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:23.755903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6d3b32c2-727d-4d3f-8857-83bc9c5b4bad None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:23.757115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6d3b32c2-727d-4d3f-8857-83bc9c5b4bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:23.816123 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 3999/8045] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:23.824854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311ea34-a322-45d3-a924-fa75e56870b8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:23.825149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311ea34-a322-45d3-a924-fa75e56870b8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:23.825434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311ea34-a322-45d3-a924-fa75e56870b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:23.846040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a311ea34-a322-45d3-a924-fa75e56870b8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:23.847323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a311ea34-a322-45d3-a924-fa75e56870b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:23.855370 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4047/8046] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:23.860006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b32c2-727d-4d3f-8857-83bc9c5b4bad None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:23.871053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b32c2-727d-4d3f-8857-83bc9c5b4bad None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:23.877923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dfb7d-48b6-42c7-9678-16c5c0b8b1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:23.878673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dfb7d-48b6-42c7-9678-16c5c0b8b1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:23.879238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dfb7d-48b6-42c7-9678-16c5c0b8b1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:23.879238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dfb7d-48b6-42c7-9678-16c5c0b8b1c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:23.880047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96dfb7d-48b6-42c7-9678-16c5c0b8b1c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:34:23.880368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96dfb7d-48b6-42c7-9678-16c5c0b8b1c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:23.882155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96dfb7d-48b6-42c7-9678-16c5c0b8b1c1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:23.897668 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4000/8047] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:23.902645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311ea34-a322-45d3-a924-fa75e56870b8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:23.913380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311ea34-a322-45d3-a924-fa75e56870b8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:23.919447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430fa9d-b975-4c07-a4c3-d76cde0b9a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:23.920145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430fa9d-b975-4c07-a4c3-d76cde0b9a8e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:23.920526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430fa9d-b975-4c07-a4c3-d76cde0b9a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:23.920834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430fa9d-b975-4c07-a4c3-d76cde0b9a8e admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:23.921557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430fa9d-b975-4c07-a4c3-d76cde0b9a8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:23.924120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430fa9d-b975-4c07-a4c3-d76cde0b9a8e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:23.957749 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4048/8048] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:23 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:23.958911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dfb7d-48b6-42c7-9678-16c5c0b8b1c1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:23.968952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dfb7d-48b6-42c7-9678-16c5c0b8b1c1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:24.034938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef2818-13e1-447c-ba55-b651426a1791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:24.035759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef2818-13e1-447c-ba55-b651426a1791 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:24.036185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef2818-13e1-447c-ba55-b651426a1791 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:24.036470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef2818-13e1-447c-ba55-b651426a1791 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:24.037137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef2818-13e1-447c-ba55-b651426a1791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:24.039048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef2818-13e1-447c-ba55-b651426a1791 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:24.063582 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4001/8049] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:23 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:24.067695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430fa9d-b975-4c07-a4c3-d76cde0b9a8e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:24.078527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430fa9d-b975-4c07-a4c3-d76cde0b9a8e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:24.083411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcce9c-8827-45f6-83a0-e244e50d148e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:24.084113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcce9c-8827-45f6-83a0-e244e50d148e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:24.084478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcce9c-8827-45f6-83a0-e244e50d148e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:24.084869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcce9c-8827-45f6-83a0-e244e50d148e admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:24.085642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcce9c-8827-45f6-83a0-e244e50d148e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:24.087254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcce9c-8827-45f6-83a0-e244e50d148e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:24.097724 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4049/8050] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:24.101452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef2818-13e1-447c-ba55-b651426a1791 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:24.112193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef2818-13e1-447c-ba55-b651426a1791 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:24.116973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cef4a-47e4-4f64-8597-0cb8f347d3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:24.117630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cef4a-47e4-4f64-8597-0cb8f347d3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:24.117863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cef4a-47e4-4f64-8597-0cb8f347d3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:24.118142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cef4a-47e4-4f64-8597-0cb8f347d3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:24.118864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cef4a-47e4-4f64-8597-0cb8f347d3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:24.120533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cef4a-47e4-4f64-8597-0cb8f347d3d8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:24.132301 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4002/8051] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:24.136454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcce9c-8827-45f6-83a0-e244e50d148e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:24.147122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcce9c-8827-45f6-83a0-e244e50d148e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:24.152182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c1bd3-4a7d-47fb-bc78-1fe0f6888016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:24.152910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c1bd3-4a7d-47fb-bc78-1fe0f6888016 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:24.153147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c1bd3-4a7d-47fb-bc78-1fe0f6888016 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:24.153497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c1bd3-4a7d-47fb-bc78-1fe0f6888016 admin admin] PATH_INFO: `/v3/projects/7c075f3bc3c94bb9851c0fec94bdbd9c/users/15e6be6839be43be977b6cecd2c54bbe/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:24.168872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c1bd3-4a7d-47fb-bc78-1fe0f6888016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c075f3bc3c94bb9851c0fec94bdbd9c, user_id=15e6be6839be43be977b6cecd2c54bbe, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:24.171600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c1bd3-4a7d-47fb-bc78-1fe0f6888016 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:24.184617 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4050/8052] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:24 2022] PUT /identity/v3/projects/7c075f3bc3c94bb9851c0fec94bdbd9c/users/15e6be6839be43be977b6cecd2c54bbe/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:24.195220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7ede2-35c4-4c63-a0c1-3b407eab7155 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:24.195548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7ede2-35c4-4c63-a0c1-3b407eab7155 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:24.195829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7ede2-35c4-4c63-a0c1-3b407eab7155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:24.223702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b1e7ede2-35c4-4c63-a0c1-3b407eab7155 None None] MFA Rules not processed for user `15e6be6839be43be977b6cecd2c54bbe`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:24.224927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b1e7ede2-35c4-4c63-a0c1-3b407eab7155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:24.233925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:24.291517 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4003/8053] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:24.296117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c1bd3-4a7d-47fb-bc78-1fe0f6888016 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:24.372511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c1bd3-4a7d-47fb-bc78-1fe0f6888016 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:24.377622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56246c84-c487-400e-991c-fe73d475cf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:24.378240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56246c84-c487-400e-991c-fe73d475cf1c admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:24.378522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56246c84-c487-400e-991c-fe73d475cf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:24.378794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56246c84-c487-400e-991c-fe73d475cf1c admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:24.379482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56246c84-c487-400e-991c-fe73d475cf1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:24.381396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56246c84-c487-400e-991c-fe73d475cf1c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:24.408239 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4051/8054] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:24 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:24.412320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7ede2-35c4-4c63-a0c1-3b407eab7155 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:24.423696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7ede2-35c4-4c63-a0c1-3b407eab7155 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:24.480131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf617961-de5e-4e10-ba35-acd7bb392978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:24.480748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf617961-de5e-4e10-ba35-acd7bb392978 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:24.481030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf617961-de5e-4e10-ba35-acd7bb392978 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:24.481303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf617961-de5e-4e10-ba35-acd7bb392978 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:24.481962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf617961-de5e-4e10-ba35-acd7bb392978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:24.483907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf617961-de5e-4e10-ba35-acd7bb392978 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:24.505294 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4004/8055] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:24 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:24.509444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56246c84-c487-400e-991c-fe73d475cf1c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:24.519880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56246c84-c487-400e-991c-fe73d475cf1c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:24.524576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a336b-806b-48ca-b5df-b9a1df82a56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:24.525184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a336b-806b-48ca-b5df-b9a1df82a56e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:24.525474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a336b-806b-48ca-b5df-b9a1df82a56e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:24.525757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a336b-806b-48ca-b5df-b9a1df82a56e admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:24.526452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a336b-806b-48ca-b5df-b9a1df82a56e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:24.528105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a336b-806b-48ca-b5df-b9a1df82a56e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:24.539182 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4052/8056] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:34:24.543228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf617961-de5e-4e10-ba35-acd7bb392978 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:24.554037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf617961-de5e-4e10-ba35-acd7bb392978 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:24.559125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7d638-db1b-467f-9831-f70a10979907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:24.559852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7d638-db1b-467f-9831-f70a10979907 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:24.560165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7d638-db1b-467f-9831-f70a10979907 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:24.560445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7d638-db1b-467f-9831-f70a10979907 admin admin] PATH_INFO: `/v3/projects/9fe04ca7b8154bffbc547756a2226b9e/users/bd38ca6ddec046979b15c548d6d4199d/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:24.575308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7d638-db1b-467f-9831-f70a10979907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe04ca7b8154bffbc547756a2226b9e, user_id=bd38ca6ddec046979b15c548d6d4199d, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:24.577960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7d638-db1b-467f-9831-f70a10979907 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:24.590638 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4005/8057] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:24 2022] PUT /identity/v3/projects/9fe04ca7b8154bffbc547756a2226b9e/users/bd38ca6ddec046979b15c548d6d4199d/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:34:24.594995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a336b-806b-48ca-b5df-b9a1df82a56e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:24.605364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a336b-806b-48ca-b5df-b9a1df82a56e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:24.669309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c917cd-f4c5-4c92-9a14-37bfab5a6b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:24.669855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c917cd-f4c5-4c92-9a14-37bfab5a6b9e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:24.670148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c917cd-f4c5-4c92-9a14-37bfab5a6b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:24.670432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c917cd-f4c5-4c92-9a14-37bfab5a6b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:24.671787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c917cd-f4c5-4c92-9a14-37bfab5a6b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:24.673460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c917cd-f4c5-4c92-9a14-37bfab5a6b9e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:24.683820 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4053/8058] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:24.687985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7d638-db1b-467f-9831-f70a10979907 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:24.699104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7d638-db1b-467f-9831-f70a10979907 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:24.704639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51292151-a697-4761-a7ac-5b436518426b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:24.705297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51292151-a697-4761-a7ac-5b436518426b admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:24.705579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51292151-a697-4761-a7ac-5b436518426b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:24.705854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51292151-a697-4761-a7ac-5b436518426b admin admin] PATH_INFO: `/v3/projects/9fe04ca7b8154bffbc547756a2226b9e/users/bd38ca6ddec046979b15c548d6d4199d/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:24.707833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51292151-a697-4761-a7ac-5b436518426b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe04ca7b8154bffbc547756a2226b9e, user_id=bd38ca6ddec046979b15c548d6d4199d, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:24.710486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51292151-a697-4761-a7ac-5b436518426b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:24.724791 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4006/8059] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:24 2022] PUT /identity/v3/projects/9fe04ca7b8154bffbc547756a2226b9e/users/bd38ca6ddec046979b15c548d6d4199d/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:24.735620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e61a6-0ad5-4e82-88f0-801e588d2607 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:24.735916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e61a6-0ad5-4e82-88f0-801e588d2607 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:24.736198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e61a6-0ad5-4e82-88f0-801e588d2607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:24.743506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:24.766248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a19e61a6-0ad5-4e82-88f0-801e588d2607 None None] MFA Rules not processed for user `bd38ca6ddec046979b15c548d6d4199d`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:24.767607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a19e61a6-0ad5-4e82-88f0-801e588d2607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:24.834551 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4054/8060] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:24 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:24.839090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51292151-a697-4761-a7ac-5b436518426b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:24.850458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51292151-a697-4761-a7ac-5b436518426b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:24.855228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60098123-ba1b-4acd-bbfc-c991273ab3dc tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd38ca6ddec046979b15c548d6d4199d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fe04ca7b8154bffbc547756a2226b9e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:24.855882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60098123-ba1b-4acd-bbfc-c991273ab3dc tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:24.856170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60098123-ba1b-4acd-bbfc-c991273ab3dc tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:24.856454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60098123-ba1b-4acd-bbfc-c991273ab3dc tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:24.857165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60098123-ba1b-4acd-bbfc-c991273ab3dc tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:24.858767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60098123-ba1b-4acd-bbfc-c991273ab3dc tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:24.877192 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4007/8061] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 30 21:34:24 2022] POST /identity/v3/domains => generated 276 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:24.881282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e61a6-0ad5-4e82-88f0-801e588d2607 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:24.891222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e61a6-0ad5-4e82-88f0-801e588d2607 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:24.962920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5018466-57bd-4330-ac82-0da0098536aa tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd38ca6ddec046979b15c548d6d4199d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fe04ca7b8154bffbc547756a2226b9e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:24.963598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5018466-57bd-4330-ac82-0da0098536aa tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:24.963890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5018466-57bd-4330-ac82-0da0098536aa tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:24.964171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5018466-57bd-4330-ac82-0da0098536aa tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:24.964858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5018466-57bd-4330-ac82-0da0098536aa tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:24.967108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5018466-57bd-4330-ac82-0da0098536aa tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:25.015426 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4055/8062] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:24 2022] POST /identity/v3/users => generated 348 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:25.020446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60098123-ba1b-4acd-bbfc-c991273ab3dc tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:25.036396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60098123-ba1b-4acd-bbfc-c991273ab3dc tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:25.043986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484320f-7fd5-42c0-b463-f6be0d2b936b tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd38ca6ddec046979b15c548d6d4199d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fe04ca7b8154bffbc547756a2226b9e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:25.044894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484320f-7fd5-42c0-b463-f6be0d2b936b tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:25.045306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484320f-7fd5-42c0-b463-f6be0d2b936b tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:25.045595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484320f-7fd5-42c0-b463-f6be0d2b936b tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:25.046268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484320f-7fd5-42c0-b463-f6be0d2b936b tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:25.048716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484320f-7fd5-42c0-b463-f6be0d2b936b tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:25.104267 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4008/8063] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:25 2022] POST /identity/v3/users => generated 323 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:25.105515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5018466-57bd-4330-ac82-0da0098536aa tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:25.123785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5018466-57bd-4330-ac82-0da0098536aa tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:25.129258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef507f-2bda-41d7-9917-5b8609548dcb tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd38ca6ddec046979b15c548d6d4199d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fe04ca7b8154bffbc547756a2226b9e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:25.130670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef507f-2bda-41d7-9917-5b8609548dcb tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:25.130670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef507f-2bda-41d7-9917-5b8609548dcb tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:25.130670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef507f-2bda-41d7-9917-5b8609548dcb tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] PATH_INFO: `/v3/users/a5c8fca4c4c0411b9c06b63318323443` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:25.149789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef507f-2bda-41d7-9917-5b8609548dcb tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorizing `identity:get_user(user_id=a5c8fca4c4c0411b9c06b63318323443)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:25.154504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef507f-2bda-41d7-9917-5b8609548dcb tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:25.161808 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4056/8064] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:34:25 2022] GET /identity/v3/users/a5c8fca4c4c0411b9c06b63318323443 => generated 348 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:25.162466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484320f-7fd5-42c0-b463-f6be0d2b936b tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:25.177213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484320f-7fd5-42c0-b463-f6be0d2b936b tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:25.183065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3031ef-f0ae-4f87-a128-384f170b4692 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd38ca6ddec046979b15c548d6d4199d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fe04ca7b8154bffbc547756a2226b9e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:25.183625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3031ef-f0ae-4f87-a128-384f170b4692 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:25.184578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3031ef-f0ae-4f87-a128-384f170b4692 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:25.184578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3031ef-f0ae-4f87-a128-384f170b4692 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:25.184959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3031ef-f0ae-4f87-a128-384f170b4692 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Adding query filter params (domain_id=6a48d7fab0a240c7a460150822c5c0e9) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:34:25.185283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3031ef-f0ae-4f87-a128-384f170b4692 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:25.188135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3031ef-f0ae-4f87-a128-384f170b4692 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:25.210398 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4009/8065] 10.222.0.17 () {58 vars in 1207 bytes} [Sat Jul 30 21:34:25 2022] GET /identity/v3/users?domain_id=6a48d7fab0a240c7a460150822c5c0e9 => generated 485 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:25.210833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef507f-2bda-41d7-9917-5b8609548dcb tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:25.221573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef507f-2bda-41d7-9917-5b8609548dcb tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:25.226419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2cd6c-a251-47c4-9f2f-af171625e9df tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd38ca6ddec046979b15c548d6d4199d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fe04ca7b8154bffbc547756a2226b9e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:25.227056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2cd6c-a251-47c4-9f2f-af171625e9df tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:25.227384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2cd6c-a251-47c4-9f2f-af171625e9df tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:25.227675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2cd6c-a251-47c4-9f2f-af171625e9df tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:25.228408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2cd6c-a251-47c4-9f2f-af171625e9df tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:25.229428 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-1ee2cd6c-a251-47c4-9f2f-af171625e9df tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:34:25.229428 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:34:25.229428 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:34:25.230572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2cd6c-a251-47c4-9f2f-af171625e9df tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:25.273721 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4057/8066] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:25 2022] GET /identity/v3/users => generated 7753 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:25.278765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3031ef-f0ae-4f87-a128-384f170b4692 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:25.293104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3031ef-f0ae-4f87-a128-384f170b4692 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:25.300328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d95ed-2c14-4950-ac31-2c795e2b1793 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd38ca6ddec046979b15c548d6d4199d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fe04ca7b8154bffbc547756a2226b9e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:25.301046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d95ed-2c14-4950-ac31-2c795e2b1793 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:25.301344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d95ed-2c14-4950-ac31-2c795e2b1793 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:25.301635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d95ed-2c14-4950-ac31-2c795e2b1793 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:25.302407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d95ed-2c14-4950-ac31-2c795e2b1793 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1576118395) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:34:25.302716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d95ed-2c14-4950-ac31-2c795e2b1793 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:25.304663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d95ed-2c14-4950-ac31-2c795e2b1793 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:25.322541 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4010/8067] 10.222.0.17 () {58 vars in 1189 bytes} [Sat Jul 30 21:34:25 2022] GET /identity/v3/users?name=tempest-test_user-1576118395 => generated 476 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:25.327435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2cd6c-a251-47c4-9f2f-af171625e9df tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:25.338520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2cd6c-a251-47c4-9f2f-af171625e9df tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:25.343272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39937c2-b06c-4785-b216-6e9113c92546 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd38ca6ddec046979b15c548d6d4199d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fe04ca7b8154bffbc547756a2226b9e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:25.343948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39937c2-b06c-4785-b216-6e9113c92546 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:25.344236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39937c2-b06c-4785-b216-6e9113c92546 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:25.344515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39937c2-b06c-4785-b216-6e9113c92546 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:25.345281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39937c2-b06c-4785-b216-6e9113c92546 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:34:25.345589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39937c2-b06c-4785-b216-6e9113c92546 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:25.347496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39937c2-b06c-4785-b216-6e9113c92546 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:25.368472 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4058/8068] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Jul 30 21:34:25 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:25.373627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d95ed-2c14-4950-ac31-2c795e2b1793 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:25.384808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d95ed-2c14-4950-ac31-2c795e2b1793 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:25.389622 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adafb5-3740-445c-ba65-edbaea8d6d1f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd38ca6ddec046979b15c548d6d4199d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fe04ca7b8154bffbc547756a2226b9e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:25.390270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adafb5-3740-445c-ba65-edbaea8d6d1f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:25.390595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adafb5-3740-445c-ba65-edbaea8d6d1f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:25.390884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adafb5-3740-445c-ba65-edbaea8d6d1f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] PATH_INFO: `/v3/users/684944b38f3e4b09883339ec95335b1e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:25.392980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:25.408036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adafb5-3740-445c-ba65-edbaea8d6d1f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorizing `identity:delete_user(user_id=684944b38f3e4b09883339ec95335b1e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:25.410096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adafb5-3740-445c-ba65-edbaea8d6d1f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:25.455873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-86adafb5-3740-445c-ba65-edbaea8d6d1f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '684944b38f3e4b09883339ec95335b1e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:25.456660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-86adafb5-3740-445c-ba65-edbaea8d6d1f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '684944b38f3e4b09883339ec95335b1e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:25.472434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-86adafb5-3740-445c-ba65-edbaea8d6d1f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '684944b38f3e4b09883339ec95335b1e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:25.473262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-86adafb5-3740-445c-ba65-edbaea8d6d1f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '684944b38f3e4b09883339ec95335b1e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:25.482295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-86adafb5-3740-445c-ba65-edbaea8d6d1f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '684944b38f3e4b09883339ec95335b1e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:25.495913 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4011/8069] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:25 2022] DELETE /identity/v3/users/684944b38f3e4b09883339ec95335b1e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:25.499693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39937c2-b06c-4785-b216-6e9113c92546 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:25.502104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d39937c2-b06c-4785-b216-6e9113c92546 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:25.515166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39937c2-b06c-4785-b216-6e9113c92546 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:25.545074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:25.575822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752862c-7771-495f-9193-c08db406d3f1 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd38ca6ddec046979b15c548d6d4199d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fe04ca7b8154bffbc547756a2226b9e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:25.576508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752862c-7771-495f-9193-c08db406d3f1 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:25.576800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752862c-7771-495f-9193-c08db406d3f1 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:25.577086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752862c-7771-495f-9193-c08db406d3f1 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] PATH_INFO: `/v3/users/a5c8fca4c4c0411b9c06b63318323443` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:25.578273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752862c-7771-495f-9193-c08db406d3f1 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a5c8fca4c4c0411b9c06b63318323443)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:25.580278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752862c-7771-495f-9193-c08db406d3f1 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:25.627400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6752862c-7771-495f-9193-c08db406d3f1 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5c8fca4c4c0411b9c06b63318323443'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:25.639903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6752862c-7771-495f-9193-c08db406d3f1 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5c8fca4c4c0411b9c06b63318323443'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:25.640634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6752862c-7771-495f-9193-c08db406d3f1 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5c8fca4c4c0411b9c06b63318323443'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:25.648672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6752862c-7771-495f-9193-c08db406d3f1 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5c8fca4c4c0411b9c06b63318323443'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:25.649354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6752862c-7771-495f-9193-c08db406d3f1 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5c8fca4c4c0411b9c06b63318323443'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:25.662720 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4059/8070] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:25 2022] DELETE /identity/v3/users/a5c8fca4c4c0411b9c06b63318323443 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:34:25.666750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adafb5-3740-445c-ba65-edbaea8d6d1f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:25.677502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adafb5-3740-445c-ba65-edbaea8d6d1f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:25.733555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc98cd1-f6ad-4439-873f-803facab7ee7 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd38ca6ddec046979b15c548d6d4199d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fe04ca7b8154bffbc547756a2226b9e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:25.734132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc98cd1-f6ad-4439-873f-803facab7ee7 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:25.734911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc98cd1-f6ad-4439-873f-803facab7ee7 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:25.735277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc98cd1-f6ad-4439-873f-803facab7ee7 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] PATH_INFO: `/v3/domains/6a48d7fab0a240c7a460150822c5c0e9` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:25.736517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc98cd1-f6ad-4439-873f-803facab7ee7 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6a48d7fab0a240c7a460150822c5c0e9)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:25.738123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc98cd1-f6ad-4439-873f-803facab7ee7 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:25.759889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3cc98cd1-f6ad-4439-873f-803facab7ee7 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6a48d7fab0a240c7a460150822c5c0e9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:25.760576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3cc98cd1-f6ad-4439-873f-803facab7ee7 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6a48d7fab0a240c7a460150822c5c0e9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:25.785272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3cc98cd1-f6ad-4439-873f-803facab7ee7 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6a48d7fab0a240c7a460150822c5c0e9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:25.785905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3cc98cd1-f6ad-4439-873f-803facab7ee7 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6a48d7fab0a240c7a460150822c5c0e9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:25.788361 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4012/8071] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:34:25 2022] PATCH /identity/v3/domains/6a48d7fab0a240c7a460150822c5c0e9 => generated 277 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:25.792283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752862c-7771-495f-9193-c08db406d3f1 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:25.793714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6752862c-7771-495f-9193-c08db406d3f1 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:25.808226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752862c-7771-495f-9193-c08db406d3f1 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:25.866087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b6523-bef3-4f93-b046-c986e27fba2f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd38ca6ddec046979b15c548d6d4199d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fe04ca7b8154bffbc547756a2226b9e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:25.866744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b6523-bef3-4f93-b046-c986e27fba2f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:25.867057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b6523-bef3-4f93-b046-c986e27fba2f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:25.867624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b6523-bef3-4f93-b046-c986e27fba2f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] PATH_INFO: `/v3/domains/6a48d7fab0a240c7a460150822c5c0e9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:25.878731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b6523-bef3-4f93-b046-c986e27fba2f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6a48d7fab0a240c7a460150822c5c0e9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:25.880457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b6523-bef3-4f93-b046-c986e27fba2f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:25.902193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c55b6523-bef3-4f93-b046-c986e27fba2f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6a48d7fab0a240c7a460150822c5c0e9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:25.905566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c55b6523-bef3-4f93-b046-c986e27fba2f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6a48d7fab0a240c7a460150822c5c0e9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:25.927320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:25.957991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c55b6523-bef3-4f93-b046-c986e27fba2f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a48d7fab0a240c7a460150822c5c0e9', 'request_id': 'req-c55b6523-bef3-4f93-b046-c986e27fba2f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:25.965287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c55b6523-bef3-4f93-b046-c986e27fba2f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a48d7fab0a240c7a460150822c5c0e9', 'request_id': 'req-c55b6523-bef3-4f93-b046-c986e27fba2f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:25.978673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c55b6523-bef3-4f93-b046-c986e27fba2f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a48d7fab0a240c7a460150822c5c0e9', 'request_id': 'req-c55b6523-bef3-4f93-b046-c986e27fba2f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:25.994206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c55b6523-bef3-4f93-b046-c986e27fba2f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] The token cache is being invalidate because project 6a48d7fab0a240c7a460150822c5c0e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:25.998705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c55b6523-bef3-4f93-b046-c986e27fba2f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:25.998705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c55b6523-bef3-4f93-b046-c986e27fba2f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:26.008615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c55b6523-bef3-4f93-b046-c986e27fba2f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6a48d7fab0a240c7a460150822c5c0e9', 'request_id': 'req-c55b6523-bef3-4f93-b046-c986e27fba2f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:26.009372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c55b6523-bef3-4f93-b046-c986e27fba2f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6a48d7fab0a240c7a460150822c5c0e9', 'request_id': 'req-c55b6523-bef3-4f93-b046-c986e27fba2f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:26.010038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c55b6523-bef3-4f93-b046-c986e27fba2f tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6a48d7fab0a240c7a460150822c5c0e9', 'request_id': 'req-c55b6523-bef3-4f93-b046-c986e27fba2f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:26.018631 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4060/8072] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:34:25 2022] DELETE /identity/v3/domains/6a48d7fab0a240c7a460150822c5c0e9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:26.022777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc98cd1-f6ad-4439-873f-803facab7ee7 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:26.024455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3cc98cd1-f6ad-4439-873f-803facab7ee7 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:26.060954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:26.093099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc98cd1-f6ad-4439-873f-803facab7ee7 tempest-UsersV3TestJSON-1099293745 tempest-UsersV3TestJSON-1099293745-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:26.149904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c99a3-5768-49fa-8991-4d142251a20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:26.150554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c99a3-5768-49fa-8991-4d142251a20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:26.150841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c99a3-5768-49fa-8991-4d142251a20f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:26.151125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c99a3-5768-49fa-8991-4d142251a20f admin admin] PATH_INFO: `/v3/users/15e6be6839be43be977b6cecd2c54bbe` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:26.152343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c99a3-5768-49fa-8991-4d142251a20f admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e6be6839be43be977b6cecd2c54bbe)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:26.154260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c99a3-5768-49fa-8991-4d142251a20f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:26.202405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-710c99a3-5768-49fa-8991-4d142251a20f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e6be6839be43be977b6cecd2c54bbe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:26.203608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-710c99a3-5768-49fa-8991-4d142251a20f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e6be6839be43be977b6cecd2c54bbe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:26.216108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-710c99a3-5768-49fa-8991-4d142251a20f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e6be6839be43be977b6cecd2c54bbe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:26.216826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-710c99a3-5768-49fa-8991-4d142251a20f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e6be6839be43be977b6cecd2c54bbe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:26.225596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-710c99a3-5768-49fa-8991-4d142251a20f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e6be6839be43be977b6cecd2c54bbe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:26.238348 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4013/8073] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:26 2022] DELETE /identity/v3/users/15e6be6839be43be977b6cecd2c54bbe => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:34:26.243047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a8f70-7987-43ff-97b0-5dab7c7f34e1 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:26.243440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a8f70-7987-43ff-97b0-5dab7c7f34e1 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:26.243730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a8f70-7987-43ff-97b0-5dab7c7f34e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:26.264643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-6f1a8f70-7987-43ff-97b0-5dab7c7f34e1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:26.266283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6f1a8f70-7987-43ff-97b0-5dab7c7f34e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:26.332012 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4061/8074] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:26.342314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c99a3-5768-49fa-8991-4d142251a20f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:26.344371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-710c99a3-5768-49fa-8991-4d142251a20f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:26.411780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c99a3-5768-49fa-8991-4d142251a20f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:26.416674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77a8eb-6ca2-468d-b7ea-b1a3155cc59f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:26.419841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77a8eb-6ca2-468d-b7ea-b1a3155cc59f service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:26.420679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77a8eb-6ca2-468d-b7ea-b1a3155cc59f service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:26.420969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77a8eb-6ca2-468d-b7ea-b1a3155cc59f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:26.432148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77a8eb-6ca2-468d-b7ea-b1a3155cc59f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:26.434031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77a8eb-6ca2-468d-b7ea-b1a3155cc59f service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:26.447618 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4014/8075] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:34:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:34:26.715716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a8f70-7987-43ff-97b0-5dab7c7f34e1 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:26.717289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6f1a8f70-7987-43ff-97b0-5dab7c7f34e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:26.732934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a8f70-7987-43ff-97b0-5dab7c7f34e1 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:26.737669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55da27-e26d-478e-890e-01f9fe27e8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:26.738323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55da27-e26d-478e-890e-01f9fe27e8f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:26.738605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55da27-e26d-478e-890e-01f9fe27e8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:26.738876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55da27-e26d-478e-890e-01f9fe27e8f5 admin admin] PATH_INFO: `/v3/projects/7c075f3bc3c94bb9851c0fec94bdbd9c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:26.740092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55da27-e26d-478e-890e-01f9fe27e8f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c075f3bc3c94bb9851c0fec94bdbd9c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:26.741967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55da27-e26d-478e-890e-01f9fe27e8f5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:26.789987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9e55da27-e26d-478e-890e-01f9fe27e8f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c075f3bc3c94bb9851c0fec94bdbd9c', 'request_id': 'req-9e55da27-e26d-478e-890e-01f9fe27e8f5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:26.796030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9e55da27-e26d-478e-890e-01f9fe27e8f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c075f3bc3c94bb9851c0fec94bdbd9c', 'request_id': 'req-9e55da27-e26d-478e-890e-01f9fe27e8f5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:26.803252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9e55da27-e26d-478e-890e-01f9fe27e8f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c075f3bc3c94bb9851c0fec94bdbd9c', 'request_id': 'req-9e55da27-e26d-478e-890e-01f9fe27e8f5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:26.814994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9e55da27-e26d-478e-890e-01f9fe27e8f5 admin admin] The token cache is being invalidate because project 7c075f3bc3c94bb9851c0fec94bdbd9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:26.815279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9e55da27-e26d-478e-890e-01f9fe27e8f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:26.815987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9e55da27-e26d-478e-890e-01f9fe27e8f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:26.817544 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4062/8076] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:26 2022] DELETE /identity/v3/projects/7c075f3bc3c94bb9851c0fec94bdbd9c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:26.821659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77a8eb-6ca2-468d-b7ea-b1a3155cc59f service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:26.826712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:26.834765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77a8eb-6ca2-468d-b7ea-b1a3155cc59f service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:26.900557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86344476-b97e-4e02-b291-b684cd67b1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:26.901258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86344476-b97e-4e02-b291-b684cd67b1ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:26.901548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86344476-b97e-4e02-b291-b684cd67b1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:26.901830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86344476-b97e-4e02-b291-b684cd67b1ed admin admin] PATH_INFO: `/v3/users/bd38ca6ddec046979b15c548d6d4199d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:26.903063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86344476-b97e-4e02-b291-b684cd67b1ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd38ca6ddec046979b15c548d6d4199d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:26.905121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86344476-b97e-4e02-b291-b684cd67b1ed admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:26.965135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-86344476-b97e-4e02-b291-b684cd67b1ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd38ca6ddec046979b15c548d6d4199d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:26.965478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-86344476-b97e-4e02-b291-b684cd67b1ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd38ca6ddec046979b15c548d6d4199d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:26.978824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-86344476-b97e-4e02-b291-b684cd67b1ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd38ca6ddec046979b15c548d6d4199d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:26.979535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-86344476-b97e-4e02-b291-b684cd67b1ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd38ca6ddec046979b15c548d6d4199d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:26.988591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-86344476-b97e-4e02-b291-b684cd67b1ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd38ca6ddec046979b15c548d6d4199d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:27.007480 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4015/8077] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:26 2022] DELETE /identity/v3/users/bd38ca6ddec046979b15c548d6d4199d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:27.281971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55da27-e26d-478e-890e-01f9fe27e8f5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:27.283576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9e55da27-e26d-478e-890e-01f9fe27e8f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:27.300289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55da27-e26d-478e-890e-01f9fe27e8f5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:27.309135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:27.362318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5402d61-5679-4808-8432-9d075d464220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:27.363189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5402d61-5679-4808-8432-9d075d464220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:27.363536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5402d61-5679-4808-8432-9d075d464220 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:27.363824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5402d61-5679-4808-8432-9d075d464220 admin admin] PATH_INFO: `/v3/projects/9fe04ca7b8154bffbc547756a2226b9e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:27.365142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5402d61-5679-4808-8432-9d075d464220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fe04ca7b8154bffbc547756a2226b9e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:27.367280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5402d61-5679-4808-8432-9d075d464220 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:27.414401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5402d61-5679-4808-8432-9d075d464220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fe04ca7b8154bffbc547756a2226b9e', 'request_id': 'req-b5402d61-5679-4808-8432-9d075d464220'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:27.420543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5402d61-5679-4808-8432-9d075d464220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fe04ca7b8154bffbc547756a2226b9e', 'request_id': 'req-b5402d61-5679-4808-8432-9d075d464220'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:27.428728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5402d61-5679-4808-8432-9d075d464220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fe04ca7b8154bffbc547756a2226b9e', 'request_id': 'req-b5402d61-5679-4808-8432-9d075d464220'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:27.439191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5402d61-5679-4808-8432-9d075d464220 admin admin] The token cache is being invalidate because project 9fe04ca7b8154bffbc547756a2226b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:27.439527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5402d61-5679-4808-8432-9d075d464220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:27.440215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b5402d61-5679-4808-8432-9d075d464220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:27.441765 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4063/8078] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:27 2022] DELETE /identity/v3/projects/9fe04ca7b8154bffbc547756a2226b9e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:27.446625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5050a-62ff-43af-9a13-50294757c379 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:27.447100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5050a-62ff-43af-9a13-50294757c379 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:27.447247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5050a-62ff-43af-9a13-50294757c379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:27.469407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d3f5050a-62ff-43af-9a13-50294757c379 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:27.470654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d3f5050a-62ff-43af-9a13-50294757c379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:27.534569 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4016/8079] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:27.543280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a344ab-677e-4d54-8f04-eae312cd08af None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:27.543849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a344ab-677e-4d54-8f04-eae312cd08af None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:27.544136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a344ab-677e-4d54-8f04-eae312cd08af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:27.565438 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-75a344ab-677e-4d54-8f04-eae312cd08af None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:27.566667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-75a344ab-677e-4d54-8f04-eae312cd08af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:27.574760 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4064/8080] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:27.579199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5050a-62ff-43af-9a13-50294757c379 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:27.589711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5050a-62ff-43af-9a13-50294757c379 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:27.594867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d2610-7249-44e7-9dc6-e0de5e0eb75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:27.595483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d2610-7249-44e7-9dc6-e0de5e0eb75c admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:27.595767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d2610-7249-44e7-9dc6-e0de5e0eb75c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:27.596044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d2610-7249-44e7-9dc6-e0de5e0eb75c admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:27.596742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d2610-7249-44e7-9dc6-e0de5e0eb75c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:34:27.597049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d2610-7249-44e7-9dc6-e0de5e0eb75c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:27.598656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d2610-7249-44e7-9dc6-e0de5e0eb75c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:27.611784 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4017/8081] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:34:27.616239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a344ab-677e-4d54-8f04-eae312cd08af None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:27.628803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a344ab-677e-4d54-8f04-eae312cd08af None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:27.634269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacc401-435d-4a96-be98-c01631853534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:27.635055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacc401-435d-4a96-be98-c01631853534 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:27.635451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacc401-435d-4a96-be98-c01631853534 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:27.635795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacc401-435d-4a96-be98-c01631853534 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:27.636534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eacc401-435d-4a96-be98-c01631853534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:27.638629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eacc401-435d-4a96-be98-c01631853534 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:27.671069 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4065/8082] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:27 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:27.672543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d2610-7249-44e7-9dc6-e0de5e0eb75c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:27.683099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d2610-7249-44e7-9dc6-e0de5e0eb75c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:27.687939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:27.746045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be014e6-275a-4e50-aaa7-7e90441d2ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:27.746684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be014e6-275a-4e50-aaa7-7e90441d2ddc admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:27.746972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be014e6-275a-4e50-aaa7-7e90441d2ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:27.747252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be014e6-275a-4e50-aaa7-7e90441d2ddc admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:27.747980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be014e6-275a-4e50-aaa7-7e90441d2ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:27.750567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be014e6-275a-4e50-aaa7-7e90441d2ddc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:27.774085 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4018/8083] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:27 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:27.778301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacc401-435d-4a96-be98-c01631853534 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:27.790294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacc401-435d-4a96-be98-c01631853534 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:27.795132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8114b-e514-4d18-9f4f-a88bc664fd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:27.795789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8114b-e514-4d18-9f4f-a88bc664fd06 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:27.796097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8114b-e514-4d18-9f4f-a88bc664fd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:27.796367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8114b-e514-4d18-9f4f-a88bc664fd06 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:27.797065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8114b-e514-4d18-9f4f-a88bc664fd06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:27.799079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8114b-e514-4d18-9f4f-a88bc664fd06 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:27.809952 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4066/8084] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:27.814076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be014e6-275a-4e50-aaa7-7e90441d2ddc admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:27.824279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be014e6-275a-4e50-aaa7-7e90441d2ddc admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:27.829559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7da062-a5ba-4980-99ff-d156929b891d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:27.830166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7da062-a5ba-4980-99ff-d156929b891d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:27.830450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7da062-a5ba-4980-99ff-d156929b891d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:27.830725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7da062-a5ba-4980-99ff-d156929b891d admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:27.831446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7da062-a5ba-4980-99ff-d156929b891d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:27.833037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7da062-a5ba-4980-99ff-d156929b891d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:27.845070 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4019/8085] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:34:27.849404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8114b-e514-4d18-9f4f-a88bc664fd06 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:27.859707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8114b-e514-4d18-9f4f-a88bc664fd06 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:27.864562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4e631-3c21-405b-859a-5f559e84a288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:27.865240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4e631-3c21-405b-859a-5f559e84a288 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:27.865525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4e631-3c21-405b-859a-5f559e84a288 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:27.865802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4e631-3c21-405b-859a-5f559e84a288 admin admin] PATH_INFO: `/v3/projects/f8316b62ea474e0d8b95db6e721d8def/users/44cd3430909e4938bb65bef623faa214/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:27.871638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7da062-a5ba-4980-99ff-d156929b891d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:27.873709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ae7da062-a5ba-4980-99ff-d156929b891d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:27.882541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4e631-3c21-405b-859a-5f559e84a288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8316b62ea474e0d8b95db6e721d8def, user_id=44cd3430909e4938bb65bef623faa214, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:27.885302 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4e631-3c21-405b-859a-5f559e84a288 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:27.900448 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4067/8086] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:27 2022] PUT /identity/v3/projects/f8316b62ea474e0d8b95db6e721d8def/users/44cd3430909e4938bb65bef623faa214/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:27.911511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb455a52-54c6-4119-ab05-780767ff8d73 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:27.911809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb455a52-54c6-4119-ab05-780767ff8d73 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:27.912095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb455a52-54c6-4119-ab05-780767ff8d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:27.938096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7da062-a5ba-4980-99ff-d156929b891d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:27.940711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-eb455a52-54c6-4119-ab05-780767ff8d73 None None] MFA Rules not processed for user `44cd3430909e4938bb65bef623faa214`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:27.942067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-eb455a52-54c6-4119-ab05-780767ff8d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:27.977643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:28.003737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f53ff-55ab-4ad4-85b8-0096d453b2bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:28.004717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f53ff-55ab-4ad4-85b8-0096d453b2bb service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:28.005170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f53ff-55ab-4ad4-85b8-0096d453b2bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:28.005449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f53ff-55ab-4ad4-85b8-0096d453b2bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:28.007454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3b5f53ff-55ab-4ad4-85b8-0096d453b2bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:28.038487 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4068/8087] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:28.040310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb455a52-54c6-4119-ab05-780767ff8d73 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:28.096150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:28.103794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f53ff-55ab-4ad4-85b8-0096d453b2bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:28.105844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f53ff-55ab-4ad4-85b8-0096d453b2bb service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:28.115341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb455a52-54c6-4119-ab05-780767ff8d73 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:28.116731 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4020/8088] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:34:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:34:28.119998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c66b9c-9cd9-4903-a146-1e8087735901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:28.120668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c66b9c-9cd9-4903-a146-1e8087735901 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:28.120953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c66b9c-9cd9-4903-a146-1e8087735901 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:28.121229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c66b9c-9cd9-4903-a146-1e8087735901 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:28.121952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c66b9c-9cd9-4903-a146-1e8087735901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:28.124090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c66b9c-9cd9-4903-a146-1e8087735901 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:28.153422 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4069/8089] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:28 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:28.157353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f53ff-55ab-4ad4-85b8-0096d453b2bb service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:28.169248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f53ff-55ab-4ad4-85b8-0096d453b2bb service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:28.233459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724daeeb-2f88-4548-86b8-d9d59d3fc340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:28.234109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724daeeb-2f88-4548-86b8-d9d59d3fc340 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:28.234397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724daeeb-2f88-4548-86b8-d9d59d3fc340 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:28.234670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724daeeb-2f88-4548-86b8-d9d59d3fc340 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:28.235890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724daeeb-2f88-4548-86b8-d9d59d3fc340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:28.237287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724daeeb-2f88-4548-86b8-d9d59d3fc340 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:28.263489 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4021/8090] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:28 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:28.264703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c66b9c-9cd9-4903-a146-1e8087735901 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:28.275954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c66b9c-9cd9-4903-a146-1e8087735901 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:28.280931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c072f2f-e27a-441b-b35e-7c4befad795a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:28.281695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c072f2f-e27a-441b-b35e-7c4befad795a admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:28.282083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c072f2f-e27a-441b-b35e-7c4befad795a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:28.282437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c072f2f-e27a-441b-b35e-7c4befad795a admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:28.283493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c072f2f-e27a-441b-b35e-7c4befad795a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:28.285232 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c072f2f-e27a-441b-b35e-7c4befad795a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:28.298915 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4070/8091] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:34:28.300346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724daeeb-2f88-4548-86b8-d9d59d3fc340 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:28.310895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724daeeb-2f88-4548-86b8-d9d59d3fc340 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:28.316523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba516cea-9df6-4577-a173-ff8214516839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:28.317290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba516cea-9df6-4577-a173-ff8214516839 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:28.317652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba516cea-9df6-4577-a173-ff8214516839 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:28.318009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba516cea-9df6-4577-a173-ff8214516839 admin admin] PATH_INFO: `/v3/projects/2ee20067373842b8b572d4c01c24819e/users/e4a466d817b745deb53620fcd9179fc8/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:28.333856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba516cea-9df6-4577-a173-ff8214516839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee20067373842b8b572d4c01c24819e, user_id=e4a466d817b745deb53620fcd9179fc8, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:28.336663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba516cea-9df6-4577-a173-ff8214516839 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:28.351046 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4022/8092] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:28 2022] PUT /identity/v3/projects/2ee20067373842b8b572d4c01c24819e/users/e4a466d817b745deb53620fcd9179fc8/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:28.355008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c072f2f-e27a-441b-b35e-7c4befad795a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:28.365638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c072f2f-e27a-441b-b35e-7c4befad795a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:28.429088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1969a10-0f15-421c-b208-f9e21fe15398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:28.429894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1969a10-0f15-421c-b208-f9e21fe15398 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:28.430286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1969a10-0f15-421c-b208-f9e21fe15398 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:28.430714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1969a10-0f15-421c-b208-f9e21fe15398 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:28.431668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1969a10-0f15-421c-b208-f9e21fe15398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:28.433375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1969a10-0f15-421c-b208-f9e21fe15398 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:28.445487 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4071/8093] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:28.449783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba516cea-9df6-4577-a173-ff8214516839 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:28.460272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba516cea-9df6-4577-a173-ff8214516839 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:28.465277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddb028-e995-46c0-bec8-87b7b6253812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:28.465950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddb028-e995-46c0-bec8-87b7b6253812 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:28.466221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddb028-e995-46c0-bec8-87b7b6253812 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:28.466495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddb028-e995-46c0-bec8-87b7b6253812 admin admin] PATH_INFO: `/v3/projects/2ee20067373842b8b572d4c01c24819e/users/e4a466d817b745deb53620fcd9179fc8/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:28.468774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddb028-e995-46c0-bec8-87b7b6253812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee20067373842b8b572d4c01c24819e, user_id=e4a466d817b745deb53620fcd9179fc8, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:28.471414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddb028-e995-46c0-bec8-87b7b6253812 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:28.482565 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4023/8094] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:28 2022] PUT /identity/v3/projects/2ee20067373842b8b572d4c01c24819e/users/e4a466d817b745deb53620fcd9179fc8/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:34:28.493688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaa3ee-8e88-47d5-aaca-7edec2d11660 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:28.494442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaa3ee-8e88-47d5-aaca-7edec2d11660 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:28.494442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaa3ee-8e88-47d5-aaca-7edec2d11660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:28.525144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-eabaa3ee-8e88-47d5-aaca-7edec2d11660 None None] MFA Rules not processed for user `e4a466d817b745deb53620fcd9179fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:28.526487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-eabaa3ee-8e88-47d5-aaca-7edec2d11660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:28.554598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:28.600189 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4072/8095] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:28 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:34:28.605177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddb028-e995-46c0-bec8-87b7b6253812 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:28.616999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddb028-e995-46c0-bec8-87b7b6253812 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:28.622776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776d014-265d-4953-83d6-b2ed742f5550 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a466d817b745deb53620fcd9179fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee20067373842b8b572d4c01c24819e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:28.623553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776d014-265d-4953-83d6-b2ed742f5550 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:28.623945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776d014-265d-4953-83d6-b2ed742f5550 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:28.624349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776d014-265d-4953-83d6-b2ed742f5550 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:28.625696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776d014-265d-4953-83d6-b2ed742f5550 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:28.627403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776d014-265d-4953-83d6-b2ed742f5550 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:28.647763 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4024/8096] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 30 21:34:28 2022] POST /identity/v3/services => generated 238 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:28.651552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabaa3ee-8e88-47d5-aaca-7edec2d11660 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:28.661497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabaa3ee-8e88-47d5-aaca-7edec2d11660 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:28.677050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce9bf3-76d7-4ba5-88b5-b3ff1be0aee4 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a466d817b745deb53620fcd9179fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee20067373842b8b572d4c01c24819e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:28.677725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce9bf3-76d7-4ba5-88b5-b3ff1be0aee4 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:28.678010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce9bf3-76d7-4ba5-88b5-b3ff1be0aee4 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:28.678292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce9bf3-76d7-4ba5-88b5-b3ff1be0aee4 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] PATH_INFO: `/v3/services/fb2a9d10f1364614bc6fce913b309270` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:28.678914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce9bf3-76d7-4ba5-88b5-b3ff1be0aee4 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorizing `identity:delete_service(service_id=fb2a9d10f1364614bc6fce913b309270)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:28.680544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce9bf3-76d7-4ba5-88b5-b3ff1be0aee4 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:28.703934 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4073/8097] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:28 2022] DELETE /identity/v3/services/fb2a9d10f1364614bc6fce913b309270 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:34:28.708990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776d014-265d-4953-83d6-b2ed742f5550 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:28.719362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776d014-265d-4953-83d6-b2ed742f5550 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:28.733856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d311f4b-16a8-4930-9cc7-4d87f2b7c120 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a466d817b745deb53620fcd9179fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee20067373842b8b572d4c01c24819e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:28.735420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d311f4b-16a8-4930-9cc7-4d87f2b7c120 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:28.735825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d311f4b-16a8-4930-9cc7-4d87f2b7c120 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:28.736229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d311f4b-16a8-4930-9cc7-4d87f2b7c120 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:28.736804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d311f4b-16a8-4930-9cc7-4d87f2b7c120 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:28.738394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d311f4b-16a8-4930-9cc7-4d87f2b7c120 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:28.757489 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4025/8098] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:28 2022] POST /identity/v3/services => generated 288 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:28.760107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce9bf3-76d7-4ba5-88b5-b3ff1be0aee4 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:28.771039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce9bf3-76d7-4ba5-88b5-b3ff1be0aee4 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:28.786478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b5dc0-9719-4cd4-bd55-dd9fee11b023 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a466d817b745deb53620fcd9179fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee20067373842b8b572d4c01c24819e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:28.787153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b5dc0-9719-4cd4-bd55-dd9fee11b023 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:28.787434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b5dc0-9719-4cd4-bd55-dd9fee11b023 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:28.787710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b5dc0-9719-4cd4-bd55-dd9fee11b023 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] PATH_INFO: `/v3/services/88f862e6e8484a3f9803d66d738db0f7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:28.788392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b5dc0-9719-4cd4-bd55-dd9fee11b023 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorizing `identity:update_service(service_id=88f862e6e8484a3f9803d66d738db0f7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:28.789400 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-302b5dc0-9719-4cd4-bd55-dd9fee11b023 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:34:28.789400 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:34:28.789400 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:34:28.790287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b5dc0-9719-4cd4-bd55-dd9fee11b023 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:28.811999 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4074/8099] 10.222.0.17 () {60 vars in 1252 bytes} [Sat Jul 30 21:34:28 2022] PATCH /identity/v3/services/88f862e6e8484a3f9803d66d738db0f7 => generated 283 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:28.813237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d311f4b-16a8-4930-9cc7-4d87f2b7c120 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:28.824850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d311f4b-16a8-4930-9cc7-4d87f2b7c120 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:28.841651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64927d2e-43cc-4215-a97a-db0cc967c2a8 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a466d817b745deb53620fcd9179fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee20067373842b8b572d4c01c24819e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:28.842428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64927d2e-43cc-4215-a97a-db0cc967c2a8 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:28.842717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64927d2e-43cc-4215-a97a-db0cc967c2a8 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:28.842998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64927d2e-43cc-4215-a97a-db0cc967c2a8 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] PATH_INFO: `/v3/services/88f862e6e8484a3f9803d66d738db0f7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:28.844159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64927d2e-43cc-4215-a97a-db0cc967c2a8 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorizing `identity:get_service(service_id=88f862e6e8484a3f9803d66d738db0f7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:28.845172 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-64927d2e-43cc-4215-a97a-db0cc967c2a8 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:34:28.845172 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:34:28.845172 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:34:28.846058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64927d2e-43cc-4215-a97a-db0cc967c2a8 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:28.852617 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4026/8100] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:34:28 2022] GET /identity/v3/services/88f862e6e8484a3f9803d66d738db0f7 => generated 283 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:34:28.856848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b5dc0-9719-4cd4-bd55-dd9fee11b023 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:28.868284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b5dc0-9719-4cd4-bd55-dd9fee11b023 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:28.873023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850976ee-efca-4d6f-ab13-66f216a6b69e tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a466d817b745deb53620fcd9179fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee20067373842b8b572d4c01c24819e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:28.873892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850976ee-efca-4d6f-ab13-66f216a6b69e tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:28.874184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850976ee-efca-4d6f-ab13-66f216a6b69e tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:28.874517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850976ee-efca-4d6f-ab13-66f216a6b69e tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] PATH_INFO: `/v3/services/88f862e6e8484a3f9803d66d738db0f7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:28.875467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850976ee-efca-4d6f-ab13-66f216a6b69e tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorizing `identity:delete_service(service_id=88f862e6e8484a3f9803d66d738db0f7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:28.877167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850976ee-efca-4d6f-ab13-66f216a6b69e tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:28.898986 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4075/8101] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:28 2022] DELETE /identity/v3/services/88f862e6e8484a3f9803d66d738db0f7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:28.903211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64927d2e-43cc-4215-a97a-db0cc967c2a8 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:28.914740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64927d2e-43cc-4215-a97a-db0cc967c2a8 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:28.930307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f33b66-90d3-49b7-9145-889c9e7a8353 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a466d817b745deb53620fcd9179fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee20067373842b8b572d4c01c24819e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:28.930941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f33b66-90d3-49b7-9145-889c9e7a8353 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:28.931224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f33b66-90d3-49b7-9145-889c9e7a8353 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:28.931634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f33b66-90d3-49b7-9145-889c9e7a8353 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] PATH_INFO: `/v3/services/88f862e6e8484a3f9803d66d738db0f7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:28.932265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f33b66-90d3-49b7-9145-889c9e7a8353 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorizing `identity:get_service(service_id=88f862e6e8484a3f9803d66d738db0f7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:28.933878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f33b66-90d3-49b7-9145-889c9e7a8353 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:28.943477 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-d7f33b66-90d3-49b7-9145-889c9e7a8353 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Could not find service: 88f862e6e8484a3f9803d66d738db0f7.: keystone.exception.ServiceNotFound: Could not find service: 88f862e6e8484a3f9803d66d738db0f7. Jul 30 21:34:28.943477 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:28.943477 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 30 21:34:28.943477 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 30 21:34:28.943477 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 30 21:34:28.943477 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 30 21:34:28.943477 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 30 21:34:28.943477 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 21:34:28.943477 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 88f862e6e8484a3f9803d66d738db0f7. Jul 30 21:34:28.943477 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:34:28.943477 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:34:28.943477 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:34:28.943477 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:28.943477 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:34:28.943477 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:34:28.944866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:34:28.944866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:34:28.944866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:34:28.944866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:34:28.944866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:34:28.944866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:34:28.944866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:34:28.944866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:34:28.944866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 30 21:34:28.944866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 30 21:34:28.944866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 30 21:34:28.944866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 30 21:34:28.944866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:34:28.944866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:34:28.944866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 30 21:34:28.944866 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 30 21:34:28.946380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 30 21:34:28.946380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 30 21:34:28.946380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 30 21:34:28.946380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application with Lock( Jul 30 21:34:28.946380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 30 21:34:28.946380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._enter() Jul 30 21:34:28.946380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 30 21:34:28.946380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 30 21:34:28.946380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 30 21:34:28.946380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.creator() Jul 30 21:34:28.946380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 30 21:34:28.946380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application created_value = creator( Jul 30 21:34:28.946380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 30 21:34:28.946380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 30 21:34:28.946380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 88f862e6e8484a3f9803d66d738db0f7. Jul 30 21:34:28.946380 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:34:28.947550 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4027/8102] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:34:28 2022] GET /identity/v3/services/88f862e6e8484a3f9803d66d738db0f7 => generated 113 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:34:28.950947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850976ee-efca-4d6f-ab13-66f216a6b69e tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:28.964012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850976ee-efca-4d6f-ab13-66f216a6b69e tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:28.969568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece11c36-1da0-43dd-a1ea-429d52dd1d97 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a466d817b745deb53620fcd9179fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee20067373842b8b572d4c01c24819e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:28.970211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece11c36-1da0-43dd-a1ea-429d52dd1d97 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:28.970529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece11c36-1da0-43dd-a1ea-429d52dd1d97 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:28.970837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece11c36-1da0-43dd-a1ea-429d52dd1d97 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:28.971585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece11c36-1da0-43dd-a1ea-429d52dd1d97 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:28.973208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece11c36-1da0-43dd-a1ea-429d52dd1d97 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:28.993549 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4076/8103] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:28 2022] POST /identity/v3/services => generated 274 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:28.995509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f33b66-90d3-49b7-9145-889c9e7a8353 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:29.007711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f33b66-90d3-49b7-9145-889c9e7a8353 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:29.023692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07898edc-5114-45f3-8533-ed13d81383fc tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a466d817b745deb53620fcd9179fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee20067373842b8b572d4c01c24819e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:29.024322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07898edc-5114-45f3-8533-ed13d81383fc tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:29.024609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07898edc-5114-45f3-8533-ed13d81383fc tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:29.024912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07898edc-5114-45f3-8533-ed13d81383fc tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:29.025605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07898edc-5114-45f3-8533-ed13d81383fc tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:29.027231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07898edc-5114-45f3-8533-ed13d81383fc tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:29.051512 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4028/8104] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:28 2022] POST /identity/v3/services => generated 274 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:29.051756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece11c36-1da0-43dd-a1ea-429d52dd1d97 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:29.064158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece11c36-1da0-43dd-a1ea-429d52dd1d97 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:29.085148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13cfc0-080f-4f7d-a8c8-0bcdf177e859 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a466d817b745deb53620fcd9179fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee20067373842b8b572d4c01c24819e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:29.085941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13cfc0-080f-4f7d-a8c8-0bcdf177e859 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:29.086297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13cfc0-080f-4f7d-a8c8-0bcdf177e859 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:29.086645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13cfc0-080f-4f7d-a8c8-0bcdf177e859 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:29.087803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13cfc0-080f-4f7d-a8c8-0bcdf177e859 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:29.089335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13cfc0-080f-4f7d-a8c8-0bcdf177e859 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:29.113589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07898edc-5114-45f3-8533-ed13d81383fc tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:29.115424 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4077/8105] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:29 2022] POST /identity/v3/services => generated 272 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:29.126335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07898edc-5114-45f3-8533-ed13d81383fc tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:29.145089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:29.150734 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8cf7a-c24d-467e-9ad8-ae978abb62ac tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a466d817b745deb53620fcd9179fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee20067373842b8b572d4c01c24819e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:29.151722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8cf7a-c24d-467e-9ad8-ae978abb62ac tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:29.152719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8cf7a-c24d-467e-9ad8-ae978abb62ac tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:29.153148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8cf7a-c24d-467e-9ad8-ae978abb62ac tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:29.154526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8cf7a-c24d-467e-9ad8-ae978abb62ac tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:29.159340 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-9ca8cf7a-c24d-467e-9ad8-ae978abb62ac tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:34:29.159340 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:34:29.159340 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:34:29.160723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8cf7a-c24d-467e-9ad8-ae978abb62ac tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:29.174504 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4029/8106] 10.222.0.17 () {58 vars in 1131 bytes} [Sat Jul 30 21:34:29 2022] GET /identity/v3/services => generated 2975 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:34:29.178889 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13cfc0-080f-4f7d-a8c8-0bcdf177e859 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:29.200077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13cfc0-080f-4f7d-a8c8-0bcdf177e859 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:29.206441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda5e3b-7ebd-405d-bdd2-1eb2b574148b tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a466d817b745deb53620fcd9179fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee20067373842b8b572d4c01c24819e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:29.207175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda5e3b-7ebd-405d-bdd2-1eb2b574148b tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:29.207581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda5e3b-7ebd-405d-bdd2-1eb2b574148b tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:29.207914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda5e3b-7ebd-405d-bdd2-1eb2b574148b tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:29.209239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda5e3b-7ebd-405d-bdd2-1eb2b574148b tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-565945938) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:34:29.209239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda5e3b-7ebd-405d-bdd2-1eb2b574148b tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:29.210348 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-dbda5e3b-7ebd-405d-bdd2-1eb2b574148b tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:34:29.210348 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:34:29.210348 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:34:29.211049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda5e3b-7ebd-405d-bdd2-1eb2b574148b tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:29.217457 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4078/8107] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 30 21:34:29 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-565945938 => generated 416 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:29.222158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8cf7a-c24d-467e-9ad8-ae978abb62ac tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:29.235369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8cf7a-c24d-467e-9ad8-ae978abb62ac tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:29.240653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f074a2-adec-4b7f-929e-9ea56a1551ea tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a466d817b745deb53620fcd9179fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee20067373842b8b572d4c01c24819e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:29.241320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f074a2-adec-4b7f-929e-9ea56a1551ea tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:29.241607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f074a2-adec-4b7f-929e-9ea56a1551ea tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:29.241888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f074a2-adec-4b7f-929e-9ea56a1551ea tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:29.242818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f074a2-adec-4b7f-929e-9ea56a1551ea tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-684276466) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:34:29.242974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f074a2-adec-4b7f-929e-9ea56a1551ea tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:29.244619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f074a2-adec-4b7f-929e-9ea56a1551ea tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:29.251552 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4030/8108] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 30 21:34:29 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-684276466 => generated 416 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:29.255991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda5e3b-7ebd-405d-bdd2-1eb2b574148b tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:29.267721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda5e3b-7ebd-405d-bdd2-1eb2b574148b tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:29.272612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ee556-4215-42a7-968d-e07b5f5aed94 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a466d817b745deb53620fcd9179fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee20067373842b8b572d4c01c24819e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:29.273253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ee556-4215-42a7-968d-e07b5f5aed94 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:29.273544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ee556-4215-42a7-968d-e07b5f5aed94 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:29.273828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ee556-4215-42a7-968d-e07b5f5aed94 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] PATH_INFO: `/v3/services` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:29.274561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ee556-4215-42a7-968d-e07b5f5aed94 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-53880313) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:34:29.274880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ee556-4215-42a7-968d-e07b5f5aed94 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:29.276561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ee556-4215-42a7-968d-e07b5f5aed94 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:29.282782 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4079/8109] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Jul 30 21:34:29 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-53880313 => generated 413 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:29.288375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f074a2-adec-4b7f-929e-9ea56a1551ea tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:29.299078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f074a2-adec-4b7f-929e-9ea56a1551ea tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:29.304043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45945e9f-9fb0-4705-ab3d-63cb536d5fee tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a466d817b745deb53620fcd9179fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee20067373842b8b572d4c01c24819e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:29.304720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45945e9f-9fb0-4705-ab3d-63cb536d5fee tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:29.305012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45945e9f-9fb0-4705-ab3d-63cb536d5fee tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:29.305298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45945e9f-9fb0-4705-ab3d-63cb536d5fee tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] PATH_INFO: `/v3/services/cb814b9199194dd78fd05520fecfbc8c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:29.305927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45945e9f-9fb0-4705-ab3d-63cb536d5fee tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorizing `identity:delete_service(service_id=cb814b9199194dd78fd05520fecfbc8c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:29.307561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45945e9f-9fb0-4705-ab3d-63cb536d5fee tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:29.330950 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4031/8110] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:29 2022] DELETE /identity/v3/services/cb814b9199194dd78fd05520fecfbc8c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:29.335055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ee556-4215-42a7-968d-e07b5f5aed94 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:29.347470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ee556-4215-42a7-968d-e07b5f5aed94 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:29.365545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1068e7f-209c-4c0d-af73-6df49b4c6a11 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a466d817b745deb53620fcd9179fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee20067373842b8b572d4c01c24819e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:29.366199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1068e7f-209c-4c0d-af73-6df49b4c6a11 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:29.366485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1068e7f-209c-4c0d-af73-6df49b4c6a11 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:29.366816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1068e7f-209c-4c0d-af73-6df49b4c6a11 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] PATH_INFO: `/v3/services/810f82fe6273470287a002fe41f8ae3b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:29.367480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1068e7f-209c-4c0d-af73-6df49b4c6a11 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorizing `identity:delete_service(service_id=810f82fe6273470287a002fe41f8ae3b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:29.369112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1068e7f-209c-4c0d-af73-6df49b4c6a11 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:29.392408 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4080/8111] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:29 2022] DELETE /identity/v3/services/810f82fe6273470287a002fe41f8ae3b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:29.396550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45945e9f-9fb0-4705-ab3d-63cb536d5fee tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:29.410441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45945e9f-9fb0-4705-ab3d-63cb536d5fee tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:29.426089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a379e-f5ab-4860-b090-6864bbfab1c1 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a466d817b745deb53620fcd9179fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee20067373842b8b572d4c01c24819e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:29.426827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a379e-f5ab-4860-b090-6864bbfab1c1 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:29.427119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a379e-f5ab-4860-b090-6864bbfab1c1 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:29.427463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a379e-f5ab-4860-b090-6864bbfab1c1 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] PATH_INFO: `/v3/services/55ea137f7f15418396d03c338aebb387` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:29.428217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a379e-f5ab-4860-b090-6864bbfab1c1 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorizing `identity:delete_service(service_id=55ea137f7f15418396d03c338aebb387)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:29.429883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a379e-f5ab-4860-b090-6864bbfab1c1 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:29.452348 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4032/8112] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:29 2022] DELETE /identity/v3/services/55ea137f7f15418396d03c338aebb387 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:34:29.458193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1068e7f-209c-4c0d-af73-6df49b4c6a11 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:29.478623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:29.537654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1068e7f-209c-4c0d-af73-6df49b4c6a11 tempest-ServicesTestJSON-2092796688 tempest-ServicesTestJSON-2092796688-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:29.551993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939a3f4-4db2-4ec5-9117-419b8a23453f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:29.552635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939a3f4-4db2-4ec5-9117-419b8a23453f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:29.552919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939a3f4-4db2-4ec5-9117-419b8a23453f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:29.553247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939a3f4-4db2-4ec5-9117-419b8a23453f admin admin] PATH_INFO: `/v3/users/44cd3430909e4938bb65bef623faa214` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:29.554363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939a3f4-4db2-4ec5-9117-419b8a23453f admin admin] RBAC: Authorizing `identity:delete_user(user_id=44cd3430909e4938bb65bef623faa214)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:29.556336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939a3f4-4db2-4ec5-9117-419b8a23453f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:29.604522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a939a3f4-4db2-4ec5-9117-419b8a23453f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44cd3430909e4938bb65bef623faa214'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:29.616670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a939a3f4-4db2-4ec5-9117-419b8a23453f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44cd3430909e4938bb65bef623faa214'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:29.617378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a939a3f4-4db2-4ec5-9117-419b8a23453f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44cd3430909e4938bb65bef623faa214'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:29.625383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a939a3f4-4db2-4ec5-9117-419b8a23453f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44cd3430909e4938bb65bef623faa214'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:29.626079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a939a3f4-4db2-4ec5-9117-419b8a23453f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44cd3430909e4938bb65bef623faa214'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:29.641585 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4081/8113] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:29 2022] DELETE /identity/v3/users/44cd3430909e4938bb65bef623faa214 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:29.646233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6d2f5-1fa3-46ff-b396-d5fdf0afbad6 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:29.646527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6d2f5-1fa3-46ff-b396-d5fdf0afbad6 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:29.646810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6d2f5-1fa3-46ff-b396-d5fdf0afbad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:29.666291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-19b6d2f5-1fa3-46ff-b396-d5fdf0afbad6 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:29.667470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-19b6d2f5-1fa3-46ff-b396-d5fdf0afbad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:29.729118 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4033/8114] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:29.738945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939a3f4-4db2-4ec5-9117-419b8a23453f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:29.740435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a939a3f4-4db2-4ec5-9117-419b8a23453f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:29.810488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939a3f4-4db2-4ec5-9117-419b8a23453f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:29.815066 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317f0b8-c69a-46a1-b477-107102b66191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:29.815870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317f0b8-c69a-46a1-b477-107102b66191 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:29.816156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317f0b8-c69a-46a1-b477-107102b66191 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:29.816434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317f0b8-c69a-46a1-b477-107102b66191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:29.826089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317f0b8-c69a-46a1-b477-107102b66191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:29.827558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317f0b8-c69a-46a1-b477-107102b66191 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:29.838387 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4082/8115] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:34:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:34:30.143202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6d2f5-1fa3-46ff-b396-d5fdf0afbad6 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:30.144816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-19b6d2f5-1fa3-46ff-b396-d5fdf0afbad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:30.164865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6d2f5-1fa3-46ff-b396-d5fdf0afbad6 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:30.183623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6495734-3d55-412a-aa44-c457f64e6f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:30.184662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6495734-3d55-412a-aa44-c457f64e6f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:30.185135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6495734-3d55-412a-aa44-c457f64e6f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:30.185578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6495734-3d55-412a-aa44-c457f64e6f3b admin admin] PATH_INFO: `/v3/projects/f8316b62ea474e0d8b95db6e721d8def` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:30.186986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6495734-3d55-412a-aa44-c457f64e6f3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8316b62ea474e0d8b95db6e721d8def)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:30.189771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6495734-3d55-412a-aa44-c457f64e6f3b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:30.261932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d6495734-3d55-412a-aa44-c457f64e6f3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8316b62ea474e0d8b95db6e721d8def', 'request_id': 'req-d6495734-3d55-412a-aa44-c457f64e6f3b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:30.284182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d6495734-3d55-412a-aa44-c457f64e6f3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8316b62ea474e0d8b95db6e721d8def', 'request_id': 'req-d6495734-3d55-412a-aa44-c457f64e6f3b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:30.292918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d6495734-3d55-412a-aa44-c457f64e6f3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8316b62ea474e0d8b95db6e721d8def', 'request_id': 'req-d6495734-3d55-412a-aa44-c457f64e6f3b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:30.309964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d6495734-3d55-412a-aa44-c457f64e6f3b admin admin] The token cache is being invalidate because project f8316b62ea474e0d8b95db6e721d8def was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:30.310296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d6495734-3d55-412a-aa44-c457f64e6f3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:30.310939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d6495734-3d55-412a-aa44-c457f64e6f3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:30.313277 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4034/8116] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:30 2022] DELETE /identity/v3/projects/f8316b62ea474e0d8b95db6e721d8def => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:30.317478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317f0b8-c69a-46a1-b477-107102b66191 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:30.327812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317f0b8-c69a-46a1-b477-107102b66191 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:30.336835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:30.416178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7c6e4-b74a-403c-93b5-23ae568d6b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:30.416923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7c6e4-b74a-403c-93b5-23ae568d6b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:30.417391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7c6e4-b74a-403c-93b5-23ae568d6b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:30.417750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7c6e4-b74a-403c-93b5-23ae568d6b23 admin admin] PATH_INFO: `/v3/users/e4a466d817b745deb53620fcd9179fc8` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:30.418966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7c6e4-b74a-403c-93b5-23ae568d6b23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4a466d817b745deb53620fcd9179fc8)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:30.420981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7c6e4-b74a-403c-93b5-23ae568d6b23 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:30.474809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5cd7c6e4-b74a-403c-93b5-23ae568d6b23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4a466d817b745deb53620fcd9179fc8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:30.494303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5cd7c6e4-b74a-403c-93b5-23ae568d6b23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4a466d817b745deb53620fcd9179fc8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:30.495126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5cd7c6e4-b74a-403c-93b5-23ae568d6b23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4a466d817b745deb53620fcd9179fc8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:30.505455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5cd7c6e4-b74a-403c-93b5-23ae568d6b23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4a466d817b745deb53620fcd9179fc8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:30.506152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-5cd7c6e4-b74a-403c-93b5-23ae568d6b23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4a466d817b745deb53620fcd9179fc8'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:30.522520 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4083/8117] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:30 2022] DELETE /identity/v3/users/e4a466d817b745deb53620fcd9179fc8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:31.027733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6495734-3d55-412a-aa44-c457f64e6f3b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:31.036378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d6495734-3d55-412a-aa44-c457f64e6f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:31.057569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6495734-3d55-412a-aa44-c457f64e6f3b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:31.072946 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:31.132100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe537c13-e6e2-4928-89af-1974946c3684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:31.132863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe537c13-e6e2-4928-89af-1974946c3684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:31.133155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe537c13-e6e2-4928-89af-1974946c3684 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:31.133428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe537c13-e6e2-4928-89af-1974946c3684 admin admin] PATH_INFO: `/v3/projects/2ee20067373842b8b572d4c01c24819e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:31.134710 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe537c13-e6e2-4928-89af-1974946c3684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ee20067373842b8b572d4c01c24819e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:31.137382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe537c13-e6e2-4928-89af-1974946c3684 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:31.199402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe537c13-e6e2-4928-89af-1974946c3684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ee20067373842b8b572d4c01c24819e', 'request_id': 'req-fe537c13-e6e2-4928-89af-1974946c3684'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:31.208800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe537c13-e6e2-4928-89af-1974946c3684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ee20067373842b8b572d4c01c24819e', 'request_id': 'req-fe537c13-e6e2-4928-89af-1974946c3684'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:31.214944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe537c13-e6e2-4928-89af-1974946c3684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ee20067373842b8b572d4c01c24819e', 'request_id': 'req-fe537c13-e6e2-4928-89af-1974946c3684'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:31.227277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe537c13-e6e2-4928-89af-1974946c3684 admin admin] The token cache is being invalidate because project 2ee20067373842b8b572d4c01c24819e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:31.227677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe537c13-e6e2-4928-89af-1974946c3684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:31.228739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fe537c13-e6e2-4928-89af-1974946c3684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:31.230463 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4035/8118] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:31 2022] DELETE /identity/v3/projects/2ee20067373842b8b572d4c01c24819e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:31.237071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29c0ee-1a66-49be-8996-63b4b3c2e496 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:31.237553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29c0ee-1a66-49be-8996-63b4b3c2e496 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:31.237644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29c0ee-1a66-49be-8996-63b4b3c2e496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:31.265089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-be29c0ee-1a66-49be-8996-63b4b3c2e496 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:31.266903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-be29c0ee-1a66-49be-8996-63b4b3c2e496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:31.337243 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4084/8119] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:31.344783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945657b5-acb1-41e1-b4f1-262b68675789 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:31.345084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945657b5-acb1-41e1-b4f1-262b68675789 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:31.345438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945657b5-acb1-41e1-b4f1-262b68675789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:31.366639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-945657b5-acb1-41e1-b4f1-262b68675789 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:31.368002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-945657b5-acb1-41e1-b4f1-262b68675789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:31.378178 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4036/8120] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:31.381905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29c0ee-1a66-49be-8996-63b4b3c2e496 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:31.392289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29c0ee-1a66-49be-8996-63b4b3c2e496 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:31.397542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa6cd8-b474-4a34-aa03-8f3967fb1940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:31.398165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa6cd8-b474-4a34-aa03-8f3967fb1940 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:31.398458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa6cd8-b474-4a34-aa03-8f3967fb1940 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:31.398746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa6cd8-b474-4a34-aa03-8f3967fb1940 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:31.399504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa6cd8-b474-4a34-aa03-8f3967fb1940 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:34:31.399818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa6cd8-b474-4a34-aa03-8f3967fb1940 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:31.401430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa6cd8-b474-4a34-aa03-8f3967fb1940 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:31.418487 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4085/8121] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:31.420222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945657b5-acb1-41e1-b4f1-262b68675789 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:31.430553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945657b5-acb1-41e1-b4f1-262b68675789 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:31.435398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d673a7-a3d7-4d87-a4d0-3ad67e09ffba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:31.436041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d673a7-a3d7-4d87-a4d0-3ad67e09ffba admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:31.436354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d673a7-a3d7-4d87-a4d0-3ad67e09ffba admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:31.436633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d673a7-a3d7-4d87-a4d0-3ad67e09ffba admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:31.437948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d673a7-a3d7-4d87-a4d0-3ad67e09ffba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:31.439909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d673a7-a3d7-4d87-a4d0-3ad67e09ffba admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:31.473440 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4037/8122] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:31 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:31.474211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa6cd8-b474-4a34-aa03-8f3967fb1940 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:31.485510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa6cd8-b474-4a34-aa03-8f3967fb1940 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:31.498197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:31.550468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fbcb3-768d-41bc-8b96-4e0b869fc247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:31.551082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fbcb3-768d-41bc-8b96-4e0b869fc247 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:31.551403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fbcb3-768d-41bc-8b96-4e0b869fc247 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:31.551679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fbcb3-768d-41bc-8b96-4e0b869fc247 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:31.552341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fbcb3-768d-41bc-8b96-4e0b869fc247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:31.554914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fbcb3-768d-41bc-8b96-4e0b869fc247 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:31.585117 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4086/8123] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:31 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:31.594608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d673a7-a3d7-4d87-a4d0-3ad67e09ffba admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:31.605574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d673a7-a3d7-4d87-a4d0-3ad67e09ffba admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:31.610955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea7693-b8a4-4bf6-8cc2-7a9e455bc951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:31.611672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea7693-b8a4-4bf6-8cc2-7a9e455bc951 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:31.611964 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea7693-b8a4-4bf6-8cc2-7a9e455bc951 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:31.612262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea7693-b8a4-4bf6-8cc2-7a9e455bc951 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:31.612958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea7693-b8a4-4bf6-8cc2-7a9e455bc951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:31.614570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea7693-b8a4-4bf6-8cc2-7a9e455bc951 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:31.625580 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4038/8124] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:31.629730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fbcb3-768d-41bc-8b96-4e0b869fc247 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:31.640155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fbcb3-768d-41bc-8b96-4e0b869fc247 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:31.644944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f8b73-3240-4b71-b503-d6306fda27de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:31.645561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8b73-3240-4b71-b503-d6306fda27de admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:31.645853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8b73-3240-4b71-b503-d6306fda27de admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:31.646137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8b73-3240-4b71-b503-d6306fda27de admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:31.646872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f8b73-3240-4b71-b503-d6306fda27de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:31.648521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f8b73-3240-4b71-b503-d6306fda27de admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:31.660597 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4087/8125] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:31.664813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea7693-b8a4-4bf6-8cc2-7a9e455bc951 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:31.675676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea7693-b8a4-4bf6-8cc2-7a9e455bc951 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:31.680507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb1e73-f01a-4916-be7f-7dc897bd1a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:31.681173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb1e73-f01a-4916-be7f-7dc897bd1a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:31.681457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb1e73-f01a-4916-be7f-7dc897bd1a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:31.681738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb1e73-f01a-4916-be7f-7dc897bd1a09 admin admin] PATH_INFO: `/v3/projects/25958b9b39cb4bf2a21e038c8f17159d/users/a4625b508ef3457a854cde3cb78c680f/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:31.696893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb1e73-f01a-4916-be7f-7dc897bd1a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25958b9b39cb4bf2a21e038c8f17159d, user_id=a4625b508ef3457a854cde3cb78c680f, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:31.699564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb1e73-f01a-4916-be7f-7dc897bd1a09 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:31.712106 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4039/8126] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:31 2022] PUT /identity/v3/projects/25958b9b39cb4bf2a21e038c8f17159d/users/a4625b508ef3457a854cde3cb78c680f/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:31.722427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5774c28-64b4-44d6-aaa4-e2f0d5fdb991 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:31.722719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5774c28-64b4-44d6-aaa4-e2f0d5fdb991 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:31.723011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5774c28-64b4-44d6-aaa4-e2f0d5fdb991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:31.751465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d5774c28-64b4-44d6-aaa4-e2f0d5fdb991 None None] MFA Rules not processed for user `a4625b508ef3457a854cde3cb78c680f`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:31.752775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d5774c28-64b4-44d6-aaa4-e2f0d5fdb991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:31.817010 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4088/8127] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:31.821463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb1e73-f01a-4916-be7f-7dc897bd1a09 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:31.866053 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:31.886879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb1e73-f01a-4916-be7f-7dc897bd1a09 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:31.891608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f374560-6bbb-47ca-816f-2a51b585113f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:31.892229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f374560-6bbb-47ca-816f-2a51b585113f admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:31.892527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f374560-6bbb-47ca-816f-2a51b585113f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:31.892799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f374560-6bbb-47ca-816f-2a51b585113f admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:31.893468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f374560-6bbb-47ca-816f-2a51b585113f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:31.895466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f374560-6bbb-47ca-816f-2a51b585113f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:31.923686 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4040/8128] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:31 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:31.927036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5774c28-64b4-44d6-aaa4-e2f0d5fdb991 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:31.938125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5774c28-64b4-44d6-aaa4-e2f0d5fdb991 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:31.995508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216e754-0531-4539-985e-512094667b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:31.996147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216e754-0531-4539-985e-512094667b3f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:31.996462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216e754-0531-4539-985e-512094667b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:31.996726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216e754-0531-4539-985e-512094667b3f admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:31.997425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216e754-0531-4539-985e-512094667b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:31.999385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216e754-0531-4539-985e-512094667b3f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:32.021604 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4089/8129] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:31 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:32.025556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f374560-6bbb-47ca-816f-2a51b585113f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:32.036463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f374560-6bbb-47ca-816f-2a51b585113f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:32.041198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f37294-b5ca-4ad6-bb88-ea029e7f3ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:32.041804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f37294-b5ca-4ad6-bb88-ea029e7f3ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:32.042101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f37294-b5ca-4ad6-bb88-ea029e7f3ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:32.042372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f37294-b5ca-4ad6-bb88-ea029e7f3ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:32.043113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f37294-b5ca-4ad6-bb88-ea029e7f3ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:32.044760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f37294-b5ca-4ad6-bb88-ea029e7f3ca1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:32.056497 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4041/8130] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:32.060895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216e754-0531-4539-985e-512094667b3f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:32.071086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216e754-0531-4539-985e-512094667b3f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:32.075785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65b396-5247-4d4b-b568-673b002091bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:32.076441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65b396-5247-4d4b-b568-673b002091bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:32.076726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65b396-5247-4d4b-b568-673b002091bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:32.077004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65b396-5247-4d4b-b568-673b002091bc admin admin] PATH_INFO: `/v3/projects/ad2c658479b049b894da8ea7c97f2fe0/users/445cf27af92d4059af1caee000db2032/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:32.088863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:32.092203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65b396-5247-4d4b-b568-673b002091bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2c658479b049b894da8ea7c97f2fe0, user_id=445cf27af92d4059af1caee000db2032, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:32.095805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65b396-5247-4d4b-b568-673b002091bc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:32.110784 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4090/8131] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:32 2022] PUT /identity/v3/projects/ad2c658479b049b894da8ea7c97f2fe0/users/445cf27af92d4059af1caee000db2032/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:32.114715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f37294-b5ca-4ad6-bb88-ea029e7f3ca1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:32.125279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f37294-b5ca-4ad6-bb88-ea029e7f3ca1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:32.181818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb4c21-83a0-4234-b8f8-a76fdd57b3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:32.182447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb4c21-83a0-4234-b8f8-a76fdd57b3cc admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:32.182714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb4c21-83a0-4234-b8f8-a76fdd57b3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:32.182990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb4c21-83a0-4234-b8f8-a76fdd57b3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:32.183718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb4c21-83a0-4234-b8f8-a76fdd57b3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:32.185300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb4c21-83a0-4234-b8f8-a76fdd57b3cc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:32.199580 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4042/8132] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:32.201103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65b396-5247-4d4b-b568-673b002091bc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:32.212478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65b396-5247-4d4b-b568-673b002091bc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:32.217192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f9ab5-406a-43d2-8e88-5785ab7a1bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:32.217857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f9ab5-406a-43d2-8e88-5785ab7a1bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:32.218149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f9ab5-406a-43d2-8e88-5785ab7a1bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:32.219061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f9ab5-406a-43d2-8e88-5785ab7a1bc4 admin admin] PATH_INFO: `/v3/projects/ad2c658479b049b894da8ea7c97f2fe0/users/445cf27af92d4059af1caee000db2032/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:32.221107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f9ab5-406a-43d2-8e88-5785ab7a1bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2c658479b049b894da8ea7c97f2fe0, user_id=445cf27af92d4059af1caee000db2032, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:32.223854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f9ab5-406a-43d2-8e88-5785ab7a1bc4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:32.235188 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4091/8133] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:32 2022] PUT /identity/v3/projects/ad2c658479b049b894da8ea7c97f2fe0/users/445cf27af92d4059af1caee000db2032/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:32.246564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63f3fe-9832-4a52-baf7-130a6c48c6ce None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:32.246857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63f3fe-9832-4a52-baf7-130a6c48c6ce None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:32.247136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63f3fe-9832-4a52-baf7-130a6c48c6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:32.276178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1c63f3fe-9832-4a52-baf7-130a6c48c6ce None None] MFA Rules not processed for user `445cf27af92d4059af1caee000db2032`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:32.277386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1c63f3fe-9832-4a52-baf7-130a6c48c6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:32.345944 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4043/8134] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:32.350693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f9ab5-406a-43d2-8e88-5785ab7a1bc4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:32.361731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f9ab5-406a-43d2-8e88-5785ab7a1bc4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:32.366429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5460ce1-a6c7-4c98-b6ab-1c365359aa93 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:32.367040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5460ce1-a6c7-4c98-b6ab-1c365359aa93 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:32.367359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5460ce1-a6c7-4c98-b6ab-1c365359aa93 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:32.367649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5460ce1-a6c7-4c98-b6ab-1c365359aa93 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:32.368305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5460ce1-a6c7-4c98-b6ab-1c365359aa93 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:32.371259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5460ce1-a6c7-4c98-b6ab-1c365359aa93 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:32.398891 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4092/8135] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 30 21:34:32 2022] POST /identity/v3/projects => generated 329 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:32.403017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63f3fe-9832-4a52-baf7-130a6c48c6ce None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:32.413314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63f3fe-9832-4a52-baf7-130a6c48c6ce None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:32.448094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:32.475042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209bbae-9eb7-41fc-9f33-1658729f43d8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:32.475698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209bbae-9eb7-41fc-9f33-1658729f43d8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:32.475992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209bbae-9eb7-41fc-9f33-1658729f43d8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:32.476275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209bbae-9eb7-41fc-9f33-1658729f43d8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:32.476957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209bbae-9eb7-41fc-9f33-1658729f43d8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:32.478882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209bbae-9eb7-41fc-9f33-1658729f43d8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:32.499230 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4044/8136] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:32 2022] POST /identity/v3/users => generated 413 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:32.504117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5460ce1-a6c7-4c98-b6ab-1c365359aa93 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:32.514500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5460ce1-a6c7-4c98-b6ab-1c365359aa93 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:32.519810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d335a-20fe-44c4-86da-7a339f60a443 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:32.520421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d335a-20fe-44c4-86da-7a339f60a443 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:32.520713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d335a-20fe-44c4-86da-7a339f60a443 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:32.520995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d335a-20fe-44c4-86da-7a339f60a443 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:32.521697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d335a-20fe-44c4-86da-7a339f60a443 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:32.523312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d335a-20fe-44c4-86da-7a339f60a443 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:32.538134 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4093/8137] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:34:32 2022] POST /identity/v3/roles => generated 244 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:32.542037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209bbae-9eb7-41fc-9f33-1658729f43d8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:32.554574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209bbae-9eb7-41fc-9f33-1658729f43d8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:32.559935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e4d8c-5394-49b8-98ad-381780eb5d59 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:32.560548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e4d8c-5394-49b8-98ad-381780eb5d59 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:32.560831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e4d8c-5394-49b8-98ad-381780eb5d59 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:32.561122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e4d8c-5394-49b8-98ad-381780eb5d59 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:32.561831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e4d8c-5394-49b8-98ad-381780eb5d59 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:32.564015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e4d8c-5394-49b8-98ad-381780eb5d59 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:32.579244 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4045/8138] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:34:32 2022] POST /identity/v3/roles => generated 245 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:32.583310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d335a-20fe-44c4-86da-7a339f60a443 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:32.593369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d335a-20fe-44c4-86da-7a339f60a443 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:32.598185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742d3df-106f-4990-9207-af17b0473bff tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:32.598789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742d3df-106f-4990-9207-af17b0473bff tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:32.599076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742d3df-106f-4990-9207-af17b0473bff tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:32.599397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742d3df-106f-4990-9207-af17b0473bff tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects/b3fe445937564596b1845fa4b4dead8d/users/c06276d6e7f3422484b1b9a274e3ae28/roles/257a8f74aa0244d4b419e6ed74dfec1a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:32.614459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742d3df-106f-4990-9207-af17b0473bff tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b3fe445937564596b1845fa4b4dead8d, user_id=c06276d6e7f3422484b1b9a274e3ae28, role_id=257a8f74aa0244d4b419e6ed74dfec1a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:32.617271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742d3df-106f-4990-9207-af17b0473bff tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:32.631631 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4094/8139] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:32 2022] PUT /identity/v3/projects/b3fe445937564596b1845fa4b4dead8d/users/c06276d6e7f3422484b1b9a274e3ae28/roles/257a8f74aa0244d4b419e6ed74dfec1a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:32.635729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e4d8c-5394-49b8-98ad-381780eb5d59 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:32.646383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e4d8c-5394-49b8-98ad-381780eb5d59 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:32.702033 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e2281-f947-4977-8fd5-c37e6099a6ee tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:32.702698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e2281-f947-4977-8fd5-c37e6099a6ee tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:32.703615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e2281-f947-4977-8fd5-c37e6099a6ee tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:32.703896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e2281-f947-4977-8fd5-c37e6099a6ee tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects/b3fe445937564596b1845fa4b4dead8d/users/c06276d6e7f3422484b1b9a274e3ae28/roles/6917ad2f1faf45be82f4e55d1922903b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:32.706134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e2281-f947-4977-8fd5-c37e6099a6ee tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b3fe445937564596b1845fa4b4dead8d, user_id=c06276d6e7f3422484b1b9a274e3ae28, role_id=6917ad2f1faf45be82f4e55d1922903b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:32.708800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e2281-f947-4977-8fd5-c37e6099a6ee tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:32.721616 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4046/8140] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:32 2022] PUT /identity/v3/projects/b3fe445937564596b1845fa4b4dead8d/users/c06276d6e7f3422484b1b9a274e3ae28/roles/6917ad2f1faf45be82f4e55d1922903b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:32.725673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742d3df-106f-4990-9207-af17b0473bff tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:32.736468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742d3df-106f-4990-9207-af17b0473bff tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:32.792573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86bef2-649d-4714-86de-6fc69e466eb9 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:32.793193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86bef2-649d-4714-86de-6fc69e466eb9 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:32.793480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86bef2-649d-4714-86de-6fc69e466eb9 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:32.793769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86bef2-649d-4714-86de-6fc69e466eb9 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:32.794470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86bef2-649d-4714-86de-6fc69e466eb9 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:32.796348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86bef2-649d-4714-86de-6fc69e466eb9 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:32.822914 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4095/8141] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:32 2022] GET /identity/v3/users => generated 7504 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:32.827646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040c48d-178b-4470-8986-3689a4bb4f61 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:32.828481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040c48d-178b-4470-8986-3689a4bb4f61 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:32.828761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040c48d-178b-4470-8986-3689a4bb4f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:32.865437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0040c48d-178b-4470-8986-3689a4bb4f61 None None] MFA Rules not processed for user `c06276d6e7f3422484b1b9a274e3ae28`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:32.866569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0040c48d-178b-4470-8986-3689a4bb4f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:32.929622 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4047/8142] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:32.940306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e07028-40a6-4720-80be-769225b797cb None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:32.940603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e07028-40a6-4720-80be-769225b797cb None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:32.940891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e07028-40a6-4720-80be-769225b797cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:32.960079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-49e07028-40a6-4720-80be-769225b797cb None None] MFA Rules not processed for user `c06276d6e7f3422484b1b9a274e3ae28`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:32.961295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-49e07028-40a6-4720-80be-769225b797cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:32.968542 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4096/8143] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:32.972627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040c48d-178b-4470-8986-3689a4bb4f61 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:32.981806 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040c48d-178b-4470-8986-3689a4bb4f61 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:32.986449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272705a3-933c-4744-aa8f-39c14a80308e tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06276d6e7f3422484b1b9a274e3ae28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3fe445937564596b1845fa4b4dead8d', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-93591457', 'tempest-DelegatedRole-1648594737'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:32.987057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272705a3-933c-4744-aa8f-39c14a80308e tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:32.987381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272705a3-933c-4744-aa8f-39c14a80308e tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:32.987662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272705a3-933c-4744-aa8f-39c14a80308e tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:32.989387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272705a3-933c-4744-aa8f-39c14a80308e tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] RBAC: Authorizing `identity:create_trust()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:32.990560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272705a3-933c-4744-aa8f-39c14a80308e tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:33.024209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:33.078250 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4048/8144] 10.222.0.17 () {60 vars in 1174 bytes} [Sat Jul 30 21:34:32 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:33.079430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e07028-40a6-4720-80be-769225b797cb None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:33.091020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e07028-40a6-4720-80be-769225b797cb None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:33.095811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112489d8-5d9a-4d5c-a136-ed0ea66f80a2 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:33.096434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112489d8-5d9a-4d5c-a136-ed0ea66f80a2 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:33.098680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112489d8-5d9a-4d5c-a136-ed0ea66f80a2 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:33.098680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112489d8-5d9a-4d5c-a136-ed0ea66f80a2 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:33.098680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112489d8-5d9a-4d5c-a136-ed0ea66f80a2 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:33.098680 ncdv-master-1 devstack@keystone.service[91085]: WARNING py.warnings [None req-112489d8-5d9a-4d5c-a136-ed0ea66f80a2 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:34:33.098680 ncdv-master-1 devstack@keystone.service[91085]: warnings.warn(msg) Jul 30 21:34:33.098680 ncdv-master-1 devstack@keystone.service[91085]: Jul 30 21:34:33.099645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112489d8-5d9a-4d5c-a136-ed0ea66f80a2 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:33.107578 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4097/8145] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Jul 30 21:34:33 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:33.112538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272705a3-933c-4744-aa8f-39c14a80308e tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:33.122845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272705a3-933c-4744-aa8f-39c14a80308e tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:33.127624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97346538-3e95-4626-b251-6d8e45677e2a tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06276d6e7f3422484b1b9a274e3ae28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3fe445937564596b1845fa4b4dead8d', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-93591457', 'tempest-DelegatedRole-1648594737'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:33.128260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97346538-3e95-4626-b251-6d8e45677e2a tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:33.128549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97346538-3e95-4626-b251-6d8e45677e2a tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:33.128829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97346538-3e95-4626-b251-6d8e45677e2a tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] PATH_INFO: `/v3/OS-TRUST/trusts/7b6fd7048bb74f448dea8bf239cac1c1` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:33.137359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97346538-3e95-4626-b251-6d8e45677e2a tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] RBAC: Authorizing `identity:delete_trust(trust_id=7b6fd7048bb74f448dea8bf239cac1c1)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:33.138825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97346538-3e95-4626-b251-6d8e45677e2a tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:33.159978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-97346538-3e95-4626-b251-6d8e45677e2a tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7b6fd7048bb74f448dea8bf239cac1c1', 'request_id': 'req-97346538-3e95-4626-b251-6d8e45677e2a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:33.160904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-97346538-3e95-4626-b251-6d8e45677e2a tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '7b6fd7048bb74f448dea8bf239cac1c1', 'request_id': 'req-97346538-3e95-4626-b251-6d8e45677e2a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:33.168820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-97346538-3e95-4626-b251-6d8e45677e2a tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7b6fd7048bb74f448dea8bf239cac1c1', 'request_id': 'req-97346538-3e95-4626-b251-6d8e45677e2a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:33.176064 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4049/8146] 10.222.0.17 () {58 vars in 1254 bytes} [Sat Jul 30 21:34:33 2022] DELETE /identity/v3/OS-TRUST/trusts/7b6fd7048bb74f448dea8bf239cac1c1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:33.180020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112489d8-5d9a-4d5c-a136-ed0ea66f80a2 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:33.181787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-112489d8-5d9a-4d5c-a136-ed0ea66f80a2 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:33.195816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112489d8-5d9a-4d5c-a136-ed0ea66f80a2 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:33.199962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628430b5-263f-43bb-a29e-2e752857d545 tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06276d6e7f3422484b1b9a274e3ae28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3fe445937564596b1845fa4b4dead8d', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-93591457', 'tempest-DelegatedRole-1648594737'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:33.200600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628430b5-263f-43bb-a29e-2e752857d545 tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:33.200888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628430b5-263f-43bb-a29e-2e752857d545 tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:33.201213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628430b5-263f-43bb-a29e-2e752857d545 tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] PATH_INFO: `/v3/OS-TRUST/trusts/7b6fd7048bb74f448dea8bf239cac1c1` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:33.237221 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-628430b5-263f-43bb-a29e-2e752857d545 tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] Could not find trust: 7b6fd7048bb74f448dea8bf239cac1c1.: keystone.exception.TrustNotFound: Could not find trust: 7b6fd7048bb74f448dea8bf239cac1c1. Jul 30 21:34:33.237221 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:33.237221 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:34:33.237221 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:34:33.237221 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:34:33.237221 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:34:33.237221 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:34:33.237221 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:34:33.237221 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:34:33.237221 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:34:33.237221 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:34:33.237221 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:34:33.237221 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 30 21:34:33.237221 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 30 21:34:33.237221 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 30 21:34:33.238555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 30 21:34:33.238555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 30 21:34:33.238555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 30 21:34:33.238555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 30 21:34:33.238555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 30 21:34:33.238555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:34:33.238555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:34:33.238555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 30 21:34:33.238555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 30 21:34:33.238555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 30 21:34:33.238555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 30 21:34:33.238555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 7b6fd7048bb74f448dea8bf239cac1c1. Jul 30 21:34:33.238555 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:34:33.238555 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4098/8147] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:34:33 2022] GET /identity/v3/OS-TRUST/trusts/7b6fd7048bb74f448dea8bf239cac1c1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:34:33.242659 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97346538-3e95-4626-b251-6d8e45677e2a tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:33.244120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-97346538-3e95-4626-b251-6d8e45677e2a tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:33.259279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97346538-3e95-4626-b251-6d8e45677e2a tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:33.264267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6854a88-d624-4503-b58a-42e0aaee3710 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:33.264899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6854a88-d624-4503-b58a-42e0aaee3710 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:33.265209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6854a88-d624-4503-b58a-42e0aaee3710 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:33.265491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6854a88-d624-4503-b58a-42e0aaee3710 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles/6917ad2f1faf45be82f4e55d1922903b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:33.266929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6854a88-d624-4503-b58a-42e0aaee3710 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6917ad2f1faf45be82f4e55d1922903b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:33.268558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6854a88-d624-4503-b58a-42e0aaee3710 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:33.310738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f6854a88-d624-4503-b58a-42e0aaee3710 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invalidating the token cache because role 6917ad2f1faf45be82f4e55d1922903b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:33.311065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f6854a88-d624-4503-b58a-42e0aaee3710 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:33.311773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-f6854a88-d624-4503-b58a-42e0aaee3710 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:33.313633 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4050/8148] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:33 2022] DELETE /identity/v3/roles/6917ad2f1faf45be82f4e55d1922903b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:33.321850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628430b5-263f-43bb-a29e-2e752857d545 tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:33.323635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-628430b5-263f-43bb-a29e-2e752857d545 tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:33.338300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628430b5-263f-43bb-a29e-2e752857d545 tempest-TrustsV3TestJSON-1714902050 tempest-user-668597587] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:33.387363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:33.398994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b36fde-d9e1-47a2-8fe6-942f934e085e tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:33.399699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b36fde-d9e1-47a2-8fe6-942f934e085e tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:33.399998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b36fde-d9e1-47a2-8fe6-942f934e085e tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:33.400285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b36fde-d9e1-47a2-8fe6-942f934e085e tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles/257a8f74aa0244d4b419e6ed74dfec1a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:33.401793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b36fde-d9e1-47a2-8fe6-942f934e085e tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_role(role_id=257a8f74aa0244d4b419e6ed74dfec1a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:33.403523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b36fde-d9e1-47a2-8fe6-942f934e085e tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:33.441040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-99b36fde-d9e1-47a2-8fe6-942f934e085e tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invalidating the token cache because role 257a8f74aa0244d4b419e6ed74dfec1a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:33.441337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-99b36fde-d9e1-47a2-8fe6-942f934e085e tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:33.442022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-99b36fde-d9e1-47a2-8fe6-942f934e085e tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:33.444014 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4099/8149] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:33 2022] DELETE /identity/v3/roles/257a8f74aa0244d4b419e6ed74dfec1a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:33.448393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6854a88-d624-4503-b58a-42e0aaee3710 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:33.463728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6854a88-d624-4503-b58a-42e0aaee3710 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:33.523478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ab448-7a6f-45d8-9116-fbc470907944 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:33.524128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ab448-7a6f-45d8-9116-fbc470907944 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:33.524419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ab448-7a6f-45d8-9116-fbc470907944 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:33.524702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ab448-7a6f-45d8-9116-fbc470907944 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/users/c06276d6e7f3422484b1b9a274e3ae28` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:33.525903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ab448-7a6f-45d8-9116-fbc470907944 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c06276d6e7f3422484b1b9a274e3ae28)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:33.527863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ab448-7a6f-45d8-9116-fbc470907944 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:33.567385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=9 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:33.574885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dd8ab448-7a6f-45d8-9116-fbc470907944 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c06276d6e7f3422484b1b9a274e3ae28'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:33.575713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dd8ab448-7a6f-45d8-9116-fbc470907944 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c06276d6e7f3422484b1b9a274e3ae28'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:33.589367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dd8ab448-7a6f-45d8-9116-fbc470907944 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c06276d6e7f3422484b1b9a274e3ae28'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:33.590045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dd8ab448-7a6f-45d8-9116-fbc470907944 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c06276d6e7f3422484b1b9a274e3ae28'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:33.597924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-dd8ab448-7a6f-45d8-9116-fbc470907944 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c06276d6e7f3422484b1b9a274e3ae28'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:33.612114 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4051/8150] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:33 2022] DELETE /identity/v3/users/c06276d6e7f3422484b1b9a274e3ae28 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:33.616336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b36fde-d9e1-47a2-8fe6-942f934e085e tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:33.617799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-99b36fde-d9e1-47a2-8fe6-942f934e085e tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:33.630986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b36fde-d9e1-47a2-8fe6-942f934e085e tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:33.688917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd687ab5-81e7-4f50-990b-03296da06e15 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:33.689486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd687ab5-81e7-4f50-990b-03296da06e15 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:33.689814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd687ab5-81e7-4f50-990b-03296da06e15 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:33.690053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd687ab5-81e7-4f50-990b-03296da06e15 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects/b3fe445937564596b1845fa4b4dead8d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:33.691241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd687ab5-81e7-4f50-990b-03296da06e15 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b3fe445937564596b1845fa4b4dead8d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:33.693301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd687ab5-81e7-4f50-990b-03296da06e15 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:33.745042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bd687ab5-81e7-4f50-990b-03296da06e15 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3fe445937564596b1845fa4b4dead8d', 'request_id': 'req-bd687ab5-81e7-4f50-990b-03296da06e15'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:33.752666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bd687ab5-81e7-4f50-990b-03296da06e15 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3fe445937564596b1845fa4b4dead8d', 'request_id': 'req-bd687ab5-81e7-4f50-990b-03296da06e15'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:33.762152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bd687ab5-81e7-4f50-990b-03296da06e15 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3fe445937564596b1845fa4b4dead8d', 'request_id': 'req-bd687ab5-81e7-4f50-990b-03296da06e15'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:33.775828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bd687ab5-81e7-4f50-990b-03296da06e15 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] The token cache is being invalidate because project b3fe445937564596b1845fa4b4dead8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:33.776190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bd687ab5-81e7-4f50-990b-03296da06e15 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:33.776858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bd687ab5-81e7-4f50-990b-03296da06e15 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:33.778407 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4100/8151] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:33 2022] DELETE /identity/v3/projects/b3fe445937564596b1845fa4b4dead8d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:33.785949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ab448-7a6f-45d8-9116-fbc470907944 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:33.787398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dd8ab448-7a6f-45d8-9116-fbc470907944 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:33.800325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ab448-7a6f-45d8-9116-fbc470907944 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:33.855725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b1566-b8ef-4a68-b488-f270bd06de36 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:33.856346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b1566-b8ef-4a68-b488-f270bd06de36 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:33.856639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b1566-b8ef-4a68-b488-f270bd06de36 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:33.856918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b1566-b8ef-4a68-b488-f270bd06de36 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:33.857580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b1566-b8ef-4a68-b488-f270bd06de36 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:33.859524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b1566-b8ef-4a68-b488-f270bd06de36 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:33.885335 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4052/8152] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 30 21:34:33 2022] POST /identity/v3/projects => generated 329 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:33.889466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd687ab5-81e7-4f50-990b-03296da06e15 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:33.891385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bd687ab5-81e7-4f50-990b-03296da06e15 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:33.904408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd687ab5-81e7-4f50-990b-03296da06e15 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:33.945980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:33.963507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c20bc-a946-4906-b759-077dae2f02fa tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:33.964260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c20bc-a946-4906-b759-077dae2f02fa tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:33.964557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c20bc-a946-4906-b759-077dae2f02fa tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:33.964842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c20bc-a946-4906-b759-077dae2f02fa tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:33.965603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c20bc-a946-4906-b759-077dae2f02fa tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:33.967681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c20bc-a946-4906-b759-077dae2f02fa tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:33.991786 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4101/8153] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:33 2022] POST /identity/v3/users => generated 416 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:33.993548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b1566-b8ef-4a68-b488-f270bd06de36 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:34.006831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b1566-b8ef-4a68-b488-f270bd06de36 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:34.012519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338fae7-92d6-4f70-afba-bfa974ab103a tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:34.013153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338fae7-92d6-4f70-afba-bfa974ab103a tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:34.013442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338fae7-92d6-4f70-afba-bfa974ab103a tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:34.013722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338fae7-92d6-4f70-afba-bfa974ab103a tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:34.014459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338fae7-92d6-4f70-afba-bfa974ab103a tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:34.016704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338fae7-92d6-4f70-afba-bfa974ab103a tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:34.032095 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4053/8154] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:34:33 2022] POST /identity/v3/roles => generated 243 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:34.036201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c20bc-a946-4906-b759-077dae2f02fa tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:34.046742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c20bc-a946-4906-b759-077dae2f02fa tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:34.051755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10911cab-6a3b-4c23-a1a5-5eb4b0e5003c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:34.052381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10911cab-6a3b-4c23-a1a5-5eb4b0e5003c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:34.052677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10911cab-6a3b-4c23-a1a5-5eb4b0e5003c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:34.052962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10911cab-6a3b-4c23-a1a5-5eb4b0e5003c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:34.053685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10911cab-6a3b-4c23-a1a5-5eb4b0e5003c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:34.055484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10911cab-6a3b-4c23-a1a5-5eb4b0e5003c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:34.072866 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4102/8155] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:34:34 2022] POST /identity/v3/roles => generated 246 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:34.077379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338fae7-92d6-4f70-afba-bfa974ab103a tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:34.089312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338fae7-92d6-4f70-afba-bfa974ab103a tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:34.094088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9d66d-9347-4e43-ab22-cdd97ef95d2c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:34.094759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9d66d-9347-4e43-ab22-cdd97ef95d2c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:34.095052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9d66d-9347-4e43-ab22-cdd97ef95d2c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:34.095363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9d66d-9347-4e43-ab22-cdd97ef95d2c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects/f74e80a76e0548aeb2a47de27908b286/users/f3dd567f39834a3385781938142c4c31/roles/ccd7839c837347039d7afed0c184e60a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:34.110855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9d66d-9347-4e43-ab22-cdd97ef95d2c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f74e80a76e0548aeb2a47de27908b286, user_id=f3dd567f39834a3385781938142c4c31, role_id=ccd7839c837347039d7afed0c184e60a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:34.113549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9d66d-9347-4e43-ab22-cdd97ef95d2c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:34.127211 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4054/8156] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:34 2022] PUT /identity/v3/projects/f74e80a76e0548aeb2a47de27908b286/users/f3dd567f39834a3385781938142c4c31/roles/ccd7839c837347039d7afed0c184e60a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:34.131697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10911cab-6a3b-4c23-a1a5-5eb4b0e5003c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:34.143422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10911cab-6a3b-4c23-a1a5-5eb4b0e5003c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:34.200646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c03bc-cde1-456a-bae9-ea6f172bf9a8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:34.201254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c03bc-cde1-456a-bae9-ea6f172bf9a8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:34.201546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c03bc-cde1-456a-bae9-ea6f172bf9a8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:34.201833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c03bc-cde1-456a-bae9-ea6f172bf9a8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects/f74e80a76e0548aeb2a47de27908b286/users/f3dd567f39834a3385781938142c4c31/roles/5a063d9118774fda9608ed4120054900` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:34.204864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c03bc-cde1-456a-bae9-ea6f172bf9a8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f74e80a76e0548aeb2a47de27908b286, user_id=f3dd567f39834a3385781938142c4c31, role_id=5a063d9118774fda9608ed4120054900)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:34.207548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c03bc-cde1-456a-bae9-ea6f172bf9a8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:34.220299 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4103/8157] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:34 2022] PUT /identity/v3/projects/f74e80a76e0548aeb2a47de27908b286/users/f3dd567f39834a3385781938142c4c31/roles/5a063d9118774fda9608ed4120054900 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:34.224365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9d66d-9347-4e43-ab22-cdd97ef95d2c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:34.235116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9d66d-9347-4e43-ab22-cdd97ef95d2c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:34.290935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cacfd-e2fc-45ef-b326-c3f5e9dee19b tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:34.291588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cacfd-e2fc-45ef-b326-c3f5e9dee19b tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:34.291875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cacfd-e2fc-45ef-b326-c3f5e9dee19b tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:34.292176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cacfd-e2fc-45ef-b326-c3f5e9dee19b tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:34.292876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cacfd-e2fc-45ef-b326-c3f5e9dee19b tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:34.294749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cacfd-e2fc-45ef-b326-c3f5e9dee19b tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:34.316031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:34.338728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e485333-450b-46eb-9320-7b86866ef0a7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:34.338975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e485333-450b-46eb-9320-7b86866ef0a7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:34.339557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e485333-450b-46eb-9320-7b86866ef0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:34.342229 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4055/8158] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:34 2022] GET /identity/v3/users => generated 7507 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:34.382980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2e485333-450b-46eb-9320-7b86866ef0a7 None None] MFA Rules not processed for user `f3dd567f39834a3385781938142c4c31`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:34.384233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2e485333-450b-46eb-9320-7b86866ef0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:34.448220 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4104/8159] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:34 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:34:34.458348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141da45-3619-4b23-a1b5-e1faff94a7f4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:34.458560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141da45-3619-4b23-a1b5-e1faff94a7f4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:34.458848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141da45-3619-4b23-a1b5-e1faff94a7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:34.477882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a141da45-3619-4b23-a1b5-e1faff94a7f4 None None] MFA Rules not processed for user `f3dd567f39834a3385781938142c4c31`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:34.479091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a141da45-3619-4b23-a1b5-e1faff94a7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:34.486896 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4056/8160] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:34 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:34.490930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e485333-450b-46eb-9320-7b86866ef0a7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:34.500982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e485333-450b-46eb-9320-7b86866ef0a7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:34.505337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678877fe-bbd8-4a46-9654-c5a497f9ac4e tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dd567f39834a3385781938142c4c31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f74e80a76e0548aeb2a47de27908b286', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-674594389', 'tempest-NotDelegatedRole-426590315'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:34.505957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678877fe-bbd8-4a46-9654-c5a497f9ac4e tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:34.506245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678877fe-bbd8-4a46-9654-c5a497f9ac4e tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:34.506558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678877fe-bbd8-4a46-9654-c5a497f9ac4e tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:34.507304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678877fe-bbd8-4a46-9654-c5a497f9ac4e tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] RBAC: Authorizing `identity:create_trust()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:34.508491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678877fe-bbd8-4a46-9654-c5a497f9ac4e tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:34.548134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:34.586083 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4105/8161] 10.222.0.17 () {60 vars in 1174 bytes} [Sat Jul 30 21:34:34 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:34.589606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141da45-3619-4b23-a1b5-e1faff94a7f4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:34.598580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141da45-3619-4b23-a1b5-e1faff94a7f4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:34.602855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624a15d-7c1d-4301-a313-b0beaf251061 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dd567f39834a3385781938142c4c31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f74e80a76e0548aeb2a47de27908b286', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-674594389', 'tempest-NotDelegatedRole-426590315'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:34.603499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624a15d-7c1d-4301-a313-b0beaf251061 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:34.603791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624a15d-7c1d-4301-a313-b0beaf251061 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:34.604072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624a15d-7c1d-4301-a313-b0beaf251061 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:34.604766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624a15d-7c1d-4301-a313-b0beaf251061 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:34.606122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624a15d-7c1d-4301-a313-b0beaf251061 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:34.612297 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4057/8162] 10.222.0.17 () {58 vars in 1252 bytes} [Sat Jul 30 21:34:34 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=f3dd567f39834a3385781938142c4c31 => generated 611 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:34.616108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678877fe-bbd8-4a46-9654-c5a497f9ac4e tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:34.626123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678877fe-bbd8-4a46-9654-c5a497f9ac4e tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:34.630358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d09ad-8990-43e1-a7d6-74cb895afa18 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dd567f39834a3385781938142c4c31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f74e80a76e0548aeb2a47de27908b286', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-674594389', 'tempest-NotDelegatedRole-426590315'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:34.630981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d09ad-8990-43e1-a7d6-74cb895afa18 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:34.631265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d09ad-8990-43e1-a7d6-74cb895afa18 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:34.631573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d09ad-8990-43e1-a7d6-74cb895afa18 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] PATH_INFO: `/v3/OS-TRUST/trusts/efd739cf34ea441d948a8845bc874a92` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:34.638933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d09ad-8990-43e1-a7d6-74cb895afa18 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] RBAC: Authorizing `identity:delete_trust(trust_id=efd739cf34ea441d948a8845bc874a92)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:34.640416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d09ad-8990-43e1-a7d6-74cb895afa18 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:34.660133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cc4d09ad-8990-43e1-a7d6-74cb895afa18 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'efd739cf34ea441d948a8845bc874a92', 'request_id': 'req-cc4d09ad-8990-43e1-a7d6-74cb895afa18'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:34.667460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cc4d09ad-8990-43e1-a7d6-74cb895afa18 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'efd739cf34ea441d948a8845bc874a92', 'request_id': 'req-cc4d09ad-8990-43e1-a7d6-74cb895afa18'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:34.668115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cc4d09ad-8990-43e1-a7d6-74cb895afa18 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'efd739cf34ea441d948a8845bc874a92', 'request_id': 'req-cc4d09ad-8990-43e1-a7d6-74cb895afa18'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:34.675050 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4106/8163] 10.222.0.17 () {58 vars in 1254 bytes} [Sat Jul 30 21:34:34 2022] DELETE /identity/v3/OS-TRUST/trusts/efd739cf34ea441d948a8845bc874a92 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:34.679240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624a15d-7c1d-4301-a313-b0beaf251061 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:34.680969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a624a15d-7c1d-4301-a313-b0beaf251061 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:34.693796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624a15d-7c1d-4301-a313-b0beaf251061 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:34.698197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21861d93-8220-4863-9eaf-3b47914c7439 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dd567f39834a3385781938142c4c31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f74e80a76e0548aeb2a47de27908b286', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-674594389', 'tempest-NotDelegatedRole-426590315'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:34.698845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21861d93-8220-4863-9eaf-3b47914c7439 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:34.699163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21861d93-8220-4863-9eaf-3b47914c7439 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:34.699493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21861d93-8220-4863-9eaf-3b47914c7439 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] PATH_INFO: `/v3/OS-TRUST/trusts/efd739cf34ea441d948a8845bc874a92` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:34.709070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-21861d93-8220-4863-9eaf-3b47914c7439 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] Could not find trust: efd739cf34ea441d948a8845bc874a92.: keystone.exception.TrustNotFound: Could not find trust: efd739cf34ea441d948a8845bc874a92. Jul 30 21:34:34.709070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:34.709070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:34:34.709070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:34:34.709070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:34:34.709070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:34:34.709070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:34:34.709070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:34:34.709070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:34:34.709070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:34:34.709070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:34:34.709070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:34:34.709070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 30 21:34:34.709070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 30 21:34:34.709070 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 30 21:34:34.710446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 30 21:34:34.710446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 30 21:34:34.710446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 30 21:34:34.710446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 30 21:34:34.710446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 30 21:34:34.710446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:34:34.710446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:34:34.710446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 30 21:34:34.710446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 30 21:34:34.710446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 30 21:34:34.710446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 30 21:34:34.710446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: efd739cf34ea441d948a8845bc874a92. Jul 30 21:34:34.710446 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:34:34.710446 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4058/8164] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:34:34 2022] GET /identity/v3/OS-TRUST/trusts/efd739cf34ea441d948a8845bc874a92 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 30 21:34:34.714131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d09ad-8990-43e1-a7d6-74cb895afa18 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:34.715645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cc4d09ad-8990-43e1-a7d6-74cb895afa18 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:34.730334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d09ad-8990-43e1-a7d6-74cb895afa18 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:34.735725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75bc60-2e41-4c05-ba11-c7f022d552dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:34.736372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75bc60-2e41-4c05-ba11-c7f022d552dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:34.736667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75bc60-2e41-4c05-ba11-c7f022d552dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:34.736950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75bc60-2e41-4c05-ba11-c7f022d552dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles/5a063d9118774fda9608ed4120054900` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:34.738439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75bc60-2e41-4c05-ba11-c7f022d552dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5a063d9118774fda9608ed4120054900)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:34.740118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75bc60-2e41-4c05-ba11-c7f022d552dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:34.783682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8a75bc60-2e41-4c05-ba11-c7f022d552dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invalidating the token cache because role 5a063d9118774fda9608ed4120054900 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:34.783979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8a75bc60-2e41-4c05-ba11-c7f022d552dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:34.784661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8a75bc60-2e41-4c05-ba11-c7f022d552dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:34.786504 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4107/8165] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:34 2022] DELETE /identity/v3/roles/5a063d9118774fda9608ed4120054900 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:34.790581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21861d93-8220-4863-9eaf-3b47914c7439 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:34.792367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-21861d93-8220-4863-9eaf-3b47914c7439 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:34.808059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21861d93-8220-4863-9eaf-3b47914c7439 tempest-TrustsV3TestJSON-1913435354 tempest-user-1452859179] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:34.866204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88749a42-ae00-4003-a4fc-0a313f85003f tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:34.866851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88749a42-ae00-4003-a4fc-0a313f85003f tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:34.867142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88749a42-ae00-4003-a4fc-0a313f85003f tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:34.867464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88749a42-ae00-4003-a4fc-0a313f85003f tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles/ccd7839c837347039d7afed0c184e60a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:34.868928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88749a42-ae00-4003-a4fc-0a313f85003f tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ccd7839c837347039d7afed0c184e60a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:34.870529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88749a42-ae00-4003-a4fc-0a313f85003f tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:34.906793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-88749a42-ae00-4003-a4fc-0a313f85003f tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invalidating the token cache because role ccd7839c837347039d7afed0c184e60a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:34.907084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-88749a42-ae00-4003-a4fc-0a313f85003f tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:34.907786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-88749a42-ae00-4003-a4fc-0a313f85003f tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:34.909590 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4059/8166] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:34 2022] DELETE /identity/v3/roles/ccd7839c837347039d7afed0c184e60a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:34.913877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75bc60-2e41-4c05-ba11-c7f022d552dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:34.925134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75bc60-2e41-4c05-ba11-c7f022d552dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:34.983368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6317c48-f30f-41e7-8eac-ae4cfe5087b0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:34.984537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6317c48-f30f-41e7-8eac-ae4cfe5087b0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:34.984830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6317c48-f30f-41e7-8eac-ae4cfe5087b0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:34.985109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6317c48-f30f-41e7-8eac-ae4cfe5087b0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/users/f3dd567f39834a3385781938142c4c31` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:34.986288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6317c48-f30f-41e7-8eac-ae4cfe5087b0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f3dd567f39834a3385781938142c4c31)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:34.988251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6317c48-f30f-41e7-8eac-ae4cfe5087b0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:35.035140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b6317c48-f30f-41e7-8eac-ae4cfe5087b0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3dd567f39834a3385781938142c4c31'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:35.036359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=11 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:35.051243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b6317c48-f30f-41e7-8eac-ae4cfe5087b0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3dd567f39834a3385781938142c4c31'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:35.051985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b6317c48-f30f-41e7-8eac-ae4cfe5087b0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3dd567f39834a3385781938142c4c31'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:35.059526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b6317c48-f30f-41e7-8eac-ae4cfe5087b0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3dd567f39834a3385781938142c4c31'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:35.060190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-b6317c48-f30f-41e7-8eac-ae4cfe5087b0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3dd567f39834a3385781938142c4c31'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:35.073006 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4108/8167] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:34 2022] DELETE /identity/v3/users/f3dd567f39834a3385781938142c4c31 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:35.077210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88749a42-ae00-4003-a4fc-0a313f85003f tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:35.078643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-88749a42-ae00-4003-a4fc-0a313f85003f tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:35.092225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88749a42-ae00-4003-a4fc-0a313f85003f tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:35.150089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243c061-259c-4803-a069-73fc72709e18 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:35.150731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243c061-259c-4803-a069-73fc72709e18 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:35.151018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243c061-259c-4803-a069-73fc72709e18 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:35.151349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243c061-259c-4803-a069-73fc72709e18 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects/f74e80a76e0548aeb2a47de27908b286` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:35.152508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243c061-259c-4803-a069-73fc72709e18 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f74e80a76e0548aeb2a47de27908b286)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:35.154410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243c061-259c-4803-a069-73fc72709e18 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:35.196651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:35.204481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6243c061-259c-4803-a069-73fc72709e18 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f74e80a76e0548aeb2a47de27908b286', 'request_id': 'req-6243c061-259c-4803-a069-73fc72709e18'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:35.212094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6243c061-259c-4803-a069-73fc72709e18 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f74e80a76e0548aeb2a47de27908b286', 'request_id': 'req-6243c061-259c-4803-a069-73fc72709e18'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:35.217661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6243c061-259c-4803-a069-73fc72709e18 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f74e80a76e0548aeb2a47de27908b286', 'request_id': 'req-6243c061-259c-4803-a069-73fc72709e18'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:35.229435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6243c061-259c-4803-a069-73fc72709e18 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] The token cache is being invalidate because project f74e80a76e0548aeb2a47de27908b286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:35.229722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6243c061-259c-4803-a069-73fc72709e18 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:35.230364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6243c061-259c-4803-a069-73fc72709e18 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:35.231889 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4060/8168] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:35 2022] DELETE /identity/v3/projects/f74e80a76e0548aeb2a47de27908b286 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:35.237453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6317c48-f30f-41e7-8eac-ae4cfe5087b0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:35.238781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b6317c48-f30f-41e7-8eac-ae4cfe5087b0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:35.252131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6317c48-f30f-41e7-8eac-ae4cfe5087b0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:35.308253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90399429-1895-4d02-a4d3-2eea7e358775 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:35.308878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90399429-1895-4d02-a4d3-2eea7e358775 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:35.309166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90399429-1895-4d02-a4d3-2eea7e358775 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:35.309442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90399429-1895-4d02-a4d3-2eea7e358775 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:35.310094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90399429-1895-4d02-a4d3-2eea7e358775 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:35.312054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90399429-1895-4d02-a4d3-2eea7e358775 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:35.337890 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4109/8169] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 30 21:34:35 2022] POST /identity/v3/projects => generated 329 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:35.342147 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243c061-259c-4803-a069-73fc72709e18 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:35.344168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6243c061-259c-4803-a069-73fc72709e18 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:35.357332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243c061-259c-4803-a069-73fc72709e18 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:35.416664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b891c66-e30f-48e0-822f-a7112f44ea69 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:35.417289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b891c66-e30f-48e0-822f-a7112f44ea69 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:35.417574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b891c66-e30f-48e0-822f-a7112f44ea69 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:35.417854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b891c66-e30f-48e0-822f-a7112f44ea69 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:35.418536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b891c66-e30f-48e0-822f-a7112f44ea69 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:35.420489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b891c66-e30f-48e0-822f-a7112f44ea69 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:35.441621 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4061/8170] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:35 2022] POST /identity/v3/users => generated 416 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:35.445349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90399429-1895-4d02-a4d3-2eea7e358775 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:35.456897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90399429-1895-4d02-a4d3-2eea7e358775 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:35.461573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8a1ed-2007-4094-a48d-f608117add4e tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:35.462179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8a1ed-2007-4094-a48d-f608117add4e tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:35.462468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8a1ed-2007-4094-a48d-f608117add4e tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:35.462746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8a1ed-2007-4094-a48d-f608117add4e tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:35.463482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8a1ed-2007-4094-a48d-f608117add4e tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:35.465061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8a1ed-2007-4094-a48d-f608117add4e tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:35.482860 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4110/8171] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:34:35 2022] POST /identity/v3/roles => generated 243 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:35.484085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b891c66-e30f-48e0-822f-a7112f44ea69 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:35.494719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b891c66-e30f-48e0-822f-a7112f44ea69 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:35.499381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fec198-6343-4108-b82a-ace244c327cf tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:35.500737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fec198-6343-4108-b82a-ace244c327cf tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:35.501030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fec198-6343-4108-b82a-ace244c327cf tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:35.501313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fec198-6343-4108-b82a-ace244c327cf tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:35.502023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fec198-6343-4108-b82a-ace244c327cf tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:35.503661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fec198-6343-4108-b82a-ace244c327cf tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:35.519821 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4062/8172] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:34:35 2022] POST /identity/v3/roles => generated 247 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:35.522668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8a1ed-2007-4094-a48d-f608117add4e tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:35.532996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8a1ed-2007-4094-a48d-f608117add4e tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:35.537556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ab480-0375-43cb-98fe-811d118c217b tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:35.538214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ab480-0375-43cb-98fe-811d118c217b tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:35.538502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ab480-0375-43cb-98fe-811d118c217b tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:35.538783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ab480-0375-43cb-98fe-811d118c217b tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects/36c56aff70d04ff18c47b1315be2c5b2/users/4fe42704b17c4ba2a36975273f381cfd/roles/3e7589f3762f402487648f27229454ff` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:35.553645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ab480-0375-43cb-98fe-811d118c217b tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_grant(project_id=36c56aff70d04ff18c47b1315be2c5b2, user_id=4fe42704b17c4ba2a36975273f381cfd, role_id=3e7589f3762f402487648f27229454ff)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:35.556327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ab480-0375-43cb-98fe-811d118c217b tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:35.569672 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4111/8173] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:35 2022] PUT /identity/v3/projects/36c56aff70d04ff18c47b1315be2c5b2/users/4fe42704b17c4ba2a36975273f381cfd/roles/3e7589f3762f402487648f27229454ff => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:34:35.573688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fec198-6343-4108-b82a-ace244c327cf tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:35.584817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fec198-6343-4108-b82a-ace244c327cf tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:35.642507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aef46-6a2f-47e1-8ea2-bff0fbc05736 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:35.643180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aef46-6a2f-47e1-8ea2-bff0fbc05736 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:35.643503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aef46-6a2f-47e1-8ea2-bff0fbc05736 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:35.643793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aef46-6a2f-47e1-8ea2-bff0fbc05736 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects/36c56aff70d04ff18c47b1315be2c5b2/users/4fe42704b17c4ba2a36975273f381cfd/roles/9c0614c39b7948d8a83b0ada314d094f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:35.646034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aef46-6a2f-47e1-8ea2-bff0fbc05736 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_grant(project_id=36c56aff70d04ff18c47b1315be2c5b2, user_id=4fe42704b17c4ba2a36975273f381cfd, role_id=9c0614c39b7948d8a83b0ada314d094f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:35.648721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aef46-6a2f-47e1-8ea2-bff0fbc05736 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:35.662900 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4063/8174] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:35 2022] PUT /identity/v3/projects/36c56aff70d04ff18c47b1315be2c5b2/users/4fe42704b17c4ba2a36975273f381cfd/roles/9c0614c39b7948d8a83b0ada314d094f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:35.666991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ab480-0375-43cb-98fe-811d118c217b tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:35.677949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ab480-0375-43cb-98fe-811d118c217b tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:35.733714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f646778-9a93-432e-80bd-45bc75faa601 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:35.734332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f646778-9a93-432e-80bd-45bc75faa601 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:35.734618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f646778-9a93-432e-80bd-45bc75faa601 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:35.734898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f646778-9a93-432e-80bd-45bc75faa601 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:35.735648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f646778-9a93-432e-80bd-45bc75faa601 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:35.737488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f646778-9a93-432e-80bd-45bc75faa601 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:35.764707 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4112/8175] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:35 2022] GET /identity/v3/users => generated 7507 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:35.770301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ffa70-cf65-4c82-940a-e63877c61dfd None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:35.770603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ffa70-cf65-4c82-940a-e63877c61dfd None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:35.770887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ffa70-cf65-4c82-940a-e63877c61dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:35.807992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-140ffa70-cf65-4c82-940a-e63877c61dfd None None] MFA Rules not processed for user `4fe42704b17c4ba2a36975273f381cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:35.809199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-140ffa70-cf65-4c82-940a-e63877c61dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:35.830754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:35.885870 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4064/8176] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:35.896541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b07da-dc45-4cb0-89e9-b14fabc535de None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:35.896836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b07da-dc45-4cb0-89e9-b14fabc535de None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:35.897117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b07da-dc45-4cb0-89e9-b14fabc535de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:35.916676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f03b07da-dc45-4cb0-89e9-b14fabc535de None None] MFA Rules not processed for user `4fe42704b17c4ba2a36975273f381cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:35.917920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f03b07da-dc45-4cb0-89e9-b14fabc535de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:35.925843 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4113/8177] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:35.930324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ffa70-cf65-4c82-940a-e63877c61dfd None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:35.940503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ffa70-cf65-4c82-940a-e63877c61dfd None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:35.944772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f3ea5-411d-4016-95d2-d9c1589e0dc0 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe42704b17c4ba2a36975273f381cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36c56aff70d04ff18c47b1315be2c5b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1401156042', 'tempest-DelegatedRole-933389816'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:35.945391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f3ea5-411d-4016-95d2-d9c1589e0dc0 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:35.945674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f3ea5-411d-4016-95d2-d9c1589e0dc0 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:35.945947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f3ea5-411d-4016-95d2-d9c1589e0dc0 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:35.946803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f3ea5-411d-4016-95d2-d9c1589e0dc0 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: Authorizing `identity:create_trust()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:35.947980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f3ea5-411d-4016-95d2-d9c1589e0dc0 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:36.041307 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4065/8178] 10.222.0.17 () {60 vars in 1174 bytes} [Sat Jul 30 21:34:35 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:36.045584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b07da-dc45-4cb0-89e9-b14fabc535de None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:36.050358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:36.056153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b07da-dc45-4cb0-89e9-b14fabc535de None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:36.061523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8891c-25bd-4b8a-8b1e-87a0a3c6518b tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe42704b17c4ba2a36975273f381cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36c56aff70d04ff18c47b1315be2c5b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1401156042', 'tempest-DelegatedRole-933389816'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:36.062917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8891c-25bd-4b8a-8b1e-87a0a3c6518b tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:36.063263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8891c-25bd-4b8a-8b1e-87a0a3c6518b tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:36.063746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8891c-25bd-4b8a-8b1e-87a0a3c6518b tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] PATH_INFO: `/v3/OS-TRUST/trusts/e30d39232401419099576dcbfacfb8c5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:36.069901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc8891c-25bd-4b8a-8b1e-87a0a3c6518b tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: Authorizing `identity:get_trust(trust_id=e30d39232401419099576dcbfacfb8c5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:36.071372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc8891c-25bd-4b8a-8b1e-87a0a3c6518b tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:36.078673 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4114/8179] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:34:36 2022] GET /identity/v3/OS-TRUST/trusts/e30d39232401419099576dcbfacfb8c5 => generated 858 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:36.082708 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f3ea5-411d-4016-95d2-d9c1589e0dc0 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:36.092380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f3ea5-411d-4016-95d2-d9c1589e0dc0 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:36.096827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bfe1f-e8ab-485a-b640-2d695441549c tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe42704b17c4ba2a36975273f381cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36c56aff70d04ff18c47b1315be2c5b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1401156042', 'tempest-DelegatedRole-933389816'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:36.097472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bfe1f-e8ab-485a-b640-2d695441549c tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:36.097763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bfe1f-e8ab-485a-b640-2d695441549c tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:36.098050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bfe1f-e8ab-485a-b640-2d695441549c tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] PATH_INFO: `/v3/OS-TRUST/trusts/e30d39232401419099576dcbfacfb8c5/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:36.104428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bfe1f-e8ab-485a-b640-2d695441549c tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=e30d39232401419099576dcbfacfb8c5)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:36.105917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bfe1f-e8ab-485a-b640-2d695441549c tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:36.113403 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4066/8180] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 21:34:36 2022] GET /identity/v3/OS-TRUST/trusts/e30d39232401419099576dcbfacfb8c5/roles => generated 370 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:34:36.117265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8891c-25bd-4b8a-8b1e-87a0a3c6518b tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:36.127219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8891c-25bd-4b8a-8b1e-87a0a3c6518b tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:36.131380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf64209-b613-4f12-b076-2df90637f0b4 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe42704b17c4ba2a36975273f381cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36c56aff70d04ff18c47b1315be2c5b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1401156042', 'tempest-DelegatedRole-933389816'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:36.132026 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf64209-b613-4f12-b076-2df90637f0b4 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:36.132312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf64209-b613-4f12-b076-2df90637f0b4 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:36.132589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf64209-b613-4f12-b076-2df90637f0b4 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] PATH_INFO: `/v3/OS-TRUST/trusts/e30d39232401419099576dcbfacfb8c5/roles/3e7589f3762f402487648f27229454ff` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:36.138364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf64209-b613-4f12-b076-2df90637f0b4 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e30d39232401419099576dcbfacfb8c5, role_id=3e7589f3762f402487648f27229454ff)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:36.139814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf64209-b613-4f12-b076-2df90637f0b4 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:36.146554 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4115/8181] 10.222.0.17 () {58 vars in 1368 bytes} [Sat Jul 30 21:34:36 2022] GET /identity/v3/OS-TRUST/trusts/e30d39232401419099576dcbfacfb8c5/roles/3e7589f3762f402487648f27229454ff => generated 243 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:34:36.150226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bfe1f-e8ab-485a-b640-2d695441549c tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:36.159572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bfe1f-e8ab-485a-b640-2d695441549c tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:36.164149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6bd7b-001c-4010-b57a-5c557a152375 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe42704b17c4ba2a36975273f381cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36c56aff70d04ff18c47b1315be2c5b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1401156042', 'tempest-DelegatedRole-933389816'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:36.164785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6bd7b-001c-4010-b57a-5c557a152375 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] REQUEST_METHOD: `HEAD` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:36.165070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6bd7b-001c-4010-b57a-5c557a152375 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:36.165351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6bd7b-001c-4010-b57a-5c557a152375 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] PATH_INFO: `/v3/OS-TRUST/trusts/e30d39232401419099576dcbfacfb8c5/roles/3e7589f3762f402487648f27229454ff` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:36.171245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6bd7b-001c-4010-b57a-5c557a152375 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e30d39232401419099576dcbfacfb8c5, role_id=3e7589f3762f402487648f27229454ff)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:36.173176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6bd7b-001c-4010-b57a-5c557a152375 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:36.179824 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4067/8182] 10.222.0.17 () {58 vars in 1369 bytes} [Sat Jul 30 21:34:36 2022] HEAD /identity/v3/OS-TRUST/trusts/e30d39232401419099576dcbfacfb8c5/roles/3e7589f3762f402487648f27229454ff => generated 0 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 30 21:34:36.183715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf64209-b613-4f12-b076-2df90637f0b4 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:36.193573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf64209-b613-4f12-b076-2df90637f0b4 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:36.197733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a63e4b-11e7-4100-a37b-83c01faadb7c tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe42704b17c4ba2a36975273f381cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36c56aff70d04ff18c47b1315be2c5b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1401156042', 'tempest-DelegatedRole-933389816'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:36.198371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a63e4b-11e7-4100-a37b-83c01faadb7c tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:36.198661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a63e4b-11e7-4100-a37b-83c01faadb7c tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:36.198946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a63e4b-11e7-4100-a37b-83c01faadb7c tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] PATH_INFO: `/v3/OS-TRUST/trusts/e30d39232401419099576dcbfacfb8c5/roles/9c0614c39b7948d8a83b0ada314d094f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:36.204826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a63e4b-11e7-4100-a37b-83c01faadb7c tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e30d39232401419099576dcbfacfb8c5, role_id=9c0614c39b7948d8a83b0ada314d094f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:36.206239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a63e4b-11e7-4100-a37b-83c01faadb7c tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:36.216159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-f0a63e4b-11e7-4100-a37b-83c01faadb7c tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Could not find role: 9c0614c39b7948d8a83b0ada314d094f.: keystone.exception.RoleNotFound: Could not find role: 9c0614c39b7948d8a83b0ada314d094f. Jul 30 21:34:36.216159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:36.216159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:34:36.216159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:34:36.216159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:34:36.216159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:34:36.216159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:34:36.216159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:34:36.216159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:34:36.216159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:34:36.216159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:34:36.216159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:34:36.216159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 30 21:34:36.216159 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 21:34:36.217238 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 9c0614c39b7948d8a83b0ada314d094f. Jul 30 21:34:36.217238 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:34:36.217238 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4116/8183] 10.222.0.17 () {58 vars in 1368 bytes} [Sat Jul 30 21:34:36 2022] GET /identity/v3/OS-TRUST/trusts/e30d39232401419099576dcbfacfb8c5/roles/9c0614c39b7948d8a83b0ada314d094f => generated 110 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:34:36.221077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6bd7b-001c-4010-b57a-5c557a152375 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:36.230284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6bd7b-001c-4010-b57a-5c557a152375 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:36.234879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9277e-dba2-4064-8211-eea9c401d3a9 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe42704b17c4ba2a36975273f381cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36c56aff70d04ff18c47b1315be2c5b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1401156042', 'tempest-DelegatedRole-933389816'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:36.235543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9277e-dba2-4064-8211-eea9c401d3a9 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] REQUEST_METHOD: `HEAD` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:36.235827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9277e-dba2-4064-8211-eea9c401d3a9 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:36.236102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9277e-dba2-4064-8211-eea9c401d3a9 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] PATH_INFO: `/v3/OS-TRUST/trusts/e30d39232401419099576dcbfacfb8c5/roles/9c0614c39b7948d8a83b0ada314d094f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:36.241889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9277e-dba2-4064-8211-eea9c401d3a9 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e30d39232401419099576dcbfacfb8c5, role_id=9c0614c39b7948d8a83b0ada314d094f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:36.243306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9277e-dba2-4064-8211-eea9c401d3a9 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:36.254501 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-8da9277e-dba2-4064-8211-eea9c401d3a9 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Could not find role: 9c0614c39b7948d8a83b0ada314d094f.: keystone.exception.RoleNotFound: Could not find role: 9c0614c39b7948d8a83b0ada314d094f. Jul 30 21:34:36.254501 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:36.254501 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:34:36.254501 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:34:36.254501 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:34:36.254501 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:34:36.254501 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:34:36.254501 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:34:36.254501 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:34:36.254501 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:34:36.254501 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:34:36.254501 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:34:36.254501 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 30 21:34:36.254501 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 21:34:36.255801 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 9c0614c39b7948d8a83b0ada314d094f. Jul 30 21:34:36.255801 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:34:36.255801 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4068/8184] 10.222.0.17 () {58 vars in 1369 bytes} [Sat Jul 30 21:34:36 2022] HEAD /identity/v3/OS-TRUST/trusts/e30d39232401419099576dcbfacfb8c5/roles/9c0614c39b7948d8a83b0ada314d094f => generated 0 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 30 21:34:36.259373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a63e4b-11e7-4100-a37b-83c01faadb7c tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:36.269115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a63e4b-11e7-4100-a37b-83c01faadb7c tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:36.273432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dd217-a0dd-41d1-a345-02a6ee63620f tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe42704b17c4ba2a36975273f381cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36c56aff70d04ff18c47b1315be2c5b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1401156042', 'tempest-DelegatedRole-933389816'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:36.274057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dd217-a0dd-41d1-a345-02a6ee63620f tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:36.274346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dd217-a0dd-41d1-a345-02a6ee63620f tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:36.274632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dd217-a0dd-41d1-a345-02a6ee63620f tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] PATH_INFO: `/v3/OS-TRUST/trusts/e30d39232401419099576dcbfacfb8c5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:36.280594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5dd217-a0dd-41d1-a345-02a6ee63620f tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: Authorizing `identity:delete_trust(trust_id=e30d39232401419099576dcbfacfb8c5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:36.282546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5dd217-a0dd-41d1-a345-02a6ee63620f tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:36.300662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7d5dd217-a0dd-41d1-a345-02a6ee63620f tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'e30d39232401419099576dcbfacfb8c5', 'request_id': 'req-7d5dd217-a0dd-41d1-a345-02a6ee63620f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:36.307637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7d5dd217-a0dd-41d1-a345-02a6ee63620f tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e30d39232401419099576dcbfacfb8c5', 'request_id': 'req-7d5dd217-a0dd-41d1-a345-02a6ee63620f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:36.308299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7d5dd217-a0dd-41d1-a345-02a6ee63620f tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e30d39232401419099576dcbfacfb8c5', 'request_id': 'req-7d5dd217-a0dd-41d1-a345-02a6ee63620f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:36.314699 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4117/8185] 10.222.0.17 () {58 vars in 1254 bytes} [Sat Jul 30 21:34:36 2022] DELETE /identity/v3/OS-TRUST/trusts/e30d39232401419099576dcbfacfb8c5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:36.318989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9277e-dba2-4064-8211-eea9c401d3a9 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:36.320711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8da9277e-dba2-4064-8211-eea9c401d3a9 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:36.333543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9277e-dba2-4064-8211-eea9c401d3a9 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:36.337720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee1259-c55f-4c0d-b12e-ee5133437db5 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe42704b17c4ba2a36975273f381cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36c56aff70d04ff18c47b1315be2c5b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1401156042', 'tempest-DelegatedRole-933389816'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:36.338342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee1259-c55f-4c0d-b12e-ee5133437db5 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:36.338627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee1259-c55f-4c0d-b12e-ee5133437db5 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:36.338907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee1259-c55f-4c0d-b12e-ee5133437db5 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] PATH_INFO: `/v3/OS-TRUST/trusts/e30d39232401419099576dcbfacfb8c5` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:36.348092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-9cee1259-c55f-4c0d-b12e-ee5133437db5 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Could not find trust: e30d39232401419099576dcbfacfb8c5.: keystone.exception.TrustNotFound: Could not find trust: e30d39232401419099576dcbfacfb8c5. Jul 30 21:34:36.348092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:36.348092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:34:36.348092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:34:36.348092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:34:36.348092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:34:36.348092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:34:36.348092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:34:36.348092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:34:36.348092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:34:36.348092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:34:36.348092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:34:36.348092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 30 21:34:36.348092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 30 21:34:36.348092 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 30 21:34:36.349397 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 30 21:34:36.349397 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 30 21:34:36.349397 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 30 21:34:36.349397 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 30 21:34:36.349397 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 30 21:34:36.349397 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:34:36.349397 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:34:36.349397 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 30 21:34:36.349397 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 30 21:34:36.349397 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 30 21:34:36.349397 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 30 21:34:36.349397 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: e30d39232401419099576dcbfacfb8c5. Jul 30 21:34:36.349397 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:34:36.349397 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4069/8186] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:34:36 2022] GET /identity/v3/OS-TRUST/trusts/e30d39232401419099576dcbfacfb8c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:34:36.353340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dd217-a0dd-41d1-a345-02a6ee63620f tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:36.354708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7d5dd217-a0dd-41d1-a345-02a6ee63620f tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:36.370319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dd217-a0dd-41d1-a345-02a6ee63620f tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:36.376368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a4c0e-5bc5-4e39-be9e-4c960d7da6e8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:36.377115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a4c0e-5bc5-4e39-be9e-4c960d7da6e8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:36.377402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a4c0e-5bc5-4e39-be9e-4c960d7da6e8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:36.377687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a4c0e-5bc5-4e39-be9e-4c960d7da6e8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles/9c0614c39b7948d8a83b0ada314d094f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:36.380052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a4c0e-5bc5-4e39-be9e-4c960d7da6e8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9c0614c39b7948d8a83b0ada314d094f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:36.381191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a4c0e-5bc5-4e39-be9e-4c960d7da6e8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:36.425087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a15a4c0e-5bc5-4e39-be9e-4c960d7da6e8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invalidating the token cache because role 9c0614c39b7948d8a83b0ada314d094f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:36.425375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a15a4c0e-5bc5-4e39-be9e-4c960d7da6e8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:36.426086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a15a4c0e-5bc5-4e39-be9e-4c960d7da6e8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:36.428140 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4118/8187] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:36 2022] DELETE /identity/v3/roles/9c0614c39b7948d8a83b0ada314d094f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:36.432203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee1259-c55f-4c0d-b12e-ee5133437db5 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:36.433951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9cee1259-c55f-4c0d-b12e-ee5133437db5 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:36.448705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee1259-c55f-4c0d-b12e-ee5133437db5 tempest-TrustsV3TestJSON-1457910951 tempest-user-1925156342] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:36.497390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:36.508572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b7af4-8385-42a4-83f1-c7de5ce10672 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:36.509221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b7af4-8385-42a4-83f1-c7de5ce10672 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:36.509540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b7af4-8385-42a4-83f1-c7de5ce10672 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:36.509825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b7af4-8385-42a4-83f1-c7de5ce10672 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles/3e7589f3762f402487648f27229454ff` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:36.511439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b7af4-8385-42a4-83f1-c7de5ce10672 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3e7589f3762f402487648f27229454ff)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:36.513058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b7af4-8385-42a4-83f1-c7de5ce10672 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:36.550347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-563b7af4-8385-42a4-83f1-c7de5ce10672 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invalidating the token cache because role 3e7589f3762f402487648f27229454ff has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:36.550642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-563b7af4-8385-42a4-83f1-c7de5ce10672 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:36.551393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-563b7af4-8385-42a4-83f1-c7de5ce10672 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:36.553237 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4070/8188] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:36 2022] DELETE /identity/v3/roles/3e7589f3762f402487648f27229454ff => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:36.557353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a4c0e-5bc5-4e39-be9e-4c960d7da6e8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:36.568107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a4c0e-5bc5-4e39-be9e-4c960d7da6e8 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:36.625269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e502ca-47c0-47b5-a835-c1545b282009 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:36.625918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e502ca-47c0-47b5-a835-c1545b282009 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:36.626217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e502ca-47c0-47b5-a835-c1545b282009 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:36.626501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e502ca-47c0-47b5-a835-c1545b282009 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/users/4fe42704b17c4ba2a36975273f381cfd` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:36.627744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e502ca-47c0-47b5-a835-c1545b282009 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4fe42704b17c4ba2a36975273f381cfd)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:36.629675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e502ca-47c0-47b5-a835-c1545b282009 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:36.663069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=9 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:36.682735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f7e502ca-47c0-47b5-a835-c1545b282009 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fe42704b17c4ba2a36975273f381cfd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:36.694987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f7e502ca-47c0-47b5-a835-c1545b282009 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fe42704b17c4ba2a36975273f381cfd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:36.695719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f7e502ca-47c0-47b5-a835-c1545b282009 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fe42704b17c4ba2a36975273f381cfd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:36.703617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f7e502ca-47c0-47b5-a835-c1545b282009 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fe42704b17c4ba2a36975273f381cfd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:36.704291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f7e502ca-47c0-47b5-a835-c1545b282009 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fe42704b17c4ba2a36975273f381cfd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:36.719355 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4119/8189] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:36 2022] DELETE /identity/v3/users/4fe42704b17c4ba2a36975273f381cfd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:36.723864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b7af4-8385-42a4-83f1-c7de5ce10672 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:36.725311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-563b7af4-8385-42a4-83f1-c7de5ce10672 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:36.738515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b7af4-8385-42a4-83f1-c7de5ce10672 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:36.800773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cde45-d46e-4c05-941f-54aafcc03616 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:36.801500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cde45-d46e-4c05-941f-54aafcc03616 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:36.801715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cde45-d46e-4c05-941f-54aafcc03616 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:36.801997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cde45-d46e-4c05-941f-54aafcc03616 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects/36c56aff70d04ff18c47b1315be2c5b2` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:36.803179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cde45-d46e-4c05-941f-54aafcc03616 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=36c56aff70d04ff18c47b1315be2c5b2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:36.805128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cde45-d46e-4c05-941f-54aafcc03616 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:36.856346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-454cde45-d46e-4c05-941f-54aafcc03616 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c56aff70d04ff18c47b1315be2c5b2', 'request_id': 'req-454cde45-d46e-4c05-941f-54aafcc03616'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:36.863441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-454cde45-d46e-4c05-941f-54aafcc03616 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c56aff70d04ff18c47b1315be2c5b2', 'request_id': 'req-454cde45-d46e-4c05-941f-54aafcc03616'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:36.869151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-454cde45-d46e-4c05-941f-54aafcc03616 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c56aff70d04ff18c47b1315be2c5b2', 'request_id': 'req-454cde45-d46e-4c05-941f-54aafcc03616'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:36.880603 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-454cde45-d46e-4c05-941f-54aafcc03616 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] The token cache is being invalidate because project 36c56aff70d04ff18c47b1315be2c5b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:36.880898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-454cde45-d46e-4c05-941f-54aafcc03616 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:36.881599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-454cde45-d46e-4c05-941f-54aafcc03616 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:36.883142 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4071/8190] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:36 2022] DELETE /identity/v3/projects/36c56aff70d04ff18c47b1315be2c5b2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:34:36.888599 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e502ca-47c0-47b5-a835-c1545b282009 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:36.890514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f7e502ca-47c0-47b5-a835-c1545b282009 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:36.904061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e502ca-47c0-47b5-a835-c1545b282009 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:36.960196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2fc3f-e93a-47eb-acba-839ca2e8e007 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:36.960826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2fc3f-e93a-47eb-acba-839ca2e8e007 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:36.961119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2fc3f-e93a-47eb-acba-839ca2e8e007 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:36.961406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2fc3f-e93a-47eb-acba-839ca2e8e007 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:36.962073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2fc3f-e93a-47eb-acba-839ca2e8e007 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:36.964017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2fc3f-e93a-47eb-acba-839ca2e8e007 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:36.989992 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4120/8191] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 30 21:34:36 2022] POST /identity/v3/projects => generated 328 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:36.994062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cde45-d46e-4c05-941f-54aafcc03616 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:36.995636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-454cde45-d46e-4c05-941f-54aafcc03616 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:37.010211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cde45-d46e-4c05-941f-54aafcc03616 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:37.058291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:37.076880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd06693-67e9-4d7f-ab15-74b6f6ea9da1 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:37.078273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd06693-67e9-4d7f-ab15-74b6f6ea9da1 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:37.078703 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd06693-67e9-4d7f-ab15-74b6f6ea9da1 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:37.079043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd06693-67e9-4d7f-ab15-74b6f6ea9da1 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:37.079772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd06693-67e9-4d7f-ab15-74b6f6ea9da1 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:37.082097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd06693-67e9-4d7f-ab15-74b6f6ea9da1 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:37.103188 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4072/8192] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:36 2022] POST /identity/v3/users => generated 413 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:37.107356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2fc3f-e93a-47eb-acba-839ca2e8e007 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:37.118322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2fc3f-e93a-47eb-acba-839ca2e8e007 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:37.122956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b95c0-d762-44a9-8ba6-c328c74a2592 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:37.123610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b95c0-d762-44a9-8ba6-c328c74a2592 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:37.123903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b95c0-d762-44a9-8ba6-c328c74a2592 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:37.124218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b95c0-d762-44a9-8ba6-c328c74a2592 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:37.125686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b95c0-d762-44a9-8ba6-c328c74a2592 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:37.127338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b95c0-d762-44a9-8ba6-c328c74a2592 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:37.144009 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4121/8193] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:34:37 2022] POST /identity/v3/roles => generated 244 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:37.147956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd06693-67e9-4d7f-ab15-74b6f6ea9da1 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:37.159141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd06693-67e9-4d7f-ab15-74b6f6ea9da1 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:37.164583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd984f26-ceef-4094-abe9-11527173b675 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:37.165188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd984f26-ceef-4094-abe9-11527173b675 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:37.165477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd984f26-ceef-4094-abe9-11527173b675 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:37.165756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd984f26-ceef-4094-abe9-11527173b675 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:37.166449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd984f26-ceef-4094-abe9-11527173b675 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:37.168106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd984f26-ceef-4094-abe9-11527173b675 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:37.183244 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4073/8194] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:34:37 2022] POST /identity/v3/roles => generated 246 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:37.186741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b95c0-d762-44a9-8ba6-c328c74a2592 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:37.197848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b95c0-d762-44a9-8ba6-c328c74a2592 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:37.203157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5e216-9b59-4fa9-ba3a-658255b576ff tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:37.203855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5e216-9b59-4fa9-ba3a-658255b576ff tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:37.204188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5e216-9b59-4fa9-ba3a-658255b576ff tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:37.204458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5e216-9b59-4fa9-ba3a-658255b576ff tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects/04a61700557e491baf729603159f7944/users/335d5ab7f7df4a6788ef4448fa7103d3/roles/3ef52843891141d0a2e61091f7f3c262` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:37.219135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5e216-9b59-4fa9-ba3a-658255b576ff tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_grant(project_id=04a61700557e491baf729603159f7944, user_id=335d5ab7f7df4a6788ef4448fa7103d3, role_id=3ef52843891141d0a2e61091f7f3c262)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:37.221885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5e216-9b59-4fa9-ba3a-658255b576ff tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:37.234494 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4122/8195] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:37 2022] PUT /identity/v3/projects/04a61700557e491baf729603159f7944/users/335d5ab7f7df4a6788ef4448fa7103d3/roles/3ef52843891141d0a2e61091f7f3c262 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:37.238648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd984f26-ceef-4094-abe9-11527173b675 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:37.250339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd984f26-ceef-4094-abe9-11527173b675 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:37.306698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720546b-ea8a-4db6-bc9d-50311c900e33 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:37.307487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720546b-ea8a-4db6-bc9d-50311c900e33 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:37.307786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720546b-ea8a-4db6-bc9d-50311c900e33 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:37.308074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720546b-ea8a-4db6-bc9d-50311c900e33 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects/04a61700557e491baf729603159f7944/users/335d5ab7f7df4a6788ef4448fa7103d3/roles/74046fd8bfa74ef68722d764222734ad` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:37.310382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720546b-ea8a-4db6-bc9d-50311c900e33 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_grant(project_id=04a61700557e491baf729603159f7944, user_id=335d5ab7f7df4a6788ef4448fa7103d3, role_id=74046fd8bfa74ef68722d764222734ad)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:37.313560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720546b-ea8a-4db6-bc9d-50311c900e33 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:37.326331 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4074/8196] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:37 2022] PUT /identity/v3/projects/04a61700557e491baf729603159f7944/users/335d5ab7f7df4a6788ef4448fa7103d3/roles/74046fd8bfa74ef68722d764222734ad => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:37.330927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5e216-9b59-4fa9-ba3a-658255b576ff tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:37.341801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5e216-9b59-4fa9-ba3a-658255b576ff tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:37.402576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:37.411254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e71d66-7121-47c6-9f5b-b101674d3e7f tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:37.412155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e71d66-7121-47c6-9f5b-b101674d3e7f tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:37.412693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e71d66-7121-47c6-9f5b-b101674d3e7f tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:37.413184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e71d66-7121-47c6-9f5b-b101674d3e7f tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:37.414090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e71d66-7121-47c6-9f5b-b101674d3e7f tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:37.416219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e71d66-7121-47c6-9f5b-b101674d3e7f tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:37.445271 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4123/8197] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:37 2022] GET /identity/v3/users => generated 7504 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:37.450045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180a3cc-3ac5-4dad-a163-c47371ed5aaf None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:37.450689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180a3cc-3ac5-4dad-a163-c47371ed5aaf None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:37.451006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180a3cc-3ac5-4dad-a163-c47371ed5aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:37.493296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-3180a3cc-3ac5-4dad-a163-c47371ed5aaf None None] MFA Rules not processed for user `335d5ab7f7df4a6788ef4448fa7103d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:37.494538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3180a3cc-3ac5-4dad-a163-c47371ed5aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:37.559582 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4075/8198] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:37.570339 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec5719-a8c1-4930-90cf-8fef963ee7fb None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:37.570836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec5719-a8c1-4930-90cf-8fef963ee7fb None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:37.570987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec5719-a8c1-4930-90cf-8fef963ee7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:37.590126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5fec5719-a8c1-4930-90cf-8fef963ee7fb None None] MFA Rules not processed for user `335d5ab7f7df4a6788ef4448fa7103d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:37.591372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5fec5719-a8c1-4930-90cf-8fef963ee7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:37.598693 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4124/8199] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:34:37.603044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180a3cc-3ac5-4dad-a163-c47371ed5aaf None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:37.612867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180a3cc-3ac5-4dad-a163-c47371ed5aaf None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:37.617337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce1726-e2bd-4567-8d49-ca2d5b883f21 tempest-TrustsV3TestJSON-276452312 tempest-user-793013285] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '335d5ab7f7df4a6788ef4448fa7103d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a61700557e491baf729603159f7944', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-2001740502', 'tempest-NotDelegatedRole-998160050'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:37.617984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce1726-e2bd-4567-8d49-ca2d5b883f21 tempest-TrustsV3TestJSON-276452312 tempest-user-793013285] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:37.618271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce1726-e2bd-4567-8d49-ca2d5b883f21 tempest-TrustsV3TestJSON-276452312 tempest-user-793013285] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:37.618632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce1726-e2bd-4567-8d49-ca2d5b883f21 tempest-TrustsV3TestJSON-276452312 tempest-user-793013285] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:37.619415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce1726-e2bd-4567-8d49-ca2d5b883f21 tempest-TrustsV3TestJSON-276452312 tempest-user-793013285] RBAC: Authorizing `identity:create_trust()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:37.620556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce1726-e2bd-4567-8d49-ca2d5b883f21 tempest-TrustsV3TestJSON-276452312 tempest-user-793013285] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:37.665149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:37.707839 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-e3ce1726-e2bd-4567-8d49-ca2d5b883f21 tempest-TrustsV3TestJSON-276452312 tempest-user-793013285] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jul 30 21:34:37.707839 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:37.707839 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Jul 30 21:34:37.707839 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Jul 30 21:34:37.707839 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Jul 30 21:34:37.707839 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Jul 30 21:34:37.707839 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Jul 30 21:34:37.707839 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:34:37.707839 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:34:37.707839 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:34:37.707839 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:37.707839 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Jul 30 21:34:37.707839 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Jul 30 21:34:37.707839 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Jul 30 21:34:37.709179 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise ValueError(str(e)) Jul 30 21:34:37.709179 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Jul 30 21:34:37.709179 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:34:37.709179 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 30 21:34:37.709179 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:34:37.709179 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:37.709179 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:34:37.709179 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:34:37.709179 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:34:37.709179 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:34:37.709179 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:34:37.709179 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:34:37.709179 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:34:37.709179 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:34:37.709179 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:34:37.709179 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:34:37.709179 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Jul 30 21:34:37.709179 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Jul 30 21:34:37.710662 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Jul 30 21:34:37.710662 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Jul 30 21:34:37.710662 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Jul 30 21:34:37.710662 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Jul 30 21:34:37.710662 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jul 30 21:34:37.710662 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:34:37.710662 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4076/8200] 10.222.0.17 () {60 vars in 1174 bytes} [Sat Jul 30 21:34:37 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 107 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 30 21:34:37.713394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec5719-a8c1-4930-90cf-8fef963ee7fb None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:37.728065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec5719-a8c1-4930-90cf-8fef963ee7fb None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:37.732768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebb1e3-b772-4480-9dae-a4cec3d99c16 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:37.733409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebb1e3-b772-4480-9dae-a4cec3d99c16 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:37.734213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebb1e3-b772-4480-9dae-a4cec3d99c16 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:37.734510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebb1e3-b772-4480-9dae-a4cec3d99c16 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles/74046fd8bfa74ef68722d764222734ad` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:37.736178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebb1e3-b772-4480-9dae-a4cec3d99c16 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_role(role_id=74046fd8bfa74ef68722d764222734ad)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:37.737872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebb1e3-b772-4480-9dae-a4cec3d99c16 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:37.780047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7cebb1e3-b772-4480-9dae-a4cec3d99c16 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invalidating the token cache because role 74046fd8bfa74ef68722d764222734ad has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:37.780341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7cebb1e3-b772-4480-9dae-a4cec3d99c16 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:37.781545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7cebb1e3-b772-4480-9dae-a4cec3d99c16 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:37.783515 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4125/8201] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:37 2022] DELETE /identity/v3/roles/74046fd8bfa74ef68722d764222734ad => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:34:37.787819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce1726-e2bd-4567-8d49-ca2d5b883f21 tempest-TrustsV3TestJSON-276452312 tempest-user-793013285] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:37.789749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e3ce1726-e2bd-4567-8d49-ca2d5b883f21 tempest-TrustsV3TestJSON-276452312 tempest-user-793013285] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:37.807652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce1726-e2bd-4567-8d49-ca2d5b883f21 tempest-TrustsV3TestJSON-276452312 tempest-user-793013285] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:37.870067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d0a70-60d3-44b3-8dd7-a81178c99354 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:37.870641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d0a70-60d3-44b3-8dd7-a81178c99354 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:37.870928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d0a70-60d3-44b3-8dd7-a81178c99354 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:37.871210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d0a70-60d3-44b3-8dd7-a81178c99354 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles/3ef52843891141d0a2e61091f7f3c262` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:37.872692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d0a70-60d3-44b3-8dd7-a81178c99354 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3ef52843891141d0a2e61091f7f3c262)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:37.874355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d0a70-60d3-44b3-8dd7-a81178c99354 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:37.912221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-975d0a70-60d3-44b3-8dd7-a81178c99354 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invalidating the token cache because role 3ef52843891141d0a2e61091f7f3c262 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:37.912509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-975d0a70-60d3-44b3-8dd7-a81178c99354 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:37.913176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-975d0a70-60d3-44b3-8dd7-a81178c99354 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:37.915064 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4077/8202] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:37 2022] DELETE /identity/v3/roles/3ef52843891141d0a2e61091f7f3c262 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:34:37.919479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebb1e3-b772-4480-9dae-a4cec3d99c16 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:37.930782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebb1e3-b772-4480-9dae-a4cec3d99c16 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:37.986642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6043d-1bf7-4d7c-aadb-1fd60dcd7dcc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:37.987317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6043d-1bf7-4d7c-aadb-1fd60dcd7dcc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:37.987630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6043d-1bf7-4d7c-aadb-1fd60dcd7dcc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:37.987915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6043d-1bf7-4d7c-aadb-1fd60dcd7dcc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/users/335d5ab7f7df4a6788ef4448fa7103d3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:37.989111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6043d-1bf7-4d7c-aadb-1fd60dcd7dcc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_user(user_id=335d5ab7f7df4a6788ef4448fa7103d3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:37.991030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6043d-1bf7-4d7c-aadb-1fd60dcd7dcc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:38.043012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-97f6043d-1bf7-4d7c-aadb-1fd60dcd7dcc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '335d5ab7f7df4a6788ef4448fa7103d3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:38.058741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-97f6043d-1bf7-4d7c-aadb-1fd60dcd7dcc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '335d5ab7f7df4a6788ef4448fa7103d3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:38.059505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-97f6043d-1bf7-4d7c-aadb-1fd60dcd7dcc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '335d5ab7f7df4a6788ef4448fa7103d3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:38.066739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-97f6043d-1bf7-4d7c-aadb-1fd60dcd7dcc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '335d5ab7f7df4a6788ef4448fa7103d3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:38.067526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-97f6043d-1bf7-4d7c-aadb-1fd60dcd7dcc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '335d5ab7f7df4a6788ef4448fa7103d3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:38.082024 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4126/8203] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:37 2022] DELETE /identity/v3/users/335d5ab7f7df4a6788ef4448fa7103d3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:38.086344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d0a70-60d3-44b3-8dd7-a81178c99354 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:38.087804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-975d0a70-60d3-44b3-8dd7-a81178c99354 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:38.103029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d0a70-60d3-44b3-8dd7-a81178c99354 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:38.163419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff56586-922f-4b18-a0ca-c59290145869 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:38.164083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff56586-922f-4b18-a0ca-c59290145869 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:38.164271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff56586-922f-4b18-a0ca-c59290145869 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:38.164554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff56586-922f-4b18-a0ca-c59290145869 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects/04a61700557e491baf729603159f7944` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:38.165740 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff56586-922f-4b18-a0ca-c59290145869 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=04a61700557e491baf729603159f7944)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:38.167704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff56586-922f-4b18-a0ca-c59290145869 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:38.212189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:38.216015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cff56586-922f-4b18-a0ca-c59290145869 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a61700557e491baf729603159f7944', 'request_id': 'req-cff56586-922f-4b18-a0ca-c59290145869'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:38.223985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cff56586-922f-4b18-a0ca-c59290145869 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a61700557e491baf729603159f7944', 'request_id': 'req-cff56586-922f-4b18-a0ca-c59290145869'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:38.229850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cff56586-922f-4b18-a0ca-c59290145869 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a61700557e491baf729603159f7944', 'request_id': 'req-cff56586-922f-4b18-a0ca-c59290145869'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:38.242534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cff56586-922f-4b18-a0ca-c59290145869 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] The token cache is being invalidate because project 04a61700557e491baf729603159f7944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:38.242825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cff56586-922f-4b18-a0ca-c59290145869 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:38.243527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cff56586-922f-4b18-a0ca-c59290145869 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:38.245057 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4078/8204] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:38 2022] DELETE /identity/v3/projects/04a61700557e491baf729603159f7944 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:38.251880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6043d-1bf7-4d7c-aadb-1fd60dcd7dcc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:38.253270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-97f6043d-1bf7-4d7c-aadb-1fd60dcd7dcc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:38.267437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6043d-1bf7-4d7c-aadb-1fd60dcd7dcc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:38.285750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:38.329442 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd79d47-1d0d-42b9-88d7-7796c0af40f6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:38.330068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79d47-1d0d-42b9-88d7-7796c0af40f6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:38.330362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79d47-1d0d-42b9-88d7-7796c0af40f6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:38.330646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79d47-1d0d-42b9-88d7-7796c0af40f6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:38.331346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd79d47-1d0d-42b9-88d7-7796c0af40f6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:38.333302 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd79d47-1d0d-42b9-88d7-7796c0af40f6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:38.359788 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4127/8205] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 30 21:34:38 2022] POST /identity/v3/projects => generated 329 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:38.363914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff56586-922f-4b18-a0ca-c59290145869 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:38.365386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cff56586-922f-4b18-a0ca-c59290145869 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:38.379624 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff56586-922f-4b18-a0ca-c59290145869 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:38.438794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50d377-0fb6-42f5-b44c-22c518b71440 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:38.439384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50d377-0fb6-42f5-b44c-22c518b71440 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:38.439677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50d377-0fb6-42f5-b44c-22c518b71440 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:38.439956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50d377-0fb6-42f5-b44c-22c518b71440 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:38.440812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50d377-0fb6-42f5-b44c-22c518b71440 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:38.442548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50d377-0fb6-42f5-b44c-22c518b71440 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:38.464355 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4079/8206] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:38 2022] POST /identity/v3/users => generated 416 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:38.467959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd79d47-1d0d-42b9-88d7-7796c0af40f6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:38.479116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd79d47-1d0d-42b9-88d7-7796c0af40f6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:38.484701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb2bf7-1bb8-4594-a4ad-e58cffcccd14 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:38.485344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb2bf7-1bb8-4594-a4ad-e58cffcccd14 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:38.485633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb2bf7-1bb8-4594-a4ad-e58cffcccd14 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:38.485911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb2bf7-1bb8-4594-a4ad-e58cffcccd14 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:38.486615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb2bf7-1bb8-4594-a4ad-e58cffcccd14 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:38.488259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb2bf7-1bb8-4594-a4ad-e58cffcccd14 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:38.503983 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4128/8207] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:34:38 2022] POST /identity/v3/roles => generated 244 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:38.507897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50d377-0fb6-42f5-b44c-22c518b71440 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:38.518696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50d377-0fb6-42f5-b44c-22c518b71440 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:38.523366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809fbab-daa0-4e16-99ee-dfa8a79a251c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:38.524083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809fbab-daa0-4e16-99ee-dfa8a79a251c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:38.524380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809fbab-daa0-4e16-99ee-dfa8a79a251c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:38.524663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809fbab-daa0-4e16-99ee-dfa8a79a251c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:38.525406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809fbab-daa0-4e16-99ee-dfa8a79a251c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:38.527008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809fbab-daa0-4e16-99ee-dfa8a79a251c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:38.542207 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4080/8208] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:34:38 2022] POST /identity/v3/roles => generated 246 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:38.546858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb2bf7-1bb8-4594-a4ad-e58cffcccd14 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:38.557563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb2bf7-1bb8-4594-a4ad-e58cffcccd14 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:38.562227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556187a-fd1e-4668-ab9f-ef0f684caf56 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:38.562892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556187a-fd1e-4668-ab9f-ef0f684caf56 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:38.563180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556187a-fd1e-4668-ab9f-ef0f684caf56 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:38.563511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556187a-fd1e-4668-ab9f-ef0f684caf56 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects/435b454a850348e3b12fc4a8729a2c57/users/265c4807911d48d88e482dcd6c2363f5/roles/79f3e40af8104ced915aabd2e9ca21bf` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:38.578570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556187a-fd1e-4668-ab9f-ef0f684caf56 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_grant(project_id=435b454a850348e3b12fc4a8729a2c57, user_id=265c4807911d48d88e482dcd6c2363f5, role_id=79f3e40af8104ced915aabd2e9ca21bf)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:38.581301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556187a-fd1e-4668-ab9f-ef0f684caf56 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:38.594160 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4129/8209] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:38 2022] PUT /identity/v3/projects/435b454a850348e3b12fc4a8729a2c57/users/265c4807911d48d88e482dcd6c2363f5/roles/79f3e40af8104ced915aabd2e9ca21bf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:38.598268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809fbab-daa0-4e16-99ee-dfa8a79a251c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:38.609536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809fbab-daa0-4e16-99ee-dfa8a79a251c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:38.668992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264b542-581a-4d9a-9bf8-befc63856f33 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:38.669666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264b542-581a-4d9a-9bf8-befc63856f33 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:38.669955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264b542-581a-4d9a-9bf8-befc63856f33 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:38.670236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264b542-581a-4d9a-9bf8-befc63856f33 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects/435b454a850348e3b12fc4a8729a2c57/users/265c4807911d48d88e482dcd6c2363f5/roles/ce575f4cb6af49a3bbf3c05b837cfe62` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:38.673076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264b542-581a-4d9a-9bf8-befc63856f33 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_grant(project_id=435b454a850348e3b12fc4a8729a2c57, user_id=265c4807911d48d88e482dcd6c2363f5, role_id=ce575f4cb6af49a3bbf3c05b837cfe62)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:38.675771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264b542-581a-4d9a-9bf8-befc63856f33 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:38.688104 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4081/8210] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:38 2022] PUT /identity/v3/projects/435b454a850348e3b12fc4a8729a2c57/users/265c4807911d48d88e482dcd6c2363f5/roles/ce575f4cb6af49a3bbf3c05b837cfe62 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:38.692306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556187a-fd1e-4668-ab9f-ef0f684caf56 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:38.703647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556187a-fd1e-4668-ab9f-ef0f684caf56 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:38.759770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f2f61-6f69-4673-b664-1f16066f66a6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:38.760396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f2f61-6f69-4673-b664-1f16066f66a6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:38.760683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f2f61-6f69-4673-b664-1f16066f66a6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:38.760991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f2f61-6f69-4673-b664-1f16066f66a6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:38.761712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f2f61-6f69-4673-b664-1f16066f66a6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:38.763581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f2f61-6f69-4673-b664-1f16066f66a6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:38.794692 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4130/8211] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:38 2022] GET /identity/v3/users => generated 7507 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:38.800389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b37c8c-c7f9-4a23-8d13-834a916663cf None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:38.800679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b37c8c-c7f9-4a23-8d13-834a916663cf None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:38.800953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b37c8c-c7f9-4a23-8d13-834a916663cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:38.837551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d9b37c8c-c7f9-4a23-8d13-834a916663cf None None] MFA Rules not processed for user `265c4807911d48d88e482dcd6c2363f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:38.838813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d9b37c8c-c7f9-4a23-8d13-834a916663cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:38.866388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=4,keystone:SELECT=90,keystone:INSERT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:38.907782 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4082/8212] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:34:38.917804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d153ab9-24e2-4c10-8de1-6aca2637c345 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:38.918100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d153ab9-24e2-4c10-8de1-6aca2637c345 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:38.918381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d153ab9-24e2-4c10-8de1-6aca2637c345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:38.937695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8d153ab9-24e2-4c10-8de1-6aca2637c345 None None] MFA Rules not processed for user `265c4807911d48d88e482dcd6c2363f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:38.938937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8d153ab9-24e2-4c10-8de1-6aca2637c345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:38.946219 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4131/8213] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:38.950319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b37c8c-c7f9-4a23-8d13-834a916663cf None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:38.960046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b37c8c-c7f9-4a23-8d13-834a916663cf None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:38.964210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab807d3-3d2f-4225-969a-d9a1cb913e1e tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265c4807911d48d88e482dcd6c2363f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '435b454a850348e3b12fc4a8729a2c57', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1148214328', 'tempest-NotDelegatedRole-834249419'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:38.964822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab807d3-3d2f-4225-969a-d9a1cb913e1e tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:38.965109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab807d3-3d2f-4225-969a-d9a1cb913e1e tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:38.965387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab807d3-3d2f-4225-969a-d9a1cb913e1e tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:38.966092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab807d3-3d2f-4225-969a-d9a1cb913e1e tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: Authorizing `identity:create_trust()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:38.967249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab807d3-3d2f-4225-969a-d9a1cb913e1e tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:39.039103 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4083/8214] 10.222.0.17 () {60 vars in 1174 bytes} [Sat Jul 30 21:34:38 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:39.043505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d153ab9-24e2-4c10-8de1-6aca2637c345 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:39.052217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d153ab9-24e2-4c10-8de1-6aca2637c345 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:39.057359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69702e-796a-472a-bfe1-024a214bd582 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265c4807911d48d88e482dcd6c2363f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '435b454a850348e3b12fc4a8729a2c57', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1148214328', 'tempest-NotDelegatedRole-834249419'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:39.058008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69702e-796a-472a-bfe1-024a214bd582 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:39.058297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69702e-796a-472a-bfe1-024a214bd582 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:39.058582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69702e-796a-472a-bfe1-024a214bd582 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] PATH_INFO: `/v3/OS-TRUST/trusts/33e3dafc17364a819f770cf2fb2f2e5a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:39.064571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69702e-796a-472a-bfe1-024a214bd582 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: Authorizing `identity:get_trust(trust_id=33e3dafc17364a819f770cf2fb2f2e5a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:39.066058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69702e-796a-472a-bfe1-024a214bd582 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:39.073380 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4132/8215] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:34:39 2022] GET /identity/v3/OS-TRUST/trusts/33e3dafc17364a819f770cf2fb2f2e5a => generated 834 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:39.077966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab807d3-3d2f-4225-969a-d9a1cb913e1e tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:39.087479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab807d3-3d2f-4225-969a-d9a1cb913e1e tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:39.091844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1a3dc-fe8b-46e1-9797-ac0ee03bd1b5 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265c4807911d48d88e482dcd6c2363f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '435b454a850348e3b12fc4a8729a2c57', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1148214328', 'tempest-NotDelegatedRole-834249419'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:39.092540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1a3dc-fe8b-46e1-9797-ac0ee03bd1b5 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:39.092825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1a3dc-fe8b-46e1-9797-ac0ee03bd1b5 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:39.093795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1a3dc-fe8b-46e1-9797-ac0ee03bd1b5 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] PATH_INFO: `/v3/OS-TRUST/trusts/33e3dafc17364a819f770cf2fb2f2e5a/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:39.099918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1a3dc-fe8b-46e1-9797-ac0ee03bd1b5 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=33e3dafc17364a819f770cf2fb2f2e5a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:39.101370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1a3dc-fe8b-46e1-9797-ac0ee03bd1b5 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:39.108617 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4084/8216] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 21:34:39 2022] GET /identity/v3/OS-TRUST/trusts/33e3dafc17364a819f770cf2fb2f2e5a/roles => generated 371 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:39.112822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69702e-796a-472a-bfe1-024a214bd582 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:39.122354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69702e-796a-472a-bfe1-024a214bd582 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:39.126954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e88e2-a821-4d8f-93a0-f3b707a4cd05 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265c4807911d48d88e482dcd6c2363f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '435b454a850348e3b12fc4a8729a2c57', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1148214328', 'tempest-NotDelegatedRole-834249419'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:39.127682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e88e2-a821-4d8f-93a0-f3b707a4cd05 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:39.128015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e88e2-a821-4d8f-93a0-f3b707a4cd05 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:39.128297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e88e2-a821-4d8f-93a0-f3b707a4cd05 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] PATH_INFO: `/v3/OS-TRUST/trusts/33e3dafc17364a819f770cf2fb2f2e5a/roles/79f3e40af8104ced915aabd2e9ca21bf` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:39.134284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e88e2-a821-4d8f-93a0-f3b707a4cd05 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: Authorizing `identity:get_role_for_trust(trust_id=33e3dafc17364a819f770cf2fb2f2e5a, role_id=79f3e40af8104ced915aabd2e9ca21bf)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:39.135761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e88e2-a821-4d8f-93a0-f3b707a4cd05 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:39.142816 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4133/8217] 10.222.0.17 () {58 vars in 1368 bytes} [Sat Jul 30 21:34:39 2022] GET /identity/v3/OS-TRUST/trusts/33e3dafc17364a819f770cf2fb2f2e5a/roles/79f3e40af8104ced915aabd2e9ca21bf => generated 244 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:39.146730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1a3dc-fe8b-46e1-9797-ac0ee03bd1b5 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:39.156682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1a3dc-fe8b-46e1-9797-ac0ee03bd1b5 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:39.161391 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f7be8-e8e3-45b7-a274-599389cbb486 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265c4807911d48d88e482dcd6c2363f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '435b454a850348e3b12fc4a8729a2c57', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1148214328', 'tempest-NotDelegatedRole-834249419'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:39.162095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f7be8-e8e3-45b7-a274-599389cbb486 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] REQUEST_METHOD: `HEAD` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:39.162418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f7be8-e8e3-45b7-a274-599389cbb486 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:39.162704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f7be8-e8e3-45b7-a274-599389cbb486 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] PATH_INFO: `/v3/OS-TRUST/trusts/33e3dafc17364a819f770cf2fb2f2e5a/roles/79f3e40af8104ced915aabd2e9ca21bf` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:39.168699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f7be8-e8e3-45b7-a274-599389cbb486 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: Authorizing `identity:get_role_for_trust(trust_id=33e3dafc17364a819f770cf2fb2f2e5a, role_id=79f3e40af8104ced915aabd2e9ca21bf)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:39.170133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f7be8-e8e3-45b7-a274-599389cbb486 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:39.176894 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4085/8218] 10.222.0.17 () {58 vars in 1369 bytes} [Sat Jul 30 21:34:39 2022] HEAD /identity/v3/OS-TRUST/trusts/33e3dafc17364a819f770cf2fb2f2e5a/roles/79f3e40af8104ced915aabd2e9ca21bf => generated 0 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:39.180905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e88e2-a821-4d8f-93a0-f3b707a4cd05 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:39.190888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e88e2-a821-4d8f-93a0-f3b707a4cd05 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:39.195061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b54f1b-0108-4b3f-9245-c9e4123c2736 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265c4807911d48d88e482dcd6c2363f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '435b454a850348e3b12fc4a8729a2c57', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1148214328', 'tempest-NotDelegatedRole-834249419'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:39.195983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b54f1b-0108-4b3f-9245-c9e4123c2736 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:39.196123 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b54f1b-0108-4b3f-9245-c9e4123c2736 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:39.196347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b54f1b-0108-4b3f-9245-c9e4123c2736 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] PATH_INFO: `/v3/OS-TRUST/trusts/33e3dafc17364a819f770cf2fb2f2e5a/roles/ce575f4cb6af49a3bbf3c05b837cfe62` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:39.202063 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b54f1b-0108-4b3f-9245-c9e4123c2736 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: Authorizing `identity:get_role_for_trust(trust_id=33e3dafc17364a819f770cf2fb2f2e5a, role_id=ce575f4cb6af49a3bbf3c05b837cfe62)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:39.204040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b54f1b-0108-4b3f-9245-c9e4123c2736 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:39.213997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-06b54f1b-0108-4b3f-9245-c9e4123c2736 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Could not find role: ce575f4cb6af49a3bbf3c05b837cfe62.: keystone.exception.RoleNotFound: Could not find role: ce575f4cb6af49a3bbf3c05b837cfe62. Jul 30 21:34:39.213997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:39.213997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:34:39.213997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:34:39.213997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:34:39.213997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:34:39.213997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:34:39.213997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:34:39.213997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:34:39.213997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:34:39.213997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:34:39.213997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:34:39.213997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 30 21:34:39.213997 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 21:34:39.218703 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ce575f4cb6af49a3bbf3c05b837cfe62. Jul 30 21:34:39.218703 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:34:39.218703 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4134/8219] 10.222.0.17 () {58 vars in 1368 bytes} [Sat Jul 30 21:34:39 2022] GET /identity/v3/OS-TRUST/trusts/33e3dafc17364a819f770cf2fb2f2e5a/roles/ce575f4cb6af49a3bbf3c05b837cfe62 => generated 110 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 30 21:34:39.219673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f7be8-e8e3-45b7-a274-599389cbb486 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:39.228969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f7be8-e8e3-45b7-a274-599389cbb486 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:39.233114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44eeb9-9d6e-4424-9c4e-1f4431f6f20b tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265c4807911d48d88e482dcd6c2363f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '435b454a850348e3b12fc4a8729a2c57', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1148214328', 'tempest-NotDelegatedRole-834249419'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:39.233783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44eeb9-9d6e-4424-9c4e-1f4431f6f20b tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] REQUEST_METHOD: `HEAD` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:39.234071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44eeb9-9d6e-4424-9c4e-1f4431f6f20b tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:39.234350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44eeb9-9d6e-4424-9c4e-1f4431f6f20b tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] PATH_INFO: `/v3/OS-TRUST/trusts/33e3dafc17364a819f770cf2fb2f2e5a/roles/ce575f4cb6af49a3bbf3c05b837cfe62` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:39.240116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44eeb9-9d6e-4424-9c4e-1f4431f6f20b tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: Authorizing `identity:get_role_for_trust(trust_id=33e3dafc17364a819f770cf2fb2f2e5a, role_id=ce575f4cb6af49a3bbf3c05b837cfe62)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:39.241531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44eeb9-9d6e-4424-9c4e-1f4431f6f20b tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:39.252247 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-3d44eeb9-9d6e-4424-9c4e-1f4431f6f20b tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Could not find role: ce575f4cb6af49a3bbf3c05b837cfe62.: keystone.exception.RoleNotFound: Could not find role: ce575f4cb6af49a3bbf3c05b837cfe62. Jul 30 21:34:39.252247 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:39.252247 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:34:39.252247 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:34:39.252247 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:34:39.252247 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:34:39.252247 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:34:39.252247 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:34:39.252247 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:34:39.252247 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:34:39.252247 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:34:39.252247 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:34:39.252247 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 30 21:34:39.252247 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 21:34:39.253464 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ce575f4cb6af49a3bbf3c05b837cfe62. Jul 30 21:34:39.253464 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:34:39.253464 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4086/8220] 10.222.0.17 () {58 vars in 1369 bytes} [Sat Jul 30 21:34:39 2022] HEAD /identity/v3/OS-TRUST/trusts/33e3dafc17364a819f770cf2fb2f2e5a/roles/ce575f4cb6af49a3bbf3c05b837cfe62 => generated 0 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:34:39.257222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b54f1b-0108-4b3f-9245-c9e4123c2736 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:39.267746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b54f1b-0108-4b3f-9245-c9e4123c2736 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:39.271959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b75bd-9d96-4bc6-b588-623bbf993903 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265c4807911d48d88e482dcd6c2363f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '435b454a850348e3b12fc4a8729a2c57', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1148214328', 'tempest-NotDelegatedRole-834249419'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:39.272640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b75bd-9d96-4bc6-b588-623bbf993903 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:39.272931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b75bd-9d96-4bc6-b588-623bbf993903 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:39.273223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b75bd-9d96-4bc6-b588-623bbf993903 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] PATH_INFO: `/v3/OS-TRUST/trusts/33e3dafc17364a819f770cf2fb2f2e5a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:39.274828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:39.280288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b75bd-9d96-4bc6-b588-623bbf993903 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: Authorizing `identity:delete_trust(trust_id=33e3dafc17364a819f770cf2fb2f2e5a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:39.281989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b75bd-9d96-4bc6-b588-623bbf993903 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:39.298304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-423b75bd-9d96-4bc6-b588-623bbf993903 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '33e3dafc17364a819f770cf2fb2f2e5a', 'request_id': 'req-423b75bd-9d96-4bc6-b588-623bbf993903'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:39.305435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-423b75bd-9d96-4bc6-b588-623bbf993903 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '33e3dafc17364a819f770cf2fb2f2e5a', 'request_id': 'req-423b75bd-9d96-4bc6-b588-623bbf993903'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:39.306076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-423b75bd-9d96-4bc6-b588-623bbf993903 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '33e3dafc17364a819f770cf2fb2f2e5a', 'request_id': 'req-423b75bd-9d96-4bc6-b588-623bbf993903'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:39.313422 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4135/8221] 10.222.0.17 () {58 vars in 1254 bytes} [Sat Jul 30 21:34:39 2022] DELETE /identity/v3/OS-TRUST/trusts/33e3dafc17364a819f770cf2fb2f2e5a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:39.317725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44eeb9-9d6e-4424-9c4e-1f4431f6f20b tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:39.319496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3d44eeb9-9d6e-4424-9c4e-1f4431f6f20b tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:39.333294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44eeb9-9d6e-4424-9c4e-1f4431f6f20b tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:39.337442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fd472-e99c-4e76-9aed-a1e76b7ceda6 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265c4807911d48d88e482dcd6c2363f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '435b454a850348e3b12fc4a8729a2c57', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1148214328', 'tempest-NotDelegatedRole-834249419'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:39.338082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fd472-e99c-4e76-9aed-a1e76b7ceda6 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:39.338371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fd472-e99c-4e76-9aed-a1e76b7ceda6 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:39.338650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fd472-e99c-4e76-9aed-a1e76b7ceda6 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] PATH_INFO: `/v3/OS-TRUST/trusts/33e3dafc17364a819f770cf2fb2f2e5a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:39.347459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-874fd472-e99c-4e76-9aed-a1e76b7ceda6 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Could not find trust: 33e3dafc17364a819f770cf2fb2f2e5a.: keystone.exception.TrustNotFound: Could not find trust: 33e3dafc17364a819f770cf2fb2f2e5a. Jul 30 21:34:39.347459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:39.347459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:34:39.347459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:34:39.347459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:34:39.347459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:34:39.347459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:34:39.347459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:34:39.347459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:34:39.347459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:34:39.347459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:34:39.347459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:34:39.347459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 30 21:34:39.347459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 30 21:34:39.347459 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 30 21:34:39.348734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 30 21:34:39.348734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 30 21:34:39.348734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 30 21:34:39.348734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 30 21:34:39.348734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 30 21:34:39.348734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:34:39.348734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:34:39.348734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 30 21:34:39.348734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 30 21:34:39.348734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 30 21:34:39.348734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 30 21:34:39.348734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 33e3dafc17364a819f770cf2fb2f2e5a. Jul 30 21:34:39.348734 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:34:39.348734 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4087/8222] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:34:39 2022] GET /identity/v3/OS-TRUST/trusts/33e3dafc17364a819f770cf2fb2f2e5a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:34:39.352623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b75bd-9d96-4bc6-b588-623bbf993903 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:39.354158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-423b75bd-9d96-4bc6-b588-623bbf993903 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:39.369505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b75bd-9d96-4bc6-b588-623bbf993903 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:39.374201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055a9ad-704b-4dab-bd44-f143dab63eaf tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:39.375628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055a9ad-704b-4dab-bd44-f143dab63eaf tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:39.375919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055a9ad-704b-4dab-bd44-f143dab63eaf tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:39.376199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055a9ad-704b-4dab-bd44-f143dab63eaf tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles/ce575f4cb6af49a3bbf3c05b837cfe62` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:39.377819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055a9ad-704b-4dab-bd44-f143dab63eaf tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ce575f4cb6af49a3bbf3c05b837cfe62)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:39.379462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055a9ad-704b-4dab-bd44-f143dab63eaf tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:39.417039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a055a9ad-704b-4dab-bd44-f143dab63eaf tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invalidating the token cache because role ce575f4cb6af49a3bbf3c05b837cfe62 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:39.417335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a055a9ad-704b-4dab-bd44-f143dab63eaf tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:39.418000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a055a9ad-704b-4dab-bd44-f143dab63eaf tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:39.420198 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4136/8223] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:39 2022] DELETE /identity/v3/roles/ce575f4cb6af49a3bbf3c05b837cfe62 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:39.425019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fd472-e99c-4e76-9aed-a1e76b7ceda6 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:39.427884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-874fd472-e99c-4e76-9aed-a1e76b7ceda6 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:39.446800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fd472-e99c-4e76-9aed-a1e76b7ceda6 tempest-TrustsV3TestJSON-1967017902 tempest-user-1167551285] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:39.510104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:39.520069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372198af-1f90-4c08-8a45-2e70eb8b7172 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:39.520779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372198af-1f90-4c08-8a45-2e70eb8b7172 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:39.521188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372198af-1f90-4c08-8a45-2e70eb8b7172 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:39.521519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372198af-1f90-4c08-8a45-2e70eb8b7172 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles/79f3e40af8104ced915aabd2e9ca21bf` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:39.523041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372198af-1f90-4c08-8a45-2e70eb8b7172 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_role(role_id=79f3e40af8104ced915aabd2e9ca21bf)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:39.524711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372198af-1f90-4c08-8a45-2e70eb8b7172 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:39.560562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-372198af-1f90-4c08-8a45-2e70eb8b7172 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invalidating the token cache because role 79f3e40af8104ced915aabd2e9ca21bf has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:39.560855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-372198af-1f90-4c08-8a45-2e70eb8b7172 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:39.561539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-372198af-1f90-4c08-8a45-2e70eb8b7172 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:39.563871 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4088/8224] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:39 2022] DELETE /identity/v3/roles/79f3e40af8104ced915aabd2e9ca21bf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:39.568076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055a9ad-704b-4dab-bd44-f143dab63eaf tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:39.579645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055a9ad-704b-4dab-bd44-f143dab63eaf tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:39.637277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991848c-278b-4f0a-af89-6e7e6f9e7926 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:39.637931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991848c-278b-4f0a-af89-6e7e6f9e7926 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:39.638224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991848c-278b-4f0a-af89-6e7e6f9e7926 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:39.638512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991848c-278b-4f0a-af89-6e7e6f9e7926 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/users/265c4807911d48d88e482dcd6c2363f5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:39.639737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991848c-278b-4f0a-af89-6e7e6f9e7926 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_user(user_id=265c4807911d48d88e482dcd6c2363f5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:39.641711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991848c-278b-4f0a-af89-6e7e6f9e7926 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:39.685634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4991848c-278b-4f0a-af89-6e7e6f9e7926 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '265c4807911d48d88e482dcd6c2363f5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:39.698271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4991848c-278b-4f0a-af89-6e7e6f9e7926 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '265c4807911d48d88e482dcd6c2363f5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:39.698895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4991848c-278b-4f0a-af89-6e7e6f9e7926 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '265c4807911d48d88e482dcd6c2363f5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:39.706064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4991848c-278b-4f0a-af89-6e7e6f9e7926 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '265c4807911d48d88e482dcd6c2363f5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:39.706725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4991848c-278b-4f0a-af89-6e7e6f9e7926 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '265c4807911d48d88e482dcd6c2363f5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:39.719860 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4137/8225] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:39 2022] DELETE /identity/v3/users/265c4807911d48d88e482dcd6c2363f5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:39.724051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372198af-1f90-4c08-8a45-2e70eb8b7172 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:39.725449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-372198af-1f90-4c08-8a45-2e70eb8b7172 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:39.740196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372198af-1f90-4c08-8a45-2e70eb8b7172 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:39.803451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e3613-dee4-4ce4-b02b-a039fc6dcbb6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:39.804112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e3613-dee4-4ce4-b02b-a039fc6dcbb6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:39.804405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e3613-dee4-4ce4-b02b-a039fc6dcbb6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:39.804688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e3613-dee4-4ce4-b02b-a039fc6dcbb6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects/435b454a850348e3b12fc4a8729a2c57` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:39.805868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e3613-dee4-4ce4-b02b-a039fc6dcbb6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=435b454a850348e3b12fc4a8729a2c57)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:39.808107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e3613-dee4-4ce4-b02b-a039fc6dcbb6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:39.860260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-320e3613-dee4-4ce4-b02b-a039fc6dcbb6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435b454a850348e3b12fc4a8729a2c57', 'request_id': 'req-320e3613-dee4-4ce4-b02b-a039fc6dcbb6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:39.867351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-320e3613-dee4-4ce4-b02b-a039fc6dcbb6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435b454a850348e3b12fc4a8729a2c57', 'request_id': 'req-320e3613-dee4-4ce4-b02b-a039fc6dcbb6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:39.873186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-320e3613-dee4-4ce4-b02b-a039fc6dcbb6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435b454a850348e3b12fc4a8729a2c57', 'request_id': 'req-320e3613-dee4-4ce4-b02b-a039fc6dcbb6'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:39.885112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-320e3613-dee4-4ce4-b02b-a039fc6dcbb6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] The token cache is being invalidate because project 435b454a850348e3b12fc4a8729a2c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:39.885407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-320e3613-dee4-4ce4-b02b-a039fc6dcbb6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:39.886061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-320e3613-dee4-4ce4-b02b-a039fc6dcbb6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:39.887638 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4089/8226] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:39 2022] DELETE /identity/v3/projects/435b454a850348e3b12fc4a8729a2c57 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:39.893349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991848c-278b-4f0a-af89-6e7e6f9e7926 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:39.894750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4991848c-278b-4f0a-af89-6e7e6f9e7926 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:39.903797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=14 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:39.908588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991848c-278b-4f0a-af89-6e7e6f9e7926 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:39.967624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafb8f3-e2e9-4d42-8450-6a0839431919 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:39.968317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafb8f3-e2e9-4d42-8450-6a0839431919 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:39.968609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafb8f3-e2e9-4d42-8450-6a0839431919 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:39.968895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafb8f3-e2e9-4d42-8450-6a0839431919 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:39.969553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafb8f3-e2e9-4d42-8450-6a0839431919 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:39.971486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafb8f3-e2e9-4d42-8450-6a0839431919 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:40.003012 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4138/8227] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 30 21:34:39 2022] POST /identity/v3/projects => generated 328 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:40.007115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e3613-dee4-4ce4-b02b-a039fc6dcbb6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:40.008585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-320e3613-dee4-4ce4-b02b-a039fc6dcbb6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:40.022410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e3613-dee4-4ce4-b02b-a039fc6dcbb6 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:40.073236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:40.088899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c4a80-23f7-4aa0-86f4-9bb90f349844 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:40.089535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c4a80-23f7-4aa0-86f4-9bb90f349844 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:40.089824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c4a80-23f7-4aa0-86f4-9bb90f349844 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:40.090107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c4a80-23f7-4aa0-86f4-9bb90f349844 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:40.090936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c4a80-23f7-4aa0-86f4-9bb90f349844 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:40.092943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c4a80-23f7-4aa0-86f4-9bb90f349844 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:40.116756 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4090/8228] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:40 2022] POST /identity/v3/users => generated 413 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:40.120822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafb8f3-e2e9-4d42-8450-6a0839431919 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:40.132267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafb8f3-e2e9-4d42-8450-6a0839431919 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:40.136847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17de963-c8d7-4f3f-b2f5-df88b2613a28 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:40.137463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17de963-c8d7-4f3f-b2f5-df88b2613a28 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:40.137753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17de963-c8d7-4f3f-b2f5-df88b2613a28 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:40.138037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17de963-c8d7-4f3f-b2f5-df88b2613a28 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:40.138773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17de963-c8d7-4f3f-b2f5-df88b2613a28 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:40.140404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17de963-c8d7-4f3f-b2f5-df88b2613a28 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:40.155187 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4139/8229] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:34:40 2022] POST /identity/v3/roles => generated 243 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:40.159819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c4a80-23f7-4aa0-86f4-9bb90f349844 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:40.170845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c4a80-23f7-4aa0-86f4-9bb90f349844 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:40.176141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a532ee-4819-4c63-abc3-71448a91d59c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:40.176751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a532ee-4819-4c63-abc3-71448a91d59c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:40.177043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a532ee-4819-4c63-abc3-71448a91d59c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:40.177328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a532ee-4819-4c63-abc3-71448a91d59c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:40.178035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a532ee-4819-4c63-abc3-71448a91d59c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:40.179671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a532ee-4819-4c63-abc3-71448a91d59c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:40.193671 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4091/8230] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 30 21:34:40 2022] POST /identity/v3/roles => generated 247 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:40.197716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17de963-c8d7-4f3f-b2f5-df88b2613a28 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:40.208441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17de963-c8d7-4f3f-b2f5-df88b2613a28 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:40.213100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841809c-2c90-4348-ba0a-d8dbce383e62 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:40.213756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841809c-2c90-4348-ba0a-d8dbce383e62 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:40.214046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841809c-2c90-4348-ba0a-d8dbce383e62 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:40.214329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841809c-2c90-4348-ba0a-d8dbce383e62 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects/a9934553835945dcad78be9797c929e7/users/97a8fa3943a34867af36f31e1da1cde5/roles/1d2cda3873ec4c36bcc6a205952823f5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:40.229630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841809c-2c90-4348-ba0a-d8dbce383e62 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a9934553835945dcad78be9797c929e7, user_id=97a8fa3943a34867af36f31e1da1cde5, role_id=1d2cda3873ec4c36bcc6a205952823f5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:40.232260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841809c-2c90-4348-ba0a-d8dbce383e62 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:40.245729 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4140/8231] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:40 2022] PUT /identity/v3/projects/a9934553835945dcad78be9797c929e7/users/97a8fa3943a34867af36f31e1da1cde5/roles/1d2cda3873ec4c36bcc6a205952823f5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:40.250235 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a532ee-4819-4c63-abc3-71448a91d59c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:40.261418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a532ee-4819-4c63-abc3-71448a91d59c tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:40.318419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ab53d-a04d-4378-ac33-c97bdec33394 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:40.319095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ab53d-a04d-4378-ac33-c97bdec33394 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:40.319425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ab53d-a04d-4378-ac33-c97bdec33394 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:40.319716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ab53d-a04d-4378-ac33-c97bdec33394 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects/a9934553835945dcad78be9797c929e7/users/97a8fa3943a34867af36f31e1da1cde5/roles/54c3c962e22d45648acf4fc12b92ee7c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:40.322289 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ab53d-a04d-4378-ac33-c97bdec33394 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a9934553835945dcad78be9797c929e7, user_id=97a8fa3943a34867af36f31e1da1cde5, role_id=54c3c962e22d45648acf4fc12b92ee7c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:40.324988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ab53d-a04d-4378-ac33-c97bdec33394 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:40.337986 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4092/8232] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:40 2022] PUT /identity/v3/projects/a9934553835945dcad78be9797c929e7/users/97a8fa3943a34867af36f31e1da1cde5/roles/54c3c962e22d45648acf4fc12b92ee7c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:40.341984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841809c-2c90-4348-ba0a-d8dbce383e62 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:40.353556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841809c-2c90-4348-ba0a-d8dbce383e62 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:40.413419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa8748-9a7d-4ecb-a951-41821cd3c52b tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:40.414048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa8748-9a7d-4ecb-a951-41821cd3c52b tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:40.414340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa8748-9a7d-4ecb-a951-41821cd3c52b tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:40.414624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa8748-9a7d-4ecb-a951-41821cd3c52b tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:40.415377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa8748-9a7d-4ecb-a951-41821cd3c52b tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:40.417234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa8748-9a7d-4ecb-a951-41821cd3c52b tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:40.443783 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4141/8233] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:40 2022] GET /identity/v3/users => generated 7504 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:40.448828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ea8d5-45bd-45a5-b084-bc827b9b49e2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:40.449120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ea8d5-45bd-45a5-b084-bc827b9b49e2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:40.449403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ea8d5-45bd-45a5-b084-bc827b9b49e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:40.490938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9c4ea8d5-45bd-45a5-b084-bc827b9b49e2 None None] MFA Rules not processed for user `97a8fa3943a34867af36f31e1da1cde5`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:40.492112 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9c4ea8d5-45bd-45a5-b084-bc827b9b49e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:40.560185 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4093/8234] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:40.570854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575248f-83c9-4b5b-8ec0-317f71b3210e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:40.571151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575248f-83c9-4b5b-8ec0-317f71b3210e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:40.571548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575248f-83c9-4b5b-8ec0-317f71b3210e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:40.591945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a575248f-83c9-4b5b-8ec0-317f71b3210e None None] MFA Rules not processed for user `97a8fa3943a34867af36f31e1da1cde5`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:40.593765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a575248f-83c9-4b5b-8ec0-317f71b3210e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:40.601314 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4142/8235] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:40.605447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ea8d5-45bd-45a5-b084-bc827b9b49e2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:40.614856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ea8d5-45bd-45a5-b084-bc827b9b49e2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:40.618977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4898b28-2ba8-48b1-8d17-b7f3ba8013d9 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97a8fa3943a34867af36f31e1da1cde5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9934553835945dcad78be9797c929e7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-994316870', 'tempest-NotDelegatedRole-1933460062'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:40.619623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4898b28-2ba8-48b1-8d17-b7f3ba8013d9 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:40.619910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4898b28-2ba8-48b1-8d17-b7f3ba8013d9 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:40.620188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4898b28-2ba8-48b1-8d17-b7f3ba8013d9 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:40.620901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4898b28-2ba8-48b1-8d17-b7f3ba8013d9 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: Authorizing `identity:create_trust()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:40.622083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4898b28-2ba8-48b1-8d17-b7f3ba8013d9 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:40.662874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:40.694002 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4094/8236] 10.222.0.17 () {60 vars in 1174 bytes} [Sat Jul 30 21:34:40 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:40.698206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575248f-83c9-4b5b-8ec0-317f71b3210e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:40.707567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575248f-83c9-4b5b-8ec0-317f71b3210e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:40.711836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4681b7-07bc-4522-b4bb-06abdec58486 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97a8fa3943a34867af36f31e1da1cde5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9934553835945dcad78be9797c929e7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-994316870', 'tempest-NotDelegatedRole-1933460062'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:40.712480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4681b7-07bc-4522-b4bb-06abdec58486 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:40.712772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4681b7-07bc-4522-b4bb-06abdec58486 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:40.713059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4681b7-07bc-4522-b4bb-06abdec58486 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] PATH_INFO: `/v3/OS-TRUST/trusts/4d1c4293d05f464999549a1127962693` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:40.719783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4681b7-07bc-4522-b4bb-06abdec58486 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: Authorizing `identity:get_trust(trust_id=4d1c4293d05f464999549a1127962693)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:40.721229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4681b7-07bc-4522-b4bb-06abdec58486 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:40.728355 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4143/8237] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:34:40 2022] GET /identity/v3/OS-TRUST/trusts/4d1c4293d05f464999549a1127962693 => generated 834 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:40.732304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4898b28-2ba8-48b1-8d17-b7f3ba8013d9 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:40.741845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4898b28-2ba8-48b1-8d17-b7f3ba8013d9 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:40.745962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367ba05-cff5-4354-ac6b-410e6010d38e tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97a8fa3943a34867af36f31e1da1cde5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9934553835945dcad78be9797c929e7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-994316870', 'tempest-NotDelegatedRole-1933460062'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:40.746595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367ba05-cff5-4354-ac6b-410e6010d38e tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:40.746883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367ba05-cff5-4354-ac6b-410e6010d38e tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:40.747167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367ba05-cff5-4354-ac6b-410e6010d38e tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] PATH_INFO: `/v3/OS-TRUST/trusts/4d1c4293d05f464999549a1127962693/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:40.753761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367ba05-cff5-4354-ac6b-410e6010d38e tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=4d1c4293d05f464999549a1127962693)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:40.755233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367ba05-cff5-4354-ac6b-410e6010d38e tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:40.762101 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4095/8238] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 21:34:40 2022] GET /identity/v3/OS-TRUST/trusts/4d1c4293d05f464999549a1127962693/roles => generated 370 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:40.766839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4681b7-07bc-4522-b4bb-06abdec58486 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:40.776204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4681b7-07bc-4522-b4bb-06abdec58486 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:40.780413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7167e-b483-48c2-a237-9e79e657b6f3 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97a8fa3943a34867af36f31e1da1cde5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9934553835945dcad78be9797c929e7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-994316870', 'tempest-NotDelegatedRole-1933460062'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:40.781351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7167e-b483-48c2-a237-9e79e657b6f3 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:40.781853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7167e-b483-48c2-a237-9e79e657b6f3 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:40.782369 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7167e-b483-48c2-a237-9e79e657b6f3 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] PATH_INFO: `/v3/OS-TRUST/trusts/4d1c4293d05f464999549a1127962693/roles/1d2cda3873ec4c36bcc6a205952823f5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:40.790286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7167e-b483-48c2-a237-9e79e657b6f3 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: Authorizing `identity:get_role_for_trust(trust_id=4d1c4293d05f464999549a1127962693, role_id=1d2cda3873ec4c36bcc6a205952823f5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:40.791767 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7167e-b483-48c2-a237-9e79e657b6f3 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:40.798887 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4144/8239] 10.222.0.17 () {58 vars in 1368 bytes} [Sat Jul 30 21:34:40 2022] GET /identity/v3/OS-TRUST/trusts/4d1c4293d05f464999549a1127962693/roles/1d2cda3873ec4c36bcc6a205952823f5 => generated 243 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:40.802889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367ba05-cff5-4354-ac6b-410e6010d38e tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:40.812774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367ba05-cff5-4354-ac6b-410e6010d38e tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:40.816924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0c1a8-fe92-4709-851c-a00bb9c97ab2 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97a8fa3943a34867af36f31e1da1cde5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9934553835945dcad78be9797c929e7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-994316870', 'tempest-NotDelegatedRole-1933460062'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:40.817577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0c1a8-fe92-4709-851c-a00bb9c97ab2 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] REQUEST_METHOD: `HEAD` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:40.817865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0c1a8-fe92-4709-851c-a00bb9c97ab2 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:40.818144 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0c1a8-fe92-4709-851c-a00bb9c97ab2 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] PATH_INFO: `/v3/OS-TRUST/trusts/4d1c4293d05f464999549a1127962693/roles/1d2cda3873ec4c36bcc6a205952823f5` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:40.823947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0c1a8-fe92-4709-851c-a00bb9c97ab2 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: Authorizing `identity:get_role_for_trust(trust_id=4d1c4293d05f464999549a1127962693, role_id=1d2cda3873ec4c36bcc6a205952823f5)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:40.825371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0c1a8-fe92-4709-851c-a00bb9c97ab2 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:40.833113 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4096/8240] 10.222.0.17 () {58 vars in 1369 bytes} [Sat Jul 30 21:34:40 2022] HEAD /identity/v3/OS-TRUST/trusts/4d1c4293d05f464999549a1127962693/roles/1d2cda3873ec4c36bcc6a205952823f5 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 30 21:34:40.837364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7167e-b483-48c2-a237-9e79e657b6f3 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:40.847676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7167e-b483-48c2-a237-9e79e657b6f3 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:40.852363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cbe1d-8c07-43e4-8eed-3918f4abdc10 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97a8fa3943a34867af36f31e1da1cde5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9934553835945dcad78be9797c929e7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-994316870', 'tempest-NotDelegatedRole-1933460062'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:40.853028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cbe1d-8c07-43e4-8eed-3918f4abdc10 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:40.853318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cbe1d-8c07-43e4-8eed-3918f4abdc10 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:40.853623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cbe1d-8c07-43e4-8eed-3918f4abdc10 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] PATH_INFO: `/v3/OS-TRUST/trusts/4d1c4293d05f464999549a1127962693/roles/54c3c962e22d45648acf4fc12b92ee7c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:40.855216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:40.860845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cbe1d-8c07-43e4-8eed-3918f4abdc10 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: Authorizing `identity:get_role_for_trust(trust_id=4d1c4293d05f464999549a1127962693, role_id=54c3c962e22d45648acf4fc12b92ee7c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:40.862808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cbe1d-8c07-43e4-8eed-3918f4abdc10 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:40.873266 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-ef4cbe1d-8c07-43e4-8eed-3918f4abdc10 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Could not find role: 54c3c962e22d45648acf4fc12b92ee7c.: keystone.exception.RoleNotFound: Could not find role: 54c3c962e22d45648acf4fc12b92ee7c. Jul 30 21:34:40.873266 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:40.873266 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:34:40.873266 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:34:40.873266 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:34:40.873266 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:34:40.873266 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:34:40.873266 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:34:40.873266 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:34:40.873266 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:34:40.873266 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:34:40.873266 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:34:40.873266 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 30 21:34:40.873266 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 21:34:40.875364 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 54c3c962e22d45648acf4fc12b92ee7c. Jul 30 21:34:40.875364 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:34:40.875364 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4145/8241] 10.222.0.17 () {58 vars in 1368 bytes} [Sat Jul 30 21:34:40 2022] GET /identity/v3/OS-TRUST/trusts/4d1c4293d05f464999549a1127962693/roles/54c3c962e22d45648acf4fc12b92ee7c => generated 110 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 30 21:34:40.879640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0c1a8-fe92-4709-851c-a00bb9c97ab2 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:40.889253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0c1a8-fe92-4709-851c-a00bb9c97ab2 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:40.894006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcaf14-305e-4446-9ee2-176341519420 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97a8fa3943a34867af36f31e1da1cde5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9934553835945dcad78be9797c929e7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-994316870', 'tempest-NotDelegatedRole-1933460062'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:40.894660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcaf14-305e-4446-9ee2-176341519420 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] REQUEST_METHOD: `HEAD` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:40.894949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcaf14-305e-4446-9ee2-176341519420 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:40.895234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcaf14-305e-4446-9ee2-176341519420 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] PATH_INFO: `/v3/OS-TRUST/trusts/4d1c4293d05f464999549a1127962693/roles/54c3c962e22d45648acf4fc12b92ee7c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:40.901069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcaf14-305e-4446-9ee2-176341519420 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: Authorizing `identity:get_role_for_trust(trust_id=4d1c4293d05f464999549a1127962693, role_id=54c3c962e22d45648acf4fc12b92ee7c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:40.902502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcaf14-305e-4446-9ee2-176341519420 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:40.912634 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-e7fcaf14-305e-4446-9ee2-176341519420 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Could not find role: 54c3c962e22d45648acf4fc12b92ee7c.: keystone.exception.RoleNotFound: Could not find role: 54c3c962e22d45648acf4fc12b92ee7c. Jul 30 21:34:40.912634 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:40.912634 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:34:40.912634 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:34:40.912634 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:34:40.912634 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:34:40.912634 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:34:40.912634 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:34:40.912634 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:34:40.912634 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:34:40.912634 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:34:40.912634 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:34:40.912634 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 30 21:34:40.912634 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 30 21:34:40.913868 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 54c3c962e22d45648acf4fc12b92ee7c. Jul 30 21:34:40.913868 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:34:40.913868 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4097/8242] 10.222.0.17 () {58 vars in 1369 bytes} [Sat Jul 30 21:34:40 2022] HEAD /identity/v3/OS-TRUST/trusts/4d1c4293d05f464999549a1127962693/roles/54c3c962e22d45648acf4fc12b92ee7c => generated 0 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 30 21:34:40.917948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cbe1d-8c07-43e4-8eed-3918f4abdc10 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:40.927923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cbe1d-8c07-43e4-8eed-3918f4abdc10 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:40.932322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c20fa-0440-425c-9bf3-20f6689ace02 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97a8fa3943a34867af36f31e1da1cde5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9934553835945dcad78be9797c929e7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-994316870', 'tempest-NotDelegatedRole-1933460062'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:40.932952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c20fa-0440-425c-9bf3-20f6689ace02 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:40.933241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c20fa-0440-425c-9bf3-20f6689ace02 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:40.933525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c20fa-0440-425c-9bf3-20f6689ace02 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] PATH_INFO: `/v3/OS-TRUST/trusts/4d1c4293d05f464999549a1127962693` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:40.939832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c20fa-0440-425c-9bf3-20f6689ace02 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: Authorizing `identity:delete_trust(trust_id=4d1c4293d05f464999549a1127962693)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:40.941264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c20fa-0440-425c-9bf3-20f6689ace02 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:40.958311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-376c20fa-0440-425c-9bf3-20f6689ace02 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '4d1c4293d05f464999549a1127962693', 'request_id': 'req-376c20fa-0440-425c-9bf3-20f6689ace02'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:40.965613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-376c20fa-0440-425c-9bf3-20f6689ace02 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '4d1c4293d05f464999549a1127962693', 'request_id': 'req-376c20fa-0440-425c-9bf3-20f6689ace02'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:40.966280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-376c20fa-0440-425c-9bf3-20f6689ace02 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '4d1c4293d05f464999549a1127962693', 'request_id': 'req-376c20fa-0440-425c-9bf3-20f6689ace02'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:40.972637 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4146/8243] 10.222.0.17 () {58 vars in 1254 bytes} [Sat Jul 30 21:34:40 2022] DELETE /identity/v3/OS-TRUST/trusts/4d1c4293d05f464999549a1127962693 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:40.976664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcaf14-305e-4446-9ee2-176341519420 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:40.978386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e7fcaf14-305e-4446-9ee2-176341519420 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:40.991256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcaf14-305e-4446-9ee2-176341519420 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:40.995570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059476ce-35ff-414d-9ef6-2a86a4a0c087 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97a8fa3943a34867af36f31e1da1cde5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9934553835945dcad78be9797c929e7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-994316870', 'tempest-NotDelegatedRole-1933460062'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:40.996150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059476ce-35ff-414d-9ef6-2a86a4a0c087 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:40.996445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059476ce-35ff-414d-9ef6-2a86a4a0c087 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:40.996726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059476ce-35ff-414d-9ef6-2a86a4a0c087 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] PATH_INFO: `/v3/OS-TRUST/trusts/4d1c4293d05f464999549a1127962693` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:41.006354 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-059476ce-35ff-414d-9ef6-2a86a4a0c087 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Could not find trust: 4d1c4293d05f464999549a1127962693.: keystone.exception.TrustNotFound: Could not find trust: 4d1c4293d05f464999549a1127962693. Jul 30 21:34:41.006354 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:34:41.006354 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:34:41.006354 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:34:41.006354 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:34:41.006354 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:34:41.006354 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:34:41.006354 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:34:41.006354 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:34:41.006354 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:34:41.006354 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:34:41.006354 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:34:41.006354 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 30 21:34:41.006354 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 30 21:34:41.006354 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 30 21:34:41.007659 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 30 21:34:41.007659 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 30 21:34:41.007659 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 30 21:34:41.007659 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 30 21:34:41.007659 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 30 21:34:41.007659 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:34:41.007659 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:34:41.007659 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 30 21:34:41.007659 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 30 21:34:41.007659 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 30 21:34:41.007659 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 30 21:34:41.007659 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 4d1c4293d05f464999549a1127962693. Jul 30 21:34:41.007659 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:34:41.007659 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4098/8244] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:34:40 2022] GET /identity/v3/OS-TRUST/trusts/4d1c4293d05f464999549a1127962693 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:34:41.011790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c20fa-0440-425c-9bf3-20f6689ace02 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:41.013194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-376c20fa-0440-425c-9bf3-20f6689ace02 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:41.029488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c20fa-0440-425c-9bf3-20f6689ace02 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:41.034072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a4880-7989-4704-b92a-e0d4d03600dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:41.034702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a4880-7989-4704-b92a-e0d4d03600dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:41.034992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a4880-7989-4704-b92a-e0d4d03600dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:41.035272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a4880-7989-4704-b92a-e0d4d03600dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles/54c3c962e22d45648acf4fc12b92ee7c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:41.036745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a4880-7989-4704-b92a-e0d4d03600dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_role(role_id=54c3c962e22d45648acf4fc12b92ee7c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:41.038334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a4880-7989-4704-b92a-e0d4d03600dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:41.075353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-537a4880-7989-4704-b92a-e0d4d03600dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invalidating the token cache because role 54c3c962e22d45648acf4fc12b92ee7c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:41.075645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-537a4880-7989-4704-b92a-e0d4d03600dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:41.076320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-537a4880-7989-4704-b92a-e0d4d03600dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:41.078766 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4147/8245] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:41 2022] DELETE /identity/v3/roles/54c3c962e22d45648acf4fc12b92ee7c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:41.083034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059476ce-35ff-414d-9ef6-2a86a4a0c087 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:41.084831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-059476ce-35ff-414d-9ef6-2a86a4a0c087 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:41.099952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059476ce-35ff-414d-9ef6-2a86a4a0c087 tempest-TrustsV3TestJSON-356017573 tempest-user-799667594] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:41.156439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b09fd-a4a7-4090-b189-7afd67eb6451 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:41.157079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b09fd-a4a7-4090-b189-7afd67eb6451 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:41.157372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b09fd-a4a7-4090-b189-7afd67eb6451 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:41.157660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b09fd-a4a7-4090-b189-7afd67eb6451 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/roles/1d2cda3873ec4c36bcc6a205952823f5` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:41.159247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b09fd-a4a7-4090-b189-7afd67eb6451 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1d2cda3873ec4c36bcc6a205952823f5)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:41.161093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b09fd-a4a7-4090-b189-7afd67eb6451 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:41.199442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-109b09fd-a4a7-4090-b189-7afd67eb6451 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invalidating the token cache because role 1d2cda3873ec4c36bcc6a205952823f5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:41.200086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-109b09fd-a4a7-4090-b189-7afd67eb6451 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:41.200386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-109b09fd-a4a7-4090-b189-7afd67eb6451 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:41.202241 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4099/8246] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:41 2022] DELETE /identity/v3/roles/1d2cda3873ec4c36bcc6a205952823f5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:41.206578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a4880-7989-4704-b92a-e0d4d03600dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:41.217577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a4880-7989-4704-b92a-e0d4d03600dc tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:41.273300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fc910-1095-479a-a30a-a4f5692091f0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:41.273879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fc910-1095-479a-a30a-a4f5692091f0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:41.274151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fc910-1095-479a-a30a-a4f5692091f0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:41.274429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fc910-1095-479a-a30a-a4f5692091f0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/users/97a8fa3943a34867af36f31e1da1cde5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:41.275620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fc910-1095-479a-a30a-a4f5692091f0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_user(user_id=97a8fa3943a34867af36f31e1da1cde5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:41.277518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fc910-1095-479a-a30a-a4f5692091f0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:41.320395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-354fc910-1095-479a-a30a-a4f5692091f0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97a8fa3943a34867af36f31e1da1cde5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:41.332128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-354fc910-1095-479a-a30a-a4f5692091f0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97a8fa3943a34867af36f31e1da1cde5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:41.332797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-354fc910-1095-479a-a30a-a4f5692091f0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97a8fa3943a34867af36f31e1da1cde5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:41.337252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=13 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:41.340998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-354fc910-1095-479a-a30a-a4f5692091f0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97a8fa3943a34867af36f31e1da1cde5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:41.341754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-354fc910-1095-479a-a30a-a4f5692091f0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97a8fa3943a34867af36f31e1da1cde5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:41.355150 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4148/8247] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:41 2022] DELETE /identity/v3/users/97a8fa3943a34867af36f31e1da1cde5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:41.360007 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b09fd-a4a7-4090-b189-7afd67eb6451 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:41.361439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-109b09fd-a4a7-4090-b189-7afd67eb6451 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:41.375818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b09fd-a4a7-4090-b189-7afd67eb6451 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:41.416785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:41.448561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00342435-c82c-4b62-9e84-fa98a9ca4d69 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445cf27af92d4059af1caee000db2032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2c658479b049b894da8ea7c97f2fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:41.449215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00342435-c82c-4b62-9e84-fa98a9ca4d69 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:41.449533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00342435-c82c-4b62-9e84-fa98a9ca4d69 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:41.449815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00342435-c82c-4b62-9e84-fa98a9ca4d69 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] PATH_INFO: `/v3/projects/a9934553835945dcad78be9797c929e7` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:41.450985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00342435-c82c-4b62-9e84-fa98a9ca4d69 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a9934553835945dcad78be9797c929e7)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:41.452957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00342435-c82c-4b62-9e84-fa98a9ca4d69 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:41.500597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-00342435-c82c-4b62-9e84-fa98a9ca4d69 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9934553835945dcad78be9797c929e7', 'request_id': 'req-00342435-c82c-4b62-9e84-fa98a9ca4d69'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:41.508620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-00342435-c82c-4b62-9e84-fa98a9ca4d69 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9934553835945dcad78be9797c929e7', 'request_id': 'req-00342435-c82c-4b62-9e84-fa98a9ca4d69'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:41.514307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-00342435-c82c-4b62-9e84-fa98a9ca4d69 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9934553835945dcad78be9797c929e7', 'request_id': 'req-00342435-c82c-4b62-9e84-fa98a9ca4d69'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:41.525420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-00342435-c82c-4b62-9e84-fa98a9ca4d69 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] The token cache is being invalidate because project a9934553835945dcad78be9797c929e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:41.525648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-00342435-c82c-4b62-9e84-fa98a9ca4d69 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:41.526292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-00342435-c82c-4b62-9e84-fa98a9ca4d69 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:41.527876 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4100/8248] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:41 2022] DELETE /identity/v3/projects/a9934553835945dcad78be9797c929e7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:41.536076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fc910-1095-479a-a30a-a4f5692091f0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:41.537538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-354fc910-1095-479a-a30a-a4f5692091f0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:41.604557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fc910-1095-479a-a30a-a4f5692091f0 tempest-TrustsV3TestJSON-69819003 tempest-TrustsV3TestJSON-69819003-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:41.661790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea71852-e98f-4e6a-a4b4-5bbfb03dfb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:41.662440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea71852-e98f-4e6a-a4b4-5bbfb03dfb5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:41.662727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea71852-e98f-4e6a-a4b4-5bbfb03dfb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:41.663003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea71852-e98f-4e6a-a4b4-5bbfb03dfb5f admin admin] PATH_INFO: `/v3/users/a4625b508ef3457a854cde3cb78c680f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:41.664222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea71852-e98f-4e6a-a4b4-5bbfb03dfb5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4625b508ef3457a854cde3cb78c680f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:41.666149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea71852-e98f-4e6a-a4b4-5bbfb03dfb5f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:41.710854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cea71852-e98f-4e6a-a4b4-5bbfb03dfb5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4625b508ef3457a854cde3cb78c680f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:41.723182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cea71852-e98f-4e6a-a4b4-5bbfb03dfb5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4625b508ef3457a854cde3cb78c680f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:41.723864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cea71852-e98f-4e6a-a4b4-5bbfb03dfb5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4625b508ef3457a854cde3cb78c680f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:41.731024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cea71852-e98f-4e6a-a4b4-5bbfb03dfb5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4625b508ef3457a854cde3cb78c680f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:41.731685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cea71852-e98f-4e6a-a4b4-5bbfb03dfb5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4625b508ef3457a854cde3cb78c680f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:41.745099 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4149/8249] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:41 2022] DELETE /identity/v3/users/a4625b508ef3457a854cde3cb78c680f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:41.749644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9902a-dea6-4ebd-ad04-bb0f6bf313ca None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:41.750220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9902a-dea6-4ebd-ad04-bb0f6bf313ca None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:41.750503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9902a-dea6-4ebd-ad04-bb0f6bf313ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:41.770755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-23b9902a-dea6-4ebd-ad04-bb0f6bf313ca None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:41.772021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-23b9902a-dea6-4ebd-ad04-bb0f6bf313ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:41.832271 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4101/8250] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:41.844847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea71852-e98f-4e6a-a4b4-5bbfb03dfb5f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:41.846346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cea71852-e98f-4e6a-a4b4-5bbfb03dfb5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:41.861360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:41.909229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea71852-e98f-4e6a-a4b4-5bbfb03dfb5f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:41.913064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f78db-3ec2-45a9-a37b-f399543b34a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:41.913686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f78db-3ec2-45a9-a37b-f399543b34a4 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:41.914001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f78db-3ec2-45a9-a37b-f399543b34a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:41.914283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f78db-3ec2-45a9-a37b-f399543b34a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:41.924657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f78db-3ec2-45a9-a37b-f399543b34a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:41.926088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f78db-3ec2-45a9-a37b-f399543b34a4 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:41.936228 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4150/8251] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:34:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:34:42.203934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9902a-dea6-4ebd-ad04-bb0f6bf313ca None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:42.205468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-23b9902a-dea6-4ebd-ad04-bb0f6bf313ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:42.219500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9902a-dea6-4ebd-ad04-bb0f6bf313ca None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:42.224487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3cc28-d01e-4336-afb2-bd16faa16854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:42.225135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3cc28-d01e-4336-afb2-bd16faa16854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:42.225437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3cc28-d01e-4336-afb2-bd16faa16854 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:42.225694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3cc28-d01e-4336-afb2-bd16faa16854 admin admin] PATH_INFO: `/v3/projects/25958b9b39cb4bf2a21e038c8f17159d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:42.226893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3cc28-d01e-4336-afb2-bd16faa16854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25958b9b39cb4bf2a21e038c8f17159d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:42.228846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3cc28-d01e-4336-afb2-bd16faa16854 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:42.278127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fdf3cc28-d01e-4336-afb2-bd16faa16854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25958b9b39cb4bf2a21e038c8f17159d', 'request_id': 'req-fdf3cc28-d01e-4336-afb2-bd16faa16854'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:42.285648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fdf3cc28-d01e-4336-afb2-bd16faa16854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25958b9b39cb4bf2a21e038c8f17159d', 'request_id': 'req-fdf3cc28-d01e-4336-afb2-bd16faa16854'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:42.287661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:42.293057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fdf3cc28-d01e-4336-afb2-bd16faa16854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25958b9b39cb4bf2a21e038c8f17159d', 'request_id': 'req-fdf3cc28-d01e-4336-afb2-bd16faa16854'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:42.305814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fdf3cc28-d01e-4336-afb2-bd16faa16854 admin admin] The token cache is being invalidate because project 25958b9b39cb4bf2a21e038c8f17159d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:42.306102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fdf3cc28-d01e-4336-afb2-bd16faa16854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:42.306749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fdf3cc28-d01e-4336-afb2-bd16faa16854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:42.308320 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4102/8252] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:42 2022] DELETE /identity/v3/projects/25958b9b39cb4bf2a21e038c8f17159d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:42.312861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f78db-3ec2-45a9-a37b-f399543b34a4 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:42.323502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f78db-3ec2-45a9-a37b-f399543b34a4 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:42.380792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c495f79-913f-4f85-8b1b-d1ab0363cf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:42.381388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c495f79-913f-4f85-8b1b-d1ab0363cf15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:42.381806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c495f79-913f-4f85-8b1b-d1ab0363cf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:42.382096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c495f79-913f-4f85-8b1b-d1ab0363cf15 admin admin] PATH_INFO: `/v3/users/445cf27af92d4059af1caee000db2032` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:42.383257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c495f79-913f-4f85-8b1b-d1ab0363cf15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=445cf27af92d4059af1caee000db2032)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:42.385196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c495f79-913f-4f85-8b1b-d1ab0363cf15 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:42.430740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4c495f79-913f-4f85-8b1b-d1ab0363cf15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445cf27af92d4059af1caee000db2032'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:42.443082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4c495f79-913f-4f85-8b1b-d1ab0363cf15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445cf27af92d4059af1caee000db2032'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:42.443780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4c495f79-913f-4f85-8b1b-d1ab0363cf15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445cf27af92d4059af1caee000db2032'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:42.450662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4c495f79-913f-4f85-8b1b-d1ab0363cf15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445cf27af92d4059af1caee000db2032'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:42.451307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4c495f79-913f-4f85-8b1b-d1ab0363cf15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445cf27af92d4059af1caee000db2032'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:42.464349 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4151/8253] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:42 2022] DELETE /identity/v3/users/445cf27af92d4059af1caee000db2032 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:42.730504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3cc28-d01e-4336-afb2-bd16faa16854 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:42.732098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fdf3cc28-d01e-4336-afb2-bd16faa16854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:42.746654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3cc28-d01e-4336-afb2-bd16faa16854 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:42.813022 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f6deb-0e54-48d9-903b-070ba2d215df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:42.813680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f6deb-0e54-48d9-903b-070ba2d215df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:42.813969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f6deb-0e54-48d9-903b-070ba2d215df admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:42.814251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f6deb-0e54-48d9-903b-070ba2d215df admin admin] PATH_INFO: `/v3/projects/ad2c658479b049b894da8ea7c97f2fe0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:42.815459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f6deb-0e54-48d9-903b-070ba2d215df admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad2c658479b049b894da8ea7c97f2fe0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:42.817378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f6deb-0e54-48d9-903b-070ba2d215df admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:42.865429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-471f6deb-0e54-48d9-903b-070ba2d215df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad2c658479b049b894da8ea7c97f2fe0', 'request_id': 'req-471f6deb-0e54-48d9-903b-070ba2d215df'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:42.872868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-471f6deb-0e54-48d9-903b-070ba2d215df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad2c658479b049b894da8ea7c97f2fe0', 'request_id': 'req-471f6deb-0e54-48d9-903b-070ba2d215df'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:42.879400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-471f6deb-0e54-48d9-903b-070ba2d215df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad2c658479b049b894da8ea7c97f2fe0', 'request_id': 'req-471f6deb-0e54-48d9-903b-070ba2d215df'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:42.890258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-471f6deb-0e54-48d9-903b-070ba2d215df admin admin] The token cache is being invalidate because project ad2c658479b049b894da8ea7c97f2fe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:42.890546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-471f6deb-0e54-48d9-903b-070ba2d215df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:42.891176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-471f6deb-0e54-48d9-903b-070ba2d215df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:42.892703 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4103/8254] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:42 2022] DELETE /identity/v3/projects/ad2c658479b049b894da8ea7c97f2fe0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:42.897484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ea92a-c658-480e-a89f-cdfd9182806e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:42.897965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ea92a-c658-480e-a89f-cdfd9182806e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:42.898108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ea92a-c658-480e-a89f-cdfd9182806e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:42.925276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b69ea92a-c658-480e-a89f-cdfd9182806e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:42.926885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b69ea92a-c658-480e-a89f-cdfd9182806e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:42.962595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:42.994293 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4152/8255] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:43.002988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae8e71-98fb-41ea-be53-35947292dfba None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:43.003280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae8e71-98fb-41ea-be53-35947292dfba None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:43.003590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae8e71-98fb-41ea-be53-35947292dfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:43.024403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-74ae8e71-98fb-41ea-be53-35947292dfba None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:43.025800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-74ae8e71-98fb-41ea-be53-35947292dfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:43.034518 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4104/8256] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:43.039029 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ea92a-c658-480e-a89f-cdfd9182806e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:43.049367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ea92a-c658-480e-a89f-cdfd9182806e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:43.053879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e266fa-e056-410e-93a9-77b74b9a3823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:43.054485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e266fa-e056-410e-93a9-77b74b9a3823 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:43.054768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e266fa-e056-410e-93a9-77b74b9a3823 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:43.055047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e266fa-e056-410e-93a9-77b74b9a3823 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:43.055809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e266fa-e056-410e-93a9-77b74b9a3823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:34:43.056111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e266fa-e056-410e-93a9-77b74b9a3823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:43.057703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e266fa-e056-410e-93a9-77b74b9a3823 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:43.070235 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4153/8257] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:43.074451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae8e71-98fb-41ea-be53-35947292dfba None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:43.083986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae8e71-98fb-41ea-be53-35947292dfba None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:43.088828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fce96-fbac-48a4-a278-3994c2f6a340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:43.089463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fce96-fbac-48a4-a278-3994c2f6a340 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:43.089751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fce96-fbac-48a4-a278-3994c2f6a340 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:43.090031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fce96-fbac-48a4-a278-3994c2f6a340 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:43.090691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fce96-fbac-48a4-a278-3994c2f6a340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:43.092633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fce96-fbac-48a4-a278-3994c2f6a340 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:43.121892 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4105/8258] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:43 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:43.126229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e266fa-e056-410e-93a9-77b74b9a3823 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:43.136310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e266fa-e056-410e-93a9-77b74b9a3823 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:43.195900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f9fcd-605a-4039-8d85-d55c34c0662d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:43.196449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f9fcd-605a-4039-8d85-d55c34c0662d admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:43.196740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f9fcd-605a-4039-8d85-d55c34c0662d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:43.197024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f9fcd-605a-4039-8d85-d55c34c0662d admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:43.197681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f9fcd-605a-4039-8d85-d55c34c0662d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:43.199620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f9fcd-605a-4039-8d85-d55c34c0662d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:43.220821 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4154/8259] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:43 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:43.224194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fce96-fbac-48a4-a278-3994c2f6a340 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:43.235313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fce96-fbac-48a4-a278-3994c2f6a340 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:43.239836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93311548-c2c7-44bc-a1f7-dd2e0fe4613d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:43.240726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93311548-c2c7-44bc-a1f7-dd2e0fe4613d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:43.241014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93311548-c2c7-44bc-a1f7-dd2e0fe4613d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:43.241288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93311548-c2c7-44bc-a1f7-dd2e0fe4613d admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:43.241967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93311548-c2c7-44bc-a1f7-dd2e0fe4613d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:43.243973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93311548-c2c7-44bc-a1f7-dd2e0fe4613d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:43.254278 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4106/8260] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:43.258208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f9fcd-605a-4039-8d85-d55c34c0662d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:43.268730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f9fcd-605a-4039-8d85-d55c34c0662d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:43.273540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77eb44-cccd-4dc9-8d94-6a087ceedca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:43.274207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77eb44-cccd-4dc9-8d94-6a087ceedca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:43.274496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77eb44-cccd-4dc9-8d94-6a087ceedca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:43.274780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77eb44-cccd-4dc9-8d94-6a087ceedca1 admin admin] PATH_INFO: `/v3/projects/28e1436cae9e4d6ea18149fa05886db9/users/e10cfa1d75ec4b39a5d72a10146114f8/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:43.290468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77eb44-cccd-4dc9-8d94-6a087ceedca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e1436cae9e4d6ea18149fa05886db9, user_id=e10cfa1d75ec4b39a5d72a10146114f8, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:43.293286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77eb44-cccd-4dc9-8d94-6a087ceedca1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:43.306927 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4155/8261] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:43 2022] PUT /identity/v3/projects/28e1436cae9e4d6ea18149fa05886db9/users/e10cfa1d75ec4b39a5d72a10146114f8/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:34:43.311109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93311548-c2c7-44bc-a1f7-dd2e0fe4613d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:43.321270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93311548-c2c7-44bc-a1f7-dd2e0fe4613d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:43.354589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:43.380902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc851e-a749-41f0-8973-f72aae69cb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:43.381528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc851e-a749-41f0-8973-f72aae69cb55 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:43.381817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc851e-a749-41f0-8973-f72aae69cb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:43.382100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc851e-a749-41f0-8973-f72aae69cb55 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:43.382792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc851e-a749-41f0-8973-f72aae69cb55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:43.384436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc851e-a749-41f0-8973-f72aae69cb55 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:43.394783 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4107/8262] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:43.399053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77eb44-cccd-4dc9-8d94-6a087ceedca1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:43.410119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77eb44-cccd-4dc9-8d94-6a087ceedca1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:43.414796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19bf0e-4673-4813-92ca-78301a75c54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:43.415495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19bf0e-4673-4813-92ca-78301a75c54d admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:43.415781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19bf0e-4673-4813-92ca-78301a75c54d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:43.416059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19bf0e-4673-4813-92ca-78301a75c54d admin admin] PATH_INFO: `/v3/projects/28e1436cae9e4d6ea18149fa05886db9/users/e10cfa1d75ec4b39a5d72a10146114f8/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:43.417999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19bf0e-4673-4813-92ca-78301a75c54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e1436cae9e4d6ea18149fa05886db9, user_id=e10cfa1d75ec4b39a5d72a10146114f8, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:43.420632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19bf0e-4673-4813-92ca-78301a75c54d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:43.430800 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4156/8263] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:43 2022] PUT /identity/v3/projects/28e1436cae9e4d6ea18149fa05886db9/users/e10cfa1d75ec4b39a5d72a10146114f8/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:43.440733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d56e11-eaa3-499d-b438-45661b42c4fa None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:43.441034 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d56e11-eaa3-499d-b438-45661b42c4fa None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:43.441354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d56e11-eaa3-499d-b438-45661b42c4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:43.470077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e4d56e11-eaa3-499d-b438-45661b42c4fa None None] MFA Rules not processed for user `e10cfa1d75ec4b39a5d72a10146114f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:43.471259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e4d56e11-eaa3-499d-b438-45661b42c4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:43.539495 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4108/8264] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:43.543934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19bf0e-4673-4813-92ca-78301a75c54d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:43.605432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19bf0e-4673-4813-92ca-78301a75c54d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:43.614234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a6feb-dda2-4242-97a7-7a60de948d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:43.614848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6feb-dda2-4242-97a7-7a60de948d79 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:43.615142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6feb-dda2-4242-97a7-7a60de948d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:43.615461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6feb-dda2-4242-97a7-7a60de948d79 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:43.616118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a6feb-dda2-4242-97a7-7a60de948d79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:43.618028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a6feb-dda2-4242-97a7-7a60de948d79 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:43.638943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:43.648200 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4157/8265] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:43 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:43.652111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d56e11-eaa3-499d-b438-45661b42c4fa None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:43.663336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d56e11-eaa3-499d-b438-45661b42c4fa None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:43.720433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa05f0-6b4a-4e44-9717-a20e3ff26897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:43.720992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa05f0-6b4a-4e44-9717-a20e3ff26897 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:43.721282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa05f0-6b4a-4e44-9717-a20e3ff26897 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:43.721565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa05f0-6b4a-4e44-9717-a20e3ff26897 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:43.722237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa05f0-6b4a-4e44-9717-a20e3ff26897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:43.724209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa05f0-6b4a-4e44-9717-a20e3ff26897 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:43.744729 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4109/8266] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:43 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:43.748697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a6feb-dda2-4242-97a7-7a60de948d79 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:43.760219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a6feb-dda2-4242-97a7-7a60de948d79 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:43.765554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1a283-d0e1-465b-ac15-310bc241fde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:43.766174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1a283-d0e1-465b-ac15-310bc241fde6 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:43.766461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1a283-d0e1-465b-ac15-310bc241fde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:43.766742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1a283-d0e1-465b-ac15-310bc241fde6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:43.767479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1a283-d0e1-465b-ac15-310bc241fde6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:43.769081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1a283-d0e1-465b-ac15-310bc241fde6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:43.779715 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4158/8267] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:43.783541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa05f0-6b4a-4e44-9717-a20e3ff26897 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:43.793560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa05f0-6b4a-4e44-9717-a20e3ff26897 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:43.798296 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e88903-f629-4a08-884d-b9be5de30fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:43.798900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e88903-f629-4a08-884d-b9be5de30fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:43.799183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e88903-f629-4a08-884d-b9be5de30fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:43.799492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e88903-f629-4a08-884d-b9be5de30fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:43.800184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e88903-f629-4a08-884d-b9be5de30fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:43.801759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e88903-f629-4a08-884d-b9be5de30fd0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:43.812108 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4110/8268] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:43.816199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1a283-d0e1-465b-ac15-310bc241fde6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:43.826231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1a283-d0e1-465b-ac15-310bc241fde6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:43.831506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828d2fb-fc01-4385-8853-9e76e0c961bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:43.832164 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828d2fb-fc01-4385-8853-9e76e0c961bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:43.832451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828d2fb-fc01-4385-8853-9e76e0c961bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:43.832729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828d2fb-fc01-4385-8853-9e76e0c961bc admin admin] PATH_INFO: `/v3/projects/c72976369030487db1579e644081139c/users/4dd1fb6a3b90405a97d28694e3382097/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:43.847200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828d2fb-fc01-4385-8853-9e76e0c961bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c72976369030487db1579e644081139c, user_id=4dd1fb6a3b90405a97d28694e3382097, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:43.849910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828d2fb-fc01-4385-8853-9e76e0c961bc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:43.863241 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4159/8269] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:43 2022] PUT /identity/v3/projects/c72976369030487db1579e644081139c/users/4dd1fb6a3b90405a97d28694e3382097/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:43.875369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd961b-6919-4a63-99d7-d1abb7a5e2ca None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:43.875662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd961b-6919-4a63-99d7-d1abb7a5e2ca None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:43.875947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd961b-6919-4a63-99d7-d1abb7a5e2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:43.903965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1afd961b-6919-4a63-99d7-d1abb7a5e2ca None None] MFA Rules not processed for user `4dd1fb6a3b90405a97d28694e3382097`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:43.905172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1afd961b-6919-4a63-99d7-d1abb7a5e2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:43.933328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:43.974252 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4111/8270] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:43.985946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828d2fb-fc01-4385-8853-9e76e0c961bc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:43.988614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2828d2fb-fc01-4385-8853-9e76e0c961bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:44.069606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828d2fb-fc01-4385-8853-9e76e0c961bc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:44.073379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b7a77-c1d2-4203-b835-f62ab7bde559 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:44.073989 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b7a77-c1d2-4203-b835-f62ab7bde559 service glance] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:44.074274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b7a77-c1d2-4203-b835-f62ab7bde559 service glance] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:44.074553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b7a77-c1d2-4203-b835-f62ab7bde559 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:44.136176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b7a77-c1d2-4203-b835-f62ab7bde559 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:44.137608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b7a77-c1d2-4203-b835-f62ab7bde559 service glance] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:44.147092 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4160/8271] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:34:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:34:44.882984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd961b-6919-4a63-99d7-d1abb7a5e2ca None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:44.945787 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd961b-6919-4a63-99d7-d1abb7a5e2ca None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:44.950403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4579b5-1bb1-4ea9-b807-4be88ebe409f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:44.951051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4579b5-1bb1-4ea9-b807-4be88ebe409f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:44.951382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4579b5-1bb1-4ea9-b807-4be88ebe409f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:44.951664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4579b5-1bb1-4ea9-b807-4be88ebe409f admin admin] PATH_INFO: `/v3/users/e10cfa1d75ec4b39a5d72a10146114f8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:44.953333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4579b5-1bb1-4ea9-b807-4be88ebe409f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e10cfa1d75ec4b39a5d72a10146114f8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:44.955240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4579b5-1bb1-4ea9-b807-4be88ebe409f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:45.002377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-db4579b5-1bb1-4ea9-b807-4be88ebe409f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e10cfa1d75ec4b39a5d72a10146114f8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:45.003101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-db4579b5-1bb1-4ea9-b807-4be88ebe409f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e10cfa1d75ec4b39a5d72a10146114f8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:45.017203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-db4579b5-1bb1-4ea9-b807-4be88ebe409f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e10cfa1d75ec4b39a5d72a10146114f8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:45.017866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-db4579b5-1bb1-4ea9-b807-4be88ebe409f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e10cfa1d75ec4b39a5d72a10146114f8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:45.025355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-db4579b5-1bb1-4ea9-b807-4be88ebe409f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e10cfa1d75ec4b39a5d72a10146114f8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:45.038060 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4112/8272] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:44 2022] DELETE /identity/v3/users/e10cfa1d75ec4b39a5d72a10146114f8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:45.042523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bc059-33f8-4f72-8d21-b80d82ab35a8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:45.043024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bc059-33f8-4f72-8d21-b80d82ab35a8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:45.043138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bc059-33f8-4f72-8d21-b80d82ab35a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:45.062795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-633bc059-33f8-4f72-8d21-b80d82ab35a8 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:45.064027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-633bc059-33f8-4f72-8d21-b80d82ab35a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:45.124052 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4161/8273] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:45.134602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4579b5-1bb1-4ea9-b807-4be88ebe409f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:45.136103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-db4579b5-1bb1-4ea9-b807-4be88ebe409f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:45.189085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:45.198123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4579b5-1bb1-4ea9-b807-4be88ebe409f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:45.202047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779fab0-52df-454b-b42b-e92a1a03d185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:45.202723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779fab0-52df-454b-b42b-e92a1a03d185 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:45.203013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779fab0-52df-454b-b42b-e92a1a03d185 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:45.203310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779fab0-52df-454b-b42b-e92a1a03d185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:45.212570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779fab0-52df-454b-b42b-e92a1a03d185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:45.213999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779fab0-52df-454b-b42b-e92a1a03d185 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:45.223662 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4113/8274] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:34:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:34:45.496096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bc059-33f8-4f72-8d21-b80d82ab35a8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:45.497570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-633bc059-33f8-4f72-8d21-b80d82ab35a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:45.510358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bc059-33f8-4f72-8d21-b80d82ab35a8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:45.515050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79d6b8-984e-422c-83f1-fe664b2ca6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:45.515747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79d6b8-984e-422c-83f1-fe664b2ca6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:45.516038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79d6b8-984e-422c-83f1-fe664b2ca6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:45.516322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79d6b8-984e-422c-83f1-fe664b2ca6cc admin admin] PATH_INFO: `/v3/projects/28e1436cae9e4d6ea18149fa05886db9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:45.517528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79d6b8-984e-422c-83f1-fe664b2ca6cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=28e1436cae9e4d6ea18149fa05886db9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:45.519474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79d6b8-984e-422c-83f1-fe664b2ca6cc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:45.521175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:45.569184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cb79d6b8-984e-422c-83f1-fe664b2ca6cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28e1436cae9e4d6ea18149fa05886db9', 'request_id': 'req-cb79d6b8-984e-422c-83f1-fe664b2ca6cc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:45.575426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cb79d6b8-984e-422c-83f1-fe664b2ca6cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28e1436cae9e4d6ea18149fa05886db9', 'request_id': 'req-cb79d6b8-984e-422c-83f1-fe664b2ca6cc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:45.582865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cb79d6b8-984e-422c-83f1-fe664b2ca6cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28e1436cae9e4d6ea18149fa05886db9', 'request_id': 'req-cb79d6b8-984e-422c-83f1-fe664b2ca6cc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:45.594031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cb79d6b8-984e-422c-83f1-fe664b2ca6cc admin admin] The token cache is being invalidate because project 28e1436cae9e4d6ea18149fa05886db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:45.594323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cb79d6b8-984e-422c-83f1-fe664b2ca6cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:45.594966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cb79d6b8-984e-422c-83f1-fe664b2ca6cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:45.596527 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4162/8275] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:45 2022] DELETE /identity/v3/projects/28e1436cae9e4d6ea18149fa05886db9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:45.600697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779fab0-52df-454b-b42b-e92a1a03d185 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:45.611225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779fab0-52df-454b-b42b-e92a1a03d185 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:45.677425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4509c77-ed9a-4e9d-b436-a177c041fdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:45.678090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4509c77-ed9a-4e9d-b436-a177c041fdd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:45.678378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4509c77-ed9a-4e9d-b436-a177c041fdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:45.678661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4509c77-ed9a-4e9d-b436-a177c041fdd0 admin admin] PATH_INFO: `/v3/users/4dd1fb6a3b90405a97d28694e3382097` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:45.679869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4509c77-ed9a-4e9d-b436-a177c041fdd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd1fb6a3b90405a97d28694e3382097)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:45.681786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4509c77-ed9a-4e9d-b436-a177c041fdd0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:45.727386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c4509c77-ed9a-4e9d-b436-a177c041fdd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd1fb6a3b90405a97d28694e3382097'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:45.728056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c4509c77-ed9a-4e9d-b436-a177c041fdd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd1fb6a3b90405a97d28694e3382097'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:45.740072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c4509c77-ed9a-4e9d-b436-a177c041fdd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd1fb6a3b90405a97d28694e3382097'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:45.740717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c4509c77-ed9a-4e9d-b436-a177c041fdd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd1fb6a3b90405a97d28694e3382097'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:45.747825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c4509c77-ed9a-4e9d-b436-a177c041fdd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd1fb6a3b90405a97d28694e3382097'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:45.760274 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4114/8276] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:45 2022] DELETE /identity/v3/users/4dd1fb6a3b90405a97d28694e3382097 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:46.032384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79d6b8-984e-422c-83f1-fe664b2ca6cc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:46.033834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cb79d6b8-984e-422c-83f1-fe664b2ca6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:46.047266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79d6b8-984e-422c-83f1-fe664b2ca6cc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:46.103826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590dc05d-4ee4-4949-b032-d97f1aa9e6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:46.104469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dc05d-4ee4-4949-b032-d97f1aa9e6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:46.104752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dc05d-4ee4-4949-b032-d97f1aa9e6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:46.105028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dc05d-4ee4-4949-b032-d97f1aa9e6c3 admin admin] PATH_INFO: `/v3/projects/c72976369030487db1579e644081139c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:46.106173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590dc05d-4ee4-4949-b032-d97f1aa9e6c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c72976369030487db1579e644081139c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:46.108154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590dc05d-4ee4-4949-b032-d97f1aa9e6c3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:46.156196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-590dc05d-4ee4-4949-b032-d97f1aa9e6c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c72976369030487db1579e644081139c', 'request_id': 'req-590dc05d-4ee4-4949-b032-d97f1aa9e6c3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:46.162978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-590dc05d-4ee4-4949-b032-d97f1aa9e6c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c72976369030487db1579e644081139c', 'request_id': 'req-590dc05d-4ee4-4949-b032-d97f1aa9e6c3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:46.170411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-590dc05d-4ee4-4949-b032-d97f1aa9e6c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c72976369030487db1579e644081139c', 'request_id': 'req-590dc05d-4ee4-4949-b032-d97f1aa9e6c3'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:46.181099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-590dc05d-4ee4-4949-b032-d97f1aa9e6c3 admin admin] The token cache is being invalidate because project c72976369030487db1579e644081139c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:46.181398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-590dc05d-4ee4-4949-b032-d97f1aa9e6c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:46.182035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-590dc05d-4ee4-4949-b032-d97f1aa9e6c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:46.183623 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4163/8277] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:46 2022] DELETE /identity/v3/projects/c72976369030487db1579e644081139c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:46.188912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc3ad4-ffad-4a55-8c90-8531317fc063 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:46.189419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc3ad4-ffad-4a55-8c90-8531317fc063 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:46.189544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc3ad4-ffad-4a55-8c90-8531317fc063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:46.209447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-aecc3ad4-ffad-4a55-8c90-8531317fc063 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:46.210662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-aecc3ad4-ffad-4a55-8c90-8531317fc063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:46.269674 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4115/8278] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:46.277496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915bebd-01ff-481f-9ca4-65bf37a6ec2f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:46.277794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915bebd-01ff-481f-9ca4-65bf37a6ec2f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:46.278079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915bebd-01ff-481f-9ca4-65bf37a6ec2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:46.297753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1915bebd-01ff-481f-9ca4-65bf37a6ec2f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:46.298976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1915bebd-01ff-481f-9ca4-65bf37a6ec2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:46.307160 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4164/8279] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:46.311312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc3ad4-ffad-4a55-8c90-8531317fc063 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:46.321724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc3ad4-ffad-4a55-8c90-8531317fc063 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:46.326245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f4d35-c654-49c0-ae96-9af80490dd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:46.326848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f4d35-c654-49c0-ae96-9af80490dd39 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:46.327213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f4d35-c654-49c0-ae96-9af80490dd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:46.328134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f4d35-c654-49c0-ae96-9af80490dd39 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:46.328867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f4d35-c654-49c0-ae96-9af80490dd39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:34:46.329180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f4d35-c654-49c0-ae96-9af80490dd39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:46.330790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f4d35-c654-49c0-ae96-9af80490dd39 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:46.333240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:46.345044 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4116/8280] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:46.349107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915bebd-01ff-481f-9ca4-65bf37a6ec2f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:46.359073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915bebd-01ff-481f-9ca4-65bf37a6ec2f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:46.363792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5f416-c4f5-47d1-b705-7d12b06b30c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:46.364403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5f416-c4f5-47d1-b705-7d12b06b30c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:46.364694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5f416-c4f5-47d1-b705-7d12b06b30c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:46.364975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5f416-c4f5-47d1-b705-7d12b06b30c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:46.365638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5f416-c4f5-47d1-b705-7d12b06b30c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:46.367556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5f416-c4f5-47d1-b705-7d12b06b30c9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:46.379575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:46.396398 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4165/8281] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:46 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:46.400625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f4d35-c654-49c0-ae96-9af80490dd39 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:46.410782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f4d35-c654-49c0-ae96-9af80490dd39 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:46.466879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5d5f7-0f86-402c-99b4-f05dccf2054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:46.467533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5d5f7-0f86-402c-99b4-f05dccf2054d admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:46.467943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5d5f7-0f86-402c-99b4-f05dccf2054d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:46.468336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5d5f7-0f86-402c-99b4-f05dccf2054d admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:46.469011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5d5f7-0f86-402c-99b4-f05dccf2054d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:46.470933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5d5f7-0f86-402c-99b4-f05dccf2054d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:46.493615 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4117/8282] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:46 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:46.497779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5f416-c4f5-47d1-b705-7d12b06b30c9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:46.509081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5f416-c4f5-47d1-b705-7d12b06b30c9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:46.513763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301693cb-166e-4328-ad7c-12f203edfc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:46.514370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301693cb-166e-4328-ad7c-12f203edfc19 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:46.514656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301693cb-166e-4328-ad7c-12f203edfc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:46.514933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301693cb-166e-4328-ad7c-12f203edfc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:46.515652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301693cb-166e-4328-ad7c-12f203edfc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:46.517252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301693cb-166e-4328-ad7c-12f203edfc19 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:46.528469 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4166/8283] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:46.531130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5d5f7-0f86-402c-99b4-f05dccf2054d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:46.541173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5d5f7-0f86-402c-99b4-f05dccf2054d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:46.546295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e577eb-9efc-4f76-ba66-f18dbca28559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:46.546966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e577eb-9efc-4f76-ba66-f18dbca28559 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:46.547252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e577eb-9efc-4f76-ba66-f18dbca28559 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:46.547565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e577eb-9efc-4f76-ba66-f18dbca28559 admin admin] PATH_INFO: `/v3/projects/01d1bd9f7c68478798b128194bc0f527/users/b5c3715c291b4138a8e903b8275fd01b/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:46.562976 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e577eb-9efc-4f76-ba66-f18dbca28559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d1bd9f7c68478798b128194bc0f527, user_id=b5c3715c291b4138a8e903b8275fd01b, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:46.566098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e577eb-9efc-4f76-ba66-f18dbca28559 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:46.579109 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4118/8284] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:46 2022] PUT /identity/v3/projects/01d1bd9f7c68478798b128194bc0f527/users/b5c3715c291b4138a8e903b8275fd01b/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:34:46.583055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301693cb-166e-4328-ad7c-12f203edfc19 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:46.593082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301693cb-166e-4328-ad7c-12f203edfc19 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:46.649312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc31dd-5e79-4e7e-b162-1f279b3615cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:46.649848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc31dd-5e79-4e7e-b162-1f279b3615cf admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:46.650138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc31dd-5e79-4e7e-b162-1f279b3615cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:46.650422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc31dd-5e79-4e7e-b162-1f279b3615cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:46.651112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc31dd-5e79-4e7e-b162-1f279b3615cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:46.652774 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc31dd-5e79-4e7e-b162-1f279b3615cf admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:46.662580 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4167/8285] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:46.666947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e577eb-9efc-4f76-ba66-f18dbca28559 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:46.678598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e577eb-9efc-4f76-ba66-f18dbca28559 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:46.683257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b6a58-9d6c-4907-8ce9-ce82426f732f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:46.683955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b6a58-9d6c-4907-8ce9-ce82426f732f admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:46.684242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b6a58-9d6c-4907-8ce9-ce82426f732f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:46.684520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b6a58-9d6c-4907-8ce9-ce82426f732f admin admin] PATH_INFO: `/v3/projects/01d1bd9f7c68478798b128194bc0f527/users/b5c3715c291b4138a8e903b8275fd01b/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:46.686460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b6a58-9d6c-4907-8ce9-ce82426f732f admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d1bd9f7c68478798b128194bc0f527, user_id=b5c3715c291b4138a8e903b8275fd01b, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:46.689678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b6a58-9d6c-4907-8ce9-ce82426f732f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:46.700351 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4119/8286] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:46 2022] PUT /identity/v3/projects/01d1bd9f7c68478798b128194bc0f527/users/b5c3715c291b4138a8e903b8275fd01b/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:46.710384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c054d2-c689-42e2-8d71-665d09512395 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:46.710677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c054d2-c689-42e2-8d71-665d09512395 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:46.710957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c054d2-c689-42e2-8d71-665d09512395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:46.739007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a7c054d2-c689-42e2-8d71-665d09512395 None None] MFA Rules not processed for user `b5c3715c291b4138a8e903b8275fd01b`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:46.740271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a7c054d2-c689-42e2-8d71-665d09512395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:46.808577 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4168/8287] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:46.813309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b6a58-9d6c-4907-8ce9-ce82426f732f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:46.878426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b6a58-9d6c-4907-8ce9-ce82426f732f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:46.883102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ac15e-2bd3-4b38-a6fd-4b657b4dec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:46.883772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ac15e-2bd3-4b38-a6fd-4b657b4dec46 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:46.884065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ac15e-2bd3-4b38-a6fd-4b657b4dec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:46.884331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ac15e-2bd3-4b38-a6fd-4b657b4dec46 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:46.884998 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ac15e-2bd3-4b38-a6fd-4b657b4dec46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:46.886904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ac15e-2bd3-4b38-a6fd-4b657b4dec46 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:46.913099 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4120/8288] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:46 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:46.917153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c054d2-c689-42e2-8d71-665d09512395 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:46.928460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c054d2-c689-42e2-8d71-665d09512395 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:46.985379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e942272-b842-4e38-ad07-a224fe0046ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:46.985998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e942272-b842-4e38-ad07-a224fe0046ce admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:46.986288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e942272-b842-4e38-ad07-a224fe0046ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:46.986570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e942272-b842-4e38-ad07-a224fe0046ce admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:46.987229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e942272-b842-4e38-ad07-a224fe0046ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:46.989176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e942272-b842-4e38-ad07-a224fe0046ce admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:46.997988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:47.013423 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4169/8289] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:46 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:47.014616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ac15e-2bd3-4b38-a6fd-4b657b4dec46 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:47.025475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ac15e-2bd3-4b38-a6fd-4b657b4dec46 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:47.030688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94521cc5-7a19-4f01-9727-9c35a542db56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:47.031341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94521cc5-7a19-4f01-9727-9c35a542db56 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:47.031635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94521cc5-7a19-4f01-9727-9c35a542db56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:47.031935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94521cc5-7a19-4f01-9727-9c35a542db56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:47.032615 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94521cc5-7a19-4f01-9727-9c35a542db56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:47.034230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94521cc5-7a19-4f01-9727-9c35a542db56 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:47.044899 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4121/8290] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:47.049496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e942272-b842-4e38-ad07-a224fe0046ce admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:47.059690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e942272-b842-4e38-ad07-a224fe0046ce admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:47.064557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fe64f-8a0e-435f-a233-d5cb5909da32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:47.065175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fe64f-8a0e-435f-a233-d5cb5909da32 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:47.065466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fe64f-8a0e-435f-a233-d5cb5909da32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:47.065768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fe64f-8a0e-435f-a233-d5cb5909da32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:47.066454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fe64f-8a0e-435f-a233-d5cb5909da32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:47.068097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fe64f-8a0e-435f-a233-d5cb5909da32 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:47.077980 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4170/8291] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:47.082018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94521cc5-7a19-4f01-9727-9c35a542db56 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:47.092191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94521cc5-7a19-4f01-9727-9c35a542db56 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:47.097502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21b5ba-21f4-4de3-a68d-897210e69645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:47.098197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21b5ba-21f4-4de3-a68d-897210e69645 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:47.098482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21b5ba-21f4-4de3-a68d-897210e69645 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:47.098762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21b5ba-21f4-4de3-a68d-897210e69645 admin admin] PATH_INFO: `/v3/projects/6a20dbbd5c7946708f75027fe91d9c1f/users/50b79f631e0a40f7a958b0df2a145d72/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:47.113976 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21b5ba-21f4-4de3-a68d-897210e69645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a20dbbd5c7946708f75027fe91d9c1f, user_id=50b79f631e0a40f7a958b0df2a145d72, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:47.116651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21b5ba-21f4-4de3-a68d-897210e69645 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:47.124565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:47.131655 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4122/8292] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:47 2022] PUT /identity/v3/projects/6a20dbbd5c7946708f75027fe91d9c1f/users/50b79f631e0a40f7a958b0df2a145d72/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:47.143748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524bd44-b354-4b69-afb5-caa460715f38 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:47.144043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524bd44-b354-4b69-afb5-caa460715f38 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:47.144325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524bd44-b354-4b69-afb5-caa460715f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:47.174288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5524bd44-b354-4b69-afb5-caa460715f38 None None] MFA Rules not processed for user `50b79f631e0a40f7a958b0df2a145d72`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:47.175475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5524bd44-b354-4b69-afb5-caa460715f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:47.238742 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4171/8293] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:47.250534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21b5ba-21f4-4de3-a68d-897210e69645 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:47.252268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5f21b5ba-21f4-4de3-a68d-897210e69645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:47.311820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21b5ba-21f4-4de3-a68d-897210e69645 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:47.315532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237e583-adbb-4688-8702-2351d9add982 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:47.316153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237e583-adbb-4688-8702-2351d9add982 service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:47.316441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237e583-adbb-4688-8702-2351d9add982 service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:47.316722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237e583-adbb-4688-8702-2351d9add982 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:47.376030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237e583-adbb-4688-8702-2351d9add982 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:47.377480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237e583-adbb-4688-8702-2351d9add982 service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:47.387135 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4123/8294] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:34:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:34:47.965249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524bd44-b354-4b69-afb5-caa460715f38 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:48.029804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524bd44-b354-4b69-afb5-caa460715f38 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:48.034663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597912f-7943-451a-8139-63965d8268ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:48.035338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597912f-7943-451a-8139-63965d8268ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:48.035635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597912f-7943-451a-8139-63965d8268ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:48.035923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597912f-7943-451a-8139-63965d8268ea admin admin] PATH_INFO: `/v3/users/b5c3715c291b4138a8e903b8275fd01b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:48.037093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597912f-7943-451a-8139-63965d8268ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5c3715c291b4138a8e903b8275fd01b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:48.039025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597912f-7943-451a-8139-63965d8268ea admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:48.085338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4597912f-7943-451a-8139-63965d8268ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5c3715c291b4138a8e903b8275fd01b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:48.098308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4597912f-7943-451a-8139-63965d8268ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5c3715c291b4138a8e903b8275fd01b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:48.098997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4597912f-7943-451a-8139-63965d8268ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5c3715c291b4138a8e903b8275fd01b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:48.104347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:48.106395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4597912f-7943-451a-8139-63965d8268ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5c3715c291b4138a8e903b8275fd01b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:48.107138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-4597912f-7943-451a-8139-63965d8268ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5c3715c291b4138a8e903b8275fd01b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:48.121117 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4172/8295] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:47 2022] DELETE /identity/v3/users/b5c3715c291b4138a8e903b8275fd01b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:48.126468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2e994-0aa2-4673-ad7d-0a76ddd37d80 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:48.126762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2e994-0aa2-4673-ad7d-0a76ddd37d80 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:48.127044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2e994-0aa2-4673-ad7d-0a76ddd37d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:48.146918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bcd2e994-0aa2-4673-ad7d-0a76ddd37d80 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:48.148152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bcd2e994-0aa2-4673-ad7d-0a76ddd37d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:48.208332 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4124/8296] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:34:48.217955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597912f-7943-451a-8139-63965d8268ea admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:48.219395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4597912f-7943-451a-8139-63965d8268ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:48.279079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597912f-7943-451a-8139-63965d8268ea admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:48.283270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10eb26b-5e67-42a7-942e-ebe08fde495b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:48.283983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10eb26b-5e67-42a7-942e-ebe08fde495b service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:48.284272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10eb26b-5e67-42a7-942e-ebe08fde495b service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:48.284635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10eb26b-5e67-42a7-942e-ebe08fde495b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:48.294023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10eb26b-5e67-42a7-942e-ebe08fde495b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:48.295514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10eb26b-5e67-42a7-942e-ebe08fde495b service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:48.305473 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4173/8297] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:34:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:34:48.580926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2e994-0aa2-4673-ad7d-0a76ddd37d80 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:48.582466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bcd2e994-0aa2-4673-ad7d-0a76ddd37d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:48.595901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2e994-0aa2-4673-ad7d-0a76ddd37d80 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:48.600901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804ce80-3372-4107-829f-c27cafd945b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:48.601549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ce80-3372-4107-829f-c27cafd945b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:48.601887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ce80-3372-4107-829f-c27cafd945b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:48.602165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ce80-3372-4107-829f-c27cafd945b7 admin admin] PATH_INFO: `/v3/projects/01d1bd9f7c68478798b128194bc0f527` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:48.603384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804ce80-3372-4107-829f-c27cafd945b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d1bd9f7c68478798b128194bc0f527)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:48.605304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804ce80-3372-4107-829f-c27cafd945b7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:48.656422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:48.661515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a804ce80-3372-4107-829f-c27cafd945b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d1bd9f7c68478798b128194bc0f527', 'request_id': 'req-a804ce80-3372-4107-829f-c27cafd945b7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:48.668945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a804ce80-3372-4107-829f-c27cafd945b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d1bd9f7c68478798b128194bc0f527', 'request_id': 'req-a804ce80-3372-4107-829f-c27cafd945b7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:48.674697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a804ce80-3372-4107-829f-c27cafd945b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d1bd9f7c68478798b128194bc0f527', 'request_id': 'req-a804ce80-3372-4107-829f-c27cafd945b7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:48.686263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a804ce80-3372-4107-829f-c27cafd945b7 admin admin] The token cache is being invalidate because project 01d1bd9f7c68478798b128194bc0f527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:48.686557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a804ce80-3372-4107-829f-c27cafd945b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:48.687260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a804ce80-3372-4107-829f-c27cafd945b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:48.688841 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4125/8298] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:48 2022] DELETE /identity/v3/projects/01d1bd9f7c68478798b128194bc0f527 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:48.692900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10eb26b-5e67-42a7-942e-ebe08fde495b service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:48.703145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10eb26b-5e67-42a7-942e-ebe08fde495b service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:48.761711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0b659-f36e-43bb-adfa-5703cf634b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:48.762363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0b659-f36e-43bb-adfa-5703cf634b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:48.762658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0b659-f36e-43bb-adfa-5703cf634b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:48.762942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0b659-f36e-43bb-adfa-5703cf634b8e admin admin] PATH_INFO: `/v3/users/50b79f631e0a40f7a958b0df2a145d72` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:48.764142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0b659-f36e-43bb-adfa-5703cf634b8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=50b79f631e0a40f7a958b0df2a145d72)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:48.766584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0b659-f36e-43bb-adfa-5703cf634b8e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:48.811868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72b0b659-f36e-43bb-adfa-5703cf634b8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50b79f631e0a40f7a958b0df2a145d72'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:48.823572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72b0b659-f36e-43bb-adfa-5703cf634b8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50b79f631e0a40f7a958b0df2a145d72'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:48.824242 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72b0b659-f36e-43bb-adfa-5703cf634b8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50b79f631e0a40f7a958b0df2a145d72'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:48.834205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72b0b659-f36e-43bb-adfa-5703cf634b8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50b79f631e0a40f7a958b0df2a145d72'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:48.834892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-72b0b659-f36e-43bb-adfa-5703cf634b8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50b79f631e0a40f7a958b0df2a145d72'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:48.849222 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4174/8299] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:48 2022] DELETE /identity/v3/users/50b79f631e0a40f7a958b0df2a145d72 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:49.133854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804ce80-3372-4107-829f-c27cafd945b7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:49.135315 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a804ce80-3372-4107-829f-c27cafd945b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:49.160233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804ce80-3372-4107-829f-c27cafd945b7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:49.225906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f9ce7-0f84-4ac7-8a2d-43492176bc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:49.226552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f9ce7-0f84-4ac7-8a2d-43492176bc69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:49.226834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f9ce7-0f84-4ac7-8a2d-43492176bc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:49.227111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f9ce7-0f84-4ac7-8a2d-43492176bc69 admin admin] PATH_INFO: `/v3/projects/6a20dbbd5c7946708f75027fe91d9c1f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:49.228308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f9ce7-0f84-4ac7-8a2d-43492176bc69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a20dbbd5c7946708f75027fe91d9c1f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:49.230514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f9ce7-0f84-4ac7-8a2d-43492176bc69 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:49.276882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2b5f9ce7-0f84-4ac7-8a2d-43492176bc69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a20dbbd5c7946708f75027fe91d9c1f', 'request_id': 'req-2b5f9ce7-0f84-4ac7-8a2d-43492176bc69'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:49.283886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2b5f9ce7-0f84-4ac7-8a2d-43492176bc69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a20dbbd5c7946708f75027fe91d9c1f', 'request_id': 'req-2b5f9ce7-0f84-4ac7-8a2d-43492176bc69'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:49.289670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2b5f9ce7-0f84-4ac7-8a2d-43492176bc69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a20dbbd5c7946708f75027fe91d9c1f', 'request_id': 'req-2b5f9ce7-0f84-4ac7-8a2d-43492176bc69'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:49.301346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2b5f9ce7-0f84-4ac7-8a2d-43492176bc69 admin admin] The token cache is being invalidate because project 6a20dbbd5c7946708f75027fe91d9c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:49.301634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2b5f9ce7-0f84-4ac7-8a2d-43492176bc69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:49.302269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-2b5f9ce7-0f84-4ac7-8a2d-43492176bc69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:49.303796 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4126/8300] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:49 2022] DELETE /identity/v3/projects/6a20dbbd5c7946708f75027fe91d9c1f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:49.308699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e15c3-6a4d-4a2e-983e-92b790ad0c12 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:49.309165 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e15c3-6a4d-4a2e-983e-92b790ad0c12 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:49.309295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e15c3-6a4d-4a2e-983e-92b790ad0c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:49.329706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-de1e15c3-6a4d-4a2e-983e-92b790ad0c12 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:49.330926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-de1e15c3-6a4d-4a2e-983e-92b790ad0c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:49.336270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:49.391867 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4175/8301] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:49.399823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f092d8-fd1b-489d-a1c5-4710f0b509a2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:49.400121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f092d8-fd1b-489d-a1c5-4710f0b509a2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:49.400403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f092d8-fd1b-489d-a1c5-4710f0b509a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:49.419742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e0f092d8-fd1b-489d-a1c5-4710f0b509a2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:49.421442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e0f092d8-fd1b-489d-a1c5-4710f0b509a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:49.429355 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4127/8302] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:49.433464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e15c3-6a4d-4a2e-983e-92b790ad0c12 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:49.443956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e15c3-6a4d-4a2e-983e-92b790ad0c12 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:49.448529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f6796-a9d4-47a0-b019-b137321bce81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:49.449141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f6796-a9d4-47a0-b019-b137321bce81 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:49.449429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f6796-a9d4-47a0-b019-b137321bce81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:49.449739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f6796-a9d4-47a0-b019-b137321bce81 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:49.450434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f6796-a9d4-47a0-b019-b137321bce81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:34:49.450741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f6796-a9d4-47a0-b019-b137321bce81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:49.452386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f6796-a9d4-47a0-b019-b137321bce81 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:49.463812 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4176/8303] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:49.468077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f092d8-fd1b-489d-a1c5-4710f0b509a2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:49.478537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f092d8-fd1b-489d-a1c5-4710f0b509a2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:49.484095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f0c7a-1d95-49a6-8abb-391c7c6e65ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:49.484746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f0c7a-1d95-49a6-8abb-391c7c6e65ef admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:49.485031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f0c7a-1d95-49a6-8abb-391c7c6e65ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:49.485337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f0c7a-1d95-49a6-8abb-391c7c6e65ef admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:49.486072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f0c7a-1d95-49a6-8abb-391c7c6e65ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:49.488069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f0c7a-1d95-49a6-8abb-391c7c6e65ef admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:49.516082 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4128/8304] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:49 2022] POST /identity/v3/projects => generated 409 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:49.520367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f6796-a9d4-47a0-b019-b137321bce81 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:49.530405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f6796-a9d4-47a0-b019-b137321bce81 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:49.586263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884bae4-3a04-4a7c-9815-1f911d9def16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:49.586878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884bae4-3a04-4a7c-9815-1f911d9def16 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:49.587167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884bae4-3a04-4a7c-9815-1f911d9def16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:49.587479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884bae4-3a04-4a7c-9815-1f911d9def16 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:49.588138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884bae4-3a04-4a7c-9815-1f911d9def16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:49.590054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884bae4-3a04-4a7c-9815-1f911d9def16 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:49.612822 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4177/8305] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:49 2022] POST /identity/v3/users => generated 305 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:49.615347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f0c7a-1d95-49a6-8abb-391c7c6e65ef admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:49.626509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f0c7a-1d95-49a6-8abb-391c7c6e65ef admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:49.631061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb912846-6469-4320-bbd6-4b27c9c76833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:49.631711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb912846-6469-4320-bbd6-4b27c9c76833 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:49.632016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb912846-6469-4320-bbd6-4b27c9c76833 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:49.632295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb912846-6469-4320-bbd6-4b27c9c76833 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:49.632989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb912846-6469-4320-bbd6-4b27c9c76833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:49.634579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb912846-6469-4320-bbd6-4b27c9c76833 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:49.644505 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4129/8306] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:49.648337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884bae4-3a04-4a7c-9815-1f911d9def16 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:49.658202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884bae4-3a04-4a7c-9815-1f911d9def16 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:49.662818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf5dc4-d5f4-425c-9311-80b903d9d06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:49.663470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf5dc4-d5f4-425c-9311-80b903d9d06a admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:49.663758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf5dc4-d5f4-425c-9311-80b903d9d06a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:49.664036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf5dc4-d5f4-425c-9311-80b903d9d06a admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:49.664733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf5dc4-d5f4-425c-9311-80b903d9d06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:49.666338 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf5dc4-d5f4-425c-9311-80b903d9d06a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:49.677852 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4178/8307] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:34:49.682027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb912846-6469-4320-bbd6-4b27c9c76833 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:49.693247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb912846-6469-4320-bbd6-4b27c9c76833 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:49.698247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b450b-7833-44dd-b311-d5d81bedd942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:49.698916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b450b-7833-44dd-b311-d5d81bedd942 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:49.699208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b450b-7833-44dd-b311-d5d81bedd942 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:49.699543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b450b-7833-44dd-b311-d5d81bedd942 admin admin] PATH_INFO: `/v3/projects/5f122f86989d403c8fca0de43c885d64/users/9d1243aa5bc043f19a8f75a1897bc057/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:49.711995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:49.716869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b450b-7833-44dd-b311-d5d81bedd942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f122f86989d403c8fca0de43c885d64, user_id=9d1243aa5bc043f19a8f75a1897bc057, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:49.719769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b450b-7833-44dd-b311-d5d81bedd942 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:49.733769 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4130/8308] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:49 2022] PUT /identity/v3/projects/5f122f86989d403c8fca0de43c885d64/users/9d1243aa5bc043f19a8f75a1897bc057/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:49.744256 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87b9e6-2a08-48f5-9e3c-0e42af575631 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:49.744626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87b9e6-2a08-48f5-9e3c-0e42af575631 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:49.744973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87b9e6-2a08-48f5-9e3c-0e42af575631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:49.776787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-cc87b9e6-2a08-48f5-9e3c-0e42af575631 None None] MFA Rules not processed for user `9d1243aa5bc043f19a8f75a1897bc057`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:49.778020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cc87b9e6-2a08-48f5-9e3c-0e42af575631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:49.842246 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4179/8309] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:49 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:49.847563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b450b-7833-44dd-b311-d5d81bedd942 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:49.909236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b450b-7833-44dd-b311-d5d81bedd942 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:49.913917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bb991-fa4d-476d-8fa9-4e188143c5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:49.914531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bb991-fa4d-476d-8fa9-4e188143c5fd admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:49.914818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bb991-fa4d-476d-8fa9-4e188143c5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:49.915101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bb991-fa4d-476d-8fa9-4e188143c5fd admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:49.915795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bb991-fa4d-476d-8fa9-4e188143c5fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:49.917695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bb991-fa4d-476d-8fa9-4e188143c5fd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:49.944466 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4131/8310] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:49 2022] POST /identity/v3/projects => generated 409 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:49.948422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87b9e6-2a08-48f5-9e3c-0e42af575631 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:49.959582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87b9e6-2a08-48f5-9e3c-0e42af575631 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:49.963277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:50.018105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8dd4d1-4e75-4777-bdfe-2f5f6fde53c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:50.018730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dd4d1-4e75-4777-bdfe-2f5f6fde53c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:50.019024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dd4d1-4e75-4777-bdfe-2f5f6fde53c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:50.019317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dd4d1-4e75-4777-bdfe-2f5f6fde53c6 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:50.020021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8dd4d1-4e75-4777-bdfe-2f5f6fde53c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:50.021936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8dd4d1-4e75-4777-bdfe-2f5f6fde53c6 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:50.042962 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4180/8311] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:49 2022] POST /identity/v3/users => generated 311 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:50.047700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bb991-fa4d-476d-8fa9-4e188143c5fd admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:50.058109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bb991-fa4d-476d-8fa9-4e188143c5fd admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:50.062785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cb3d5-398f-4e41-9db3-7c36a4c6136b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:50.063438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cb3d5-398f-4e41-9db3-7c36a4c6136b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:50.063728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cb3d5-398f-4e41-9db3-7c36a4c6136b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:50.064011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cb3d5-398f-4e41-9db3-7c36a4c6136b admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:50.064702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cb3d5-398f-4e41-9db3-7c36a4c6136b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:50.066308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cb3d5-398f-4e41-9db3-7c36a4c6136b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:50.077431 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4132/8312] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:50.081194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8dd4d1-4e75-4777-bdfe-2f5f6fde53c6 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:50.091039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8dd4d1-4e75-4777-bdfe-2f5f6fde53c6 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:50.096234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699822b-ddf1-4c05-b1d8-38371daa10e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:50.096906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699822b-ddf1-4c05-b1d8-38371daa10e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:50.097181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699822b-ddf1-4c05-b1d8-38371daa10e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:50.097464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699822b-ddf1-4c05-b1d8-38371daa10e1 admin admin] PATH_INFO: `/v3/projects/3837a1882bb949668e8dd0b194cad68b/users/7e7d8a2717ca4c9d96a09f44edc28919/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:50.113549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699822b-ddf1-4c05-b1d8-38371daa10e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3837a1882bb949668e8dd0b194cad68b, user_id=7e7d8a2717ca4c9d96a09f44edc28919, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:50.116243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699822b-ddf1-4c05-b1d8-38371daa10e1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:50.129268 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4181/8313] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:50 2022] PUT /identity/v3/projects/3837a1882bb949668e8dd0b194cad68b/users/7e7d8a2717ca4c9d96a09f44edc28919/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:50.133120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cb3d5-398f-4e41-9db3-7c36a4c6136b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:50.143606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cb3d5-398f-4e41-9db3-7c36a4c6136b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:50.199532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d94b1-7808-4473-b760-5d2854f2db39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:50.200151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d94b1-7808-4473-b760-5d2854f2db39 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:50.200437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d94b1-7808-4473-b760-5d2854f2db39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:50.200713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d94b1-7808-4473-b760-5d2854f2db39 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:50.201399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d94b1-7808-4473-b760-5d2854f2db39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:50.203651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d94b1-7808-4473-b760-5d2854f2db39 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:50.213715 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4133/8314] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:50.218334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699822b-ddf1-4c05-b1d8-38371daa10e1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:50.228765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699822b-ddf1-4c05-b1d8-38371daa10e1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:50.233414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25e204-0e4b-45c6-9228-a30fc5199e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:50.234075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25e204-0e4b-45c6-9228-a30fc5199e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:50.234364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25e204-0e4b-45c6-9228-a30fc5199e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:50.234642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25e204-0e4b-45c6-9228-a30fc5199e92 admin admin] PATH_INFO: `/v3/projects/3837a1882bb949668e8dd0b194cad68b/users/7e7d8a2717ca4c9d96a09f44edc28919/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:50.236694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25e204-0e4b-45c6-9228-a30fc5199e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3837a1882bb949668e8dd0b194cad68b, user_id=7e7d8a2717ca4c9d96a09f44edc28919, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:50.239353 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25e204-0e4b-45c6-9228-a30fc5199e92 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:50.249786 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4182/8315] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:50 2022] PUT /identity/v3/projects/3837a1882bb949668e8dd0b194cad68b/users/7e7d8a2717ca4c9d96a09f44edc28919/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:50.261251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967836a-6c50-4e3b-9ea5-3c7506ec43d2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:50.261552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967836a-6c50-4e3b-9ea5-3c7506ec43d2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:50.261840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967836a-6c50-4e3b-9ea5-3c7506ec43d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:50.292016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5967836a-6c50-4e3b-9ea5-3c7506ec43d2 None None] MFA Rules not processed for user `7e7d8a2717ca4c9d96a09f44edc28919`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:50.293295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5967836a-6c50-4e3b-9ea5-3c7506ec43d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:50.339756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:50.365423 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4134/8316] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:50 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:50.376122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25e204-0e4b-45c6-9228-a30fc5199e92 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:50.377853 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8e25e204-0e4b-45c6-9228-a30fc5199e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:50.441993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25e204-0e4b-45c6-9228-a30fc5199e92 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:50.445722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490a200-23d7-41a3-b465-cb21c20258e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:50.446330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490a200-23d7-41a3-b465-cb21c20258e5 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:50.446611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490a200-23d7-41a3-b465-cb21c20258e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:50.446885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490a200-23d7-41a3-b465-cb21c20258e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:50.456611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490a200-23d7-41a3-b465-cb21c20258e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:50.458022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490a200-23d7-41a3-b465-cb21c20258e5 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:50.467508 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4183/8317] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:34:50 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:34:52.321481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967836a-6c50-4e3b-9ea5-3c7506ec43d2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:52.398704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967836a-6c50-4e3b-9ea5-3c7506ec43d2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:52.403383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7c5eb-a0eb-4976-b892-ec57469f3c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:52.404066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7c5eb-a0eb-4976-b892-ec57469f3c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:52.404380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7c5eb-a0eb-4976-b892-ec57469f3c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:52.404771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7c5eb-a0eb-4976-b892-ec57469f3c16 admin admin] PATH_INFO: `/v3/users/9d1243aa5bc043f19a8f75a1897bc057` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:52.406163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7c5eb-a0eb-4976-b892-ec57469f3c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d1243aa5bc043f19a8f75a1897bc057)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:52.408158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7c5eb-a0eb-4976-b892-ec57469f3c16 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:52.456902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-02b7c5eb-a0eb-4976-b892-ec57469f3c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d1243aa5bc043f19a8f75a1897bc057'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:52.457569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-02b7c5eb-a0eb-4976-b892-ec57469f3c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d1243aa5bc043f19a8f75a1897bc057'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:52.469269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-02b7c5eb-a0eb-4976-b892-ec57469f3c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d1243aa5bc043f19a8f75a1897bc057'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:52.469857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-02b7c5eb-a0eb-4976-b892-ec57469f3c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d1243aa5bc043f19a8f75a1897bc057'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:52.476604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-02b7c5eb-a0eb-4976-b892-ec57469f3c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d1243aa5bc043f19a8f75a1897bc057'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:52.489527 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4135/8318] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:52 2022] DELETE /identity/v3/users/9d1243aa5bc043f19a8f75a1897bc057 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:52.494251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680f282-14dc-4273-9127-ecc13081fd15 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:52.494754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680f282-14dc-4273-9127-ecc13081fd15 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:52.494864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680f282-14dc-4273-9127-ecc13081fd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:52.515688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8680f282-14dc-4273-9127-ecc13081fd15 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:52.516906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8680f282-14dc-4273-9127-ecc13081fd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:52.566976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:52.577595 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4184/8319] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:52.587375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7c5eb-a0eb-4976-b892-ec57469f3c16 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:52.588958 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-02b7c5eb-a0eb-4976-b892-ec57469f3c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:52.649695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7c5eb-a0eb-4976-b892-ec57469f3c16 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:52.653696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80645f57-e488-40b7-b335-1ed424236cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:52.654317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80645f57-e488-40b7-b335-1ed424236cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:52.654602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80645f57-e488-40b7-b335-1ed424236cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:52.654939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80645f57-e488-40b7-b335-1ed424236cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:52.664184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80645f57-e488-40b7-b335-1ed424236cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:52.665674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80645f57-e488-40b7-b335-1ed424236cb4 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:52.675956 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4136/8320] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:34:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:34:52.962938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680f282-14dc-4273-9127-ecc13081fd15 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:52.964430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8680f282-14dc-4273-9127-ecc13081fd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:52.983893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680f282-14dc-4273-9127-ecc13081fd15 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:52.988941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381de28-2b1b-4438-a580-bb441fc97184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:52.989596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381de28-2b1b-4438-a580-bb441fc97184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:52.989960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381de28-2b1b-4438-a580-bb441fc97184 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:52.990151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381de28-2b1b-4438-a580-bb441fc97184 admin admin] PATH_INFO: `/v3/projects/5f122f86989d403c8fca0de43c885d64` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:52.991346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381de28-2b1b-4438-a580-bb441fc97184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f122f86989d403c8fca0de43c885d64)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:52.993272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381de28-2b1b-4438-a580-bb441fc97184 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:53.040208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3381de28-2b1b-4438-a580-bb441fc97184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f122f86989d403c8fca0de43c885d64', 'request_id': 'req-3381de28-2b1b-4438-a580-bb441fc97184'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:53.047191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3381de28-2b1b-4438-a580-bb441fc97184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f122f86989d403c8fca0de43c885d64', 'request_id': 'req-3381de28-2b1b-4438-a580-bb441fc97184'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:53.054931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3381de28-2b1b-4438-a580-bb441fc97184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f122f86989d403c8fca0de43c885d64', 'request_id': 'req-3381de28-2b1b-4438-a580-bb441fc97184'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:53.065446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3381de28-2b1b-4438-a580-bb441fc97184 admin admin] The token cache is being invalidate because project 5f122f86989d403c8fca0de43c885d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:53.065742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3381de28-2b1b-4438-a580-bb441fc97184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:53.066398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3381de28-2b1b-4438-a580-bb441fc97184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:53.068029 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4185/8321] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:52 2022] DELETE /identity/v3/projects/5f122f86989d403c8fca0de43c885d64 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:53.072290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80645f57-e488-40b7-b335-1ed424236cb4 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:53.077497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:53.093931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80645f57-e488-40b7-b335-1ed424236cb4 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:53.160625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6dfc3-5fd7-41a3-b2c9-533118d6d4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:53.161274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6dfc3-5fd7-41a3-b2c9-533118d6d4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:53.161559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6dfc3-5fd7-41a3-b2c9-533118d6d4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:53.161889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6dfc3-5fd7-41a3-b2c9-533118d6d4fd admin admin] PATH_INFO: `/v3/users/7e7d8a2717ca4c9d96a09f44edc28919` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:53.163165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6dfc3-5fd7-41a3-b2c9-533118d6d4fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e7d8a2717ca4c9d96a09f44edc28919)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:53.165136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6dfc3-5fd7-41a3-b2c9-533118d6d4fd admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:53.209886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d3c6dfc3-5fd7-41a3-b2c9-533118d6d4fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e7d8a2717ca4c9d96a09f44edc28919'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:53.210539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d3c6dfc3-5fd7-41a3-b2c9-533118d6d4fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e7d8a2717ca4c9d96a09f44edc28919'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:53.222929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d3c6dfc3-5fd7-41a3-b2c9-533118d6d4fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e7d8a2717ca4c9d96a09f44edc28919'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:53.223589 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d3c6dfc3-5fd7-41a3-b2c9-533118d6d4fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e7d8a2717ca4c9d96a09f44edc28919'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:53.230895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d3c6dfc3-5fd7-41a3-b2c9-533118d6d4fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e7d8a2717ca4c9d96a09f44edc28919'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:53.243245 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4137/8322] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:53 2022] DELETE /identity/v3/users/7e7d8a2717ca4c9d96a09f44edc28919 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:53.416658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381de28-2b1b-4438-a580-bb441fc97184 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:53.418171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3381de28-2b1b-4438-a580-bb441fc97184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:53.431452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381de28-2b1b-4438-a580-bb441fc97184 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:53.490205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20a957-db85-4c99-966c-07caefea6365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:53.490858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20a957-db85-4c99-966c-07caefea6365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:53.491146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20a957-db85-4c99-966c-07caefea6365 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:53.491464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20a957-db85-4c99-966c-07caefea6365 admin admin] PATH_INFO: `/v3/projects/3837a1882bb949668e8dd0b194cad68b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:53.492665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20a957-db85-4c99-966c-07caefea6365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3837a1882bb949668e8dd0b194cad68b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:53.494637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20a957-db85-4c99-966c-07caefea6365 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:53.541791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0a20a957-db85-4c99-966c-07caefea6365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3837a1882bb949668e8dd0b194cad68b', 'request_id': 'req-0a20a957-db85-4c99-966c-07caefea6365'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:53.547931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0a20a957-db85-4c99-966c-07caefea6365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3837a1882bb949668e8dd0b194cad68b', 'request_id': 'req-0a20a957-db85-4c99-966c-07caefea6365'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:53.555263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0a20a957-db85-4c99-966c-07caefea6365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3837a1882bb949668e8dd0b194cad68b', 'request_id': 'req-0a20a957-db85-4c99-966c-07caefea6365'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:53.566039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0a20a957-db85-4c99-966c-07caefea6365 admin admin] The token cache is being invalidate because project 3837a1882bb949668e8dd0b194cad68b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:53.566340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0a20a957-db85-4c99-966c-07caefea6365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:53.566983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0a20a957-db85-4c99-966c-07caefea6365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:53.568515 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4186/8323] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:53 2022] DELETE /identity/v3/projects/3837a1882bb949668e8dd0b194cad68b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:53.573779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e294da-ce91-4d81-a549-d541694a2bf9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:53.574264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e294da-ce91-4d81-a549-d541694a2bf9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:53.574372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e294da-ce91-4d81-a549-d541694a2bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:53.594486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e2e294da-ce91-4d81-a549-d541694a2bf9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:53.595781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e2e294da-ce91-4d81-a549-d541694a2bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:53.653487 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4138/8324] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:53.661529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d893c1-c590-43f1-b93f-acdbaa90d863 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:53.661829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d893c1-c590-43f1-b93f-acdbaa90d863 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:53.662115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d893c1-c590-43f1-b93f-acdbaa90d863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:53.681647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-91d893c1-c590-43f1-b93f-acdbaa90d863 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:53.682859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-91d893c1-c590-43f1-b93f-acdbaa90d863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:53.692259 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4187/8325] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:53.696473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e294da-ce91-4d81-a549-d541694a2bf9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:53.707137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e294da-ce91-4d81-a549-d541694a2bf9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:53.711756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966138dd-ed0c-43b0-9578-fe9c7c1572f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:53.712363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966138dd-ed0c-43b0-9578-fe9c7c1572f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:53.712648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966138dd-ed0c-43b0-9578-fe9c7c1572f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:53.712925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966138dd-ed0c-43b0-9578-fe9c7c1572f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:53.713618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966138dd-ed0c-43b0-9578-fe9c7c1572f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:34:53.713923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966138dd-ed0c-43b0-9578-fe9c7c1572f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:53.715539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966138dd-ed0c-43b0-9578-fe9c7c1572f0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:53.727131 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4139/8326] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:53.731258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d893c1-c590-43f1-b93f-acdbaa90d863 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:53.737158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:53.741653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d893c1-c590-43f1-b93f-acdbaa90d863 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:53.748048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c325fd8-829d-4824-a80e-5712bef8fa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:53.749331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c325fd8-829d-4824-a80e-5712bef8fa7b admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:53.750068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c325fd8-829d-4824-a80e-5712bef8fa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:53.750538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c325fd8-829d-4824-a80e-5712bef8fa7b admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:53.751237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c325fd8-829d-4824-a80e-5712bef8fa7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:53.753195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c325fd8-829d-4824-a80e-5712bef8fa7b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:53.779830 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4188/8327] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:53 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:53.784187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966138dd-ed0c-43b0-9578-fe9c7c1572f0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:53.794213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966138dd-ed0c-43b0-9578-fe9c7c1572f0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:53.799039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:53.852662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9dfbd-a0f4-4fe8-8e20-469f054c7b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:53.853277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9dfbd-a0f4-4fe8-8e20-469f054c7b24 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:53.853563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9dfbd-a0f4-4fe8-8e20-469f054c7b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:53.853840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9dfbd-a0f4-4fe8-8e20-469f054c7b24 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:53.854506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9dfbd-a0f4-4fe8-8e20-469f054c7b24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:53.856461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9dfbd-a0f4-4fe8-8e20-469f054c7b24 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:53.882546 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4140/8328] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:53 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:53.884560 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c325fd8-829d-4824-a80e-5712bef8fa7b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:53.895434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c325fd8-829d-4824-a80e-5712bef8fa7b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:53.900555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711362c4-30e2-4c9d-bd57-9eedaad76e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:53.901078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711362c4-30e2-4c9d-bd57-9eedaad76e58 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:53.901395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711362c4-30e2-4c9d-bd57-9eedaad76e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:53.901683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711362c4-30e2-4c9d-bd57-9eedaad76e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:53.902411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711362c4-30e2-4c9d-bd57-9eedaad76e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:53.904173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711362c4-30e2-4c9d-bd57-9eedaad76e58 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:53.915191 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4189/8329] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:53.919194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9dfbd-a0f4-4fe8-8e20-469f054c7b24 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:53.930243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9dfbd-a0f4-4fe8-8e20-469f054c7b24 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:53.935080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45aae7-8b41-49e3-9cf9-b062c207522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:53.935745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45aae7-8b41-49e3-9cf9-b062c207522b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:53.936035 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45aae7-8b41-49e3-9cf9-b062c207522b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:53.936965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45aae7-8b41-49e3-9cf9-b062c207522b admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:53.937674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45aae7-8b41-49e3-9cf9-b062c207522b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:53.939323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45aae7-8b41-49e3-9cf9-b062c207522b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:53.950159 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4141/8330] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:53.954412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711362c4-30e2-4c9d-bd57-9eedaad76e58 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:53.964377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711362c4-30e2-4c9d-bd57-9eedaad76e58 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:53.968978 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ab71a-2697-4928-bb01-dc12e1a1c274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:53.969630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ab71a-2697-4928-bb01-dc12e1a1c274 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:53.969915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ab71a-2697-4928-bb01-dc12e1a1c274 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:53.970195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ab71a-2697-4928-bb01-dc12e1a1c274 admin admin] PATH_INFO: `/v3/projects/02b81b7ff47f4c878eadcc6c0f115a8c/users/648604d10b624fa8a33ff38fa2ddb788/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:53.985473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ab71a-2697-4928-bb01-dc12e1a1c274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b81b7ff47f4c878eadcc6c0f115a8c, user_id=648604d10b624fa8a33ff38fa2ddb788, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:53.988248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ab71a-2697-4928-bb01-dc12e1a1c274 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:54.002265 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4190/8331] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:53 2022] PUT /identity/v3/projects/02b81b7ff47f4c878eadcc6c0f115a8c/users/648604d10b624fa8a33ff38fa2ddb788/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:54.014106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69d00d-040f-45ff-a775-c624f4c1511b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:54.014764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69d00d-040f-45ff-a775-c624f4c1511b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:54.015046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69d00d-040f-45ff-a775-c624f4c1511b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:54.042612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ae69d00d-040f-45ff-a775-c624f4c1511b None None] MFA Rules not processed for user `648604d10b624fa8a33ff38fa2ddb788`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:54.043900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ae69d00d-040f-45ff-a775-c624f4c1511b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:54.109421 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4142/8332] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:54.114214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ab71a-2697-4928-bb01-dc12e1a1c274 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:54.194046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ab71a-2697-4928-bb01-dc12e1a1c274 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:54.198651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb57deb-82cb-4cab-a486-e8927a6638f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:54.199276 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb57deb-82cb-4cab-a486-e8927a6638f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:54.199590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb57deb-82cb-4cab-a486-e8927a6638f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:54.199868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb57deb-82cb-4cab-a486-e8927a6638f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:54.200544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb57deb-82cb-4cab-a486-e8927a6638f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:54.202473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb57deb-82cb-4cab-a486-e8927a6638f3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:54.230044 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4191/8333] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:54 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:34:54.234697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69d00d-040f-45ff-a775-c624f4c1511b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:54.245798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69d00d-040f-45ff-a775-c624f4c1511b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:54.303594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec371d-6c79-4b95-8ad1-298fee9110c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:54.304218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec371d-6c79-4b95-8ad1-298fee9110c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:54.304537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec371d-6c79-4b95-8ad1-298fee9110c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:54.304816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec371d-6c79-4b95-8ad1-298fee9110c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:54.305500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec371d-6c79-4b95-8ad1-298fee9110c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:54.307431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec371d-6c79-4b95-8ad1-298fee9110c1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:54.328739 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4143/8334] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:54 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:54.333435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb57deb-82cb-4cab-a486-e8927a6638f3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:54.344509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb57deb-82cb-4cab-a486-e8927a6638f3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:54.349255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a2073-407d-4f75-a95e-d428e7d17965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:54.349909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2073-407d-4f75-a95e-d428e7d17965 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:54.350294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2073-407d-4f75-a95e-d428e7d17965 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:54.350589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2073-407d-4f75-a95e-d428e7d17965 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:54.351299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a2073-407d-4f75-a95e-d428e7d17965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:54.352974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a2073-407d-4f75-a95e-d428e7d17965 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:54.364107 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4192/8335] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:54.368152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec371d-6c79-4b95-8ad1-298fee9110c1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:54.378838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec371d-6c79-4b95-8ad1-298fee9110c1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:54.383688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a399273-fa28-415b-ae5a-f85903bcc5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:54.384351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a399273-fa28-415b-ae5a-f85903bcc5e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:54.384653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a399273-fa28-415b-ae5a-f85903bcc5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:54.384918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a399273-fa28-415b-ae5a-f85903bcc5e7 admin admin] PATH_INFO: `/v3/projects/e2da312cfc2143bf872779fceff0feb8/users/499c53ab73c0491f996096f4e6b6b446/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:54.387167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:54.401407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a399273-fa28-415b-ae5a-f85903bcc5e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2da312cfc2143bf872779fceff0feb8, user_id=499c53ab73c0491f996096f4e6b6b446, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:54.404097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a399273-fa28-415b-ae5a-f85903bcc5e7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:54.417260 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4144/8336] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:54 2022] PUT /identity/v3/projects/e2da312cfc2143bf872779fceff0feb8/users/499c53ab73c0491f996096f4e6b6b446/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:54.421859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a2073-407d-4f75-a95e-d428e7d17965 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:54.432043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a2073-407d-4f75-a95e-d428e7d17965 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:54.494475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307e961-a190-44f7-9e90-f7e1d19581ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:54.495017 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307e961-a190-44f7-9e90-f7e1d19581ff admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:54.495698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307e961-a190-44f7-9e90-f7e1d19581ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:54.495698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307e961-a190-44f7-9e90-f7e1d19581ff admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:54.496272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307e961-a190-44f7-9e90-f7e1d19581ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:54.497860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307e961-a190-44f7-9e90-f7e1d19581ff admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:54.508011 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4193/8337] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:54.512405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a399273-fa28-415b-ae5a-f85903bcc5e7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:54.522896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a399273-fa28-415b-ae5a-f85903bcc5e7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:54.527604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e2ee8-ad8b-41b0-82ff-4f9e7a454769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:54.528267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e2ee8-ad8b-41b0-82ff-4f9e7a454769 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:54.528557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e2ee8-ad8b-41b0-82ff-4f9e7a454769 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:54.528840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e2ee8-ad8b-41b0-82ff-4f9e7a454769 admin admin] PATH_INFO: `/v3/projects/e2da312cfc2143bf872779fceff0feb8/users/499c53ab73c0491f996096f4e6b6b446/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:54.531347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e2ee8-ad8b-41b0-82ff-4f9e7a454769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2da312cfc2143bf872779fceff0feb8, user_id=499c53ab73c0491f996096f4e6b6b446, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:54.533981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e2ee8-ad8b-41b0-82ff-4f9e7a454769 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:54.544257 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4145/8338] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:54 2022] PUT /identity/v3/projects/e2da312cfc2143bf872779fceff0feb8/users/499c53ab73c0491f996096f4e6b6b446/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:54.555478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d4715-7993-466e-b7ce-5ac43100648d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:54.555773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d4715-7993-466e-b7ce-5ac43100648d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:54.556080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d4715-7993-466e-b7ce-5ac43100648d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:54.583002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-151d4715-7993-466e-b7ce-5ac43100648d None None] MFA Rules not processed for user `499c53ab73c0491f996096f4e6b6b446`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:54.584241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-151d4715-7993-466e-b7ce-5ac43100648d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:54.589183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:54.653877 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4194/8339] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:34:54.664823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e2ee8-ad8b-41b0-82ff-4f9e7a454769 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:54.666639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b85e2ee8-ad8b-41b0-82ff-4f9e7a454769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:54.727631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e2ee8-ad8b-41b0-82ff-4f9e7a454769 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:54.731433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e92f8-d17e-4bdd-84e0-36df32c70bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:54.732055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e92f8-d17e-4bdd-84e0-36df32c70bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:54.732341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e92f8-d17e-4bdd-84e0-36df32c70bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:54.732619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e92f8-d17e-4bdd-84e0-36df32c70bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:54.741675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e92f8-d17e-4bdd-84e0-36df32c70bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:54.743103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e92f8-d17e-4bdd-84e0-36df32c70bc5 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:54.752973 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4146/8340] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:34:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:34:56.271074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d4715-7993-466e-b7ce-5ac43100648d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:56.338672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d4715-7993-466e-b7ce-5ac43100648d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:56.343956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18398d9b-aa44-43ee-90f1-addd11606a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:56.344635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18398d9b-aa44-43ee-90f1-addd11606a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:56.344923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18398d9b-aa44-43ee-90f1-addd11606a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:56.345198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18398d9b-aa44-43ee-90f1-addd11606a4e admin admin] PATH_INFO: `/v3/users/648604d10b624fa8a33ff38fa2ddb788` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:56.346362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18398d9b-aa44-43ee-90f1-addd11606a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=648604d10b624fa8a33ff38fa2ddb788)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:56.348330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18398d9b-aa44-43ee-90f1-addd11606a4e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:56.395871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-18398d9b-aa44-43ee-90f1-addd11606a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '648604d10b624fa8a33ff38fa2ddb788'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:56.408134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-18398d9b-aa44-43ee-90f1-addd11606a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '648604d10b624fa8a33ff38fa2ddb788'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:56.408801 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-18398d9b-aa44-43ee-90f1-addd11606a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '648604d10b624fa8a33ff38fa2ddb788'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:56.415656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-18398d9b-aa44-43ee-90f1-addd11606a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '648604d10b624fa8a33ff38fa2ddb788'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:56.416296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-18398d9b-aa44-43ee-90f1-addd11606a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '648604d10b624fa8a33ff38fa2ddb788'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:56.429846 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4195/8341] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:56 2022] DELETE /identity/v3/users/648604d10b624fa8a33ff38fa2ddb788 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:56.434500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3d22a-ab15-4f76-8921-952fca8a839c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:56.434992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3d22a-ab15-4f76-8921-952fca8a839c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:56.435137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3d22a-ab15-4f76-8921-952fca8a839c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:56.454206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-98f3d22a-ab15-4f76-8921-952fca8a839c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:56.455438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-98f3d22a-ab15-4f76-8921-952fca8a839c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:56.517160 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4147/8342] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:56.529628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18398d9b-aa44-43ee-90f1-addd11606a4e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:56.531278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-18398d9b-aa44-43ee-90f1-addd11606a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:56.558744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:56.595133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18398d9b-aa44-43ee-90f1-addd11606a4e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:56.598742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fb258-769a-4e9e-969f-bcaba8f5b58c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:56.599393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fb258-769a-4e9e-969f-bcaba8f5b58c service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:56.599676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fb258-769a-4e9e-969f-bcaba8f5b58c service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:56.599952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fb258-769a-4e9e-969f-bcaba8f5b58c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:56.609036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759fb258-769a-4e9e-969f-bcaba8f5b58c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:56.610453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759fb258-769a-4e9e-969f-bcaba8f5b58c service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:56.619860 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4196/8343] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:34:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:34:56.890882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3d22a-ab15-4f76-8921-952fca8a839c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:56.892362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-98f3d22a-ab15-4f76-8921-952fca8a839c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:56.906696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3d22a-ab15-4f76-8921-952fca8a839c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:56.911435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13092d45-6a2d-4410-9863-4867394bd85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:56.912088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13092d45-6a2d-4410-9863-4867394bd85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:56.912819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13092d45-6a2d-4410-9863-4867394bd85f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:56.912819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13092d45-6a2d-4410-9863-4867394bd85f admin admin] PATH_INFO: `/v3/projects/02b81b7ff47f4c878eadcc6c0f115a8c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:56.913927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13092d45-6a2d-4410-9863-4867394bd85f admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b81b7ff47f4c878eadcc6c0f115a8c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:56.915881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13092d45-6a2d-4410-9863-4867394bd85f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:56.963059 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-13092d45-6a2d-4410-9863-4867394bd85f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b81b7ff47f4c878eadcc6c0f115a8c', 'request_id': 'req-13092d45-6a2d-4410-9863-4867394bd85f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:56.971613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-13092d45-6a2d-4410-9863-4867394bd85f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b81b7ff47f4c878eadcc6c0f115a8c', 'request_id': 'req-13092d45-6a2d-4410-9863-4867394bd85f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:56.977977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-13092d45-6a2d-4410-9863-4867394bd85f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b81b7ff47f4c878eadcc6c0f115a8c', 'request_id': 'req-13092d45-6a2d-4410-9863-4867394bd85f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:56.980746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:57.000626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-13092d45-6a2d-4410-9863-4867394bd85f admin admin] The token cache is being invalidate because project 02b81b7ff47f4c878eadcc6c0f115a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:57.000928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-13092d45-6a2d-4410-9863-4867394bd85f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:57.001598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-13092d45-6a2d-4410-9863-4867394bd85f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:57.003124 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4148/8344] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:56 2022] DELETE /identity/v3/projects/02b81b7ff47f4c878eadcc6c0f115a8c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:57.007101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fb258-769a-4e9e-969f-bcaba8f5b58c service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:57.017239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fb258-769a-4e9e-969f-bcaba8f5b58c service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:57.073558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e0ea2-a722-4b69-b867-826b8aa1d110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:57.074205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e0ea2-a722-4b69-b867-826b8aa1d110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:57.074492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e0ea2-a722-4b69-b867-826b8aa1d110 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:57.074775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e0ea2-a722-4b69-b867-826b8aa1d110 admin admin] PATH_INFO: `/v3/users/499c53ab73c0491f996096f4e6b6b446` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:57.075946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e0ea2-a722-4b69-b867-826b8aa1d110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=499c53ab73c0491f996096f4e6b6b446)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:57.077851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e0ea2-a722-4b69-b867-826b8aa1d110 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:57.122590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b0e0ea2-a722-4b69-b867-826b8aa1d110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '499c53ab73c0491f996096f4e6b6b446'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:57.135352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b0e0ea2-a722-4b69-b867-826b8aa1d110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '499c53ab73c0491f996096f4e6b6b446'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:57.136034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b0e0ea2-a722-4b69-b867-826b8aa1d110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '499c53ab73c0491f996096f4e6b6b446'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:57.143167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b0e0ea2-a722-4b69-b867-826b8aa1d110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '499c53ab73c0491f996096f4e6b6b446'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:57.143838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b0e0ea2-a722-4b69-b867-826b8aa1d110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '499c53ab73c0491f996096f4e6b6b446'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:57.156394 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4197/8345] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:34:57 2022] DELETE /identity/v3/users/499c53ab73c0491f996096f4e6b6b446 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:57.428956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13092d45-6a2d-4410-9863-4867394bd85f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:57.430428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-13092d45-6a2d-4410-9863-4867394bd85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:57.445384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13092d45-6a2d-4410-9863-4867394bd85f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:57.505824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e3fe4-a3fd-4a55-a419-817d9450cb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:57.506491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e3fe4-a3fd-4a55-a419-817d9450cb1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:57.506766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e3fe4-a3fd-4a55-a419-817d9450cb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:57.507048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e3fe4-a3fd-4a55-a419-817d9450cb1b admin admin] PATH_INFO: `/v3/projects/e2da312cfc2143bf872779fceff0feb8` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:57.508262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e3fe4-a3fd-4a55-a419-817d9450cb1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2da312cfc2143bf872779fceff0feb8)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:57.510207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e3fe4-a3fd-4a55-a419-817d9450cb1b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:57.562211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-249e3fe4-a3fd-4a55-a419-817d9450cb1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2da312cfc2143bf872779fceff0feb8', 'request_id': 'req-249e3fe4-a3fd-4a55-a419-817d9450cb1b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:57.569473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-249e3fe4-a3fd-4a55-a419-817d9450cb1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2da312cfc2143bf872779fceff0feb8', 'request_id': 'req-249e3fe4-a3fd-4a55-a419-817d9450cb1b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:57.575117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-249e3fe4-a3fd-4a55-a419-817d9450cb1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2da312cfc2143bf872779fceff0feb8', 'request_id': 'req-249e3fe4-a3fd-4a55-a419-817d9450cb1b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:57.586198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-249e3fe4-a3fd-4a55-a419-817d9450cb1b admin admin] The token cache is being invalidate because project e2da312cfc2143bf872779fceff0feb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:34:57.586479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-249e3fe4-a3fd-4a55-a419-817d9450cb1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:57.587125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-249e3fe4-a3fd-4a55-a419-817d9450cb1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:34:57.588684 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4149/8346] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:34:57 2022] DELETE /identity/v3/projects/e2da312cfc2143bf872779fceff0feb8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:57.594030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e0fb9-4717-47c5-96be-0a60525dbf6c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:57.594516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e0fb9-4717-47c5-96be-0a60525dbf6c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:57.594633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e0fb9-4717-47c5-96be-0a60525dbf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:57.614711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-524e0fb9-4717-47c5-96be-0a60525dbf6c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:57.615930 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-524e0fb9-4717-47c5-96be-0a60525dbf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:57.658219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:57.679573 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4198/8347] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:57.687411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487926d-09bc-45c5-a83e-5746a9c25e66 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:57.687712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487926d-09bc-45c5-a83e-5746a9c25e66 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:57.687995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487926d-09bc-45c5-a83e-5746a9c25e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:57.708179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6487926d-09bc-45c5-a83e-5746a9c25e66 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:57.709399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6487926d-09bc-45c5-a83e-5746a9c25e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:57.718530 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4150/8348] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:57.722741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e0fb9-4717-47c5-96be-0a60525dbf6c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:57.732502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e0fb9-4717-47c5-96be-0a60525dbf6c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:57.737074 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8ba06-f303-47ee-a5fb-afdf891707d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:57.737687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8ba06-f303-47ee-a5fb-afdf891707d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:57.737976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8ba06-f303-47ee-a5fb-afdf891707d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:57.738260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8ba06-f303-47ee-a5fb-afdf891707d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:57.738981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8ba06-f303-47ee-a5fb-afdf891707d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:34:57.739304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8ba06-f303-47ee-a5fb-afdf891707d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:57.740910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8ba06-f303-47ee-a5fb-afdf891707d0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:57.752539 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4199/8349] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:34:57.756770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487926d-09bc-45c5-a83e-5746a9c25e66 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:57.766727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487926d-09bc-45c5-a83e-5746a9c25e66 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:57.771401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8950e2d-84dd-4fa3-96a2-d58f9813a2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:57.772031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8950e2d-84dd-4fa3-96a2-d58f9813a2bc admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:57.772317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8950e2d-84dd-4fa3-96a2-d58f9813a2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:57.772593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8950e2d-84dd-4fa3-96a2-d58f9813a2bc admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:57.773252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8950e2d-84dd-4fa3-96a2-d58f9813a2bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:57.775142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8950e2d-84dd-4fa3-96a2-d58f9813a2bc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:57.802564 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4151/8350] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:57 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:57.806704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8ba06-f303-47ee-a5fb-afdf891707d0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:57.816793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8ba06-f303-47ee-a5fb-afdf891707d0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:57.873200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00515eb3-e795-46d2-a711-19e40cc7aacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:57.873744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00515eb3-e795-46d2-a711-19e40cc7aacd admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:57.874030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00515eb3-e795-46d2-a711-19e40cc7aacd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:57.874306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00515eb3-e795-46d2-a711-19e40cc7aacd admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:57.875215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00515eb3-e795-46d2-a711-19e40cc7aacd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:57.877194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00515eb3-e795-46d2-a711-19e40cc7aacd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:57.901406 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4200/8351] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:57 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:57.902745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8950e2d-84dd-4fa3-96a2-d58f9813a2bc admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:57.914030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8950e2d-84dd-4fa3-96a2-d58f9813a2bc admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:57.918852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11361271-84d9-43ee-8a91-7d20467aa62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:57.919683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11361271-84d9-43ee-8a91-7d20467aa62b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:57.920015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11361271-84d9-43ee-8a91-7d20467aa62b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:57.920442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11361271-84d9-43ee-8a91-7d20467aa62b admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:57.921145 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11361271-84d9-43ee-8a91-7d20467aa62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:57.922861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11361271-84d9-43ee-8a91-7d20467aa62b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:57.933874 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4152/8352] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:57.937864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00515eb3-e795-46d2-a711-19e40cc7aacd admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:57.948253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00515eb3-e795-46d2-a711-19e40cc7aacd admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:57.953771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b2ecc-4687-41ba-87cb-311180cab4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:57.954680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b2ecc-4687-41ba-87cb-311180cab4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:57.954680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b2ecc-4687-41ba-87cb-311180cab4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:57.954980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b2ecc-4687-41ba-87cb-311180cab4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:57.956036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b2ecc-4687-41ba-87cb-311180cab4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:57.957721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b2ecc-4687-41ba-87cb-311180cab4c2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:57.970596 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4201/8353] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:57.974851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11361271-84d9-43ee-8a91-7d20467aa62b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:57.985025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11361271-84d9-43ee-8a91-7d20467aa62b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:57.989626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909b309-62a5-4c0e-83d5-bfa12fb0d21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:57.990304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909b309-62a5-4c0e-83d5-bfa12fb0d21a admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:57.990591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909b309-62a5-4c0e-83d5-bfa12fb0d21a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:57.990874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909b309-62a5-4c0e-83d5-bfa12fb0d21a admin admin] PATH_INFO: `/v3/projects/3dd91bab71e44f49ae0ab464b1a8c9ec/users/e91a5f9bdda64cf8a525459544719edb/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:58.012982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909b309-62a5-4c0e-83d5-bfa12fb0d21a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd91bab71e44f49ae0ab464b1a8c9ec, user_id=e91a5f9bdda64cf8a525459544719edb, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:58.016354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909b309-62a5-4c0e-83d5-bfa12fb0d21a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:58.030674 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4153/8354] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:57 2022] PUT /identity/v3/projects/3dd91bab71e44f49ae0ab464b1a8c9ec/users/e91a5f9bdda64cf8a525459544719edb/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:58.132574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd08e7d-5698-4e7d-9558-d73d1858098b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:58.132798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd08e7d-5698-4e7d-9558-d73d1858098b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:58.133093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd08e7d-5698-4e7d-9558-d73d1858098b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:58.161008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0fd08e7d-5698-4e7d-9558-d73d1858098b None None] MFA Rules not processed for user `e91a5f9bdda64cf8a525459544719edb`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:58.162222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0fd08e7d-5698-4e7d-9558-d73d1858098b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:58.226446 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4202/8355] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:58.230949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909b309-62a5-4c0e-83d5-bfa12fb0d21a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:58.256137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:58.295962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909b309-62a5-4c0e-83d5-bfa12fb0d21a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:58.300775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457ffa5-522a-4852-ae5f-d37573bf4d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:58.301398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457ffa5-522a-4852-ae5f-d37573bf4d8e admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:58.301688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457ffa5-522a-4852-ae5f-d37573bf4d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:58.301969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457ffa5-522a-4852-ae5f-d37573bf4d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:58.302628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457ffa5-522a-4852-ae5f-d37573bf4d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:58.304595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457ffa5-522a-4852-ae5f-d37573bf4d8e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:58.332264 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4154/8356] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:34:58 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:58.336443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd08e7d-5698-4e7d-9558-d73d1858098b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:58.347392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd08e7d-5698-4e7d-9558-d73d1858098b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:58.387142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:58.406671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364b708-a1ff-4d2c-870b-65f1034413ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:58.407344 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364b708-a1ff-4d2c-870b-65f1034413ea admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:58.407636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364b708-a1ff-4d2c-870b-65f1034413ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:58.407915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364b708-a1ff-4d2c-870b-65f1034413ea admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:58.408580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364b708-a1ff-4d2c-870b-65f1034413ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:58.410569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364b708-a1ff-4d2c-870b-65f1034413ea admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:58.434617 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4203/8357] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:34:58 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:34:58.436842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457ffa5-522a-4852-ae5f-d37573bf4d8e admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:58.447280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457ffa5-522a-4852-ae5f-d37573bf4d8e admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:58.451929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978beb63-96ee-43b3-88ed-7725de0fe4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:58.452534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978beb63-96ee-43b3-88ed-7725de0fe4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:58.452816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978beb63-96ee-43b3-88ed-7725de0fe4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:58.453093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978beb63-96ee-43b3-88ed-7725de0fe4e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:58.453776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978beb63-96ee-43b3-88ed-7725de0fe4e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:58.455390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978beb63-96ee-43b3-88ed-7725de0fe4e1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:58.465980 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4155/8358] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:58.470100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364b708-a1ff-4d2c-870b-65f1034413ea admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:58.480280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364b708-a1ff-4d2c-870b-65f1034413ea admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:58.485637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de540e-2f60-46b0-b885-befd63cff341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:58.486301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de540e-2f60-46b0-b885-befd63cff341 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:58.486588 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de540e-2f60-46b0-b885-befd63cff341 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:58.486894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de540e-2f60-46b0-b885-befd63cff341 admin admin] PATH_INFO: `/v3/projects/1e1adc34ed9e4409a4f3685b78285916/users/48899d4874544670b015a620b3e7ad2e/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:58.502392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de540e-2f60-46b0-b885-befd63cff341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1adc34ed9e4409a4f3685b78285916, user_id=48899d4874544670b015a620b3e7ad2e, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:58.505079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de540e-2f60-46b0-b885-befd63cff341 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:58.518476 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4204/8359] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:58 2022] PUT /identity/v3/projects/1e1adc34ed9e4409a4f3685b78285916/users/48899d4874544670b015a620b3e7ad2e/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:58.522753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978beb63-96ee-43b3-88ed-7725de0fe4e1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:58.532944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978beb63-96ee-43b3-88ed-7725de0fe4e1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:58.591880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5f71b-62c2-4667-918c-e9e78157c181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:58.592500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5f71b-62c2-4667-918c-e9e78157c181 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:58.592790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5f71b-62c2-4667-918c-e9e78157c181 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:58.593073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5f71b-62c2-4667-918c-e9e78157c181 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:58.593764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5f71b-62c2-4667-918c-e9e78157c181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:58.595398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5f71b-62c2-4667-918c-e9e78157c181 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:58.610485 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4156/8360] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:34:58.614825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de540e-2f60-46b0-b885-befd63cff341 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:58.626294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de540e-2f60-46b0-b885-befd63cff341 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:58.630952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a4288-b2ec-4c20-a782-6fdccc59cd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:58.631656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a4288-b2ec-4c20-a782-6fdccc59cd5c admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:58.631941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a4288-b2ec-4c20-a782-6fdccc59cd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:58.632225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a4288-b2ec-4c20-a782-6fdccc59cd5c admin admin] PATH_INFO: `/v3/projects/1e1adc34ed9e4409a4f3685b78285916/users/48899d4874544670b015a620b3e7ad2e/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:58.634206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a4288-b2ec-4c20-a782-6fdccc59cd5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1adc34ed9e4409a4f3685b78285916, user_id=48899d4874544670b015a620b3e7ad2e, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:58.636909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a4288-b2ec-4c20-a782-6fdccc59cd5c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:58.648361 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4205/8361] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:34:58 2022] PUT /identity/v3/projects/1e1adc34ed9e4409a4f3685b78285916/users/48899d4874544670b015a620b3e7ad2e/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:34:58.658442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a053dc0-8365-401e-9487-c70c3453ba99 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:58.658739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a053dc0-8365-401e-9487-c70c3453ba99 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:58.659031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a053dc0-8365-401e-9487-c70c3453ba99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:58.687796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6a053dc0-8365-401e-9487-c70c3453ba99 None None] MFA Rules not processed for user `48899d4874544670b015a620b3e7ad2e`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:34:58.689021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6a053dc0-8365-401e-9487-c70c3453ba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:58.757547 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4157/8362] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:34:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:34:58.767975 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a4288-b2ec-4c20-a782-6fdccc59cd5c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:34:58.769711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-702a4288-b2ec-4c20-a782-6fdccc59cd5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:34:58.830258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a4288-b2ec-4c20-a782-6fdccc59cd5c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:34:58.834081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf59860-2c51-44bc-8723-97758b1af254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:34:58.834692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf59860-2c51-44bc-8723-97758b1af254 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:34:58.834983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf59860-2c51-44bc-8723-97758b1af254 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:34:58.835267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf59860-2c51-44bc-8723-97758b1af254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:34:58.844844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf59860-2c51-44bc-8723-97758b1af254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:34:58.846274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf59860-2c51-44bc-8723-97758b1af254 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:34:58.855893 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4206/8363] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:34:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:35:02.114503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef38dab-ec1d-45d3-a255-fe24c203db75 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:02.115106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef38dab-ec1d-45d3-a255-fe24c203db75 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:02.115106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef38dab-ec1d-45d3-a255-fe24c203db75 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:02.116356 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4158/8364] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:35:02.122155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470062d6-563d-45f1-8514-3d81edc24671 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:02.123069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470062d6-563d-45f1-8514-3d81edc24671 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:02.123936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470062d6-563d-45f1-8514-3d81edc24671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:02.147055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-470062d6-563d-45f1-8514-3d81edc24671 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:02.148325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-470062d6-563d-45f1-8514-3d81edc24671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:02.242260 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4207/8365] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:35:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:35:02.268432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef38dab-ec1d-45d3-a255-fe24c203db75 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:02.270469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3ef38dab-ec1d-45d3-a255-fe24c203db75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:02.295473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef38dab-ec1d-45d3-a255-fe24c203db75 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:02.301865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae22a0-80eb-4ceb-b029-0de77854ea28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:02.302693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae22a0-80eb-4ceb-b029-0de77854ea28 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:02.302984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae22a0-80eb-4ceb-b029-0de77854ea28 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:02.303273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae22a0-80eb-4ceb-b029-0de77854ea28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:02.312945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae22a0-80eb-4ceb-b029-0de77854ea28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:02.314545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae22a0-80eb-4ceb-b029-0de77854ea28 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:02.325092 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4159/8366] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:35:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:35:03.475578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470062d6-563d-45f1-8514-3d81edc24671 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:03.496660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470062d6-563d-45f1-8514-3d81edc24671 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:03.504309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142945f2-5074-4d2d-b213-680661fa1eca tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48899d4874544670b015a620b3e7ad2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e1adc34ed9e4409a4f3685b78285916', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:03.504968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142945f2-5074-4d2d-b213-680661fa1eca tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:03.505259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142945f2-5074-4d2d-b213-680661fa1eca tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:03.505544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142945f2-5074-4d2d-b213-680661fa1eca tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:03.506273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142945f2-5074-4d2d-b213-680661fa1eca tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:35:03.506585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142945f2-5074-4d2d-b213-680661fa1eca tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:03.508366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142945f2-5074-4d2d-b213-680661fa1eca tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:03.527156 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4208/8367] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:35:03.531675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae22a0-80eb-4ceb-b029-0de77854ea28 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:03.538739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:03.543533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae22a0-80eb-4ceb-b029-0de77854ea28 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:03.551044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af492b-3397-4156-9f4a-927892376dd5 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48899d4874544670b015a620b3e7ad2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e1adc34ed9e4409a4f3685b78285916', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:03.552355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af492b-3397-4156-9f4a-927892376dd5 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:03.552853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af492b-3397-4156-9f4a-927892376dd5 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:03.553327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af492b-3397-4156-9f4a-927892376dd5 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:03.554309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af492b-3397-4156-9f4a-927892376dd5 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:03.556954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af492b-3397-4156-9f4a-927892376dd5 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:03.590765 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4160/8368] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:35:03 2022] POST /identity/v3/projects => generated 348 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:35:03.595463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142945f2-5074-4d2d-b213-680661fa1eca tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:03.606624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142945f2-5074-4d2d-b213-680661fa1eca tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:03.613130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:03.737112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0264278-2c9c-4c8c-bdd8-d0facfbf974c tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48899d4874544670b015a620b3e7ad2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e1adc34ed9e4409a4f3685b78285916', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:03.737788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0264278-2c9c-4c8c-bdd8-d0facfbf974c tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:03.738237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0264278-2c9c-4c8c-bdd8-d0facfbf974c tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:03.738688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0264278-2c9c-4c8c-bdd8-d0facfbf974c tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:03.739524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0264278-2c9c-4c8c-bdd8-d0facfbf974c tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:35:03.739984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0264278-2c9c-4c8c-bdd8-d0facfbf974c tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:03.741598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0264278-2c9c-4c8c-bdd8-d0facfbf974c tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:03.760309 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4209/8369] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:35:04.494261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af492b-3397-4156-9f4a-927892376dd5 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:04.505553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af492b-3397-4156-9f4a-927892376dd5 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:04.510377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056207d-8143-433b-89bd-2cc7384f6f84 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48899d4874544670b015a620b3e7ad2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e1adc34ed9e4409a4f3685b78285916', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:04.511019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056207d-8143-433b-89bd-2cc7384f6f84 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:04.511329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056207d-8143-433b-89bd-2cc7384f6f84 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:04.511636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056207d-8143-433b-89bd-2cc7384f6f84 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] PATH_INFO: `/v3/projects/737fe3188b234894b74f18eacb64c1f9` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:04.512779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056207d-8143-433b-89bd-2cc7384f6f84 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] RBAC: Authorizing `identity:delete_project(project_id=737fe3188b234894b74f18eacb64c1f9)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:04.514725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056207d-8143-433b-89bd-2cc7384f6f84 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:04.564866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b056207d-8143-433b-89bd-2cc7384f6f84 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '737fe3188b234894b74f18eacb64c1f9', 'request_id': 'req-b056207d-8143-433b-89bd-2cc7384f6f84'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:04.572540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b056207d-8143-433b-89bd-2cc7384f6f84 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '737fe3188b234894b74f18eacb64c1f9', 'request_id': 'req-b056207d-8143-433b-89bd-2cc7384f6f84'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:04.578619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b056207d-8143-433b-89bd-2cc7384f6f84 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '737fe3188b234894b74f18eacb64c1f9', 'request_id': 'req-b056207d-8143-433b-89bd-2cc7384f6f84'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:04.590354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b056207d-8143-433b-89bd-2cc7384f6f84 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] The token cache is being invalidate because project 737fe3188b234894b74f18eacb64c1f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:35:04.591062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b056207d-8143-433b-89bd-2cc7384f6f84 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:04.591328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b056207d-8143-433b-89bd-2cc7384f6f84 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:04.592860 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4161/8370] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:35:04 2022] DELETE /identity/v3/projects/737fe3188b234894b74f18eacb64c1f9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:35:04.603617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0264278-2c9c-4c8c-bdd8-d0facfbf974c tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:04.605399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f0264278-2c9c-4c8c-bdd8-d0facfbf974c tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:04.666500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0264278-2c9c-4c8c-bdd8-d0facfbf974c tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:04.715186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80c3c3-fc89-482a-ac97-eae9fbfaaba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:04.715864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80c3c3-fc89-482a-ac97-eae9fbfaaba8 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:04.716153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80c3c3-fc89-482a-ac97-eae9fbfaaba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:04.716434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80c3c3-fc89-482a-ac97-eae9fbfaaba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:04.718602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5a80c3c3-fc89-482a-ac97-eae9fbfaaba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:04.786645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80c3c3-fc89-482a-ac97-eae9fbfaaba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:04.788130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80c3c3-fc89-482a-ac97-eae9fbfaaba8 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:04.798023 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4210/8371] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:35:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:35:14.587176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=34,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:14.793024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:27.711789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056207d-8143-433b-89bd-2cc7384f6f84 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:27.713116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b056207d-8143-433b-89bd-2cc7384f6f84 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:27.819044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056207d-8143-433b-89bd-2cc7384f6f84 tempest-RoutersIpV6AdminTest-1794687894 tempest-RoutersIpV6AdminTest-1794687894-project-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:27.824599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d78cc-4107-4619-93da-e652188ea11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:27.826084 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d78cc-4107-4619-93da-e652188ea11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:27.826540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d78cc-4107-4619-93da-e652188ea11e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:27.826990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d78cc-4107-4619-93da-e652188ea11e admin admin] PATH_INFO: `/v3/users/937935818cda4a6e8b9104d38aa3a8b1` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:27.828453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d78cc-4107-4619-93da-e652188ea11e admin admin] RBAC: Authorizing `identity:delete_user(user_id=937935818cda4a6e8b9104d38aa3a8b1)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:27.830612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d78cc-4107-4619-93da-e652188ea11e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:27.889459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-258d78cc-4107-4619-93da-e652188ea11e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '937935818cda4a6e8b9104d38aa3a8b1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:27.890446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-258d78cc-4107-4619-93da-e652188ea11e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '937935818cda4a6e8b9104d38aa3a8b1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:27.905581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-258d78cc-4107-4619-93da-e652188ea11e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '937935818cda4a6e8b9104d38aa3a8b1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:27.906701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-258d78cc-4107-4619-93da-e652188ea11e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '937935818cda4a6e8b9104d38aa3a8b1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:27.916489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-258d78cc-4107-4619-93da-e652188ea11e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '937935818cda4a6e8b9104d38aa3a8b1'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:27.932984 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4162/8372] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:35:27 2022] DELETE /identity/v3/users/937935818cda4a6e8b9104d38aa3a8b1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:28.295761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80c3c3-fc89-482a-ac97-eae9fbfaaba8 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:28.333816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80c3c3-fc89-482a-ac97-eae9fbfaaba8 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:28.393131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e90e0-8351-4695-bab8-d1cbf485789b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:28.394480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e90e0-8351-4695-bab8-d1cbf485789b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:28.394770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e90e0-8351-4695-bab8-d1cbf485789b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:28.395054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e90e0-8351-4695-bab8-d1cbf485789b admin admin] PATH_INFO: `/v3/projects/86550d66e9144788967e5b514cda82d7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:28.396299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e90e0-8351-4695-bab8-d1cbf485789b admin admin] RBAC: Authorizing `identity:delete_project(project_id=86550d66e9144788967e5b514cda82d7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:28.398213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e90e0-8351-4695-bab8-d1cbf485789b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:28.457640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ae0e90e0-8351-4695-bab8-d1cbf485789b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86550d66e9144788967e5b514cda82d7', 'request_id': 'req-ae0e90e0-8351-4695-bab8-d1cbf485789b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:28.465584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ae0e90e0-8351-4695-bab8-d1cbf485789b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86550d66e9144788967e5b514cda82d7', 'request_id': 'req-ae0e90e0-8351-4695-bab8-d1cbf485789b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:28.473343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ae0e90e0-8351-4695-bab8-d1cbf485789b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86550d66e9144788967e5b514cda82d7', 'request_id': 'req-ae0e90e0-8351-4695-bab8-d1cbf485789b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:28.484895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ae0e90e0-8351-4695-bab8-d1cbf485789b admin admin] The token cache is being invalidate because project 86550d66e9144788967e5b514cda82d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:35:28.485192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ae0e90e0-8351-4695-bab8-d1cbf485789b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:28.485835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ae0e90e0-8351-4695-bab8-d1cbf485789b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:28.487468 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4211/8373] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:35:28 2022] DELETE /identity/v3/projects/86550d66e9144788967e5b514cda82d7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:28.492670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e5b1f-bb9b-46c4-8163-0ded7d3d5b17 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:28.492965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e5b1f-bb9b-46c4-8163-0ded7d3d5b17 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:28.493248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e5b1f-bb9b-46c4-8163-0ded7d3d5b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:28.515646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4c4e5b1f-bb9b-46c4-8163-0ded7d3d5b17 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:28.516796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4c4e5b1f-bb9b-46c4-8163-0ded7d3d5b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:28.574587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:28.584654 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4163/8374] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:28.594198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba8df4-f17e-47f6-8b09-6328e9c13b97 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:28.594493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba8df4-f17e-47f6-8b09-6328e9c13b97 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:28.594796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba8df4-f17e-47f6-8b09-6328e9c13b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:28.619046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-76ba8df4-f17e-47f6-8b09-6328e9c13b97 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:28.620320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-76ba8df4-f17e-47f6-8b09-6328e9c13b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:28.629384 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4212/8375] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:28.633667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e5b1f-bb9b-46c4-8163-0ded7d3d5b17 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:28.652595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e5b1f-bb9b-46c4-8163-0ded7d3d5b17 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:28.658239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd442a-3b5e-4633-bbe6-1c4b87290dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:28.658803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd442a-3b5e-4633-bbe6-1c4b87290dbf admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:28.659088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd442a-3b5e-4633-bbe6-1c4b87290dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:28.659398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd442a-3b5e-4633-bbe6-1c4b87290dbf admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:28.660114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd442a-3b5e-4633-bbe6-1c4b87290dbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:35:28.660424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd442a-3b5e-4633-bbe6-1c4b87290dbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:28.662032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd442a-3b5e-4633-bbe6-1c4b87290dbf admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:28.675004 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4164/8376] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:35:28.679379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba8df4-f17e-47f6-8b09-6328e9c13b97 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:28.689445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba8df4-f17e-47f6-8b09-6328e9c13b97 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:28.694594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58f7d7-a3fb-406d-9b1c-e0234038d085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:28.695205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58f7d7-a3fb-406d-9b1c-e0234038d085 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:28.695544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58f7d7-a3fb-406d-9b1c-e0234038d085 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:28.695851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58f7d7-a3fb-406d-9b1c-e0234038d085 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:28.696527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58f7d7-a3fb-406d-9b1c-e0234038d085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:28.698420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58f7d7-a3fb-406d-9b1c-e0234038d085 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:28.730489 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4213/8377] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:35:28 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:35:28.732181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd442a-3b5e-4633-bbe6-1c4b87290dbf admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:28.744020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd442a-3b5e-4633-bbe6-1c4b87290dbf admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:28.803565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de3e50-231a-4c51-b598-82429565af03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:28.804201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de3e50-231a-4c51-b598-82429565af03 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:28.804486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de3e50-231a-4c51-b598-82429565af03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:28.804764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de3e50-231a-4c51-b598-82429565af03 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:28.805433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de3e50-231a-4c51-b598-82429565af03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:28.807389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de3e50-231a-4c51-b598-82429565af03 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:28.831391 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4165/8378] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:35:28 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:35:28.835493 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58f7d7-a3fb-406d-9b1c-e0234038d085 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:28.847657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58f7d7-a3fb-406d-9b1c-e0234038d085 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:28.853186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34de6c5-c796-4d84-8eeb-58bab774d216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:28.853826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34de6c5-c796-4d84-8eeb-58bab774d216 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:28.854117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34de6c5-c796-4d84-8eeb-58bab774d216 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:28.854400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34de6c5-c796-4d84-8eeb-58bab774d216 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:28.855103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34de6c5-c796-4d84-8eeb-58bab774d216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:28.857761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34de6c5-c796-4d84-8eeb-58bab774d216 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:28.871326 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4214/8379] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:35:28.873116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de3e50-231a-4c51-b598-82429565af03 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:28.884030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de3e50-231a-4c51-b598-82429565af03 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:28.888895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81212113-8c3f-4383-a3a2-f64a5f68d255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:28.889513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81212113-8c3f-4383-a3a2-f64a5f68d255 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:28.889804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81212113-8c3f-4383-a3a2-f64a5f68d255 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:28.890087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81212113-8c3f-4383-a3a2-f64a5f68d255 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:28.890783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81212113-8c3f-4383-a3a2-f64a5f68d255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:28.892423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81212113-8c3f-4383-a3a2-f64a5f68d255 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:28.904210 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4166/8380] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:35:28.908176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34de6c5-c796-4d84-8eeb-58bab774d216 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:28.918841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34de6c5-c796-4d84-8eeb-58bab774d216 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:28.924572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e429c3f-ce83-44f9-b0dd-f9e313b391f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:28.925254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e429c3f-ce83-44f9-b0dd-f9e313b391f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:28.925547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e429c3f-ce83-44f9-b0dd-f9e313b391f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:28.925834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e429c3f-ce83-44f9-b0dd-f9e313b391f4 admin admin] PATH_INFO: `/v3/projects/7353cff71bc74e7386a4ebba1f6034c0/users/713a3b0b01bd4a7aa128101b5b86be0f/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:28.940775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e429c3f-ce83-44f9-b0dd-f9e313b391f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7353cff71bc74e7386a4ebba1f6034c0, user_id=713a3b0b01bd4a7aa128101b5b86be0f, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:28.943700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e429c3f-ce83-44f9-b0dd-f9e313b391f4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:28.957305 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4215/8381] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:35:28 2022] PUT /identity/v3/projects/7353cff71bc74e7386a4ebba1f6034c0/users/713a3b0b01bd4a7aa128101b5b86be0f/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:28.969213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6901b-2bea-42b8-9624-9fccf27e88bf None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:28.969508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6901b-2bea-42b8-9624-9fccf27e88bf None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:28.969917 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6901b-2bea-42b8-9624-9fccf27e88bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:29.011078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8ba6901b-2bea-42b8-9624-9fccf27e88bf None None] MFA Rules not processed for user `713a3b0b01bd4a7aa128101b5b86be0f`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:29.011078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8ba6901b-2bea-42b8-9624-9fccf27e88bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:29.079324 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4167/8382] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:29.083816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e429c3f-ce83-44f9-b0dd-f9e313b391f4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:29.099372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:29.163652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e429c3f-ce83-44f9-b0dd-f9e313b391f4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:29.170577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69644295-97f6-493a-9c89-04768628b4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:29.171494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69644295-97f6-493a-9c89-04768628b4e3 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:29.171790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69644295-97f6-493a-9c89-04768628b4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:29.172135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69644295-97f6-493a-9c89-04768628b4e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:29.172962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69644295-97f6-493a-9c89-04768628b4e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:29.174884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69644295-97f6-493a-9c89-04768628b4e3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:29.205558 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4216/8383] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:35:29 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:35:29.206702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6901b-2bea-42b8-9624-9fccf27e88bf None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:29.218665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6901b-2bea-42b8-9624-9fccf27e88bf None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:29.271520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:29.280586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ecb7c-1a06-4d3e-ab40-c41caeabd086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:29.281219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ecb7c-1a06-4d3e-ab40-c41caeabd086 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:29.281532 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ecb7c-1a06-4d3e-ab40-c41caeabd086 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:29.281813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ecb7c-1a06-4d3e-ab40-c41caeabd086 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:29.282554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ecb7c-1a06-4d3e-ab40-c41caeabd086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:29.284571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ecb7c-1a06-4d3e-ab40-c41caeabd086 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:29.308681 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4168/8384] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:35:29 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:35:29.310220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69644295-97f6-493a-9c89-04768628b4e3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:29.321976 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69644295-97f6-493a-9c89-04768628b4e3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:29.327373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aeede-6f46-4642-8a4d-a3497e0a174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:29.328019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aeede-6f46-4642-8a4d-a3497e0a174d admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:29.328289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aeede-6f46-4642-8a4d-a3497e0a174d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:29.328572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aeede-6f46-4642-8a4d-a3497e0a174d admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:29.329272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4aeede-6f46-4642-8a4d-a3497e0a174d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:29.330885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4aeede-6f46-4642-8a4d-a3497e0a174d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:29.348244 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4217/8385] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:35:29.354217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ecb7c-1a06-4d3e-ab40-c41caeabd086 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:29.366981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ecb7c-1a06-4d3e-ab40-c41caeabd086 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:29.372336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273ba9a-caeb-41bb-960a-72d00d0a3ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:29.373012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273ba9a-caeb-41bb-960a-72d00d0a3ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:29.373311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273ba9a-caeb-41bb-960a-72d00d0a3ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:29.373580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273ba9a-caeb-41bb-960a-72d00d0a3ae1 admin admin] PATH_INFO: `/v3/projects/9809aced43804e86841fcab4e9311e22/users/060846b8872d4e2c9d895f2404ec1621/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:29.389652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273ba9a-caeb-41bb-960a-72d00d0a3ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9809aced43804e86841fcab4e9311e22, user_id=060846b8872d4e2c9d895f2404ec1621, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:29.392538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273ba9a-caeb-41bb-960a-72d00d0a3ae1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:29.406700 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4169/8386] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:35:29 2022] PUT /identity/v3/projects/9809aced43804e86841fcab4e9311e22/users/060846b8872d4e2c9d895f2404ec1621/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:29.410869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aeede-6f46-4642-8a4d-a3497e0a174d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:29.422555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aeede-6f46-4642-8a4d-a3497e0a174d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:29.487152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ad3a0-7b7c-4240-90da-c60cb78b1082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:29.487824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ad3a0-7b7c-4240-90da-c60cb78b1082 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:29.488115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ad3a0-7b7c-4240-90da-c60cb78b1082 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:29.488393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ad3a0-7b7c-4240-90da-c60cb78b1082 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:29.489086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ad3a0-7b7c-4240-90da-c60cb78b1082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:29.490706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ad3a0-7b7c-4240-90da-c60cb78b1082 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:29.506483 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4218/8387] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:35:29.507727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273ba9a-caeb-41bb-960a-72d00d0a3ae1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:29.521018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273ba9a-caeb-41bb-960a-72d00d0a3ae1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:29.526538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2d7ef-d7ae-4405-b2d2-ff2e23491a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:29.527228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2d7ef-d7ae-4405-b2d2-ff2e23491a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:29.527549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2d7ef-d7ae-4405-b2d2-ff2e23491a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:29.527835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2d7ef-d7ae-4405-b2d2-ff2e23491a31 admin admin] PATH_INFO: `/v3/projects/9809aced43804e86841fcab4e9311e22/users/060846b8872d4e2c9d895f2404ec1621/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:29.529822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2d7ef-d7ae-4405-b2d2-ff2e23491a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9809aced43804e86841fcab4e9311e22, user_id=060846b8872d4e2c9d895f2404ec1621, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:29.532520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2d7ef-d7ae-4405-b2d2-ff2e23491a31 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:29.543771 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4170/8388] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:35:29 2022] PUT /identity/v3/projects/9809aced43804e86841fcab4e9311e22/users/060846b8872d4e2c9d895f2404ec1621/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:29.555234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffef97-bc78-4658-957b-ed3be384db7e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:29.555569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffef97-bc78-4658-957b-ed3be384db7e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:29.555860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffef97-bc78-4658-957b-ed3be384db7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:29.585312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-13ffef97-bc78-4658-957b-ed3be384db7e None None] MFA Rules not processed for user `060846b8872d4e2c9d895f2404ec1621`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:29.586567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-13ffef97-bc78-4658-957b-ed3be384db7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:29.659691 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4219/8389] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:29.670802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2d7ef-d7ae-4405-b2d2-ff2e23491a31 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:29.672745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-95f2d7ef-d7ae-4405-b2d2-ff2e23491a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:29.755433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2d7ef-d7ae-4405-b2d2-ff2e23491a31 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:29.759370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730308a5-4ed6-401f-91a1-6cc6790f7593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:29.760008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730308a5-4ed6-401f-91a1-6cc6790f7593 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:29.760291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730308a5-4ed6-401f-91a1-6cc6790f7593 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:29.760568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730308a5-4ed6-401f-91a1-6cc6790f7593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:29.821541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730308a5-4ed6-401f-91a1-6cc6790f7593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:29.823000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730308a5-4ed6-401f-91a1-6cc6790f7593 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:29.833528 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4171/8390] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:35:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:35:33.670217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffef97-bc78-4658-957b-ed3be384db7e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:33.672106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-13ffef97-bc78-4658-957b-ed3be384db7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:33.690901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffef97-bc78-4658-957b-ed3be384db7e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:33.694950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17517a-219d-410a-a87f-51981bd5281a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:33.695720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17517a-219d-410a-a87f-51981bd5281a service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:33.696012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17517a-219d-410a-a87f-51981bd5281a service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:33.696294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17517a-219d-410a-a87f-51981bd5281a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:33.710100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:33.715160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17517a-219d-410a-a87f-51981bd5281a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:33.719994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17517a-219d-410a-a87f-51981bd5281a service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:33.734070 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4220/8391] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:35:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:35:34.255993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec75eab-2c7f-47df-9552-bb27cbb12376 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:34.257168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec75eab-2c7f-47df-9552-bb27cbb12376 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:34.257820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec75eab-2c7f-47df-9552-bb27cbb12376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:34.323833 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bec75eab-2c7f-47df-9552-bb27cbb12376 None None] MFA Rules not processed for user `9f113fc80feb42148c3dad0c33417dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:34.325818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bec75eab-2c7f-47df-9552-bb27cbb12376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:34.413720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:34.455905 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4172/8392] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:35.268963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17517a-219d-410a-a87f-51981bd5281a service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:35.288526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17517a-219d-410a-a87f-51981bd5281a service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:35.293020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6dc3b-97ba-43e0-a54e-7a3598aae5cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:35.294476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6dc3b-97ba-43e0-a54e-7a3598aae5cf service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:35.294981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6dc3b-97ba-43e0-a54e-7a3598aae5cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:35.295640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6dc3b-97ba-43e0-a54e-7a3598aae5cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:35.297887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-90e6dc3b-97ba-43e0-a54e-7a3598aae5cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:35.329119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6dc3b-97ba-43e0-a54e-7a3598aae5cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:35.331421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6dc3b-97ba-43e0-a54e-7a3598aae5cf service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:35.346472 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4221/8393] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:35:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:35:37.772875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec75eab-2c7f-47df-9552-bb27cbb12376 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:37.776834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bec75eab-2c7f-47df-9552-bb27cbb12376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:38.005246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec75eab-2c7f-47df-9552-bb27cbb12376 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:38.030457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cb923-cf29-4690-8639-ec337bd90172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:38.031179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cb923-cf29-4690-8639-ec337bd90172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:38.031516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cb923-cf29-4690-8639-ec337bd90172 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:38.031803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cb923-cf29-4690-8639-ec337bd90172 admin admin] PATH_INFO: `/v3/users/e91a5f9bdda64cf8a525459544719edb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:38.033671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5cb923-cf29-4690-8639-ec337bd90172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e91a5f9bdda64cf8a525459544719edb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:38.046344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5cb923-cf29-4690-8639-ec337bd90172 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:38.151631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0b5cb923-cf29-4690-8639-ec337bd90172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e91a5f9bdda64cf8a525459544719edb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:38.152327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0b5cb923-cf29-4690-8639-ec337bd90172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e91a5f9bdda64cf8a525459544719edb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:38.173741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0b5cb923-cf29-4690-8639-ec337bd90172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e91a5f9bdda64cf8a525459544719edb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:38.184107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0b5cb923-cf29-4690-8639-ec337bd90172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e91a5f9bdda64cf8a525459544719edb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:38.216141 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0b5cb923-cf29-4690-8639-ec337bd90172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e91a5f9bdda64cf8a525459544719edb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:38.245015 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4173/8394] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:35:37 2022] DELETE /identity/v3/users/e91a5f9bdda64cf8a525459544719edb => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:38.255153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396e903-f398-4931-b0b0-edc1a1cac80c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:38.255791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396e903-f398-4931-b0b0-edc1a1cac80c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:38.255791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396e903-f398-4931-b0b0-edc1a1cac80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:38.356840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4396e903-f398-4931-b0b0-edc1a1cac80c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:38.358495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4396e903-f398-4931-b0b0-edc1a1cac80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:38.471339 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4222/8395] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:38.480851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cb923-cf29-4690-8639-ec337bd90172 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:38.482999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0b5cb923-cf29-4690-8639-ec337bd90172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:38.552083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:38.574184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cb923-cf29-4690-8639-ec337bd90172 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:38.578988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3a701-5ea9-4f7a-840d-faebc14abc31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:38.580160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3a701-5ea9-4f7a-840d-faebc14abc31 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:38.580160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3a701-5ea9-4f7a-840d-faebc14abc31 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:38.580422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3a701-5ea9-4f7a-840d-faebc14abc31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:38.592891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3a701-5ea9-4f7a-840d-faebc14abc31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:38.593902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3a701-5ea9-4f7a-840d-faebc14abc31 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:38.609247 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4174/8396] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:35:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:35:38.851576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396e903-f398-4931-b0b0-edc1a1cac80c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:38.853038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4396e903-f398-4931-b0b0-edc1a1cac80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:38.871249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396e903-f398-4931-b0b0-edc1a1cac80c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:38.877650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5de51-eeac-4d5c-8d71-0b83487dc6aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:38.878299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5de51-eeac-4d5c-8d71-0b83487dc6aa service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:38.878580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5de51-eeac-4d5c-8d71-0b83487dc6aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:38.878855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5de51-eeac-4d5c-8d71-0b83487dc6aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:38.881249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e3f5de51-eeac-4d5c-8d71-0b83487dc6aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:38.984821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5de51-eeac-4d5c-8d71-0b83487dc6aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:38.986474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5de51-eeac-4d5c-8d71-0b83487dc6aa service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:39.024710 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4223/8397] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:35:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:35:39.368506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3a701-5ea9-4f7a-840d-faebc14abc31 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:39.370203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7df3a701-5ea9-4f7a-840d-faebc14abc31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:39.387027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3a701-5ea9-4f7a-840d-faebc14abc31 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:39.392767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a17556-6482-4c07-a711-23756cb5c5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:39.393841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a17556-6482-4c07-a711-23756cb5c5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:39.394305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a17556-6482-4c07-a711-23756cb5c5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:39.394751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a17556-6482-4c07-a711-23756cb5c5d5 admin admin] PATH_INFO: `/v3/projects/3dd91bab71e44f49ae0ab464b1a8c9ec` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:39.396329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a17556-6482-4c07-a711-23756cb5c5d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dd91bab71e44f49ae0ab464b1a8c9ec)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:39.398406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a17556-6482-4c07-a711-23756cb5c5d5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:39.467047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7a17556-6482-4c07-a711-23756cb5c5d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dd91bab71e44f49ae0ab464b1a8c9ec', 'request_id': 'req-a7a17556-6482-4c07-a711-23756cb5c5d5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:39.476884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7a17556-6482-4c07-a711-23756cb5c5d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dd91bab71e44f49ae0ab464b1a8c9ec', 'request_id': 'req-a7a17556-6482-4c07-a711-23756cb5c5d5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:39.486426 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7a17556-6482-4c07-a711-23756cb5c5d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dd91bab71e44f49ae0ab464b1a8c9ec', 'request_id': 'req-a7a17556-6482-4c07-a711-23756cb5c5d5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:39.501126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7a17556-6482-4c07-a711-23756cb5c5d5 admin admin] The token cache is being invalidate because project 3dd91bab71e44f49ae0ab464b1a8c9ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:35:39.501419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7a17556-6482-4c07-a711-23756cb5c5d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:39.503739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a7a17556-6482-4c07-a711-23756cb5c5d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:39.506065 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4175/8398] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:35:39 2022] DELETE /identity/v3/projects/3dd91bab71e44f49ae0ab464b1a8c9ec => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:39.509694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5de51-eeac-4d5c-8d71-0b83487dc6aa service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:39.523396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5de51-eeac-4d5c-8d71-0b83487dc6aa service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:39.585478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:39.616352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3f79e-2b4c-46c6-abb2-c6eadcd2b24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:39.617372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3f79e-2b4c-46c6-abb2-c6eadcd2b24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:39.617842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3f79e-2b4c-46c6-abb2-c6eadcd2b24b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:39.618127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3f79e-2b4c-46c6-abb2-c6eadcd2b24b admin admin] PATH_INFO: `/v3/users/48899d4874544670b015a620b3e7ad2e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:39.619684 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3f79e-2b4c-46c6-abb2-c6eadcd2b24b admin admin] RBAC: Authorizing `identity:delete_user(user_id=48899d4874544670b015a620b3e7ad2e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:39.621770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3f79e-2b4c-46c6-abb2-c6eadcd2b24b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:39.724536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-50d3f79e-2b4c-46c6-abb2-c6eadcd2b24b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48899d4874544670b015a620b3e7ad2e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:39.744642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-50d3f79e-2b4c-46c6-abb2-c6eadcd2b24b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48899d4874544670b015a620b3e7ad2e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:39.745637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-50d3f79e-2b4c-46c6-abb2-c6eadcd2b24b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48899d4874544670b015a620b3e7ad2e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:39.754697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-50d3f79e-2b4c-46c6-abb2-c6eadcd2b24b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48899d4874544670b015a620b3e7ad2e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:39.755475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-50d3f79e-2b4c-46c6-abb2-c6eadcd2b24b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48899d4874544670b015a620b3e7ad2e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:39.773571 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4224/8399] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:35:39 2022] DELETE /identity/v3/users/48899d4874544670b015a620b3e7ad2e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:35:40.078575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a17556-6482-4c07-a711-23756cb5c5d5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:40.080066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a7a17556-6482-4c07-a711-23756cb5c5d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:40.105629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a17556-6482-4c07-a711-23756cb5c5d5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:40.321072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab75c7e-9633-4039-b563-0ddd736bbbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:40.321072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab75c7e-9633-4039-b563-0ddd736bbbb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:40.321072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab75c7e-9633-4039-b563-0ddd736bbbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:40.321072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab75c7e-9633-4039-b563-0ddd736bbbb9 admin admin] PATH_INFO: `/v3/projects/1e1adc34ed9e4409a4f3685b78285916` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:40.321533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab75c7e-9633-4039-b563-0ddd736bbbb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1adc34ed9e4409a4f3685b78285916)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:40.323123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab75c7e-9633-4039-b563-0ddd736bbbb9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:40.409062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3ab75c7e-9633-4039-b563-0ddd736bbbb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1adc34ed9e4409a4f3685b78285916', 'request_id': 'req-3ab75c7e-9633-4039-b563-0ddd736bbbb9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:40.429754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3ab75c7e-9633-4039-b563-0ddd736bbbb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1adc34ed9e4409a4f3685b78285916', 'request_id': 'req-3ab75c7e-9633-4039-b563-0ddd736bbbb9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:40.440208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3ab75c7e-9633-4039-b563-0ddd736bbbb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1adc34ed9e4409a4f3685b78285916', 'request_id': 'req-3ab75c7e-9633-4039-b563-0ddd736bbbb9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:40.461005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:40.465994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3ab75c7e-9633-4039-b563-0ddd736bbbb9 admin admin] The token cache is being invalidate because project 1e1adc34ed9e4409a4f3685b78285916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:35:40.466516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3ab75c7e-9633-4039-b563-0ddd736bbbb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:40.467910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-3ab75c7e-9633-4039-b563-0ddd736bbbb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:40.473126 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4176/8400] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:35:40 2022] DELETE /identity/v3/projects/1e1adc34ed9e4409a4f3685b78285916 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:40.477105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083f48f-0011-4c35-b729-3bf6a5616e11 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:40.477411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083f48f-0011-4c35-b729-3bf6a5616e11 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:40.477763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083f48f-0011-4c35-b729-3bf6a5616e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:40.612044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c083f48f-0011-4c35-b729-3bf6a5616e11 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:40.613922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c083f48f-0011-4c35-b729-3bf6a5616e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:40.745175 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4225/8401] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:40.753199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083f48f-0011-4c35-b729-3bf6a5616e11 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:40.753795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9973f-231e-4b52-a47c-65a9251c667d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:40.754069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9973f-231e-4b52-a47c-65a9251c667d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:40.754355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9973f-231e-4b52-a47c-65a9251c667d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:40.756389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c083f48f-0011-4c35-b729-3bf6a5616e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:40.789818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-dad9973f-231e-4b52-a47c-65a9251c667d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:40.794446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-dad9973f-231e-4b52-a47c-65a9251c667d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:40.830174 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4177/8402] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:40.831170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9973f-231e-4b52-a47c-65a9251c667d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:40.847276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9973f-231e-4b52-a47c-65a9251c667d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:40.856100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8965aaa-5366-4fa9-ba43-79c5fb1c0fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:40.857519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8965aaa-5366-4fa9-ba43-79c5fb1c0fed admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:40.858021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8965aaa-5366-4fa9-ba43-79c5fb1c0fed admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:40.858503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8965aaa-5366-4fa9-ba43-79c5fb1c0fed admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:40.859562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8965aaa-5366-4fa9-ba43-79c5fb1c0fed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:35:40.860107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8965aaa-5366-4fa9-ba43-79c5fb1c0fed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:40.862231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8965aaa-5366-4fa9-ba43-79c5fb1c0fed admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:40.865193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:40.883999 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4178/8403] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:35:40.885170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8965aaa-5366-4fa9-ba43-79c5fb1c0fed admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:40.896627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8965aaa-5366-4fa9-ba43-79c5fb1c0fed admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:40.897346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083f48f-0011-4c35-b729-3bf6a5616e11 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:40.902085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaef90-d53f-4df4-bcfc-2854c1b5ee59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:40.903851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaef90-d53f-4df4-bcfc-2854c1b5ee59 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:40.904070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008f5e0-002b-4568-9528-4bde841044e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:40.904523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaef90-d53f-4df4-bcfc-2854c1b5ee59 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:40.904890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaef90-d53f-4df4-bcfc-2854c1b5ee59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:40.905322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008f5e0-002b-4568-9528-4bde841044e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:40.905781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008f5e0-002b-4568-9528-4bde841044e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:40.906335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008f5e0-002b-4568-9528-4bde841044e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:40.907388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008f5e0-002b-4568-9528-4bde841044e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:40.907818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-45aaef90-d53f-4df4-bcfc-2854c1b5ee59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:40.910399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008f5e0-002b-4568-9528-4bde841044e6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:40.998976 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4179/8404] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:35:40 2022] POST /identity/v3/projects => generated 391 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:35:41.004213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008f5e0-002b-4568-9528-4bde841044e6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:41.061730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aaef90-d53f-4df4-bcfc-2854c1b5ee59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:41.063849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aaef90-d53f-4df4-bcfc-2854c1b5ee59 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:41.083027 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4226/8405] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:35:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:35:41.117491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008f5e0-002b-4568-9528-4bde841044e6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:41.123407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d7658-f25a-4fe3-accc-325d037a940b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:41.124386 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d7658-f25a-4fe3-accc-325d037a940b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:41.125285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d7658-f25a-4fe3-accc-325d037a940b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:41.125795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d7658-f25a-4fe3-accc-325d037a940b admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:41.127961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d7658-f25a-4fe3-accc-325d037a940b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:41.130768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d7658-f25a-4fe3-accc-325d037a940b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:41.165127 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4180/8406] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:35:41 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:35:41.169674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaef90-d53f-4df4-bcfc-2854c1b5ee59 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:41.182509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaef90-d53f-4df4-bcfc-2854c1b5ee59 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:41.187490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8eb27-8132-4e25-a497-87da53e541cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:41.188114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8eb27-8132-4e25-a497-87da53e541cb admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:41.188395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8eb27-8132-4e25-a497-87da53e541cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:41.188672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8eb27-8132-4e25-a497-87da53e541cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:41.189362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8eb27-8132-4e25-a497-87da53e541cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:41.190961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8eb27-8132-4e25-a497-87da53e541cb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:41.205071 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4227/8407] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:35:41.206793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d7658-f25a-4fe3-accc-325d037a940b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:41.226381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d7658-f25a-4fe3-accc-325d037a940b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:41.236574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9aae59-f976-4628-89a9-1c47ef2f6a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:41.238464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9aae59-f976-4628-89a9-1c47ef2f6a04 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:41.238948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9aae59-f976-4628-89a9-1c47ef2f6a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:41.240269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9aae59-f976-4628-89a9-1c47ef2f6a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:41.241896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9aae59-f976-4628-89a9-1c47ef2f6a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:41.244075 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9aae59-f976-4628-89a9-1c47ef2f6a04 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:41.261676 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4181/8408] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:35:41.263159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8eb27-8132-4e25-a497-87da53e541cb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:41.277528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8eb27-8132-4e25-a497-87da53e541cb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:41.294687 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8e844-a9d3-4078-91d5-8a9414cbe516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:41.297080 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8e844-a9d3-4078-91d5-8a9414cbe516 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:41.297654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8e844-a9d3-4078-91d5-8a9414cbe516 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:41.308713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8e844-a9d3-4078-91d5-8a9414cbe516 admin admin] PATH_INFO: `/v3/projects/a8e95094ab784040bf108f18610f11b9/users/5e0f1e79ed194db08d32981b7179cca4/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:41.360580 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8e844-a9d3-4078-91d5-8a9414cbe516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e95094ab784040bf108f18610f11b9, user_id=5e0f1e79ed194db08d32981b7179cca4, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:41.364597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8e844-a9d3-4078-91d5-8a9414cbe516 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:41.399442 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4228/8409] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:35:41 2022] PUT /identity/v3/projects/a8e95094ab784040bf108f18610f11b9/users/5e0f1e79ed194db08d32981b7179cca4/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:35:41.402002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ffaa2-c1c7-49ca-bb4c-263fbbd11f00 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:41.402300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ffaa2-c1c7-49ca-bb4c-263fbbd11f00 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:41.402588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ffaa2-c1c7-49ca-bb4c-263fbbd11f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:41.436537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5e9ffaa2-c1c7-49ca-bb4c-263fbbd11f00 None None] MFA Rules not processed for user `5e0f1e79ed194db08d32981b7179cca4`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:41.437910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5e9ffaa2-c1c7-49ca-bb4c-263fbbd11f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:41.528609 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4182/8410] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:41.550613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8e844-a9d3-4078-91d5-8a9414cbe516 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:41.629861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8e844-a9d3-4078-91d5-8a9414cbe516 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:41.633531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90ee65-a29d-43df-9c66-b07450c93922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:41.634445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90ee65-a29d-43df-9c66-b07450c93922 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:41.634579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90ee65-a29d-43df-9c66-b07450c93922 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:41.634921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90ee65-a29d-43df-9c66-b07450c93922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:41.645642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90ee65-a29d-43df-9c66-b07450c93922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:41.647669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90ee65-a29d-43df-9c66-b07450c93922 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:41.657469 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4229/8411] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:35:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:35:41.704154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ffaa2-c1c7-49ca-bb4c-263fbbd11f00 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:41.726485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:41.788720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ffaa2-c1c7-49ca-bb4c-263fbbd11f00 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:41.797221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4732a5-f53a-48a4-a1ec-9607d9a190c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:41.798105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4732a5-f53a-48a4-a1ec-9607d9a190c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:41.798506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4732a5-f53a-48a4-a1ec-9607d9a190c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:41.799181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4732a5-f53a-48a4-a1ec-9607d9a190c1 admin admin] PATH_INFO: `/v3/users/5e0f1e79ed194db08d32981b7179cca4` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:41.800871 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4732a5-f53a-48a4-a1ec-9607d9a190c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e0f1e79ed194db08d32981b7179cca4)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:41.804517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4732a5-f53a-48a4-a1ec-9607d9a190c1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:41.875855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0e4732a5-f53a-48a4-a1ec-9607d9a190c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e0f1e79ed194db08d32981b7179cca4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:41.876745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0e4732a5-f53a-48a4-a1ec-9607d9a190c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e0f1e79ed194db08d32981b7179cca4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:41.904431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0e4732a5-f53a-48a4-a1ec-9607d9a190c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e0f1e79ed194db08d32981b7179cca4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:41.905756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0e4732a5-f53a-48a4-a1ec-9607d9a190c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e0f1e79ed194db08d32981b7179cca4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:41.927662 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-0e4732a5-f53a-48a4-a1ec-9607d9a190c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e0f1e79ed194db08d32981b7179cca4'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:41.957494 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4183/8412] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:35:41 2022] DELETE /identity/v3/users/5e0f1e79ed194db08d32981b7179cca4 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:41.961835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b22a8d-7700-42dd-a9f6-c040d7839edb None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:41.962131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b22a8d-7700-42dd-a9f6-c040d7839edb None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:41.962412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b22a8d-7700-42dd-a9f6-c040d7839edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:41.992961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c0b22a8d-7700-42dd-a9f6-c040d7839edb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:41.995626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c0b22a8d-7700-42dd-a9f6-c040d7839edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:42.067386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:42.098385 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4230/8413] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:42.109277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4732a5-f53a-48a4-a1ec-9607d9a190c1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:42.110877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0e4732a5-f53a-48a4-a1ec-9607d9a190c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:42.189593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4732a5-f53a-48a4-a1ec-9607d9a190c1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:42.193717 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d373d-60ed-4b9d-a760-c3bdad7b71b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:42.194362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d373d-60ed-4b9d-a760-c3bdad7b71b8 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:42.194653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d373d-60ed-4b9d-a760-c3bdad7b71b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:42.194934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d373d-60ed-4b9d-a760-c3bdad7b71b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:42.205948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d373d-60ed-4b9d-a760-c3bdad7b71b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:42.207591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d373d-60ed-4b9d-a760-c3bdad7b71b8 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:42.219130 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4184/8414] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:35:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:35:42.625297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b22a8d-7700-42dd-a9f6-c040d7839edb None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:42.626864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c0b22a8d-7700-42dd-a9f6-c040d7839edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:42.640820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b22a8d-7700-42dd-a9f6-c040d7839edb None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:42.649143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2562c5-b2b3-4df1-8de3-466ae197040e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:42.650511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2562c5-b2b3-4df1-8de3-466ae197040e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:42.650807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2562c5-b2b3-4df1-8de3-466ae197040e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:42.651094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2562c5-b2b3-4df1-8de3-466ae197040e admin admin] PATH_INFO: `/v3/projects/a8e95094ab784040bf108f18610f11b9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:42.660087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2562c5-b2b3-4df1-8de3-466ae197040e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8e95094ab784040bf108f18610f11b9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:42.669096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2562c5-b2b3-4df1-8de3-466ae197040e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:42.736935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3e2562c5-b2b3-4df1-8de3-466ae197040e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8e95094ab784040bf108f18610f11b9', 'request_id': 'req-3e2562c5-b2b3-4df1-8de3-466ae197040e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:42.744532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3e2562c5-b2b3-4df1-8de3-466ae197040e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8e95094ab784040bf108f18610f11b9', 'request_id': 'req-3e2562c5-b2b3-4df1-8de3-466ae197040e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:42.756616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3e2562c5-b2b3-4df1-8de3-466ae197040e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8e95094ab784040bf108f18610f11b9', 'request_id': 'req-3e2562c5-b2b3-4df1-8de3-466ae197040e'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:42.776584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3e2562c5-b2b3-4df1-8de3-466ae197040e admin admin] The token cache is being invalidate because project a8e95094ab784040bf108f18610f11b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:35:42.776729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3e2562c5-b2b3-4df1-8de3-466ae197040e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:42.777468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3e2562c5-b2b3-4df1-8de3-466ae197040e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:42.783388 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4231/8415] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:35:42 2022] DELETE /identity/v3/projects/a8e95094ab784040bf108f18610f11b9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:42.785738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde066a-e7d5-4d22-bebf-cd1e38f79164 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:42.786227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde066a-e7d5-4d22-bebf-cd1e38f79164 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:42.786559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde066a-e7d5-4d22-bebf-cd1e38f79164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:42.812212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4bde066a-e7d5-4d22-bebf-cd1e38f79164 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:42.813652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4bde066a-e7d5-4d22-bebf-cd1e38f79164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:42.856425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:42.903563 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4185/8416] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:42.909011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992351cc-bbaa-4431-bb3a-7787c62b073e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:42.909307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992351cc-bbaa-4431-bb3a-7787c62b073e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:42.909594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992351cc-bbaa-4431-bb3a-7787c62b073e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:42.926150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bad5a-0863-4cef-9f48-58749df05e92 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:42.926527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bad5a-0863-4cef-9f48-58749df05e92 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:42.926879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bad5a-0863-4cef-9f48-58749df05e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:42.935880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-992351cc-bbaa-4431-bb3a-7787c62b073e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:42.937382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-992351cc-bbaa-4431-bb3a-7787c62b073e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:42.947165 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4232/8417] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:42.951714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992351cc-bbaa-4431-bb3a-7787c62b073e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:42.960594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-019bad5a-0863-4cef-9f48-58749df05e92 None None] MFA Rules not processed for user `713a3b0b01bd4a7aa128101b5b86be0f`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:42.962079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-019bad5a-0863-4cef-9f48-58749df05e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:42.964668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992351cc-bbaa-4431-bb3a-7787c62b073e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:42.972700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d6f8f-320a-4e26-8e19-31b117fe9f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:42.974119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d6f8f-320a-4e26-8e19-31b117fe9f88 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:42.974590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d6f8f-320a-4e26-8e19-31b117fe9f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:42.975810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d6f8f-320a-4e26-8e19-31b117fe9f88 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:42.976926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d6f8f-320a-4e26-8e19-31b117fe9f88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:35:42.977231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d6f8f-320a-4e26-8e19-31b117fe9f88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:42.979683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d6f8f-320a-4e26-8e19-31b117fe9f88 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:43.000502 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4233/8418] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:35:43.002993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d6f8f-320a-4e26-8e19-31b117fe9f88 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:43.018643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d6f8f-320a-4e26-8e19-31b117fe9f88 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:43.025069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2409f4-ea93-4057-a17b-ae3b8c068b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:43.025953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2409f4-ea93-4057-a17b-ae3b8c068b0f admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:43.026470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2409f4-ea93-4057-a17b-ae3b8c068b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:43.027708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2409f4-ea93-4057-a17b-ae3b8c068b0f admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:43.028246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2409f4-ea93-4057-a17b-ae3b8c068b0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:43.030247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2409f4-ea93-4057-a17b-ae3b8c068b0f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:43.052368 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4186/8419] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:35:43.067797 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4234/8420] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:35:43 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:35:43.071709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bad5a-0863-4cef-9f48-58749df05e92 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:43.093083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bad5a-0863-4cef-9f48-58749df05e92 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:43.163888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea841af6-d4df-45d2-ab70-de73f9f4ed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:43.164827 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea841af6-d4df-45d2-ab70-de73f9f4ed7a admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:43.165083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea841af6-d4df-45d2-ab70-de73f9f4ed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:43.165369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea841af6-d4df-45d2-ab70-de73f9f4ed7a admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:43.166044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea841af6-d4df-45d2-ab70-de73f9f4ed7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:43.168284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea841af6-d4df-45d2-ab70-de73f9f4ed7a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:43.196728 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4187/8421] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:35:43 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:35:43.201449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2409f4-ea93-4057-a17b-ae3b8c068b0f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:43.217116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2409f4-ea93-4057-a17b-ae3b8c068b0f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:43.229203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf72876-5eda-47b9-96bb-248f3fa8c417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:43.229849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf72876-5eda-47b9-96bb-248f3fa8c417 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:43.230133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf72876-5eda-47b9-96bb-248f3fa8c417 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:43.230409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf72876-5eda-47b9-96bb-248f3fa8c417 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:43.231193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf72876-5eda-47b9-96bb-248f3fa8c417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:43.233869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf72876-5eda-47b9-96bb-248f3fa8c417 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:43.255813 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4235/8422] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:35:43.258036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea841af6-d4df-45d2-ab70-de73f9f4ed7a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:43.269529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea841af6-d4df-45d2-ab70-de73f9f4ed7a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:43.277298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56724f20-b9a7-41ad-b3c3-69931f206d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:43.277896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56724f20-b9a7-41ad-b3c3-69931f206d86 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:43.278200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56724f20-b9a7-41ad-b3c3-69931f206d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:43.278479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56724f20-b9a7-41ad-b3c3-69931f206d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:43.279185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56724f20-b9a7-41ad-b3c3-69931f206d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:43.280937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56724f20-b9a7-41ad-b3c3-69931f206d86 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:43.295409 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4188/8423] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:35:43.299171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf72876-5eda-47b9-96bb-248f3fa8c417 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:43.314705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf72876-5eda-47b9-96bb-248f3fa8c417 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:43.321139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf243f-7af5-45a3-be34-852b9d49fb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:43.322605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf243f-7af5-45a3-be34-852b9d49fb5a admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:43.322901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf243f-7af5-45a3-be34-852b9d49fb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:43.323188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf243f-7af5-45a3-be34-852b9d49fb5a admin admin] PATH_INFO: `/v3/projects/6de55043c6b2481a9eb2919745dbdceb/users/d3b8914990fd48f681d18ea46d189a44/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:43.344196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf243f-7af5-45a3-be34-852b9d49fb5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de55043c6b2481a9eb2919745dbdceb, user_id=d3b8914990fd48f681d18ea46d189a44, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:43.347238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf243f-7af5-45a3-be34-852b9d49fb5a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:43.366508 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4236/8424] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:35:43 2022] PUT /identity/v3/projects/6de55043c6b2481a9eb2919745dbdceb/users/d3b8914990fd48f681d18ea46d189a44/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:35:43.378909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536d676-e92d-4b91-8568-8e594309c458 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:43.379201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536d676-e92d-4b91-8568-8e594309c458 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:43.379577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536d676-e92d-4b91-8568-8e594309c458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:43.417809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f536d676-e92d-4b91-8568-8e594309c458 None None] MFA Rules not processed for user `d3b8914990fd48f681d18ea46d189a44`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:43.419872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f536d676-e92d-4b91-8568-8e594309c458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:43.501501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:43.526789 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4189/8425] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:43.547058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf243f-7af5-45a3-be34-852b9d49fb5a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:43.550103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-92bf243f-7af5-45a3-be34-852b9d49fb5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:43.627611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf243f-7af5-45a3-be34-852b9d49fb5a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:43.632311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e875b-2aaf-4bdc-b4fa-f7e8bc15d70d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:43.633206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e875b-2aaf-4bdc-b4fa-f7e8bc15d70d service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:43.633497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e875b-2aaf-4bdc-b4fa-f7e8bc15d70d service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:43.633773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e875b-2aaf-4bdc-b4fa-f7e8bc15d70d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:43.641163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:43.645227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e875b-2aaf-4bdc-b4fa-f7e8bc15d70d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:43.647079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e875b-2aaf-4bdc-b4fa-f7e8bc15d70d service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:43.662293 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4237/8426] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:35:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:35:44.455972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536d676-e92d-4b91-8568-8e594309c458 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:44.523543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536d676-e92d-4b91-8568-8e594309c458 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:44.528488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ee2d5-deb3-4cac-9642-6ce43a15886c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:44.529189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ee2d5-deb3-4cac-9642-6ce43a15886c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:44.529479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ee2d5-deb3-4cac-9642-6ce43a15886c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:44.529909 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ee2d5-deb3-4cac-9642-6ce43a15886c admin admin] PATH_INFO: `/v3/users/d3b8914990fd48f681d18ea46d189a44` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:44.531124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ee2d5-deb3-4cac-9642-6ce43a15886c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b8914990fd48f681d18ea46d189a44)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:44.533138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ee2d5-deb3-4cac-9642-6ce43a15886c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:44.581852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d99ee2d5-deb3-4cac-9642-6ce43a15886c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b8914990fd48f681d18ea46d189a44'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:44.582540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d99ee2d5-deb3-4cac-9642-6ce43a15886c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b8914990fd48f681d18ea46d189a44'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:44.595063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d99ee2d5-deb3-4cac-9642-6ce43a15886c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b8914990fd48f681d18ea46d189a44'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:44.595750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d99ee2d5-deb3-4cac-9642-6ce43a15886c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b8914990fd48f681d18ea46d189a44'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:44.604006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d99ee2d5-deb3-4cac-9642-6ce43a15886c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b8914990fd48f681d18ea46d189a44'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:44.616531 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4190/8427] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:35:44 2022] DELETE /identity/v3/users/d3b8914990fd48f681d18ea46d189a44 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:44.621109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d132dd7-12d9-498a-8810-f206c9c475d2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:44.621429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d132dd7-12d9-498a-8810-f206c9c475d2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:44.622455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d132dd7-12d9-498a-8810-f206c9c475d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:44.642825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1d132dd7-12d9-498a-8810-f206c9c475d2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:44.644101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1d132dd7-12d9-498a-8810-f206c9c475d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:44.710386 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4238/8428] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:35:44.720030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ee2d5-deb3-4cac-9642-6ce43a15886c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:44.721542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d99ee2d5-deb3-4cac-9642-6ce43a15886c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:44.786503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ee2d5-deb3-4cac-9642-6ce43a15886c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:44.790168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1740014-520a-4022-971c-3abf3817d8e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:44.790791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1740014-520a-4022-971c-3abf3817d8e5 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:44.791156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1740014-520a-4022-971c-3abf3817d8e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:44.791373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1740014-520a-4022-971c-3abf3817d8e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:44.800716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1740014-520a-4022-971c-3abf3817d8e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:44.802156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1740014-520a-4022-971c-3abf3817d8e5 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:44.812458 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4191/8429] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:35:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:35:45.348321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d132dd7-12d9-498a-8810-f206c9c475d2 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:45.350181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1d132dd7-12d9-498a-8810-f206c9c475d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:45.366425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d132dd7-12d9-498a-8810-f206c9c475d2 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:45.380124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fe383-67b5-441d-8003-76452953daa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:45.381132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fe383-67b5-441d-8003-76452953daa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:45.381977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fe383-67b5-441d-8003-76452953daa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:45.382337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fe383-67b5-441d-8003-76452953daa9 admin admin] PATH_INFO: `/v3/projects/6de55043c6b2481a9eb2919745dbdceb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:45.383868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fe383-67b5-441d-8003-76452953daa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de55043c6b2481a9eb2919745dbdceb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:45.389047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fe383-67b5-441d-8003-76452953daa9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:45.450659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b3fe383-67b5-441d-8003-76452953daa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de55043c6b2481a9eb2919745dbdceb', 'request_id': 'req-8b3fe383-67b5-441d-8003-76452953daa9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:45.458007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b3fe383-67b5-441d-8003-76452953daa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de55043c6b2481a9eb2919745dbdceb', 'request_id': 'req-8b3fe383-67b5-441d-8003-76452953daa9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:45.468648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b3fe383-67b5-441d-8003-76452953daa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de55043c6b2481a9eb2919745dbdceb', 'request_id': 'req-8b3fe383-67b5-441d-8003-76452953daa9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:45.480723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b3fe383-67b5-441d-8003-76452953daa9 admin admin] The token cache is being invalidate because project 6de55043c6b2481a9eb2919745dbdceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:35:45.481576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b3fe383-67b5-441d-8003-76452953daa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:45.482253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-8b3fe383-67b5-441d-8003-76452953daa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:45.483839 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4239/8430] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:35:45 2022] DELETE /identity/v3/projects/6de55043c6b2481a9eb2919745dbdceb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:45.488706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bc292-acd5-46a7-8934-6e7e0a33bcda None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:45.489211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bc292-acd5-46a7-8934-6e7e0a33bcda None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:45.489324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bc292-acd5-46a7-8934-6e7e0a33bcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:45.509898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-630bc292-acd5-46a7-8934-6e7e0a33bcda None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:45.511165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-630bc292-acd5-46a7-8934-6e7e0a33bcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:45.520304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:45.579058 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4192/8431] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:45.587167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53704256-cbb9-48a7-ba9a-20459dc4b8ae None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:45.587561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53704256-cbb9-48a7-ba9a-20459dc4b8ae None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:45.587897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53704256-cbb9-48a7-ba9a-20459dc4b8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:45.630478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-53704256-cbb9-48a7-ba9a-20459dc4b8ae None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:45.632020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-53704256-cbb9-48a7-ba9a-20459dc4b8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:45.645821 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4240/8432] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:45.647196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bc292-acd5-46a7-8934-6e7e0a33bcda None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:45.659611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bc292-acd5-46a7-8934-6e7e0a33bcda None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:45.664774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb650b8e-b0c3-4c90-ae8f-82d1e333a468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:45.665361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb650b8e-b0c3-4c90-ae8f-82d1e333a468 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:45.665644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb650b8e-b0c3-4c90-ae8f-82d1e333a468 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:45.665921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb650b8e-b0c3-4c90-ae8f-82d1e333a468 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:45.666774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb650b8e-b0c3-4c90-ae8f-82d1e333a468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:35:45.667106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb650b8e-b0c3-4c90-ae8f-82d1e333a468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:45.668793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb650b8e-b0c3-4c90-ae8f-82d1e333a468 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:45.685804 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4193/8433] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:35:45.686950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53704256-cbb9-48a7-ba9a-20459dc4b8ae None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:45.698652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53704256-cbb9-48a7-ba9a-20459dc4b8ae None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:45.705112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0717cd5-85ed-4d97-ac31-d47ff4547575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:45.705744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0717cd5-85ed-4d97-ac31-d47ff4547575 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:45.706971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0717cd5-85ed-4d97-ac31-d47ff4547575 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:45.706971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0717cd5-85ed-4d97-ac31-d47ff4547575 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:45.707195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0717cd5-85ed-4d97-ac31-d47ff4547575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:45.709133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0717cd5-85ed-4d97-ac31-d47ff4547575 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:45.748184 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4241/8434] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:35:45 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:35:45.750256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb650b8e-b0c3-4c90-ae8f-82d1e333a468 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:45.763195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb650b8e-b0c3-4c90-ae8f-82d1e333a468 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:45.833504 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3164d-f582-408d-9ce8-b671e3787c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:45.834509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3164d-f582-408d-9ce8-b671e3787c76 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:45.834509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3164d-f582-408d-9ce8-b671e3787c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:45.834791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3164d-f582-408d-9ce8-b671e3787c76 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:45.835612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3164d-f582-408d-9ce8-b671e3787c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:45.838772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3164d-f582-408d-9ce8-b671e3787c76 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:45.869211 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4194/8435] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:35:45 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:35:45.875030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0717cd5-85ed-4d97-ac31-d47ff4547575 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:45.890119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0717cd5-85ed-4d97-ac31-d47ff4547575 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:45.895340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce5cea-51a8-4a85-846f-1a4cacb258fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:45.896532 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce5cea-51a8-4a85-846f-1a4cacb258fd admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:45.897122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce5cea-51a8-4a85-846f-1a4cacb258fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:45.897581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce5cea-51a8-4a85-846f-1a4cacb258fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:45.898478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce5cea-51a8-4a85-846f-1a4cacb258fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:45.900337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce5cea-51a8-4a85-846f-1a4cacb258fd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:45.913513 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4242/8436] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:35:45.918063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3164d-f582-408d-9ce8-b671e3787c76 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:45.941938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3164d-f582-408d-9ce8-b671e3787c76 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:45.950882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71cf50-7326-4783-962a-7ca602150d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:45.951719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71cf50-7326-4783-962a-7ca602150d57 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:45.952134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71cf50-7326-4783-962a-7ca602150d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:45.952564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71cf50-7326-4783-962a-7ca602150d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:45.955387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71cf50-7326-4783-962a-7ca602150d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:45.957453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71cf50-7326-4783-962a-7ca602150d57 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:45.978334 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4195/8437] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:35:45.978613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce5cea-51a8-4a85-846f-1a4cacb258fd admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:45.998094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce5cea-51a8-4a85-846f-1a4cacb258fd admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:46.013822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e14f2-2a06-41ff-aa1a-b5ec44b5b921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:46.014672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e14f2-2a06-41ff-aa1a-b5ec44b5b921 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:46.015241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e14f2-2a06-41ff-aa1a-b5ec44b5b921 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:46.015809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e14f2-2a06-41ff-aa1a-b5ec44b5b921 admin admin] PATH_INFO: `/v3/projects/6099f6bbd53448b08244401c2e5709c5/users/bca2d261b255473cbdedea4f8adebd19/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:46.034589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e14f2-2a06-41ff-aa1a-b5ec44b5b921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6099f6bbd53448b08244401c2e5709c5, user_id=bca2d261b255473cbdedea4f8adebd19, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:46.037858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e14f2-2a06-41ff-aa1a-b5ec44b5b921 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:46.064650 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4243/8438] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:35:45 2022] PUT /identity/v3/projects/6099f6bbd53448b08244401c2e5709c5/users/bca2d261b255473cbdedea4f8adebd19/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:46.076423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350a39a-a333-461a-85df-2ca51266f16c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:46.076707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350a39a-a333-461a-85df-2ca51266f16c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:46.076983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350a39a-a333-461a-85df-2ca51266f16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:46.117640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f350a39a-a333-461a-85df-2ca51266f16c None None] MFA Rules not processed for user `bca2d261b255473cbdedea4f8adebd19`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:46.119233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f350a39a-a333-461a-85df-2ca51266f16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:46.226673 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4196/8439] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:46.253770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e14f2-2a06-41ff-aa1a-b5ec44b5b921 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:46.256378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bb8e14f2-2a06-41ff-aa1a-b5ec44b5b921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:46.284527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:46.343875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e14f2-2a06-41ff-aa1a-b5ec44b5b921 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:46.347783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82e12b-f797-47fc-a978-3bf8871b7b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:46.348413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82e12b-f797-47fc-a978-3bf8871b7b92 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:46.348703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82e12b-f797-47fc-a978-3bf8871b7b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:46.348986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82e12b-f797-47fc-a978-3bf8871b7b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:46.358450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82e12b-f797-47fc-a978-3bf8871b7b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:46.360589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82e12b-f797-47fc-a978-3bf8871b7b92 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:46.369846 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4244/8440] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:35:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:35:46.383999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350a39a-a333-461a-85df-2ca51266f16c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:46.397056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:46.457902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350a39a-a333-461a-85df-2ca51266f16c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:46.462627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783dac3c-a385-4a02-b8fa-239704fdb775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:46.463348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dac3c-a385-4a02-b8fa-239704fdb775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:46.463639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dac3c-a385-4a02-b8fa-239704fdb775 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:46.463922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dac3c-a385-4a02-b8fa-239704fdb775 admin admin] PATH_INFO: `/v3/users/bca2d261b255473cbdedea4f8adebd19` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:46.465140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783dac3c-a385-4a02-b8fa-239704fdb775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bca2d261b255473cbdedea4f8adebd19)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:46.467116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783dac3c-a385-4a02-b8fa-239704fdb775 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:46.519096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-783dac3c-a385-4a02-b8fa-239704fdb775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bca2d261b255473cbdedea4f8adebd19'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:46.519862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-783dac3c-a385-4a02-b8fa-239704fdb775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bca2d261b255473cbdedea4f8adebd19'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:46.533499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-783dac3c-a385-4a02-b8fa-239704fdb775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bca2d261b255473cbdedea4f8adebd19'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:46.534314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-783dac3c-a385-4a02-b8fa-239704fdb775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bca2d261b255473cbdedea4f8adebd19'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:46.542826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-783dac3c-a385-4a02-b8fa-239704fdb775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bca2d261b255473cbdedea4f8adebd19'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:46.556884 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4197/8441] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:35:46 2022] DELETE /identity/v3/users/bca2d261b255473cbdedea4f8adebd19 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:46.562790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24df806-8012-4724-9aca-dce6c11aac93 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:46.563229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24df806-8012-4724-9aca-dce6c11aac93 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:46.563611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24df806-8012-4724-9aca-dce6c11aac93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:46.584971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b24df806-8012-4724-9aca-dce6c11aac93 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:46.586243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b24df806-8012-4724-9aca-dce6c11aac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:46.649113 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4245/8442] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:46.659181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783dac3c-a385-4a02-b8fa-239704fdb775 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:46.660641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-783dac3c-a385-4a02-b8fa-239704fdb775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:46.730445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783dac3c-a385-4a02-b8fa-239704fdb775 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:46.735062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518b3b6-aa77-49c9-ac04-34f8d9f574ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:46.735735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518b3b6-aa77-49c9-ac04-34f8d9f574ce service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:46.736021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518b3b6-aa77-49c9-ac04-34f8d9f574ce service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:46.736302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518b3b6-aa77-49c9-ac04-34f8d9f574ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:46.746233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518b3b6-aa77-49c9-ac04-34f8d9f574ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:46.748373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518b3b6-aa77-49c9-ac04-34f8d9f574ce service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:46.760317 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4198/8443] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:35:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:35:47.214788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24df806-8012-4724-9aca-dce6c11aac93 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:47.216897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b24df806-8012-4724-9aca-dce6c11aac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:47.229414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24df806-8012-4724-9aca-dce6c11aac93 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:47.235322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a07ce-73cf-45ec-a3f9-3256010470f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:47.235991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a07ce-73cf-45ec-a3f9-3256010470f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:47.236474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a07ce-73cf-45ec-a3f9-3256010470f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:47.236761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a07ce-73cf-45ec-a3f9-3256010470f4 admin admin] PATH_INFO: `/v3/projects/6099f6bbd53448b08244401c2e5709c5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:47.237936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a07ce-73cf-45ec-a3f9-3256010470f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6099f6bbd53448b08244401c2e5709c5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:47.239895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a07ce-73cf-45ec-a3f9-3256010470f4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:47.321161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-298a07ce-73cf-45ec-a3f9-3256010470f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6099f6bbd53448b08244401c2e5709c5', 'request_id': 'req-298a07ce-73cf-45ec-a3f9-3256010470f4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:47.330626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-298a07ce-73cf-45ec-a3f9-3256010470f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6099f6bbd53448b08244401c2e5709c5', 'request_id': 'req-298a07ce-73cf-45ec-a3f9-3256010470f4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:47.343482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-298a07ce-73cf-45ec-a3f9-3256010470f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6099f6bbd53448b08244401c2e5709c5', 'request_id': 'req-298a07ce-73cf-45ec-a3f9-3256010470f4'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:47.357181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-298a07ce-73cf-45ec-a3f9-3256010470f4 admin admin] The token cache is being invalidate because project 6099f6bbd53448b08244401c2e5709c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:35:47.357485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-298a07ce-73cf-45ec-a3f9-3256010470f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:47.358265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-298a07ce-73cf-45ec-a3f9-3256010470f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:47.360352 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4246/8444] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:35:47 2022] DELETE /identity/v3/projects/6099f6bbd53448b08244401c2e5709c5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:47.366744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b71c-a140-4bac-a4af-c53d5e2c9517 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:47.367256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b71c-a140-4bac-a4af-c53d5e2c9517 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:47.367664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b71c-a140-4bac-a4af-c53d5e2c9517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:47.416992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-57e6b71c-a140-4bac-a4af-c53d5e2c9517 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:47.420285 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-57e6b71c-a140-4bac-a4af-c53d5e2c9517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:47.468840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:47.518431 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4199/8445] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:47.526301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13120f-d948-42ac-b742-a7dce03c7f5f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:47.526782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13120f-d948-42ac-b742-a7dce03c7f5f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:47.527208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13120f-d948-42ac-b742-a7dce03c7f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:47.556095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9d13120f-d948-42ac-b742-a7dce03c7f5f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:47.557692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9d13120f-d948-42ac-b742-a7dce03c7f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:47.586384 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4247/8446] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:35:47.588330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6b71c-a140-4bac-a4af-c53d5e2c9517 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:47.604347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6b71c-a140-4bac-a4af-c53d5e2c9517 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:47.609691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef960a1-0cdd-4858-9085-ccf19b964e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:47.610263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef960a1-0cdd-4858-9085-ccf19b964e1b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:47.610553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef960a1-0cdd-4858-9085-ccf19b964e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:47.610868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef960a1-0cdd-4858-9085-ccf19b964e1b admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:47.611640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef960a1-0cdd-4858-9085-ccf19b964e1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:35:47.611951 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef960a1-0cdd-4858-9085-ccf19b964e1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:47.613614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef960a1-0cdd-4858-9085-ccf19b964e1b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:47.630585 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4200/8447] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:35:47.631745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13120f-d948-42ac-b742-a7dce03c7f5f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:47.646909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13120f-d948-42ac-b742-a7dce03c7f5f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:47.658783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27b822-db9e-4c7b-a9c9-fe57f4d3a99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:47.659552 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27b822-db9e-4c7b-a9c9-fe57f4d3a99c admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:47.659906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27b822-db9e-4c7b-a9c9-fe57f4d3a99c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:47.660403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27b822-db9e-4c7b-a9c9-fe57f4d3a99c admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:47.661726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27b822-db9e-4c7b-a9c9-fe57f4d3a99c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:47.664069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27b822-db9e-4c7b-a9c9-fe57f4d3a99c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:47.697091 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4248/8448] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:35:47 2022] POST /identity/v3/projects => generated 403 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:35:47.702771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef960a1-0cdd-4858-9085-ccf19b964e1b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:47.716601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef960a1-0cdd-4858-9085-ccf19b964e1b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:47.779890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf40659-b17a-4c08-8517-3eece5f850b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:47.780661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf40659-b17a-4c08-8517-3eece5f850b8 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:47.781015 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf40659-b17a-4c08-8517-3eece5f850b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:47.781369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf40659-b17a-4c08-8517-3eece5f850b8 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:47.782116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf40659-b17a-4c08-8517-3eece5f850b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:47.784121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf40659-b17a-4c08-8517-3eece5f850b8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:47.804794 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4201/8449] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:35:47 2022] POST /identity/v3/users => generated 302 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:35:47.809452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27b822-db9e-4c7b-a9c9-fe57f4d3a99c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:47.819734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27b822-db9e-4c7b-a9c9-fe57f4d3a99c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:47.824400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8cbf7-8cb5-4236-b2be-499dd1dfa674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:47.825646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8cbf7-8cb5-4236-b2be-499dd1dfa674 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:47.825927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8cbf7-8cb5-4236-b2be-499dd1dfa674 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:47.826200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8cbf7-8cb5-4236-b2be-499dd1dfa674 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:47.826881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8cbf7-8cb5-4236-b2be-499dd1dfa674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:47.828502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8cbf7-8cb5-4236-b2be-499dd1dfa674 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:47.838526 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4249/8450] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:35:47.842375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf40659-b17a-4c08-8517-3eece5f850b8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:47.852689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf40659-b17a-4c08-8517-3eece5f850b8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:47.857807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3236305-9c40-4cc9-b4df-fb41fb6ac91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:47.858414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3236305-9c40-4cc9-b4df-fb41fb6ac91f admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:47.858724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3236305-9c40-4cc9-b4df-fb41fb6ac91f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:47.859004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3236305-9c40-4cc9-b4df-fb41fb6ac91f admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:47.859791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3236305-9c40-4cc9-b4df-fb41fb6ac91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:47.861330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3236305-9c40-4cc9-b4df-fb41fb6ac91f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:47.872901 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4202/8451] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:35:47.877362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8cbf7-8cb5-4236-b2be-499dd1dfa674 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:47.882574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:47.888854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8cbf7-8cb5-4236-b2be-499dd1dfa674 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:47.894468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea28430-7756-4b8e-b8f8-597ae8414e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:47.895141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea28430-7756-4b8e-b8f8-597ae8414e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:47.895490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea28430-7756-4b8e-b8f8-597ae8414e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:47.895778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea28430-7756-4b8e-b8f8-597ae8414e8b admin admin] PATH_INFO: `/v3/projects/097ba92efae3441b97b4e3aab1659a4c/users/9c7e4d2128ef4c23ad3761cdfeae0796/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:47.910419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea28430-7756-4b8e-b8f8-597ae8414e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=097ba92efae3441b97b4e3aab1659a4c, user_id=9c7e4d2128ef4c23ad3761cdfeae0796, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:47.913145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea28430-7756-4b8e-b8f8-597ae8414e8b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:47.925849 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4250/8452] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:35:47 2022] PUT /identity/v3/projects/097ba92efae3441b97b4e3aab1659a4c/users/9c7e4d2128ef4c23ad3761cdfeae0796/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:35:47.937599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e0039-4e07-4ea4-a292-b25ff8da010b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:47.937888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e0039-4e07-4ea4-a292-b25ff8da010b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:47.938170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e0039-4e07-4ea4-a292-b25ff8da010b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:47.965733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2d1e0039-4e07-4ea4-a292-b25ff8da010b None None] MFA Rules not processed for user `9c7e4d2128ef4c23ad3761cdfeae0796`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:47.966973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2d1e0039-4e07-4ea4-a292-b25ff8da010b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:48.031786 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4203/8453] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:48.036202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea28430-7756-4b8e-b8f8-597ae8414e8b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:48.098845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea28430-7756-4b8e-b8f8-597ae8414e8b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:48.103639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f68ef-d66c-4b15-bdfb-4f642ab92fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:48.104264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f68ef-d66c-4b15-bdfb-4f642ab92fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:48.104557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f68ef-d66c-4b15-bdfb-4f642ab92fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:48.104839 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f68ef-d66c-4b15-bdfb-4f642ab92fb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:48.105514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f68ef-d66c-4b15-bdfb-4f642ab92fb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:48.107998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f68ef-d66c-4b15-bdfb-4f642ab92fb0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:48.141065 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4251/8454] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:35:48 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:35:48.142206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e0039-4e07-4ea4-a292-b25ff8da010b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:48.153300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e0039-4e07-4ea4-a292-b25ff8da010b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:48.180701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:48.214435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e6233-d344-4979-b532-4a08f8360187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:48.215055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e6233-d344-4979-b532-4a08f8360187 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:48.215387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e6233-d344-4979-b532-4a08f8360187 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:48.215669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e6233-d344-4979-b532-4a08f8360187 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:48.216323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e6233-d344-4979-b532-4a08f8360187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:48.218312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e6233-d344-4979-b532-4a08f8360187 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:48.239334 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4204/8455] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:35:48 2022] POST /identity/v3/users => generated 309 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:35:48.243400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f68ef-d66c-4b15-bdfb-4f642ab92fb0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:48.254993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f68ef-d66c-4b15-bdfb-4f642ab92fb0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:48.259788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7228158-b611-440e-8215-3f8680b8fa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:48.260403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7228158-b611-440e-8215-3f8680b8fa4d admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:48.260697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7228158-b611-440e-8215-3f8680b8fa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:48.260996 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7228158-b611-440e-8215-3f8680b8fa4d admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:48.261691 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7228158-b611-440e-8215-3f8680b8fa4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:48.263314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7228158-b611-440e-8215-3f8680b8fa4d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:48.274343 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4252/8456] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:35:48.278904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e6233-d344-4979-b532-4a08f8360187 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:48.289113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e6233-d344-4979-b532-4a08f8360187 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:48.294325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50069949-c8be-4155-b22b-139a3e680443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:48.294977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50069949-c8be-4155-b22b-139a3e680443 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:48.295261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50069949-c8be-4155-b22b-139a3e680443 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:48.295567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50069949-c8be-4155-b22b-139a3e680443 admin admin] PATH_INFO: `/v3/projects/8608391c507c48d09a4867db79ec0b9a/users/c3c571ce11774652adb8aeaa4d9a326f/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:48.310309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50069949-c8be-4155-b22b-139a3e680443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8608391c507c48d09a4867db79ec0b9a, user_id=c3c571ce11774652adb8aeaa4d9a326f, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:48.313032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50069949-c8be-4155-b22b-139a3e680443 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:48.325663 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4205/8457] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:35:48 2022] PUT /identity/v3/projects/8608391c507c48d09a4867db79ec0b9a/users/c3c571ce11774652adb8aeaa4d9a326f/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:48.329680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7228158-b611-440e-8215-3f8680b8fa4d admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:48.339944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7228158-b611-440e-8215-3f8680b8fa4d admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:48.397773 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e4581-28c9-4d3a-8004-d298541e470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:48.398330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e4581-28c9-4d3a-8004-d298541e470b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:48.398618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e4581-28c9-4d3a-8004-d298541e470b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:48.398896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e4581-28c9-4d3a-8004-d298541e470b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:48.399619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e4581-28c9-4d3a-8004-d298541e470b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:48.401210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e4581-28c9-4d3a-8004-d298541e470b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:48.411960 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4253/8458] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:35:48.415942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50069949-c8be-4155-b22b-139a3e680443 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:48.426885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50069949-c8be-4155-b22b-139a3e680443 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:48.431759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ad2d7-670c-4774-8903-556b8a457d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:48.432424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ad2d7-670c-4774-8903-556b8a457d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:48.432714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ad2d7-670c-4774-8903-556b8a457d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:48.432992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ad2d7-670c-4774-8903-556b8a457d85 admin admin] PATH_INFO: `/v3/projects/8608391c507c48d09a4867db79ec0b9a/users/c3c571ce11774652adb8aeaa4d9a326f/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:48.435180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ad2d7-670c-4774-8903-556b8a457d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8608391c507c48d09a4867db79ec0b9a, user_id=c3c571ce11774652adb8aeaa4d9a326f, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:48.437847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ad2d7-670c-4774-8903-556b8a457d85 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:48.448346 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4206/8459] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:35:48 2022] PUT /identity/v3/projects/8608391c507c48d09a4867db79ec0b9a/users/c3c571ce11774652adb8aeaa4d9a326f/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:48.458615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac96826-ebf8-4bc9-81f4-845405571f33 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:48.458912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac96826-ebf8-4bc9-81f4-845405571f33 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:48.459197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac96826-ebf8-4bc9-81f4-845405571f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:48.487855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-eac96826-ebf8-4bc9-81f4-845405571f33 None None] MFA Rules not processed for user `c3c571ce11774652adb8aeaa4d9a326f`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:48.489111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-eac96826-ebf8-4bc9-81f4-845405571f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:48.529406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:48.563228 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4254/8460] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:48.574338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ad2d7-670c-4774-8903-556b8a457d85 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:48.576146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f71ad2d7-670c-4774-8903-556b8a457d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:48.684499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ad2d7-670c-4774-8903-556b8a457d85 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:48.689174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027bd74-5267-474f-8881-07c3cc9ec491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:48.689874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027bd74-5267-474f-8881-07c3cc9ec491 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:48.690431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027bd74-5267-474f-8881-07c3cc9ec491 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:48.690631 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027bd74-5267-474f-8881-07c3cc9ec491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:48.703062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027bd74-5267-474f-8881-07c3cc9ec491 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:48.705836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027bd74-5267-474f-8881-07c3cc9ec491 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:48.718167 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4207/8461] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:35:48 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:35:48.870469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac96826-ebf8-4bc9-81f4-845405571f33 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:48.939413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac96826-ebf8-4bc9-81f4-845405571f33 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:48.945751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b649d74-d96a-430f-99e4-f265caf71e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:48.946518 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b649d74-d96a-430f-99e4-f265caf71e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:48.946988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b649d74-d96a-430f-99e4-f265caf71e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:48.947333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b649d74-d96a-430f-99e4-f265caf71e8b admin admin] PATH_INFO: `/v3/users/9c7e4d2128ef4c23ad3761cdfeae0796` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:48.948707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b649d74-d96a-430f-99e4-f265caf71e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c7e4d2128ef4c23ad3761cdfeae0796)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:48.951447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b649d74-d96a-430f-99e4-f265caf71e8b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:49.022645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7b649d74-d96a-430f-99e4-f265caf71e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c7e4d2128ef4c23ad3761cdfeae0796'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:49.035547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7b649d74-d96a-430f-99e4-f265caf71e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c7e4d2128ef4c23ad3761cdfeae0796'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:49.036269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7b649d74-d96a-430f-99e4-f265caf71e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c7e4d2128ef4c23ad3761cdfeae0796'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:49.043783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7b649d74-d96a-430f-99e4-f265caf71e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c7e4d2128ef4c23ad3761cdfeae0796'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:49.044444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7b649d74-d96a-430f-99e4-f265caf71e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c7e4d2128ef4c23ad3761cdfeae0796'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:49.057988 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4255/8462] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:35:48 2022] DELETE /identity/v3/users/9c7e4d2128ef4c23ad3761cdfeae0796 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:49.063191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a775e-8ae8-4ca9-8f58-93dc9b308cd0 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:49.063551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a775e-8ae8-4ca9-8f58-93dc9b308cd0 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:49.063836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a775e-8ae8-4ca9-8f58-93dc9b308cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:49.085012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e27a775e-8ae8-4ca9-8f58-93dc9b308cd0 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:49.086246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e27a775e-8ae8-4ca9-8f58-93dc9b308cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:49.182610 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4208/8463] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:35:49.191890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b649d74-d96a-430f-99e4-f265caf71e8b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:49.193925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7b649d74-d96a-430f-99e4-f265caf71e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:49.254627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b649d74-d96a-430f-99e4-f265caf71e8b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:49.258280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34d508-c05c-4b06-ad8d-29fafdea4e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:49.258893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34d508-c05c-4b06-ad8d-29fafdea4e6a service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:49.259178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34d508-c05c-4b06-ad8d-29fafdea4e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:49.259491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34d508-c05c-4b06-ad8d-29fafdea4e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:49.266936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:49.269665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34d508-c05c-4b06-ad8d-29fafdea4e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:49.271602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34d508-c05c-4b06-ad8d-29fafdea4e6a service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:49.282257 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4256/8464] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:35:49.568754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a775e-8ae8-4ca9-8f58-93dc9b308cd0 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:49.570203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e27a775e-8ae8-4ca9-8f58-93dc9b308cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:49.589852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a775e-8ae8-4ca9-8f58-93dc9b308cd0 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:49.595014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baf0a2-bc50-4753-ace7-9e472dc107e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:49.595616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baf0a2-bc50-4753-ace7-9e472dc107e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:49.595907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baf0a2-bc50-4753-ace7-9e472dc107e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:49.596186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baf0a2-bc50-4753-ace7-9e472dc107e7 admin admin] PATH_INFO: `/v3/projects/097ba92efae3441b97b4e3aab1659a4c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:49.597397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3baf0a2-bc50-4753-ace7-9e472dc107e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=097ba92efae3441b97b4e3aab1659a4c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:49.599309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3baf0a2-bc50-4753-ace7-9e472dc107e7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:49.608308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:49.646687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c3baf0a2-bc50-4753-ace7-9e472dc107e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '097ba92efae3441b97b4e3aab1659a4c', 'request_id': 'req-c3baf0a2-bc50-4753-ace7-9e472dc107e7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:49.654016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c3baf0a2-bc50-4753-ace7-9e472dc107e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '097ba92efae3441b97b4e3aab1659a4c', 'request_id': 'req-c3baf0a2-bc50-4753-ace7-9e472dc107e7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:49.660004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c3baf0a2-bc50-4753-ace7-9e472dc107e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '097ba92efae3441b97b4e3aab1659a4c', 'request_id': 'req-c3baf0a2-bc50-4753-ace7-9e472dc107e7'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:49.672295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c3baf0a2-bc50-4753-ace7-9e472dc107e7 admin admin] The token cache is being invalidate because project 097ba92efae3441b97b4e3aab1659a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:35:49.672701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c3baf0a2-bc50-4753-ace7-9e472dc107e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:49.673389 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c3baf0a2-bc50-4753-ace7-9e472dc107e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:49.674922 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4209/8465] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:35:49 2022] DELETE /identity/v3/projects/097ba92efae3441b97b4e3aab1659a4c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:49.678958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34d508-c05c-4b06-ad8d-29fafdea4e6a service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:49.689799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34d508-c05c-4b06-ad8d-29fafdea4e6a service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:49.754370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140cb6b-9c54-495c-a904-a91ec5ea2fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:49.755457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140cb6b-9c54-495c-a904-a91ec5ea2fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:49.755850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140cb6b-9c54-495c-a904-a91ec5ea2fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:49.756237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140cb6b-9c54-495c-a904-a91ec5ea2fd7 admin admin] PATH_INFO: `/v3/users/c3c571ce11774652adb8aeaa4d9a326f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:49.757843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140cb6b-9c54-495c-a904-a91ec5ea2fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c571ce11774652adb8aeaa4d9a326f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:49.759947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140cb6b-9c54-495c-a904-a91ec5ea2fd7 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:49.827671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6140cb6b-9c54-495c-a904-a91ec5ea2fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c571ce11774652adb8aeaa4d9a326f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:49.847749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6140cb6b-9c54-495c-a904-a91ec5ea2fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c571ce11774652adb8aeaa4d9a326f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:49.848589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6140cb6b-9c54-495c-a904-a91ec5ea2fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c571ce11774652adb8aeaa4d9a326f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:49.858350 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6140cb6b-9c54-495c-a904-a91ec5ea2fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c571ce11774652adb8aeaa4d9a326f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:49.859491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6140cb6b-9c54-495c-a904-a91ec5ea2fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c571ce11774652adb8aeaa4d9a326f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:49.877318 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4257/8466] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:35:49 2022] DELETE /identity/v3/users/c3c571ce11774652adb8aeaa4d9a326f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:50.307929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baf0a2-bc50-4753-ace7-9e472dc107e7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:50.309540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c3baf0a2-bc50-4753-ace7-9e472dc107e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:50.322752 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baf0a2-bc50-4753-ace7-9e472dc107e7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:50.390130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4a051-d332-4484-90aa-e1460ad5f22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:50.390829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4a051-d332-4484-90aa-e1460ad5f22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:50.391135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4a051-d332-4484-90aa-e1460ad5f22f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:50.391460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4a051-d332-4484-90aa-e1460ad5f22f admin admin] PATH_INFO: `/v3/projects/8608391c507c48d09a4867db79ec0b9a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:50.392651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4a051-d332-4484-90aa-e1460ad5f22f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8608391c507c48d09a4867db79ec0b9a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:50.394574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4a051-d332-4484-90aa-e1460ad5f22f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:50.447961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5bc4a051-d332-4484-90aa-e1460ad5f22f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8608391c507c48d09a4867db79ec0b9a', 'request_id': 'req-5bc4a051-d332-4484-90aa-e1460ad5f22f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:50.455978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5bc4a051-d332-4484-90aa-e1460ad5f22f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8608391c507c48d09a4867db79ec0b9a', 'request_id': 'req-5bc4a051-d332-4484-90aa-e1460ad5f22f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:50.461939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5bc4a051-d332-4484-90aa-e1460ad5f22f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8608391c507c48d09a4867db79ec0b9a', 'request_id': 'req-5bc4a051-d332-4484-90aa-e1460ad5f22f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:50.474550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5bc4a051-d332-4484-90aa-e1460ad5f22f admin admin] The token cache is being invalidate because project 8608391c507c48d09a4867db79ec0b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:35:50.474847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5bc4a051-d332-4484-90aa-e1460ad5f22f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:50.475565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-5bc4a051-d332-4484-90aa-e1460ad5f22f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:35:50.477402 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4210/8467] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:35:50 2022] DELETE /identity/v3/projects/8608391c507c48d09a4867db79ec0b9a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:50.482394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49321eed-c1ad-45bc-bcd9-b338fb600299 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:50.482690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49321eed-c1ad-45bc-bcd9-b338fb600299 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:50.482969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49321eed-c1ad-45bc-bcd9-b338fb600299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:50.504471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-49321eed-c1ad-45bc-bcd9-b338fb600299 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:50.506452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-49321eed-c1ad-45bc-bcd9-b338fb600299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:50.571441 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4258/8468] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:50.581070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84bf58-8dee-4e6b-9a42-8db1934600c2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:50.581369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84bf58-8dee-4e6b-9a42-8db1934600c2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:50.581652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84bf58-8dee-4e6b-9a42-8db1934600c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:50.601687 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-ef84bf58-8dee-4e6b-9a42-8db1934600c2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:50.602927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ef84bf58-8dee-4e6b-9a42-8db1934600c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:50.611058 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4211/8469] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:50.615923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49321eed-c1ad-45bc-bcd9-b338fb600299 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:50.628206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49321eed-c1ad-45bc-bcd9-b338fb600299 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:50.633101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a03d3-4e4f-46ca-ad8d-8a9a51baa926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:50.633730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a03d3-4e4f-46ca-ad8d-8a9a51baa926 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:50.634021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a03d3-4e4f-46ca-ad8d-8a9a51baa926 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:50.634309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a03d3-4e4f-46ca-ad8d-8a9a51baa926 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:50.635021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a03d3-4e4f-46ca-ad8d-8a9a51baa926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:35:50.635368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a03d3-4e4f-46ca-ad8d-8a9a51baa926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:50.637600 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a03d3-4e4f-46ca-ad8d-8a9a51baa926 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:50.650882 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4259/8470] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:35:50.655416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84bf58-8dee-4e6b-9a42-8db1934600c2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:50.665376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84bf58-8dee-4e6b-9a42-8db1934600c2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:50.670229 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ba3e1-966e-4885-bd69-f8fc264281bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:50.670941 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ba3e1-966e-4885-bd69-f8fc264281bf admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:50.671312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ba3e1-966e-4885-bd69-f8fc264281bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:50.671694 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ba3e1-966e-4885-bd69-f8fc264281bf admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:50.672429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ba3e1-966e-4885-bd69-f8fc264281bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:50.674403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ba3e1-966e-4885-bd69-f8fc264281bf admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:50.696270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:50.706027 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4212/8471] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:35:50 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:35:50.710523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a03d3-4e4f-46ca-ad8d-8a9a51baa926 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:50.715816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:50.722178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a03d3-4e4f-46ca-ad8d-8a9a51baa926 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:50.781574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb931e-09d2-47bf-887d-b964c76c3c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:50.782199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb931e-09d2-47bf-887d-b964c76c3c11 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:50.782481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb931e-09d2-47bf-887d-b964c76c3c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:50.782776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb931e-09d2-47bf-887d-b964c76c3c11 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:50.783512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb931e-09d2-47bf-887d-b964c76c3c11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:50.785548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb931e-09d2-47bf-887d-b964c76c3c11 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:50.813268 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4260/8472] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:35:50 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:35:50.815201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ba3e1-966e-4885-bd69-f8fc264281bf admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:50.831357 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ba3e1-966e-4885-bd69-f8fc264281bf admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:50.842517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121782c-f722-461c-b773-8af176dd46d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:50.842918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121782c-f722-461c-b773-8af176dd46d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:50.843272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121782c-f722-461c-b773-8af176dd46d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:50.843681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121782c-f722-461c-b773-8af176dd46d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:50.844422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121782c-f722-461c-b773-8af176dd46d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:50.846085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121782c-f722-461c-b773-8af176dd46d8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:50.857567 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4213/8473] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:35:50.861770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb931e-09d2-47bf-887d-b964c76c3c11 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:50.873381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb931e-09d2-47bf-887d-b964c76c3c11 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:50.878993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886508be-c069-4218-b9e2-27d07de10579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:50.879805 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886508be-c069-4218-b9e2-27d07de10579 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:50.880096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886508be-c069-4218-b9e2-27d07de10579 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:50.880473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886508be-c069-4218-b9e2-27d07de10579 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:50.881185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886508be-c069-4218-b9e2-27d07de10579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:50.882835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886508be-c069-4218-b9e2-27d07de10579 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:50.895368 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4261/8474] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:35:50.899814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121782c-f722-461c-b773-8af176dd46d8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:50.910489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121782c-f722-461c-b773-8af176dd46d8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:50.915273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0233d4-5666-4745-af45-e29fa4702ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:50.916017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0233d4-5666-4745-af45-e29fa4702ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:50.916306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0233d4-5666-4745-af45-e29fa4702ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:50.916617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0233d4-5666-4745-af45-e29fa4702ff6 admin admin] PATH_INFO: `/v3/projects/24a61164d3b4464c8efba365fa6c2441/users/d83bbcb9fcd044ffbd701ae31834229c/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:50.932794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0233d4-5666-4745-af45-e29fa4702ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a61164d3b4464c8efba365fa6c2441, user_id=d83bbcb9fcd044ffbd701ae31834229c, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:50.936079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0233d4-5666-4745-af45-e29fa4702ff6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:50.949582 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4214/8475] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:35:50 2022] PUT /identity/v3/projects/24a61164d3b4464c8efba365fa6c2441/users/d83bbcb9fcd044ffbd701ae31834229c/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:35:50.960771 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221dd1f-6a09-4971-9530-561398ca4d4d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:50.961073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221dd1f-6a09-4971-9530-561398ca4d4d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:50.961362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221dd1f-6a09-4971-9530-561398ca4d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:50.990070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a221dd1f-6a09-4971-9530-561398ca4d4d None None] MFA Rules not processed for user `d83bbcb9fcd044ffbd701ae31834229c`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:50.991334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a221dd1f-6a09-4971-9530-561398ca4d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:51.063154 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4262/8476] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:51.067735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0233d4-5666-4745-af45-e29fa4702ff6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:51.133999 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0233d4-5666-4745-af45-e29fa4702ff6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:51.139219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59dda75-09c6-4410-aa77-d650252c4e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:51.139983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dda75-09c6-4410-aa77-d650252c4e97 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:51.140331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dda75-09c6-4410-aa77-d650252c4e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:51.140676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dda75-09c6-4410-aa77-d650252c4e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:51.141364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59dda75-09c6-4410-aa77-d650252c4e97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:51.143313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59dda75-09c6-4410-aa77-d650252c4e97 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:51.172036 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4215/8477] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:35:51 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:35:51.175912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221dd1f-6a09-4971-9530-561398ca4d4d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:51.188636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221dd1f-6a09-4971-9530-561398ca4d4d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:51.252609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7ab6e-79ea-4416-91ea-e7f20f092d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:51.253263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7ab6e-79ea-4416-91ea-e7f20f092d47 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:51.253549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7ab6e-79ea-4416-91ea-e7f20f092d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:51.253829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7ab6e-79ea-4416-91ea-e7f20f092d47 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:51.254539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7ab6e-79ea-4416-91ea-e7f20f092d47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:51.256601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7ab6e-79ea-4416-91ea-e7f20f092d47 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:51.273536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:51.281899 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4263/8478] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:35:51 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:35:51.285225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59dda75-09c6-4410-aa77-d650252c4e97 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:51.296521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59dda75-09c6-4410-aa77-d650252c4e97 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:51.301368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fc0f0-1bb9-499d-b15a-63ab19f38656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:51.301991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fc0f0-1bb9-499d-b15a-63ab19f38656 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:51.302282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fc0f0-1bb9-499d-b15a-63ab19f38656 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:51.302596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fc0f0-1bb9-499d-b15a-63ab19f38656 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:51.303503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fc0f0-1bb9-499d-b15a-63ab19f38656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:51.304924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fc0f0-1bb9-499d-b15a-63ab19f38656 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:51.316818 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4216/8479] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:35:51.321203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7ab6e-79ea-4416-91ea-e7f20f092d47 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:51.332179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7ab6e-79ea-4416-91ea-e7f20f092d47 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:51.337879 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f2c5a-ce8a-4c4c-93d4-bd72047a0bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:51.338637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f2c5a-ce8a-4c4c-93d4-bd72047a0bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:51.338993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f2c5a-ce8a-4c4c-93d4-bd72047a0bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:51.339379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f2c5a-ce8a-4c4c-93d4-bd72047a0bc8 admin admin] PATH_INFO: `/v3/projects/ebfbced34f8749f4b4b952736e29159d/users/bc53faa25aec48629c8439e400e57019/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:51.375323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f2c5a-ce8a-4c4c-93d4-bd72047a0bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebfbced34f8749f4b4b952736e29159d, user_id=bc53faa25aec48629c8439e400e57019, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:51.376925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f2c5a-ce8a-4c4c-93d4-bd72047a0bc8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:51.395170 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4264/8480] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:35:51 2022] PUT /identity/v3/projects/ebfbced34f8749f4b4b952736e29159d/users/bc53faa25aec48629c8439e400e57019/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:35:51.396568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fc0f0-1bb9-499d-b15a-63ab19f38656 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:51.413500 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fc0f0-1bb9-499d-b15a-63ab19f38656 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:51.523431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83910152-64db-43fe-895a-1203fbbb2101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:51.524300 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83910152-64db-43fe-895a-1203fbbb2101 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:51.524691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83910152-64db-43fe-895a-1203fbbb2101 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:51.525089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83910152-64db-43fe-895a-1203fbbb2101 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:51.525889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83910152-64db-43fe-895a-1203fbbb2101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:51.528459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83910152-64db-43fe-895a-1203fbbb2101 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:51.539065 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4217/8481] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:35:51.543868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f2c5a-ce8a-4c4c-93d4-bd72047a0bc8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:51.555561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f2c5a-ce8a-4c4c-93d4-bd72047a0bc8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:51.561220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efd9c9-c8fa-4ff6-9857-6d342d67d7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:51.561913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efd9c9-c8fa-4ff6-9857-6d342d67d7d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:51.562372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efd9c9-c8fa-4ff6-9857-6d342d67d7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:51.562662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efd9c9-c8fa-4ff6-9857-6d342d67d7d1 admin admin] PATH_INFO: `/v3/projects/ebfbced34f8749f4b4b952736e29159d/users/bc53faa25aec48629c8439e400e57019/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:51.564716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efd9c9-c8fa-4ff6-9857-6d342d67d7d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebfbced34f8749f4b4b952736e29159d, user_id=bc53faa25aec48629c8439e400e57019, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:51.567675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efd9c9-c8fa-4ff6-9857-6d342d67d7d1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:51.579038 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4265/8482] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:35:51 2022] PUT /identity/v3/projects/ebfbced34f8749f4b4b952736e29159d/users/bc53faa25aec48629c8439e400e57019/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:35:51.589574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e326eb5-80d8-418b-84ae-bcfa1185ff2b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:51.589870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e326eb5-80d8-418b-84ae-bcfa1185ff2b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:51.590834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e326eb5-80d8-418b-84ae-bcfa1185ff2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:51.626775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2e326eb5-80d8-418b-84ae-bcfa1185ff2b None None] MFA Rules not processed for user `bc53faa25aec48629c8439e400e57019`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:35:51.628040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2e326eb5-80d8-418b-84ae-bcfa1185ff2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:51.650767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:51.709307 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4218/8483] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:35:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:35:51.721622 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efd9c9-c8fa-4ff6-9857-6d342d67d7d1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:51.724133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b6efd9c9-c8fa-4ff6-9857-6d342d67d7d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:35:51.792467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efd9c9-c8fa-4ff6-9857-6d342d67d7d1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:51.797776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a992092-179d-4ac5-9c2f-44578d6ad89b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:51.798895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a992092-179d-4ac5-9c2f-44578d6ad89b service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:51.798895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a992092-179d-4ac5-9c2f-44578d6ad89b service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:51.799106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a992092-179d-4ac5-9c2f-44578d6ad89b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:51.810846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a992092-179d-4ac5-9c2f-44578d6ad89b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:51.812332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a992092-179d-4ac5-9c2f-44578d6ad89b service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:51.823251 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4266/8484] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:35:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:35:51.922251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e326eb5-80d8-418b-84ae-bcfa1185ff2b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:35:51.937715 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e326eb5-80d8-418b-84ae-bcfa1185ff2b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:35:51.942672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef456f1-b176-4a6c-9354-b8eb61eb8ed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:35:51.943505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef456f1-b176-4a6c-9354-b8eb61eb8ed7 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:35:51.943828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef456f1-b176-4a6c-9354-b8eb61eb8ed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:35:51.944536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef456f1-b176-4a6c-9354-b8eb61eb8ed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:35:52.028666 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef456f1-b176-4a6c-9354-b8eb61eb8ed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:35:52.030801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef456f1-b176-4a6c-9354-b8eb61eb8ed7 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:35:52.045098 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4219/8485] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:35:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:36:01.818790 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=41,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:02.039397 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=47 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:23.472566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a992092-179d-4ac5-9c2f-44578d6ad89b service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:23.534013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a992092-179d-4ac5-9c2f-44578d6ad89b service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:23.538567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3434b08-4c3a-4b7f-acc2-1d66f7c1f835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:23.539199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3434b08-4c3a-4b7f-acc2-1d66f7c1f835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:23.539511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3434b08-4c3a-4b7f-acc2-1d66f7c1f835 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:23.539784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3434b08-4c3a-4b7f-acc2-1d66f7c1f835 admin admin] PATH_INFO: `/v3/users/d83bbcb9fcd044ffbd701ae31834229c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:23.540922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3434b08-4c3a-4b7f-acc2-1d66f7c1f835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d83bbcb9fcd044ffbd701ae31834229c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:23.542818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3434b08-4c3a-4b7f-acc2-1d66f7c1f835 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:23.587085 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f3434b08-4c3a-4b7f-acc2-1d66f7c1f835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd83bbcb9fcd044ffbd701ae31834229c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:23.599219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f3434b08-4c3a-4b7f-acc2-1d66f7c1f835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd83bbcb9fcd044ffbd701ae31834229c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:23.599929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f3434b08-4c3a-4b7f-acc2-1d66f7c1f835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd83bbcb9fcd044ffbd701ae31834229c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:23.606958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f3434b08-4c3a-4b7f-acc2-1d66f7c1f835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd83bbcb9fcd044ffbd701ae31834229c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:23.607663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-f3434b08-4c3a-4b7f-acc2-1d66f7c1f835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd83bbcb9fcd044ffbd701ae31834229c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:23.620306 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4267/8486] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:36:23 2022] DELETE /identity/v3/users/d83bbcb9fcd044ffbd701ae31834229c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:23.625598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8d37e-fc81-4b05-b676-2df709e9cef9 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:23.626114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8d37e-fc81-4b05-b676-2df709e9cef9 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:23.626326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8d37e-fc81-4b05-b676-2df709e9cef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:23.646456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7fd8d37e-fc81-4b05-b676-2df709e9cef9 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:36:23.647722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7fd8d37e-fc81-4b05-b676-2df709e9cef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:23.706629 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4220/8487] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:36:23.716391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3434b08-4c3a-4b7f-acc2-1d66f7c1f835 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:23.717793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f3434b08-4c3a-4b7f-acc2-1d66f7c1f835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:23.779575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3434b08-4c3a-4b7f-acc2-1d66f7c1f835 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:23.783346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986febf5-674a-4a82-a1c8-bd8107d57d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:23.783973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986febf5-674a-4a82-a1c8-bd8107d57d0a service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:23.784325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986febf5-674a-4a82-a1c8-bd8107d57d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:23.784539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986febf5-674a-4a82-a1c8-bd8107d57d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:23.794070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986febf5-674a-4a82-a1c8-bd8107d57d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:23.796031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986febf5-674a-4a82-a1c8-bd8107d57d0a service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:23.806026 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4268/8488] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:36:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:36:24.144922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8d37e-fc81-4b05-b676-2df709e9cef9 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:24.146394 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7fd8d37e-fc81-4b05-b676-2df709e9cef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:24.162329 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8d37e-fc81-4b05-b676-2df709e9cef9 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:24.167103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc482ec7-a398-4593-9075-b2615c47381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:24.167882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc482ec7-a398-4593-9075-b2615c47381b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:24.168236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc482ec7-a398-4593-9075-b2615c47381b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:24.168554 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc482ec7-a398-4593-9075-b2615c47381b admin admin] PATH_INFO: `/v3/projects/24a61164d3b4464c8efba365fa6c2441` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:24.170680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc482ec7-a398-4593-9075-b2615c47381b admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a61164d3b4464c8efba365fa6c2441)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:24.174290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc482ec7-a398-4593-9075-b2615c47381b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:24.224760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cc482ec7-a398-4593-9075-b2615c47381b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a61164d3b4464c8efba365fa6c2441', 'request_id': 'req-cc482ec7-a398-4593-9075-b2615c47381b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:24.231338 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cc482ec7-a398-4593-9075-b2615c47381b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a61164d3b4464c8efba365fa6c2441', 'request_id': 'req-cc482ec7-a398-4593-9075-b2615c47381b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:24.237749 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cc482ec7-a398-4593-9075-b2615c47381b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a61164d3b4464c8efba365fa6c2441', 'request_id': 'req-cc482ec7-a398-4593-9075-b2615c47381b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:24.248705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cc482ec7-a398-4593-9075-b2615c47381b admin admin] The token cache is being invalidate because project 24a61164d3b4464c8efba365fa6c2441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:36:24.248994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cc482ec7-a398-4593-9075-b2615c47381b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:24.249884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cc482ec7-a398-4593-9075-b2615c47381b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:24.251429 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4221/8489] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:36:24 2022] DELETE /identity/v3/projects/24a61164d3b4464c8efba365fa6c2441 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:24.255461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986febf5-674a-4a82-a1c8-bd8107d57d0a service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:24.265199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986febf5-674a-4a82-a1c8-bd8107d57d0a service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:24.283604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:24.324466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0ad62-3ee2-4999-ab69-6197a09a1919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:24.325110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0ad62-3ee2-4999-ab69-6197a09a1919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:24.325401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0ad62-3ee2-4999-ab69-6197a09a1919 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:24.325681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0ad62-3ee2-4999-ab69-6197a09a1919 admin admin] PATH_INFO: `/v3/users/bc53faa25aec48629c8439e400e57019` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:24.326858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0ad62-3ee2-4999-ab69-6197a09a1919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc53faa25aec48629c8439e400e57019)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:24.328855 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0ad62-3ee2-4999-ab69-6197a09a1919 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:24.376100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ebf0ad62-3ee2-4999-ab69-6197a09a1919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc53faa25aec48629c8439e400e57019'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:24.388172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ebf0ad62-3ee2-4999-ab69-6197a09a1919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc53faa25aec48629c8439e400e57019'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:24.388927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ebf0ad62-3ee2-4999-ab69-6197a09a1919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc53faa25aec48629c8439e400e57019'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:24.395727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ebf0ad62-3ee2-4999-ab69-6197a09a1919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc53faa25aec48629c8439e400e57019'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:24.396357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ebf0ad62-3ee2-4999-ab69-6197a09a1919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc53faa25aec48629c8439e400e57019'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:24.409829 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4269/8490] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:36:24 2022] DELETE /identity/v3/users/bc53faa25aec48629c8439e400e57019 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:24.682402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc482ec7-a398-4593-9075-b2615c47381b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:24.683979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cc482ec7-a398-4593-9075-b2615c47381b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:24.697187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc482ec7-a398-4593-9075-b2615c47381b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:24.755095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984a919-024d-443c-ae82-e61113607936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:24.755766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984a919-024d-443c-ae82-e61113607936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:24.756047 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984a919-024d-443c-ae82-e61113607936 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:24.756327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984a919-024d-443c-ae82-e61113607936 admin admin] PATH_INFO: `/v3/projects/ebfbced34f8749f4b4b952736e29159d` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:24.757493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984a919-024d-443c-ae82-e61113607936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebfbced34f8749f4b4b952736e29159d)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:24.759405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984a919-024d-443c-ae82-e61113607936 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:24.789781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:24.808052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8984a919-024d-443c-ae82-e61113607936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebfbced34f8749f4b4b952736e29159d', 'request_id': 'req-8984a919-024d-443c-ae82-e61113607936'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:24.815573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8984a919-024d-443c-ae82-e61113607936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebfbced34f8749f4b4b952736e29159d', 'request_id': 'req-8984a919-024d-443c-ae82-e61113607936'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:24.821040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8984a919-024d-443c-ae82-e61113607936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebfbced34f8749f4b4b952736e29159d', 'request_id': 'req-8984a919-024d-443c-ae82-e61113607936'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:24.832518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8984a919-024d-443c-ae82-e61113607936 admin admin] The token cache is being invalidate because project ebfbced34f8749f4b4b952736e29159d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:36:24.832828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8984a919-024d-443c-ae82-e61113607936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:24.833454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8984a919-024d-443c-ae82-e61113607936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:24.834973 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4222/8491] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:36:24 2022] DELETE /identity/v3/projects/ebfbced34f8749f4b4b952736e29159d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:24.840083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64396fb4-2f43-4761-a7f4-6bf4bf589c03 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:24.840575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64396fb4-2f43-4761-a7f4-6bf4bf589c03 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:24.840697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64396fb4-2f43-4761-a7f4-6bf4bf589c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:24.860803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-64396fb4-2f43-4761-a7f4-6bf4bf589c03 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:36:24.861958 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-64396fb4-2f43-4761-a7f4-6bf4bf589c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:24.921173 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4270/8492] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:36:24.929212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e33af-acac-43d1-9a7f-01a12f288ccd None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:24.929503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e33af-acac-43d1-9a7f-01a12f288ccd None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:24.929778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e33af-acac-43d1-9a7f-01a12f288ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:24.949502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-568e33af-acac-43d1-9a7f-01a12f288ccd None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:36:24.950695 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-568e33af-acac-43d1-9a7f-01a12f288ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:24.959607 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4223/8493] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:36:24.964133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64396fb4-2f43-4761-a7f4-6bf4bf589c03 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:24.974057 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64396fb4-2f43-4761-a7f4-6bf4bf589c03 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:24.978614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e7a8c-cecc-42b3-aa8e-4362130537d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:24.979266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e7a8c-cecc-42b3-aa8e-4362130537d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:24.979585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e7a8c-cecc-42b3-aa8e-4362130537d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:24.979885 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e7a8c-cecc-42b3-aa8e-4362130537d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:24.980590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e7a8c-cecc-42b3-aa8e-4362130537d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:36:24.980897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e7a8c-cecc-42b3-aa8e-4362130537d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:24.982623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e7a8c-cecc-42b3-aa8e-4362130537d4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:24.994445 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4271/8494] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:36:24.999761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e33af-acac-43d1-9a7f-01a12f288ccd None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:25.009382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e33af-acac-43d1-9a7f-01a12f288ccd None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:25.014625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97e6ff-49f4-474c-90de-292d1abb53b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:25.015244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97e6ff-49f4-474c-90de-292d1abb53b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:25.015571 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97e6ff-49f4-474c-90de-292d1abb53b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:25.015915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97e6ff-49f4-474c-90de-292d1abb53b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:25.016596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97e6ff-49f4-474c-90de-292d1abb53b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:25.018497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97e6ff-49f4-474c-90de-292d1abb53b4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:25.050662 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4224/8495] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:36:24 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:36:25.052787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e7a8c-cecc-42b3-aa8e-4362130537d4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:25.064086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e7a8c-cecc-42b3-aa8e-4362130537d4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:25.091322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:25.124209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655a1bb-f390-480b-81bb-6549fc22b63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:25.125108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655a1bb-f390-480b-81bb-6549fc22b63a admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:25.125394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655a1bb-f390-480b-81bb-6549fc22b63a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:25.125670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655a1bb-f390-480b-81bb-6549fc22b63a admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:25.126346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655a1bb-f390-480b-81bb-6549fc22b63a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:25.128332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655a1bb-f390-480b-81bb-6549fc22b63a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:25.153530 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4272/8496] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:36:25 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:36:25.154923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97e6ff-49f4-474c-90de-292d1abb53b4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:25.165372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97e6ff-49f4-474c-90de-292d1abb53b4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:25.170272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee6b14-673a-47ef-ba51-f4de58c4fe95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:25.170967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee6b14-673a-47ef-ba51-f4de58c4fe95 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:25.171125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee6b14-673a-47ef-ba51-f4de58c4fe95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:25.171427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee6b14-673a-47ef-ba51-f4de58c4fe95 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:25.172108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee6b14-673a-47ef-ba51-f4de58c4fe95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:25.173741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee6b14-673a-47ef-ba51-f4de58c4fe95 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:25.183811 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4225/8497] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:36:25.188115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655a1bb-f390-480b-81bb-6549fc22b63a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:25.198015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655a1bb-f390-480b-81bb-6549fc22b63a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:25.203299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d60ab6-bc17-4f36-8f2f-079c2c9a333e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:25.203924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d60ab6-bc17-4f36-8f2f-079c2c9a333e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:25.204207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d60ab6-bc17-4f36-8f2f-079c2c9a333e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:25.204505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d60ab6-bc17-4f36-8f2f-079c2c9a333e admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:25.205218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d60ab6-bc17-4f36-8f2f-079c2c9a333e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:25.206808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d60ab6-bc17-4f36-8f2f-079c2c9a333e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:25.217894 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4273/8498] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:36:25.224283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee6b14-673a-47ef-ba51-f4de58c4fe95 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:25.234712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee6b14-673a-47ef-ba51-f4de58c4fe95 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:25.239616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa67b9-9770-46bb-b586-0bef16d300a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:25.240307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa67b9-9770-46bb-b586-0bef16d300a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:25.240590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa67b9-9770-46bb-b586-0bef16d300a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:25.240869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa67b9-9770-46bb-b586-0bef16d300a4 admin admin] PATH_INFO: `/v3/projects/bb773a36a04c4eee91455ba9e1b49826/users/28c552a4a0fd41979fd7d493b22b891c/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:25.256133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa67b9-9770-46bb-b586-0bef16d300a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb773a36a04c4eee91455ba9e1b49826, user_id=28c552a4a0fd41979fd7d493b22b891c, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:25.258758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa67b9-9770-46bb-b586-0bef16d300a4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:25.272477 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4226/8499] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:36:25 2022] PUT /identity/v3/projects/bb773a36a04c4eee91455ba9e1b49826/users/28c552a4a0fd41979fd7d493b22b891c/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:36:25.283798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b4fac-d705-4d9e-9cdb-11a3be050aed None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:25.284096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b4fac-d705-4d9e-9cdb-11a3be050aed None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:25.284381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b4fac-d705-4d9e-9cdb-11a3be050aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:25.312424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d84b4fac-d705-4d9e-9cdb-11a3be050aed None None] MFA Rules not processed for user `28c552a4a0fd41979fd7d493b22b891c`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:36:25.313652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d84b4fac-d705-4d9e-9cdb-11a3be050aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:25.378703 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4274/8500] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:36:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:36:25.383143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa67b9-9770-46bb-b586-0bef16d300a4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:25.445629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa67b9-9770-46bb-b586-0bef16d300a4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:25.450337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a43f6-d6dd-4bfd-aba5-ad7f2dd03805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:25.450992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a43f6-d6dd-4bfd-aba5-ad7f2dd03805 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:25.451316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a43f6-d6dd-4bfd-aba5-ad7f2dd03805 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:25.451595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a43f6-d6dd-4bfd-aba5-ad7f2dd03805 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:25.452274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a43f6-d6dd-4bfd-aba5-ad7f2dd03805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:25.454182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a43f6-d6dd-4bfd-aba5-ad7f2dd03805 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:25.480686 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4227/8501] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:36:25 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:36:25.485290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b4fac-d705-4d9e-9cdb-11a3be050aed None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:25.496143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b4fac-d705-4d9e-9cdb-11a3be050aed None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:25.554462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ae365-dc69-4c3b-a3ca-3933ff8551b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:25.555089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ae365-dc69-4c3b-a3ca-3933ff8551b8 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:25.555411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ae365-dc69-4c3b-a3ca-3933ff8551b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:25.555695 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ae365-dc69-4c3b-a3ca-3933ff8551b8 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:25.556348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ae365-dc69-4c3b-a3ca-3933ff8551b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:25.558266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ae365-dc69-4c3b-a3ca-3933ff8551b8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:25.579493 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4275/8502] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:36:25 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:36:25.583700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a43f6-d6dd-4bfd-aba5-ad7f2dd03805 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:25.594234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a43f6-d6dd-4bfd-aba5-ad7f2dd03805 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:25.598880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd948250-1d93-4ef0-9990-6ae1ae16b8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:25.599519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd948250-1d93-4ef0-9990-6ae1ae16b8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:25.599807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd948250-1d93-4ef0-9990-6ae1ae16b8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:25.600088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd948250-1d93-4ef0-9990-6ae1ae16b8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:25.600774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd948250-1d93-4ef0-9990-6ae1ae16b8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:25.602409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd948250-1d93-4ef0-9990-6ae1ae16b8a0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:25.613578 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4228/8503] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:36:25.617692 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ae365-dc69-4c3b-a3ca-3933ff8551b8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:25.628759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ae365-dc69-4c3b-a3ca-3933ff8551b8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:25.633458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f277326-5615-4e24-85dd-a913fafe94d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:25.634119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f277326-5615-4e24-85dd-a913fafe94d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:25.634409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f277326-5615-4e24-85dd-a913fafe94d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:25.634689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f277326-5615-4e24-85dd-a913fafe94d2 admin admin] PATH_INFO: `/v3/projects/4452d2a2fcbd4561b3ff268dff9175f2/users/ada24d1a2ffd47859ff66fe1608385c3/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:25.649324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f277326-5615-4e24-85dd-a913fafe94d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4452d2a2fcbd4561b3ff268dff9175f2, user_id=ada24d1a2ffd47859ff66fe1608385c3, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:25.652037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f277326-5615-4e24-85dd-a913fafe94d2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:25.665314 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4276/8504] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:36:25 2022] PUT /identity/v3/projects/4452d2a2fcbd4561b3ff268dff9175f2/users/ada24d1a2ffd47859ff66fe1608385c3/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:36:25.669255 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd948250-1d93-4ef0-9990-6ae1ae16b8a0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:25.680274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd948250-1d93-4ef0-9990-6ae1ae16b8a0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:25.700060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:25.740414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d71b9-dc40-43ff-8425-57b0a4afdb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:25.741064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d71b9-dc40-43ff-8425-57b0a4afdb16 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:25.741346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d71b9-dc40-43ff-8425-57b0a4afdb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:25.741626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d71b9-dc40-43ff-8425-57b0a4afdb16 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:25.742310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d71b9-dc40-43ff-8425-57b0a4afdb16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:25.744010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d71b9-dc40-43ff-8425-57b0a4afdb16 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:25.754250 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4229/8505] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:36:25.758495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f277326-5615-4e24-85dd-a913fafe94d2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:25.765131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:25.772289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f277326-5615-4e24-85dd-a913fafe94d2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:25.777337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f2182-9b90-45c7-acca-fe753748397b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:25.778008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f2182-9b90-45c7-acca-fe753748397b admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:25.778293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f2182-9b90-45c7-acca-fe753748397b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:25.778571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f2182-9b90-45c7-acca-fe753748397b admin admin] PATH_INFO: `/v3/projects/4452d2a2fcbd4561b3ff268dff9175f2/users/ada24d1a2ffd47859ff66fe1608385c3/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:25.781054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f2182-9b90-45c7-acca-fe753748397b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4452d2a2fcbd4561b3ff268dff9175f2, user_id=ada24d1a2ffd47859ff66fe1608385c3, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:25.783807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f2182-9b90-45c7-acca-fe753748397b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:25.794012 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4277/8506] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:36:25 2022] PUT /identity/v3/projects/4452d2a2fcbd4561b3ff268dff9175f2/users/ada24d1a2ffd47859ff66fe1608385c3/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:25.804981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99656adf-21df-42f2-8a6a-156f75d011f5 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:25.805388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99656adf-21df-42f2-8a6a-156f75d011f5 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:25.805744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99656adf-21df-42f2-8a6a-156f75d011f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:25.833162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-99656adf-21df-42f2-8a6a-156f75d011f5 None None] MFA Rules not processed for user `ada24d1a2ffd47859ff66fe1608385c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:36:25.834370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-99656adf-21df-42f2-8a6a-156f75d011f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:25.901972 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4230/8507] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:36:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:36:25.913740 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f2182-9b90-45c7-acca-fe753748397b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:25.915572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-494f2182-9b90-45c7-acca-fe753748397b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:25.976522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f2182-9b90-45c7-acca-fe753748397b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:25.980523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c2c13-7f8d-4ec6-8402-b8c087dd9461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:25.981151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c2c13-7f8d-4ec6-8402-b8c087dd9461 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:25.981436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c2c13-7f8d-4ec6-8402-b8c087dd9461 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:25.981720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c2c13-7f8d-4ec6-8402-b8c087dd9461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:25.992279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c2c13-7f8d-4ec6-8402-b8c087dd9461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:25.993735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c2c13-7f8d-4ec6-8402-b8c087dd9461 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:26.005934 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4278/8508] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:36:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:36:26.452212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99656adf-21df-42f2-8a6a-156f75d011f5 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:26.532636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99656adf-21df-42f2-8a6a-156f75d011f5 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:26.537221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e886c26-0ae2-41a5-89b5-00846736ded1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:26.537866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e886c26-0ae2-41a5-89b5-00846736ded1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:26.538209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e886c26-0ae2-41a5-89b5-00846736ded1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:26.538487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e886c26-0ae2-41a5-89b5-00846736ded1 admin admin] PATH_INFO: `/v3/users/28c552a4a0fd41979fd7d493b22b891c` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:26.539680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e886c26-0ae2-41a5-89b5-00846736ded1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28c552a4a0fd41979fd7d493b22b891c)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:26.542167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e886c26-0ae2-41a5-89b5-00846736ded1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:26.590505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8e886c26-0ae2-41a5-89b5-00846736ded1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28c552a4a0fd41979fd7d493b22b891c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:26.591160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8e886c26-0ae2-41a5-89b5-00846736ded1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28c552a4a0fd41979fd7d493b22b891c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:26.592661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:26.605625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8e886c26-0ae2-41a5-89b5-00846736ded1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28c552a4a0fd41979fd7d493b22b891c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:26.606275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8e886c26-0ae2-41a5-89b5-00846736ded1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28c552a4a0fd41979fd7d493b22b891c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:26.613588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-8e886c26-0ae2-41a5-89b5-00846736ded1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28c552a4a0fd41979fd7d493b22b891c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:26.626840 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4231/8509] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:36:26 2022] DELETE /identity/v3/users/28c552a4a0fd41979fd7d493b22b891c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:26.631319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a3f63-3376-4d06-a0b7-c794d0abdf14 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:26.631614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a3f63-3376-4d06-a0b7-c794d0abdf14 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:26.631902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a3f63-3376-4d06-a0b7-c794d0abdf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:26.651005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-888a3f63-3376-4d06-a0b7-c794d0abdf14 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:36:26.652264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-888a3f63-3376-4d06-a0b7-c794d0abdf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:26.710882 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4279/8510] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:36:26.720541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e886c26-0ae2-41a5-89b5-00846736ded1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:26.722038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8e886c26-0ae2-41a5-89b5-00846736ded1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:26.782401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e886c26-0ae2-41a5-89b5-00846736ded1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:26.786080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd66727-e88a-4271-9f91-eff641961cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:26.786702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd66727-e88a-4271-9f91-eff641961cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:26.786988 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd66727-e88a-4271-9f91-eff641961cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:26.787265 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd66727-e88a-4271-9f91-eff641961cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:26.796819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd66727-e88a-4271-9f91-eff641961cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:26.798266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd66727-e88a-4271-9f91-eff641961cd6 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:26.807718 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4232/8511] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:36:27.086638 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a3f63-3376-4d06-a0b7-c794d0abdf14 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:27.088194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-888a3f63-3376-4d06-a0b7-c794d0abdf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:27.100510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a3f63-3376-4d06-a0b7-c794d0abdf14 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:27.105316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d9dd1-b804-483b-a776-bed576c722d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:27.105959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d9dd1-b804-483b-a776-bed576c722d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:27.106247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d9dd1-b804-483b-a776-bed576c722d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:27.106528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d9dd1-b804-483b-a776-bed576c722d2 admin admin] PATH_INFO: `/v3/projects/bb773a36a04c4eee91455ba9e1b49826` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:27.109099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d9dd1-b804-483b-a776-bed576c722d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb773a36a04c4eee91455ba9e1b49826)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:27.111035 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d9dd1-b804-483b-a776-bed576c722d2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:27.167394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-426d9dd1-b804-483b-a776-bed576c722d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb773a36a04c4eee91455ba9e1b49826', 'request_id': 'req-426d9dd1-b804-483b-a776-bed576c722d2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:27.176016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-426d9dd1-b804-483b-a776-bed576c722d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb773a36a04c4eee91455ba9e1b49826', 'request_id': 'req-426d9dd1-b804-483b-a776-bed576c722d2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:27.183450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-426d9dd1-b804-483b-a776-bed576c722d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb773a36a04c4eee91455ba9e1b49826', 'request_id': 'req-426d9dd1-b804-483b-a776-bed576c722d2'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:27.194105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-426d9dd1-b804-483b-a776-bed576c722d2 admin admin] The token cache is being invalidate because project bb773a36a04c4eee91455ba9e1b49826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:36:27.194392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-426d9dd1-b804-483b-a776-bed576c722d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:27.195039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-426d9dd1-b804-483b-a776-bed576c722d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:27.196601 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4280/8512] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:36:27 2022] DELETE /identity/v3/projects/bb773a36a04c4eee91455ba9e1b49826 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:27.201444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd66727-e88a-4271-9f91-eff641961cd6 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:27.211621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd66727-e88a-4271-9f91-eff641961cd6 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:27.276179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af7f5f-5d98-4255-b707-61cf975d84cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:27.276818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7f5f-5d98-4255-b707-61cf975d84cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:27.277102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7f5f-5d98-4255-b707-61cf975d84cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:27.277377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7f5f-5d98-4255-b707-61cf975d84cc admin admin] PATH_INFO: `/v3/users/ada24d1a2ffd47859ff66fe1608385c3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:27.278528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af7f5f-5d98-4255-b707-61cf975d84cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada24d1a2ffd47859ff66fe1608385c3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:27.281012 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af7f5f-5d98-4255-b707-61cf975d84cc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:27.325835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-18af7f5f-5d98-4255-b707-61cf975d84cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada24d1a2ffd47859ff66fe1608385c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:27.326481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-18af7f5f-5d98-4255-b707-61cf975d84cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada24d1a2ffd47859ff66fe1608385c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:27.338657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-18af7f5f-5d98-4255-b707-61cf975d84cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada24d1a2ffd47859ff66fe1608385c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:27.339301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-18af7f5f-5d98-4255-b707-61cf975d84cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada24d1a2ffd47859ff66fe1608385c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:27.343327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:27.347231 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-18af7f5f-5d98-4255-b707-61cf975d84cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada24d1a2ffd47859ff66fe1608385c3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:27.362474 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4233/8513] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:36:27 2022] DELETE /identity/v3/users/ada24d1a2ffd47859ff66fe1608385c3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:27.682910 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d9dd1-b804-483b-a776-bed576c722d2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:27.684358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-426d9dd1-b804-483b-a776-bed576c722d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:27.698002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d9dd1-b804-483b-a776-bed576c722d2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:27.713920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:27.768957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ecc8e-8e25-43a6-b332-d8ab76da96ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:27.769628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ecc8e-8e25-43a6-b332-d8ab76da96ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:27.769948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ecc8e-8e25-43a6-b332-d8ab76da96ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:27.770231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ecc8e-8e25-43a6-b332-d8ab76da96ae admin admin] PATH_INFO: `/v3/projects/4452d2a2fcbd4561b3ff268dff9175f2` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:27.771741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ecc8e-8e25-43a6-b332-d8ab76da96ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=4452d2a2fcbd4561b3ff268dff9175f2)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:27.773754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ecc8e-8e25-43a6-b332-d8ab76da96ae admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:27.823337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb5ecc8e-8e25-43a6-b332-d8ab76da96ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4452d2a2fcbd4561b3ff268dff9175f2', 'request_id': 'req-fb5ecc8e-8e25-43a6-b332-d8ab76da96ae'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:27.830016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb5ecc8e-8e25-43a6-b332-d8ab76da96ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4452d2a2fcbd4561b3ff268dff9175f2', 'request_id': 'req-fb5ecc8e-8e25-43a6-b332-d8ab76da96ae'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:27.836841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb5ecc8e-8e25-43a6-b332-d8ab76da96ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4452d2a2fcbd4561b3ff268dff9175f2', 'request_id': 'req-fb5ecc8e-8e25-43a6-b332-d8ab76da96ae'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:27.848257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb5ecc8e-8e25-43a6-b332-d8ab76da96ae admin admin] The token cache is being invalidate because project 4452d2a2fcbd4561b3ff268dff9175f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:36:27.848557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb5ecc8e-8e25-43a6-b332-d8ab76da96ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:27.849204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fb5ecc8e-8e25-43a6-b332-d8ab76da96ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:27.850774 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4281/8514] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:36:27 2022] DELETE /identity/v3/projects/4452d2a2fcbd4561b3ff268dff9175f2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:27.855634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390e67c-4bec-48fd-8b7e-aed6e02b0d6d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:27.856133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390e67c-4bec-48fd-8b7e-aed6e02b0d6d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:27.856263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390e67c-4bec-48fd-8b7e-aed6e02b0d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:27.880792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1390e67c-4bec-48fd-8b7e-aed6e02b0d6d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:36:27.882018 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1390e67c-4bec-48fd-8b7e-aed6e02b0d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:27.944905 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4234/8515] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:36:27.953307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5a850-508a-44cc-b83b-228b682fd126 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:27.953594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5a850-508a-44cc-b83b-228b682fd126 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:27.953875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5a850-508a-44cc-b83b-228b682fd126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:27.974287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1df5a850-508a-44cc-b83b-228b682fd126 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:36:27.975603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1df5a850-508a-44cc-b83b-228b682fd126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:27.983689 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4282/8516] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:36:27.987921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390e67c-4bec-48fd-8b7e-aed6e02b0d6d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:27.998561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390e67c-4bec-48fd-8b7e-aed6e02b0d6d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:28.003380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6c082-d288-4158-9333-5f93dfa02a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:28.003987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6c082-d288-4158-9333-5f93dfa02a20 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:28.004293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6c082-d288-4158-9333-5f93dfa02a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:28.004566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6c082-d288-4158-9333-5f93dfa02a20 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:28.005263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6c082-d288-4158-9333-5f93dfa02a20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:36:28.005566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6c082-d288-4158-9333-5f93dfa02a20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:28.007153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6c082-d288-4158-9333-5f93dfa02a20 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:28.019569 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4235/8517] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:36:28.024071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5a850-508a-44cc-b83b-228b682fd126 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:28.033713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5a850-508a-44cc-b83b-228b682fd126 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:28.038428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29c942-40dc-482e-a626-7035de67032e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:28.039072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29c942-40dc-482e-a626-7035de67032e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:28.039394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29c942-40dc-482e-a626-7035de67032e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:28.039676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29c942-40dc-482e-a626-7035de67032e admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:28.040394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29c942-40dc-482e-a626-7035de67032e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:28.042306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29c942-40dc-482e-a626-7035de67032e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:28.069518 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4283/8518] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:36:28 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:36:28.073619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6c082-d288-4158-9333-5f93dfa02a20 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:28.084259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6c082-d288-4158-9333-5f93dfa02a20 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:28.140763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017803e-0657-40ef-979e-96cba8e04b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:28.141398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017803e-0657-40ef-979e-96cba8e04b9b admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:28.141691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017803e-0657-40ef-979e-96cba8e04b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:28.141971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017803e-0657-40ef-979e-96cba8e04b9b admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:28.142643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017803e-0657-40ef-979e-96cba8e04b9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:28.144669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017803e-0657-40ef-979e-96cba8e04b9b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:28.169117 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4236/8519] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:36:28 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:36:28.170725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29c942-40dc-482e-a626-7035de67032e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:28.183602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29c942-40dc-482e-a626-7035de67032e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:28.191881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55399823-0d70-4929-b496-45d9bcfbc438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:28.192515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55399823-0d70-4929-b496-45d9bcfbc438 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:28.192806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55399823-0d70-4929-b496-45d9bcfbc438 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:28.193093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55399823-0d70-4929-b496-45d9bcfbc438 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:28.193799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55399823-0d70-4929-b496-45d9bcfbc438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:28.197697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55399823-0d70-4929-b496-45d9bcfbc438 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:28.209849 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4284/8520] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:36:28.213981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017803e-0657-40ef-979e-96cba8e04b9b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:28.227573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017803e-0657-40ef-979e-96cba8e04b9b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:28.233019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee4c3c-fc83-4b27-b73e-f21ff777a8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:28.233680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee4c3c-fc83-4b27-b73e-f21ff777a8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:28.233973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee4c3c-fc83-4b27-b73e-f21ff777a8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:28.234260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee4c3c-fc83-4b27-b73e-f21ff777a8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:28.234963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee4c3c-fc83-4b27-b73e-f21ff777a8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:28.236680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee4c3c-fc83-4b27-b73e-f21ff777a8c0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:28.249006 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4237/8521] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:36:28.253447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55399823-0d70-4929-b496-45d9bcfbc438 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:28.266178 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55399823-0d70-4929-b496-45d9bcfbc438 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:28.270791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f91f6a-3d1c-42fc-bb25-6997be549135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:28.271485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f91f6a-3d1c-42fc-bb25-6997be549135 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:28.271775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f91f6a-3d1c-42fc-bb25-6997be549135 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:28.272054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f91f6a-3d1c-42fc-bb25-6997be549135 admin admin] PATH_INFO: `/v3/projects/d9f593dcc1904559bba2c1271fc36ef9/users/d8533314435742cf9bcffcb4bcab6354/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:28.287497 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f91f6a-3d1c-42fc-bb25-6997be549135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f593dcc1904559bba2c1271fc36ef9, user_id=d8533314435742cf9bcffcb4bcab6354, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:28.290140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f91f6a-3d1c-42fc-bb25-6997be549135 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:28.303317 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4285/8522] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:36:28 2022] PUT /identity/v3/projects/d9f593dcc1904559bba2c1271fc36ef9/users/d8533314435742cf9bcffcb4bcab6354/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:28.315535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a670e36-3715-4f90-9901-c50d1097895f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:28.315882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a670e36-3715-4f90-9901-c50d1097895f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:28.316115 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a670e36-3715-4f90-9901-c50d1097895f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:28.343627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7a670e36-3715-4f90-9901-c50d1097895f None None] MFA Rules not processed for user `d8533314435742cf9bcffcb4bcab6354`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:36:28.344848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7a670e36-3715-4f90-9901-c50d1097895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:28.387316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:28.411010 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4238/8523] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:36:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:36:28.415634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f91f6a-3d1c-42fc-bb25-6997be549135 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:28.462116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:28.481544 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f91f6a-3d1c-42fc-bb25-6997be549135 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:28.486834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854998ba-6dac-416c-8e16-054c7a7cdd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:28.487501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854998ba-6dac-416c-8e16-054c7a7cdd7a admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:28.487792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854998ba-6dac-416c-8e16-054c7a7cdd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:28.488073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854998ba-6dac-416c-8e16-054c7a7cdd7a admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:28.488754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854998ba-6dac-416c-8e16-054c7a7cdd7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:28.490659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854998ba-6dac-416c-8e16-054c7a7cdd7a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:28.534841 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4286/8524] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:36:28 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:36:28.536377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a670e36-3715-4f90-9901-c50d1097895f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:28.548160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a670e36-3715-4f90-9901-c50d1097895f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:28.604986 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb488c-aad0-416e-ac7d-020d1855ef85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:28.605644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb488c-aad0-416e-ac7d-020d1855ef85 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:28.605933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb488c-aad0-416e-ac7d-020d1855ef85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:28.606210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb488c-aad0-416e-ac7d-020d1855ef85 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:28.607416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb488c-aad0-416e-ac7d-020d1855ef85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:28.609401 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb488c-aad0-416e-ac7d-020d1855ef85 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:28.631335 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4239/8525] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:36:28 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:36:28.634861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854998ba-6dac-416c-8e16-054c7a7cdd7a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:28.645640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854998ba-6dac-416c-8e16-054c7a7cdd7a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:28.650450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a558dd-01e0-45ff-8c9d-35ad6adb4b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:28.651408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a558dd-01e0-45ff-8c9d-35ad6adb4b7e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:28.651408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a558dd-01e0-45ff-8c9d-35ad6adb4b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:28.651677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a558dd-01e0-45ff-8c9d-35ad6adb4b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:28.652356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a558dd-01e0-45ff-8c9d-35ad6adb4b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:28.654501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a558dd-01e0-45ff-8c9d-35ad6adb4b7e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:28.665684 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4287/8526] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:36:28.670574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb488c-aad0-416e-ac7d-020d1855ef85 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:28.680829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb488c-aad0-416e-ac7d-020d1855ef85 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:28.685796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc496ab-1a68-4ae5-ad47-796302fb9c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:28.686448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc496ab-1a68-4ae5-ad47-796302fb9c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:28.686733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc496ab-1a68-4ae5-ad47-796302fb9c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:28.687011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc496ab-1a68-4ae5-ad47-796302fb9c33 admin admin] PATH_INFO: `/v3/projects/0e9990ad5a4c4361b8df1b951ea71f6e/users/fc46bc1fd5f140bdb45b42073d7923cb/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:28.701981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc496ab-1a68-4ae5-ad47-796302fb9c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9990ad5a4c4361b8df1b951ea71f6e, user_id=fc46bc1fd5f140bdb45b42073d7923cb, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:28.704776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc496ab-1a68-4ae5-ad47-796302fb9c33 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:28.718055 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4240/8527] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:36:28 2022] PUT /identity/v3/projects/0e9990ad5a4c4361b8df1b951ea71f6e/users/fc46bc1fd5f140bdb45b42073d7923cb/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:36:28.722109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a558dd-01e0-45ff-8c9d-35ad6adb4b7e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:28.732986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a558dd-01e0-45ff-8c9d-35ad6adb4b7e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:28.792126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96ee7a-f017-47bd-be99-1d561f52955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:28.792681 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96ee7a-f017-47bd-be99-1d561f52955e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:28.792968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96ee7a-f017-47bd-be99-1d561f52955e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:28.793244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96ee7a-f017-47bd-be99-1d561f52955e admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:28.793924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96ee7a-f017-47bd-be99-1d561f52955e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:28.796190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96ee7a-f017-47bd-be99-1d561f52955e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:28.805850 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4288/8528] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:36:28.809967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc496ab-1a68-4ae5-ad47-796302fb9c33 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:28.820260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc496ab-1a68-4ae5-ad47-796302fb9c33 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:28.824923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116c87e-ff5a-4ddf-bddb-d89bb9108da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:28.825683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116c87e-ff5a-4ddf-bddb-d89bb9108da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:28.826093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116c87e-ff5a-4ddf-bddb-d89bb9108da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:28.826502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116c87e-ff5a-4ddf-bddb-d89bb9108da6 admin admin] PATH_INFO: `/v3/projects/0e9990ad5a4c4361b8df1b951ea71f6e/users/fc46bc1fd5f140bdb45b42073d7923cb/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:28.828683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116c87e-ff5a-4ddf-bddb-d89bb9108da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9990ad5a4c4361b8df1b951ea71f6e, user_id=fc46bc1fd5f140bdb45b42073d7923cb, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:28.831362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116c87e-ff5a-4ddf-bddb-d89bb9108da6 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:28.844080 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4241/8529] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:36:28 2022] PUT /identity/v3/projects/0e9990ad5a4c4361b8df1b951ea71f6e/users/fc46bc1fd5f140bdb45b42073d7923cb/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:28.854333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085f6b-637d-4847-8061-a63863a16a60 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:28.854628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085f6b-637d-4847-8061-a63863a16a60 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:28.854912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085f6b-637d-4847-8061-a63863a16a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:28.883690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-30085f6b-637d-4847-8061-a63863a16a60 None None] MFA Rules not processed for user `fc46bc1fd5f140bdb45b42073d7923cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:36:28.884922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-30085f6b-637d-4847-8061-a63863a16a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:28.959918 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4289/8530] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:36:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:36:28.971280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116c87e-ff5a-4ddf-bddb-d89bb9108da6 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:28.973092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2116c87e-ff5a-4ddf-bddb-d89bb9108da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:29.054591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116c87e-ff5a-4ddf-bddb-d89bb9108da6 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:29.058429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0189ddb-ee36-4fd8-9ce6-c478282eb705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:29.059114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0189ddb-ee36-4fd8-9ce6-c478282eb705 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:29.059449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0189ddb-ee36-4fd8-9ce6-c478282eb705 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:29.059761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0189ddb-ee36-4fd8-9ce6-c478282eb705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:29.109974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:29.120212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0189ddb-ee36-4fd8-9ce6-c478282eb705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:29.122319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0189ddb-ee36-4fd8-9ce6-c478282eb705 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:29.132544 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4242/8531] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:36:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:36:29.468548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30085f6b-637d-4847-8061-a63863a16a60 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:29.470091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-30085f6b-637d-4847-8061-a63863a16a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:29.515216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:29.534921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30085f6b-637d-4847-8061-a63863a16a60 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:29.538682 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcddaa9-1acb-4d93-a8da-29467a8d2fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:29.539372 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcddaa9-1acb-4d93-a8da-29467a8d2fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:29.539663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcddaa9-1acb-4d93-a8da-29467a8d2fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:29.539943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcddaa9-1acb-4d93-a8da-29467a8d2fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:29.541709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8dcddaa9-1acb-4d93-a8da-29467a8d2fa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:29.554286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcddaa9-1acb-4d93-a8da-29467a8d2fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:29.556033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcddaa9-1acb-4d93-a8da-29467a8d2fa5 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:29.567184 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4290/8532] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:36:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:36:31.705323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0189ddb-ee36-4fd8-9ce6-c478282eb705 service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:31.717351 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0189ddb-ee36-4fd8-9ce6-c478282eb705 service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:31.721008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c87a51-ba92-408e-a2e8-044d97161637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:31.721630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c87a51-ba92-408e-a2e8-044d97161637 service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:31.721915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c87a51-ba92-408e-a2e8-044d97161637 service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:31.722192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c87a51-ba92-408e-a2e8-044d97161637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:31.731781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c87a51-ba92-408e-a2e8-044d97161637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:31.733943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c87a51-ba92-408e-a2e8-044d97161637 service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:31.744426 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4243/8533] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:36:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:36:31.866653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcddaa9-1acb-4d93-a8da-29467a8d2fa5 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:31.870250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8dcddaa9-1acb-4d93-a8da-29467a8d2fa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:31.886418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcddaa9-1acb-4d93-a8da-29467a8d2fa5 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:31.890401 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579855b-b71a-4bbf-8fd4-46764a332275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:31.891099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579855b-b71a-4bbf-8fd4-46764a332275 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:31.891491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579855b-b71a-4bbf-8fd4-46764a332275 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:31.891835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579855b-b71a-4bbf-8fd4-46764a332275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:31.893664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c579855b-b71a-4bbf-8fd4-46764a332275 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:31.908800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579855b-b71a-4bbf-8fd4-46764a332275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:31.910430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579855b-b71a-4bbf-8fd4-46764a332275 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:31.922568 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4291/8534] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:36:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:36:36.887872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86f6db-97ba-44c8-9b15-f45d8c5cdc07 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:36.889348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86f6db-97ba-44c8-9b15-f45d8c5cdc07 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:36.889673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86f6db-97ba-44c8-9b15-f45d8c5cdc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:36.913764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8e86f6db-97ba-44c8-9b15-f45d8c5cdc07 None None] MFA Rules not processed for user `713a3b0b01bd4a7aa128101b5b86be0f`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:36:36.915704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8e86f6db-97ba-44c8-9b15-f45d8c5cdc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:36.985880 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4244/8535] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:36:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:36:40.185044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579855b-b71a-4bbf-8fd4-46764a332275 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:40.187472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c579855b-b71a-4bbf-8fd4-46764a332275 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:40.268990 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579855b-b71a-4bbf-8fd4-46764a332275 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:40.274595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa8e23-9eda-46c0-bc3c-7ff699522f17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:40.275224 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa8e23-9eda-46c0-bc3c-7ff699522f17 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:40.275546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa8e23-9eda-46c0-bc3c-7ff699522f17 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:40.275828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa8e23-9eda-46c0-bc3c-7ff699522f17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:40.277624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-37aa8e23-9eda-46c0-bc3c-7ff699522f17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:40.292742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa8e23-9eda-46c0-bc3c-7ff699522f17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:40.294329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa8e23-9eda-46c0-bc3c-7ff699522f17 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:40.308856 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4292/8536] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:36:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:36:46.574187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86f6db-97ba-44c8-9b15-f45d8c5cdc07 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:46.637080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86f6db-97ba-44c8-9b15-f45d8c5cdc07 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:46.641653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e28ad-6b27-4eee-b225-dc751850797d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:46.642292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e28ad-6b27-4eee-b225-dc751850797d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:46.642578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e28ad-6b27-4eee-b225-dc751850797d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:46.642862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e28ad-6b27-4eee-b225-dc751850797d admin admin] PATH_INFO: `/v3/users/d8533314435742cf9bcffcb4bcab6354` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:46.644057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e28ad-6b27-4eee-b225-dc751850797d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8533314435742cf9bcffcb4bcab6354)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:46.645975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e28ad-6b27-4eee-b225-dc751850797d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:46.691592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ff1e28ad-6b27-4eee-b225-dc751850797d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8533314435742cf9bcffcb4bcab6354'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:46.692256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ff1e28ad-6b27-4eee-b225-dc751850797d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8533314435742cf9bcffcb4bcab6354'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:46.704303 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ff1e28ad-6b27-4eee-b225-dc751850797d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8533314435742cf9bcffcb4bcab6354'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:46.704919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ff1e28ad-6b27-4eee-b225-dc751850797d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8533314435742cf9bcffcb4bcab6354'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:46.711902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-ff1e28ad-6b27-4eee-b225-dc751850797d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8533314435742cf9bcffcb4bcab6354'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:46.720794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:46.725556 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4245/8537] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:36:46 2022] DELETE /identity/v3/users/d8533314435742cf9bcffcb4bcab6354 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:46.730379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3055a-cfdb-4e77-abd0-345c2a583cd5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:46.730928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3055a-cfdb-4e77-abd0-345c2a583cd5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:46.731060 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3055a-cfdb-4e77-abd0-345c2a583cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:46.750384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-43c3055a-cfdb-4e77-abd0-345c2a583cd5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:36:46.751609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-43c3055a-cfdb-4e77-abd0-345c2a583cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:46.809935 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4293/8538] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:36:46.819727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e28ad-6b27-4eee-b225-dc751850797d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:46.821182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ff1e28ad-6b27-4eee-b225-dc751850797d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:46.881365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e28ad-6b27-4eee-b225-dc751850797d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:46.885151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d389a0-43a4-4620-95f8-d1e85cbfa8b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:46.885779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d389a0-43a4-4620-95f8-d1e85cbfa8b3 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:46.886098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d389a0-43a4-4620-95f8-d1e85cbfa8b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:46.886382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d389a0-43a4-4620-95f8-d1e85cbfa8b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:46.895553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d389a0-43a4-4620-95f8-d1e85cbfa8b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:46.896991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d389a0-43a4-4620-95f8-d1e85cbfa8b3 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:46.906960 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4246/8539] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:36:47.264335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3055a-cfdb-4e77-abd0-345c2a583cd5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:47.265875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-43c3055a-cfdb-4e77-abd0-345c2a583cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:47.278784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3055a-cfdb-4e77-abd0-345c2a583cd5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:47.285075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c9f64-328e-4828-ae25-3d8c78d23110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:47.286196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c9f64-328e-4828-ae25-3d8c78d23110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:47.286496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c9f64-328e-4828-ae25-3d8c78d23110 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:47.286780 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c9f64-328e-4828-ae25-3d8c78d23110 admin admin] PATH_INFO: `/v3/projects/d9f593dcc1904559bba2c1271fc36ef9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:47.288125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c9f64-328e-4828-ae25-3d8c78d23110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9f593dcc1904559bba2c1271fc36ef9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:47.290823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c9f64-328e-4828-ae25-3d8c78d23110 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:47.343130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:47.344851 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c70c9f64-328e-4828-ae25-3d8c78d23110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9f593dcc1904559bba2c1271fc36ef9', 'request_id': 'req-c70c9f64-328e-4828-ae25-3d8c78d23110'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:47.351840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c70c9f64-328e-4828-ae25-3d8c78d23110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9f593dcc1904559bba2c1271fc36ef9', 'request_id': 'req-c70c9f64-328e-4828-ae25-3d8c78d23110'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:47.360331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c70c9f64-328e-4828-ae25-3d8c78d23110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9f593dcc1904559bba2c1271fc36ef9', 'request_id': 'req-c70c9f64-328e-4828-ae25-3d8c78d23110'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:47.370887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c70c9f64-328e-4828-ae25-3d8c78d23110 admin admin] The token cache is being invalidate because project d9f593dcc1904559bba2c1271fc36ef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:36:47.371179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c70c9f64-328e-4828-ae25-3d8c78d23110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:47.371867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c70c9f64-328e-4828-ae25-3d8c78d23110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:47.373425 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4294/8540] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:36:47 2022] DELETE /identity/v3/projects/d9f593dcc1904559bba2c1271fc36ef9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:36:47.377685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d389a0-43a4-4620-95f8-d1e85cbfa8b3 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:47.388848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d389a0-43a4-4620-95f8-d1e85cbfa8b3 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:47.453317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bd811-148b-4ffb-90a2-a7ddc884009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:47.453971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bd811-148b-4ffb-90a2-a7ddc884009a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:47.454257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bd811-148b-4ffb-90a2-a7ddc884009a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:47.454528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bd811-148b-4ffb-90a2-a7ddc884009a admin admin] PATH_INFO: `/v3/users/fc46bc1fd5f140bdb45b42073d7923cb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:47.455764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bd811-148b-4ffb-90a2-a7ddc884009a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc46bc1fd5f140bdb45b42073d7923cb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:47.458640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bd811-148b-4ffb-90a2-a7ddc884009a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:47.506635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7a5bd811-148b-4ffb-90a2-a7ddc884009a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc46bc1fd5f140bdb45b42073d7923cb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:47.507328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7a5bd811-148b-4ffb-90a2-a7ddc884009a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc46bc1fd5f140bdb45b42073d7923cb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:47.519632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7a5bd811-148b-4ffb-90a2-a7ddc884009a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc46bc1fd5f140bdb45b42073d7923cb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:47.520274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7a5bd811-148b-4ffb-90a2-a7ddc884009a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc46bc1fd5f140bdb45b42073d7923cb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:47.528513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7a5bd811-148b-4ffb-90a2-a7ddc884009a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc46bc1fd5f140bdb45b42073d7923cb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:47.540807 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4247/8541] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:36:47 2022] DELETE /identity/v3/users/fc46bc1fd5f140bdb45b42073d7923cb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:47.816549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c9f64-328e-4828-ae25-3d8c78d23110 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:47.818055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c70c9f64-328e-4828-ae25-3d8c78d23110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:47.833966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c9f64-328e-4828-ae25-3d8c78d23110 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:47.894125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5430ba-c2f8-4962-ac32-0096a47e5d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:47.894778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5430ba-c2f8-4962-ac32-0096a47e5d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:47.895097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5430ba-c2f8-4962-ac32-0096a47e5d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:47.895436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5430ba-c2f8-4962-ac32-0096a47e5d34 admin admin] PATH_INFO: `/v3/projects/0e9990ad5a4c4361b8df1b951ea71f6e` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:47.896685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5430ba-c2f8-4962-ac32-0096a47e5d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e9990ad5a4c4361b8df1b951ea71f6e)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:47.898586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5430ba-c2f8-4962-ac32-0096a47e5d34 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:47.946541 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0a5430ba-c2f8-4962-ac32-0096a47e5d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e9990ad5a4c4361b8df1b951ea71f6e', 'request_id': 'req-0a5430ba-c2f8-4962-ac32-0096a47e5d34'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:47.952609 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0a5430ba-c2f8-4962-ac32-0096a47e5d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e9990ad5a4c4361b8df1b951ea71f6e', 'request_id': 'req-0a5430ba-c2f8-4962-ac32-0096a47e5d34'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:47.960033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0a5430ba-c2f8-4962-ac32-0096a47e5d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e9990ad5a4c4361b8df1b951ea71f6e', 'request_id': 'req-0a5430ba-c2f8-4962-ac32-0096a47e5d34'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:47.970461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0a5430ba-c2f8-4962-ac32-0096a47e5d34 admin admin] The token cache is being invalidate because project 0e9990ad5a4c4361b8df1b951ea71f6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:36:47.970756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0a5430ba-c2f8-4962-ac32-0096a47e5d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:47.971426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-0a5430ba-c2f8-4962-ac32-0096a47e5d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:47.973010 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4295/8542] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:36:47 2022] DELETE /identity/v3/projects/0e9990ad5a4c4361b8df1b951ea71f6e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:47.978042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c44b91-8f75-4f92-bea9-3be10c239ca2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:47.978550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c44b91-8f75-4f92-bea9-3be10c239ca2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:47.978663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c44b91-8f75-4f92-bea9-3be10c239ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:48.004669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-01c44b91-8f75-4f92-bea9-3be10c239ca2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:36:48.005902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-01c44b91-8f75-4f92-bea9-3be10c239ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:48.023647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:48.070505 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4248/8543] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:36:48.079607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e5938-d497-4a05-8d1f-9ca5906d4f3f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:48.079906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e5938-d497-4a05-8d1f-9ca5906d4f3f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:48.080186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e5938-d497-4a05-8d1f-9ca5906d4f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:48.099969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-291e5938-d497-4a05-8d1f-9ca5906d4f3f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:36:48.101223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-291e5938-d497-4a05-8d1f-9ca5906d4f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:48.110557 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4296/8544] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:36:48.114835 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c44b91-8f75-4f92-bea9-3be10c239ca2 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:48.125482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c44b91-8f75-4f92-bea9-3be10c239ca2 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:48.130051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731dcc5-d21e-4f91-9619-815228e1d124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:48.130654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731dcc5-d21e-4f91-9619-815228e1d124 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:48.130936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731dcc5-d21e-4f91-9619-815228e1d124 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:48.131210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731dcc5-d21e-4f91-9619-815228e1d124 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:48.131933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731dcc5-d21e-4f91-9619-815228e1d124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:36:48.132241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731dcc5-d21e-4f91-9619-815228e1d124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:48.133829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731dcc5-d21e-4f91-9619-815228e1d124 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:48.145326 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4249/8545] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:36:48.150215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e5938-d497-4a05-8d1f-9ca5906d4f3f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:48.160660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e5938-d497-4a05-8d1f-9ca5906d4f3f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:48.165467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f149a-af8a-4352-97ad-b9cb47ffd012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:48.166110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f149a-af8a-4352-97ad-b9cb47ffd012 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:48.166402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f149a-af8a-4352-97ad-b9cb47ffd012 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:48.166680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f149a-af8a-4352-97ad-b9cb47ffd012 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:48.167384 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f149a-af8a-4352-97ad-b9cb47ffd012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:48.169938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f149a-af8a-4352-97ad-b9cb47ffd012 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:48.199411 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4297/8546] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:36:48 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:36:48.203635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731dcc5-d21e-4f91-9619-815228e1d124 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:48.213865 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731dcc5-d21e-4f91-9619-815228e1d124 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:48.273013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ac86b-79c6-48c8-a8e4-218ee7633106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:48.273720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ac86b-79c6-48c8-a8e4-218ee7633106 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:48.274083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ac86b-79c6-48c8-a8e4-218ee7633106 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:48.274439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ac86b-79c6-48c8-a8e4-218ee7633106 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:48.275206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ac86b-79c6-48c8-a8e4-218ee7633106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:48.277667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ac86b-79c6-48c8-a8e4-218ee7633106 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:48.303661 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4250/8547] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:36:48 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:36:48.307747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f149a-af8a-4352-97ad-b9cb47ffd012 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:48.318222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f149a-af8a-4352-97ad-b9cb47ffd012 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:48.322962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5cc45-5d39-4873-82eb-4f30ca1c0e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:48.323612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5cc45-5d39-4873-82eb-4f30ca1c0e36 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:48.323902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5cc45-5d39-4873-82eb-4f30ca1c0e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:48.324181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5cc45-5d39-4873-82eb-4f30ca1c0e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:48.324877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5cc45-5d39-4873-82eb-4f30ca1c0e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:48.326511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5cc45-5d39-4873-82eb-4f30ca1c0e36 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:48.337746 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4298/8548] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:36:48.342640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ac86b-79c6-48c8-a8e4-218ee7633106 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:48.353714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ac86b-79c6-48c8-a8e4-218ee7633106 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:48.359125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e66108-5f22-4f93-8465-f228b22f4f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:48.359784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e66108-5f22-4f93-8465-f228b22f4f6e admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:48.360073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e66108-5f22-4f93-8465-f228b22f4f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:48.360348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e66108-5f22-4f93-8465-f228b22f4f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:48.361046 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e66108-5f22-4f93-8465-f228b22f4f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:48.363041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e66108-5f22-4f93-8465-f228b22f4f6e admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:48.373785 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4251/8549] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:36:48.378508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5cc45-5d39-4873-82eb-4f30ca1c0e36 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:48.388917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5cc45-5d39-4873-82eb-4f30ca1c0e36 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:48.394985 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2dcfd-8118-4134-bbec-01fb692e87d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:48.395393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2dcfd-8118-4134-bbec-01fb692e87d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:48.395635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2dcfd-8118-4134-bbec-01fb692e87d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:48.395916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2dcfd-8118-4134-bbec-01fb692e87d3 admin admin] PATH_INFO: `/v3/projects/79eef4eae66c425fa1988888bc0217ef/users/d53fe208fe194ef2b59ccbd17ab5c008/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:48.412572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2dcfd-8118-4134-bbec-01fb692e87d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79eef4eae66c425fa1988888bc0217ef, user_id=d53fe208fe194ef2b59ccbd17ab5c008, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:48.415496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2dcfd-8118-4134-bbec-01fb692e87d3 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:48.430116 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4299/8550] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:36:48 2022] PUT /identity/v3/projects/79eef4eae66c425fa1988888bc0217ef/users/d53fe208fe194ef2b59ccbd17ab5c008/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:36:48.440823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882275a-85bf-491c-8dd8-37eee438276a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:48.441417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882275a-85bf-491c-8dd8-37eee438276a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:48.442458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882275a-85bf-491c-8dd8-37eee438276a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:48.474580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e882275a-85bf-491c-8dd8-37eee438276a None None] MFA Rules not processed for user `d53fe208fe194ef2b59ccbd17ab5c008`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:36:48.475836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e882275a-85bf-491c-8dd8-37eee438276a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:48.544354 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4252/8551] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:36:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:36:48.548977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2dcfd-8118-4134-bbec-01fb692e87d3 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:48.553670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:48.620664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2dcfd-8118-4134-bbec-01fb692e87d3 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:48.625731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca29b9-0489-4258-bf66-e98598b70915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:48.626382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca29b9-0489-4258-bf66-e98598b70915 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:48.626670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca29b9-0489-4258-bf66-e98598b70915 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:48.626948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca29b9-0489-4258-bf66-e98598b70915 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:48.627677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca29b9-0489-4258-bf66-e98598b70915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:48.629570 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca29b9-0489-4258-bf66-e98598b70915 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:48.660544 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4300/8552] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:36:48 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:36:48.664646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882275a-85bf-491c-8dd8-37eee438276a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:48.675461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882275a-85bf-491c-8dd8-37eee438276a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:48.687658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:48.734045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f5060-3279-406a-952e-51374d35dbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:48.734724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f5060-3279-406a-952e-51374d35dbd7 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:48.734992 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f5060-3279-406a-952e-51374d35dbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:48.735440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f5060-3279-406a-952e-51374d35dbd7 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:48.735993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f5060-3279-406a-952e-51374d35dbd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:48.737944 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f5060-3279-406a-952e-51374d35dbd7 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:48.760983 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4253/8553] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:36:48 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:36:48.762264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca29b9-0489-4258-bf66-e98598b70915 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:48.773965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca29b9-0489-4258-bf66-e98598b70915 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:48.779403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee9721-fd4e-4585-b14f-a7d1dbf72262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:48.780048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee9721-fd4e-4585-b14f-a7d1dbf72262 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:48.780340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee9721-fd4e-4585-b14f-a7d1dbf72262 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:48.780625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee9721-fd4e-4585-b14f-a7d1dbf72262 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:48.781321 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee9721-fd4e-4585-b14f-a7d1dbf72262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:48.782921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee9721-fd4e-4585-b14f-a7d1dbf72262 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:48.793781 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4301/8554] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:36:48.797864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f5060-3279-406a-952e-51374d35dbd7 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:48.808003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f5060-3279-406a-952e-51374d35dbd7 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:48.812755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797e2e0-1fd9-42ef-a012-a134b6a1744a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:48.813347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797e2e0-1fd9-42ef-a012-a134b6a1744a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:48.813636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797e2e0-1fd9-42ef-a012-a134b6a1744a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:48.814028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797e2e0-1fd9-42ef-a012-a134b6a1744a admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:48.814758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797e2e0-1fd9-42ef-a012-a134b6a1744a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:48.816388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797e2e0-1fd9-42ef-a012-a134b6a1744a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:48.826947 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4254/8555] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:36:48.830936 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee9721-fd4e-4585-b14f-a7d1dbf72262 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:48.841036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee9721-fd4e-4585-b14f-a7d1dbf72262 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:48.846448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cb5fb-ffc4-484e-8a6b-9c96ef71d53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:48.847113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cb5fb-ffc4-484e-8a6b-9c96ef71d53f admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:48.847439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cb5fb-ffc4-484e-8a6b-9c96ef71d53f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:48.847724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cb5fb-ffc4-484e-8a6b-9c96ef71d53f admin admin] PATH_INFO: `/v3/projects/95d9546b46754d6eba599513082465c3/users/ba65fe2576d4460689afa9d55f4b11f3/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:48.862402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cb5fb-ffc4-484e-8a6b-9c96ef71d53f admin admin] RBAC: Authorizing `identity:create_grant(project_id=95d9546b46754d6eba599513082465c3, user_id=ba65fe2576d4460689afa9d55f4b11f3, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:48.865095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cb5fb-ffc4-484e-8a6b-9c96ef71d53f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:48.877978 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4302/8556] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:36:48 2022] PUT /identity/v3/projects/95d9546b46754d6eba599513082465c3/users/ba65fe2576d4460689afa9d55f4b11f3/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:48.888814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cce48c-47f5-476f-945c-21d6b369e68b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:48.889322 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cce48c-47f5-476f-945c-21d6b369e68b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:48.889680 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cce48c-47f5-476f-945c-21d6b369e68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:48.918140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-36cce48c-47f5-476f-945c-21d6b369e68b None None] MFA Rules not processed for user `ba65fe2576d4460689afa9d55f4b11f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:36:48.919353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-36cce48c-47f5-476f-945c-21d6b369e68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:48.986126 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4255/8557] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:36:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:36:48.990626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cb5fb-ffc4-484e-8a6b-9c96ef71d53f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:49.054061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cb5fb-ffc4-484e-8a6b-9c96ef71d53f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:49.059206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c9577-4e91-4571-941a-5467ded14ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:49.060357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c9577-4e91-4571-941a-5467ded14ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:49.060647 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c9577-4e91-4571-941a-5467ded14ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:49.060929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c9577-4e91-4571-941a-5467ded14ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:49.061604 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c9577-4e91-4571-941a-5467ded14ea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:49.063536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c9577-4e91-4571-941a-5467ded14ea4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:49.093368 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4303/8558] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:36:48 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:36:49.094606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cce48c-47f5-476f-945c-21d6b369e68b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:49.106406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cce48c-47f5-476f-945c-21d6b369e68b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:49.162963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93be466-8a4f-499d-a340-77fc0b8ea452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:49.163628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93be466-8a4f-499d-a340-77fc0b8ea452 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:49.163913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93be466-8a4f-499d-a340-77fc0b8ea452 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:49.164190 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93be466-8a4f-499d-a340-77fc0b8ea452 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:49.164854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93be466-8a4f-499d-a340-77fc0b8ea452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:49.166768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93be466-8a4f-499d-a340-77fc0b8ea452 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:49.187914 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4256/8559] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:36:49 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:36:49.191904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c9577-4e91-4571-941a-5467ded14ea4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:49.202526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c9577-4e91-4571-941a-5467ded14ea4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:49.207283 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395e58f-e950-45c0-b0cf-dc315d157473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:49.207924 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395e58f-e950-45c0-b0cf-dc315d157473 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:49.208216 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395e58f-e950-45c0-b0cf-dc315d157473 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:49.208499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395e58f-e950-45c0-b0cf-dc315d157473 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:49.209221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395e58f-e950-45c0-b0cf-dc315d157473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:49.210831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395e58f-e950-45c0-b0cf-dc315d157473 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:49.222676 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4304/8560] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:36:49.226337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93be466-8a4f-499d-a340-77fc0b8ea452 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:49.237256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93be466-8a4f-499d-a340-77fc0b8ea452 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:49.241954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3aaf0-fc93-4ac7-b836-836c538436b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:49.242612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3aaf0-fc93-4ac7-b836-836c538436b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:49.242901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3aaf0-fc93-4ac7-b836-836c538436b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:49.243186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3aaf0-fc93-4ac7-b836-836c538436b9 admin admin] PATH_INFO: `/v3/projects/1e6ccaca3e204cbf85a6290475fb2608/users/67d67a898b0046fbaa0836b6ef66b83f/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:49.255643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:49.258855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3aaf0-fc93-4ac7-b836-836c538436b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e6ccaca3e204cbf85a6290475fb2608, user_id=67d67a898b0046fbaa0836b6ef66b83f, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:49.261929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3aaf0-fc93-4ac7-b836-836c538436b9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:49.274931 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4257/8561] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:36:49 2022] PUT /identity/v3/projects/1e6ccaca3e204cbf85a6290475fb2608/users/67d67a898b0046fbaa0836b6ef66b83f/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:49.279395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395e58f-e950-45c0-b0cf-dc315d157473 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:49.289499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395e58f-e950-45c0-b0cf-dc315d157473 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:49.314725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:49.352335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5dd04-7d1f-4a04-9206-b2c5db5e8a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:49.352968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5dd04-7d1f-4a04-9206-b2c5db5e8a8a admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:49.353548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5dd04-7d1f-4a04-9206-b2c5db5e8a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:49.353836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5dd04-7d1f-4a04-9206-b2c5db5e8a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:49.354656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5dd04-7d1f-4a04-9206-b2c5db5e8a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:49.356492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5dd04-7d1f-4a04-9206-b2c5db5e8a8a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:49.366313 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4305/8562] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:36:49.370596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3aaf0-fc93-4ac7-b836-836c538436b9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:49.381556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3aaf0-fc93-4ac7-b836-836c538436b9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:49.386387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a477faf-9bd7-4c64-8079-7e2f5b963d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:49.387089 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a477faf-9bd7-4c64-8079-7e2f5b963d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:49.387410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a477faf-9bd7-4c64-8079-7e2f5b963d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:49.387698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a477faf-9bd7-4c64-8079-7e2f5b963d52 admin admin] PATH_INFO: `/v3/projects/1e6ccaca3e204cbf85a6290475fb2608/users/67d67a898b0046fbaa0836b6ef66b83f/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:49.390261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a477faf-9bd7-4c64-8079-7e2f5b963d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e6ccaca3e204cbf85a6290475fb2608, user_id=67d67a898b0046fbaa0836b6ef66b83f, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:49.392960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a477faf-9bd7-4c64-8079-7e2f5b963d52 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:49.404931 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4258/8563] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:36:49 2022] PUT /identity/v3/projects/1e6ccaca3e204cbf85a6290475fb2608/users/67d67a898b0046fbaa0836b6ef66b83f/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:49.416116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d98000-b6ec-44f6-911b-cc93e28206b6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:49.416414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d98000-b6ec-44f6-911b-cc93e28206b6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:49.416701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d98000-b6ec-44f6-911b-cc93e28206b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:49.445021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-d7d98000-b6ec-44f6-911b-cc93e28206b6 None None] MFA Rules not processed for user `67d67a898b0046fbaa0836b6ef66b83f`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:36:49.446182 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d7d98000-b6ec-44f6-911b-cc93e28206b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:49.516096 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4306/8564] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:36:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:36:49.527215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a477faf-9bd7-4c64-8079-7e2f5b963d52 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:49.529658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9a477faf-9bd7-4c64-8079-7e2f5b963d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:49.589671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a477faf-9bd7-4c64-8079-7e2f5b963d52 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:49.594193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a757008-380f-4465-b544-1af557a98b2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:49.594826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a757008-380f-4465-b544-1af557a98b2a service cinder] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:49.595107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a757008-380f-4465-b544-1af557a98b2a service cinder] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:49.595418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a757008-380f-4465-b544-1af557a98b2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:49.604436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a757008-380f-4465-b544-1af557a98b2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:49.605853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a757008-380f-4465-b544-1af557a98b2a service cinder] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:49.615352 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4259/8565] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:36:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:36:49.657252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d98000-b6ec-44f6-911b-cc93e28206b6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:49.658683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d7d98000-b6ec-44f6-911b-cc93e28206b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:49.673274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d98000-b6ec-44f6-911b-cc93e28206b6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:49.677005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4d65b-be71-4e03-bd54-52834b425b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:49.677617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4d65b-be71-4e03-bd54-52834b425b1e service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:49.677908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4d65b-be71-4e03-bd54-52834b425b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:49.678188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4d65b-be71-4e03-bd54-52834b425b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:49.735951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4d65b-be71-4e03-bd54-52834b425b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:49.737317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4d65b-be71-4e03-bd54-52834b425b1e service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:49.746532 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4307/8566] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:36:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:36:52.705178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a757008-380f-4465-b544-1af557a98b2a service cinder] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:52.770366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a757008-380f-4465-b544-1af557a98b2a service cinder] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:52.775165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b868e4-cc14-4c51-b2bc-7ef9855e5831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:52.775851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b868e4-cc14-4c51-b2bc-7ef9855e5831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:52.776172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b868e4-cc14-4c51-b2bc-7ef9855e5831 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:52.776474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b868e4-cc14-4c51-b2bc-7ef9855e5831 admin admin] PATH_INFO: `/v3/users/d53fe208fe194ef2b59ccbd17ab5c008` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:52.777654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b868e4-cc14-4c51-b2bc-7ef9855e5831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d53fe208fe194ef2b59ccbd17ab5c008)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:52.780139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b868e4-cc14-4c51-b2bc-7ef9855e5831 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:52.829588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a4b868e4-cc14-4c51-b2bc-7ef9855e5831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd53fe208fe194ef2b59ccbd17ab5c008'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:52.830279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a4b868e4-cc14-4c51-b2bc-7ef9855e5831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd53fe208fe194ef2b59ccbd17ab5c008'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:52.843251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a4b868e4-cc14-4c51-b2bc-7ef9855e5831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd53fe208fe194ef2b59ccbd17ab5c008'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:52.843942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a4b868e4-cc14-4c51-b2bc-7ef9855e5831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd53fe208fe194ef2b59ccbd17ab5c008'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:52.852390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a4b868e4-cc14-4c51-b2bc-7ef9855e5831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd53fe208fe194ef2b59ccbd17ab5c008'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:52.863518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:52.868719 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4260/8567] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:36:52 2022] DELETE /identity/v3/users/d53fe208fe194ef2b59ccbd17ab5c008 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:52.873706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e5339-4ac5-45c1-a8eb-323cfd6d6e6f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:52.874489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e5339-4ac5-45c1-a8eb-323cfd6d6e6f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:52.874620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e5339-4ac5-45c1-a8eb-323cfd6d6e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:52.893938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0b6e5339-4ac5-45c1-a8eb-323cfd6d6e6f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:36:52.895264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0b6e5339-4ac5-45c1-a8eb-323cfd6d6e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:52.940447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:52.960003 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4308/8568] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:36:52.970407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b868e4-cc14-4c51-b2bc-7ef9855e5831 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:52.972306 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a4b868e4-cc14-4c51-b2bc-7ef9855e5831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:53.046921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b868e4-cc14-4c51-b2bc-7ef9855e5831 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:53.051510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2161c-e6fd-4ef7-b90a-65d6c59d98a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:53.052222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2161c-e6fd-4ef7-b90a-65d6c59d98a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:53.052510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2161c-e6fd-4ef7-b90a-65d6c59d98a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:53.052792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2161c-e6fd-4ef7-b90a-65d6c59d98a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:53.063344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2161c-e6fd-4ef7-b90a-65d6c59d98a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:53.064793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2161c-e6fd-4ef7-b90a-65d6c59d98a9 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:53.074644 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4261/8569] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:36:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:36:53.362768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e5339-4ac5-45c1-a8eb-323cfd6d6e6f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:53.365931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0b6e5339-4ac5-45c1-a8eb-323cfd6d6e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:53.404966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e5339-4ac5-45c1-a8eb-323cfd6d6e6f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:53.430929 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf8901-8656-4a33-b427-10eea5ef0d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:53.431667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf8901-8656-4a33-b427-10eea5ef0d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:53.431959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf8901-8656-4a33-b427-10eea5ef0d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:53.432270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf8901-8656-4a33-b427-10eea5ef0d34 admin admin] PATH_INFO: `/v3/projects/79eef4eae66c425fa1988888bc0217ef` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:53.433640 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf8901-8656-4a33-b427-10eea5ef0d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79eef4eae66c425fa1988888bc0217ef)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:53.435772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf8901-8656-4a33-b427-10eea5ef0d34 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:53.493467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-feaf8901-8656-4a33-b427-10eea5ef0d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79eef4eae66c425fa1988888bc0217ef', 'request_id': 'req-feaf8901-8656-4a33-b427-10eea5ef0d34'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:53.500447 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-feaf8901-8656-4a33-b427-10eea5ef0d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79eef4eae66c425fa1988888bc0217ef', 'request_id': 'req-feaf8901-8656-4a33-b427-10eea5ef0d34'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:53.509481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-feaf8901-8656-4a33-b427-10eea5ef0d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79eef4eae66c425fa1988888bc0217ef', 'request_id': 'req-feaf8901-8656-4a33-b427-10eea5ef0d34'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:53.522402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-feaf8901-8656-4a33-b427-10eea5ef0d34 admin admin] The token cache is being invalidate because project 79eef4eae66c425fa1988888bc0217ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:36:53.522828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-feaf8901-8656-4a33-b427-10eea5ef0d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:53.523608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-feaf8901-8656-4a33-b427-10eea5ef0d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:53.525157 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4309/8570] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:36:53 2022] DELETE /identity/v3/projects/79eef4eae66c425fa1988888bc0217ef => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:53.530010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2161c-e6fd-4ef7-b90a-65d6c59d98a9 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:53.540511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2161c-e6fd-4ef7-b90a-65d6c59d98a9 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:53.603962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e51c1a-a790-44da-aa1e-d84cacc395d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:53.604721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e51c1a-a790-44da-aa1e-d84cacc395d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:53.605016 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e51c1a-a790-44da-aa1e-d84cacc395d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:53.605298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e51c1a-a790-44da-aa1e-d84cacc395d5 admin admin] PATH_INFO: `/v3/users/ba65fe2576d4460689afa9d55f4b11f3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:53.606590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e51c1a-a790-44da-aa1e-d84cacc395d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba65fe2576d4460689afa9d55f4b11f3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:53.609362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e51c1a-a790-44da-aa1e-d84cacc395d5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:53.658889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-42e51c1a-a790-44da-aa1e-d84cacc395d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba65fe2576d4460689afa9d55f4b11f3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:53.659552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-42e51c1a-a790-44da-aa1e-d84cacc395d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba65fe2576d4460689afa9d55f4b11f3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:53.672785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-42e51c1a-a790-44da-aa1e-d84cacc395d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba65fe2576d4460689afa9d55f4b11f3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:53.673513 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-42e51c1a-a790-44da-aa1e-d84cacc395d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba65fe2576d4460689afa9d55f4b11f3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:53.681885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-42e51c1a-a790-44da-aa1e-d84cacc395d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba65fe2576d4460689afa9d55f4b11f3'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:53.695339 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4262/8571] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:36:53 2022] DELETE /identity/v3/users/ba65fe2576d4460689afa9d55f4b11f3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:54.012452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf8901-8656-4a33-b427-10eea5ef0d34 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:54.017046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-feaf8901-8656-4a33-b427-10eea5ef0d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:54.034906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf8901-8656-4a33-b427-10eea5ef0d34 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:54.103317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87bcd6-1531-47b2-aeff-d0d146ae386f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:54.104005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87bcd6-1531-47b2-aeff-d0d146ae386f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:54.104285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87bcd6-1531-47b2-aeff-d0d146ae386f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:54.104566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87bcd6-1531-47b2-aeff-d0d146ae386f admin admin] PATH_INFO: `/v3/projects/95d9546b46754d6eba599513082465c3` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:54.106139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87bcd6-1531-47b2-aeff-d0d146ae386f admin admin] RBAC: Authorizing `identity:delete_project(project_id=95d9546b46754d6eba599513082465c3)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:54.109611 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87bcd6-1531-47b2-aeff-d0d146ae386f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:54.164845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cf87bcd6-1531-47b2-aeff-d0d146ae386f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95d9546b46754d6eba599513082465c3', 'request_id': 'req-cf87bcd6-1531-47b2-aeff-d0d146ae386f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:54.171546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cf87bcd6-1531-47b2-aeff-d0d146ae386f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95d9546b46754d6eba599513082465c3', 'request_id': 'req-cf87bcd6-1531-47b2-aeff-d0d146ae386f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:54.179982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cf87bcd6-1531-47b2-aeff-d0d146ae386f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95d9546b46754d6eba599513082465c3', 'request_id': 'req-cf87bcd6-1531-47b2-aeff-d0d146ae386f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:54.188483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:54.192891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cf87bcd6-1531-47b2-aeff-d0d146ae386f admin admin] The token cache is being invalidate because project 95d9546b46754d6eba599513082465c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:36:54.193433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cf87bcd6-1531-47b2-aeff-d0d146ae386f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:54.194677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cf87bcd6-1531-47b2-aeff-d0d146ae386f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:54.198240 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4310/8572] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:36:54 2022] DELETE /identity/v3/projects/95d9546b46754d6eba599513082465c3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:54.201777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e51c1a-a790-44da-aa1e-d84cacc395d5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:54.203688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-42e51c1a-a790-44da-aa1e-d84cacc395d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:54.218087 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e51c1a-a790-44da-aa1e-d84cacc395d5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:54.236780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:54.278729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dc5ab-391a-4bb3-bc83-688b75442b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:54.279392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dc5ab-391a-4bb3-bc83-688b75442b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:54.279676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dc5ab-391a-4bb3-bc83-688b75442b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:54.279953 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dc5ab-391a-4bb3-bc83-688b75442b84 admin admin] PATH_INFO: `/v3/users/67d67a898b0046fbaa0836b6ef66b83f` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:54.281111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675dc5ab-391a-4bb3-bc83-688b75442b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d67a898b0046fbaa0836b6ef66b83f)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:54.283010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675dc5ab-391a-4bb3-bc83-688b75442b84 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:54.329194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-675dc5ab-391a-4bb3-bc83-688b75442b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d67a898b0046fbaa0836b6ef66b83f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:54.329853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-675dc5ab-391a-4bb3-bc83-688b75442b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d67a898b0046fbaa0836b6ef66b83f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:54.342446 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-675dc5ab-391a-4bb3-bc83-688b75442b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d67a898b0046fbaa0836b6ef66b83f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:54.343104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-675dc5ab-391a-4bb3-bc83-688b75442b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d67a898b0046fbaa0836b6ef66b83f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:54.349753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-675dc5ab-391a-4bb3-bc83-688b75442b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d67a898b0046fbaa0836b6ef66b83f'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:54.362199 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4263/8573] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:36:54 2022] DELETE /identity/v3/users/67d67a898b0046fbaa0836b6ef66b83f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:36:54.640397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87bcd6-1531-47b2-aeff-d0d146ae386f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:36:54.642323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cf87bcd6-1531-47b2-aeff-d0d146ae386f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:36:54.655722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87bcd6-1531-47b2-aeff-d0d146ae386f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:36:54.717670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95a49b-2736-4245-a2dc-a88de9784f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:36:54.718356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95a49b-2736-4245-a2dc-a88de9784f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:36:54.718648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95a49b-2736-4245-a2dc-a88de9784f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:36:54.719004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95a49b-2736-4245-a2dc-a88de9784f7f admin admin] PATH_INFO: `/v3/projects/1e6ccaca3e204cbf85a6290475fb2608` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:36:54.720275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95a49b-2736-4245-a2dc-a88de9784f7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e6ccaca3e204cbf85a6290475fb2608)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:36:54.722255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95a49b-2736-4245-a2dc-a88de9784f7f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:36:54.772916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d95a49b-2736-4245-a2dc-a88de9784f7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e6ccaca3e204cbf85a6290475fb2608', 'request_id': 'req-1d95a49b-2736-4245-a2dc-a88de9784f7f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:54.779461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d95a49b-2736-4245-a2dc-a88de9784f7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e6ccaca3e204cbf85a6290475fb2608', 'request_id': 'req-1d95a49b-2736-4245-a2dc-a88de9784f7f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:54.787201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d95a49b-2736-4245-a2dc-a88de9784f7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e6ccaca3e204cbf85a6290475fb2608', 'request_id': 'req-1d95a49b-2736-4245-a2dc-a88de9784f7f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:54.798376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d95a49b-2736-4245-a2dc-a88de9784f7f admin admin] The token cache is being invalidate because project 1e6ccaca3e204cbf85a6290475fb2608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:36:54.798668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d95a49b-2736-4245-a2dc-a88de9784f7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:54.799343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1d95a49b-2736-4245-a2dc-a88de9784f7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:36:54.800871 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4311/8574] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:36:54 2022] DELETE /identity/v3/projects/1e6ccaca3e204cbf85a6290475fb2608 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:37:04.358735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:04.795190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:17.564960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dc5ab-391a-4bb3-bc83-688b75442b84 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:17.567058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-675dc5ab-391a-4bb3-bc83-688b75442b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:17.586836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dc5ab-391a-4bb3-bc83-688b75442b84 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:17.664120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736049c-d3b0-433a-a380-5f51aff4e46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:17.665559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736049c-d3b0-433a-a380-5f51aff4e46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:17.665853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736049c-d3b0-433a-a380-5f51aff4e46c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:17.666124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736049c-d3b0-433a-a380-5f51aff4e46c admin admin] PATH_INFO: `/v3/users/9f113fc80feb42148c3dad0c33417dfe` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:17.667367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736049c-d3b0-433a-a380-5f51aff4e46c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f113fc80feb42148c3dad0c33417dfe)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:17.669564 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736049c-d3b0-433a-a380-5f51aff4e46c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:17.724499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6736049c-d3b0-433a-a380-5f51aff4e46c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f113fc80feb42148c3dad0c33417dfe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:17.725348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6736049c-d3b0-433a-a380-5f51aff4e46c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f113fc80feb42148c3dad0c33417dfe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:17.743906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6736049c-d3b0-433a-a380-5f51aff4e46c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f113fc80feb42148c3dad0c33417dfe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:17.744660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6736049c-d3b0-433a-a380-5f51aff4e46c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f113fc80feb42148c3dad0c33417dfe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:17.754982 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6736049c-d3b0-433a-a380-5f51aff4e46c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f113fc80feb42148c3dad0c33417dfe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:17.772801 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4264/8575] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:37:17 2022] DELETE /identity/v3/users/9f113fc80feb42148c3dad0c33417dfe => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:37:17.777524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d10048-9630-475f-9b89-f7f33541cb7b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:17.778107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d10048-9630-475f-9b89-f7f33541cb7b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:17.778296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d10048-9630-475f-9b89-f7f33541cb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:17.799309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-47d10048-9630-475f-9b89-f7f33541cb7b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:37:17.800475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-47d10048-9630-475f-9b89-f7f33541cb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:17.868299 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4312/8576] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:37:17.878529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736049c-d3b0-433a-a380-5f51aff4e46c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:17.879974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6736049c-d3b0-433a-a380-5f51aff4e46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:17.950885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736049c-d3b0-433a-a380-5f51aff4e46c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:17.957090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80380b6-3af5-48e0-9bb2-86782d810175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:17.957722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80380b6-3af5-48e0-9bb2-86782d810175 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:17.958002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80380b6-3af5-48e0-9bb2-86782d810175 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:17.958278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80380b6-3af5-48e0-9bb2-86782d810175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:17.968630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80380b6-3af5-48e0-9bb2-86782d810175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:17.970367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80380b6-3af5-48e0-9bb2-86782d810175 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:17.980536 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4265/8577] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:37:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:37:18.172741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d10048-9630-475f-9b89-f7f33541cb7b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:18.174982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-47d10048-9630-475f-9b89-f7f33541cb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:18.192606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d10048-9630-475f-9b89-f7f33541cb7b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:18.197414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575222d-8425-45b7-b0d0-4710e30a2caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:18.198069 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575222d-8425-45b7-b0d0-4710e30a2caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:18.198490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575222d-8425-45b7-b0d0-4710e30a2caa admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:18.198782 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575222d-8425-45b7-b0d0-4710e30a2caa admin admin] PATH_INFO: `/v3/projects/4a16baf2cd6043c79dbe21fafc13eb28` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:18.200666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575222d-8425-45b7-b0d0-4710e30a2caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a16baf2cd6043c79dbe21fafc13eb28)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:18.202615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575222d-8425-45b7-b0d0-4710e30a2caa admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:18.255558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7575222d-8425-45b7-b0d0-4710e30a2caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a16baf2cd6043c79dbe21fafc13eb28', 'request_id': 'req-7575222d-8425-45b7-b0d0-4710e30a2caa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:18.261856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7575222d-8425-45b7-b0d0-4710e30a2caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a16baf2cd6043c79dbe21fafc13eb28', 'request_id': 'req-7575222d-8425-45b7-b0d0-4710e30a2caa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:18.271000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7575222d-8425-45b7-b0d0-4710e30a2caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a16baf2cd6043c79dbe21fafc13eb28', 'request_id': 'req-7575222d-8425-45b7-b0d0-4710e30a2caa'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:18.282548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7575222d-8425-45b7-b0d0-4710e30a2caa admin admin] The token cache is being invalidate because project 4a16baf2cd6043c79dbe21fafc13eb28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:37:18.282835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7575222d-8425-45b7-b0d0-4710e30a2caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:18.283521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7575222d-8425-45b7-b0d0-4710e30a2caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:18.285053 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4313/8578] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:37:18 2022] DELETE /identity/v3/projects/4a16baf2cd6043c79dbe21fafc13eb28 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:37:18.289117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80380b6-3af5-48e0-9bb2-86782d810175 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:18.302258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80380b6-3af5-48e0-9bb2-86782d810175 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:18.322681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:18.364269 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9795fd-67ff-4f63-87d4-8c12ff358b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:18.364949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9795fd-67ff-4f63-87d4-8c12ff358b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:18.365237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9795fd-67ff-4f63-87d4-8c12ff358b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:18.365518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9795fd-67ff-4f63-87d4-8c12ff358b25 admin admin] PATH_INFO: `/v3/users/1fa0bf58ed064372805f230f0b35e42b` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:18.366691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9795fd-67ff-4f63-87d4-8c12ff358b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa0bf58ed064372805f230f0b35e42b)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:18.368683 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9795fd-67ff-4f63-87d4-8c12ff358b25 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:18.413637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6d9795fd-67ff-4f63-87d4-8c12ff358b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa0bf58ed064372805f230f0b35e42b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:18.414341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6d9795fd-67ff-4f63-87d4-8c12ff358b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa0bf58ed064372805f230f0b35e42b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:18.426453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6d9795fd-67ff-4f63-87d4-8c12ff358b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa0bf58ed064372805f230f0b35e42b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:18.427105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6d9795fd-67ff-4f63-87d4-8c12ff358b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa0bf58ed064372805f230f0b35e42b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:18.434737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-6d9795fd-67ff-4f63-87d4-8c12ff358b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa0bf58ed064372805f230f0b35e42b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:18.451165 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4266/8579] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:37:18 2022] DELETE /identity/v3/users/1fa0bf58ed064372805f230f0b35e42b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:37:18.623803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575222d-8425-45b7-b0d0-4710e30a2caa admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:18.626758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7575222d-8425-45b7-b0d0-4710e30a2caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:18.648909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575222d-8425-45b7-b0d0-4710e30a2caa admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:18.718888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5f734-1c65-4697-bb87-6ba77891440c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:18.719586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5f734-1c65-4697-bb87-6ba77891440c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:18.719878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5f734-1c65-4697-bb87-6ba77891440c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:18.720174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5f734-1c65-4697-bb87-6ba77891440c admin admin] PATH_INFO: `/v3/projects/152c660df7e349ad86665647d6b3bbcd` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:18.721334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5f734-1c65-4697-bb87-6ba77891440c admin admin] RBAC: Authorizing `identity:delete_project(project_id=152c660df7e349ad86665647d6b3bbcd)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:18.723248 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5f734-1c65-4697-bb87-6ba77891440c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:18.760873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:18.780708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9da5f734-1c65-4697-bb87-6ba77891440c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '152c660df7e349ad86665647d6b3bbcd', 'request_id': 'req-9da5f734-1c65-4697-bb87-6ba77891440c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:18.787251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9da5f734-1c65-4697-bb87-6ba77891440c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '152c660df7e349ad86665647d6b3bbcd', 'request_id': 'req-9da5f734-1c65-4697-bb87-6ba77891440c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:18.797429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9da5f734-1c65-4697-bb87-6ba77891440c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '152c660df7e349ad86665647d6b3bbcd', 'request_id': 'req-9da5f734-1c65-4697-bb87-6ba77891440c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:18.808696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9da5f734-1c65-4697-bb87-6ba77891440c admin admin] The token cache is being invalidate because project 152c660df7e349ad86665647d6b3bbcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:37:18.808992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9da5f734-1c65-4697-bb87-6ba77891440c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:18.810245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9da5f734-1c65-4697-bb87-6ba77891440c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:18.811937 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4314/8580] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:37:18 2022] DELETE /identity/v3/projects/152c660df7e349ad86665647d6b3bbcd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:37:18.817106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635c6d7-fd7d-43fa-8776-857664c95c18 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:18.817574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635c6d7-fd7d-43fa-8776-857664c95c18 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:18.817700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635c6d7-fd7d-43fa-8776-857664c95c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:18.837976 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e635c6d7-fd7d-43fa-8776-857664c95c18 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:37:18.839174 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e635c6d7-fd7d-43fa-8776-857664c95c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:18.905012 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4267/8581] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:37:18.913462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832721bd-3b8e-4018-83c6-bcb3725d2aca None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:18.913756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832721bd-3b8e-4018-83c6-bcb3725d2aca None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:18.914042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832721bd-3b8e-4018-83c6-bcb3725d2aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:18.936660 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-832721bd-3b8e-4018-83c6-bcb3725d2aca None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:37:18.938174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-832721bd-3b8e-4018-83c6-bcb3725d2aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:18.946361 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4315/8582] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:37:18.950700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635c6d7-fd7d-43fa-8776-857664c95c18 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:18.961399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635c6d7-fd7d-43fa-8776-857664c95c18 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:18.966950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe8332-f52f-408c-9aaa-ce5e5696ed68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:18.967612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe8332-f52f-408c-9aaa-ce5e5696ed68 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:18.967905 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe8332-f52f-408c-9aaa-ce5e5696ed68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:18.968187 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe8332-f52f-408c-9aaa-ce5e5696ed68 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:18.968888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe8332-f52f-408c-9aaa-ce5e5696ed68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:37:18.969198 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe8332-f52f-408c-9aaa-ce5e5696ed68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:18.970818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe8332-f52f-408c-9aaa-ce5e5696ed68 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:18.986720 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4268/8583] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:37:18.988097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832721bd-3b8e-4018-83c6-bcb3725d2aca None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:18.998866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832721bd-3b8e-4018-83c6-bcb3725d2aca None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:19.004328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d2e02-ed8a-4321-9038-05ffc88588d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:19.004966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d2e02-ed8a-4321-9038-05ffc88588d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:19.005252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d2e02-ed8a-4321-9038-05ffc88588d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:19.005530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d2e02-ed8a-4321-9038-05ffc88588d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:19.006207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d2e02-ed8a-4321-9038-05ffc88588d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:19.008154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d2e02-ed8a-4321-9038-05ffc88588d1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:19.036807 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4316/8584] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:37:18 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:37:19.040665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe8332-f52f-408c-9aaa-ce5e5696ed68 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:19.051783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe8332-f52f-408c-9aaa-ce5e5696ed68 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:19.080722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:19.114021 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a02309-2dce-407d-a9c3-ef23ac7bc556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:19.114650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a02309-2dce-407d-a9c3-ef23ac7bc556 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:19.114937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a02309-2dce-407d-a9c3-ef23ac7bc556 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:19.115219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a02309-2dce-407d-a9c3-ef23ac7bc556 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:19.115930 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a02309-2dce-407d-a9c3-ef23ac7bc556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:19.117847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a02309-2dce-407d-a9c3-ef23ac7bc556 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:19.140539 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4269/8585] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:37:19 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:37:19.144608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d2e02-ed8a-4321-9038-05ffc88588d1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:19.155629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d2e02-ed8a-4321-9038-05ffc88588d1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:19.160329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113f6e0-e724-4dd7-bd43-c29e27457440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:19.160948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113f6e0-e724-4dd7-bd43-c29e27457440 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:19.161239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113f6e0-e724-4dd7-bd43-c29e27457440 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:19.161527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113f6e0-e724-4dd7-bd43-c29e27457440 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:19.162225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113f6e0-e724-4dd7-bd43-c29e27457440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:19.163866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113f6e0-e724-4dd7-bd43-c29e27457440 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:19.176346 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4317/8586] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:37:19.180559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a02309-2dce-407d-a9c3-ef23ac7bc556 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:19.191548 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a02309-2dce-407d-a9c3-ef23ac7bc556 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:19.196346 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf010c3-07d8-480c-951e-0b1ef27db4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:19.196970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf010c3-07d8-480c-951e-0b1ef27db4fb admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:19.197260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf010c3-07d8-480c-951e-0b1ef27db4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:19.197583 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf010c3-07d8-480c-951e-0b1ef27db4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:19.198236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf010c3-07d8-480c-951e-0b1ef27db4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:19.199937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf010c3-07d8-480c-951e-0b1ef27db4fb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:19.212287 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4270/8587] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:37:19.216009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113f6e0-e724-4dd7-bd43-c29e27457440 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:19.226324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113f6e0-e724-4dd7-bd43-c29e27457440 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:19.232262 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815807b3-575d-47ca-a7e5-be4453abcd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:19.232945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815807b3-575d-47ca-a7e5-be4453abcd81 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:19.233234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815807b3-575d-47ca-a7e5-be4453abcd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:19.233525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815807b3-575d-47ca-a7e5-be4453abcd81 admin admin] PATH_INFO: `/v3/projects/c71987fd348840d4b720569334345669/users/05fc0e62b2504ac28f4a3821873ebb5a/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:19.249920 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815807b3-575d-47ca-a7e5-be4453abcd81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c71987fd348840d4b720569334345669, user_id=05fc0e62b2504ac28f4a3821873ebb5a, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:19.252646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815807b3-575d-47ca-a7e5-be4453abcd81 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:19.266887 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4318/8588] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:37:19 2022] PUT /identity/v3/projects/c71987fd348840d4b720569334345669/users/05fc0e62b2504ac28f4a3821873ebb5a/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:37:19.279492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb670611-3cd0-4806-99b5-11032519509d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:19.279790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb670611-3cd0-4806-99b5-11032519509d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:19.280074 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb670611-3cd0-4806-99b5-11032519509d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:19.308617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-bb670611-3cd0-4806-99b5-11032519509d None None] MFA Rules not processed for user `05fc0e62b2504ac28f4a3821873ebb5a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:37:19.309864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bb670611-3cd0-4806-99b5-11032519509d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:19.379212 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4271/8589] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:37:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:37:19.384147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815807b3-575d-47ca-a7e5-be4453abcd81 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:19.450523 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815807b3-575d-47ca-a7e5-be4453abcd81 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:19.455214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50837f6-39c8-480e-a878-c04f6bbf6327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:19.455893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50837f6-39c8-480e-a878-c04f6bbf6327 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:19.456181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50837f6-39c8-480e-a878-c04f6bbf6327 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:19.456460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50837f6-39c8-480e-a878-c04f6bbf6327 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:19.457167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50837f6-39c8-480e-a878-c04f6bbf6327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:19.459076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50837f6-39c8-480e-a878-c04f6bbf6327 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:19.494399 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4319/8590] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:37:19 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:37:19.496602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb670611-3cd0-4806-99b5-11032519509d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:19.514506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb670611-3cd0-4806-99b5-11032519509d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:19.590459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022f72a-35ea-4d51-ba37-6d93b9754a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:19.591477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022f72a-35ea-4d51-ba37-6d93b9754a8f admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:19.591765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022f72a-35ea-4d51-ba37-6d93b9754a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:19.592042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022f72a-35ea-4d51-ba37-6d93b9754a8f admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:19.592713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022f72a-35ea-4d51-ba37-6d93b9754a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:19.594633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022f72a-35ea-4d51-ba37-6d93b9754a8f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:19.616497 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4272/8591] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:37:19 2022] POST /identity/v3/users => generated 301 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:37:19.620446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50837f6-39c8-480e-a878-c04f6bbf6327 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:19.639737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50837f6-39c8-480e-a878-c04f6bbf6327 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:19.647124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74231e13-6eda-481c-80f8-3d11c551c0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:19.647806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74231e13-6eda-481c-80f8-3d11c551c0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:19.648095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74231e13-6eda-481c-80f8-3d11c551c0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:19.648374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74231e13-6eda-481c-80f8-3d11c551c0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:19.649108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74231e13-6eda-481c-80f8-3d11c551c0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:19.650763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74231e13-6eda-481c-80f8-3d11c551c0f2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:19.662890 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4320/8592] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:37:19.667256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022f72a-35ea-4d51-ba37-6d93b9754a8f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:19.678419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022f72a-35ea-4d51-ba37-6d93b9754a8f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:19.683415 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d3c78-9c57-4dbe-8b70-a42e903715fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:19.684160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d3c78-9c57-4dbe-8b70-a42e903715fa admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:19.684378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d3c78-9c57-4dbe-8b70-a42e903715fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:19.684660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d3c78-9c57-4dbe-8b70-a42e903715fa admin admin] PATH_INFO: `/v3/projects/89572f4714b84c4a9fb76a429671fe45/users/849a2eec937c470cbc1a87deb887e2a1/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:19.700060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d3c78-9c57-4dbe-8b70-a42e903715fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=89572f4714b84c4a9fb76a429671fe45, user_id=849a2eec937c470cbc1a87deb887e2a1, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:19.702723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d3c78-9c57-4dbe-8b70-a42e903715fa admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:19.715970 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4273/8593] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:37:19 2022] PUT /identity/v3/projects/89572f4714b84c4a9fb76a429671fe45/users/849a2eec937c470cbc1a87deb887e2a1/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:37:19.726366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42003cc5-a206-4980-80e9-d4a24d2e9585 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:19.726658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42003cc5-a206-4980-80e9-d4a24d2e9585 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:19.726938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42003cc5-a206-4980-80e9-d4a24d2e9585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:19.755463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-42003cc5-a206-4980-80e9-d4a24d2e9585 None None] MFA Rules not processed for user `849a2eec937c470cbc1a87deb887e2a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:37:19.756620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-42003cc5-a206-4980-80e9-d4a24d2e9585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:19.769073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:19.825347 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4321/8594] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:37:19 2022] POST /identity/v3/auth/tokens => generated 3261 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:37:19.855063 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d3c78-9c57-4dbe-8b70-a42e903715fa admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:19.857646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-366d3c78-9c57-4dbe-8b70-a42e903715fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:19.863029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:19.960474 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d3c78-9c57-4dbe-8b70-a42e903715fa admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:19.966808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006c661-57d7-4b2c-9ea8-cdd9dbf029d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:19.968175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006c661-57d7-4b2c-9ea8-cdd9dbf029d2 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:19.968175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006c661-57d7-4b2c-9ea8-cdd9dbf029d2 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:19.968175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006c661-57d7-4b2c-9ea8-cdd9dbf029d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:19.982339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006c661-57d7-4b2c-9ea8-cdd9dbf029d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:19.985185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006c661-57d7-4b2c-9ea8-cdd9dbf029d2 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:19.996177 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4274/8595] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:37:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:37:20.646120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42003cc5-a206-4980-80e9-d4a24d2e9585 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:20.724722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42003cc5-a206-4980-80e9-d4a24d2e9585 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:20.729524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1a32b-ea60-4dfa-89d4-f61ba09eaddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:20.730175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1a32b-ea60-4dfa-89d4-f61ba09eaddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:20.730463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1a32b-ea60-4dfa-89d4-f61ba09eaddc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:20.730742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1a32b-ea60-4dfa-89d4-f61ba09eaddc admin admin] PATH_INFO: `/v3/users/05fc0e62b2504ac28f4a3821873ebb5a` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:20.732045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1a32b-ea60-4dfa-89d4-f61ba09eaddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=05fc0e62b2504ac28f4a3821873ebb5a)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:20.734005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1a32b-ea60-4dfa-89d4-f61ba09eaddc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:20.792675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-66e1a32b-ea60-4dfa-89d4-f61ba09eaddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05fc0e62b2504ac28f4a3821873ebb5a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:20.811846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-66e1a32b-ea60-4dfa-89d4-f61ba09eaddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05fc0e62b2504ac28f4a3821873ebb5a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:20.813125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-66e1a32b-ea60-4dfa-89d4-f61ba09eaddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05fc0e62b2504ac28f4a3821873ebb5a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:20.822380 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-66e1a32b-ea60-4dfa-89d4-f61ba09eaddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05fc0e62b2504ac28f4a3821873ebb5a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:20.823379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-66e1a32b-ea60-4dfa-89d4-f61ba09eaddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05fc0e62b2504ac28f4a3821873ebb5a'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:20.842972 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4322/8596] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:37:20 2022] DELETE /identity/v3/users/05fc0e62b2504ac28f4a3821873ebb5a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:37:20.844857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434dbbe-8291-4df3-bf44-dc2579171c1b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:20.845966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434dbbe-8291-4df3-bf44-dc2579171c1b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:20.845966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434dbbe-8291-4df3-bf44-dc2579171c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:20.868239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d434dbbe-8291-4df3-bf44-dc2579171c1b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:37:20.871148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d434dbbe-8291-4df3-bf44-dc2579171c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:20.951518 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4275/8597] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:37:20.962905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1a32b-ea60-4dfa-89d4-f61ba09eaddc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:20.964621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-66e1a32b-ea60-4dfa-89d4-f61ba09eaddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:21.049443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:21.089373 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1a32b-ea60-4dfa-89d4-f61ba09eaddc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:21.093476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd64a43-aa66-4689-b6f8-e5773a74ab00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:21.094115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd64a43-aa66-4689-b6f8-e5773a74ab00 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:21.094400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd64a43-aa66-4689-b6f8-e5773a74ab00 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:21.094683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd64a43-aa66-4689-b6f8-e5773a74ab00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:21.105480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd64a43-aa66-4689-b6f8-e5773a74ab00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:21.107783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd64a43-aa66-4689-b6f8-e5773a74ab00 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:21.119067 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4323/8598] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:37:21.473987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434dbbe-8291-4df3-bf44-dc2579171c1b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:21.475742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d434dbbe-8291-4df3-bf44-dc2579171c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:21.491629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434dbbe-8291-4df3-bf44-dc2579171c1b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:21.497963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c82b9d-2c8c-4e99-9779-741a0b35ce24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:21.499796 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c82b9d-2c8c-4e99-9779-741a0b35ce24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:21.500370 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c82b9d-2c8c-4e99-9779-741a0b35ce24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:21.500763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c82b9d-2c8c-4e99-9779-741a0b35ce24 admin admin] PATH_INFO: `/v3/projects/c71987fd348840d4b720569334345669` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:21.502670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c82b9d-2c8c-4e99-9779-741a0b35ce24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c71987fd348840d4b720569334345669)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:21.506825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c82b9d-2c8c-4e99-9779-741a0b35ce24 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:21.558254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75c82b9d-2c8c-4e99-9779-741a0b35ce24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c71987fd348840d4b720569334345669', 'request_id': 'req-75c82b9d-2c8c-4e99-9779-741a0b35ce24'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:21.567142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75c82b9d-2c8c-4e99-9779-741a0b35ce24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c71987fd348840d4b720569334345669', 'request_id': 'req-75c82b9d-2c8c-4e99-9779-741a0b35ce24'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:21.573465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75c82b9d-2c8c-4e99-9779-741a0b35ce24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c71987fd348840d4b720569334345669', 'request_id': 'req-75c82b9d-2c8c-4e99-9779-741a0b35ce24'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:21.585242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75c82b9d-2c8c-4e99-9779-741a0b35ce24 admin admin] The token cache is being invalidate because project c71987fd348840d4b720569334345669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:37:21.585539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75c82b9d-2c8c-4e99-9779-741a0b35ce24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:21.586195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-75c82b9d-2c8c-4e99-9779-741a0b35ce24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:21.587977 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4276/8599] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:37:21 2022] DELETE /identity/v3/projects/c71987fd348840d4b720569334345669 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:37:21.592259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd64a43-aa66-4689-b6f8-e5773a74ab00 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:21.602200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd64a43-aa66-4689-b6f8-e5773a74ab00 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:21.661479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21f5c7-6352-43e6-aa37-b830c54fd75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:21.662135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21f5c7-6352-43e6-aa37-b830c54fd75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:21.662949 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21f5c7-6352-43e6-aa37-b830c54fd75a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:21.663238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21f5c7-6352-43e6-aa37-b830c54fd75a admin admin] PATH_INFO: `/v3/users/849a2eec937c470cbc1a87deb887e2a1` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:21.665103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21f5c7-6352-43e6-aa37-b830c54fd75a admin admin] RBAC: Authorizing `identity:delete_user(user_id=849a2eec937c470cbc1a87deb887e2a1)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:21.667200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21f5c7-6352-43e6-aa37-b830c54fd75a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:21.717596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3c21f5c7-6352-43e6-aa37-b830c54fd75a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '849a2eec937c470cbc1a87deb887e2a1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:21.729494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3c21f5c7-6352-43e6-aa37-b830c54fd75a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '849a2eec937c470cbc1a87deb887e2a1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:21.730192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3c21f5c7-6352-43e6-aa37-b830c54fd75a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '849a2eec937c470cbc1a87deb887e2a1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:21.737973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3c21f5c7-6352-43e6-aa37-b830c54fd75a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '849a2eec937c470cbc1a87deb887e2a1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:21.738663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-3c21f5c7-6352-43e6-aa37-b830c54fd75a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '849a2eec937c470cbc1a87deb887e2a1'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:21.753547 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4324/8600] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:37:21 2022] DELETE /identity/v3/users/849a2eec937c470cbc1a87deb887e2a1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:37:22.182810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c82b9d-2c8c-4e99-9779-741a0b35ce24 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:22.184308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-75c82b9d-2c8c-4e99-9779-741a0b35ce24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:22.198282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c82b9d-2c8c-4e99-9779-741a0b35ce24 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:22.202364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:22.306714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214c8d5-a347-4150-93de-56336efd692d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:22.307521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214c8d5-a347-4150-93de-56336efd692d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:22.307896 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214c8d5-a347-4150-93de-56336efd692d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:22.308320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214c8d5-a347-4150-93de-56336efd692d admin admin] PATH_INFO: `/v3/projects/89572f4714b84c4a9fb76a429671fe45` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:22.309770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214c8d5-a347-4150-93de-56336efd692d admin admin] RBAC: Authorizing `identity:delete_project(project_id=89572f4714b84c4a9fb76a429671fe45)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:22.312128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214c8d5-a347-4150-93de-56336efd692d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:22.374817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c214c8d5-a347-4150-93de-56336efd692d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89572f4714b84c4a9fb76a429671fe45', 'request_id': 'req-c214c8d5-a347-4150-93de-56336efd692d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:22.387980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c214c8d5-a347-4150-93de-56336efd692d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89572f4714b84c4a9fb76a429671fe45', 'request_id': 'req-c214c8d5-a347-4150-93de-56336efd692d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:22.398157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c214c8d5-a347-4150-93de-56336efd692d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89572f4714b84c4a9fb76a429671fe45', 'request_id': 'req-c214c8d5-a347-4150-93de-56336efd692d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:22.419653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c214c8d5-a347-4150-93de-56336efd692d admin admin] The token cache is being invalidate because project 89572f4714b84c4a9fb76a429671fe45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:37:22.420133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c214c8d5-a347-4150-93de-56336efd692d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:22.421036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c214c8d5-a347-4150-93de-56336efd692d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:22.422928 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4277/8601] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:37:22 2022] DELETE /identity/v3/projects/89572f4714b84c4a9fb76a429671fe45 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:37:22.428577 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbe678-3a11-4020-b722-187f47052380 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:22.429062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbe678-3a11-4020-b722-187f47052380 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:22.429163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbe678-3a11-4020-b722-187f47052380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:22.454637 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-bfdbe678-3a11-4020-b722-187f47052380 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:37:22.456394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bfdbe678-3a11-4020-b722-187f47052380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:22.528727 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:22.549110 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4325/8602] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:37:22.556844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84e615-9c38-4e6b-9904-0cafa5d96000 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:22.557139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84e615-9c38-4e6b-9904-0cafa5d96000 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:22.557423 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84e615-9c38-4e6b-9904-0cafa5d96000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:22.587614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9f84e615-9c38-4e6b-9904-0cafa5d96000 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:37:22.589122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9f84e615-9c38-4e6b-9904-0cafa5d96000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:22.598181 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4278/8603] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:37:22.602266 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbe678-3a11-4020-b722-187f47052380 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:22.622846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbe678-3a11-4020-b722-187f47052380 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:22.627832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b518c8-de78-43ec-915f-763c487bddb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:22.628451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b518c8-de78-43ec-915f-763c487bddb9 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:22.628731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b518c8-de78-43ec-915f-763c487bddb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:22.629011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b518c8-de78-43ec-915f-763c487bddb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:22.629703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b518c8-de78-43ec-915f-763c487bddb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:37:22.630015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b518c8-de78-43ec-915f-763c487bddb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:22.631634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b518c8-de78-43ec-915f-763c487bddb9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:22.644236 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4326/8604] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:37:22.648914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84e615-9c38-4e6b-9904-0cafa5d96000 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:22.659348 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84e615-9c38-4e6b-9904-0cafa5d96000 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:22.663626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5987e8-c240-479e-b658-9e88c4deea52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:22.664241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5987e8-c240-479e-b658-9e88c4deea52 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:22.664524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5987e8-c240-479e-b658-9e88c4deea52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:22.664805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5987e8-c240-479e-b658-9e88c4deea52 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:22.665466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5987e8-c240-479e-b658-9e88c4deea52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:22.667439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5987e8-c240-479e-b658-9e88c4deea52 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:22.703477 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4279/8605] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:37:22 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:37:22.705032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b518c8-de78-43ec-915f-763c487bddb9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:22.715723 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b518c8-de78-43ec-915f-763c487bddb9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:22.776629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec26005-ecbd-4887-8d31-fe1ad341eca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:22.777261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec26005-ecbd-4887-8d31-fe1ad341eca8 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:22.777657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec26005-ecbd-4887-8d31-fe1ad341eca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:22.778722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec26005-ecbd-4887-8d31-fe1ad341eca8 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:22.779513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec26005-ecbd-4887-8d31-fe1ad341eca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:22.781409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec26005-ecbd-4887-8d31-fe1ad341eca8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:22.806101 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4327/8606] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:37:22 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:37:22.807390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5987e8-c240-479e-b658-9e88c4deea52 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:22.817841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5987e8-c240-479e-b658-9e88c4deea52 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:22.822464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5373f-25e9-4d4a-9df9-f3f1611bd0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:22.823076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5373f-25e9-4d4a-9df9-f3f1611bd0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:22.823399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5373f-25e9-4d4a-9df9-f3f1611bd0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:22.823679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5373f-25e9-4d4a-9df9-f3f1611bd0a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:22.824371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5373f-25e9-4d4a-9df9-f3f1611bd0a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:22.826000 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5373f-25e9-4d4a-9df9-f3f1611bd0a4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:22.839693 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4280/8607] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:37:22.842175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec26005-ecbd-4887-8d31-fe1ad341eca8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:22.852778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec26005-ecbd-4887-8d31-fe1ad341eca8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:22.858204 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ec433-07cf-4e32-9871-727bc9465a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:22.858818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ec433-07cf-4e32-9871-727bc9465a76 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:22.859101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ec433-07cf-4e32-9871-727bc9465a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:22.859521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ec433-07cf-4e32-9871-727bc9465a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:22.860219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ec433-07cf-4e32-9871-727bc9465a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:22.861845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ec433-07cf-4e32-9871-727bc9465a76 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:22.876973 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4328/8608] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:37:22.877785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5373f-25e9-4d4a-9df9-f3f1611bd0a4 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:22.888512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5373f-25e9-4d4a-9df9-f3f1611bd0a4 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:22.893182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069ad2b-48d6-4c47-89b9-ed2abffa3cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:22.893841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069ad2b-48d6-4c47-89b9-ed2abffa3cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:22.894124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069ad2b-48d6-4c47-89b9-ed2abffa3cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:22.894400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069ad2b-48d6-4c47-89b9-ed2abffa3cf9 admin admin] PATH_INFO: `/v3/projects/cc59858bd4e749cab7d1d772d65e4111/users/e062653d52144a3a91277e045033f27a/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:22.908956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069ad2b-48d6-4c47-89b9-ed2abffa3cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc59858bd4e749cab7d1d772d65e4111, user_id=e062653d52144a3a91277e045033f27a, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:22.911643 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069ad2b-48d6-4c47-89b9-ed2abffa3cf9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:22.925837 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4281/8609] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:37:22 2022] PUT /identity/v3/projects/cc59858bd4e749cab7d1d772d65e4111/users/e062653d52144a3a91277e045033f27a/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:37:22.931004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f340d-5048-4f59-9162-756494a7492c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:22.931454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f340d-5048-4f59-9162-756494a7492c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:22.931810 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f340d-5048-4f59-9162-756494a7492c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:22.953298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-678f340d-5048-4f59-9162-756494a7492c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:37:22.954901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-678f340d-5048-4f59-9162-756494a7492c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:23.020784 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4329/8610] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:37:23.030745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069ad2b-48d6-4c47-89b9-ed2abffa3cf9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:23.032538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6069ad2b-48d6-4c47-89b9-ed2abffa3cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:23.069138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:23.097404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069ad2b-48d6-4c47-89b9-ed2abffa3cf9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:23.101218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1ab92-eae6-498a-ab83-88cf4942dac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:23.101883 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1ab92-eae6-498a-ab83-88cf4942dac4 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:23.102170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1ab92-eae6-498a-ab83-88cf4942dac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:23.102599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1ab92-eae6-498a-ab83-88cf4942dac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:23.113196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1ab92-eae6-498a-ab83-88cf4942dac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:23.114647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1ab92-eae6-498a-ab83-88cf4942dac4 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:23.126188 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4282/8611] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:37:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:37:24.649888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f340d-5048-4f59-9162-756494a7492c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:24.652121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-678f340d-5048-4f59-9162-756494a7492c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:24.758481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:24.795814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f340d-5048-4f59-9162-756494a7492c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:24.801997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492dd21-bb45-4dbf-91b6-4fecf8959362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:24.802765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492dd21-bb45-4dbf-91b6-4fecf8959362 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:24.803180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492dd21-bb45-4dbf-91b6-4fecf8959362 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:24.803591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492dd21-bb45-4dbf-91b6-4fecf8959362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:24.808127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3492dd21-bb45-4dbf-91b6-4fecf8959362 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:24.831008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492dd21-bb45-4dbf-91b6-4fecf8959362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:24.833109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492dd21-bb45-4dbf-91b6-4fecf8959362 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:24.852544 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4330/8612] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:37:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:37:28.332258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec00a9e-9082-4e4f-a4d4-1768c9d01d98 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:28.332735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec00a9e-9082-4e4f-a4d4-1768c9d01d98 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:28.332847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec00a9e-9082-4e4f-a4d4-1768c9d01d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:28.386538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2ec00a9e-9082-4e4f-a4d4-1768c9d01d98 None None] MFA Rules not processed for user `e062653d52144a3a91277e045033f27a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:37:28.388685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2ec00a9e-9082-4e4f-a4d4-1768c9d01d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:28.500746 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4283/8613] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:37:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:37:28.505366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492dd21-bb45-4dbf-91b6-4fecf8959362 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:28.518765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492dd21-bb45-4dbf-91b6-4fecf8959362 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:28.526019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de920ee3-6441-43d2-95ef-862df0332f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:28.526921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de920ee3-6441-43d2-95ef-862df0332f0e admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:28.527649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de920ee3-6441-43d2-95ef-862df0332f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:28.528619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de920ee3-6441-43d2-95ef-862df0332f0e admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:28.529495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de920ee3-6441-43d2-95ef-862df0332f0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:28.531630 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de920ee3-6441-43d2-95ef-862df0332f0e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:28.571846 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4331/8614] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:37:28 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:37:28.576647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec00a9e-9082-4e4f-a4d4-1768c9d01d98 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:28.588937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec00a9e-9082-4e4f-a4d4-1768c9d01d98 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:28.668029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40e527-e31c-4b4f-958b-273377d5641c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:28.668979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40e527-e31c-4b4f-958b-273377d5641c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:28.669271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40e527-e31c-4b4f-958b-273377d5641c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:28.669555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40e527-e31c-4b4f-958b-273377d5641c admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:28.670316 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40e527-e31c-4b4f-958b-273377d5641c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:28.672685 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40e527-e31c-4b4f-958b-273377d5641c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:28.707632 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4284/8615] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:37:28 2022] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:37:28.711974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de920ee3-6441-43d2-95ef-862df0332f0e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:28.735395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de920ee3-6441-43d2-95ef-862df0332f0e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:28.750043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ed5d2-011c-4772-b667-6f9a6a394022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:28.750709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ed5d2-011c-4772-b667-6f9a6a394022 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:28.750998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ed5d2-011c-4772-b667-6f9a6a394022 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:28.751282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ed5d2-011c-4772-b667-6f9a6a394022 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:28.752049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ed5d2-011c-4772-b667-6f9a6a394022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:28.754417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ed5d2-011c-4772-b667-6f9a6a394022 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:28.769411 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4332/8616] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:37:28.773411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40e527-e31c-4b4f-958b-273377d5641c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:28.786626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40e527-e31c-4b4f-958b-273377d5641c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:28.792650 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a4af6-ec44-4ef9-a523-71c31b1c43e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:28.793409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a4af6-ec44-4ef9-a523-71c31b1c43e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:28.793706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a4af6-ec44-4ef9-a523-71c31b1c43e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:28.793995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a4af6-ec44-4ef9-a523-71c31b1c43e9 admin admin] PATH_INFO: `/v3/projects/bb0c514b014146f68f6b46d2e1d137cc/users/d66a9a0d50294a8ba272151cae81f7c2/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:28.820691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a4af6-ec44-4ef9-a523-71c31b1c43e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0c514b014146f68f6b46d2e1d137cc, user_id=d66a9a0d50294a8ba272151cae81f7c2, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:28.823313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a4af6-ec44-4ef9-a523-71c31b1c43e9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:28.847540 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4285/8617] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:37:28 2022] PUT /identity/v3/projects/bb0c514b014146f68f6b46d2e1d137cc/users/d66a9a0d50294a8ba272151cae81f7c2/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:37:28.849289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ed5d2-011c-4772-b667-6f9a6a394022 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:28.860496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ed5d2-011c-4772-b667-6f9a6a394022 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:28.939225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d74b92-e465-4ae1-bf8e-d7db903ae4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:28.939901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d74b92-e465-4ae1-bf8e-d7db903ae4af admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:28.940191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d74b92-e465-4ae1-bf8e-d7db903ae4af admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:28.940467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d74b92-e465-4ae1-bf8e-d7db903ae4af admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:28.941181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d74b92-e465-4ae1-bf8e-d7db903ae4af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:28.942799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d74b92-e465-4ae1-bf8e-d7db903ae4af admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:28.954486 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4333/8618] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:37:28.959477 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a4af6-ec44-4ef9-a523-71c31b1c43e9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:28.973364 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a4af6-ec44-4ef9-a523-71c31b1c43e9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:28.979881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4e815-cbd9-4096-9897-2f7a705d7bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:28.980691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4e815-cbd9-4096-9897-2f7a705d7bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:28.981057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4e815-cbd9-4096-9897-2f7a705d7bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:28.981535 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4e815-cbd9-4096-9897-2f7a705d7bb5 admin admin] PATH_INFO: `/v3/projects/bb0c514b014146f68f6b46d2e1d137cc/users/d66a9a0d50294a8ba272151cae81f7c2/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:28.983783 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4e815-cbd9-4096-9897-2f7a705d7bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0c514b014146f68f6b46d2e1d137cc, user_id=d66a9a0d50294a8ba272151cae81f7c2, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:28.986551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4e815-cbd9-4096-9897-2f7a705d7bb5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:29.030432 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4286/8619] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:37:28 2022] PUT /identity/v3/projects/bb0c514b014146f68f6b46d2e1d137cc/users/d66a9a0d50294a8ba272151cae81f7c2/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:37:35.151668 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32edc5-a8e5-40ba-b38c-7f8d11366f33 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:35.153415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32edc5-a8e5-40ba-b38c-7f8d11366f33 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:35.153922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32edc5-a8e5-40ba-b38c-7f8d11366f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:35.234538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7a32edc5-a8e5-40ba-b38c-7f8d11366f33 None None] MFA Rules not processed for user `d66a9a0d50294a8ba272151cae81f7c2`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:37:35.234538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7a32edc5-a8e5-40ba-b38c-7f8d11366f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:35.310839 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4334/8620] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:37:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:37:35.323983 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4e815-cbd9-4096-9897-2f7a705d7bb5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:35.326320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1fd4e815-cbd9-4096-9897-2f7a705d7bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:35.354637 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:35.406791 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4e815-cbd9-4096-9897-2f7a705d7bb5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:35.411323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce2703-4f79-4c3a-bbd1-c536ba2eb019 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:35.412103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce2703-4f79-4c3a-bbd1-c536ba2eb019 service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:35.412488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce2703-4f79-4c3a-bbd1-c536ba2eb019 service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:35.412899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce2703-4f79-4c3a-bbd1-c536ba2eb019 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:35.528323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce2703-4f79-4c3a-bbd1-c536ba2eb019 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:35.529861 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce2703-4f79-4c3a-bbd1-c536ba2eb019 service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:35.544235 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4287/8621] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:37:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:37:39.797107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47e173-f0d2-4a4b-91ae-9589f2b445e6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:39.797802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47e173-f0d2-4a4b-91ae-9589f2b445e6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:39.797802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47e173-f0d2-4a4b-91ae-9589f2b445e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:39.828955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4d47e173-f0d2-4a4b-91ae-9589f2b445e6 None None] MFA Rules not processed for user `e062653d52144a3a91277e045033f27a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:37:39.830483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4d47e173-f0d2-4a4b-91ae-9589f2b445e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:39.849452 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4335/8622] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:37:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:37:39.857411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de92b64-08ac-4aa7-95dd-3012e54641c4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:39.858452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de92b64-08ac-4aa7-95dd-3012e54641c4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:39.858888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de92b64-08ac-4aa7-95dd-3012e54641c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:39.901234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1de92b64-08ac-4aa7-95dd-3012e54641c4 None None] MFA Rules not processed for user `713a3b0b01bd4a7aa128101b5b86be0f`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:37:39.905168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1de92b64-08ac-4aa7-95dd-3012e54641c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:39.991364 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4288/8623] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:37:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:37:40.123726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47e173-f0d2-4a4b-91ae-9589f2b445e6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:40.125937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4d47e173-f0d2-4a4b-91ae-9589f2b445e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:40.164613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:40.214238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47e173-f0d2-4a4b-91ae-9589f2b445e6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:40.219520 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeea8fd-015a-484c-a9c2-5dca2af979dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:40.220791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeea8fd-015a-484c-a9c2-5dca2af979dc service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:40.221149 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeea8fd-015a-484c-a9c2-5dca2af979dc service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:40.221504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeea8fd-015a-484c-a9c2-5dca2af979dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:40.223860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-daeea8fd-015a-484c-a9c2-5dca2af979dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:40.297288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeea8fd-015a-484c-a9c2-5dca2af979dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:40.298750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeea8fd-015a-484c-a9c2-5dca2af979dc service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:40.322190 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4336/8624] 10.222.0.17 () {60 vars in 1396 bytes} [Sat Jul 30 21:37:40 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3240 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:37:40.676936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de92b64-08ac-4aa7-95dd-3012e54641c4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:40.679055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1de92b64-08ac-4aa7-95dd-3012e54641c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:40.810507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de92b64-08ac-4aa7-95dd-3012e54641c4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:40.822989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e73d9c-350d-4abf-8b43-cd8cc280262e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:40.824766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e73d9c-350d-4abf-8b43-cd8cc280262e service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:40.825490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e73d9c-350d-4abf-8b43-cd8cc280262e service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:40.825779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e73d9c-350d-4abf-8b43-cd8cc280262e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:40.827853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-41e73d9c-350d-4abf-8b43-cd8cc280262e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:40.844531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e73d9c-350d-4abf-8b43-cd8cc280262e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:40.845878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e73d9c-350d-4abf-8b43-cd8cc280262e service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:40.860911 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4289/8625] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:37:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:37:47.049983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeea8fd-015a-484c-a9c2-5dca2af979dc service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:47.063024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeea8fd-015a-484c-a9c2-5dca2af979dc service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:47.066877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6f3d5-9813-42e7-99d8-276820d4bcbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:47.067537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6f3d5-9813-42e7-99d8-276820d4bcbc service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:47.067828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6f3d5-9813-42e7-99d8-276820d4bcbc service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:47.068113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6f3d5-9813-42e7-99d8-276820d4bcbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:47.070027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-44d6f3d5-9813-42e7-99d8-276820d4bcbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:47.135824 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6f3d5-9813-42e7-99d8-276820d4bcbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:47.137904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6f3d5-9813-42e7-99d8-276820d4bcbc service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:47.148963 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4337/8626] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:37:50.852541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:52.503491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e73d9c-350d-4abf-8b43-cd8cc280262e service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:52.505627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-41e73d9c-350d-4abf-8b43-cd8cc280262e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:52.606512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e73d9c-350d-4abf-8b43-cd8cc280262e service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:52.613729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c102a24-a40e-4277-9993-21e8192ddbea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:52.614372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c102a24-a40e-4277-9993-21e8192ddbea service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:52.615851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c102a24-a40e-4277-9993-21e8192ddbea service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:52.615980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c102a24-a40e-4277-9993-21e8192ddbea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:52.617834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0c102a24-a40e-4277-9993-21e8192ddbea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:52.638767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c102a24-a40e-4277-9993-21e8192ddbea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:52.640742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c102a24-a40e-4277-9993-21e8192ddbea service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:52.663788 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4290/8627] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:37:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:37:55.463538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6f3d5-9813-42e7-99d8-276820d4bcbc service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:55.465048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-44d6f3d5-9813-42e7-99d8-276820d4bcbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:55.482991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6f3d5-9813-42e7-99d8-276820d4bcbc service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:55.487962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05bf58-0401-4df0-8ffc-5a35dca9c3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:55.488699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05bf58-0401-4df0-8ffc-5a35dca9c3a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:55.489107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05bf58-0401-4df0-8ffc-5a35dca9c3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:55.489456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05bf58-0401-4df0-8ffc-5a35dca9c3a0 admin admin] PATH_INFO: `/v3/users/8b1ec28438dc45a48433b159e5f04d6b` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:55.490706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05bf58-0401-4df0-8ffc-5a35dca9c3a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1ec28438dc45a48433b159e5f04d6b)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:55.492769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05bf58-0401-4df0-8ffc-5a35dca9c3a0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:55.543595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e05bf58-0401-4df0-8ffc-5a35dca9c3a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1ec28438dc45a48433b159e5f04d6b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:55.554999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:55.556212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e05bf58-0401-4df0-8ffc-5a35dca9c3a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1ec28438dc45a48433b159e5f04d6b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:55.556993 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e05bf58-0401-4df0-8ffc-5a35dca9c3a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1ec28438dc45a48433b159e5f04d6b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:55.566108 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e05bf58-0401-4df0-8ffc-5a35dca9c3a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1ec28438dc45a48433b159e5f04d6b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:55.566818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-1e05bf58-0401-4df0-8ffc-5a35dca9c3a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1ec28438dc45a48433b159e5f04d6b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:55.581270 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4338/8628] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:37:55 2022] DELETE /identity/v3/users/8b1ec28438dc45a48433b159e5f04d6b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:37:55.769009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c102a24-a40e-4277-9993-21e8192ddbea service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:55.781918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c102a24-a40e-4277-9993-21e8192ddbea service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:55.841136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e878b1-213f-4096-87de-69bec52464df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:55.841786 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e878b1-213f-4096-87de-69bec52464df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:55.842076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e878b1-213f-4096-87de-69bec52464df admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:55.842362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e878b1-213f-4096-87de-69bec52464df admin admin] PATH_INFO: `/v3/projects/5105e54fdfa345c4891676afaf2dcd5e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:55.843577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e878b1-213f-4096-87de-69bec52464df admin admin] RBAC: Authorizing `identity:delete_project(project_id=5105e54fdfa345c4891676afaf2dcd5e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:55.845492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e878b1-213f-4096-87de-69bec52464df admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:55.894627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e5e878b1-213f-4096-87de-69bec52464df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5105e54fdfa345c4891676afaf2dcd5e', 'request_id': 'req-e5e878b1-213f-4096-87de-69bec52464df'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:55.903221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e5e878b1-213f-4096-87de-69bec52464df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5105e54fdfa345c4891676afaf2dcd5e', 'request_id': 'req-e5e878b1-213f-4096-87de-69bec52464df'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:55.909879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e5e878b1-213f-4096-87de-69bec52464df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5105e54fdfa345c4891676afaf2dcd5e', 'request_id': 'req-e5e878b1-213f-4096-87de-69bec52464df'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:55.921812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e5e878b1-213f-4096-87de-69bec52464df admin admin] The token cache is being invalidate because project 5105e54fdfa345c4891676afaf2dcd5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:37:55.922108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e5e878b1-213f-4096-87de-69bec52464df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:55.922763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-e5e878b1-213f-4096-87de-69bec52464df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:55.924432 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4291/8629] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:37:55 2022] DELETE /identity/v3/projects/5105e54fdfa345c4891676afaf2dcd5e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:37:55.928477 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05bf58-0401-4df0-8ffc-5a35dca9c3a0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:55.929961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1e05bf58-0401-4df0-8ffc-5a35dca9c3a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:55.944575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05bf58-0401-4df0-8ffc-5a35dca9c3a0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:56.019481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e2a8d-23a5-4663-b886-133263b22d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:56.020254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e2a8d-23a5-4663-b886-133263b22d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:56.020890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e2a8d-23a5-4663-b886-133263b22d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:56.021253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e2a8d-23a5-4663-b886-133263b22d30 admin admin] PATH_INFO: `/v3/users/0b3af0781e8242b5a2d1676f712a839d` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:56.022675 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e2a8d-23a5-4663-b886-133263b22d30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b3af0781e8242b5a2d1676f712a839d)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:56.024799 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e2a8d-23a5-4663-b886-133263b22d30 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:56.087822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d79e2a8d-23a5-4663-b886-133263b22d30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b3af0781e8242b5a2d1676f712a839d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:56.104260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d79e2a8d-23a5-4663-b886-133263b22d30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b3af0781e8242b5a2d1676f712a839d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:56.105484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d79e2a8d-23a5-4663-b886-133263b22d30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b3af0781e8242b5a2d1676f712a839d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:56.115103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d79e2a8d-23a5-4663-b886-133263b22d30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b3af0781e8242b5a2d1676f712a839d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:56.115912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-d79e2a8d-23a5-4663-b886-133263b22d30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b3af0781e8242b5a2d1676f712a839d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:56.133743 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4339/8630] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:37:55 2022] DELETE /identity/v3/users/0b3af0781e8242b5a2d1676f712a839d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:37:56.439497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e878b1-213f-4096-87de-69bec52464df admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:56.441099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e5e878b1-213f-4096-87de-69bec52464df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:56.470974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e878b1-213f-4096-87de-69bec52464df admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:56.484769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:56.535747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e80fb-6e9f-4d3c-b80e-2b8c93025bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:56.536514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e80fb-6e9f-4d3c-b80e-2b8c93025bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:56.536882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e80fb-6e9f-4d3c-b80e-2b8c93025bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:56.537226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e80fb-6e9f-4d3c-b80e-2b8c93025bb9 admin admin] PATH_INFO: `/v3/projects/da052081754c4f55a216da6f9c25eab3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:56.538456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e80fb-6e9f-4d3c-b80e-2b8c93025bb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da052081754c4f55a216da6f9c25eab3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:56.540458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e80fb-6e9f-4d3c-b80e-2b8c93025bb9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:56.588407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d73e80fb-6e9f-4d3c-b80e-2b8c93025bb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da052081754c4f55a216da6f9c25eab3', 'request_id': 'req-d73e80fb-6e9f-4d3c-b80e-2b8c93025bb9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:56.595899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d73e80fb-6e9f-4d3c-b80e-2b8c93025bb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da052081754c4f55a216da6f9c25eab3', 'request_id': 'req-d73e80fb-6e9f-4d3c-b80e-2b8c93025bb9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:56.601547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d73e80fb-6e9f-4d3c-b80e-2b8c93025bb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da052081754c4f55a216da6f9c25eab3', 'request_id': 'req-d73e80fb-6e9f-4d3c-b80e-2b8c93025bb9'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:56.613828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d73e80fb-6e9f-4d3c-b80e-2b8c93025bb9 admin admin] The token cache is being invalidate because project da052081754c4f55a216da6f9c25eab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:37:56.614656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d73e80fb-6e9f-4d3c-b80e-2b8c93025bb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:56.615339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d73e80fb-6e9f-4d3c-b80e-2b8c93025bb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:37:56.616893 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4292/8631] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:37:56 2022] DELETE /identity/v3/projects/da052081754c4f55a216da6f9c25eab3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:37:56.622398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cdf7c-9e70-4afa-b0bb-9a84b0f6c49e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:56.622870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cdf7c-9e70-4afa-b0bb-9a84b0f6c49e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:56.622979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cdf7c-9e70-4afa-b0bb-9a84b0f6c49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:56.643435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-240cdf7c-9e70-4afa-b0bb-9a84b0f6c49e None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:37:56.644872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-240cdf7c-9e70-4afa-b0bb-9a84b0f6c49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:56.696876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:56.708857 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4340/8632] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:37:56.716577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ddf35-eaad-4200-be05-5e020ed0cfbf None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:56.716876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ddf35-eaad-4200-be05-5e020ed0cfbf None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:56.717160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ddf35-eaad-4200-be05-5e020ed0cfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:56.737716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1d2ddf35-eaad-4200-be05-5e020ed0cfbf None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:37:56.738945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1d2ddf35-eaad-4200-be05-5e020ed0cfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:56.748327 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4293/8633] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:37:56.752606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cdf7c-9e70-4afa-b0bb-9a84b0f6c49e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:56.763480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cdf7c-9e70-4afa-b0bb-9a84b0f6c49e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:56.768382 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321d99c-2309-40af-9bd0-a39f8119d5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:56.769006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321d99c-2309-40af-9bd0-a39f8119d5af admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:56.769296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321d99c-2309-40af-9bd0-a39f8119d5af admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:56.769578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321d99c-2309-40af-9bd0-a39f8119d5af admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:56.770282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321d99c-2309-40af-9bd0-a39f8119d5af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:37:56.770590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321d99c-2309-40af-9bd0-a39f8119d5af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:56.772273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321d99c-2309-40af-9bd0-a39f8119d5af admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:56.784370 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4341/8634] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:37:56.788847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ddf35-eaad-4200-be05-5e020ed0cfbf None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:56.804797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ddf35-eaad-4200-be05-5e020ed0cfbf None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:56.812211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab9b4d-62ae-4091-b038-5b36a15a9e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:56.812955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab9b4d-62ae-4091-b038-5b36a15a9e1d admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:56.813324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab9b4d-62ae-4091-b038-5b36a15a9e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:56.813672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab9b4d-62ae-4091-b038-5b36a15a9e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:56.814417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab9b4d-62ae-4091-b038-5b36a15a9e1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:56.816957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab9b4d-62ae-4091-b038-5b36a15a9e1d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:56.854007 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4294/8635] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:37:56 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:37:56.860395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321d99c-2309-40af-9bd0-a39f8119d5af admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:56.880460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321d99c-2309-40af-9bd0-a39f8119d5af admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:56.956298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2d429-58d8-40c3-9822-5f4bddba2bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:56.957176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2d429-58d8-40c3-9822-5f4bddba2bca admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:56.957466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2d429-58d8-40c3-9822-5f4bddba2bca admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:56.957897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2d429-58d8-40c3-9822-5f4bddba2bca admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:56.958704 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2d429-58d8-40c3-9822-5f4bddba2bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:56.960884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2d429-58d8-40c3-9822-5f4bddba2bca admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:56.987732 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4342/8636] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:37:56 2022] POST /identity/v3/users => generated 283 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:37:56.992584 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab9b4d-62ae-4091-b038-5b36a15a9e1d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:57.006460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab9b4d-62ae-4091-b038-5b36a15a9e1d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:57.011458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3659c-2342-4110-af2e-f3e9040ca45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:57.012233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3659c-2342-4110-af2e-f3e9040ca45d admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:57.012523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3659c-2342-4110-af2e-f3e9040ca45d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:57.012803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3659c-2342-4110-af2e-f3e9040ca45d admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:57.013649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3659c-2342-4110-af2e-f3e9040ca45d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:57.015268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3659c-2342-4110-af2e-f3e9040ca45d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:57.027378 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4295/8637] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:37:57.031394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2d429-58d8-40c3-9822-5f4bddba2bca admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:57.043111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2d429-58d8-40c3-9822-5f4bddba2bca admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:57.049281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f7989-4cad-4b97-97d2-0ea7d3551258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:57.049918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f7989-4cad-4b97-97d2-0ea7d3551258 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:57.050207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f7989-4cad-4b97-97d2-0ea7d3551258 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:57.050489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f7989-4cad-4b97-97d2-0ea7d3551258 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:57.051226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f7989-4cad-4b97-97d2-0ea7d3551258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:57.052884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f7989-4cad-4b97-97d2-0ea7d3551258 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:57.066430 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4343/8638] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:37:57.070667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3659c-2342-4110-af2e-f3e9040ca45d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:57.081671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3659c-2342-4110-af2e-f3e9040ca45d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:57.086632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55573375-1d80-44a3-8387-4e399e9d6576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:57.087330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55573375-1d80-44a3-8387-4e399e9d6576 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:57.087626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55573375-1d80-44a3-8387-4e399e9d6576 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:57.087911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55573375-1d80-44a3-8387-4e399e9d6576 admin admin] PATH_INFO: `/v3/projects/562236753a0f4c77a467dad79128aa53/users/501f5c68b24b4d55871be0f7e5200054/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:57.105656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55573375-1d80-44a3-8387-4e399e9d6576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=562236753a0f4c77a467dad79128aa53, user_id=501f5c68b24b4d55871be0f7e5200054, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:57.108508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55573375-1d80-44a3-8387-4e399e9d6576 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:57.124569 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4296/8639] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:37:57 2022] PUT /identity/v3/projects/562236753a0f4c77a467dad79128aa53/users/501f5c68b24b4d55871be0f7e5200054/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:37:57.129987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa3873-5564-43c3-ae50-d9c6c8fda93f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:57.130229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa3873-5564-43c3-ae50-d9c6c8fda93f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:57.130491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa3873-5564-43c3-ae50-d9c6c8fda93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:57.150091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-32aa3873-5564-43c3-ae50-d9c6c8fda93f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:37:57.151886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-32aa3873-5564-43c3-ae50-d9c6c8fda93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:57.227546 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4344/8640] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:37:57.238634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55573375-1d80-44a3-8387-4e399e9d6576 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:37:57.241055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-55573375-1d80-44a3-8387-4e399e9d6576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:37:57.295406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:57.313006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55573375-1d80-44a3-8387-4e399e9d6576 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:37:57.319751 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238b19d-c005-4e9c-8a58-e866ee5dfda2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:37:57.320570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238b19d-c005-4e9c-8a58-e866ee5dfda2 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:37:57.321550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238b19d-c005-4e9c-8a58-e866ee5dfda2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:37:57.322004 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238b19d-c005-4e9c-8a58-e866ee5dfda2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:37:57.336706 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238b19d-c005-4e9c-8a58-e866ee5dfda2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:37:57.339156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238b19d-c005-4e9c-8a58-e866ee5dfda2 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:37:57.351829 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4297/8641] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:37:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:38:02.742309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa531d-62d8-4f16-bece-0f2eababa7b9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:02.742833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa531d-62d8-4f16-bece-0f2eababa7b9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:02.743006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa531d-62d8-4f16-bece-0f2eababa7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:02.778122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-67fa531d-62d8-4f16-bece-0f2eababa7b9 None None] MFA Rules not processed for user `501f5c68b24b4d55871be0f7e5200054`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:38:02.779472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-67fa531d-62d8-4f16-bece-0f2eababa7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:38:02.864231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:02.875748 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4345/8642] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:38:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:38:02.880294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238b19d-c005-4e9c-8a58-e866ee5dfda2 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:38:02.891484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238b19d-c005-4e9c-8a58-e866ee5dfda2 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:38:02.896284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3827591-0a50-425d-b78c-e941a9094cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:38:02.896981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3827591-0a50-425d-b78c-e941a9094cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:02.897330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3827591-0a50-425d-b78c-e941a9094cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:02.897670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3827591-0a50-425d-b78c-e941a9094cd8 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:02.898408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3827591-0a50-425d-b78c-e941a9094cd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:38:02.900481 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3827591-0a50-425d-b78c-e941a9094cd8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:38:02.928433 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4298/8643] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:38:02 2022] POST /identity/v3/users => generated 288 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:38:02.932748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa531d-62d8-4f16-bece-0f2eababa7b9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:38:02.944938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa531d-62d8-4f16-bece-0f2eababa7b9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:38:02.950585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea02b67-10ab-4f11-a752-f22b25944cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:38:02.951345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea02b67-10ab-4f11-a752-f22b25944cac admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:02.951802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea02b67-10ab-4f11-a752-f22b25944cac admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:02.952314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea02b67-10ab-4f11-a752-f22b25944cac admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:02.953095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea02b67-10ab-4f11-a752-f22b25944cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:38:02.954800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea02b67-10ab-4f11-a752-f22b25944cac admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:38:02.969899 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4346/8644] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:38:02.971122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3827591-0a50-425d-b78c-e941a9094cd8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:38:02.982126 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3827591-0a50-425d-b78c-e941a9094cd8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:38:02.987048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1573fb-323c-4b98-af95-c4eb0cac1afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:38:02.987763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1573fb-323c-4b98-af95-c4eb0cac1afe admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:02.988050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1573fb-323c-4b98-af95-c4eb0cac1afe admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:02.988333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1573fb-323c-4b98-af95-c4eb0cac1afe admin admin] PATH_INFO: `/v3/system/users/872913b67c734f0d932228e3da6f13d7/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:03.006385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1573fb-323c-4b98-af95-c4eb0cac1afe admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=872913b67c734f0d932228e3da6f13d7, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:38:03.007530 ncdv-master-1 devstack@keystone.service[91086]: WARNING py.warnings [None req-1e1573fb-323c-4b98-af95-c4eb0cac1afe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:38:03.007530 ncdv-master-1 devstack@keystone.service[91086]: warnings.warn(msg) Jul 30 21:38:03.007530 ncdv-master-1 devstack@keystone.service[91086]: Jul 30 21:38:03.008400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1573fb-323c-4b98-af95-c4eb0cac1afe admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:38:03.016933 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4299/8645] 10.222.0.17 () {60 vars in 1378 bytes} [Sat Jul 30 21:38:02 2022] PUT /identity/v3/system/users/872913b67c734f0d932228e3da6f13d7/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:38:03.029488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c53e1-aa23-48ef-bd83-a4e7bf804d1c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:03.029705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c53e1-aa23-48ef-bd83-a4e7bf804d1c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:03.029986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c53e1-aa23-48ef-bd83-a4e7bf804d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:03.061556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-fb2c53e1-aa23-48ef-bd83-a4e7bf804d1c None None] MFA Rules not processed for user `872913b67c734f0d932228e3da6f13d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:38:03.062789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-fb2c53e1-aa23-48ef-bd83-a4e7bf804d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:38:03.142697 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4347/8646] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:38:03 2022] POST /identity/v3/auth/tokens => generated 2405 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 30 21:38:03.147209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1573fb-323c-4b98-af95-c4eb0cac1afe admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:38:03.261947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1573fb-323c-4b98-af95-c4eb0cac1afe admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:38:03.299639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5dc776-19c8-4f6b-aa16-36686d472f8d None tempest-ImageQuotaTest-1065326365-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872913b67c734f0d932228e3da6f13d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:38:03.300286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dc776-19c8-4f6b-aa16-36686d472f8d None tempest-ImageQuotaTest-1065326365-system-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:03.300579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dc776-19c8-4f6b-aa16-36686d472f8d None tempest-ImageQuotaTest-1065326365-system-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:03.300859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dc776-19c8-4f6b-aa16-36686d472f8d None tempest-ImageQuotaTest-1065326365-system-admin] PATH_INFO: `/v3/services` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:03.301810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5dc776-19c8-4f6b-aa16-36686d472f8d None tempest-ImageQuotaTest-1065326365-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:38:03.303180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5dc776-19c8-4f6b-aa16-36686d472f8d None tempest-ImageQuotaTest-1065326365-system-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:38:03.311403 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4300/8647] 10.222.0.17 () {58 vars in 1110 bytes} [Sat Jul 30 21:38:03 2022] GET /identity/v3/services => generated 2191 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:38:03.316412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c53e1-aa23-48ef-bd83-a4e7bf804d1c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:38:03.466400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c53e1-aa23-48ef-bd83-a4e7bf804d1c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:38:03.476214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:03.513436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90880ba1-a1dd-4639-8cce-8d3398e13794 None tempest-ImageQuotaTest-1065326365-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872913b67c734f0d932228e3da6f13d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:38:03.514503 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90880ba1-a1dd-4639-8cce-8d3398e13794 None tempest-ImageQuotaTest-1065326365-system-admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:03.514846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90880ba1-a1dd-4639-8cce-8d3398e13794 None tempest-ImageQuotaTest-1065326365-system-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:03.515068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90880ba1-a1dd-4639-8cce-8d3398e13794 None tempest-ImageQuotaTest-1065326365-system-admin] PATH_INFO: `/v3/limits` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:03.515888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90880ba1-a1dd-4639-8cce-8d3398e13794 None tempest-ImageQuotaTest-1065326365-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:38:03.517376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90880ba1-a1dd-4639-8cce-8d3398e13794 None tempest-ImageQuotaTest-1065326365-system-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:38:03.561281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application [None req-90880ba1-a1dd-4639-8cce-8d3398e13794 None tempest-ImageQuotaTest-1065326365-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jul 30 21:38:03.561281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:38:03.561281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:38:03.561281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:38:03.561281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:38:03.561281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:38:03.561281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:38:03.561281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:38:03.561281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:38:03.561281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:38:03.561281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:38:03.561281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:38:03.561281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Jul 30 21:38:03.561281 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Jul 30 21:38:03.562066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:38:03.562066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:38:03.562066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Jul 30 21:38:03.562066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Jul 30 21:38:03.562066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 30 21:38:03.562066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 30 21:38:03.562066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Jul 30 21:38:03.562066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Jul 30 21:38:03.562066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Jul 30 21:38:03.562066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application raise exception.NoLimitReference Jul 30 21:38:03.562066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jul 30 21:38:03.562066 ncdv-master-1 devstack@keystone.service[91085]: ERROR keystone.server.flask.application Jul 30 21:38:03.563050 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4348/8648] 10.222.0.17 () {60 vars in 1126 bytes} [Sat Jul 30 21:38:03 2022] POST /identity/v3/limits => generated 124 bytes in 247 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 30 21:38:03.568109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5dc776-19c8-4f6b-aa16-36686d472f8d None tempest-ImageQuotaTest-1065326365-system-admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:38:03.587830 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:03.714793 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5dc776-19c8-4f6b-aa16-36686d472f8d None tempest-ImageQuotaTest-1065326365-system-admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:38:03.758741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcaf97-a92c-4230-8443-91a707385ea4 None tempest-ImageQuotaTest-1065326365-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872913b67c734f0d932228e3da6f13d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:38:03.759445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcaf97-a92c-4230-8443-91a707385ea4 None tempest-ImageQuotaTest-1065326365-system-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:03.759744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcaf97-a92c-4230-8443-91a707385ea4 None tempest-ImageQuotaTest-1065326365-system-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:03.760010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcaf97-a92c-4230-8443-91a707385ea4 None tempest-ImageQuotaTest-1065326365-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:03.761167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcaf97-a92c-4230-8443-91a707385ea4 None tempest-ImageQuotaTest-1065326365-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:38:03.763204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcaf97-a92c-4230-8443-91a707385ea4 None tempest-ImageQuotaTest-1065326365-system-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:38:03.771795 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4301/8649] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:38:03 2022] GET /identity/v3/registered_limits => generated 129 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:38:03.779270 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90880ba1-a1dd-4639-8cce-8d3398e13794 None tempest-ImageQuotaTest-1065326365-system-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:38:03.911237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90880ba1-a1dd-4639-8cce-8d3398e13794 None tempest-ImageQuotaTest-1065326365-system-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:38:03.956034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f28ea9-0db0-406e-a737-dd3d6d24112e None tempest-ImageQuotaTest-1065326365-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872913b67c734f0d932228e3da6f13d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:38:03.956763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f28ea9-0db0-406e-a737-dd3d6d24112e None tempest-ImageQuotaTest-1065326365-system-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:03.957120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f28ea9-0db0-406e-a737-dd3d6d24112e None tempest-ImageQuotaTest-1065326365-system-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:03.957466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f28ea9-0db0-406e-a737-dd3d6d24112e None tempest-ImageQuotaTest-1065326365-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:03.958211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f28ea9-0db0-406e-a737-dd3d6d24112e None tempest-ImageQuotaTest-1065326365-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:38:03.959408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f28ea9-0db0-406e-a737-dd3d6d24112e None tempest-ImageQuotaTest-1065326365-system-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:38:03.980598 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4349/8650] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:38:03 2022] GET /identity/v3/registered_limits => generated 129 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:38:07.481649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2b36b-7b28-4750-9e04-520a325965cc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:07.482587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2b36b-7b28-4750-9e04-520a325965cc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:07.482877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2b36b-7b28-4750-9e04-520a325965cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:07.503301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7ef2b36b-7b28-4750-9e04-520a325965cc None None] MFA Rules not processed for user `e062653d52144a3a91277e045033f27a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:38:07.504599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7ef2b36b-7b28-4750-9e04-520a325965cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:38:07.546356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f28ea9-0db0-406e-a737-dd3d6d24112e None tempest-ImageQuotaTest-1065326365-system-admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:38:07.557685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f28ea9-0db0-406e-a737-dd3d6d24112e None tempest-ImageQuotaTest-1065326365-system-admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:38:07.564763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47ef2d-a319-4c5d-8a96-58f51b3b3210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:38:07.565506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47ef2d-a319-4c5d-8a96-58f51b3b3210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:07.566004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47ef2d-a319-4c5d-8a96-58f51b3b3210 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:07.566364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47ef2d-a319-4c5d-8a96-58f51b3b3210 admin admin] PATH_INFO: `/v3/users/501f5c68b24b4d55871be0f7e5200054` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:07.567825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47ef2d-a319-4c5d-8a96-58f51b3b3210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=501f5c68b24b4d55871be0f7e5200054)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:38:07.569888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47ef2d-a319-4c5d-8a96-58f51b3b3210 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:38:07.570775 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4302/8651] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:38:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:38:07.598797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:07.625473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7f47ef2d-a319-4c5d-8a96-58f51b3b3210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '501f5c68b24b4d55871be0f7e5200054'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:07.638225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7f47ef2d-a319-4c5d-8a96-58f51b3b3210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '501f5c68b24b4d55871be0f7e5200054'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:07.638918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7f47ef2d-a319-4c5d-8a96-58f51b3b3210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '501f5c68b24b4d55871be0f7e5200054'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:07.646313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7f47ef2d-a319-4c5d-8a96-58f51b3b3210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '501f5c68b24b4d55871be0f7e5200054'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:07.647031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7f47ef2d-a319-4c5d-8a96-58f51b3b3210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '501f5c68b24b4d55871be0f7e5200054'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:07.662726 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4350/8652] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:38:07 2022] DELETE /identity/v3/users/501f5c68b24b4d55871be0f7e5200054 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:38:07.848923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2b36b-7b28-4750-9e04-520a325965cc None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:38:07.862052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2b36b-7b28-4750-9e04-520a325965cc None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:38:07.903613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:07.932611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306d0e4-3820-471d-86b7-145f623d994a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:38:07.933272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306d0e4-3820-471d-86b7-145f623d994a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:07.933556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306d0e4-3820-471d-86b7-145f623d994a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:07.933834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306d0e4-3820-471d-86b7-145f623d994a admin admin] PATH_INFO: `/v3/projects/562236753a0f4c77a467dad79128aa53` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:07.935019 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306d0e4-3820-471d-86b7-145f623d994a admin admin] RBAC: Authorizing `identity:delete_project(project_id=562236753a0f4c77a467dad79128aa53)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:38:07.936981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306d0e4-3820-471d-86b7-145f623d994a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:38:07.987977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4306d0e4-3820-471d-86b7-145f623d994a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '562236753a0f4c77a467dad79128aa53', 'request_id': 'req-4306d0e4-3820-471d-86b7-145f623d994a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:07.996927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4306d0e4-3820-471d-86b7-145f623d994a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '562236753a0f4c77a467dad79128aa53', 'request_id': 'req-4306d0e4-3820-471d-86b7-145f623d994a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:08.011997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4306d0e4-3820-471d-86b7-145f623d994a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '562236753a0f4c77a467dad79128aa53', 'request_id': 'req-4306d0e4-3820-471d-86b7-145f623d994a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:08.024528 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4306d0e4-3820-471d-86b7-145f623d994a admin admin] The token cache is being invalidate because project 562236753a0f4c77a467dad79128aa53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:38:08.024815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4306d0e4-3820-471d-86b7-145f623d994a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:08.025476 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4306d0e4-3820-471d-86b7-145f623d994a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:08.027903 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4303/8653] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:38:07 2022] DELETE /identity/v3/projects/562236753a0f4c77a467dad79128aa53 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:38:08.031932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47ef2d-a319-4c5d-8a96-58f51b3b3210 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:38:08.033304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7f47ef2d-a319-4c5d-8a96-58f51b3b3210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:38:08.046436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47ef2d-a319-4c5d-8a96-58f51b3b3210 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:38:08.122218 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfaca91-eafd-496e-af12-1189ef146a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:38:08.122880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaca91-eafd-496e-af12-1189ef146a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:08.123175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaca91-eafd-496e-af12-1189ef146a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:08.123495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaca91-eafd-496e-af12-1189ef146a45 admin admin] PATH_INFO: `/v3/users/872913b67c734f0d932228e3da6f13d7` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:08.125065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfaca91-eafd-496e-af12-1189ef146a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=872913b67c734f0d932228e3da6f13d7)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:38:08.127119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfaca91-eafd-496e-af12-1189ef146a45 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:38:08.192496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7cfaca91-eafd-496e-af12-1189ef146a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872913b67c734f0d932228e3da6f13d7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:08.206137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7cfaca91-eafd-496e-af12-1189ef146a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872913b67c734f0d932228e3da6f13d7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:08.206397 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7cfaca91-eafd-496e-af12-1189ef146a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872913b67c734f0d932228e3da6f13d7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:08.214973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7cfaca91-eafd-496e-af12-1189ef146a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872913b67c734f0d932228e3da6f13d7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:08.215850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-7cfaca91-eafd-496e-af12-1189ef146a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872913b67c734f0d932228e3da6f13d7'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:08.228878 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4351/8654] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:38:08 2022] DELETE /identity/v3/users/872913b67c734f0d932228e3da6f13d7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:38:08.553447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306d0e4-3820-471d-86b7-145f623d994a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:38:08.556094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4306d0e4-3820-471d-86b7-145f623d994a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:38:08.570577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306d0e4-3820-471d-86b7-145f623d994a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:38:08.634163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db918e58-4916-4644-a955-9ea1b966731f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:38:08.634913 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db918e58-4916-4644-a955-9ea1b966731f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:08.635272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db918e58-4916-4644-a955-9ea1b966731f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:08.636133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db918e58-4916-4644-a955-9ea1b966731f admin admin] PATH_INFO: `/v3/projects/None` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:08.643416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db918e58-4916-4644-a955-9ea1b966731f admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:38:08.645344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db918e58-4916-4644-a955-9ea1b966731f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:38:08.656927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application [None req-db918e58-4916-4644-a955-9ea1b966731f admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Jul 30 21:38:08.656927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 30 21:38:08.656927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 30 21:38:08.656927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 30 21:38:08.656927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 30 21:38:08.656927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 30 21:38:08.656927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 30 21:38:08.656927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 30 21:38:08.656927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 30 21:38:08.656927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 30 21:38:08.656927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 30 21:38:08.656927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 30 21:38:08.656927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 30 21:38:08.656927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 30 21:38:08.656927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 30 21:38:08.656927 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 30 21:38:08.658008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 30 21:38:08.658008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 30 21:38:08.658008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 30 21:38:08.658008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 30 21:38:08.658008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 30 21:38:08.658008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 30 21:38:08.658008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Jul 30 21:38:08.658008 ncdv-master-1 devstack@keystone.service[91086]: ERROR keystone.server.flask.application Jul 30 21:38:08.659185 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4304/8655] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Jul 30 21:38:08 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 30 21:38:18.225147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=77,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:18.647908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:19.825627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6121042-0e78-4f63-bc5b-2a3764fb85a4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:19.826090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6121042-0e78-4f63-bc5b-2a3764fb85a4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:19.826193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6121042-0e78-4f63-bc5b-2a3764fb85a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:19.855334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a6121042-0e78-4f63-bc5b-2a3764fb85a4 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:38:19.856559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a6121042-0e78-4f63-bc5b-2a3764fb85a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:38:19.921580 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4352/8656] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:38:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:38:19.968431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db918e58-4916-4644-a955-9ea1b966731f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:38:19.970251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-db918e58-4916-4644-a955-9ea1b966731f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:38:20.043550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db918e58-4916-4644-a955-9ea1b966731f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:38:20.048658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747c94a-0967-476c-85d0-b0b3dc627378 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:38:20.049280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747c94a-0967-476c-85d0-b0b3dc627378 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:20.049563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747c94a-0967-476c-85d0-b0b3dc627378 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:20.049842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747c94a-0967-476c-85d0-b0b3dc627378 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:20.058542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747c94a-0967-476c-85d0-b0b3dc627378 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:38:20.060182 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747c94a-0967-476c-85d0-b0b3dc627378 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:38:20.068250 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4305/8657] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:38:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:38:21.333935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a56c9-5cf2-4152-a717-9c7620ff07cf None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:21.334414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a56c9-5cf2-4152-a717-9c7620ff07cf None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:21.334517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a56c9-5cf2-4152-a717-9c7620ff07cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:21.353179 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-064a56c9-5cf2-4152-a717-9c7620ff07cf None None] MFA Rules not processed for user `e062653d52144a3a91277e045033f27a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:38:21.354381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-064a56c9-5cf2-4152-a717-9c7620ff07cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:38:21.409059 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4353/8658] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:38:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:38:21.668376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747c94a-0967-476c-85d0-b0b3dc627378 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:38:21.669804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d747c94a-0967-476c-85d0-b0b3dc627378 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:38:21.730276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747c94a-0967-476c-85d0-b0b3dc627378 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:38:21.734029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f49541-3a19-4264-bb1a-64c78d684c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:38:21.734654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f49541-3a19-4264-bb1a-64c78d684c7b service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:21.734943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f49541-3a19-4264-bb1a-64c78d684c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:21.735227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f49541-3a19-4264-bb1a-64c78d684c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:21.736989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b4f49541-3a19-4264-bb1a-64c78d684c7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:38:21.750159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f49541-3a19-4264-bb1a-64c78d684c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:38:21.751613 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f49541-3a19-4264-bb1a-64c78d684c7b service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:38:21.762089 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4306/8659] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:38:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:38:23.084979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a56c9-5cf2-4152-a717-9c7620ff07cf None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:38:23.086593 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-064a56c9-5cf2-4152-a717-9c7620ff07cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:38:23.183545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a56c9-5cf2-4152-a717-9c7620ff07cf None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:38:23.191449 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa298e4-abc6-4481-a52f-d5f44fb5aeaa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:38:23.192119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa298e4-abc6-4481-a52f-d5f44fb5aeaa service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:23.192416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa298e4-abc6-4481-a52f-d5f44fb5aeaa service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:23.192699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa298e4-abc6-4481-a52f-d5f44fb5aeaa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:23.194872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0aa298e4-abc6-4481-a52f-d5f44fb5aeaa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:38:23.216499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa298e4-abc6-4481-a52f-d5f44fb5aeaa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:38:23.220832 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa298e4-abc6-4481-a52f-d5f44fb5aeaa service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:38:23.247445 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4354/8660] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:38:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:38:27.228413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f49541-3a19-4264-bb1a-64c78d684c7b service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:38:27.229961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b4f49541-3a19-4264-bb1a-64c78d684c7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:38:27.250744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f49541-3a19-4264-bb1a-64c78d684c7b service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:38:27.256970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac09b5d-599a-43e8-bdcb-2219d7a7a3c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:38:27.257700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac09b5d-599a-43e8-bdcb-2219d7a7a3c6 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:27.258064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac09b5d-599a-43e8-bdcb-2219d7a7a3c6 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:27.258420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac09b5d-599a-43e8-bdcb-2219d7a7a3c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:27.260458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-eac09b5d-599a-43e8-bdcb-2219d7a7a3c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:38:27.275642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac09b5d-599a-43e8-bdcb-2219d7a7a3c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:38:27.278056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac09b5d-599a-43e8-bdcb-2219d7a7a3c6 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:38:27.291915 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4307/8661] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:38:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:38:33.233386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=95 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:33.570987 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa298e4-abc6-4481-a52f-d5f44fb5aeaa service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:38:33.572558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0aa298e4-abc6-4481-a52f-d5f44fb5aeaa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:38:33.586870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa298e4-abc6-4481-a52f-d5f44fb5aeaa service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:38:33.591513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a009caa-3c55-443b-9bd8-63214ad0a911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:38:33.592158 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a009caa-3c55-443b-9bd8-63214ad0a911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:33.592445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a009caa-3c55-443b-9bd8-63214ad0a911 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:33.592726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a009caa-3c55-443b-9bd8-63214ad0a911 admin admin] PATH_INFO: `/v3/users/713a3b0b01bd4a7aa128101b5b86be0f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:33.593892 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a009caa-3c55-443b-9bd8-63214ad0a911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=713a3b0b01bd4a7aa128101b5b86be0f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:38:33.595893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a009caa-3c55-443b-9bd8-63214ad0a911 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:38:33.643715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9a009caa-3c55-443b-9bd8-63214ad0a911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713a3b0b01bd4a7aa128101b5b86be0f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:33.655614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9a009caa-3c55-443b-9bd8-63214ad0a911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713a3b0b01bd4a7aa128101b5b86be0f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:33.656295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9a009caa-3c55-443b-9bd8-63214ad0a911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713a3b0b01bd4a7aa128101b5b86be0f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:33.663360 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9a009caa-3c55-443b-9bd8-63214ad0a911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713a3b0b01bd4a7aa128101b5b86be0f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:33.664023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-9a009caa-3c55-443b-9bd8-63214ad0a911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713a3b0b01bd4a7aa128101b5b86be0f'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:33.678956 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4355/8662] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:38:33 2022] DELETE /identity/v3/users/713a3b0b01bd4a7aa128101b5b86be0f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:38:33.684205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f636dc4-1363-432c-bd5c-003a9581dc3c None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:33.685124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f636dc4-1363-432c-bd5c-003a9581dc3c None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:33.685767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f636dc4-1363-432c-bd5c-003a9581dc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:33.714100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7f636dc4-1363-432c-bd5c-003a9581dc3c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:38:33.715380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7f636dc4-1363-432c-bd5c-003a9581dc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:38:33.777170 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4308/8663] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:38:33.786942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a009caa-3c55-443b-9bd8-63214ad0a911 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:38:33.788484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9a009caa-3c55-443b-9bd8-63214ad0a911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:38:33.852632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a009caa-3c55-443b-9bd8-63214ad0a911 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:38:33.857143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad7be0-62d7-4fbc-bc22-d6a9886a4ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:38:33.857764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad7be0-62d7-4fbc-bc22-d6a9886a4ebf service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:33.858046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad7be0-62d7-4fbc-bc22-d6a9886a4ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:33.858325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad7be0-62d7-4fbc-bc22-d6a9886a4ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:33.867515 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad7be0-62d7-4fbc-bc22-d6a9886a4ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:38:33.868966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad7be0-62d7-4fbc-bc22-d6a9886a4ebf service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:38:33.878597 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4356/8664] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:38:34.059224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f636dc4-1363-432c-bd5c-003a9581dc3c None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:38:34.060832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7f636dc4-1363-432c-bd5c-003a9581dc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:38:34.081157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f636dc4-1363-432c-bd5c-003a9581dc3c None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:38:34.086091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d9008-958e-4ac7-9dff-3133a55bf3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:38:34.086810 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d9008-958e-4ac7-9dff-3133a55bf3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:34.087167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d9008-958e-4ac7-9dff-3133a55bf3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:34.087578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d9008-958e-4ac7-9dff-3133a55bf3d5 admin admin] PATH_INFO: `/v3/projects/7353cff71bc74e7386a4ebba1f6034c0` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:34.088945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d9008-958e-4ac7-9dff-3133a55bf3d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7353cff71bc74e7386a4ebba1f6034c0)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:38:34.091355 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d9008-958e-4ac7-9dff-3133a55bf3d5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:38:34.109577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=100 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:34.160903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-809d9008-958e-4ac7-9dff-3133a55bf3d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7353cff71bc74e7386a4ebba1f6034c0', 'request_id': 'req-809d9008-958e-4ac7-9dff-3133a55bf3d5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:34.169614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-809d9008-958e-4ac7-9dff-3133a55bf3d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7353cff71bc74e7386a4ebba1f6034c0', 'request_id': 'req-809d9008-958e-4ac7-9dff-3133a55bf3d5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:34.175842 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-809d9008-958e-4ac7-9dff-3133a55bf3d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7353cff71bc74e7386a4ebba1f6034c0', 'request_id': 'req-809d9008-958e-4ac7-9dff-3133a55bf3d5'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:34.193995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-809d9008-958e-4ac7-9dff-3133a55bf3d5 admin admin] The token cache is being invalidate because project 7353cff71bc74e7386a4ebba1f6034c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:38:34.194904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-809d9008-958e-4ac7-9dff-3133a55bf3d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:34.195625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-809d9008-958e-4ac7-9dff-3133a55bf3d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:34.197203 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4309/8665] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:38:34 2022] DELETE /identity/v3/projects/7353cff71bc74e7386a4ebba1f6034c0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:38:34.201750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad7be0-62d7-4fbc-bc22-d6a9886a4ebf service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:38:34.212154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad7be0-62d7-4fbc-bc22-d6a9886a4ebf service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:38:34.269899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e92a7-e020-4d75-9e0f-4d18af0b332d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:38:34.270646 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e92a7-e020-4d75-9e0f-4d18af0b332d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:34.270813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e92a7-e020-4d75-9e0f-4d18af0b332d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:34.271089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e92a7-e020-4d75-9e0f-4d18af0b332d admin admin] PATH_INFO: `/v3/users/060846b8872d4e2c9d895f2404ec1621` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:34.272574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e92a7-e020-4d75-9e0f-4d18af0b332d admin admin] RBAC: Authorizing `identity:delete_user(user_id=060846b8872d4e2c9d895f2404ec1621)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:38:34.274472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e92a7-e020-4d75-9e0f-4d18af0b332d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:38:34.290772 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:34.322121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ee9e92a7-e020-4d75-9e0f-4d18af0b332d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '060846b8872d4e2c9d895f2404ec1621'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:34.334335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ee9e92a7-e020-4d75-9e0f-4d18af0b332d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '060846b8872d4e2c9d895f2404ec1621'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:34.335009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ee9e92a7-e020-4d75-9e0f-4d18af0b332d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '060846b8872d4e2c9d895f2404ec1621'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:34.342508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ee9e92a7-e020-4d75-9e0f-4d18af0b332d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '060846b8872d4e2c9d895f2404ec1621'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:34.343137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ee9e92a7-e020-4d75-9e0f-4d18af0b332d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '060846b8872d4e2c9d895f2404ec1621'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:34.355675 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4357/8666] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:38:34 2022] DELETE /identity/v3/users/060846b8872d4e2c9d895f2404ec1621 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:38:34.629866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d9008-958e-4ac7-9dff-3133a55bf3d5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:38:34.632902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-809d9008-958e-4ac7-9dff-3133a55bf3d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:38:34.648302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d9008-958e-4ac7-9dff-3133a55bf3d5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:38:34.709547 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c0bea-9039-4211-a4c1-4d10362da64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:38:34.710352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c0bea-9039-4211-a4c1-4d10362da64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:38:34.710638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c0bea-9039-4211-a4c1-4d10362da64d admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:38:34.710915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c0bea-9039-4211-a4c1-4d10362da64d admin admin] PATH_INFO: `/v3/projects/9809aced43804e86841fcab4e9311e22` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:38:34.712136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c0bea-9039-4211-a4c1-4d10362da64d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9809aced43804e86841fcab4e9311e22)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:38:34.714298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c0bea-9039-4211-a4c1-4d10362da64d admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:38:34.773530 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b37c0bea-9039-4211-a4c1-4d10362da64d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9809aced43804e86841fcab4e9311e22', 'request_id': 'req-b37c0bea-9039-4211-a4c1-4d10362da64d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:34.782261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b37c0bea-9039-4211-a4c1-4d10362da64d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9809aced43804e86841fcab4e9311e22', 'request_id': 'req-b37c0bea-9039-4211-a4c1-4d10362da64d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:34.789309 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b37c0bea-9039-4211-a4c1-4d10362da64d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9809aced43804e86841fcab4e9311e22', 'request_id': 'req-b37c0bea-9039-4211-a4c1-4d10362da64d'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:34.803954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b37c0bea-9039-4211-a4c1-4d10362da64d admin admin] The token cache is being invalidate because project 9809aced43804e86841fcab4e9311e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:38:34.804250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b37c0bea-9039-4211-a4c1-4d10362da64d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:34.804928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b37c0bea-9039-4211-a4c1-4d10362da64d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:38:34.806531 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4310/8667] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:38:34 2022] DELETE /identity/v3/projects/9809aced43804e86841fcab4e9311e22 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:38:44.352139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=9,keystone:SELECT=20,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:44.800453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=69,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:39:15.358809 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c7340-8b43-42a0-aeff-ea607afeadde None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:39:15.359337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c7340-8b43-42a0-aeff-ea607afeadde None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:39:15.359434 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c7340-8b43-42a0-aeff-ea607afeadde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:39:15.378542 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-710c7340-8b43-42a0-aeff-ea607afeadde None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:39:15.379764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-710c7340-8b43-42a0-aeff-ea607afeadde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:39:15.440337 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4358/8668] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 21:39:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:39:15.452312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c0bea-9039-4211-a4c1-4d10362da64d admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:39:15.453720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b37c0bea-9039-4211-a4c1-4d10362da64d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:39:15.533581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c0bea-9039-4211-a4c1-4d10362da64d admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:39:15.539252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb13d2f-8adc-41a4-a383-ba6d1dd708e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:39:15.539977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb13d2f-8adc-41a4-a383-ba6d1dd708e0 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:39:15.540578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb13d2f-8adc-41a4-a383-ba6d1dd708e0 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:39:15.541072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb13d2f-8adc-41a4-a383-ba6d1dd708e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:39:15.550360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb13d2f-8adc-41a4-a383-ba6d1dd708e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:39:15.552003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb13d2f-8adc-41a4-a383-ba6d1dd708e0 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:39:15.560314 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4311/8669] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:39:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:39:18.402133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6ee53-4967-4cf9-9d25-b1f90fe02a10 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:39:18.402617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6ee53-4967-4cf9-9d25-b1f90fe02a10 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:39:18.402708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6ee53-4967-4cf9-9d25-b1f90fe02a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:39:18.422686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b2f6ee53-4967-4cf9-9d25-b1f90fe02a10 None None] MFA Rules not processed for user `e062653d52144a3a91277e045033f27a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:39:18.423945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b2f6ee53-4967-4cf9-9d25-b1f90fe02a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:39:18.482272 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4359/8670] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:39:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:39:25.556911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=32 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:39:28.475121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=53 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:39:29.266843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb13d2f-8adc-41a4-a383-ba6d1dd708e0 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:39:29.268266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-edb13d2f-8adc-41a4-a383-ba6d1dd708e0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:39:29.327925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb13d2f-8adc-41a4-a383-ba6d1dd708e0 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:39:29.331588 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1605fd-3c21-4f85-acbc-e60e5fc125a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:39:29.332200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1605fd-3c21-4f85-acbc-e60e5fc125a7 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:39:29.332485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1605fd-3c21-4f85-acbc-e60e5fc125a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:39:29.332761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1605fd-3c21-4f85-acbc-e60e5fc125a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:39:29.334472 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-3a1605fd-3c21-4f85-acbc-e60e5fc125a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:39:29.404114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1605fd-3c21-4f85-acbc-e60e5fc125a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:39:29.405558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1605fd-3c21-4f85-acbc-e60e5fc125a7 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:39:29.415220 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4312/8671] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:39:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:39:39.410869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=50 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:41:36.986225 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6ee53-4967-4cf9-9d25-b1f90fe02a10 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:41:36.987745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b2f6ee53-4967-4cf9-9d25-b1f90fe02a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:41:37.003240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6ee53-4967-4cf9-9d25-b1f90fe02a10 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:41:37.007083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7dbe92-cbe4-4e32-97c7-d6672e89d782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:41:37.007731 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7dbe92-cbe4-4e32-97c7-d6672e89d782 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:41:37.008008 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7dbe92-cbe4-4e32-97c7-d6672e89d782 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:41:37.008285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7dbe92-cbe4-4e32-97c7-d6672e89d782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:41:37.009992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3e7dbe92-cbe4-4e32-97c7-d6672e89d782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:41:37.092781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7dbe92-cbe4-4e32-97c7-d6672e89d782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:41:37.094213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7dbe92-cbe4-4e32-97c7-d6672e89d782 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:41:37.107945 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4360/8672] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:41:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:41:38.288712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1605fd-3c21-4f85-acbc-e60e5fc125a7 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:41:38.299991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1605fd-3c21-4f85-acbc-e60e5fc125a7 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:41:38.303608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138ecde-8037-4324-a7d0-dd563f7f4e99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:41:38.304211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138ecde-8037-4324-a7d0-dd563f7f4e99 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:41:38.304495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138ecde-8037-4324-a7d0-dd563f7f4e99 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:41:38.304774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138ecde-8037-4324-a7d0-dd563f7f4e99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:41:38.306501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4138ecde-8037-4324-a7d0-dd563f7f4e99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:41:38.323282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138ecde-8037-4324-a7d0-dd563f7f4e99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:41:38.324943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138ecde-8037-4324-a7d0-dd563f7f4e99 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:41:38.339515 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4313/8673] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:41:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:41:41.027324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02dec1-5a9d-44a9-b67d-41dfae211c24 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:41:41.027775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02dec1-5a9d-44a9-b67d-41dfae211c24 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:41:41.027909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02dec1-5a9d-44a9-b67d-41dfae211c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:41:41.046841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ee02dec1-5a9d-44a9-b67d-41dfae211c24 None None] MFA Rules not processed for user `e062653d52144a3a91277e045033f27a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:41:41.048196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ee02dec1-5a9d-44a9-b67d-41dfae211c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:41:41.055416 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4361/8674] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:41:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:41:43.503367 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138ecde-8037-4324-a7d0-dd563f7f4e99 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:41:43.516102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138ecde-8037-4324-a7d0-dd563f7f4e99 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:41:43.520263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c718f9-a9ae-48af-95d6-43be636b6f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:41:43.520887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c718f9-a9ae-48af-95d6-43be636b6f2a service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:41:43.521172 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c718f9-a9ae-48af-95d6-43be636b6f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:41:43.521453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c718f9-a9ae-48af-95d6-43be636b6f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:41:43.523220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a2c718f9-a9ae-48af-95d6-43be636b6f2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:41:43.539057 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c718f9-a9ae-48af-95d6-43be636b6f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:41:43.540490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c718f9-a9ae-48af-95d6-43be636b6f2a service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:41:43.555386 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4314/8675] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:41:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:41:51.041300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=42 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:41:53.545987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=12 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:43:29.053775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02dec1-5a9d-44a9-b67d-41dfae211c24 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:43:29.055197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ee02dec1-5a9d-44a9-b67d-41dfae211c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:43:29.131153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02dec1-5a9d-44a9-b67d-41dfae211c24 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:43:29.136432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11807cf-1026-4edf-9ee9-50a07115486c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:43:29.137052 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11807cf-1026-4edf-9ee9-50a07115486c service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:43:29.137335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11807cf-1026-4edf-9ee9-50a07115486c service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:43:29.137608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11807cf-1026-4edf-9ee9-50a07115486c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:43:29.139412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a11807cf-1026-4edf-9ee9-50a07115486c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:43:29.153395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11807cf-1026-4edf-9ee9-50a07115486c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:43:29.155500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11807cf-1026-4edf-9ee9-50a07115486c service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:43:29.167834 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4362/8676] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:43:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:43:30.218094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c718f9-a9ae-48af-95d6-43be636b6f2a service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:43:30.219596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a2c718f9-a9ae-48af-95d6-43be636b6f2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:43:30.241184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c718f9-a9ae-48af-95d6-43be636b6f2a service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:43:30.246286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506acb1-89d4-408d-8694-c51a3227f5d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:43:30.246811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506acb1-89d4-408d-8694-c51a3227f5d4 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:43:30.247093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506acb1-89d4-408d-8694-c51a3227f5d4 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:43:30.247502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506acb1-89d4-408d-8694-c51a3227f5d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:43:30.249243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7506acb1-89d4-408d-8694-c51a3227f5d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:43:30.265278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506acb1-89d4-408d-8694-c51a3227f5d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:43:30.266893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506acb1-89d4-408d-8694-c51a3227f5d4 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:43:30.280265 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4315/8677] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:43:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:43:32.465255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11807cf-1026-4edf-9ee9-50a07115486c service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:43:32.467186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a11807cf-1026-4edf-9ee9-50a07115486c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:43:32.538585 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11807cf-1026-4edf-9ee9-50a07115486c service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:43:32.542404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670b825-e822-42ef-811e-95f322725224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1656aa416bc146f486e71517e476773a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:43:32.543014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670b825-e822-42ef-811e-95f322725224 service cinder] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:43:32.543307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670b825-e822-42ef-811e-95f322725224 service cinder] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:43:32.543597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670b825-e822-42ef-811e-95f322725224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:43:32.545349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0670b825-e822-42ef-811e-95f322725224 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:43:32.556081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670b825-e822-42ef-811e-95f322725224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:43:32.557485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670b825-e822-42ef-811e-95f322725224 service cinder] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:43:32.566208 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4363/8678] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:43:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:43:36.269243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd458e-d93c-4cf6-b73c-9edd513ec251 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:43:36.269747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd458e-d93c-4cf6-b73c-9edd513ec251 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:43:36.269847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd458e-d93c-4cf6-b73c-9edd513ec251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:43:36.289514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-65bd458e-d93c-4cf6-b73c-9edd513ec251 None None] MFA Rules not processed for user `e062653d52144a3a91277e045033f27a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:43:36.290726 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-65bd458e-d93c-4cf6-b73c-9edd513ec251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:43:36.298172 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4316/8679] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:43:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:43:36.628535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670b825-e822-42ef-811e-95f322725224 service cinder] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:43:36.640863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670b825-e822-42ef-811e-95f322725224 service cinder] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:43:36.644472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07992c45-16e1-4d07-809e-2f8aecc16f4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:43:36.645083 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07992c45-16e1-4d07-809e-2f8aecc16f4e service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:43:36.645363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07992c45-16e1-4d07-809e-2f8aecc16f4e service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:43:36.645634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07992c45-16e1-4d07-809e-2f8aecc16f4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:43:36.647416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-07992c45-16e1-4d07-809e-2f8aecc16f4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:43:36.660125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07992c45-16e1-4d07-809e-2f8aecc16f4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:43:36.661537 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07992c45-16e1-4d07-809e-2f8aecc16f4e service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:43:36.672579 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4364/8680] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:43:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:43:37.154761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd458e-d93c-4cf6-b73c-9edd513ec251 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:43:37.170508 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd458e-d93c-4cf6-b73c-9edd513ec251 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:43:37.177966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec81cc-a5c0-47ff-8252-0b9bd16bc7c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:43:37.178748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec81cc-a5c0-47ff-8252-0b9bd16bc7c6 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:43:37.179139 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec81cc-a5c0-47ff-8252-0b9bd16bc7c6 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:43:37.179545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec81cc-a5c0-47ff-8252-0b9bd16bc7c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:43:37.181483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-51ec81cc-a5c0-47ff-8252-0b9bd16bc7c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:43:37.197399 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec81cc-a5c0-47ff-8252-0b9bd16bc7c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:43:37.199667 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec81cc-a5c0-47ff-8252-0b9bd16bc7c6 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:43:37.222632 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4317/8681] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:43:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:43:38.929261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07992c45-16e1-4d07-809e-2f8aecc16f4e service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:43:38.942568 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07992c45-16e1-4d07-809e-2f8aecc16f4e service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:43:38.946762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057304d1-a54b-4568-889d-f452a9357bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:43:38.947629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057304d1-a54b-4568-889d-f452a9357bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:43:38.947988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057304d1-a54b-4568-889d-f452a9357bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:43:38.948362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057304d1-a54b-4568-889d-f452a9357bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:43:38.950247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-057304d1-a54b-4568-889d-f452a9357bb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:43:38.966304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057304d1-a54b-4568-889d-f452a9357bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:43:38.968127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057304d1-a54b-4568-889d-f452a9357bb3 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:43:38.983835 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4365/8682] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:43:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:43:39.669728 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec81cc-a5c0-47ff-8252-0b9bd16bc7c6 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:43:39.671929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-51ec81cc-a5c0-47ff-8252-0b9bd16bc7c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:43:39.690679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec81cc-a5c0-47ff-8252-0b9bd16bc7c6 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:43:39.696569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9adc8-9032-431c-a359-5247971ffd10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:43:39.697194 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9adc8-9032-431c-a359-5247971ffd10 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:43:39.697479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9adc8-9032-431c-a359-5247971ffd10 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:43:39.697760 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9adc8-9032-431c-a359-5247971ffd10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:43:39.699560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-92e9adc8-9032-431c-a359-5247971ffd10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:43:39.718873 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9adc8-9032-431c-a359-5247971ffd10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:43:39.720691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9adc8-9032-431c-a359-5247971ffd10 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:43:39.735299 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4318/8683] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:43:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:43:45.719377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057304d1-a54b-4568-889d-f452a9357bb3 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:43:45.739113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057304d1-a54b-4568-889d-f452a9357bb3 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:43:45.744969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f949ef4-7923-4a14-836e-d7d8f8f3969f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:43:45.745739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f949ef4-7923-4a14-836e-d7d8f8f3969f service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:43:45.746128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f949ef4-7923-4a14-836e-d7d8f8f3969f service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:43:45.746472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f949ef4-7923-4a14-836e-d7d8f8f3969f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:43:45.748437 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0f949ef4-7923-4a14-836e-d7d8f8f3969f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:43:45.766058 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f949ef4-7923-4a14-836e-d7d8f8f3969f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:43:45.767730 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f949ef4-7923-4a14-836e-d7d8f8f3969f service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:43:45.782518 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4366/8684] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:43:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:43:49.727360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=21 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:43:55.777450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=81 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:05.683419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9adc8-9032-431c-a359-5247971ffd10 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:05.684947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-92e9adc8-9032-431c-a359-5247971ffd10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:05.794618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9adc8-9032-431c-a359-5247971ffd10 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:05.800440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fad21-d53f-411b-b977-8c2403f127c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:05.801077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fad21-d53f-411b-b977-8c2403f127c9 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:05.801362 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fad21-d53f-411b-b977-8c2403f127c9 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:05.801627 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fad21-d53f-411b-b977-8c2403f127c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:05.803473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ee6fad21-d53f-411b-b977-8c2403f127c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:05.819767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fad21-d53f-411b-b977-8c2403f127c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:05.821711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fad21-d53f-411b-b977-8c2403f127c9 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:05.835649 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4319/8685] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:46:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:46:09.157378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f949ef4-7923-4a14-836e-d7d8f8f3969f service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:09.204481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f949ef4-7923-4a14-836e-d7d8f8f3969f service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:09.208419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107379cc-538f-4738-824c-f7da235f67e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:09.209042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107379cc-538f-4738-824c-f7da235f67e3 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:09.209326 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107379cc-538f-4738-824c-f7da235f67e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:09.209603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107379cc-538f-4738-824c-f7da235f67e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:09.211491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-107379cc-538f-4738-824c-f7da235f67e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:09.300501 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107379cc-538f-4738-824c-f7da235f67e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:09.301946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107379cc-538f-4738-824c-f7da235f67e3 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:09.321319 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4367/8686] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:46:12.457505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fad21-d53f-411b-b977-8c2403f127c9 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:12.489654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fad21-d53f-411b-b977-8c2403f127c9 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:12.498137 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81aaf39-4bbc-4ea2-b5ca-3d7b7bf15d97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:12.498931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81aaf39-4bbc-4ea2-b5ca-3d7b7bf15d97 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:12.499366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81aaf39-4bbc-4ea2-b5ca-3d7b7bf15d97 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:12.499704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81aaf39-4bbc-4ea2-b5ca-3d7b7bf15d97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:12.501831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b81aaf39-4bbc-4ea2-b5ca-3d7b7bf15d97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:12.520899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81aaf39-4bbc-4ea2-b5ca-3d7b7bf15d97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:12.522762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81aaf39-4bbc-4ea2-b5ca-3d7b7bf15d97 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:12.537632 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4320/8687] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:46:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:46:15.392870 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107379cc-538f-4738-824c-f7da235f67e3 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:15.408818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107379cc-538f-4738-824c-f7da235f67e3 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:15.415592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5407f-c0a9-4d8e-90a0-da85453780b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:15.416234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5407f-c0a9-4d8e-90a0-da85453780b8 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:15.416639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5407f-c0a9-4d8e-90a0-da85453780b8 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:15.416928 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5407f-c0a9-4d8e-90a0-da85453780b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:15.418891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-74b5407f-c0a9-4d8e-90a0-da85453780b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:15.437024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5407f-c0a9-4d8e-90a0-da85453780b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:15.438815 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5407f-c0a9-4d8e-90a0-da85453780b8 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:15.460869 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4368/8688] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:46:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:46:15.469166 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81aaf39-4bbc-4ea2-b5ca-3d7b7bf15d97 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:15.471325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b81aaf39-4bbc-4ea2-b5ca-3d7b7bf15d97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:15.485578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81aaf39-4bbc-4ea2-b5ca-3d7b7bf15d97 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:15.490237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f713889-daf2-4036-82d6-979f936fe225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:15.490878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f713889-daf2-4036-82d6-979f936fe225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:15.491163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f713889-daf2-4036-82d6-979f936fe225 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:15.491480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f713889-daf2-4036-82d6-979f936fe225 admin admin] PATH_INFO: `/v3/users/e062653d52144a3a91277e045033f27a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:15.493210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f713889-daf2-4036-82d6-979f936fe225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e062653d52144a3a91277e045033f27a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:15.495143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f713889-daf2-4036-82d6-979f936fe225 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:15.543962 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7f713889-daf2-4036-82d6-979f936fe225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e062653d52144a3a91277e045033f27a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:15.544629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7f713889-daf2-4036-82d6-979f936fe225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e062653d52144a3a91277e045033f27a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:15.557216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7f713889-daf2-4036-82d6-979f936fe225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e062653d52144a3a91277e045033f27a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:15.557859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7f713889-daf2-4036-82d6-979f936fe225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e062653d52144a3a91277e045033f27a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:15.565428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7f713889-daf2-4036-82d6-979f936fe225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e062653d52144a3a91277e045033f27a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:15.578676 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4321/8689] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:46:15 2022] DELETE /identity/v3/users/e062653d52144a3a91277e045033f27a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:46:15.753154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5407f-c0a9-4d8e-90a0-da85453780b8 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:15.766207 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5407f-c0a9-4d8e-90a0-da85453780b8 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:15.830890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b8018-dda3-4421-8cd3-9d8556f06ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:15.831605 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b8018-dda3-4421-8cd3-9d8556f06ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:15.831895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b8018-dda3-4421-8cd3-9d8556f06ade admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:15.832180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b8018-dda3-4421-8cd3-9d8556f06ade admin admin] PATH_INFO: `/v3/projects/cc59858bd4e749cab7d1d772d65e4111` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:15.833347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b8018-dda3-4421-8cd3-9d8556f06ade admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc59858bd4e749cab7d1d772d65e4111)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:15.835304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b8018-dda3-4421-8cd3-9d8556f06ade admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:15.868140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:15.884223 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6a8b8018-dda3-4421-8cd3-9d8556f06ade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc59858bd4e749cab7d1d772d65e4111', 'request_id': 'req-6a8b8018-dda3-4421-8cd3-9d8556f06ade'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:15.890721 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6a8b8018-dda3-4421-8cd3-9d8556f06ade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc59858bd4e749cab7d1d772d65e4111', 'request_id': 'req-6a8b8018-dda3-4421-8cd3-9d8556f06ade'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:15.898575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6a8b8018-dda3-4421-8cd3-9d8556f06ade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc59858bd4e749cab7d1d772d65e4111', 'request_id': 'req-6a8b8018-dda3-4421-8cd3-9d8556f06ade'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:15.909601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6a8b8018-dda3-4421-8cd3-9d8556f06ade admin admin] The token cache is being invalidate because project cc59858bd4e749cab7d1d772d65e4111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:46:15.909917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6a8b8018-dda3-4421-8cd3-9d8556f06ade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:15.910540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-6a8b8018-dda3-4421-8cd3-9d8556f06ade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:15.912086 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4369/8690] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:46:15 2022] DELETE /identity/v3/projects/cc59858bd4e749cab7d1d772d65e4111 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:46:15.916832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f713889-daf2-4036-82d6-979f936fe225 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:15.918295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7f713889-daf2-4036-82d6-979f936fe225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:15.931821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f713889-daf2-4036-82d6-979f936fe225 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:15.972314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:15.992866 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf7764-6f39-467d-9271-4f68d8090e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:15.993523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf7764-6f39-467d-9271-4f68d8090e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:15.993805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf7764-6f39-467d-9271-4f68d8090e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:15.994083 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf7764-6f39-467d-9271-4f68d8090e51 admin admin] PATH_INFO: `/v3/users/d66a9a0d50294a8ba272151cae81f7c2` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:15.995340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf7764-6f39-467d-9271-4f68d8090e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d66a9a0d50294a8ba272151cae81f7c2)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:15.997301 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf7764-6f39-467d-9271-4f68d8090e51 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:16.043382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1daf7764-6f39-467d-9271-4f68d8090e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd66a9a0d50294a8ba272151cae81f7c2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:16.044037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1daf7764-6f39-467d-9271-4f68d8090e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd66a9a0d50294a8ba272151cae81f7c2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:16.055762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1daf7764-6f39-467d-9271-4f68d8090e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd66a9a0d50294a8ba272151cae81f7c2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:16.056398 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1daf7764-6f39-467d-9271-4f68d8090e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd66a9a0d50294a8ba272151cae81f7c2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:16.063915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-1daf7764-6f39-467d-9271-4f68d8090e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd66a9a0d50294a8ba272151cae81f7c2'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:16.076706 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4322/8691] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:46:15 2022] DELETE /identity/v3/users/d66a9a0d50294a8ba272151cae81f7c2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:46:16.259679 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b8018-dda3-4421-8cd3-9d8556f06ade admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:16.261357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6a8b8018-dda3-4421-8cd3-9d8556f06ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:16.276274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b8018-dda3-4421-8cd3-9d8556f06ade admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:16.341703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f69f82-0199-4ca3-84b9-ddaef51c0d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:16.342387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f69f82-0199-4ca3-84b9-ddaef51c0d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:16.342663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f69f82-0199-4ca3-84b9-ddaef51c0d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:16.342947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f69f82-0199-4ca3-84b9-ddaef51c0d7c admin admin] PATH_INFO: `/v3/projects/bb0c514b014146f68f6b46d2e1d137cc` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:16.344183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f69f82-0199-4ca3-84b9-ddaef51c0d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb0c514b014146f68f6b46d2e1d137cc)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:16.346277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f69f82-0199-4ca3-84b9-ddaef51c0d7c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:16.393829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-76f69f82-0199-4ca3-84b9-ddaef51c0d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb0c514b014146f68f6b46d2e1d137cc', 'request_id': 'req-76f69f82-0199-4ca3-84b9-ddaef51c0d7c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:16.400688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-76f69f82-0199-4ca3-84b9-ddaef51c0d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb0c514b014146f68f6b46d2e1d137cc', 'request_id': 'req-76f69f82-0199-4ca3-84b9-ddaef51c0d7c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:16.407715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-76f69f82-0199-4ca3-84b9-ddaef51c0d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb0c514b014146f68f6b46d2e1d137cc', 'request_id': 'req-76f69f82-0199-4ca3-84b9-ddaef51c0d7c'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:16.418894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-76f69f82-0199-4ca3-84b9-ddaef51c0d7c admin admin] The token cache is being invalidate because project bb0c514b014146f68f6b46d2e1d137cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:46:16.419192 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-76f69f82-0199-4ca3-84b9-ddaef51c0d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:16.419911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-76f69f82-0199-4ca3-84b9-ddaef51c0d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:16.421443 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4370/8692] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:46:16 2022] DELETE /identity/v3/projects/bb0c514b014146f68f6b46d2e1d137cc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:46:26.073299 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:26.416257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=65,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:26.727205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a74c1-9d91-4252-9c5a-65a61faa91e1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:26.727523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a74c1-9d91-4252-9c5a-65a61faa91e1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:26.727802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a74c1-9d91-4252-9c5a-65a61faa91e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:26.792994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7f6a74c1-9d91-4252-9c5a-65a61faa91e1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:46:26.794204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7f6a74c1-9d91-4252-9c5a-65a61faa91e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:26.852567 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4323/8693] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:46:26.861835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717680b-8884-4dad-b2d5-b3e0c55fc4d6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:26.862133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717680b-8884-4dad-b2d5-b3e0c55fc4d6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:26.862419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717680b-8884-4dad-b2d5-b3e0c55fc4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:26.881703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b717680b-8884-4dad-b2d5-b3e0c55fc4d6 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:46:26.882919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b717680b-8884-4dad-b2d5-b3e0c55fc4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:26.891893 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4371/8694] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:46:26.896682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a74c1-9d91-4252-9c5a-65a61faa91e1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:26.907494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a74c1-9d91-4252-9c5a-65a61faa91e1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:26.912055 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21184a3-ca18-438e-9562-0707575f761b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:26.912654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21184a3-ca18-438e-9562-0707575f761b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:26.912935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21184a3-ca18-438e-9562-0707575f761b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:26.913207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21184a3-ca18-438e-9562-0707575f761b admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:26.913899 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21184a3-ca18-438e-9562-0707575f761b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:46:26.914202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21184a3-ca18-438e-9562-0707575f761b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:26.915817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21184a3-ca18-438e-9562-0707575f761b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:26.927193 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4324/8695] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:46:26.937498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717680b-8884-4dad-b2d5-b3e0c55fc4d6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:26.946868 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717680b-8884-4dad-b2d5-b3e0c55fc4d6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:26.952362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44f6b3-4d1c-4a13-a866-7e5ac59f8370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:26.952981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44f6b3-4d1c-4a13-a866-7e5ac59f8370 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:26.953269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44f6b3-4d1c-4a13-a866-7e5ac59f8370 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:26.953548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44f6b3-4d1c-4a13-a866-7e5ac59f8370 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:26.954221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44f6b3-4d1c-4a13-a866-7e5ac59f8370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:26.956185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44f6b3-4d1c-4a13-a866-7e5ac59f8370 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:26.996073 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4372/8696] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:46:26 2022] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:46:26.997250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21184a3-ca18-438e-9562-0707575f761b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:27.007653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21184a3-ca18-438e-9562-0707575f761b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:27.064387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4442b2-2466-4659-8b7f-660579c34386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:27.065006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4442b2-2466-4659-8b7f-660579c34386 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:27.065293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4442b2-2466-4659-8b7f-660579c34386 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:27.065574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4442b2-2466-4659-8b7f-660579c34386 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:27.066230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4442b2-2466-4659-8b7f-660579c34386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:27.068177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4442b2-2466-4659-8b7f-660579c34386 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:27.089673 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4325/8697] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:46:26 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:46:27.094264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44f6b3-4d1c-4a13-a866-7e5ac59f8370 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:27.104814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44f6b3-4d1c-4a13-a866-7e5ac59f8370 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:27.109534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d7400-9548-4b05-a6e9-d2841add01a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:27.110168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d7400-9548-4b05-a6e9-d2841add01a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:27.110462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d7400-9548-4b05-a6e9-d2841add01a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:27.110743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d7400-9548-4b05-a6e9-d2841add01a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:27.111481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d7400-9548-4b05-a6e9-d2841add01a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:27.113087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d7400-9548-4b05-a6e9-d2841add01a0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:27.123592 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4373/8698] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:46:27.127654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4442b2-2466-4659-8b7f-660579c34386 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:27.138487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4442b2-2466-4659-8b7f-660579c34386 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:27.143363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307f4a2-2f76-4db4-8407-6419c50965c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:27.144001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307f4a2-2f76-4db4-8407-6419c50965c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:27.144291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307f4a2-2f76-4db4-8407-6419c50965c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:27.144598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307f4a2-2f76-4db4-8407-6419c50965c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:27.145318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307f4a2-2f76-4db4-8407-6419c50965c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:27.146922 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307f4a2-2f76-4db4-8407-6419c50965c5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:27.157756 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4326/8699] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:46:27.161895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d7400-9548-4b05-a6e9-d2841add01a0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:27.172012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d7400-9548-4b05-a6e9-d2841add01a0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:27.176708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24827bd-efef-4616-82fe-0ad8b98fb6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:27.177366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24827bd-efef-4616-82fe-0ad8b98fb6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:27.177654 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24827bd-efef-4616-82fe-0ad8b98fb6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:27.177934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24827bd-efef-4616-82fe-0ad8b98fb6dc admin admin] PATH_INFO: `/v3/projects/a7c57b1993494c8b99141f943666bd72/users/7bec108879034d339f614b54e83ef240/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:27.192908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24827bd-efef-4616-82fe-0ad8b98fb6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c57b1993494c8b99141f943666bd72, user_id=7bec108879034d339f614b54e83ef240, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:27.195584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24827bd-efef-4616-82fe-0ad8b98fb6dc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:27.208654 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4374/8700] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:46:27 2022] PUT /identity/v3/projects/a7c57b1993494c8b99141f943666bd72/users/7bec108879034d339f614b54e83ef240/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:46:27.221658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62890ee3-0116-419f-924a-ead51213ed42 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:27.221955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62890ee3-0116-419f-924a-ead51213ed42 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:27.222275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62890ee3-0116-419f-924a-ead51213ed42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:27.256551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-62890ee3-0116-419f-924a-ead51213ed42 None None] MFA Rules not processed for user `7bec108879034d339f614b54e83ef240`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:46:27.257701 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-62890ee3-0116-419f-924a-ead51213ed42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:27.282240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:27.329271 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4327/8701] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:46:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:46:27.333973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24827bd-efef-4616-82fe-0ad8b98fb6dc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:27.411036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24827bd-efef-4616-82fe-0ad8b98fb6dc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:27.418144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97ee13-1bfb-4dff-968b-8629859e1aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:27.418770 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97ee13-1bfb-4dff-968b-8629859e1aaa admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:27.419055 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97ee13-1bfb-4dff-968b-8629859e1aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:27.419402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97ee13-1bfb-4dff-968b-8629859e1aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:27.420265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97ee13-1bfb-4dff-968b-8629859e1aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:27.422739 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97ee13-1bfb-4dff-968b-8629859e1aaa admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:27.453862 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4375/8702] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:46:27 2022] POST /identity/v3/projects => generated 393 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:46:27.456206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62890ee3-0116-419f-924a-ead51213ed42 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:27.466970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62890ee3-0116-419f-924a-ead51213ed42 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:27.524020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db15b8-865c-4d0a-a4ee-409657bf9ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:27.524569 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db15b8-865c-4d0a-a4ee-409657bf9ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:27.524854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db15b8-865c-4d0a-a4ee-409657bf9ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:27.525135 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db15b8-865c-4d0a-a4ee-409657bf9ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:27.525839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db15b8-865c-4d0a-a4ee-409657bf9ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:27.527774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db15b8-865c-4d0a-a4ee-409657bf9ee0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:27.549189 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4328/8703] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:46:27 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:46:27.553337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97ee13-1bfb-4dff-968b-8629859e1aaa admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:27.564394 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97ee13-1bfb-4dff-968b-8629859e1aaa admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:27.569050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244cae8-9890-4891-9083-45fcc8cc5a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:27.569653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244cae8-9890-4891-9083-45fcc8cc5a0f admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:27.569937 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244cae8-9890-4891-9083-45fcc8cc5a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:27.570210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244cae8-9890-4891-9083-45fcc8cc5a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:27.570921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244cae8-9890-4891-9083-45fcc8cc5a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:27.572589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244cae8-9890-4891-9083-45fcc8cc5a0f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:27.585934 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4376/8704] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:46:27.587775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db15b8-865c-4d0a-a4ee-409657bf9ee0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:27.597915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db15b8-865c-4d0a-a4ee-409657bf9ee0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:27.602566 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44a667-f8ae-485a-a6bc-d1cb8df04280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:27.603756 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44a667-f8ae-485a-a6bc-d1cb8df04280 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:27.604048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44a667-f8ae-485a-a6bc-d1cb8df04280 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:27.604327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44a667-f8ae-485a-a6bc-d1cb8df04280 admin admin] PATH_INFO: `/v3/projects/6d3141efeb044988a1ff104123a61866/users/7e61b96047d1489288d77933432b767e/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:27.619657 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44a667-f8ae-485a-a6bc-d1cb8df04280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3141efeb044988a1ff104123a61866, user_id=7e61b96047d1489288d77933432b767e, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:27.622294 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44a667-f8ae-485a-a6bc-d1cb8df04280 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:27.635557 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4329/8705] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:46:27 2022] PUT /identity/v3/projects/6d3141efeb044988a1ff104123a61866/users/7e61b96047d1489288d77933432b767e/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:46:27.639757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244cae8-9890-4891-9083-45fcc8cc5a0f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:27.649803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244cae8-9890-4891-9083-45fcc8cc5a0f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:27.706113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d5196-49c6-4264-a0f1-3691cb41a832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:27.707115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d5196-49c6-4264-a0f1-3691cb41a832 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:27.707467 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d5196-49c6-4264-a0f1-3691cb41a832 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:27.707769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d5196-49c6-4264-a0f1-3691cb41a832 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:27.708481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d5196-49c6-4264-a0f1-3691cb41a832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:27.710109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d5196-49c6-4264-a0f1-3691cb41a832 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:27.713482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:27.724440 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4377/8706] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:46:27.729836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44a667-f8ae-485a-a6bc-d1cb8df04280 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:27.740874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44a667-f8ae-485a-a6bc-d1cb8df04280 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:27.746219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2eb26-fbe9-4ab7-b318-8b6dcff8a615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:27.746971 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2eb26-fbe9-4ab7-b318-8b6dcff8a615 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:27.747259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2eb26-fbe9-4ab7-b318-8b6dcff8a615 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:27.747576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2eb26-fbe9-4ab7-b318-8b6dcff8a615 admin admin] PATH_INFO: `/v3/projects/6d3141efeb044988a1ff104123a61866/users/7e61b96047d1489288d77933432b767e/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:27.749617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2eb26-fbe9-4ab7-b318-8b6dcff8a615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3141efeb044988a1ff104123a61866, user_id=7e61b96047d1489288d77933432b767e, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:27.752310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2eb26-fbe9-4ab7-b318-8b6dcff8a615 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:27.763442 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4330/8707] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:46:27 2022] PUT /identity/v3/projects/6d3141efeb044988a1ff104123a61866/users/7e61b96047d1489288d77933432b767e/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:46:27.775876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6629b-572f-4636-94d5-984ea1cba57d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:27.776110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6629b-572f-4636-94d5-984ea1cba57d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:27.776395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6629b-572f-4636-94d5-984ea1cba57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:27.806556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-f2f6629b-572f-4636-94d5-984ea1cba57d None None] MFA Rules not processed for user `7e61b96047d1489288d77933432b767e`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:46:27.807830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f2f6629b-572f-4636-94d5-984ea1cba57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:27.875632 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4378/8708] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:46:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:46:27.889266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5159c-54f6-4d06-880a-c04cf61f17af None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:27.889557 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5159c-54f6-4d06-880a-c04cf61f17af None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:27.889838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5159c-54f6-4d06-880a-c04cf61f17af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:27.909774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d6e5159c-54f6-4d06-880a-c04cf61f17af None None] MFA Rules not processed for user `7bec108879034d339f614b54e83ef240`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:46:27.910990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d6e5159c-54f6-4d06-880a-c04cf61f17af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:27.967642 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4331/8709] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:46:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:46:27.981589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6629b-572f-4636-94d5-984ea1cba57d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:27.983680 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f2f6629b-572f-4636-94d5-984ea1cba57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:28.060776 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6629b-572f-4636-94d5-984ea1cba57d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:28.066423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbe941-93cd-444a-85e0-30df613eca5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:28.067049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbe941-93cd-444a-85e0-30df613eca5a service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:28.067368 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbe941-93cd-444a-85e0-30df613eca5a service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:28.067650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbe941-93cd-444a-85e0-30df613eca5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:28.077120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbbe941-93cd-444a-85e0-30df613eca5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:28.078715 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbbe941-93cd-444a-85e0-30df613eca5a service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:28.088370 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4379/8710] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:46:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:46:37.576857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5159c-54f6-4d06-880a-c04cf61f17af None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:37.578372 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d6e5159c-54f6-4d06-880a-c04cf61f17af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:37.603226 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:37.650877 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5159c-54f6-4d06-880a-c04cf61f17af None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:37.654449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d495fa6-0e9d-48ba-a4f9-0ddcb7793634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:37.655062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d495fa6-0e9d-48ba-a4f9-0ddcb7793634 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:37.655377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d495fa6-0e9d-48ba-a4f9-0ddcb7793634 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:37.655654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d495fa6-0e9d-48ba-a4f9-0ddcb7793634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:37.657388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8d495fa6-0e9d-48ba-a4f9-0ddcb7793634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:37.673105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d495fa6-0e9d-48ba-a4f9-0ddcb7793634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:37.674516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d495fa6-0e9d-48ba-a4f9-0ddcb7793634 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:37.688393 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4332/8711] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:46:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:46:38.083601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=69 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:38.863785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbe941-93cd-444a-85e0-30df613eca5a service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:38.865228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cfbbe941-93cd-444a-85e0-30df613eca5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:38.880249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbe941-93cd-444a-85e0-30df613eca5a service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:38.883897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187bac2-9793-41bb-84f9-916fc735831a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:38.884506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187bac2-9793-41bb-84f9-916fc735831a service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:38.885453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187bac2-9793-41bb-84f9-916fc735831a service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:38.885741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187bac2-9793-41bb-84f9-916fc735831a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:38.887778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7187bac2-9793-41bb-84f9-916fc735831a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:38.903623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187bac2-9793-41bb-84f9-916fc735831a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:38.905053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187bac2-9793-41bb-84f9-916fc735831a service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:38.924411 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4380/8712] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:46:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:46:42.582928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d495fa6-0e9d-48ba-a4f9-0ddcb7793634 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:42.597003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d495fa6-0e9d-48ba-a4f9-0ddcb7793634 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:42.602503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10fdc3-952e-40f3-83f9-6eadb26ba9df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:42.603106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10fdc3-952e-40f3-83f9-6eadb26ba9df service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:42.603911 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10fdc3-952e-40f3-83f9-6eadb26ba9df service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:42.604188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10fdc3-952e-40f3-83f9-6eadb26ba9df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:42.612298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10fdc3-952e-40f3-83f9-6eadb26ba9df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:42.613862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10fdc3-952e-40f3-83f9-6eadb26ba9df service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:42.623907 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4333/8713] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:46:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:46:42.639558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001cc1b-9da2-4768-8be2-ad11a993b9df None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:42.640002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001cc1b-9da2-4768-8be2-ad11a993b9df None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:42.640233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001cc1b-9da2-4768-8be2-ad11a993b9df None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:42.641582 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4381/8714] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:46:42.646207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10fdc3-952e-40f3-83f9-6eadb26ba9df service nova] Authenticating service token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:46:42.660492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10fdc3-952e-40f3-83f9-6eadb26ba9df service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:42.669387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10fdc3-952e-40f3-83f9-6eadb26ba9df service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:42.674093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ae828-6c6f-4901-a110-b1ae57d12102 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e61b96047d1489288d77933432b767e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3141efeb044988a1ff104123a61866', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:42.674724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ae828-6c6f-4901-a110-b1ae57d12102 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:42.675014 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ae828-6c6f-4901-a110-b1ae57d12102 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:42.675317 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ae828-6c6f-4901-a110-b1ae57d12102 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] PATH_INFO: `/v3/projects/6d3141efeb044988a1ff104123a61866` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:42.676501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ae828-6c6f-4901-a110-b1ae57d12102 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] RBAC: Authorizing `identity:get_project(project_id=6d3141efeb044988a1ff104123a61866)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:42.678277 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ae828-6c6f-4901-a110-b1ae57d12102 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:42.679972 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4334/8715] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:46:42 2022] GET /identity/v3/projects/6d3141efeb044988a1ff104123a61866 => generated 393 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:46:42.841915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001cc1b-9da2-4768-8be2-ad11a993b9df None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:42.856105 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001cc1b-9da2-4768-8be2-ad11a993b9df None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:42.859624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ab4b7-94ee-4371-aea5-96001b53a5c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:42.860228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ab4b7-94ee-4371-aea5-96001b53a5c1 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:42.860512 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ab4b7-94ee-4371-aea5-96001b53a5c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:42.860787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ab4b7-94ee-4371-aea5-96001b53a5c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:42.862547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f86ab4b7-94ee-4371-aea5-96001b53a5c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:42.874487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ab4b7-94ee-4371-aea5-96001b53a5c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:42.876023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ab4b7-94ee-4371-aea5-96001b53a5c1 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:42.886773 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4382/8716] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:46:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:46:43.041275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e35314-e15b-4bb4-b647-2cd036a8842e None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:43.041781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e35314-e15b-4bb4-b647-2cd036a8842e None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:43.042213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e35314-e15b-4bb4-b647-2cd036a8842e None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:43.043610 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4335/8717] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 30 21:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:46:43.048719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ab4b7-94ee-4371-aea5-96001b53a5c1 service neutron] Authenticating service token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 30 21:46:43.050177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f86ab4b7-94ee-4371-aea5-96001b53a5c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:43.069534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ab4b7-94ee-4371-aea5-96001b53a5c1 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:43.080974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ab4b7-94ee-4371-aea5-96001b53a5c1 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:43.085836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b74eb-c5f1-455e-9be3-c4013216c084 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e61b96047d1489288d77933432b767e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3141efeb044988a1ff104123a61866', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:43.086813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b74eb-c5f1-455e-9be3-c4013216c084 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:43.087275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b74eb-c5f1-455e-9be3-c4013216c084 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:43.087587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b74eb-c5f1-455e-9be3-c4013216c084 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] PATH_INFO: `/v3/projects/6d3141efeb044988a1ff104123a61866` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:43.089408 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b74eb-c5f1-455e-9be3-c4013216c084 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] RBAC: Authorizing `identity:get_project(project_id=6d3141efeb044988a1ff104123a61866)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:43.091202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b74eb-c5f1-455e-9be3-c4013216c084 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:43.092949 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4383/8718] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 30 21:46:43 2022] GET /identity/v3/projects/6d3141efeb044988a1ff104123a61866 => generated 393 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 30 21:46:45.923151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e35314-e15b-4bb4-b647-2cd036a8842e None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:45.987582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e35314-e15b-4bb4-b647-2cd036a8842e None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:45.992181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904d892-8dcf-45ba-856f-a1777befe76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:45.992859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904d892-8dcf-45ba-856f-a1777befe76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:45.993155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904d892-8dcf-45ba-856f-a1777befe76a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:45.993439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904d892-8dcf-45ba-856f-a1777befe76a admin admin] PATH_INFO: `/v3/users/7bec108879034d339f614b54e83ef240` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:45.995152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904d892-8dcf-45ba-856f-a1777befe76a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bec108879034d339f614b54e83ef240)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:45.997128 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904d892-8dcf-45ba-856f-a1777befe76a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:46.045840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c904d892-8dcf-45ba-856f-a1777befe76a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bec108879034d339f614b54e83ef240'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:46.046522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c904d892-8dcf-45ba-856f-a1777befe76a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bec108879034d339f614b54e83ef240'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:46.059090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c904d892-8dcf-45ba-856f-a1777befe76a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bec108879034d339f614b54e83ef240'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:46.059813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c904d892-8dcf-45ba-856f-a1777befe76a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bec108879034d339f614b54e83ef240'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:46.066937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-c904d892-8dcf-45ba-856f-a1777befe76a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bec108879034d339f614b54e83ef240'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:46.079202 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4336/8719] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:46:45 2022] DELETE /identity/v3/users/7bec108879034d339f614b54e83ef240 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:46:46.083825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17447439-ddb7-4556-bce7-e2d52a4120b2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:46.084299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17447439-ddb7-4556-bce7-e2d52a4120b2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:46.084492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17447439-ddb7-4556-bce7-e2d52a4120b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:46.104555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-17447439-ddb7-4556-bce7-e2d52a4120b2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:46:46.105761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-17447439-ddb7-4556-bce7-e2d52a4120b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:46.163174 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4384/8720] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:46:46.173420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904d892-8dcf-45ba-856f-a1777befe76a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:46.174822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c904d892-8dcf-45ba-856f-a1777befe76a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:46.189267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:46.238579 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904d892-8dcf-45ba-856f-a1777befe76a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:46.242556 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5ed81-07c3-4e58-9026-b242b885d006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:46.243197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5ed81-07c3-4e58-9026-b242b885d006 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:46.243517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5ed81-07c3-4e58-9026-b242b885d006 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:46.243799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5ed81-07c3-4e58-9026-b242b885d006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:46.253894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5ed81-07c3-4e58-9026-b242b885d006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:46.255409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5ed81-07c3-4e58-9026-b242b885d006 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:46.265213 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4337/8721] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:46:46.720181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17447439-ddb7-4556-bce7-e2d52a4120b2 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:46.721613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-17447439-ddb7-4556-bce7-e2d52a4120b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:46.734337 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17447439-ddb7-4556-bce7-e2d52a4120b2 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:46.739034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43134ef9-eddb-4222-b366-a8866ec718fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:46.739722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43134ef9-eddb-4222-b366-a8866ec718fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:46.740011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43134ef9-eddb-4222-b366-a8866ec718fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:46.740287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43134ef9-eddb-4222-b366-a8866ec718fc admin admin] PATH_INFO: `/v3/projects/a7c57b1993494c8b99141f943666bd72` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:46.741802 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43134ef9-eddb-4222-b366-a8866ec718fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7c57b1993494c8b99141f943666bd72)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:46.743797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43134ef9-eddb-4222-b366-a8866ec718fc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:46.793415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43134ef9-eddb-4222-b366-a8866ec718fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7c57b1993494c8b99141f943666bd72', 'request_id': 'req-43134ef9-eddb-4222-b366-a8866ec718fc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:46.799545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43134ef9-eddb-4222-b366-a8866ec718fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7c57b1993494c8b99141f943666bd72', 'request_id': 'req-43134ef9-eddb-4222-b366-a8866ec718fc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:46.806793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43134ef9-eddb-4222-b366-a8866ec718fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7c57b1993494c8b99141f943666bd72', 'request_id': 'req-43134ef9-eddb-4222-b366-a8866ec718fc'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:46.817296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43134ef9-eddb-4222-b366-a8866ec718fc admin admin] The token cache is being invalidate because project a7c57b1993494c8b99141f943666bd72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:46:46.817757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43134ef9-eddb-4222-b366-a8866ec718fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:46.818416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-43134ef9-eddb-4222-b366-a8866ec718fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:46.819979 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4385/8722] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:46:46 2022] DELETE /identity/v3/projects/a7c57b1993494c8b99141f943666bd72 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:46:46.824607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5ed81-07c3-4e58-9026-b242b885d006 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:46.834503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5ed81-07c3-4e58-9026-b242b885d006 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:46.890671 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f2e47-d0c5-4451-aaf1-9b06eb9dd920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:46.891341 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f2e47-d0c5-4451-aaf1-9b06eb9dd920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:46.891634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f2e47-d0c5-4451-aaf1-9b06eb9dd920 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:46.891915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f2e47-d0c5-4451-aaf1-9b06eb9dd920 admin admin] PATH_INFO: `/v3/users/7e61b96047d1489288d77933432b767e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:46.893114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f2e47-d0c5-4451-aaf1-9b06eb9dd920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e61b96047d1489288d77933432b767e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:46.895036 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f2e47-d0c5-4451-aaf1-9b06eb9dd920 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:46.942352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-398f2e47-d0c5-4451-aaf1-9b06eb9dd920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e61b96047d1489288d77933432b767e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:46.942968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-398f2e47-d0c5-4451-aaf1-9b06eb9dd920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e61b96047d1489288d77933432b767e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:46.955097 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-398f2e47-d0c5-4451-aaf1-9b06eb9dd920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e61b96047d1489288d77933432b767e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:46.955785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-398f2e47-d0c5-4451-aaf1-9b06eb9dd920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e61b96047d1489288d77933432b767e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:46.962987 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-398f2e47-d0c5-4451-aaf1-9b06eb9dd920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e61b96047d1489288d77933432b767e'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:46.975277 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4338/8723] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:46:46 2022] DELETE /identity/v3/users/7e61b96047d1489288d77933432b767e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:46:47.257499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43134ef9-eddb-4222-b366-a8866ec718fc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:47.258955 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-43134ef9-eddb-4222-b366-a8866ec718fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:47.272778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43134ef9-eddb-4222-b366-a8866ec718fc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:47.318628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:47.332383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f4475-58b3-47d9-8027-dca0fe24e7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:47.333028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f4475-58b3-47d9-8027-dca0fe24e7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:47.333310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f4475-58b3-47d9-8027-dca0fe24e7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:47.333582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f4475-58b3-47d9-8027-dca0fe24e7fd admin admin] PATH_INFO: `/v3/projects/6d3141efeb044988a1ff104123a61866` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:47.334722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f4475-58b3-47d9-8027-dca0fe24e7fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d3141efeb044988a1ff104123a61866)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:47.336651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f4475-58b3-47d9-8027-dca0fe24e7fd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:47.384398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ad5f4475-58b3-47d9-8027-dca0fe24e7fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d3141efeb044988a1ff104123a61866', 'request_id': 'req-ad5f4475-58b3-47d9-8027-dca0fe24e7fd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:47.390831 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ad5f4475-58b3-47d9-8027-dca0fe24e7fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d3141efeb044988a1ff104123a61866', 'request_id': 'req-ad5f4475-58b3-47d9-8027-dca0fe24e7fd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:47.398788 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ad5f4475-58b3-47d9-8027-dca0fe24e7fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d3141efeb044988a1ff104123a61866', 'request_id': 'req-ad5f4475-58b3-47d9-8027-dca0fe24e7fd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:47.409655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ad5f4475-58b3-47d9-8027-dca0fe24e7fd admin admin] The token cache is being invalidate because project 6d3141efeb044988a1ff104123a61866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:46:47.409950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ad5f4475-58b3-47d9-8027-dca0fe24e7fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:47.410589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-ad5f4475-58b3-47d9-8027-dca0fe24e7fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:46:47.412178 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4386/8724] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:46:47 2022] DELETE /identity/v3/projects/6d3141efeb044988a1ff104123a61866 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:46:47.418857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c72e99-254d-423c-8c17-902d1ebb3027 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:47.419152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c72e99-254d-423c-8c17-902d1ebb3027 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:47.419487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c72e99-254d-423c-8c17-902d1ebb3027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:47.440732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-26c72e99-254d-423c-8c17-902d1ebb3027 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:46:47.441959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-26c72e99-254d-423c-8c17-902d1ebb3027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:47.471527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:47.503509 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4339/8725] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:46:47.512575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36030a99-26e7-40e5-9571-e7dd007a4cb5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:47.512867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36030a99-26e7-40e5-9571-e7dd007a4cb5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:47.513147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36030a99-26e7-40e5-9571-e7dd007a4cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:47.532971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-36030a99-26e7-40e5-9571-e7dd007a4cb5 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:46:47.534180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-36030a99-26e7-40e5-9571-e7dd007a4cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:47.542257 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4387/8726] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:46:47.546336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c72e99-254d-423c-8c17-902d1ebb3027 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:47.556116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c72e99-254d-423c-8c17-902d1ebb3027 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:47.560716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f8c0e-985d-4de0-b4f7-bd3beddc49ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:47.561321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f8c0e-985d-4de0-b4f7-bd3beddc49ae admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:47.561606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f8c0e-985d-4de0-b4f7-bd3beddc49ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:47.561884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f8c0e-985d-4de0-b4f7-bd3beddc49ae admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:47.562611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f8c0e-985d-4de0-b4f7-bd3beddc49ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:46:47.562916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f8c0e-985d-4de0-b4f7-bd3beddc49ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:47.564541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f8c0e-985d-4de0-b4f7-bd3beddc49ae admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:47.576545 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4340/8727] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:46:47.581044 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36030a99-26e7-40e5-9571-e7dd007a4cb5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:47.590935 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36030a99-26e7-40e5-9571-e7dd007a4cb5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:47.595656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e270aa-28d3-4dae-a28c-f08d915b7f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:47.596259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e270aa-28d3-4dae-a28c-f08d915b7f05 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:47.596539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e270aa-28d3-4dae-a28c-f08d915b7f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:47.596843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e270aa-28d3-4dae-a28c-f08d915b7f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:47.597506 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e270aa-28d3-4dae-a28c-f08d915b7f05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:47.599409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e270aa-28d3-4dae-a28c-f08d915b7f05 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:47.625823 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4388/8728] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:46:47 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:46:47.630041 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f8c0e-985d-4de0-b4f7-bd3beddc49ae admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:47.641061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f8c0e-985d-4de0-b4f7-bd3beddc49ae admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:47.698880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add599a-141f-4b54-a8ba-0b83b904ae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:47.699581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add599a-141f-4b54-a8ba-0b83b904ae52 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:47.699884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add599a-141f-4b54-a8ba-0b83b904ae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:47.700159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add599a-141f-4b54-a8ba-0b83b904ae52 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:47.700818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add599a-141f-4b54-a8ba-0b83b904ae52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:47.702729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add599a-141f-4b54-a8ba-0b83b904ae52 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:47.724733 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4341/8729] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:46:47 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:46:47.729046 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e270aa-28d3-4dae-a28c-f08d915b7f05 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:47.739784 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e270aa-28d3-4dae-a28c-f08d915b7f05 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:47.744452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6eb6a-1b5e-46ea-815e-b3e540b43025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:47.745059 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6eb6a-1b5e-46ea-815e-b3e540b43025 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:47.745343 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6eb6a-1b5e-46ea-815e-b3e540b43025 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:47.745621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6eb6a-1b5e-46ea-815e-b3e540b43025 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:47.746311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6eb6a-1b5e-46ea-815e-b3e540b43025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:47.748133 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6eb6a-1b5e-46ea-815e-b3e540b43025 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:47.758257 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4389/8730] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:46:47.762969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add599a-141f-4b54-a8ba-0b83b904ae52 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:47.773094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add599a-141f-4b54-a8ba-0b83b904ae52 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:47.778424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749b141-6314-4430-8c7c-bc7366f5e0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:47.779026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749b141-6314-4430-8c7c-bc7366f5e0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:47.779337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749b141-6314-4430-8c7c-bc7366f5e0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:47.779626 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749b141-6314-4430-8c7c-bc7366f5e0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:47.780312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749b141-6314-4430-8c7c-bc7366f5e0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:47.781903 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749b141-6314-4430-8c7c-bc7366f5e0f4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:47.792515 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4342/8731] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:46:47.796559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6eb6a-1b5e-46ea-815e-b3e540b43025 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:47.806758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6eb6a-1b5e-46ea-815e-b3e540b43025 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:47.811543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5e52d-74da-4d52-a868-481696bf9357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:47.812336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5e52d-74da-4d52-a868-481696bf9357 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:47.812633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5e52d-74da-4d52-a868-481696bf9357 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:47.812915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5e52d-74da-4d52-a868-481696bf9357 admin admin] PATH_INFO: `/v3/projects/d275969596b84899b2ef27b6d269d3f3/users/8505261efa7442379b2a9089ca4d56b9/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:47.828015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5e52d-74da-4d52-a868-481696bf9357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d275969596b84899b2ef27b6d269d3f3, user_id=8505261efa7442379b2a9089ca4d56b9, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:47.830694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5e52d-74da-4d52-a868-481696bf9357 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:47.844260 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4390/8732] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:46:47 2022] PUT /identity/v3/projects/d275969596b84899b2ef27b6d269d3f3/users/8505261efa7442379b2a9089ca4d56b9/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:46:47.849409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc204d8-67f8-4e78-a630-5d058fe9ab30 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:47.849700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc204d8-67f8-4e78-a630-5d058fe9ab30 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:47.849979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc204d8-67f8-4e78-a630-5d058fe9ab30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:47.868486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8cc204d8-67f8-4e78-a630-5d058fe9ab30 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:46:47.870230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8cc204d8-67f8-4e78-a630-5d058fe9ab30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:47.930406 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4343/8733] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:46:47.940854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5e52d-74da-4d52-a868-481696bf9357 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:47.942578 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-68a5e52d-74da-4d52-a868-481696bf9357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:48.002362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5e52d-74da-4d52-a868-481696bf9357 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:48.006213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621c2cf-c528-4220-b3f4-15ea04a05d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:48.006837 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621c2cf-c528-4220-b3f4-15ea04a05d46 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:48.007121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621c2cf-c528-4220-b3f4-15ea04a05d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:48.007455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621c2cf-c528-4220-b3f4-15ea04a05d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:48.018070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621c2cf-c528-4220-b3f4-15ea04a05d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:48.019543 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621c2cf-c528-4220-b3f4-15ea04a05d46 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:48.029579 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4391/8734] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:46:51.801470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c088ba-2409-49cd-b32a-dc15b35915d8 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:51.801985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c088ba-2409-49cd-b32a-dc15b35915d8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:51.802183 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c088ba-2409-49cd-b32a-dc15b35915d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:51.837686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-50c088ba-2409-49cd-b32a-dc15b35915d8 None None] MFA Rules not processed for user `8505261efa7442379b2a9089ca4d56b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:46:51.838927 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-50c088ba-2409-49cd-b32a-dc15b35915d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:51.871381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:51.912618 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4344/8735] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:46:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:46:51.924661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9b017-8a3d-404f-95f7-64f7a7103e56 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:51.925166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9b017-8a3d-404f-95f7-64f7a7103e56 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:51.925255 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9b017-8a3d-404f-95f7-64f7a7103e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:51.944760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-87b9b017-8a3d-404f-95f7-64f7a7103e56 None None] MFA Rules not processed for user `8505261efa7442379b2a9089ca4d56b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:46:51.946012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-87b9b017-8a3d-404f-95f7-64f7a7103e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:51.954323 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4392/8736] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:46:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:46:51.966832 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c088ba-2409-49cd-b32a-dc15b35915d8 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:51.968251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-50c088ba-2409-49cd-b32a-dc15b35915d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:52.064608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c088ba-2409-49cd-b32a-dc15b35915d8 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:52.072817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf152912-6136-4bcc-ae53-3cbdfe3f67b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:52.073460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf152912-6136-4bcc-ae53-3cbdfe3f67b3 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:52.073750 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf152912-6136-4bcc-ae53-3cbdfe3f67b3 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:52.074031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf152912-6136-4bcc-ae53-3cbdfe3f67b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:52.082543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf152912-6136-4bcc-ae53-3cbdfe3f67b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:52.084189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf152912-6136-4bcc-ae53-3cbdfe3f67b3 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:52.094394 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4345/8737] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:46:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:46:54.408130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9b017-8a3d-404f-95f7-64f7a7103e56 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:46:54.432517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9b017-8a3d-404f-95f7-64f7a7103e56 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:46:54.441840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be049c9-4f36-46e8-a163-8790212f041e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:46:54.442561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be049c9-4f36-46e8-a163-8790212f041e service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:46:54.442918 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be049c9-4f36-46e8-a163-8790212f041e service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:46:54.443431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be049c9-4f36-46e8-a163-8790212f041e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:46:54.451001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4be049c9-4f36-46e8-a163-8790212f041e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:46:54.467386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be049c9-4f36-46e8-a163-8790212f041e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:46:54.469367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be049c9-4f36-46e8-a163-8790212f041e service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:46:54.473081 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:54.487493 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4393/8738] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:46:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:47:02.089292 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=48 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:03.931217 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf152912-6136-4bcc-ae53-3cbdfe3f67b3 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:47:03.932788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cf152912-6136-4bcc-ae53-3cbdfe3f67b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:47:03.947838 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf152912-6136-4bcc-ae53-3cbdfe3f67b3 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:47:03.951607 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5865bc-e9e9-42b8-b65a-fef08a200f10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:47:03.952225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5865bc-e9e9-42b8-b65a-fef08a200f10 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:03.952509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5865bc-e9e9-42b8-b65a-fef08a200f10 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:03.952789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5865bc-e9e9-42b8-b65a-fef08a200f10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:03.954523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8d5865bc-e9e9-42b8-b65a-fef08a200f10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:47:03.967635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5865bc-e9e9-42b8-b65a-fef08a200f10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:47:03.969444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5865bc-e9e9-42b8-b65a-fef08a200f10 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:47:03.981769 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4346/8739] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:47:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:47:04.073614 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b551b0-8c96-403e-8466-87f2bc59ce03 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:04.074148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b551b0-8c96-403e-8466-87f2bc59ce03 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:04.074238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b551b0-8c96-403e-8466-87f2bc59ce03 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:04.075575 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4394/8740] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:47:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 30 21:47:04.080444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39a7b3-acaf-483a-ae92-9fa4078291f4 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:04.080741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39a7b3-acaf-483a-ae92-9fa4078291f4 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:04.081149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39a7b3-acaf-483a-ae92-9fa4078291f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:04.119608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-aa39a7b3-acaf-483a-ae92-9fa4078291f4 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:47:04.120801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-aa39a7b3-acaf-483a-ae92-9fa4078291f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:47:04.184181 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4347/8741] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:47:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:47:04.207531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b551b0-8c96-403e-8466-87f2bc59ce03 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:47:04.209247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f1b551b0-8c96-403e-8466-87f2bc59ce03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:47:04.229470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b551b0-8c96-403e-8466-87f2bc59ce03 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:47:04.234890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8540151-d184-4e21-87dd-d0e6ce063985 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:47:04.235538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8540151-d184-4e21-87dd-d0e6ce063985 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:04.235828 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8540151-d184-4e21-87dd-d0e6ce063985 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:04.236104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8540151-d184-4e21-87dd-d0e6ce063985 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:04.244817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8540151-d184-4e21-87dd-d0e6ce063985 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:47:04.246315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8540151-d184-4e21-87dd-d0e6ce063985 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:47:04.256240 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4395/8742] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:47:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:47:04.427562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39a7b3-acaf-483a-ae92-9fa4078291f4 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:47:04.440152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39a7b3-acaf-483a-ae92-9fa4078291f4 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:47:04.443658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e3b0e-51aa-4d5a-9700-af3e53fbd8b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:47:04.444366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e3b0e-51aa-4d5a-9700-af3e53fbd8b2 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:04.444654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e3b0e-51aa-4d5a-9700-af3e53fbd8b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:04.444929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e3b0e-51aa-4d5a-9700-af3e53fbd8b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:04.446658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0f2e3b0e-51aa-4d5a-9700-af3e53fbd8b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:47:04.464604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e3b0e-51aa-4d5a-9700-af3e53fbd8b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:47:04.466514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e3b0e-51aa-4d5a-9700-af3e53fbd8b2 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:47:04.481872 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4348/8743] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:47:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:47:14.252136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=7 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:14.474122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=47 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:42.895265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8540151-d184-4e21-87dd-d0e6ce063985 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:47:42.910001 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8540151-d184-4e21-87dd-d0e6ce063985 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:47:42.914733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd520999-5272-4f44-b0c1-46ccbca5b0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:47:42.915505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd520999-5272-4f44-b0c1-46ccbca5b0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:42.916511 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd520999-5272-4f44-b0c1-46ccbca5b0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:42.916878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd520999-5272-4f44-b0c1-46ccbca5b0d5 admin admin] PATH_INFO: `/v3/users/8505261efa7442379b2a9089ca4d56b9` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:42.919141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd520999-5272-4f44-b0c1-46ccbca5b0d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8505261efa7442379b2a9089ca4d56b9)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:47:42.921251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd520999-5272-4f44-b0c1-46ccbca5b0d5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:47:42.975597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd520999-5272-4f44-b0c1-46ccbca5b0d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8505261efa7442379b2a9089ca4d56b9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:47:42.988358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd520999-5272-4f44-b0c1-46ccbca5b0d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8505261efa7442379b2a9089ca4d56b9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:47:42.989049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd520999-5272-4f44-b0c1-46ccbca5b0d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8505261efa7442379b2a9089ca4d56b9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:47:43.000091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd520999-5272-4f44-b0c1-46ccbca5b0d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8505261efa7442379b2a9089ca4d56b9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:47:43.000785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-dd520999-5272-4f44-b0c1-46ccbca5b0d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8505261efa7442379b2a9089ca4d56b9'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:47:43.015578 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4396/8744] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:47:42 2022] DELETE /identity/v3/users/8505261efa7442379b2a9089ca4d56b9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:47:43.188078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e3b0e-51aa-4d5a-9700-af3e53fbd8b2 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:47:43.202334 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e3b0e-51aa-4d5a-9700-af3e53fbd8b2 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:47:43.263764 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280ea99-a43e-4e8a-99b7-41fb04257d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:47:43.264417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280ea99-a43e-4e8a-99b7-41fb04257d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:43.264704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280ea99-a43e-4e8a-99b7-41fb04257d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:43.264989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280ea99-a43e-4e8a-99b7-41fb04257d9b admin admin] PATH_INFO: `/v3/projects/d275969596b84899b2ef27b6d269d3f3` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:43.266162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280ea99-a43e-4e8a-99b7-41fb04257d9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d275969596b84899b2ef27b6d269d3f3)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:47:43.268116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280ea99-a43e-4e8a-99b7-41fb04257d9b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:47:43.315344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a280ea99-a43e-4e8a-99b7-41fb04257d9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd275969596b84899b2ef27b6d269d3f3', 'request_id': 'req-a280ea99-a43e-4e8a-99b7-41fb04257d9b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:47:43.322774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a280ea99-a43e-4e8a-99b7-41fb04257d9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd275969596b84899b2ef27b6d269d3f3', 'request_id': 'req-a280ea99-a43e-4e8a-99b7-41fb04257d9b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:47:43.328524 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a280ea99-a43e-4e8a-99b7-41fb04257d9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd275969596b84899b2ef27b6d269d3f3', 'request_id': 'req-a280ea99-a43e-4e8a-99b7-41fb04257d9b'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:47:43.339916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a280ea99-a43e-4e8a-99b7-41fb04257d9b admin admin] The token cache is being invalidate because project d275969596b84899b2ef27b6d269d3f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:47:43.340212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a280ea99-a43e-4e8a-99b7-41fb04257d9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:47:43.340846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-a280ea99-a43e-4e8a-99b7-41fb04257d9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:47:43.342359 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4349/8745] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:47:43 2022] DELETE /identity/v3/projects/d275969596b84899b2ef27b6d269d3f3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:47:43.347417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3544bc-38a3-4e4b-aced-543732702b46 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:43.347768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3544bc-38a3-4e4b-aced-543732702b46 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:43.348053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3544bc-38a3-4e4b-aced-543732702b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:43.367849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-2f3544bc-38a3-4e4b-aced-543732702b46 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:47:43.369039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2f3544bc-38a3-4e4b-aced-543732702b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:47:43.430303 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4397/8746] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:47:43.438886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01dcb7-659a-4d19-b414-33642e74134a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:43.439177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01dcb7-659a-4d19-b414-33642e74134a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:43.439502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01dcb7-659a-4d19-b414-33642e74134a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:43.459467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4b01dcb7-659a-4d19-b414-33642e74134a None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:47:43.460689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4b01dcb7-659a-4d19-b414-33642e74134a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:47:43.469573 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4350/8747] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:47:43.474094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3544bc-38a3-4e4b-aced-543732702b46 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:47:43.486364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3544bc-38a3-4e4b-aced-543732702b46 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:47:43.491072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672bcb5-367c-4592-80c2-445cf2bca854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:47:43.491732 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672bcb5-367c-4592-80c2-445cf2bca854 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:43.492023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672bcb5-367c-4592-80c2-445cf2bca854 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:43.492302 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672bcb5-367c-4592-80c2-445cf2bca854 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:43.493002 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672bcb5-367c-4592-80c2-445cf2bca854 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:47:43.493309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672bcb5-367c-4592-80c2-445cf2bca854 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:47:43.494952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672bcb5-367c-4592-80c2-445cf2bca854 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:47:43.506608 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4398/8748] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:47:43.511582 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01dcb7-659a-4d19-b414-33642e74134a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:47:43.521542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01dcb7-659a-4d19-b414-33642e74134a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:47:43.527314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af872d-b6c7-4579-93f4-9a7bed348cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:47:43.527937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af872d-b6c7-4579-93f4-9a7bed348cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:43.528223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af872d-b6c7-4579-93f4-9a7bed348cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:43.528503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af872d-b6c7-4579-93f4-9a7bed348cc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:43.529161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af872d-b6c7-4579-93f4-9a7bed348cc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:47:43.531065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af872d-b6c7-4579-93f4-9a7bed348cc9 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:47:43.557447 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4351/8749] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:47:43 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:47:43.561734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672bcb5-367c-4592-80c2-445cf2bca854 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:47:43.575760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672bcb5-367c-4592-80c2-445cf2bca854 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:47:43.642618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb9bcf-d3ca-437d-b011-662943dc404c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:47:43.643250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb9bcf-d3ca-437d-b011-662943dc404c admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:43.643575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb9bcf-d3ca-437d-b011-662943dc404c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:43.643857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb9bcf-d3ca-437d-b011-662943dc404c admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:43.644534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb9bcf-d3ca-437d-b011-662943dc404c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:47:43.646476 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb9bcf-d3ca-437d-b011-662943dc404c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:47:43.656107 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:43.672901 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4399/8750] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:47:43 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:47:43.676444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af872d-b6c7-4579-93f4-9a7bed348cc9 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:47:43.687002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af872d-b6c7-4579-93f4-9a7bed348cc9 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:47:43.692017 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129518db-cd35-4dd4-b08c-b97b010c5a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:47:43.692635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129518db-cd35-4dd4-b08c-b97b010c5a37 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:43.692923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129518db-cd35-4dd4-b08c-b97b010c5a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:43.693204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129518db-cd35-4dd4-b08c-b97b010c5a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:43.693932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129518db-cd35-4dd4-b08c-b97b010c5a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:47:43.695652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129518db-cd35-4dd4-b08c-b97b010c5a37 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:47:43.706492 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4352/8751] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:47:43.710594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb9bcf-d3ca-437d-b011-662943dc404c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:47:43.722899 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb9bcf-d3ca-437d-b011-662943dc404c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:47:43.729847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3777de6-cddb-4c4b-8b00-69140f9db74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:47:43.730481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3777de6-cddb-4c4b-8b00-69140f9db74c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:43.731941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3777de6-cddb-4c4b-8b00-69140f9db74c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:43.732239 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3777de6-cddb-4c4b-8b00-69140f9db74c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:43.733127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3777de6-cddb-4c4b-8b00-69140f9db74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:47:43.734779 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3777de6-cddb-4c4b-8b00-69140f9db74c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:47:43.746376 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4400/8752] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:47:43.750578 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129518db-cd35-4dd4-b08c-b97b010c5a37 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:47:43.761359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129518db-cd35-4dd4-b08c-b97b010c5a37 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:47:43.766466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd3aeb-92ff-493e-9f3c-590ee62805e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:47:43.767129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd3aeb-92ff-493e-9f3c-590ee62805e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:43.767456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd3aeb-92ff-493e-9f3c-590ee62805e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:43.767739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd3aeb-92ff-493e-9f3c-590ee62805e1 admin admin] PATH_INFO: `/v3/projects/d6fde8f046df422fa52fe982d42e95a5/users/45bbff38b6eb4ef6a4e32a1569d32493/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:43.783200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd3aeb-92ff-493e-9f3c-590ee62805e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6fde8f046df422fa52fe982d42e95a5, user_id=45bbff38b6eb4ef6a4e32a1569d32493, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:47:43.785887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd3aeb-92ff-493e-9f3c-590ee62805e1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:47:43.801625 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4353/8753] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:47:43 2022] PUT /identity/v3/projects/d6fde8f046df422fa52fe982d42e95a5/users/45bbff38b6eb4ef6a4e32a1569d32493/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:47:43.807470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50980a-2d10-4009-bd64-203e14f8701f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:43.807756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50980a-2d10-4009-bd64-203e14f8701f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:43.808032 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50980a-2d10-4009-bd64-203e14f8701f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:43.827620 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ea50980a-2d10-4009-bd64-203e14f8701f None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:47:43.828734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ea50980a-2d10-4009-bd64-203e14f8701f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:47:43.888847 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4401/8754] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:47:43.898250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2dac6-edb4-413f-aa12-fd97c5635814 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:43.898541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2dac6-edb4-413f-aa12-fd97c5635814 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:43.898824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2dac6-edb4-413f-aa12-fd97c5635814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:43.940422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b7b2dac6-edb4-413f-aa12-fd97c5635814 None None] MFA Rules not processed for user `4a886ccf9590432caf209526410a7b53`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:47:43.941859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b7b2dac6-edb4-413f-aa12-fd97c5635814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:47:43.953887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:44.001216 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4354/8755] 10.222.0.17 () {58 vars in 1062 bytes} [Sat Jul 30 21:47:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:47:44.007569 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50980a-2d10-4009-bd64-203e14f8701f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:47:44.018531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50980a-2d10-4009-bd64-203e14f8701f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:47:44.022300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b8f42-945a-4b5d-a267-3ca4f835ae17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:47:44.022917 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b8f42-945a-4b5d-a267-3ca4f835ae17 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:44.023205 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b8f42-945a-4b5d-a267-3ca4f835ae17 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:44.023519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b8f42-945a-4b5d-a267-3ca4f835ae17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:44.036677 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b8f42-945a-4b5d-a267-3ca4f835ae17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:47:44.038119 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b8f42-945a-4b5d-a267-3ca4f835ae17 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:47:44.049976 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4402/8756] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:47:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:47:48.219955 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1191be2-cf5d-4f18-931c-67a2b0adc1f1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:48.220511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1191be2-cf5d-4f18-931c-67a2b0adc1f1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:48.220511 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1191be2-cf5d-4f18-931c-67a2b0adc1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:48.251943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e1191be2-cf5d-4f18-931c-67a2b0adc1f1 None None] MFA Rules not processed for user `45bbff38b6eb4ef6a4e32a1569d32493`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:47:48.253164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e1191be2-cf5d-4f18-931c-67a2b0adc1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:47:48.348240 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4355/8757] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:47:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:47:48.359238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b374a-e586-4d53-a0f1-60559512b986 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:48.360219 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b374a-e586-4d53-a0f1-60559512b986 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:48.360509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b374a-e586-4d53-a0f1-60559512b986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:48.381163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-739b374a-e586-4d53-a0f1-60559512b986 None None] MFA Rules not processed for user `45bbff38b6eb4ef6a4e32a1569d32493`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:47:48.382402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-739b374a-e586-4d53-a0f1-60559512b986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:47:48.394111 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4403/8758] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:47:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:47:48.407553 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1191be2-cf5d-4f18-931c-67a2b0adc1f1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:47:48.409013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e1191be2-cf5d-4f18-931c-67a2b0adc1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:47:48.501378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1191be2-cf5d-4f18-931c-67a2b0adc1f1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:47:48.508996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516e0bb-6ba9-4c4e-a49c-cedc9ea67bae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:47:48.509855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e0bb-6ba9-4c4e-a49c-cedc9ea67bae service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:48.510184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e0bb-6ba9-4c4e-a49c-cedc9ea67bae service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:48.510471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e0bb-6ba9-4c4e-a49c-cedc9ea67bae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:48.523552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516e0bb-6ba9-4c4e-a49c-cedc9ea67bae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:47:48.526203 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516e0bb-6ba9-4c4e-a49c-cedc9ea67bae service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:47:48.537046 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4356/8759] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:47:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:47:58.374994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=3,keystone:SELECT=43 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:58.532162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=83 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:59.908789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7788fc-ba69-43a1-af9f-fa54ed46f6f9 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:59.909336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7788fc-ba69-43a1-af9f-fa54ed46f6f9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:59.909336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7788fc-ba69-43a1-af9f-fa54ed46f6f9 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:59.910714 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4404/8760] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:47:59.916994 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7ad1c-e396-41e0-80ea-53bb1d2b1c7a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:47:59.917473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7ad1c-e396-41e0-80ea-53bb1d2b1c7a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:47:59.917473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7ad1c-e396-41e0-80ea-53bb1d2b1c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:47:59.938223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9bc7ad1c-e396-41e0-80ea-53bb1d2b1c7a None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:47:59.939495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9bc7ad1c-e396-41e0-80ea-53bb1d2b1c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:48:00.011774 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4357/8761] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:47:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:48:00.032752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7788fc-ba69-43a1-af9f-fa54ed46f6f9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:48:00.034469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4e7788fc-ba69-43a1-af9f-fa54ed46f6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:48:00.053673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7788fc-ba69-43a1-af9f-fa54ed46f6f9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:48:00.058741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecd3fe-a6ab-4147-8663-576a165971e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:48:00.059393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecd3fe-a6ab-4147-8663-576a165971e3 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:48:00.059683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecd3fe-a6ab-4147-8663-576a165971e3 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:48:00.059963 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecd3fe-a6ab-4147-8663-576a165971e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:48:00.068352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecd3fe-a6ab-4147-8663-576a165971e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:48:00.069926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecd3fe-a6ab-4147-8663-576a165971e3 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:48:00.080245 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4405/8762] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:48:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:48:10.002366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=29 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:48:10.076208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:48:30.168990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7ad1c-e396-41e0-80ea-53bb1d2b1c7a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:48:30.182940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7ad1c-e396-41e0-80ea-53bb1d2b1c7a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:48:30.187975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3054b2-76ad-4881-9bcb-f23af77b239f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:48:30.188577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3054b2-76ad-4881-9bcb-f23af77b239f service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:48:30.188858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3054b2-76ad-4881-9bcb-f23af77b239f service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:48:30.189130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3054b2-76ad-4881-9bcb-f23af77b239f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:48:30.190879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6a3054b2-76ad-4881-9bcb-f23af77b239f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:48:30.216910 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3054b2-76ad-4881-9bcb-f23af77b239f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:48:30.218475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3054b2-76ad-4881-9bcb-f23af77b239f service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:48:30.231463 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4358/8763] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:48:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:48:38.031766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecd3fe-a6ab-4147-8663-576a165971e3 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:48:38.042113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecd3fe-a6ab-4147-8663-576a165971e3 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:48:38.045836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abda84e-91d4-49c9-b168-0059cbf3f13a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:48:38.046712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda84e-91d4-49c9-b168-0059cbf3f13a service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:48:38.046998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda84e-91d4-49c9-b168-0059cbf3f13a service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:48:38.047272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda84e-91d4-49c9-b168-0059cbf3f13a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:48:38.049053 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7abda84e-91d4-49c9-b168-0059cbf3f13a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:48:38.065760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abda84e-91d4-49c9-b168-0059cbf3f13a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:48:38.067196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abda84e-91d4-49c9-b168-0059cbf3f13a service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:48:38.079462 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4406/8764] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:48:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:48:38.091150 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3054b2-76ad-4881-9bcb-f23af77b239f service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:48:38.105092 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3054b2-76ad-4881-9bcb-f23af77b239f service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:48:38.110382 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e2807-f64c-419a-b1f4-34fd37117d8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:48:38.111037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e2807-f64c-419a-b1f4-34fd37117d8b service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:48:38.111352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e2807-f64c-419a-b1f4-34fd37117d8b service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:48:38.111638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e2807-f64c-419a-b1f4-34fd37117d8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:48:38.113388 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b25e2807-f64c-419a-b1f4-34fd37117d8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:48:38.128795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e2807-f64c-419a-b1f4-34fd37117d8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:48:38.130390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e2807-f64c-419a-b1f4-34fd37117d8b service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:48:38.144915 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4359/8765] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:48:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:48:41.951869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8125c-77e5-4d47-b081-2a3587d811e8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:48:41.952393 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8125c-77e5-4d47-b081-2a3587d811e8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:48:41.952487 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8125c-77e5-4d47-b081-2a3587d811e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:48:41.971909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e2b8125c-77e5-4d47-b081-2a3587d811e8 None None] MFA Rules not processed for user `45bbff38b6eb4ef6a4e32a1569d32493`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:48:41.973124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e2b8125c-77e5-4d47-b081-2a3587d811e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:48:41.980781 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4407/8766] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:48:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:48:42.232763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a808c-26f7-4664-9302-3105b14b3110 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:48:42.233244 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a808c-26f7-4664-9302-3105b14b3110 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:48:42.233345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a808c-26f7-4664-9302-3105b14b3110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:48:42.263314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5c2a808c-26f7-4664-9302-3105b14b3110 None None] MFA Rules not processed for user `4a886ccf9590432caf209526410a7b53`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:48:42.264784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5c2a808c-26f7-4664-9302-3105b14b3110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:48:42.271274 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4360/8767] 10.222.0.17 () {58 vars in 1062 bytes} [Sat Jul 30 21:48:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:48:42.277729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8125c-77e5-4d47-b081-2a3587d811e8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:48:42.287235 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8125c-77e5-4d47-b081-2a3587d811e8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:48:42.290893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6732dfb-6832-4ea0-9da1-1ae283c0e876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:48:42.292138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6732dfb-6832-4ea0-9da1-1ae283c0e876 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:48:42.292428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6732dfb-6832-4ea0-9da1-1ae283c0e876 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:48:42.292707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6732dfb-6832-4ea0-9da1-1ae283c0e876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:48:42.294457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e6732dfb-6832-4ea0-9da1-1ae283c0e876 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:48:42.306703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6732dfb-6832-4ea0-9da1-1ae283c0e876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:48:42.308190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6732dfb-6832-4ea0-9da1-1ae283c0e876 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:48:42.318772 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4408/8768] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:48:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:48:42.632330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fdb69-ff40-4ea6-9010-da4e1be0d965 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:48:42.632630 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fdb69-ff40-4ea6-9010-da4e1be0d965 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:48:42.632915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fdb69-ff40-4ea6-9010-da4e1be0d965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:48:42.653980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-1a1fdb69-ff40-4ea6-9010-da4e1be0d965 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:48:42.655192 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1a1fdb69-ff40-4ea6-9010-da4e1be0d965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:48:42.664025 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4361/8769] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:48:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:48:42.675142 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6732dfb-6832-4ea0-9da1-1ae283c0e876 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:48:42.676741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e6732dfb-6832-4ea0-9da1-1ae283c0e876 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:48:42.695317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6732dfb-6832-4ea0-9da1-1ae283c0e876 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:48:42.701037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e488d-52b4-42a3-8e3c-6bc07b6818b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:48:42.701658 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e488d-52b4-42a3-8e3c-6bc07b6818b2 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:48:42.701947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e488d-52b4-42a3-8e3c-6bc07b6818b2 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:48:42.702246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e488d-52b4-42a3-8e3c-6bc07b6818b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:48:42.710563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e488d-52b4-42a3-8e3c-6bc07b6818b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:48:42.712173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e488d-52b4-42a3-8e3c-6bc07b6818b2 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:48:42.722660 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4409/8770] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:48:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:48:45.015519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fdb69-ff40-4ea6-9010-da4e1be0d965 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:48:45.035839 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fdb69-ff40-4ea6-9010-da4e1be0d965 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:48:45.044201 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d4e45-e75a-4f98-b26d-3d0fb4862951 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:48:45.044878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d4e45-e75a-4f98-b26d-3d0fb4862951 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:48:45.045160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d4e45-e75a-4f98-b26d-3d0fb4862951 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:48:45.045605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d4e45-e75a-4f98-b26d-3d0fb4862951 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:48:45.048061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-762d4e45-e75a-4f98-b26d-3d0fb4862951 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:48:45.068721 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d4e45-e75a-4f98-b26d-3d0fb4862951 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:48:45.070503 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d4e45-e75a-4f98-b26d-3d0fb4862951 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:48:45.084847 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4362/8771] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:48:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:48:49.194959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e488d-52b4-42a3-8e3c-6bc07b6818b2 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:48:49.196473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1a3e488d-52b4-42a3-8e3c-6bc07b6818b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:48:49.217981 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e488d-52b4-42a3-8e3c-6bc07b6818b2 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:48:49.223720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6714a1b-576d-4928-afe2-98f98b44fbfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:48:49.224355 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6714a1b-576d-4928-afe2-98f98b44fbfb service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:48:49.224648 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6714a1b-576d-4928-afe2-98f98b44fbfb service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:48:49.224932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6714a1b-576d-4928-afe2-98f98b44fbfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:48:49.227252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c6714a1b-576d-4928-afe2-98f98b44fbfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:48:49.247023 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6714a1b-576d-4928-afe2-98f98b44fbfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:48:49.248768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6714a1b-576d-4928-afe2-98f98b44fbfb service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:48:49.264382 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4410/8772] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:48:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:48:51.467852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a2c8d-036c-4819-81d2-73c4399288ba None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:48:51.468428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a2c8d-036c-4819-81d2-73c4399288ba None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:48:51.468428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a2c8d-036c-4819-81d2-73c4399288ba None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:48:51.469896 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4363/8773] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:48:51.475028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7abf9-b4f4-4aba-9cf2-14023d0f7a54 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:48:51.475522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7abf9-b4f4-4aba-9cf2-14023d0f7a54 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:48:51.475737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7abf9-b4f4-4aba-9cf2-14023d0f7a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:48:51.496502 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-97c7abf9-b4f4-4aba-9cf2-14023d0f7a54 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:48:51.497719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-97c7abf9-b4f4-4aba-9cf2-14023d0f7a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:48:51.506547 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4411/8774] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:48:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:48:51.527484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a2c8d-036c-4819-81d2-73c4399288ba None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:48:51.544220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a2c8d-036c-4819-81d2-73c4399288ba None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:48:51.549253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c811908-4cb2-4408-a851-5064a34315d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:48:51.549854 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c811908-4cb2-4408-a851-5064a34315d3 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:48:51.550136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c811908-4cb2-4408-a851-5064a34315d3 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:48:51.550413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c811908-4cb2-4408-a851-5064a34315d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:48:51.559314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c811908-4cb2-4408-a851-5064a34315d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:48:51.560881 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c811908-4cb2-4408-a851-5064a34315d3 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:48:51.570950 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4364/8775] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:48:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:48:51.802716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac45543-e6ff-4cb1-a493-ab9ed3c9bf37 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:48:51.803014 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac45543-e6ff-4cb1-a493-ab9ed3c9bf37 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:48:51.803324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac45543-e6ff-4cb1-a493-ab9ed3c9bf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:48:51.824652 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7ac45543-e6ff-4cb1-a493-ab9ed3c9bf37 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:48:51.825864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7ac45543-e6ff-4cb1-a493-ab9ed3c9bf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:48:51.834408 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4412/8776] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:48:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:48:51.845658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c811908-4cb2-4408-a851-5064a34315d3 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:48:51.858916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c811908-4cb2-4408-a851-5064a34315d3 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:48:51.863990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203531b-bd60-421a-aed1-230239c0c635 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:48:51.864592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203531b-bd60-421a-aed1-230239c0c635 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:48:51.864879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203531b-bd60-421a-aed1-230239c0c635 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:48:51.865156 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203531b-bd60-421a-aed1-230239c0c635 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:48:51.874039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203531b-bd60-421a-aed1-230239c0c635 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:48:51.875957 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203531b-bd60-421a-aed1-230239c0c635 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:48:51.887460 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4365/8777] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:48:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:49:01.818915 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=33 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:49:01.882595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=45 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:49:31.608590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac45543-e6ff-4cb1-a493-ab9ed3c9bf37 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:49:31.621724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac45543-e6ff-4cb1-a493-ab9ed3c9bf37 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:49:31.627871 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562a2b3-9cff-467b-b0df-fd16c168fd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:49:31.628822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562a2b3-9cff-467b-b0df-fd16c168fd89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:49:31.629090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562a2b3-9cff-467b-b0df-fd16c168fd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:49:31.629366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562a2b3-9cff-467b-b0df-fd16c168fd89 admin admin] PATH_INFO: `/v3/users/45bbff38b6eb4ef6a4e32a1569d32493` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:49:31.630551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562a2b3-9cff-467b-b0df-fd16c168fd89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45bbff38b6eb4ef6a4e32a1569d32493)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:49:31.632670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562a2b3-9cff-467b-b0df-fd16c168fd89 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:49:31.690111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e562a2b3-9cff-467b-b0df-fd16c168fd89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45bbff38b6eb4ef6a4e32a1569d32493'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:49:31.702090 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e562a2b3-9cff-467b-b0df-fd16c168fd89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45bbff38b6eb4ef6a4e32a1569d32493'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:49:31.702761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e562a2b3-9cff-467b-b0df-fd16c168fd89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45bbff38b6eb4ef6a4e32a1569d32493'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:49:31.710021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e562a2b3-9cff-467b-b0df-fd16c168fd89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45bbff38b6eb4ef6a4e32a1569d32493'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:49:31.710672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-e562a2b3-9cff-467b-b0df-fd16c168fd89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45bbff38b6eb4ef6a4e32a1569d32493'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:49:31.723425 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4413/8778] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:49:31 2022] DELETE /identity/v3/users/45bbff38b6eb4ef6a4e32a1569d32493 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:49:31.898210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203531b-bd60-421a-aed1-230239c0c635 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:49:31.911114 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203531b-bd60-421a-aed1-230239c0c635 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:49:31.972340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077780d-e2ee-4f20-9f62-f49175e99d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:49:31.972995 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077780d-e2ee-4f20-9f62-f49175e99d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:49:31.973288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077780d-e2ee-4f20-9f62-f49175e99d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:49:31.973604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077780d-e2ee-4f20-9f62-f49175e99d2c admin admin] PATH_INFO: `/v3/projects/d6fde8f046df422fa52fe982d42e95a5` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:49:31.974772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077780d-e2ee-4f20-9f62-f49175e99d2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6fde8f046df422fa52fe982d42e95a5)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:49:31.976716 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077780d-e2ee-4f20-9f62-f49175e99d2c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:49:32.025510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7077780d-e2ee-4f20-9f62-f49175e99d2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6fde8f046df422fa52fe982d42e95a5', 'request_id': 'req-7077780d-e2ee-4f20-9f62-f49175e99d2c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:49:32.033378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7077780d-e2ee-4f20-9f62-f49175e99d2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6fde8f046df422fa52fe982d42e95a5', 'request_id': 'req-7077780d-e2ee-4f20-9f62-f49175e99d2c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:49:32.039208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7077780d-e2ee-4f20-9f62-f49175e99d2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6fde8f046df422fa52fe982d42e95a5', 'request_id': 'req-7077780d-e2ee-4f20-9f62-f49175e99d2c'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:49:32.053813 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7077780d-e2ee-4f20-9f62-f49175e99d2c admin admin] The token cache is being invalidate because project d6fde8f046df422fa52fe982d42e95a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:49:32.054105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7077780d-e2ee-4f20-9f62-f49175e99d2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:49:32.054767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7077780d-e2ee-4f20-9f62-f49175e99d2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:49:32.056331 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4366/8779] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:49:31 2022] DELETE /identity/v3/projects/d6fde8f046df422fa52fe982d42e95a5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:49:32.062012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95971bbf-5ceb-4b77-b98a-eec10779e29b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:49:32.062402 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95971bbf-5ceb-4b77-b98a-eec10779e29b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:49:32.062686 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95971bbf-5ceb-4b77-b98a-eec10779e29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:49:32.082024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-95971bbf-5ceb-4b77-b98a-eec10779e29b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:49:32.083237 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-95971bbf-5ceb-4b77-b98a-eec10779e29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:49:32.145427 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4414/8780] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:49:32.154523 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2c475-de45-493e-8f1d-64c0763d1d37 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:49:32.154812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2c475-de45-493e-8f1d-64c0763d1d37 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:49:32.155093 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2c475-de45-493e-8f1d-64c0763d1d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:49:32.176818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-74f2c475-de45-493e-8f1d-64c0763d1d37 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:49:32.178042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-74f2c475-de45-493e-8f1d-64c0763d1d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:49:32.186191 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4367/8781] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:49:32.190724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95971bbf-5ceb-4b77-b98a-eec10779e29b None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:49:32.200931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95971bbf-5ceb-4b77-b98a-eec10779e29b None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:49:32.205561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca468f1-7cb5-4b07-b601-ee217ae76754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:49:32.206172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca468f1-7cb5-4b07-b601-ee217ae76754 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:49:32.206462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca468f1-7cb5-4b07-b601-ee217ae76754 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:49:32.206753 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca468f1-7cb5-4b07-b601-ee217ae76754 admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:49:32.207486 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca468f1-7cb5-4b07-b601-ee217ae76754 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:49:32.207804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca468f1-7cb5-4b07-b601-ee217ae76754 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:49:32.209410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca468f1-7cb5-4b07-b601-ee217ae76754 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:49:32.222027 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4415/8782] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:49:32.227262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2c475-de45-493e-8f1d-64c0763d1d37 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:49:32.237425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2c475-de45-493e-8f1d-64c0763d1d37 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:49:32.242724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68a8bd-ec48-4445-ba6f-fa2777f270b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:49:32.243586 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68a8bd-ec48-4445-ba6f-fa2777f270b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:49:32.243872 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68a8bd-ec48-4445-ba6f-fa2777f270b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:49:32.244184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68a8bd-ec48-4445-ba6f-fa2777f270b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:49:32.244846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68a8bd-ec48-4445-ba6f-fa2777f270b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:49:32.246790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68a8bd-ec48-4445-ba6f-fa2777f270b2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:49:32.274686 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4368/8783] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:49:32 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:49:32.280700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca468f1-7cb5-4b07-b601-ee217ae76754 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:49:32.291103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca468f1-7cb5-4b07-b601-ee217ae76754 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:49:32.351273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f16cb1-d6c2-409a-bb98-5d2e84fae684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:49:32.351933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f16cb1-d6c2-409a-bb98-5d2e84fae684 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:49:32.352215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f16cb1-d6c2-409a-bb98-5d2e84fae684 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:49:32.352491 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f16cb1-d6c2-409a-bb98-5d2e84fae684 admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:49:32.353161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f16cb1-d6c2-409a-bb98-5d2e84fae684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:49:32.355093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f16cb1-d6c2-409a-bb98-5d2e84fae684 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:49:32.363729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:49:32.380816 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4416/8784] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:49:32 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:49:32.384705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68a8bd-ec48-4445-ba6f-fa2777f270b2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:49:32.395611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68a8bd-ec48-4445-ba6f-fa2777f270b2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:49:32.400359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087febd-a6e3-490d-8df0-76a72c2430da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:49:32.400975 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087febd-a6e3-490d-8df0-76a72c2430da admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:49:32.401259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087febd-a6e3-490d-8df0-76a72c2430da admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:49:32.401540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087febd-a6e3-490d-8df0-76a72c2430da admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:49:32.402230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087febd-a6e3-490d-8df0-76a72c2430da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:49:32.404368 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087febd-a6e3-490d-8df0-76a72c2430da admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:49:32.418358 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4369/8785] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:49:32.420261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f16cb1-d6c2-409a-bb98-5d2e84fae684 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:49:32.430908 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f16cb1-d6c2-409a-bb98-5d2e84fae684 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:49:32.436047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8f4d2-7c37-4652-942e-bde9e48315d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:49:32.436674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8f4d2-7c37-4652-942e-bde9e48315d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:49:32.436960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8f4d2-7c37-4652-942e-bde9e48315d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:49:32.437269 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8f4d2-7c37-4652-942e-bde9e48315d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:49:32.437968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8f4d2-7c37-4652-942e-bde9e48315d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:49:32.439610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8f4d2-7c37-4652-942e-bde9e48315d1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:49:32.451940 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4417/8786] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:49:32.456065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087febd-a6e3-490d-8df0-76a72c2430da admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:49:32.466997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087febd-a6e3-490d-8df0-76a72c2430da admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:49:32.471670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7623d63-a631-4cc2-82f9-107c3a916dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:49:32.472326 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7623d63-a631-4cc2-82f9-107c3a916dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:49:32.472610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7623d63-a631-4cc2-82f9-107c3a916dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:49:32.472888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7623d63-a631-4cc2-82f9-107c3a916dcb admin admin] PATH_INFO: `/v3/projects/4d5d85194b3a4a05bd1e5e1af89e5acf/users/bbfd9b97c2004392b2f32631352d95fb/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:49:32.488252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7623d63-a631-4cc2-82f9-107c3a916dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5d85194b3a4a05bd1e5e1af89e5acf, user_id=bbfd9b97c2004392b2f32631352d95fb, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:49:32.490902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7623d63-a631-4cc2-82f9-107c3a916dcb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:49:32.503636 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4370/8787] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:49:32 2022] PUT /identity/v3/projects/4d5d85194b3a4a05bd1e5e1af89e5acf/users/bbfd9b97c2004392b2f32631352d95fb/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:49:32.508848 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53353a7-0279-4728-8f74-25833ed27858 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:49:32.509143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53353a7-0279-4728-8f74-25833ed27858 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:49:32.509458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53353a7-0279-4728-8f74-25833ed27858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:49:32.529662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b53353a7-0279-4728-8f74-25833ed27858 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:49:32.530940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b53353a7-0279-4728-8f74-25833ed27858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:49:32.595412 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4418/8788] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:49:32.605051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7623d63-a631-4cc2-82f9-107c3a916dcb admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:49:32.606765 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b7623d63-a631-4cc2-82f9-107c3a916dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:49:32.638371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:49:32.667906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7623d63-a631-4cc2-82f9-107c3a916dcb admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:49:32.671836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59908c30-1fa0-4488-863c-f0dc278fa07b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:49:32.672466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59908c30-1fa0-4488-863c-f0dc278fa07b service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:49:32.672755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59908c30-1fa0-4488-863c-f0dc278fa07b service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:49:32.673037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59908c30-1fa0-4488-863c-f0dc278fa07b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:49:32.682360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59908c30-1fa0-4488-863c-f0dc278fa07b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:49:32.683867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59908c30-1fa0-4488-863c-f0dc278fa07b service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:49:32.693542 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4371/8789] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:49:36.791410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650d974-1d73-4144-9608-c736324cdeff None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:49:36.792012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650d974-1d73-4144-9608-c736324cdeff None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:49:36.792012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650d974-1d73-4144-9608-c736324cdeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:49:36.829167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b650d974-1d73-4144-9608-c736324cdeff None None] MFA Rules not processed for user `bbfd9b97c2004392b2f32631352d95fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:49:36.830533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b650d974-1d73-4144-9608-c736324cdeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:49:36.905344 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4419/8790] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:49:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:49:36.920729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59908c30-1fa0-4488-863c-f0dc278fa07b service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:49:36.922318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-59908c30-1fa0-4488-863c-f0dc278fa07b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:49:37.010645 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59908c30-1fa0-4488-863c-f0dc278fa07b service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:49:37.016993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decfafc-2e45-4ea9-8424-8964f33d1056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:49:37.017623 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decfafc-2e45-4ea9-8424-8964f33d1056 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:49:37.017908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decfafc-2e45-4ea9-8424-8964f33d1056 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:49:37.018186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decfafc-2e45-4ea9-8424-8964f33d1056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:49:37.026921 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decfafc-2e45-4ea9-8424-8964f33d1056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:49:37.029253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decfafc-2e45-4ea9-8424-8964f33d1056 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:49:37.039108 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4372/8791] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:49:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:49:38.330070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb91d74-8622-4e26-80fe-6113fceadb07 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:49:38.330572 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb91d74-8622-4e26-80fe-6113fceadb07 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:49:38.330666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb91d74-8622-4e26-80fe-6113fceadb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:49:38.360859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7cb91d74-8622-4e26-80fe-6113fceadb07 None None] MFA Rules not processed for user `bbfd9b97c2004392b2f32631352d95fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:49:38.362421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7cb91d74-8622-4e26-80fe-6113fceadb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:49:38.371899 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4420/8792] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:49:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:49:47.036227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=51 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:49:48.354229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:50:27.883499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbf9c2-87be-40ed-8610-a2e80126cc93 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:50:27.884085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbf9c2-87be-40ed-8610-a2e80126cc93 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:50:27.884085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbf9c2-87be-40ed-8610-a2e80126cc93 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:50:27.885476 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4373/8793] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:50:27.891488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a58b8-9406-4e44-8dd9-6f2fb91b2f45 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:50:27.891973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a58b8-9406-4e44-8dd9-6f2fb91b2f45 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:50:27.892184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a58b8-9406-4e44-8dd9-6f2fb91b2f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:50:27.912054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-cb1a58b8-9406-4e44-8dd9-6f2fb91b2f45 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:50:27.913356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cb1a58b8-9406-4e44-8dd9-6f2fb91b2f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:50:27.977912 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4421/8794] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:50:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:50:28.001071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbf9c2-87be-40ed-8610-a2e80126cc93 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:50:28.002829 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-49bbf9c2-87be-40ed-8610-a2e80126cc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:50:28.023058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbf9c2-87be-40ed-8610-a2e80126cc93 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:50:28.028759 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fffec-b0f3-4064-a810-a6609b7a87ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:50:28.029366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fffec-b0f3-4064-a810-a6609b7a87ab service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:50:28.029651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fffec-b0f3-4064-a810-a6609b7a87ab service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:50:28.029929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fffec-b0f3-4064-a810-a6609b7a87ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:50:28.038263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fffec-b0f3-4064-a810-a6609b7a87ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:50:28.039912 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fffec-b0f3-4064-a810-a6609b7a87ab service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:50:28.049580 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4374/8795] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:50:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:50:37.969299 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=29 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:50:38.045562 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:50:50.239717 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700170c-e419-4227-95e9-9d887a535c5e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:50:50.240249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700170c-e419-4227-95e9-9d887a535c5e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:50:50.240249 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700170c-e419-4227-95e9-9d887a535c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:50:50.259676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-6700170c-e419-4227-95e9-9d887a535c5e None None] MFA Rules not processed for user `bbfd9b97c2004392b2f32631352d95fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:50:50.260521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6700170c-e419-4227-95e9-9d887a535c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:50:50.267710 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4422/8796] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:50:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:51:00.253842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:51:37.961821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fffec-b0f3-4064-a810-a6609b7a87ab service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:51:37.963247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a95fffec-b0f3-4064-a810-a6609b7a87ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:51:37.975682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fffec-b0f3-4064-a810-a6609b7a87ab service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:51:37.979248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26150da-8343-46df-abea-3b872641039b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:51:37.979993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26150da-8343-46df-abea-3b872641039b service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:51:37.980283 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26150da-8343-46df-abea-3b872641039b service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:51:37.980560 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26150da-8343-46df-abea-3b872641039b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:51:37.982224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e26150da-8343-46df-abea-3b872641039b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:51:38.011380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26150da-8343-46df-abea-3b872641039b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:51:38.012822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26150da-8343-46df-abea-3b872641039b service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:51:38.027439 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4375/8797] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:51:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:51:39.202113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700170c-e419-4227-95e9-9d887a535c5e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:51:39.211635 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700170c-e419-4227-95e9-9d887a535c5e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:51:39.215821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b2b47-bfc0-49bb-80c8-759ba22b89a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:51:39.216430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b2b47-bfc0-49bb-80c8-759ba22b89a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:51:39.216719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b2b47-bfc0-49bb-80c8-759ba22b89a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:51:39.216998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b2b47-bfc0-49bb-80c8-759ba22b89a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:51:39.219546 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-020b2b47-bfc0-49bb-80c8-759ba22b89a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:51:39.235625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b2b47-bfc0-49bb-80c8-759ba22b89a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:51:39.237045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b2b47-bfc0-49bb-80c8-759ba22b89a3 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:51:39.251128 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4423/8798] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:51:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:51:48.019358 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=11 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:51:49.243253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:51:51.363138 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5534721-69a0-4969-a8b0-14e4fc2adae8 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:51:51.363754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5534721-69a0-4969-a8b0-14e4fc2adae8 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:51:51.363754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5534721-69a0-4969-a8b0-14e4fc2adae8 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:51:51.365135 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4376/8799] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:51:51.370814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8809c-28bb-4c35-9200-939ea26776e3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:51:51.371407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8809c-28bb-4c35-9200-939ea26776e3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:51:51.371407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8809c-28bb-4c35-9200-939ea26776e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:51:51.392021 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-95a8809c-28bb-4c35-9200-939ea26776e3 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:51:51.393231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-95a8809c-28bb-4c35-9200-939ea26776e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:51:51.402440 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4424/8800] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:51:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:51:51.423973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5534721-69a0-4969-a8b0-14e4fc2adae8 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:51:51.425677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b5534721-69a0-4969-a8b0-14e4fc2adae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:51:51.445376 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5534721-69a0-4969-a8b0-14e4fc2adae8 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:51:51.450411 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacd3e5-47c8-43f2-83c2-ca82990217a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:51:51.451010 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacd3e5-47c8-43f2-83c2-ca82990217a0 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:51:51.451318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacd3e5-47c8-43f2-83c2-ca82990217a0 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:51:51.451625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacd3e5-47c8-43f2-83c2-ca82990217a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:51:51.459926 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacd3e5-47c8-43f2-83c2-ca82990217a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:51:51.461490 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacd3e5-47c8-43f2-83c2-ca82990217a0 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:51:51.471625 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4377/8801] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:51:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:51:55.207974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8809c-28bb-4c35-9200-939ea26776e3 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:51:55.217911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8809c-28bb-4c35-9200-939ea26776e3 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:51:55.221783 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1e455-a6fd-4dc8-9ee1-fdebbdb1ff57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:51:55.222406 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1e455-a6fd-4dc8-9ee1-fdebbdb1ff57 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:51:55.222693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1e455-a6fd-4dc8-9ee1-fdebbdb1ff57 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:51:55.222971 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1e455-a6fd-4dc8-9ee1-fdebbdb1ff57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:51:55.224759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6af1e455-a6fd-4dc8-9ee1-fdebbdb1ff57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:51:55.236983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1e455-a6fd-4dc8-9ee1-fdebbdb1ff57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:51:55.238407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1e455-a6fd-4dc8-9ee1-fdebbdb1ff57 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:51:55.249311 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4425/8802] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:51:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:51:55.667064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacd3e5-47c8-43f2-83c2-ca82990217a0 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:51:55.683253 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacd3e5-47c8-43f2-83c2-ca82990217a0 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:51:55.689590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f19b17-52ed-4a46-a51c-e79b21d7d142 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:51:55.690325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f19b17-52ed-4a46-a51c-e79b21d7d142 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:51:55.690677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f19b17-52ed-4a46-a51c-e79b21d7d142 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:51:55.691025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f19b17-52ed-4a46-a51c-e79b21d7d142 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:51:55.692890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a1f19b17-52ed-4a46-a51c-e79b21d7d142 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:51:55.708384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f19b17-52ed-4a46-a51c-e79b21d7d142 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:51:55.710040 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f19b17-52ed-4a46-a51c-e79b21d7d142 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:51:55.723732 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4378/8803] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:51:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:52:04.612884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ae8e8-4adc-4a1f-83fd-90eaa5504fa5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:52:04.613425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ae8e8-4adc-4a1f-83fd-90eaa5504fa5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:52:04.613425 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ae8e8-4adc-4a1f-83fd-90eaa5504fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:52:04.634089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8c7ae8e8-4adc-4a1f-83fd-90eaa5504fa5 None None] MFA Rules not processed for user `bbfd9b97c2004392b2f32631352d95fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:52:04.635340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8c7ae8e8-4adc-4a1f-83fd-90eaa5504fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:52:04.643209 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4426/8804] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:52:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:52:04.959396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f19b17-52ed-4a46-a51c-e79b21d7d142 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:52:04.969045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f19b17-52ed-4a46-a51c-e79b21d7d142 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:52:04.972929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f3213-45ac-43cb-bd32-7b1665d98a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:52:04.973590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f3213-45ac-43cb-bd32-7b1665d98a92 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:52:04.973882 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f3213-45ac-43cb-bd32-7b1665d98a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:52:04.974168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f3213-45ac-43cb-bd32-7b1665d98a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:52:04.976005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9a7f3213-45ac-43cb-bd32-7b1665d98a92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:52:04.989857 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f3213-45ac-43cb-bd32-7b1665d98a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:52:04.991331 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f3213-45ac-43cb-bd32-7b1665d98a92 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:52:05.003815 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4379/8805] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:52:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:52:14.629049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=12 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:52:14.997492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=18 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:52:49.899469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ae8e8-4adc-4a1f-83fd-90eaa5504fa5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:52:49.910459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ae8e8-4adc-4a1f-83fd-90eaa5504fa5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:52:49.914042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e97993-66f1-4d85-a832-ab32bd9c2388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:52:49.914657 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e97993-66f1-4d85-a832-ab32bd9c2388 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:52:49.914940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e97993-66f1-4d85-a832-ab32bd9c2388 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:52:49.915222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e97993-66f1-4d85-a832-ab32bd9c2388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:52:49.917012 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-12e97993-66f1-4d85-a832-ab32bd9c2388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:52:49.930697 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e97993-66f1-4d85-a832-ab32bd9c2388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:52:49.932206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e97993-66f1-4d85-a832-ab32bd9c2388 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:52:49.943199 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4427/8806] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:52:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:52:50.040262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071f7d7-4f12-42b8-a3f2-fa4796098875 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:52:50.040772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071f7d7-4f12-42b8-a3f2-fa4796098875 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:52:50.040868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071f7d7-4f12-42b8-a3f2-fa4796098875 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:52:50.042178 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4380/8807] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:52:50.047195 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d80788-5112-41b1-adc0-adf0d755dd8e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:52:50.047509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d80788-5112-41b1-adc0-adf0d755dd8e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:52:50.047843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d80788-5112-41b1-adc0-adf0d755dd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:52:50.069277 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-96d80788-5112-41b1-adc0-adf0d755dd8e None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:52:50.070531 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-96d80788-5112-41b1-adc0-adf0d755dd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:52:50.079763 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4428/8808] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:52:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:52:50.100534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071f7d7-4f12-42b8-a3f2-fa4796098875 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:52:50.116847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071f7d7-4f12-42b8-a3f2-fa4796098875 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:52:50.121852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff922f-59d9-484c-90dc-96ad3dc664f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:52:50.122458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff922f-59d9-484c-90dc-96ad3dc664f6 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:52:50.122748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff922f-59d9-484c-90dc-96ad3dc664f6 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:52:50.123029 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff922f-59d9-484c-90dc-96ad3dc664f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:52:50.131456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff922f-59d9-484c-90dc-96ad3dc664f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:52:50.133037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff922f-59d9-484c-90dc-96ad3dc664f6 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:52:50.143667 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4381/8809] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:52:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:52:50.316843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d80788-5112-41b1-adc0-adf0d755dd8e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:52:50.326199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d80788-5112-41b1-adc0-adf0d755dd8e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:52:50.330334 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3918c3d-9923-4341-a6ed-ea8e20991ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:52:50.330946 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3918c3d-9923-4341-a6ed-ea8e20991ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:52:50.331234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3918c3d-9923-4341-a6ed-ea8e20991ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:52:50.331549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3918c3d-9923-4341-a6ed-ea8e20991ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:52:50.333284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c3918c3d-9923-4341-a6ed-ea8e20991ee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:52:50.349504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3918c3d-9923-4341-a6ed-ea8e20991ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:52:50.350932 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3918c3d-9923-4341-a6ed-ea8e20991ee0 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:52:50.364479 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4429/8810] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:52:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:53:00.138782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:53:00.357116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=15 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:53:23.282371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0600fce-7cdb-4715-923c-170d7fa6bf02 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:53:23.282954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0600fce-7cdb-4715-923c-170d7fa6bf02 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:53:23.282954 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0600fce-7cdb-4715-923c-170d7fa6bf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:53:23.301712 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e0600fce-7cdb-4715-923c-170d7fa6bf02 None None] MFA Rules not processed for user `bbfd9b97c2004392b2f32631352d95fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:53:23.302931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e0600fce-7cdb-4715-923c-170d7fa6bf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:53:23.309952 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4382/8811] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:53:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:53:33.296860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:53:36.141281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3918c3d-9923-4341-a6ed-ea8e20991ee0 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:53:36.155510 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3918c3d-9923-4341-a6ed-ea8e20991ee0 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:53:36.160551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac4ccb-7dbf-4657-ba59-21722462e196 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:53:36.161161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac4ccb-7dbf-4657-ba59-21722462e196 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:53:36.161448 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac4ccb-7dbf-4657-ba59-21722462e196 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:53:36.161757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac4ccb-7dbf-4657-ba59-21722462e196 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:53:36.163551 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-28ac4ccb-7dbf-4657-ba59-21722462e196 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:53:36.177856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac4ccb-7dbf-4657-ba59-21722462e196 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:53:36.179499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac4ccb-7dbf-4657-ba59-21722462e196 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:53:36.192642 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4430/8812] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:53:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:53:43.038403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0600fce-7cdb-4715-923c-170d7fa6bf02 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:53:43.052809 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0600fce-7cdb-4715-923c-170d7fa6bf02 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:53:43.057851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b363d3-213a-42e6-844d-04d9ef44b49b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:53:43.058461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b363d3-213a-42e6-844d-04d9ef44b49b service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:53:43.058744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b363d3-213a-42e6-844d-04d9ef44b49b service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:53:43.059024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b363d3-213a-42e6-844d-04d9ef44b49b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:53:43.060918 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-59b363d3-213a-42e6-844d-04d9ef44b49b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:53:43.077617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b363d3-213a-42e6-844d-04d9ef44b49b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:53:43.079210 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b363d3-213a-42e6-844d-04d9ef44b49b service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:53:43.091750 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4383/8813] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:53:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:53:46.185211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:53:53.084893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:10.983122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a6ce1-f324-40da-9f96-9a50930d5b22 None None] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:54:10.984200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a6ce1-f324-40da-9f96-9a50930d5b22 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:54:10.984200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a6ce1-f324-40da-9f96-9a50930d5b22 None None] PATH_INFO: `/` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:54:10.985682 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4431/8814] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 21:54:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 21:54:10.990846 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01614f4-7afd-42cc-a98c-1039e9181675 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:54:10.991352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01614f4-7afd-42cc-a98c-1039e9181675 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:54:10.991352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01614f4-7afd-42cc-a98c-1039e9181675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:54:11.012106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-a01614f4-7afd-42cc-a98c-1039e9181675 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:54:11.013335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a01614f4-7afd-42cc-a98c-1039e9181675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:54:11.023236 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4384/8815] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 21:54:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:54:11.044759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a6ce1-f324-40da-9f96-9a50930d5b22 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:54:11.062160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a6ce1-f324-40da-9f96-9a50930d5b22 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:54:11.067183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332f6cd-cbe4-469a-bdb4-630748ed3841 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:54:11.067821 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332f6cd-cbe4-469a-bdb4-630748ed3841 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:54:11.068109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332f6cd-cbe4-469a-bdb4-630748ed3841 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:54:11.068387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332f6cd-cbe4-469a-bdb4-630748ed3841 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:54:11.076818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332f6cd-cbe4-469a-bdb4-630748ed3841 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:54:11.078412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332f6cd-cbe4-469a-bdb4-630748ed3841 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:54:11.088159 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4432/8816] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:54:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:54:11.317100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01614f4-7afd-42cc-a98c-1039e9181675 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:54:11.330297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01614f4-7afd-42cc-a98c-1039e9181675 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:54:11.335473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f582a-466a-44e2-8bd3-e42efc7e854d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:54:11.336105 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f582a-466a-44e2-8bd3-e42efc7e854d service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:54:11.336396 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f582a-466a-44e2-8bd3-e42efc7e854d service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:54:11.336677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f582a-466a-44e2-8bd3-e42efc7e854d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:54:11.338486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-616f582a-466a-44e2-8bd3-e42efc7e854d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:54:11.350483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f582a-466a-44e2-8bd3-e42efc7e854d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:54:11.352131 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f582a-466a-44e2-8bd3-e42efc7e854d service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:54:11.362831 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4385/8817] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:54:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:54:21.084117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:21.357890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=9 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:37.892623 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332f6cd-cbe4-469a-bdb4-630748ed3841 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:54:37.894087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1332f6cd-cbe4-469a-bdb4-630748ed3841 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:54:37.912191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332f6cd-cbe4-469a-bdb4-630748ed3841 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:54:37.917836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1b646-ee56-470b-a4f2-10a07e47b590 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:54:37.918451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1b646-ee56-470b-a4f2-10a07e47b590 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:54:37.918741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1b646-ee56-470b-a4f2-10a07e47b590 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:54:37.919015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1b646-ee56-470b-a4f2-10a07e47b590 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:54:37.927038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1b646-ee56-470b-a4f2-10a07e47b590 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:54:37.928636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1b646-ee56-470b-a4f2-10a07e47b590 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:54:37.938175 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4433/8818] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:54:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:54:40.662568 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f582a-466a-44e2-8bd3-e42efc7e854d service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:54:40.672146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f582a-466a-44e2-8bd3-e42efc7e854d service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:54:40.675848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3c0a6-d93d-4214-b981-9a15ede4c1cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:54:40.676458 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3c0a6-d93d-4214-b981-9a15ede4c1cc service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:54:40.676744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3c0a6-d93d-4214-b981-9a15ede4c1cc service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:54:40.677025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3c0a6-d93d-4214-b981-9a15ede4c1cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:54:40.678773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-22c3c0a6-d93d-4214-b981-9a15ede4c1cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:54:40.691042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3c0a6-d93d-4214-b981-9a15ede4c1cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:54:40.692510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3c0a6-d93d-4214-b981-9a15ede4c1cc service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:54:40.703518 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4386/8819] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:54:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:54:41.105933 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1b646-ee56-470b-a4f2-10a07e47b590 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:54:41.120398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1b646-ee56-470b-a4f2-10a07e47b590 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:54:41.128171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b73fa-83fa-4d64-9102-ef6f61680c2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:54:41.128934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b73fa-83fa-4d64-9102-ef6f61680c2a service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:54:41.129289 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b73fa-83fa-4d64-9102-ef6f61680c2a service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:54:41.129639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b73fa-83fa-4d64-9102-ef6f61680c2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:54:41.131659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5a1b73fa-83fa-4d64-9102-ef6f61680c2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:54:41.148598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b73fa-83fa-4d64-9102-ef6f61680c2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:54:41.150197 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b73fa-83fa-4d64-9102-ef6f61680c2a service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:54:41.164169 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4434/8820] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:54:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:54:50.697056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:51.156755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=12 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:57.335448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3c0a6-d93d-4214-b981-9a15ede4c1cc service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:54:57.357432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3c0a6-d93d-4214-b981-9a15ede4c1cc service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:54:57.363850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc14c60-eb9c-4176-9695-e592cb07790e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:54:57.364494 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc14c60-eb9c-4176-9695-e592cb07790e service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:54:57.364785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc14c60-eb9c-4176-9695-e592cb07790e service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:54:57.365314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc14c60-eb9c-4176-9695-e592cb07790e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:54:57.367521 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9bc14c60-eb9c-4176-9695-e592cb07790e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:54:57.390732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc14c60-eb9c-4176-9695-e592cb07790e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:54:57.392814 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc14c60-eb9c-4176-9695-e592cb07790e service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:54:57.407742 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4387/8821] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:54:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:55:02.459259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b73fa-83fa-4d64-9102-ef6f61680c2a service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:02.468571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b73fa-83fa-4d64-9102-ef6f61680c2a service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:02.472260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5ab89-1bec-49de-9d71-699139e4a517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:02.472866 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5ab89-1bec-49de-9d71-699139e4a517 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:02.473152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5ab89-1bec-49de-9d71-699139e4a517 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:02.473441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5ab89-1bec-49de-9d71-699139e4a517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:02.482336 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5ab89-1bec-49de-9d71-699139e4a517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:02.484371 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5ab89-1bec-49de-9d71-699139e4a517 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:02.493942 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4435/8822] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:55:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:55:05.357060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc14c60-eb9c-4176-9695-e592cb07790e service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:05.379327 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc14c60-eb9c-4176-9695-e592cb07790e service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:05.386781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d329f-a481-4b23-bc66-841a7dc6a881 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:05.387744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d329f-a481-4b23-bc66-841a7dc6a881 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:05.388356 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d329f-a481-4b23-bc66-841a7dc6a881 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:05.390952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d329f-a481-4b23-bc66-841a7dc6a881 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:05.395354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f61d329f-a481-4b23-bc66-841a7dc6a881 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:05.417605 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d329f-a481-4b23-bc66-841a7dc6a881 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:05.420104 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d329f-a481-4b23-bc66-841a7dc6a881 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:05.432047 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5ab89-1bec-49de-9d71-699139e4a517 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:05.441428 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4388/8823] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:55:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:55:05.450316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5ab89-1bec-49de-9d71-699139e4a517 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:05.459279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f0b59-820a-4fab-9a43-39d834be8987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:05.460484 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f0b59-820a-4fab-9a43-39d834be8987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:05.460991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f0b59-820a-4fab-9a43-39d834be8987 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:05.463702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f0b59-820a-4fab-9a43-39d834be8987 admin admin] PATH_INFO: `/v3/users/bbfd9b97c2004392b2f32631352d95fb` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:05.466309 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f0b59-820a-4fab-9a43-39d834be8987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbfd9b97c2004392b2f32631352d95fb)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:05.469118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f0b59-820a-4fab-9a43-39d834be8987 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:05.533906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-398f0b59-820a-4fab-9a43-39d834be8987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbfd9b97c2004392b2f32631352d95fb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:05.546507 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-398f0b59-820a-4fab-9a43-39d834be8987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbfd9b97c2004392b2f32631352d95fb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:05.548264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-398f0b59-820a-4fab-9a43-39d834be8987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbfd9b97c2004392b2f32631352d95fb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:05.555659 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-398f0b59-820a-4fab-9a43-39d834be8987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbfd9b97c2004392b2f32631352d95fb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:05.556332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-398f0b59-820a-4fab-9a43-39d834be8987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbfd9b97c2004392b2f32631352d95fb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:05.569601 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4436/8824] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:55:05 2022] DELETE /identity/v3/users/bbfd9b97c2004392b2f32631352d95fb => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:55:05.760330 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d329f-a481-4b23-bc66-841a7dc6a881 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:05.772774 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d329f-a481-4b23-bc66-841a7dc6a881 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:05.833940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc55d7-a234-4cf8-8029-7d634edab6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:05.834596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc55d7-a234-4cf8-8029-7d634edab6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:05.834886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc55d7-a234-4cf8-8029-7d634edab6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:05.835414 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc55d7-a234-4cf8-8029-7d634edab6fc admin admin] PATH_INFO: `/v3/projects/4d5d85194b3a4a05bd1e5e1af89e5acf` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:05.836773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc55d7-a234-4cf8-8029-7d634edab6fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d5d85194b3a4a05bd1e5e1af89e5acf)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:05.838688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc55d7-a234-4cf8-8029-7d634edab6fc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:05.887552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-06cc55d7-a234-4cf8-8029-7d634edab6fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'request_id': 'req-06cc55d7-a234-4cf8-8029-7d634edab6fc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:05.897686 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-06cc55d7-a234-4cf8-8029-7d634edab6fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'request_id': 'req-06cc55d7-a234-4cf8-8029-7d634edab6fc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:05.904108 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-06cc55d7-a234-4cf8-8029-7d634edab6fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'request_id': 'req-06cc55d7-a234-4cf8-8029-7d634edab6fc'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:05.917272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-06cc55d7-a234-4cf8-8029-7d634edab6fc admin admin] The token cache is being invalidate because project 4d5d85194b3a4a05bd1e5e1af89e5acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:55:05.917572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-06cc55d7-a234-4cf8-8029-7d634edab6fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:05.918242 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-06cc55d7-a234-4cf8-8029-7d634edab6fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:05.919851 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4389/8825] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:55:05 2022] DELETE /identity/v3/projects/4d5d85194b3a4a05bd1e5e1af89e5acf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:55:05.926834 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9414555-a877-41d6-bf2c-2c2b4e66b860 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:05.927443 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9414555-a877-41d6-bf2c-2c2b4e66b860 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:05.927960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9414555-a877-41d6-bf2c-2c2b4e66b860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:05.951075 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a9414555-a877-41d6-bf2c-2c2b4e66b860 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:55:05.953000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a9414555-a877-41d6-bf2c-2c2b4e66b860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:06.015188 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4437/8826] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:55:06.024069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fb1bb-a723-446e-991c-b34d71cfa5d1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:06.024360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fb1bb-a723-446e-991c-b34d71cfa5d1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:06.024642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fb1bb-a723-446e-991c-b34d71cfa5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:06.043824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-502fb1bb-a723-446e-991c-b34d71cfa5d1 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:55:06.045020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-502fb1bb-a723-446e-991c-b34d71cfa5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:06.053320 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4390/8827] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:55:06.057450 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9414555-a877-41d6-bf2c-2c2b4e66b860 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:06.068067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9414555-a877-41d6-bf2c-2c2b4e66b860 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:06.072756 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36804f71-43e1-4afa-95aa-27a1cac05f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:06.073364 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36804f71-43e1-4afa-95aa-27a1cac05f3e admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:06.073655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36804f71-43e1-4afa-95aa-27a1cac05f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:06.073938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36804f71-43e1-4afa-95aa-27a1cac05f3e admin admin] PATH_INFO: `/v3/domains` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:06.074663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36804f71-43e1-4afa-95aa-27a1cac05f3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:55:06.074974 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36804f71-43e1-4afa-95aa-27a1cac05f3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:06.076650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36804f71-43e1-4afa-95aa-27a1cac05f3e admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:06.088182 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4438/8828] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:55:06.092371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fb1bb-a723-446e-991c-b34d71cfa5d1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:06.101782 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fb1bb-a723-446e-991c-b34d71cfa5d1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:06.106465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b9b0f-3c02-4f79-9560-7ee769e7a013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:06.107065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b9b0f-3c02-4f79-9560-7ee769e7a013 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:06.107392 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b9b0f-3c02-4f79-9560-7ee769e7a013 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:06.107674 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b9b0f-3c02-4f79-9560-7ee769e7a013 admin admin] PATH_INFO: `/v3/projects` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:06.108828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b9b0f-3c02-4f79-9560-7ee769e7a013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:06.110714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b9b0f-3c02-4f79-9560-7ee769e7a013 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:06.139620 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4391/8829] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:55:06 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:55:06.144106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36804f71-43e1-4afa-95aa-27a1cac05f3e admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:06.154314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36804f71-43e1-4afa-95aa-27a1cac05f3e admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:06.199236 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:06.213086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abf798-28a3-4f8e-8519-d9683c990dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:06.213712 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abf798-28a3-4f8e-8519-d9683c990dba admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:06.214006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abf798-28a3-4f8e-8519-d9683c990dba admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:06.214288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abf798-28a3-4f8e-8519-d9683c990dba admin admin] PATH_INFO: `/v3/users` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:06.214997 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abf798-28a3-4f8e-8519-d9683c990dba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:06.216953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abf798-28a3-4f8e-8519-d9683c990dba admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:06.237889 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4439/8830] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:55:06 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:55:06.242064 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b9b0f-3c02-4f79-9560-7ee769e7a013 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:06.252940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b9b0f-3c02-4f79-9560-7ee769e7a013 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:06.257565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d208a50-8c51-4277-9e0d-f37994b83571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:06.258167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d208a50-8c51-4277-9e0d-f37994b83571 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:06.258452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d208a50-8c51-4277-9e0d-f37994b83571 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:06.258729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d208a50-8c51-4277-9e0d-f37994b83571 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:06.259457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d208a50-8c51-4277-9e0d-f37994b83571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:06.261058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d208a50-8c51-4277-9e0d-f37994b83571 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:06.272158 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4392/8831] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:55:06.276300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abf798-28a3-4f8e-8519-d9683c990dba admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:06.286285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abf798-28a3-4f8e-8519-d9683c990dba admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:06.290916 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7c3da-8134-4fa7-a091-51524e594c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:06.291561 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7c3da-8134-4fa7-a091-51524e594c6c admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:06.291850 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7c3da-8134-4fa7-a091-51524e594c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:06.292128 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7c3da-8134-4fa7-a091-51524e594c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:06.292812 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7c3da-8134-4fa7-a091-51524e594c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:06.294399 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7c3da-8134-4fa7-a091-51524e594c6c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:06.305854 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4440/8832] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:55:06.309973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d208a50-8c51-4277-9e0d-f37994b83571 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:06.320731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d208a50-8c51-4277-9e0d-f37994b83571 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:06.325354 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff04d4-c7a9-40f5-b05a-abe06b040519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:06.326005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff04d4-c7a9-40f5-b05a-abe06b040519 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:06.326290 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff04d4-c7a9-40f5-b05a-abe06b040519 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:06.326567 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff04d4-c7a9-40f5-b05a-abe06b040519 admin admin] PATH_INFO: `/v3/projects/f7e4885eb9d54dccbc0a3589ba059b4f/users/c4b0c5ad524b4f0b83b0c4fa2d2b618a/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:06.341197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff04d4-c7a9-40f5-b05a-abe06b040519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7e4885eb9d54dccbc0a3589ba059b4f, user_id=c4b0c5ad524b4f0b83b0c4fa2d2b618a, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:06.343856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff04d4-c7a9-40f5-b05a-abe06b040519 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:06.352374 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:06.357228 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4393/8833] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:55:06 2022] PUT /identity/v3/projects/f7e4885eb9d54dccbc0a3589ba059b4f/users/c4b0c5ad524b4f0b83b0c4fa2d2b618a/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:55:06.362845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b045e70-850f-4404-a62a-c5344082f7f7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:06.363170 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b045e70-850f-4404-a62a-c5344082f7f7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:06.363565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b045e70-850f-4404-a62a-c5344082f7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:06.382921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4b045e70-850f-4404-a62a-c5344082f7f7 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:55:06.384191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4b045e70-850f-4404-a62a-c5344082f7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:06.442657 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4441/8834] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:55:06.452581 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff04d4-c7a9-40f5-b05a-abe06b040519 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:06.454350 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-14ff04d4-c7a9-40f5-b05a-abe06b040519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:06.511575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff04d4-c7a9-40f5-b05a-abe06b040519 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:06.515544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d359bf2-c4ff-4083-ad6b-dbd5020f15b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:06.516176 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d359bf2-c4ff-4083-ad6b-dbd5020f15b9 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:06.516465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d359bf2-c4ff-4083-ad6b-dbd5020f15b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:06.516746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d359bf2-c4ff-4083-ad6b-dbd5020f15b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:06.526889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d359bf2-c4ff-4083-ad6b-dbd5020f15b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:06.528380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d359bf2-c4ff-4083-ad6b-dbd5020f15b9 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:06.538636 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4394/8835] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:55:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:55:10.611206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bff66-403f-44da-a790-36f00fc36ea2 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:10.612098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bff66-403f-44da-a790-36f00fc36ea2 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:10.612558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bff66-403f-44da-a790-36f00fc36ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:10.655091 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-450bff66-403f-44da-a790-36f00fc36ea2 None None] MFA Rules not processed for user `c4b0c5ad524b4f0b83b0c4fa2d2b618a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:55:10.656475 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-450bff66-403f-44da-a790-36f00fc36ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:10.738875 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4442/8836] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:55:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:55:10.750177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fe6a7-c84c-4d6b-b36c-c501aa468386 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:10.750718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fe6a7-c84c-4d6b-b36c-c501aa468386 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:10.750718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fe6a7-c84c-4d6b-b36c-c501aa468386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:10.771213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-fb5fe6a7-c84c-4d6b-b36c-c501aa468386 None None] MFA Rules not processed for user `c4b0c5ad524b4f0b83b0c4fa2d2b618a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:55:10.772592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fb5fe6a7-c84c-4d6b-b36c-c501aa468386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:10.780290 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4395/8837] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:55:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:55:10.795969 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bff66-403f-44da-a790-36f00fc36ea2 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:10.798004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-450bff66-403f-44da-a790-36f00fc36ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:10.872280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:10.902746 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bff66-403f-44da-a790-36f00fc36ea2 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:10.912733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c4f83-6634-421f-8b13-5f67ddf67a42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:10.913522 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c4f83-6634-421f-8b13-5f67ddf67a42 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:10.913796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c4f83-6634-421f-8b13-5f67ddf67a42 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:10.914070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c4f83-6634-421f-8b13-5f67ddf67a42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:10.924180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c4f83-6634-421f-8b13-5f67ddf67a42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:10.926466 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c4f83-6634-421f-8b13-5f67ddf67a42 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:10.937257 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4443/8838] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:55:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:55:11.230727 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fe6a7-c84c-4d6b-b36c-c501aa468386 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:11.232196 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fb5fe6a7-c84c-4d6b-b36c-c501aa468386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:11.244890 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fe6a7-c84c-4d6b-b36c-c501aa468386 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:11.248658 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e95ba5-70d0-4c29-9def-f43b9faa7e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:11.249699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e95ba5-70d0-4c29-9def-f43b9faa7e01 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:11.250238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e95ba5-70d0-4c29-9def-f43b9faa7e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:11.250720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e95ba5-70d0-4c29-9def-f43b9faa7e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:11.253218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-64e95ba5-70d0-4c29-9def-f43b9faa7e01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:11.269406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e95ba5-70d0-4c29-9def-f43b9faa7e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:11.271073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e95ba5-70d0-4c29-9def-f43b9faa7e01 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:11.283571 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4396/8839] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:55:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:55:12.629071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c4f83-6634-421f-8b13-5f67ddf67a42 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:12.630830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5e0c4f83-6634-421f-8b13-5f67ddf67a42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:12.728615 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c4f83-6634-421f-8b13-5f67ddf67a42 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:12.733903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b472be3-b0a5-4127-9516-1d5986dde081 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:12.734651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b472be3-b0a5-4127-9516-1d5986dde081 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:12.734931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b472be3-b0a5-4127-9516-1d5986dde081 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:12.735214 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b472be3-b0a5-4127-9516-1d5986dde081 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:12.737062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0b472be3-b0a5-4127-9516-1d5986dde081 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:12.749366 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b472be3-b0a5-4127-9516-1d5986dde081 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:12.750964 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b472be3-b0a5-4127-9516-1d5986dde081 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:12.761520 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4444/8840] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:55:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:55:21.276270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=35 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:21.282160 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c0d35-888b-4c67-95bc-d2aa0aab4d9b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:21.282454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c0d35-888b-4c67-95bc-d2aa0aab4d9b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:21.282737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c0d35-888b-4c67-95bc-d2aa0aab4d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:21.301818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-f42c0d35-888b-4c67-95bc-d2aa0aab4d9b None None] MFA Rules not processed for user `c4b0c5ad524b4f0b83b0c4fa2d2b618a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:55:21.303031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f42c0d35-888b-4c67-95bc-d2aa0aab4d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:21.310002 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4397/8841] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:55:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:55:22.757092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=41 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:31.296660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:42.805825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b472be3-b0a5-4127-9516-1d5986dde081 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:42.807333 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0b472be3-b0a5-4127-9516-1d5986dde081 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:42.825719 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b472be3-b0a5-4127-9516-1d5986dde081 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:42.832375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb8beb-3069-45b2-90ec-e3f03b08d45b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:42.833096 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb8beb-3069-45b2-90ec-e3f03b08d45b service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:42.833460 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb8beb-3069-45b2-90ec-e3f03b08d45b service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:42.833816 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb8beb-3069-45b2-90ec-e3f03b08d45b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:42.835988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-edeb8beb-3069-45b2-90ec-e3f03b08d45b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:42.852927 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb8beb-3069-45b2-90ec-e3f03b08d45b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:42.855761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb8beb-3069-45b2-90ec-e3f03b08d45b service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:42.861979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c0d35-888b-4c67-95bc-d2aa0aab4d9b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:42.871336 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4445/8842] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:55:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:55:42.876870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c0d35-888b-4c67-95bc-d2aa0aab4d9b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:42.882279 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9798c57-4fd3-4a40-ae66-7ede33d5c9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:42.882968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9798c57-4fd3-4a40-ae66-7ede33d5c9ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:42.883460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9798c57-4fd3-4a40-ae66-7ede33d5c9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:42.883744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9798c57-4fd3-4a40-ae66-7ede33d5c9ad admin admin] PATH_INFO: `/v3/users/c4b0c5ad524b4f0b83b0c4fa2d2b618a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:42.885425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9798c57-4fd3-4a40-ae66-7ede33d5c9ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4b0c5ad524b4f0b83b0c4fa2d2b618a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:42.888149 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9798c57-4fd3-4a40-ae66-7ede33d5c9ad admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:42.947828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d9798c57-4fd3-4a40-ae66-7ede33d5c9ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:42.948580 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d9798c57-4fd3-4a40-ae66-7ede33d5c9ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:42.966078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d9798c57-4fd3-4a40-ae66-7ede33d5c9ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:42.966895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d9798c57-4fd3-4a40-ae66-7ede33d5c9ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:42.974344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-d9798c57-4fd3-4a40-ae66-7ede33d5c9ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:42.987940 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4398/8843] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:55:42 2022] DELETE /identity/v3/users/c4b0c5ad524b4f0b83b0c4fa2d2b618a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:55:43.178469 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb8beb-3069-45b2-90ec-e3f03b08d45b service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:43.189995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb8beb-3069-45b2-90ec-e3f03b08d45b service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:43.248282 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef562a2-276c-4586-bea0-167e53449cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:43.248857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef562a2-276c-4586-bea0-167e53449cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:43.249153 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef562a2-276c-4586-bea0-167e53449cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:43.249427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef562a2-276c-4586-bea0-167e53449cf5 admin admin] PATH_INFO: `/v3/projects/f7e4885eb9d54dccbc0a3589ba059b4f` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:43.250587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef562a2-276c-4586-bea0-167e53449cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7e4885eb9d54dccbc0a3589ba059b4f)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:43.252535 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef562a2-276c-4586-bea0-167e53449cf5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:43.299209 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fef562a2-276c-4586-bea0-167e53449cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'request_id': 'req-fef562a2-276c-4586-bea0-167e53449cf5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:43.305370 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fef562a2-276c-4586-bea0-167e53449cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'request_id': 'req-fef562a2-276c-4586-bea0-167e53449cf5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:43.312914 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fef562a2-276c-4586-bea0-167e53449cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'request_id': 'req-fef562a2-276c-4586-bea0-167e53449cf5'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:43.323499 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fef562a2-276c-4586-bea0-167e53449cf5 admin admin] The token cache is being invalidate because project f7e4885eb9d54dccbc0a3589ba059b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:55:43.323827 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fef562a2-276c-4586-bea0-167e53449cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:43.324483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-fef562a2-276c-4586-bea0-167e53449cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:43.326988 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4446/8844] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:55:43 2022] DELETE /identity/v3/projects/f7e4885eb9d54dccbc0a3589ba059b4f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 21:55:43.332162 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c982f64-a2bf-4783-88ae-3edccca1190b None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:43.332486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c982f64-a2bf-4783-88ae-3edccca1190b None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:43.332772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c982f64-a2bf-4783-88ae-3edccca1190b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:43.355702 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9c982f64-a2bf-4783-88ae-3edccca1190b None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:55:43.356942 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9c982f64-a2bf-4783-88ae-3edccca1190b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:43.422518 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4399/8845] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:55:43.430319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07e516-a4d2-46eb-b48c-bbe91742fe33 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:43.430612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07e516-a4d2-46eb-b48c-bbe91742fe33 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:43.430893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07e516-a4d2-46eb-b48c-bbe91742fe33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:43.450458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ef07e516-a4d2-46eb-b48c-bbe91742fe33 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:55:43.451843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ef07e516-a4d2-46eb-b48c-bbe91742fe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:43.459951 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4447/8846] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:55:43.464237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c982f64-a2bf-4783-88ae-3edccca1190b None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:43.474585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c982f64-a2bf-4783-88ae-3edccca1190b None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:43.479152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf18a9-d511-48c2-9f22-eeef7693bb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:43.479804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf18a9-d511-48c2-9f22-eeef7693bb2a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:43.480091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf18a9-d511-48c2-9f22-eeef7693bb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:43.480371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf18a9-d511-48c2-9f22-eeef7693bb2a admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:43.481072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf18a9-d511-48c2-9f22-eeef7693bb2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:55:43.481380 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf18a9-d511-48c2-9f22-eeef7693bb2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:43.483906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf18a9-d511-48c2-9f22-eeef7693bb2a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:43.495774 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4400/8847] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:55:43.500212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07e516-a4d2-46eb-b48c-bbe91742fe33 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:43.509641 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07e516-a4d2-46eb-b48c-bbe91742fe33 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:43.514787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07613619-9908-40be-a5f6-272384ed0150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:43.515418 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07613619-9908-40be-a5f6-272384ed0150 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:43.515703 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07613619-9908-40be-a5f6-272384ed0150 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:43.515979 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07613619-9908-40be-a5f6-272384ed0150 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:43.516642 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07613619-9908-40be-a5f6-272384ed0150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:43.518789 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07613619-9908-40be-a5f6-272384ed0150 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:43.545961 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4448/8848] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:55:43 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:55:43.550025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf18a9-d511-48c2-9f22-eeef7693bb2a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:43.560305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf18a9-d511-48c2-9f22-eeef7693bb2a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:43.616422 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585b88e-02f8-451f-bfd7-4befb625dd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:43.617038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585b88e-02f8-451f-bfd7-4befb625dd36 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:43.617325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585b88e-02f8-451f-bfd7-4befb625dd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:43.617606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585b88e-02f8-451f-bfd7-4befb625dd36 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:43.618272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585b88e-02f8-451f-bfd7-4befb625dd36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:43.620234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585b88e-02f8-451f-bfd7-4befb625dd36 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:43.627997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:43.642619 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4401/8849] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:55:43 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:55:43.646754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07613619-9908-40be-a5f6-272384ed0150 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:43.658315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07613619-9908-40be-a5f6-272384ed0150 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:43.663040 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046d5b6-7432-4b86-b644-7399dc16e469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:43.664116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046d5b6-7432-4b86-b644-7399dc16e469 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:43.664432 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046d5b6-7432-4b86-b644-7399dc16e469 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:43.664729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046d5b6-7432-4b86-b644-7399dc16e469 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:43.665459 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046d5b6-7432-4b86-b644-7399dc16e469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:43.667098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046d5b6-7432-4b86-b644-7399dc16e469 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:43.679121 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4449/8850] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:55:43.683542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585b88e-02f8-451f-bfd7-4befb625dd36 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:43.693795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585b88e-02f8-451f-bfd7-4befb625dd36 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:43.698542 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8c078-dda4-44bf-acf9-37ee6b9b8d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:43.699158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8c078-dda4-44bf-acf9-37ee6b9b8d0a admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:43.699491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8c078-dda4-44bf-acf9-37ee6b9b8d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:43.699778 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8c078-dda4-44bf-acf9-37ee6b9b8d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:43.700478 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8c078-dda4-44bf-acf9-37ee6b9b8d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:43.702574 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8c078-dda4-44bf-acf9-37ee6b9b8d0a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:43.713615 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4402/8851] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 21:55:43.718446 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046d5b6-7432-4b86-b644-7399dc16e469 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:43.728590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046d5b6-7432-4b86-b644-7399dc16e469 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:43.733296 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c4776-c429-4da2-9b1a-3a0d7fff7a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:43.733954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c4776-c429-4da2-9b1a-3a0d7fff7a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:43.734244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c4776-c429-4da2-9b1a-3a0d7fff7a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:43.734526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c4776-c429-4da2-9b1a-3a0d7fff7a6f admin admin] PATH_INFO: `/v3/projects/dd505d6ecb2d422aa69f58429cf153d5/users/2271f170a7fe4a9fbd84ec68bf534624/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:43.749018 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c4776-c429-4da2-9b1a-3a0d7fff7a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd505d6ecb2d422aa69f58429cf153d5, user_id=2271f170a7fe4a9fbd84ec68bf534624, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:43.751729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c4776-c429-4da2-9b1a-3a0d7fff7a6f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:43.765104 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4450/8852] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:55:43 2022] PUT /identity/v3/projects/dd505d6ecb2d422aa69f58429cf153d5/users/2271f170a7fe4a9fbd84ec68bf534624/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:55:43.776594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4804-ed98-4add-b372-dd85029f4b88 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:43.776895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4804-ed98-4add-b372-dd85029f4b88 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:43.777185 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4804-ed98-4add-b372-dd85029f4b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:43.805855 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d3bd4804-ed98-4add-b372-dd85029f4b88 None None] MFA Rules not processed for user `2271f170a7fe4a9fbd84ec68bf534624`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:55:43.807073 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d3bd4804-ed98-4add-b372-dd85029f4b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:43.871569 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4403/8853] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:55:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:55:43.882175 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c4776-c429-4da2-9b1a-3a0d7fff7a6f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:43.884022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-364c4776-c429-4da2-9b1a-3a0d7fff7a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:43.898950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:43.943545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c4776-c429-4da2-9b1a-3a0d7fff7a6f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:43.947120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f1fd1-0e89-4bde-9229-3b25effd5fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:43.947768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f1fd1-0e89-4bde-9229-3b25effd5fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:43.948050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f1fd1-0e89-4bde-9229-3b25effd5fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:43.948331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f1fd1-0e89-4bde-9229-3b25effd5fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:43.957238 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f1fd1-0e89-4bde-9229-3b25effd5fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:43.958653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f1fd1-0e89-4bde-9229-3b25effd5fd1 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:43.967401 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4451/8854] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:55:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:55:53.868641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:53.963416 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=20 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:56.890028 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd4804-ed98-4add-b372-dd85029f4b88 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:56.955336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd4804-ed98-4add-b372-dd85029f4b88 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:56.959803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd499186-dc72-42f2-9050-7551516e2db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:56.960448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd499186-dc72-42f2-9050-7551516e2db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:56.960731 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd499186-dc72-42f2-9050-7551516e2db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:56.961005 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd499186-dc72-42f2-9050-7551516e2db5 admin admin] PATH_INFO: `/v3/users/2271f170a7fe4a9fbd84ec68bf534624` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:56.962152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd499186-dc72-42f2-9050-7551516e2db5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2271f170a7fe4a9fbd84ec68bf534624)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:56.964116 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd499186-dc72-42f2-9050-7551516e2db5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:57.011967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cd499186-dc72-42f2-9050-7551516e2db5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2271f170a7fe4a9fbd84ec68bf534624'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:57.012652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cd499186-dc72-42f2-9050-7551516e2db5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2271f170a7fe4a9fbd84ec68bf534624'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:57.025649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cd499186-dc72-42f2-9050-7551516e2db5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2271f170a7fe4a9fbd84ec68bf534624'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:57.026297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cd499186-dc72-42f2-9050-7551516e2db5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2271f170a7fe4a9fbd84ec68bf534624'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:57.036673 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-cd499186-dc72-42f2-9050-7551516e2db5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2271f170a7fe4a9fbd84ec68bf534624'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:57.050215 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4404/8855] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:55:56 2022] DELETE /identity/v3/users/2271f170a7fe4a9fbd84ec68bf534624 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:55:57.054842 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21206a-9c7c-4ccb-95c8-31a35b27f5ec None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:57.055411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21206a-9c7c-4ccb-95c8-31a35b27f5ec None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:57.055411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21206a-9c7c-4ccb-95c8-31a35b27f5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:57.075253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-af21206a-9c7c-4ccb-95c8-31a35b27f5ec None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:55:57.076489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-af21206a-9c7c-4ccb-95c8-31a35b27f5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:57.137164 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4452/8856] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:55:57.147297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd499186-dc72-42f2-9050-7551516e2db5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:57.148935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cd499186-dc72-42f2-9050-7551516e2db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:57.209851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd499186-dc72-42f2-9050-7551516e2db5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:57.213617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96f311-1b3a-4e0c-aa5a-d951c0acc9c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:57.214249 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96f311-1b3a-4e0c-aa5a-d951c0acc9c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:57.214538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96f311-1b3a-4e0c-aa5a-d951c0acc9c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:57.214823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96f311-1b3a-4e0c-aa5a-d951c0acc9c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:57.224664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96f311-1b3a-4e0c-aa5a-d951c0acc9c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:57.226123 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96f311-1b3a-4e0c-aa5a-d951c0acc9c5 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:57.243388 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4405/8857] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:55:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:55:57.423835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21206a-9c7c-4ccb-95c8-31a35b27f5ec None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:57.425586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-af21206a-9c7c-4ccb-95c8-31a35b27f5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:57.442407 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21206a-9c7c-4ccb-95c8-31a35b27f5ec None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:57.447114 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fcda9-cae9-41ec-8555-bdc094422dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:57.447808 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fcda9-cae9-41ec-8555-bdc094422dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:57.448099 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fcda9-cae9-41ec-8555-bdc094422dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:57.448381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fcda9-cae9-41ec-8555-bdc094422dbb admin admin] PATH_INFO: `/v3/projects/dd505d6ecb2d422aa69f58429cf153d5` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:57.449617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fcda9-cae9-41ec-8555-bdc094422dbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd505d6ecb2d422aa69f58429cf153d5)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:57.457233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fcda9-cae9-41ec-8555-bdc094422dbb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:57.510940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cd5fcda9-cae9-41ec-8555-bdc094422dbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd505d6ecb2d422aa69f58429cf153d5', 'request_id': 'req-cd5fcda9-cae9-41ec-8555-bdc094422dbb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:57.517110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cd5fcda9-cae9-41ec-8555-bdc094422dbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd505d6ecb2d422aa69f58429cf153d5', 'request_id': 'req-cd5fcda9-cae9-41ec-8555-bdc094422dbb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:57.524613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cd5fcda9-cae9-41ec-8555-bdc094422dbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd505d6ecb2d422aa69f58429cf153d5', 'request_id': 'req-cd5fcda9-cae9-41ec-8555-bdc094422dbb'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:57.535798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cd5fcda9-cae9-41ec-8555-bdc094422dbb admin admin] The token cache is being invalidate because project dd505d6ecb2d422aa69f58429cf153d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:55:57.536087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cd5fcda9-cae9-41ec-8555-bdc094422dbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:57.536710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cd5fcda9-cae9-41ec-8555-bdc094422dbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:55:57.538226 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4453/8858] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:55:57 2022] DELETE /identity/v3/projects/dd505d6ecb2d422aa69f58429cf153d5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:55:57.543527 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a84559-d212-421f-a2a7-602166b9f242 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:57.543850 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a84559-d212-421f-a2a7-602166b9f242 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:57.544817 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a84559-d212-421f-a2a7-602166b9f242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:57.564102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-62a84559-d212-421f-a2a7-602166b9f242 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:55:57.565320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-62a84559-d212-421f-a2a7-602166b9f242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:57.582002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:57.626408 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4406/8859] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:55:57.634325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bfe81-8e40-4a9c-827f-e8ebd6a60683 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:57.634618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bfe81-8e40-4a9c-827f-e8ebd6a60683 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:57.634926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bfe81-8e40-4a9c-827f-e8ebd6a60683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:57.655045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-5a4bfe81-8e40-4a9c-827f-e8ebd6a60683 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:55:57.656295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5a4bfe81-8e40-4a9c-827f-e8ebd6a60683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:57.664073 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4454/8860] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:55:57.668225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a84559-d212-421f-a2a7-602166b9f242 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:57.678714 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a84559-d212-421f-a2a7-602166b9f242 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:57.683427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7987a56-a555-43f0-81c4-76a4501c5ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:57.684045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7987a56-a555-43f0-81c4-76a4501c5ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:57.684333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7987a56-a555-43f0-81c4-76a4501c5ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:57.684632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7987a56-a555-43f0-81c4-76a4501c5ed3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:57.685347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7987a56-a555-43f0-81c4-76a4501c5ed3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:55:57.685656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7987a56-a555-43f0-81c4-76a4501c5ed3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:57.687257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7987a56-a555-43f0-81c4-76a4501c5ed3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:57.698705 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4407/8861] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:55:57.703000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bfe81-8e40-4a9c-827f-e8ebd6a60683 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:57.712410 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bfe81-8e40-4a9c-827f-e8ebd6a60683 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:57.717550 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b537255-9d35-4fe3-b743-d81797728ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:57.718159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b537255-9d35-4fe3-b743-d81797728ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:57.718440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b537255-9d35-4fe3-b743-d81797728ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:57.718716 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b537255-9d35-4fe3-b743-d81797728ee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:57.719414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b537255-9d35-4fe3-b743-d81797728ee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:57.721292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b537255-9d35-4fe3-b743-d81797728ee0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:57.748228 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4455/8862] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:55:57 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:55:57.752416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7987a56-a555-43f0-81c4-76a4501c5ed3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:57.762668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7987a56-a555-43f0-81c4-76a4501c5ed3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:57.825819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ade095-8058-4c95-9cab-3cff11cff3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:57.826485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ade095-8058-4c95-9cab-3cff11cff3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:57.826776 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ade095-8058-4c95-9cab-3cff11cff3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:57.827049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ade095-8058-4c95-9cab-3cff11cff3d3 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:57.827797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ade095-8058-4c95-9cab-3cff11cff3d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:57.829761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ade095-8058-4c95-9cab-3cff11cff3d3 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:57.855441 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4408/8863] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:55:57 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:55:57.859814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b537255-9d35-4fe3-b743-d81797728ee0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:57.872967 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b537255-9d35-4fe3-b743-d81797728ee0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:57.877653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f2aed-18d0-4919-a7ce-1361514c43ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:57.878200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f2aed-18d0-4919-a7ce-1361514c43ce admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:57.878482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f2aed-18d0-4919-a7ce-1361514c43ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:57.878755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f2aed-18d0-4919-a7ce-1361514c43ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:57.879488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f2aed-18d0-4919-a7ce-1361514c43ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:57.881065 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f2aed-18d0-4919-a7ce-1361514c43ce admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:57.891360 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4456/8864] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:55:57.895724 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ade095-8058-4c95-9cab-3cff11cff3d3 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:57.906798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ade095-8058-4c95-9cab-3cff11cff3d3 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:57.911596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065f72f-cbe7-480e-9bc1-41ebbb9d2a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:57.912212 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065f72f-cbe7-480e-9bc1-41ebbb9d2a33 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:57.912506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065f72f-cbe7-480e-9bc1-41ebbb9d2a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:57.912788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065f72f-cbe7-480e-9bc1-41ebbb9d2a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:57.913483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065f72f-cbe7-480e-9bc1-41ebbb9d2a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:57.915085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065f72f-cbe7-480e-9bc1-41ebbb9d2a33 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:57.925934 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4409/8865] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:55:57.930838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f2aed-18d0-4919-a7ce-1361514c43ce admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:57.941367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f2aed-18d0-4919-a7ce-1361514c43ce admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:57.946185 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0da499-f688-462f-ba31-0c027f55b1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:57.946859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0da499-f688-462f-ba31-0c027f55b1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:57.947150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0da499-f688-462f-ba31-0c027f55b1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:57.947470 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0da499-f688-462f-ba31-0c027f55b1a1 admin admin] PATH_INFO: `/v3/projects/73522e133e6b48bfbe0d6503f6848412/users/698c74ff3c464ded80a8d49e91f841cd/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:57.963557 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0da499-f688-462f-ba31-0c027f55b1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73522e133e6b48bfbe0d6503f6848412, user_id=698c74ff3c464ded80a8d49e91f841cd, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:57.966895 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0da499-f688-462f-ba31-0c027f55b1a1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:57.980355 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4457/8866] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:55:57 2022] PUT /identity/v3/projects/73522e133e6b48bfbe0d6503f6848412/users/698c74ff3c464ded80a8d49e91f841cd/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:55:57.990461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb67d6-9c50-4426-a860-ef815686c8e7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:57.990876 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb67d6-9c50-4426-a860-ef815686c8e7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:57.991230 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb67d6-9c50-4426-a860-ef815686c8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:58.020969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e5fb67d6-9c50-4426-a860-ef815686c8e7 None None] MFA Rules not processed for user `698c74ff3c464ded80a8d49e91f841cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:55:58.022205 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e5fb67d6-9c50-4426-a860-ef815686c8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:58.085399 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4410/8867] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:55:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:55:58.095947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0da499-f688-462f-ba31-0c027f55b1a1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:55:58.097710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-2a0da499-f688-462f-ba31-0c027f55b1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:55:58.119190 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:58.164755 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0da499-f688-462f-ba31-0c027f55b1a1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:55:58.169454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de99ecf-7d20-4f01-ac2d-777fd72e6ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:55:58.170087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de99ecf-7d20-4f01-ac2d-777fd72e6ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:55:58.170376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de99ecf-7d20-4f01-ac2d-777fd72e6ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:55:58.170655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de99ecf-7d20-4f01-ac2d-777fd72e6ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:55:58.181483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de99ecf-7d20-4f01-ac2d-777fd72e6ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:55:58.184011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de99ecf-7d20-4f01-ac2d-777fd72e6ed1 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:55:58.194715 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4458/8868] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:55:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:56:02.978288 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb67d6-9c50-4426-a860-ef815686c8e7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:02.998319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:03.044660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb67d6-9c50-4426-a860-ef815686c8e7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:03.049173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a682b-c1c4-4e74-9a0d-58d5f44316c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:03.049811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a682b-c1c4-4e74-9a0d-58d5f44316c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:03.050096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a682b-c1c4-4e74-9a0d-58d5f44316c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:03.050373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a682b-c1c4-4e74-9a0d-58d5f44316c8 admin admin] PATH_INFO: `/v3/users/698c74ff3c464ded80a8d49e91f841cd` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:03.051551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a682b-c1c4-4e74-9a0d-58d5f44316c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=698c74ff3c464ded80a8d49e91f841cd)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:03.053471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a682b-c1c4-4e74-9a0d-58d5f44316c8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:03.099531 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b35a682b-c1c4-4e74-9a0d-58d5f44316c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '698c74ff3c464ded80a8d49e91f841cd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:56:03.100252 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b35a682b-c1c4-4e74-9a0d-58d5f44316c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '698c74ff3c464ded80a8d49e91f841cd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:56:03.114606 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b35a682b-c1c4-4e74-9a0d-58d5f44316c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '698c74ff3c464ded80a8d49e91f841cd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:56:03.115251 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b35a682b-c1c4-4e74-9a0d-58d5f44316c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '698c74ff3c464ded80a8d49e91f841cd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:56:03.123305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b35a682b-c1c4-4e74-9a0d-58d5f44316c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '698c74ff3c464ded80a8d49e91f841cd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:56:03.135491 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4411/8869] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:56:02 2022] DELETE /identity/v3/users/698c74ff3c464ded80a8d49e91f841cd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:56:03.140287 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025bb46-0bbc-4642-93d5-9ae721a337e4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:03.140781 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025bb46-0bbc-4642-93d5-9ae721a337e4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:03.140886 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025bb46-0bbc-4642-93d5-9ae721a337e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:03.160027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3025bb46-0bbc-4642-93d5-9ae721a337e4 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:56:03.161259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3025bb46-0bbc-4642-93d5-9ae721a337e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:56:03.219905 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4459/8870] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:56:03.229665 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a682b-c1c4-4e74-9a0d-58d5f44316c8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:03.231164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b35a682b-c1c4-4e74-9a0d-58d5f44316c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:56:03.289956 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a682b-c1c4-4e74-9a0d-58d5f44316c8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:03.293742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e01b9-d3a0-4ec6-9f1d-a9a9965abd20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:03.294870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e01b9-d3a0-4ec6-9f1d-a9a9965abd20 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:03.295177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e01b9-d3a0-4ec6-9f1d-a9a9965abd20 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:03.295480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e01b9-d3a0-4ec6-9f1d-a9a9965abd20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:03.304973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e01b9-d3a0-4ec6-9f1d-a9a9965abd20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:03.306408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e01b9-d3a0-4ec6-9f1d-a9a9965abd20 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:03.316886 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4412/8871] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:56:03.484923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025bb46-0bbc-4642-93d5-9ae721a337e4 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:03.486452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3025bb46-0bbc-4642-93d5-9ae721a337e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:56:03.499314 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025bb46-0bbc-4642-93d5-9ae721a337e4 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:03.508556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c75aab-25c9-4487-a49a-811c752e2575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:03.510322 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c75aab-25c9-4487-a49a-811c752e2575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:03.510617 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c75aab-25c9-4487-a49a-811c752e2575 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:03.510900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c75aab-25c9-4487-a49a-811c752e2575 admin admin] PATH_INFO: `/v3/projects/73522e133e6b48bfbe0d6503f6848412` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:03.512286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c75aab-25c9-4487-a49a-811c752e2575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73522e133e6b48bfbe0d6503f6848412)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:03.514650 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c75aab-25c9-4487-a49a-811c752e2575 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:03.562699 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-48c75aab-25c9-4487-a49a-811c752e2575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73522e133e6b48bfbe0d6503f6848412', 'request_id': 'req-48c75aab-25c9-4487-a49a-811c752e2575'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:56:03.568793 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-48c75aab-25c9-4487-a49a-811c752e2575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73522e133e6b48bfbe0d6503f6848412', 'request_id': 'req-48c75aab-25c9-4487-a49a-811c752e2575'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:56:03.575822 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-48c75aab-25c9-4487-a49a-811c752e2575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73522e133e6b48bfbe0d6503f6848412', 'request_id': 'req-48c75aab-25c9-4487-a49a-811c752e2575'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:56:03.586612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-48c75aab-25c9-4487-a49a-811c752e2575 admin admin] The token cache is being invalidate because project 73522e133e6b48bfbe0d6503f6848412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 21:56:03.586906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-48c75aab-25c9-4487-a49a-811c752e2575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:56:03.587564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-48c75aab-25c9-4487-a49a-811c752e2575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 21:56:03.589080 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4460/8872] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:56:03 2022] DELETE /identity/v3/projects/73522e133e6b48bfbe0d6503f6848412 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:56:03.595440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cd3b7-332c-4d03-b244-5edb8cc4cfcb None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:03.595732 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cd3b7-332c-4d03-b244-5edb8cc4cfcb None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:03.596013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cd3b7-332c-4d03-b244-5edb8cc4cfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:03.617257 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-0c9cd3b7-332c-4d03-b244-5edb8cc4cfcb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:56:03.618456 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-0c9cd3b7-332c-4d03-b244-5edb8cc4cfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:56:03.651140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:03.679599 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4413/8873] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:56:03.688313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045d4d1-37e6-4d9a-9786-1d395588040c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:03.688613 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045d4d1-37e6-4d9a-9786-1d395588040c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:03.688896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045d4d1-37e6-4d9a-9786-1d395588040c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:03.708761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e045d4d1-37e6-4d9a-9786-1d395588040c None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:56:03.709991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e045d4d1-37e6-4d9a-9786-1d395588040c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:56:03.718490 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4461/8874] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:56:03.722880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cd3b7-332c-4d03-b244-5edb8cc4cfcb None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:03.733258 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cd3b7-332c-4d03-b244-5edb8cc4cfcb None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:03.737779 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31326340-d38c-47a6-a95b-17526217712b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:03.738385 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31326340-d38c-47a6-a95b-17526217712b admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:03.738670 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31326340-d38c-47a6-a95b-17526217712b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:03.738947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31326340-d38c-47a6-a95b-17526217712b admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:03.739697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31326340-d38c-47a6-a95b-17526217712b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 21:56:03.740008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31326340-d38c-47a6-a95b-17526217712b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:03.741611 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31326340-d38c-47a6-a95b-17526217712b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:03.753034 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4414/8875] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 21:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 21:56:03.757211 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045d4d1-37e6-4d9a-9786-1d395588040c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:03.767125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045d4d1-37e6-4d9a-9786-1d395588040c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:03.772278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31bc5a-0795-4a4f-acc3-c88b4b766525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:03.772900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31bc5a-0795-4a4f-acc3-c88b4b766525 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:03.773183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31bc5a-0795-4a4f-acc3-c88b4b766525 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:03.773516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31bc5a-0795-4a4f-acc3-c88b4b766525 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:03.774196 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31bc5a-0795-4a4f-acc3-c88b4b766525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:03.776157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31bc5a-0795-4a4f-acc3-c88b4b766525 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:03.807679 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4462/8876] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:56:03 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:56:03.808849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31326340-d38c-47a6-a95b-17526217712b admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:03.819165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31326340-d38c-47a6-a95b-17526217712b admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:03.881342 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd44f8-7ba7-434a-b1c9-73c7037b848c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:03.881974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd44f8-7ba7-434a-b1c9-73c7037b848c admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:03.882264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd44f8-7ba7-434a-b1c9-73c7037b848c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:03.882549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd44f8-7ba7-434a-b1c9-73c7037b848c admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:03.883222 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd44f8-7ba7-434a-b1c9-73c7037b848c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:03.885216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd44f8-7ba7-434a-b1c9-73c7037b848c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:03.907331 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4415/8877] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:56:03 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:56:03.912210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31bc5a-0795-4a4f-acc3-c88b4b766525 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:03.923765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31bc5a-0795-4a4f-acc3-c88b4b766525 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:03.928398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d4f86-f7a3-4f08-9d96-e73bdef211f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:03.929011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d4f86-f7a3-4f08-9d96-e73bdef211f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:03.929290 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d4f86-f7a3-4f08-9d96-e73bdef211f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:03.929565 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d4f86-f7a3-4f08-9d96-e73bdef211f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:03.930374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d4f86-f7a3-4f08-9d96-e73bdef211f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:03.932072 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d4f86-f7a3-4f08-9d96-e73bdef211f5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:03.944405 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4463/8878] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:56:03.948573 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd44f8-7ba7-434a-b1c9-73c7037b848c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:03.959361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd44f8-7ba7-434a-b1c9-73c7037b848c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:03.964009 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0495df-7a37-4444-911c-c403123b4fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:03.964617 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0495df-7a37-4444-911c-c403123b4fce admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:03.964904 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0495df-7a37-4444-911c-c403123b4fce admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:03.965186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0495df-7a37-4444-911c-c403123b4fce admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:03.966534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0495df-7a37-4444-911c-c403123b4fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:03.968175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0495df-7a37-4444-911c-c403123b4fce admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:03.978713 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4416/8879] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:56:03.982845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d4f86-f7a3-4f08-9d96-e73bdef211f5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:03.993177 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d4f86-f7a3-4f08-9d96-e73bdef211f5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:03.998320 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0b31f-29b8-4b9f-b838-eef333db3e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:03.998669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0b31f-29b8-4b9f-b838-eef333db3e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:03.998954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0b31f-29b8-4b9f-b838-eef333db3e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:03.999231 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0b31f-29b8-4b9f-b838-eef333db3e54 admin admin] PATH_INFO: `/v3/projects/9a9d01d869a84e2486ef3918ff0dc1cd/users/cdd6e3798b5c4086ba6c1ccf22cbbb17/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:04.001673 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:04.017521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0b31f-29b8-4b9f-b838-eef333db3e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9d01d869a84e2486ef3918ff0dc1cd, user_id=cdd6e3798b5c4086ba6c1ccf22cbbb17, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:04.020251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0b31f-29b8-4b9f-b838-eef333db3e54 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:04.033580 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4464/8880] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:56:03 2022] PUT /identity/v3/projects/9a9d01d869a84e2486ef3918ff0dc1cd/users/cdd6e3798b5c4086ba6c1ccf22cbbb17/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:56:04.039069 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae1d5a-4754-4d24-a8b8-f18dbd263076 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:04.039431 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae1d5a-4754-4d24-a8b8-f18dbd263076 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:04.039720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae1d5a-4754-4d24-a8b8-f18dbd263076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:04.058509 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c1ae1d5a-4754-4d24-a8b8-f18dbd263076 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:56:04.059840 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c1ae1d5a-4754-4d24-a8b8-f18dbd263076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:56:04.118473 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4417/8881] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:56:04.128656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0b31f-29b8-4b9f-b838-eef333db3e54 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:04.130363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-11a0b31f-29b8-4b9f-b838-eef333db3e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:56:04.191966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0b31f-29b8-4b9f-b838-eef333db3e54 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:04.195912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a6e58-2b43-4182-b6f2-b2a4e9ba3643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:04.196579 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a6e58-2b43-4182-b6f2-b2a4e9ba3643 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:04.196874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a6e58-2b43-4182-b6f2-b2a4e9ba3643 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:04.197191 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a6e58-2b43-4182-b6f2-b2a4e9ba3643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:04.207222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a6e58-2b43-4182-b6f2-b2a4e9ba3643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:04.208729 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a6e58-2b43-4182-b6f2-b2a4e9ba3643 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:04.218537 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4465/8882] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:56:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:56:07.929343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed17bac-27a9-4340-b360-feb368695c9d None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:07.929845 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed17bac-27a9-4340-b360-feb368695c9d None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:07.929963 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed17bac-27a9-4340-b360-feb368695c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:07.972488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5ed17bac-27a9-4340-b360-feb368695c9d None None] MFA Rules not processed for user `cdd6e3798b5c4086ba6c1ccf22cbbb17`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:56:07.973753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5ed17bac-27a9-4340-b360-feb368695c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:56:08.002100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:08.059590 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4418/8883] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:56:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:56:08.064278 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a6e58-2b43-4182-b6f2-b2a4e9ba3643 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:08.095643 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a6e58-2b43-4182-b6f2-b2a4e9ba3643 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:08.100689 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a875b4-b659-4a7a-858d-9f83e560d3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:08.101526 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a875b4-b659-4a7a-858d-9f83e560d3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:08.101840 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a875b4-b659-4a7a-858d-9f83e560d3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:08.102116 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a875b4-b659-4a7a-858d-9f83e560d3c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:08.102777 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a875b4-b659-4a7a-858d-9f83e560d3c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:08.104707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a875b4-b659-4a7a-858d-9f83e560d3c8 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:08.133170 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4466/8884] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 21:56:08 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 21:56:08.137167 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed17bac-27a9-4340-b360-feb368695c9d None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:08.149278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed17bac-27a9-4340-b360-feb368695c9d None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:08.211113 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc450c-5945-46ba-a778-2555551c38b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:08.211807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc450c-5945-46ba-a778-2555551c38b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:08.212111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc450c-5945-46ba-a778-2555551c38b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:08.212393 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc450c-5945-46ba-a778-2555551c38b0 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:08.213101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc450c-5945-46ba-a778-2555551c38b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:08.215153 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc450c-5945-46ba-a778-2555551c38b0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:08.242033 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4419/8885] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 21:56:08 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 21:56:08.243340 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a875b4-b659-4a7a-858d-9f83e560d3c8 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:08.254409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a875b4-b659-4a7a-858d-9f83e560d3c8 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:08.259391 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4cf3c-db1c-4589-8b91-15b7dc891afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:08.260027 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4cf3c-db1c-4589-8b91-15b7dc891afb admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:08.260318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4cf3c-db1c-4589-8b91-15b7dc891afb admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:08.260603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4cf3c-db1c-4589-8b91-15b7dc891afb admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:08.261312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4cf3c-db1c-4589-8b91-15b7dc891afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:08.263529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4cf3c-db1c-4589-8b91-15b7dc891afb admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:08.275128 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4467/8886] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:56:08.284328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc450c-5945-46ba-a778-2555551c38b0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:08.299232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc450c-5945-46ba-a778-2555551c38b0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:08.308246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3a1e4-2a0d-44ca-9bf9-e88151ac3208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:08.309024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3a1e4-2a0d-44ca-9bf9-e88151ac3208 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:08.309425 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3a1e4-2a0d-44ca-9bf9-e88151ac3208 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:08.309773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3a1e4-2a0d-44ca-9bf9-e88151ac3208 admin admin] PATH_INFO: `/v3/projects/f839601740744201bd0d51d47622f421/users/efefc56c46724c3baa237aa5120f8741/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:08.327361 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3a1e4-2a0d-44ca-9bf9-e88151ac3208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f839601740744201bd0d51d47622f421, user_id=efefc56c46724c3baa237aa5120f8741, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:08.330697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3a1e4-2a0d-44ca-9bf9-e88151ac3208 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:08.348712 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4420/8887] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:56:08 2022] PUT /identity/v3/projects/f839601740744201bd0d51d47622f421/users/efefc56c46724c3baa237aa5120f8741/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:56:08.352612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4cf3c-db1c-4589-8b91-15b7dc891afb admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:08.363566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4cf3c-db1c-4589-8b91-15b7dc891afb admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:08.425833 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cf478-b944-4b09-a944-a9326d9b4b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:08.426480 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cf478-b944-4b09-a944-a9326d9b4b3b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:08.426769 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cf478-b944-4b09-a944-a9326d9b4b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:08.427045 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cf478-b944-4b09-a944-a9326d9b4b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:08.427778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6cf478-b944-4b09-a944-a9326d9b4b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:08.429415 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6cf478-b944-4b09-a944-a9326d9b4b3b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:08.440649 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4468/8888] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 21:56:08.444819 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3a1e4-2a0d-44ca-9bf9-e88151ac3208 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:08.456373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3a1e4-2a0d-44ca-9bf9-e88151ac3208 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:08.461529 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950c3b1-2bc1-42a7-a13d-81529c44d31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:08.462243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950c3b1-2bc1-42a7-a13d-81529c44d31b admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:08.462526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950c3b1-2bc1-42a7-a13d-81529c44d31b admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:08.462824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950c3b1-2bc1-42a7-a13d-81529c44d31b admin admin] PATH_INFO: `/v3/projects/f839601740744201bd0d51d47622f421/users/efefc56c46724c3baa237aa5120f8741/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:08.464924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950c3b1-2bc1-42a7-a13d-81529c44d31b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f839601740744201bd0d51d47622f421, user_id=efefc56c46724c3baa237aa5120f8741, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:08.468168 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950c3b1-2bc1-42a7-a13d-81529c44d31b admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:08.479190 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4421/8889] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 21:56:08 2022] PUT /identity/v3/projects/f839601740744201bd0d51d47622f421/users/efefc56c46724c3baa237aa5120f8741/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 21:56:12.983345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27453d-142c-4337-bd96-74e2a268d2c1 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:12.983825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27453d-142c-4337-bd96-74e2a268d2c1 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:12.983945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27453d-142c-4337-bd96-74e2a268d2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:13.025341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9f27453d-142c-4337-bd96-74e2a268d2c1 None None] MFA Rules not processed for user `efefc56c46724c3baa237aa5120f8741`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:56:13.026872 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9f27453d-142c-4337-bd96-74e2a268d2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:56:13.052807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:13.120129 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4469/8890] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:56:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 21:56:13.149412 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0365c-f9f4-4a57-889f-3632581f29a7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:13.149900 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0365c-f9f4-4a57-889f-3632581f29a7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:13.150001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0365c-f9f4-4a57-889f-3632581f29a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:13.209360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b8b0365c-f9f4-4a57-889f-3632581f29a7 None None] MFA Rules not processed for user `60d1fa32e98f45128f990a107db45eae`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:56:13.210789 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b8b0365c-f9f4-4a57-889f-3632581f29a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:56:13.281003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:13.333580 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4422/8891] 10.222.0.17 () {58 vars in 1063 bytes} [Sat Jul 30 21:56:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:56:13.339820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27453d-142c-4337-bd96-74e2a268d2c1 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:13.350603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27453d-142c-4337-bd96-74e2a268d2c1 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:13.355104 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55c428-9a59-44e4-a684-51f97b061d19 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:13.357082 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55c428-9a59-44e4-a684-51f97b061d19 service glance] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:13.357710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55c428-9a59-44e4-a684-51f97b061d19 service glance] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:13.358152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55c428-9a59-44e4-a684-51f97b061d19 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:13.444265 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55c428-9a59-44e4-a684-51f97b061d19 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:13.445763 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55c428-9a59-44e4-a684-51f97b061d19 service glance] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:13.458648 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4470/8892] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:56:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:56:13.614965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df228a19-7fa3-4c32-89f7-d9a18f47be60 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:13.615266 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df228a19-7fa3-4c32-89f7-d9a18f47be60 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:13.615597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df228a19-7fa3-4c32-89f7-d9a18f47be60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:13.671384 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-df228a19-7fa3-4c32-89f7-d9a18f47be60 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:56:13.672609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-df228a19-7fa3-4c32-89f7-d9a18f47be60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:56:13.753772 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4423/8893] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:56:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:56:13.807272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94187c60-bf36-4c06-b6a3-7199ce259c82 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:13.807603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94187c60-bf36-4c06-b6a3-7199ce259c82 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:13.807881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94187c60-bf36-4c06-b6a3-7199ce259c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:13.860254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-94187c60-bf36-4c06-b6a3-7199ce259c82 None None] MFA Rules not processed for user `2181960e3bed4031889d6e72a721e151`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:56:13.861513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-94187c60-bf36-4c06-b6a3-7199ce259c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:56:13.935361 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4471/8894] 10.222.0.17 () {58 vars in 1040 bytes} [Sat Jul 30 21:56:13 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:56:13.941768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df228a19-7fa3-4c32-89f7-d9a18f47be60 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:13.954462 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df228a19-7fa3-4c32-89f7-d9a18f47be60 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:13.959741 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926af2be-9a2a-4e9e-9fbd-d1558ef1de2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:13.960359 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af2be-9a2a-4e9e-9fbd-d1558ef1de2a service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:13.960648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af2be-9a2a-4e9e-9fbd-d1558ef1de2a service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:13.960929 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af2be-9a2a-4e9e-9fbd-d1558ef1de2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:13.969206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926af2be-9a2a-4e9e-9fbd-d1558ef1de2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:13.970794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926af2be-9a2a-4e9e-9fbd-d1558ef1de2a service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:13.979014 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4424/8895] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:56:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:56:23.118297 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e25699-6d36-48fd-93f8-aaddb9e2cac5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:23.118862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e25699-6d36-48fd-93f8-aaddb9e2cac5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:23.118862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e25699-6d36-48fd-93f8-aaddb9e2cac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:23.138636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-41e25699-6d36-48fd-93f8-aaddb9e2cac5 None None] MFA Rules not processed for user `cdd6e3798b5c4086ba6c1ccf22cbbb17`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:56:23.139901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-41e25699-6d36-48fd-93f8-aaddb9e2cac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:56:23.147051 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4472/8896] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 21:56:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:56:23.975902 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=61 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:24.201191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4929a-a648-4e00-9f63-d212a6b7c698 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:24.201482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4929a-a648-4e00-9f63-d212a6b7c698 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:24.201768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4929a-a648-4e00-9f63-d212a6b7c698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:24.221178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5be4929a-a648-4e00-9f63-d212a6b7c698 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:56:24.222427 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5be4929a-a648-4e00-9f63-d212a6b7c698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:56:24.294757 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4425/8897] 10.222.0.48 () {58 vars in 1015 bytes} [Sat Jul 30 21:56:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:56:24.306494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40313b30-e129-4fa8-a09f-dc015284730f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:24.306991 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40313b30-e129-4fa8-a09f-dc015284730f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:24.307124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40313b30-e129-4fa8-a09f-dc015284730f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:24.316168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=100 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:24.327478 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-40313b30-e129-4fa8-a09f-dc015284730f None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:56:24.328698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-40313b30-e129-4fa8-a09f-dc015284730f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:56:24.338164 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4473/8898] 10.222.0.17 () {58 vars in 1058 bytes} [Sat Jul 30 21:56:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:56:24.344207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4929a-a648-4e00-9f63-d212a6b7c698 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:24.354746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4929a-a648-4e00-9f63-d212a6b7c698 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:24.360340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d798bbb-1b37-48a0-aacb-d22233239390 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:24.360950 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d798bbb-1b37-48a0-aacb-d22233239390 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:24.361237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d798bbb-1b37-48a0-aacb-d22233239390 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:24.361515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d798bbb-1b37-48a0-aacb-d22233239390 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:24.369802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d798bbb-1b37-48a0-aacb-d22233239390 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:24.371985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d798bbb-1b37-48a0-aacb-d22233239390 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:24.386098 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4426/8899] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:56:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:56:25.047786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb29be0-d148-419b-bf50-6088dac8dbc6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:25.048139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb29be0-d148-419b-bf50-6088dac8dbc6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:25.048554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb29be0-d148-419b-bf50-6088dac8dbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:25.069607 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0bb29be0-d148-419b-bf50-6088dac8dbc6 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:56:25.070883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0bb29be0-d148-419b-bf50-6088dac8dbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:56:25.082409 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4474/8900] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:56:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:56:25.095893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d798bbb-1b37-48a0-aacb-d22233239390 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:25.107746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d798bbb-1b37-48a0-aacb-d22233239390 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:25.112773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2ec71-5e30-4766-b38e-5c621f994899 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:25.113413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2ec71-5e30-4766-b38e-5c621f994899 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:25.113699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2ec71-5e30-4766-b38e-5c621f994899 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:25.113981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2ec71-5e30-4766-b38e-5c621f994899 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:25.124268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2ec71-5e30-4766-b38e-5c621f994899 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:25.126246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2ec71-5e30-4766-b38e-5c621f994899 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:25.137738 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4427/8901] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 21:56:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 21:56:35.063303 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:35.132071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=45 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:37.913172 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb29be0-d148-419b-bf50-6088dac8dbc6 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:37.978909 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb29be0-d148-419b-bf50-6088dac8dbc6 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:37.983166 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ec13d-5faf-43dd-9b3a-7b2752ed0ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:37.983823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ec13d-5faf-43dd-9b3a-7b2752ed0ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:37.984118 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ec13d-5faf-43dd-9b3a-7b2752ed0ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:37.984398 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ec13d-5faf-43dd-9b3a-7b2752ed0ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:38.001254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d74ec13d-5faf-43dd-9b3a-7b2752ed0ab6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:56:38.077857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ec13d-5faf-43dd-9b3a-7b2752ed0ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:38.079313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ec13d-5faf-43dd-9b3a-7b2752ed0ab6 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:38.102485 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4475/8902] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:56:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:56:40.450353 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2ec71-5e30-4766-b38e-5c621f994899 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:40.451825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5dc2ec71-5e30-4766-b38e-5c621f994899 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:56:40.476526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2ec71-5e30-4766-b38e-5c621f994899 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:40.480218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4d1a6-d221-4e8a-846d-be431822f4df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:40.480828 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4d1a6-d221-4e8a-846d-be431822f4df service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:40.481688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4d1a6-d221-4e8a-846d-be431822f4df service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:40.481973 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4d1a6-d221-4e8a-846d-be431822f4df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:40.483738 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-cee4d1a6-d221-4e8a-846d-be431822f4df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:56:40.499901 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4d1a6-d221-4e8a-846d-be431822f4df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:40.501340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4d1a6-d221-4e8a-846d-be431822f4df service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:40.519415 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4428/8903] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:56:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:56:47.104463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c5e9b-194f-42b3-9439-fb7997a6240a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:47.105043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c5e9b-194f-42b3-9439-fb7997a6240a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:47.105043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c5e9b-194f-42b3-9439-fb7997a6240a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:47.134820 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-688c5e9b-194f-42b3-9439-fb7997a6240a None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:56:47.136068 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-688c5e9b-194f-42b3-9439-fb7997a6240a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:56:47.144897 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4476/8904] 10.222.0.47 () {58 vars in 1015 bytes} [Sat Jul 30 21:56:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:56:47.157669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4d1a6-d221-4e8a-846d-be431822f4df service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:47.169032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4d1a6-d221-4e8a-846d-be431822f4df service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:47.174540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd952029-5549-43be-9ba8-015688b16482 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:47.175175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd952029-5549-43be-9ba8-015688b16482 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:47.175492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd952029-5549-43be-9ba8-015688b16482 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:47.175766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd952029-5549-43be-9ba8-015688b16482 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:47.186220 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd952029-5549-43be-9ba8-015688b16482 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:47.187851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd952029-5549-43be-9ba8-015688b16482 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:47.197727 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4429/8905] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:56:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:56:48.761156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c5e9b-194f-42b3-9439-fb7997a6240a None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:56:48.772227 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c5e9b-194f-42b3-9439-fb7997a6240a None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:56:48.776823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f6228-f13e-40cc-89ca-0160ac77c0b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:56:48.777656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f6228-f13e-40cc-89ca-0160ac77c0b1 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:56:48.778095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f6228-f13e-40cc-89ca-0160ac77c0b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:56:48.778387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f6228-f13e-40cc-89ca-0160ac77c0b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:56:48.788151 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f6228-f13e-40cc-89ca-0160ac77c0b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:56:48.789672 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f6228-f13e-40cc-89ca-0160ac77c0b1 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:56:48.800145 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4477/8906] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:56:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 21:56:57.193661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=17 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:58.795890 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=75 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:57:51.882090 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd952029-5549-43be-9ba8-015688b16482 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:57:51.892206 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd952029-5549-43be-9ba8-015688b16482 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:57:51.896127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec19cb0-ed64-4b18-acf8-c486d2b297b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:57:51.896736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec19cb0-ed64-4b18-acf8-c486d2b297b9 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:57:51.897030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec19cb0-ed64-4b18-acf8-c486d2b297b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:57:51.897339 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec19cb0-ed64-4b18-acf8-c486d2b297b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:57:51.899085 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bec19cb0-ed64-4b18-acf8-c486d2b297b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:57:51.911906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec19cb0-ed64-4b18-acf8-c486d2b297b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:57:51.913349 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec19cb0-ed64-4b18-acf8-c486d2b297b9 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:57:51.924042 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4430/8907] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:57:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:58:01.917991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:58:51.906405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbdb78-938a-460e-b609-82cb47544ad4 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:58:51.907649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbdb78-938a-460e-b609-82cb47544ad4 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:58:51.907649 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbdb78-938a-460e-b609-82cb47544ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:58:51.955233 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b2cbdb78-938a-460e-b609-82cb47544ad4 None None] MFA Rules not processed for user `4a886ccf9590432caf209526410a7b53`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:58:51.956492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b2cbdb78-938a-460e-b609-82cb47544ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:58:51.963892 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4478/8908] 10.222.0.48 () {58 vars in 1015 bytes} [Sat Jul 30 21:58:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:58:51.977506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec19cb0-ed64-4b18-acf8-c486d2b297b9 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:58:51.987479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec19cb0-ed64-4b18-acf8-c486d2b297b9 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:58:51.991271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b379ab-87fd-4260-a6f0-d9d0ee008dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:58:51.991920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b379ab-87fd-4260-a6f0-d9d0ee008dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:58:51.992209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b379ab-87fd-4260-a6f0-d9d0ee008dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:58:51.992489 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b379ab-87fd-4260-a6f0-d9d0ee008dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:58:51.999966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b379ab-87fd-4260-a6f0-d9d0ee008dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:58:52.001409 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b379ab-87fd-4260-a6f0-d9d0ee008dc3 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:58:52.009682 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4431/8909] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:58:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:59:01.952567 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=13 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:59:02.006344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:59:08.584067 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6ab8-3047-4b8e-b29f-ffb1f999fe96 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:59:08.584683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6ab8-3047-4b8e-b29f-ffb1f999fe96 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:59:08.584683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6ab8-3047-4b8e-b29f-ffb1f999fe96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:59:08.623877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-509a6ab8-3047-4b8e-b29f-ffb1f999fe96 None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:59:08.625674 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-509a6ab8-3047-4b8e-b29f-ffb1f999fe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:59:08.635869 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4479/8910] 10.222.0.17 () {58 vars in 1059 bytes} [Sat Jul 30 21:59:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:59:08.642373 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb8c0a-3e1a-4980-996e-de22db1af585 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:59:08.642853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb8c0a-3e1a-4980-996e-de22db1af585 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:59:08.643232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb8c0a-3e1a-4980-996e-de22db1af585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:59:08.662977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-18bb8c0a-3e1a-4980-996e-de22db1af585 None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:59:08.664180 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-18bb8c0a-3e1a-4980-996e-de22db1af585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:59:08.674336 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4432/8911] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:59:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:59:08.694212 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a6ab8-3047-4b8e-b29f-ffb1f999fe96 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:59:08.706273 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a6ab8-3047-4b8e-b29f-ffb1f999fe96 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:59:08.709983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d11b4-3fe7-4347-9889-3b09055ee942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:59:08.710608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d11b4-3fe7-4347-9889-3b09055ee942 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:59:08.710897 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d11b4-3fe7-4347-9889-3b09055ee942 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:59:08.711180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d11b4-3fe7-4347-9889-3b09055ee942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:59:08.722524 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d11b4-3fe7-4347-9889-3b09055ee942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:59:08.724010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d11b4-3fe7-4347-9889-3b09055ee942 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:59:08.735628 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4480/8912] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:59:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:59:10.024100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671dcb5-abd5-4133-b42c-d86003460158 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:59:10.024652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671dcb5-abd5-4133-b42c-d86003460158 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:59:10.024652 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671dcb5-abd5-4133-b42c-d86003460158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:59:10.043959 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d671dcb5-abd5-4133-b42c-d86003460158 None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:59:10.045234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d671dcb5-abd5-4133-b42c-d86003460158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:59:10.054601 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4433/8913] 10.222.0.17 () {58 vars in 1059 bytes} [Sat Jul 30 21:59:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:59:10.060229 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ed980-910f-4a49-a9c7-e69e55e5b6d3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:59:10.061049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ed980-910f-4a49-a9c7-e69e55e5b6d3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:59:10.061335 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ed980-910f-4a49-a9c7-e69e55e5b6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:59:10.082791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-951ed980-910f-4a49-a9c7-e69e55e5b6d3 None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 21:59:10.084041 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-951ed980-910f-4a49-a9c7-e69e55e5b6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 21:59:10.093327 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4481/8914] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 21:59:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 21:59:10.104455 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671dcb5-abd5-4133-b42c-d86003460158 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 21:59:10.113879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671dcb5-abd5-4133-b42c-d86003460158 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 21:59:10.117678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add1c5b-1591-4603-8266-1cacd8c60938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 21:59:10.118297 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add1c5b-1591-4603-8266-1cacd8c60938 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 21:59:10.118587 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add1c5b-1591-4603-8266-1cacd8c60938 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 21:59:10.118868 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add1c5b-1591-4603-8266-1cacd8c60938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 21:59:10.129676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add1c5b-1591-4603-8266-1cacd8c60938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 21:59:10.131109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add1c5b-1591-4603-8266-1cacd8c60938 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 21:59:10.142835 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4434/8915] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 21:59:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 21:59:20.077347 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=18 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:59:20.137159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=12 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:00:24.477846 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3524e8-2833-4682-b9f5-b47eb2ac4458 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:00:24.478417 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3524e8-2833-4682-b9f5-b47eb2ac4458 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:00:24.478530 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3524e8-2833-4682-b9f5-b47eb2ac4458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:00:24.501304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-eb3524e8-2833-4682-b9f5-b47eb2ac4458 None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:00:24.503332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-eb3524e8-2833-4682-b9f5-b47eb2ac4458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:00:24.525276 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4482/8916] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 22:00:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:00:24.547320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add1c5b-1591-4603-8266-1cacd8c60938 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:00:24.570435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add1c5b-1591-4603-8266-1cacd8c60938 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:00:24.577291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf773e-afbe-49c8-9f4c-ff82c7c95058 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:00:24.579125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf773e-afbe-49c8-9f4c-ff82c7c95058 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:00:24.579282 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf773e-afbe-49c8-9f4c-ff82c7c95058 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:00:24.579803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf773e-afbe-49c8-9f4c-ff82c7c95058 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:00:24.591660 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf773e-afbe-49c8-9f4c-ff82c7c95058 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:00:24.594325 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf773e-afbe-49c8-9f4c-ff82c7c95058 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:00:24.609442 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4435/8917] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:00:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:00:25.587308 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553797b-b9b0-433e-80c5-34471e4c2b2e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:00:25.587761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553797b-b9b0-433e-80c5-34471e4c2b2e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:00:25.587881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553797b-b9b0-433e-80c5-34471e4c2b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:00:25.610292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-8553797b-b9b0-433e-80c5-34471e4c2b2e None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:00:25.611786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-8553797b-b9b0-433e-80c5-34471e4c2b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:00:25.622573 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4483/8918] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 22:00:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:00:25.638705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf773e-afbe-49c8-9f4c-ff82c7c95058 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:00:25.651856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf773e-afbe-49c8-9f4c-ff82c7c95058 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:00:25.657636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a0bac-f135-421e-a514-fb9447d775b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:00:25.658256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a0bac-f135-421e-a514-fb9447d775b9 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:00:25.658539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a0bac-f135-421e-a514-fb9447d775b9 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:00:25.658818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a0bac-f135-421e-a514-fb9447d775b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:00:25.668885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a0bac-f135-421e-a514-fb9447d775b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:00:25.670470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a0bac-f135-421e-a514-fb9447d775b9 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:00:25.681507 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4436/8919] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:00:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:00:31.885562 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea00199-ddb0-4e93-906d-eb17efb76b9b None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:00:31.885999 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea00199-ddb0-4e93-906d-eb17efb76b9b None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:00:31.886124 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea00199-ddb0-4e93-906d-eb17efb76b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:00:31.906258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-aea00199-ddb0-4e93-906d-eb17efb76b9b None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:00:31.907534 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-aea00199-ddb0-4e93-906d-eb17efb76b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:00:31.914735 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4484/8920] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 22:00:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:00:31.955403 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a0bac-f135-421e-a514-fb9447d775b9 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:00:31.966618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a0bac-f135-421e-a514-fb9447d775b9 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:00:31.971629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2d576-d574-44ae-887a-2fe6a7dea4e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:00:31.972232 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2d576-d574-44ae-887a-2fe6a7dea4e0 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:00:31.972515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2d576-d574-44ae-887a-2fe6a7dea4e0 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:00:31.972788 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2d576-d574-44ae-887a-2fe6a7dea4e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:00:31.980745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2d576-d574-44ae-887a-2fe6a7dea4e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:00:31.982313 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2d576-d574-44ae-887a-2fe6a7dea4e0 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:00:31.991114 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4437/8921] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 22:00:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 22:00:32.484033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24520e-cfdc-4dbe-8c15-dc4923965402 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:00:32.484330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24520e-cfdc-4dbe-8c15-dc4923965402 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:00:32.484616 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24520e-cfdc-4dbe-8c15-dc4923965402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:00:32.504666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7b24520e-cfdc-4dbe-8c15-dc4923965402 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:00:32.505891 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7b24520e-cfdc-4dbe-8c15-dc4923965402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:00:32.513205 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4485/8922] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 22:00:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:00:32.526031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2d576-d574-44ae-887a-2fe6a7dea4e0 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:00:32.536540 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2d576-d574-44ae-887a-2fe6a7dea4e0 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:00:32.541570 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c512a04-eeef-4d37-a164-6433c7295dd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:00:32.542175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c512a04-eeef-4d37-a164-6433c7295dd0 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:00:32.542463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c512a04-eeef-4d37-a164-6433c7295dd0 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:00:32.542744 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c512a04-eeef-4d37-a164-6433c7295dd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:00:32.551032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c512a04-eeef-4d37-a164-6433c7295dd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:00:32.552663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c512a04-eeef-4d37-a164-6433c7295dd0 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:00:32.560909 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4438/8923] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 22:00:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 22:00:40.880168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf0f27-8363-4777-83f1-c63bf42fb973 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:00:40.880766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf0f27-8363-4777-83f1-c63bf42fb973 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:00:40.880766 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf0f27-8363-4777-83f1-c63bf42fb973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:00:40.902136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1fbf0f27-8363-4777-83f1-c63bf42fb973 None None] MFA Rules not processed for user `cdd6e3798b5c4086ba6c1ccf22cbbb17`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:00:40.903403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1fbf0f27-8363-4777-83f1-c63bf42fb973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:00:40.910434 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4486/8924] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:00:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:00:41.162496 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece4a67-9679-4be4-8f63-72e47630a91a None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:00:41.163054 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece4a67-9679-4be4-8f63-72e47630a91a None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:00:41.163163 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece4a67-9679-4be4-8f63-72e47630a91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:00:41.183699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-6ece4a67-9679-4be4-8f63-72e47630a91a None None] MFA Rules not processed for user `4a886ccf9590432caf209526410a7b53`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:00:41.184935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-6ece4a67-9679-4be4-8f63-72e47630a91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:00:41.192294 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4439/8925] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 22:00:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:00:41.204424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf0f27-8363-4777-83f1-c63bf42fb973 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:00:41.213968 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf0f27-8363-4777-83f1-c63bf42fb973 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:00:41.218092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644d5d1-7a02-4d3c-b6dd-d3e252b63659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:00:41.218718 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644d5d1-7a02-4d3c-b6dd-d3e252b63659 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:00:41.219000 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644d5d1-7a02-4d3c-b6dd-d3e252b63659 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:00:41.219274 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644d5d1-7a02-4d3c-b6dd-d3e252b63659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:00:41.226295 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644d5d1-7a02-4d3c-b6dd-d3e252b63659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:00:41.227759 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644d5d1-7a02-4d3c-b6dd-d3e252b63659 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:00:41.235433 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4487/8926] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:00:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:00:41.560275 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece4a67-9679-4be4-8f63-72e47630a91a None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:00:41.572966 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece4a67-9679-4be4-8f63-72e47630a91a None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:00:41.578672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb598b-9efe-4be5-94e6-56852943a70a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:00:41.579310 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb598b-9efe-4be5-94e6-56852943a70a service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:00:41.579602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb598b-9efe-4be5-94e6-56852943a70a service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:00:41.579878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb598b-9efe-4be5-94e6-56852943a70a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:00:41.581629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-06eb598b-9efe-4be5-94e6-56852943a70a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:00:41.607199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb598b-9efe-4be5-94e6-56852943a70a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:00:41.608860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb598b-9efe-4be5-94e6-56852943a70a service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:00:41.618761 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4440/8927] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:00:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:00:42.715984 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8601466-ab82-4c24-8e68-a13433d179ab None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:00:42.716861 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8601466-ab82-4c24-8e68-a13433d179ab None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:00:42.717139 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8601466-ab82-4c24-8e68-a13433d179ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:00:42.743263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-b8601466-ab82-4c24-8e68-a13433d179ab None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:00:42.744525 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b8601466-ab82-4c24-8e68-a13433d179ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:00:42.751999 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4488/8928] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 22:00:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:00:42.765457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb598b-9efe-4be5-94e6-56852943a70a service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:00:42.777070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb598b-9efe-4be5-94e6-56852943a70a service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:00:42.782767 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6aa4c-5646-4d9c-9674-db368ca6497a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:00:42.783499 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6aa4c-5646-4d9c-9674-db368ca6497a service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:00:42.783785 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6aa4c-5646-4d9c-9674-db368ca6497a service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:00:42.784062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6aa4c-5646-4d9c-9674-db368ca6497a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:00:42.792812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6aa4c-5646-4d9c-9674-db368ca6497a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:00:42.794576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6aa4c-5646-4d9c-9674-db368ca6497a service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:00:42.804704 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4441/8929] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 22:00:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 22:00:52.738329 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=27 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:00:52.801071 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=47 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:00:57.225708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08ba16-5ba3-4e58-b1d7-d2a40f7abdf9 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:00:57.225708 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08ba16-5ba3-4e58-b1d7-d2a40f7abdf9 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:00:57.226260 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08ba16-5ba3-4e58-b1d7-d2a40f7abdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:00:57.259765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-6e08ba16-5ba3-4e58-b1d7-d2a40f7abdf9 None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:00:57.261111 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-6e08ba16-5ba3-4e58-b1d7-d2a40f7abdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:00:57.271574 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4489/8930] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 22:00:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:00:57.295170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6aa4c-5646-4d9c-9674-db368ca6497a service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:00:57.309745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6aa4c-5646-4d9c-9674-db368ca6497a service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:00:57.315340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb401618-eec7-42b7-9315-9f572f24b4e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:00:57.315960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb401618-eec7-42b7-9315-9f572f24b4e9 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:00:57.316280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb401618-eec7-42b7-9315-9f572f24b4e9 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:00:57.316561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb401618-eec7-42b7-9315-9f572f24b4e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:00:57.325465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb401618-eec7-42b7-9315-9f572f24b4e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:00:57.327099 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb401618-eec7-42b7-9315-9f572f24b4e9 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:00:57.338153 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4442/8931] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:00:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:01:07.253992 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:01:07.333894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:01:34.430025 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08ba16-5ba3-4e58-b1d7-d2a40f7abdf9 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:01:34.442252 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08ba16-5ba3-4e58-b1d7-d2a40f7abdf9 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:01:34.448959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cf499-5924-49f1-a1c4-28319e91cd29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:01:34.449594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cf499-5924-49f1-a1c4-28319e91cd29 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:01:34.449880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cf499-5924-49f1-a1c4-28319e91cd29 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:01:34.450157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cf499-5924-49f1-a1c4-28319e91cd29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:01:34.459720 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cf499-5924-49f1-a1c4-28319e91cd29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:01:34.461302 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cf499-5924-49f1-a1c4-28319e91cd29 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:01:34.471669 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4490/8932] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:01:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:01:44.466798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:01:49.037480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb401618-eec7-42b7-9315-9f572f24b4e9 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:01:49.049618 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb401618-eec7-42b7-9315-9f572f24b4e9 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:01:49.054688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fcb8d-7ad1-4abf-89c2-8074614c0e0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:01:49.055404 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fcb8d-7ad1-4abf-89c2-8074614c0e0f service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:01:49.055704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fcb8d-7ad1-4abf-89c2-8074614c0e0f service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:01:49.055991 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fcb8d-7ad1-4abf-89c2-8074614c0e0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:01:49.064413 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fcb8d-7ad1-4abf-89c2-8074614c0e0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:01:49.065996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fcb8d-7ad1-4abf-89c2-8074614c0e0f service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:01:49.075830 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4443/8933] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:01:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:01:49.122983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726853a-0656-4158-a567-64e4a0992ec6 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:01:49.123419 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726853a-0656-4158-a567-64e4a0992ec6 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:01:49.123583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726853a-0656-4158-a567-64e4a0992ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:01:49.161030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-7726853a-0656-4158-a567-64e4a0992ec6 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:01:49.162246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7726853a-0656-4158-a567-64e4a0992ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:01:49.170769 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4491/8934] 10.222.0.17 () {58 vars in 1058 bytes} [Sat Jul 30 22:01:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:01:49.176816 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fcb8d-7ad1-4abf-89c2-8074614c0e0f service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:01:49.187320 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fcb8d-7ad1-4abf-89c2-8074614c0e0f service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:01:49.192379 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e561bb-c074-4929-b1fa-ebaefd3819c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:01:49.192985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e561bb-c074-4929-b1fa-ebaefd3819c7 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:01:49.193280 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e561bb-c074-4929-b1fa-ebaefd3819c7 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:01:49.193614 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e561bb-c074-4929-b1fa-ebaefd3819c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:01:49.202094 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e561bb-c074-4929-b1fa-ebaefd3819c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:01:49.204218 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e561bb-c074-4929-b1fa-ebaefd3819c7 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:01:49.214249 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4444/8935] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:01:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:01:59.158735 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=9 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:01:59.209938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=12 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:31.467693 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53091d67-fb30-4514-a81e-0b32f43e39a7 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:31.468157 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53091d67-fb30-4514-a81e-0b32f43e39a7 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:31.468288 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53091d67-fb30-4514-a81e-0b32f43e39a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:31.487547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-53091d67-fb30-4514-a81e-0b32f43e39a7 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:02:31.488760 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-53091d67-fb30-4514-a81e-0b32f43e39a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:02:31.495960 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4492/8936] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 22:02:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:02:31.536298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e561bb-c074-4929-b1fa-ebaefd3819c7 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:31.548058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e561bb-c074-4929-b1fa-ebaefd3819c7 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:31.553068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670b28e-1179-448e-b230-a94414e651c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:31.553672 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670b28e-1179-448e-b230-a94414e651c9 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:31.553960 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670b28e-1179-448e-b230-a94414e651c9 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:31.554243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670b28e-1179-448e-b230-a94414e651c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:31.562332 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670b28e-1179-448e-b230-a94414e651c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:31.564545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670b28e-1179-448e-b230-a94414e651c9 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:31.572688 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4445/8937] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 22:02:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 22:02:31.922702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53091d67-fb30-4514-a81e-0b32f43e39a7 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:31.932389 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53091d67-fb30-4514-a81e-0b32f43e39a7 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:31.935925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97628de0-6359-4e80-b1d5-0e51e07af766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:31.936540 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97628de0-6359-4e80-b1d5-0e51e07af766 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:31.936847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97628de0-6359-4e80-b1d5-0e51e07af766 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:31.937125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97628de0-6359-4e80-b1d5-0e51e07af766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:32.005610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97628de0-6359-4e80-b1d5-0e51e07af766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:32.007064 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97628de0-6359-4e80-b1d5-0e51e07af766 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:32.026335 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4493/8938] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:02:35.155632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df92f1-5139-4361-b86f-f1bf94c6b5c7 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:35.156628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df92f1-5139-4361-b86f-f1bf94c6b5c7 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:35.156711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df92f1-5139-4361-b86f-f1bf94c6b5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:35.178805 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-73df92f1-5139-4361-b86f-f1bf94c6b5c7 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:02:35.180154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-73df92f1-5139-4361-b86f-f1bf94c6b5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:02:35.188952 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4446/8939] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 22:02:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:02:35.202481 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97628de0-6359-4e80-b1d5-0e51e07af766 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:35.213844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97628de0-6359-4e80-b1d5-0e51e07af766 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:35.220671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fca120-c94f-435f-b0f1-82fdc8163051 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:35.221374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fca120-c94f-435f-b0f1-82fdc8163051 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:35.221671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fca120-c94f-435f-b0f1-82fdc8163051 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:35.221956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fca120-c94f-435f-b0f1-82fdc8163051 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:35.232413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fca120-c94f-435f-b0f1-82fdc8163051 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:35.234031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fca120-c94f-435f-b0f1-82fdc8163051 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:35.248479 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4494/8940] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:02:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:02:38.510675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df92f1-5139-4361-b86f-f1bf94c6b5c7 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:38.523272 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df92f1-5139-4361-b86f-f1bf94c6b5c7 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:38.528834 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3201df-89a8-4a9d-83ef-6b75f868da34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:38.529486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3201df-89a8-4a9d-83ef-6b75f868da34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:38.529769 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3201df-89a8-4a9d-83ef-6b75f868da34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:38.530045 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3201df-89a8-4a9d-83ef-6b75f868da34 admin admin] PATH_INFO: `/v3/users/cdd6e3798b5c4086ba6c1ccf22cbbb17` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:38.531923 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3201df-89a8-4a9d-83ef-6b75f868da34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd6e3798b5c4086ba6c1ccf22cbbb17)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:38.533831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3201df-89a8-4a9d-83ef-6b75f868da34 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:38.595799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fb3201df-89a8-4a9d-83ef-6b75f868da34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd6e3798b5c4086ba6c1ccf22cbbb17'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:02:38.598098 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fb3201df-89a8-4a9d-83ef-6b75f868da34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd6e3798b5c4086ba6c1ccf22cbbb17'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:02:38.610173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fb3201df-89a8-4a9d-83ef-6b75f868da34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd6e3798b5c4086ba6c1ccf22cbbb17'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:02:38.610825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fb3201df-89a8-4a9d-83ef-6b75f868da34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd6e3798b5c4086ba6c1ccf22cbbb17'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:02:38.618248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-fb3201df-89a8-4a9d-83ef-6b75f868da34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd6e3798b5c4086ba6c1ccf22cbbb17'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:02:38.632301 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4447/8941] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 22:02:38 2022] DELETE /identity/v3/users/cdd6e3798b5c4086ba6c1ccf22cbbb17 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:02:38.840462 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fca120-c94f-435f-b0f1-82fdc8163051 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:38.851829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fca120-c94f-435f-b0f1-82fdc8163051 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:38.911011 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8440add-2269-4c78-9e03-af129678d0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:38.911706 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8440add-2269-4c78-9e03-af129678d0fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:38.912007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8440add-2269-4c78-9e03-af129678d0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:38.912292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8440add-2269-4c78-9e03-af129678d0fd admin admin] PATH_INFO: `/v3/projects/9a9d01d869a84e2486ef3918ff0dc1cd` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:38.913456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8440add-2269-4c78-9e03-af129678d0fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9d01d869a84e2486ef3918ff0dc1cd)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:38.915440 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8440add-2269-4c78-9e03-af129678d0fd admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:38.964874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a8440add-2269-4c78-9e03-af129678d0fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9d01d869a84e2486ef3918ff0dc1cd', 'request_id': 'req-a8440add-2269-4c78-9e03-af129678d0fd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:02:38.970881 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a8440add-2269-4c78-9e03-af129678d0fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9d01d869a84e2486ef3918ff0dc1cd', 'request_id': 'req-a8440add-2269-4c78-9e03-af129678d0fd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:02:38.974474 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:38.978576 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a8440add-2269-4c78-9e03-af129678d0fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9d01d869a84e2486ef3918ff0dc1cd', 'request_id': 'req-a8440add-2269-4c78-9e03-af129678d0fd'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:02:39.006912 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a8440add-2269-4c78-9e03-af129678d0fd admin admin] The token cache is being invalidate because project 9a9d01d869a84e2486ef3918ff0dc1cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 22:02:39.007392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a8440add-2269-4c78-9e03-af129678d0fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:02:39.008317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-a8440add-2269-4c78-9e03-af129678d0fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:02:39.010975 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4495/8942] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 22:02:38 2022] DELETE /identity/v3/projects/9a9d01d869a84e2486ef3918ff0dc1cd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:02:39.015171 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3201df-89a8-4a9d-83ef-6b75f868da34 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:39.016803 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-fb3201df-89a8-4a9d-83ef-6b75f868da34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:02:39.036408 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3201df-89a8-4a9d-83ef-6b75f868da34 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:39.093324 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee19551-6c68-4fa4-8ccc-60eb89bf706f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:39.094003 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee19551-6c68-4fa4-8ccc-60eb89bf706f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:39.094293 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee19551-6c68-4fa4-8ccc-60eb89bf706f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:39.094577 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee19551-6c68-4fa4-8ccc-60eb89bf706f admin admin] PATH_INFO: `/v3/users/efefc56c46724c3baa237aa5120f8741` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:39.095792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee19551-6c68-4fa4-8ccc-60eb89bf706f admin admin] RBAC: Authorizing `identity:delete_user(user_id=efefc56c46724c3baa237aa5120f8741)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:39.097725 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee19551-6c68-4fa4-8ccc-60eb89bf706f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:39.144117 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-eee19551-6c68-4fa4-8ccc-60eb89bf706f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efefc56c46724c3baa237aa5120f8741'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:02:39.144770 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-eee19551-6c68-4fa4-8ccc-60eb89bf706f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efefc56c46724c3baa237aa5120f8741'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:02:39.149961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:39.158928 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-eee19551-6c68-4fa4-8ccc-60eb89bf706f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efefc56c46724c3baa237aa5120f8741'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:02:39.159600 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-eee19551-6c68-4fa4-8ccc-60eb89bf706f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efefc56c46724c3baa237aa5120f8741'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:02:39.166864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-eee19551-6c68-4fa4-8ccc-60eb89bf706f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efefc56c46724c3baa237aa5120f8741'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:02:39.179697 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4448/8943] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 22:02:39 2022] DELETE /identity/v3/users/efefc56c46724c3baa237aa5120f8741 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:02:39.357062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8440add-2269-4c78-9e03-af129678d0fd admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:39.358644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a8440add-2269-4c78-9e03-af129678d0fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:02:39.372473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8440add-2269-4c78-9e03-af129678d0fd admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:39.432564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce54a5-8962-4519-b690-4b8ff448391d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:39.433220 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce54a5-8962-4519-b690-4b8ff448391d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:39.433509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce54a5-8962-4519-b690-4b8ff448391d admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:39.433796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce54a5-8962-4519-b690-4b8ff448391d admin admin] PATH_INFO: `/v3/projects/f839601740744201bd0d51d47622f421` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:39.434947 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce54a5-8962-4519-b690-4b8ff448391d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f839601740744201bd0d51d47622f421)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:39.436943 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce54a5-8962-4519-b690-4b8ff448391d admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:39.482291 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-19ce54a5-8962-4519-b690-4b8ff448391d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f839601740744201bd0d51d47622f421', 'request_id': 'req-19ce54a5-8962-4519-b690-4b8ff448391d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:02:39.488838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-19ce54a5-8962-4519-b690-4b8ff448391d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f839601740744201bd0d51d47622f421', 'request_id': 'req-19ce54a5-8962-4519-b690-4b8ff448391d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:02:39.496130 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-19ce54a5-8962-4519-b690-4b8ff448391d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f839601740744201bd0d51d47622f421', 'request_id': 'req-19ce54a5-8962-4519-b690-4b8ff448391d'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:02:39.506830 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-19ce54a5-8962-4519-b690-4b8ff448391d admin admin] The token cache is being invalidate because project f839601740744201bd0d51d47622f421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 22:02:39.507125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-19ce54a5-8962-4519-b690-4b8ff448391d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:02:39.507806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-19ce54a5-8962-4519-b690-4b8ff448391d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:02:39.509308 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4496/8944] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 22:02:39 2022] DELETE /identity/v3/projects/f839601740744201bd0d51d47622f421 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:02:39.514460 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363a41c-dbf1-4971-9992-768c78a0d2ae None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:39.514945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363a41c-dbf1-4971-9992-768c78a0d2ae None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:39.515070 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363a41c-dbf1-4971-9992-768c78a0d2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:39.563468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-9363a41c-dbf1-4971-9992-768c78a0d2ae None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:02:39.564699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9363a41c-dbf1-4971-9992-768c78a0d2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:02:39.624931 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4449/8945] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:02:39.632734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18f7c7-3262-4d9a-9495-2370bf3ed18d None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:39.633031 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18f7c7-3262-4d9a-9495-2370bf3ed18d None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:39.633311 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18f7c7-3262-4d9a-9495-2370bf3ed18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:39.653664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1e18f7c7-3262-4d9a-9495-2370bf3ed18d None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:02:39.654901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1e18f7c7-3262-4d9a-9495-2370bf3ed18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:02:39.663492 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4497/8946] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:02:39.667723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363a41c-dbf1-4971-9992-768c78a0d2ae None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:39.678551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363a41c-dbf1-4971-9992-768c78a0d2ae None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:39.683219 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceea1b9-c4b4-4a40-982b-394c08449304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:39.683863 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceea1b9-c4b4-4a40-982b-394c08449304 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:39.684151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceea1b9-c4b4-4a40-982b-394c08449304 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:39.684459 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceea1b9-c4b4-4a40-982b-394c08449304 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:39.685157 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceea1b9-c4b4-4a40-982b-394c08449304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 22:02:39.685466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceea1b9-c4b4-4a40-982b-394c08449304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:39.687060 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceea1b9-c4b4-4a40-982b-394c08449304 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:39.698551 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4450/8947] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 22:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 22:02:39.702791 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18f7c7-3262-4d9a-9495-2370bf3ed18d None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:39.712365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18f7c7-3262-4d9a-9495-2370bf3ed18d None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:39.717271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd36752-0d04-4a9d-a761-77389c4f2fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:39.717894 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd36752-0d04-4a9d-a761-77389c4f2fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:39.718181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd36752-0d04-4a9d-a761-77389c4f2fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:39.719076 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd36752-0d04-4a9d-a761-77389c4f2fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:39.720073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd36752-0d04-4a9d-a761-77389c4f2fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:39.721700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd36752-0d04-4a9d-a761-77389c4f2fd9 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:39.758704 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4498/8948] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 22:02:39 2022] POST /identity/v3/projects => generated 393 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 22:02:39.762862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceea1b9-c4b4-4a40-982b-394c08449304 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:39.774945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceea1b9-c4b4-4a40-982b-394c08449304 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:39.831248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb2596-5728-4688-bc51-fd6358090240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:39.831920 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb2596-5728-4688-bc51-fd6358090240 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:39.832191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb2596-5728-4688-bc51-fd6358090240 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:39.832465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb2596-5728-4688-bc51-fd6358090240 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:39.833124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb2596-5728-4688-bc51-fd6358090240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:39.835038 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb2596-5728-4688-bc51-fd6358090240 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:39.856112 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4451/8949] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 22:02:39 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 22:02:39.860310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd36752-0d04-4a9d-a761-77389c4f2fd9 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:39.870884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd36752-0d04-4a9d-a761-77389c4f2fd9 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:39.875644 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33d634-8393-4432-bcf5-162c186f15da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:39.876263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33d634-8393-4432-bcf5-162c186f15da admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:39.876556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33d634-8393-4432-bcf5-162c186f15da admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:39.876841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33d634-8393-4432-bcf5-162c186f15da admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:39.877538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33d634-8393-4432-bcf5-162c186f15da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:39.879147 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33d634-8393-4432-bcf5-162c186f15da admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:39.889062 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4499/8950] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 22:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 22:02:39.893889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb2596-5728-4688-bc51-fd6358090240 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:39.904312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb2596-5728-4688-bc51-fd6358090240 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:39.909663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a7b89-39a9-46f9-b6fc-c421719a0305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:39.910302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a7b89-39a9-46f9-b6fc-c421719a0305 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:39.910592 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a7b89-39a9-46f9-b6fc-c421719a0305 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:39.910875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a7b89-39a9-46f9-b6fc-c421719a0305 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:39.911602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a7b89-39a9-46f9-b6fc-c421719a0305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:39.913202 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a7b89-39a9-46f9-b6fc-c421719a0305 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:39.923848 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4452/8951] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 22:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 22:02:39.928420 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33d634-8393-4432-bcf5-162c186f15da admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:39.938678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33d634-8393-4432-bcf5-162c186f15da admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:39.943426 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0578c3-99a8-46f2-908e-8c0c562ede1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:39.944088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0578c3-99a8-46f2-908e-8c0c562ede1f admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:39.944379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0578c3-99a8-46f2-908e-8c0c562ede1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:39.944664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0578c3-99a8-46f2-908e-8c0c562ede1f admin admin] PATH_INFO: `/v3/projects/cd23983804f14a2c83c88db64491820c/users/ec9fa31beca14813baa00869e5e7952a/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:39.959792 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0578c3-99a8-46f2-908e-8c0c562ede1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd23983804f14a2c83c88db64491820c, user_id=ec9fa31beca14813baa00869e5e7952a, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:39.962439 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0578c3-99a8-46f2-908e-8c0c562ede1f admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:39.964705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:39.978549 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4500/8952] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 22:02:39 2022] PUT /identity/v3/projects/cd23983804f14a2c83c88db64491820c/users/ec9fa31beca14813baa00869e5e7952a/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 22:02:39.989641 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e4dad-b195-42b9-91cd-ea5ee794e360 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:39.989937 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e4dad-b195-42b9-91cd-ea5ee794e360 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:39.990250 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e4dad-b195-42b9-91cd-ea5ee794e360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:40.019639 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d00e4dad-b195-42b9-91cd-ea5ee794e360 None None] MFA Rules not processed for user `ec9fa31beca14813baa00869e5e7952a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:02:40.020794 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d00e4dad-b195-42b9-91cd-ea5ee794e360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:02:40.024985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:40.087812 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4453/8953] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:02:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:02:40.092298 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0578c3-99a8-46f2-908e-8c0c562ede1f admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:40.153798 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0578c3-99a8-46f2-908e-8c0c562ede1f admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:40.158452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e1876-d3b0-42d9-9d6e-8b444f7b31f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:40.159062 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e1876-d3b0-42d9-9d6e-8b444f7b31f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:40.159383 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e1876-d3b0-42d9-9d6e-8b444f7b31f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:40.159663 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e1876-d3b0-42d9-9d6e-8b444f7b31f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:40.160330 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e1876-d3b0-42d9-9d6e-8b444f7b31f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:40.162213 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e1876-d3b0-42d9-9d6e-8b444f7b31f2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:40.188307 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4501/8954] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 22:02:40 2022] POST /identity/v3/projects => generated 391 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 22:02:40.192437 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e4dad-b195-42b9-91cd-ea5ee794e360 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:40.203977 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e4dad-b195-42b9-91cd-ea5ee794e360 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:40.259390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df204154-2f57-488d-bbb6-b05f2d57c114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:40.260032 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df204154-2f57-488d-bbb6-b05f2d57c114 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:40.260318 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df204154-2f57-488d-bbb6-b05f2d57c114 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:40.260595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df204154-2f57-488d-bbb6-b05f2d57c114 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:40.261263 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df204154-2f57-488d-bbb6-b05f2d57c114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:40.263207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df204154-2f57-488d-bbb6-b05f2d57c114 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:40.284816 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4454/8955] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 22:02:40 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 22:02:40.288797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e1876-d3b0-42d9-9d6e-8b444f7b31f2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:40.299234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e1876-d3b0-42d9-9d6e-8b444f7b31f2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:40.304594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b2384-f331-4a3a-bff6-cba586de7cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:40.305206 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b2384-f331-4a3a-bff6-cba586de7cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:40.305494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b2384-f331-4a3a-bff6-cba586de7cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:40.305806 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b2384-f331-4a3a-bff6-cba586de7cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:40.306496 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b2384-f331-4a3a-bff6-cba586de7cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:40.308141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b2384-f331-4a3a-bff6-cba586de7cd5 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:40.319204 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4502/8956] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 22:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 22:02:40.323889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df204154-2f57-488d-bbb6-b05f2d57c114 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:40.334860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df204154-2f57-488d-bbb6-b05f2d57c114 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:40.339693 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769222c1-e7b8-4198-a668-51748ac7ea9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:40.340363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769222c1-e7b8-4198-a668-51748ac7ea9c admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:40.340655 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769222c1-e7b8-4198-a668-51748ac7ea9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:40.340938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769222c1-e7b8-4198-a668-51748ac7ea9c admin admin] PATH_INFO: `/v3/projects/4ba3291ae539455f93ec69c9b2143a03/users/13b46db77f7148eda25d2c80d611c4bd/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:40.355965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769222c1-e7b8-4198-a668-51748ac7ea9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba3291ae539455f93ec69c9b2143a03, user_id=13b46db77f7148eda25d2c80d611c4bd, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:40.358644 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769222c1-e7b8-4198-a668-51748ac7ea9c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:40.372091 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4455/8957] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 22:02:40 2022] PUT /identity/v3/projects/4ba3291ae539455f93ec69c9b2143a03/users/13b46db77f7148eda25d2c80d611c4bd/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:02:40.376612 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b2384-f331-4a3a-bff6-cba586de7cd5 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:40.386877 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b2384-f331-4a3a-bff6-cba586de7cd5 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:40.446038 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150f22a-942a-4660-826e-248ea4e7b537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:40.446662 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150f22a-942a-4660-826e-248ea4e7b537 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:40.446954 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150f22a-942a-4660-826e-248ea4e7b537 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:40.447226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150f22a-942a-4660-826e-248ea4e7b537 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:40.447945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150f22a-942a-4660-826e-248ea4e7b537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:40.449548 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150f22a-942a-4660-826e-248ea4e7b537 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:40.459743 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4503/8958] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 22:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 22:02:40.464025 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769222c1-e7b8-4198-a668-51748ac7ea9c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:40.474558 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769222c1-e7b8-4198-a668-51748ac7ea9c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:40.479228 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9aea9-1748-4443-83ff-00e59752fff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:40.479924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9aea9-1748-4443-83ff-00e59752fff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:40.480209 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9aea9-1748-4443-83ff-00e59752fff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:40.480487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9aea9-1748-4443-83ff-00e59752fff1 admin admin] PATH_INFO: `/v3/projects/4ba3291ae539455f93ec69c9b2143a03/users/13b46db77f7148eda25d2c80d611c4bd/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:40.482447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9aea9-1748-4443-83ff-00e59752fff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba3291ae539455f93ec69c9b2143a03, user_id=13b46db77f7148eda25d2c80d611c4bd, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:40.485628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9aea9-1748-4443-83ff-00e59752fff1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:40.495717 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4456/8959] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 22:02:40 2022] PUT /identity/v3/projects/4ba3291ae539455f93ec69c9b2143a03/users/13b46db77f7148eda25d2c80d611c4bd/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:02:40.505876 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e389e-b3a5-4f9f-8c9d-3c5a7ee0761f None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:40.506171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e389e-b3a5-4f9f-8c9d-3c5a7ee0761f None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:40.506452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e389e-b3a5-4f9f-8c9d-3c5a7ee0761f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:40.533803 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-094e389e-b3a5-4f9f-8c9d-3c5a7ee0761f None None] MFA Rules not processed for user `13b46db77f7148eda25d2c80d611c4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:02:40.535079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-094e389e-b3a5-4f9f-8c9d-3c5a7ee0761f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:02:40.586363 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:40.607242 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4504/8960] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:02:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:02:40.621682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9aea9-1748-4443-83ff-00e59752fff1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:40.623492 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-99b9aea9-1748-4443-83ff-00e59752fff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:02:40.689677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:40.715575 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9aea9-1748-4443-83ff-00e59752fff1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:40.721254 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6028b3-2e38-458c-b441-6d1d3e009efc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:40.721879 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6028b3-2e38-458c-b441-6d1d3e009efc service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:40.722170 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6028b3-2e38-458c-b441-6d1d3e009efc service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:40.722453 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6028b3-2e38-458c-b441-6d1d3e009efc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:40.778601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6028b3-2e38-458c-b441-6d1d3e009efc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:40.780236 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6028b3-2e38-458c-b441-6d1d3e009efc service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:40.789306 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4457/8961] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:02:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:02:43.799095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e389e-b3a5-4f9f-8c9d-3c5a7ee0761f None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:43.800817 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-094e389e-b3a5-4f9f-8c9d-3c5a7ee0761f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:02:43.865150 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e389e-b3a5-4f9f-8c9d-3c5a7ee0761f None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:43.868952 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306bcfa-042d-445d-9624-ce6fdea98e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:43.869634 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306bcfa-042d-445d-9624-ce6fdea98e6d service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:43.869862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306bcfa-042d-445d-9624-ce6fdea98e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:43.870136 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306bcfa-042d-445d-9624-ce6fdea98e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:43.880556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306bcfa-042d-445d-9624-ce6fdea98e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:43.881988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306bcfa-042d-445d-9624-ce6fdea98e6d service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:43.892106 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4505/8962] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:02:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:02:46.652308 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17f9af-0b88-4dcd-a86e-b6b8d3471462 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:46.652844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17f9af-0b88-4dcd-a86e-b6b8d3471462 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:46.652844 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17f9af-0b88-4dcd-a86e-b6b8d3471462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:46.672604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-7b17f9af-0b88-4dcd-a86e-b6b8d3471462 None None] MFA Rules not processed for user `ec9fa31beca14813baa00869e5e7952a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:02:46.674043 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7b17f9af-0b88-4dcd-a86e-b6b8d3471462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:02:46.683601 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4458/8963] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:02:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:02:47.571655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306bcfa-042d-445d-9624-ce6fdea98e6d service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:47.574461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0306bcfa-042d-445d-9624-ce6fdea98e6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:02:47.684092 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306bcfa-042d-445d-9624-ce6fdea98e6d service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:47.689645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05369cc-0f10-42fd-8691-eafb0325f8bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:47.690301 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05369cc-0f10-42fd-8691-eafb0325f8bd service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:47.690745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05369cc-0f10-42fd-8691-eafb0325f8bd service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:47.691036 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05369cc-0f10-42fd-8691-eafb0325f8bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:47.693088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c05369cc-0f10-42fd-8691-eafb0325f8bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:02:47.710468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05369cc-0f10-42fd-8691-eafb0325f8bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:47.712563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05369cc-0f10-42fd-8691-eafb0325f8bd service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:47.729478 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4506/8964] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:02:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:02:49.750151 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850cdcc-017e-43ac-91a9-a424d0bade10 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:49.750669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850cdcc-017e-43ac-91a9-a424d0bade10 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:49.750891 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850cdcc-017e-43ac-91a9-a424d0bade10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:49.775200 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-2850cdcc-017e-43ac-91a9-a424d0bade10 None None] MFA Rules not processed for user `4a886ccf9590432caf209526410a7b53`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:02:49.776520 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2850cdcc-017e-43ac-91a9-a424d0bade10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:02:49.789522 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4459/8965] 10.222.0.47 () {58 vars in 1015 bytes} [Sat Jul 30 22:02:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:02:49.801598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05369cc-0f10-42fd-8691-eafb0325f8bd service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:02:49.812608 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05369cc-0f10-42fd-8691-eafb0325f8bd service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:02:49.821957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e400986-8ee0-4ff7-a546-5b07ded5830a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:02:49.822754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e400986-8ee0-4ff7-a546-5b07ded5830a service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:02:49.823145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e400986-8ee0-4ff7-a546-5b07ded5830a service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:02:49.823628 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e400986-8ee0-4ff7-a546-5b07ded5830a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:02:49.832747 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e400986-8ee0-4ff7-a546-5b07ded5830a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:02:49.834701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e400986-8ee0-4ff7-a546-5b07ded5830a service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:02:49.845500 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4507/8966] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:02:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:02:59.769417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=41 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:59.840367 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=69 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:03:42.389640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01ca1a-9155-4369-a21b-3f206d812011 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:03:42.390237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01ca1a-9155-4369-a21b-3f206d812011 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:03:42.390237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01ca1a-9155-4369-a21b-3f206d812011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:03:42.414178 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-4d01ca1a-9155-4369-a21b-3f206d812011 None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:03:42.415552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4d01ca1a-9155-4369-a21b-3f206d812011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:03:42.426880 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4460/8967] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 22:03:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:03:42.441700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e400986-8ee0-4ff7-a546-5b07ded5830a service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:03:42.443948 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1e400986-8ee0-4ff7-a546-5b07ded5830a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:03:42.464505 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e400986-8ee0-4ff7-a546-5b07ded5830a service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:03:42.470250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2333f-7de1-4586-b8ac-943ba6992f36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:03:42.471378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2333f-7de1-4586-b8ac-943ba6992f36 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:03:42.471378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2333f-7de1-4586-b8ac-943ba6992f36 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:03:42.471655 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2333f-7de1-4586-b8ac-943ba6992f36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:03:42.480685 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2333f-7de1-4586-b8ac-943ba6992f36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:03:42.483115 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2333f-7de1-4586-b8ac-943ba6992f36 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:03:42.494464 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4508/8968] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:03:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:03:48.216608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5c91b-2358-4529-bece-fab7b76eba9f None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:03:48.217101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5c91b-2358-4529-bece-fab7b76eba9f None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:03:48.217189 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5c91b-2358-4529-bece-fab7b76eba9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:03:48.238981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-adb5c91b-2358-4529-bece-fab7b76eba9f None None] MFA Rules not processed for user `ec9fa31beca14813baa00869e5e7952a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:03:48.240246 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-adb5c91b-2358-4529-bece-fab7b76eba9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:03:48.252893 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4461/8969] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:03:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:03:52.163409 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2333f-7de1-4586-b8ac-943ba6992f36 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:03:52.164884 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1bd2333f-7de1-4586-b8ac-943ba6992f36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:03:52.176826 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2333f-7de1-4586-b8ac-943ba6992f36 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:03:52.180488 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cfcf4-5f6d-4165-941c-1bfd43be36fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:03:52.181100 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cfcf4-5f6d-4165-941c-1bfd43be36fd service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:03:52.181388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cfcf4-5f6d-4165-941c-1bfd43be36fd service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:03:52.181670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cfcf4-5f6d-4165-941c-1bfd43be36fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:03:52.183444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-cf1cfcf4-5f6d-4165-941c-1bfd43be36fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:03:52.193319 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1cfcf4-5f6d-4165-941c-1bfd43be36fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:03:52.194741 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1cfcf4-5f6d-4165-941c-1bfd43be36fd service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:03:52.203306 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4509/8970] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:03:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:03:58.233247 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:04:02.199161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=12 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:04:34.146843 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5c91b-2358-4529-bece-fab7b76eba9f None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:04:34.156811 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5c91b-2358-4529-bece-fab7b76eba9f None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:04:34.160635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacde7a-0b71-401c-a87d-8677524a5dc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:04:34.161256 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacde7a-0b71-401c-a87d-8677524a5dc2 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:04:34.161546 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacde7a-0b71-401c-a87d-8677524a5dc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:04:34.161826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacde7a-0b71-401c-a87d-8677524a5dc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:04:34.163654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bfacde7a-0b71-401c-a87d-8677524a5dc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:04:34.178006 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacde7a-0b71-401c-a87d-8677524a5dc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:04:34.179482 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacde7a-0b71-401c-a87d-8677524a5dc2 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:04:34.191216 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4462/8971] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:04:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:04:35.467957 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cfcf4-5f6d-4165-941c-1bfd43be36fd service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:04:35.477253 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cfcf4-5f6d-4165-941c-1bfd43be36fd service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:04:35.480911 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5f5b6-e872-4ae0-bd3d-efbfc1805157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:04:35.481514 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5f5b6-e872-4ae0-bd3d-efbfc1805157 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:04:35.481797 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5f5b6-e872-4ae0-bd3d-efbfc1805157 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:04:35.482071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5f5b6-e872-4ae0-bd3d-efbfc1805157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:04:35.483818 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e8a5f5b6-e872-4ae0-bd3d-efbfc1805157 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:04:35.497500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5f5b6-e872-4ae0-bd3d-efbfc1805157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:04:35.498923 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5f5b6-e872-4ae0-bd3d-efbfc1805157 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:04:35.510355 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4510/8972] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:04:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:04:44.185815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:04:45.505566 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:05:24.714428 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacde7a-0b71-401c-a87d-8677524a5dc2 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:05:24.716483 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-bfacde7a-0b71-401c-a87d-8677524a5dc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:05:24.733544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacde7a-0b71-401c-a87d-8677524a5dc2 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:05:24.740448 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d5dac-3c62-4cfc-8432-23dcbfbf791e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:05:24.741186 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d5dac-3c62-4cfc-8432-23dcbfbf791e service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:05:24.741550 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d5dac-3c62-4cfc-8432-23dcbfbf791e service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:05:24.741906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d5dac-3c62-4cfc-8432-23dcbfbf791e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:05:24.744095 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5e1d5dac-3c62-4cfc-8432-23dcbfbf791e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:05:24.758224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d5dac-3c62-4cfc-8432-23dcbfbf791e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:05:24.760664 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d5dac-3c62-4cfc-8432-23dcbfbf791e service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:05:24.774160 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4463/8973] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:05:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:05:26.865882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5f5b6-e872-4ae0-bd3d-efbfc1805157 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:05:26.878504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5f5b6-e872-4ae0-bd3d-efbfc1805157 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:05:26.886271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83825061-504b-4ed3-ac83-fa764a2b4edc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:05:26.887061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83825061-504b-4ed3-ac83-fa764a2b4edc service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:05:26.887392 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83825061-504b-4ed3-ac83-fa764a2b4edc service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:05:26.887678 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83825061-504b-4ed3-ac83-fa764a2b4edc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:05:26.889665 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-83825061-504b-4ed3-ac83-fa764a2b4edc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:05:26.903707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83825061-504b-4ed3-ac83-fa764a2b4edc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:05:26.905328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83825061-504b-4ed3-ac83-fa764a2b4edc service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:05:26.916975 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4511/8974] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:05:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:05:34.767311 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:05:36.912016 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:05:37.412240 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17149209-ef17-47ee-91ff-bcc2d7d487cd None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:05:37.412798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17149209-ef17-47ee-91ff-bcc2d7d487cd None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:05:37.412798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17149209-ef17-47ee-91ff-bcc2d7d487cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:05:37.433184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-17149209-ef17-47ee-91ff-bcc2d7d487cd None None] MFA Rules not processed for user `ec9fa31beca14813baa00869e5e7952a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:05:37.434442 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-17149209-ef17-47ee-91ff-bcc2d7d487cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:05:37.441786 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4464/8975] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:05:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:05:37.788645 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0190902-be27-4a2c-a39f-dd1bef890faf None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:05:37.788938 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0190902-be27-4a2c-a39f-dd1bef890faf None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:05:37.789221 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0190902-be27-4a2c-a39f-dd1bef890faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:05:37.810250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-c0190902-be27-4a2c-a39f-dd1bef890faf None None] MFA Rules not processed for user `4a886ccf9590432caf209526410a7b53`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:05:37.811584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c0190902-be27-4a2c-a39f-dd1bef890faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:05:37.818316 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4512/8976] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 22:05:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:05:37.830154 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17149209-ef17-47ee-91ff-bcc2d7d487cd None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:05:37.841576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17149209-ef17-47ee-91ff-bcc2d7d487cd None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:05:37.845766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25feab8a-ad83-45e3-8ea7-bf5b0ff5027f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:05:37.846410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25feab8a-ad83-45e3-8ea7-bf5b0ff5027f service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:05:37.846697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25feab8a-ad83-45e3-8ea7-bf5b0ff5027f service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:05:37.846974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25feab8a-ad83-45e3-8ea7-bf5b0ff5027f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:05:37.856062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25feab8a-ad83-45e3-8ea7-bf5b0ff5027f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:05:37.858026 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25feab8a-ad83-45e3-8ea7-bf5b0ff5027f service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:05:37.871711 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4465/8977] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:05:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:05:47.804962 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:05:47.864479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=9 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:06:22.214160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0190902-be27-4a2c-a39f-dd1bef890faf None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:06:22.232627 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0190902-be27-4a2c-a39f-dd1bef890faf None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:06:22.236281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e4bc1-78e3-4beb-9985-b70819f57f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:06:22.236869 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e4bc1-78e3-4beb-9985-b70819f57f8d service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:06:22.237154 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e4bc1-78e3-4beb-9985-b70819f57f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:06:22.237430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e4bc1-78e3-4beb-9985-b70819f57f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:06:22.239181 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-718e4bc1-78e3-4beb-9985-b70819f57f8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:06:22.267441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e4bc1-78e3-4beb-9985-b70819f57f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:06:22.269174 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e4bc1-78e3-4beb-9985-b70819f57f8d service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:06:22.279842 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4513/8978] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:06:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:06:23.421352 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa393f-913b-4d87-9473-c8985b7869da None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:06:23.421940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa393f-913b-4d87-9473-c8985b7869da None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:06:23.421940 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa393f-913b-4d87-9473-c8985b7869da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:06:23.441651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c8fa393f-913b-4d87-9473-c8985b7869da None None] MFA Rules not processed for user `4a886ccf9590432caf209526410a7b53`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:06:23.442886 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c8fa393f-913b-4d87-9473-c8985b7869da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:06:23.449830 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4466/8979] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 22:06:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:06:23.470455 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e4bc1-78e3-4beb-9985-b70819f57f8d service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:06:23.479902 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e4bc1-78e3-4beb-9985-b70819f57f8d service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:06:23.483602 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5445a5b-7557-44bd-ab86-2b52af505e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:06:23.484264 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5445a5b-7557-44bd-ab86-2b52af505e6d service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:06:23.484555 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5445a5b-7557-44bd-ab86-2b52af505e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:06:23.484829 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5445a5b-7557-44bd-ab86-2b52af505e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:06:23.492259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5445a5b-7557-44bd-ab86-2b52af505e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:06:23.493696 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5445a5b-7557-44bd-ab86-2b52af505e6d service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:06:23.501982 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4514/8980] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:06:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:06:23.621347 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4c313-4c86-44e7-97a6-29c32fba5458 None None] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:06:23.621635 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4c313-4c86-44e7-97a6-29c32fba5458 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:06:23.621915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4c313-4c86-44e7-97a6-29c32fba5458 None None] PATH_INFO: `/` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:06:23.623276 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4467/8981] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 30 22:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 30 22:06:23.628140 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b473f-6553-4ab3-931c-fb997270d32c None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:06:23.628376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b473f-6553-4ab3-931c-fb997270d32c None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:06:23.628653 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b473f-6553-4ab3-931c-fb997270d32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:06:23.649280 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-be7b473f-6553-4ab3-931c-fb997270d32c None None] MFA Rules not processed for user `2d1bd6b5950c4f9890a133dfd5bea4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:06:23.651180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-be7b473f-6553-4ab3-931c-fb997270d32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:06:23.679901 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4515/8982] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 22:06:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:06:23.709887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4c313-4c86-44e7-97a6-29c32fba5458 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:06:23.723943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4c313-4c86-44e7-97a6-29c32fba5458 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:06:23.728818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526a553-5903-49c8-91b8-62ec6f66f7f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:06:23.729417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526a553-5903-49c8-91b8-62ec6f66f7f4 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:06:23.729698 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526a553-5903-49c8-91b8-62ec6f66f7f4 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:06:23.729979 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526a553-5903-49c8-91b8-62ec6f66f7f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:06:23.738077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526a553-5903-49c8-91b8-62ec6f66f7f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:06:23.739682 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526a553-5903-49c8-91b8-62ec6f66f7f4 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:06:23.749417 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4468/8983] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:06:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:06:23.921020 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b473f-6553-4ab3-931c-fb997270d32c None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:06:23.930324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b473f-6553-4ab3-931c-fb997270d32c None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:06:23.933960 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f9611-bc28-4bab-9d2f-5080c5a8d556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:06:23.934559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f9611-bc28-4bab-9d2f-5080c5a8d556 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:06:23.934845 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f9611-bc28-4bab-9d2f-5080c5a8d556 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:06:23.935121 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f9611-bc28-4bab-9d2f-5080c5a8d556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:06:23.936921 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7e6f9611-bc28-4bab-9d2f-5080c5a8d556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:06:23.953381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f9611-bc28-4bab-9d2f-5080c5a8d556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:06:23.954800 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f9611-bc28-4bab-9d2f-5080c5a8d556 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:06:23.968985 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4516/8984] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:06:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:06:24.030867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526a553-5903-49c8-91b8-62ec6f66f7f4 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:06:24.041709 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526a553-5903-49c8-91b8-62ec6f66f7f4 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:06:24.046777 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8869c-8086-423d-b7f4-f71a99665d1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:06:24.047432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8869c-8086-423d-b7f4-f71a99665d1f service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:06:24.047723 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8869c-8086-423d-b7f4-f71a99665d1f service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:06:24.048001 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8869c-8086-423d-b7f4-f71a99665d1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:06:24.049792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-67e8869c-8086-423d-b7f4-f71a99665d1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:06:24.061649 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8869c-8086-423d-b7f4-f71a99665d1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:06:24.063215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8869c-8086-423d-b7f4-f71a99665d1f service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:06:24.073563 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4469/8985] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:06:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 22:06:33.960983 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=43 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:06:34.068878 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=15 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:06:44.609199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f9611-bc28-4bab-9d2f-5080c5a8d556 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:06:44.632564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f9611-bc28-4bab-9d2f-5080c5a8d556 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:06:44.638925 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e589b3-f939-4816-aa06-6eaece326c71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:06:44.639591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e589b3-f939-4816-aa06-6eaece326c71 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:06:44.639873 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e589b3-f939-4816-aa06-6eaece326c71 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:06:44.640144 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e589b3-f939-4816-aa06-6eaece326c71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:06:44.641922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-15e589b3-f939-4816-aa06-6eaece326c71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:06:44.655378 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e589b3-f939-4816-aa06-6eaece326c71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:06:44.656950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e589b3-f939-4816-aa06-6eaece326c71 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:06:44.667567 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4517/8986] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:06:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:06:52.016919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8869c-8086-423d-b7f4-f71a99665d1f service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:06:52.037457 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8869c-8086-423d-b7f4-f71a99665d1f service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:06:52.043549 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bedc4a-d1e2-4363-afa6-66738ec19ddc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:06:52.044195 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bedc4a-d1e2-4363-afa6-66738ec19ddc service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:06:52.044488 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bedc4a-d1e2-4363-afa6-66738ec19ddc service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:06:52.044768 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bedc4a-d1e2-4363-afa6-66738ec19ddc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:06:52.046572 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-43bedc4a-d1e2-4363-afa6-66738ec19ddc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:06:52.058208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bedc4a-d1e2-4363-afa6-66738ec19ddc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:06:52.059897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bedc4a-d1e2-4363-afa6-66738ec19ddc service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:06:52.069835 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4470/8987] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:06:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:06:52.125159 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e589b3-f939-4816-aa06-6eaece326c71 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:06:52.136994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e589b3-f939-4816-aa06-6eaece326c71 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:06:52.142258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f9dd7-05a5-4a3f-8c14-91e2694dc42e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:06:52.142874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f9dd7-05a5-4a3f-8c14-91e2694dc42e service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:06:52.143160 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f9dd7-05a5-4a3f-8c14-91e2694dc42e service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:06:52.143471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f9dd7-05a5-4a3f-8c14-91e2694dc42e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:06:52.145516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3e8f9dd7-05a5-4a3f-8c14-91e2694dc42e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:06:52.157559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f9dd7-05a5-4a3f-8c14-91e2694dc42e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:06:52.159173 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f9dd7-05a5-4a3f-8c14-91e2694dc42e service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:06:52.169082 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4518/8988] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:06:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:07:02.065633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=10 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:07:02.164904 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=16 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:07:24.042304 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df4c19-6420-4773-8b6f-819fd266d9d1 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:07:24.042755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df4c19-6420-4773-8b6f-819fd266d9d1 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:07:24.042755 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df4c19-6420-4773-8b6f-819fd266d9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:07:24.063916 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-38df4c19-6420-4773-8b6f-819fd266d9d1 None None] MFA Rules not processed for user `ec9fa31beca14813baa00869e5e7952a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:07:24.065173 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-38df4c19-6420-4773-8b6f-819fd266d9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:07:24.073566 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4471/8989] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:07:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:07:34.058935 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:07:59.982201 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f9dd7-05a5-4a3f-8c14-91e2694dc42e service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:07:59.995054 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f9dd7-05a5-4a3f-8c14-91e2694dc42e service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:08:00.000887 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a85796-ac8f-48d5-954d-4928dd5680c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:08:00.001545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a85796-ac8f-48d5-954d-4928dd5680c7 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:08:00.001841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a85796-ac8f-48d5-954d-4928dd5680c7 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:08:00.002137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a85796-ac8f-48d5-954d-4928dd5680c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:08:00.010471 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a85796-ac8f-48d5-954d-4928dd5680c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:08:00.012095 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a85796-ac8f-48d5-954d-4928dd5680c7 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:08:00.021305 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4519/8990] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:07:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:08:10.016961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:09:00.875825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df4c19-6420-4773-8b6f-819fd266d9d1 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:09:00.895537 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df4c19-6420-4773-8b6f-819fd266d9d1 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:09:00.899111 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b019af3-ac02-4189-8ac5-d818b62e46e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:09:00.899795 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b019af3-ac02-4189-8ac5-d818b62e46e6 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:09:00.900082 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b019af3-ac02-4189-8ac5-d818b62e46e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:09:00.900363 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b019af3-ac02-4189-8ac5-d818b62e46e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:09:00.907516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b019af3-ac02-4189-8ac5-d818b62e46e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:09:00.908948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b019af3-ac02-4189-8ac5-d818b62e46e6 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:09:00.917291 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4472/8991] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:09:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:09:10.662468 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a85796-ac8f-48d5-954d-4928dd5680c7 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:09:10.674226 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a85796-ac8f-48d5-954d-4928dd5680c7 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:09:10.679327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a062c2-c2ba-478c-8fb6-cc0df1128e97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:09:10.679934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a062c2-c2ba-478c-8fb6-cc0df1128e97 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:09:10.680215 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a062c2-c2ba-478c-8fb6-cc0df1128e97 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:09:10.680489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a062c2-c2ba-478c-8fb6-cc0df1128e97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:09:10.682862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-28a062c2-c2ba-478c-8fb6-cc0df1128e97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:09:10.694222 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a062c2-c2ba-478c-8fb6-cc0df1128e97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:09:10.695825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a062c2-c2ba-478c-8fb6-cc0df1128e97 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:09:10.706603 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4520/8992] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:09:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:09:10.913378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=10 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:09:13.516711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b019af3-ac02-4189-8ac5-d818b62e46e6 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:09:13.526668 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b019af3-ac02-4189-8ac5-d818b62e46e6 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:09:13.530602 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c0408-2b58-40cc-98fc-023c084edf7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:09:13.531237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c0408-2b58-40cc-98fc-023c084edf7c service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:09:13.531559 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c0408-2b58-40cc-98fc-023c084edf7c service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:09:13.531853 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c0408-2b58-40cc-98fc-023c084edf7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:09:13.541699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c0408-2b58-40cc-98fc-023c084edf7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:09:13.543133 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c0408-2b58-40cc-98fc-023c084edf7c service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:09:13.552775 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4473/8993] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:09:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:09:16.477603 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c284a23-8ba2-4d10-8e82-378de657d7e8 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:09:16.478103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c284a23-8ba2-4d10-8e82-378de657d7e8 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:09:16.478103 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c284a23-8ba2-4d10-8e82-378de657d7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:09:16.498357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-1c284a23-8ba2-4d10-8e82-378de657d7e8 None None] MFA Rules not processed for user `ec9fa31beca14813baa00869e5e7952a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:09:16.499633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-1c284a23-8ba2-4d10-8e82-378de657d7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:09:16.507493 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4521/8994] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:09:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:09:19.198466 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c0408-2b58-40cc-98fc-023c084edf7c service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:09:19.210628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c0408-2b58-40cc-98fc-023c084edf7c service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:09:19.216215 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d60911-d58c-44f0-baa7-725b468939a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:09:19.217436 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d60911-d58c-44f0-baa7-725b468939a8 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:09:19.217825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d60911-d58c-44f0-baa7-725b468939a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:09:19.218204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d60911-d58c-44f0-baa7-725b468939a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:09:19.236245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d60911-d58c-44f0-baa7-725b468939a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:09:19.238148 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d60911-d58c-44f0-baa7-725b468939a8 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:09:19.263310 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4474/8995] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:09:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:09:26.492705 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=9 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:09:29.246771 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=12 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:01.628690 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c284a23-8ba2-4d10-8e82-378de657d7e8 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:01.638519 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c284a23-8ba2-4d10-8e82-378de657d7e8 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:01.642285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf8dc0-22ae-4cdb-b86f-99b70f7c322c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:01.642901 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf8dc0-22ae-4cdb-b86f-99b70f7c322c service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:01.643189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf8dc0-22ae-4cdb-b86f-99b70f7c322c service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:01.643500 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf8dc0-22ae-4cdb-b86f-99b70f7c322c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:01.654951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf8dc0-22ae-4cdb-b86f-99b70f7c322c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:01.656463 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf8dc0-22ae-4cdb-b86f-99b70f7c322c service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:01.668306 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4522/8996] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:10:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:10:02.855742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d60911-d58c-44f0-baa7-725b468939a8 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:02.864479 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d60911-d58c-44f0-baa7-725b468939a8 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:02.868753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b73f2-e646-4dc5-aaae-ddaf8562ffa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:02.869360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b73f2-e646-4dc5-aaae-ddaf8562ffa9 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:02.869653 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b73f2-e646-4dc5-aaae-ddaf8562ffa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:02.869932 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b73f2-e646-4dc5-aaae-ddaf8562ffa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:02.879945 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b73f2-e646-4dc5-aaae-ddaf8562ffa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:02.881416 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b73f2-e646-4dc5-aaae-ddaf8562ffa9 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:02.892111 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4475/8997] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:10:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:10:11.662768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:12.887519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:13.656155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf8dc0-22ae-4cdb-b86f-99b70f7c322c service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:13.668315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf8dc0-22ae-4cdb-b86f-99b70f7c322c service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:13.673422 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833380e5-7313-4113-8321-6febd140dde9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:13.674034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833380e5-7313-4113-8321-6febd140dde9 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:13.674669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833380e5-7313-4113-8321-6febd140dde9 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:13.674951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833380e5-7313-4113-8321-6febd140dde9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:13.684573 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833380e5-7313-4113-8321-6febd140dde9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:13.686156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833380e5-7313-4113-8321-6febd140dde9 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:13.696407 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4523/8998] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:10:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:10:13.960406 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b73f2-e646-4dc5-aaae-ddaf8562ffa9 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:14.024807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b73f2-e646-4dc5-aaae-ddaf8562ffa9 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:14.029497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2271025-4d44-4d5b-bbdd-076ee1e63ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:14.030142 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2271025-4d44-4d5b-bbdd-076ee1e63ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:14.030465 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2271025-4d44-4d5b-bbdd-076ee1e63ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:14.030745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2271025-4d44-4d5b-bbdd-076ee1e63ac2 admin admin] PATH_INFO: `/v3/users/ec9fa31beca14813baa00869e5e7952a` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:14.031961 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2271025-4d44-4d5b-bbdd-076ee1e63ac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec9fa31beca14813baa00869e5e7952a)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:14.033884 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2271025-4d44-4d5b-bbdd-076ee1e63ac2 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:14.081507 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b2271025-4d44-4d5b-bbdd-076ee1e63ac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec9fa31beca14813baa00869e5e7952a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:10:14.082211 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b2271025-4d44-4d5b-bbdd-076ee1e63ac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec9fa31beca14813baa00869e5e7952a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:10:14.094544 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b2271025-4d44-4d5b-bbdd-076ee1e63ac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec9fa31beca14813baa00869e5e7952a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:10:14.095204 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b2271025-4d44-4d5b-bbdd-076ee1e63ac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec9fa31beca14813baa00869e5e7952a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:10:14.102604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-b2271025-4d44-4d5b-bbdd-076ee1e63ac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec9fa31beca14813baa00869e5e7952a'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:10:14.115431 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4476/8999] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 22:10:13 2022] DELETE /identity/v3/users/ec9fa31beca14813baa00869e5e7952a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:10:14.120734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f17b8-0ac4-4993-8a9c-b382644cbbee None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:14.121030 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f17b8-0ac4-4993-8a9c-b382644cbbee None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:14.121315 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f17b8-0ac4-4993-8a9c-b382644cbbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:14.140137 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-dd3f17b8-0ac4-4993-8a9c-b382644cbbee None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:10:14.141306 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-dd3f17b8-0ac4-4993-8a9c-b382644cbbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:10:14.200457 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4524/9000] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:10:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:10:14.210495 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2271025-4d44-4d5b-bbdd-076ee1e63ac2 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:14.212140 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b2271025-4d44-4d5b-bbdd-076ee1e63ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:10:14.282625 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2271025-4d44-4d5b-bbdd-076ee1e63ac2 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:14.286225 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8cbfc-8ce3-404e-8eb2-b83971403946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:14.286847 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8cbfc-8ce3-404e-8eb2-b83971403946 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:14.287129 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8cbfc-8ce3-404e-8eb2-b83971403946 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:14.287441 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8cbfc-8ce3-404e-8eb2-b83971403946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:14.296934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8cbfc-8ce3-404e-8eb2-b83971403946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:14.298360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8cbfc-8ce3-404e-8eb2-b83971403946 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:14.308434 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4477/9001] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:10:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:10:14.485113 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f17b8-0ac4-4993-8a9c-b382644cbbee None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:14.486745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-dd3f17b8-0ac4-4993-8a9c-b382644cbbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:10:14.501377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f17b8-0ac4-4993-8a9c-b382644cbbee None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:14.507146 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf05a7-ddc2-46e6-a4ba-85aa374bb58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:14.507849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf05a7-ddc2-46e6-a4ba-85aa374bb58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:14.508135 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf05a7-ddc2-46e6-a4ba-85aa374bb58b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:14.508412 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf05a7-ddc2-46e6-a4ba-85aa374bb58b admin admin] PATH_INFO: `/v3/projects/cd23983804f14a2c83c88db64491820c` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:14.509786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf05a7-ddc2-46e6-a4ba-85aa374bb58b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd23983804f14a2c83c88db64491820c)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:14.512359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf05a7-ddc2-46e6-a4ba-85aa374bb58b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:14.572106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bcbf05a7-ddc2-46e6-a4ba-85aa374bb58b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd23983804f14a2c83c88db64491820c', 'request_id': 'req-bcbf05a7-ddc2-46e6-a4ba-85aa374bb58b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:10:14.582796 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bcbf05a7-ddc2-46e6-a4ba-85aa374bb58b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd23983804f14a2c83c88db64491820c', 'request_id': 'req-bcbf05a7-ddc2-46e6-a4ba-85aa374bb58b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:10:14.591362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bcbf05a7-ddc2-46e6-a4ba-85aa374bb58b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd23983804f14a2c83c88db64491820c', 'request_id': 'req-bcbf05a7-ddc2-46e6-a4ba-85aa374bb58b'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:10:14.601629 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bcbf05a7-ddc2-46e6-a4ba-85aa374bb58b admin admin] The token cache is being invalidate because project cd23983804f14a2c83c88db64491820c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 22:10:14.601919 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bcbf05a7-ddc2-46e6-a4ba-85aa374bb58b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:10:14.602563 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-bcbf05a7-ddc2-46e6-a4ba-85aa374bb58b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:10:14.604721 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4525/9002] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 22:10:14 2022] DELETE /identity/v3/projects/cd23983804f14a2c83c88db64491820c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:10:14.608775 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8cbfc-8ce3-404e-8eb2-b83971403946 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:14.618420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8cbfc-8ce3-404e-8eb2-b83971403946 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:14.626565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:14.678184 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779af7b4-438f-4dc1-ad19-38e2da7283f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:14.678820 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779af7b4-438f-4dc1-ad19-38e2da7283f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:14.679103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779af7b4-438f-4dc1-ad19-38e2da7283f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:14.679419 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779af7b4-438f-4dc1-ad19-38e2da7283f4 admin admin] PATH_INFO: `/v3/users/13b46db77f7148eda25d2c80d611c4bd` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:14.680593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779af7b4-438f-4dc1-ad19-38e2da7283f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13b46db77f7148eda25d2c80d611c4bd)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:14.683030 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779af7b4-438f-4dc1-ad19-38e2da7283f4 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:14.728062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-779af7b4-438f-4dc1-ad19-38e2da7283f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13b46db77f7148eda25d2c80d611c4bd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:10:14.728748 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-779af7b4-438f-4dc1-ad19-38e2da7283f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13b46db77f7148eda25d2c80d611c4bd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:10:14.740651 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-779af7b4-438f-4dc1-ad19-38e2da7283f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13b46db77f7148eda25d2c80d611c4bd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:10:14.741286 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-779af7b4-438f-4dc1-ad19-38e2da7283f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13b46db77f7148eda25d2c80d611c4bd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:10:14.748990 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-779af7b4-438f-4dc1-ad19-38e2da7283f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13b46db77f7148eda25d2c80d611c4bd'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:10:14.762706 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4478/9003] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 22:10:14 2022] DELETE /identity/v3/users/13b46db77f7148eda25d2c80d611c4bd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:10:15.043768 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf05a7-ddc2-46e6-a4ba-85aa374bb58b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:15.045286 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-bcbf05a7-ddc2-46e6-a4ba-85aa374bb58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:10:15.062009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf05a7-ddc2-46e6-a4ba-85aa374bb58b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:15.123009 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54339d-5ed1-462b-9b80-58c7466163ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:15.123610 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54339d-5ed1-462b-9b80-58c7466163ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:15.123903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54339d-5ed1-462b-9b80-58c7466163ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:15.124187 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54339d-5ed1-462b-9b80-58c7466163ce admin admin] PATH_INFO: `/v3/projects/4ba3291ae539455f93ec69c9b2143a03` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:15.125358 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54339d-5ed1-462b-9b80-58c7466163ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ba3291ae539455f93ec69c9b2143a03)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:15.127271 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54339d-5ed1-462b-9b80-58c7466163ce admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:15.138509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:15.174536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cb54339d-5ed1-462b-9b80-58c7466163ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ba3291ae539455f93ec69c9b2143a03', 'request_id': 'req-cb54339d-5ed1-462b-9b80-58c7466163ce'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:10:15.180734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cb54339d-5ed1-462b-9b80-58c7466163ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ba3291ae539455f93ec69c9b2143a03', 'request_id': 'req-cb54339d-5ed1-462b-9b80-58c7466163ce'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:10:15.188117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cb54339d-5ed1-462b-9b80-58c7466163ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ba3291ae539455f93ec69c9b2143a03', 'request_id': 'req-cb54339d-5ed1-462b-9b80-58c7466163ce'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:10:15.199122 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cb54339d-5ed1-462b-9b80-58c7466163ce admin admin] The token cache is being invalidate because project 4ba3291ae539455f93ec69c9b2143a03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 22:10:15.199445 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cb54339d-5ed1-462b-9b80-58c7466163ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:10:15.200079 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-cb54339d-5ed1-462b-9b80-58c7466163ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:10:15.201577 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4526/9004] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 22:10:15 2022] DELETE /identity/v3/projects/4ba3291ae539455f93ec69c9b2143a03 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:10:15.206875 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d737451-1b73-4026-808d-0046526fdccb None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:15.207369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d737451-1b73-4026-808d-0046526fdccb None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:15.207475 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d737451-1b73-4026-808d-0046526fdccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:15.237132 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-8d737451-1b73-4026-808d-0046526fdccb None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:10:15.238344 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-8d737451-1b73-4026-808d-0046526fdccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:10:15.297075 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4479/9005] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:10:15.305258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d1f5b-2e08-435b-9cf9-e1d8bc15a031 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:15.305559 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d1f5b-2e08-435b-9cf9-e1d8bc15a031 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:15.305844 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d1f5b-2e08-435b-9cf9-e1d8bc15a031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:15.327513 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ad8d1f5b-2e08-435b-9cf9-e1d8bc15a031 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:10:15.328725 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ad8d1f5b-2e08-435b-9cf9-e1d8bc15a031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:10:15.337063 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4527/9006] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:10:15.341647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d737451-1b73-4026-808d-0046526fdccb None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:15.351821 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d737451-1b73-4026-808d-0046526fdccb None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:15.356610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127ffc0-3bc6-42e0-a6d9-f4ab6fafc366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:15.357224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127ffc0-3bc6-42e0-a6d9-f4ab6fafc366 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:15.357514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127ffc0-3bc6-42e0-a6d9-f4ab6fafc366 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:15.357822 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127ffc0-3bc6-42e0-a6d9-f4ab6fafc366 admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:15.358552 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127ffc0-3bc6-42e0-a6d9-f4ab6fafc366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 22:10:15.358859 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127ffc0-3bc6-42e0-a6d9-f4ab6fafc366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:15.360505 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127ffc0-3bc6-42e0-a6d9-f4ab6fafc366 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:15.373364 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4480/9007] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 22:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 22:10:15.377589 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d1f5b-2e08-435b-9cf9-e1d8bc15a031 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:15.388304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d1f5b-2e08-435b-9cf9-e1d8bc15a031 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:15.394972 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020776d-ef40-4c66-9679-b82dcfb0d5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:15.395726 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020776d-ef40-4c66-9679-b82dcfb0d5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:15.396087 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020776d-ef40-4c66-9679-b82dcfb0d5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:15.396472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020776d-ef40-4c66-9679-b82dcfb0d5f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:15.397244 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020776d-ef40-4c66-9679-b82dcfb0d5f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:15.399354 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020776d-ef40-4c66-9679-b82dcfb0d5f2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:15.427081 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4528/9008] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 22:10:15 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 22:10:15.431400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127ffc0-3bc6-42e0-a6d9-f4ab6fafc366 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:15.441737 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127ffc0-3bc6-42e0-a6d9-f4ab6fafc366 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:15.446679 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:15.500610 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f679b84-e2a7-48a0-ba1f-4c96f7ae18f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:15.501248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f679b84-e2a7-48a0-ba1f-4c96f7ae18f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:15.501519 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f679b84-e2a7-48a0-ba1f-4c96f7ae18f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:15.501798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f679b84-e2a7-48a0-ba1f-4c96f7ae18f0 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:15.502493 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f679b84-e2a7-48a0-ba1f-4c96f7ae18f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:15.504467 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f679b84-e2a7-48a0-ba1f-4c96f7ae18f0 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:15.527726 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4481/9009] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 22:10:15 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 22:10:15.532199 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020776d-ef40-4c66-9679-b82dcfb0d5f2 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:15.543316 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020776d-ef40-4c66-9679-b82dcfb0d5f2 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:15.548982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b5a5c-1cb8-4803-a10b-064d3a29d9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:15.549595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b5a5c-1cb8-4803-a10b-064d3a29d9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:15.549882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b5a5c-1cb8-4803-a10b-064d3a29d9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:15.550161 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b5a5c-1cb8-4803-a10b-064d3a29d9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:15.550854 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b5a5c-1cb8-4803-a10b-064d3a29d9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:15.552556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b5a5c-1cb8-4803-a10b-064d3a29d9c4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:15.563123 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4529/9010] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 22:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 22:10:15.567237 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f679b84-e2a7-48a0-ba1f-4c96f7ae18f0 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:15.577934 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f679b84-e2a7-48a0-ba1f-4c96f7ae18f0 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:15.583512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2d030-5266-4ac1-8911-f09b9f1496eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:15.584122 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2d030-5266-4ac1-8911-f09b9f1496eb admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:15.584410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2d030-5266-4ac1-8911-f09b9f1496eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:15.584689 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2d030-5266-4ac1-8911-f09b9f1496eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:15.585378 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2d030-5266-4ac1-8911-f09b9f1496eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:15.586965 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2d030-5266-4ac1-8911-f09b9f1496eb admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:15.599007 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4482/9011] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 22:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 30 22:10:15.603376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b5a5c-1cb8-4803-a10b-064d3a29d9c4 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:15.613661 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b5a5c-1cb8-4803-a10b-064d3a29d9c4 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:15.618431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd01c38-6973-4f0e-a12c-683a707ec80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:15.619097 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd01c38-6973-4f0e-a12c-683a707ec80c admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:15.619427 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd01c38-6973-4f0e-a12c-683a707ec80c admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:15.619713 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd01c38-6973-4f0e-a12c-683a707ec80c admin admin] PATH_INFO: `/v3/projects/cb0d987d5adc45fbb03290b133ee0641/users/eba4265a2b324928b7aee20262b850fe/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:15.634245 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd01c38-6973-4f0e-a12c-683a707ec80c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb0d987d5adc45fbb03290b133ee0641, user_id=eba4265a2b324928b7aee20262b850fe, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:15.637346 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd01c38-6973-4f0e-a12c-683a707ec80c admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:15.653028 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4530/9012] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 22:10:15 2022] PUT /identity/v3/projects/cb0d987d5adc45fbb03290b133ee0641/users/eba4265a2b324928b7aee20262b850fe/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:10:15.658125 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f6aca-dd7d-48c3-ad01-aa89d70926f3 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:15.658420 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f6aca-dd7d-48c3-ad01-aa89d70926f3 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:15.658704 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f6aca-dd7d-48c3-ad01-aa89d70926f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:15.677400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-430f6aca-dd7d-48c3-ad01-aa89d70926f3 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:10:15.678609 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-430f6aca-dd7d-48c3-ad01-aa89d70926f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:10:15.737705 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4483/9013] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:10:15.747307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd01c38-6973-4f0e-a12c-683a707ec80c admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:15.748994 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0bd01c38-6973-4f0e-a12c-683a707ec80c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:10:15.809317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd01c38-6973-4f0e-a12c-683a707ec80c admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:15.813015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0e082-259f-41a4-aaea-07006f379d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:15.813636 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0e082-259f-41a4-aaea-07006f379d1a service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:15.813922 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0e082-259f-41a4-aaea-07006f379d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:15.814202 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0e082-259f-41a4-aaea-07006f379d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:15.823736 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0e082-259f-41a4-aaea-07006f379d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:15.825210 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0e082-259f-41a4-aaea-07006f379d1a service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:15.834686 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4531/9014] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:10:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:10:20.037065 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e08988-0447-4992-8ddc-e14e3cade6dc None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:20.038027 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e08988-0447-4992-8ddc-e14e3cade6dc None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:20.038468 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e08988-0447-4992-8ddc-e14e3cade6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:20.071340 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-b9e08988-0447-4992-8ddc-e14e3cade6dc None None] MFA Rules not processed for user `eba4265a2b324928b7aee20262b850fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:10:20.073343 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b9e08988-0447-4992-8ddc-e14e3cade6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:10:20.142959 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4484/9015] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:10:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:10:20.147841 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0e082-259f-41a4-aaea-07006f379d1a service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:20.158188 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0e082-259f-41a4-aaea-07006f379d1a service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:20.162982 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1315579-575a-40f5-8cbd-58e2b45d23f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:20.163575 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1315579-575a-40f5-8cbd-58e2b45d23f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:20.163863 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1315579-575a-40f5-8cbd-58e2b45d23f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:20.164143 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1315579-575a-40f5-8cbd-58e2b45d23f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:20.164804 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1315579-575a-40f5-8cbd-58e2b45d23f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:20.166737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1315579-575a-40f5-8cbd-58e2b45d23f0 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:20.192889 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4532/9016] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 22:10:20 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 22:10:20.197473 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e08988-0447-4992-8ddc-e14e3cade6dc None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:20.208526 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e08988-0447-4992-8ddc-e14e3cade6dc None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:20.221461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:20.267534 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d60910-71dd-4458-83f7-79ddb24c0b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:20.268161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d60910-71dd-4458-83f7-79ddb24c0b2f admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:20.268449 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d60910-71dd-4458-83f7-79ddb24c0b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:20.268729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d60910-71dd-4458-83f7-79ddb24c0b2f admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:20.269675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d60910-71dd-4458-83f7-79ddb24c0b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:20.271628 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d60910-71dd-4458-83f7-79ddb24c0b2f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:20.302570 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4485/9017] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 22:10:20 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 22:10:20.307089 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1315579-575a-40f5-8cbd-58e2b45d23f0 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:20.320742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1315579-575a-40f5-8cbd-58e2b45d23f0 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:20.326272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01e51c-f7af-4ccd-89bb-5e8fadb0dbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:20.326900 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01e51c-f7af-4ccd-89bb-5e8fadb0dbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:20.327183 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01e51c-f7af-4ccd-89bb-5e8fadb0dbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:20.327509 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01e51c-f7af-4ccd-89bb-5e8fadb0dbe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:20.328234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01e51c-f7af-4ccd-89bb-5e8fadb0dbe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:20.330327 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01e51c-f7af-4ccd-89bb-5e8fadb0dbe1 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:20.342924 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4533/9018] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 22:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 22:10:20.347193 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d60910-71dd-4458-83f7-79ddb24c0b2f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:20.357762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d60910-71dd-4458-83f7-79ddb24c0b2f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:20.362807 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be65ac-b1a8-4917-913d-f1594e9f32e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:20.363506 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be65ac-b1a8-4917-913d-f1594e9f32e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:20.363800 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be65ac-b1a8-4917-913d-f1594e9f32e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:20.364086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be65ac-b1a8-4917-913d-f1594e9f32e1 admin admin] PATH_INFO: `/v3/projects/6f1f9ed7186f4d6e9a414519de4db980/users/9240e830d88b4d48b761ee9746c466bb/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:20.378864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be65ac-b1a8-4917-913d-f1594e9f32e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1f9ed7186f4d6e9a414519de4db980, user_id=9240e830d88b4d48b761ee9746c466bb, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:20.381591 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be65ac-b1a8-4917-913d-f1594e9f32e1 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:20.395343 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4486/9019] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 22:10:20 2022] PUT /identity/v3/projects/6f1f9ed7186f4d6e9a414519de4db980/users/9240e830d88b4d48b761ee9746c466bb/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:10:20.399250 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01e51c-f7af-4ccd-89bb-5e8fadb0dbe1 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:20.410086 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01e51c-f7af-4ccd-89bb-5e8fadb0dbe1 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:20.413813 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:20.471517 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db776e3f-85d8-47d0-b657-13aa8997a7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:20.472141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db776e3f-85d8-47d0-b657-13aa8997a7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:20.472424 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db776e3f-85d8-47d0-b657-13aa8997a7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:20.472700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db776e3f-85d8-47d0-b657-13aa8997a7d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:20.473390 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db776e3f-85d8-47d0-b657-13aa8997a7d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:20.475267 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db776e3f-85d8-47d0-b657-13aa8997a7d4 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:20.488321 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4534/9020] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 22:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 22:10:20.489967 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be65ac-b1a8-4917-913d-f1594e9f32e1 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:20.501555 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be65ac-b1a8-4917-913d-f1594e9f32e1 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:20.506522 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02617a9-68b0-44f6-8f57-316b51e00bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:20.507276 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02617a9-68b0-44f6-8f57-316b51e00bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:20.507739 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02617a9-68b0-44f6-8f57-316b51e00bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:20.508119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02617a9-68b0-44f6-8f57-316b51e00bf5 admin admin] PATH_INFO: `/v3/projects/6f1f9ed7186f4d6e9a414519de4db980/users/9240e830d88b4d48b761ee9746c466bb/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:20.510949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02617a9-68b0-44f6-8f57-316b51e00bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1f9ed7186f4d6e9a414519de4db980, user_id=9240e830d88b4d48b761ee9746c466bb, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:20.513677 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02617a9-68b0-44f6-8f57-316b51e00bf5 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:20.525612 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4487/9021] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 22:10:20 2022] PUT /identity/v3/projects/6f1f9ed7186f4d6e9a414519de4db980/users/9240e830d88b4d48b761ee9746c466bb/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:10:25.135864 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99633a0a-4c2b-4b41-a54e-7a1c553b9c97 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:25.136345 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99633a0a-4c2b-4b41-a54e-7a1c553b9c97 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:25.136430 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99633a0a-4c2b-4b41-a54e-7a1c553b9c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:25.178875 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-99633a0a-4c2b-4b41-a54e-7a1c553b9c97 None None] MFA Rules not processed for user `9240e830d88b4d48b761ee9746c466bb`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:10:25.180259 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-99633a0a-4c2b-4b41-a54e-7a1c553b9c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:10:25.264169 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4535/9022] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:10:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 22:10:25.282375 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02617a9-68b0-44f6-8f57-316b51e00bf5 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:25.285223 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d02617a9-68b0-44f6-8f57-316b51e00bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:10:25.402620 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02617a9-68b0-44f6-8f57-316b51e00bf5 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:25.412402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2bf99-3bce-433e-9009-a482ca9d02b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:25.412804 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2bf99-3bce-433e-9009-a482ca9d02b9 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:25.413039 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2bf99-3bce-433e-9009-a482ca9d02b9 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:25.413307 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2bf99-3bce-433e-9009-a482ca9d02b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:25.484020 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2bf99-3bce-433e-9009-a482ca9d02b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:25.485636 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2bf99-3bce-433e-9009-a482ca9d02b9 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:25.491450 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:25.499779 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4488/9023] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:10:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:10:26.537750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab1765-baea-42ac-9317-31884464c242 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:26.538194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab1765-baea-42ac-9317-31884464c242 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:26.538325 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab1765-baea-42ac-9317-31884464c242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:26.562429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-60ab1765-baea-42ac-9317-31884464c242 None None] MFA Rules not processed for user `eba4265a2b324928b7aee20262b850fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:10:26.563835 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-60ab1765-baea-42ac-9317-31884464c242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:10:26.572593 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4536/9024] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:10:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:10:27.220907 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2bf99-3bce-433e-9009-a482ca9d02b9 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:27.222469 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-ffe2bf99-3bce-433e-9009-a482ca9d02b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:10:27.314439 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2bf99-3bce-433e-9009-a482ca9d02b9 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:27.319678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d06536-c910-4bc9-b334-96651a183178 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:27.320377 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d06536-c910-4bc9-b334-96651a183178 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:27.320730 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d06536-c910-4bc9-b334-96651a183178 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:27.321076 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d06536-c910-4bc9-b334-96651a183178 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:27.322925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-32d06536-c910-4bc9-b334-96651a183178 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:10:27.335241 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d06536-c910-4bc9-b334-96651a183178 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:27.336980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d06536-c910-4bc9-b334-96651a183178 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:27.350490 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4489/9025] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:10:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:10:29.829377 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab1765-baea-42ac-9317-31884464c242 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:29.830944 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-60ab1765-baea-42ac-9317-31884464c242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:10:29.849357 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab1765-baea-42ac-9317-31884464c242 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:29.855015 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d606ec-1092-44ae-a384-66dc52e187a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:29.855709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d606ec-1092-44ae-a384-66dc52e187a5 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:29.856003 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d606ec-1092-44ae-a384-66dc52e187a5 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:29.856284 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d606ec-1092-44ae-a384-66dc52e187a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:29.858056 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-84d606ec-1092-44ae-a384-66dc52e187a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:10:29.870995 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d606ec-1092-44ae-a384-66dc52e187a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:29.872639 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d606ec-1092-44ae-a384-66dc52e187a5 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:29.883695 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4537/9026] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:10:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:10:37.343894 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=32 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:38.169848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d06536-c910-4bc9-b334-96651a183178 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:10:38.171305 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-32d06536-c910-4bc9-b334-96651a183178 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:10:38.228302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d06536-c910-4bc9-b334-96651a183178 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:10:38.231870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a92e4-1841-4825-a4ed-01589c4a8b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:10:38.232487 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a92e4-1841-4825-a4ed-01589c4a8b07 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:10:38.232773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a92e4-1841-4825-a4ed-01589c4a8b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:10:38.233051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a92e4-1841-4825-a4ed-01589c4a8b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:10:38.241906 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a92e4-1841-4825-a4ed-01589c4a8b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:10:38.244067 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a92e4-1841-4825-a4ed-01589c4a8b07 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:10:38.253463 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4490/9027] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:10:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:10:39.879134 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=69 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:48.249298 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=26 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:11:57.025263 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d606ec-1092-44ae-a384-66dc52e187a5 service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:11:57.037019 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d606ec-1092-44ae-a384-66dc52e187a5 service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:11:57.042006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c602e87-ec27-46dc-9b7d-6b1a830bccff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:11:57.042621 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c602e87-ec27-46dc-9b7d-6b1a830bccff service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:11:57.042906 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c602e87-ec27-46dc-9b7d-6b1a830bccff service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:11:57.043186 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c602e87-ec27-46dc-9b7d-6b1a830bccff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:11:57.044966 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7c602e87-ec27-46dc-9b7d-6b1a830bccff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:11:57.068896 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c602e87-ec27-46dc-9b7d-6b1a830bccff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:11:57.070959 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c602e87-ec27-46dc-9b7d-6b1a830bccff service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:11:57.080804 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4538/9028] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:11:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:11:58.171502 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a92e4-1841-4825-a4ed-01589c4a8b07 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:11:58.172980 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4a6a92e4-1841-4825-a4ed-01589c4a8b07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:11:58.187480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a92e4-1841-4825-a4ed-01589c4a8b07 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:11:58.192497 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5ad2b-6fb3-4a00-a0b8-db0224e51c3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:11:58.193102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ad2b-6fb3-4a00-a0b8-db0224e51c3d service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:11:58.193424 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ad2b-6fb3-4a00-a0b8-db0224e51c3d service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:11:58.193705 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ad2b-6fb3-4a00-a0b8-db0224e51c3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:11:58.195444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c7c5ad2b-6fb3-4a00-a0b8-db0224e51c3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:11:58.207207 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5ad2b-6fb3-4a00-a0b8-db0224e51c3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:11:58.208823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5ad2b-6fb3-4a00-a0b8-db0224e51c3d service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:11:58.219225 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4491/9029] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:11:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:12:07.076666 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=11 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:12:08.215051 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:12:50.396194 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccb079-93fa-43a9-aba9-409f103d33e5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:12:50.396764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccb079-93fa-43a9-aba9-409f103d33e5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:12:50.396764 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccb079-93fa-43a9-aba9-409f103d33e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:12:50.466230 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-0dccb079-93fa-43a9-aba9-409f103d33e5 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:12:50.467744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-0dccb079-93fa-43a9-aba9-409f103d33e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:12:50.551451 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4539/9030] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 22:12:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:12:50.602498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5ad2b-6fb3-4a00-a0b8-db0224e51c3d service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:12:50.604688 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c7c5ad2b-6fb3-4a00-a0b8-db0224e51c3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:12:50.708608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5ad2b-6fb3-4a00-a0b8-db0224e51c3d service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:12:50.714433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780fcd2-174f-49f6-8e85-b93e9112cc3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:12:50.715066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780fcd2-174f-49f6-8e85-b93e9112cc3b service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:12:50.715452 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780fcd2-174f-49f6-8e85-b93e9112cc3b service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:12:50.715745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780fcd2-174f-49f6-8e85-b93e9112cc3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:12:50.724181 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780fcd2-174f-49f6-8e85-b93e9112cc3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:12:50.725823 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780fcd2-174f-49f6-8e85-b93e9112cc3b service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:12:50.734084 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4492/9031] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 22:12:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 30 22:12:52.437905 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccb079-93fa-43a9-aba9-409f103d33e5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:12:52.455294 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccb079-93fa-43a9-aba9-409f103d33e5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:12:52.461110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803a247-61cc-4b7a-be16-e294b9e66601 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:12:52.463077 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803a247-61cc-4b7a-be16-e294b9e66601 service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:12:52.463217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803a247-61cc-4b7a-be16-e294b9e66601 service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:12:52.463618 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803a247-61cc-4b7a-be16-e294b9e66601 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:12:52.466504 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3803a247-61cc-4b7a-be16-e294b9e66601 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:12:52.505131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803a247-61cc-4b7a-be16-e294b9e66601 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:12:52.506757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803a247-61cc-4b7a-be16-e294b9e66601 service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:12:52.518746 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4540/9032] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:12:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:13:00.730733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=41 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:13:02.513857 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=55 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:13:03.285766 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780fcd2-174f-49f6-8e85-b93e9112cc3b service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:13:03.295106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780fcd2-174f-49f6-8e85-b93e9112cc3b service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:13:03.298757 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f098ed0-c600-487a-aa19-7e6301f2b806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:13:03.299402 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f098ed0-c600-487a-aa19-7e6301f2b806 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:13:03.299690 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f098ed0-c600-487a-aa19-7e6301f2b806 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:13:03.299969 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f098ed0-c600-487a-aa19-7e6301f2b806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:13:03.301729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4f098ed0-c600-487a-aa19-7e6301f2b806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:13:03.311052 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f098ed0-c600-487a-aa19-7e6301f2b806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:13:03.312510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f098ed0-c600-487a-aa19-7e6301f2b806 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:13:03.320383 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4493/9033] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:13:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:13:04.439591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f92fb-5e52-4d28-b312-a6cded77af0e None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:13:04.440112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f92fb-5e52-4d28-b312-a6cded77af0e None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:13:04.440234 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f92fb-5e52-4d28-b312-a6cded77af0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:13:04.481702 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-3a3f92fb-5e52-4d28-b312-a6cded77af0e None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:13:04.483088 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-3a3f92fb-5e52-4d28-b312-a6cded77af0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:13:04.492949 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4541/9034] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 22:13:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:13:04.504867 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f098ed0-c600-487a-aa19-7e6301f2b806 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:13:04.506268 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4f098ed0-c600-487a-aa19-7e6301f2b806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:13:04.587470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f098ed0-c600-487a-aa19-7e6301f2b806 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:13:04.591109 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f66652-f2e0-47ee-ab08-00f50707c7a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:13:04.591772 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f66652-f2e0-47ee-ab08-00f50707c7a2 service glance] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:13:04.592058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f66652-f2e0-47ee-ab08-00f50707c7a2 service glance] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:13:04.592337 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f66652-f2e0-47ee-ab08-00f50707c7a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:13:04.603066 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f66652-f2e0-47ee-ab08-00f50707c7a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:13:04.604545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f66652-f2e0-47ee-ab08-00f50707c7a2 service glance] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:13:04.615360 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4494/9035] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:13:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:13:04.680701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f92fb-5e52-4d28-b312-a6cded77af0e None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:13:04.690400 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f92fb-5e52-4d28-b312-a6cded77af0e None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:13:04.694073 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91944a8-d4d6-413f-b013-622cfdb8e95d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:13:04.694688 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91944a8-d4d6-413f-b013-622cfdb8e95d service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:13:04.694977 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91944a8-d4d6-413f-b013-622cfdb8e95d service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:13:04.695261 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91944a8-d4d6-413f-b013-622cfdb8e95d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:13:04.697564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-c91944a8-d4d6-413f-b013-622cfdb8e95d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:13:04.706973 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91944a8-d4d6-413f-b013-622cfdb8e95d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:13:04.708465 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91944a8-d4d6-413f-b013-622cfdb8e95d service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:13:04.717006 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4542/9036] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:13:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:13:04.790758 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cceb78-ea0a-4a89-854c-b038ef469138 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:13:04.791050 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cceb78-ea0a-4a89-854c-b038ef469138 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:13:04.791366 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cceb78-ea0a-4a89-854c-b038ef469138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:13:04.810780 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-c0cceb78-ea0a-4a89-854c-b038ef469138 None None] MFA Rules not processed for user `08a2a5793b7a4797a470719a682e541a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:13:04.812119 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-c0cceb78-ea0a-4a89-854c-b038ef469138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:13:04.821917 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4495/9037] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 30 22:13:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:13:04.832318 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91944a8-d4d6-413f-b013-622cfdb8e95d service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:13:04.841711 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91944a8-d4d6-413f-b013-622cfdb8e95d service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:13:04.845396 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4b3c4-9b97-4b92-829c-44843b1860ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:13:04.845998 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4b3c4-9b97-4b92-829c-44843b1860ba service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:13:04.846279 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4b3c4-9b97-4b92-829c-44843b1860ba service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:13:04.846553 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4b3c4-9b97-4b92-829c-44843b1860ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:13:04.856624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4b3c4-9b97-4b92-829c-44843b1860ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:13:04.858039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4b3c4-9b97-4b92-829c-44843b1860ba service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:13:04.868999 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4543/9038] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:13:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:13:04.928885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cceb78-ea0a-4a89-854c-b038ef469138 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:13:04.940130 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cceb78-ea0a-4a89-854c-b038ef469138 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:13:04.945088 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a6d13-09b9-4e57-9e83-61c5ba18c3c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:13:04.945696 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a6d13-09b9-4e57-9e83-61c5ba18c3c9 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:13:04.945981 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a6d13-09b9-4e57-9e83-61c5ba18c3c9 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:13:04.946797 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a6d13-09b9-4e57-9e83-61c5ba18c3c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:13:04.948512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-db9a6d13-09b9-4e57-9e83-61c5ba18c3c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:13:04.959595 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a6d13-09b9-4e57-9e83-61c5ba18c3c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:13:04.961164 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a6d13-09b9-4e57-9e83-61c5ba18c3c9 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:13:04.971600 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4496/9039] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:13:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:13:06.359243 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb3535-44ed-4904-b62d-4dfb9c30c89a None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:13:06.359752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb3535-44ed-4904-b62d-4dfb9c30c89a None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:13:06.359880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb3535-44ed-4904-b62d-4dfb9c30c89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:13:06.379584 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9ffb3535-44ed-4904-b62d-4dfb9c30c89a None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:13:06.380795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9ffb3535-44ed-4904-b62d-4dfb9c30c89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:13:06.388297 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4544/9040] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 22:13:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:13:06.400848 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a6d13-09b9-4e57-9e83-61c5ba18c3c9 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:13:06.412510 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a6d13-09b9-4e57-9e83-61c5ba18c3c9 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:13:06.418056 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf6cbe-f4cc-4503-a63e-8a1a7932e74c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:13:06.418707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf6cbe-f4cc-4503-a63e-8a1a7932e74c service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:13:06.418997 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf6cbe-f4cc-4503-a63e-8a1a7932e74c service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:13:06.419278 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf6cbe-f4cc-4503-a63e-8a1a7932e74c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:13:06.428062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf6cbe-f4cc-4503-a63e-8a1a7932e74c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:13:06.429647 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf6cbe-f4cc-4503-a63e-8a1a7932e74c service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:13:06.438638 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4497/9041] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 22:13:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 30 22:13:16.374676 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=24 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:13:16.435360 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=56 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:13:19.855883 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee2109-c085-4229-bb63-30b77c62f575 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:13:19.856385 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee2109-c085-4229-bb63-30b77c62f575 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:13:19.856571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee2109-c085-4229-bb63-30b77c62f575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:13:19.876152 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-13ee2109-c085-4229-bb63-30b77c62f575 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:13:19.877441 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-13ee2109-c085-4229-bb63-30b77c62f575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:13:19.884628 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4545/9042] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 22:13:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:13:19.897893 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf6cbe-f4cc-4503-a63e-8a1a7932e74c service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:13:19.908711 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf6cbe-f4cc-4503-a63e-8a1a7932e74c service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:13:19.913925 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f5193-9b0a-4dc7-921b-dde8ca7adde6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:13:19.914533 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f5193-9b0a-4dc7-921b-dde8ca7adde6 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:13:19.915336 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f5193-9b0a-4dc7-921b-dde8ca7adde6 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:13:19.915621 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f5193-9b0a-4dc7-921b-dde8ca7adde6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:13:19.924227 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f5193-9b0a-4dc7-921b-dde8ca7adde6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:13:19.925812 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f5193-9b0a-4dc7-921b-dde8ca7adde6 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:13:19.934684 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4498/9043] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 22:13:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 22:13:29.870757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:13:29.931243 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=6 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:14:04.854457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee2109-c085-4229-bb63-30b77c62f575 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:14:04.866495 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee2109-c085-4229-bb63-30b77c62f575 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:14:04.870349 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da54f4-d4a0-408e-a3c6-a1743ce33be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:14:04.871586 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da54f4-d4a0-408e-a3c6-a1743ce33be7 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:14:04.871874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da54f4-d4a0-408e-a3c6-a1743ce33be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:14:04.872155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da54f4-d4a0-408e-a3c6-a1743ce33be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:14:04.874098 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-06da54f4-d4a0-408e-a3c6-a1743ce33be7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:14:04.883807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da54f4-d4a0-408e-a3c6-a1743ce33be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:14:04.885241 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da54f4-d4a0-408e-a3c6-a1743ce33be7 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:14:04.893130 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4546/9044] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:14:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:14:14.889694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:14:33.838234 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f5193-9b0a-4dc7-921b-dde8ca7adde6 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:14:33.851915 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f5193-9b0a-4dc7-921b-dde8ca7adde6 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:14:33.858888 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0542627-7e25-4ade-8198-aaf7d8462f93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:14:33.859536 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0542627-7e25-4ade-8198-aaf7d8462f93 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:14:33.859824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0542627-7e25-4ade-8198-aaf7d8462f93 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:14:33.860102 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0542627-7e25-4ade-8198-aaf7d8462f93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:14:33.861895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a0542627-7e25-4ade-8198-aaf7d8462f93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:14:33.874898 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0542627-7e25-4ade-8198-aaf7d8462f93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:14:33.876545 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0542627-7e25-4ade-8198-aaf7d8462f93 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:14:33.891846 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4499/9045] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:14:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:14:36.774533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a22fe-e044-4e4e-85c1-e9a8e67fd9c5 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:14:36.775039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a22fe-e044-4e4e-85c1-e9a8e67fd9c5 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:14:36.775167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a22fe-e044-4e4e-85c1-e9a8e67fd9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:14:36.794285 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-ff8a22fe-e044-4e4e-85c1-e9a8e67fd9c5 None None] MFA Rules not processed for user `eba4265a2b324928b7aee20262b850fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:14:36.795581 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ff8a22fe-e044-4e4e-85c1-e9a8e67fd9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:14:36.802359 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4547/9046] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:14:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:14:40.702048 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0542627-7e25-4ade-8198-aaf7d8462f93 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:14:40.712191 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0542627-7e25-4ade-8198-aaf7d8462f93 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:14:40.717068 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309f730-1b61-432b-9d1f-0f901b931be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:14:40.717939 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309f730-1b61-432b-9d1f-0f901b931be3 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:14:40.718291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309f730-1b61-432b-9d1f-0f901b931be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:14:40.718634 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309f730-1b61-432b-9d1f-0f901b931be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:14:40.720517 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-b309f730-1b61-432b-9d1f-0f901b931be3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:14:40.732972 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309f730-1b61-432b-9d1f-0f901b931be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:14:40.734697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309f730-1b61-432b-9d1f-0f901b931be3 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:14:40.753272 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4500/9047] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:14:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:14:46.789549 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:14:50.739642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=12 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:16:57.961387 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a22fe-e044-4e4e-85c1-e9a8e67fd9c5 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:16:58.025669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a22fe-e044-4e4e-85c1-e9a8e67fd9c5 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:16:58.031328 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cb831-e8aa-4bfa-8781-104f1a12a51d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:16:58.031956 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cb831-e8aa-4bfa-8781-104f1a12a51d service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:16:58.032246 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cb831-e8aa-4bfa-8781-104f1a12a51d service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:16:58.032528 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cb831-e8aa-4bfa-8781-104f1a12a51d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:16:58.041254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cb831-e8aa-4bfa-8781-104f1a12a51d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:16:58.042888 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cb831-e8aa-4bfa-8781-104f1a12a51d service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:16:58.051980 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4548/9048] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:16:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:16:59.240512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309f730-1b61-432b-9d1f-0f901b931be3 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:16:59.259599 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309f730-1b61-432b-9d1f-0f901b931be3 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:16:59.263985 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2244c66-a246-4054-8822-987bb127ead0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:16:59.264601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2244c66-a246-4054-8822-987bb127ead0 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:16:59.264889 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2244c66-a246-4054-8822-987bb127ead0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:16:59.265177 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2244c66-a246-4054-8822-987bb127ead0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:16:59.267031 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d2244c66-a246-4054-8822-987bb127ead0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:16:59.291675 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2244c66-a246-4054-8822-987bb127ead0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:16:59.293107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2244c66-a246-4054-8822-987bb127ead0 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:16:59.306102 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4501/9049] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:16:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:17:00.492724 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cb831-e8aa-4bfa-8781-104f1a12a51d service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:17:00.501860 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cb831-e8aa-4bfa-8781-104f1a12a51d service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:17:00.505597 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9089ad-6932-4526-9c07-b2d51f8e5f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:17:00.506200 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9089ad-6932-4526-9c07-b2d51f8e5f95 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:17:00.506483 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9089ad-6932-4526-9c07-b2d51f8e5f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:17:00.506758 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9089ad-6932-4526-9c07-b2d51f8e5f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:17:00.508633 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-5e9089ad-6932-4526-9c07-b2d51f8e5f95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:17:00.522953 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9089ad-6932-4526-9c07-b2d51f8e5f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:17:00.524436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9089ad-6932-4526-9c07-b2d51f8e5f95 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:17:00.536324 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4549/9050] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:17:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:17:01.045444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2244c66-a246-4054-8822-987bb127ead0 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:17:01.070390 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2244c66-a246-4054-8822-987bb127ead0 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:17:01.075543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400f951-5719-428a-9c75-ff45741680c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:17:01.076155 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400f951-5719-428a-9c75-ff45741680c2 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:17:01.076445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400f951-5719-428a-9c75-ff45741680c2 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:17:01.076722 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400f951-5719-428a-9c75-ff45741680c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:17:01.085429 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400f951-5719-428a-9c75-ff45741680c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:17:01.087013 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400f951-5719-428a-9c75-ff45741680c2 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:17:01.097052 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4502/9051] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:17:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:17:07.134785 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9089ad-6932-4526-9c07-b2d51f8e5f95 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:17:07.149024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9089ad-6932-4526-9c07-b2d51f8e5f95 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:17:07.154594 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f638c-7aa1-4c4d-a47e-e6fb93102104 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:17:07.155217 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f638c-7aa1-4c4d-a47e-e6fb93102104 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:17:07.155538 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f638c-7aa1-4c4d-a47e-e6fb93102104 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:17:07.155825 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f638c-7aa1-4c4d-a47e-e6fb93102104 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:17:07.165004 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f638c-7aa1-4c4d-a47e-e6fb93102104 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:17:07.166582 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f638c-7aa1-4c4d-a47e-e6fb93102104 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:17:07.176664 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4550/9052] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:17:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:17:11.093312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=25 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:17:17.172379 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=39 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:18:43.234849 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400f951-5719-428a-9c75-ff45741680c2 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:43.252936 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400f951-5719-428a-9c75-ff45741680c2 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:43.260464 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c259044-a302-49d0-a68d-3c65688c3501 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:43.260699 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c259044-a302-49d0-a68d-3c65688c3501 service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:43.261143 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c259044-a302-49d0-a68d-3c65688c3501 service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:43.261440 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c259044-a302-49d0-a68d-3c65688c3501 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:43.272061 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c259044-a302-49d0-a68d-3c65688c3501 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:43.274127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c259044-a302-49d0-a68d-3c65688c3501 service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:43.285541 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4503/9053] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:18:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:18:47.124843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f638c-7aa1-4c4d-a47e-e6fb93102104 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:47.135078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f638c-7aa1-4c4d-a47e-e6fb93102104 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:47.138722 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6e4aa-c81d-4ee6-a92c-fa74b5a53746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:47.139374 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6e4aa-c81d-4ee6-a92c-fa74b5a53746 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:47.139667 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6e4aa-c81d-4ee6-a92c-fa74b5a53746 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:47.139950 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6e4aa-c81d-4ee6-a92c-fa74b5a53746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:47.211421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6e4aa-c81d-4ee6-a92c-fa74b5a53746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:47.212940 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6e4aa-c81d-4ee6-a92c-fa74b5a53746 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:47.231966 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4551/9054] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:18:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:18:50.460824 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c259044-a302-49d0-a68d-3c65688c3501 service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:50.473100 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c259044-a302-49d0-a68d-3c65688c3501 service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:50.478333 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238a68c-ae76-4f9c-86aa-6aa342f5dc69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:50.478948 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238a68c-ae76-4f9c-86aa-6aa342f5dc69 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:50.479238 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238a68c-ae76-4f9c-86aa-6aa342f5dc69 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:50.479561 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238a68c-ae76-4f9c-86aa-6aa342f5dc69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:50.481328 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4238a68c-ae76-4f9c-86aa-6aa342f5dc69 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:18:50.493931 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238a68c-ae76-4f9c-86aa-6aa342f5dc69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:50.495742 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238a68c-ae76-4f9c-86aa-6aa342f5dc69 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:50.506305 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4504/9055] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:18:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 22:18:53.391125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6e4aa-c81d-4ee6-a92c-fa74b5a53746 service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:53.404168 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6e4aa-c81d-4ee6-a92c-fa74b5a53746 service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:53.411733 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d228d1-18c8-4967-a4b1-d443b1f7dc68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:53.413428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d228d1-18c8-4967-a4b1-d443b1f7dc68 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:53.414101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d228d1-18c8-4967-a4b1-d443b1f7dc68 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:53.414489 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d228d1-18c8-4967-a4b1-d443b1f7dc68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:53.416596 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-b8d228d1-18c8-4967-a4b1-d443b1f7dc68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:18:53.431362 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d228d1-18c8-4967-a4b1-d443b1f7dc68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:53.433656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d228d1-18c8-4967-a4b1-d443b1f7dc68 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:53.456718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238a68c-ae76-4f9c-86aa-6aa342f5dc69 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:53.463672 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4552/9056] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:18:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:18:53.476597 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238a68c-ae76-4f9c-86aa-6aa342f5dc69 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:53.482887 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca02fd-cc20-4104-821f-4a9c13803764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:53.484746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca02fd-cc20-4104-821f-4a9c13803764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:53.485107 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca02fd-cc20-4104-821f-4a9c13803764 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:53.485454 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca02fd-cc20-4104-821f-4a9c13803764 admin admin] PATH_INFO: `/v3/users/eba4265a2b324928b7aee20262b850fe` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:53.487501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca02fd-cc20-4104-821f-4a9c13803764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eba4265a2b324928b7aee20262b850fe)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:53.491049 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca02fd-cc20-4104-821f-4a9c13803764 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:53.554720 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-aaca02fd-cc20-4104-821f-4a9c13803764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eba4265a2b324928b7aee20262b850fe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:18:53.555432 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-aaca02fd-cc20-4104-821f-4a9c13803764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eba4265a2b324928b7aee20262b850fe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:18:53.576601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-aaca02fd-cc20-4104-821f-4a9c13803764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eba4265a2b324928b7aee20262b850fe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:18:53.577221 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-aaca02fd-cc20-4104-821f-4a9c13803764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eba4265a2b324928b7aee20262b850fe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:18:53.584713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-aaca02fd-cc20-4104-821f-4a9c13803764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eba4265a2b324928b7aee20262b850fe'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:18:53.597743 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4505/9057] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 22:18:53 2022] DELETE /identity/v3/users/eba4265a2b324928b7aee20262b850fe => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:18:53.775494 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d228d1-18c8-4967-a4b1-d443b1f7dc68 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:53.787351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d228d1-18c8-4967-a4b1-d443b1f7dc68 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:53.844429 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c38b85-0f08-43bd-b7fd-a395f1a46449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:53.845006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c38b85-0f08-43bd-b7fd-a395f1a46449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:53.845292 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c38b85-0f08-43bd-b7fd-a395f1a46449 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:53.845574 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c38b85-0f08-43bd-b7fd-a395f1a46449 admin admin] PATH_INFO: `/v3/projects/cb0d987d5adc45fbb03290b133ee0641` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:53.847375 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c38b85-0f08-43bd-b7fd-a395f1a46449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb0d987d5adc45fbb03290b133ee0641)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:53.849324 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c38b85-0f08-43bd-b7fd-a395f1a46449 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:53.894671 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-29c38b85-0f08-43bd-b7fd-a395f1a46449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb0d987d5adc45fbb03290b133ee0641', 'request_id': 'req-29c38b85-0f08-43bd-b7fd-a395f1a46449'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:18:53.900907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-29c38b85-0f08-43bd-b7fd-a395f1a46449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb0d987d5adc45fbb03290b133ee0641', 'request_id': 'req-29c38b85-0f08-43bd-b7fd-a395f1a46449'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:18:53.909359 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-29c38b85-0f08-43bd-b7fd-a395f1a46449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb0d987d5adc45fbb03290b133ee0641', 'request_id': 'req-29c38b85-0f08-43bd-b7fd-a395f1a46449'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:18:53.913228 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:18:53.934710 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-29c38b85-0f08-43bd-b7fd-a395f1a46449 admin admin] The token cache is being invalidate because project cb0d987d5adc45fbb03290b133ee0641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 22:18:53.935006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-29c38b85-0f08-43bd-b7fd-a395f1a46449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:18:53.935670 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-29c38b85-0f08-43bd-b7fd-a395f1a46449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:18:53.937188 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4553/9058] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 22:18:53 2022] DELETE /identity/v3/projects/cb0d987d5adc45fbb03290b133ee0641 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:18:53.941248 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca02fd-cc20-4104-821f-4a9c13803764 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:53.942681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-aaca02fd-cc20-4104-821f-4a9c13803764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:18:53.956302 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca02fd-cc20-4104-821f-4a9c13803764 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:54.012471 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17e059-bd8f-4bc4-8a1e-b85758a17b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:54.013124 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e059-bd8f-4bc4-8a1e-b85758a17b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:54.013410 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e059-bd8f-4bc4-8a1e-b85758a17b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:54.013692 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e059-bd8f-4bc4-8a1e-b85758a17b02 admin admin] PATH_INFO: `/v3/users/9240e830d88b4d48b761ee9746c466bb` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:54.014870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17e059-bd8f-4bc4-8a1e-b85758a17b02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9240e830d88b4d48b761ee9746c466bb)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:54.016852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17e059-bd8f-4bc4-8a1e-b85758a17b02 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:54.064312 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-af17e059-bd8f-4bc4-8a1e-b85758a17b02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9240e830d88b4d48b761ee9746c466bb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:18:54.064885 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-af17e059-bd8f-4bc4-8a1e-b85758a17b02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9240e830d88b4d48b761ee9746c466bb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:18:54.065984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:18:54.078594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-af17e059-bd8f-4bc4-8a1e-b85758a17b02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9240e830d88b4d48b761ee9746c466bb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:18:54.079261 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-af17e059-bd8f-4bc4-8a1e-b85758a17b02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9240e830d88b4d48b761ee9746c466bb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:18:54.089565 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-af17e059-bd8f-4bc4-8a1e-b85758a17b02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9240e830d88b4d48b761ee9746c466bb'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:18:54.102529 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4506/9059] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 22:18:53 2022] DELETE /identity/v3/users/9240e830d88b4d48b761ee9746c466bb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:18:54.277934 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c38b85-0f08-43bd-b7fd-a395f1a46449 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:54.279734 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-29c38b85-0f08-43bd-b7fd-a395f1a46449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:18:54.293180 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c38b85-0f08-43bd-b7fd-a395f1a46449 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:54.364453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcfcff-c386-45e8-898d-72cd5a009b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:54.365093 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcfcff-c386-45e8-898d-72cd5a009b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:54.365376 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcfcff-c386-45e8-898d-72cd5a009b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:54.365651 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcfcff-c386-45e8-898d-72cd5a009b51 admin admin] PATH_INFO: `/v3/projects/6f1f9ed7186f4d6e9a414519de4db980` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:54.366795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcfcff-c386-45e8-898d-72cd5a009b51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f1f9ed7186f4d6e9a414519de4db980)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:54.368750 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcfcff-c386-45e8-898d-72cd5a009b51 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:54.413564 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c3fcfcff-c386-45e8-898d-72cd5a009b51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f1f9ed7186f4d6e9a414519de4db980', 'request_id': 'req-c3fcfcff-c386-45e8-898d-72cd5a009b51'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:18:54.420176 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c3fcfcff-c386-45e8-898d-72cd5a009b51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f1f9ed7186f4d6e9a414519de4db980', 'request_id': 'req-c3fcfcff-c386-45e8-898d-72cd5a009b51'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:18:54.427988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c3fcfcff-c386-45e8-898d-72cd5a009b51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f1f9ed7186f4d6e9a414519de4db980', 'request_id': 'req-c3fcfcff-c386-45e8-898d-72cd5a009b51'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:18:54.438709 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c3fcfcff-c386-45e8-898d-72cd5a009b51 admin admin] The token cache is being invalidate because project 6f1f9ed7186f4d6e9a414519de4db980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 22:18:54.439005 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c3fcfcff-c386-45e8-898d-72cd5a009b51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:18:54.440451 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-c3fcfcff-c386-45e8-898d-72cd5a009b51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:18:54.442271 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4554/9060] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 22:18:54 2022] DELETE /identity/v3/projects/6f1f9ed7186f4d6e9a414519de4db980 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:18:54.447208 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5893a-9396-4537-916f-ad6b1594d141 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:54.447543 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5893a-9396-4537-916f-ad6b1594d141 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:54.447815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5893a-9396-4537-916f-ad6b1594d141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:54.495433 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-20c5893a-9396-4537-916f-ad6b1594d141 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:18:54.496661 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-20c5893a-9396-4537-916f-ad6b1594d141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:18:54.556185 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4507/9061] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 30 22:18:54.564155 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573768cb-1120-415d-8fb8-451657935d15 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:54.564458 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573768cb-1120-415d-8fb8-451657935d15 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:54.565388 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573768cb-1120-415d-8fb8-451657935d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:54.584619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-573768cb-1120-415d-8fb8-451657935d15 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:18:54.585814 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-573768cb-1120-415d-8fb8-451657935d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:18:54.593664 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4555/9062] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:18:54.597895 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5893a-9396-4537-916f-ad6b1594d141 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:54.607826 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5893a-9396-4537-916f-ad6b1594d141 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:54.612908 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6f594-6053-40dc-847b-0078316cbe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:54.613514 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6f594-6053-40dc-847b-0078316cbe8c admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:54.613801 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6f594-6053-40dc-847b-0078316cbe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:54.614080 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6f594-6053-40dc-847b-0078316cbe8c admin admin] PATH_INFO: `/v3/domains` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:54.614763 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6f594-6053-40dc-847b-0078316cbe8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 30 22:18:54.615077 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6f594-6053-40dc-847b-0078316cbe8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:54.616719 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6f594-6053-40dc-847b-0078316cbe8c admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:54.628698 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4508/9063] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 30 22:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 30 22:18:54.633110 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573768cb-1120-415d-8fb8-451657935d15 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:54.642656 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573768cb-1120-415d-8fb8-451657935d15 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:54.647698 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649bb3e-f5e1-4a07-afcd-f2a9ade03087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:54.648300 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649bb3e-f5e1-4a07-afcd-f2a9ade03087 admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:54.648583 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649bb3e-f5e1-4a07-afcd-f2a9ade03087 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:54.648858 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649bb3e-f5e1-4a07-afcd-f2a9ade03087 admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:54.649521 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649bb3e-f5e1-4a07-afcd-f2a9ade03087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:54.651436 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649bb3e-f5e1-4a07-afcd-f2a9ade03087 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:54.687565 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4556/9064] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 22:18:54 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 22:18:54.692321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6f594-6053-40dc-847b-0078316cbe8c admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:54.702345 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6f594-6053-40dc-847b-0078316cbe8c admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:54.759159 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dd943-9bc3-418b-84c3-03c02fd96f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:54.759831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dd943-9bc3-418b-84c3-03c02fd96f6f admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:54.760120 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dd943-9bc3-418b-84c3-03c02fd96f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:54.760400 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dd943-9bc3-418b-84c3-03c02fd96f6f admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:54.761081 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943dd943-9bc3-418b-84c3-03c02fd96f6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:54.762984 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943dd943-9bc3-418b-84c3-03c02fd96f6f admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:54.783594 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4509/9065] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 22:18:54 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 22:18:54.787787 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649bb3e-f5e1-4a07-afcd-f2a9ade03087 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:54.798281 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649bb3e-f5e1-4a07-afcd-f2a9ade03087 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:54.803431 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b6969-4a2f-43ea-baa3-e3d30dc0a881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:54.804033 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b6969-4a2f-43ea-baa3-e3d30dc0a881 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:54.804323 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b6969-4a2f-43ea-baa3-e3d30dc0a881 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:54.804606 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b6969-4a2f-43ea-baa3-e3d30dc0a881 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:54.805302 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b6969-4a2f-43ea-baa3-e3d30dc0a881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:54.807356 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b6969-4a2f-43ea-baa3-e3d30dc0a881 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:54.819560 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4557/9066] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 22:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 22:18:54.823608 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dd943-9bc3-418b-84c3-03c02fd96f6f admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:54.833747 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dd943-9bc3-418b-84c3-03c02fd96f6f admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:54.838365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8392d1-be05-4ed4-9f97-9e15edb86c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:54.838968 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8392d1-be05-4ed4-9f97-9e15edb86c68 admin admin] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:54.839314 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8392d1-be05-4ed4-9f97-9e15edb86c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:54.839596 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8392d1-be05-4ed4-9f97-9e15edb86c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:54.840284 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8392d1-be05-4ed4-9f97-9e15edb86c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:54.841874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8392d1-be05-4ed4-9f97-9e15edb86c68 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:54.852574 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4510/9067] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 22:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 22:18:54.856742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b6969-4a2f-43ea-baa3-e3d30dc0a881 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:54.867414 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b6969-4a2f-43ea-baa3-e3d30dc0a881 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:54.872126 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f75d31-9de2-4a91-a4c2-6c5665a13c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:54.872786 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f75d31-9de2-4a91-a4c2-6c5665a13c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:54.873078 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f75d31-9de2-4a91-a4c2-6c5665a13c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:54.873461 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f75d31-9de2-4a91-a4c2-6c5665a13c10 admin admin] PATH_INFO: `/v3/projects/993b687d3fbc463bbb1a465aaa1dab7e/users/12027d76069b44eb97904ce6443c5f95/roles/c3edb43d117b427a91e426e4e42f0c63` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:54.888843 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f75d31-9de2-4a91-a4c2-6c5665a13c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=993b687d3fbc463bbb1a465aaa1dab7e, user_id=12027d76069b44eb97904ce6443c5f95, role_id=c3edb43d117b427a91e426e4e42f0c63)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:54.891591 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f75d31-9de2-4a91-a4c2-6c5665a13c10 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:54.900836 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:18:54.906045 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4558/9068] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 22:18:54 2022] PUT /identity/v3/projects/993b687d3fbc463bbb1a465aaa1dab7e/users/12027d76069b44eb97904ce6443c5f95/roles/c3edb43d117b427a91e426e4e42f0c63 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 30 22:18:54.911745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95d5ad-cd0b-4f11-8bcf-db4f2645b2a2 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:54.912037 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95d5ad-cd0b-4f11-8bcf-db4f2645b2a2 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:54.912323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95d5ad-cd0b-4f11-8bcf-db4f2645b2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:54.931648 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-5a95d5ad-cd0b-4f11-8bcf-db4f2645b2a2 None None] MFA Rules not processed for user `57e206ec85774a5086d011cb1726114a`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:18:54.932862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5a95d5ad-cd0b-4f11-8bcf-db4f2645b2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:18:54.936799 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:18:54.995362 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4511/9069] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:18:55.005258 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f75d31-9de2-4a91-a4c2-6c5665a13c10 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:55.006986 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-10f75d31-9de2-4a91-a4c2-6c5665a13c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:18:55.063795 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f75d31-9de2-4a91-a4c2-6c5665a13c10 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:55.067498 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f148b5-5a1f-4850-8092-b8b37e336aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:55.068117 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f148b5-5a1f-4850-8092-b8b37e336aef service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:55.068405 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f148b5-5a1f-4850-8092-b8b37e336aef service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:55.068683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f148b5-5a1f-4850-8092-b8b37e336aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:55.077714 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f148b5-5a1f-4850-8092-b8b37e336aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:55.079071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f148b5-5a1f-4850-8092-b8b37e336aef service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:55.088656 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4559/9070] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:18:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:18:59.211825 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c3fcf-9575-4fa6-b67e-8de5f3f55607 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:59.212369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c3fcf-9575-4fa6-b67e-8de5f3f55607 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:59.212369 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c3fcf-9575-4fa6-b67e-8de5f3f55607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:59.248616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-153c3fcf-9575-4fa6-b67e-8de5f3f55607 None None] MFA Rules not processed for user `12027d76069b44eb97904ce6443c5f95`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:18:59.249862 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-153c3fcf-9575-4fa6-b67e-8de5f3f55607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:18:59.334624 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4512/9071] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:18:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:18:59.335811 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f148b5-5a1f-4850-8092-b8b37e336aef service neutron] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:59.346444 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f148b5-5a1f-4850-8092-b8b37e336aef service neutron] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:59.352404 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899e9e6-d797-45af-922a-9bb5af00bffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:59.353042 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899e9e6-d797-45af-922a-9bb5af00bffc admin admin] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:59.353332 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899e9e6-d797-45af-922a-9bb5af00bffc admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:59.353761 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899e9e6-d797-45af-922a-9bb5af00bffc admin admin] PATH_INFO: `/v3/projects` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:59.354457 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899e9e6-d797-45af-922a-9bb5af00bffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:59.356529 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899e9e6-d797-45af-922a-9bb5af00bffc admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:59.402195 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4560/9072] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Jul 30 22:18:59 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 30 22:18:59.403860 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c3fcf-9575-4fa6-b67e-8de5f3f55607 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:59.416023 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c3fcf-9575-4fa6-b67e-8de5f3f55607 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:59.487919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c465811-3a46-40f1-88fc-2b94e7e37f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:59.491175 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c465811-3a46-40f1-88fc-2b94e7e37f83 admin admin] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:59.491646 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c465811-3a46-40f1-88fc-2b94e7e37f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:59.491938 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c465811-3a46-40f1-88fc-2b94e7e37f83 admin admin] PATH_INFO: `/v3/users` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:59.492656 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c465811-3a46-40f1-88fc-2b94e7e37f83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:59.494619 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c465811-3a46-40f1-88fc-2b94e7e37f83 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:59.520451 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4513/9073] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 30 22:18:59 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 30 22:18:59.524341 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899e9e6-d797-45af-922a-9bb5af00bffc admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:59.541071 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899e9e6-d797-45af-922a-9bb5af00bffc admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:59.549744 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6a419-d78a-4f74-94ad-e5d620506b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:59.550433 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6a419-d78a-4f74-94ad-e5d620506b8b admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:59.550775 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6a419-d78a-4f74-94ad-e5d620506b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:59.551061 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6a419-d78a-4f74-94ad-e5d620506b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:59.552048 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6a419-d78a-4f74-94ad-e5d620506b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:59.553423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6a419-d78a-4f74-94ad-e5d620506b8b admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:59.565322 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4561/9074] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 22:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 22:18:59.569761 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c465811-3a46-40f1-88fc-2b94e7e37f83 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:59.581213 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c465811-3a46-40f1-88fc-2b94e7e37f83 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:59.586541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae933e7-a5e7-4a0e-9f87-cda93d66d46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:59.587161 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae933e7-a5e7-4a0e-9f87-cda93d66d46a admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:59.587498 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae933e7-a5e7-4a0e-9f87-cda93d66d46a admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:59.587753 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae933e7-a5e7-4a0e-9f87-cda93d66d46a admin admin] PATH_INFO: `/v3/projects/8415684e08f14b2cabf4fc0afd567b04/users/c8986acc17614ddb9b53db17ee6dc4ea/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:59.607188 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae933e7-a5e7-4a0e-9f87-cda93d66d46a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8415684e08f14b2cabf4fc0afd567b04, user_id=c8986acc17614ddb9b53db17ee6dc4ea, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:59.610323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae933e7-a5e7-4a0e-9f87-cda93d66d46a admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:59.628072 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4514/9075] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 22:18:59 2022] PUT /identity/v3/projects/8415684e08f14b2cabf4fc0afd567b04/users/c8986acc17614ddb9b53db17ee6dc4ea/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:18:59.632141 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6a419-d78a-4f74-94ad-e5d620506b8b admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:59.644403 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6a419-d78a-4f74-94ad-e5d620506b8b admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:59.726454 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058cf7c-90d3-4f6e-a666-2e8150f295d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:59.727129 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058cf7c-90d3-4f6e-a666-2e8150f295d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:59.727473 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058cf7c-90d3-4f6e-a666-2e8150f295d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:59.727754 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058cf7c-90d3-4f6e-a666-2e8150f295d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:59.728453 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058cf7c-90d3-4f6e-a666-2e8150f295d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:59.730050 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058cf7c-90d3-4f6e-a666-2e8150f295d2 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:59.744942 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4562/9076] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 22:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 30 22:18:59.745993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae933e7-a5e7-4a0e-9f87-cda93d66d46a admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:18:59.753044 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:18:59.757593 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae933e7-a5e7-4a0e-9f87-cda93d66d46a admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:18:59.763629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411097f4-03c1-4f2f-b616-320ef2ac27fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:18:59.764669 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411097f4-03c1-4f2f-b616-320ef2ac27fc admin admin] REQUEST_METHOD: `PUT` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:18:59.765371 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411097f4-03c1-4f2f-b616-320ef2ac27fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:18:59.765654 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411097f4-03c1-4f2f-b616-320ef2ac27fc admin admin] PATH_INFO: `/v3/projects/8415684e08f14b2cabf4fc0afd567b04/users/c8986acc17614ddb9b53db17ee6dc4ea/roles/3b89b89da98d4ec08a0587aa13832636` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:18:59.768216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411097f4-03c1-4f2f-b616-320ef2ac27fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8415684e08f14b2cabf4fc0afd567b04, user_id=c8986acc17614ddb9b53db17ee6dc4ea, role_id=3b89b89da98d4ec08a0587aa13832636)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:18:59.770856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411097f4-03c1-4f2f-b616-320ef2ac27fc admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:18:59.782136 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4515/9077] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Jul 30 22:18:59 2022] PUT /identity/v3/projects/8415684e08f14b2cabf4fc0afd567b04/users/c8986acc17614ddb9b53db17ee6dc4ea/roles/3b89b89da98d4ec08a0587aa13832636 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:19:04.238317 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e60c31-cc53-4188-81fd-484c889c8a28 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:19:04.238859 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e60c31-cc53-4188-81fd-484c889c8a28 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:19:04.239010 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e60c31-cc53-4188-81fd-484c889c8a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:19:04.315148 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-a7e60c31-cc53-4188-81fd-484c889c8a28 None None] MFA Rules not processed for user `c8986acc17614ddb9b53db17ee6dc4ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:19:04.317043 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-a7e60c31-cc53-4188-81fd-484c889c8a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:19:04.426601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:19:04.465582 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4563/9078] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:19:04.484736 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411097f4-03c1-4f2f-b616-320ef2ac27fc admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:19:04.487165 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-411097f4-03c1-4f2f-b616-320ef2ac27fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:19:04.659996 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411097f4-03c1-4f2f-b616-320ef2ac27fc admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:19:04.668784 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b8aab-0499-4def-8001-d7cc44618fcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:19:04.669601 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b8aab-0499-4def-8001-d7cc44618fcf service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:19:04.670058 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b8aab-0499-4def-8001-d7cc44618fcf service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:19:04.670445 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b8aab-0499-4def-8001-d7cc44618fcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:19:04.747321 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b8aab-0499-4def-8001-d7cc44618fcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:19:04.748970 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b8aab-0499-4def-8001-d7cc44618fcf service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:19:04.761369 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4516/9079] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:19:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:19:05.847413 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb92b4-608d-4d26-a50b-430377cf8fe3 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:19:05.847931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb92b4-608d-4d26-a50b-430377cf8fe3 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:19:05.848049 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb92b4-608d-4d26-a50b-430377cf8fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:19:05.867757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-e3eb92b4-608d-4d26-a50b-430377cf8fe3 None None] MFA Rules not processed for user `12027d76069b44eb97904ce6443c5f95`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:19:05.869778 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e3eb92b4-608d-4d26-a50b-430377cf8fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:19:05.877035 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4564/9080] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:19:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:19:06.200295 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b8aab-0499-4def-8001-d7cc44618fcf service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:19:06.201681 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-a53b8aab-0499-4def-8001-d7cc44618fcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:19:06.270516 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b8aab-0499-4def-8001-d7cc44618fcf service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:19:06.274216 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901224b1-d09e-444a-80f3-ff4ec9b3c084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:19:06.274836 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901224b1-d09e-444a-80f3-ff4ec9b3c084 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:19:06.275121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901224b1-d09e-444a-80f3-ff4ec9b3c084 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:19:06.275438 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901224b1-d09e-444a-80f3-ff4ec9b3c084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:19:06.277444 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-901224b1-d09e-444a-80f3-ff4ec9b3c084 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:19:06.286773 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901224b1-d09e-444a-80f3-ff4ec9b3c084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:19:06.288239 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901224b1-d09e-444a-80f3-ff4ec9b3c084 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:19:06.296052 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4517/9081] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:19:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:19:06.987794 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb92b4-608d-4d26-a50b-430377cf8fe3 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:19:06.990683 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-e3eb92b4-608d-4d26-a50b-430377cf8fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:19:07.084624 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb92b4-608d-4d26-a50b-430377cf8fe3 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:19:07.089626 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d398f6-b803-4fd3-a206-27918a50232f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:19:07.090203 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d398f6-b803-4fd3-a206-27918a50232f service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:19:07.090492 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d398f6-b803-4fd3-a206-27918a50232f service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:19:07.091421 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d398f6-b803-4fd3-a206-27918a50232f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:19:07.093257 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-f8d398f6-b803-4fd3-a206-27918a50232f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:19:07.105554 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d398f6-b803-4fd3-a206-27918a50232f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:19:07.107131 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d398f6-b803-4fd3-a206-27918a50232f service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:19:07.118024 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4565/9082] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:19:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:19:16.163323 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901224b1-d09e-444a-80f3-ff4ec9b3c084 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:19:16.165134 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-901224b1-d09e-444a-80f3-ff4ec9b3c084 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:19:16.184273 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901224b1-d09e-444a-80f3-ff4ec9b3c084 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:19:16.190640 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301bbd2-59d2-4723-bfc1-9e4f471929dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:19:16.191270 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301bbd2-59d2-4723-bfc1-9e4f471929dd service nova] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:19:16.191585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301bbd2-59d2-4723-bfc1-9e4f471929dd service nova] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:19:16.191869 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301bbd2-59d2-4723-bfc1-9e4f471929dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:19:16.193798 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-f301bbd2-59d2-4723-bfc1-9e4f471929dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:19:16.209678 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301bbd2-59d2-4723-bfc1-9e4f471929dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:19:16.211676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301bbd2-59d2-4723-bfc1-9e4f471929dd service nova] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:19:16.231516 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4518/9083] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:19:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:19:17.114171 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=39 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:19:17.920701 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d398f6-b803-4fd3-a206-27918a50232f service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:19:17.930508 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d398f6-b803-4fd3-a206-27918a50232f service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:19:17.934138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dcf64-a228-4b31-96a2-f67e0efbdff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:19:17.934748 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dcf64-a228-4b31-96a2-f67e0efbdff7 service neutron] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:19:17.935037 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dcf64-a228-4b31-96a2-f67e0efbdff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:19:17.935348 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dcf64-a228-4b31-96a2-f67e0efbdff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:19:17.944988 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dcf64-a228-4b31-96a2-f67e0efbdff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:19:17.946423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dcf64-a228-4b31-96a2-f67e0efbdff7 service neutron] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:19:17.956037 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4566/9084] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:19:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:19:26.220897 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=95,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:19:27.951745 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:20:19.787512 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301bbd2-59d2-4723-bfc1-9e4f471929dd service nova] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:20:19.796880 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301bbd2-59d2-4723-bfc1-9e4f471929dd service nova] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:20:19.801199 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559524b-3ac9-476c-a735-434c291af451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:20:19.801815 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559524b-3ac9-476c-a735-434c291af451 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:20:19.802103 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559524b-3ac9-476c-a735-434c291af451 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:20:19.802383 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559524b-3ac9-476c-a735-434c291af451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:20:19.804158 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1559524b-3ac9-476c-a735-434c291af451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:20:19.826101 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559524b-3ac9-476c-a735-434c291af451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:20:19.827563 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559524b-3ac9-476c-a735-434c291af451 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:20:19.835596 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4519/9085] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:20:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:20:29.831993 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=11 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:21:16.232961 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5dace-de0e-4126-affa-0f301aad4b67 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:21:16.233536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5dace-de0e-4126-affa-0f301aad4b67 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:21:16.233536 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5dace-de0e-4126-affa-0f301aad4b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:21:16.254351 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-9ce5dace-de0e-4126-affa-0f301aad4b67 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:21:16.255590 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-9ce5dace-de0e-4126-affa-0f301aad4b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:21:16.318068 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4567/9086] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 22:21:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:21:16.364281 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559524b-3ac9-476c-a735-434c291af451 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:21:16.365707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-1559524b-3ac9-476c-a735-434c291af451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:21:16.439585 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559524b-3ac9-476c-a735-434c291af451 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:21:16.444858 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedee86-4dad-403f-9d8a-71a2e85ef11c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:21:16.445515 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedee86-4dad-403f-9d8a-71a2e85ef11c service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:21:16.445802 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedee86-4dad-403f-9d8a-71a2e85ef11c service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:21:16.446086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedee86-4dad-403f-9d8a-71a2e85ef11c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:21:16.455062 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fedee86-4dad-403f-9d8a-71a2e85ef11c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:21:16.456746 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fedee86-4dad-403f-9d8a-71a2e85ef11c service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:21:16.465295 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4520/9087] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 22:21:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 22:21:25.883865 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03b884-7b82-4625-9521-c453dd39de50 None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:21:25.884428 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03b884-7b82-4625-9521-c453dd39de50 None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:21:25.884547 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03b884-7b82-4625-9521-c453dd39de50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:21:25.903472 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-4e03b884-7b82-4625-9521-c453dd39de50 None None] MFA Rules not processed for user `12027d76069b44eb97904ce6443c5f95`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:21:25.904951 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4e03b884-7b82-4625-9521-c453dd39de50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:21:25.912836 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4568/9088] 10.222.0.17 () {58 vars in 958 bytes} [Sat Jul 30 22:21:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:21:26.245874 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedee86-4dad-403f-9d8a-71a2e85ef11c service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:21:26.254974 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedee86-4dad-403f-9d8a-71a2e85ef11c service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:21:26.258518 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dd22d-f6b9-4062-a7a4-579393ab8269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:21:26.259121 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dd22d-f6b9-4062-a7a4-579393ab8269 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:21:26.259447 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dd22d-f6b9-4062-a7a4-579393ab8269 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:21:26.259729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dd22d-f6b9-4062-a7a4-579393ab8269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:21:26.261451 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-2e2dd22d-f6b9-4062-a7a4-579393ab8269 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:21:26.271260 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dd22d-f6b9-4062-a7a4-579393ab8269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:21:26.272707 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dd22d-f6b9-4062-a7a4-579393ab8269 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:21:26.280750 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4521/9089] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:21:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:21:26.618305 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03b884-7b82-4625-9521-c453dd39de50 None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:21:26.619838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-4e03b884-7b82-4625-9521-c453dd39de50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:21:26.638743 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03b884-7b82-4625-9521-c453dd39de50 None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:21:26.644941 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e46fc1-298c-4a19-8861-cddb6ff0fef8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:21:26.645601 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e46fc1-298c-4a19-8861-cddb6ff0fef8 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:21:26.646028 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e46fc1-298c-4a19-8861-cddb6ff0fef8 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:21:26.646313 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e46fc1-298c-4a19-8861-cddb6ff0fef8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:21:26.648120 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-35e46fc1-298c-4a19-8861-cddb6ff0fef8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:21:26.660945 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e46fc1-298c-4a19-8861-cddb6ff0fef8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:21:26.662556 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e46fc1-298c-4a19-8861-cddb6ff0fef8 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:21:26.672941 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4569/9090] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:21:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:21:27.799604 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890833a2-283f-45b3-af27-987d5b279bcf None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:21:27.800463 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890833a2-283f-45b3-af27-987d5b279bcf None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:21:27.800762 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890833a2-283f-45b3-af27-987d5b279bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:21:27.820335 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-890833a2-283f-45b3-af27-987d5b279bcf None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:21:27.821538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-890833a2-283f-45b3-af27-987d5b279bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:21:27.829225 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4522/9091] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 22:21:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:21:27.841516 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e46fc1-298c-4a19-8861-cddb6ff0fef8 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:21:27.853304 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e46fc1-298c-4a19-8861-cddb6ff0fef8 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:21:27.858310 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716b09b-b3e2-41cf-ae42-aa53aa8f8f5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:21:27.858931 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716b09b-b3e2-41cf-ae42-aa53aa8f8f5f service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:21:27.859247 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716b09b-b3e2-41cf-ae42-aa53aa8f8f5f service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:21:27.859558 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716b09b-b3e2-41cf-ae42-aa53aa8f8f5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:21:27.868381 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716b09b-b3e2-41cf-ae42-aa53aa8f8f5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:21:27.870112 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716b09b-b3e2-41cf-ae42-aa53aa8f8f5f service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:21:27.879699 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4570/9092] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 22:21:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 22:21:35.387042 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890833a2-283f-45b3-af27-987d5b279bcf None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:21:35.398851 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890833a2-283f-45b3-af27-987d5b279bcf None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:21:35.402491 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260eac3-df61-4a8c-ac9c-e024b46e4eaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:21:35.403106 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260eac3-df61-4a8c-ac9c-e024b46e4eaf service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:21:35.403434 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260eac3-df61-4a8c-ac9c-e024b46e4eaf service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:21:35.403713 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260eac3-df61-4a8c-ac9c-e024b46e4eaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:21:35.405745 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-5260eac3-df61-4a8c-ac9c-e024b46e4eaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:21:35.415616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260eac3-df61-4a8c-ac9c-e024b46e4eaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:21:35.417072 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260eac3-df61-4a8c-ac9c-e024b46e4eaf service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:21:35.425614 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4523/9093] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:21:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:21:37.876386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=43 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:21:45.421485 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=47 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:21:46.591762 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716b09b-b3e2-41cf-ae42-aa53aa8f8f5f service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:21:46.604365 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716b09b-b3e2-41cf-ae42-aa53aa8f8f5f service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:21:46.610007 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6ec60-717c-4c81-8e6a-2fc664d987fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08a2a5793b7a4797a470719a682e541a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:21:46.610742 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ec60-717c-4c81-8e6a-2fc664d987fe service nova] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:21:46.611039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ec60-717c-4c81-8e6a-2fc664d987fe service nova] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:21:46.611352 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ec60-717c-4c81-8e6a-2fc664d987fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:21:46.613132 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-ebe6ec60-717c-4c81-8e6a-2fc664d987fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:21:46.626251 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6ec60-717c-4c81-8e6a-2fc664d987fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:21:46.627880 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6ec60-717c-4c81-8e6a-2fc664d987fe service nova] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:21:46.638814 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4571/9094] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:21:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:21:56.634312 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:22:04.029919 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260eac3-df61-4a8c-ac9c-e024b46e4eaf service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:22:04.043405 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260eac3-df61-4a8c-ac9c-e024b46e4eaf service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:22:04.048943 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a09db8-5e56-408b-b43b-e38123b3a35c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:22:04.050381 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a09db8-5e56-408b-b43b-e38123b3a35c service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:22:04.050676 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a09db8-5e56-408b-b43b-e38123b3a35c service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:22:04.050952 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a09db8-5e56-408b-b43b-e38123b3a35c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:22:04.053011 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-69a09db8-5e56-408b-b43b-e38123b3a35c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:22:04.078245 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a09db8-5e56-408b-b43b-e38123b3a35c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:22:04.080127 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a09db8-5e56-408b-b43b-e38123b3a35c service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:22:04.090630 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4524/9095] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:22:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:22:11.096024 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6ec60-717c-4c81-8e6a-2fc664d987fe service nova] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:22:11.107307 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6ec60-717c-4c81-8e6a-2fc664d987fe service nova] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:22:11.112878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058fd18-9403-4b0d-8fda-442df371e291 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:22:11.113479 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058fd18-9403-4b0d-8fda-442df371e291 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:22:11.113765 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058fd18-9403-4b0d-8fda-442df371e291 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:22:11.114039 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058fd18-9403-4b0d-8fda-442df371e291 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:22:11.115819 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-d058fd18-9403-4b0d-8fda-442df371e291 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:22:11.127051 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058fd18-9403-4b0d-8fda-442df371e291 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:22:11.129275 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058fd18-9403-4b0d-8fda-442df371e291 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:22:11.138854 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4572/9096] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:22:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:22:14.085989 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=11 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:22:21.134867 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=6 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:23:14.127629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d9ff2-d3c5-4cce-8c74-1d6c99138d06 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:23:14.128146 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d9ff2-d3c5-4cce-8c74-1d6c99138d06 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:23:14.128417 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d9ff2-d3c5-4cce-8c74-1d6c99138d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:23:14.198924 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-d35d9ff2-d3c5-4cce-8c74-1d6c99138d06 None None] MFA Rules not processed for user `60d1fa32e98f45128f990a107db45eae`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:23:14.200079 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d35d9ff2-d3c5-4cce-8c74-1d6c99138d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:23:14.261182 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4525/9097] 10.222.0.17 () {58 vars in 1063 bytes} [Sat Jul 30 22:23:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:23:14.267094 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058fd18-9403-4b0d-8fda-442df371e291 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:23:14.276145 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058fd18-9403-4b0d-8fda-442df371e291 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:23:14.279737 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e638218-4587-4bdb-a756-1defb3ab186e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1fa32e98f45128f990a107db45eae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:23:14.280595 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e638218-4587-4bdb-a756-1defb3ab186e service glance] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:23:14.280878 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e638218-4587-4bdb-a756-1defb3ab186e service glance] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:23:14.281156 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e638218-4587-4bdb-a756-1defb3ab186e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:23:14.282893 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-7e638218-4587-4bdb-a756-1defb3ab186e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:23:14.310625 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e638218-4587-4bdb-a756-1defb3ab186e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:23:14.312101 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e638218-4587-4bdb-a756-1defb3ab186e service glance] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:23:14.322858 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4573/9098] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:23:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:23:17.541233 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dca0cf-cc33-4b66-8164-390601df1e20 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:23:17.541733 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dca0cf-cc33-4b66-8164-390601df1e20 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:23:17.541870 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dca0cf-cc33-4b66-8164-390601df1e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:23:17.594539 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-e1dca0cf-cc33-4b66-8164-390601df1e20 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:23:17.595856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-e1dca0cf-cc33-4b66-8164-390601df1e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:23:17.613510 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4526/9099] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 30 22:23:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:23:17.653807 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e638218-4587-4bdb-a756-1defb3ab186e service glance] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:23:17.675189 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e638218-4587-4bdb-a756-1defb3ab186e service glance] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:23:17.680395 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52575bbb-d81d-4cdb-a7f2-a8fb0d512a1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:23:17.681006 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52575bbb-d81d-4cdb-a7f2-a8fb0d512a1d service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:23:17.681293 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52575bbb-d81d-4cdb-a7f2-a8fb0d512a1d service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:23:17.681571 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52575bbb-d81d-4cdb-a7f2-a8fb0d512a1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:23:17.689669 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52575bbb-d81d-4cdb-a7f2-a8fb0d512a1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:23:17.691942 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52575bbb-d81d-4cdb-a7f2-a8fb0d512a1d service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:23:17.700131 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4574/9100] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 22:23:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 22:23:26.972291 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ea885-8345-405c-8815-f2e5c75e8a11 None None] REQUEST_METHOD: `POST` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:23:26.972841 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ea885-8345-405c-8815-f2e5c75e8a11 None None] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:23:26.972949 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ea885-8345-405c-8815-f2e5c75e8a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:23:26.992598 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.auth.core [None req-734ea885-8345-405c-8815-f2e5c75e8a11 None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:23:26.993808 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-734ea885-8345-405c-8815-f2e5c75e8a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:23:27.001096 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4527/9101] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 22:23:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:23:27.013752 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52575bbb-d81d-4cdb-a7f2-a8fb0d512a1d service swift] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:23:27.024965 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52575bbb-d81d-4cdb-a7f2-a8fb0d512a1d service swift] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:23:27.030013 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ff482-b3a6-4fe9-8cf9-15909c0d3ff2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:23:27.030874 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ff482-b3a6-4fe9-8cf9-15909c0d3ff2 service swift] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:23:27.031163 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ff482-b3a6-4fe9-8cf9-15909c0d3ff2 service swift] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:23:27.031485 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ff482-b3a6-4fe9-8cf9-15909c0d3ff2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:23:27.039849 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ff482-b3a6-4fe9-8cf9-15909c0d3ff2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:23:27.041435 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ff482-b3a6-4fe9-8cf9-15909c0d3ff2 service swift] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:23:27.049588 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4575/9102] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 22:23:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 22:23:28.384684 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ea885-8345-405c-8815-f2e5c75e8a11 None None] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:23:28.395629 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ea885-8345-405c-8815-f2e5c75e8a11 None None] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:23:28.399484 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff7230-aa6a-4bf5-aca8-e600585b5194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a886ccf9590432caf209526410a7b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:23:28.400136 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff7230-aa6a-4bf5-aca8-e600585b5194 service neutron] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:23:28.400418 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff7230-aa6a-4bf5-aca8-e600585b5194 service neutron] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:23:28.400691 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff7230-aa6a-4bf5-aca8-e600585b5194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:23:28.402480 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-d2ff7230-aa6a-4bf5-aca8-e600585b5194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:23:28.417002 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff7230-aa6a-4bf5-aca8-e600585b5194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:23:28.418538 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff7230-aa6a-4bf5-aca8-e600585b5194 service neutron] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:23:28.429797 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4528/9103] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:23:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 30 22:23:31.942125 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df4138-ffd2-42f7-b1e4-fb7ca38985fa None None] REQUEST_METHOD: `POST` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:23:31.942587 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df4138-ffd2-42f7-b1e4-fb7ca38985fa None None] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:23:31.942694 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df4138-ffd2-42f7-b1e4-fb7ca38985fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:23:31.961423 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.auth.core [None req-43df4138-ffd2-42f7-b1e4-fb7ca38985fa None None] MFA Rules not processed for user `877b427e6ff84af29a59dc9e1a3128ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 30 22:23:31.962619 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-43df4138-ffd2-42f7-b1e4-fb7ca38985fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:23:31.969764 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4576/9104] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 30 22:23:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 30 22:23:31.982792 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff7230-aa6a-4bf5-aca8-e600585b5194 service neutron] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:23:31.995096 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff7230-aa6a-4bf5-aca8-e600585b5194 service neutron] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:23:32.000264 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaba936-cd6c-41c3-8276-e4018e029324 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181960e3bed4031889d6e72a721e151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:23:32.000914 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaba936-cd6c-41c3-8276-e4018e029324 service swift] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:23:32.001197 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaba936-cd6c-41c3-8276-e4018e029324 service swift] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:23:32.001470 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaba936-cd6c-41c3-8276-e4018e029324 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:23:32.012501 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaba936-cd6c-41c3-8276-e4018e029324 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:23:32.014091 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaba936-cd6c-41c3-8276-e4018e029324 service swift] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:23:32.022505 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4529/9105] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 30 22:23:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 30 22:23:41.936882 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df4138-ffd2-42f7-b1e4-fb7ca38985fa None None] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:23:41.947034 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=31 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:23:42.019663 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=79 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:23:42.026539 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df4138-ffd2-42f7-b1e4-fb7ca38985fa None None] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:23:42.031592 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b8e6c-1319-4028-9ad2-36c63ece1a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:23:42.032411 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b8e6c-1319-4028-9ad2-36c63ece1a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:23:42.032700 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b8e6c-1319-4028-9ad2-36c63ece1a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:23:42.032980 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b8e6c-1319-4028-9ad2-36c63ece1a6a admin admin] PATH_INFO: `/v3/users/12027d76069b44eb97904ce6443c5f95` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:23:42.034193 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b8e6c-1319-4028-9ad2-36c63ece1a6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=12027d76069b44eb97904ce6443c5f95)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:23:42.036331 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b8e6c-1319-4028-9ad2-36c63ece1a6a admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:23:42.083751 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-263b8e6c-1319-4028-9ad2-36c63ece1a6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12027d76069b44eb97904ce6443c5f95'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:23:42.095545 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-263b8e6c-1319-4028-9ad2-36c63ece1a6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12027d76069b44eb97904ce6443c5f95'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:23:42.096240 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-263b8e6c-1319-4028-9ad2-36c63ece1a6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12027d76069b44eb97904ce6443c5f95'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:23:42.113452 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-263b8e6c-1319-4028-9ad2-36c63ece1a6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12027d76069b44eb97904ce6443c5f95'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:23:42.114272 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-263b8e6c-1319-4028-9ad2-36c63ece1a6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12027d76069b44eb97904ce6443c5f95'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:23:42.131677 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4577/9106] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 22:23:41 2022] DELETE /identity/v3/users/12027d76069b44eb97904ce6443c5f95 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:23:42.312735 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaba936-cd6c-41c3-8276-e4018e029324 service swift] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:23:42.325551 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaba936-cd6c-41c3-8276-e4018e029324 service swift] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:23:42.383262 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61d346-73ff-417f-a7bd-87aba2182bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:23:42.383947 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61d346-73ff-417f-a7bd-87aba2182bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:23:42.384259 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61d346-73ff-417f-a7bd-87aba2182bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:23:42.384541 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61d346-73ff-417f-a7bd-87aba2182bb8 admin admin] PATH_INFO: `/v3/projects/993b687d3fbc463bbb1a465aaa1dab7e` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:23:42.385697 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61d346-73ff-417f-a7bd-87aba2182bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=993b687d3fbc463bbb1a465aaa1dab7e)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:23:42.387638 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61d346-73ff-417f-a7bd-87aba2182bb8 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:23:42.440179 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4d61d346-73ff-417f-a7bd-87aba2182bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '993b687d3fbc463bbb1a465aaa1dab7e', 'request_id': 'req-4d61d346-73ff-417f-a7bd-87aba2182bb8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:23:42.447718 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4d61d346-73ff-417f-a7bd-87aba2182bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '993b687d3fbc463bbb1a465aaa1dab7e', 'request_id': 'req-4d61d346-73ff-417f-a7bd-87aba2182bb8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:23:42.453267 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4d61d346-73ff-417f-a7bd-87aba2182bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '993b687d3fbc463bbb1a465aaa1dab7e', 'request_id': 'req-4d61d346-73ff-417f-a7bd-87aba2182bb8'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:23:42.464319 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4d61d346-73ff-417f-a7bd-87aba2182bb8 admin admin] The token cache is being invalidate because project 993b687d3fbc463bbb1a465aaa1dab7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 22:23:42.464612 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4d61d346-73ff-417f-a7bd-87aba2182bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:23:42.465274 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-4d61d346-73ff-417f-a7bd-87aba2182bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:23:42.466796 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4530/9107] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 22:23:42 2022] DELETE /identity/v3/projects/993b687d3fbc463bbb1a465aaa1dab7e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:23:42.470913 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b8e6c-1319-4028-9ad2-36c63ece1a6a admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:23:42.472490 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-263b8e6c-1319-4028-9ad2-36c63ece1a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:23:42.485598 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b8e6c-1319-4028-9ad2-36c63ece1a6a admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:23:42.542254 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4f211-306e-4227-9d9a-26f8db103753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:23:42.542907 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4f211-306e-4227-9d9a-26f8db103753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:23:42.543198 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4f211-306e-4227-9d9a-26f8db103753 admin admin] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:23:42.543527 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4f211-306e-4227-9d9a-26f8db103753 admin admin] PATH_INFO: `/v3/users/c8986acc17614ddb9b53db17ee6dc4ea` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:23:42.544707 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4f211-306e-4227-9d9a-26f8db103753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8986acc17614ddb9b53db17ee6dc4ea)` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:23:42.546664 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4f211-306e-4227-9d9a-26f8db103753 admin admin] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:23:42.570167 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:23:42.595361 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-38e4f211-306e-4227-9d9a-26f8db103753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8986acc17614ddb9b53db17ee6dc4ea'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:23:42.607138 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-38e4f211-306e-4227-9d9a-26f8db103753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8986acc17614ddb9b53db17ee6dc4ea'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:23:42.607856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-38e4f211-306e-4227-9d9a-26f8db103753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8986acc17614ddb9b53db17ee6dc4ea'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:23:42.615184 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-38e4f211-306e-4227-9d9a-26f8db103753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8986acc17614ddb9b53db17ee6dc4ea'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:23:42.615838 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.notifications [None req-38e4f211-306e-4227-9d9a-26f8db103753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8986acc17614ddb9b53db17ee6dc4ea'} {{(pid=91085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:23:42.628785 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4578/9108] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 22:23:42 2022] DELETE /identity/v3/users/c8986acc17614ddb9b53db17ee6dc4ea => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:23:42.807271 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61d346-73ff-417f-a7bd-87aba2182bb8 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:23:42.808818 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-4d61d346-73ff-417f-a7bd-87aba2182bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:23:42.822008 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61d346-73ff-417f-a7bd-87aba2182bb8 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:23:42.880632 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571cb2a-ba07-4838-94f1-b29e43d1e668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e206ec85774a5086d011cb1726114a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375d034049af46779b4f307bede15a89', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:23:42.881287 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571cb2a-ba07-4838-94f1-b29e43d1e668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:23:42.881576 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571cb2a-ba07-4838-94f1-b29e43d1e668 admin admin] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:23:42.881856 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571cb2a-ba07-4838-94f1-b29e43d1e668 admin admin] PATH_INFO: `/v3/projects/8415684e08f14b2cabf4fc0afd567b04` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:23:42.883024 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571cb2a-ba07-4838-94f1-b29e43d1e668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8415684e08f14b2cabf4fc0afd567b04)` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:23:42.884978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571cb2a-ba07-4838-94f1-b29e43d1e668 admin admin] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:23:42.919594 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:23:42.933852 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7571cb2a-ba07-4838-94f1-b29e43d1e668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8415684e08f14b2cabf4fc0afd567b04', 'request_id': 'req-7571cb2a-ba07-4838-94f1-b29e43d1e668'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:23:42.941078 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7571cb2a-ba07-4838-94f1-b29e43d1e668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8415684e08f14b2cabf4fc0afd567b04', 'request_id': 'req-7571cb2a-ba07-4838-94f1-b29e43d1e668'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:23:42.946729 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7571cb2a-ba07-4838-94f1-b29e43d1e668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8415684e08f14b2cabf4fc0afd567b04', 'request_id': 'req-7571cb2a-ba07-4838-94f1-b29e43d1e668'} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:23:42.957461 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7571cb2a-ba07-4838-94f1-b29e43d1e668 admin admin] The token cache is being invalidate because project 8415684e08f14b2cabf4fc0afd567b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 30 22:23:42.957754 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7571cb2a-ba07-4838-94f1-b29e43d1e668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:23:42.958387 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.notifications [None req-7571cb2a-ba07-4838-94f1-b29e43d1e668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 30 22:23:42.959917 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4531/9109] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 22:23:42 2022] DELETE /identity/v3/projects/8415684e08f14b2cabf4fc0afd567b04 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 30 22:23:52.624757 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=20,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:23:52.954616 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:27:08.017926 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4f211-306e-4227-9d9a-26f8db103753 admin admin] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:27:08.020022 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-38e4f211-306e-4227-9d9a-26f8db103753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:27:08.149862 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4f211-306e-4227-9d9a-26f8db103753 admin admin] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:27:08.208903 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c55197-44df-4dde-9f81-73afaf0bb301 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:27:08.209533 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c55197-44df-4dde-9f81-73afaf0bb301 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:27:08.209823 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c55197-44df-4dde-9f81-73afaf0bb301 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:27:08.210106 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c55197-44df-4dde-9f81-73afaf0bb301 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:27:08.211898 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-98c55197-44df-4dde-9f81-73afaf0bb301 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:27:08.222856 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c55197-44df-4dde-9f81-73afaf0bb301 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:27:08.224464 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c55197-44df-4dde-9f81-73afaf0bb301 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:27:08.234273 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4579/9110] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:27:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:27:17.108933 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571cb2a-ba07-4838-94f1-b29e43d1e668 admin admin] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:27:17.110365 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-7571cb2a-ba07-4838-94f1-b29e43d1e668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:27:17.159486 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571cb2a-ba07-4838-94f1-b29e43d1e668 admin admin] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:27:17.164781 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481dc7f-473d-418a-b783-d82a5274d711 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:27:17.165407 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481dc7f-473d-418a-b783-d82a5274d711 service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:27:17.165700 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481dc7f-473d-418a-b783-d82a5274d711 service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:27:17.165978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481dc7f-473d-418a-b783-d82a5274d711 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:27:17.167790 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.fernet_utils [None req-9481dc7f-473d-418a-b783-d82a5274d711 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:27:17.183224 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481dc7f-473d-418a-b783-d82a5274d711 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:27:17.184831 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481dc7f-473d-418a-b783-d82a5274d711 service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:27:17.195260 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4532/9111] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:27:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:27:18.230208 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=84 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:27:27.191086 ncdv-master-1 devstack@keystone.service[91086]: DEBUG dbcounter [-] [91086] Writing DB stats keystone:SELECT=17 {{(pid=91086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:32:12.020632 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c55197-44df-4dde-9f81-73afaf0bb301 service placement] Authenticating user token {{(pid=91085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:32:12.022109 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.fernet_utils [None req-98c55197-44df-4dde-9f81-73afaf0bb301 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 30 22:32:12.047386 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c55197-44df-4dde-9f81-73afaf0bb301 service placement] Validating token access rules against request {{(pid=91085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:32:12.052456 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84236b73-14a2-411c-9802-a368155e8ad9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:32:12.053070 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84236b73-14a2-411c-9802-a368155e8ad9 service placement] REQUEST_METHOD: `GET` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:32:12.053847 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84236b73-14a2-411c-9802-a368155e8ad9 service placement] SCRIPT_NAME: `/identity` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:32:12.054127 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84236b73-14a2-411c-9802-a368155e8ad9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:32:12.062749 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84236b73-14a2-411c-9802-a368155e8ad9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:32:12.064482 ncdv-master-1 devstack@keystone.service[91085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84236b73-14a2-411c-9802-a368155e8ad9 service placement] RBAC: Authorization granted {{(pid=91085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:32:12.075102 ncdv-master-1 devstack@keystone.service[91085]: [pid: 91085|app: 0|req: 4580/9112] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:32:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 30 22:32:22.070728 ncdv-master-1 devstack@keystone.service[91085]: DEBUG dbcounter [-] [91085] Writing DB stats keystone:SELECT=11 {{(pid=91085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:32:23.074642 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481dc7f-473d-418a-b783-d82a5274d711 service placement] Authenticating user token {{(pid=91086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 30 22:32:23.085633 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481dc7f-473d-418a-b783-d82a5274d711 service placement] Validating token access rules against request {{(pid=91086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 30 22:32:23.091214 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696e3cd-023e-4cae-9a7d-101d7524ccde service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1bd6b5950c4f9890a133dfd5bea4d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 30 22:32:23.091864 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696e3cd-023e-4cae-9a7d-101d7524ccde service placement] REQUEST_METHOD: `GET` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 30 22:32:23.092152 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696e3cd-023e-4cae-9a7d-101d7524ccde service placement] SCRIPT_NAME: `/identity` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 30 22:32:23.092435 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696e3cd-023e-4cae-9a7d-101d7524ccde service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 30 22:32:23.100978 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696e3cd-023e-4cae-9a7d-101d7524ccde service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 30 22:32:23.102590 ncdv-master-1 devstack@keystone.service[91086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696e3cd-023e-4cae-9a7d-101d7524ccde service placement] RBAC: Authorization granted {{(pid=91086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 30 22:32:23.113641 ncdv-master-1 devstack@keystone.service[91086]: [pid: 91086|app: 0|req: 4533/9113] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 30 22:32:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)